INCLG: Inpainting for Non-Cleft Lip Generation with a Multi-Task Image Processing Network

Shuang Chen, Amir Atapour-Abarghouei, Edmond S. L. Ho and Hubert P. H. Shum
Software Impacts (SIMPAC), 2023

 Impact Factor: 2.1

INCLG: Inpainting for Non-Cleft Lip Generation with a Multi-Task Image Processing Network

Abstract

We present a software that predicts non-cleft facial images for patients with cleft lip, thereby facilitating the understanding, awareness and discussion of cleft lip surgeries. To protect patients’ privacy, we design a software framework using image inpainting, which does not require cleft lip images for training, thereby mitigating the risk of model leakage. We implement a novel multi-task architecture that predicts both the non-cleft facial image and facial landmarks, resulting in better performance as evaluated by surgeons. The software is implemented with PyTorch and is usable with consumer-level color images with a fast prediction speed, enabling effective deployment.

Downloads

YouTube

Citations

BibTeX

@article{chen23inclg,
 author={Chen, Shuang and Atapour-Abarghouei, Amir and Ho, Edmond S. L. and Shum, Hubert P. H.},
 journal={Software Impacts},
 title={INCLG: Inpainting for Non-Cleft Lip Generation with a Multi-Task Image Processing Network},
 year={2023},
 volume={17},
 pages={100517},
 numpages={4},
 doi={10.1016/j.simpa.2023.100517},
 publisher={Elsevier},
}

RIS

TY  - JOUR
AU  - Chen, Shuang
AU  - Atapour-Abarghouei, Amir
AU  - Ho, Edmond S. L.
AU  - Shum, Hubert P. H.
T2  - Software Impacts
TI  - INCLG: Inpainting for Non-Cleft Lip Generation with a Multi-Task Image Processing Network
PY  - 2023
VL  - 17
SP  - 100517
EP  - 100517
DO  - 10.1016/j.simpa.2023.100517
PB  - Elsevier
ER  - 

Plain Text

Shuang Chen, Amir Atapour-Abarghouei, Edmond S. L. Ho and Hubert P. H. Shum, "INCLG: Inpainting for Non-Cleft Lip Generation with a Multi-Task Image Processing Network," Software Impacts, vol. 17, pp. 100517, Elsevier, 2023.

Supporting Grants

Similar Research

Shuang Chen, Amir Atapour-Abarghouei, Jane Kerby, Edmond S. L. Ho, David C. G. Sainsbury, Sophie Butterworth and Hubert P. H. Shum, "A Feasibility Study on Image Inpainting for Non-Cleft Lip Generation from Patients with Cleft Lip", Proceedings of the 2022 IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI), 2022
Daniel Organisciak, Edmond S. L. Ho and Hubert P. H. Shum, "Makeup Style Transfer on Low-Quality Images with Weighted Multi-Scale Attention", Proceedings of the 2020 International Conference on Pattern Recognition (ICPR), 2020
Mridula Vijendran, Frederick W. B. Li and Hubert P. H. Shum, "Tackling Data Bias in Painting Classification with Style Transfer", Proceedings of the 2023 International Conference on Computer Vision Theory and Applications (VISAPP), 2023

 

 

Last updated on 14 April 2024
RSS Feed