INCLG: Inpainting for Non-Cleft Lip Generation with a Multi-Task Image Processing Network

Shuang Chen, Amir Atapour-Abarghouei, Edmond S. L. Ho and Hubert P. H. Shum
Software Impacts (SIMPAC), 2023

 Impact Factor: 1.3

INCLG: Inpainting for Non-Cleft Lip Generation with a Multi-Task Image Processing Network

Abstract

We present a software that predicts non-cleft facial images for patients with cleft lip, thereby facilitating the understanding, awareness and discussion of cleft lip surgeries. To protect patients’ privacy, we design a software framework using image inpainting, which does not require cleft lip images for training, thereby mitigating the risk of model leakage. We implement a novel multi-task architecture that predicts both the non-cleft facial image and facial landmarks, resulting in better performance as evaluated by surgeons. The software is implemented with PyTorch and is usable with consumer-level color images with a fast prediction speed, enabling effective deployment.


Downloads


YouTube


Cite This Research

Plain Text

Shuang Chen, Amir Atapour-Abarghouei, Edmond S. L. Ho and Hubert P. H. Shum, "INCLG: Inpainting for Non-Cleft Lip Generation with a Multi-Task Image Processing Network," Software Impacts, vol. 17, pp. 100517, Elsevier, 2023.

BibTeX

@article{chen23inclg,
 author={Chen, Shuang and Atapour-Abarghouei, Amir and Ho, Edmond S. L. and Shum, Hubert P. H.},
 journal={Software Impacts},
 series={SIMPAC '24},
 title={INCLG: Inpainting for Non-Cleft Lip Generation with a Multi-Task Image Processing Network},
 year={2023},
 volume={17},
 pages={100517},
 numpages={4},
 doi={10.1016/j.simpa.2023.100517},
 publisher={Elsevier},
}

RIS

TY  - JOUR
AU  - Chen, Shuang
AU  - Atapour-Abarghouei, Amir
AU  - Ho, Edmond S. L.
AU  - Shum, Hubert P. H.
T2  - Software Impacts
TI  - INCLG: Inpainting for Non-Cleft Lip Generation with a Multi-Task Image Processing Network
PY  - 2023
VL  - 17
SP  - 100517
EP  - 100517
DO  - 10.1016/j.simpa.2023.100517
PB  - Elsevier
ER  - 


Supporting Grants


Similar Research

Shuang Chen, Amir Atapour-Abarghouei, Jane Kerby, Edmond S. L. Ho, David C. G. Sainsbury, Sophie Butterworth and Hubert P. H. Shum, "A Feasibility Study on Image Inpainting for Non-Cleft Lip Generation from Patients with Cleft Lip", Proceedings of the 2022 IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI), 2022
Abril Corona-Figueroa, Jonathan Frawley, Sam Bond-Taylor, Sarath Bethapudi, Hubert P. H. Shum and Chris G. Willcocks, "MedNeRF: Medical Neural Radiance Fields for Reconstructing 3D-Aware CT-projections from a Single X-ray", Proceedings of the 2022 International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 2022
Francis Xiatian Zhang, Shuang Chen, Xianghua Xie and Hubert P. H. Shum, "Depth-Aware Endoscopic Video Inpainting", Proceedings of the 2024 International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI), 2024

 

RSS Feed