MedNeRF: Medical Neural Radiance Fields for Reconstructing 3D-Aware CT-projections from a Single X-ray

Abril Corona-Figueroa, Jonathan Frawley, Sam Bond-Taylor, Sarath Bethapudi, Hubert P. H. Shum and Chris G. Willcocks
Proceedings of the 2022 International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 2022

 Citation: 36#

MedNeRF: Medical Neural Radiance Fields for Reconstructing 3D-Aware CT-projections from a Single X-ray
# According to Google Scholar 2023"

Abstract

Computed tomography (CT) is an effective medical imaging modality, widely used in the field of clinical medicine for the diagnosis of various pathologies. Advances in Multidetector CT imaging technology have enabled additional functionalities, including generation of thin slice multiplanar cross-sectional body imaging and 3D reconstructions. However, this involves patients being exposed to a considerable dose of ionising radiation. Excessive ionising radiation can lead to deterministic and harmful effects on the body. This paper proposes a Deep Learning model that learns to reconstruct CT projections from a few or even a single-view X-ray. This is based on a novel architecture that builds from neural radiance fields, which learns a continuous representation of CT scans by disentangling the shape and volumetric depth of surface and internal anatomical structures from 2D images. Our model is trained on chest and knee datasets, and we demonstrate qualitative and quantitative high-fidelity renderings and compare our approach to other recent radiance field-based methods. Our code and link to our datasets is available at \url{https://github.com/jonathanfrawley/mednerf}

Downloads

YouTube

Citations

BibTeX

@inproceedings{coronafigueroaa22mednerf,
 author={Corona-Figueroa, Abril and Frawley, Jonathan and Bond-Taylor, Sam and Bethapudi, Sarath and Shum, Hubert P. H. and Willcocks, Chris G.},
 booktitle={Proceedings of the 2022 International Conference of the IEEE Engineering in Medicine and Biology Society},
 series={EMBC '22},
 title={MedNeRF: Medical Neural Radiance Fields for Reconstructing 3D-Aware CT-projections from a Single X-ray},
 year={2022},
 month={7},
 pages={3843--3848},
 numpages={6},
 doi={10.1109/EMBC48229.2022.9871757},
 publisher={IEEE},
 location={Glasgow, UK},
}

RIS

TY  - CONF
AU  - Corona-Figueroa, Abril
AU  - Frawley, Jonathan
AU  - Bond-Taylor, Sam
AU  - Bethapudi, Sarath
AU  - Shum, Hubert P. H.
AU  - Willcocks, Chris G.
T2  - Proceedings of the 2022 International Conference of the IEEE Engineering in Medicine and Biology Society
TI  - MedNeRF: Medical Neural Radiance Fields for Reconstructing 3D-Aware CT-projections from a Single X-ray
PY  - 2022
Y1  - 7 2022
SP  - 3843
EP  - 3848
DO  - 10.1109/EMBC48229.2022.9871757
PB  - IEEE
ER  - 

Plain Text

Abril Corona-Figueroa, Jonathan Frawley, Sam Bond-Taylor, Sarath Bethapudi, Hubert P. H. Shum and Chris G. Willcocks, "MedNeRF: Medical Neural Radiance Fields for Reconstructing 3D-Aware CT-projections from a Single X-ray," in EMBC '22: Proceedings of the 2022 International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 3843-3848, Glasgow, UK, IEEE, Jul 2022.

Supporting Grants

Similar Research

Abril Corona-Figueroa, Sam Bond-Taylor, Neelanjan Bhowmik, Yona Falinie A. Gaus, Toby P. Breckon, Hubert P. H. Shum and Chris G. Willcocks, "Unaligned 2D to 3D Translation with Conditional Vector-Quantized Code Diffusion using Transformers", Proceedings of the 2023 IEEE/CVF International Conference on Computer Vision (ICCV), 2023
Shuang Chen, Amir Atapour-Abarghouei, Edmond S. L. Ho and Hubert P. H. Shum, "INCLG: Inpainting for Non-Cleft Lip Generation with a Multi-Task Image Processing Network", Software Impacts (SIMPAC), 2023
Shuang Chen, Amir Atapour-Abarghouei, Jane Kerby, Edmond S. L. Ho, David C. G. Sainsbury, Sophie Butterworth and Hubert P. H. Shum, "A Feasibility Study on Image Inpainting for Non-Cleft Lip Generation from Patients with Cleft Lip", Proceedings of the 2022 IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI), 2022

 

 

Last updated on 14 April 2024
RSS Feed