- Title
- Manipulating Medical Image Translation with Manifold Disentanglement
- Creator
- Liu, Siyu; Dowling, Jason A.; Engstrom, Craig; Greer, Peter B.; Crozier, Stuart; Chandra, Shekhar S.
- Relation
- 2023 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2023. Proceedings of 2023 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2023 (Port Macquarie, Australia 28 November - 1 December 2023) p. 332-339
- Publisher Link
- http://dx.doi.org/10.1109/DICTA60407.2023.00053
- Publisher
- Institute of Electrical and Electronics Engineers (IEEE)
- Resource Type
- conference paper
- Date
- 2023
- Description
- Most current medical image translation Generative Adversarial Networks (GANs) can only generate one definitive output for each input. However, in reality, there can be many simultaneously valid translations. For example, when synthesising medical images from segmentation, diverse tissue structures, contrasts, textures, and even modalities are possible based on the same segmentation. In this work, we propose Manifold Disentanglement Generative Adversarial Network (MDGAN), a style-based network capable of capturing this output diversity. The mechanism enabling output diversity is a style-based manifold, which is learnt from image data, and can be sampled to 'stylise' the input into diverse outputs. We train MDGAN for segmentation-to-MR-and-CT translation and show that the manifold i) can learn distinct clusters that control the output modality (CT or MR), ii) can be traversed to smoothly alter features within each modality (such as tissue structures, contrasts in MR) and iii) is disentangled such that the input's anatomical structures are faithfully preserved when generating diverse images based on the same segmentation map.
- Subject
- GAN; medical image translation; multi-modal
- Identifier
- http://hdl.handle.net/1959.13/1502486
- Identifier
- uon:55232
- Identifier
- ISBN:9798350382204
- Language
- eng
- Reviewed
- Hits: 326
- Visitors: 325
- Downloads: 0
| Thumbnail | File | Description | Size | Format |
|---|