An Artificial Intelligence – AI Algorithm Produces Synthetic Brain Magnetic Resonance Imaging – MRI images

An Artificial Intelligence - AI algorithm can produce synthetic brain Magnetic Resonance Imaging - MRI images, solving a number of challenges in training AI algorithms, according to research presented at the International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI) in Granada, Spain.

Researchers from NVIDIA, Massachusetts General Hospital and Brigham and Women’s Hospital in Boston, and the Mayo Clinic in Rochester, MN, have trained a type of AI algorithm called a generative adversarial network (GAN) to generate synthetic abnormal brain Magnetic Resonance Imaging - MRI images. These synthetic images could be used to augment a small dataset or even on their own to train a deep-learning algorithm, according to Hoo-Chang Shin, a senior research scientist at NVIDIA.

AI algorithm produces synthetic brain MR images

AI algorithm produces synthetic brain MR images

We showed that you don’t have to have access to a large number of patient images,” he told “You can generate a lot of synthetic images and train your AI on these synthetic images — with only a handful of real images to fine-tune the pre-trained AI — and achieve almost the same performance as if you had trained on a large number of real data.”

The use of GANs in medical imaging has been on the rise lately for applications such as creating a synthetic head Computerized Tomography - CT image from a brain Magnetic Resonance Imaging - MRI image and for producing synthetic X-ray images to aid in algorithm training. In their project, the researchers trained a GAN using the Alzheimer’s Disease Neuroimaging Initiative (ADNI) dataset and the Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) dataset.

The algorithm allows developers to alter the size of a tumor on the Magnetic Resonance Imaging - MRI image, change its location, or place it on an otherwise normal brain — enabling hundreds or even thousands of these synthetic images to be created, according to the researchers. In testing, they found that adding synthetic data to augment real MRI data improved the performance of a deep-learning algorithm.

“Secondly, which is even more exciting, we can achieve similar performance using synthetic data only,” Shin said.

The algorithm tackles one of the big challenges of training deep-learning algorithms for medical imaging AI: the lack of reliable and accurate data for training the neural networks, he said. It can be challenging to find enough cases for a specific disease to train AI — especially if it’s a rare condition.

“And secondly, even if we had enough [disease cases], annotating them takes a really long time and is very costly,” Shin said.

The algorithm also addresses the patient privacy issues that have hindered the creation of large datasets needed for training these algorithms.

“Our algorithm can generate synthetic patient images which are not tied to a specific patient, so they are anonymous,” Shin said. “It’s easier to share [the dataset] outside of clinical institutions or a hospital, so we can get a large medical image dataset and train AI for a well-performing AI algorithm.”