We use cookies to understand how you use our site and to improve your experience. This includes personalizing content and advertising. To learn more, click here. By continuing to use our site, you accept our use of cookies. Cookie Policy.

Features Partner Sites Information LinkXpress
Sign In
Advertise with Us

Download Mobile App




Events

ATTENTION: Due to the COVID-19 PANDEMIC, many events are being rescheduled for a later date, converted into virtual venues, or altogether cancelled. Please check with the event organizer or website prior to planning for any forthcoming event.

Novel AI Image Generation Tool Has Promising Future in Radiology

By MedImaging International staff writers
Posted on 20 Mar 2023
Print article
Image: A study has found the use of generative models for augmenting and generating radiological data to be feasible (Photo courtesy of Charité University Berlin)
Image: A study has found the use of generative models for augmenting and generating radiological data to be feasible (Photo courtesy of Charité University Berlin)

DALL-E 2, an artificial intelligence (AI) tool that was unveiled in April 2022 by OpenAI, generates novel photorealistic images or artwork based on textual input. Trained on billions of text-image pairs available existing on the internet, DALL-E 2 boasts powerful generative capabilities. Now, new research indicates that the DALL-E 2 deep learning model for text-to-image generation could have a bright future in health care, particularly for image generation, augmentation, and manipulation.

Researchers at Charité University Berlin (Berlin, Germany) set out to examine whether generative models have sufficient medical domain knowledge to provide accurate and useful results and to understand if the capabilities of DALL-E 2 can be transferred to the medical domain in order to create or augment data. They analyzed DALL-E 2’s radiological knowledge in creating and manipulating X-ray, computed tomography (CT), magnetic resonance imaging (MRI), and ultrasound images. The research team found that DALL-E 2 has learned relevant representations of X-ray images and has the potential for text-to-image generation. In particular, DALL-E 2 managed to create realistic X-ray images based on short text prompts, although it performed poorly when presented with specific CT, MRI, or ultrasound image prompts. Moreover, while it was able to reasonably reconstruct missing elements in radiological images, its ability to generate images with pathological abnormalities was limited. Additionally, DALL-E 2 could do much more, such as generating an entire, full-body radiograph using only one knee image.

Synthetic data generated by DALL-E 2 can significantly speed up the development of new deep-learning tools for radiology while resolving privacy concerns over data sharing between institutions. The researchers have suggested that the generated images must be subjected to quality control by domain experts in order to minimize the risk of incorrect information being integrated into a generated data set. According to the researchers, there is also a need for further research to tweak these models to medical data and integrate medical terminology in order to create powerful models for data generation and augmentation in radiology research. DALL-E 2 is unavailable to the public for fine-tuning, although other generative models such as Stable Diffusion can be tweaked by the public and adapted to generate a variety of medical images. The study indicates that AI image generation in radiology has a promising future and further R&D could pave the way for exciting new tools for radiologists and medical professionals.

Related Links:
Charité University Berlin

Gold Supplier
Ultrasound Phantom
Multi-Purpose Multi-Tissue Ultrasound Phantom - Model 040GSE
New
Mobile DR System
Compact
New
Image Sharing Platform
CareRad
New
Digital X-Ray Flat Panel Detector
2121DXV

Print article
Sun Nuclear -    Mirion
FIME - Informa

Channels

MRI

view channel
Image: The AI-powered platform offers a game-changing solution for age-related disease detection and management (Photo courtesy of Freepik)

AI-Driven Imaging Platform Analyzes MRI Data for Early Detection of Age-Related Diseases

The increasing prevalence of age-related illnesses and their effects on patients, healthcare systems, and economies present a substantial challenge in the healthcare sector. As the global population ages,... Read more

Ultrasound

view channel
Image: A novel, skull-implantable ultrasound device can open the blood-brain barrier to deliver chemotherapy (Photo courtesy of Northwestern Medicine)

Skull-Implantable Ultrasound Device Enables Powerful Chemotherapy Drug to Reach Brain Tumors

A significant challenge in treating lethal brain cancer known as glioblastoma has been the inability of powerful chemotherapy to penetrate the blood-brain barrier to target the aggressive brain tumor.... Read more

Nuclear Medicine

view channel
Image: The components of the dosimeter can fit into an 18mm by 7mm capsule (Photo courtesy of University of NUS)

Novel Ingestible Capsule X-Ray Dosimeter Enables Real-Time Radiotherapy Monitoring

Gastric cancer ranks among the most prevalent cancers worldwide. Precision is vital in modern radiotherapy, as it aims to target tumor cells while minimizing damage to healthy tissue. However, challenges... Read more

Imaging IT

view channel
Image: The new Medical Imaging Suite makes healthcare imaging data more accessible, interoperable and useful (Photo courtesy of Google Cloud)

New Google Cloud Medical Imaging Suite Makes Imaging Healthcare Data More Accessible

Medical imaging is a critical tool used to diagnose patients, and there are billions of medical images scanned globally each year. Imaging data accounts for about 90% of all healthcare data1 and, until... Read more

Industry News

view channel
Image: The global AI-enabled medical imaging solutions market is expected to reach USD 18.36 billion in 2032 (Photo courtesy of Freepik)

Global AI-Enabled Medical Imaging Solutions Market Driven by Need for Early Disease Detection

The AI-enabled medical imaging solutions market is currently in its developmental stages, following the significant role of AI-based tools in combating the COVID-19 pandemic. The pandemic saw an upswing... Read more
Copyright © 2000-2023 Globetech Media. All rights reserved.