We use cookies to understand how you use our site and to improve your experience. This includes personalizing content and advertising. To learn more, click here. By continuing to use our site, you accept our use of cookies. Cookie Policy.

Features Partner Sites Information LinkXpress
Sign In
Advertise with Us

Download Mobile App

AI Outperforms Human Readers in Detecting Lung Nodules on X-Rays

By MedImaging International staff writers
Posted on 01 Feb 2024
Print article
Image: A new study tested a variety of AI algorithms head-to-head under similar conditions (Photo courtesy of 123RF)
Image: A new study tested a variety of AI algorithms head-to-head under similar conditions (Photo courtesy of 123RF)

Currently, over 150 artificial intelligence (AI)-based software products are available in the European market for radiology, with many addressing similar use cases. This makes it challenging for radiology departments to determine which software is most suitable for their needs. While software performance is a crucial factor in the procurement process, public data are scarce on the performance of these products. Clinical centers often lack the resources and personnel to thoroughly evaluate and compare multiple products before making a purchase. To address this issue, an initiative called Project AIR has been launched that aims to enhance market transparency for AI in radiology. Project AIR researchers have compiled a verified database of medical images for various clinical uses. This database allows for the comparative testing of multiple AI algorithms.

Now, in the first tests of the Project AIR concept, researchers discovered that out of seven AI algorithms trialed for detecting lung nodules in X-rays, four surpassed human readers in performance, while two algorithms for bone age prediction did not meet expectations. For testing the Project AIR concept, a team that included researchers from Radboud University (Nijmegen, the Netherlands) invited AI developers to participate. Between June 2022 and January 2023, nine products from eight vendors were validated: two for bone age prediction and seven for lung nodule assessment (one vendor participated in both categories). The team observed that the two algorithms for bone age analysis, Visiana, and Vuno, demonstrated excellent correlation with the reference standard, achieving r correlation coefficients of 0.987-0.989 (with 1 indicating perfect agreement). In lung nodule analysis, there was a more significant variation in performance, with human readers averaging an Area Under the Curve (AUC) of 0.81. The AI algorithms from Annalise.ai, Lunit, Milvue, and Oxipit showed superior performance, with AUCs of 0.90, 0.93, 0.86, and 0.88, respectively. The next tests of the Project AIR concept will focus on AI algorithms for fracture detection.

“We have shown the feasibility of the Project AIR methodology for external validation of commercial artificial intelligence (AI) products in medical imaging,” noted the researchers. “It is conceivable that in the future, radiology departments will require vendors to participate in transparent and comparative evaluations as a prerequisite for purchasing AI products.”

Related Links:
Radboud University

Gold Member
Solid State Kv/Dose Multi-Sensor
X-Ray Detector
1.5T MRI System
uMR 670
Color Doppler Ultrasound System

Print article



view channel
Image: The device creates microbubbles that temporarily disrupt the BBB, permitting the entry of immunotherapy into the brain (Photo courtesy of Northwestern)

Ultrasound Technology Breaks Blood-Brain Barrier for Glioblastoma Treatment

Despite extensive molecular studies, the outlook for patients diagnosed with the aggressive brain cancer known as glioblastoma (GBM) continues to be poor. This is partly due to the blood-brain barrier... Read more

Nuclear Medicine

view channel
Image: 68Ga-NC-BCH whole-body PET imaging rapidly targets an important gastrointestinal cancer biomarker in lesions in GI cancer patients (Photo courtesy of Qi, Guo, et al.; doi.org/10.2967/jnumed.123.267110)

New PET Radiotracer Enables Same-Day Imaging of Key Gastrointestinal Cancer Biomarker

Gastrointestinal cancers rank among the most prevalent cancers worldwide, contributing to over a quarter of all cancer cases and over one-third of cancer-related deaths annually. The initial symptoms of... Read more

General/Advanced Imaging

view channel
Image: The denoised image is less noisy and the defect is more detectable and visually clearer with DEMIST (Photo courtesy of Abhinav Jha/WUSTL)

Artificial Intelligence Tool Enhances Usability of Medical Images

Doctors use myocardial perfusion imaging (MPI) single-photon emission computed tomography (SPECT) images to evaluate blood flow to the heart muscle. To capture these images, patients are administered a... Read more

Imaging IT

view channel
Image: The new Medical Imaging Suite makes healthcare imaging data more accessible, interoperable and useful (Photo courtesy of Google Cloud)

New Google Cloud Medical Imaging Suite Makes Imaging Healthcare Data More Accessible

Medical imaging is a critical tool used to diagnose patients, and there are billions of medical images scanned globally each year. Imaging data accounts for about 90% of all healthcare data1 and, until... Read more
Copyright © 2000-2024 Globetech Media. All rights reserved.