Benchmark and performance test for AI reading breast ultrasound images
Official title: Construction of a Standardized Benchmark Evaluation System for Intelligent Breast Ultrasound Image Interpretation and Systematic Performance Assessment of Multimodal Artificial Intelligence Models Based on ACR BI-RADS v2025 Criteria
Run by Peking Union Medical College Hospital · NCT07500428 · Data updated 2026-11-12
This project will test whether multimodal AI models can read breast ultrasound images to help classify normal, benign, and malignant findings for people who have had breast ultrasound.
Quick facts
| Study type | Observational |
|---|---|
| Ages | 18 Years to 75 Years |
| Sex | Women only |
| Enrollment | 1380 (estimated) |
| Sponsor | Peking Union Medical College Hospital Academic / other |
| Locations | 1 site (Beijing) |
| Status | Recruiting |
| Started | March 12, 2026 |
| Main results expected | December 1, 2026 |
| Study ends | March 1, 2027 |
| Registry record updated | March 30, 2026 |
| Trial ID | NCT07500428 on ClinicalTrials.gov |
Is this trial a fit for you?
✓Likely a good fit
Ideal candidates for inclusion are cases with de-identified B-mode breast ultrasound images that have clear visualization of the lesion and a documented pathological diagnosis (or a confirmed normal status by an experienced radiologist).
✕Probably not a fit
Patients without B-mode ultrasound images, without pathology or confirmed normal status, with severely degraded images, or whose images were not shared/de-identified will not be included and therefore will not directly benefit from this project.
A plain-English reading of the study's rules. Only the study team can confirm whether you qualify.
What this trial studies
This retrospective single-center project will collect de-identified B-mode breast ultrasound images from Peking Union Medical College Hospital (2018–2025) and from open-access datasets to create a standardized evaluation benchmark. Expert radiologists with junior and senior experience will independently annotate images using ACR BI-RADS v2025 criteria, with a senior arbitrator resolving disagreements. Baseline CNN (ResNet-50) and transformer (USFM) models will be trained, and multiple multimodal large language models will be tested on an evaluation set plus an out-of-distribution safety test set. Images will be stratified into difficulty tiers based on cross-architecture model consensus to characterize where models succeed or fail.
Why it matters
Potential benefit: If successful, the benchmark and model comparisons could improve diagnostic consistency and help models identify cancers more reliably on breast ultrasound, reducing variability between readers.
How similar studies have gone: Previous AI work using CNNs and other deep-learning approaches has shown promising performance on breast ultrasound, but multimodal large language model approaches are newer and standardized benchmarks for head-to-head comparison are still lacking.
Who can join: the full rules
Show full inclusion / exclusion criteria
Inclusion Criteria: * B-mode breast ultrasound grayscale images from the institutional PACS database or from published open-access breast ultrasound datasets with documented original institutional ethics approval * Image quality adequate for clinical diagnosis with clear visualization of the region of interest * Pathological diagnosis confirmed (for benign and malignant lesion groups), or normal breast status confirmed by a senior radiologist with \>15 years of breast ultrasound experience (for the normal group) * Complete de-identification with removal of all personally identifiable information Exclusion Criteria: * Severely degraded image quality precluding meaningful BI-RADS assessment * Duplicate images from the same patient (only the most representative image retained per lesion) * Images with residual personally identifiable information after de-identification processing * Cases with ambiguous, disputed, or unavailable pathological results * Non-B-mode ultrasound images, including elastography, contrast-enhanced ultrasound, and Doppler imaging
Where it's running
-
Peking Union Medical College Hospital
Beijing, China Recruiting
Study contacts
- Principal investigator: Qingli Zhu, MD — Peking Union Medical College Hospital
- Study coordinator: Qingli Zhu, MD
- Email: zqlpumch@126.com
- Phone: +86 13621376699
Similar studies
Other studies for the same condition or treatment. Recruiting studies are listed first.
-
Dalpiciclib plus hormone therapy for early HR+/HER2- breast cancer
This trial tests whether adding dalpiciclib at two different doses and durations to standard hormone therapy helps people with early HR+/HER2- breast cancer.
-
How local breast cancer treatments affect side effects and quality of life in Chinese patients
This project will test how surgery and related treatments (chemotherapy, radiation, hormone or targeted therapy) affect side effects and daily quality of life for people with early-stage breast cancer in China.
-
Predicting outcomes for advanced breast cancer patients treated with CDK4/6 inhibitors and endocrine therapy
This study is trying to see how well different CDK4/6 inhibitors combined with hormone therapy work for people with advanced breast cancer and how safe they are.
-
Understanding breast cancer risk factors and outcomes in Florida
This study is trying to understand the different risk factors and outcomes of breast cancer in men and women in Florida by collecting samples and survey information from new patients at breast clinics.
-
68Ga-FAPI-46 versus 18F-FDG PET imaging in ER-positive breast cancer
This test compares whether 68Ga-FAPI-46 PET scans find more cancer spread than standard 18F-FDG PET scans in people with ER-positive breast cancer who need staging.
-
Combination treatment for brain metastasis from ER+/HER-2- breast cancer
This study is testing a new combination treatment of elacestrant and abemaciclib to see if it can help people with brain metastases from estrogen receptor-positive, HER-2 negative breast cancer.
How to take part
- Review the eligibility criteria above with your treating physician.
- Check the official listing on ClinicalTrials.gov for the latest contact details and recruitment status.
- Contact the study coordinator or principal investigator to ask for pre-screening. Pre-screening is free and never obligates you to enroll.