Measuring automation bias in doctors using AI for diagnosis
Trust or Verify? Automation Bias in Physician-LLM Diagnostic Reasoning
This study tests how much doctors might rely on AI suggestions for diagnoses and whether that could lead to mistakes, aiming to improve patient safety.
Quick facts
| Phase | Not applicable |
|---|---|
| Study type | Interventional |
| Enrollment | 50 (estimated) |
| Sex | All |
| Sponsor | Lahore University of Management Sciences Academic / other |
| Locations | 1 site (Lahore, Punjab) |
| Trial ID | NCT06963957 on ClinicalTrials.gov |
What this trial studies
This study systematically investigates how automation bias affects physicians' diagnostic reasoning when using ChatGPT-4o in clinical decision-making. It aims to identify the extent to which doctors may over-rely on AI-generated suggestions, potentially leading to diagnostic errors. By examining various contextual factors that contribute to this bias, such as time constraints and cognitive fatigue, the study seeks to enhance understanding of the risks associated with integrating AI tools into healthcare. The findings could inform strategies to mitigate these biases and improve patient safety.
Who should consider this trial
Good fit: Ideal candidates for this study are medical practitioners who have completed their MBBS or equivalent and have undergone specific training on using large language models like ChatGPT.
Not a fit: Patients who are not medical practitioners or those without the required training in AI tools will not benefit from this study.
Why it matters
Potential benefit: If successful, this study could lead to improved diagnostic accuracy and patient safety by addressing automation bias in clinical settings.
How similar studies have performed: While the integration of AI in healthcare is a growing field, the specific focus on automation bias in physician decision-making with LLMs is relatively novel and has not been extensively tested in prior studies.
Eligibility criteria
Show full inclusion / exclusion criteria
Inclusion Criteria: * Completed Bachelor of Medicine, Bachelor of Surgery (MBBS) Exam. The equivalent degree of MBBS in US and Canada is called Doctor of Medicine (MD). * Full or Provisionally Registered Medical Practitioners with the Pakistan Medical and Dental Council (PMDC). * Participants must have completed a structured training program on the use of ChatGPT (or a comparable large language model), totaling at least 10 hours of instruction. The program must include hands-on practice related to LLM's aspects, specifically prompt engineering and content evaluation. Exclusion Criteria: * Any other Registered Medical Practitioners (Full or Provisional) with PMDC (e.g., Professionals with Bachelor of Dental Surgery or BDS).
Where this trial is running
Lahore, Punjab
- Lahore University of Management Sciences — Lahore, Punjab, Pakistan (Recruiting)
Study contacts
- Principal investigator: Ihsan Ayyub Qazi, PhD — Lahore University of Management Sciences (LUMS)
- Study coordinator: Ihsan Ayyub Qazi, PhD
- Email: ihsan.qazi@lums.edu.pk
- Phone: +923233333766
How to participate
- Review the eligibility criteria above with your treating physician.
- Visit the official trial page on ClinicalTrials.gov for the most current contact information and recruitment status.
- Contact the listed study coordinator or principal investigator to request pre-screening. Pre-screening is free and never obligates you to enroll.