AI-powered evaluation of anesthesiology trainee communication during error disclosure
Artificial Intelligence Assessment of Trainee Communication Compared to Human Assessment: A Prospective Cohort Study
This project will test whether a web-based AI can rate anesthesiology residents' and fellows' communication when they practice telling a parent about a medical error.
Quick facts
| Phase | Not applicable |
|---|---|
| Study type | Interventional |
| Enrollment | 45 (estimated) |
| Ages | 18 Years to 99 Years |
| Sex | All |
| Sponsor | Stanford University Academic / other |
| Locations | 1 site (Palo Alto, California) |
| Trial ID | NCT07107880 on ClinicalTrials.gov |
What this trial studies
An AI voice platform will deliver a simulated, audio-based encounter where a trainee discusses a dental injury that occurred during intubation with a simulated parent. Trainees (residents and fellows, excluding PGY‑1) will complete the simulation remotely and receive immediate AI-generated performance ratings. A human rater will also score each encounter using the same scales, and trainees will complete questionnaires about usability and satisfaction. Investigators will compare AI scores to human scores to measure reliability and explore the educational value of the tool.
Who should consider this trial
Good fit: Ideal participants are English-speaking anesthesiology residents and fellows (post-PGY-1) affiliated with Stanford who have access to a computer or smart device and the internet.
Not a fit: Non-English speakers, PGY-1 trainees, individuals without the necessary technology, or those not affiliated with the Stanford anesthesiology program are unlikely to benefit from participating.
Why it matters
Potential benefit: If successful, this could help train clinicians to communicate more clearly and compassionately after medical errors, improving patient trust and safety.
How similar studies have performed: Similar voice-based and automated feedback systems for clinical communication are emerging and have shown early promise, but direct, robust comparisons to human raters remain limited.
Eligibility criteria
Show full inclusion / exclusion criteria
Inclusion Criteria: * Participant's must be 18 years of age or older * Graduate medical trainess such as residents and fellows at all levels of training excluding PGY1 trainees at Department of Anesthesiology, Perioperative, and Pain Medicine at Stanford University * Able to speak and understand English * Willing and able to provide consent to participate in research * Able to participate in Artificial Intelligence communication simulation Exclusion Criteria: * Non-English speaker * unable to provide consent to participate in research * individual with no access to the necessary technology (internet, computer/smart device) required for participating in the digital, voice-based interaction with the AI platform
Where this trial is running
Palo Alto, California
- Lucile Packard Children's Hospital Stanford — Palo Alto, California, United States (Recruiting)
Study contacts
- Principal investigator: Thomas Caruso, MD, PhD — Stanford University
- Study coordinator: Asheen Rama, MD
- Email: asheen21@stanford.edu
- Phone: 650-723-5728
How to participate
- Review the eligibility criteria above with your treating physician.
- Visit the official trial page on ClinicalTrials.gov for the most current contact information and recruitment status.
- Contact the listed study coordinator or principal investigator to request pre-screening. Pre-screening is free and never obligates you to enroll.