Human vs. artificial intelligence in medical charting: a comparative study in the simulated emergency medicine context

Comprehensive Summary

Lipinski et al. evaluated whether AI scribes improve documentation efficiency in emergency medicine compared to traditional physician voice dictation. In this study, 16 physicians and residents completed standardized patient encounters recorded by the AI scribe Mutuo, then documented the same encounters using Dragon dictation. Participants subsequently edited the AI-generated notes, enabling comparison across key factors including documentation time, editing burden, and user preference. Editing AI-generated notes was significantly faster than dictation (1:15 vs. 2:05 minutes), representing a 39% reduction in documentation time. Notably, 69% of note sections required no edits, and most changes were minor, typically limited to a few words or a single sentence, with edits most frequently occurring in the history and plan sections. Furthermore, 63% of participants preferred AI-generated notes overall. These findings suggest that AI scribes can meaningfully reduce documentation burden with minimal editing required, supporting their potential to improve physician efficiency, though real-world clinical validation remains necessary.

Outcomes and Implications

This study's findings carry meaningful implications for emergency medicine, particularly in addressing physician burnout and improving efficiency in high-pressure clinical environments. By reducing documentation burden, AI scribes free physicians to devote greater attention to direct patient care and clinical decision-making. While the minimal editing requirements are encouraging, physician oversight remains essential to ensure note accuracy and uphold clinical safety standards. Broader implementation will ultimately depend on robust data privacy protections and rigorous real-world validation across diverse clinical settings.