Large language model-based simplification of breast imaging reports: a prospective multicentre study with 2965 patient-based evaluations.

Published in Insights into imaging. Abstract: To compare patient perceptions of radiologist-written and artificial intelligence (AI)-generated simplifications of breast imaging reports in terms of simplicity, comprehensibility, empathy, and overall preference. In this prospective multicentre survey-based study, 10 anonymized breast imaging reports (5 ultrasound, 5 mammography; one BI-RADS category 1-5 per modality) were simplified by ChatGPT-4 within a 50-word limit. After assessment by a panel of 20 physicians, paired radiologist-written and AI-generated reports were evaluated by 314 patients (2965 evaluations) who rated simplicity, comprehensibility, and empathy on a 5-point Likert scale and indicated their preferred report. The origin of each report was concealed, and each pair was presented in randomized order. Univariable and multivariable mixed-effects logistic regression analyses were performed to identify factors associated with preferring AI-generated reports. AI-generated reports were preferred in 63.3% (1876/2965) of evaluations. High simplicity and comprehensibility scores (4-5) were more frequently assigned to AI reports than to radiologist-written reports (70.0% vs 43.4% and 68.1% vs 40.4%, respectively). In multivariable analysis, higher comprehensibility was the strongest predictor in both directions: higher comprehensibility of AI-generated reports increased the odds of preferring AI (score 4: adjusted OR 1.87, 95% CI 1.08-3.23, p = 0.025), while higher comprehensibility of radiologist-written reports re...