Publication Date

2021

Journal or Book Title

Journal of Medical Internet Research

Abstract

Background: Interventions to define medical jargon have been shown to improve electronic health record (EHR) note comprehension among crowdsourced participants on Amazon Mechanical Turk (AMT). However, AMT participants may not be representative of the general population or patients who are most at-risk for low health literacy. Objective: In this work, we assessed the efficacy of an intervention (NoteAid) for EHR note comprehension among participants in a community hospital setting. Methods: Participants were recruited from Lowell General Hospital (LGH), a community hospital in Massachusetts, to take the ComprehENotes test, a web-based test of EHR note comprehension. Participants were randomly assigned to control (n=85) or intervention (n=89) groups to take the test without or with NoteAid, respectively. For comparison, we used a sample of 200 participants recruited from AMT to take the ComprehENotes test (100 in the control group and 100 in the intervention group). Results: A total of 174 participants were recruited from LGH, and 200 participants were recruited from AMT. Participants in both intervention groups (community hospital and AMT) scored significantly higher than participants in the control groups (P<.001). The average score for the community hospital participants was significantly lower than the average score for the AMT participants (P<.001), consistent with the lower education levels in the community hospital sample. Education level had a significant effect on scores for the community hospital participants (P<.001). Conclusions: Use of NoteAid was associated with significantly improved EHR note comprehension in both community hospital and AMT samples. Our results demonstrate the generalizability of ComprehENotes as a test of EHR note comprehension and the effectiveness of NoteAid for improving EHR note comprehension.

ISSN

1438-8871

ORCID

Lalor, John/0000-0003-0848-4786; Wu, Hao/0000-0001-6471-1774

DOI

https://doi.org/10.2196/26354

Volume

23

Issue

5

License

UMass Amherst Open Access Policy

Funder

Health Services Research & Development, US Department of Veterans AffairsUS Department of Veterans Affairs [I01HX001457]; National Institutes of Health (NIH)United States Department of Health & Human ServicesNational Institutes of Health (NIH) - USA [R01LM012817]

Share

COinS