Automated interpretation of stress echocardiography reports using natural language processing
© The Author(s) 2022. Published by Oxford University Press on behalf of the European Society of Cardiology..
Aims: Stress echocardiography (SE) findings and interpretations are commonly documented in free-text reports. Reusing SE results requires laborious manual reviews. This study aimed to develop and validate an automated method for abstracting SE reports in a large cohort.
Methods and results: This study included adult patients who had SE within 30 days of their emergency department visit for suspected acute coronary syndrome in a large integrated healthcare system. An automated natural language processing (NLP) algorithm was developed to abstract SE reports and classify overall SE results into normal, non-diagnostic, infarction, and ischaemia categories. Randomly selected reports (n = 140) were double-blindly reviewed by cardiologists to perform criterion validity of the NLP algorithm. Construct validity was tested on the entire cohort using abstracted SE data and additional clinical variables. The NLP algorithm abstracted 6346 consecutive SE reports. Cardiologists had good agreements on the overall SE results on the 140 reports: Kappa (0.83) and intraclass correlation coefficient (0.89). The NLP algorithm achieved 98.6% specificity and negative predictive value, 95.7% sensitivity, positive predictive value, and F-score on the overall SE results and near-perfect scores on ischaemia findings. The 30-day acute myocardial infarction or death outcomes were highest among patients with ischaemia (5.0%), followed by infarction (1.4%), non-diagnostic (0.8%), and normal (0.3%) results. We found substantial variations in the format and quality of SE reports, even within the same institution.
Conclusions: Natural language processing is an accurate and efficient method for abstracting unstructured SE reports. This approach creates new opportunities for research, public health measures, and care improvement.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2022 |
|---|---|
| Erschienen: |
2022 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:3 |
|---|---|
| Enthalten in: |
European heart journal. Digital health - 3(2022), 4 vom: 19. Dez., Seite 626-637 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Zheng, Chengyi [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
Acute coronary syndrome |
|---|
| Anmerkungen: |
Date Revised 21.02.2023 published: Electronic-eCollection Citation Status PubMed-not-MEDLINE |
|---|
| doi: |
10.1093/ehjdh/ztac047 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM352213043 |
|---|
| LEADER | 01000naa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM352213043 | ||
| 003 | DE-627 | ||
| 005 | 20231226053211.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231226s2022 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1093/ehjdh/ztac047 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1173.xml |
| 035 | |a (DE-627)NLM352213043 | ||
| 035 | |a (NLM)36710893 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Zheng, Chengyi |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Automated interpretation of stress echocardiography reports using natural language processing |
| 264 | 1 | |c 2022 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Revised 21.02.2023 | ||
| 500 | |a published: Electronic-eCollection | ||
| 500 | |a Citation Status PubMed-not-MEDLINE | ||
| 520 | |a © The Author(s) 2022. Published by Oxford University Press on behalf of the European Society of Cardiology. | ||
| 520 | |a Aims: Stress echocardiography (SE) findings and interpretations are commonly documented in free-text reports. Reusing SE results requires laborious manual reviews. This study aimed to develop and validate an automated method for abstracting SE reports in a large cohort | ||
| 520 | |a Methods and results: This study included adult patients who had SE within 30 days of their emergency department visit for suspected acute coronary syndrome in a large integrated healthcare system. An automated natural language processing (NLP) algorithm was developed to abstract SE reports and classify overall SE results into normal, non-diagnostic, infarction, and ischaemia categories. Randomly selected reports (n = 140) were double-blindly reviewed by cardiologists to perform criterion validity of the NLP algorithm. Construct validity was tested on the entire cohort using abstracted SE data and additional clinical variables. The NLP algorithm abstracted 6346 consecutive SE reports. Cardiologists had good agreements on the overall SE results on the 140 reports: Kappa (0.83) and intraclass correlation coefficient (0.89). The NLP algorithm achieved 98.6% specificity and negative predictive value, 95.7% sensitivity, positive predictive value, and F-score on the overall SE results and near-perfect scores on ischaemia findings. The 30-day acute myocardial infarction or death outcomes were highest among patients with ischaemia (5.0%), followed by infarction (1.4%), non-diagnostic (0.8%), and normal (0.3%) results. We found substantial variations in the format and quality of SE reports, even within the same institution | ||
| 520 | |a Conclusions: Natural language processing is an accurate and efficient method for abstracting unstructured SE reports. This approach creates new opportunities for research, public health measures, and care improvement | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a Acute coronary syndrome | |
| 650 | 4 | |a Artificial intelligence | |
| 650 | 4 | |a Emergency department | |
| 650 | 4 | |a Natural language processing | |
| 650 | 4 | |a Noninvasive stress test | |
| 650 | 4 | |a Stress echocardiography | |
| 700 | 1 | |a Sun, Benjamin C |e verfasserin |4 aut | |
| 700 | 1 | |a Wu, Yi-Lin |e verfasserin |4 aut | |
| 700 | 1 | |a Ferencik, Maros |e verfasserin |4 aut | |
| 700 | 1 | |a Lee, Ming-Sum |e verfasserin |4 aut | |
| 700 | 1 | |a Redberg, Rita F |e verfasserin |4 aut | |
| 700 | 1 | |a Kawatkar, Aniket A |e verfasserin |4 aut | |
| 700 | 1 | |a Musigdilok, Visanee V |e verfasserin |4 aut | |
| 700 | 1 | |a Sharp, Adam L |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t European heart journal. Digital health |d 2020 |g 3(2022), 4 vom: 19. Dez., Seite 626-637 |w (DE-627)NLM325972273 |x 2634-3916 |7 nnns |
| 773 | 1 | 8 | |g volume:3 |g year:2022 |g number:4 |g day:19 |g month:12 |g pages:626-637 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1093/ehjdh/ztac047 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 3 |j 2022 |e 4 |b 19 |c 12 |h 626-637 | ||