Early detection of colorectal cancer by leveraging Dutch primary care consultation notes with free text embeddings
© 2023. The Author(s)..
We aimed to assess the added predictive performance that free-text Dutch consultation notes provide in detecting colorectal cancer in primary care, in comparison to currently used models. We developed, evaluated and compared three prediction models for colorectal cancer (CRC) in a large primary care database with 60,641 patients. The prediction model with both known predictive features and free-text data (with TabTxt AUROC: 0.823) performs statistically significantly better (p < 0.05) than the other two models with only tabular (as used nowadays) and text data, respectively (AUROC Tab: 0.767; Txt: 0.797). The specificity of the two models that use demographics and known CRC features (with specificity Tab: 0.321; TabTxt: 0.335) are higher than that of the model with only free-text (specificity Txt: 0.234). The Txt and, to a lesser degree, TabTxt model are well calibrated, while the Tab model shows slight underprediction at both tails. As expected with an outcome prevalence below 0.01, all models show much uncalibrated predictions in the extreme upper tail (top 1%). Free-text consultation notes show promising results to improve the predictive performance over established prediction models that only use structured features. Clinical future implications for our CRC use case include that such improvement may help lowering the number of referrals for suspected CRC to medical specialists.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2023 |
|---|---|
| Erschienen: |
2023 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:13 |
|---|---|
| Enthalten in: |
Scientific reports - 13(2023), 1 vom: 04. Juli, Seite 10760 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Luik, Torec T [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
|---|
| Anmerkungen: |
Date Completed 06.07.2023 Date Revised 18.07.2023 published: Electronic Citation Status MEDLINE |
|---|
| doi: |
10.1038/s41598-023-37397-2 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM359039375 |
|---|
| LEADER | 01000naa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM359039375 | ||
| 003 | DE-627 | ||
| 005 | 20231226210605.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231226s2023 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1038/s41598-023-37397-2 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1196.xml |
| 035 | |a (DE-627)NLM359039375 | ||
| 035 | |a (NLM)37402757 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Luik, Torec T |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Early detection of colorectal cancer by leveraging Dutch primary care consultation notes with free text embeddings |
| 264 | 1 | |c 2023 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 06.07.2023 | ||
| 500 | |a Date Revised 18.07.2023 | ||
| 500 | |a published: Electronic | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a © 2023. The Author(s). | ||
| 520 | |a We aimed to assess the added predictive performance that free-text Dutch consultation notes provide in detecting colorectal cancer in primary care, in comparison to currently used models. We developed, evaluated and compared three prediction models for colorectal cancer (CRC) in a large primary care database with 60,641 patients. The prediction model with both known predictive features and free-text data (with TabTxt AUROC: 0.823) performs statistically significantly better (p < 0.05) than the other two models with only tabular (as used nowadays) and text data, respectively (AUROC Tab: 0.767; Txt: 0.797). The specificity of the two models that use demographics and known CRC features (with specificity Tab: 0.321; TabTxt: 0.335) are higher than that of the model with only free-text (specificity Txt: 0.234). The Txt and, to a lesser degree, TabTxt model are well calibrated, while the Tab model shows slight underprediction at both tails. As expected with an outcome prevalence below 0.01, all models show much uncalibrated predictions in the extreme upper tail (top 1%). Free-text consultation notes show promising results to improve the predictive performance over established prediction models that only use structured features. Clinical future implications for our CRC use case include that such improvement may help lowering the number of referrals for suspected CRC to medical specialists | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a Research Support, Non-U.S. Gov't | |
| 700 | 1 | |a Abu-Hanna, Ameen |e verfasserin |4 aut | |
| 700 | 1 | |a van Weert, Henk C P M |e verfasserin |4 aut | |
| 700 | 1 | |a Schut, Martijn C |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Scientific reports |d 2011 |g 13(2023), 1 vom: 04. Juli, Seite 10760 |w (DE-627)NLM215703936 |x 2045-2322 |7 nnns |
| 773 | 1 | 8 | |g volume:13 |g year:2023 |g number:1 |g day:04 |g month:07 |g pages:10760 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1038/s41598-023-37397-2 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 13 |j 2023 |e 1 |b 04 |c 07 |h 10760 | ||