Natural Language Processing of Referral Letters for Machine Learning-Based Triaging of Patients With Low Back Pain to the Most Appropriate Intervention : Retrospective Study
©Sebastian Fudickar, Carsten Bantel, Jannik Spieker, Heinrich Töpfer, Patrick Stegeman, Henrica R Schiphorst Preuper, Michiel F Reneman, André P Wolff, Remko Soer. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 30.01.2024..
BACKGROUND: Decision support systems (DSSs) for suggesting optimal treatments for individual patients with low back pain (LBP) are currently insufficiently accurate for clinical application. Most of the input provided to train these systems is based on patient-reported outcome measures. However, with the appearance of electronic health records (EHRs), additional qualitative data on reasons for referrals and patients' goals become available for DSSs. Currently, no decision support tools cover a wide range of biopsychosocial factors, including referral letter information to help clinicians triage patients to the optimal LBP treatment.
OBJECTIVE: The objective of this study was to investigate the added value of including qualitative data from EHRs and referral letters to the accuracy of a quantitative DSS for patients with LBP.
METHODS: A retrospective study was conducted in a clinical cohort of Dutch patients with LBP. Patients filled out a baseline questionnaire about demographics, pain, disability, work status, quality of life, medication, psychosocial functioning, comorbidity, history, and duration of pain. Referral reasons and patient requests for help (patient goals) were extracted via natural language processing (NLP) and enriched in the data set. For decision support, these data were considered independent factors for triage to neurosurgery, anesthesiology, rehabilitation, or minimal intervention. Support vector machine, k-nearest neighbor, and multilayer perceptron models were trained for 2 conditions: with and without consideration of the referral letter content. The models' accuracies were evaluated via F1-scores, and confusion matrices were used to predict the treatment path (out of 4 paths) with and without additional referral parameters.
RESULTS: Data from 1608 patients were evaluated. The evaluation indicated that 2 referral reasons from the referral letters (for anesthesiology and rehabilitation intervention) increased the F1-score accuracy by up to 19.5% for triaging. The confusion matrices confirmed the results.
CONCLUSIONS: This study indicates that data enriching by adding NLP-based extraction of the content of referral letters increases the model accuracy of DSSs in suggesting optimal treatments for individual patients with LBP. Overall model accuracies were considered low and insufficient for clinical application.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2024 |
|---|---|
| Erschienen: |
2024 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:26 |
|---|---|
| Enthalten in: |
Journal of medical Internet research - 26(2024) vom: 30. Jan., Seite e46857 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Fudickar, Sebastian [VerfasserIn] |
|---|
| Links: |
|---|
| Anmerkungen: |
Date Completed 31.01.2024 Date Revised 16.02.2024 published: Electronic Citation Status MEDLINE |
|---|
| doi: |
10.2196/46857 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM36780011X |
|---|
| LEADER | 01000caa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM36780011X | ||
| 003 | DE-627 | ||
| 005 | 20240216232753.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 240130s2024 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.2196/46857 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1295.xml |
| 035 | |a (DE-627)NLM36780011X | ||
| 035 | |a (NLM)38289669 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Fudickar, Sebastian |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Natural Language Processing of Referral Letters for Machine Learning-Based Triaging of Patients With Low Back Pain to the Most Appropriate Intervention |b Retrospective Study |
| 264 | 1 | |c 2024 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 31.01.2024 | ||
| 500 | |a Date Revised 16.02.2024 | ||
| 500 | |a published: Electronic | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a ©Sebastian Fudickar, Carsten Bantel, Jannik Spieker, Heinrich Töpfer, Patrick Stegeman, Henrica R Schiphorst Preuper, Michiel F Reneman, André P Wolff, Remko Soer. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 30.01.2024. | ||
| 520 | |a BACKGROUND: Decision support systems (DSSs) for suggesting optimal treatments for individual patients with low back pain (LBP) are currently insufficiently accurate for clinical application. Most of the input provided to train these systems is based on patient-reported outcome measures. However, with the appearance of electronic health records (EHRs), additional qualitative data on reasons for referrals and patients' goals become available for DSSs. Currently, no decision support tools cover a wide range of biopsychosocial factors, including referral letter information to help clinicians triage patients to the optimal LBP treatment | ||
| 520 | |a OBJECTIVE: The objective of this study was to investigate the added value of including qualitative data from EHRs and referral letters to the accuracy of a quantitative DSS for patients with LBP | ||
| 520 | |a METHODS: A retrospective study was conducted in a clinical cohort of Dutch patients with LBP. Patients filled out a baseline questionnaire about demographics, pain, disability, work status, quality of life, medication, psychosocial functioning, comorbidity, history, and duration of pain. Referral reasons and patient requests for help (patient goals) were extracted via natural language processing (NLP) and enriched in the data set. For decision support, these data were considered independent factors for triage to neurosurgery, anesthesiology, rehabilitation, or minimal intervention. Support vector machine, k-nearest neighbor, and multilayer perceptron models were trained for 2 conditions: with and without consideration of the referral letter content. The models' accuracies were evaluated via F1-scores, and confusion matrices were used to predict the treatment path (out of 4 paths) with and without additional referral parameters | ||
| 520 | |a RESULTS: Data from 1608 patients were evaluated. The evaluation indicated that 2 referral reasons from the referral letters (for anesthesiology and rehabilitation intervention) increased the F1-score accuracy by up to 19.5% for triaging. The confusion matrices confirmed the results | ||
| 520 | |a CONCLUSIONS: This study indicates that data enriching by adding NLP-based extraction of the content of referral letters increases the model accuracy of DSSs in suggesting optimal treatments for individual patients with LBP. Overall model accuracies were considered low and insufficient for clinical application | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a LBP | |
| 650 | 4 | |a NLP | |
| 650 | 4 | |a artificial intelligence | |
| 650 | 4 | |a back | |
| 650 | 4 | |a clinical application | |
| 650 | 4 | |a decision support | |
| 650 | 4 | |a decision-making | |
| 650 | 4 | |a low back pain | |
| 650 | 4 | |a machine learning | |
| 650 | 4 | |a natural language processing | |
| 650 | 4 | |a neural network | |
| 650 | 4 | |a pain | |
| 650 | 4 | |a patient records | |
| 650 | 4 | |a psychosocial | |
| 650 | 4 | |a qualitative data | |
| 650 | 4 | |a quality of life | |
| 650 | 4 | |a questionnaire | |
| 650 | 4 | |a support system | |
| 650 | 4 | |a triaging | |
| 700 | 1 | |a Bantel, Carsten |e verfasserin |4 aut | |
| 700 | 1 | |a Spieker, Jannik |e verfasserin |4 aut | |
| 700 | 1 | |a Töpfer, Heinrich |e verfasserin |4 aut | |
| 700 | 1 | |a Stegeman, Patrick |e verfasserin |4 aut | |
| 700 | 1 | |a Schiphorst Preuper, Henrica R |e verfasserin |4 aut | |
| 700 | 1 | |a Reneman, Michiel F |e verfasserin |4 aut | |
| 700 | 1 | |a Wolff, André P |e verfasserin |4 aut | |
| 700 | 1 | |a Soer, Remko |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Journal of medical Internet research |d 1999 |g 26(2024) vom: 30. Jan., Seite e46857 |w (DE-627)NLM116127104 |x 1438-8871 |7 nnns |
| 773 | 1 | 8 | |g volume:26 |g year:2024 |g day:30 |g month:01 |g pages:e46857 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.2196/46857 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 26 |j 2024 |b 30 |c 01 |h e46857 | ||