A Neural Network Model Using Pain Score Patterns to Predict the Need for Outpatient Opioid Refills Following Ambulatory Surgery : Algorithm Development and Validation
©Rodney Allanigue Gabriel, Sierra Simpson, William Zhong, Brittany Nicole Burton, Soraya Mehdipour, Engy Tadros Said. Originally published in JMIR Perioperative Medicine (http://periop.jmir.org), 08.02.2023..
BACKGROUND: Expansion of clinical guidance tools is crucial to identify patients at risk of requiring an opioid refill after outpatient surgery.
OBJECTIVE: The objective of this study was to develop machine learning algorithms incorporating pain and opioid features to predict the need for outpatient opioid refills following ambulatory surgery.
METHODS: Neural networks, regression, random forest, and a support vector machine were used to evaluate the data set. For each model, oversampling and undersampling techniques were implemented to balance the data set. Hyperparameter tuning based on k-fold cross-validation was performed, and feature importance was ranked based on a Shapley Additive Explanations (SHAP) explainer model. To assess performance, we calculated the average area under the receiver operating characteristics curve (AUC), F1-score, sensitivity, and specificity for each model.
RESULTS: There were 1333 patients, of whom 144 (10.8%) refilled their opioid prescription within 2 weeks after outpatient surgery. The average AUC calculated from k-fold cross-validation was 0.71 for the neural network model. When the model was validated on the test set, the AUC was 0.75. The features with the highest impact on model output were performance of a regional nerve block, postanesthesia care unit maximum pain score, postanesthesia care unit median pain score, active smoking history, and total perioperative opioid consumption.
CONCLUSIONS: Applying machine learning algorithms allows providers to better predict outcomes that require specialized health care resources such as transitional pain clinics. This model can aid as a clinical decision support for early identification of at-risk patients who may benefit from transitional pain clinic care perioperatively in ambulatory surgery.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2023 |
|---|---|
| Erschienen: |
2023 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:6 |
|---|---|
| Enthalten in: |
JMIR perioperative medicine - 6(2023) vom: 08. Feb., Seite e40455 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Gabriel, Rodney Allanigue [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
Algorithms |
|---|
| Anmerkungen: |
Date Revised 25.02.2023 published: Electronic Citation Status PubMed-not-MEDLINE |
|---|
| doi: |
10.2196/40455 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM352632143 |
|---|
| LEADER | 01000naa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM352632143 | ||
| 003 | DE-627 | ||
| 005 | 20231226054155.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231226s2023 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.2196/40455 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1175.xml |
| 035 | |a (DE-627)NLM352632143 | ||
| 035 | |a (NLM)36753316 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Gabriel, Rodney Allanigue |e verfasserin |4 aut | |
| 245 | 1 | 2 | |a A Neural Network Model Using Pain Score Patterns to Predict the Need for Outpatient Opioid Refills Following Ambulatory Surgery |b Algorithm Development and Validation |
| 264 | 1 | |c 2023 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Revised 25.02.2023 | ||
| 500 | |a published: Electronic | ||
| 500 | |a Citation Status PubMed-not-MEDLINE | ||
| 520 | |a ©Rodney Allanigue Gabriel, Sierra Simpson, William Zhong, Brittany Nicole Burton, Soraya Mehdipour, Engy Tadros Said. Originally published in JMIR Perioperative Medicine (http://periop.jmir.org), 08.02.2023. | ||
| 520 | |a BACKGROUND: Expansion of clinical guidance tools is crucial to identify patients at risk of requiring an opioid refill after outpatient surgery | ||
| 520 | |a OBJECTIVE: The objective of this study was to develop machine learning algorithms incorporating pain and opioid features to predict the need for outpatient opioid refills following ambulatory surgery | ||
| 520 | |a METHODS: Neural networks, regression, random forest, and a support vector machine were used to evaluate the data set. For each model, oversampling and undersampling techniques were implemented to balance the data set. Hyperparameter tuning based on k-fold cross-validation was performed, and feature importance was ranked based on a Shapley Additive Explanations (SHAP) explainer model. To assess performance, we calculated the average area under the receiver operating characteristics curve (AUC), F1-score, sensitivity, and specificity for each model | ||
| 520 | |a RESULTS: There were 1333 patients, of whom 144 (10.8%) refilled their opioid prescription within 2 weeks after outpatient surgery. The average AUC calculated from k-fold cross-validation was 0.71 for the neural network model. When the model was validated on the test set, the AUC was 0.75. The features with the highest impact on model output were performance of a regional nerve block, postanesthesia care unit maximum pain score, postanesthesia care unit median pain score, active smoking history, and total perioperative opioid consumption | ||
| 520 | |a CONCLUSIONS: Applying machine learning algorithms allows providers to better predict outcomes that require specialized health care resources such as transitional pain clinics. This model can aid as a clinical decision support for early identification of at-risk patients who may benefit from transitional pain clinic care perioperatively in ambulatory surgery | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a algorithms | |
| 650 | 4 | |a ambulatory surgery | |
| 650 | 4 | |a clinical decision support | |
| 650 | 4 | |a machine learning | |
| 650 | 4 | |a opioids | |
| 650 | 4 | |a outpatient | |
| 650 | 4 | |a pain | |
| 650 | 4 | |a pain care | |
| 650 | 4 | |a pain management | |
| 650 | 4 | |a pain medication | |
| 650 | 4 | |a patient needs | |
| 650 | 4 | |a predict | |
| 650 | 4 | |a surgery | |
| 700 | 1 | |a Simpson, Sierra |e verfasserin |4 aut | |
| 700 | 1 | |a Zhong, William |e verfasserin |4 aut | |
| 700 | 1 | |a Burton, Brittany Nicole |e verfasserin |4 aut | |
| 700 | 1 | |a Mehdipour, Soraya |e verfasserin |4 aut | |
| 700 | 1 | |a Said, Engy Tadros |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t JMIR perioperative medicine |d 2018 |g 6(2023) vom: 08. Feb., Seite e40455 |w (DE-627)NLM319578879 |x 2561-9128 |7 nnns |
| 773 | 1 | 8 | |g volume:6 |g year:2023 |g day:08 |g month:02 |g pages:e40455 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.2196/40455 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 6 |j 2023 |b 08 |c 02 |h e40455 | ||