Implications for Electronic Surveys in Inpatient Settings Based on Patient Survey Response Patterns : Cross-Sectional Study
©Megan E Gregory, Lindsey N Sova, Timothy R Huerta, Ann Scheck McAlearney. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 01.11.2023..
BACKGROUND: Surveys of hospitalized patients are important for research and learning about unobservable medical issues (eg, mental health, quality of life, and symptoms), but there has been little work examining survey data quality in this population whose capacity to respond to survey items may differ from the general population.
OBJECTIVE: The aim of this study is to determine what factors drive response rates, survey drop-offs, and missing data in surveys of hospitalized patients.
METHODS: Cross-sectional surveys were distributed on an inpatient tablet to patients in a large, midwestern US hospital. Three versions were tested: 1 with 174 items and 2 with 111 items; one 111-item version had missing item reminders that prompted participants when they did not answer items. Response rate, drop-off rate (abandoning survey before completion), and item missingness (skipping items) were examined to investigate data quality. Chi-square tests, Kaplan-Meyer survival curves, and distribution charts were used to compare data quality among survey versions. Response duration was computed for each version.
RESULTS: Overall, 2981 patients responded. Response rate did not differ between the 174- and 111-item versions (81.7% vs 83%, P=.53). Drop-off was significantly reduced when the survey was shortened (65.7% vs 20.2% of participants dropped off, P<.001). Approximately one-quarter of participants dropped off by item 120, with over half dropping off by item 158. The percentage of participants with missing data decreased substantially when missing item reminders were added (77.2% vs 31.7% of participants, P<.001). The mean percentage of items with missing data was reduced in the shorter survey (40.7% vs 20.3% of items missing); with missing item reminders, the percentage of items with missing data was further reduced (20.3% vs 11.7% of items missing). Across versions, for the median participant, each item added 24.6 seconds to a survey's duration.
CONCLUSIONS: Hospitalized patients may have a higher tolerance for longer surveys than the general population, but surveys given to hospitalized patients should have a maximum of 120 items to ensure high rates of completion. Missing item prompts should be used to reduce missing data. Future research should examine generalizability to nonhospitalized individuals.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2023 |
|---|---|
| Erschienen: |
2023 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:25 |
|---|---|
| Enthalten in: |
Journal of medical Internet research - 25(2023) vom: 01. Nov., Seite e48236 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Gregory, Megan E [VerfasserIn] |
|---|
| Links: |
|---|
| Anmerkungen: |
Date Completed 02.11.2023 Date Revised 10.02.2024 published: Electronic Citation Status MEDLINE |
|---|
| doi: |
10.2196/48236 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM364020598 |
|---|
| LEADER | 01000caa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM364020598 | ||
| 003 | DE-627 | ||
| 005 | 20240210232835.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231226s2023 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.2196/48236 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1287.xml |
| 035 | |a (DE-627)NLM364020598 | ||
| 035 | |a (NLM)37910163 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Gregory, Megan E |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Implications for Electronic Surveys in Inpatient Settings Based on Patient Survey Response Patterns |b Cross-Sectional Study |
| 264 | 1 | |c 2023 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 02.11.2023 | ||
| 500 | |a Date Revised 10.02.2024 | ||
| 500 | |a published: Electronic | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a ©Megan E Gregory, Lindsey N Sova, Timothy R Huerta, Ann Scheck McAlearney. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 01.11.2023. | ||
| 520 | |a BACKGROUND: Surveys of hospitalized patients are important for research and learning about unobservable medical issues (eg, mental health, quality of life, and symptoms), but there has been little work examining survey data quality in this population whose capacity to respond to survey items may differ from the general population | ||
| 520 | |a OBJECTIVE: The aim of this study is to determine what factors drive response rates, survey drop-offs, and missing data in surveys of hospitalized patients | ||
| 520 | |a METHODS: Cross-sectional surveys were distributed on an inpatient tablet to patients in a large, midwestern US hospital. Three versions were tested: 1 with 174 items and 2 with 111 items; one 111-item version had missing item reminders that prompted participants when they did not answer items. Response rate, drop-off rate (abandoning survey before completion), and item missingness (skipping items) were examined to investigate data quality. Chi-square tests, Kaplan-Meyer survival curves, and distribution charts were used to compare data quality among survey versions. Response duration was computed for each version | ||
| 520 | |a RESULTS: Overall, 2981 patients responded. Response rate did not differ between the 174- and 111-item versions (81.7% vs 83%, P=.53). Drop-off was significantly reduced when the survey was shortened (65.7% vs 20.2% of participants dropped off, P<.001). Approximately one-quarter of participants dropped off by item 120, with over half dropping off by item 158. The percentage of participants with missing data decreased substantially when missing item reminders were added (77.2% vs 31.7% of participants, P<.001). The mean percentage of items with missing data was reduced in the shorter survey (40.7% vs 20.3% of items missing); with missing item reminders, the percentage of items with missing data was further reduced (20.3% vs 11.7% of items missing). Across versions, for the median participant, each item added 24.6 seconds to a survey's duration | ||
| 520 | |a CONCLUSIONS: Hospitalized patients may have a higher tolerance for longer surveys than the general population, but surveys given to hospitalized patients should have a maximum of 120 items to ensure high rates of completion. Missing item prompts should be used to reduce missing data. Future research should examine generalizability to nonhospitalized individuals | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a Research Support, U.S. Gov't, Non-P.H.S. | |
| 650 | 4 | |a cross-sectional study | |
| 650 | 4 | |a data quality | |
| 650 | 4 | |a electronic survey | |
| 650 | 4 | |a hospitalization | |
| 650 | 4 | |a mental health | |
| 650 | 4 | |a patient experience | |
| 650 | 4 | |a patient satisfaction | |
| 650 | 4 | |a patient surveys | |
| 650 | 4 | |a quality of life | |
| 650 | 4 | |a surveys | |
| 650 | 4 | |a symptoms | |
| 700 | 1 | |a Sova, Lindsey N |e verfasserin |4 aut | |
| 700 | 1 | |a Huerta, Timothy R |e verfasserin |4 aut | |
| 700 | 1 | |a McAlearney, Ann Scheck |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Journal of medical Internet research |d 1999 |g 25(2023) vom: 01. Nov., Seite e48236 |w (DE-627)NLM116127104 |x 1438-8871 |7 nnns |
| 773 | 1 | 8 | |g volume:25 |g year:2023 |g day:01 |g month:11 |g pages:e48236 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.2196/48236 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 25 |j 2023 |b 01 |c 11 |h e48236 | ||