Efficacy, Usability, and Acceptability of a Chatbot for Promoting COVID-19 Vaccination in Unvaccinated or Booster-Hesitant Young Adults : Pre-Post Pilot Study
©Tzu Tsun Luk, Judy Hiu Tung Lui, Man Ping Wang. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 04.10.2022..
BACKGROUND: COVID-19 vaccines are highly effective in preventing severe disease and death but are underused. Interventions to address COVID-19 vaccine hesitancy are paramount to reducing the burden of COVID-19.
OBJECTIVE: We aimed to evaluate the preliminary efficacy, usability, and acceptability of a chatbot for promoting COVID-19 vaccination and examine the factors associated with COVID-19 vaccine hesitancy.
METHODS: In November 2021, we conducted a pre-post pilot study to evaluate "Vac Chat, Fact Check," a web-based chatbot for promoting COVID-19 vaccination. We conducted a web-based survey (N=290) on COVID-19 vaccination at a university in Hong Kong. A subset of 46 participants who were either unvaccinated (n=22) or were vaccinated but hesitant to receive boosters (n=24) were selected and given access to the chatbot for a 7-day trial period. The chatbot provided information about COVID-19 vaccination (eg, efficacy and common side effects), debunked common myths about the vaccine, and included a decision aid for selecting vaccine platforms (inactivated and mRNA vaccines). The main efficacy outcome was changes in the COVID-19 Vaccine Hesitancy Scale (VHS) score (range 9-45) from preintervention (web-based survey) to postintervention (immediately posttrial). Other efficacy outcomes included changes in intention to vaccinate or receive boosters and willingness to encourage others to vaccinate on a scale from 1 (not at all) to 5 (very). Usability was assessed by the System Usability Scale (range 0-100). Linear regression was used to examine the factors associated with COVID-19 VHS scores in all survey respondents.
RESULTS: The mean (SD) age of all survey respondents was 21.4 (6.3) years, and 61% (177/290) of respondents were female. Higher eHealth literacy (B=-0.26; P<.001) and perceived danger of COVID-19 (B=-0.17; P=.009) were associated with lower COVID-19 vaccine hesitancy, adjusting for age, sex, chronic disease status, previous flu vaccination, and perceived susceptibility to COVID-19. The main efficacy outcome of COVID-19 VHS score significantly decreased from 28.6 (preintervention) to 24.5 (postintervention), with a mean difference of -4.2 (P<.001) and an effect size (Cohen d) of 0.94. The intention to vaccinate increased from 3.0 to 3.9 (P<.001) in unvaccinated participants, whereas the intention to receive boosters increased from 1.9 to 2.8 (P<.001) in booster-hesitant participants. Willingness to encourage others to vaccinate increased from 2.7 to 3.0 (P=.04). At postintervention, the median (IQR) System Usability Scale score was 72.5 (65-77.5), whereas the median (IQR) recommendation score was 7 (6-8) on a scale from 0 to 10. In a post hoc 4-month follow-up, 82% (18/22) of initially unvaccinated participants reported having received the COVID-19 vaccine, whereas 29% (7/24) of booster-hesitant participants received boosters.
CONCLUSIONS: This pilot study provided initial evidence to support the efficacy, usability, and acceptability of a chatbot for promoting COVID-19 vaccination in young adults who were unvaccinated or booster-hesitant.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2022 |
|---|---|
| Erschienen: |
2022 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:24 |
|---|---|
| Enthalten in: |
Journal of medical Internet research - 24(2022), 10 vom: 04. Okt., Seite e39063 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Luk, Tzu Tsun [VerfasserIn] |
|---|
| Links: |
|---|
| Anmerkungen: |
Date Completed 06.10.2022 Date Revised 06.11.2022 published: Electronic Citation Status MEDLINE |
|---|
| doi: |
10.2196/39063 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM346946530 |
|---|
| LEADER | 01000naa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM346946530 | ||
| 003 | DE-627 | ||
| 005 | 20231226032649.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231226s2022 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.2196/39063 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1156.xml |
| 035 | |a (DE-627)NLM346946530 | ||
| 035 | |a (NLM)36179132 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Luk, Tzu Tsun |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Efficacy, Usability, and Acceptability of a Chatbot for Promoting COVID-19 Vaccination in Unvaccinated or Booster-Hesitant Young Adults |b Pre-Post Pilot Study |
| 264 | 1 | |c 2022 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 06.10.2022 | ||
| 500 | |a Date Revised 06.11.2022 | ||
| 500 | |a published: Electronic | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a ©Tzu Tsun Luk, Judy Hiu Tung Lui, Man Ping Wang. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 04.10.2022. | ||
| 520 | |a BACKGROUND: COVID-19 vaccines are highly effective in preventing severe disease and death but are underused. Interventions to address COVID-19 vaccine hesitancy are paramount to reducing the burden of COVID-19 | ||
| 520 | |a OBJECTIVE: We aimed to evaluate the preliminary efficacy, usability, and acceptability of a chatbot for promoting COVID-19 vaccination and examine the factors associated with COVID-19 vaccine hesitancy | ||
| 520 | |a METHODS: In November 2021, we conducted a pre-post pilot study to evaluate "Vac Chat, Fact Check," a web-based chatbot for promoting COVID-19 vaccination. We conducted a web-based survey (N=290) on COVID-19 vaccination at a university in Hong Kong. A subset of 46 participants who were either unvaccinated (n=22) or were vaccinated but hesitant to receive boosters (n=24) were selected and given access to the chatbot for a 7-day trial period. The chatbot provided information about COVID-19 vaccination (eg, efficacy and common side effects), debunked common myths about the vaccine, and included a decision aid for selecting vaccine platforms (inactivated and mRNA vaccines). The main efficacy outcome was changes in the COVID-19 Vaccine Hesitancy Scale (VHS) score (range 9-45) from preintervention (web-based survey) to postintervention (immediately posttrial). Other efficacy outcomes included changes in intention to vaccinate or receive boosters and willingness to encourage others to vaccinate on a scale from 1 (not at all) to 5 (very). Usability was assessed by the System Usability Scale (range 0-100). Linear regression was used to examine the factors associated with COVID-19 VHS scores in all survey respondents | ||
| 520 | |a RESULTS: The mean (SD) age of all survey respondents was 21.4 (6.3) years, and 61% (177/290) of respondents were female. Higher eHealth literacy (B=-0.26; P<.001) and perceived danger of COVID-19 (B=-0.17; P=.009) were associated with lower COVID-19 vaccine hesitancy, adjusting for age, sex, chronic disease status, previous flu vaccination, and perceived susceptibility to COVID-19. The main efficacy outcome of COVID-19 VHS score significantly decreased from 28.6 (preintervention) to 24.5 (postintervention), with a mean difference of -4.2 (P<.001) and an effect size (Cohen d) of 0.94. The intention to vaccinate increased from 3.0 to 3.9 (P<.001) in unvaccinated participants, whereas the intention to receive boosters increased from 1.9 to 2.8 (P<.001) in booster-hesitant participants. Willingness to encourage others to vaccinate increased from 2.7 to 3.0 (P=.04). At postintervention, the median (IQR) System Usability Scale score was 72.5 (65-77.5), whereas the median (IQR) recommendation score was 7 (6-8) on a scale from 0 to 10. In a post hoc 4-month follow-up, 82% (18/22) of initially unvaccinated participants reported having received the COVID-19 vaccine, whereas 29% (7/24) of booster-hesitant participants received boosters | ||
| 520 | |a CONCLUSIONS: This pilot study provided initial evidence to support the efficacy, usability, and acceptability of a chatbot for promoting COVID-19 vaccination in young adults who were unvaccinated or booster-hesitant | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a Research Support, Non-U.S. Gov't | |
| 650 | 4 | |a COVID-19 | |
| 650 | 4 | |a Chinese | |
| 650 | 4 | |a booster | |
| 650 | 4 | |a booster hesitancy | |
| 650 | 4 | |a chatbot | |
| 650 | 4 | |a chatbot usability | |
| 650 | 4 | |a conversational agent | |
| 650 | 4 | |a coronavirus | |
| 650 | 4 | |a health intervention | |
| 650 | 4 | |a health promotion | |
| 650 | 4 | |a immunization | |
| 650 | 4 | |a pandemic | |
| 650 | 4 | |a students | |
| 650 | 4 | |a university students | |
| 650 | 4 | |a vaccine | |
| 650 | 4 | |a vaccine hesitancy | |
| 650 | 4 | |a virtual assistant | |
| 650 | 4 | |a web-based survey | |
| 650 | 4 | |a young adult | |
| 650 | 4 | |a youth | |
| 650 | 7 | |a COVID-19 Vaccines |2 NLM | |
| 650 | 7 | |a Influenza Vaccines |2 NLM | |
| 700 | 1 | |a Lui, Judy Hiu Tung |e verfasserin |4 aut | |
| 700 | 1 | |a Wang, Man Ping |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Journal of medical Internet research |d 1999 |g 24(2022), 10 vom: 04. Okt., Seite e39063 |w (DE-627)NLM116127104 |x 1438-8871 |7 nnns |
| 773 | 1 | 8 | |g volume:24 |g year:2022 |g number:10 |g day:04 |g month:10 |g pages:e39063 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.2196/39063 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 24 |j 2022 |e 10 |b 04 |c 10 |h e39063 | ||