A chatbot-delivered intervention for optimizing social media use and reducing perceived isolation among rural-living LGBTQ+ youth : Development, acceptability, usability, satisfaction, and utility
© 2023 The Authors..
Background: Lesbian, gay, bisexual, transgender, and queer/questioning (LGBTQ+) youth are at higher risk of isolation and depression than their heterosexual peers. Having access to tailored mental health resources is a documented concern for rural living LGBTQ+ youth. Social media provides access to connections to a broader and like-minded community of peers, but it also is a vehicle for negative interactions. We developed REALbot, an automated, social media-based educational intervention to improve social media efficacy, reduce perceived isolation, and bolster connections for rural living LGBTQ+ youth. This report presents data on the acceptability, feasibility, and utility of REALbot among its target audience of rural living LGBTQ+ youth.
Methods: We conducted a week-long exploratory study with a single non-comparison group of 20 rural-living LGBTQ+ youth aged 14-19 recruited from social media to test our Facebook- and Instagram-delivered chatbot. We assessed pre- and post-test scores of social media self-efficacy, social isolation (4-item Patient-Reported Outcomes Measurement System - PROMIS), and depressive symptoms (Patient Health Questionnaire, Adolescent Version - PHQ-A). At post-test, we assessed acceptability (User Experience Questionnaire - UEQ-S), usability (Chatbot Usability Questionnaire -CUQ and Post-Study Satisfaction and Usability Questionnaire -PSSUQ), and satisfaction with the chatbot (Client Satisfaction Questionnaire - CSQ), along with two open-ended questions on 'likes' and 'dislikes' about the intervention. We compared pre- and post-test scores with standard univariate statistics. Means and standard deviations were calculated for usability, acceptability, and satisfaction. To analyze the responses to post-test open-end questions, we used a content analysis approach.
Results: Acceptability of REALbot was high with UEQ-S 5.3 out of 7 (SD = 1.1) and received high usability scores with CUQ and PSSUQ (mean score (M) = 78.0, SD = 14.5 and M = 86.9, SD = 25.2, respectively), as well as high user satisfaction with CSQ (M = 24.9, SD = 5.4). Themes related to user 'likes' and 'dislikes' were organized in two main categories: usability and content provided. Participants were engaged with the chatbot, sending an average of 49.3 messages (SD = 43.6, median = 30). Pre-/post- changes in scores of perceived isolation, depressive symptoms and social media self-efficacy were not significant (p's > 0.08).
Conclusion: REALbot deployment was found to be feasible and acceptable, with good usability and user satisfaction scores. Participants reported changes from pre- to post-test in most outcomes of interest and effect sizes were small to medium. Additional development and a formal evaluation of feasibility and engagement with behavioral targets is warranted.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2023 |
|---|---|
| Erschienen: |
2023 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:34 |
|---|---|
| Enthalten in: |
Internet interventions - 34(2023) vom: 15. Dez., Seite 100668 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Escobar-Viera, César G [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
Journal Article |
|---|
| Anmerkungen: |
Date Revised 20.10.2023 published: Electronic-eCollection Citation Status PubMed-not-MEDLINE |
|---|
| doi: |
10.1016/j.invent.2023.100668 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM362431132 |
|---|
| LEADER | 01000naa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM362431132 | ||
| 003 | DE-627 | ||
| 005 | 20231226091229.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231226s2023 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1016/j.invent.2023.100668 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1208.xml |
| 035 | |a (DE-627)NLM362431132 | ||
| 035 | |a (NLM)37746640 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Escobar-Viera, César G |e verfasserin |4 aut | |
| 245 | 1 | 2 | |a A chatbot-delivered intervention for optimizing social media use and reducing perceived isolation among rural-living LGBTQ+ youth |b Development, acceptability, usability, satisfaction, and utility |
| 264 | 1 | |c 2023 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Revised 20.10.2023 | ||
| 500 | |a published: Electronic-eCollection | ||
| 500 | |a Citation Status PubMed-not-MEDLINE | ||
| 520 | |a © 2023 The Authors. | ||
| 520 | |a Background: Lesbian, gay, bisexual, transgender, and queer/questioning (LGBTQ+) youth are at higher risk of isolation and depression than their heterosexual peers. Having access to tailored mental health resources is a documented concern for rural living LGBTQ+ youth. Social media provides access to connections to a broader and like-minded community of peers, but it also is a vehicle for negative interactions. We developed REALbot, an automated, social media-based educational intervention to improve social media efficacy, reduce perceived isolation, and bolster connections for rural living LGBTQ+ youth. This report presents data on the acceptability, feasibility, and utility of REALbot among its target audience of rural living LGBTQ+ youth | ||
| 520 | |a Methods: We conducted a week-long exploratory study with a single non-comparison group of 20 rural-living LGBTQ+ youth aged 14-19 recruited from social media to test our Facebook- and Instagram-delivered chatbot. We assessed pre- and post-test scores of social media self-efficacy, social isolation (4-item Patient-Reported Outcomes Measurement System - PROMIS), and depressive symptoms (Patient Health Questionnaire, Adolescent Version - PHQ-A). At post-test, we assessed acceptability (User Experience Questionnaire - UEQ-S), usability (Chatbot Usability Questionnaire -CUQ and Post-Study Satisfaction and Usability Questionnaire -PSSUQ), and satisfaction with the chatbot (Client Satisfaction Questionnaire - CSQ), along with two open-ended questions on 'likes' and 'dislikes' about the intervention. We compared pre- and post-test scores with standard univariate statistics. Means and standard deviations were calculated for usability, acceptability, and satisfaction. To analyze the responses to post-test open-end questions, we used a content analysis approach | ||
| 520 | |a Results: Acceptability of REALbot was high with UEQ-S 5.3 out of 7 (SD = 1.1) and received high usability scores with CUQ and PSSUQ (mean score (M) = 78.0, SD = 14.5 and M = 86.9, SD = 25.2, respectively), as well as high user satisfaction with CSQ (M = 24.9, SD = 5.4). Themes related to user 'likes' and 'dislikes' were organized in two main categories: usability and content provided. Participants were engaged with the chatbot, sending an average of 49.3 messages (SD = 43.6, median = 30). Pre-/post- changes in scores of perceived isolation, depressive symptoms and social media self-efficacy were not significant (p's > 0.08) | ||
| 520 | |a Conclusion: REALbot deployment was found to be feasible and acceptable, with good usability and user satisfaction scores. Participants reported changes from pre- to post-test in most outcomes of interest and effect sizes were small to medium. Additional development and a formal evaluation of feasibility and engagement with behavioral targets is warranted | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a LGBT youth | |
| 650 | 4 | |a Rural | |
| 650 | 4 | |a Social isolation | |
| 650 | 4 | |a Social media, chatbot | |
| 700 | 1 | |a Porta, Giovanna |e verfasserin |4 aut | |
| 700 | 1 | |a Coulter, Robert W S |e verfasserin |4 aut | |
| 700 | 1 | |a Martina, Jamie |e verfasserin |4 aut | |
| 700 | 1 | |a Goldbach, Jeremy |e verfasserin |4 aut | |
| 700 | 1 | |a Rollman, Bruce L |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Internet interventions |d 2014 |g 34(2023) vom: 15. Dez., Seite 100668 |w (DE-627)NLM24026682X |x 2214-7829 |7 nnns |
| 773 | 1 | 8 | |g volume:34 |g year:2023 |g day:15 |g month:12 |g pages:100668 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1016/j.invent.2023.100668 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 34 |j 2023 |b 15 |c 12 |h 100668 | ||