Conversational Agents in Health Care : Expert Interviews to Inform the Definition, Classification, and Conceptual Framework
©Laura Martinengo, Xiaowen Lin, Ahmad Ishqi Jabir, Tobias Kowatsch, Rifat Atun, Josip Car, Lorainne Tudor Car. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 01.11.2023..
BACKGROUND: Conversational agents (CAs), or chatbots, are computer programs that simulate conversations with humans. The use of CAs in health care settings is recent and rapidly increasing, which often translates to poor reporting of the CA development and evaluation processes and unreliable research findings. We developed and published a conceptual framework, designing, developing, evaluating, and implementing a smartphone-delivered, rule-based conversational agent (DISCOVER), consisting of 3 iterative stages of CA design, development, and evaluation and implementation, complemented by 2 cross-cutting themes (user-centered design and data privacy and security).
OBJECTIVE: This study aims to perform in-depth, semistructured interviews with multidisciplinary experts in health care CAs to share their views on the definition and classification of health care CAs and evaluate and validate the DISCOVER conceptual framework.
METHODS: We conducted one-on-one semistructured interviews via Zoom (Zoom Video Communications) with 12 multidisciplinary CA experts using an interview guide based on our framework. The interviews were audio recorded, transcribed by the research team, and analyzed using thematic analysis.
RESULTS: Following participants' input, we defined CAs as digital interfaces that use natural language to engage in a synchronous dialogue using ≥1 communication modality, such as text, voice, images, or video. CAs were classified by 13 categories: response generation method, input and output modalities, CA purpose, deployment platform, CA development modality, appearance, length of interaction, type of CA-user interaction, dialogue initiation, communication style, CA personality, human support, and type of health care intervention. Experts considered that the conceptual framework could be adapted for artificial intelligence-based CAs. However, despite recent advances in artificial intelligence, including large language models, the technology is not able to ensure safety and reliability in health care settings. Finally, aligned with participants' feedback, we present an updated iteration of the conceptual framework for health care conversational agents (CHAT) with key considerations for CA design, development, and evaluation and implementation, complemented by 3 cross-cutting themes: ethics, user involvement, and data privacy and security.
CONCLUSIONS: We present an expanded, validated CHAT and aim at guiding researchers from a variety of backgrounds and with different levels of expertise in the design, development, and evaluation and implementation of rule-based CAs in health care settings.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2023 |
|---|---|
| Erschienen: |
2023 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:25 |
|---|---|
| Enthalten in: |
Journal of medical Internet research - 25(2023) vom: 01. Nov., Seite e50767 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Martinengo, Laura [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
Chatbot |
|---|
| Anmerkungen: |
Date Completed 02.11.2023 Date Revised 18.11.2023 published: Electronic Citation Status MEDLINE |
|---|
| doi: |
10.2196/50767 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM364020490 |
|---|
| LEADER | 01000naa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM364020490 | ||
| 003 | DE-627 | ||
| 005 | 20231226094557.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231226s2023 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.2196/50767 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1213.xml |
| 035 | |a (DE-627)NLM364020490 | ||
| 035 | |a (NLM)37910153 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Martinengo, Laura |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Conversational Agents in Health Care |b Expert Interviews to Inform the Definition, Classification, and Conceptual Framework |
| 264 | 1 | |c 2023 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 02.11.2023 | ||
| 500 | |a Date Revised 18.11.2023 | ||
| 500 | |a published: Electronic | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a ©Laura Martinengo, Xiaowen Lin, Ahmad Ishqi Jabir, Tobias Kowatsch, Rifat Atun, Josip Car, Lorainne Tudor Car. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 01.11.2023. | ||
| 520 | |a BACKGROUND: Conversational agents (CAs), or chatbots, are computer programs that simulate conversations with humans. The use of CAs in health care settings is recent and rapidly increasing, which often translates to poor reporting of the CA development and evaluation processes and unreliable research findings. We developed and published a conceptual framework, designing, developing, evaluating, and implementing a smartphone-delivered, rule-based conversational agent (DISCOVER), consisting of 3 iterative stages of CA design, development, and evaluation and implementation, complemented by 2 cross-cutting themes (user-centered design and data privacy and security) | ||
| 520 | |a OBJECTIVE: This study aims to perform in-depth, semistructured interviews with multidisciplinary experts in health care CAs to share their views on the definition and classification of health care CAs and evaluate and validate the DISCOVER conceptual framework | ||
| 520 | |a METHODS: We conducted one-on-one semistructured interviews via Zoom (Zoom Video Communications) with 12 multidisciplinary CA experts using an interview guide based on our framework. The interviews were audio recorded, transcribed by the research team, and analyzed using thematic analysis | ||
| 520 | |a RESULTS: Following participants' input, we defined CAs as digital interfaces that use natural language to engage in a synchronous dialogue using ≥1 communication modality, such as text, voice, images, or video. CAs were classified by 13 categories: response generation method, input and output modalities, CA purpose, deployment platform, CA development modality, appearance, length of interaction, type of CA-user interaction, dialogue initiation, communication style, CA personality, human support, and type of health care intervention. Experts considered that the conceptual framework could be adapted for artificial intelligence-based CAs. However, despite recent advances in artificial intelligence, including large language models, the technology is not able to ensure safety and reliability in health care settings. Finally, aligned with participants' feedback, we present an updated iteration of the conceptual framework for health care conversational agents (CHAT) with key considerations for CA design, development, and evaluation and implementation, complemented by 3 cross-cutting themes: ethics, user involvement, and data privacy and security | ||
| 520 | |a CONCLUSIONS: We present an expanded, validated CHAT and aim at guiding researchers from a variety of backgrounds and with different levels of expertise in the design, development, and evaluation and implementation of rule-based CAs in health care settings | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a Research Support, Non-U.S. Gov't | |
| 650 | 4 | |a chatbot | |
| 650 | 4 | |a conceptual framework | |
| 650 | 4 | |a conversational agent | |
| 650 | 4 | |a digital health | |
| 650 | 4 | |a expert interview | |
| 650 | 4 | |a mHealth | |
| 650 | 4 | |a mobile health | |
| 650 | 4 | |a mobile phone | |
| 700 | 1 | |a Lin, Xiaowen |e verfasserin |4 aut | |
| 700 | 1 | |a Jabir, Ahmad Ishqi |e verfasserin |4 aut | |
| 700 | 1 | |a Kowatsch, Tobias |e verfasserin |4 aut | |
| 700 | 1 | |a Atun, Rifat |e verfasserin |4 aut | |
| 700 | 1 | |a Car, Josip |e verfasserin |4 aut | |
| 700 | 1 | |a Tudor Car, Lorainne |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Journal of medical Internet research |d 1999 |g 25(2023) vom: 01. Nov., Seite e50767 |w (DE-627)NLM116127104 |x 1438-8871 |7 nnns |
| 773 | 1 | 8 | |g volume:25 |g year:2023 |g day:01 |g month:11 |g pages:e50767 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.2196/50767 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 25 |j 2023 |b 01 |c 11 |h e50767 | ||