ChatGPT vs. neurologists : a cross-sectional study investigating preference, satisfaction ratings and perceived empathy in responses among people living with multiple sclerosis
© 2024. The Author(s)..
BACKGROUND: ChatGPT is an open-source natural language processing software that replies to users' queries. We conducted a cross-sectional study to assess people living with Multiple Sclerosis' (PwMS) preferences, satisfaction, and empathy toward two alternate responses to four frequently-asked questions, one authored by a group of neurologists, the other by ChatGPT.
METHODS: An online form was sent through digital communication platforms. PwMS were blind to the author of each response and were asked to express their preference for each alternate response to the four questions. The overall satisfaction was assessed using a Likert scale (1-5); the Consultation and Relational Empathy scale was employed to assess perceived empathy.
RESULTS: We included 1133 PwMS (age, 45.26 ± 11.50 years; females, 68.49%). ChatGPT's responses showed significantly higher empathy scores (Coeff = 1.38; 95% CI = 0.65, 2.11; p > z < 0.01), when compared with neurologists' responses. No association was found between ChatGPT' responses and mean satisfaction (Coeff = 0.03; 95% CI = - 0.01, 0.07; p = 0.157). College graduate, when compared with high school education responder, had significantly lower likelihood to prefer ChatGPT response (IRR = 0.87; 95% CI = 0.79, 0.95; p < 0.01).
CONCLUSIONS: ChatGPT-authored responses provided higher empathy than neurologists. Although AI holds potential, physicians should prepare to interact with increasingly digitized patients and guide them on responsible AI use. Future development should consider tailoring AIs' responses to individual characteristics. Within the progressive digitalization of the population, ChatGPT could emerge as a helpful support in healthcare management rather than an alternative.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2024 |
|---|---|
| Erschienen: |
2024 |
| Enthalten in: |
Zur Gesamtaufnahme - year:2024 |
|---|---|
| Enthalten in: |
Journal of neurology - (2024) vom: 03. Apr. |
| Sprache: |
Englisch |
|---|
| Links: |
|---|
| Themen: |
Artificial intelligence |
|---|
| Anmerkungen: |
Date Revised 03.04.2024 published: Print-Electronic Citation Status Publisher |
|---|
| doi: |
10.1007/s00415-024-12328-x |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM370576624 |
|---|
| LEADER | 01000naa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM370576624 | ||
| 003 | DE-627 | ||
| 005 | 20240404000855.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 240404s2024 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1007/s00415-024-12328-x |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1363.xml |
| 035 | |a (DE-627)NLM370576624 | ||
| 035 | |a (NLM)38568227 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Maida, Elisabetta |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a ChatGPT vs. neurologists |b a cross-sectional study investigating preference, satisfaction ratings and perceived empathy in responses among people living with multiple sclerosis |
| 264 | 1 | |c 2024 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Revised 03.04.2024 | ||
| 500 | |a published: Print-Electronic | ||
| 500 | |a Citation Status Publisher | ||
| 520 | |a © 2024. The Author(s). | ||
| 520 | |a BACKGROUND: ChatGPT is an open-source natural language processing software that replies to users' queries. We conducted a cross-sectional study to assess people living with Multiple Sclerosis' (PwMS) preferences, satisfaction, and empathy toward two alternate responses to four frequently-asked questions, one authored by a group of neurologists, the other by ChatGPT | ||
| 520 | |a METHODS: An online form was sent through digital communication platforms. PwMS were blind to the author of each response and were asked to express their preference for each alternate response to the four questions. The overall satisfaction was assessed using a Likert scale (1-5); the Consultation and Relational Empathy scale was employed to assess perceived empathy | ||
| 520 | |a RESULTS: We included 1133 PwMS (age, 45.26 ± 11.50 years; females, 68.49%). ChatGPT's responses showed significantly higher empathy scores (Coeff = 1.38; 95% CI = 0.65, 2.11; p > z < 0.01), when compared with neurologists' responses. No association was found between ChatGPT' responses and mean satisfaction (Coeff = 0.03; 95% CI = - 0.01, 0.07; p = 0.157). College graduate, when compared with high school education responder, had significantly lower likelihood to prefer ChatGPT response (IRR = 0.87; 95% CI = 0.79, 0.95; p < 0.01) | ||
| 520 | |a CONCLUSIONS: ChatGPT-authored responses provided higher empathy than neurologists. Although AI holds potential, physicians should prepare to interact with increasingly digitized patients and guide them on responsible AI use. Future development should consider tailoring AIs' responses to individual characteristics. Within the progressive digitalization of the population, ChatGPT could emerge as a helpful support in healthcare management rather than an alternative | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a Artificial intelligence | |
| 650 | 4 | |a Large language model | |
| 650 | 4 | |a Machine learning | |
| 650 | 4 | |a Multiple sclerosis | |
| 700 | 1 | |a Moccia, Marcello |e verfasserin |4 aut | |
| 700 | 1 | |a Palladino, Raffaele |e verfasserin |4 aut | |
| 700 | 1 | |a Borriello, Giovanna |e verfasserin |4 aut | |
| 700 | 1 | |a Affinito, Giuseppina |e verfasserin |4 aut | |
| 700 | 1 | |a Clerico, Marinella |e verfasserin |4 aut | |
| 700 | 1 | |a Repice, Anna Maria |e verfasserin |4 aut | |
| 700 | 1 | |a Di Sapio, Alessia |e verfasserin |4 aut | |
| 700 | 1 | |a Iodice, Rosa |e verfasserin |4 aut | |
| 700 | 1 | |a Spiezia, Antonio Luca |e verfasserin |4 aut | |
| 700 | 1 | |a Sparaco, Maddalena |e verfasserin |4 aut | |
| 700 | 1 | |a Miele, Giuseppina |e verfasserin |4 aut | |
| 700 | 1 | |a Bile, Floriana |e verfasserin |4 aut | |
| 700 | 1 | |a Scandurra, Cristiano |e verfasserin |4 aut | |
| 700 | 1 | |a Ferraro, Diana |e verfasserin |4 aut | |
| 700 | 1 | |a Stromillo, Maria Laura |e verfasserin |4 aut | |
| 700 | 1 | |a Docimo, Renato |e verfasserin |4 aut | |
| 700 | 1 | |a De Martino, Antonio |e verfasserin |4 aut | |
| 700 | 1 | |a Mancinelli, Luca |e verfasserin |4 aut | |
| 700 | 1 | |a Abbadessa, Gianmarco |e verfasserin |4 aut | |
| 700 | 1 | |a Smolik, Krzysztof |e verfasserin |4 aut | |
| 700 | 1 | |a Lorusso, Lorenzo |e verfasserin |4 aut | |
| 700 | 1 | |a Leone, Maurizio |e verfasserin |4 aut | |
| 700 | 1 | |a Leveraro, Elisa |e verfasserin |4 aut | |
| 700 | 1 | |a Lauro, Francesca |e verfasserin |4 aut | |
| 700 | 1 | |a Trojsi, Francesca |e verfasserin |4 aut | |
| 700 | 1 | |a Streito, Lidia Mislin |e verfasserin |4 aut | |
| 700 | 1 | |a Gabriele, Francesca |e verfasserin |4 aut | |
| 700 | 1 | |a Marinelli, Fabiana |e verfasserin |4 aut | |
| 700 | 1 | |a Ianniello, Antonio |e verfasserin |4 aut | |
| 700 | 1 | |a De Santis, Federica |e verfasserin |4 aut | |
| 700 | 1 | |a Foschi, Matteo |e verfasserin |4 aut | |
| 700 | 1 | |a De Stefano, Nicola |e verfasserin |4 aut | |
| 700 | 1 | |a Morra, Vincenzo Brescia |e verfasserin |4 aut | |
| 700 | 1 | |a Bisecco, Alvino |e verfasserin |4 aut | |
| 700 | 1 | |a Coghe, Giancarlo |e verfasserin |4 aut | |
| 700 | 1 | |a Cocco, Eleonora |e verfasserin |4 aut | |
| 700 | 1 | |a Romoli, Michele |e verfasserin |4 aut | |
| 700 | 1 | |a Corea, Francesco |e verfasserin |4 aut | |
| 700 | 1 | |a Leocani, Letizia |e verfasserin |4 aut | |
| 700 | 1 | |a Frau, Jessica |e verfasserin |4 aut | |
| 700 | 1 | |a Sacco, Simona |e verfasserin |4 aut | |
| 700 | 1 | |a Inglese, Matilde |e verfasserin |4 aut | |
| 700 | 1 | |a Carotenuto, Antonio |e verfasserin |4 aut | |
| 700 | 1 | |a Lanzillo, Roberta |e verfasserin |4 aut | |
| 700 | 1 | |a Padovani, Alessandro |e verfasserin |4 aut | |
| 700 | 1 | |a Triassi, Maria |e verfasserin |4 aut | |
| 700 | 1 | |a Bonavita, Simona |e verfasserin |4 aut | |
| 700 | 1 | |a Lavorgna, Luigi |e verfasserin |4 aut | |
| 700 | 0 | |a Digital Technologies, Web, Social Media Study Group of the Italian Society of Neurology (SIN) |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Journal of neurology |d 1974 |g (2024) vom: 03. Apr. |w (DE-627)NLM000508543 |x 1432-1459 |7 nnns |
| 773 | 1 | 8 | |g year:2024 |g day:03 |g month:04 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1007/s00415-024-12328-x |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |j 2024 |b 03 |c 04 | ||