Identifying depression and its determinants upon initiating treatment : ChatGPT versus primary care physicians
© Author(s) (or their employer(s)) 2023. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ..
OBJECTIVE: To compare evaluations of depressive episodes and suggested treatment protocols generated by Chat Generative Pretrained Transformer (ChatGPT)-3 and ChatGPT-4 with the recommendations of primary care physicians.
METHODS: Vignettes were input to the ChatGPT interface. These vignettes focused primarily on hypothetical patients with symptoms of depression during initial consultations. The creators of these vignettes meticulously designed eight distinct versions in which they systematically varied patient attributes (sex, socioeconomic status (blue collar worker or white collar worker) and depression severity (mild or severe)). Each variant was subsequently introduced into ChatGPT-3.5 and ChatGPT-4. Each vignette was repeated 10 times to ensure consistency and reliability of the ChatGPT responses.
RESULTS: For mild depression, ChatGPT-3.5 and ChatGPT-4 recommended psychotherapy in 95.0% and 97.5% of cases, respectively. Primary care physicians, however, recommended psychotherapy in only 4.3% of cases. For severe cases, ChatGPT favoured an approach that combined psychotherapy, while primary care physicians recommended a combined approach. The pharmacological recommendations of ChatGPT-3.5 and ChatGPT-4 showed a preference for exclusive use of antidepressants (74% and 68%, respectively), in contrast with primary care physicians, who typically recommended a mix of antidepressants and anxiolytics/hypnotics (67.4%). Unlike primary care physicians, ChatGPT showed no gender or socioeconomic biases in its recommendations.
CONCLUSION: ChatGPT-3.5 and ChatGPT-4 aligned well with accepted guidelines for managing mild and severe depression, without showing the gender or socioeconomic biases observed among primary care physicians. Despite the suggested potential benefit of using atificial intelligence (AI) chatbots like ChatGPT to enhance clinical decision making, further research is needed to refine AI recommendations for severe cases and to consider potential risks and ethical issues.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2023 |
|---|---|
| Erschienen: |
2023 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:11 |
|---|---|
| Enthalten in: |
Family medicine and community health - 11(2023), 4 vom: 04. Sept. |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Levkovich, Inbar [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
Anti-Anxiety Agents |
|---|
| Anmerkungen: |
Date Completed 23.10.2023 Date Revised 23.10.2023 published: Print Citation Status MEDLINE |
|---|
| doi: |
10.1136/fmch-2023-002391 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM363377344 |
|---|
| LEADER | 01000naa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM363377344 | ||
| 003 | DE-627 | ||
| 005 | 20231226093221.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231226s2023 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1136/fmch-2023-002391 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1211.xml |
| 035 | |a (DE-627)NLM363377344 | ||
| 035 | |a (NLM)37844967 | ||
| 035 | |a (PII)e002391 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Levkovich, Inbar |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Identifying depression and its determinants upon initiating treatment |b ChatGPT versus primary care physicians |
| 264 | 1 | |c 2023 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 23.10.2023 | ||
| 500 | |a Date Revised 23.10.2023 | ||
| 500 | |a published: Print | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a © Author(s) (or their employer(s)) 2023. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ. | ||
| 520 | |a OBJECTIVE: To compare evaluations of depressive episodes and suggested treatment protocols generated by Chat Generative Pretrained Transformer (ChatGPT)-3 and ChatGPT-4 with the recommendations of primary care physicians | ||
| 520 | |a METHODS: Vignettes were input to the ChatGPT interface. These vignettes focused primarily on hypothetical patients with symptoms of depression during initial consultations. The creators of these vignettes meticulously designed eight distinct versions in which they systematically varied patient attributes (sex, socioeconomic status (blue collar worker or white collar worker) and depression severity (mild or severe)). Each variant was subsequently introduced into ChatGPT-3.5 and ChatGPT-4. Each vignette was repeated 10 times to ensure consistency and reliability of the ChatGPT responses | ||
| 520 | |a RESULTS: For mild depression, ChatGPT-3.5 and ChatGPT-4 recommended psychotherapy in 95.0% and 97.5% of cases, respectively. Primary care physicians, however, recommended psychotherapy in only 4.3% of cases. For severe cases, ChatGPT favoured an approach that combined psychotherapy, while primary care physicians recommended a combined approach. The pharmacological recommendations of ChatGPT-3.5 and ChatGPT-4 showed a preference for exclusive use of antidepressants (74% and 68%, respectively), in contrast with primary care physicians, who typically recommended a mix of antidepressants and anxiolytics/hypnotics (67.4%). Unlike primary care physicians, ChatGPT showed no gender or socioeconomic biases in its recommendations | ||
| 520 | |a CONCLUSION: ChatGPT-3.5 and ChatGPT-4 aligned well with accepted guidelines for managing mild and severe depression, without showing the gender or socioeconomic biases observed among primary care physicians. Despite the suggested potential benefit of using atificial intelligence (AI) chatbots like ChatGPT to enhance clinical decision making, further research is needed to refine AI recommendations for severe cases and to consider potential risks and ethical issues | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a Depression | |
| 650 | 4 | |a Family Health | |
| 650 | 4 | |a Family Practice | |
| 650 | 4 | |a General Practice | |
| 650 | 4 | |a Mental Health | |
| 650 | 7 | |a Anti-Anxiety Agents |2 NLM | |
| 650 | 7 | |a Choline O-Acetyltransferase |2 NLM | |
| 650 | 7 | |a EC 2.3.1.6 |2 NLM | |
| 650 | 7 | |a Antidepressive Agents |2 NLM | |
| 700 | 1 | |a Elyoseph, Zohar |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Family medicine and community health |d 2016 |g 11(2023), 4 vom: 04. Sept. |w (DE-627)NLM276367251 |x 2009-8774 |7 nnns |
| 773 | 1 | 8 | |g volume:11 |g year:2023 |g number:4 |g day:04 |g month:09 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1136/fmch-2023-002391 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 11 |j 2023 |e 4 |b 04 |c 09 | ||