Evaluating the performance of large language models : ChatGPT and Google Bard in generating differential diagnoses in clinicopathological conferences of neurodegenerative disorders
© 2023 The Authors. Brain Pathology published by John Wiley & Sons Ltd on behalf of International Society of Neuropathology..
This study explores the utility of the large language models (LLMs), specifically ChatGPT and Google Bard, in predicting neuropathologic diagnoses from clinical summaries. A total of 25 cases of neurodegenerative disorders presented at Mayo Clinic brain bank Clinico-Pathological Conferences were analyzed. The LLMs provided multiple pathologic diagnoses and their rationales, which were compared with the final clinical diagnoses made by physicians. ChatGPT-3.5, ChatGPT-4, and Google Bard correctly made primary diagnoses in 32%, 52%, and 40% of cases, respectively, while correct diagnoses were included in 76%, 84%, and 76% of cases, respectively. These findings highlight the potential of artificial intelligence tools like ChatGPT in neuropathology, suggesting they may facilitate more comprehensive discussions in clinicopathological conferences.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2024 |
|---|---|
| Erschienen: |
2024 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:34 |
|---|---|
| Enthalten in: |
Brain pathology (Zurich, Switzerland) - 34(2024), 3 vom: 08. Apr., Seite e13207 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Koga, Shunsuke [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
Artificial intelligence |
|---|
| Anmerkungen: |
Date Completed 12.04.2024 Date Revised 25.04.2024 published: Print-Electronic Citation Status MEDLINE |
|---|
| doi: |
10.1111/bpa.13207 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM360528392 |
|---|
| LEADER | 01000caa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM360528392 | ||
| 003 | DE-627 | ||
| 005 | 20240425232328.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231226s2024 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1111/bpa.13207 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1386.xml |
| 035 | |a (DE-627)NLM360528392 | ||
| 035 | |a (NLM)37553205 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Koga, Shunsuke |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Evaluating the performance of large language models |b ChatGPT and Google Bard in generating differential diagnoses in clinicopathological conferences of neurodegenerative disorders |
| 264 | 1 | |c 2024 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 12.04.2024 | ||
| 500 | |a Date Revised 25.04.2024 | ||
| 500 | |a published: Print-Electronic | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a © 2023 The Authors. Brain Pathology published by John Wiley & Sons Ltd on behalf of International Society of Neuropathology. | ||
| 520 | |a This study explores the utility of the large language models (LLMs), specifically ChatGPT and Google Bard, in predicting neuropathologic diagnoses from clinical summaries. A total of 25 cases of neurodegenerative disorders presented at Mayo Clinic brain bank Clinico-Pathological Conferences were analyzed. The LLMs provided multiple pathologic diagnoses and their rationales, which were compared with the final clinical diagnoses made by physicians. ChatGPT-3.5, ChatGPT-4, and Google Bard correctly made primary diagnoses in 32%, 52%, and 40% of cases, respectively, while correct diagnoses were included in 76%, 84%, and 76% of cases, respectively. These findings highlight the potential of artificial intelligence tools like ChatGPT in neuropathology, suggesting they may facilitate more comprehensive discussions in clinicopathological conferences | ||
| 650 | 4 | |a Letter | |
| 650 | 4 | |a CPC | |
| 650 | 4 | |a ChatGPT | |
| 650 | 4 | |a Google Bard | |
| 650 | 4 | |a artificial intelligence | |
| 650 | 4 | |a clinicopathological conference | |
| 650 | 4 | |a large language model | |
| 650 | 4 | |a neuropathology | |
| 650 | 4 | |a pathology | |
| 700 | 1 | |a Martin, Nicholas B |e verfasserin |4 aut | |
| 700 | 1 | |a Dickson, Dennis W |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Brain pathology (Zurich, Switzerland) |d 1996 |g 34(2024), 3 vom: 08. Apr., Seite e13207 |w (DE-627)NLM013232258 |x 1750-3639 |7 nnns |
| 773 | 1 | 8 | |g volume:34 |g year:2024 |g number:3 |g day:08 |g month:04 |g pages:e13207 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1111/bpa.13207 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 34 |j 2024 |e 3 |b 08 |c 04 |h e13207 | ||