Inter-Rater Variability in the Evaluation of Lung Ultrasound in Videos Acquired from COVID-19 Patients
Lung ultrasound (LUS) allows for the detection of a series of manifestations of COVID-19, such as B-lines and consolidations. The objective of this work was to study the inter-rater reliability (IRR) when detecting signs associated with COVID-19 in the LUS, as well as the performance of the test in a longitudinal or transverse orientation. Thirty-three physicians with advanced experience in LUS independently evaluated ultrasound videos previously acquired using the ULTRACOV system on 20 patients with confirmed COVID-19. For each patient, 24 videos of 3 s were acquired (using 12 positions with the probe in longitudinal and transverse orientations). The physicians had no information about the patients or other previous evaluations. The score assigned to each acquisition followed the convention applied in previous studies. A substantial IRR was found in the cases of normal LUS (κ = 0.74), with only a fair IRR for the presence of individual B-lines (κ = 0.36) and for confluent B-lines occupying < 50% (κ = 0.26) and a moderate IRR in consolidations and B-lines < 50% (κ = 0.50). No statistically significant differences between the longitudinal and transverse scans were found. The IRR for LUS of COVID-19 patients may benefit from more standardized clinical protocols..
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2023 |
|---|---|
| Erschienen: |
2023 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:13 |
|---|---|
| Enthalten in: |
Applied Sciences - 13(2023), 3, p 1321 |
| Sprache: |
Englisch |
|---|
| Links: |
doi.org [kostenfrei] |
|---|
| doi: |
10.3390/app13031321 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
DOAJ080689868 |
|---|
| LEADER | 01000caa a22002652 4500 | ||
|---|---|---|---|
| 001 | DOAJ080689868 | ||
| 003 | DE-627 | ||
| 005 | 20240413070808.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 230310s2023 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.3390/app13031321 |2 doi | |
| 035 | |a (DE-627)DOAJ080689868 | ||
| 035 | |a (DE-599)DOAJ54a57b4af235447fb23da72f74ad2800 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 050 | 0 | |a TA1-2040 | |
| 050 | 0 | |a QH301-705.5 | |
| 050 | 0 | |a QC1-999 | |
| 050 | 0 | |a QD1-999 | |
| 100 | 0 | |a Joaquin L. Herraiz |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Inter-Rater Variability in the Evaluation of Lung Ultrasound in Videos Acquired from COVID-19 Patients |
| 264 | 1 | |c 2023 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a Computermedien |b c |2 rdamedia | ||
| 338 | |a Online-Ressource |b cr |2 rdacarrier | ||
| 520 | |a Lung ultrasound (LUS) allows for the detection of a series of manifestations of COVID-19, such as B-lines and consolidations. The objective of this work was to study the inter-rater reliability (IRR) when detecting signs associated with COVID-19 in the LUS, as well as the performance of the test in a longitudinal or transverse orientation. Thirty-three physicians with advanced experience in LUS independently evaluated ultrasound videos previously acquired using the ULTRACOV system on 20 patients with confirmed COVID-19. For each patient, 24 videos of 3 s were acquired (using 12 positions with the probe in longitudinal and transverse orientations). The physicians had no information about the patients or other previous evaluations. The score assigned to each acquisition followed the convention applied in previous studies. A substantial IRR was found in the cases of normal LUS (κ = 0.74), with only a fair IRR for the presence of individual B-lines (κ = 0.36) and for confluent B-lines occupying < 50% (κ = 0.26) and a moderate IRR in consolidations and B-lines < 50% (κ = 0.50). No statistically significant differences between the longitudinal and transverse scans were found. The IRR for LUS of COVID-19 patients may benefit from more standardized clinical protocols. | ||
| 650 | 4 | |a coronavirus disease 2019 | |
| 650 | 4 | |a inter-observer agreement | |
| 650 | 4 | |a inter-rater reliability | |
| 650 | 4 | |a lung ultrasound | |
| 650 | 4 | |a point-of-care ultrasound | |
| 650 | 4 | |a reliability | |
| 653 | 0 | |a Technology | |
| 653 | 0 | |a T | |
| 653 | 0 | |a Engineering (General). Civil engineering (General) | |
| 653 | 0 | |a Biology (General) | |
| 653 | 0 | |a Physics | |
| 653 | 0 | |a Chemistry | |
| 700 | 0 | |a Clara Freijo |e verfasserin |4 aut | |
| 700 | 0 | |a Jorge Camacho |e verfasserin |4 aut | |
| 700 | 0 | |a Mario Muñoz |e verfasserin |4 aut | |
| 700 | 0 | |a Ricardo González |e verfasserin |4 aut | |
| 700 | 0 | |a Rafael Alonso-Roca |e verfasserin |4 aut | |
| 700 | 0 | |a Jorge Álvarez-Troncoso |e verfasserin |4 aut | |
| 700 | 0 | |a Luis Matías Beltrán-Romero |e verfasserin |4 aut | |
| 700 | 0 | |a Máximo Bernabeu-Wittel |e verfasserin |4 aut | |
| 700 | 0 | |a Rafael Blancas |e verfasserin |4 aut | |
| 700 | 0 | |a Antonio Calvo-Cebrián |e verfasserin |4 aut | |
| 700 | 0 | |a Ricardo Campo-Linares |e verfasserin |4 aut | |
| 700 | 0 | |a Jaldún Chehayeb-Morán |e verfasserin |4 aut | |
| 700 | 0 | |a Jose Chorda-Ribelles |e verfasserin |4 aut | |
| 700 | 0 | |a Samuel García-Rubio |e verfasserin |4 aut | |
| 700 | 0 | |a Gonzalo García-de-Casasola |e verfasserin |4 aut | |
| 700 | 0 | |a Adriana Gil-Rodrigo |e verfasserin |4 aut | |
| 700 | 0 | |a César Henríquez-Camacho |e verfasserin |4 aut | |
| 700 | 0 | |a Alba Hernandez-Píriz |e verfasserin |4 aut | |
| 700 | 0 | |a Carlos Hernandez-Quiles |e verfasserin |4 aut | |
| 700 | 0 | |a Rafael Llamas-Fuentes |e verfasserin |4 aut | |
| 700 | 0 | |a Davide Luordo |e verfasserin |4 aut | |
| 700 | 0 | |a Raquel Marín-Baselga |e verfasserin |4 aut | |
| 700 | 0 | |a María Cristina Martínez-Díaz |e verfasserin |4 aut | |
| 700 | 0 | |a María Mateos-González |e verfasserin |4 aut | |
| 700 | 0 | |a Manuel Mendez-Bailon |e verfasserin |4 aut | |
| 700 | 0 | |a Francisco Miralles-Aguiar |e verfasserin |4 aut | |
| 700 | 0 | |a Ramón Nogue |e verfasserin |4 aut | |
| 700 | 0 | |a Marta Nogué |e verfasserin |4 aut | |
| 700 | 0 | |a Borja Ortiz de Urbina-Antia |e verfasserin |4 aut | |
| 700 | 0 | |a Alberto Ángel Oviedo-García |e verfasserin |4 aut | |
| 700 | 0 | |a José M. Porcel |e verfasserin |4 aut | |
| 700 | 0 | |a Santiago Rodriguez |e verfasserin |4 aut | |
| 700 | 0 | |a Diego Aníbal Rodríguez-Serrano |e verfasserin |4 aut | |
| 700 | 0 | |a Talía Sainz |e verfasserin |4 aut | |
| 700 | 0 | |a Ignacio Manuel Sánchez-Barrancos |e verfasserin |4 aut | |
| 700 | 0 | |a Marta Torres-Arrese |e verfasserin |4 aut | |
| 700 | 0 | |a Juan Torres-Macho |e verfasserin |4 aut | |
| 700 | 0 | |a Angela Trueba Vicente |e verfasserin |4 aut | |
| 700 | 0 | |a Tomas Villén-Villegas |e verfasserin |4 aut | |
| 700 | 0 | |a Juan José Zafra-Sánchez |e verfasserin |4 aut | |
| 700 | 0 | |a Yale Tung-Chen |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i In |t Applied Sciences |d MDPI AG, 2012 |g 13(2023), 3, p 1321 |w (DE-627)DOAJ000144045 |x 20763417 |7 nnns |
| 773 | 1 | 8 | |g volume:13 |g year:2023 |g number:3, p 1321 |
| 856 | 4 | 0 | |u https://doi.org/10.3390/app13031321 |z kostenfrei |
| 856 | 4 | 0 | |u https://doaj.org/article/54a57b4af235447fb23da72f74ad2800 |z kostenfrei |
| 856 | 4 | 0 | |u https://www.mdpi.com/2076-3417/13/3/1321 |z kostenfrei |
| 856 | 4 | 2 | |u https://doaj.org/toc/2076-3417 |y Journal toc |z kostenfrei |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_DOAJ | ||
| 951 | |a AR | ||
| 952 | |d 13 |j 2023 |e 3, p 1321 | ||