External clinical validation of automated software to identify structural abnormalities and microhaemorrhages in nailfold videocapillaroscopy images
OBJECTIVES: Automated systems to analyse nailfold videocapillaroscopy (NVC) images are needed to promptly and comprehensively characterise patients with systemic sclerosis (SSc) or Raynaud's phenomenon (RP). We previously developed, and validated in-house, a deep convolutional neural network-based algorithm to classify NVC-captured images according to the presence/absence of structural abnormalities and/or microhaemorrhages. We present its external clinical validation.
METHODS: A total of 1,164 NVC images of RP patients were annotated by 5 trained capillaroscopists according to the following categories: normal capillary; dilation; giant capillary; abnormal shape; tortuosity; microhaemorrhage. The images were also presented to the algorithm. Matches and discrepancies between algorithm predictions and those annotations obtained by consensus of ≥3 or ≥4 interobservers were analysed.
RESULTS: Consensus among ≥3 capillaroscopists was achieved in 86.9% of images, 75.8% of which were correctly predicted by the algorithm. Consensus among ≥4 experts occurred in 52.0% of cases, in which 87.1% of the algorithm's results matched with those of the expert panel. The algorithm's positive predictive value was >80% for microhaemorrhages and unaltered, giant or abnormal capillaries. Sensitivity was >75% for dilations and tortuosities. Negative predictive value and specificity were >89% for all categories.
CONCLUSIONS: This external clinical validation suggests that this algorithm is useful to assist in the diagnosis and follow-up of SSc or RP patients in a timely manner. It may also be helpful in the management of patients with any pathology presenting with microvascular changes, as the algorithm has been designed to also be useful for research aiming at extending the usage of nailfold capillaroscopy to more conditions.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2023 |
|---|---|
| Erschienen: |
2023 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:41 |
|---|---|
| Enthalten in: |
Clinical and experimental rheumatology - 41(2023), 8 vom: 04. Aug., Seite 1605-1611 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Gracia Tello, Borja C [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
|---|
| Anmerkungen: |
Date Completed 04.08.2023 Date Revised 04.08.2023 published: Print-Electronic Citation Status MEDLINE |
|---|
| doi: |
10.55563/clinexprheumatol/m6obl3 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM356439429 |
|---|
| LEADER | 01000naa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM356439429 | ||
| 003 | DE-627 | ||
| 005 | 20231226070450.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231226s2023 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.55563/clinexprheumatol/m6obl3 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1188.xml |
| 035 | |a (DE-627)NLM356439429 | ||
| 035 | |a (NLM)37140670 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Gracia Tello, Borja C |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a External clinical validation of automated software to identify structural abnormalities and microhaemorrhages in nailfold videocapillaroscopy images |
| 264 | 1 | |c 2023 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 04.08.2023 | ||
| 500 | |a Date Revised 04.08.2023 | ||
| 500 | |a published: Print-Electronic | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a OBJECTIVES: Automated systems to analyse nailfold videocapillaroscopy (NVC) images are needed to promptly and comprehensively characterise patients with systemic sclerosis (SSc) or Raynaud's phenomenon (RP). We previously developed, and validated in-house, a deep convolutional neural network-based algorithm to classify NVC-captured images according to the presence/absence of structural abnormalities and/or microhaemorrhages. We present its external clinical validation | ||
| 520 | |a METHODS: A total of 1,164 NVC images of RP patients were annotated by 5 trained capillaroscopists according to the following categories: normal capillary; dilation; giant capillary; abnormal shape; tortuosity; microhaemorrhage. The images were also presented to the algorithm. Matches and discrepancies between algorithm predictions and those annotations obtained by consensus of ≥3 or ≥4 interobservers were analysed | ||
| 520 | |a RESULTS: Consensus among ≥3 capillaroscopists was achieved in 86.9% of images, 75.8% of which were correctly predicted by the algorithm. Consensus among ≥4 experts occurred in 52.0% of cases, in which 87.1% of the algorithm's results matched with those of the expert panel. The algorithm's positive predictive value was >80% for microhaemorrhages and unaltered, giant or abnormal capillaries. Sensitivity was >75% for dilations and tortuosities. Negative predictive value and specificity were >89% for all categories | ||
| 520 | |a CONCLUSIONS: This external clinical validation suggests that this algorithm is useful to assist in the diagnosis and follow-up of SSc or RP patients in a timely manner. It may also be helpful in the management of patients with any pathology presenting with microvascular changes, as the algorithm has been designed to also be useful for research aiming at extending the usage of nailfold capillaroscopy to more conditions | ||
| 650 | 4 | |a Journal Article | |
| 700 | 1 | |a Ramos Ibañez, Eduardo |e verfasserin |4 aut | |
| 700 | 1 | |a Saez Comet, Luis |e verfasserin |4 aut | |
| 700 | 1 | |a Guillén Del Castillo, Alfredo |e verfasserin |4 aut | |
| 700 | 1 | |a Simeón Aznar, Carmen Pilar |e verfasserin |4 aut | |
| 700 | 1 | |a Selva-O'Callaghan, Albert |e verfasserin |4 aut | |
| 700 | 1 | |a Espinosa, Gerard |e verfasserin |4 aut | |
| 700 | 1 | |a Lledó, Gema |e verfasserin |4 aut | |
| 700 | 1 | |a Freire Dapena, Mayka |e verfasserin |4 aut | |
| 700 | 1 | |a Martinez Robles, Elena |e verfasserin |4 aut | |
| 700 | 1 | |a Ríos, Juan José |e verfasserin |4 aut | |
| 700 | 1 | |a Todolí Parra, José Antonio |e verfasserin |4 aut | |
| 700 | 1 | |a Marí Alfonso, Begoña |e verfasserin |4 aut | |
| 700 | 1 | |a Ortego Centeno, Norberto |e verfasserin |4 aut | |
| 700 | 1 | |a Marín Ballvé, Adela |e verfasserin |4 aut | |
| 700 | 1 | |a Callejas Rubio, José Luis |e verfasserin |4 aut | |
| 700 | 1 | |a Fonollosa Plá, Vicent |e verfasserin |4 aut | |
| 700 | 1 | |a Fanlo, Patricia |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Clinical and experimental rheumatology |d 1989 |g 41(2023), 8 vom: 04. Aug., Seite 1605-1611 |w (DE-627)NLM012613010 |x 0392-856X |7 nnns |
| 773 | 1 | 8 | |g volume:41 |g year:2023 |g number:8 |g day:04 |g month:08 |g pages:1605-1611 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.55563/clinexprheumatol/m6obl3 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 41 |j 2023 |e 8 |b 04 |c 08 |h 1605-1611 | ||