Deep learning-based cross-classifications reveal conserved spatial behaviors within tumor histological images
Histopathological images are a rich but incompletely explored data type for studying cancer. Manual inspection is time consuming, making it challenging to use for image data mining. Here we show that convolutional neural networks (CNNs) can be systematically applied across cancer types, enabling comparisons to reveal shared spatial behaviors. We develop CNN architectures to analyze 27,815 hematoxylin and eosin scanned images from The Cancer Genome Atlas for tumor/normal, cancer subtype, and mutation classification. Our CNNs are able to classify TCGA pathologist-annotated tumor/normal status of whole slide images (WSIs) in 19 cancer types with consistently high AUCs (0.995 ± 0.008), as well as subtypes with lower but significant accuracy (AUC 0.87 ± 0.1). Remarkably, tumor/normal CNNs trained on one tissue are effective in others (AUC 0.88 ± 0.11), with classifier relationships also recapitulating known adenocarcinoma, carcinoma, and developmental biology. Moreover, classifier comparisons reveal intra-slide spatial similarities, with an average tile-level correlation of 0.45 ± 0.16 between classifier pairs. Breast cancers, bladder cancers, and uterine cancers have spatial patterns that are particularly easy to detect, suggesting these cancers can be canonical types for image analysis. Patterns for TP53 mutations can also be detected, with WSI self- and cross-tissue AUCs ranging from 0.65-0.80. Finally, we comparatively evaluate CNNs on 170 breast and colon cancer images with pathologist-annotated nuclei, finding that both cellular and intercellular regions contribute to CNN accuracy. These results demonstrate the power of CNNs not only for histopathological classification, but also for cross-comparisons to reveal conserved spatial behaviors across tumors.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2020 |
|---|---|
| Erschienen: |
2020 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:11 |
|---|---|
| Enthalten in: |
Nature communications - 11(2020), 1 vom: 11. Dez., Seite 6367 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Noorbakhsh, Javad [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
Journal Article |
|---|
| Anmerkungen: |
Date Completed 04.01.2021 Date Revised 30.03.2024 published: Electronic Citation Status MEDLINE |
|---|
| doi: |
10.1038/s41467-020-20030-5 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM318767449 |
|---|
| LEADER | 01000caa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM318767449 | ||
| 003 | DE-627 | ||
| 005 | 20240330234508.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231225s2020 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1038/s41467-020-20030-5 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1356.xml |
| 035 | |a (DE-627)NLM318767449 | ||
| 035 | |a (NLM)33311458 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Noorbakhsh, Javad |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Deep learning-based cross-classifications reveal conserved spatial behaviors within tumor histological images |
| 264 | 1 | |c 2020 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 04.01.2021 | ||
| 500 | |a Date Revised 30.03.2024 | ||
| 500 | |a published: Electronic | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a Histopathological images are a rich but incompletely explored data type for studying cancer. Manual inspection is time consuming, making it challenging to use for image data mining. Here we show that convolutional neural networks (CNNs) can be systematically applied across cancer types, enabling comparisons to reveal shared spatial behaviors. We develop CNN architectures to analyze 27,815 hematoxylin and eosin scanned images from The Cancer Genome Atlas for tumor/normal, cancer subtype, and mutation classification. Our CNNs are able to classify TCGA pathologist-annotated tumor/normal status of whole slide images (WSIs) in 19 cancer types with consistently high AUCs (0.995 ± 0.008), as well as subtypes with lower but significant accuracy (AUC 0.87 ± 0.1). Remarkably, tumor/normal CNNs trained on one tissue are effective in others (AUC 0.88 ± 0.11), with classifier relationships also recapitulating known adenocarcinoma, carcinoma, and developmental biology. Moreover, classifier comparisons reveal intra-slide spatial similarities, with an average tile-level correlation of 0.45 ± 0.16 between classifier pairs. Breast cancers, bladder cancers, and uterine cancers have spatial patterns that are particularly easy to detect, suggesting these cancers can be canonical types for image analysis. Patterns for TP53 mutations can also be detected, with WSI self- and cross-tissue AUCs ranging from 0.65-0.80. Finally, we comparatively evaluate CNNs on 170 breast and colon cancer images with pathologist-annotated nuclei, finding that both cellular and intercellular regions contribute to CNN accuracy. These results demonstrate the power of CNNs not only for histopathological classification, but also for cross-comparisons to reveal conserved spatial behaviors across tumors | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a Research Support, N.I.H., Extramural | |
| 650 | 4 | |a Research Support, Non-U.S. Gov't | |
| 700 | 1 | |a Farahmand, Saman |e verfasserin |4 aut | |
| 700 | 1 | |a Foroughi Pour, Ali |e verfasserin |4 aut | |
| 700 | 1 | |a Namburi, Sandeep |e verfasserin |4 aut | |
| 700 | 1 | |a Caruana, Dennis |e verfasserin |4 aut | |
| 700 | 1 | |a Rimm, David |e verfasserin |4 aut | |
| 700 | 1 | |a Soltanieh-Ha, Mohammad |e verfasserin |4 aut | |
| 700 | 1 | |a Zarringhalam, Kourosh |e verfasserin |4 aut | |
| 700 | 1 | |a Chuang, Jeffrey H |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Nature communications |d 2010 |g 11(2020), 1 vom: 11. Dez., Seite 6367 |w (DE-627)NLM199274525 |x 2041-1723 |7 nnns |
| 773 | 1 | 8 | |g volume:11 |g year:2020 |g number:1 |g day:11 |g month:12 |g pages:6367 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1038/s41467-020-20030-5 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 11 |j 2020 |e 1 |b 11 |c 12 |h 6367 | ||