Learn2Reg : Comprehensive Multi-Task Medical Image Registration Challenge, Dataset and Evaluation in the Era of Deep Learning
Image registration is a fundamental medical image analysis task, and a wide variety of approaches have been proposed. However, only a few studies have comprehensively compared medical image registration approaches on a wide range of clinically relevant tasks. This limits the development of registration methods, the adoption of research advances into practice, and a fair benchmark across competing approaches. The Learn2Reg challenge addresses these limitations by providing a multi-task medical image registration data set for comprehensive characterisation of deformable registration algorithms. A continuous evaluation will be possible at https://learn2reg.grand-challenge.org. Learn2Reg covers a wide range of anatomies (brain, abdomen, and thorax), modalities (ultrasound, CT, MR), availability of annotations, as well as intra- and inter-patient registration evaluation. We established an easily accessible framework for training and validation of 3D registration methods, which enabled the compilation of results of over 65 individual method submissions from more than 20 unique teams. We used a complementary set of metrics, including robustness, accuracy, plausibility, and runtime, enabling unique insight into the current state-of-the-art of medical image registration. This paper describes datasets, tasks, evaluation methods and results of the challenge, as well as results of further analysis of transferability to new datasets, the importance of label supervision, and resulting bias. While no single approach worked best across all tasks, many methodological aspects could be identified that push the performance of medical image registration to new state-of-the-art performance. Furthermore, we demystified the common belief that conventional registration methods have to be much slower than deep-learning-based methods.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2023 |
|---|---|
| Erschienen: |
2023 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:42 |
|---|---|
| Enthalten in: |
IEEE transactions on medical imaging - 42(2023), 3 vom: 20. März, Seite 697-712 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Hering, Alessa [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
|---|
| Anmerkungen: |
Date Completed 11.04.2023 Date Revised 28.04.2023 published: Print-Electronic Citation Status MEDLINE |
|---|
| doi: |
10.1109/TMI.2022.3213983 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM347794017 |
|---|
| LEADER | 01000naa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM347794017 | ||
| 003 | DE-627 | ||
| 005 | 20231226034700.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231226s2023 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1109/TMI.2022.3213983 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1159.xml |
| 035 | |a (DE-627)NLM347794017 | ||
| 035 | |a (NLM)36264729 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Hering, Alessa |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Learn2Reg |b Comprehensive Multi-Task Medical Image Registration Challenge, Dataset and Evaluation in the Era of Deep Learning |
| 264 | 1 | |c 2023 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 11.04.2023 | ||
| 500 | |a Date Revised 28.04.2023 | ||
| 500 | |a published: Print-Electronic | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a Image registration is a fundamental medical image analysis task, and a wide variety of approaches have been proposed. However, only a few studies have comprehensively compared medical image registration approaches on a wide range of clinically relevant tasks. This limits the development of registration methods, the adoption of research advances into practice, and a fair benchmark across competing approaches. The Learn2Reg challenge addresses these limitations by providing a multi-task medical image registration data set for comprehensive characterisation of deformable registration algorithms. A continuous evaluation will be possible at https://learn2reg.grand-challenge.org. Learn2Reg covers a wide range of anatomies (brain, abdomen, and thorax), modalities (ultrasound, CT, MR), availability of annotations, as well as intra- and inter-patient registration evaluation. We established an easily accessible framework for training and validation of 3D registration methods, which enabled the compilation of results of over 65 individual method submissions from more than 20 unique teams. We used a complementary set of metrics, including robustness, accuracy, plausibility, and runtime, enabling unique insight into the current state-of-the-art of medical image registration. This paper describes datasets, tasks, evaluation methods and results of the challenge, as well as results of further analysis of transferability to new datasets, the importance of label supervision, and resulting bias. While no single approach worked best across all tasks, many methodological aspects could be identified that push the performance of medical image registration to new state-of-the-art performance. Furthermore, we demystified the common belief that conventional registration methods have to be much slower than deep-learning-based methods | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a Research Support, Non-U.S. Gov't | |
| 700 | 1 | |a Hansen, Lasse |e verfasserin |4 aut | |
| 700 | 1 | |a Mok, Tony C W |e verfasserin |4 aut | |
| 700 | 1 | |a Chung, Albert C S |e verfasserin |4 aut | |
| 700 | 1 | |a Siebert, Hanna |e verfasserin |4 aut | |
| 700 | 1 | |a Hager, Stephanie |e verfasserin |4 aut | |
| 700 | 1 | |a Lange, Annkristin |e verfasserin |4 aut | |
| 700 | 1 | |a Kuckertz, Sven |e verfasserin |4 aut | |
| 700 | 1 | |a Heldmann, Stefan |e verfasserin |4 aut | |
| 700 | 1 | |a Shao, Wei |e verfasserin |4 aut | |
| 700 | 1 | |a Vesal, Sulaiman |e verfasserin |4 aut | |
| 700 | 1 | |a Rusu, Mirabela |e verfasserin |4 aut | |
| 700 | 1 | |a Sonn, Geoffrey |e verfasserin |4 aut | |
| 700 | 1 | |a Estienne, Theo |e verfasserin |4 aut | |
| 700 | 1 | |a Vakalopoulou, Maria |e verfasserin |4 aut | |
| 700 | 1 | |a Han, Luyi |e verfasserin |4 aut | |
| 700 | 1 | |a Huang, Yunzhi |e verfasserin |4 aut | |
| 700 | 1 | |a Yap, Pew-Thian |e verfasserin |4 aut | |
| 700 | 1 | |a Brudfors, Mikael |e verfasserin |4 aut | |
| 700 | 1 | |a Balbastre, Yael |e verfasserin |4 aut | |
| 700 | 1 | |a Joutard, Samuel |e verfasserin |4 aut | |
| 700 | 1 | |a Modat, Marc |e verfasserin |4 aut | |
| 700 | 1 | |a Lifshitz, Gal |e verfasserin |4 aut | |
| 700 | 1 | |a Raviv, Dan |e verfasserin |4 aut | |
| 700 | 1 | |a Lv, Jinxin |e verfasserin |4 aut | |
| 700 | 1 | |a Li, Qiang |e verfasserin |4 aut | |
| 700 | 1 | |a Jaouen, Vincent |e verfasserin |4 aut | |
| 700 | 1 | |a Visvikis, Dimitris |e verfasserin |4 aut | |
| 700 | 1 | |a Fourcade, Constance |e verfasserin |4 aut | |
| 700 | 1 | |a Rubeaux, Mathieu |e verfasserin |4 aut | |
| 700 | 1 | |a Pan, Wentao |e verfasserin |4 aut | |
| 700 | 1 | |a Xu, Zhe |e verfasserin |4 aut | |
| 700 | 1 | |a Jian, Bailiang |e verfasserin |4 aut | |
| 700 | 1 | |a De Benetti, Francesca |e verfasserin |4 aut | |
| 700 | 1 | |a Wodzinski, Marek |e verfasserin |4 aut | |
| 700 | 1 | |a Gunnarsson, Niklas |e verfasserin |4 aut | |
| 700 | 1 | |a Sjolund, Jens |e verfasserin |4 aut | |
| 700 | 1 | |a Grzech, Daniel |e verfasserin |4 aut | |
| 700 | 1 | |a Qiu, Huaqi |e verfasserin |4 aut | |
| 700 | 1 | |a Li, Zeju |e verfasserin |4 aut | |
| 700 | 1 | |a Thorley, Alexander |e verfasserin |4 aut | |
| 700 | 1 | |a Duan, Jinming |e verfasserin |4 aut | |
| 700 | 1 | |a Grosbrohmer, Christoph |e verfasserin |4 aut | |
| 700 | 1 | |a Hoopes, Andrew |e verfasserin |4 aut | |
| 700 | 1 | |a Reinertsen, Ingerid |e verfasserin |4 aut | |
| 700 | 1 | |a Xiao, Yiming |e verfasserin |4 aut | |
| 700 | 1 | |a Landman, Bennett |e verfasserin |4 aut | |
| 700 | 1 | |a Huo, Yuankai |e verfasserin |4 aut | |
| 700 | 1 | |a Murphy, Keelin |e verfasserin |4 aut | |
| 700 | 1 | |a Lessmann, Nikolas |e verfasserin |4 aut | |
| 700 | 1 | |a van Ginneken, Bram |e verfasserin |4 aut | |
| 700 | 1 | |a Dalca, Adrian V |e verfasserin |4 aut | |
| 700 | 1 | |a Heinrich, Mattias P |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t IEEE transactions on medical imaging |d 1982 |g 42(2023), 3 vom: 20. März, Seite 697-712 |w (DE-627)NLM082855269 |x 1558-254X |7 nnns |
| 773 | 1 | 8 | |g volume:42 |g year:2023 |g number:3 |g day:20 |g month:03 |g pages:697-712 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1109/TMI.2022.3213983 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 42 |j 2023 |e 3 |b 20 |c 03 |h 697-712 | ||