Conditional permutation importance revisited
BACKGROUND: Random forest based variable importance measures have become popular tools for assessing the contributions of the predictor variables in a fitted random forest. In this article we reconsider a frequently used variable importance measure, the Conditional Permutation Importance (CPI). We argue and illustrate that the CPI corresponds to a more partial quantification of variable importance and suggest several improvements in its methodology and implementation that enhance its practical value. In addition, we introduce the threshold value in the CPI algorithm as a parameter that can make the CPI more partial or more marginal.
RESULTS: By means of extensive simulations, where the original version of the CPI is used as the reference, we examine the impact of the proposed methodological improvements. The simulation results show how the improved CPI methodology increases the interpretability and stability of the computations. In addition, the newly proposed implementation decreases the computation times drastically and is more widely applicable. The improved CPI algorithm is made freely available as an add-on package to the open-source software R.
CONCLUSION: The proposed methodology and implementation of the CPI is computationally faster and leads to more stable results. It has a beneficial impact on practical research by making random forest analyses more interpretable.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2020 |
|---|---|
| Erschienen: |
2020 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:21 |
|---|---|
| Enthalten in: |
BMC bioinformatics - 21(2020), 1 vom: 14. Juli, Seite 307 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Debeer, Dries [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
Conditional permutation importance |
|---|
| Anmerkungen: |
Date Completed 24.08.2020 Date Revised 24.08.2020 published: Electronic Citation Status MEDLINE |
|---|
| doi: |
10.1186/s12859-020-03622-2 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM31241403X |
|---|
| LEADER | 01000naa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM31241403X | ||
| 003 | DE-627 | ||
| 005 | 20231225144351.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231225s2020 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1186/s12859-020-03622-2 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1041.xml |
| 035 | |a (DE-627)NLM31241403X | ||
| 035 | |a (NLM)32664864 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Debeer, Dries |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Conditional permutation importance revisited |
| 264 | 1 | |c 2020 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 24.08.2020 | ||
| 500 | |a Date Revised 24.08.2020 | ||
| 500 | |a published: Electronic | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a BACKGROUND: Random forest based variable importance measures have become popular tools for assessing the contributions of the predictor variables in a fitted random forest. In this article we reconsider a frequently used variable importance measure, the Conditional Permutation Importance (CPI). We argue and illustrate that the CPI corresponds to a more partial quantification of variable importance and suggest several improvements in its methodology and implementation that enhance its practical value. In addition, we introduce the threshold value in the CPI algorithm as a parameter that can make the CPI more partial or more marginal | ||
| 520 | |a RESULTS: By means of extensive simulations, where the original version of the CPI is used as the reference, we examine the impact of the proposed methodological improvements. The simulation results show how the improved CPI methodology increases the interpretability and stability of the computations. In addition, the newly proposed implementation decreases the computation times drastically and is more widely applicable. The improved CPI algorithm is made freely available as an add-on package to the open-source software R | ||
| 520 | |a CONCLUSION: The proposed methodology and implementation of the CPI is computationally faster and leads to more stable results. It has a beneficial impact on practical research by making random forest analyses more interpretable | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a Conditional permutation importance | |
| 650 | 4 | |a R | |
| 650 | 4 | |a Random forest | |
| 700 | 1 | |a Strobl, Carolin |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t BMC bioinformatics |d 2000 |g 21(2020), 1 vom: 14. Juli, Seite 307 |w (DE-627)NLM109215982 |x 1471-2105 |7 nnns |
| 773 | 1 | 8 | |g volume:21 |g year:2020 |g number:1 |g day:14 |g month:07 |g pages:307 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1186/s12859-020-03622-2 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 21 |j 2020 |e 1 |b 14 |c 07 |h 307 | ||