A two-phase approach to re-calibrating expensive computer simulation for sex-specific colorectal neoplasia development modeling
© 2022. The Author(s)..
BACKGROUND: Medical evidence from more recent observational studies may significantly alter our understanding of disease incidence and progression, and would require recalibration of existing computational and predictive disease models. However, it is often challenging to perform recalibration when there are a large number of model parameters to be estimated. Moreover, comparing the fitting performances of candidate parameter designs can be difficult due to significant variation in simulated outcomes under limited computational budget and long runtime, even for one simulation replication.
METHODS: We developed a two-phase recalibration procedure. As a proof-of-the-concept study, we verified the procedure in the context of sex-specific colorectal neoplasia development. We considered two individual-based state-transition stochastic simulation models, estimating model parameters that govern colorectal adenoma occurrence and its growth through three preclinical states: non-advanced precancerous polyp, advanced precancerous polyp, and cancerous polyp. For the calibration, we used a weighted-sum-squared error between three prevalence values reported in the literature and the corresponding simulation outcomes. In phase 1 of the calibration procedure, we first extracted the baseline parameter design from relevant studies on the same model. We then performed sampling-based searches within a proper range around the baseline design to identify the initial set of good candidate designs. In phase 2, we performed local search (e.g., the Nelder-Mead algorithm), starting from the candidate designs identified at the end of phase 1. Further, we investigated the efficiency of exploring dimensions of the parameter space sequentially based on our prior knowledge of the system dynamics.
RESULTS: The efficiency of our two-phase re-calibration procedure was first investigated with CMOST, a relatively inexpensive computational model. It was then further verified with the V/NCS model, which is much more expensive. Overall, our two-phase procedure showed a better goodness-of-fit than the straightforward employment of the Nelder-Mead algorithm, when only a limited number of simulation replications were allowed. In addition, in phase 2, performing local search along parameter space dimensions sequentially was more efficient than performing the search over all dimensions concurrently.
CONCLUSION: The proposed two-phase re-calibration procedure is efficient at estimating parameters of computationally expensive stochastic dynamic disease models.
Medienart: |
E-Artikel |
---|
Erscheinungsjahr: |
2022 |
---|---|
Erschienen: |
2022 |
Enthalten in: |
Zur Gesamtaufnahme - volume:22 |
---|---|
Enthalten in: |
BMC medical informatics and decision making - 22(2022), 1 vom: 18. Sept., Seite 244 |
Sprache: |
Englisch |
---|
Beteiligte Personen: |
Vivas-Valencia, Carolina [VerfasserIn] |
---|
Links: |
---|
Themen: |
Colorectal neoplasia |
---|
Anmerkungen: |
Date Completed 20.09.2022 Date Revised 01.10.2022 published: Electronic Citation Status MEDLINE |
---|
doi: |
10.1186/s12911-022-01991-7 |
---|
funding: |
|
---|---|
Förderinstitution / Projekttitel: |
|
PPN (Katalog-ID): |
NLM346338840 |
---|
LEADER | 01000naa a22002652 4500 | ||
---|---|---|---|
001 | NLM346338840 | ||
003 | DE-627 | ||
005 | 20231226031212.0 | ||
007 | cr uuu---uuuuu | ||
008 | 231226s2022 xx |||||o 00| ||eng c | ||
024 | 7 | |a 10.1186/s12911-022-01991-7 |2 doi | |
028 | 5 | 2 | |a pubmed24n1154.xml |
035 | |a (DE-627)NLM346338840 | ||
035 | |a (NLM)36117168 | ||
040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
041 | |a eng | ||
100 | 1 | |a Vivas-Valencia, Carolina |e verfasserin |4 aut | |
245 | 1 | 2 | |a A two-phase approach to re-calibrating expensive computer simulation for sex-specific colorectal neoplasia development modeling |
264 | 1 | |c 2022 | |
336 | |a Text |b txt |2 rdacontent | ||
337 | |a ƒaComputermedien |b c |2 rdamedia | ||
338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
500 | |a Date Completed 20.09.2022 | ||
500 | |a Date Revised 01.10.2022 | ||
500 | |a published: Electronic | ||
500 | |a Citation Status MEDLINE | ||
520 | |a © 2022. The Author(s). | ||
520 | |a BACKGROUND: Medical evidence from more recent observational studies may significantly alter our understanding of disease incidence and progression, and would require recalibration of existing computational and predictive disease models. However, it is often challenging to perform recalibration when there are a large number of model parameters to be estimated. Moreover, comparing the fitting performances of candidate parameter designs can be difficult due to significant variation in simulated outcomes under limited computational budget and long runtime, even for one simulation replication | ||
520 | |a METHODS: We developed a two-phase recalibration procedure. As a proof-of-the-concept study, we verified the procedure in the context of sex-specific colorectal neoplasia development. We considered two individual-based state-transition stochastic simulation models, estimating model parameters that govern colorectal adenoma occurrence and its growth through three preclinical states: non-advanced precancerous polyp, advanced precancerous polyp, and cancerous polyp. For the calibration, we used a weighted-sum-squared error between three prevalence values reported in the literature and the corresponding simulation outcomes. In phase 1 of the calibration procedure, we first extracted the baseline parameter design from relevant studies on the same model. We then performed sampling-based searches within a proper range around the baseline design to identify the initial set of good candidate designs. In phase 2, we performed local search (e.g., the Nelder-Mead algorithm), starting from the candidate designs identified at the end of phase 1. Further, we investigated the efficiency of exploring dimensions of the parameter space sequentially based on our prior knowledge of the system dynamics | ||
520 | |a RESULTS: The efficiency of our two-phase re-calibration procedure was first investigated with CMOST, a relatively inexpensive computational model. It was then further verified with the V/NCS model, which is much more expensive. Overall, our two-phase procedure showed a better goodness-of-fit than the straightforward employment of the Nelder-Mead algorithm, when only a limited number of simulation replications were allowed. In addition, in phase 2, performing local search along parameter space dimensions sequentially was more efficient than performing the search over all dimensions concurrently | ||
520 | |a CONCLUSION: The proposed two-phase re-calibration procedure is efficient at estimating parameters of computationally expensive stochastic dynamic disease models | ||
650 | 4 | |a Journal Article | |
650 | 4 | |a Research Support, N.I.H., Extramural | |
650 | 4 | |a Colorectal neoplasia | |
650 | 4 | |a Computationally expensive simulator | |
650 | 4 | |a Model recalibration | |
650 | 4 | |a State-transition model | |
700 | 1 | |a Zhou, You |e verfasserin |4 aut | |
700 | 1 | |a Sai, Aditya |e verfasserin |4 aut | |
700 | 1 | |a Imperiale, Thomas F |e verfasserin |4 aut | |
700 | 1 | |a Kong, Nan |e verfasserin |4 aut | |
773 | 0 | 8 | |i Enthalten in |t BMC medical informatics and decision making |d 2001 |g 22(2022), 1 vom: 18. Sept., Seite 244 |w (DE-627)NLM112392881 |x 1472-6947 |7 nnns |
773 | 1 | 8 | |g volume:22 |g year:2022 |g number:1 |g day:18 |g month:09 |g pages:244 |
856 | 4 | 0 | |u http://dx.doi.org/10.1186/s12911-022-01991-7 |3 Volltext |
912 | |a GBV_USEFLAG_A | ||
912 | |a GBV_NLM | ||
951 | |a AR | ||
952 | |d 22 |j 2022 |e 1 |b 18 |c 09 |h 244 |