System identifiability in a time-evolving agent-based model
Copyright: © 2024 Robin et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited..
Mathematical models are a valuable tool for studying and predicting the spread of infectious agents. The accuracy of model simulations and predictions invariably depends on the specification of model parameters. Estimation of these parameters is therefore extremely important; however, while some parameters can be derived from observational studies, the values of others are difficult to measure. Instead, models can be coupled with inference algorithms (i.e., data assimilation methods, or statistical filters), which fit model simulations to existing observations and estimate unobserved model state variables and parameters. Ideally, these inference algorithms should find the best fitting solution for a given model and set of observations; however, as those estimated quantities are unobserved, it is typically uncertain whether the correct parameters have been identified. Further, it is unclear what 'correct' really means for abstract parameters defined based on specific model forms. In this work, we explored the problem of non-identifiability in a stochastic system which, when overlooked, can significantly impede model prediction. We used a network, agent-based model to simulate the transmission of Methicillin-resistant staphylococcus aureus (MRSA) within hospital settings and attempted to infer key model parameters using the Ensemble Adjustment Kalman Filter, an efficient Bayesian inference algorithm. We show that even though the inference method converged and that simulations using the estimated parameters produced an agreement with observations, the true parameters are not fully identifiable. While the model-inference system can exclude a substantial area of parameter space that is unlikely to contain the true parameters, the estimated parameter range still included multiple parameter combinations that can fit observations equally well. We show that analyzing synthetic trajectories can support or contradict claims of identifiability. While we perform this on a specific model system, this approach can be generalized for a variety of stochastic representations of partially observable systems. We also suggest data manipulations intended to improve identifiability that might be applicable in many systems of interest.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2024 |
|---|---|
| Erschienen: |
2024 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:19 |
|---|---|
| Enthalten in: |
PloS one - 19(2024), 1 vom: 25., Seite e0290821 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Robin, Tal T [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
|---|
| Anmerkungen: |
Date Completed 29.01.2024 Date Revised 28.02.2024 published: Electronic-eCollection Citation Status MEDLINE |
|---|
| doi: |
10.1371/journal.pone.0290821 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM367618184 |
|---|
| LEADER | 01000caa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM367618184 | ||
| 003 | DE-627 | ||
| 005 | 20240229170749.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 240126s2024 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1371/journal.pone.0290821 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1310.xml |
| 035 | |a (DE-627)NLM367618184 | ||
| 035 | |a (NLM)38271401 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Robin, Tal T |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a System identifiability in a time-evolving agent-based model |
| 264 | 1 | |c 2024 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 29.01.2024 | ||
| 500 | |a Date Revised 28.02.2024 | ||
| 500 | |a published: Electronic-eCollection | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a Copyright: © 2024 Robin et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. | ||
| 520 | |a Mathematical models are a valuable tool for studying and predicting the spread of infectious agents. The accuracy of model simulations and predictions invariably depends on the specification of model parameters. Estimation of these parameters is therefore extremely important; however, while some parameters can be derived from observational studies, the values of others are difficult to measure. Instead, models can be coupled with inference algorithms (i.e., data assimilation methods, or statistical filters), which fit model simulations to existing observations and estimate unobserved model state variables and parameters. Ideally, these inference algorithms should find the best fitting solution for a given model and set of observations; however, as those estimated quantities are unobserved, it is typically uncertain whether the correct parameters have been identified. Further, it is unclear what 'correct' really means for abstract parameters defined based on specific model forms. In this work, we explored the problem of non-identifiability in a stochastic system which, when overlooked, can significantly impede model prediction. We used a network, agent-based model to simulate the transmission of Methicillin-resistant staphylococcus aureus (MRSA) within hospital settings and attempted to infer key model parameters using the Ensemble Adjustment Kalman Filter, an efficient Bayesian inference algorithm. We show that even though the inference method converged and that simulations using the estimated parameters produced an agreement with observations, the true parameters are not fully identifiable. While the model-inference system can exclude a substantial area of parameter space that is unlikely to contain the true parameters, the estimated parameter range still included multiple parameter combinations that can fit observations equally well. We show that analyzing synthetic trajectories can support or contradict claims of identifiability. While we perform this on a specific model system, this approach can be generalized for a variety of stochastic representations of partially observable systems. We also suggest data manipulations intended to improve identifiability that might be applicable in many systems of interest | ||
| 650 | 4 | |a Journal Article | |
| 700 | 1 | |a Cascante-Vega, Jaime |e verfasserin |4 aut | |
| 700 | 1 | |a Shaman, Jeffrey |e verfasserin |4 aut | |
| 700 | 1 | |a Pei, Sen |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t PloS one |d 2006 |g 19(2024), 1 vom: 25., Seite e0290821 |w (DE-627)NLM167327399 |x 1932-6203 |7 nnns |
| 773 | 1 | 8 | |g volume:19 |g year:2024 |g number:1 |g day:25 |g pages:e0290821 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1371/journal.pone.0290821 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 19 |j 2024 |e 1 |b 25 |h e0290821 | ||