Inferring Dynamic Networks from Marginals with Iterative Proportional Fitting
A common network inference problem, arising from real-world data constraints, is how to infer a dynamic network from its time-aggregated adjacency matrix and time-varying marginals (i.e., row and column sums). Prior approaches to this problem have repurposed the classic iterative proportional fitting (IPF) procedure, also known as Sinkhorn's algorithm, with promising empirical results. However, the statistical foundation for using IPF has not been well understood: under what settings does IPF provide principled estimation of a dynamic network from its marginals, and how well does it estimate the network? In this work, we establish such a setting, by identifying a generative network model whose maximum likelihood estimates are recovered by IPF. Our model both reveals implicit assumptions on the use of IPF in such settings and enables new analyses, such as structure-dependent error bounds on IPF's parameter estimates. When IPF fails to converge on sparse network data, we introduce a principled algorithm that guarantees IPF converges under minimal changes to the network structure. Finally, we conduct experiments with synthetic and real-world data, which demonstrate the practical value of our theoretical and algorithmic contributions..
| Medienart: |
|
|---|
Preprint| Erscheinungsjahr: |
2024 |
|---|---|
| Erschienen: |
2024 |
| Enthalten in: |
arXiv.org - (2024) vom: 28. Feb. Zur Gesamtaufnahme - year:2024 |
|---|
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Chang, Serina [VerfasserIn] |
|---|
| Links: |
Volltext [kostenfrei] |
|---|
| Förderinstitution / Projekttitel: |
|
|---|
| PPN (Katalog-ID): |
XCH042803659 |
|---|
| LEADER | 01000naa a22002652 4500 | ||
|---|---|---|---|
| 001 | XCH042803659 | ||
| 003 | DE-627 | ||
| 005 | 20240306114527.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 240306s2024 xx |||||o 00| ||eng c | ||
| 035 | |a (DE-627)XCH042803659 | ||
| 035 | |a (chemrXiv)2402.18697 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Chang, Serina |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Inferring Dynamic Networks from Marginals with Iterative Proportional Fitting |
| 264 | 1 | |c 2024 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a Computermedien |b c |2 rdamedia | ||
| 338 | |a Online-Ressource |b cr |2 rdacarrier | ||
| 520 | |a A common network inference problem, arising from real-world data constraints, is how to infer a dynamic network from its time-aggregated adjacency matrix and time-varying marginals (i.e., row and column sums). Prior approaches to this problem have repurposed the classic iterative proportional fitting (IPF) procedure, also known as Sinkhorn's algorithm, with promising empirical results. However, the statistical foundation for using IPF has not been well understood: under what settings does IPF provide principled estimation of a dynamic network from its marginals, and how well does it estimate the network? In this work, we establish such a setting, by identifying a generative network model whose maximum likelihood estimates are recovered by IPF. Our model both reveals implicit assumptions on the use of IPF in such settings and enables new analyses, such as structure-dependent error bounds on IPF's parameter estimates. When IPF fails to converge on sparse network data, we introduce a principled algorithm that guarantees IPF converges under minimal changes to the network structure. Finally, we conduct experiments with synthetic and real-world data, which demonstrate the practical value of our theoretical and algorithmic contributions. | ||
| 650 | 4 | |a Statistics - Machine Learning |7 (dpeaa)DE-84 | |
| 650 | 4 | |a Computer Science - Machine Learning |7 (dpeaa)DE-84 | |
| 650 | 4 | |a Computer Science - Social and Information Networks |7 (dpeaa)DE-84 | |
| 650 | 4 | |a Mathematics - Optimization and Control |7 (dpeaa)DE-84 | |
| 650 | 4 | |a Mathematics - Statistics |7 (dpeaa)DE-84 | |
| 650 | 4 | |a Statistics - Theory |7 (dpeaa)DE-84 | |
| 650 | 4 | |a 510 |7 (dpeaa)DE-84 | |
| 650 | 4 | |a 000 |7 (dpeaa)DE-84 | |
| 700 | 1 | |a Koehler, Frederic |4 aut | |
| 700 | 1 | |a Qu, Zhaonan |4 aut | |
| 700 | 1 | |a Leskovec, Jure |4 aut | |
| 700 | 1 | |a Ugander, Johan |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t arXiv.org |g (2024) vom: 28. Feb. |
| 773 | 1 | 8 | |g year:2024 |g day:28 |g month:02 |
| 856 | 4 | 0 | |u https://arxiv.org/abs/2402.18697 |z kostenfrei |3 Volltext |
| 912 | |a GBV_XCH | ||
| 951 | |a AR | ||
| 952 | |j 2024 |b 28 |c 02 | ||