Scaling Properties for Artificial Neural Network Models of a Small Nervous System
Abstract The nematode wormC. elegansprovides a unique opportunity for exploringin silicodata-driven models of a whole nervous system, given its transparency and well-characterized nervous system facilitating a wealth of measurement data from wet-lab experiments. This study explores the scaling properties that may govern learning the underlying neural dynamics of this small nervous system by using artificial neural network (ANN) models. We investigate the accuracy of self-supervised next time-step neural activity prediction as a function of data and models. For data scaling, we report a monotonic log-linear reduction in mean-squared error (MSE) as a function of the amount of neural activity data. For model scaling, we find MSE to be a nonlinear function of the size of the ANN models. Furthermore, we observe that the dataset and model size scaling properties are influenced by the particular choice of model architecture but not by the precise experimental source of theC. elegansneural data. Our results fall short of producing long-horizon predictive and generative models ofC. eleganswhole nervous system dynamics but suggest directions to achieve those. In particular our data scaling properties extrapolate that recording more neural activity data is a fruitful near-term approach to obtaining better predictive ANN models of a small nervous system..
| Medienart: |
|
|---|
Preprint| Erscheinungsjahr: |
2024 |
|---|---|
| Erschienen: |
2024 |
| Enthalten in: |
bioRxiv.org - (2024) vom: 07. März Zur Gesamtaufnahme - year:2024 |
|---|
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Simeon, Quilee [VerfasserIn] |
|---|
| Links: |
Volltext [kostenfrei] |
|---|
| Themen: |
|---|
| doi: |
10.1101/2024.02.13.580186 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
XBI042511739 |
|---|
| LEADER | 01000caa a22002652 4500 | ||
|---|---|---|---|
| 001 | XBI042511739 | ||
| 003 | DE-627 | ||
| 005 | 20240309090730.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 240215s2024 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1101/2024.02.13.580186 |2 doi | |
| 035 | |a (DE-627)XBI042511739 | ||
| 035 | |a (biorXiv)10.1101/2024.02.13.580186 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Simeon, Quilee |e verfasserin |0 (orcid)0000-0003-4561-5087 |4 aut | |
| 245 | 1 | 0 | |a Scaling Properties for Artificial Neural Network Models of a Small Nervous System |
| 264 | 1 | |c 2024 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a Computermedien |b c |2 rdamedia | ||
| 338 | |a Online-Ressource |b cr |2 rdacarrier | ||
| 520 | |a Abstract The nematode wormC. elegansprovides a unique opportunity for exploringin silicodata-driven models of a whole nervous system, given its transparency and well-characterized nervous system facilitating a wealth of measurement data from wet-lab experiments. This study explores the scaling properties that may govern learning the underlying neural dynamics of this small nervous system by using artificial neural network (ANN) models. We investigate the accuracy of self-supervised next time-step neural activity prediction as a function of data and models. For data scaling, we report a monotonic log-linear reduction in mean-squared error (MSE) as a function of the amount of neural activity data. For model scaling, we find MSE to be a nonlinear function of the size of the ANN models. Furthermore, we observe that the dataset and model size scaling properties are influenced by the particular choice of model architecture but not by the precise experimental source of theC. elegansneural data. Our results fall short of producing long-horizon predictive and generative models ofC. eleganswhole nervous system dynamics but suggest directions to achieve those. In particular our data scaling properties extrapolate that recording more neural activity data is a fruitful near-term approach to obtaining better predictive ANN models of a small nervous system. | ||
| 650 | 4 | |a Biology |7 (dpeaa)DE-84 | |
| 650 | 4 | |a 570 |7 (dpeaa)DE-84 | |
| 700 | 1 | |a Venâncio, Leandro |0 (orcid)0009-0002-0924-5218 |4 aut | |
| 700 | 1 | |a Skuhersky, Michael A. |0 (orcid)0000-0002-6057-794X |4 aut | |
| 700 | 1 | |a Nayebi, Aran |0 (orcid)0000-0002-7509-9629 |4 aut | |
| 700 | 1 | |a Boyden, Edward S. |4 aut | |
| 700 | 1 | |a Yang, Guangyu Robert |0 (orcid)0000-0002-8919-4248 |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t bioRxiv.org |g (2024) vom: 07. März |
| 773 | 1 | 8 | |g year:2024 |g day:07 |g month:03 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1101/2024.02.13.580186 |z kostenfrei |3 Volltext |
| 912 | |a GBV_XBI | ||
| 951 | |a AR | ||
| 952 | |j 2024 |b 07 |c 03 | ||