Keypoint-MoSeq: parsing behavior by linking point tracking to pose dynamics
Abstract Keypoint tracking algorithms have revolutionized the analysis of animal behavior, enabling investigators to flexibly quantify behavioral dynamics from conventional video recordings obtained in a wide variety of settings. However, it remains unclear how to parse continuous keypoint data into the modules out of which behavior is organized. This challenge is particularly acute because keypoint data is susceptible to high frequency jitter that clustering algorithms can mistake for transitions between behavioral modules. Here we present keypoint-MoSeq, a machine learning-based platform for identifying behavioral modules (“syllables”) from keypoint data without human supervision. Keypoint-MoSeq uses a generative model to distinguish keypoint noise from behavior, enabling it to effectively identify syllables whose boundaries correspond to natural sub-second discontinuities inherent to mouse behavior. Keypoint-MoSeq outperforms commonly used alternative clustering methods at identifying these transitions, at capturing correlations between neural activity and behavior, and at classifying either solitary or social behaviors in accordance with human annotations. Keypoint-MoSeq therefore renders behavioral syllables and grammar accessible to the many researchers who use standard video to capture animal behavior..
| Medienart: |
|
|---|
Preprint| Erscheinungsjahr: |
2023 |
|---|---|
| Erschienen: |
2023 |
| Enthalten in: |
bioRxiv.org - (2023) vom: 27. Dez. Zur Gesamtaufnahme - year:2023 |
|---|
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Weinreb, Caleb [VerfasserIn] |
|---|
| Links: |
Volltext [kostenfrei] |
|---|
| Themen: |
|---|
| doi: |
10.1101/2023.03.16.532307 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
XBI038995247 |
|---|
| LEADER | 01000caa a22002652 4500 | ||
|---|---|---|---|
| 001 | XBI038995247 | ||
| 003 | DE-627 | ||
| 005 | 20231228090646.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 230320s2023 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1101/2023.03.16.532307 |2 doi | |
| 035 | |a (DE-627)XBI038995247 | ||
| 035 | |a (biorXiv)10.1101/2023.03.16.532307 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Weinreb, Caleb |e verfasserin |0 (orcid)0000-0001-6100-6084 |4 aut | |
| 245 | 1 | 0 | |a Keypoint-MoSeq: parsing behavior by linking point tracking to pose dynamics |
| 264 | 1 | |c 2023 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a Computermedien |b c |2 rdamedia | ||
| 338 | |a Online-Ressource |b cr |2 rdacarrier | ||
| 520 | |a Abstract Keypoint tracking algorithms have revolutionized the analysis of animal behavior, enabling investigators to flexibly quantify behavioral dynamics from conventional video recordings obtained in a wide variety of settings. However, it remains unclear how to parse continuous keypoint data into the modules out of which behavior is organized. This challenge is particularly acute because keypoint data is susceptible to high frequency jitter that clustering algorithms can mistake for transitions between behavioral modules. Here we present keypoint-MoSeq, a machine learning-based platform for identifying behavioral modules (“syllables”) from keypoint data without human supervision. Keypoint-MoSeq uses a generative model to distinguish keypoint noise from behavior, enabling it to effectively identify syllables whose boundaries correspond to natural sub-second discontinuities inherent to mouse behavior. Keypoint-MoSeq outperforms commonly used alternative clustering methods at identifying these transitions, at capturing correlations between neural activity and behavior, and at classifying either solitary or social behaviors in accordance with human annotations. Keypoint-MoSeq therefore renders behavioral syllables and grammar accessible to the many researchers who use standard video to capture animal behavior. | ||
| 650 | 4 | |a Biology |7 (dpeaa)DE-84 | |
| 650 | 4 | |a 570 |7 (dpeaa)DE-84 | |
| 700 | 1 | |a Pearl, Jonah |0 (orcid)0000-0001-9300-1552 |4 aut | |
| 700 | 1 | |a Lin, Sherry |0 (orcid)0000-0002-1275-8391 |4 aut | |
| 700 | 1 | |a Osman, Mohammed Abdal Monium |0 (orcid)0000-0001-8606-6518 |4 aut | |
| 700 | 1 | |a Zhang, Libby |4 aut | |
| 700 | 1 | |a Annapragada, Sidharth |4 aut | |
| 700 | 1 | |a Conlin, Eli |4 aut | |
| 700 | 1 | |a Hoffman, Red |4 aut | |
| 700 | 1 | |a Makowska, Sofia |4 aut | |
| 700 | 1 | |a Gillis, Winthrop F. |0 (orcid)0000-0002-1659-8639 |4 aut | |
| 700 | 1 | |a Jay, Maya |0 (orcid)0000-0001-5537-6476 |4 aut | |
| 700 | 1 | |a Ye, Shaokai |0 (orcid)0000-0003-4250-2220 |4 aut | |
| 700 | 1 | |a Mathis, Alexander |0 (orcid)0000-0002-3777-2202 |4 aut | |
| 700 | 1 | |a Mathis, Mackenzie Weygandt |0 (orcid)0000-0001-7368-4456 |4 aut | |
| 700 | 1 | |a Pereira, Talmo |0 (orcid)0000-0001-9075-8365 |4 aut | |
| 700 | 1 | |a Linderman, Scott W. |0 (orcid)0000-0002-3878-9073 |4 aut | |
| 700 | 1 | |a Datta, Sandeep Robert |0 (orcid)0000-0002-8068-3862 |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t bioRxiv.org |g (2023) vom: 27. Dez. |
| 773 | 1 | 8 | |g year:2023 |g day:27 |g month:12 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1101/2023.03.16.532307 |z kostenfrei |3 Volltext |
| 912 | |a GBV_XBI | ||
| 951 | |a AR | ||
| 952 | |j 2023 |b 27 |c 12 | ||