SegmentNT: annotating the genome at single-nucleotide resolution with DNA foundation models
Foundation models have achieved remarkable success in several fields such as natural language processing, computer vision and more recently biology. DNA foundation models in particular are emerging as a promising approach for genomics. However, so far no model has delivered granular, nucleotide-level predictions across a wide range of genomic and regulatory elements, limiting their practical usefulness. In this paper, we build on our previous work on the Nucleotide Transformer (NT) to develop a segmentation model, SegmentNT, that processes input DNA sequences up to 30kb-long to predict 14 different classes of genomic elements at single nucleotide resolution. By utilizing pre-trained weights from NT, SegmentNT surpasses the performance of several ablation models, including convolution networks with one-hot encoded nucleotide sequences and models trained from scratch. SegmentNT can process multiple sequence lengths with zero-shot generalization for sequences of up to 50kb. We show improved performance on the detection of splice sites throughout the genome and demonstrate strong nucleotide-level precision. Because it evaluates all gene elements simultaneously, SegmentNT can predict the impact of sequence variants not only on splice site changes but also on exon and intron rearrangements in transcript isoforms. Finally, we show that a SegmentNT model trained on human genomic elements can generalize to elements of different human and plant species and that a trained multispecies SegmentNT model achieves stronger generalization for all genic elements on unseen species. In summary, SegmentNT demonstrates that DNA foundation models can tackle complex, granular tasks in genomics at a single-nucleotide resolution. SegmentNT can be easily extended to additional genomic elements and species, thus representing a new paradigm on how we analyze and interpret DNA. We make our SegmentNT-30kb human and multispecies models available on our github repository in Jax and HuggingFace space in Pytorch..
| Medienart: |
|
|---|
Preprint| Erscheinungsjahr: |
2024 |
|---|---|
| Erschienen: |
2024 |
| Enthalten in: |
bioRxiv.org - (2024) vom: 27. März Zur Gesamtaufnahme - year:2024 |
|---|
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
de Almeida, Bernardo P [VerfasserIn] |
|---|
| Links: |
Volltext [kostenfrei] |
|---|
| Themen: |
|---|
| doi: |
10.1101/2024.03.14.584712 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
XBI042929857 |
|---|
| LEADER | 01000caa a22002652 4500 | ||
|---|---|---|---|
| 001 | XBI042929857 | ||
| 003 | DE-627 | ||
| 005 | 20240328090508.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 240317s2024 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1101/2024.03.14.584712 |2 doi | |
| 035 | |a (DE-627)XBI042929857 | ||
| 035 | |a (biorXiv)10.1101/2024.03.14.584712 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a de Almeida, Bernardo P |e verfasserin |0 (orcid)0000-0002-6084-6775 |4 aut | |
| 245 | 1 | 0 | |a SegmentNT: annotating the genome at single-nucleotide resolution with DNA foundation models |
| 264 | 1 | |c 2024 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a Computermedien |b c |2 rdamedia | ||
| 338 | |a Online-Ressource |b cr |2 rdacarrier | ||
| 520 | |a Foundation models have achieved remarkable success in several fields such as natural language processing, computer vision and more recently biology. DNA foundation models in particular are emerging as a promising approach for genomics. However, so far no model has delivered granular, nucleotide-level predictions across a wide range of genomic and regulatory elements, limiting their practical usefulness. In this paper, we build on our previous work on the Nucleotide Transformer (NT) to develop a segmentation model, SegmentNT, that processes input DNA sequences up to 30kb-long to predict 14 different classes of genomic elements at single nucleotide resolution. By utilizing pre-trained weights from NT, SegmentNT surpasses the performance of several ablation models, including convolution networks with one-hot encoded nucleotide sequences and models trained from scratch. SegmentNT can process multiple sequence lengths with zero-shot generalization for sequences of up to 50kb. We show improved performance on the detection of splice sites throughout the genome and demonstrate strong nucleotide-level precision. Because it evaluates all gene elements simultaneously, SegmentNT can predict the impact of sequence variants not only on splice site changes but also on exon and intron rearrangements in transcript isoforms. Finally, we show that a SegmentNT model trained on human genomic elements can generalize to elements of different human and plant species and that a trained multispecies SegmentNT model achieves stronger generalization for all genic elements on unseen species. In summary, SegmentNT demonstrates that DNA foundation models can tackle complex, granular tasks in genomics at a single-nucleotide resolution. SegmentNT can be easily extended to additional genomic elements and species, thus representing a new paradigm on how we analyze and interpret DNA. We make our SegmentNT-30kb human and multispecies models available on our github repository in Jax and HuggingFace space in Pytorch. | ||
| 650 | 4 | |a Biology |7 (dpeaa)DE-84 | |
| 650 | 4 | |a 570 |7 (dpeaa)DE-84 | |
| 700 | 1 | |a Dalla-Torre, Hugo |4 aut | |
| 700 | 1 | |a Richard, Guillaume |4 aut | |
| 700 | 1 | |a Blum, Christopher |4 aut | |
| 700 | 1 | |a Hexemer, Lorenz |4 aut | |
| 700 | 1 | |a Gelard, Maxence |4 aut | |
| 700 | 1 | |a Mendoza-Revilla, Javier |0 (orcid)0000-0002-4026-9333 |4 aut | |
| 700 | 1 | |a Pandey, Priyanka |4 aut | |
| 700 | 1 | |a Laurent, Stefan |4 aut | |
| 700 | 1 | |a Lopez, Marie |4 aut | |
| 700 | 1 | |a Laterre, Alexandre |4 aut | |
| 700 | 1 | |a Lang, Maren |4 aut | |
| 700 | 1 | |a Sahin, Ugur |4 aut | |
| 700 | 1 | |a Beguir, Karim |4 aut | |
| 700 | 1 | |a Pierrot, Thomas |0 (orcid)0000-0002-5227-6194 |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t bioRxiv.org |g (2024) vom: 27. März |
| 773 | 1 | 8 | |g year:2024 |g day:27 |g month:03 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1101/2024.03.14.584712 |z kostenfrei |3 Volltext |
| 912 | |a GBV_XBI | ||
| 951 | |a AR | ||
| 952 | |j 2024 |b 27 |c 03 | ||