DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery through Sophisticated AI System Technologies
In the upcoming decade, deep learning may revolutionize the natural sciences, enhancing our capacity to model and predict natural occurrences. This could herald a new era of scientific exploration, bringing significant advancements across sectors from drug development to renewable energy. To answer this call, we present DeepSpeed4Science initiative (deepspeed4science.ai) which aims to build unique capabilities through AI system technology innovations to help domain experts to unlock today's biggest science mysteries. By leveraging DeepSpeed's current technology pillars (training, inference and compression) as base technology enablers, DeepSpeed4Science will create a new set of AI system technologies tailored for accelerating scientific discoveries by addressing their unique complexity beyond the common technical approaches used for accelerating generic large language models (LLMs). In this paper, we showcase the early progress we made with DeepSpeed4Science in addressing two of the critical system challenges in structural biology research..
| Medienart: |
|
|---|
Preprint| Erscheinungsjahr: |
2023 |
|---|---|
| Erschienen: |
2023 |
| Enthalten in: |
arXiv.org - (2023) vom: 06. Okt. Zur Gesamtaufnahme - year:2023 |
|---|
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Song, Shuaiwen Leon [VerfasserIn] |
|---|
| Links: |
Volltext [kostenfrei] |
|---|
| Themen: |
000 |
|---|
| Förderinstitution / Projekttitel: |
|
|---|
| PPN (Katalog-ID): |
XAR041125940 |
|---|
| LEADER | 01000caa a22002652 4500 | ||
|---|---|---|---|
| 001 | XAR041125940 | ||
| 003 | DE-627 | ||
| 005 | 20231013080534.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 231012s2023 xx |||||o 00| ||eng c | ||
| 035 | |a (DE-627)XAR041125940 | ||
| 035 | |a (arXiv)2310.04610 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Song, Shuaiwen Leon |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery through Sophisticated AI System Technologies |
| 264 | 1 | |c 2023 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a Computermedien |b c |2 rdamedia | ||
| 338 | |a Online-Ressource |b cr |2 rdacarrier | ||
| 520 | |a In the upcoming decade, deep learning may revolutionize the natural sciences, enhancing our capacity to model and predict natural occurrences. This could herald a new era of scientific exploration, bringing significant advancements across sectors from drug development to renewable energy. To answer this call, we present DeepSpeed4Science initiative (deepspeed4science.ai) which aims to build unique capabilities through AI system technology innovations to help domain experts to unlock today's biggest science mysteries. By leveraging DeepSpeed's current technology pillars (training, inference and compression) as base technology enablers, DeepSpeed4Science will create a new set of AI system technologies tailored for accelerating scientific discoveries by addressing their unique complexity beyond the common technical approaches used for accelerating generic large language models (LLMs). In this paper, we showcase the early progress we made with DeepSpeed4Science in addressing two of the critical system challenges in structural biology research. | ||
| 650 | 4 | |a Computer Science - Artificial Intelligence |7 (dpeaa)DE-84 | |
| 650 | 4 | |a Computer Science - Machine Learning |7 (dpeaa)DE-84 | |
| 650 | 4 | |a 000 |7 (dpeaa)DE-84 | |
| 700 | 1 | |a Kruft, Bonnie |4 aut | |
| 700 | 1 | |a Zhang, Minjia |4 aut | |
| 700 | 1 | |a Li, Conglong |4 aut | |
| 700 | 1 | |a Chen, Shiyang |4 aut | |
| 700 | 1 | |a Zhang, Chengming |4 aut | |
| 700 | 1 | |a Tanaka, Masahiro |4 aut | |
| 700 | 1 | |a Wu, Xiaoxia |4 aut | |
| 700 | 1 | |a Rasley, Jeff |4 aut | |
| 700 | 1 | |a Awan, Ammar Ahmad |4 aut | |
| 700 | 1 | |a Holmes, Connor |4 aut | |
| 700 | 1 | |a Cai, Martin |4 aut | |
| 700 | 1 | |a Ghanem, Adam |4 aut | |
| 700 | 1 | |a Zhou, Zhongzhu |4 aut | |
| 700 | 1 | |a He, Yuxiong |4 aut | |
| 700 | 1 | |a Luferenko, Pete |4 aut | |
| 700 | 1 | |a Kumar, Divya |4 aut | |
| 700 | 1 | |a Weyn, Jonathan |4 aut | |
| 700 | 1 | |a Zhang, Ruixiong |4 aut | |
| 700 | 1 | |a Klocek, Sylwester |4 aut | |
| 700 | 1 | |a Vragov, Volodymyr |4 aut | |
| 700 | 1 | |a AlQuraishi, Mohammed |4 aut | |
| 700 | 1 | |a Ahdritz, Gustaf |4 aut | |
| 700 | 1 | |a Floristean, Christina |4 aut | |
| 700 | 1 | |a Negri, Cristina |4 aut | |
| 700 | 1 | |a Kotamarthi, Rao |4 aut | |
| 700 | 1 | |a Vishwanath, Venkatram |4 aut | |
| 700 | 1 | |a Ramanathan, Arvind |4 aut | |
| 700 | 1 | |a Foreman, Sam |4 aut | |
| 700 | 1 | |a Hippe, Kyle |4 aut | |
| 700 | 1 | |a Arcomano, Troy |4 aut | |
| 700 | 1 | |a Maulik, Romit |4 aut | |
| 700 | 1 | |a Zvyagin, Maxim |4 aut | |
| 700 | 1 | |a Brace, Alexander |4 aut | |
| 700 | 1 | |a Zhang, Bin |4 aut | |
| 700 | 1 | |a Bohorquez, Cindy Orozco |4 aut | |
| 700 | 1 | |a Clyde, Austin |4 aut | |
| 700 | 1 | |a Kale, Bharat |4 aut | |
| 700 | 1 | |a Perez-Rivera, Danilo |4 aut | |
| 700 | 1 | |a Ma, Heng |4 aut | |
| 700 | 1 | |a Mann, Carla M. |4 aut | |
| 700 | 1 | |a Irvin, Michael |4 aut | |
| 700 | 1 | |a Pauloski, J. Gregory |4 aut | |
| 700 | 1 | |a Ward, Logan |4 aut | |
| 700 | 1 | |a Hayot, Valerie |4 aut | |
| 700 | 1 | |a Emani, Murali |4 aut | |
| 700 | 1 | |a Xie, Zhen |4 aut | |
| 700 | 1 | |a Lin, Diangen |4 aut | |
| 700 | 1 | |a Shukla, Maulik |4 aut | |
| 700 | 1 | |a Foster, Ian |4 aut | |
| 700 | 1 | |a Davis, James J. |4 aut | |
| 700 | 1 | |a Papka, Michael E. |4 aut | |
| 700 | 1 | |a Brettin, Thomas |4 aut | |
| 700 | 1 | |a Balaprakash, Prasanna |4 aut | |
| 700 | 1 | |a Tourassi, Gina |4 aut | |
| 700 | 1 | |a Gounley, John |4 aut | |
| 700 | 1 | |a Hanson, Heidi |4 aut | |
| 700 | 1 | |a Potok, Thomas E |4 aut | |
| 700 | 1 | |a Pasini, Massimiliano Lupo |4 aut | |
| 700 | 1 | |a Evans, Kate |4 aut | |
| 700 | 1 | |a Lu, Dan |4 aut | |
| 700 | 1 | |a Lunga, Dalton |4 aut | |
| 700 | 1 | |a Yin, Junqi |4 aut | |
| 700 | 1 | |a Dash, Sajal |4 aut | |
| 700 | 1 | |a Wang, Feiyi |4 aut | |
| 700 | 1 | |a Shankar, Mallikarjun |4 aut | |
| 700 | 1 | |a Lyngaas, Isaac |4 aut | |
| 700 | 1 | |a Wang, Xiao |4 aut | |
| 700 | 1 | |a Cong, Guojing |4 aut | |
| 700 | 1 | |a Zhang, Pei |4 aut | |
| 700 | 1 | |a Fan, Ming |4 aut | |
| 700 | 1 | |a Liu, Siyan |4 aut | |
| 700 | 1 | |a Hoisie, Adolfy |4 aut | |
| 700 | 1 | |a Yoo, Shinjae |4 aut | |
| 700 | 1 | |a Ren, Yihui |4 aut | |
| 700 | 1 | |a Tang, William |4 aut | |
| 700 | 1 | |a Felker, Kyle |4 aut | |
| 700 | 1 | |a Svyatkovskiy, Alexey |4 aut | |
| 700 | 1 | |a Liu, Hang |4 aut | |
| 700 | 1 | |a Aji, Ashwin |4 aut | |
| 700 | 1 | |a Dalton, Angela |4 aut | |
| 700 | 1 | |a Schulte, Michael |4 aut | |
| 700 | 1 | |a Schulz, Karl |4 aut | |
| 700 | 1 | |a Deng, Yuntian |4 aut | |
| 700 | 1 | |a Nie, Weili |4 aut | |
| 700 | 1 | |a Romero, Josh |4 aut | |
| 700 | 1 | |a Dallago, Christian |4 aut | |
| 700 | 1 | |a Vahdat, Arash |4 aut | |
| 700 | 1 | |a Xiao, Chaowei |4 aut | |
| 700 | 1 | |a Gibbs, Thomas |4 aut | |
| 700 | 1 | |a Anandkumar, Anima |4 aut | |
| 700 | 1 | |a Stevens, Rick |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t arXiv.org |g (2023) vom: 06. Okt. |
| 773 | 1 | 8 | |g year:2023 |g day:06 |g month:10 |
| 856 | 4 | 0 | |u https://arxiv.org/abs/2310.04610 |z kostenfrei |3 Volltext |
| 912 | |a GBV_XAR | ||
| 951 | |a AR | ||
| 952 | |j 2023 |b 06 |c 10 | ||