AI / ML / LLM / Transformer Models Timeline Details
Viktor Garske
@vemgar
, Last update: Tue Dec 26 15:23:35 2023
← Back to the full graph
The Pile
This graph is clickable!
timeline
12/2020
12/2020
06/2021
06/2021
12/2020->06/2021
04/2023
04/2023
06/2021->04/2023
Pythia
Pythia
Stablelm
StableLM
Pythia->Stablelm
GptJ
GPT-J
GptJ->Stablelm
Pile
The Pile
Pile->Pythia
Pile->Stablelm
Pile->GptJ
Type
Dataset
Paper name
The Pile: An 800GB Dataset of Diverse Text for Language Modeling
Paper authors
Gao et al.
Paper link
https://arxiv.org/abs/2101.00027
Publish date
2020-12
Affiliation
Eleuther AI