AI / ML / LLM / Transformer Models Timeline Details

Viktor Garske @vemgar, Last update: Sun Jul 30 16:20:21 2023
← Back to the full graph

The Pile

This graph is clickable!

timeline 12/2020 12/2020 06/2021 06/2021 12/2020->06/2021 04/2023 04/2023 06/2021->04/2023 Pythia Pythia Stablelm StableLM Pythia->Stablelm GptJ GPT-J GptJ->Stablelm Pile The Pile Pile->Pythia Pile->Stablelm Pile->GptJ
Type
Dataset
Paper name
The Pile: An 800GB Dataset of Diverse Text for Language Modeling
Paper authors
Gao et al.
Paper link
https://arxiv.org/abs/2101.00027
Publish date
2020-12
Affiliation
Eleuther AI