AI / ML / LLM / Transformer Models Timeline Details

Viktor Garske @vemgar, Last update: Tue Dec 26 15:23:35 2023
← Back to the full graph

Pythia

This graph is clickable!

timeline 12/2020 12/2020 08/2021 08/2021 12/2020->08/2021 04/2023 04/2023 08/2021->04/2023 05/2023 05/2023 04/2023->05/2023 Pythia Pythia Dolly2 Dolly 2.0 Pythia->Dolly2 Oasst1Model OpenAssistant Pythia->Oasst1Model Stablelm StableLM Pythia->Stablelm RedpajamaInciteBase RedPajama-INCITE-Base Pythia->RedpajamaInciteBase GptNeox GPT-NeoX GptNeox->Pythia GptNeox->Stablelm Pile The Pile Pile->Pythia Pile->Stablelm
Type
Model
Paper name
Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling
Paper authors
Biderman et al.
Paper link
https://arxiv.org/abs/2304.01373
Publish date
2023-04-03
Affiliation
Eleuther AI