AI / ML / LLM / Transformer Models Timeline Details

Viktor Garske @vemgar, Last update: Tue Dec 26 15:23:35 2023
← Back to the full graph

RedPajama-Data-1T

This graph is clickable!

timeline 02/2023 02/2023 04/2023 04/2023 02/2023->04/2023 05/2023 05/2023 04/2023->05/2023 06/2023 06/2023 05/2023->06/2023 Llama LLaMA Openllama OpenLLaMA Llama->Openllama RedpajamaInciteBase RedPajama-INCITE-Base Llama->RedpajamaInciteBase RedpajamaData1t RedPajama-Data-1T Llama->RedpajamaData1t Mpt30b MPT-30B RedpajamaData1t->Openllama RedpajamaData1t->RedpajamaInciteBase RedpajamaData1t->Mpt30b
Type
Dataset
Blog post title
RedPajama, a project to create leading open-source models, starts by reproducing LLaMA training dataset of over 1.2 trillion tokens
Blog post link
https://www.together.xyz/blog/redpajama
Publish date
2023-04-17
Repository link
https://github.com/togethercomputer/RedPajama-Data
Affiliation
Together