AI / ML / LLM / Transformer Models Timeline Details

Viktor Garske @vemgar, Last update: Tue Dec 26 15:23:35 2023
← Back to the full graph

StarCoderBase

This graph is clickable!

timeline 02/2019 02/2019 09/2019 09/2019 02/2019->09/2019 11/2019 11/2019 09/2019->11/2019 07/2021 07/2021 11/2019->07/2021 05/2022 05/2022 07/2021->05/2022 05/2023 05/2023 05/2022->05/2023 MegatronLm Megatron-LM Starcoderbase StarCoderBase MegatronLm->Starcoderbase Gpt2 GPT-2 Starcoder StarCoder Gpt2->Starcoder Gpt2->Starcoderbase Codex OpenAI Codex Codex->Starcoder Codex->Starcoderbase Starcoderbase->Starcoder Flashattention FlashAttention Flashattention->Starcoderbase Ftd FTD Ftd->Starcoderbase Starcoderdata StarCoderData Starcoderdata->Starcoder Starcoderdata->Starcoderbase
Type
Model
Blog post title
StarCoder: A State-of-the-Art LLM for Code
Blog post authors
von Werra, Ben Allal
Blog post link
https://huggingface.co/blog/starcoder
Model Card link
https://huggingface.co/bigcode/starcoderbase
Publish date
2023-05-04
Repository link
https://github.com/bigcode-project/starcoder
Affiliation
BigCode (HuggingFace, ServiceNow)