AI / ML / LLM / Transformer Models Timeline Details

Viktor Garske @vemgar, Last update: Tue Dec 26 15:23:35 2023
← Back to the full graph

Mesh Transformer JAX

This graph is clickable!

timeline 09/2019 09/2019 06/2021 06/2021 09/2019->06/2021 MegatronLm Megatron-LM MeshTransformerJax Mesh Transformer JAX MegatronLm->MeshTransformerJax GptJ GPT-J MeshTransformerJax->GptJ
Type
Model
Blog post title
GPT-J-6B: 6B JAX-Based Transformer
Blog post authors
Aran Komatsuzaki
Blog post link
https://arankomatsuzaki.wordpress.com/2021/06/04/gpt-j/
Publish date
2021-06-04