AI / ML / LLM / Transformer Models Timeline Details

Viktor Garske @vemgar, Last update: Tue Dec 26 15:23:35 2023
← Back to the full graph

LSST (Long Sequences with Sparse Transformers)

This graph is clickable!

timeline 06/2017 06/2017 04/2019 04/2019 06/2017->04/2019 09/2023 09/2023 04/2019->09/2023 Mistral7b Mistral 7B Attention Attention / Transformers Attention->Mistral7b LongSeqSparseTransformers LSST Attention->LongSeqSparseTransformers LongSeqSparseTransformers->Mistral7b
Type
Method
Paper name
Generating Long Sequences with Sparse Transformers
Paper authors
Child et al.
Paper link
https://arxiv.org/abs/1904.10509
Publish date
2019-04-23