AI / ML / LLM / Transformer Models Timeline Details

Viktor Garske @vemgar, Last update: Tue Dec 26 15:23:35 2023
← Back to the full graph

Longformer

This graph is clickable!

timeline 06/2017 06/2017 04/2020 04/2020 06/2017->04/2020 09/2023 09/2023 04/2020->09/2023 Mistral7b Mistral 7B Attention Attention / Transformers Attention->Mistral7b Longformer Longformer Attention->Longformer Longformer->Mistral7b
Type
Method
Paper name
Longformer: The Long-Document Transformer
Paper authors
Beltagy et al.
Paper link
https://arxiv.org/abs/2004.05150
Publish date
2020-04-10
Affiliation
Allen AI