AI / ML / LLM / Transformer Models Timeline Details

Viktor Garske @vemgar, Last update: Tue Dec 26 15:23:35 2023
← Back to the full graph

RWKV (Receptance Weighted Key Value)

This graph is clickable!

timeline 06/2017 06/2017 05/2023 05/2023 06/2017->05/2023 Attention Attention / Transformers Rwkv RWKV Attention->Rwkv
Type
Method
Paper name
RWKV: Reinventing RNNs for the Transformer Era
Paper authors
Peng et al.
Paper link
https://arxiv.org/abs/2305.13048
Publish date
2023-05-22
Repository link
https://github.com/BlinkDL/RWKV-LM