About RWKV v5 World 3B
[RWKV](https://wiki.rwkv.com) is an RNN (recurrent neural network) with transformer-level performance. It aims to combine the best of RNNs and transformers - great performance, fast inference, low VRAM, fast training, "infinite" context length, and free sentence embedding.
RWKV-5 is trained on 100+ world languages (70% English, 15% multilang, 15% code).
RWKV 3B models are provided for free, by Recursal.AI, for the beta period. More details [here](https://substack.recursal.ai/p/public-rwkv-3b-model-via-openrouter).
#rnn
Specifications
- Provider
- Rwkv
- Context Length
- 10,000 tokens
- Input Types
- text
- Output Types
- text
- Category
- RWKV
- Added
- 12/10/2023