About R1 Distill Qwen 1.5B
DeepSeek R1 Distill Qwen 1.5B is a distilled large language model based on [Qwen 2.5 Math 1.5B](https://huggingface.co/Qwen/Qwen2.5-Math-1.5B), using outputs from [DeepSeek R1](/deepseek/deepseek-r1). It's a very small and efficient model which outperforms [GPT 4o 0513](/openai/gpt-4o-2024-05-13) on Math Benchmarks.
Other benchmark results include:
- AIME 2024 pass@1: 28.9 - AIME 2024 cons@64: 52.7 - MATH-500 pass@1: 83.9
The model leverages fine-tuning from DeepSeek R1's outputs, enabling competitive performance comparable to larger frontier models.
Specifications
- Provider
- DeepSeek
- Context Length
- 131,072 tokens
- Input Types
- text
- Output Types
- text
- Category
- Other
- Added
- 1/31/2025
Frequently Asked Questions
Common questions about R1 Distill Qwen 1.5B