Qwen2 72B Specs, Benchmarks & Downloads
Qwen2 72B
Qwen large second generation
Status
active
Parameters
72.00
Context Window
131072
Modality
Text
Release Date
Jun 07, 2024
About
Explore Qwen2 72B, a text AI model developed by Alibaba. View specifications, context window, architecture, license, supported platforms, features, benchmarks, official downloads, and related articles.
Qwen2 72B provides high capability open inference.
Family
QwenDeveloper
AlibabaArchitecture
TransformerLicense
Apache 2.0Hardware Requirements
Minimum:
Use Case: Local inference
GPU Minimum: RTX 4090
GPU VRAM: 24GB
System RAM: 64GB
Storage: 120GB
Operating System: Linux
72B quantized deployment
Recommended:
Use Case: Multi GPU inference
GPU Minimum: 2x RTX 4090
GPU VRAM: 48GB
System RAM: 128GB
Storage: 180GB
Operating System: Linux
Recommended multi GPU setup
High Performance:
Use Case: Production serving
GPU Minimum: 4x A100
GPU VRAM: 320GB
System RAM: 256GB
Storage: 300GB
Operating System: Linux
Enterprise deployment
Model Deployment Readiness
Model Ecosystem Support
24%
Platforms
50%
Features
2%
Downloads
20%
Platform Compatibility
50%
Supported across 6 of 12 platforms
Context Window
Industry-standard context window comparison
131,072
tokens
128K
4K
32K
128K
1M
2M
Database Rank
#1
Percentile
Top 100%
Capacity
Very High
Benchmark Performance
Evaluation profile across publicly reported benchmarks
|
HumanEval
|
Coding | 59.8 % | 2024 |
|
MMLU
|
Knowledge | 82.3 % | 2024 |
|
IFEval
|
Instruction Following | 77.6 % | 2024 |
|
MMLU
|
Knowledge | 82.3 % | 2024 |
Highest Benchmark
MMLU
82.3%
Benchmarks Available
4
Latest Evaluation
Jun 2024
