WizardLM 2 8x22B Specs, Benchmarks & Downloads
WizardLM 2 8x22B
Microsoft MoE model
Status
active
Parameters
141.00
Context Window
65536
Modality
Text
Release Date
Apr 16, 2024
About
Explore WizardLM 2 8x22B, a text AI model developed by OpenAI. View specifications, context window, architecture, license, supported platforms, features, benchmarks, official downloads, and related articles.
WizardLM 2 8x22B provides strong instruction performance using MoE architecture.
Family
OpenCoderDeveloper
OpenAIArchitecture
TransformerLicense
Llama Community LicenseHardware Requirements
Minimum:
Use Case: Distributed inference
GPU Minimum: 2x RTX 4090
GPU VRAM: 48GB
System RAM: 128GB
Storage: 200GB
Operating System: Linux
WizardLM 2 8x22B MoE deployment
Recommended:
Use Case: Server inference
GPU Minimum: 4x RTX 4090
GPU VRAM: 96GB
System RAM: 256GB
Storage: 300GB
Operating System: Linux
Recommended MoE deployment
High Performance:
Use Case: Production serving
GPU Minimum: 4x H100
GPU VRAM: 320GB
System RAM: 512GB
Storage: 600GB
Operating System: Linux
Enterprise MoE serving
Model Deployment Readiness
Model Ecosystem Support
18%
Platforms
33%
Features
1%
Downloads
20%
Platform Compatibility
33%
Supported across 4 of 12 platforms
Context Window
Industry-standard context window comparison
65,536
tokens
64K
4K
32K
128K
1M
2M
Database Rank
#28
Percentile
Top 73%
Capacity
High
Benchmark Performance
Evaluation profile across publicly reported benchmarks
|
MMLU
|
Knowledge | 81.0 % | 2024 |
|
HumanEval
|
Coding | 82.0 % | 2024 |
Highest Benchmark
HumanEval
82.0%
Benchmarks Available
2
Latest Evaluation
Apr 2024
