Yi 34B Specs, Benchmarks & Downloads
Yi 34B
01.AI large model
Status
active
Parameters
34.00
Context Window
4096
Modality
Text
Release Date
Nov 02, 2023
About
Explore Yi 34B, a text AI model developed by TII. View specifications, context window, architecture, license, supported platforms, features, benchmarks, official downloads, and related articles.
Yi 34B provides improved reasoning and generation capabilities.
Family
TinyLlamaDeveloper
TIIArchitecture
TransformerLicense
Llama Community LicenseHardware Requirements
Minimum:
Use Case: Local inference
GPU Minimum: RTX 4090
GPU VRAM: 24GB
System RAM: 64GB
Storage: 100GB
Operating System: Linux
Yi 34B quantized
Recommended:
Use Case: Multi GPU inference
GPU Minimum: 2x RTX 4090
GPU VRAM: 48GB
System RAM: 128GB
Storage: 150GB
Operating System: Linux
Recommended deployment
High Performance:
Use Case: Production serving
GPU Minimum: 4x A100
GPU VRAM: 320GB
System RAM: 256GB
Storage: 300GB
Operating System: Linux
Enterprise deployment
Model Deployment Readiness
Model Ecosystem Support
15%
Platforms
25%
Features
1%
Downloads
20%
Platform Compatibility
25%
Supported across 3 of 12 platforms
Context Window
Industry-standard context window comparison
4,096
tokens
4K
4K
32K
128K
1M
2M
Database Rank
#72
Percentile
Top 29%
Capacity
Small
Benchmark Performance
Evaluation profile across publicly reported benchmarks
|
MMLU
|
Knowledge | 76.3 % | 2023 |
Highest Benchmark
MMLU
76.3%
Benchmarks Available
1
Latest Evaluation
Nov 2023
