Granite 3.0 8B Specs, Benchmarks & Downloads
Granite 3.0 8B
IBM enterprise open model
Status
active
Parameters
8.00
Context Window
128000
Modality
Text
Release Date
Oct 21, 2024
About
Explore Granite 3.0 8B, a text AI model developed by IBM. View specifications, context window, architecture, license, supported platforms, features, benchmarks, official downloads, and related articles.
Granite 3.0 8B is designed for enterprise AI applications.
Family
GraniteDeveloper
IBMArchitecture
TransformerLicense
Apache 2.0Hardware Requirements
Minimum:
Use Case: Local inference
GPU Minimum: RTX 3060
GPU VRAM: 12GB
System RAM: 32GB
Storage: 40GB
Operating System: Linux
Granite 3.0 8B deployment
Recommended:
Use Case: Desktop inference
GPU Minimum: RTX 4070
GPU VRAM: 12GB
System RAM: 32GB
Storage: 50GB
Operating System: Linux
Recommended setup
High Performance:
Use Case: Fast inference
GPU Minimum: RTX 4090
GPU VRAM: 24GB
System RAM: 64GB
Storage: 60GB
Operating System: Linux
High throughput
Model Deployment Readiness
Model Ecosystem Support
12%
Platforms
17%
Features
0%
Downloads
20%
Platform Compatibility
17%
Supported across 2 of 12 platforms
Context Window
Industry-standard context window comparison
128,000
tokens
125K
4K
32K
128K
1M
2M
Database Rank
#17
Percentile
Top 84%
Capacity
High
Benchmark Performance
Evaluation profile across publicly reported benchmarks
|
MMLU
|
Knowledge | 71.8 % | 2024 |
Highest Benchmark
MMLU
71.8%
Benchmarks Available
1
Latest Evaluation
Oct 2024
