OLMo 7B Instruct Specs, Benchmarks & Downloads
OLMo 7B Instruct
Instruction tuned OLMo model
Status
active
Parameters
7.00
Context Window
2048
Modality
Text
Release Date
Feb 01, 2024
About
Explore OLMo 7B Instruct, a text AI model developed by Snowflake. View specifications, context window, architecture, license, supported platforms, features, benchmarks, official downloads, and related articles.
OLMo 7B Instruct is optimized for assistant style interactions.
Family
CodeLlamaDeveloper
SnowflakeArchitecture
TransformerLicense
Llama Community LicenseHardware Requirements
Minimum:
Use Case: Local inference
GPU Minimum: RTX 3060
GPU VRAM: 12GB
System RAM: 32GB
Storage: 50GB
Operating System: Linux
OLMo 7B Instruct deployment
Recommended:
Use Case: Desktop inference
GPU Minimum: RTX 4070
GPU VRAM: 12GB
System RAM: 32GB
Storage: 60GB
Operating System: Linux
Recommended setup
High Performance:
Use Case: Fast inference
GPU Minimum: RTX 4090
GPU VRAM: 24GB
System RAM: 64GB
Storage: 70GB
Operating System: Linux
High throughput
Model Deployment Readiness
Model Ecosystem Support
15%
Platforms
25%
Features
1%
Downloads
20%
Platform Compatibility
25%
Supported across 3 of 12 platforms
Context Window
Industry-standard context window comparison
2,048
tokens
2K
4K
32K
128K
1M
2M
Database Rank
#90
Percentile
Top 11%
Capacity
Small
Benchmark Performance
Evaluation profile across publicly reported benchmarks
|
MMLU
|
Knowledge | 60.0 % | 2024 |
Highest Benchmark
MMLU
60.0%
Benchmarks Available
1
Latest Evaluation
Feb 2024
