Llama 3.1 8B Specs, Benchmarks & Downloads
Llama 3.1 8B
Long context Llama model
Status
active
Parameters
8.00
Context Window
131072
Modality
Text
Release Date
Jul 23, 2024
About
Explore Llama 3.1 8B, a text AI model developed by Meta. View specifications, context window, architecture, license, supported platforms, features, benchmarks, official downloads, and related articles.
Llama 3.1 8B introduced improved multilingual capability and extended context support.
Family
LlamaDeveloper
MetaArchitecture
Decoder OnlyLicense
Llama Community LicenseHardware Requirements
Minimum:
Use Case: Local inference
GPU Minimum: RTX 3060
GPU VRAM: 12GB
System RAM: 32GB
Storage: 40GB
Operating System: Windows Linux macOS
Llama 3.1 8B deployment
Recommended:
Use Case: Desktop inference
GPU Minimum: RTX 4070
GPU VRAM: 12GB
System RAM: 32GB
Storage: 50GB
Operating System: Linux
Recommended setup
High Performance:
Use Case: High throughput inference
GPU Minimum: RTX 4090
GPU VRAM: 24GB
System RAM: 64GB
Storage: 60GB
Operating System: Linux
High performance local use
Model Deployment Readiness
Model Ecosystem Support
24%
Platforms
50%
Features
2%
Downloads
20%
Platform Compatibility
50%
Supported across 6 of 12 platforms
Context Window
Industry-standard context window comparison
131,072
tokens
128K
4K
32K
128K
1M
2M
Database Rank
#1
Percentile
Top 100%
Capacity
Very High
Benchmark Performance
Evaluation profile across publicly reported benchmarks
|
MMLU
|
Knowledge | 73.0 % | 2024 |
|
GPQA
|
Reasoning | 31.8 % | 2024 |
|
HumanEval
|
Coding | 72.6 % | 2024 |
|
MATH-500
|
Mathematics | 51.9 % | 2024 |
|
IFEval
|
Instruction Following | 80.4 % | 2024 |
|
HumanEval
|
Coding | 72.6 % | 2024 |
Highest Benchmark
IFEval
80.4%
Benchmarks Available
6
Latest Evaluation
Jul 2024
