Llama 2 7B Specs, Benchmarks & Downloads
Llama 2 7B
Meta open foundation model
Status
active
Parameters
7.00
Context Window
4096
Modality
Text
Release Date
Jul 18, 2023
About
Explore Llama 2 7B, a text AI model developed by Meta. View specifications, context window, architecture, license, supported platforms, features, benchmarks, official downloads, and related articles.
Llama 2 7B is an open-weight large language model developed by Meta for general language generation and assistant applications.
Family
LlamaDeveloper
MetaArchitecture
Decoder OnlyLicense
Llama Community LicenseHardware Requirements
Minimum:
Use Case: Local inference
GPU Minimum: GTX 1660 Super
GPU VRAM: 6GB
System RAM: 16GB
Storage: 20GB
Operating System: Windows Linux macOS
Llama 2 7B local deployment
Recommended:
Use Case: Desktop inference
GPU Minimum: RTX 3060
GPU VRAM: 12GB
System RAM: 32GB
Storage: 30GB
Operating System: Windows Linux macOS
Recommended quantized local deployment
High Performance:
Use Case: High throughput inference
GPU Minimum: RTX 4090
GPU VRAM: 24GB
System RAM: 64GB
Storage: 50GB
Operating System: Linux
Maximum single GPU performance
Model Deployment Readiness
Model Ecosystem Support
24%
Platforms
50%
Features
1%
Downloads
20%
Platform Compatibility
50%
Supported across 6 of 12 platforms
Context Window
Industry-standard context window comparison
4,096
tokens
4K
4K
32K
128K
1M
2M
Database Rank
#72
Percentile
Top 29%
Capacity
Small
Benchmark Performance
Evaluation profile across publicly reported benchmarks
|
MMLU
|
Knowledge | 45.3 % | 2023 |
|
HumanEval
|
Coding | 29.9 % | 2023 |
Highest Benchmark
MMLU
45.3%
Benchmarks Available
2
Latest Evaluation
Jul 2023
