Code Llama 70B Specs, Benchmarks & Downloads
Code Llama 70B
Large Code Llama model
Status
active
Parameters
70.00
Context Window
16384
Modality
Text
Release Date
Jan 29, 2024
About
Explore Code Llama 70B, a text AI model developed by AllenAI. View specifications, context window, architecture, license, supported platforms, features, benchmarks, official downloads, and related articles.
Code Llama 70B provides high quality code generation and understanding.
Family
FalconDeveloper
AllenAIArchitecture
TransformerLicense
Llama Community LicenseHardware Requirements
Minimum:
Use Case: Local inference
GPU Minimum: RTX 4090
GPU VRAM: 24GB
System RAM: 128GB
Storage: 150GB
Operating System: Linux
Code Llama 70B quantized
Recommended:
Use Case: Multi GPU inference
GPU Minimum: 2x RTX 4090
GPU VRAM: 48GB
System RAM: 256GB
Storage: 250GB
Operating System: Linux
Large coding model deployment
High Performance:
Use Case: Production serving
GPU Minimum: 4x A100
GPU VRAM: 320GB
System RAM: 512GB
Storage: 500GB
Operating System: Linux
Enterprise deployment
Model Deployment Readiness
Model Ecosystem Support
18%
Platforms
33%
Features
1%
Downloads
20%
Platform Compatibility
33%
Supported across 4 of 12 platforms
Context Window
Industry-standard context window comparison
16,384
tokens
16K
4K
32K
128K
1M
2M
Database Rank
#44
Percentile
Top 57%
Capacity
Medium
Benchmark Performance
Evaluation profile across publicly reported benchmarks
|
HumanEval
|
Coding | 67.8 % | 2024 |
Highest Benchmark
HumanEval
67.8%
Benchmarks Available
1
Latest Evaluation
Jan 2024
