StarCoder2 7B Specs, Benchmarks & Downloads
StarCoder2 7B
Mid-size code model
Status
active
Parameters
7.00
Context Window
16384
Modality
Text
Release Date
Feb 28, 2024
About
Explore StarCoder2 7B, a text AI model developed by Hugging Face. View specifications, context window, architecture, license, supported platforms, features, benchmarks, official downloads, and related articles.
StarCoder2 7B improves programming performance and efficiency.
Family
GLMDeveloper
Hugging FaceArchitecture
TransformerLicense
Llama Community LicenseHardware Requirements
Minimum:
Use Case: Local inference
GPU Minimum: RTX 3060
GPU VRAM: 12GB
System RAM: 32GB
Storage: 40GB
Operating System: Linux
StarCoder2 7B deployment
Recommended:
Use Case: Desktop inference
GPU Minimum: RTX 4070
GPU VRAM: 12GB
System RAM: 32GB
Storage: 50GB
Operating System: Linux
Recommended coding setup
High Performance:
Use Case: Fast inference
GPU Minimum: RTX 4090
GPU VRAM: 24GB
System RAM: 64GB
Storage: 60GB
Operating System: Linux
High throughput
Model Deployment Readiness
Model Ecosystem Support
18%
Platforms
33%
Features
1%
Downloads
20%
Platform Compatibility
33%
Supported across 4 of 12 platforms
Context Window
Industry-standard context window comparison
16,384
tokens
16K
4K
32K
128K
1M
2M
Database Rank
#44
Percentile
Top 57%
Capacity
Medium
Benchmark Performance
Evaluation profile across publicly reported benchmarks
|
HumanEval
|
Coding | 35.4 % | 2024 |
|
MMLU
|
Knowledge | 43.0 % | 2024 |
Highest Benchmark
MMLU
43.0%
Benchmarks Available
2
Latest Evaluation
Feb 2024
