Falcon 40B Specs, Benchmarks & Downloads
Falcon 40B
TII large language model
Status
active
Parameters
40.00
Context Window
2048
Modality
Text
Release Date
May 24, 2023
About
Explore Falcon 40B, a text AI model developed by OpenBMB. View specifications, context window, architecture, license, supported platforms, features, benchmarks, official downloads, and related articles.
Falcon 40B provides stronger general language performance.
Family
SmolLMDeveloper
OpenBMBArchitecture
TransformerLicense
Apache 2.0Hardware Requirements
Minimum:
Use Case: Local inference
GPU Minimum: RTX 4090
GPU VRAM: 24GB
System RAM: 64GB
Storage: 100GB
Operating System: Linux
Falcon 40B quantized
Recommended:
Use Case: Multi GPU inference
GPU Minimum: 2x RTX 4090
GPU VRAM: 48GB
System RAM: 128GB
Storage: 150GB
Operating System: Linux
Recommended deployment
High Performance:
Use Case: Production serving
GPU Minimum: 4x A100
GPU VRAM: 320GB
System RAM: 256GB
Storage: 300GB
Operating System: Linux
Enterprise serving
Model Deployment Readiness
Model Ecosystem Support
15%
Platforms
25%
Features
1%
Downloads
20%
Platform Compatibility
25%
Supported across 3 of 12 platforms
Context Window
Industry-standard context window comparison
2,048
tokens
2K
4K
32K
128K
1M
2M
Database Rank
#90
Percentile
Top 11%
Capacity
Small
Benchmark Performance
Evaluation profile across publicly reported benchmarks
|
MMLU
|
Knowledge | 55.4 % | 2023 |
|
HumanEval
|
Coding | 29.9 % | 2023 |
Highest Benchmark
MMLU
55.4%
Benchmarks Available
2
Latest Evaluation
May 2023
