Falcon 180B Specs, Benchmarks & Downloads
Falcon 180B
TII flagship model
Status
active
Parameters
180.00
Context Window
2048
Modality
Text
Release Date
Sep 06, 2023
About
Explore Falcon 180B, a text AI model developed by OpenBMB. View specifications, context window, architecture, license, supported platforms, features, benchmarks, official downloads, and related articles.
Falcon 180B is a large open language model designed for advanced applications.
Family
SmolLMDeveloper
OpenBMBArchitecture
TransformerLicense
Apache 2.0Hardware Requirements
Minimum:
Use Case: Distributed inference
GPU Minimum: 4x RTX 4090
GPU VRAM: 96GB
System RAM: 256GB
Storage: 300GB
Operating System: Linux
Falcon 180B requires distributed setup
Recommended:
Use Case: Server inference
GPU Minimum: 8x A100
GPU VRAM: 640GB
System RAM: 512GB
Storage: 1TB
Operating System: Linux
Large scale deployment
High Performance:
Use Case: Enterprise serving
GPU Minimum: 8x H100
GPU VRAM: 640GB
System RAM: 1024GB
Storage: 2TB
Operating System: Linux
Maximum performance
Model Deployment Readiness
Model Ecosystem Support
13%
Platforms
17%
Features
1%
Downloads
20%
Platform Compatibility
17%
Supported across 2 of 12 platforms
Context Window
Industry-standard context window comparison
2,048
tokens
2K
4K
32K
128K
1M
2M
Database Rank
#90
Percentile
Top 11%
Capacity
Small
Benchmark Performance
Evaluation profile across publicly reported benchmarks
|
MMLU
|
Knowledge | 69.1 % | 2023 |
|
HumanEval
|
Coding | 34.8 % | 2023 |
Highest Benchmark
MMLU
69.1%
Benchmarks Available
2
Latest Evaluation
Sep 2023
