OpenChat 3.5 7B Specs, Benchmarks & Downloads
OpenChat 3.5 7B
Community instruction model
Status
active
Parameters
7.00
Context Window
8192
Modality
Text
Release Date
Oct 27, 2023
About
Explore OpenChat 3.5 7B, a text AI model developed by . View specifications, context window, architecture, license, supported platforms, features, benchmarks, official downloads, and related articles.
OpenChat 3.5 is a fine-tuned open language model for conversational tasks.
Family
N/ADeveloper
N/AArchitecture
TransformerLicense
Llama Community LicenseHardware Requirements
Minimum:
Use Case: Local inference
GPU Minimum: RTX 3060
GPU VRAM: 12GB
System RAM: 32GB
Storage: 50GB
Operating System: Linux
OpenChat 3.5 7B deployment
Recommended:
Use Case: Desktop inference
GPU Minimum: RTX 4070
GPU VRAM: 12GB
System RAM: 32GB
Storage: 60GB
Operating System: Linux
Recommended setup
High Performance:
Use Case: Fast inference
GPU Minimum: RTX 4090
GPU VRAM: 24GB
System RAM: 64GB
Storage: 70GB
Operating System: Linux
High throughput
Model Deployment Readiness
Model Ecosystem Support
21%
Platforms
42%
Features
1%
Downloads
20%
Platform Compatibility
42%
Supported across 5 of 12 platforms
Context Window
Industry-standard context window comparison
8,192
tokens
8K
4K
32K
128K
1M
2M
Database Rank
#55
Percentile
Top 46%
Capacity
Medium
Benchmark Performance
Evaluation profile across publicly reported benchmarks
|
MMLU
|
Knowledge | 64.3 % | 2023 |
|
HumanEval
|
Coding | 52.0 % | 2023 |
Highest Benchmark
MMLU
64.3%
Benchmarks Available
2
Latest Evaluation
Oct 2023
