Nous Hermes 2 Mixtral Specs, Benchmarks & Downloads
Nous Hermes 2 Mixtral
Nous Research MoE model
Status
active
Parameters
46.00
Context Window
32768
Modality
Text
Release Date
Jan 01, 2024
About
Explore Nous Hermes 2 Mixtral, a text AI model developed by Red Hat. View specifications, context window, architecture, license, supported platforms, features, benchmarks, official downloads, and related articles.
Nous Hermes 2 Mixtral is an instruction tuned mixture-of-experts model.
Family
AyaDeveloper
Red HatArchitecture
TransformerLicense
Llama Community LicenseHardware Requirements
Minimum:
Use Case: Multi GPU inference
GPU Minimum: RTX 4090
GPU VRAM: 24GB
System RAM: 128GB
Storage: 150GB
Operating System: Linux
Nous Hermes Mixtral deployment
Recommended:
Use Case: Server inference
GPU Minimum: 2x RTX 4090
GPU VRAM: 48GB
System RAM: 256GB
Storage: 200GB
Operating System: Linux
Recommended MoE deployment
High Performance:
Use Case: Production serving
GPU Minimum: 4x A100
GPU VRAM: 320GB
System RAM: 512GB
Storage: 500GB
Operating System: Linux
Enterprise deployment
Model Deployment Readiness
Model Ecosystem Support
15%
Platforms
25%
Features
1%
Downloads
20%
Platform Compatibility
25%
Supported across 3 of 12 platforms
Context Window
Industry-standard context window comparison
32,768
tokens
32K
4K
32K
128K
1M
2M
Database Rank
#30
Percentile
Top 71%
Capacity
High
Benchmark Performance
Evaluation profile across publicly reported benchmarks
|
MMLU
|
Knowledge | 70.6 % | 2024 |
Highest Benchmark
MMLU
70.6%
Benchmarks Available
1
Latest Evaluation
Jan 2024
