All Models
Llama 3.1 8B
Compact GPT model for low-latency assistance and high-volume workloads
Available Providers (5)
| Provider | Model ID | Input Cost | Output Cost | Context | Max Output | Docs |
|---|---|---|---|---|---|---|
 NanoGPT | Meta-Llama-3-1-8B-Instruct-FP8 | $0.02/MTok | $0.03/MTok | 128K | 16.4K | |
 Groq | llama-3.1-8b-instant | $0.05/MTok | $0.08/MTok | 131.1K | 131.1K | |
 CoreWeave | meta-llama/Llama-3.1-8B-Instruct | $0.22/MTok | $0.22/MTok | 131.1K | 131.1K | |
 Merge Gateway | meta/llama-3.1-8b-instruct | $0.22/MTok | $0.22/MTok | 128K | 2.0K | |
| NanoGPT | aion-labs/aion-rp-llama-3.1-8b | $0.80/MTok | $1.60/MTok | 32.8K | 16.4K |
Capabilities
Reasoning
Tool Calling
Attachments
Open Weights
Structured Output