All Providers
9Models
5Families
125KMax Context
$0.01–$0.20Input Cost/MTok
$0–$0.50Output Cost/MTok
Capabilities
Reasoning
Tool Calling
Attachments
Open Weights
Setup
Set the following environment variable to use Inference:
INFERENCE_API_KEYModels (9)
| Model | Model ID | Input Cost | Output Cost | Context | Capabilities |
|---|---|---|---|---|---|
| Qwen 3 Embedding 4Bqwen | qwen/qwen3-embedding-4b | $0.01/MTok | $0/MTok | 32K | Open |
| Llama 3.2 1B Instructllama | meta/llama-3.2-1b-instruct | $0.01/MTok | $0.01/MTok | 16K | ToolsOpen |
| Llama 3.2 3B Instructllama | meta/llama-3.2-3b-instruct | $0.02/MTok | $0.02/MTok | 16K | ToolsOpen |
| Llama 3.1 8B Instructllama | meta/llama-3.1-8b-instruct | $0.03/MTok | $0.03/MTok | 16K | ToolsOpen |
| Mistral Nemo 12B Instructmistral-nemo | mistral/mistral-nemo-12b-instruct | $0.04/MTok | $0.10/MTok | 16K | ToolsOpen |
| Llama 3.2 11B Vision Instructllama | meta/llama-3.2-11b-vision-instruct | $0.06/MTok | $0.06/MTok | 16K | ToolsOpen |
| Osmosis Structure 0.6Bosmosis | osmosis/osmosis-structure-0.6b | $0.10/MTok | $0.50/MTok | 4K | ToolsOpen |
| Google Gemma 3gemma | google/gemma-3 | $0.15/MTok | $0.30/MTok | 125K | ToolsOpen |
| Qwen 2.5 7B Vision Instructqwen | qwen/qwen-2.5-7b-vision-instruct | $0.20/MTok | $0.20/MTok | 125K | ToolsOpen |