Models
Opper supports a wide range of models and providers. We strive to make models available through European inference providers.
The following language and multi modal models are currently available in the platform:
Language models
| Provider | Model | Region | Input (1M tokens) | Output (1M tokens) |
|---|---|---|---|---|
| Anthropic | anthropic/claude-3-haiku | US | $0.25 | $1.25 |
| Anthropic | anthropic/claude-3-opus | US | $15.00 | $75.00 |
| Anthropic | anthropic/claude-3-sonnet | US | $3.00 | $15.00 |
| Anthropic | anthropic/claude-3.5-haiku | US | $1.00 | $5.00 |
| Anthropic | anthropic/claude-3.5-haiku-20241022 | US | $1.00 | $5.00 |
| Anthropic | anthropic/claude-3.5-sonnet | US | $3.00 | $15.00 |
| Anthropic | anthropic/claude-3.5-sonnet-20240620 | US | $3.00 | $15.00 |
| Anthropic | anthropic/claude-3.5-sonnet-20241022 | US | $3.00 | $15.00 |
| AWS | aws/claude-3-haiku-eu | EU | $0.25 | $1.25 |
| AWS | aws/claude-3-sonnet-eu | EU | $3.00 | $15.00 |
| AWS | aws/claude-3.5-sonnet-eu | EU | $3.00 | $15.00 |
| Amazon | aws/titan-text-express-v1-eu | EU | $1.30 | $1.70 |
| Azure | azure/gpt-4o-eu | EU | $2.75 | $11.00 |
| Azure | azure/gpt3-eu | EU | $0.50 | $1.50 |
| Azure | azure/gpt4-eu | EU | $30.00 | $60.00 |
| Azure | azure/meta-llama-3.1-405b | US | $5.33 | $16.00 |
| Azure | azure/meta-llama-3.1-70b-eu | EU | $2.68 | $3.54 |
| Azure | azure/mistral-large-2407-eu | EU | $2.00 | $6.00 |
| Azure | azure/mistral-large-eu | EU | $8.00 | $24.00 |
| Cerebras | cerebras/llama3.1-70b | US | $0.60 | $0.60 |
| Cerebras | cerebras/llama3.1-8b | US | $0.10 | $0.10 |
| Fireworks | fireworks/deepseek-v3 | US | $0.90 | $0.90 |
| gcp/gemini-1.5-flash-001-eu | EU | $0.07 | $0.30 | |
| gcp/gemini-1.5-flash-002-eu | EU | $0.07 | $0.30 | |
| gcp/gemini-1.5-flash-eu | EU | $0.07 | $0.30 | |
| gcp/gemini-1.5-pro-001-eu | EU | $3.50 | $10.50 | |
| gcp/gemini-1.5-pro-002-eu | EU | $3.50 | $10.50 | |
| gcp/gemini-1.5-pro-eu | EU | $3.50 | $10.50 | |
| gcp/gemini-2.0-flash-exp | US | $0.00 | $0.00 | |
| gcp/gemini-exp-1114 | EU | $0.00 | $0.00 | |
| gcp/gemini-exp-1206 | EU | $0.00 | $0.00 | |
| gcp/gemini-pro-1.0-eu | EU | $0.25 | $0.50 | |
| Groq | groq/gemma2-9b-it | US | $0.20 | $0.20 |
| Groq | groq/llama-3.1-70b-versatile | US | $0.59 | $0.79 |
| Groq | groq/llama-3.1-8b-instant | US | $0.05 | $0.08 |
| Groq | groq/llama-3.3-70b-versatile | US | $0.59 | $0.79 |
| Mistral | mistral/mistral-large-2407-eu | EU | $3.00 | $9.00 |
| Mistral | mistral/mistral-large-eu | EU | $2.00 | $6.00 |
| Mistral | mistral/mistral-small-eu | EU | $1.00 | $3.00 |
| Mistral | mistral/mistral-tiny-eu | EU | $0.25 | $0.25 |
| Mistral | mistral/pixtral-12b-2409-eu | EU | $0.15 | $0.15 |
| Mistral | mistral/pixtral-large-2411-eu | EU | $2.00 | $6.00 |
| Mistral | mistral/pixtral-large-latest-eu | EU | $2.00 | $6.00 |
| OpenAI | openai/gpt-4o | US | $2.50 | $10.00 |
| OpenAI | openai/gpt-4o-2024-05-13 | US | $5.00 | $15.00 |
| OpenAI | openai/gpt-4o-2024-08-06 | US | $2.50 | $10.00 |
| OpenAI | openai/gpt-4o-audio-preview | US | $2.50 | $10.00 |
| OpenAI | openai/gpt-4o-mini | US | $0.15 | $0.60 |
| OpenAI | openai/gpt3.5-turbo | US | $0.50 | $1.50 |
| OpenAI | openai/gpt4-turbo | US | $10.00 | $30.00 |
| OpenAI | openai/o1-mini | US | $3.00 | $12.00 |
| OpenAI | openai/o1-preview | US | $15.00 | $60.00 |
| Opper | opper/mistral-nemo-instruct | EU | $0.00 | $0.00 |
| Opper | opper/molmo-7b-d-0924 | EU | $0.00 | $0.00 |
| Xai | xai/grok-beta | US | $5.00 | $15.00 |
| Xai | xai/grok-vision-beta | US | $0.00 | $0.00 |
Multimodal models
| Provider | Model | Region | Image In | Image Out | Audio In | Options |
|---|---|---|---|---|---|---|
| Azure | azure/dall-e-3-eu | EU | X | |||
| gcp/gemini-pro-1.5-eu | EU | X | X | |||
| gcp/imagen-3.0-generate-001-eu | EU | X | ||||
| Mistral | mistral/pixtral-12b-2409-eu | EU | X | |||
| OpenAI | openai/gpt4-turbo | US | X | |||
| OpenAI | openai/gpt-4o | US | X |
Custom models and bring-your-own-key
Custom models can be added using the API or the Opper CLI. The README explains how to add a model, but here is an example of adding your own Azure deployment:
This adds your custom deployment on my-gpt4-deployment.openai.azure.com and the model name gpt4-production using the my-api-key-here API key. This model is then accessible in Opper using the name example/my-gpt4.