Models
Opper supports a wide range of models and providers. We strive to make models available through European inference providers.
The following language and multi modal models are currently available in the platform:
Language models
| Provider | Model | Region |
|---|---|---|
| Anthropic | anthropic/claude-2 | US |
| Anthropic | anthropic/claude-3-haiku | US |
| Anthropic | anthropic/claude-3-opus | US |
| Anthropic | anthropic/claude-3-sonnet | US |
| Anthropic | anthropic/claude-3.5-haiku | US |
| Anthropic | anthropic/claude-3.5-haiku-20241022 | US |
| Anthropic | anthropic/claude-3.5-sonnet | US |
| Anthropic | anthropic/claude-3.5-sonnet-20240620 | US |
| Anthropic | anthropic/claude-3.5-sonnet-20241022 | US |
| AWS | aws/claude-3-haiku-eu | EU |
| AWS | aws/claude-3-sonnet-eu | EU |
| AWS | aws/claude-3.5-sonnet-eu | EU |
| Amazon | aws/titan-text-express-v1-eu | EU |
| Azure | azure/gpt-4o-eu | EU |
| Azure | azure/gpt3-eu | EU |
| Azure | azure/gpt4-eu | EU |
| Azure | azure/meta-llama-3.1-405b | US |
| Azure | azure/meta-llama-3.1-70b-eu | EU |
| Azure | azure/mistral-large-2407-eu | EU |
| Azure | azure/mistral-large-eu | EU |
| Cerebras | cerebras/llama3.1-70b | US |
| Cerebras | cerebras/llama3.1-8b | US |
| gcp/gemini-1.5-flash-001-eu | EU | |
| gcp/gemini-1.5-flash-002-eu | EU | |
| gcp/gemini-1.5-flash-eu | EU | |
| gcp/gemini-1.5-pro-001-eu | EU | |
| gcp/gemini-1.5-pro-002-eu | EU | |
| gcp/gemini-1.5-pro-eu | EU | |
| gcp/gemini-exp-1114 | EU | |
| gcp/gemini-pro-1.0-eu | EU | |
| Groq | groq/gemma2-9b-it | US |
| Groq | groq/llama-3.1-70b-versatile | US |
| Groq | groq/llama-3.1-8b-instant | US |
| Mistral | mistral/mistral-large-2407-eu | EU |
| Mistral | mistral/mistral-large-eu | EU |
| Mistral | mistral/mistral-small-eu | EU |
| Mistral | mistral/mistral-tiny-eu | EU |
| Mistral | mistral/pixtral-12b-2409-eu | EU |
| Mistral | mistral/pixtral-large-2411-eu | EU |
| Mistral | mistral/pixtral-large-latest-eu | EU |
| OpenAI | openai/gpt-4o | US |
| OpenAI | openai/gpt-4o-2024-05-13 | US |
| OpenAI | openai/gpt-4o-2024-08-06 | US |
| OpenAI | openai/gpt-4o-mini | US |
| OpenAI | openai/gpt3.5-turbo | US |
| OpenAI | openai/gpt4-turbo | US |
| OpenAI | openai/o1-mini | US |
| OpenAI | openai/o1-preview | US |
| Opper | opper/mistral-nemo-instruct | EU |
| Opper | opper/molmo-7b-d-0924 | EU |
| Xai | xai/grok-beta | US |
| Xai | xai/grok-vision-beta | US |
Multimodal models
| Provider | Model | Region | Image In | Image Out | Audio In | Options |
|---|---|---|---|---|---|---|
| Azure | azure/dall-e-3-eu | EU | X | |||
| gcp/gemini-pro-1.5-eu | EU | X | X | |||
| gcp/imagen-3.0-generate-001-eu | EU | X | ||||
| Mistral | mistral/pixtral-12b-2409-eu | EU | X | |||
| OpenAI | openai/gpt4-turbo | US | X | |||
| OpenAI | openai/gpt-4o | US | X |
Custom models and bring-your-own-key
Custom models can be added using the API or the Opper CLI. The README explains how to add a model, but here is an example of adding your own Azure deployment:
This adds your custom deployment on my-gpt4-deployment.openai.azure.com and the model name gpt4-production using the my-api-key-here API key. This model is then accessible in Opper using the name example/my-gpt4.