Models
Opper supports a wide range of models and providers. We strive to make models available through European inference providers.
The following language and multi modal models are currently available in the platform:
Language models
Provider | Model | Region |
---|---|---|
Anthropic | anthropic/claude-2 | US |
Anthropic | anthropic/claude-3-haiku | US |
Anthropic | anthropic/claude-3-opus | US |
Anthropic | anthropic/claude-3-sonnet | US |
Anthropic | anthropic/claude-3.5-haiku | US |
Anthropic | anthropic/claude-3.5-haiku-20241022 | US |
Anthropic | anthropic/claude-3.5-sonnet | US |
Anthropic | anthropic/claude-3.5-sonnet-20240620 | US |
Anthropic | anthropic/claude-3.5-sonnet-20241022 | US |
AWS | aws/claude-3-haiku-eu | EU |
AWS | aws/claude-3-sonnet-eu | EU |
AWS | aws/claude-3.5-sonnet-eu | EU |
Amazon | aws/titan-text-express-v1-eu | EU |
Azure | azure/gpt-4o-eu | EU |
Azure | azure/gpt3-eu | EU |
Azure | azure/gpt4-eu | EU |
Azure | azure/meta-llama-3.1-405b | US |
Azure | azure/meta-llama-3.1-70b-eu | EU |
Azure | azure/mistral-large-2407-eu | EU |
Azure | azure/mistral-large-eu | EU |
Cerebras | cerebras/llama3.1-70b | US |
Cerebras | cerebras/llama3.1-8b | US |
gcp/gemini-1.5-flash-001-eu | EU | |
gcp/gemini-1.5-flash-002-eu | EU | |
gcp/gemini-1.5-flash-eu | EU | |
gcp/gemini-1.5-pro-001-eu | EU | |
gcp/gemini-1.5-pro-002-eu | EU | |
gcp/gemini-1.5-pro-eu | EU | |
gcp/gemini-2.0-flash-exp | US | |
gcp/gemini-exp-1114 | EU | |
gcp/gemini-exp-1121 | EU | |
gcp/gemini-pro-1.0-eu | EU | |
Groq | groq/gemma2-9b-it | US |
Groq | groq/llama-3.1-70b-versatile | US |
Groq | groq/llama-3.1-8b-instant | US |
Groq | groq/llama-3.3-70b-versatile | US |
Mistral | mistral/mistral-large-2407-eu | EU |
Mistral | mistral/mistral-large-eu | EU |
Mistral | mistral/mistral-small-eu | EU |
Mistral | mistral/mistral-tiny-eu | EU |
Mistral | mistral/pixtral-12b-2409-eu | EU |
Mistral | mistral/pixtral-large-2411-eu | EU |
Mistral | mistral/pixtral-large-latest-eu | EU |
OpenAI | openai/gpt-4o | US |
OpenAI | openai/gpt-4o-2024-05-13 | US |
OpenAI | openai/gpt-4o-2024-08-06 | US |
OpenAI | openai/gpt-4o-audio-preview | US |
OpenAI | openai/gpt-4o-mini | US |
OpenAI | openai/gpt3.5-turbo | US |
OpenAI | openai/gpt4-turbo | US |
OpenAI | openai/o1-mini | US |
OpenAI | openai/o1-preview | US |
Opper | opper/mistral-nemo-instruct | EU |
Opper | opper/molmo-7b-d-0924 | EU |
Xai | xai/grok-beta | US |
Xai | xai/grok-vision-beta | US |
Multimodal models
Provider | Model | Region | Image In | Image Out | Audio In | Options |
---|---|---|---|---|---|---|
Azure | azure/dall-e-3-eu | EU | X | |||
gcp/gemini-pro-1.5-eu | EU | X | X | |||
gcp/imagen-3.0-generate-001-eu | EU | X | ||||
Mistral | mistral/pixtral-12b-2409-eu | EU | X | |||
OpenAI | openai/gpt4-turbo | US | X | |||
OpenAI | openai/gpt-4o | US | X |
Custom models and bring-your-own-key
Custom models can be added using the API or the Opper CLI. The README explains how to add a model, but here is an example of adding your own Azure deployment:
This adds your custom deployment on my-gpt4-deployment.openai.azure.com
and the model name gpt4-production
using the my-api-key-here
API key. This model is then accessible in Opper using the name example/my-gpt4
.