Models

Opper supports a wide range of models and providers. We strive to make models available through European inference providers.

The following language and multi modal models are currently available in the platform:

Language models

ProviderModelRegion
Anthropicanthropic/claude-2US
Anthropicanthropic/claude-3-haikuUS
Anthropicanthropic/claude-3-opusUS
Anthropicanthropic/claude-3-sonnetUS
Anthropicanthropic/claude-3.5-haikuUS
Anthropicanthropic/claude-3.5-haiku-20241022US
Anthropicanthropic/claude-3.5-sonnetUS
Anthropicanthropic/claude-3.5-sonnet-20240620US
Anthropicanthropic/claude-3.5-sonnet-20241022US
AWSaws/claude-3-haiku-euEU
AWSaws/claude-3-sonnet-euEU
AWSaws/claude-3.5-sonnet-euEU
Amazonaws/titan-text-express-v1-euEU
Azureazure/gpt-4o-euEU
Azureazure/gpt3-euEU
Azureazure/gpt4-euEU
Azureazure/meta-llama-3.1-405bUS
Azureazure/meta-llama-3.1-70b-euEU
Azureazure/mistral-large-2407-euEU
Azureazure/mistral-large-euEU
Cerebrascerebras/llama3.1-70bUS
Cerebrascerebras/llama3.1-8bUS
Googlegcp/gemini-1.5-flash-001-euEU
Googlegcp/gemini-1.5-flash-002-euEU
Googlegcp/gemini-1.5-flash-euEU
Googlegcp/gemini-1.5-pro-001-euEU
Googlegcp/gemini-1.5-pro-002-euEU
Googlegcp/gemini-1.5-pro-euEU
Googlegcp/gemini-2.0-flash-expUS
Googlegcp/gemini-exp-1114EU
Googlegcp/gemini-exp-1121EU
Googlegcp/gemini-pro-1.0-euEU
Groqgroq/gemma2-9b-itUS
Groqgroq/llama-3.1-70b-versatileUS
Groqgroq/llama-3.1-8b-instantUS
Groqgroq/llama-3.3-70b-versatileUS
Mistralmistral/mistral-large-2407-euEU
Mistralmistral/mistral-large-euEU
Mistralmistral/mistral-small-euEU
Mistralmistral/mistral-tiny-euEU
Mistralmistral/pixtral-12b-2409-euEU
Mistralmistral/pixtral-large-2411-euEU
Mistralmistral/pixtral-large-latest-euEU
OpenAIopenai/gpt-4oUS
OpenAIopenai/gpt-4o-2024-05-13US
OpenAIopenai/gpt-4o-2024-08-06US
OpenAIopenai/gpt-4o-audio-previewUS
OpenAIopenai/gpt-4o-miniUS
OpenAIopenai/gpt3.5-turboUS
OpenAIopenai/gpt4-turboUS
OpenAIopenai/o1-miniUS
OpenAIopenai/o1-previewUS
Opperopper/mistral-nemo-instructEU
Opperopper/molmo-7b-d-0924EU
Xaixai/grok-betaUS
Xaixai/grok-vision-betaUS

Multimodal models

ProviderModelRegionImage InImage OutAudio InOptions
Azureazure/dall-e-3-euEUX
Googlegcp/gemini-pro-1.5-euEUXX
Googlegcp/imagen-3.0-generate-001-euEUX
Mistralmistral/pixtral-12b-2409-euEUX
OpenAIopenai/gpt4-turboUSX
OpenAIopenai/gpt-4oUSX

Custom models and bring-your-own-key

Custom models can be added using the API or the Opper CLI. The README explains how to add a model, but here is an example of adding your own Azure deployment:

This adds your custom deployment on my-gpt4-deployment.openai.azure.com and the model name gpt4-production using the my-api-key-here API key. This model is then accessible in Opper using the name example/my-gpt4.