Register a custom model
The quickest way is in the dashboard. Open Models in platform.opper.ai, choose Create → BYOK model, and fill in:
Save it, then call the model by its name like any other:
Custom models belong to your organization, and each name can be used once in it. Pick a name no catalog model uses: when a name matches both, the catalog model is the one called.
What your endpoint needs
An endpoint you set must use HTTPS, and its hostname must resolve only to public IP addresses.http:// URLs, localhost, and private or link-local addresses are refused, so a server on a private network has to be reachable at a public HTTPS address first.
Registering makes one short test call to the model with your credentials. If that call fails, you get a 400 with the reason and nothing is saved.
Register from the API or CLI
If you’d rather automate it, the API takes these fields:
The CLI takes
name, identifier, and api_key as arguments, and extra as --extra.
- cURL
- CLI
What’s next
Models
The full catalog of built-in models.
AI Gateway
How routing and model selection fit together.