LLM Connections
LLM Connections store your provider API credentials so Oodle can call LLMs on your behalf. They are required for the Playground, LLM-as-Judge evaluators, and dataset experiments.
Navigate to Agent Observability → Settings → LLM Connections (ap1, us1).
Only Admin users can create and manage LLM connections.
Supported Providers
| Provider | Default Base URL |
|---|---|
https://generativelanguage.googleapis.com | |
| Anthropic | https://api.anthropic.com |
| OpenAI | https://api.openai.com/v1 |
| TypeSafe (Jev) | https://api.typesafe.ai/v1/systemone |
TypeSafe (Jev)
Jev is a decision model, not a chat model. It answers a typed question (yes/no, one of a set of options, or a level on a scale) with a calibrated probability, and it cannot generate text. Use a TypeSafe connection in two places:
-
As an evaluator's connection: the evaluator prompt is the question.
-
As an experiment's model, when the prompt template asks one question about the item's variables. The Decision field on the run form gives the answer's shape, one of Jev's three question types:
Decision Criteria Output Yes / no none; Threshold is the P(yes) at or above which the answer is yes(0.5 unless set)yesornoOne of a set of options one option per line, option: descriptionthe chosen option A level on an ordered scale 2 to 10 levels, one per line, lowest first the nearest level The output is a word, so an output comparer reads it like any model's, and you can compare Jev with chat models on the same decision task, for example "which team owns this ticket?".
The Playground does not list it.
To reach Jev through OpenRouter instead, set the
Base URL to
https://openrouter.ai/api/alpha/decisions and add
~typesafe/jev-latest as a custom model.
Creating a Connection
- Click + New Connection
- Fill in the required fields:
| Field | Required | Description |
|---|---|---|
| Name | Yes | Display name for the connection |
| Provider | Yes | Google, Anthropic, OpenAI, or TypeSafe |
| API Key | Yes | Your provider API key |
| Default Model | No | Model used when none is explicitly selected |
| Base URL | No | Override the default API endpoint (useful for proxies or custom deployments) |
| Custom Models | No | Additional model names not in the built-in list (e.g. deepseek/deepseek-v4-flash) |
| Custom Headers | No | Extra HTTP headers sent with every request |
- Optionally toggle Set as default connection to make this the primary connection
- Optionally toggle Show default models from provider off to hide built-in models and only show your custom models
- Click Create
Default Connection
One connection can be marked as the default. The Playground, evaluator wizard, and experiment form auto-select the default connection when no other is specified.
Custom Models
If your provider supports models not in Oodle's built-in list, add them as Custom Models. These appear alongside built-in models in every model selector. You can also type any model name directly in model dropdowns — select Use "model-name" to use an unlisted model.
Editing and Deleting
Click the edit icon on any connection to update its configuration. When editing, leave the API key blank to keep the existing key.
Deleting a connection stops any evaluators and Playground sessions that use it.
Support
If you need assistance or have any questions, please reach out to us through:
- Email at [email protected]