GenAI Evaluators

Define LLM-as-judge and code evaluators, and the rules that run them over live traffic.

Get the reference of the oodle_eval library

Get the reference of the oodle_eval library

List the files of the oodle_eval library

List the files of the oodle_eval library

Get one file of the oodle_eval library

Get one file of the oodle_eval library

List code evaluator starters

List code evaluator starters

List evaluators

List evaluators

Create an evaluator

Create an evaluator

Delete an evaluator

Delete an evaluator

Get an evaluator

Get an evaluator

Update an evaluator

Update an evaluator

Run an evaluator on one span without saving a score

Run an evaluator on one span without saving a score

Check an evaluator without saving it

Check an evaluator without saving it

List evaluation rules

List evaluation rules

Create an evaluation rule

Create an evaluation rule

Delete an evaluation rule

Delete an evaluation rule

Get an evaluation rule

Get an evaluation rule

Update an evaluation rule

Update an evaluation rule