Interface LlmAsJudge

interface LlmAsJudge {
    modelConfig?: null | unstable.EvaluatorModelConfig;
    name: string;
    outputDefinition: unstable.EvaluatorOutputDefinition;
    prompt: string;
    type: "llm_as_judge";
}

Properties

Optional explicit model configuration. Omit or set to null to use the project default evaluation model.

name: string

Evaluator name within the authenticated project.

Structured output schema the evaluator must return.

Always send dataType. Do not send version; it is an internal storage detail and not part of the public request contract.

prompt: string

Prompt template used by the evaluator.

type: "llm_as_judge"