OptionaljsonOptional JSONPath selector applied to the selected source before it is passed to the evaluator prompt.
Requirements:
$source=metadataSource field that should populate the prompt variable.
Quick reference:
target=observation: input, output, metadatatarget=experiment: input, output, metadata, expected_output, experiment_item_metadataPrompt variable name without braces.
Example: for the prompt Judge {{input}} against {{output}}, use input and output.
Maps one evaluator variable to one source field from the target object.
Manual mappings are used for
llm_as_judgeevaluators.codeevaluators use a fixed runtime mapping managed by Langfuse.How to build a valid mapping list:
GET /evaluators/{id}.variablesarray.{{or}}.sourcethat is valid for the selectedtarget.jsonPathis optional. Use it only when the selected source is a JSON object and you want to extract one nested field before inserting it into the evaluator prompt.Recovery guidance:
invalid_variable_mapping: the variable name is unknown for this evaluator, or the selectedsourceis not valid for the chosentargetmissing_variable_mapping: one or more LLM-as-judge evaluator variables are not mapped yetduplicate_variable_mapping: the same evaluator variable appears more than onceinvalid_json_path: the JSONPath expression is malformed. Remove it or correct it.Example
Example
Example