Use these values when mapping evaluator prompt variables to live data.
Source semantics:
input: the observation input payload
output: the observation output payload
metadata: the observation metadata object. Combine with jsonPath when you need one nested field instead of the whole object.
tool_calls: the tool calls recorded on the observation, as an array of {id, name, arguments, type, index} objects in the order the model emitted them. Combine with jsonPath (for example $[*].name) to select parts of each call.
expected_output: the experiment item's expected output when the observation belongs to an experiment.
experiment_item_metadata: the experiment item's metadata when the observation belongs to an experiment.
Source field used to populate a prompt variable.
Use these values when mapping evaluator prompt variables to live data.
Source semantics:
input: the observation input payloadoutput: the observation output payloadmetadata: the observation metadata object. Combine withjsonPathwhen you need one nested field instead of the whole object.tool_calls: the tool calls recorded on the observation, as an array of{id, name, arguments, type, index}objects in the order the model emitted them. Combine withjsonPath(for example$[*].name) to select parts of each call.expected_output: the experiment item's expected output when the observation belongs to an experiment.experiment_item_metadata: the experiment item's metadata when the observation belongs to an experiment.