Execute instruction-adherence evaluator

Evaluate how well responses follow given instructions

Request Body:

• input.instructions (string, required): The instructions that should be followed
• input.response (string, required): The response to evaluate for instruction adherence

POST /v2/evaluators/instruction-adherence/execute

Execute instruction-adherence evaluator

cURL

curl --request POST \
  --url https://api.traceloop.com/v2/evaluators/instruction-adherence/execute \
  --header 'Authorization: <api-key>' \
  --header 'Content-Type: application/json' \
  --data '
{
  "input": {
    "instructions": "Respond in exactly 3 bullet points and use formal language.",
    "response": "- First point about the topic\n- Second relevant consideration\n- Final concluding thought"
  }
}
'

200

{
  "instruction_adherence_score": 0.87
}

Authorizations

Authorization · string · header · required

Type "Bearer" followed by a space and JWT token.

Body

application/json

Request body

input · object · required

Show child attributes

Response

200

application/json

OK

instruction_adherence_score · number

Example:

0.87