Execute answer-correctness evaluator

Evaluate factual accuracy by comparing answers against ground truth

Request Body:

• input.question (string, required): The original question
• input.completion (string, required): The completion to evaluate
• input.ground_truth (string, required): The expected correct answer

POST /v2/evaluators/answer-correctness/execute

Execute answer-correctness evaluator

cURL

curl --request POST \
  --url https://api.traceloop.com/v2/evaluators/answer-correctness/execute \
  --header 'Authorization: <api-key>' \
  --header 'Content-Type: application/json' \
  --data '
{
  "input": {
    "completion": "World War II ended in 1945.",
    "ground_truth": "1945",
    "question": "What year did World War II end?"
  }
}
'

200

{
  "correctness_score": 0.91
}

Authorizations

Authorization · string · header · required

Type "Bearer" followed by a space and JWT token.

Body

application/json

Request body

input · object · required

Show child attributes

Response

200

application/json

OK

correctness_score · number

Example:

0.91