Execute faithfulness evaluator

Check if a completion is faithful to the provided context

Request Body:

• input.completion (string, required): The LLM completion to check for faithfulness
• input.context (string, required): The context that the completion should be faithful to
• input.question (string, required): The original question asked

POST /v2/evaluators/faithfulness/execute

Execute faithfulness evaluator

cURL

curl --request POST \
  --url https://api.traceloop.com/v2/evaluators/faithfulness/execute \
  --header 'Authorization: <api-key>' \
  --header 'Content-Type: application/json' \
  --data '
{
  "input": {
    "completion": "The Eiffel Tower is located in Paris and was built in 1889.",
    "context": "The Eiffel Tower is a wrought-iron lattice tower on the Champ de Mars in Paris, France. It was constructed from 1887 to 1889.",
    "question": "When was the Eiffel Tower built?"
  }
}
'

200

{
  "is_faithful": true
}

Authorizations

Authorization · string · header · required

Type "Bearer" followed by a space and JWT token.

Body

application/json

Request body

input · object · required

Show child attributes

Response

200

application/json

OK

is_faithful · boolean

Example:

true