Execute semantic-similarity evaluator

Calculate semantic similarity between completion and reference

Request Body:

• input.completion (string, required): The completion text to compare
• input.reference (string, required): The reference text to compare against

POST /v2/evaluators/semantic-similarity/execute

Execute semantic-similarity evaluator

cURL

curl --request POST \
  --url https://api.traceloop.com/v2/evaluators/semantic-similarity/execute \
  --header 'Authorization: <api-key>' \
  --header 'Content-Type: application/json' \
  --data '
{
  "input": {
    "completion": "The cat sat on the mat.",
    "reference": "A feline was resting on the rug."
  }
}
'

200

{
  "similarity_score": 0.92
}

Authorizations

Authorization · string · header · required

Type "Bearer" followed by a space and JWT token.

Body

application/json

Request body

input · object · required

Show child attributes

Response

200

application/json

OK

similarity_score · number

Example:

0.92