Skip to main content
POST
Create an eval judge

Authorizations

Authorization
string
header
required

Your organization API key (it starts with anek_org_). The same key works on the Voice API and the Support API. See Authentication.

Path Parameters

projectId
string
required

Project id

Body

application/json
name
string
required

Unique within the project.

Required string length: 1 - 256
model
string
required

The judge model. Must be a model the platform's judge supports (for example gemini-2.5-flash); anything else is refused with 422.

Minimum string length: 1
prompt_template
string
required

The judge prompt. Must contain the placeholders {name}, {when_relevant}, {success_criteria}, {failure_criteria} and {conversation_text}. Start from GET …/eval-judges/templates.

description
string | null
temperature
number
default:0
Required range: 0 <= x <= 2

Response

The created judge

judge
object
required

An LLM judge configuration: the model, temperature and prompt template used to decide each test case of an eval call.