Skip to main content
POST
/
batches
/
evaluate
{
  "batch_id": "<string>",
  "name": "<string>",
  "status": "<string>",
  "total_evaluations": 123,
  "estimated_completion_time": {},
  "created_at": {}
}

Overview

Creates and immediately starts a batch evaluation job. This is a convenience endpoint that combines batch creation with immediate execution.

Request Body

name
string
required
Name for the batch job
description
string
Description of the batch job
judge_ids
array
required
Array of judge IDs to evaluate content against
content_items
array
required
Array of content items to evaluate
priority
string
default:"normal"
Batch priority (low, normal, high)
auto_start
boolean
default:"true"
Whether to start evaluation immediately

Response

batch_id
string
required
Unique identifier for the batch
name
string
required
Batch name
status
string
required
Batch status (created, evaluating)
total_evaluations
integer
required
Total evaluations to perform
estimated_completion_time
datetime
Estimated completion time
created_at
datetime
required
Creation timestamp

Examples

curl -X POST https://api.judge.example.com/batches/evaluate \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "name": "Daily Content Review",
    "description": "Review all today'\''s content",
    "judge_ids": ["jdg_xyz789"],
    "content_items": [
      {
        "content_id": "cnt_001"
      },
      {
        "text_content": "This is inline content to evaluate",
        "name": "Inline Content Test",
        "metadata": {"source": "api"}
      }
    ],
    "priority": "high",
    "auto_start": true
  }'