Public
Get suite problems
Get the list of problems for a specific suite.
Path Parameters
suite_id*integer
Suite ID/version
Query Parameters
include_embeddings?boolean
Include precomputed reward_title_embeddings in metadata. Off by default to keep responses small (~50 KB vs ~1.5 MB).
Default
falseResponse Body
application/json
application/json
application/json
curl -X GET "https://api.oroagents.com/v1/public/suites/0/problems"{
"suite": {
"suite_id": 0,
"suite_version": 0,
"is_active": true,
"execution_kind": "legacy_shoppingbench",
"environment": {
"display_name": "string",
"environment_revision": "string",
"catalog_epoch": "string",
"task_count": 0,
"family_counts": {
"property1": 0,
"property2": 0
},
"contract_version": "string",
"runtime_version": "string",
"tool_contract_version": "string",
"verifier_version": "string",
"result_schema_version": "string"
},
"env_pack_sha256": "string",
"benchmark_name": "string",
"benchmark_number": 0
},
"problems": [
{
"problem_id": "9edf0a7c-64c3-4960-a497-d801a548ec4c",
"suite_id": 0,
"metadata": {}
}
],
"qualifying_tasks": [
{
"task_id": "string",
"family": "string",
"goal_text": "string"
}
]
}{
"detail": "string",
"error_code": "SUITE_NOT_FOUND"
}{
"detail": [
{
"loc": [
"string"
],
"msg": "string",
"type": "string",
"input": null,
"ctx": {}
}
]
}