First 18 rows of validation
| idstring | group_idstring | splitstring | sourcestring | kindstring | questionstring | optionsList | targetList | state_jsonstring | metadata_jsonstring | record_jsonstring | original_line_numberint64 |
|---|---|---|---|---|---|---|---|---|---|---|---|
| case-2b8765f3f152b9e5389a:call_t2 | context-retention-control-v1:942:id:28 | validation | context-retention-control-v1 |
| noul |
| Under the controlled retention policy, must the record and input of tool call t2 (run_check) stay for the current goal? |
| ["no","yes"] |
| [0,1] |
| {"context": "Original controlled retention policy. The current work item is named in goal; older goals do not override it. A needed work item is the current one or any prerequisite reached recursively through the listed dependencies. For every completed eligible call attached to … |
| {"case_id": "case-2b8765f3f152b9e5389a", "component": "call", "entity_ids": ["context-retention-control-v1:942:id:28"], "family": "policy", "provenance": {"generator_version": "context-retention-control-v1", "group_index": 28, "license": "CC0-1.0", "seed": 942, "source_relation":… |
| {"group_id":"context-retention-control-v1:942:id:28","id":"case-2b8765f3f152b9e5389a:call_t2","kind":"noul","metadata":{"case_id":"case-2b8765f3f152b9e5389a","component":"call","entity_ids":["context-retention-control-v1:942:id:28"],"family":"policy","provenance":{"generator_vers… |
| 1 |
| case-2b8765f3f152b9e5389a:result_t2 | context-retention-control-v1:942:id:28 | validation | context-retention-control-v1 | noul | Under the controlled retention policy, must the full output of tool call t2 (run_check, 217 chars) stay verbatim? | ["no","yes"] | [1,0] | {"context": "Original controlled retention policy. The current work item is named in goal; older goals do not override it. A needed work item is the current one or any prerequisite reached recursively through the listed dependencies. For every completed eligible call attached to … | {"case_id": "case-2b8765f3f152b9e5389a", "component": "result", "entity_ids": ["context-retention-control-v1:942:id:28"], "family": "policy", "provenance": {"generator_version": "context-retention-control-v1", "group_index": 28, "license": "CC0-1.0", "seed": 942, "source_relation… | {"group_id":"context-retention-control-v1:942:id:28","id":"case-2b8765f3f152b9e5389a:result_t2","kind":"noul","metadata":{"case_id":"case-2b8765f3f152b9e5389a","component":"result","entity_ids":["context-retention-control-v1:942:id:28"],"family":"policy","provenance":{"generator_… | 2 |
| case-2b8765f3f152b9e5389a:call_t3 | context-retention-control-v1:942:id:28 | validation | context-retention-control-v1 | noul | Under the controlled retention policy, must the record and input of tool call t3 (read_file) stay for the current goal? | ["no","yes"] | [0,1] | {"context": "Original controlled retention policy. The current work item is named in goal; older goals do not override it. A needed work item is the current one or any prerequisite reached recursively through the listed dependencies. For every completed eligible call attached to … | {"case_id": "case-2b8765f3f152b9e5389a", "component": "call", "entity_ids": ["context-retention-control-v1:942:id:28"], "family": "policy", "provenance": {"generator_version": "context-retention-control-v1", "group_index": 28, "license": "CC0-1.0", "seed": 942, "source_relation":… | {"group_id":"context-retention-control-v1:942:id:28","id":"case-2b8765f3f152b9e5389a:call_t3","kind":"noul","metadata":{"case_id":"case-2b8765f3f152b9e5389a","component":"call","entity_ids":["context-retention-control-v1:942:id:28"],"family":"policy","provenance":{"generator_vers… | 3 |
| case-2b8765f3f152b9e5389a:result_t3 | context-retention-control-v1:942:id:28 | validation | context-retention-control-v1 | noul | Under the controlled retention policy, must the full output of tool call t3 (read_file, 281 chars) stay verbatim? | ["no","yes"] | [1,0] | {"context": "Original controlled retention policy. The current work item is named in goal; older goals do not override it. A needed work item is the current one or any prerequisite reached recursively through the listed dependencies. For every completed eligible call attached to … | {"case_id": "case-2b8765f3f152b9e5389a", "component": "result", "entity_ids": ["context-retention-control-v1:942:id:28"], "family": "policy", "provenance": {"generator_version": "context-retention-control-v1", "group_index": 28, "license": "CC0-1.0", "seed": 942, "source_relation… | {"group_id":"context-retention-control-v1:942:id:28","id":"case-2b8765f3f152b9e5389a:result_t3","kind":"noul","metadata":{"case_id":"case-2b8765f3f152b9e5389a","component":"result","entity_ids":["context-retention-control-v1:942:id:28"],"family":"policy","provenance":{"generator_… | 4 |
| case-2b8765f3f152b9e5389a:call_t4 | context-retention-control-v1:942:id:28 | validation | context-retention-control-v1 | noul | Under the controlled retention policy, must the record and input of tool call t4 (read_manifest) stay for the current goal? | ["no","yes"] | [1,0] | {"context": "Original controlled retention policy. The current work item is named in goal; older goals do not override it. A needed work item is the current one or any prerequisite reached recursively through the listed dependencies. For every completed eligible call attached to … | {"case_id": "case-2b8765f3f152b9e5389a", "component": "call", "entity_ids": ["context-retention-control-v1:942:id:28"], "family": "policy", "provenance": {"generator_version": "context-retention-control-v1", "group_index": 28, "license": "CC0-1.0", "seed": 942, "source_relation":… | {"group_id":"context-retention-control-v1:942:id:28","id":"case-2b8765f3f152b9e5389a:call_t4","kind":"noul","metadata":{"case_id":"case-2b8765f3f152b9e5389a","component":"call","entity_ids":["context-retention-control-v1:942:id:28"],"family":"policy","provenance":{"generator_vers… | 5 |
| case-2b8765f3f152b9e5389a:result_t4 | context-retention-control-v1:942:id:28 | validation | context-retention-control-v1 | noul | Under the controlled retention policy, must the full output of tool call t4 (read_manifest, 345 chars) stay verbatim? | ["no","yes"] | [1,0] | {"context": "Original controlled retention policy. The current work item is named in goal; older goals do not override it. A needed work item is the current one or any prerequisite reached recursively through the listed dependencies. For every completed eligible call attached to … | {"case_id": "case-2b8765f3f152b9e5389a", "component": "result", "entity_ids": ["context-retention-control-v1:942:id:28"], "family": "policy", "provenance": {"generator_version": "context-retention-control-v1", "group_index": 28, "license": "CC0-1.0", "seed": 942, "source_relation… | {"group_id":"context-retention-control-v1:942:id:28","id":"case-2b8765f3f152b9e5389a:result_t4","kind":"noul","metadata":{"case_id":"case-2b8765f3f152b9e5389a","component":"result","entity_ids":["context-retention-control-v1:942:id:28"],"family":"policy","provenance":{"generator_… | 6 |
| case-2b8765f3f152b9e5389a:call_t5 | context-retention-control-v1:942:id:28 | validation | context-retention-control-v1 | noul | Under the controlled retention policy, must the record and input of tool call t5 (read_manifest) stay for the current goal? | ["no","yes"] | [0,1] | {"context": "Original controlled retention policy. The current work item is named in goal; older goals do not override it. A needed work item is the current one or any prerequisite reached recursively through the listed dependencies. For every completed eligible call attached to … | {"case_id": "case-2b8765f3f152b9e5389a", "component": "call", "entity_ids": ["context-retention-control-v1:942:id:28"], "family": "policy", "provenance": {"generator_version": "context-retention-control-v1", "group_index": 28, "license": "CC0-1.0", "seed": 942, "source_relation":… | {"group_id":"context-retention-control-v1:942:id:28","id":"case-2b8765f3f152b9e5389a:call_t5","kind":"noul","metadata":{"case_id":"case-2b8765f3f152b9e5389a","component":"call","entity_ids":["context-retention-control-v1:942:id:28"],"family":"policy","provenance":{"generator_vers… | 7 |
| case-2b8765f3f152b9e5389a:result_t5 | context-retention-control-v1:942:id:28 | validation | context-retention-control-v1 | noul | Under the controlled retention policy, must the full output of tool call t5 (read_manifest, 409 chars) stay verbatim? | ["no","yes"] | [1,0] | {"context": "Original controlled retention policy. The current work item is named in goal; older goals do not override it. A needed work item is the current one or any prerequisite reached recursively through the listed dependencies. For every completed eligible call attached to … | {"case_id": "case-2b8765f3f152b9e5389a", "component": "result", "entity_ids": ["context-retention-control-v1:942:id:28"], "family": "policy", "provenance": {"generator_version": "context-retention-control-v1", "group_index": 28, "license": "CC0-1.0", "seed": 942, "source_relation… | {"group_id":"context-retention-control-v1:942:id:28","id":"case-2b8765f3f152b9e5389a:result_t5","kind":"noul","metadata":{"case_id":"case-2b8765f3f152b9e5389a","component":"result","entity_ids":["context-retention-control-v1:942:id:28"],"family":"policy","provenance":{"generator_… | 8 |
| case-ed35f8c1ea5e3059d3a6:call_t2 | context-retention-control-v1:942:id:28 | validation | context-retention-control-v1 | noul | Under the controlled retention policy, must the record and input of tool call t2 (run_check) stay for the current goal? | ["no","yes"] | [1,0] | {"context": "Original controlled retention policy. The current work item is named in goal; older goals do not override it. A needed work item is the current one or any prerequisite reached recursively through the listed dependencies. For every completed eligible call attached to … | {"case_id": "case-ed35f8c1ea5e3059d3a6", "component": "call", "entity_ids": ["context-retention-control-v1:942:id:28"], "family": "policy", "provenance": {"generator_version": "context-retention-control-v1", "group_index": 28, "license": "CC0-1.0", "seed": 942, "source_relation":… | {"group_id":"context-retention-control-v1:942:id:28","id":"case-ed35f8c1ea5e3059d3a6:call_t2","kind":"noul","metadata":{"case_id":"case-ed35f8c1ea5e3059d3a6","component":"call","entity_ids":["context-retention-control-v1:942:id:28"],"family":"policy","provenance":{"generator_vers… | 9 |
| case-ed35f8c1ea5e3059d3a6:result_t2 | context-retention-control-v1:942:id:28 | validation | context-retention-control-v1 | noul | Under the controlled retention policy, must the full output of tool call t2 (run_check, 217 chars) stay verbatim? | ["no","yes"] | [1,0] | {"context": "Original controlled retention policy. The current work item is named in goal; older goals do not override it. A needed work item is the current one or any prerequisite reached recursively through the listed dependencies. For every completed eligible call attached to … | {"case_id": "case-ed35f8c1ea5e3059d3a6", "component": "result", "entity_ids": ["context-retention-control-v1:942:id:28"], "family": "policy", "provenance": {"generator_version": "context-retention-control-v1", "group_index": 28, "license": "CC0-1.0", "seed": 942, "source_relation… | {"group_id":"context-retention-control-v1:942:id:28","id":"case-ed35f8c1ea5e3059d3a6:result_t2","kind":"noul","metadata":{"case_id":"case-ed35f8c1ea5e3059d3a6","component":"result","entity_ids":["context-retention-control-v1:942:id:28"],"family":"policy","provenance":{"generator_… | 10 |
| case-ed35f8c1ea5e3059d3a6:call_t3 | context-retention-control-v1:942:id:28 | validation | context-retention-control-v1 | noul | Under the controlled retention policy, must the record and input of tool call t3 (read_file) stay for the current goal? | ["no","yes"] | [1,0] | {"context": "Original controlled retention policy. The current work item is named in goal; older goals do not override it. A needed work item is the current one or any prerequisite reached recursively through the listed dependencies. For every completed eligible call attached to … | {"case_id": "case-ed35f8c1ea5e3059d3a6", "component": "call", "entity_ids": ["context-retention-control-v1:942:id:28"], "family": "policy", "provenance": {"generator_version": "context-retention-control-v1", "group_index": 28, "license": "CC0-1.0", "seed": 942, "source_relation":… | {"group_id":"context-retention-control-v1:942:id:28","id":"case-ed35f8c1ea5e3059d3a6:call_t3","kind":"noul","metadata":{"case_id":"case-ed35f8c1ea5e3059d3a6","component":"call","entity_ids":["context-retention-control-v1:942:id:28"],"family":"policy","provenance":{"generator_vers… | 11 |
| case-ed35f8c1ea5e3059d3a6:result_t3 | context-retention-control-v1:942:id:28 | validation | context-retention-control-v1 | noul | Under the controlled retention policy, must the full output of tool call t3 (read_file, 281 chars) stay verbatim? | ["no","yes"] | [1,0] | {"context": "Original controlled retention policy. The current work item is named in goal; older goals do not override it. A needed work item is the current one or any prerequisite reached recursively through the listed dependencies. For every completed eligible call attached to … | {"case_id": "case-ed35f8c1ea5e3059d3a6", "component": "result", "entity_ids": ["context-retention-control-v1:942:id:28"], "family": "policy", "provenance": {"generator_version": "context-retention-control-v1", "group_index": 28, "license": "CC0-1.0", "seed": 942, "source_relation… | {"group_id":"context-retention-control-v1:942:id:28","id":"case-ed35f8c1ea5e3059d3a6:result_t3","kind":"noul","metadata":{"case_id":"case-ed35f8c1ea5e3059d3a6","component":"result","entity_ids":["context-retention-control-v1:942:id:28"],"family":"policy","provenance":{"generator_… | 12 |
| case-ed35f8c1ea5e3059d3a6:call_t4 | context-retention-control-v1:942:id:28 | validation | context-retention-control-v1 | noul | Under the controlled retention policy, must the record and input of tool call t4 (read_manifest) stay for the current goal? | ["no","yes"] | [0,1] | {"context": "Original controlled retention policy. The current work item is named in goal; older goals do not override it. A needed work item is the current one or any prerequisite reached recursively through the listed dependencies. For every completed eligible call attached to … | {"case_id": "case-ed35f8c1ea5e3059d3a6", "component": "call", "entity_ids": ["context-retention-control-v1:942:id:28"], "family": "policy", "provenance": {"generator_version": "context-retention-control-v1", "group_index": 28, "license": "CC0-1.0", "seed": 942, "source_relation":… | {"group_id":"context-retention-control-v1:942:id:28","id":"case-ed35f8c1ea5e3059d3a6:call_t4","kind":"noul","metadata":{"case_id":"case-ed35f8c1ea5e3059d3a6","component":"call","entity_ids":["context-retention-control-v1:942:id:28"],"family":"policy","provenance":{"generator_vers… | 13 |
| case-ed35f8c1ea5e3059d3a6:result_t4 | context-retention-control-v1:942:id:28 | validation | context-retention-control-v1 | noul | Under the controlled retention policy, must the full output of tool call t4 (read_manifest, 345 chars) stay verbatim? | ["no","yes"] | [0,1] | {"context": "Original controlled retention policy. The current work item is named in goal; older goals do not override it. A needed work item is the current one or any prerequisite reached recursively through the listed dependencies. For every completed eligible call attached to … | {"case_id": "case-ed35f8c1ea5e3059d3a6", "component": "result", "entity_ids": ["context-retention-control-v1:942:id:28"], "family": "policy", "provenance": {"generator_version": "context-retention-control-v1", "group_index": 28, "license": "CC0-1.0", "seed": 942, "source_relation… | {"group_id":"context-retention-control-v1:942:id:28","id":"case-ed35f8c1ea5e3059d3a6:result_t4","kind":"noul","metadata":{"case_id":"case-ed35f8c1ea5e3059d3a6","component":"result","entity_ids":["context-retention-control-v1:942:id:28"],"family":"policy","provenance":{"generator_… | 14 |
| case-ed35f8c1ea5e3059d3a6:call_t5 | context-retention-control-v1:942:id:28 | validation | context-retention-control-v1 | noul | Under the controlled retention policy, must the record and input of tool call t5 (read_manifest) stay for the current goal? | ["no","yes"] | [1,0] | {"context": "Original controlled retention policy. The current work item is named in goal; older goals do not override it. A needed work item is the current one or any prerequisite reached recursively through the listed dependencies. For every completed eligible call attached to … | {"case_id": "case-ed35f8c1ea5e3059d3a6", "component": "call", "entity_ids": ["context-retention-control-v1:942:id:28"], "family": "policy", "provenance": {"generator_version": "context-retention-control-v1", "group_index": 28, "license": "CC0-1.0", "seed": 942, "source_relation":… | {"group_id":"context-retention-control-v1:942:id:28","id":"case-ed35f8c1ea5e3059d3a6:call_t5","kind":"noul","metadata":{"case_id":"case-ed35f8c1ea5e3059d3a6","component":"call","entity_ids":["context-retention-control-v1:942:id:28"],"family":"policy","provenance":{"generator_vers… | 15 |
| case-ed35f8c1ea5e3059d3a6:result_t5 | context-retention-control-v1:942:id:28 | validation | context-retention-control-v1 | noul | Under the controlled retention policy, must the full output of tool call t5 (read_manifest, 409 chars) stay verbatim? | ["no","yes"] | [1,0] | {"context": "Original controlled retention policy. The current work item is named in goal; older goals do not override it. A needed work item is the current one or any prerequisite reached recursively through the listed dependencies. For every completed eligible call attached to … | {"case_id": "case-ed35f8c1ea5e3059d3a6", "component": "result", "entity_ids": ["context-retention-control-v1:942:id:28"], "family": "policy", "provenance": {"generator_version": "context-retention-control-v1", "group_index": 28, "license": "CC0-1.0", "seed": 942, "source_relation… | {"group_id":"context-retention-control-v1:942:id:28","id":"case-ed35f8c1ea5e3059d3a6:result_t5","kind":"noul","metadata":{"case_id":"case-ed35f8c1ea5e3059d3a6","component":"result","entity_ids":["context-retention-control-v1:942:id:28"],"family":"policy","provenance":{"generator_… | 16 |
| case-5356ea96a7888a97a013:call_t2 | context-retention-control-v1:942:id:28 | validation | context-retention-control-v1 | noul | Under the controlled retention policy, must the record and input of tool call t2 (run_check) stay for the current goal? | ["no","yes"] | [0,1] | {"context": "Original controlled retention policy. The current work item is named in goal; older goals do not override it. A needed work item is the current one or any prerequisite reached recursively through the listed dependencies. For every completed eligible call attached to … | {"case_id": "case-5356ea96a7888a97a013", "component": "call", "entity_ids": ["context-retention-control-v1:942:id:28"], "family": "policy", "provenance": {"generator_version": "context-retention-control-v1", "group_index": 28, "license": "CC0-1.0", "seed": 942, "source_relation":… | {"group_id":"context-retention-control-v1:942:id:28","id":"case-5356ea96a7888a97a013:call_t2","kind":"noul","metadata":{"case_id":"case-5356ea96a7888a97a013","component":"call","entity_ids":["context-retention-control-v1:942:id:28"],"family":"policy","provenance":{"generator_vers… | 17 |
| case-5356ea96a7888a97a013:result_t2 | context-retention-control-v1:942:id:28 | validation | context-retention-control-v1 | noul | Under the controlled retention policy, must the full output of tool call t2 (run_check, 217 chars) stay verbatim? | ["no","yes"] | [0,1] | {"context": "Original controlled retention policy. The current work item is named in goal; older goals do not override it. A needed work item is the current one or any prerequisite reached recursively through the listed dependencies. For every completed eligible call attached to … | {"case_id": "case-5356ea96a7888a97a013", "component": "result", "entity_ids": ["context-retention-control-v1:942:id:28"], "family": "policy", "provenance": {"generator_version": "context-retention-control-v1", "group_index": 28, "license": "CC0-1.0", "seed": 942, "source_relation… | {"group_id":"context-retention-control-v1:942:id:28","id":"case-5356ea96a7888a97a013:result_t2","kind":"noul","metadata":{"case_id":"case-5356ea96a7888a97a013","component":"result","entity_ids":["context-retention-control-v1:942:id:28"],"family":"policy","provenance":{"generator_… | 18 |
