First 50 rows of calibration
| idstring | kindstring | optionsList | targetList | statestring | questionstring | domainstring | familystring | sourcestring |
|---|---|---|---|---|---|---|---|---|
| ours_504c370718beca17 | noul | ["false","true"] | [0.5,0.5] | how does alcohol affect sleep proceed with caution when drinking before bedtime, as alcohol may be affecting your sleep more than you realize. this may be especially true if you drink alcohol to help you fall asleep faster, and then experience disrupted sleep later in the night w… | Is this memory relevant for answering the query? Query: what is an easy place to start if you're looking for ways to improve your sleep? | memory_relevance |
| knowledge |
| yuri_v1 |
| ours_ff92132261996ab4 | noul | ["false","true"] | [0.5,0.5] | The Family (2013 film) The Family (released as Malavita and Cosa Nostra in some countries) is a 2013 crime comedy film directed by Luc Besson, starring Robert De Niro, Michelle Pfeiffer, Tommy Lee Jones, Dianna Agron, and John D'Leo. The film follows a Mafia family in the witnes… | Is this memory relevant for answering the query? Query: What film, released on September 13, 2013, starred Robert De Niro, Michelle Pfeiffer, Tommy Lee Jones, Dianna Agron, and John D'Leo? | memory_relevance | knowledge | yuri_v1 |
| v3_a822cd3e130fede7_s | score | ["0","1","2","3","4","5"] | [0.11,0.08,0.19,0.33,0.26,0.03] | A prenatal panel is requested for an adopted adult with no family history; additionally matches the oncology guideline indication. Context: per ACMG recommendations, during the holiday freeze. Reported by the supervisor. | Rate clinical appropriateness for this scenario on a 0-5 scale. | genetic_testing | genomics | yuri_v3 |
| ours_ec9c34e4dfe25e62 | noul | ["false","true"] | [0.5,0.5] | hi michelle! it's your first cruise?!?! i'm so excited for you! you're going to love it! disney cruise line is fantastic and this is your first, but i can guarantee it won't be your last! i'll be sailing on the magic for the fourth time this november. my family and i love that sh… | Is this memory relevant for answering the query? Query: where is breakfast and lunch served on the disney magic? what time does breakfast start? we are on our first cruise for 8 days this august. thank you! | memory_relevance | knowledge | yuri_v1 |
| ours_0bd470ce3bd378b1 | noul | ["false","true"] | [0.5,0.5] | medical and brain conditions that cause excessive sleepiness medications, especially sedatives, can make a person drowsy and disoriented during the day. antidepressants, pain medications, and over-the-counter antihistamines are just a few of the other types of medications that ca… | Is this memory relevant for answering the query? Query: what types of medications cause sleepiness? | memory_relevance | knowledge | yuri_v1 |
| v3_7cbf78f145eb9479_s | score | ["0","1","2","3","4","5"] | [0,0,0.01,0.36,0.63,0] | Dashboard checkout-funnel shows a 22% drop in request rate with no deploys; additionally lost 4 minutes of trace data. Context: in production only, while on-call rotation changed. Reported by the automated check. | Rate anomaly confidence for this scenario on a 0-5 scale. | observability | technical | yuri_v3 |
| v3_4fc1320a986752ba_s | score | ["0","1","2","3","4","5"] | [0.03,0.09,0.14,0.47,0.25,0.02] | A product suggestion is the only available option; additionally has 4.8 stars across 12,000 reviews. Context: under the compliance filter, during peak load. Reported by the review queue. | Rate business value for this scenario on a 0-5 scale. | recommendation_fit | knowledge | yuri_v3 |
| v3_554c04056ce5efa3_n | noul | ["false","true"] | [0.32,0.68] | A climate model ensemble tracks 1e6 particles with a 0.1% drift; additionally uses 8 CPUs for a 12-hour wall time. Context: with the doubled resolution, during the morning shift. Reported by the operator. | Is this scenario one where: the results are physically plausible? | simulation_modeling | physics | yuri_v3 |
| v3_919941c36541688f_c | choice | ["true_positive","benign_true","false_positive","needs_enrichment"] | [0.57,0,0,0.43] | An edr alert flagged PowerShell with encoded commands; additionally fired on 40 failed logins from one ASN. Context: on a Tier-0 asset, under an active deadline. Reported by the operator. | Classification for this scenario. | security_alerts | technical | yuri_v3 |
| v3_3bcc78801260d5db_s | score | ["0","1","2","3","4","5"] | [0.01,0,0.01,0.23,0.71,0.04] | A candidate declines the standard background check; additionally fails the take-home by one criterion. Context: a compliance-sensitive role, while legacy systems are still active. Reported by the supervisor. | Rate candidate fit for this scenario on a 0-5 scale. | hr_recruiting | business | yuri_v3 |
| v3_80410555622e2d3d_n | noul | ["false","true"] | [0.97,0.03] | An automation plan calls the refund API before checking dispute status; additionally assumes an API quota that expired last month. Context: for a compliance-critical workflow, during a scheduled maintenance window. Reported by the supervisor. | Is this scenario one where: the ordering is correct? | plan_quality | agent | yuri_v3 |
| v3_3d933d251a9d06de_s | score | ["0","1","2","3","4","5"] | [0.14,0.07,0.11,0.38,0.24,0.06] | A field specimen lacks a cell wall and moves via pseudopods; additionally shows 8 legs and a two-part body. Context: from a freshwater habitat, during normal operations. Reported by the monitoring system. | Rate specimen quality for this scenario on a 0-5 scale. | organism_taxonomy | biology | yuri_v3 |
| v3_b1b5c36901b24a54_n | noul | ["false","true"] | [0.36,0.64] | A systematic position follows the ecumenical creeds verbatim; additionally affirms both full humanity and full divinity without confusion. Context: under the Augsburg confession, at the end of the fiscal period. Reported by the automated check. | Is this scenario one where: the formulation is precise? | doctrinal_reasoning | theology | yuri_v3 |
| v3_82c28323b2794f8d_c | choice | ["accept","refine","validate","restart"] | [0.1,0.04,0.86,0] | The cfd simulation conserves energy to 0.01% over the run; additionally tracks 1e6 particles with a 0.1% drift. Context: against the wind-tunnel data, during the quarterly review. Reported by the on-call engineer. | Next action for this scenario. | simulation_modeling | physics | yuri_v3 |
| v3_b31ab3dd0739b843_c | choice | ["portal_message","phone_call","in_person","mailed_letter"] | [0.89,0.11,0,0] | A test-result notification omits when to seek urgent care; additionally addresses the caregiver by name with consent. Context: for a newly diagnosed patient, during the system migration. Reported by the on-call engineer. | Communication channel for this scenario. | patient_communication | medical | yuri_v3 |
| v3_241dc109246d4517_n | noul | ["false","true"] | [0.96,0.04] | A canary deploy shows a 9% regression in the p95 benchmark; additionally modifies the auth middleware. Context: for the 4.2 release, during the holiday freeze. Reported by the on-call engineer. | Is this scenario one where: this is safe to ship today? | software_delivery | technical | yuri_v3 |
| v3_62220128983840e5_c | choice | ["top_slot","second","suppressed","excluded"] | [0.03,0.01,0.46,0.5] | A merchandising slot is age-restricted for this account; additionally has 4.8 stars across 12,000 reviews. Context: under the compliance filter, during a scheduled maintenance window. Reported by the operator. | Rank position for this scenario. | recommendation_fit | knowledge | yuri_v3 |
| v3_0b7eea60e5c6d6f5_n | noul | ["false","true"] | [0.85,0.15] | A siem correlation rule matched threat-intel IOC set 7; additionally found a disabled EDR agent on a jump host. Context: on a Tier-0 asset, with a new vendor onboarded. Reported by the on-call engineer. | Is this scenario one where: this matches an authorized activity? | security_alerts | technical | yuri_v3 |
| v3_bff407d73d3d75e9_c | choice | ["producer_change","schema_drift","infrastructure","expected_variation"] | [0.17,0.5,0.2,0.13] | A sensor telemetry stream arrived 3 hours late; additionally exhibits schema drift in 2 columns. Context: in the sandbox only, at the end of the fiscal period. Reported by the on-call engineer. | Root cause for this scenario. | data_quality | technical | yuri_v3 |
| v3_0a72b00504cbda72_c | choice | ["treat","retest","image","refer_specialist"] | [0.01,0.32,0.02,0.65] | An imaging report reveals proteinuria on two repeat samples; additionally has a negative D-dimer with low Wells score. Context: in a 30-year-old athlete, mid-incident. Reported by the automated check. | Next step for this scenario. | diagnostic_reasoning | medical | yuri_v3 |
| reasoning-control-v1:76109:755:verification | noul | ["false","true"] | [1,0] | {"aliases": {}, "policy": "Normalize entity aliases transitively. Ignore other entities/properties, non-authoritative and retracted records. Consider only the highest remaining revision. If their values disagree return conflict; if none remain return not_stated.", "query_entity":… | Task: Resolve the requested current status by the supplied evidence policy. Proposed answer: No eligible status record remains Is this proposed answer correct under the supplied rules? | reasoning-control-v1 | openjev | openjev_v2 |
| v3_24cefe900ae6b481_c | choice | ["history","exam","plan","consent"] | [0.1,0.3,0.51,0.09] | A progress note documents time-zero and all interventions; additionally codes chest pain but describes an MI workup. Context: in the audit sample, during the holiday freeze. Reported by the automated check. | Missing element for this scenario. | clinical_documentation | medical | yuri_v3 |
| v3_1a93c32f47df3d21_s | score | ["0","1","2","3","4","5"] | [0,0.65,0.19,0.12,0.03,0.01] | A scanned w-2 matches the schema exactly; additionally is missing the middle initial only. Context: under the strict-validation profile, during a scheduled maintenance window. Reported by the review queue. | Rate document quality for this scenario on a 0-5 scale. | form_extraction | structured | yuri_v3 |
| painting-geometry-v1:f53d053754fd363524f68104:silhouette:x6_y1 | noul | ["false","true"] | [1,0] | {"image_description": "Background is cyan. One solid magenta foreground rectangle includes exactly 3 <= x <= 5 and 0 <= y <= 7. All remaining pixels are background.", "width": 8, "height": 8, "coordinates": "Integer pixel coordinates. Origin (0,0) is top left; x increases right, … | Is pixel x=6, y=1 part of a foreground object? | painting-geometry-v1 | openjev | openjev_v2 |
| v3_29f5bde2c02b659d_s | score | ["0","1","2","3","4","5"] | [0,0,0.01,0.13,0.67,0.19] | An esterification uses a 10x excess of the nucleophile; additionally mixes a strong acid with a carbonate base. Context: in the teaching lab, at the end of the fiscal period. Reported by the on-call engineer. | Rate process hazard for this scenario on a 0-5 scale. | reaction_prediction | chemistry | yuri_v3 |
| v3_9f0ab5005e531c4a_s | score | ["0","1","2","3","4","5"] | [0.07,0.02,0.06,0.4,0.43,0.02] | A proposed workflow sequences approvals before the technical check; additionally assumes an API quota that expired last month. Context: under a read-only budget, during peak load. Reported by the review queue. | Rate completion likelihood for this scenario on a 0-5 scale. | plan_quality | agent | yuri_v3 |
| ours_f11583d08fec9ce4 | noul | ["false","true"] | [0.5,0.5] | The Last Coiner The Last Coiner is a graphic novel, written by RTS Award winning filmmaker Peter M. Kershaw, with comicbook artist Vince Danks whose credits include the "Torchwood" Official Magazine, the independently published "Harker and Critchley" from Ariel Press, and Fleetwa… | Is this memory relevant for answering the query? Query: Which comic by Richard Elson was published by Fleetway Editions? | memory_relevance | knowledge | yuri_v1 |
| v3_092a40faa63b348b_c | choice | ["winning","equal","losing","unclear"] | [0.07,0.03,0.7,0.2] | A connect-four column leaves the king exposed on an open file; additionally secures the center pawn majority. Context: in the opening phase, under reduced staffing. Reported by the monitoring system. | Position verdict for this scenario. | game_state_eval | structured | yuri_v3 |
| v3_cbad855ba04b769a_s | score | ["0","1","2","3","4","5"] | [0,0,0,0.01,0.75,0.24] | The batch job requires exclusive database access; additionally has run over its window 3 weeks straight. Context: during peak traffic, under reduced staffing. Reported by the review queue. | Rate schedule conflict risk for this scenario on a 0-5 scale. | scheduling | agent | yuri_v3 |
| v3_1ba4228d94a33f34_s | score | ["0","1","2","3","4","5"] | [0,0,0,0.06,0.86,0.08] | A new prescription mixes two serotonergic agents; additionally continues a medication during documented pregnancy. Context: in a patient on 9 medications, during an external partner integration. Reported by the monitoring system. | Rate interaction severity for this scenario on a 0-5 scale. | medication_safety | medical | yuri_v3 |
| v3_66e48669d3442e31_s | score | ["0","1","2","3","4","5"] | [0,0,0,0.09,0.84,0.07] | A policy exception request contains an unlimited indemnity clause; additionally lacks a data-breach notification window. Context: under the new procurement policy, as part of a compliance sweep. Reported by the supervisor. | Rate regulatory exposure for this scenario on a 0-5 scale. | legal_compliance | business | yuri_v3 |
| v3_fb97198a8e08ce14_s | score | ["0","1","2","3","4","5"] | [0,0.01,0.26,0.56,0.17,0] | The release candidate passed the full canary matrix; additionally adds a new dependency with no pinned hash. Context: ahead of the audit, during the system migration. Reported by the automated check. | Rate regression risk for this scenario on a 0-5 scale. | software_delivery | technical | yuri_v3 |
| v3_79aea47dee5c563a_n | noul | ["false","true"] | [0.83,0.17] | A symptom cluster shows mildly elevated LFTs after a new statin; additionally has a negative D-dimer with low Wells score. Context: after 3 months of symptoms, at the end of the fiscal period. Reported by the supervisor. | Is this scenario one where: an urgent referral is needed? | diagnostic_reasoning | medical | yuri_v3 |
| ours_3933c59d1c745f7d | noul | ["false","true"] | [0.5,0.5] | To determine whether confocal scanning laser ophthalmoscopic imaging (Heidelberg retinal tomography [HRT]) can predict visual field change in glaucoma. The study included 561 patients with glaucoma or ocular hypertension whose clinical course was followed at the Mount Sinai Facul… | Is this memory relevant for answering the query? Query: Does visual restitution training change absolute homonymous visual field defects? | memory_relevance | knowledge | yuri_v1 |
| v3_77729173022d3789_s | score | ["0","1","2","3","4","5"] | [0.01,0.01,0.05,0.5,0.42,0.01] | A claim in the report quotes a paywalled source verbatim; additionally attributes to a study that says the opposite. Context: in the executive summary, during the morning shift. Reported by the monitoring system. | Rate source quality for this scenario on a 0-5 scale. | fact_checking | knowledge | yuri_v3 |
| v3_28392deab2b429a4_n | noul | ["false","true"] | [0.84,0.16] | The metrics pipeline shows disk at 91% and climbing 1%/hour; additionally reports empty scrape targets after the network change. Context: in production only, with a new vendor onboarded. Reported by the on-call engineer. | Is this scenario one where: the dashboard itself is broken? | observability | technical | yuri_v3 |
| reasoning-control-v1:76109:1785:verification | noul | ["false","true"] | [1,0] | {"assignments": {"p_b7fdcb_0": true, "p_b7fdcb_1": false, "p_b7fdcb_2": false, "p_b7fdcb_3": false}, "expression": "(NOT (p_b7fdcb_3) OR NOT (p_b7fdcb_2))", "record_id": "b7fdcbe9e2bc5f1b", "semantics": "AND/OR/NOT have Boolean meanings. XOR is true exactly when operands differ. … | Task: Evaluate the Boolean expression using exactly the supplied assignment. Proposed answer: The expression evaluates to false Is this proposed answer correct under the supplied rules? | reasoning-control-v1 | openjev | openjev_v2 |
| v3_cb33b00613a47cb9_s | score | ["0","1","2","3","4","5"] | [0,0.02,0.16,0.43,0.37,0.02] | A climate model ensemble shows grid independence across 3 refinements; additionally has a Courant number of 3.2. Context: against the wind-tunnel data, with staffing at reduced levels. Reported by the on-call engineer. | Rate numerical error risk for this scenario on a 0-5 scale. | simulation_modeling | physics | yuri_v3 |
| ours_296c24c6e9c33bc3 | noul | ["false","true"] | [0.5,0.5] | , PatrickPatrick Ewing, Jr. New Orleans Hornets [278] Dowdell, ZabianZabian Dowdell Phoenix Suns [134] Butler, Da'SeanDa'Sean Butler San Antonio Spurs [279] Davis, BaronBaron Davis* Template:Dts/out2 Cleveland Cavaliers [280] Smith, IshIsh Smith Memphis Grizzlies [281] Rautins, A… | Is this memory relevant for answering the query? Query: What team did Waiters play for? | memory_relevance | knowledge | yuri_v1 |
| v3_cb0d5c2fe8adaf59_c | choice | ["external_attacker","insider","malware","misconfiguration"] | [0.16,0.75,0.03,0.06] | A siem correlation rule observed a 2.1 GB egress to a raw-IP host; additionally fired during the sanctioned pen-test window. Context: in the finance VLAN, immediately after go-live. Reported by the supervisor. | Actor type for this scenario. | security_alerts | technical | yuri_v3 |
| v3_314305fe68381d6b_n | noul | ["false","true"] | [0.05,0.95] | A statistic in the draft conflates correlation with causation; additionally cites a retracted paper. Context: in the appendix, during the quarterly review. Reported by the supervisor. | Is this scenario one where: this needs a correction? | fact_checking | knowledge | yuri_v3 |
| v3_63e63e5a5b28517a_n | noul | ["false","true"] | [0.72,0.28] | A hospital visit shares a job loss and asks for prayer; additionally describes marital conflict escalating to threats. Context: as the senior pastor, under reduced staffing. Reported by the on-call engineer. | Is this scenario one where: this is within lay pastoral scope? | pastoral_care | theology | yuri_v3 |
| v3_f338c50c2ff62367_n | noul | ["false","true"] | [0.97,0.03] | The variant-calling run has a contamination estimate of 8%; additionally failed the sex-check concordance. Context: under the CAP checklist, immediately after go-live. Reported by the automated check. | Is this scenario one where: the run meets release criteria? | bioinformatics_ops | genomics | yuri_v3 |
| v3_804e2907a41a5678_s | score | ["0","1","2","3","4","5"] | [0.01,0.03,0.1,0.61,0.23,0.02] | An evacuation path is the shortest path by 6 minutes; additionally passes an active school zone at dismissal. Context: under a 90-minute deadline, during a scheduled maintenance window. Reported by the monitoring system. | Rate route difficulty for this scenario on a 0-5 scale. | navigation_routing | spatial | yuri_v3 |
| v3_d02db68c11e6a97b_c | choice | ["critical","high","normal","low"] | [0.02,0.2,0.45,0.33] | The batch job depends on a task that runs at 03:00; additionally fits entirely inside the quiet period. Context: this Friday, while on-call rotation changed. Reported by the supervisor. | Priority for this scenario. | scheduling | agent | yuri_v3 |
| tic_tac_toe-v1:..XX.X.OO:XXO..O.X. | choice | ["3","4","6","8"] | [0,0.5,0,0.5] | {"board": ["XXO", "..O", ".X."], "current_player": "O", "game": "tic_tac_toe", "rules": "X starts; alternate placing a mark; three in a row wins. Squares 0..8 are row-major; . is empty."} | Choose a legal square to maximize the current player's result against optimal opposition: win, then draw, then loss. | tic_tac_toe-v1 | openjev | openjev_v2 |
| v3_ec26105e57496927_n | noul | ["false","true"] | [0.97,0.03] | A qc gate shows 14 samples below the 20x depth threshold; additionally failed the sex-check concordance. Context: under the CAP checklist, immediately after go-live. Reported by the automated check. | Is this scenario one where: the run meets release criteria? | bioinformatics_ops | genomics | yuri_v3 |
| ours_049938f9a56a95ee | noul | ["false","true"] | [0.5,0.5] | Scott Roper (Eddie Murphy) is the best hostage negotiator in San Francisco. His girlfriend Veronica "Ronnie" Tate (Carmen Ejogo) is a newspaper reporter. While listening to a horse race on his car stereo, Scott is called downtown where a man named Earl (Donal Logue) is holding 17… | Is this memory relevant for answering the query? Query: Why is Scott summoned to Montreal? | memory_relevance | knowledge | yuri_v1 |
| snake-v1:3af7ea702e9ca2f477f8aee6:collision_right | noul | ["false","true"] | [1,0] | {"coordinates": "x increases right; y increases down; walls are outside the board", "direction": "down", "food": [0, 5], "game": "snake", "height": 6, "snake_head_first": [[4, 3], [4, 2], [4, 1], [4, 0], [3, 0], [3, 1], [3, 2], [2, 2], [2, 1], [2, 0], [1, 0], [0, 0], [0, 1], [1, … | Will moving right cause an immediate wall or body collision? The tail vacates unless food is eaten. | snake-v1 | openjev | openjev_v2 |
| v3_b0c09074f5a3aef2_c | choice | ["drift","noise","offset","intermittent"] | [0.94,0,0.01,0.05] | An optical interferometer matches the NIST-traceable standard; additionally drifts 0.3C over the calibration window. Context: during the shock test, shortly after a software update. Reported by the monitoring system. | Fault class for this scenario. | instrumentation | physics | yuri_v3 |
