First 44 rows of calibration
| idstring | group_idstring | splitstring | sourcestring | kindstring | questionstring | optionsList | targetList | state_jsonstring | metadata_jsonstring | record_jsonstring | original_line_numberint64 |
|---|---|---|---|---|---|---|---|---|---|---|---|
| customer-control-v1:42:14:category | customer-control-v1:42:14 | calibration | customer-control-v1 |
| choice |
| Determine the broad category of this support ticket. For this controlled task, select the customer's expressly prioritized request. If two requests explicitly have equal priority, allocate equal support to their two categories. A malfunction of an existing feature is bug_report; … |
| ["feature_request: The user is requesting new functionality","account: Login, permissions, profile, security","billing: Charges, invoices, refunds, subscriptions","bug_report: The user is reporting something that is broken or producing errors"] |
| [0,0,0,1] |
| "Conversation with account holder Harbor-57dd0fc7e7.\nCustomer message: Exporting a report fails. I haven't tested the desktop route and don't know whether an alternative works. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: I o… |
| {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "bug_severity", "categories": ["bug_report"], "churn": 1, "frustration": 2, "refund": false, "repro": true, "severity": 2}, "entity_ids": ["Harbor-57dd0fc7e7"], "family": "routing", "language": "en"… |
| {"group_id": "customer-control-v1:42:14", "id": "customer-control-v1:42:14:category", "kind": "choice", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "bug_severity", "categories": ["bug_report"], "churn": 1, "frustration": 2, "refun… |
| 1 |
| customer-control-v1:42:14:bug_severity | customer-control-v1:42:14 | calibration | customer-control-v1 | score | How severe is the reported issue? Use the stated functional impact and the existence of a workaround. Use no functional impact when no malfunction is described. In this synthetic control, if a broken feature is described but the availability of a workaround is explicitly unknown,… | ["Cosmetic; no impact to functionality","Broken or degraded feature; workaround exists","Blocking issue; no workaround exists"] | [0,0.5,0.5] | "Conversation with account holder Harbor-57dd0fc7e7.\nCustomer message: Exporting a report fails. I haven't tested the desktop route and don't know whether an alternative works. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: I o… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "bug_severity", "categories": ["bug_report"], "churn": 1, "frustration": 2, "refund": false, "repro": true, "severity": 2}, "entity_ids": ["Harbor-57dd0fc7e7"], "family": "rubric", "language": "en",… | {"group_id": "customer-control-v1:42:14", "id": "customer-control-v1:42:14:bug_severity", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "bug_severity", "categories": ["bug_report"], "churn": 1, "frustration": 2, "re… | 2 |
| customer-control-v1:42:14:has_reproducible_steps | customer-control-v1:42:14 | calibration | customer-control-v1 | noul | The user describes specific steps to reproduce the issue. For this controlled task, require at least two ordered user actions and the observed result. A vague report, a resolved historical issue, or an instruction to support staff is insufficient. | ["no","yes"] | [0,1] | "Conversation with account holder Harbor-57dd0fc7e7.\nCustomer message: Exporting a report fails. I haven't tested the desktop route and don't know whether an alternative works. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: I o… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "bug_severity", "categories": ["bug_report"], "churn": 1, "frustration": 2, "refund": false, "repro": true, "severity": 2}, "entity_ids": ["Harbor-57dd0fc7e7"], "family": "evidence", "language": "en… | {"group_id": "customer-control-v1:42:14", "id": "customer-control-v1:42:14:has_reproducible_steps", "kind": "noul", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "bug_severity", "categories": ["bug_report"], "churn": 1, "frustration… | 3 |
| customer-control-v1:42:14:refund_requested | customer-control-v1:42:14 | calibration | customer-control-v1 | noul | The user is explicitly asking for a refund or credit for the current issue. A question about charges, an explicit denial of wanting money back, or a mention of an already completed refund is not a current request. | ["no","yes"] | [1,0] | "Conversation with account holder Harbor-57dd0fc7e7.\nCustomer message: Exporting a report fails. I haven't tested the desktop route and don't know whether an alternative works. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: I o… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "bug_severity", "categories": ["bug_report"], "churn": 1, "frustration": 2, "refund": false, "repro": true, "severity": 2}, "entity_ids": ["Harbor-57dd0fc7e7"], "family": "evidence", "language": "en… | {"group_id": "customer-control-v1:42:14", "id": "customer-control-v1:42:14:refund_requested", "kind": "noul", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "bug_severity", "categories": ["bug_report"], "churn": 1, "frustration": 2, … | 4 |
| customer-control-v1:42:14:frustration | customer-control-v1:42:14 | calibration | customer-control-v1 | score | How frustrated the user appears. Use the current expressed tone. For a reaction that carries no clear emotional valence, the controlled generator has two equally likely latent readings: calm or frustrated but civil. Do not infer very angry without an explicit anger signal. | ["Calm, matter-of-fact","Frustrated but civil","Very angry"] | [0,0,1] | "Conversation with account holder Harbor-57dd0fc7e7.\nCustomer message: Exporting a report fails. I haven't tested the desktop route and don't know whether an alternative works. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: I o… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "bug_severity", "categories": ["bug_report"], "churn": 1, "frustration": 2, "refund": false, "repro": true, "severity": 2}, "entity_ids": ["Harbor-57dd0fc7e7"], "family": "rubric", "language": "en",… | {"group_id": "customer-control-v1:42:14", "id": "customer-control-v1:42:14:frustration", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "bug_severity", "categories": ["bug_report"], "churn": 1, "frustration": 2, "ref… | 5 |
| customer-control-v1:42:14:churn_likelihood_level | customer-control-v1:42:14 | calibration | customer-control-v1 | score | Churn likelihood level. This is a local ordinal intention rubric, not an empirically calibrated prediction of future churn. Evaluate the customer's stated continuation intent. If intent was explicitly withheld or not discussed, the synthetic generator has three equally likely lat… | ["The customer explicitly intends to keep using the service and continue their subscription.","The customer is undecided about continuing, or makes departure conditional on whether the issue is resolved.","The customer explicitly requests cancellation or states a definite decisio… | [0,1,0] | "Conversation with account holder Harbor-57dd0fc7e7.\nCustomer message: Exporting a report fails. I haven't tested the desktop route and don't know whether an alternative works. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: I o… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "bug_severity", "categories": ["bug_report"], "churn": 1, "frustration": 2, "refund": false, "repro": true, "severity": 2}, "entity_ids": ["Harbor-57dd0fc7e7"], "family": "rubric", "language": "en",… | {"group_id": "customer-control-v1:42:14", "id": "customer-control-v1:42:14:churn_likelihood_level", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "bug_severity", "categories": ["bug_report"], "churn": 1, "frustratio… | 6 |
| customer-control-v1:42:33:category | customer-control-v1:42:33 | calibration | customer-control-v1 | choice | Determine the broad category of this support ticket. For this controlled task, select the customer's expressly prioritized request. If two requests explicitly have equal priority, allocate equal support to their two categories. A malfunction of an existing feature is bug_report; … | ["account: Login, permissions, profile, security","feature_request: The user is requesting new functionality","billing: Charges, invoices, refunds, subscriptions","bug_report: The user is reporting something that is broken or producing errors"] | [0,0,0,1] | "Customer Harbor-7a1a726a25: Exporting a report fails, but I can download the CSV and finish in the desktop app. That is the request I want you to handle first.\nAgent: Could you add the details?\nCustomer: It happens sometimes, but I cannot recall the sequence that led to it. Th… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "churn_likelihood_level", "categories": ["bug_report"], "churn": 0, "frustration": 1, "refund": false, "repro": false, "severity": 1}, "entity_ids": ["Harbor-7a1a726a25"], "family": "routing", "lang… | {"group_id": "customer-control-v1:42:33", "id": "customer-control-v1:42:33:category", "kind": "choice", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "churn_likelihood_level", "categories": ["bug_report"], "churn": 0, "frustration":… | 7 |
| customer-control-v1:42:33:bug_severity | customer-control-v1:42:33 | calibration | customer-control-v1 | score | How severe is the reported issue? Use the stated functional impact and the existence of a workaround. Use no functional impact when no malfunction is described. In this synthetic control, if a broken feature is described but the availability of a workaround is explicitly unknown,… | ["Cosmetic; no impact to functionality","Broken or degraded feature; workaround exists","Blocking issue; no workaround exists"] | [0,1,0] | "Customer Harbor-7a1a726a25: Exporting a report fails, but I can download the CSV and finish in the desktop app. That is the request I want you to handle first.\nAgent: Could you add the details?\nCustomer: It happens sometimes, but I cannot recall the sequence that led to it. Th… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "churn_likelihood_level", "categories": ["bug_report"], "churn": 0, "frustration": 1, "refund": false, "repro": false, "severity": 1}, "entity_ids": ["Harbor-7a1a726a25"], "family": "rubric", "langu… | {"group_id": "customer-control-v1:42:33", "id": "customer-control-v1:42:33:bug_severity", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "churn_likelihood_level", "categories": ["bug_report"], "churn": 0, "frustratio… | 8 |
| customer-control-v1:42:33:has_reproducible_steps | customer-control-v1:42:33 | calibration | customer-control-v1 | noul | The user describes specific steps to reproduce the issue. For this controlled task, require at least two ordered user actions and the observed result. A vague report, a resolved historical issue, or an instruction to support staff is insufficient. | ["no","yes"] | [1,0] | "Customer Harbor-7a1a726a25: Exporting a report fails, but I can download the CSV and finish in the desktop app. That is the request I want you to handle first.\nAgent: Could you add the details?\nCustomer: It happens sometimes, but I cannot recall the sequence that led to it. Th… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "churn_likelihood_level", "categories": ["bug_report"], "churn": 0, "frustration": 1, "refund": false, "repro": false, "severity": 1}, "entity_ids": ["Harbor-7a1a726a25"], "family": "evidence", "lan… | {"group_id": "customer-control-v1:42:33", "id": "customer-control-v1:42:33:has_reproducible_steps", "kind": "noul", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "churn_likelihood_level", "categories": ["bug_report"], "churn": 0, "f… | 9 |
| customer-control-v1:42:33:refund_requested | customer-control-v1:42:33 | calibration | customer-control-v1 | noul | The user is explicitly asking for a refund or credit for the current issue. A question about charges, an explicit denial of wanting money back, or a mention of an already completed refund is not a current request. | ["no","yes"] | [1,0] | "Customer Harbor-7a1a726a25: Exporting a report fails, but I can download the CSV and finish in the desktop app. That is the request I want you to handle first.\nAgent: Could you add the details?\nCustomer: It happens sometimes, but I cannot recall the sequence that led to it. Th… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "churn_likelihood_level", "categories": ["bug_report"], "churn": 0, "frustration": 1, "refund": false, "repro": false, "severity": 1}, "entity_ids": ["Harbor-7a1a726a25"], "family": "evidence", "lan… | {"group_id": "customer-control-v1:42:33", "id": "customer-control-v1:42:33:refund_requested", "kind": "noul", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "churn_likelihood_level", "categories": ["bug_report"], "churn": 0, "frustra… | 10 |
| customer-control-v1:42:33:frustration | customer-control-v1:42:33 | calibration | customer-control-v1 | score | How frustrated the user appears. Use the current expressed tone. For a reaction that carries no clear emotional valence, the controlled generator has two equally likely latent readings: calm or frustrated but civil. Do not infer very angry without an explicit anger signal. | ["Calm, matter-of-fact","Frustrated but civil","Very angry"] | [0,1,0] | "Customer Harbor-7a1a726a25: Exporting a report fails, but I can download the CSV and finish in the desktop app. That is the request I want you to handle first.\nAgent: Could you add the details?\nCustomer: It happens sometimes, but I cannot recall the sequence that led to it. Th… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "churn_likelihood_level", "categories": ["bug_report"], "churn": 0, "frustration": 1, "refund": false, "repro": false, "severity": 1}, "entity_ids": ["Harbor-7a1a726a25"], "family": "rubric", "langu… | {"group_id": "customer-control-v1:42:33", "id": "customer-control-v1:42:33:frustration", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "churn_likelihood_level", "categories": ["bug_report"], "churn": 0, "frustration… | 11 |
| customer-control-v1:42:33:churn_likelihood_level | customer-control-v1:42:33 | calibration | customer-control-v1 | score | Churn likelihood level. This is a local ordinal intention rubric, not an empirically calibrated prediction of future churn. Evaluate the customer's stated continuation intent. If intent was explicitly withheld or not discussed, the synthetic generator has three equally likely lat… | ["The customer explicitly intends to keep using the service and continue their subscription.","The customer is undecided about continuing, or makes departure conditional on whether the issue is resolved.","The customer explicitly requests cancellation or states a definite decisio… | [0.3333333333333333,0.3333333333333333,0.3333333333333333] | "Customer Harbor-7a1a726a25: Exporting a report fails, but I can download the CSV and finish in the desktop app. That is the request I want you to handle first.\nAgent: Could you add the details?\nCustomer: It happens sometimes, but I cannot recall the sequence that led to it. Th… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "churn_likelihood_level", "categories": ["bug_report"], "churn": 0, "frustration": 1, "refund": false, "repro": false, "severity": 1}, "entity_ids": ["Harbor-7a1a726a25"], "family": "rubric", "langu… | {"group_id": "customer-control-v1:42:33", "id": "customer-control-v1:42:33:churn_likelihood_level", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "churn_likelihood_level", "categories": ["bug_report"], "churn": 0, "… | 12 |
| customer-control-v1:42:71:category | customer-control-v1:42:71 | calibration | customer-control-v1 | choice | Determine the broad category of this support ticket. For this controlled task, select the customer's expressly prioritized request. If two requests explicitly have equal priority, allocate equal support to their two categories. A malfunction of an existing feature is bug_report; … | ["bug_report: The user is reporting something that is broken or producing errors","account: Login, permissions, profile, security","billing: Charges, invoices, refunds, subscriptions","feature_request: The user is requesting new functionality"] | [1,0,0,0] | "Customer Harbor-ec7e2b7bc5: Exporting a report fails. I haven't tested the desktop route and don't know whether an alternative works. That is the request I want you to handle first.\nAgent: Could you add the details?\nCustomer: I open a saved report, then click Export; the downl… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "bug_severity", "categories": ["bug_report"], "churn": 2, "frustration": 0, "refund": false, "repro": true, "severity": 1}, "entity_ids": ["Harbor-ec7e2b7bc5"], "family": "routing", "language": "en"… | {"group_id": "customer-control-v1:42:71", "id": "customer-control-v1:42:71:category", "kind": "choice", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "bug_severity", "categories": ["bug_report"], "churn": 2, "frustration": 0, "refun… | 13 |
| customer-control-v1:42:71:bug_severity | customer-control-v1:42:71 | calibration | customer-control-v1 | score | How severe is the reported issue? Use the stated functional impact and the existence of a workaround. Use no functional impact when no malfunction is described. In this synthetic control, if a broken feature is described but the availability of a workaround is explicitly unknown,… | ["Cosmetic; no impact to functionality","Broken or degraded feature; workaround exists","Blocking issue; no workaround exists"] | [0,0.5,0.5] | "Customer Harbor-ec7e2b7bc5: Exporting a report fails. I haven't tested the desktop route and don't know whether an alternative works. That is the request I want you to handle first.\nAgent: Could you add the details?\nCustomer: I open a saved report, then click Export; the downl… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "bug_severity", "categories": ["bug_report"], "churn": 2, "frustration": 0, "refund": false, "repro": true, "severity": 1}, "entity_ids": ["Harbor-ec7e2b7bc5"], "family": "rubric", "language": "en",… | {"group_id": "customer-control-v1:42:71", "id": "customer-control-v1:42:71:bug_severity", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "bug_severity", "categories": ["bug_report"], "churn": 2, "frustration": 0, "re… | 14 |
| customer-control-v1:42:71:has_reproducible_steps | customer-control-v1:42:71 | calibration | customer-control-v1 | noul | The user describes specific steps to reproduce the issue. For this controlled task, require at least two ordered user actions and the observed result. A vague report, a resolved historical issue, or an instruction to support staff is insufficient. | ["no","yes"] | [0,1] | "Customer Harbor-ec7e2b7bc5: Exporting a report fails. I haven't tested the desktop route and don't know whether an alternative works. That is the request I want you to handle first.\nAgent: Could you add the details?\nCustomer: I open a saved report, then click Export; the downl… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "bug_severity", "categories": ["bug_report"], "churn": 2, "frustration": 0, "refund": false, "repro": true, "severity": 1}, "entity_ids": ["Harbor-ec7e2b7bc5"], "family": "evidence", "language": "en… | {"group_id": "customer-control-v1:42:71", "id": "customer-control-v1:42:71:has_reproducible_steps", "kind": "noul", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "bug_severity", "categories": ["bug_report"], "churn": 2, "frustration… | 15 |
| customer-control-v1:42:71:refund_requested | customer-control-v1:42:71 | calibration | customer-control-v1 | noul | The user is explicitly asking for a refund or credit for the current issue. A question about charges, an explicit denial of wanting money back, or a mention of an already completed refund is not a current request. | ["no","yes"] | [1,0] | "Customer Harbor-ec7e2b7bc5: Exporting a report fails. I haven't tested the desktop route and don't know whether an alternative works. That is the request I want you to handle first.\nAgent: Could you add the details?\nCustomer: I open a saved report, then click Export; the downl… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "bug_severity", "categories": ["bug_report"], "churn": 2, "frustration": 0, "refund": false, "repro": true, "severity": 1}, "entity_ids": ["Harbor-ec7e2b7bc5"], "family": "evidence", "language": "en… | {"group_id": "customer-control-v1:42:71", "id": "customer-control-v1:42:71:refund_requested", "kind": "noul", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "bug_severity", "categories": ["bug_report"], "churn": 2, "frustration": 0, … | 16 |
| customer-control-v1:42:71:frustration | customer-control-v1:42:71 | calibration | customer-control-v1 | score | How frustrated the user appears. Use the current expressed tone. For a reaction that carries no clear emotional valence, the controlled generator has two equally likely latent readings: calm or frustrated but civil. Do not infer very angry without an explicit anger signal. | ["Calm, matter-of-fact","Frustrated but civil","Very angry"] | [1,0,0] | "Customer Harbor-ec7e2b7bc5: Exporting a report fails. I haven't tested the desktop route and don't know whether an alternative works. That is the request I want you to handle first.\nAgent: Could you add the details?\nCustomer: I open a saved report, then click Export; the downl… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "bug_severity", "categories": ["bug_report"], "churn": 2, "frustration": 0, "refund": false, "repro": true, "severity": 1}, "entity_ids": ["Harbor-ec7e2b7bc5"], "family": "rubric", "language": "en",… | {"group_id": "customer-control-v1:42:71", "id": "customer-control-v1:42:71:frustration", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "bug_severity", "categories": ["bug_report"], "churn": 2, "frustration": 0, "ref… | 17 |
| customer-control-v1:42:71:churn_likelihood_level | customer-control-v1:42:71 | calibration | customer-control-v1 | score | Churn likelihood level. This is a local ordinal intention rubric, not an empirically calibrated prediction of future churn. Evaluate the customer's stated continuation intent. If intent was explicitly withheld or not discussed, the synthetic generator has three equally likely lat… | ["The customer explicitly intends to keep using the service and continue their subscription.","The customer is undecided about continuing, or makes departure conditional on whether the issue is resolved.","The customer explicitly requests cancellation or states a definite decisio… | [0,0,1] | "Customer Harbor-ec7e2b7bc5: Exporting a report fails. I haven't tested the desktop route and don't know whether an alternative works. That is the request I want you to handle first.\nAgent: Could you add the details?\nCustomer: I open a saved report, then click Export; the downl… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "bug_severity", "categories": ["bug_report"], "churn": 2, "frustration": 0, "refund": false, "repro": true, "severity": 1}, "entity_ids": ["Harbor-ec7e2b7bc5"], "family": "rubric", "language": "en",… | {"group_id": "customer-control-v1:42:71", "id": "customer-control-v1:42:71:churn_likelihood_level", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "bug_severity", "categories": ["bug_report"], "churn": 2, "frustratio… | 18 |
| customer-control-v1:42:119:category | customer-control-v1:42:119 | calibration | customer-control-v1 | choice | Determine the broad category of this support ticket. For this controlled task, select the customer's expressly prioritized request. If two requests explicitly have equal priority, allocate equal support to their two categories. A malfunction of an existing feature is bug_report; … | ["bug_report: The user is reporting something that is broken or producing errors","billing: Charges, invoices, refunds, subscriptions","feature_request: The user is requesting new functionality","account: Login, permissions, profile, security"] | [0,0,0,1] | "Conversation with account holder Harbor-f48a9abe8b.\nCustomer message: I need access restored after changing the email address used to sign in. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: Thanks for checking. I am simply rep… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 2, "frustration": 0, "refund": false, "repro": false, "severity": 0}, "entity_ids": ["Harbor-f48a9abe8b"], "family": "routing", "language": "en", "provena… | {"group_id": "customer-control-v1:42:119", "id": "customer-control-v1:42:119:category", "kind": "choice", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 2, "frustration": 0, "refund": false… | 19 |
| customer-control-v1:42:119:bug_severity | customer-control-v1:42:119 | calibration | customer-control-v1 | score | How severe is the reported issue? Use the stated functional impact and the existence of a workaround. Use no functional impact when no malfunction is described. In this synthetic control, if a broken feature is described but the availability of a workaround is explicitly unknown,… | ["Cosmetic; no impact to functionality","Broken or degraded feature; workaround exists","Blocking issue; no workaround exists"] | [1,0,0] | "Conversation with account holder Harbor-f48a9abe8b.\nCustomer message: I need access restored after changing the email address used to sign in. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: Thanks for checking. I am simply rep… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 2, "frustration": 0, "refund": false, "repro": false, "severity": 0}, "entity_ids": ["Harbor-f48a9abe8b"], "family": "rubric", "language": "en", "provenan… | {"group_id": "customer-control-v1:42:119", "id": "customer-control-v1:42:119:bug_severity", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 2, "frustration": 0, "refund": fa… | 20 |
| customer-control-v1:42:119:has_reproducible_steps | customer-control-v1:42:119 | calibration | customer-control-v1 | noul | The user describes specific steps to reproduce the issue. For this controlled task, require at least two ordered user actions and the observed result. A vague report, a resolved historical issue, or an instruction to support staff is insufficient. | ["no","yes"] | [1,0] | "Conversation with account holder Harbor-f48a9abe8b.\nCustomer message: I need access restored after changing the email address used to sign in. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: Thanks for checking. I am simply rep… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 2, "frustration": 0, "refund": false, "repro": false, "severity": 0}, "entity_ids": ["Harbor-f48a9abe8b"], "family": "evidence", "language": "en", "proven… | {"group_id": "customer-control-v1:42:119", "id": "customer-control-v1:42:119:has_reproducible_steps", "kind": "noul", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 2, "frustration": 0, "re… | 21 |
| customer-control-v1:42:119:refund_requested | customer-control-v1:42:119 | calibration | customer-control-v1 | noul | The user is explicitly asking for a refund or credit for the current issue. A question about charges, an explicit denial of wanting money back, or a mention of an already completed refund is not a current request. | ["no","yes"] | [1,0] | "Conversation with account holder Harbor-f48a9abe8b.\nCustomer message: I need access restored after changing the email address used to sign in. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: Thanks for checking. I am simply rep… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 2, "frustration": 0, "refund": false, "repro": false, "severity": 0}, "entity_ids": ["Harbor-f48a9abe8b"], "family": "evidence", "language": "en", "proven… | {"group_id": "customer-control-v1:42:119", "id": "customer-control-v1:42:119:refund_requested", "kind": "noul", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 2, "frustration": 0, "refund":… | 22 |
| customer-control-v1:42:119:frustration | customer-control-v1:42:119 | calibration | customer-control-v1 | score | How frustrated the user appears. Use the current expressed tone. For a reaction that carries no clear emotional valence, the controlled generator has two equally likely latent readings: calm or frustrated but civil. Do not infer very angry without an explicit anger signal. | ["Calm, matter-of-fact","Frustrated but civil","Very angry"] | [1,0,0] | "Conversation with account holder Harbor-f48a9abe8b.\nCustomer message: I need access restored after changing the email address used to sign in. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: Thanks for checking. I am simply rep… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 2, "frustration": 0, "refund": false, "repro": false, "severity": 0}, "entity_ids": ["Harbor-f48a9abe8b"], "family": "rubric", "language": "en", "provenan… | {"group_id": "customer-control-v1:42:119", "id": "customer-control-v1:42:119:frustration", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 2, "frustration": 0, "refund": fal… | 23 |
| customer-control-v1:42:119:churn_likelihood_level | customer-control-v1:42:119 | calibration | customer-control-v1 | score | Churn likelihood level. This is a local ordinal intention rubric, not an empirically calibrated prediction of future churn. Evaluate the customer's stated continuation intent. If intent was explicitly withheld or not discussed, the synthetic generator has three equally likely lat… | ["The customer explicitly intends to keep using the service and continue their subscription.","The customer is undecided about continuing, or makes departure conditional on whether the issue is resolved.","The customer explicitly requests cancellation or states a definite decisio… | [0,0,1] | "Conversation with account holder Harbor-f48a9abe8b.\nCustomer message: I need access restored after changing the email address used to sign in. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: Thanks for checking. I am simply rep… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 2, "frustration": 0, "refund": false, "repro": false, "severity": 0}, "entity_ids": ["Harbor-f48a9abe8b"], "family": "rubric", "language": "en", "provenan… | {"group_id": "customer-control-v1:42:119", "id": "customer-control-v1:42:119:churn_likelihood_level", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 2, "frustration": 0, "r… | 24 |
| customer-control-v1:42:122:category | customer-control-v1:42:122 | calibration | customer-control-v1 | choice | Determine the broad category of this support ticket. For this controlled task, select the customer's expressly prioritized request. If two requests explicitly have equal priority, allocate equal support to their two categories. A malfunction of an existing feature is bug_report; … | ["billing: Charges, invoices, refunds, subscriptions","feature_request: The user is requesting new functionality","bug_report: The user is reporting something that is broken or producing errors","account: Login, permissions, profile, security"] | [0,0,1,0] | "Customer Harbor-b73b6d8271: Report export fails through every available method, so I cannot complete my filing. That is the request I want you to handle first.\nAgent: Could you add the details?\nCustomer: I open a saved report, then click Export; the download panel disappears a… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["bug_report"], "churn": 0, "frustration": 1, "refund": false, "repro": true, "severity": 2}, "entity_ids": ["Harbor-b73b6d8271"], "family": "routing", "language": "en", "prove… | {"group_id": "customer-control-v1:42:122", "id": "customer-control-v1:42:122:category", "kind": "choice", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["bug_report"], "churn": 0, "frustration": 1, "refund": fa… | 25 |
| customer-control-v1:42:122:bug_severity | customer-control-v1:42:122 | calibration | customer-control-v1 | score | How severe is the reported issue? Use the stated functional impact and the existence of a workaround. Use no functional impact when no malfunction is described. In this synthetic control, if a broken feature is described but the availability of a workaround is explicitly unknown,… | ["Cosmetic; no impact to functionality","Broken or degraded feature; workaround exists","Blocking issue; no workaround exists"] | [0,0,1] | "Customer Harbor-b73b6d8271: Report export fails through every available method, so I cannot complete my filing. That is the request I want you to handle first.\nAgent: Could you add the details?\nCustomer: I open a saved report, then click Export; the download panel disappears a… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["bug_report"], "churn": 0, "frustration": 1, "refund": false, "repro": true, "severity": 2}, "entity_ids": ["Harbor-b73b6d8271"], "family": "rubric", "language": "en", "proven… | {"group_id": "customer-control-v1:42:122", "id": "customer-control-v1:42:122:bug_severity", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["bug_report"], "churn": 0, "frustration": 1, "refund":… | 26 |
| customer-control-v1:42:122:has_reproducible_steps | customer-control-v1:42:122 | calibration | customer-control-v1 | noul | The user describes specific steps to reproduce the issue. For this controlled task, require at least two ordered user actions and the observed result. A vague report, a resolved historical issue, or an instruction to support staff is insufficient. | ["no","yes"] | [0,1] | "Customer Harbor-b73b6d8271: Report export fails through every available method, so I cannot complete my filing. That is the request I want you to handle first.\nAgent: Could you add the details?\nCustomer: I open a saved report, then click Export; the download panel disappears a… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["bug_report"], "churn": 0, "frustration": 1, "refund": false, "repro": true, "severity": 2}, "entity_ids": ["Harbor-b73b6d8271"], "family": "evidence", "language": "en", "prov… | {"group_id": "customer-control-v1:42:122", "id": "customer-control-v1:42:122:has_reproducible_steps", "kind": "noul", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["bug_report"], "churn": 0, "frustration": 1, … | 27 |
| customer-control-v1:42:122:refund_requested | customer-control-v1:42:122 | calibration | customer-control-v1 | noul | The user is explicitly asking for a refund or credit for the current issue. A question about charges, an explicit denial of wanting money back, or a mention of an already completed refund is not a current request. | ["no","yes"] | [1,0] | "Customer Harbor-b73b6d8271: Report export fails through every available method, so I cannot complete my filing. That is the request I want you to handle first.\nAgent: Could you add the details?\nCustomer: I open a saved report, then click Export; the download panel disappears a… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["bug_report"], "churn": 0, "frustration": 1, "refund": false, "repro": true, "severity": 2}, "entity_ids": ["Harbor-b73b6d8271"], "family": "evidence", "language": "en", "prov… | {"group_id": "customer-control-v1:42:122", "id": "customer-control-v1:42:122:refund_requested", "kind": "noul", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["bug_report"], "churn": 0, "frustration": 1, "refun… | 28 |
| customer-control-v1:42:122:frustration | customer-control-v1:42:122 | calibration | customer-control-v1 | score | How frustrated the user appears. Use the current expressed tone. For a reaction that carries no clear emotional valence, the controlled generator has two equally likely latent readings: calm or frustrated but civil. Do not infer very angry without an explicit anger signal. | ["Calm, matter-of-fact","Frustrated but civil","Very angry"] | [0,1,0] | "Customer Harbor-b73b6d8271: Report export fails through every available method, so I cannot complete my filing. That is the request I want you to handle first.\nAgent: Could you add the details?\nCustomer: I open a saved report, then click Export; the download panel disappears a… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["bug_report"], "churn": 0, "frustration": 1, "refund": false, "repro": true, "severity": 2}, "entity_ids": ["Harbor-b73b6d8271"], "family": "rubric", "language": "en", "proven… | {"group_id": "customer-control-v1:42:122", "id": "customer-control-v1:42:122:frustration", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["bug_report"], "churn": 0, "frustration": 1, "refund": … | 29 |
| customer-control-v1:42:122:churn_likelihood_level | customer-control-v1:42:122 | calibration | customer-control-v1 | score | Churn likelihood level. This is a local ordinal intention rubric, not an empirically calibrated prediction of future churn. Evaluate the customer's stated continuation intent. If intent was explicitly withheld or not discussed, the synthetic generator has three equally likely lat… | ["The customer explicitly intends to keep using the service and continue their subscription.","The customer is undecided about continuing, or makes departure conditional on whether the issue is resolved.","The customer explicitly requests cancellation or states a definite decisio… | [1,0,0] | "Customer Harbor-b73b6d8271: Report export fails through every available method, so I cannot complete my filing. That is the request I want you to handle first.\nAgent: Could you add the details?\nCustomer: I open a saved report, then click Export; the download panel disappears a… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["bug_report"], "churn": 0, "frustration": 1, "refund": false, "repro": true, "severity": 2}, "entity_ids": ["Harbor-b73b6d8271"], "family": "rubric", "language": "en", "proven… | {"group_id": "customer-control-v1:42:122", "id": "customer-control-v1:42:122:churn_likelihood_level", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["bug_report"], "churn": 0, "frustration": 1,… | 30 |
| customer-control-v1:42:136:category | customer-control-v1:42:136 | calibration | customer-control-v1 | choice | Determine the broad category of this support ticket. For this controlled task, select the customer's expressly prioritized request. If two requests explicitly have equal priority, allocate equal support to their two categories. A malfunction of an existing feature is bug_report; … | ["account: Login, permissions, profile, security","feature_request: The user is requesting new functionality","billing: Charges, invoices, refunds, subscriptions","bug_report: The user is reporting something that is broken or producing errors"] | [0,0,1,0] | "Customer Harbor-15e16f11cb: My card was charged twice for the same monthly invoice. That is the request I want you to handle first.\nAgent: Could you add the details?\nCustomer: Please apply a credit for the extra payment to my next invoice. Thanks for checking. I am simply repo… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["billing"], "churn": 2, "frustration": 0, "refund": true, "repro": false, "severity": 0}, "entity_ids": ["Harbor-15e16f11cb"], "family": "routing", "language": "en+zh", "prove… | {"group_id": "customer-control-v1:42:136", "id": "customer-control-v1:42:136:category", "kind": "choice", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["billing"], "churn": 2, "frustration": 0, "refund": true,… | 31 |
| customer-control-v1:42:136:bug_severity | customer-control-v1:42:136 | calibration | customer-control-v1 | score | How severe is the reported issue? Use the stated functional impact and the existence of a workaround. Use no functional impact when no malfunction is described. In this synthetic control, if a broken feature is described but the availability of a workaround is explicitly unknown,… | ["Cosmetic; no impact to functionality","Broken or degraded feature; workaround exists","Blocking issue; no workaround exists"] | [1,0,0] | "Customer Harbor-15e16f11cb: My card was charged twice for the same monthly invoice. That is the request I want you to handle first.\nAgent: Could you add the details?\nCustomer: Please apply a credit for the extra payment to my next invoice. Thanks for checking. I am simply repo… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["billing"], "churn": 2, "frustration": 0, "refund": true, "repro": false, "severity": 0}, "entity_ids": ["Harbor-15e16f11cb"], "family": "rubric", "language": "en+zh", "proven… | {"group_id": "customer-control-v1:42:136", "id": "customer-control-v1:42:136:bug_severity", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["billing"], "churn": 2, "frustration": 0, "refund": tr… | 32 |
| customer-control-v1:42:136:has_reproducible_steps | customer-control-v1:42:136 | calibration | customer-control-v1 | noul | The user describes specific steps to reproduce the issue. For this controlled task, require at least two ordered user actions and the observed result. A vague report, a resolved historical issue, or an instruction to support staff is insufficient. | ["no","yes"] | [1,0] | "Customer Harbor-15e16f11cb: My card was charged twice for the same monthly invoice. That is the request I want you to handle first.\nAgent: Could you add the details?\nCustomer: Please apply a credit for the extra payment to my next invoice. Thanks for checking. I am simply repo… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["billing"], "churn": 2, "frustration": 0, "refund": true, "repro": false, "severity": 0}, "entity_ids": ["Harbor-15e16f11cb"], "family": "evidence", "language": "en+zh", "prov… | {"group_id": "customer-control-v1:42:136", "id": "customer-control-v1:42:136:has_reproducible_steps", "kind": "noul", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["billing"], "churn": 2, "frustration": 0, "re… | 33 |
| customer-control-v1:42:136:refund_requested | customer-control-v1:42:136 | calibration | customer-control-v1 | noul | The user is explicitly asking for a refund or credit for the current issue. A question about charges, an explicit denial of wanting money back, or a mention of an already completed refund is not a current request. | ["no","yes"] | [0,1] | "Customer Harbor-15e16f11cb: My card was charged twice for the same monthly invoice. That is the request I want you to handle first.\nAgent: Could you add the details?\nCustomer: Please apply a credit for the extra payment to my next invoice. Thanks for checking. I am simply repo… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["billing"], "churn": 2, "frustration": 0, "refund": true, "repro": false, "severity": 0}, "entity_ids": ["Harbor-15e16f11cb"], "family": "evidence", "language": "en+zh", "prov… | {"group_id": "customer-control-v1:42:136", "id": "customer-control-v1:42:136:refund_requested", "kind": "noul", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["billing"], "churn": 2, "frustration": 0, "refund":… | 34 |
| customer-control-v1:42:136:frustration | customer-control-v1:42:136 | calibration | customer-control-v1 | score | How frustrated the user appears. Use the current expressed tone. For a reaction that carries no clear emotional valence, the controlled generator has two equally likely latent readings: calm or frustrated but civil. Do not infer very angry without an explicit anger signal. | ["Calm, matter-of-fact","Frustrated but civil","Very angry"] | [1,0,0] | "Customer Harbor-15e16f11cb: My card was charged twice for the same monthly invoice. That is the request I want you to handle first.\nAgent: Could you add the details?\nCustomer: Please apply a credit for the extra payment to my next invoice. Thanks for checking. I am simply repo… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["billing"], "churn": 2, "frustration": 0, "refund": true, "repro": false, "severity": 0}, "entity_ids": ["Harbor-15e16f11cb"], "family": "rubric", "language": "en+zh", "proven… | {"group_id": "customer-control-v1:42:136", "id": "customer-control-v1:42:136:frustration", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["billing"], "churn": 2, "frustration": 0, "refund": tru… | 35 |
| customer-control-v1:42:136:churn_likelihood_level | customer-control-v1:42:136 | calibration | customer-control-v1 | score | Churn likelihood level. This is a local ordinal intention rubric, not an empirically calibrated prediction of future churn. Evaluate the customer's stated continuation intent. If intent was explicitly withheld or not discussed, the synthetic generator has three equally likely lat… | ["The customer explicitly intends to keep using the service and continue their subscription.","The customer is undecided about continuing, or makes departure conditional on whether the issue is resolved.","The customer explicitly requests cancellation or states a definite decisio… | [0,0,1] | "Customer Harbor-15e16f11cb: My card was charged twice for the same monthly invoice. That is the request I want you to handle first.\nAgent: Could you add the details?\nCustomer: Please apply a credit for the extra payment to my next invoice. Thanks for checking. I am simply repo… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["billing"], "churn": 2, "frustration": 0, "refund": true, "repro": false, "severity": 0}, "entity_ids": ["Harbor-15e16f11cb"], "family": "rubric", "language": "en+zh", "proven… | {"group_id": "customer-control-v1:42:136", "id": "customer-control-v1:42:136:churn_likelihood_level", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["billing"], "churn": 2, "frustration": 0, "r… | 36 |
| customer-control-v1:42:141:category | customer-control-v1:42:141 | calibration | customer-control-v1 | choice | Determine the broad category of this support ticket. For this controlled task, select the customer's expressly prioritized request. If two requests explicitly have equal priority, allocate equal support to their two categories. A malfunction of an existing feature is bug_report; … | ["account: Login, permissions, profile, security","feature_request: The user is requesting new functionality","bug_report: The user is reporting something that is broken or producing errors","billing: Charges, invoices, refunds, subscriptions"] | [1,0,0,0] | "Conversation with account holder Harbor-9c9c4ea8d9.\nCustomer message: I need access restored after changing the email address used to sign in. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: Thanks for checking. I am simply rep… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 1, "frustration": 0, "refund": false, "repro": false, "severity": 0}, "entity_ids": ["Harbor-9c9c4ea8d9"], "family": "routing", "language": "en", "provena… | {"group_id": "customer-control-v1:42:141", "id": "customer-control-v1:42:141:category", "kind": "choice", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 1, "frustration": 0, "refund": false… | 37 |
| customer-control-v1:42:141:bug_severity | customer-control-v1:42:141 | calibration | customer-control-v1 | score | How severe is the reported issue? Use the stated functional impact and the existence of a workaround. Use no functional impact when no malfunction is described. In this synthetic control, if a broken feature is described but the availability of a workaround is explicitly unknown,… | ["Cosmetic; no impact to functionality","Broken or degraded feature; workaround exists","Blocking issue; no workaround exists"] | [1,0,0] | "Conversation with account holder Harbor-9c9c4ea8d9.\nCustomer message: I need access restored after changing the email address used to sign in. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: Thanks for checking. I am simply rep… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 1, "frustration": 0, "refund": false, "repro": false, "severity": 0}, "entity_ids": ["Harbor-9c9c4ea8d9"], "family": "rubric", "language": "en", "provenan… | {"group_id": "customer-control-v1:42:141", "id": "customer-control-v1:42:141:bug_severity", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 1, "frustration": 0, "refund": fa… | 38 |
| customer-control-v1:42:141:has_reproducible_steps | customer-control-v1:42:141 | calibration | customer-control-v1 | noul | The user describes specific steps to reproduce the issue. For this controlled task, require at least two ordered user actions and the observed result. A vague report, a resolved historical issue, or an instruction to support staff is insufficient. | ["no","yes"] | [1,0] | "Conversation with account holder Harbor-9c9c4ea8d9.\nCustomer message: I need access restored after changing the email address used to sign in. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: Thanks for checking. I am simply rep… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 1, "frustration": 0, "refund": false, "repro": false, "severity": 0}, "entity_ids": ["Harbor-9c9c4ea8d9"], "family": "evidence", "language": "en", "proven… | {"group_id": "customer-control-v1:42:141", "id": "customer-control-v1:42:141:has_reproducible_steps", "kind": "noul", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 1, "frustration": 0, "re… | 39 |
| customer-control-v1:42:141:refund_requested | customer-control-v1:42:141 | calibration | customer-control-v1 | noul | The user is explicitly asking for a refund or credit for the current issue. A question about charges, an explicit denial of wanting money back, or a mention of an already completed refund is not a current request. | ["no","yes"] | [1,0] | "Conversation with account holder Harbor-9c9c4ea8d9.\nCustomer message: I need access restored after changing the email address used to sign in. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: Thanks for checking. I am simply rep… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 1, "frustration": 0, "refund": false, "repro": false, "severity": 0}, "entity_ids": ["Harbor-9c9c4ea8d9"], "family": "evidence", "language": "en", "proven… | {"group_id": "customer-control-v1:42:141", "id": "customer-control-v1:42:141:refund_requested", "kind": "noul", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 1, "frustration": 0, "refund":… | 40 |
| customer-control-v1:42:141:frustration | customer-control-v1:42:141 | calibration | customer-control-v1 | score | How frustrated the user appears. Use the current expressed tone. For a reaction that carries no clear emotional valence, the controlled generator has two equally likely latent readings: calm or frustrated but civil. Do not infer very angry without an explicit anger signal. | ["Calm, matter-of-fact","Frustrated but civil","Very angry"] | [1,0,0] | "Conversation with account holder Harbor-9c9c4ea8d9.\nCustomer message: I need access restored after changing the email address used to sign in. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: Thanks for checking. I am simply rep… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 1, "frustration": 0, "refund": false, "repro": false, "severity": 0}, "entity_ids": ["Harbor-9c9c4ea8d9"], "family": "rubric", "language": "en", "provenan… | {"group_id": "customer-control-v1:42:141", "id": "customer-control-v1:42:141:frustration", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 1, "frustration": 0, "refund": fal… | 41 |
| customer-control-v1:42:141:churn_likelihood_level | customer-control-v1:42:141 | calibration | customer-control-v1 | score | Churn likelihood level. This is a local ordinal intention rubric, not an empirically calibrated prediction of future churn. Evaluate the customer's stated continuation intent. If intent was explicitly withheld or not discussed, the synthetic generator has three equally likely lat… | ["The customer explicitly intends to keep using the service and continue their subscription.","The customer is undecided about continuing, or makes departure conditional on whether the issue is resolved.","The customer explicitly requests cancellation or states a definite decisio… | [0,1,0] | "Conversation with account holder Harbor-9c9c4ea8d9.\nCustomer message: I need access restored after changing the email address used to sign in. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: Thanks for checking. I am simply rep… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 1, "frustration": 0, "refund": false, "repro": false, "severity": 0}, "entity_ids": ["Harbor-9c9c4ea8d9"], "family": "rubric", "language": "en", "provenan… | {"group_id": "customer-control-v1:42:141", "id": "customer-control-v1:42:141:churn_likelihood_level", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 1, "frustration": 0, "r… | 42 |
| customer-control-v1:42:209:category | customer-control-v1:42:209 | calibration | customer-control-v1 | choice | Determine the broad category of this support ticket. For this controlled task, select the customer's expressly prioritized request. If two requests explicitly have equal priority, allocate equal support to their two categories. A malfunction of an existing feature is bug_report; … | ["feature_request: The user is requesting new functionality","account: Login, permissions, profile, security","billing: Charges, invoices, refunds, subscriptions","bug_report: The user is reporting something that is broken or producing errors"] | [0,0,0,1] | "Conversation with account holder Harbor-d99829763f.\nCustomer message: Exporting a report fails. I haven't tested the desktop route and don't know whether an alternative works. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: It … | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "bug_severity", "categories": ["bug_report"], "churn": 1, "frustration": 2, "refund": false, "repro": false, "severity": 1}, "entity_ids": ["Harbor-d99829763f"], "family": "routing", "language": "en… | {"group_id": "customer-control-v1:42:209", "id": "customer-control-v1:42:209:category", "kind": "choice", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "bug_severity", "categories": ["bug_report"], "churn": 1, "frustration": 2, "ref… | 43 |
| customer-control-v1:42:209:bug_severity | customer-control-v1:42:209 | calibration | customer-control-v1 | score | How severe is the reported issue? Use the stated functional impact and the existence of a workaround. Use no functional impact when no malfunction is described. In this synthetic control, if a broken feature is described but the availability of a workaround is explicitly unknown,… | ["Cosmetic; no impact to functionality","Broken or degraded feature; workaround exists","Blocking issue; no workaround exists"] | [0,0.5,0.5] | "Conversation with account holder Harbor-d99829763f.\nCustomer message: Exporting a report fails. I haven't tested the desktop route and don't know whether an alternative works. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: It … | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "bug_severity", "categories": ["bug_report"], "churn": 1, "frustration": 2, "refund": false, "repro": false, "severity": 1}, "entity_ids": ["Harbor-d99829763f"], "family": "rubric", "language": "en+… | {"group_id": "customer-control-v1:42:209", "id": "customer-control-v1:42:209:bug_severity", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "bug_severity", "categories": ["bug_report"], "churn": 1, "frustration": 2, "… | 44 |