First 44 rows of validation
| idstring | group_idstring | splitstring | sourcestring | kindstring | questionstring | optionsList | targetList | state_jsonstring | metadata_jsonstring | record_jsonstring | original_line_numberint64 |
|---|---|---|---|---|---|---|---|---|---|---|---|
| customer-control-v1:42:9:category | customer-control-v1:42:9 | validation | customer-control-v1 |
| choice |
| Determine the broad category of this support ticket. For this controlled task, select the customer's expressly prioritized request. If two requests explicitly have equal priority, allocate equal support to their two categories. A malfunction of an existing feature is bug_report; … |
| ["billing: Charges, invoices, refunds, subscriptions","feature_request: The user is requesting new functionality","bug_report: The user is reporting something that is broken or producing errors","account: Login, permissions, profile, security"] |
| [0,0,1,0] |
| "Customer Harbor-916e9036ba: Exporting a report fails, but I can download the CSV and finish in the desktop app. That is the request I want you to handle first.\nAgent: Could you add the details?\nCustomer: I open a saved report, then click Export; the download panel disappears a… |
| {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "churn_likelihood_level", "categories": ["bug_report"], "churn": 2, "frustration": 2, "refund": false, "repro": true, "severity": 1}, "entity_ids": ["Harbor-916e9036ba"], "family": "routing", "langu… |
| {"group_id": "customer-control-v1:42:9", "id": "customer-control-v1:42:9:category", "kind": "choice", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "churn_likelihood_level", "categories": ["bug_report"], "churn": 2, "frustration": 2… |
| 1 |
| customer-control-v1:42:9:bug_severity | customer-control-v1:42:9 | validation | customer-control-v1 | score | How severe is the reported issue? Use the stated functional impact and the existence of a workaround. Use no functional impact when no malfunction is described. In this synthetic control, if a broken feature is described but the availability of a workaround is explicitly unknown,… | ["Cosmetic; no impact to functionality","Broken or degraded feature; workaround exists","Blocking issue; no workaround exists"] | [0,1,0] | "Customer Harbor-916e9036ba: Exporting a report fails, but I can download the CSV and finish in the desktop app. That is the request I want you to handle first.\nAgent: Could you add the details?\nCustomer: I open a saved report, then click Export; the download panel disappears a… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "churn_likelihood_level", "categories": ["bug_report"], "churn": 2, "frustration": 2, "refund": false, "repro": true, "severity": 1}, "entity_ids": ["Harbor-916e9036ba"], "family": "rubric", "langua… | {"group_id": "customer-control-v1:42:9", "id": "customer-control-v1:42:9:bug_severity", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "churn_likelihood_level", "categories": ["bug_report"], "churn": 2, "frustration"… | 2 |
| customer-control-v1:42:9:has_reproducible_steps | customer-control-v1:42:9 | validation | customer-control-v1 | noul | The user describes specific steps to reproduce the issue. For this controlled task, require at least two ordered user actions and the observed result. A vague report, a resolved historical issue, or an instruction to support staff is insufficient. | ["no","yes"] | [0,1] | "Customer Harbor-916e9036ba: Exporting a report fails, but I can download the CSV and finish in the desktop app. That is the request I want you to handle first.\nAgent: Could you add the details?\nCustomer: I open a saved report, then click Export; the download panel disappears a… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "churn_likelihood_level", "categories": ["bug_report"], "churn": 2, "frustration": 2, "refund": false, "repro": true, "severity": 1}, "entity_ids": ["Harbor-916e9036ba"], "family": "evidence", "lang… | {"group_id": "customer-control-v1:42:9", "id": "customer-control-v1:42:9:has_reproducible_steps", "kind": "noul", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "churn_likelihood_level", "categories": ["bug_report"], "churn": 2, "fru… | 3 |
| customer-control-v1:42:9:refund_requested | customer-control-v1:42:9 | validation | customer-control-v1 | noul | The user is explicitly asking for a refund or credit for the current issue. A question about charges, an explicit denial of wanting money back, or a mention of an already completed refund is not a current request. | ["no","yes"] | [1,0] | "Customer Harbor-916e9036ba: Exporting a report fails, but I can download the CSV and finish in the desktop app. That is the request I want you to handle first.\nAgent: Could you add the details?\nCustomer: I open a saved report, then click Export; the download panel disappears a… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "churn_likelihood_level", "categories": ["bug_report"], "churn": 2, "frustration": 2, "refund": false, "repro": true, "severity": 1}, "entity_ids": ["Harbor-916e9036ba"], "family": "evidence", "lang… | {"group_id": "customer-control-v1:42:9", "id": "customer-control-v1:42:9:refund_requested", "kind": "noul", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "churn_likelihood_level", "categories": ["bug_report"], "churn": 2, "frustrati… | 4 |
| customer-control-v1:42:9:frustration | customer-control-v1:42:9 | validation | customer-control-v1 | score | How frustrated the user appears. Use the current expressed tone. For a reaction that carries no clear emotional valence, the controlled generator has two equally likely latent readings: calm or frustrated but civil. Do not infer very angry without an explicit anger signal. | ["Calm, matter-of-fact","Frustrated but civil","Very angry"] | [0,0,1] | "Customer Harbor-916e9036ba: Exporting a report fails, but I can download the CSV and finish in the desktop app. That is the request I want you to handle first.\nAgent: Could you add the details?\nCustomer: I open a saved report, then click Export; the download panel disappears a… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "churn_likelihood_level", "categories": ["bug_report"], "churn": 2, "frustration": 2, "refund": false, "repro": true, "severity": 1}, "entity_ids": ["Harbor-916e9036ba"], "family": "rubric", "langua… | {"group_id": "customer-control-v1:42:9", "id": "customer-control-v1:42:9:frustration", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "churn_likelihood_level", "categories": ["bug_report"], "churn": 2, "frustration":… | 5 |
| customer-control-v1:42:9:churn_likelihood_level | customer-control-v1:42:9 | validation | customer-control-v1 | score | Churn likelihood level. This is a local ordinal intention rubric, not an empirically calibrated prediction of future churn. Evaluate the customer's stated continuation intent. If intent was explicitly withheld or not discussed, the synthetic generator has three equally likely lat… | ["The customer explicitly intends to keep using the service and continue their subscription.","The customer is undecided about continuing, or makes departure conditional on whether the issue is resolved.","The customer explicitly requests cancellation or states a definite decisio… | [0.3333333333333333,0.3333333333333333,0.3333333333333333] | "Customer Harbor-916e9036ba: Exporting a report fails, but I can download the CSV and finish in the desktop app. That is the request I want you to handle first.\nAgent: Could you add the details?\nCustomer: I open a saved report, then click Export; the download panel disappears a… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "churn_likelihood_level", "categories": ["bug_report"], "churn": 2, "frustration": 2, "refund": false, "repro": true, "severity": 1}, "entity_ids": ["Harbor-916e9036ba"], "family": "rubric", "langua… | {"group_id": "customer-control-v1:42:9", "id": "customer-control-v1:42:9:churn_likelihood_level", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "churn_likelihood_level", "categories": ["bug_report"], "churn": 2, "fr… | 6 |
| customer-control-v1:42:21:category | customer-control-v1:42:21 | validation | customer-control-v1 | choice | Determine the broad category of this support ticket. For this controlled task, select the customer's expressly prioritized request. If two requests explicitly have equal priority, allocate equal support to their two categories. A malfunction of an existing feature is bug_report; … | ["feature_request: The user is requesting new functionality","bug_report: The user is reporting something that is broken or producing errors","billing: Charges, invoices, refunds, subscriptions","account: Login, permissions, profile, security"] | [0,1,0,0] | "Conversation with account holder Harbor-df638d6c4b.\nCustomer message: The report heading is misaligned, but every report function still works. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: I open a saved report, then click Pr… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "churn_likelihood_level", "categories": ["bug_report"], "churn": 1, "frustration": 0, "refund": false, "repro": true, "severity": 0}, "entity_ids": ["Harbor-df638d6c4b"], "family": "routing", "langu… | {"group_id": "customer-control-v1:42:21", "id": "customer-control-v1:42:21:category", "kind": "choice", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "churn_likelihood_level", "categories": ["bug_report"], "churn": 1, "frustration":… | 7 |
| customer-control-v1:42:21:bug_severity | customer-control-v1:42:21 | validation | customer-control-v1 | score | How severe is the reported issue? Use the stated functional impact and the existence of a workaround. Use no functional impact when no malfunction is described. In this synthetic control, if a broken feature is described but the availability of a workaround is explicitly unknown,… | ["Cosmetic; no impact to functionality","Broken or degraded feature; workaround exists","Blocking issue; no workaround exists"] | [1,0,0] | "Conversation with account holder Harbor-df638d6c4b.\nCustomer message: The report heading is misaligned, but every report function still works. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: I open a saved report, then click Pr… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "churn_likelihood_level", "categories": ["bug_report"], "churn": 1, "frustration": 0, "refund": false, "repro": true, "severity": 0}, "entity_ids": ["Harbor-df638d6c4b"], "family": "rubric", "langua… | {"group_id": "customer-control-v1:42:21", "id": "customer-control-v1:42:21:bug_severity", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "churn_likelihood_level", "categories": ["bug_report"], "churn": 1, "frustratio… | 8 |
| customer-control-v1:42:21:has_reproducible_steps | customer-control-v1:42:21 | validation | customer-control-v1 | noul | The user describes specific steps to reproduce the issue. For this controlled task, require at least two ordered user actions and the observed result. A vague report, a resolved historical issue, or an instruction to support staff is insufficient. | ["no","yes"] | [0,1] | "Conversation with account holder Harbor-df638d6c4b.\nCustomer message: The report heading is misaligned, but every report function still works. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: I open a saved report, then click Pr… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "churn_likelihood_level", "categories": ["bug_report"], "churn": 1, "frustration": 0, "refund": false, "repro": true, "severity": 0}, "entity_ids": ["Harbor-df638d6c4b"], "family": "evidence", "lang… | {"group_id": "customer-control-v1:42:21", "id": "customer-control-v1:42:21:has_reproducible_steps", "kind": "noul", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "churn_likelihood_level", "categories": ["bug_report"], "churn": 1, "f… | 9 |
| customer-control-v1:42:21:refund_requested | customer-control-v1:42:21 | validation | customer-control-v1 | noul | The user is explicitly asking for a refund or credit for the current issue. A question about charges, an explicit denial of wanting money back, or a mention of an already completed refund is not a current request. | ["no","yes"] | [1,0] | "Conversation with account holder Harbor-df638d6c4b.\nCustomer message: The report heading is misaligned, but every report function still works. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: I open a saved report, then click Pr… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "churn_likelihood_level", "categories": ["bug_report"], "churn": 1, "frustration": 0, "refund": false, "repro": true, "severity": 0}, "entity_ids": ["Harbor-df638d6c4b"], "family": "evidence", "lang… | {"group_id": "customer-control-v1:42:21", "id": "customer-control-v1:42:21:refund_requested", "kind": "noul", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "churn_likelihood_level", "categories": ["bug_report"], "churn": 1, "frustra… | 10 |
| customer-control-v1:42:21:frustration | customer-control-v1:42:21 | validation | customer-control-v1 | score | How frustrated the user appears. Use the current expressed tone. For a reaction that carries no clear emotional valence, the controlled generator has two equally likely latent readings: calm or frustrated but civil. Do not infer very angry without an explicit anger signal. | ["Calm, matter-of-fact","Frustrated but civil","Very angry"] | [1,0,0] | "Conversation with account holder Harbor-df638d6c4b.\nCustomer message: The report heading is misaligned, but every report function still works. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: I open a saved report, then click Pr… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "churn_likelihood_level", "categories": ["bug_report"], "churn": 1, "frustration": 0, "refund": false, "repro": true, "severity": 0}, "entity_ids": ["Harbor-df638d6c4b"], "family": "rubric", "langua… | {"group_id": "customer-control-v1:42:21", "id": "customer-control-v1:42:21:frustration", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "churn_likelihood_level", "categories": ["bug_report"], "churn": 1, "frustration… | 11 |
| customer-control-v1:42:21:churn_likelihood_level | customer-control-v1:42:21 | validation | customer-control-v1 | score | Churn likelihood level. This is a local ordinal intention rubric, not an empirically calibrated prediction of future churn. Evaluate the customer's stated continuation intent. If intent was explicitly withheld or not discussed, the synthetic generator has three equally likely lat… | ["The customer explicitly intends to keep using the service and continue their subscription.","The customer is undecided about continuing, or makes departure conditional on whether the issue is resolved.","The customer explicitly requests cancellation or states a definite decisio… | [0.3333333333333333,0.3333333333333333,0.3333333333333333] | "Conversation with account holder Harbor-df638d6c4b.\nCustomer message: The report heading is misaligned, but every report function still works. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: I open a saved report, then click Pr… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "churn_likelihood_level", "categories": ["bug_report"], "churn": 1, "frustration": 0, "refund": false, "repro": true, "severity": 0}, "entity_ids": ["Harbor-df638d6c4b"], "family": "rubric", "langua… | {"group_id": "customer-control-v1:42:21", "id": "customer-control-v1:42:21:churn_likelihood_level", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "churn_likelihood_level", "categories": ["bug_report"], "churn": 1, "… | 12 |
| customer-control-v1:42:87:category | customer-control-v1:42:87 | validation | customer-control-v1 | choice | Determine the broad category of this support ticket. For this controlled task, select the customer's expressly prioritized request. If two requests explicitly have equal priority, allocate equal support to their two categories. A malfunction of an existing feature is bug_report; … | ["billing: Charges, invoices, refunds, subscriptions","bug_report: The user is reporting something that is broken or producing errors","account: Login, permissions, profile, security","feature_request: The user is requesting new functionality"] | [1,0,0,0] | "Conversation with account holder Harbor-836ece60cf.\nCustomer message: My card was charged twice for the same monthly invoice. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: Please refund the duplicate charge to my card. This i… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["billing"], "churn": 0, "frustration": 1, "refund": true, "repro": false, "severity": 0}, "entity_ids": ["Harbor-836ece60cf"], "family": "routing", "language": "en", "provenan… | {"group_id": "customer-control-v1:42:87", "id": "customer-control-v1:42:87:category", "kind": "choice", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["billing"], "churn": 0, "frustration": 1, "refund": true, "… | 13 |
| customer-control-v1:42:87:bug_severity | customer-control-v1:42:87 | validation | customer-control-v1 | score | How severe is the reported issue? Use the stated functional impact and the existence of a workaround. Use no functional impact when no malfunction is described. In this synthetic control, if a broken feature is described but the availability of a workaround is explicitly unknown,… | ["Cosmetic; no impact to functionality","Broken or degraded feature; workaround exists","Blocking issue; no workaround exists"] | [1,0,0] | "Conversation with account holder Harbor-836ece60cf.\nCustomer message: My card was charged twice for the same monthly invoice. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: Please refund the duplicate charge to my card. This i… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["billing"], "churn": 0, "frustration": 1, "refund": true, "repro": false, "severity": 0}, "entity_ids": ["Harbor-836ece60cf"], "family": "rubric", "language": "en", "provenanc… | {"group_id": "customer-control-v1:42:87", "id": "customer-control-v1:42:87:bug_severity", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["billing"], "churn": 0, "frustration": 1, "refund": true… | 14 |
| customer-control-v1:42:87:has_reproducible_steps | customer-control-v1:42:87 | validation | customer-control-v1 | noul | The user describes specific steps to reproduce the issue. For this controlled task, require at least two ordered user actions and the observed result. A vague report, a resolved historical issue, or an instruction to support staff is insufficient. | ["no","yes"] | [1,0] | "Conversation with account holder Harbor-836ece60cf.\nCustomer message: My card was charged twice for the same monthly invoice. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: Please refund the duplicate charge to my card. This i… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["billing"], "churn": 0, "frustration": 1, "refund": true, "repro": false, "severity": 0}, "entity_ids": ["Harbor-836ece60cf"], "family": "evidence", "language": "en", "provena… | {"group_id": "customer-control-v1:42:87", "id": "customer-control-v1:42:87:has_reproducible_steps", "kind": "noul", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["billing"], "churn": 0, "frustration": 1, "refu… | 15 |
| customer-control-v1:42:87:refund_requested | customer-control-v1:42:87 | validation | customer-control-v1 | noul | The user is explicitly asking for a refund or credit for the current issue. A question about charges, an explicit denial of wanting money back, or a mention of an already completed refund is not a current request. | ["no","yes"] | [0,1] | "Conversation with account holder Harbor-836ece60cf.\nCustomer message: My card was charged twice for the same monthly invoice. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: Please refund the duplicate charge to my card. This i… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["billing"], "churn": 0, "frustration": 1, "refund": true, "repro": false, "severity": 0}, "entity_ids": ["Harbor-836ece60cf"], "family": "evidence", "language": "en", "provena… | {"group_id": "customer-control-v1:42:87", "id": "customer-control-v1:42:87:refund_requested", "kind": "noul", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["billing"], "churn": 0, "frustration": 1, "refund": t… | 16 |
| customer-control-v1:42:87:frustration | customer-control-v1:42:87 | validation | customer-control-v1 | score | How frustrated the user appears. Use the current expressed tone. For a reaction that carries no clear emotional valence, the controlled generator has two equally likely latent readings: calm or frustrated but civil. Do not infer very angry without an explicit anger signal. | ["Calm, matter-of-fact","Frustrated but civil","Very angry"] | [0,1,0] | "Conversation with account holder Harbor-836ece60cf.\nCustomer message: My card was charged twice for the same monthly invoice. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: Please refund the duplicate charge to my card. This i… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["billing"], "churn": 0, "frustration": 1, "refund": true, "repro": false, "severity": 0}, "entity_ids": ["Harbor-836ece60cf"], "family": "rubric", "language": "en", "provenanc… | {"group_id": "customer-control-v1:42:87", "id": "customer-control-v1:42:87:frustration", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["billing"], "churn": 0, "frustration": 1, "refund": true,… | 17 |
| customer-control-v1:42:87:churn_likelihood_level | customer-control-v1:42:87 | validation | customer-control-v1 | score | Churn likelihood level. This is a local ordinal intention rubric, not an empirically calibrated prediction of future churn. Evaluate the customer's stated continuation intent. If intent was explicitly withheld or not discussed, the synthetic generator has three equally likely lat… | ["The customer explicitly intends to keep using the service and continue their subscription.","The customer is undecided about continuing, or makes departure conditional on whether the issue is resolved.","The customer explicitly requests cancellation or states a definite decisio… | [1,0,0] | "Conversation with account holder Harbor-836ece60cf.\nCustomer message: My card was charged twice for the same monthly invoice. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: Please refund the duplicate charge to my card. This i… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["billing"], "churn": 0, "frustration": 1, "refund": true, "repro": false, "severity": 0}, "entity_ids": ["Harbor-836ece60cf"], "family": "rubric", "language": "en", "provenanc… | {"group_id": "customer-control-v1:42:87", "id": "customer-control-v1:42:87:churn_likelihood_level", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["billing"], "churn": 0, "frustration": 1, "ref… | 18 |
| customer-control-v1:42:88:category | customer-control-v1:42:88 | validation | customer-control-v1 | choice | Determine the broad category of this support ticket. For this controlled task, select the customer's expressly prioritized request. If two requests explicitly have equal priority, allocate equal support to their two categories. A malfunction of an existing feature is bug_report; … | ["feature_request: The user is requesting new functionality","bug_report: The user is reporting something that is broken or producing errors","account: Login, permissions, profile, security","billing: Charges, invoices, refunds, subscriptions"] | [0,1,0,0] | "Customer Harbor-b1a63d8326: Exporting a report fails, but I can download the CSV and finish in the desktop app. That is the request I want you to handle first.\nAgent: Could you add the details?\nCustomer: It happens sometimes, but I cannot recall the sequence that led to it. Th… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["bug_report"], "churn": 0, "frustration": 1, "refund": false, "repro": false, "severity": 1}, "entity_ids": ["Harbor-b1a63d8326"], "family": "routing", "language": "en", "prov… | {"group_id": "customer-control-v1:42:88", "id": "customer-control-v1:42:88:category", "kind": "choice", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["bug_report"], "churn": 0, "frustration": 1, "refund": fals… | 19 |
| customer-control-v1:42:88:bug_severity | customer-control-v1:42:88 | validation | customer-control-v1 | score | How severe is the reported issue? Use the stated functional impact and the existence of a workaround. Use no functional impact when no malfunction is described. In this synthetic control, if a broken feature is described but the availability of a workaround is explicitly unknown,… | ["Cosmetic; no impact to functionality","Broken or degraded feature; workaround exists","Blocking issue; no workaround exists"] | [0,1,0] | "Customer Harbor-b1a63d8326: Exporting a report fails, but I can download the CSV and finish in the desktop app. That is the request I want you to handle first.\nAgent: Could you add the details?\nCustomer: It happens sometimes, but I cannot recall the sequence that led to it. Th… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["bug_report"], "churn": 0, "frustration": 1, "refund": false, "repro": false, "severity": 1}, "entity_ids": ["Harbor-b1a63d8326"], "family": "rubric", "language": "en", "prove… | {"group_id": "customer-control-v1:42:88", "id": "customer-control-v1:42:88:bug_severity", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["bug_report"], "churn": 0, "frustration": 1, "refund": f… | 20 |
| customer-control-v1:42:88:has_reproducible_steps | customer-control-v1:42:88 | validation | customer-control-v1 | noul | The user describes specific steps to reproduce the issue. For this controlled task, require at least two ordered user actions and the observed result. A vague report, a resolved historical issue, or an instruction to support staff is insufficient. | ["no","yes"] | [1,0] | "Customer Harbor-b1a63d8326: Exporting a report fails, but I can download the CSV and finish in the desktop app. That is the request I want you to handle first.\nAgent: Could you add the details?\nCustomer: It happens sometimes, but I cannot recall the sequence that led to it. Th… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["bug_report"], "churn": 0, "frustration": 1, "refund": false, "repro": false, "severity": 1}, "entity_ids": ["Harbor-b1a63d8326"], "family": "evidence", "language": "en", "pro… | {"group_id": "customer-control-v1:42:88", "id": "customer-control-v1:42:88:has_reproducible_steps", "kind": "noul", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["bug_report"], "churn": 0, "frustration": 1, "r… | 21 |
| customer-control-v1:42:88:refund_requested | customer-control-v1:42:88 | validation | customer-control-v1 | noul | The user is explicitly asking for a refund or credit for the current issue. A question about charges, an explicit denial of wanting money back, or a mention of an already completed refund is not a current request. | ["no","yes"] | [1,0] | "Customer Harbor-b1a63d8326: Exporting a report fails, but I can download the CSV and finish in the desktop app. That is the request I want you to handle first.\nAgent: Could you add the details?\nCustomer: It happens sometimes, but I cannot recall the sequence that led to it. Th… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["bug_report"], "churn": 0, "frustration": 1, "refund": false, "repro": false, "severity": 1}, "entity_ids": ["Harbor-b1a63d8326"], "family": "evidence", "language": "en", "pro… | {"group_id": "customer-control-v1:42:88", "id": "customer-control-v1:42:88:refund_requested", "kind": "noul", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["bug_report"], "churn": 0, "frustration": 1, "refund"… | 22 |
| customer-control-v1:42:88:frustration | customer-control-v1:42:88 | validation | customer-control-v1 | score | How frustrated the user appears. Use the current expressed tone. For a reaction that carries no clear emotional valence, the controlled generator has two equally likely latent readings: calm or frustrated but civil. Do not infer very angry without an explicit anger signal. | ["Calm, matter-of-fact","Frustrated but civil","Very angry"] | [0,1,0] | "Customer Harbor-b1a63d8326: Exporting a report fails, but I can download the CSV and finish in the desktop app. That is the request I want you to handle first.\nAgent: Could you add the details?\nCustomer: It happens sometimes, but I cannot recall the sequence that led to it. Th… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["bug_report"], "churn": 0, "frustration": 1, "refund": false, "repro": false, "severity": 1}, "entity_ids": ["Harbor-b1a63d8326"], "family": "rubric", "language": "en", "prove… | {"group_id": "customer-control-v1:42:88", "id": "customer-control-v1:42:88:frustration", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["bug_report"], "churn": 0, "frustration": 1, "refund": fa… | 23 |
| customer-control-v1:42:88:churn_likelihood_level | customer-control-v1:42:88 | validation | customer-control-v1 | score | Churn likelihood level. This is a local ordinal intention rubric, not an empirically calibrated prediction of future churn. Evaluate the customer's stated continuation intent. If intent was explicitly withheld or not discussed, the synthetic generator has three equally likely lat… | ["The customer explicitly intends to keep using the service and continue their subscription.","The customer is undecided about continuing, or makes departure conditional on whether the issue is resolved.","The customer explicitly requests cancellation or states a definite decisio… | [1,0,0] | "Customer Harbor-b1a63d8326: Exporting a report fails, but I can download the CSV and finish in the desktop app. That is the request I want you to handle first.\nAgent: Could you add the details?\nCustomer: It happens sometimes, but I cannot recall the sequence that led to it. Th… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["bug_report"], "churn": 0, "frustration": 1, "refund": false, "repro": false, "severity": 1}, "entity_ids": ["Harbor-b1a63d8326"], "family": "rubric", "language": "en", "prove… | {"group_id": "customer-control-v1:42:88", "id": "customer-control-v1:42:88:churn_likelihood_level", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["bug_report"], "churn": 0, "frustration": 1, "… | 24 |
| customer-control-v1:42:114:category | customer-control-v1:42:114 | validation | customer-control-v1 | choice | Determine the broad category of this support ticket. For this controlled task, select the customer's expressly prioritized request. If two requests explicitly have equal priority, allocate equal support to their two categories. A malfunction of an existing feature is bug_report; … | ["billing: Charges, invoices, refunds, subscriptions","account: Login, permissions, profile, security","bug_report: The user is reporting something that is broken or producing errors","feature_request: The user is requesting new functionality"] | [0,1,0,0] | "Conversation with account holder Harbor-eafcdcf3c3.\nCustomer message: I need access restored after changing the email address used to sign in. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: This is frustrating, but I appreciat… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 0, "frustration": 1, "refund": false, "repro": false, "severity": 0}, "entity_ids": ["Harbor-eafcdcf3c3"], "family": "routing", "language": "en+zh", "prov… | {"group_id": "customer-control-v1:42:114", "id": "customer-control-v1:42:114:category", "kind": "choice", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 0, "frustration": 1, "refund": false… | 25 |
| customer-control-v1:42:114:bug_severity | customer-control-v1:42:114 | validation | customer-control-v1 | score | How severe is the reported issue? Use the stated functional impact and the existence of a workaround. Use no functional impact when no malfunction is described. In this synthetic control, if a broken feature is described but the availability of a workaround is explicitly unknown,… | ["Cosmetic; no impact to functionality","Broken or degraded feature; workaround exists","Blocking issue; no workaround exists"] | [1,0,0] | "Conversation with account holder Harbor-eafcdcf3c3.\nCustomer message: I need access restored after changing the email address used to sign in. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: This is frustrating, but I appreciat… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 0, "frustration": 1, "refund": false, "repro": false, "severity": 0}, "entity_ids": ["Harbor-eafcdcf3c3"], "family": "rubric", "language": "en+zh", "prove… | {"group_id": "customer-control-v1:42:114", "id": "customer-control-v1:42:114:bug_severity", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 0, "frustration": 1, "refund": fa… | 26 |
| customer-control-v1:42:114:has_reproducible_steps | customer-control-v1:42:114 | validation | customer-control-v1 | noul | The user describes specific steps to reproduce the issue. For this controlled task, require at least two ordered user actions and the observed result. A vague report, a resolved historical issue, or an instruction to support staff is insufficient. | ["no","yes"] | [1,0] | "Conversation with account holder Harbor-eafcdcf3c3.\nCustomer message: I need access restored after changing the email address used to sign in. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: This is frustrating, but I appreciat… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 0, "frustration": 1, "refund": false, "repro": false, "severity": 0}, "entity_ids": ["Harbor-eafcdcf3c3"], "family": "evidence", "language": "en+zh", "pro… | {"group_id": "customer-control-v1:42:114", "id": "customer-control-v1:42:114:has_reproducible_steps", "kind": "noul", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 0, "frustration": 1, "re… | 27 |
| customer-control-v1:42:114:refund_requested | customer-control-v1:42:114 | validation | customer-control-v1 | noul | The user is explicitly asking for a refund or credit for the current issue. A question about charges, an explicit denial of wanting money back, or a mention of an already completed refund is not a current request. | ["no","yes"] | [1,0] | "Conversation with account holder Harbor-eafcdcf3c3.\nCustomer message: I need access restored after changing the email address used to sign in. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: This is frustrating, but I appreciat… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 0, "frustration": 1, "refund": false, "repro": false, "severity": 0}, "entity_ids": ["Harbor-eafcdcf3c3"], "family": "evidence", "language": "en+zh", "pro… | {"group_id": "customer-control-v1:42:114", "id": "customer-control-v1:42:114:refund_requested", "kind": "noul", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 0, "frustration": 1, "refund":… | 28 |
| customer-control-v1:42:114:frustration | customer-control-v1:42:114 | validation | customer-control-v1 | score | How frustrated the user appears. Use the current expressed tone. For a reaction that carries no clear emotional valence, the controlled generator has two equally likely latent readings: calm or frustrated but civil. Do not infer very angry without an explicit anger signal. | ["Calm, matter-of-fact","Frustrated but civil","Very angry"] | [0,1,0] | "Conversation with account holder Harbor-eafcdcf3c3.\nCustomer message: I need access restored after changing the email address used to sign in. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: This is frustrating, but I appreciat… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 0, "frustration": 1, "refund": false, "repro": false, "severity": 0}, "entity_ids": ["Harbor-eafcdcf3c3"], "family": "rubric", "language": "en+zh", "prove… | {"group_id": "customer-control-v1:42:114", "id": "customer-control-v1:42:114:frustration", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 0, "frustration": 1, "refund": fal… | 29 |
| customer-control-v1:42:114:churn_likelihood_level | customer-control-v1:42:114 | validation | customer-control-v1 | score | Churn likelihood level. This is a local ordinal intention rubric, not an empirically calibrated prediction of future churn. Evaluate the customer's stated continuation intent. If intent was explicitly withheld or not discussed, the synthetic generator has three equally likely lat… | ["The customer explicitly intends to keep using the service and continue their subscription.","The customer is undecided about continuing, or makes departure conditional on whether the issue is resolved.","The customer explicitly requests cancellation or states a definite decisio… | [1,0,0] | "Conversation with account holder Harbor-eafcdcf3c3.\nCustomer message: I need access restored after changing the email address used to sign in. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: This is frustrating, but I appreciat… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 0, "frustration": 1, "refund": false, "repro": false, "severity": 0}, "entity_ids": ["Harbor-eafcdcf3c3"], "family": "rubric", "language": "en+zh", "prove… | {"group_id": "customer-control-v1:42:114", "id": "customer-control-v1:42:114:churn_likelihood_level", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 0, "frustration": 1, "r… | 30 |
| customer-control-v1:42:205:category | customer-control-v1:42:205 | validation | customer-control-v1 | choice | Determine the broad category of this support ticket. For this controlled task, select the customer's expressly prioritized request. If two requests explicitly have equal priority, allocate equal support to their two categories. A malfunction of an existing feature is bug_report; … | ["billing: Charges, invoices, refunds, subscriptions","feature_request: The user is requesting new functionality","account: Login, permissions, profile, security","bug_report: The user is reporting something that is broken or producing errors"] | [0,0,1,0] | "Conversation with account holder Harbor-f0d73fa817.\nCustomer message: I need access restored after changing the email address used to sign in. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: This is frustrating, but I appreciat… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 1, "frustration": 1, "refund": false, "repro": false, "severity": 0}, "entity_ids": ["Harbor-f0d73fa817"], "family": "routing", "language": "en+zh", "prov… | {"group_id": "customer-control-v1:42:205", "id": "customer-control-v1:42:205:category", "kind": "choice", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 1, "frustration": 1, "refund": false… | 31 |
| customer-control-v1:42:205:bug_severity | customer-control-v1:42:205 | validation | customer-control-v1 | score | How severe is the reported issue? Use the stated functional impact and the existence of a workaround. Use no functional impact when no malfunction is described. In this synthetic control, if a broken feature is described but the availability of a workaround is explicitly unknown,… | ["Cosmetic; no impact to functionality","Broken or degraded feature; workaround exists","Blocking issue; no workaround exists"] | [1,0,0] | "Conversation with account holder Harbor-f0d73fa817.\nCustomer message: I need access restored after changing the email address used to sign in. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: This is frustrating, but I appreciat… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 1, "frustration": 1, "refund": false, "repro": false, "severity": 0}, "entity_ids": ["Harbor-f0d73fa817"], "family": "rubric", "language": "en+zh", "prove… | {"group_id": "customer-control-v1:42:205", "id": "customer-control-v1:42:205:bug_severity", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 1, "frustration": 1, "refund": fa… | 32 |
| customer-control-v1:42:205:has_reproducible_steps | customer-control-v1:42:205 | validation | customer-control-v1 | noul | The user describes specific steps to reproduce the issue. For this controlled task, require at least two ordered user actions and the observed result. A vague report, a resolved historical issue, or an instruction to support staff is insufficient. | ["no","yes"] | [1,0] | "Conversation with account holder Harbor-f0d73fa817.\nCustomer message: I need access restored after changing the email address used to sign in. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: This is frustrating, but I appreciat… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 1, "frustration": 1, "refund": false, "repro": false, "severity": 0}, "entity_ids": ["Harbor-f0d73fa817"], "family": "evidence", "language": "en+zh", "pro… | {"group_id": "customer-control-v1:42:205", "id": "customer-control-v1:42:205:has_reproducible_steps", "kind": "noul", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 1, "frustration": 1, "re… | 33 |
| customer-control-v1:42:205:refund_requested | customer-control-v1:42:205 | validation | customer-control-v1 | noul | The user is explicitly asking for a refund or credit for the current issue. A question about charges, an explicit denial of wanting money back, or a mention of an already completed refund is not a current request. | ["no","yes"] | [1,0] | "Conversation with account holder Harbor-f0d73fa817.\nCustomer message: I need access restored after changing the email address used to sign in. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: This is frustrating, but I appreciat… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 1, "frustration": 1, "refund": false, "repro": false, "severity": 0}, "entity_ids": ["Harbor-f0d73fa817"], "family": "evidence", "language": "en+zh", "pro… | {"group_id": "customer-control-v1:42:205", "id": "customer-control-v1:42:205:refund_requested", "kind": "noul", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 1, "frustration": 1, "refund":… | 34 |
| customer-control-v1:42:205:frustration | customer-control-v1:42:205 | validation | customer-control-v1 | score | How frustrated the user appears. Use the current expressed tone. For a reaction that carries no clear emotional valence, the controlled generator has two equally likely latent readings: calm or frustrated but civil. Do not infer very angry without an explicit anger signal. | ["Calm, matter-of-fact","Frustrated but civil","Very angry"] | [0,1,0] | "Conversation with account holder Harbor-f0d73fa817.\nCustomer message: I need access restored after changing the email address used to sign in. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: This is frustrating, but I appreciat… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 1, "frustration": 1, "refund": false, "repro": false, "severity": 0}, "entity_ids": ["Harbor-f0d73fa817"], "family": "rubric", "language": "en+zh", "prove… | {"group_id": "customer-control-v1:42:205", "id": "customer-control-v1:42:205:frustration", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 1, "frustration": 1, "refund": fal… | 35 |
| customer-control-v1:42:205:churn_likelihood_level | customer-control-v1:42:205 | validation | customer-control-v1 | score | Churn likelihood level. This is a local ordinal intention rubric, not an empirically calibrated prediction of future churn. Evaluate the customer's stated continuation intent. If intent was explicitly withheld or not discussed, the synthetic generator has three equally likely lat… | ["The customer explicitly intends to keep using the service and continue their subscription.","The customer is undecided about continuing, or makes departure conditional on whether the issue is resolved.","The customer explicitly requests cancellation or states a definite decisio… | [0,1,0] | "Conversation with account holder Harbor-f0d73fa817.\nCustomer message: I need access restored after changing the email address used to sign in. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: This is frustrating, but I appreciat… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 1, "frustration": 1, "refund": false, "repro": false, "severity": 0}, "entity_ids": ["Harbor-f0d73fa817"], "family": "rubric", "language": "en+zh", "prove… | {"group_id": "customer-control-v1:42:205", "id": "customer-control-v1:42:205:churn_likelihood_level", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["account"], "churn": 1, "frustration": 1, "r… | 36 |
| customer-control-v1:42:208:category | customer-control-v1:42:208 | validation | customer-control-v1 | choice | Determine the broad category of this support ticket. For this controlled task, select the customer's expressly prioritized request. If two requests explicitly have equal priority, allocate equal support to their two categories. A malfunction of an existing feature is bug_report; … | ["bug_report: The user is reporting something that is broken or producing errors","feature_request: The user is requesting new functionality","billing: Charges, invoices, refunds, subscriptions","account: Login, permissions, profile, security"] | [0,0,1,0] | "Conversation with account holder Harbor-e02f2db8b5.\nCustomer message: My card was charged twice for the same monthly invoice. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: Last month's refund has arrived. Today I only want th… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["billing"], "churn": 2, "frustration": 2, "refund": false, "repro": false, "severity": 0}, "entity_ids": ["Harbor-e02f2db8b5"], "family": "routing", "language": "en+zh", "prov… | {"group_id": "customer-control-v1:42:208", "id": "customer-control-v1:42:208:category", "kind": "choice", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["billing"], "churn": 2, "frustration": 2, "refund": false… | 37 |
| customer-control-v1:42:208:bug_severity | customer-control-v1:42:208 | validation | customer-control-v1 | score | How severe is the reported issue? Use the stated functional impact and the existence of a workaround. Use no functional impact when no malfunction is described. In this synthetic control, if a broken feature is described but the availability of a workaround is explicitly unknown,… | ["Cosmetic; no impact to functionality","Broken or degraded feature; workaround exists","Blocking issue; no workaround exists"] | [1,0,0] | "Conversation with account holder Harbor-e02f2db8b5.\nCustomer message: My card was charged twice for the same monthly invoice. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: Last month's refund has arrived. Today I only want th… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["billing"], "churn": 2, "frustration": 2, "refund": false, "repro": false, "severity": 0}, "entity_ids": ["Harbor-e02f2db8b5"], "family": "rubric", "language": "en+zh", "prove… | {"group_id": "customer-control-v1:42:208", "id": "customer-control-v1:42:208:bug_severity", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["billing"], "churn": 2, "frustration": 2, "refund": fa… | 38 |
| customer-control-v1:42:208:has_reproducible_steps | customer-control-v1:42:208 | validation | customer-control-v1 | noul | The user describes specific steps to reproduce the issue. For this controlled task, require at least two ordered user actions and the observed result. A vague report, a resolved historical issue, or an instruction to support staff is insufficient. | ["no","yes"] | [1,0] | "Conversation with account holder Harbor-e02f2db8b5.\nCustomer message: My card was charged twice for the same monthly invoice. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: Last month's refund has arrived. Today I only want th… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["billing"], "churn": 2, "frustration": 2, "refund": false, "repro": false, "severity": 0}, "entity_ids": ["Harbor-e02f2db8b5"], "family": "evidence", "language": "en+zh", "pro… | {"group_id": "customer-control-v1:42:208", "id": "customer-control-v1:42:208:has_reproducible_steps", "kind": "noul", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["billing"], "churn": 2, "frustration": 2, "re… | 39 |
| customer-control-v1:42:208:refund_requested | customer-control-v1:42:208 | validation | customer-control-v1 | noul | The user is explicitly asking for a refund or credit for the current issue. A question about charges, an explicit denial of wanting money back, or a mention of an already completed refund is not a current request. | ["no","yes"] | [1,0] | "Conversation with account holder Harbor-e02f2db8b5.\nCustomer message: My card was charged twice for the same monthly invoice. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: Last month's refund has arrived. Today I only want th… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["billing"], "churn": 2, "frustration": 2, "refund": false, "repro": false, "severity": 0}, "entity_ids": ["Harbor-e02f2db8b5"], "family": "evidence", "language": "en+zh", "pro… | {"group_id": "customer-control-v1:42:208", "id": "customer-control-v1:42:208:refund_requested", "kind": "noul", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["billing"], "churn": 2, "frustration": 2, "refund":… | 40 |
| customer-control-v1:42:208:frustration | customer-control-v1:42:208 | validation | customer-control-v1 | score | How frustrated the user appears. Use the current expressed tone. For a reaction that carries no clear emotional valence, the controlled generator has two equally likely latent readings: calm or frustrated but civil. Do not infer very angry without an explicit anger signal. | ["Calm, matter-of-fact","Frustrated but civil","Very angry"] | [0,0,1] | "Conversation with account holder Harbor-e02f2db8b5.\nCustomer message: My card was charged twice for the same monthly invoice. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: Last month's refund has arrived. Today I only want th… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["billing"], "churn": 2, "frustration": 2, "refund": false, "repro": false, "severity": 0}, "entity_ids": ["Harbor-e02f2db8b5"], "family": "rubric", "language": "en+zh", "prove… | {"group_id": "customer-control-v1:42:208", "id": "customer-control-v1:42:208:frustration", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["billing"], "churn": 2, "frustration": 2, "refund": fal… | 41 |
| customer-control-v1:42:208:churn_likelihood_level | customer-control-v1:42:208 | validation | customer-control-v1 | score | Churn likelihood level. This is a local ordinal intention rubric, not an empirically calibrated prediction of future churn. Evaluate the customer's stated continuation intent. If intent was explicitly withheld or not discussed, the synthetic generator has three equally likely lat… | ["The customer explicitly intends to keep using the service and continue their subscription.","The customer is undecided about continuing, or makes departure conditional on whether the issue is resolved.","The customer explicitly requests cancellation or states a definite decisio… | [0,0,1] | "Conversation with account holder Harbor-e02f2db8b5.\nCustomer message: My card was charged twice for the same monthly invoice. That is the request I want you to handle first.\nSupport: Please tell us more.\nCustomer response: Last month's refund has arrived. Today I only want th… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["billing"], "churn": 2, "frustration": 2, "refund": false, "repro": false, "severity": 0}, "entity_ids": ["Harbor-e02f2db8b5"], "family": "rubric", "language": "en+zh", "prove… | {"group_id": "customer-control-v1:42:208", "id": "customer-control-v1:42:208:churn_likelihood_level", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["billing"], "churn": 2, "frustration": 2, "r… | 42 |
| customer-control-v1:42:211:category | customer-control-v1:42:211 | validation | customer-control-v1 | choice | Determine the broad category of this support ticket. For this controlled task, select the customer's expressly prioritized request. If two requests explicitly have equal priority, allocate equal support to their two categories. A malfunction of an existing feature is bug_report; … | ["billing: Charges, invoices, refunds, subscriptions","account: Login, permissions, profile, security","feature_request: The user is requesting new functionality","bug_report: The user is reporting something that is broken or producing errors"] | [1,0,0,0] | "Customer Harbor-def87c2eba: My card was charged twice for the same monthly invoice. That is the request I want you to handle first.\nAgent: Could you add the details?\nCustomer: Please explain this charge; I am not asking for money back. Thanks for checking. I am simply reportin… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["billing"], "churn": 0, "frustration": 0, "refund": false, "repro": false, "severity": 0}, "entity_ids": ["Harbor-def87c2eba"], "family": "routing", "language": "en", "provena… | {"group_id": "customer-control-v1:42:211", "id": "customer-control-v1:42:211:category", "kind": "choice", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["billing"], "churn": 0, "frustration": 0, "refund": false… | 43 |
| customer-control-v1:42:211:bug_severity | customer-control-v1:42:211 | validation | customer-control-v1 | score | How severe is the reported issue? Use the stated functional impact and the existence of a workaround. Use no functional impact when no malfunction is described. In this synthetic control, if a broken feature is described but the availability of a workaround is explicitly unknown,… | ["Cosmetic; no impact to functionality","Broken or degraded feature; workaround exists","Blocking issue; no workaround exists"] | [1,0,0] | "Customer Harbor-def87c2eba: My card was charged twice for the same monthly invoice. That is the request I want you to handle first.\nAgent: Could you add the details?\nCustomer: Please explain this charge; I am not asking for money back. Thanks for checking. I am simply reportin… | {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["billing"], "churn": 0, "frustration": 0, "refund": false, "repro": false, "severity": 0}, "entity_ids": ["Harbor-def87c2eba"], "family": "rubric", "language": "en", "provenan… | {"group_id": "customer-control-v1:42:211", "id": "customer-control-v1:42:211:bug_severity", "kind": "score", "metadata": {"case_name": "customer_support_fanout_control", "control_latents": {"ambiguity": "none", "categories": ["billing"], "churn": 0, "frustration": 0, "refund": fa… | 44 |
