First 50 rows of val
| instruction.txtstring | before.pngImage | target.pngImage | after.pngImage | action.txtstring | transition.json | __key__string | __url__string |
|---|---|---|---|---|---|---|---|
| Select the Export as QIF... option from the File menu. |  |  |
 |
| click (141, 256) on menu item "Export as QIF..." in homebank |
| {"transition_id":"shard-0029__ep__7f3f3d26d2721e8c__t01","episode_id":"shard-0029__ep__7f3f3d26d2721e8c","action_index":1,"before_key":"shard-0029__scene-7f3f3d26d2721e8c-step00","after_key":"shard-0029__scene-7f3f3d26d2721e8c-step01","instruction":{"text":"Select the Export as Q… |
| shard-0029__ep__7f3f3d26d2721e8c__t01 |
| hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Add the factorial function to the current expression. |  |  |  | click (158, 569) on push button "x!" in qalculate-gtk | {"transition_id":"shard-0042__ep__283748a49f4529dd__t01","episode_id":"shard-0042__ep__283748a49f4529dd","action_index":1,"before_key":"shard-0042__scene-283748a49f4529dd-step00","after_key":"shard-0042__scene-283748a49f4529dd-step01","instruction":{"text":"Add the factorial func… | shard-0042__ep__283748a49f4529dd__t01 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Select Financial Mode in the calculator's mode dropdown. |  |  |  | click (1177, 201) on radio button "Financial Mode" in gnome-calculator | {"transition_id":"shard-0120__ep__8a14bdf5dbf93d9d__t04","episode_id":"shard-0120__ep__8a14bdf5dbf93d9d","action_index":4,"before_key":"shard-0120__scene-8a14bdf5dbf93d9d-step03","after_key":"shard-0120__scene-8a14bdf5dbf93d9d-step04","instruction":{"text":"Select Financial Mode … | shard-0120__ep__8a14bdf5dbf93d9d__t04 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Sort the files in the file manager by their size. |  |  |  | click (1034, 123) on table column header "Size" in file-roller | {"transition_id":"shard-0177__ep__3b832a903eccf5ff__t06","episode_id":"shard-0177__ep__3b832a903eccf5ff","action_index":6,"before_key":"shard-0177__scene-3b832a903eccf5ff-step05","after_key":"shard-0177__scene-3b832a903eccf5ff-step06","instruction":{"text":"Sort the files in the … | shard-0177__ep__3b832a903eccf5ff__t06 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Open the file encoding dropdown to view available encoding options. |  |  |  | click (239, 821) on combo box "Default (UTF-8)" in mousepad | {"transition_id":"shard-0219__ep__aea0cdfe8de22bcf__t12","episode_id":"shard-0219__ep__aea0cdfe8de22bcf","action_index":12,"before_key":"shard-0219__scene-aea0cdfe8de22bcf-step11","after_key":"shard-0219__scene-aea0cdfe8de22bcf-step12","instruction":{"text":"Open the file encodin… | shard-0219__ep__aea0cdfe8de22bcf__t12 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Open the News page on the Python Software Foundation website. |  |  |  | click (1669, 1599) on link "News" in chromium-browser | {"transition_id":"shard-0004__ep__f7213fd6b758d597__t02","episode_id":"shard-0004__ep__f7213fd6b758d597","action_index":2,"before_key":"shard-0004__scene-f7213fd6b758d597-step01","after_key":"shard-0004__scene-f7213fd6b758d597-step02","instruction":{"text":"Open the News page on … | shard-0004__ep__f7213fd6b758d597__t02 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Open the Image Viewer menu. |  |  |  | click (1239, 79) on toggle button "Menu" in eog | {"transition_id":"shard-0094__ep__8e13a09a9259c508__t03","episode_id":"shard-0094__ep__8e13a09a9259c508","action_index":3,"before_key":"shard-0094__scene-8e13a09a9259c508-step02","after_key":"shard-0094__scene-8e13a09a9259c508-step03","instruction":{"text":"Open the Image Viewer … | shard-0094__ep__8e13a09a9259c508__t03 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Open the Applications menu to view application categories. |  |  |  | click (46, 14) on menu "Applications" in mate-panel | {"transition_id":"shard-0248__ep__d51b01fbe4330cfe__t04","episode_id":"shard-0248__ep__d51b01fbe4330cfe","action_index":4,"before_key":"shard-0248__scene-d51b01fbe4330cfe-step03","after_key":"shard-0248__scene-d51b01fbe4330cfe-step04","instruction":{"text":"Open the Applications … | shard-0248__ep__d51b01fbe4330cfe__t04 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Open the Explorer panel in Visual Studio Code. |  |  |  | click (66, 131) on page tab in vscode | {"transition_id":"shard-0018__ep__21d432ff2c109ae9__t07","episode_id":"shard-0018__ep__21d432ff2c109ae9","action_index":7,"before_key":"shard-0018__scene-21d432ff2c109ae9-step06","after_key":"shard-0018__scene-21d432ff2c109ae9-step07","instruction":{"text":"Open the Explorer pane… | shard-0018__ep__21d432ff2c109ae9__t07 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Enable the sidebar in the file manager. |  |  |  | click (1752, 309) on check box "Show Sidebar" in nautilus | {"transition_id":"shard-0230__ep__c7c2288554d3771b__t09","episode_id":"shard-0230__ep__c7c2288554d3771b","action_index":9,"before_key":"shard-0230__scene-c7c2288554d3771b-step08","after_key":"shard-0230__scene-c7c2288554d3771b-step09","instruction":{"text":"Enable the sidebar in … | shard-0230__ep__c7c2288554d3771b__t09 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Select the Sort by Size option in the Transmission View menu. |  |  |  | click (317, 376) on radio menu item "Sort by Size" in transmission-gtk | {"transition_id":"shard-0098__ep__ff66a4c8b7f28447__t07","episode_id":"shard-0098__ep__ff66a4c8b7f28447","action_index":7,"before_key":"shard-0098__scene-ff66a4c8b7f28447-step06","after_key":"shard-0098__scene-ff66a4c8b7f28447-step07","instruction":{"text":"Select the Sort by Siz… | shard-0098__ep__ff66a4c8b7f28447__t07 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Disable Keep Aligned in the context menu. |  |  |  | click (1060, 462) on check menu item "Keep Aligned" in ata_ | {"transition_id":"shard-0068__ep__55762ef14f4f51db__t01","episode_id":"shard-0068__ep__55762ef14f4f51db","action_index":1,"before_key":"shard-0068__scene-55762ef14f4f51db-step00","after_key":"shard-0068__scene-55762ef14f4f51db-step01","instruction":{"text":"Disable Keep Aligned i… | shard-0068__ep__55762ef14f4f51db__t01 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Open the Import Page dialog. |  |  |  | click (1800, 975) on menu item "Import Page..." in zim | {"transition_id":"shard-0045__ep__3b097feb150c3353__t01","episode_id":"shard-0045__ep__3b097feb150c3353","action_index":1,"before_key":"shard-0045__scene-3b097feb150c3353-step00","after_key":"shard-0045__scene-3b097feb150c3353-step01","instruction":{"text":"Open the Import Page d… | shard-0045__ep__3b097feb150c3353__t01 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Open the keyboard shortcuts dialog in the Passwords and Keys application. |  |  |  | click (1126, 267) on push button "Keyboard Shortcuts" in seahorse | {"transition_id":"shard-0079__ep__40ffa4ab43a268d9__t02","episode_id":"shard-0079__ep__40ffa4ab43a268d9","action_index":2,"before_key":"shard-0079__scene-40ffa4ab43a268d9-step01","after_key":"shard-0079__scene-40ffa4ab43a268d9-step02","instruction":{"text":"Open the keyboard shor… | shard-0079__ep__40ffa4ab43a268d9__t02 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Initiate saving the current document. |  |  |  | click (1768, 306) on push button "Save" in gnome-text-editor | {"transition_id":"shard-0131__ep__1dea6ac3cc6db5fa__t09","episode_id":"shard-0131__ep__1dea6ac3cc6db5fa","action_index":9,"before_key":"shard-0131__scene-1dea6ac3cc6db5fa-step08","after_key":"shard-0131__scene-1dea6ac3cc6db5fa-step09","instruction":{"text":"Initiate saving the cu… | shard-0131__ep__1dea6ac3cc6db5fa__t09 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Sort the files in the file manager by their last modified date. |  |  |  | click (1371, 254) on table column header "Date Modified" in thunar | {"transition_id":"shard-0139__ep__74ec211052b8cf33__t09","episode_id":"shard-0139__ep__74ec211052b8cf33","action_index":9,"before_key":"shard-0139__scene-74ec211052b8cf33-step08","after_key":"shard-0139__scene-74ec211052b8cf33-step09","instruction":{"text":"Sort the files in the … | shard-0139__ep__74ec211052b8cf33__t09 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Open the Keyboard Shortcuts dialog from the Logs window menu. |  |  |  | click (1426, 594) on push button "Keyboard Shortcuts" in gnome-logs | {"transition_id":"shard-0037__ep__c4b6c361cbd15b8a__t10","episode_id":"shard-0037__ep__c4b6c361cbd15b8a","action_index":10,"before_key":"shard-0037__scene-c4b6c361cbd15b8a-step09","after_key":"shard-0037__scene-c4b6c361cbd15b8a-step10","instruction":{"text":"Open the Keyboard Sho… | shard-0037__ep__c4b6c361cbd15b8a__t10 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Launch the command runner. |  |  |  | click (583, 141) on list item in vscode | {"transition_id":"shard-0123__ep__f1d556c209c43b46__t15","episode_id":"shard-0123__ep__f1d556c209c43b46","action_index":15,"before_key":"shard-0123__scene-f1d556c209c43b46-step14","after_key":"shard-0123__scene-f1d556c209c43b46-step15","instruction":{"text":"Launch the command ru… | shard-0123__ep__f1d556c209c43b46__t15 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Enter the number 1 in the Line number input box. |  |  |  | click (1112, 289) on spin button "1" in mousepad | {"transition_id":"shard-0155__ep__6c74b4f103b1a374__t03","episode_id":"shard-0155__ep__6c74b4f103b1a374","action_index":3,"before_key":"shard-0155__scene-6c74b4f103b1a374-step02","after_key":"shard-0155__scene-6c74b4f103b1a374-step03","instruction":{"text":"Enter the number 1 in … | shard-0155__ep__6c74b4f103b1a374__t03 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Navigate into the /tmp folder in the file list. |  |  |  | click (1411, 169) on menu item "/tmp" in bluefish | {"transition_id":"shard-0292__ep__cdf903421199b15c__t04","episode_id":"shard-0292__ep__cdf903421199b15c","action_index":4,"before_key":"shard-0292__scene-cdf903421199b15c-step03","after_key":"shard-0292__scene-cdf903421199b15c-step04","instruction":{"text":"Navigate into the /tmp… | shard-0292__ep__cdf903421199b15c__t04 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Activate the Password input box on the Facebook login page. |  |  |  | click (1085, 766) on password text "Password" in chromium-browser | {"transition_id":"shard-0047__ep__fb219c39823e4a3f__t01","episode_id":"shard-0047__ep__fb219c39823e4a3f","action_index":1,"before_key":"shard-0047__scene-fb219c39823e4a3f-step00","after_key":"shard-0047__scene-fb219c39823e4a3f-step01","instruction":{"text":"Activate the Password … | shard-0047__ep__fb219c39823e4a3f__t01 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Select the mod unit in the conversion list. |  |  |  | click (689, 1093) on push button "mod" in qalculate-gtk | {"transition_id":"shard-0030__ep__0d1d336d3a053bb5__t01","episode_id":"shard-0030__ep__0d1d336d3a053bb5","action_index":1,"before_key":"shard-0030__scene-0d1d336d3a053bb5-step00","after_key":"shard-0030__scene-0d1d336d3a053bb5-step01","instruction":{"text":"Select the mod unit in… | shard-0030__ep__0d1d336d3a053bb5__t01 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Select the Transactions menu item in the HomeBank window. |  |  |  | click (706, 260) on menu "Transactions" in homebank | {"transition_id":"shard-0022__ep__c4260b110268ec88__t08","episode_id":"shard-0022__ep__c4260b110268ec88","action_index":8,"before_key":"shard-0022__scene-c4260b110268ec88-step07","after_key":"shard-0022__scene-c4260b110268ec88-step08","instruction":{"text":"Select the Transaction… | shard-0022__ep__c4260b110268ec88__t08 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Activate the search input in the file manager. |  |  |  | click (1854, 50) on toggle button in file-roller | {"transition_id":"shard-0034__ep__aa9b4cddc3a4efe7__t03","episode_id":"shard-0034__ep__aa9b4cddc3a4efe7","action_index":3,"before_key":"shard-0034__scene-aa9b4cddc3a4efe7-step02","after_key":"shard-0034__scene-aa9b4cddc3a4efe7-step03","instruction":{"text":"Activate the search in… | shard-0034__ep__aa9b4cddc3a4efe7__t03 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Open Kate from the Accessories menu. |  |  |  | click (296, 286) on menu item "Kate" in mate-panel | {"transition_id":"shard-0264__ep__33e8c6a7cfee8f14__t04","episode_id":"shard-0264__ep__33e8c6a7cfee8f14","action_index":4,"before_key":"shard-0264__scene-33e8c6a7cfee8f14-step03","after_key":"shard-0264__scene-33e8c6a7cfee8f14-step04","instruction":{"text":"Open Kate from the Acc… | shard-0264__ep__33e8c6a7cfee8f14__t04 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Begin the AI onboarding process in Visual Studio Code. |  |  |  | click (934, 388) on link "Generate Agent Instructions" in vscode | {"transition_id":"shard-0289__ep__64874936cd54e247__t10","episode_id":"shard-0289__ep__64874936cd54e247","action_index":10,"before_key":"shard-0289__scene-64874936cd54e247-step09","after_key":"shard-0289__scene-64874936cd54e247-step10","instruction":{"text":"Begin the AI onboardi… | shard-0289__ep__64874936cd54e247__t10 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Turn on the Match case option in the search toolbar. |  |  |  | click (1172, 1671) on check box "Match case" in zim | {"transition_id":"shard-0264__ep__2d40dae9dcf6ac72__t08","episode_id":"shard-0264__ep__2d40dae9dcf6ac72","action_index":8,"before_key":"shard-0264__scene-2d40dae9dcf6ac72-step07","after_key":"shard-0264__scene-2d40dae9dcf6ac72-step08","instruction":{"text":"Turn on the Match case… | shard-0264__ep__2d40dae9dcf6ac72__t08 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Select Keyboard Mode in the calculator's mode dropdown. |  |  |  | click (1942, 931) on radio button "Keyboard Mode" in gnome-calculator | {"transition_id":"shard-0039__ep__f68fbfdc01d2bdbf__t06","episode_id":"shard-0039__ep__f68fbfdc01d2bdbf","action_index":6,"before_key":"shard-0039__scene-f68fbfdc01d2bdbf-step05","after_key":"shard-0039__scene-f68fbfdc01d2bdbf-step06","instruction":{"text":"Select Keyboard Mode i… | shard-0039__ep__f68fbfdc01d2bdbf__t06 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Select the account type dropdown. |  |  |  | click (947, 303) on combo box "/tmp/session-96631s6q/home/kwame/Documents" in bluefish | {"transition_id":"shard-0024__ep__b35e66a337b3bee1__t04","episode_id":"shard-0024__ep__b35e66a337b3bee1","action_index":4,"before_key":"shard-0024__scene-b35e66a337b3bee1-step03","after_key":"shard-0024__scene-b35e66a337b3bee1-step04","instruction":{"text":"Select the account typ… | shard-0024__ep__b35e66a337b3bee1__t04 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Sort the files in the file list by size. |  |  |  | click (1310, 340) on table column header "Size" in mousepad | {"transition_id":"shard-0091__ep__bcef4594a67ff8e7__t02","episode_id":"shard-0091__ep__bcef4594a67ff8e7","action_index":2,"before_key":"shard-0091__scene-bcef4594a67ff8e7-step01","after_key":"shard-0091__scene-bcef4594a67ff8e7-step02","instruction":{"text":"Sort the files in the … | shard-0091__ep__bcef4594a67ff8e7__t02 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Open the gpfso_bench folder from the file manager sidebar. |  |  |  | click (810, 605) on list item in nautilus | {"transition_id":"shard-0215__ep__0c1d72adc3e8c128__t02","episode_id":"shard-0215__ep__0c1d72adc3e8c128","action_index":2,"before_key":"shard-0215__scene-0c1d72adc3e8c128-step01","after_key":"shard-0215__scene-0c1d72adc3e8c128-step02","instruction":{"text":"Open the gpfso_bench f… | shard-0215__ep__0c1d72adc3e8c128__t02 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Enable the display of hidden files in the file manager. |  |  |  | click (247, 321) on check menu item "Show Hidden Files" in thunar | {"transition_id":"shard-0228__ep__9f7f30f521b5ead7__t11","episode_id":"shard-0228__ep__9f7f30f521b5ead7","action_index":11,"before_key":"shard-0228__scene-9f7f30f521b5ead7-step10","after_key":"shard-0228__scene-9f7f30f521b5ead7-step11","instruction":{"text":"Enable the display of… | shard-0228__ep__9f7f30f521b5ead7__t11 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Close the Transmission dialog by selecting Cancel. |  |  |  | click (602, 427) on push button "Cancel" in transmission-gtk | {"transition_id":"shard-0059__ep__d96dad1d3555dd83__t03","episode_id":"shard-0059__ep__d96dad1d3555dd83","action_index":3,"before_key":"shard-0059__scene-d96dad1d3555dd83-step02","after_key":"shard-0059__scene-d96dad1d3555dd83-step03","instruction":{"text":"Close the Transmission… | shard-0059__ep__d96dad1d3555dd83__t03 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Open the Preferences window. |  |  |  | click (1864, 1490) on push button "Preferences" in gnome-text-editor | {"transition_id":"shard-0001__ep__beb9d3f0266af912__t02","episode_id":"shard-0001__ep__beb9d3f0266af912","action_index":2,"before_key":"shard-0001__scene-beb9d3f0266af912-step01","after_key":"shard-0001__scene-beb9d3f0266af912-step02","instruction":{"text":"Open the Preferences w… | shard-0001__ep__beb9d3f0266af912__t02 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Open the context menu for the image viewer. |  |  |  | click (1770, 22) on toggle button "Menu" in eog | {"transition_id":"shard-0020__ep__5a58144456db1a4c__t02","episode_id":"shard-0020__ep__5a58144456db1a4c","action_index":2,"before_key":"shard-0020__scene-5a58144456db1a4c-step01","after_key":"shard-0020__scene-5a58144456db1a4c-step02","instruction":{"text":"Open the context menu … | shard-0020__ep__5a58144456db1a4c__t02 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Open the Search panel in Visual Studio Code. |  |  |  | click (210, 258) on page tab in vscode | {"transition_id":"shard-0052__ep__a30c65c6a66f65b6__t13","episode_id":"shard-0052__ep__a30c65c6a66f65b6","action_index":13,"before_key":"shard-0052__scene-a30c65c6a66f65b6-step12","after_key":"shard-0052__scene-a30c65c6a66f65b6-step13","instruction":{"text":"Open the Search panel… | shard-0052__ep__a30c65c6a66f65b6__t13 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Activate the search input field in the Logs window. |  |  |  | click (1187, 317) on toggle button in gnome-logs | {"transition_id":"shard-0020__ep__c7c358f31e8a9f7a__t06","episode_id":"shard-0020__ep__c7c358f31e8a9f7a","action_index":6,"before_key":"shard-0020__scene-c7c358f31e8a9f7a-step05","after_key":"shard-0020__scene-c7c358f31e8a9f7a-step06","instruction":{"text":"Activate the search in… | shard-0020__ep__c7c358f31e8a9f7a__t06 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Open the Keyboard Shortcuts settings. |  |  |  | click (426, 287) on push button "Keyboard Shortcuts" in seahorse | {"transition_id":"shard-0237__ep__2129d6e5bab85bb8__t04","episode_id":"shard-0237__ep__2129d6e5bab85bb8","action_index":4,"before_key":"shard-0237__scene-2129d6e5bab85bb8-step03","after_key":"shard-0237__scene-2129d6e5bab85bb8-step04","instruction":{"text":"Open the Keyboard Shor… | shard-0237__ep__2129d6e5bab85bb8__t04 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Select the Sort by Progress option in the Transmission View menu. |  |  |  | click (302, 304) on radio menu item "Sort by Progress" in transmission-gtk | {"transition_id":"shard-0235__ep__185b17c598c4aaa5__t06","episode_id":"shard-0235__ep__185b17c598c4aaa5","action_index":6,"before_key":"shard-0235__scene-185b17c598c4aaa5-step05","after_key":"shard-0235__scene-185b17c598c4aaa5-step06","instruction":{"text":"Select the Sort by Pro… | shard-0235__ep__185b17c598c4aaa5__t06 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Select the Ci option from the calculator's function menu. |  |  |  | click (701, 168) on menu item "Ci" in qalculate-gtk | {"transition_id":"shard-0056__ep__a477ea8b9c41fb10__t05","episode_id":"shard-0056__ep__a477ea8b9c41fb10","action_index":5,"before_key":"shard-0056__scene-a477ea8b9c41fb10-step04","after_key":"shard-0056__scene-a477ea8b9c41fb10-step05","instruction":{"text":"Select the Ci option f… | shard-0056__ep__a477ea8b9c41fb10__t05 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Go to the About page. |  |  |  | click (707, 1601) on link "About" in chromium-browser | {"transition_id":"shard-0045__ep__33ee9604f065b0c5__t01","episode_id":"shard-0045__ep__33ee9604f065b0c5","action_index":1,"before_key":"shard-0045__scene-33ee9604f065b0c5-step00","after_key":"shard-0045__scene-33ee9604f065b0c5-step01","instruction":{"text":"Go to the About page."… | shard-0045__ep__33ee9604f065b0c5__t01 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Organize the desktop by name. |  |  |  | click (723, 493) on menu item "Organize Desktop by Name" in ata_ | {"transition_id":"shard-0010__ep__24401173323d83a7__t02","episode_id":"shard-0010__ep__24401173323d83a7","action_index":2,"before_key":"shard-0010__scene-24401173323d83a7-step01","after_key":"shard-0010__scene-24401173323d83a7-step02","instruction":{"text":"Organize the desktop b… | shard-0010__ep__24401173323d83a7__t02 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Open the Products section. |  |  |  | click (561, 178) on menu item "Products" in chromium-browser | {"transition_id":"shard-0035__ep__426a94cd5d5ef4db__t02","episode_id":"shard-0035__ep__426a94cd5d5ef4db","action_index":2,"before_key":"shard-0035__scene-426a94cd5d5ef4db-step01","after_key":"shard-0035__scene-426a94cd5d5ef4db-step02","instruction":{"text":"Open the Products sect… | shard-0035__ep__426a94cd5d5ef4db__t02 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Exit fullscreen mode in the image viewer. |  |  |  | click (1414, 79) on push button "Fullscreen" in eog | {"transition_id":"shard-0035__ep__4da47e1ac2f68ce7__t01","episode_id":"shard-0035__ep__4da47e1ac2f68ce7","action_index":1,"before_key":"shard-0035__scene-4da47e1ac2f68ce7-step00","after_key":"shard-0035__scene-4da47e1ac2f68ce7-step01","instruction":{"text":"Exit fullscreen mode i… | shard-0035__ep__4da47e1ac2f68ce7__t01 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Select the 'New Window' option from the dropdown menu to open a new instance of the application. |  |  |  | click (817, 457) on menu item "New Window" in mousepad | {"transition_id":"shard-0129__ep__cd8ee080758217bf__t01","episode_id":"shard-0129__ep__cd8ee080758217bf","action_index":1,"before_key":"shard-0129__scene-cd8ee080758217bf-step00","after_key":"shard-0129__scene-cd8ee080758217bf-step01","instruction":{"text":"Select the 'New Window… | shard-0129__ep__cd8ee080758217bf__t01 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Open the Add transaction dialog in the HomeBank application. |  |  |  | click (1255, 168) on push button "Add" in homebank | {"transition_id":"shard-0047__ep__7bb51380cdc1d650__t06","episode_id":"shard-0047__ep__7bb51380cdc1d650","action_index":6,"before_key":"shard-0047__scene-7bb51380cdc1d650-step05","after_key":"shard-0047__scene-7bb51380cdc1d650-step06","instruction":{"text":"Open the Add transacti… | shard-0047__ep__7bb51380cdc1d650__t06 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Launch the AI onboarding by selecting Generate Agent Instructions. |  |  |  | click (3592, 546) on link "Generate Agent Instructions" in vscode | {"transition_id":"shard-0246__ep__e12010bf8c4cb59d__t04","episode_id":"shard-0246__ep__e12010bf8c4cb59d","action_index":4,"before_key":"shard-0246__scene-e12010bf8c4cb59d-step03","after_key":"shard-0246__scene-e12010bf8c4cb59d-step04","instruction":{"text":"Launch the AI onboardi… | shard-0246__ep__e12010bf8c4cb59d__t04 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| In the text editor window titled 'Untitled Document 1', open the save dialog. |  |  |  | click (1744, 575) on push button "Save" in gnome-text-editor | {"transition_id":"shard-0044__ep__d23fd9d5834c2a12__t07","episode_id":"shard-0044__ep__d23fd9d5834c2a12","action_index":7,"before_key":"shard-0044__scene-d23fd9d5834c2a12-step06","after_key":"shard-0044__scene-d23fd9d5834c2a12-step07","instruction":{"text":"In the text editor win… | shard-0044__ep__d23fd9d5834c2a12__t07 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Open the Functions menu in the calculator application. |  |  |  | click (867, 119) on menu "Functions" in qalculate-gtk | {"transition_id":"shard-0145__ep__4dd32bbaa211ebed__t03","episode_id":"shard-0145__ep__4dd32bbaa211ebed","action_index":3,"before_key":"shard-0145__scene-4dd32bbaa211ebed-step02","after_key":"shard-0145__scene-4dd32bbaa211ebed-step03","instruction":{"text":"Open the Functions men… | shard-0145__ep__4dd32bbaa211ebed__t03 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
| Open the Format dropdown menu in the note editor. |  |  |  | click (1175, 190) on menu "Format" in zim | {"transition_id":"shard-0186__ep__df3d66ea9cda208b__t03","episode_id":"shard-0186__ep__df3d66ea9cda208b","action_index":3,"before_key":"shard-0186__scene-df3d66ea9cda208b-step02","after_key":"shard-0186__scene-df3d66ea9cda208b-step03","instruction":{"text":"Open the Format dropdo… | shard-0186__ep__df3d66ea9cda208b__t03 | hf://datasets/docling-project/DeskForge-1M@e60c169095f5b1d1f7dad68b64d4a5c8f8ba9f85/demo/transitions/val.tar |
