{"data":{"id":"10.48550/arxiv.2611.02950","type":"dois","attributes":{"doi":"10.48550/arxiv.2611.02950","prefix":"10.48550","suffix":"arxiv.2611.02950","identifiers":[{"identifier":"2611.02950","identifierType":"arXiv"}],"alternateIdentifiers":[{"alternateIdentifierType":"arXiv","alternateIdentifier":"2611.02950"}],"creators":[{"name":"Oh, Minhyeon","nameType":"Personal","givenName":"Minhyeon","familyName":"Oh","affiliation":[],"nameIdentifiers":[]},{"name":"Heo, Chiyeong","nameType":"Personal","givenName":"Chiyeong","familyName":"Heo","affiliation":[],"nameIdentifiers":[]},{"name":"Noh, Geonwoo","nameType":"Personal","givenName":"Geonwoo","familyName":"Noh","affiliation":[],"nameIdentifiers":[]},{"name":"Kim, Hoyoung","nameType":"Personal","givenName":"Hoyoung","familyName":"Kim","affiliation":[],"nameIdentifiers":[]},{"name":"Son, Jangwon","nameType":"Personal","givenName":"Jangwon","familyName":"Son","affiliation":[],"nameIdentifiers":[]},{"name":"Ok, Jungseul","nameType":"Personal","givenName":"Jungseul","familyName":"Ok","affiliation":[],"nameIdentifiers":[]}],"titles":[{"title":"Action Verification through Conjecture and Refutation for Language Model Agents"}],"publisher":"arXiv","container":{},"publicationYear":2026,"subjects":[{"lang":"en","subject":"Artificial Intelligence (cs.AI)","subjectScheme":"arXiv"},{"lang":"en","subject":"Computation and Language (cs.CL)","subjectScheme":"arXiv"},{"lang":"en","subject":"Machine Learning (cs.LG)","subjectScheme":"arXiv"},{"subject":"FOS: Computer and information sciences","subjectScheme":"Fields of Science and Technology (FOS)"}],"contributors":[],"dates":[{"date":"2026-11-02T11:15:40Z","dateType":"Submitted","dateInformation":"v1"},{"date":"2026-11-03T05:36:16Z","dateType":"Updated","dateInformation":"v1"},{"date":"2026-11","dateType":"Available","dateInformation":"v1"}],"language":null,"types":{"ris":"GEN","bibtex":"misc","citeproc":"article","schemaOrg":"CreativeWork","resourceType":"Article","resourceTypeGeneral":"Preprint"},"relatedIdentifiers":[],"relatedItems":[],"sizes":[],"formats":[],"version":"1","rightsList":[{"rights":"arXiv.org perpetual, non-exclusive license","rightsUri":"http://arxiv.org/licenses/nonexclusive-distrib/1.0/"}],"descriptions":[{"description":"Language model agents increasingly act on users' behalf by manipulating external environments through tools, often from high-level instructions that leave critical task- and environment-specific context unstated. To prevent resulting misaligned actions, recent work verifies proposed actions before execution, largely by establishing whether the conditions supporting them hold. We argue that this confirmation-oriented view leaves a fundamental blind spot: a wrong action often passes every check that asks whether it is right. This motivates a different question for verification: rather than asking what evidence supports an action, can the agent find evidence that refutes it? We pursue this direction with BlackSwan, a refutation-oriented, expect-suspect-test procedure that predicts the intended effect of each state-mutating action, formulates specific and empirically testable hypotheses for how it could be wrong, and tests them using existing observations or additional non-mutating actions, executing the action only if none survives testing. On challenging AppWorld tasks, BlackSwan improves success rate over the strongest baseline by 14.9 and 25.2%p with and without the backbone model's thinking mode, respectively. Even without thinking or in-context demonstrations, it outperforms stronger baselines equipped with them. The gains also transfer beyond AppWorld, with BlackSwan improving WebShop performance by 12.7%p. More broadly, our results suggest that language model agents have an underused capacity to recognize and self-correct misaligned actions, which can be systematically elicited through active conjecture and refutation before execution.","descriptionType":"Abstract"}],"geoLocations":[],"fundingReferences":[],"xml":"PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0iVVRGLTgiPz4KPHJlc291cmNlIHhtbG5zPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSIgeHNpOnNjaGVtYUxvY2F0aW9uPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCBodHRwOi8vc2NoZW1hLmRhdGFjaXRlLm9yZy9tZXRhL2tlcm5lbC00LjMvbWV0YWRhdGEueHNkIj4KICA8aWRlbnRpZmllciBpZGVudGlmaWVyVHlwZT0iRE9JIj4xMC40ODU1MC9BUlhJVi4yNjExLjAyOTUwPC9pZGVudGlmaWVyPgogIDxhbHRlcm5hdGVJZGVudGlmaWVycz4KICAgIDxhbHRlcm5hdGVJZGVudGlmaWVyIGFsdGVybmF0ZUlkZW50aWZpZXJUeXBlPSJhclhpdiI+MjYxMS4wMjk1MDwvYWx0ZXJuYXRlSWRlbnRpZmllcj4KICA8L2FsdGVybmF0ZUlkZW50aWZpZXJzPgogIDxjcmVhdG9ycz4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5PaCwgTWluaHllb248L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPk1pbmh5ZW9uPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPk9oPC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogICAgPGNyZWF0b3I+CiAgICAgIDxjcmVhdG9yTmFtZSBuYW1lVHlwZT0iUGVyc29uYWwiPkhlbywgQ2hpeWVvbmc8L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPkNoaXllb25nPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPkhlbzwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5Ob2gsIEdlb253b288L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPkdlb253b288L2dpdmVuTmFtZT4KICAgICAgPGZhbWlseU5hbWU+Tm9oPC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogICAgPGNyZWF0b3I+CiAgICAgIDxjcmVhdG9yTmFtZSBuYW1lVHlwZT0iUGVyc29uYWwiPktpbSwgSG95b3VuZzwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+SG95b3VuZzwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5LaW08L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgICA8Y3JlYXRvcj4KICAgICAgPGNyZWF0b3JOYW1lIG5hbWVUeXBlPSJQZXJzb25hbCI+U29uLCBKYW5nd29uPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5KYW5nd29uPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPlNvbjwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5PaywgSnVuZ3NldWw8L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPkp1bmdzZXVsPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPk9rPC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogIDwvY3JlYXRvcnM+CiAgPHRpdGxlcz4KICAgIDx0aXRsZT5BY3Rpb24gVmVyaWZpY2F0aW9uIHRocm91Z2ggQ29uamVjdHVyZSBhbmQgUmVmdXRhdGlvbiBmb3IgTGFuZ3VhZ2UgTW9kZWwgQWdlbnRzPC90aXRsZT4KICA8L3RpdGxlcz4KICA8cHVibGlzaGVyPmFyWGl2PC9wdWJsaXNoZXI+CiAgPHB1YmxpY2F0aW9uWWVhcj4yMDI2PC9wdWJsaWNhdGlvblllYXI+CiAgPHN1YmplY3RzPgogICAgPHN1YmplY3QgeG1sOmxhbmc9ImVuIiBzdWJqZWN0U2NoZW1lPSJhclhpdiI+QXJ0aWZpY2lhbCBJbnRlbGxpZ2VuY2UgKGNzLkFJKTwvc3ViamVjdD4KICAgIDxzdWJqZWN0IHhtbDpsYW5nPSJlbiIgc3ViamVjdFNjaGVtZT0iYXJYaXYiPkNvbXB1dGF0aW9uIGFuZCBMYW5ndWFnZSAoY3MuQ0wpPC9zdWJqZWN0PgogICAgPHN1YmplY3QgeG1sOmxhbmc9ImVuIiBzdWJqZWN0U2NoZW1lPSJhclhpdiI+TWFjaGluZSBMZWFybmluZyAoY3MuTEcpPC9zdWJqZWN0PgogICAgPHN1YmplY3Qgc3ViamVjdFNjaGVtZT0iRmllbGRzIG9mIFNjaWVuY2UgYW5kIFRlY2hub2xvZ3kgKEZPUykiPkZPUzogQ29tcHV0ZXIgYW5kIGluZm9ybWF0aW9uIHNjaWVuY2VzPC9zdWJqZWN0PgogIDwvc3ViamVjdHM+CiAgPGRhdGVzPgogICAgPGRhdGUgZGF0ZVR5cGU9IlN1Ym1pdHRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2MSI+MjAyNi0xMS0wMlQxMToxNTo0MFo8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iVXBkYXRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2MSI+MjAyNi0xMS0wM1QwNTozNjoxNlo8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iQXZhaWxhYmxlIiBkYXRlSW5mb3JtYXRpb249InYxIj4yMDI2LTExPC9kYXRlPgogIDwvZGF0ZXM+CiAgPHJlc291cmNlVHlwZSByZXNvdXJjZVR5cGVHZW5lcmFsPSJQcmVwcmludCI+QXJ0aWNsZTwvcmVzb3VyY2VUeXBlPgogIDx2ZXJzaW9uPjE8L3ZlcnNpb24+CiAgPHJpZ2h0c0xpc3Q+CiAgICA8cmlnaHRzIHJpZ2h0c1VSST0iaHR0cDovL2FyeGl2Lm9yZy9saWNlbnNlcy9ub25leGNsdXNpdmUtZGlzdHJpYi8xLjAvIj5hclhpdi5vcmcgcGVycGV0dWFsLCBub24tZXhjbHVzaXZlIGxpY2Vuc2U8L3JpZ2h0cz4KICA8L3JpZ2h0c0xpc3Q+CiAgPGRlc2NyaXB0aW9ucz4KICAgIDxkZXNjcmlwdGlvbiBkZXNjcmlwdGlvblR5cGU9IkFic3RyYWN0Ij5MYW5ndWFnZSBtb2RlbCBhZ2VudHMgaW5jcmVhc2luZ2x5IGFjdCBvbiB1c2VycycgYmVoYWxmIGJ5IG1hbmlwdWxhdGluZyBleHRlcm5hbCBlbnZpcm9ubWVudHMgdGhyb3VnaCB0b29scywgb2Z0ZW4gZnJvbSBoaWdoLWxldmVsIGluc3RydWN0aW9ucyB0aGF0IGxlYXZlIGNyaXRpY2FsIHRhc2stIGFuZCBlbnZpcm9ubWVudC1zcGVjaWZpYyBjb250ZXh0IHVuc3RhdGVkLiBUbyBwcmV2ZW50IHJlc3VsdGluZyBtaXNhbGlnbmVkIGFjdGlvbnMsIHJlY2VudCB3b3JrIHZlcmlmaWVzIHByb3Bvc2VkIGFjdGlvbnMgYmVmb3JlIGV4ZWN1dGlvbiwgbGFyZ2VseSBieSBlc3RhYmxpc2hpbmcgd2hldGhlciB0aGUgY29uZGl0aW9ucyBzdXBwb3J0aW5nIHRoZW0gaG9sZC4gV2UgYXJndWUgdGhhdCB0aGlzIGNvbmZpcm1hdGlvbi1vcmllbnRlZCB2aWV3IGxlYXZlcyBhIGZ1bmRhbWVudGFsIGJsaW5kIHNwb3Q6IGEgd3JvbmcgYWN0aW9uIG9mdGVuIHBhc3NlcyBldmVyeSBjaGVjayB0aGF0IGFza3Mgd2hldGhlciBpdCBpcyByaWdodC4gVGhpcyBtb3RpdmF0ZXMgYSBkaWZmZXJlbnQgcXVlc3Rpb24gZm9yIHZlcmlmaWNhdGlvbjogcmF0aGVyIHRoYW4gYXNraW5nIHdoYXQgZXZpZGVuY2Ugc3VwcG9ydHMgYW4gYWN0aW9uLCBjYW4gdGhlIGFnZW50IGZpbmQgZXZpZGVuY2UgdGhhdCByZWZ1dGVzIGl0PyBXZSBwdXJzdWUgdGhpcyBkaXJlY3Rpb24gd2l0aCBCbGFja1N3YW4sIGEgcmVmdXRhdGlvbi1vcmllbnRlZCwgZXhwZWN0LXN1c3BlY3QtdGVzdCBwcm9jZWR1cmUgdGhhdCBwcmVkaWN0cyB0aGUgaW50ZW5kZWQgZWZmZWN0IG9mIGVhY2ggc3RhdGUtbXV0YXRpbmcgYWN0aW9uLCBmb3JtdWxhdGVzIHNwZWNpZmljIGFuZCBlbXBpcmljYWxseSB0ZXN0YWJsZSBoeXBvdGhlc2VzIGZvciBob3cgaXQgY291bGQgYmUgd3JvbmcsIGFuZCB0ZXN0cyB0aGVtIHVzaW5nIGV4aXN0aW5nIG9ic2VydmF0aW9ucyBvciBhZGRpdGlvbmFsIG5vbi1tdXRhdGluZyBhY3Rpb25zLCBleGVjdXRpbmcgdGhlIGFjdGlvbiBvbmx5IGlmIG5vbmUgc3Vydml2ZXMgdGVzdGluZy4gT24gY2hhbGxlbmdpbmcgQXBwV29ybGQgdGFza3MsIEJsYWNrU3dhbiBpbXByb3ZlcyBzdWNjZXNzIHJhdGUgb3ZlciB0aGUgc3Ryb25nZXN0IGJhc2VsaW5lIGJ5IDE0LjkgYW5kIDI1LjIlcCB3aXRoIGFuZCB3aXRob3V0IHRoZSBiYWNrYm9uZSBtb2RlbCdzIHRoaW5raW5nIG1vZGUsIHJlc3BlY3RpdmVseS4gRXZlbiB3aXRob3V0IHRoaW5raW5nIG9yIGluLWNvbnRleHQgZGVtb25zdHJhdGlvbnMsIGl0IG91dHBlcmZvcm1zIHN0cm9uZ2VyIGJhc2VsaW5lcyBlcXVpcHBlZCB3aXRoIHRoZW0uIFRoZSBnYWlucyBhbHNvIHRyYW5zZmVyIGJleW9uZCBBcHBXb3JsZCwgd2l0aCBCbGFja1N3YW4gaW1wcm92aW5nIFdlYlNob3AgcGVyZm9ybWFuY2UgYnkgMTIuNyVwLiBNb3JlIGJyb2FkbHksIG91ciByZXN1bHRzIHN1Z2dlc3QgdGhhdCBsYW5ndWFnZSBtb2RlbCBhZ2VudHMgaGF2ZSBhbiB1bmRlcnVzZWQgY2FwYWNpdHkgdG8gcmVjb2duaXplIGFuZCBzZWxmLWNvcnJlY3QgbWlzYWxpZ25lZCBhY3Rpb25zLCB3aGljaCBjYW4gYmUgc3lzdGVtYXRpY2FsbHkgZWxpY2l0ZWQgdGhyb3VnaCBhY3RpdmUgY29uamVjdHVyZSBhbmQgcmVmdXRhdGlvbiBiZWZvcmUgZXhlY3V0aW9uLjwvZGVzY3JpcHRpb24+CiAgPC9kZXNjcmlwdGlvbnM+CjwvcmVzb3VyY2U+","url":"https://arxiv.org/abs/2611.02950","contentUrl":null,"metadataVersion":0,"schemaVersion":"http://datacite.org/schema/kernel-4","source":"mds","isActive":true,"state":"findable","reason":null,"viewCount":0,"viewsOverTime":[],"downloadCount":0,"downloadsOverTime":[],"referenceCount":0,"citationCount":0,"citationsOverTime":[],"partCount":0,"partOfCount":0,"versionCount":0,"versionOfCount":0,"created":"2026-11-03T10:05:15.000Z","registered":"2026-11-03T10:05:16.000Z","published":"2026","updated":"2026-11-03T10:05:16.000Z"},"relationships":{"client":{"data":{"id":"arxiv.content","type":"clients"}},"provider":{"data":{"id":"arxiv","type":"providers"}},"media":{"data":{"id":"10.48550/arxiv.2611.02950","type":"media"}},"references":{"data":[]},"citations":{"data":[]},"parts":{"data":[]},"partOf":{"data":[]},"versions":{"data":[]},"versionOf":{"data":[]}}}}