{"data":{"id":"10.5281/zenodo.23752423","type":"dois","attributes":{"doi":"10.5281/zenodo.23752423","prefix":"10.5281","suffix":"zenodo.23752423","identifiers":[{"identifier":"oai:zenodo.org:23752423","identifierType":"oai"}],"alternateIdentifiers":[{"alternateIdentifierType":"oai","alternateIdentifier":"oai:zenodo.org:23752423"}],"creators":[{"name":"Armani, Ryan","nameType":"Personal","givenName":"Ryan","familyName":"Armani","affiliation":["Independent researcher"],"nameIdentifiers":[{"nameIdentifier":"0009-0005-9964-6841","nameIdentifierScheme":"ORCID"}]}],"titles":[{"title":"Schema Mutation: Measuring Tool Calls After Interface Changes"}],"publisher":"Zenodo","container":{},"publicationYear":2026,"subjects":[{"subject":"tool use"},{"subject":"schema migration"},{"subject":"benchmark"},{"subject":"simulated controls"}],"contributors":[],"dates":[{"date":"2026-10-29","dateType":"Issued"}],"language":null,"types":{"ris":"GEN","bibtex":"misc","citeproc":"article","schemaOrg":"CreativeWork","resourceType":"","resourceTypeGeneral":"Preprint"},"relatedIdentifiers":[{"relationType":"IsSupplementedBy","relatedIdentifier":"https://github.com/pooriaarab/benchmark-schema-mutation","resourceTypeGeneral":"Software","relatedIdentifierType":"URL"},{"relationType":"IsVersionOf","relatedIdentifier":"10.5281/zenodo.23752422","relatedIdentifierType":"DOI"}],"relatedItems":[],"sizes":[],"formats":[],"version":null,"rightsList":[{"rights":"Creative Commons Attribution 4.0 International","rightsUri":"https://creativecommons.org/licenses/by/4.0/legalcode","schemeUri":"https://spdx.org/licenses/","rightsIdentifier":"cc-by-4.0","rightsIdentifierScheme":"SPDX"}],"descriptions":[{"description":"Tool interfaces change while familiar call patterns remain. Schema Mutation measures whether a call follows the current interface after a migration. The benchmark crosses 12 tool families with 5 mutation types, yielding 60 public tasks. A prompt-only scripted solver achieves 100.0% accuracy (95% Wilson interval 94.0-100.0%). Empty, constant, refusal, echo, and first-tool controls score 0.0% (0.0-6.0%). Exact stale calls fail and receive a separate diagnostic. A simulated population sweep compares pass-through with schema validation. At adherence q=0.5, simulated accuracy is 52.0% (agent-bootstrap interval 50.8-53.2%) under both layers. Validation blocks stale proposals without improving completion. These are scripted and simulated results, not learned-model evaluations. The study supports measurement checks on a synthetic public task set; it does not establish deployment reliability or identify memorization as a cause.","descriptionType":"Abstract"}],"geoLocations":[],"fundingReferences":[],"xml":"PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0iVVRGLTgiPz4KPHJlc291cmNlIHhtbG5zOnhzaT0iaHR0cDovL3d3dy53My5vcmcvMjAwMS9YTUxTY2hlbWEtaW5zdGFuY2UiIHhtbG5zPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCIgeHNpOnNjaGVtYUxvY2F0aW9uPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCBodHRwOi8vc2NoZW1hLmRhdGFjaXRlLm9yZy9tZXRhL2tlcm5lbC00L21ldGFkYXRhLnhzZCI+CiAgPGlkZW50aWZpZXIgaWRlbnRpZmllclR5cGU9IkRPSSI+MTAuNTI4MS9aRU5PRE8uMjM3NTI0MjM8L2lkZW50aWZpZXI+CiAgPGNyZWF0b3JzPgogICAgPGNyZWF0b3I+CiAgICAgIDxjcmVhdG9yTmFtZSBuYW1lVHlwZT0iUGVyc29uYWwiPkFybWFuaSwgUnlhbjwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+UnlhbjwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5Bcm1hbmk8L2ZhbWlseU5hbWU+CiAgICAgIDxuYW1lSWRlbnRpZmllciBuYW1lSWRlbnRpZmllclNjaGVtZT0iT1JDSUQiIHNjaGVtZVVSST0iIj4wMDA5LTAwMDUtOTk2NC02ODQxPC9uYW1lSWRlbnRpZmllcj4KICAgICAgPGFmZmlsaWF0aW9uPkluZGVwZW5kZW50IHJlc2VhcmNoZXI8L2FmZmlsaWF0aW9uPgogICAgPC9jcmVhdG9yPgogIDwvY3JlYXRvcnM+CiAgPHRpdGxlcz4KICAgIDx0aXRsZT5TY2hlbWEgTXV0YXRpb246IE1lYXN1cmluZyBUb29sIENhbGxzIEFmdGVyIEludGVyZmFjZSBDaGFuZ2VzPC90aXRsZT4KICA8L3RpdGxlcz4KICA8cHVibGlzaGVyPlplbm9kbzwvcHVibGlzaGVyPgogIDxwdWJsaWNhdGlvblllYXI+MjAyNjwvcHVibGljYXRpb25ZZWFyPgogIDxyZXNvdXJjZVR5cGUgcmVzb3VyY2VUeXBlR2VuZXJhbD0iUHJlcHJpbnQiLz4KICA8c3ViamVjdHM+CiAgICA8c3ViamVjdD50b29sIHVzZTwvc3ViamVjdD4KICAgIDxzdWJqZWN0PnNjaGVtYSBtaWdyYXRpb248L3N1YmplY3Q+CiAgICA8c3ViamVjdD5iZW5jaG1hcms8L3N1YmplY3Q+CiAgICA8c3ViamVjdD5zaW11bGF0ZWQgY29udHJvbHM8L3N1YmplY3Q+CiAgPC9zdWJqZWN0cz4KICA8ZGF0ZXM+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iSXNzdWVkIj4yMDI2LTEwLTI5PC9kYXRlPgogIDwvZGF0ZXM+CiAgPGFsdGVybmF0ZUlkZW50aWZpZXJzPgogICAgPGFsdGVybmF0ZUlkZW50aWZpZXIgYWx0ZXJuYXRlSWRlbnRpZmllclR5cGU9Im9haSI+b2FpOnplbm9kby5vcmc6MjM3NTI0MjM8L2FsdGVybmF0ZUlkZW50aWZpZXI+CiAgPC9hbHRlcm5hdGVJZGVudGlmaWVycz4KICA8cmVsYXRlZElkZW50aWZpZXJzPgogICAgPHJlbGF0ZWRJZGVudGlmaWVyIHJlbGF0ZWRJZGVudGlmaWVyVHlwZT0iVVJMIiByZWxhdGlvblR5cGU9IklzU3VwcGxlbWVudGVkQnkiIHJlc291cmNlVHlwZUdlbmVyYWw9IlNvZnR3YXJlIj5odHRwczovL2dpdGh1Yi5jb20vcG9vcmlhYXJhYi9iZW5jaG1hcmstc2NoZW1hLW11dGF0aW9uPC9yZWxhdGVkSWRlbnRpZmllcj4KICAgIDxyZWxhdGVkSWRlbnRpZmllciByZWxhdGVkSWRlbnRpZmllclR5cGU9IkRPSSIgcmVsYXRpb25UeXBlPSJJc1ZlcnNpb25PZiI+MTAuNTI4MS96ZW5vZG8uMjM3NTI0MjI8L3JlbGF0ZWRJZGVudGlmaWVyPgogIDwvcmVsYXRlZElkZW50aWZpZXJzPgogIDxzaXplcy8+CiAgPGZvcm1hdHMvPgogIDx2ZXJzaW9uLz4KICA8cmlnaHRzTGlzdD4KICAgIDxyaWdodHMgcmlnaHRzVVJJPSJodHRwczovL2NyZWF0aXZlY29tbW9ucy5vcmcvbGljZW5zZXMvYnkvNC4wL2xlZ2FsY29kZSIgcmlnaHRzSWRlbnRpZmllcj0iY2MtYnktNC4wIiByaWdodHNJZGVudGlmaWVyU2NoZW1lPSJTUERYIiBzY2hlbWVVUkk9Imh0dHBzOi8vc3BkeC5vcmcvbGljZW5zZXMvIj5DcmVhdGl2ZSBDb21tb25zIEF0dHJpYnV0aW9uIDQuMCBJbnRlcm5hdGlvbmFsPC9yaWdodHM+CiAgPC9yaWdodHNMaXN0PgogIDxkZXNjcmlwdGlvbnM+CiAgICA8ZGVzY3JpcHRpb24gZGVzY3JpcHRpb25UeXBlPSJBYnN0cmFjdCI+VG9vbCBpbnRlcmZhY2VzIGNoYW5nZSB3aGlsZSBmYW1pbGlhciBjYWxsIHBhdHRlcm5zIHJlbWFpbi4gU2NoZW1hIE11dGF0aW9uIG1lYXN1cmVzIHdoZXRoZXIgYSBjYWxsIGZvbGxvd3MgdGhlIGN1cnJlbnQgaW50ZXJmYWNlIGFmdGVyIGEgbWlncmF0aW9uLiBUaGUgYmVuY2htYXJrIGNyb3NzZXMgMTIgdG9vbCBmYW1pbGllcyB3aXRoIDUgbXV0YXRpb24gdHlwZXMsIHlpZWxkaW5nIDYwIHB1YmxpYyB0YXNrcy4gQSBwcm9tcHQtb25seSBzY3JpcHRlZCBzb2x2ZXIgYWNoaWV2ZXMgMTAwLjAlIGFjY3VyYWN5ICg5NSUgV2lsc29uIGludGVydmFsIDk0LjAtMTAwLjAlKS4gRW1wdHksIGNvbnN0YW50LCByZWZ1c2FsLCBlY2hvLCBhbmQgZmlyc3QtdG9vbCBjb250cm9scyBzY29yZSAwLjAlICgwLjAtNi4wJSkuIEV4YWN0IHN0YWxlIGNhbGxzIGZhaWwgYW5kIHJlY2VpdmUgYSBzZXBhcmF0ZSBkaWFnbm9zdGljLiBBIHNpbXVsYXRlZCBwb3B1bGF0aW9uIHN3ZWVwIGNvbXBhcmVzIHBhc3MtdGhyb3VnaCB3aXRoIHNjaGVtYSB2YWxpZGF0aW9uLiBBdCBhZGhlcmVuY2UgcT0wLjUsIHNpbXVsYXRlZCBhY2N1cmFjeSBpcyA1Mi4wJSAoYWdlbnQtYm9vdHN0cmFwIGludGVydmFsIDUwLjgtNTMuMiUpIHVuZGVyIGJvdGggbGF5ZXJzLiBWYWxpZGF0aW9uIGJsb2NrcyBzdGFsZSBwcm9wb3NhbHMgd2l0aG91dCBpbXByb3ZpbmcgY29tcGxldGlvbi4gVGhlc2UgYXJlIHNjcmlwdGVkIGFuZCBzaW11bGF0ZWQgcmVzdWx0cywgbm90IGxlYXJuZWQtbW9kZWwgZXZhbHVhdGlvbnMuIFRoZSBzdHVkeSBzdXBwb3J0cyBtZWFzdXJlbWVudCBjaGVja3Mgb24gYSBzeW50aGV0aWMgcHVibGljIHRhc2sgc2V0OyBpdCBkb2VzIG5vdCBlc3RhYmxpc2ggZGVwbG95bWVudCByZWxpYWJpbGl0eSBvciBpZGVudGlmeSBtZW1vcml6YXRpb24gYXMgYSBjYXVzZS48L2Rlc2NyaXB0aW9uPgogIDwvZGVzY3JpcHRpb25zPgo8L3Jlc291cmNlPgo=","url":"https://zenodo.org/doi/10.5281/zenodo.23752423","contentUrl":null,"metadataVersion":2,"schemaVersion":"http://datacite.org/schema/kernel-4","source":"api","isActive":true,"state":"findable","reason":null,"viewCount":0,"viewsOverTime":[],"downloadCount":0,"downloadsOverTime":[],"referenceCount":0,"citationCount":0,"citationsOverTime":[],"partCount":0,"partOfCount":0,"versionCount":0,"versionOfCount":1,"created":"2026-10-29T03:17:35.000Z","registered":"2026-10-29T03:17:35.000Z","published":"2026","updated":"2026-11-07T05:39:27.000Z"},"relationships":{"client":{"data":{"id":"cern.zenodo","type":"clients"}},"provider":{"data":{"id":"cern","type":"providers"}},"media":{"data":{"id":"10.5281/zenodo.23752423","type":"media"}},"references":{"data":[]},"citations":{"data":[]},"parts":{"data":[]},"partOf":{"data":[]},"versions":{"data":[]},"versionOf":{"data":[{"id":"10.5281/zenodo.23752422","type":"dois"}]}}}}