{"data":{"id":"10.48550/arxiv.1811.02429","type":"dois","attributes":{"doi":"10.48550/arxiv.1811.02429","prefix":"10.48550","suffix":"arxiv.1811.02429","identifiers":[{"identifier":"1811.02429","identifierType":"arXiv"}],"alternateIdentifiers":[{"alternateIdentifierType":"arXiv","alternateIdentifier":"1811.02429"}],"creators":[{"name":"Martinez, Matias","nameType":"Personal","givenName":"Matias","familyName":"Martinez","affiliation":[],"nameIdentifiers":[]},{"name":"Durieux, Thomas","nameType":"Personal","givenName":"Thomas","familyName":"Durieux","affiliation":[],"nameIdentifiers":[]},{"name":"Sommerard, Romain","nameType":"Personal","givenName":"Romain","familyName":"Sommerard","affiliation":[],"nameIdentifiers":[]},{"name":"Xuan, Jifeng","nameType":"Personal","givenName":"Jifeng","familyName":"Xuan","affiliation":[],"nameIdentifiers":[]},{"name":"Monperrus, Martin","nameType":"Personal","givenName":"Martin","familyName":"Monperrus","affiliation":[],"nameIdentifiers":[]}],"titles":[{"title":"Automatic Repair of Real Bugs in Java: A Large-Scale Experiment on the Defects4J Dataset"}],"publisher":"arXiv","container":{},"publicationYear":2018,"subjects":[{"lang":"en","subject":"Software Engineering (cs.SE)","subjectScheme":"arXiv"},{"subject":"FOS: Computer and information sciences","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Computer and information sciences","schemeUri":"http://www.oecd.org/science/inno/38235147.pdf","subjectScheme":"Fields of Science and Technology (FOS)"}],"contributors":[],"dates":[{"date":"2018-11-04T14:31:05Z","dateType":"Submitted","dateInformation":"v1"},{"date":"2021-11-12T01:18:26Z","dateType":"Updated","dateInformation":"v1"},{"date":"2018-11","dateType":"Available","dateInformation":"v1"},{"date":"2018","dateType":"Issued"}],"language":null,"types":{"ris":"RPRT","bibtex":"article","citeproc":"article-journal","schemaOrg":"ScholarlyArticle","resourceType":"Article","resourceTypeGeneral":"Text"},"relatedIdentifiers":[{"relationType":"IsVersionOf","relatedIdentifier":"10.1007/s10664-016-9470-4","relatedIdentifierType":"DOI"}],"relatedItems":[],"sizes":[],"formats":[],"version":"1","rightsList":[{"rights":"arXiv.org perpetual, non-exclusive license","rightsUri":"http://arxiv.org/licenses/nonexclusive-distrib/1.0/"}],"descriptions":[{"description":"Defects4J is a large, peer-reviewed, structured dataset of real-world Java bugs. Each bug in Defects4J comes with a test suite and at least one failing test case that triggers the bug. In this paper, we report on an experiment to explore the effectiveness of automatic test-suite based repair on Defects4J. The result of our experiment shows that the considered state-of-the-art repair methods can generate patches for 47 out of 224 bugs. However, those patches are only test-suite adequate, which means that they pass the test suite and may potentially be incorrect beyond the test-suite satisfaction correctness criterion. We have manually analyzed 84 different patches to assess their real correctness. In total, 9 real Java bugs can be correctly repaired with test-suite based repair. This analysis shows that test-suite based repair suffers from under-specified bugs, for which trivial or incorrect patches still pass the test suite. With respect to practical applicability, it takes on average 14.8 minutes to find a patch. The experiment was done on a scientific grid, totaling 17.6 days of computation time. All the repair systems and experimental results are publicly available on Github in order to facilitate future research on automatic repair.","descriptionType":"Abstract"},{"description":"Empirical Software Engineering, Springer, 2016. arXiv admin note: substantial text overlap with arXiv:1505.07002","descriptionType":"Other"}],"geoLocations":[],"fundingReferences":[],"xml":"PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4KPHJlc291cmNlIHhtbG5zPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSIgeHNpOnNjaGVtYUxvY2F0aW9uPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCBodHRwOi8vc2NoZW1hLmRhdGFjaXRlLm9yZy9tZXRhL2tlcm5lbC00LjMvbWV0YWRhdGEueHNkIj4KICA8aWRlbnRpZmllciBpZGVudGlmaWVyVHlwZT0iRE9JIj4xMC40ODU1MC9BUlhJVi4xODExLjAyNDI5PC9pZGVudGlmaWVyPgogIDxhbHRlcm5hdGVJZGVudGlmaWVycz4KICAgIDxhbHRlcm5hdGVJZGVudGlmaWVyIGFsdGVybmF0ZUlkZW50aWZpZXJUeXBlPSJhclhpdiI+MTgxMS4wMjQyOTwvYWx0ZXJuYXRlSWRlbnRpZmllcj4KICA8L2FsdGVybmF0ZUlkZW50aWZpZXJzPgogIDxjcmVhdG9ycz4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5NYXJ0aW5leiwgTWF0aWFzPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5NYXRpYXM8L2dpdmVuTmFtZT4KICAgICAgPGZhbWlseU5hbWU+TWFydGluZXo8L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgICA8Y3JlYXRvcj4KICAgICAgPGNyZWF0b3JOYW1lIG5hbWVUeXBlPSJQZXJzb25hbCI+RHVyaWV1eCwgVGhvbWFzPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5UaG9tYXM8L2dpdmVuTmFtZT4KICAgICAgPGZhbWlseU5hbWU+RHVyaWV1eDwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5Tb21tZXJhcmQsIFJvbWFpbjwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+Um9tYWluPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPlNvbW1lcmFyZDwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5YdWFuLCBKaWZlbmc8L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPkppZmVuZzwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5YdWFuPC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogICAgPGNyZWF0b3I+CiAgICAgIDxjcmVhdG9yTmFtZSBuYW1lVHlwZT0iUGVyc29uYWwiPk1vbnBlcnJ1cywgTWFydGluPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5NYXJ0aW48L2dpdmVuTmFtZT4KICAgICAgPGZhbWlseU5hbWU+TW9ucGVycnVzPC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogIDwvY3JlYXRvcnM+CiAgPHRpdGxlcz4KICAgIDx0aXRsZT5BdXRvbWF0aWMgUmVwYWlyIG9mIFJlYWwgQnVncyBpbiBKYXZhOiBBIExhcmdlLVNjYWxlIEV4cGVyaW1lbnQgb24gdGhlIERlZmVjdHM0SiBEYXRhc2V0PC90aXRsZT4KICA8L3RpdGxlcz4KICA8cHVibGlzaGVyPmFyWGl2PC9wdWJsaXNoZXI+CiAgPHB1YmxpY2F0aW9uWWVhcj4yMDE4PC9wdWJsaWNhdGlvblllYXI+CiAgPHN1YmplY3RzPgogICAgPHN1YmplY3QgeG1sOmxhbmc9ImVuIiBzdWJqZWN0U2NoZW1lPSJhclhpdiI+U29mdHdhcmUgRW5naW5lZXJpbmcgKGNzLlNFKTwvc3ViamVjdD4KICAgIDxzdWJqZWN0IHN1YmplY3RTY2hlbWU9IkZpZWxkcyBvZiBTY2llbmNlIGFuZCBUZWNobm9sb2d5IChGT1MpIj5GT1M6IENvbXB1dGVyIGFuZCBpbmZvcm1hdGlvbiBzY2llbmNlczwvc3ViamVjdD4KICA8L3N1YmplY3RzPgogIDxkYXRlcz4KICAgIDxkYXRlIGRhdGVUeXBlPSJTdWJtaXR0ZWQiIGRhdGVJbmZvcm1hdGlvbj0idjEiPjIwMTgtMTEtMDRUMTQ6MzE6MDVaPC9kYXRlPgogICAgPGRhdGUgZGF0ZVR5cGU9IlVwZGF0ZWQiIGRhdGVJbmZvcm1hdGlvbj0idjEiPjIwMjEtMTEtMTJUMDE6MTg6MjZaPC9kYXRlPgogICAgPGRhdGUgZGF0ZVR5cGU9IkF2YWlsYWJsZSIgZGF0ZUluZm9ybWF0aW9uPSJ2MSI+MjAxOC0xMTwvZGF0ZT4KICA8L2RhdGVzPgogIDxyZXNvdXJjZVR5cGUgcmVzb3VyY2VUeXBlR2VuZXJhbD0iVGV4dCI+QXJ0aWNsZTwvcmVzb3VyY2VUeXBlPgogIDxyZWxhdGVkSWRlbnRpZmllcnM+CiAgICA8cmVsYXRlZElkZW50aWZpZXIgcmVsYXRlZElkZW50aWZpZXJUeXBlPSJET0kiIHJlbGF0aW9uVHlwZT0iSXNWZXJzaW9uT2YiPjEwLjEwMDcvczEwNjY0LTAxNi05NDcwLTQ8L3JlbGF0ZWRJZGVudGlmaWVyPgogIDwvcmVsYXRlZElkZW50aWZpZXJzPgogIDx2ZXJzaW9uPjE8L3ZlcnNpb24+CiAgPHJpZ2h0c0xpc3Q+CiAgICA8cmlnaHRzIHJpZ2h0c1VSST0iaHR0cDovL2FyeGl2Lm9yZy9saWNlbnNlcy9ub25leGNsdXNpdmUtZGlzdHJpYi8xLjAvIj5hclhpdi5vcmcgcGVycGV0dWFsLCBub24tZXhjbHVzaXZlIGxpY2Vuc2U8L3JpZ2h0cz4KICA8L3JpZ2h0c0xpc3Q+CiAgPGRlc2NyaXB0aW9ucz4KICAgIDxkZXNjcmlwdGlvbiBkZXNjcmlwdGlvblR5cGU9IkFic3RyYWN0Ij5EZWZlY3RzNEogaXMgYSBsYXJnZSwgcGVlci1yZXZpZXdlZCwgc3RydWN0dXJlZCBkYXRhc2V0IG9mIHJlYWwtd29ybGQgSmF2YSBidWdzLiBFYWNoIGJ1ZyBpbiBEZWZlY3RzNEogY29tZXMgd2l0aCBhIHRlc3Qgc3VpdGUgYW5kIGF0IGxlYXN0IG9uZSBmYWlsaW5nIHRlc3QgY2FzZSB0aGF0IHRyaWdnZXJzIHRoZSBidWcuIEluIHRoaXMgcGFwZXIsIHdlIHJlcG9ydCBvbiBhbiBleHBlcmltZW50IHRvIGV4cGxvcmUgdGhlIGVmZmVjdGl2ZW5lc3Mgb2YgYXV0b21hdGljIHRlc3Qtc3VpdGUgYmFzZWQgcmVwYWlyIG9uIERlZmVjdHM0Si4gVGhlIHJlc3VsdCBvZiBvdXIgZXhwZXJpbWVudCBzaG93cyB0aGF0IHRoZSBjb25zaWRlcmVkIHN0YXRlLW9mLXRoZS1hcnQgcmVwYWlyIG1ldGhvZHMgY2FuIGdlbmVyYXRlIHBhdGNoZXMgZm9yIDQ3IG91dCBvZiAyMjQgYnVncy4gSG93ZXZlciwgdGhvc2UgcGF0Y2hlcyBhcmUgb25seSB0ZXN0LXN1aXRlIGFkZXF1YXRlLCB3aGljaCBtZWFucyB0aGF0IHRoZXkgcGFzcyB0aGUgdGVzdCBzdWl0ZSBhbmQgbWF5IHBvdGVudGlhbGx5IGJlIGluY29ycmVjdCBiZXlvbmQgdGhlIHRlc3Qtc3VpdGUgc2F0aXNmYWN0aW9uIGNvcnJlY3RuZXNzIGNyaXRlcmlvbi4gV2UgaGF2ZSBtYW51YWxseSBhbmFseXplZCA4NCBkaWZmZXJlbnQgcGF0Y2hlcyB0byBhc3Nlc3MgdGhlaXIgcmVhbCBjb3JyZWN0bmVzcy4gSW4gdG90YWwsIDkgcmVhbCBKYXZhIGJ1Z3MgY2FuIGJlIGNvcnJlY3RseSByZXBhaXJlZCB3aXRoIHRlc3Qtc3VpdGUgYmFzZWQgcmVwYWlyLiBUaGlzIGFuYWx5c2lzIHNob3dzIHRoYXQgdGVzdC1zdWl0ZSBiYXNlZCByZXBhaXIgc3VmZmVycyBmcm9tIHVuZGVyLXNwZWNpZmllZCBidWdzLCBmb3Igd2hpY2ggdHJpdmlhbCBvciBpbmNvcnJlY3QgcGF0Y2hlcyBzdGlsbCBwYXNzIHRoZSB0ZXN0IHN1aXRlLiBXaXRoIHJlc3BlY3QgdG8gcHJhY3RpY2FsIGFwcGxpY2FiaWxpdHksIGl0IHRha2VzIG9uIGF2ZXJhZ2UgMTQuOCBtaW51dGVzIHRvIGZpbmQgYSBwYXRjaC4gVGhlIGV4cGVyaW1lbnQgd2FzIGRvbmUgb24gYSBzY2llbnRpZmljIGdyaWQsIHRvdGFsaW5nIDE3LjYgZGF5cyBvZiBjb21wdXRhdGlvbiB0aW1lLiBBbGwgdGhlIHJlcGFpciBzeXN0ZW1zIGFuZCBleHBlcmltZW50YWwgcmVzdWx0cyBhcmUgcHVibGljbHkgYXZhaWxhYmxlIG9uIEdpdGh1YiBpbiBvcmRlciB0byBmYWNpbGl0YXRlIGZ1dHVyZSByZXNlYXJjaCBvbiBhdXRvbWF0aWMgcmVwYWlyLjwvZGVzY3JpcHRpb24+CiAgICA8ZGVzY3JpcHRpb24gZGVzY3JpcHRpb25UeXBlPSJPdGhlciI+RW1waXJpY2FsIFNvZnR3YXJlIEVuZ2luZWVyaW5nLCBTcHJpbmdlciwgMjAxNi4gYXJYaXYgYWRtaW4gbm90ZTogc3Vic3RhbnRpYWwgdGV4dCBvdmVybGFwIHdpdGggYXJYaXY6MTUwNS4wNzAwMjwvZGVzY3JpcHRpb24+CiAgPC9kZXNjcmlwdGlvbnM+CjwvcmVzb3VyY2U+","url":"https://arxiv.org/abs/1811.02429","contentUrl":null,"metadataVersion":0,"schemaVersion":"http://datacite.org/schema/kernel-4","source":"mds","isActive":true,"state":"findable","reason":null,"viewCount":0,"viewsOverTime":[],"downloadCount":0,"downloadsOverTime":[],"referenceCount":0,"citationCount":0,"citationsOverTime":[],"partCount":0,"partOfCount":0,"versionCount":0,"versionOfCount":0,"created":"2022-03-01T03:34:11.000Z","registered":"2022-03-01T03:34:12.000Z","published":"2018","updated":"2022-03-01T03:34:12.000Z"},"relationships":{"client":{"data":{"id":"arxiv.content","type":"clients"}},"provider":{"data":{"id":"arxiv","type":"providers"}},"media":{"data":{"id":"10.48550/arxiv.1811.02429","type":"media"}},"references":{"data":[]},"citations":{"data":[]},"parts":{"data":[]},"partOf":{"data":[]},"versions":{"data":[]},"versionOf":{"data":[]}}}}