{"data":{"id":"10.48550/arxiv.1904.11238","type":"dois","attributes":{"doi":"10.48550/arxiv.1904.11238","prefix":"10.48550","suffix":"arxiv.1904.11238","identifiers":[{"identifier":"1904.11238","identifierType":"arXiv"}],"alternateIdentifiers":[{"alternateIdentifierType":"arXiv","alternateIdentifier":"1904.11238"}],"creators":[{"name":"Arazo, Eric","nameType":"Personal","givenName":"Eric","familyName":"Arazo","affiliation":[],"nameIdentifiers":[]},{"name":"Ortego, Diego","nameType":"Personal","givenName":"Diego","familyName":"Ortego","affiliation":[],"nameIdentifiers":[]},{"name":"Albert, Paul","nameType":"Personal","givenName":"Paul","familyName":"Albert","affiliation":[],"nameIdentifiers":[]},{"name":"O'Connor, Noel E.","nameType":"Personal","givenName":"Noel E.","familyName":"O'Connor","affiliation":[],"nameIdentifiers":[]},{"name":"McGuinness, Kevin","nameType":"Personal","givenName":"Kevin","familyName":"McGuinness","affiliation":[],"nameIdentifiers":[]}],"titles":[{"title":"Unsupervised Label Noise Modeling and Loss Correction"}],"publisher":"arXiv","container":{},"publicationYear":2019,"subjects":[{"lang":"en","subject":"Computer Vision and Pattern Recognition (cs.CV)","subjectScheme":"arXiv"},{"subject":"FOS: Computer and information sciences","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Computer and information sciences","schemeUri":"http://www.oecd.org/science/inno/38235147.pdf","subjectScheme":"Fields of Science and Technology (FOS)"}],"contributors":[],"dates":[{"date":"2019-04-25T09:53:48Z","dateType":"Submitted","dateInformation":"v1"},{"date":"2019-04-26T00:12:28Z","dateType":"Updated","dateInformation":"v1"},{"date":"2019-06-05T14:23:24Z","dateType":"Submitted","dateInformation":"v2"},{"date":"2019-06-06T00:16:54Z","dateType":"Updated","dateInformation":"v2"},{"date":"2019-04","dateType":"Available","dateInformation":"v1"},{"date":"2019","dateType":"Issued"}],"language":null,"types":{"ris":"GEN","bibtex":"misc","citeproc":"article","schemaOrg":"CreativeWork","resourceType":"Article","resourceTypeGeneral":"Preprint"},"relatedIdentifiers":[],"relatedItems":[],"sizes":[],"formats":[],"version":"2","rightsList":[{"rights":"arXiv.org perpetual, non-exclusive license","rightsUri":"http://arxiv.org/licenses/nonexclusive-distrib/1.0/"}],"descriptions":[{"description":"Despite being robust to small amounts of label noise, convolutional neural networks trained with stochastic gradient methods have been shown to easily fit random labels. When there are a mixture of correct and mislabelled targets, networks tend to fit the former before the latter. This suggests using a suitable two-component mixture model as an unsupervised generative model of sample loss values during training to allow online estimation of the probability that a sample is mislabelled. Specifically, we propose a beta mixture to estimate this probability and correct the loss by relying on the network prediction (the so-called bootstrapping loss). We further adapt mixup augmentation to drive our approach a step further. Experiments on CIFAR-10/100 and TinyImageNet demonstrate a robustness to label noise that substantially outperforms recent state-of-the-art. Source code is available at https://git.io/fjsvE","descriptionType":"Abstract"},{"description":"Accepted to ICML 2019","descriptionType":"Other"}],"geoLocations":[],"fundingReferences":[],"xml":"PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4KPHJlc291cmNlIHhtbG5zPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSIgeHNpOnNjaGVtYUxvY2F0aW9uPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCBodHRwOi8vc2NoZW1hLmRhdGFjaXRlLm9yZy9tZXRhL2tlcm5lbC00LjMvbWV0YWRhdGEueHNkIj4KICA8aWRlbnRpZmllciBpZGVudGlmaWVyVHlwZT0iRE9JIj4xMC40ODU1MC9BUlhJVi4xOTA0LjExMjM4PC9pZGVudGlmaWVyPgogIDxhbHRlcm5hdGVJZGVudGlmaWVycz4KICAgIDxhbHRlcm5hdGVJZGVudGlmaWVyIGFsdGVybmF0ZUlkZW50aWZpZXJUeXBlPSJhclhpdiI+MTkwNC4xMTIzODwvYWx0ZXJuYXRlSWRlbnRpZmllcj4KICA8L2FsdGVybmF0ZUlkZW50aWZpZXJzPgogIDxjcmVhdG9ycz4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5BcmF6bywgRXJpYzwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+RXJpYzwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5BcmF6bzwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5PcnRlZ28sIERpZWdvPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5EaWVnbzwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5PcnRlZ288L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgICA8Y3JlYXRvcj4KICAgICAgPGNyZWF0b3JOYW1lIG5hbWVUeXBlPSJQZXJzb25hbCI+QWxiZXJ0LCBQYXVsPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5QYXVsPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPkFsYmVydDwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5PJ0Nvbm5vciwgTm9lbCBFLjwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+Tm9lbCBFLjwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5PJ0Nvbm5vcjwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5NY0d1aW5uZXNzLCBLZXZpbjwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+S2V2aW48L2dpdmVuTmFtZT4KICAgICAgPGZhbWlseU5hbWU+TWNHdWlubmVzczwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICA8L2NyZWF0b3JzPgogIDx0aXRsZXM+CiAgICA8dGl0bGU+VW5zdXBlcnZpc2VkIExhYmVsIE5vaXNlIE1vZGVsaW5nIGFuZCBMb3NzIENvcnJlY3Rpb248L3RpdGxlPgogIDwvdGl0bGVzPgogIDxwdWJsaXNoZXI+YXJYaXY8L3B1Ymxpc2hlcj4KICA8cHVibGljYXRpb25ZZWFyPjIwMTk8L3B1YmxpY2F0aW9uWWVhcj4KICA8c3ViamVjdHM+CiAgICA8c3ViamVjdCB4bWw6bGFuZz0iZW4iIHN1YmplY3RTY2hlbWU9ImFyWGl2Ij5Db21wdXRlciBWaXNpb24gYW5kIFBhdHRlcm4gUmVjb2duaXRpb24gKGNzLkNWKTwvc3ViamVjdD4KICAgIDxzdWJqZWN0IHN1YmplY3RTY2hlbWU9IkZpZWxkcyBvZiBTY2llbmNlIGFuZCBUZWNobm9sb2d5IChGT1MpIj5GT1M6IENvbXB1dGVyIGFuZCBpbmZvcm1hdGlvbiBzY2llbmNlczwvc3ViamVjdD4KICA8L3N1YmplY3RzPgogIDxkYXRlcz4KICAgIDxkYXRlIGRhdGVUeXBlPSJTdWJtaXR0ZWQiIGRhdGVJbmZvcm1hdGlvbj0idjEiPjIwMTktMDQtMjVUMDk6NTM6NDhaPC9kYXRlPgogICAgPGRhdGUgZGF0ZVR5cGU9IlVwZGF0ZWQiIGRhdGVJbmZvcm1hdGlvbj0idjEiPjIwMTktMDQtMjZUMDA6MTI6MjhaPC9kYXRlPgogICAgPGRhdGUgZGF0ZVR5cGU9IlN1Ym1pdHRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2MiI+MjAxOS0wNi0wNVQxNDoyMzoyNFo8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iVXBkYXRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2MiI+MjAxOS0wNi0wNlQwMDoxNjo1NFo8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iQXZhaWxhYmxlIiBkYXRlSW5mb3JtYXRpb249InYxIj4yMDE5LTA0PC9kYXRlPgogIDwvZGF0ZXM+CiAgPHJlc291cmNlVHlwZSByZXNvdXJjZVR5cGVHZW5lcmFsPSJQcmVwcmludCI+QXJ0aWNsZTwvcmVzb3VyY2VUeXBlPgogIDx2ZXJzaW9uPjI8L3ZlcnNpb24+CiAgPHJpZ2h0c0xpc3Q+CiAgICA8cmlnaHRzIHJpZ2h0c1VSST0iaHR0cDovL2FyeGl2Lm9yZy9saWNlbnNlcy9ub25leGNsdXNpdmUtZGlzdHJpYi8xLjAvIj5hclhpdi5vcmcgcGVycGV0dWFsLCBub24tZXhjbHVzaXZlIGxpY2Vuc2U8L3JpZ2h0cz4KICA8L3JpZ2h0c0xpc3Q+CiAgPGRlc2NyaXB0aW9ucz4KICAgIDxkZXNjcmlwdGlvbiBkZXNjcmlwdGlvblR5cGU9IkFic3RyYWN0Ij5EZXNwaXRlIGJlaW5nIHJvYnVzdCB0byBzbWFsbCBhbW91bnRzIG9mIGxhYmVsIG5vaXNlLCBjb252b2x1dGlvbmFsIG5ldXJhbCBuZXR3b3JrcyB0cmFpbmVkIHdpdGggc3RvY2hhc3RpYyBncmFkaWVudCBtZXRob2RzIGhhdmUgYmVlbiBzaG93biB0byBlYXNpbHkgZml0IHJhbmRvbSBsYWJlbHMuIFdoZW4gdGhlcmUgYXJlIGEgbWl4dHVyZSBvZiBjb3JyZWN0IGFuZCBtaXNsYWJlbGxlZCB0YXJnZXRzLCBuZXR3b3JrcyB0ZW5kIHRvIGZpdCB0aGUgZm9ybWVyIGJlZm9yZSB0aGUgbGF0dGVyLiBUaGlzIHN1Z2dlc3RzIHVzaW5nIGEgc3VpdGFibGUgdHdvLWNvbXBvbmVudCBtaXh0dXJlIG1vZGVsIGFzIGFuIHVuc3VwZXJ2aXNlZCBnZW5lcmF0aXZlIG1vZGVsIG9mIHNhbXBsZSBsb3NzIHZhbHVlcyBkdXJpbmcgdHJhaW5pbmcgdG8gYWxsb3cgb25saW5lIGVzdGltYXRpb24gb2YgdGhlIHByb2JhYmlsaXR5IHRoYXQgYSBzYW1wbGUgaXMgbWlzbGFiZWxsZWQuIFNwZWNpZmljYWxseSwgd2UgcHJvcG9zZSBhIGJldGEgbWl4dHVyZSB0byBlc3RpbWF0ZSB0aGlzIHByb2JhYmlsaXR5IGFuZCBjb3JyZWN0IHRoZSBsb3NzIGJ5IHJlbHlpbmcgb24gdGhlIG5ldHdvcmsgcHJlZGljdGlvbiAodGhlIHNvLWNhbGxlZCBib290c3RyYXBwaW5nIGxvc3MpLiBXZSBmdXJ0aGVyIGFkYXB0IG1peHVwIGF1Z21lbnRhdGlvbiB0byBkcml2ZSBvdXIgYXBwcm9hY2ggYSBzdGVwIGZ1cnRoZXIuIEV4cGVyaW1lbnRzIG9uIENJRkFSLTEwLzEwMCBhbmQgVGlueUltYWdlTmV0IGRlbW9uc3RyYXRlIGEgcm9idXN0bmVzcyB0byBsYWJlbCBub2lzZSB0aGF0IHN1YnN0YW50aWFsbHkgb3V0cGVyZm9ybXMgcmVjZW50IHN0YXRlLW9mLXRoZS1hcnQuIFNvdXJjZSBjb2RlIGlzIGF2YWlsYWJsZSBhdCBodHRwczovL2dpdC5pby9manN2RTwvZGVzY3JpcHRpb24+CiAgICA8ZGVzY3JpcHRpb24gZGVzY3JpcHRpb25UeXBlPSJPdGhlciI+QWNjZXB0ZWQgdG8gSUNNTCAyMDE5PC9kZXNjcmlwdGlvbj4KICA8L2Rlc2NyaXB0aW9ucz4KPC9yZXNvdXJjZT4=","url":"https://arxiv.org/abs/1904.11238","contentUrl":null,"metadataVersion":0,"schemaVersion":"http://datacite.org/schema/kernel-4","source":"mds","isActive":true,"state":"findable","reason":null,"viewCount":0,"viewsOverTime":[],"downloadCount":0,"downloadsOverTime":[],"referenceCount":0,"citationCount":0,"citationsOverTime":[],"partCount":0,"partOfCount":0,"versionCount":0,"versionOfCount":0,"created":"2022-02-28T06:22:19.000Z","registered":"2022-02-28T06:22:21.000Z","published":"2019","updated":"2022-02-28T06:22:21.000Z"},"relationships":{"client":{"data":{"id":"arxiv.content","type":"clients"}},"provider":{"data":{"id":"arxiv","type":"providers"}},"media":{"data":{"id":"10.48550/arxiv.1904.11238","type":"media"}},"references":{"data":[]},"citations":{"data":[]},"parts":{"data":[]},"partOf":{"data":[]},"versions":{"data":[]},"versionOf":{"data":[]}}}}