{"data":{"id":"10.48550/arxiv.2007.07314","type":"dois","attributes":{"doi":"10.48550/arxiv.2007.07314","prefix":"10.48550","suffix":"arxiv.2007.07314","identifiers":[{"identifier":"2007.07314","identifierType":"arXiv"}],"alternateIdentifiers":[{"alternateIdentifierType":"arXiv","alternateIdentifier":"2007.07314"}],"creators":[{"name":"Menon, Aditya Krishna","nameType":"Personal","givenName":"Aditya Krishna","familyName":"Menon","affiliation":[],"nameIdentifiers":[]},{"name":"Jayasumana, Sadeep","nameType":"Personal","givenName":"Sadeep","familyName":"Jayasumana","affiliation":[],"nameIdentifiers":[]},{"name":"Rawat, Ankit Singh","nameType":"Personal","givenName":"Ankit Singh","familyName":"Rawat","affiliation":[],"nameIdentifiers":[]},{"name":"Jain, Himanshu","nameType":"Personal","givenName":"Himanshu","familyName":"Jain","affiliation":[],"nameIdentifiers":[]},{"name":"Veit, Andreas","nameType":"Personal","givenName":"Andreas","familyName":"Veit","affiliation":[],"nameIdentifiers":[]},{"name":"Kumar, Sanjiv","nameType":"Personal","givenName":"Sanjiv","familyName":"Kumar","affiliation":[],"nameIdentifiers":[]}],"titles":[{"title":"Long-tail learning via logit adjustment"}],"publisher":"arXiv","container":{},"publicationYear":2020,"subjects":[{"lang":"en","subject":"Machine Learning (cs.LG)","subjectScheme":"arXiv"},{"lang":"en","subject":"Machine Learning (stat.ML)","subjectScheme":"arXiv"},{"subject":"FOS: Computer and information sciences","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Computer and information sciences","schemeUri":"http://www.oecd.org/science/inno/38235147.pdf","subjectScheme":"Fields of Science and Technology (FOS)"}],"contributors":[],"dates":[{"date":"2020-07-14T19:27:13Z","dateType":"Submitted","dateInformation":"v1"},{"date":"2020-07-16T00:02:50Z","dateType":"Updated","dateInformation":"v1"},{"date":"2021-07-09T21:23:25Z","dateType":"Submitted","dateInformation":"v2"},{"date":"2021-07-13T00:03:59Z","dateType":"Updated","dateInformation":"v2"},{"date":"2020-07","dateType":"Available","dateInformation":"v1"},{"date":"2020","dateType":"Issued"}],"language":null,"types":{"ris":"GEN","bibtex":"misc","citeproc":"article","schemaOrg":"CreativeWork","resourceType":"Article","resourceTypeGeneral":"Preprint"},"relatedIdentifiers":[],"relatedItems":[],"sizes":[],"formats":[],"version":"2","rightsList":[{"rights":"Creative Commons Attribution Non Commercial Share Alike 4.0 International","rightsUri":"https://creativecommons.org/licenses/by-nc-sa/4.0/legalcode","schemeUri":"https://spdx.org/licenses/","rightsIdentifier":"cc-by-nc-sa-4.0","rightsIdentifierScheme":"SPDX"}],"descriptions":[{"description":"Real-world classification problems typically exhibit an imbalanced or long-tailed label distribution, wherein many labels are associated with only a few samples. This poses a challenge for generalisation on such labels, and also makes naïve learning biased towards dominant labels. In this paper, we present two simple modifications of standard softmax cross-entropy training to cope with these challenges. Our techniques revisit the classic idea of logit adjustment based on the label frequencies, either applied post-hoc to a trained model, or enforced in the loss during training. Such adjustment encourages a large relative margin between logits of rare versus dominant labels. These techniques unify and generalise several recent proposals in the literature, while possessing firmer statistical grounding and empirical performance.","descriptionType":"Abstract"},{"description":"Published as a conference paper in ICLR 2021","descriptionType":"Other"}],"geoLocations":[],"fundingReferences":[],"xml":"PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4KPHJlc291cmNlIHhtbG5zPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSIgeHNpOnNjaGVtYUxvY2F0aW9uPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCBodHRwOi8vc2NoZW1hLmRhdGFjaXRlLm9yZy9tZXRhL2tlcm5lbC00LjMvbWV0YWRhdGEueHNkIj4KICA8aWRlbnRpZmllciBpZGVudGlmaWVyVHlwZT0iRE9JIj4xMC40ODU1MC9BUlhJVi4yMDA3LjA3MzE0PC9pZGVudGlmaWVyPgogIDxhbHRlcm5hdGVJZGVudGlmaWVycz4KICAgIDxhbHRlcm5hdGVJZGVudGlmaWVyIGFsdGVybmF0ZUlkZW50aWZpZXJUeXBlPSJhclhpdiI+MjAwNy4wNzMxNDwvYWx0ZXJuYXRlSWRlbnRpZmllcj4KICA8L2FsdGVybmF0ZUlkZW50aWZpZXJzPgogIDxjcmVhdG9ycz4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5NZW5vbiwgQWRpdHlhIEtyaXNobmE8L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPkFkaXR5YSBLcmlzaG5hPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPk1lbm9uPC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogICAgPGNyZWF0b3I+CiAgICAgIDxjcmVhdG9yTmFtZSBuYW1lVHlwZT0iUGVyc29uYWwiPkpheWFzdW1hbmEsIFNhZGVlcDwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+U2FkZWVwPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPkpheWFzdW1hbmE8L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgICA8Y3JlYXRvcj4KICAgICAgPGNyZWF0b3JOYW1lIG5hbWVUeXBlPSJQZXJzb25hbCI+UmF3YXQsIEFua2l0IFNpbmdoPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5BbmtpdCBTaW5naDwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5SYXdhdDwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5KYWluLCBIaW1hbnNodTwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+SGltYW5zaHU8L2dpdmVuTmFtZT4KICAgICAgPGZhbWlseU5hbWU+SmFpbjwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5WZWl0LCBBbmRyZWFzPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5BbmRyZWFzPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPlZlaXQ8L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgICA8Y3JlYXRvcj4KICAgICAgPGNyZWF0b3JOYW1lIG5hbWVUeXBlPSJQZXJzb25hbCI+S3VtYXIsIFNhbmppdjwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+U2Fuaml2PC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPkt1bWFyPC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogIDwvY3JlYXRvcnM+CiAgPHRpdGxlcz4KICAgIDx0aXRsZT5Mb25nLXRhaWwgbGVhcm5pbmcgdmlhIGxvZ2l0IGFkanVzdG1lbnQ8L3RpdGxlPgogIDwvdGl0bGVzPgogIDxwdWJsaXNoZXI+YXJYaXY8L3B1Ymxpc2hlcj4KICA8cHVibGljYXRpb25ZZWFyPjIwMjA8L3B1YmxpY2F0aW9uWWVhcj4KICA8c3ViamVjdHM+CiAgICA8c3ViamVjdCB4bWw6bGFuZz0iZW4iIHN1YmplY3RTY2hlbWU9ImFyWGl2Ij5NYWNoaW5lIExlYXJuaW5nIChjcy5MRyk8L3N1YmplY3Q+CiAgICA8c3ViamVjdCB4bWw6bGFuZz0iZW4iIHN1YmplY3RTY2hlbWU9ImFyWGl2Ij5NYWNoaW5lIExlYXJuaW5nIChzdGF0Lk1MKTwvc3ViamVjdD4KICAgIDxzdWJqZWN0IHN1YmplY3RTY2hlbWU9IkZpZWxkcyBvZiBTY2llbmNlIGFuZCBUZWNobm9sb2d5IChGT1MpIj5GT1M6IENvbXB1dGVyIGFuZCBpbmZvcm1hdGlvbiBzY2llbmNlczwvc3ViamVjdD4KICA8L3N1YmplY3RzPgogIDxkYXRlcz4KICAgIDxkYXRlIGRhdGVUeXBlPSJTdWJtaXR0ZWQiIGRhdGVJbmZvcm1hdGlvbj0idjEiPjIwMjAtMDctMTRUMTk6Mjc6MTNaPC9kYXRlPgogICAgPGRhdGUgZGF0ZVR5cGU9IlVwZGF0ZWQiIGRhdGVJbmZvcm1hdGlvbj0idjEiPjIwMjAtMDctMTZUMDA6MDI6NTBaPC9kYXRlPgogICAgPGRhdGUgZGF0ZVR5cGU9IlN1Ym1pdHRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2MiI+MjAyMS0wNy0wOVQyMToyMzoyNVo8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iVXBkYXRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2MiI+MjAyMS0wNy0xM1QwMDowMzo1OVo8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iQXZhaWxhYmxlIiBkYXRlSW5mb3JtYXRpb249InYxIj4yMDIwLTA3PC9kYXRlPgogIDwvZGF0ZXM+CiAgPHJlc291cmNlVHlwZSByZXNvdXJjZVR5cGVHZW5lcmFsPSJQcmVwcmludCI+QXJ0aWNsZTwvcmVzb3VyY2VUeXBlPgogIDx2ZXJzaW9uPjI8L3ZlcnNpb24+CiAgPHJpZ2h0c0xpc3Q+CiAgICA8cmlnaHRzIHJpZ2h0c1VSST0iaHR0cDovL2NyZWF0aXZlY29tbW9ucy5vcmcvbGljZW5zZXMvYnktbmMtc2EvNC4wLyIgcmlnaHRzSWRlbnRpZmllclNjaGVtZT0iU1BEWCIgcmlnaHRzSWRlbnRpZmllcj0iQ0MtQlktTkMtU0EtNC4wIj5DcmVhdGl2ZSBDb21tb25zIEF0dHJpYnV0aW9uIE5vbiBDb21tZXJjaWFsIFNoYXJlIEFsaWtlIDQuMCBJbnRlcm5hdGlvbmFsPC9yaWdodHM+CiAgPC9yaWdodHNMaXN0PgogIDxkZXNjcmlwdGlvbnM+CiAgICA8ZGVzY3JpcHRpb24gZGVzY3JpcHRpb25UeXBlPSJBYnN0cmFjdCI+UmVhbC13b3JsZCBjbGFzc2lmaWNhdGlvbiBwcm9ibGVtcyB0eXBpY2FsbHkgZXhoaWJpdCBhbiBpbWJhbGFuY2VkIG9yIGxvbmctdGFpbGVkIGxhYmVsIGRpc3RyaWJ1dGlvbiwgd2hlcmVpbiBtYW55IGxhYmVscyBhcmUgYXNzb2NpYXRlZCB3aXRoIG9ubHkgYSBmZXcgc2FtcGxlcy4gVGhpcyBwb3NlcyBhIGNoYWxsZW5nZSBmb3IgZ2VuZXJhbGlzYXRpb24gb24gc3VjaCBsYWJlbHMsIGFuZCBhbHNvIG1ha2VzIG5hw692ZSBsZWFybmluZyBiaWFzZWQgdG93YXJkcyBkb21pbmFudCBsYWJlbHMuIEluIHRoaXMgcGFwZXIsIHdlIHByZXNlbnQgdHdvIHNpbXBsZSBtb2RpZmljYXRpb25zIG9mIHN0YW5kYXJkIHNvZnRtYXggY3Jvc3MtZW50cm9weSB0cmFpbmluZyB0byBjb3BlIHdpdGggdGhlc2UgY2hhbGxlbmdlcy4gT3VyIHRlY2huaXF1ZXMgcmV2aXNpdCB0aGUgY2xhc3NpYyBpZGVhIG9mIGxvZ2l0IGFkanVzdG1lbnQgYmFzZWQgb24gdGhlIGxhYmVsIGZyZXF1ZW5jaWVzLCBlaXRoZXIgYXBwbGllZCBwb3N0LWhvYyB0byBhIHRyYWluZWQgbW9kZWwsIG9yIGVuZm9yY2VkIGluIHRoZSBsb3NzIGR1cmluZyB0cmFpbmluZy4gU3VjaCBhZGp1c3RtZW50IGVuY291cmFnZXMgYSBsYXJnZSByZWxhdGl2ZSBtYXJnaW4gYmV0d2VlbiBsb2dpdHMgb2YgcmFyZSB2ZXJzdXMgZG9taW5hbnQgbGFiZWxzLiBUaGVzZSB0ZWNobmlxdWVzIHVuaWZ5IGFuZCBnZW5lcmFsaXNlIHNldmVyYWwgcmVjZW50IHByb3Bvc2FscyBpbiB0aGUgbGl0ZXJhdHVyZSwgd2hpbGUgcG9zc2Vzc2luZyBmaXJtZXIgc3RhdGlzdGljYWwgZ3JvdW5kaW5nIGFuZCBlbXBpcmljYWwgcGVyZm9ybWFuY2UuPC9kZXNjcmlwdGlvbj4KICAgIDxkZXNjcmlwdGlvbiBkZXNjcmlwdGlvblR5cGU9Ik90aGVyIj5QdWJsaXNoZWQgYXMgYSBjb25mZXJlbmNlIHBhcGVyIGluIElDTFIgMjAyMTwvZGVzY3JpcHRpb24+CiAgPC9kZXNjcmlwdGlvbnM+CjwvcmVzb3VyY2U+","url":"https://arxiv.org/abs/2007.07314","contentUrl":null,"metadataVersion":0,"schemaVersion":"http://datacite.org/schema/kernel-4","source":"mds","isActive":true,"state":"findable","reason":null,"viewCount":0,"viewsOverTime":[],"downloadCount":0,"downloadsOverTime":[],"referenceCount":0,"citationCount":0,"citationsOverTime":[],"partCount":0,"partOfCount":0,"versionCount":0,"versionOfCount":0,"created":"2022-02-25T09:43:07.000Z","registered":"2022-02-25T09:43:08.000Z","published":"2020","updated":"2022-02-25T09:43:08.000Z"},"relationships":{"client":{"data":{"id":"arxiv.content","type":"clients"}},"provider":{"data":{"id":"arxiv","type":"providers"}},"media":{"data":{"id":"10.48550/arxiv.2007.07314","type":"media"}},"references":{"data":[]},"citations":{"data":[]},"parts":{"data":[]},"partOf":{"data":[]},"versions":{"data":[]},"versionOf":{"data":[]}}}}