{"data":{"id":"10.48550/arxiv.2106.16245","type":"dois","attributes":{"doi":"10.48550/arxiv.2106.16245","prefix":"10.48550","suffix":"arxiv.2106.16245","identifiers":[{"identifier":"2106.16245","identifierType":"arXiv"}],"alternateIdentifiers":[{"alternateIdentifierType":"arXiv","alternateIdentifier":"2106.16245"}],"creators":[{"name":"Ye, Han-Jia","nameType":"Personal","givenName":"Han-Jia","familyName":"Ye","affiliation":[],"nameIdentifiers":[]},{"name":"Chao, Wei-Lun","nameType":"Personal","givenName":"Wei-Lun","familyName":"Chao","affiliation":[],"nameIdentifiers":[]}],"titles":[{"title":"How to Train Your MAML to Excel in Few-Shot Classification"}],"publisher":"arXiv","container":{},"publicationYear":2021,"subjects":[{"lang":"en","subject":"Machine Learning (cs.LG)","subjectScheme":"arXiv"},{"lang":"en","subject":"Artificial Intelligence (cs.AI)","subjectScheme":"arXiv"},{"lang":"en","subject":"Computer Vision and Pattern Recognition (cs.CV)","subjectScheme":"arXiv"},{"subject":"FOS: Computer and information sciences","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Computer and information sciences","schemeUri":"http://www.oecd.org/science/inno/38235147.pdf","subjectScheme":"Fields of Science and Technology (FOS)"}],"contributors":[],"dates":[{"date":"2021-06-30T17:56:15Z","dateType":"Submitted","dateInformation":"v1"},{"date":"2021-07-01T00:25:54Z","dateType":"Updated","dateInformation":"v1"},{"date":"2021-10-10T17:51:02Z","dateType":"Submitted","dateInformation":"v2"},{"date":"2021-10-12T00:23:04Z","dateType":"Updated","dateInformation":"v2"},{"date":"2022-07-11T01:59:05Z","dateType":"Submitted","dateInformation":"v3"},{"date":"2022-07-12T00:23:23Z","dateType":"Updated","dateInformation":"v3"},{"date":"2021-06","dateType":"Available","dateInformation":"v1"},{"date":"2021","dateType":"Issued"}],"language":null,"types":{"ris":"GEN","bibtex":"misc","citeproc":"article","schemaOrg":"CreativeWork","resourceType":"Article","resourceTypeGeneral":"Preprint"},"relatedIdentifiers":[],"relatedItems":[],"sizes":[],"formats":[],"version":"3","rightsList":[{"rights":"Creative Commons Attribution Non Commercial Share Alike 4.0 International","rightsUri":"https://creativecommons.org/licenses/by-nc-sa/4.0/legalcode","schemeUri":"https://spdx.org/licenses/","rightsIdentifier":"cc-by-nc-sa-4.0","rightsIdentifierScheme":"SPDX"}],"descriptions":[{"description":"Model-agnostic meta-learning (MAML) is arguably one of the most popular meta-learning algorithms nowadays. Nevertheless, its performance on few-shot classification is far behind many recent algorithms dedicated to the problem. In this paper, we point out several key facets of how to train MAML to excel in few-shot classification. First, we find that MAML needs a large number of gradient steps in its inner loop update, which contradicts its common usage in few-shot classification. Second, we find that MAML is sensitive to the class label assignments during meta-testing. Concretely, MAML meta-trains the initialization of an $N$-way classifier. These $N$ ways, during meta-testing, then have \"$N!$\" different permutations to be paired with a few-shot task of $N$ novel classes. We find that these permutations lead to a huge variance of accuracy, making MAML unstable in few-shot classification. Third, we investigate several approaches to make MAML permutation-invariant, among which meta-training a single vector to initialize all the $N$ weight vectors in the classification head performs the best. On benchmark datasets like MiniImageNet and TieredImageNet, our approach, which we name UNICORN-MAML, performs on a par with or even outperforms many recent few-shot classification algorithms, without sacrificing MAML's simplicity.","descriptionType":"Abstract"},{"description":"Accepted to International Conference on Learning Representations 2022 (ICLR 2022)","descriptionType":"Other"}],"geoLocations":[],"fundingReferences":[],"xml":"PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4KPHJlc291cmNlIHhtbG5zPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSIgeHNpOnNjaGVtYUxvY2F0aW9uPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCBodHRwOi8vc2NoZW1hLmRhdGFjaXRlLm9yZy9tZXRhL2tlcm5lbC00LjMvbWV0YWRhdGEueHNkIj4KICA8aWRlbnRpZmllciBpZGVudGlmaWVyVHlwZT0iRE9JIj4xMC40ODU1MC9BUlhJVi4yMTA2LjE2MjQ1PC9pZGVudGlmaWVyPgogIDxhbHRlcm5hdGVJZGVudGlmaWVycz4KICAgIDxhbHRlcm5hdGVJZGVudGlmaWVyIGFsdGVybmF0ZUlkZW50aWZpZXJUeXBlPSJhclhpdiI+MjEwNi4xNjI0NTwvYWx0ZXJuYXRlSWRlbnRpZmllcj4KICA8L2FsdGVybmF0ZUlkZW50aWZpZXJzPgogIDxjcmVhdG9ycz4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5ZZSwgSGFuLUppYTwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+SGFuLUppYTwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5ZZTwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5DaGFvLCBXZWktTHVuPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5XZWktTHVuPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPkNoYW88L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgPC9jcmVhdG9ycz4KICA8dGl0bGVzPgogICAgPHRpdGxlPkhvdyB0byBUcmFpbiBZb3VyIE1BTUwgdG8gRXhjZWwgaW4gRmV3LVNob3QgQ2xhc3NpZmljYXRpb248L3RpdGxlPgogIDwvdGl0bGVzPgogIDxwdWJsaXNoZXI+YXJYaXY8L3B1Ymxpc2hlcj4KICA8cHVibGljYXRpb25ZZWFyPjIwMjE8L3B1YmxpY2F0aW9uWWVhcj4KICA8c3ViamVjdHM+CiAgICA8c3ViamVjdCB4bWw6bGFuZz0iZW4iIHN1YmplY3RTY2hlbWU9ImFyWGl2Ij5NYWNoaW5lIExlYXJuaW5nIChjcy5MRyk8L3N1YmplY3Q+CiAgICA8c3ViamVjdCB4bWw6bGFuZz0iZW4iIHN1YmplY3RTY2hlbWU9ImFyWGl2Ij5BcnRpZmljaWFsIEludGVsbGlnZW5jZSAoY3MuQUkpPC9zdWJqZWN0PgogICAgPHN1YmplY3QgeG1sOmxhbmc9ImVuIiBzdWJqZWN0U2NoZW1lPSJhclhpdiI+Q29tcHV0ZXIgVmlzaW9uIGFuZCBQYXR0ZXJuIFJlY29nbml0aW9uIChjcy5DVik8L3N1YmplY3Q+CiAgICA8c3ViamVjdCBzdWJqZWN0U2NoZW1lPSJGaWVsZHMgb2YgU2NpZW5jZSBhbmQgVGVjaG5vbG9neSAoRk9TKSI+Rk9TOiBDb21wdXRlciBhbmQgaW5mb3JtYXRpb24gc2NpZW5jZXM8L3N1YmplY3Q+CiAgPC9zdWJqZWN0cz4KICA8ZGF0ZXM+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iU3VibWl0dGVkIiBkYXRlSW5mb3JtYXRpb249InYxIj4yMDIxLTA2LTMwVDE3OjU2OjE1WjwvZGF0ZT4KICAgIDxkYXRlIGRhdGVUeXBlPSJVcGRhdGVkIiBkYXRlSW5mb3JtYXRpb249InYxIj4yMDIxLTA3LTAxVDAwOjI1OjU0WjwvZGF0ZT4KICAgIDxkYXRlIGRhdGVUeXBlPSJTdWJtaXR0ZWQiIGRhdGVJbmZvcm1hdGlvbj0idjIiPjIwMjEtMTAtMTBUMTc6NTE6MDJaPC9kYXRlPgogICAgPGRhdGUgZGF0ZVR5cGU9IlVwZGF0ZWQiIGRhdGVJbmZvcm1hdGlvbj0idjIiPjIwMjEtMTAtMTJUMDA6MjM6MDRaPC9kYXRlPgogICAgPGRhdGUgZGF0ZVR5cGU9IlN1Ym1pdHRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2MyI+MjAyMi0wNy0xMVQwMTo1OTowNVo8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iVXBkYXRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2MyI+MjAyMi0wNy0xMlQwMDoyMzoyM1o8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iQXZhaWxhYmxlIiBkYXRlSW5mb3JtYXRpb249InYxIj4yMDIxLTA2PC9kYXRlPgogIDwvZGF0ZXM+CiAgPHJlc291cmNlVHlwZSByZXNvdXJjZVR5cGVHZW5lcmFsPSJQcmVwcmludCI+QXJ0aWNsZTwvcmVzb3VyY2VUeXBlPgogIDx2ZXJzaW9uPjM8L3ZlcnNpb24+CiAgPHJpZ2h0c0xpc3Q+CiAgICA8cmlnaHRzIHJpZ2h0c1VSST0iaHR0cDovL2NyZWF0aXZlY29tbW9ucy5vcmcvbGljZW5zZXMvYnktbmMtc2EvNC4wLyIgcmlnaHRzSWRlbnRpZmllclNjaGVtZT0iU1BEWCIgcmlnaHRzSWRlbnRpZmllcj0iQ0MtQlktTkMtU0EtNC4wIj5DcmVhdGl2ZSBDb21tb25zIEF0dHJpYnV0aW9uIE5vbiBDb21tZXJjaWFsIFNoYXJlIEFsaWtlIDQuMCBJbnRlcm5hdGlvbmFsPC9yaWdodHM+CiAgPC9yaWdodHNMaXN0PgogIDxkZXNjcmlwdGlvbnM+CiAgICA8ZGVzY3JpcHRpb24gZGVzY3JpcHRpb25UeXBlPSJBYnN0cmFjdCI+TW9kZWwtYWdub3N0aWMgbWV0YS1sZWFybmluZyAoTUFNTCkgaXMgYXJndWFibHkgb25lIG9mIHRoZSBtb3N0IHBvcHVsYXIgbWV0YS1sZWFybmluZyBhbGdvcml0aG1zIG5vd2FkYXlzLiBOZXZlcnRoZWxlc3MsIGl0cyBwZXJmb3JtYW5jZSBvbiBmZXctc2hvdCBjbGFzc2lmaWNhdGlvbiBpcyBmYXIgYmVoaW5kIG1hbnkgcmVjZW50IGFsZ29yaXRobXMgZGVkaWNhdGVkIHRvIHRoZSBwcm9ibGVtLiBJbiB0aGlzIHBhcGVyLCB3ZSBwb2ludCBvdXQgc2V2ZXJhbCBrZXkgZmFjZXRzIG9mIGhvdyB0byB0cmFpbiBNQU1MIHRvIGV4Y2VsIGluIGZldy1zaG90IGNsYXNzaWZpY2F0aW9uLiBGaXJzdCwgd2UgZmluZCB0aGF0IE1BTUwgbmVlZHMgYSBsYXJnZSBudW1iZXIgb2YgZ3JhZGllbnQgc3RlcHMgaW4gaXRzIGlubmVyIGxvb3AgdXBkYXRlLCB3aGljaCBjb250cmFkaWN0cyBpdHMgY29tbW9uIHVzYWdlIGluIGZldy1zaG90IGNsYXNzaWZpY2F0aW9uLiBTZWNvbmQsIHdlIGZpbmQgdGhhdCBNQU1MIGlzIHNlbnNpdGl2ZSB0byB0aGUgY2xhc3MgbGFiZWwgYXNzaWdubWVudHMgZHVyaW5nIG1ldGEtdGVzdGluZy4gQ29uY3JldGVseSwgTUFNTCBtZXRhLXRyYWlucyB0aGUgaW5pdGlhbGl6YXRpb24gb2YgYW4gJE4kLXdheSBjbGFzc2lmaWVyLiBUaGVzZSAkTiQgd2F5cywgZHVyaW5nIG1ldGEtdGVzdGluZywgdGhlbiBoYXZlICIkTiEkIiBkaWZmZXJlbnQgcGVybXV0YXRpb25zIHRvIGJlIHBhaXJlZCB3aXRoIGEgZmV3LXNob3QgdGFzayBvZiAkTiQgbm92ZWwgY2xhc3Nlcy4gV2UgZmluZCB0aGF0IHRoZXNlIHBlcm11dGF0aW9ucyBsZWFkIHRvIGEgaHVnZSB2YXJpYW5jZSBvZiBhY2N1cmFjeSwgbWFraW5nIE1BTUwgdW5zdGFibGUgaW4gZmV3LXNob3QgY2xhc3NpZmljYXRpb24uIFRoaXJkLCB3ZSBpbnZlc3RpZ2F0ZSBzZXZlcmFsIGFwcHJvYWNoZXMgdG8gbWFrZSBNQU1MIHBlcm11dGF0aW9uLWludmFyaWFudCwgYW1vbmcgd2hpY2ggbWV0YS10cmFpbmluZyBhIHNpbmdsZSB2ZWN0b3IgdG8gaW5pdGlhbGl6ZSBhbGwgdGhlICROJCB3ZWlnaHQgdmVjdG9ycyBpbiB0aGUgY2xhc3NpZmljYXRpb24gaGVhZCBwZXJmb3JtcyB0aGUgYmVzdC4gT24gYmVuY2htYXJrIGRhdGFzZXRzIGxpa2UgTWluaUltYWdlTmV0IGFuZCBUaWVyZWRJbWFnZU5ldCwgb3VyIGFwcHJvYWNoLCB3aGljaCB3ZSBuYW1lIFVOSUNPUk4tTUFNTCwgcGVyZm9ybXMgb24gYSBwYXIgd2l0aCBvciBldmVuIG91dHBlcmZvcm1zIG1hbnkgcmVjZW50IGZldy1zaG90IGNsYXNzaWZpY2F0aW9uIGFsZ29yaXRobXMsIHdpdGhvdXQgc2FjcmlmaWNpbmcgTUFNTCdzIHNpbXBsaWNpdHkuPC9kZXNjcmlwdGlvbj4KICAgIDxkZXNjcmlwdGlvbiBkZXNjcmlwdGlvblR5cGU9Ik90aGVyIj5BY2NlcHRlZCB0byBJbnRlcm5hdGlvbmFsIENvbmZlcmVuY2Ugb24gTGVhcm5pbmcgUmVwcmVzZW50YXRpb25zIDIwMjIgKElDTFIgMjAyMik8L2Rlc2NyaXB0aW9uPgogIDwvZGVzY3JpcHRpb25zPgo8L3Jlc291cmNlPg==","url":"https://arxiv.org/abs/2106.16245","contentUrl":null,"metadataVersion":1,"schemaVersion":"http://datacite.org/schema/kernel-4","source":"mds","isActive":true,"state":"findable","reason":null,"viewCount":0,"viewsOverTime":[],"downloadCount":0,"downloadsOverTime":[],"referenceCount":0,"citationCount":0,"citationsOverTime":[],"partCount":0,"partOfCount":0,"versionCount":0,"versionOfCount":0,"created":"2022-02-23T13:34:11.000Z","registered":"2022-02-23T13:34:12.000Z","published":"2021","updated":"2022-07-12T01:57:11.000Z"},"relationships":{"client":{"data":{"id":"arxiv.content","type":"clients"}},"provider":{"data":{"id":"arxiv","type":"providers"}},"media":{"data":{"id":"10.48550/arxiv.2106.16245","type":"media"}},"references":{"data":[]},"citations":{"data":[]},"parts":{"data":[]},"partOf":{"data":[]},"versions":{"data":[]},"versionOf":{"data":[]}}}}