{"data":{"id":"10.48550/arxiv.1905.02249","type":"dois","attributes":{"doi":"10.48550/arxiv.1905.02249","prefix":"10.48550","suffix":"arxiv.1905.02249","identifiers":[{"identifier":"1905.02249","identifierType":"arXiv"}],"alternateIdentifiers":[{"alternateIdentifierType":"arXiv","alternateIdentifier":"1905.02249"}],"creators":[{"name":"Berthelot, David","nameType":"Personal","givenName":"David","familyName":"Berthelot","affiliation":[],"nameIdentifiers":[]},{"name":"Carlini, Nicholas","nameType":"Personal","givenName":"Nicholas","familyName":"Carlini","affiliation":[],"nameIdentifiers":[]},{"name":"Goodfellow, Ian","nameType":"Personal","givenName":"Ian","familyName":"Goodfellow","affiliation":[],"nameIdentifiers":[]},{"name":"Papernot, Nicolas","nameType":"Personal","givenName":"Nicolas","familyName":"Papernot","affiliation":[],"nameIdentifiers":[]},{"name":"Oliver, Avital","nameType":"Personal","givenName":"Avital","familyName":"Oliver","affiliation":[],"nameIdentifiers":[]},{"name":"Raffel, Colin","nameType":"Personal","givenName":"Colin","familyName":"Raffel","affiliation":[],"nameIdentifiers":[]}],"titles":[{"title":"MixMatch: A Holistic Approach to Semi-Supervised Learning"}],"publisher":"arXiv","container":{},"publicationYear":2019,"subjects":[{"lang":"en","subject":"Machine Learning (cs.LG)","subjectScheme":"arXiv"},{"lang":"en","subject":"Artificial Intelligence (cs.AI)","subjectScheme":"arXiv"},{"lang":"en","subject":"Computer Vision and Pattern Recognition (cs.CV)","subjectScheme":"arXiv"},{"lang":"en","subject":"Machine Learning (stat.ML)","subjectScheme":"arXiv"},{"subject":"FOS: Computer and information sciences","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Computer and information sciences","schemeUri":"http://www.oecd.org/science/inno/38235147.pdf","subjectScheme":"Fields of Science and Technology (FOS)"}],"contributors":[],"dates":[{"date":"2019-05-06T19:56:03Z","dateType":"Submitted","dateInformation":"v1"},{"date":"2019-05-08T00:02:14Z","dateType":"Updated","dateInformation":"v1"},{"date":"2019-10-23T18:47:34Z","dateType":"Submitted","dateInformation":"v2"},{"date":"2019-10-25T00:02:10Z","dateType":"Updated","dateInformation":"v2"},{"date":"2019-05","dateType":"Available","dateInformation":"v1"},{"date":"2019","dateType":"Issued"}],"language":null,"types":{"ris":"GEN","bibtex":"misc","citeproc":"article","schemaOrg":"CreativeWork","resourceType":"Article","resourceTypeGeneral":"Preprint"},"relatedIdentifiers":[],"relatedItems":[],"sizes":[],"formats":[],"version":"2","rightsList":[{"rights":"arXiv.org perpetual, non-exclusive license","rightsUri":"http://arxiv.org/licenses/nonexclusive-distrib/1.0/"}],"descriptions":[{"description":"Semi-supervised learning has proven to be a powerful paradigm for leveraging unlabeled data to mitigate the reliance on large labeled datasets. In this work, we unify the current dominant approaches for semi-supervised learning to produce a new algorithm, MixMatch, that works by guessing low-entropy labels for data-augmented unlabeled examples and mixing labeled and unlabeled data using MixUp. We show that MixMatch obtains state-of-the-art results by a large margin across many datasets and labeled data amounts. For example, on CIFAR-10 with 250 labels, we reduce error rate by a factor of 4 (from 38% to 11%) and by a factor of 2 on STL-10. We also demonstrate how MixMatch can help achieve a dramatically better accuracy-privacy trade-off for differential privacy. Finally, we perform an ablation study to tease apart which components of MixMatch are most important for its success.","descriptionType":"Abstract"}],"geoLocations":[],"fundingReferences":[],"xml":"PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4KPHJlc291cmNlIHhtbG5zPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSIgeHNpOnNjaGVtYUxvY2F0aW9uPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCBodHRwOi8vc2NoZW1hLmRhdGFjaXRlLm9yZy9tZXRhL2tlcm5lbC00LjMvbWV0YWRhdGEueHNkIj4KICA8aWRlbnRpZmllciBpZGVudGlmaWVyVHlwZT0iRE9JIj4xMC40ODU1MC9BUlhJVi4xOTA1LjAyMjQ5PC9pZGVudGlmaWVyPgogIDxhbHRlcm5hdGVJZGVudGlmaWVycz4KICAgIDxhbHRlcm5hdGVJZGVudGlmaWVyIGFsdGVybmF0ZUlkZW50aWZpZXJUeXBlPSJhclhpdiI+MTkwNS4wMjI0OTwvYWx0ZXJuYXRlSWRlbnRpZmllcj4KICA8L2FsdGVybmF0ZUlkZW50aWZpZXJzPgogIDxjcmVhdG9ycz4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5CZXJ0aGVsb3QsIERhdmlkPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5EYXZpZDwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5CZXJ0aGVsb3Q8L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgICA8Y3JlYXRvcj4KICAgICAgPGNyZWF0b3JOYW1lIG5hbWVUeXBlPSJQZXJzb25hbCI+Q2FybGluaSwgTmljaG9sYXM8L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPk5pY2hvbGFzPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPkNhcmxpbmk8L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgICA8Y3JlYXRvcj4KICAgICAgPGNyZWF0b3JOYW1lIG5hbWVUeXBlPSJQZXJzb25hbCI+R29vZGZlbGxvdywgSWFuPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5JYW48L2dpdmVuTmFtZT4KICAgICAgPGZhbWlseU5hbWU+R29vZGZlbGxvdzwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5QYXBlcm5vdCwgTmljb2xhczwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+Tmljb2xhczwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5QYXBlcm5vdDwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5PbGl2ZXIsIEF2aXRhbDwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+QXZpdGFsPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPk9saXZlcjwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5SYWZmZWwsIENvbGluPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5Db2xpbjwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5SYWZmZWw8L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgPC9jcmVhdG9ycz4KICA8dGl0bGVzPgogICAgPHRpdGxlPk1peE1hdGNoOiBBIEhvbGlzdGljIEFwcHJvYWNoIHRvIFNlbWktU3VwZXJ2aXNlZCBMZWFybmluZzwvdGl0bGU+CiAgPC90aXRsZXM+CiAgPHB1Ymxpc2hlcj5hclhpdjwvcHVibGlzaGVyPgogIDxwdWJsaWNhdGlvblllYXI+MjAxOTwvcHVibGljYXRpb25ZZWFyPgogIDxzdWJqZWN0cz4KICAgIDxzdWJqZWN0IHhtbDpsYW5nPSJlbiIgc3ViamVjdFNjaGVtZT0iYXJYaXYiPk1hY2hpbmUgTGVhcm5pbmcgKGNzLkxHKTwvc3ViamVjdD4KICAgIDxzdWJqZWN0IHhtbDpsYW5nPSJlbiIgc3ViamVjdFNjaGVtZT0iYXJYaXYiPkFydGlmaWNpYWwgSW50ZWxsaWdlbmNlIChjcy5BSSk8L3N1YmplY3Q+CiAgICA8c3ViamVjdCB4bWw6bGFuZz0iZW4iIHN1YmplY3RTY2hlbWU9ImFyWGl2Ij5Db21wdXRlciBWaXNpb24gYW5kIFBhdHRlcm4gUmVjb2duaXRpb24gKGNzLkNWKTwvc3ViamVjdD4KICAgIDxzdWJqZWN0IHhtbDpsYW5nPSJlbiIgc3ViamVjdFNjaGVtZT0iYXJYaXYiPk1hY2hpbmUgTGVhcm5pbmcgKHN0YXQuTUwpPC9zdWJqZWN0PgogICAgPHN1YmplY3Qgc3ViamVjdFNjaGVtZT0iRmllbGRzIG9mIFNjaWVuY2UgYW5kIFRlY2hub2xvZ3kgKEZPUykiPkZPUzogQ29tcHV0ZXIgYW5kIGluZm9ybWF0aW9uIHNjaWVuY2VzPC9zdWJqZWN0PgogIDwvc3ViamVjdHM+CiAgPGRhdGVzPgogICAgPGRhdGUgZGF0ZVR5cGU9IlN1Ym1pdHRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2MSI+MjAxOS0wNS0wNlQxOTo1NjowM1o8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iVXBkYXRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2MSI+MjAxOS0wNS0wOFQwMDowMjoxNFo8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iU3VibWl0dGVkIiBkYXRlSW5mb3JtYXRpb249InYyIj4yMDE5LTEwLTIzVDE4OjQ3OjM0WjwvZGF0ZT4KICAgIDxkYXRlIGRhdGVUeXBlPSJVcGRhdGVkIiBkYXRlSW5mb3JtYXRpb249InYyIj4yMDE5LTEwLTI1VDAwOjAyOjEwWjwvZGF0ZT4KICAgIDxkYXRlIGRhdGVUeXBlPSJBdmFpbGFibGUiIGRhdGVJbmZvcm1hdGlvbj0idjEiPjIwMTktMDU8L2RhdGU+CiAgPC9kYXRlcz4KICA8cmVzb3VyY2VUeXBlIHJlc291cmNlVHlwZUdlbmVyYWw9IlByZXByaW50Ij5BcnRpY2xlPC9yZXNvdXJjZVR5cGU+CiAgPHZlcnNpb24+MjwvdmVyc2lvbj4KICA8cmlnaHRzTGlzdD4KICAgIDxyaWdodHMgcmlnaHRzVVJJPSJodHRwOi8vYXJ4aXYub3JnL2xpY2Vuc2VzL25vbmV4Y2x1c2l2ZS1kaXN0cmliLzEuMC8iPmFyWGl2Lm9yZyBwZXJwZXR1YWwsIG5vbi1leGNsdXNpdmUgbGljZW5zZTwvcmlnaHRzPgogIDwvcmlnaHRzTGlzdD4KICA8ZGVzY3JpcHRpb25zPgogICAgPGRlc2NyaXB0aW9uIGRlc2NyaXB0aW9uVHlwZT0iQWJzdHJhY3QiPlNlbWktc3VwZXJ2aXNlZCBsZWFybmluZyBoYXMgcHJvdmVuIHRvIGJlIGEgcG93ZXJmdWwgcGFyYWRpZ20gZm9yIGxldmVyYWdpbmcgdW5sYWJlbGVkIGRhdGEgdG8gbWl0aWdhdGUgdGhlIHJlbGlhbmNlIG9uIGxhcmdlIGxhYmVsZWQgZGF0YXNldHMuIEluIHRoaXMgd29yaywgd2UgdW5pZnkgdGhlIGN1cnJlbnQgZG9taW5hbnQgYXBwcm9hY2hlcyBmb3Igc2VtaS1zdXBlcnZpc2VkIGxlYXJuaW5nIHRvIHByb2R1Y2UgYSBuZXcgYWxnb3JpdGhtLCBNaXhNYXRjaCwgdGhhdCB3b3JrcyBieSBndWVzc2luZyBsb3ctZW50cm9weSBsYWJlbHMgZm9yIGRhdGEtYXVnbWVudGVkIHVubGFiZWxlZCBleGFtcGxlcyBhbmQgbWl4aW5nIGxhYmVsZWQgYW5kIHVubGFiZWxlZCBkYXRhIHVzaW5nIE1peFVwLiBXZSBzaG93IHRoYXQgTWl4TWF0Y2ggb2J0YWlucyBzdGF0ZS1vZi10aGUtYXJ0IHJlc3VsdHMgYnkgYSBsYXJnZSBtYXJnaW4gYWNyb3NzIG1hbnkgZGF0YXNldHMgYW5kIGxhYmVsZWQgZGF0YSBhbW91bnRzLiBGb3IgZXhhbXBsZSwgb24gQ0lGQVItMTAgd2l0aCAyNTAgbGFiZWxzLCB3ZSByZWR1Y2UgZXJyb3IgcmF0ZSBieSBhIGZhY3RvciBvZiA0IChmcm9tIDM4JSB0byAxMSUpIGFuZCBieSBhIGZhY3RvciBvZiAyIG9uIFNUTC0xMC4gV2UgYWxzbyBkZW1vbnN0cmF0ZSBob3cgTWl4TWF0Y2ggY2FuIGhlbHAgYWNoaWV2ZSBhIGRyYW1hdGljYWxseSBiZXR0ZXIgYWNjdXJhY3ktcHJpdmFjeSB0cmFkZS1vZmYgZm9yIGRpZmZlcmVudGlhbCBwcml2YWN5LiBGaW5hbGx5LCB3ZSBwZXJmb3JtIGFuIGFibGF0aW9uIHN0dWR5IHRvIHRlYXNlIGFwYXJ0IHdoaWNoIGNvbXBvbmVudHMgb2YgTWl4TWF0Y2ggYXJlIG1vc3QgaW1wb3J0YW50IGZvciBpdHMgc3VjY2Vzcy48L2Rlc2NyaXB0aW9uPgogIDwvZGVzY3JpcHRpb25zPgo8L3Jlc291cmNlPg==","url":"https://arxiv.org/abs/1905.02249","contentUrl":null,"metadataVersion":0,"schemaVersion":"http://datacite.org/schema/kernel-4","source":"mds","isActive":true,"state":"findable","reason":null,"viewCount":0,"viewsOverTime":[],"downloadCount":0,"downloadsOverTime":[],"referenceCount":0,"citationCount":0,"citationsOverTime":[],"partCount":0,"partOfCount":0,"versionCount":0,"versionOfCount":0,"created":"2022-02-28T10:02:49.000Z","registered":"2022-02-28T10:02:51.000Z","published":"2019","updated":"2022-02-28T10:02:51.000Z"},"relationships":{"client":{"data":{"id":"arxiv.content","type":"clients"}},"provider":{"data":{"id":"arxiv","type":"providers"}},"media":{"data":{"id":"10.48550/arxiv.1905.02249","type":"media"}},"references":{"data":[]},"citations":{"data":[]},"parts":{"data":[]},"partOf":{"data":[]},"versions":{"data":[]},"versionOf":{"data":[]}}}}