{"data":{"id":"10.48550/arxiv.2103.04814","type":"dois","attributes":{"doi":"10.48550/arxiv.2103.04814","prefix":"10.48550","suffix":"arxiv.2103.04814","identifiers":[{"identifier":"2103.04814","identifierType":"arXiv"}],"alternateIdentifiers":[{"alternateIdentifierType":"arXiv","alternateIdentifier":"2103.04814"}],"creators":[{"name":"Ding, Jian","nameType":"Personal","givenName":"Jian","familyName":"Ding","affiliation":[],"nameIdentifiers":[]},{"name":"Xie, Enze","nameType":"Personal","givenName":"Enze","familyName":"Xie","affiliation":[],"nameIdentifiers":[]},{"name":"Xu, Hang","nameType":"Personal","givenName":"Hang","familyName":"Xu","affiliation":[],"nameIdentifiers":[]},{"name":"Jiang, Chenhan","nameType":"Personal","givenName":"Chenhan","familyName":"Jiang","affiliation":[],"nameIdentifiers":[]},{"name":"Li, Zhenguo","nameType":"Personal","givenName":"Zhenguo","familyName":"Li","affiliation":[],"nameIdentifiers":[]},{"name":"Luo, Ping","nameType":"Personal","givenName":"Ping","familyName":"Luo","affiliation":[],"nameIdentifiers":[]},{"name":"Xia, Gui-Song","nameType":"Personal","givenName":"Gui-Song","familyName":"Xia","affiliation":[],"nameIdentifiers":[]}],"titles":[{"title":"Deeply Unsupervised Patch Re-Identification for Pre-training Object Detectors"}],"publisher":"arXiv","container":{},"publicationYear":2021,"subjects":[{"lang":"en","subject":"Computer Vision and Pattern Recognition (cs.CV)","subjectScheme":"arXiv"},{"subject":"FOS: Computer and information sciences","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Computer and information sciences","schemeUri":"http://www.oecd.org/science/inno/38235147.pdf","subjectScheme":"Fields of Science and Technology (FOS)"}],"contributors":[],"dates":[{"date":"2021-03-08T15:13:59Z","dateType":"Submitted","dateInformation":"v1"},{"date":"2021-03-09T01:42:34Z","dateType":"Updated","dateInformation":"v1"},{"date":"2022-04-10T09:02:09Z","dateType":"Submitted","dateInformation":"v2"},{"date":"2022-04-12T00:21:48Z","dateType":"Updated","dateInformation":"v2"},{"date":"2021-03","dateType":"Available","dateInformation":"v1"},{"date":"2021","dateType":"Issued"}],"language":null,"types":{"ris":"RPRT","bibtex":"article","citeproc":"article-journal","schemaOrg":"ScholarlyArticle","resourceType":"Article","resourceTypeGeneral":"Text"},"relatedIdentifiers":[{"relationType":"IsVersionOf","relatedIdentifier":"10.1109/tpami.2022.3164911","relatedIdentifierType":"DOI"}],"relatedItems":[],"sizes":[],"formats":[],"version":"2","rightsList":[{"rights":"arXiv.org perpetual, non-exclusive license","rightsUri":"http://arxiv.org/licenses/nonexclusive-distrib/1.0/"}],"descriptions":[{"description":"Unsupervised pre-training aims at learning transferable features that are beneficial for downstream tasks. However, most state-of-the-art unsupervised methods concentrate on learning global representations for image-level classification tasks instead of discriminative local region representations, which limits their transferability to region-level downstream tasks, such as object detection. To improve the transferability of pre-trained features to object detection, we present Deeply Unsupervised Patch Re-ID (DUPR), a simple yet effective method for unsupervised visual representation learning. The patch Re-ID task treats individual patch as a pseudo-identity and contrastively learns its correspondence in two views, enabling us to obtain discriminative local features for object detection. Then the proposed patch Re-ID is performed in a deeply unsupervised manner, appealing to object detection, which usually requires multilevel feature maps. Extensive experiments demonstrate that DUPR outperforms state-of-the-art unsupervised pre-trainings and even the ImageNet supervised pre-training on various downstream tasks related to object detection.","descriptionType":"Abstract"},{"description":"Accepted to IEEE TPAMI","descriptionType":"Other"}],"geoLocations":[],"fundingReferences":[],"xml":"PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4KPHJlc291cmNlIHhtbG5zPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSIgeHNpOnNjaGVtYUxvY2F0aW9uPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCBodHRwOi8vc2NoZW1hLmRhdGFjaXRlLm9yZy9tZXRhL2tlcm5lbC00LjMvbWV0YWRhdGEueHNkIj4KICA8aWRlbnRpZmllciBpZGVudGlmaWVyVHlwZT0iRE9JIj4xMC40ODU1MC9BUlhJVi4yMTAzLjA0ODE0PC9pZGVudGlmaWVyPgogIDxhbHRlcm5hdGVJZGVudGlmaWVycz4KICAgIDxhbHRlcm5hdGVJZGVudGlmaWVyIGFsdGVybmF0ZUlkZW50aWZpZXJUeXBlPSJhclhpdiI+MjEwMy4wNDgxNDwvYWx0ZXJuYXRlSWRlbnRpZmllcj4KICA8L2FsdGVybmF0ZUlkZW50aWZpZXJzPgogIDxjcmVhdG9ycz4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5EaW5nLCBKaWFuPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5KaWFuPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPkRpbmc8L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgICA8Y3JlYXRvcj4KICAgICAgPGNyZWF0b3JOYW1lIG5hbWVUeXBlPSJQZXJzb25hbCI+WGllLCBFbnplPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5FbnplPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPlhpZTwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5YdSwgSGFuZzwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+SGFuZzwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5YdTwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5KaWFuZywgQ2hlbmhhbjwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+Q2hlbmhhbjwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5KaWFuZzwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5MaSwgWmhlbmd1bzwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+Wmhlbmd1bzwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5MaTwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5MdW8sIFBpbmc8L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPlBpbmc8L2dpdmVuTmFtZT4KICAgICAgPGZhbWlseU5hbWU+THVvPC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogICAgPGNyZWF0b3I+CiAgICAgIDxjcmVhdG9yTmFtZSBuYW1lVHlwZT0iUGVyc29uYWwiPlhpYSwgR3VpLVNvbmc8L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPkd1aS1Tb25nPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPlhpYTwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICA8L2NyZWF0b3JzPgogIDx0aXRsZXM+CiAgICA8dGl0bGU+RGVlcGx5IFVuc3VwZXJ2aXNlZCBQYXRjaCBSZS1JZGVudGlmaWNhdGlvbiBmb3IgUHJlLXRyYWluaW5nIE9iamVjdCBEZXRlY3RvcnM8L3RpdGxlPgogIDwvdGl0bGVzPgogIDxwdWJsaXNoZXI+YXJYaXY8L3B1Ymxpc2hlcj4KICA8cHVibGljYXRpb25ZZWFyPjIwMjE8L3B1YmxpY2F0aW9uWWVhcj4KICA8c3ViamVjdHM+CiAgICA8c3ViamVjdCB4bWw6bGFuZz0iZW4iIHN1YmplY3RTY2hlbWU9ImFyWGl2Ij5Db21wdXRlciBWaXNpb24gYW5kIFBhdHRlcm4gUmVjb2duaXRpb24gKGNzLkNWKTwvc3ViamVjdD4KICAgIDxzdWJqZWN0IHN1YmplY3RTY2hlbWU9IkZpZWxkcyBvZiBTY2llbmNlIGFuZCBUZWNobm9sb2d5IChGT1MpIj5GT1M6IENvbXB1dGVyIGFuZCBpbmZvcm1hdGlvbiBzY2llbmNlczwvc3ViamVjdD4KICA8L3N1YmplY3RzPgogIDxkYXRlcz4KICAgIDxkYXRlIGRhdGVUeXBlPSJTdWJtaXR0ZWQiIGRhdGVJbmZvcm1hdGlvbj0idjEiPjIwMjEtMDMtMDhUMTU6MTM6NTlaPC9kYXRlPgogICAgPGRhdGUgZGF0ZVR5cGU9IlVwZGF0ZWQiIGRhdGVJbmZvcm1hdGlvbj0idjEiPjIwMjEtMDMtMDlUMDE6NDI6MzRaPC9kYXRlPgogICAgPGRhdGUgZGF0ZVR5cGU9IlN1Ym1pdHRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2MiI+MjAyMi0wNC0xMFQwOTowMjowOVo8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iVXBkYXRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2MiI+MjAyMi0wNC0xMlQwMDoyMTo0OFo8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iQXZhaWxhYmxlIiBkYXRlSW5mb3JtYXRpb249InYxIj4yMDIxLTAzPC9kYXRlPgogIDwvZGF0ZXM+CiAgPHJlc291cmNlVHlwZSByZXNvdXJjZVR5cGVHZW5lcmFsPSJUZXh0Ij5BcnRpY2xlPC9yZXNvdXJjZVR5cGU+CiAgPHJlbGF0ZWRJZGVudGlmaWVycz4KICAgIDxyZWxhdGVkSWRlbnRpZmllciByZWxhdGVkSWRlbnRpZmllclR5cGU9IkRPSSIgcmVsYXRpb25UeXBlPSJJc1ZlcnNpb25PZiI+MTAuMTEwOS9UUEFNSS4yMDIyLjMxNjQ5MTE8L3JlbGF0ZWRJZGVudGlmaWVyPgogIDwvcmVsYXRlZElkZW50aWZpZXJzPgogIDx2ZXJzaW9uPjI8L3ZlcnNpb24+CiAgPHJpZ2h0c0xpc3Q+CiAgICA8cmlnaHRzIHJpZ2h0c1VSST0iaHR0cDovL2FyeGl2Lm9yZy9saWNlbnNlcy9ub25leGNsdXNpdmUtZGlzdHJpYi8xLjAvIj5hclhpdi5vcmcgcGVycGV0dWFsLCBub24tZXhjbHVzaXZlIGxpY2Vuc2U8L3JpZ2h0cz4KICA8L3JpZ2h0c0xpc3Q+CiAgPGRlc2NyaXB0aW9ucz4KICAgIDxkZXNjcmlwdGlvbiBkZXNjcmlwdGlvblR5cGU9IkFic3RyYWN0Ij5VbnN1cGVydmlzZWQgcHJlLXRyYWluaW5nIGFpbXMgYXQgbGVhcm5pbmcgdHJhbnNmZXJhYmxlIGZlYXR1cmVzIHRoYXQgYXJlIGJlbmVmaWNpYWwgZm9yIGRvd25zdHJlYW0gdGFza3MuIEhvd2V2ZXIsIG1vc3Qgc3RhdGUtb2YtdGhlLWFydCB1bnN1cGVydmlzZWQgbWV0aG9kcyBjb25jZW50cmF0ZSBvbiBsZWFybmluZyBnbG9iYWwgcmVwcmVzZW50YXRpb25zIGZvciBpbWFnZS1sZXZlbCBjbGFzc2lmaWNhdGlvbiB0YXNrcyBpbnN0ZWFkIG9mIGRpc2NyaW1pbmF0aXZlIGxvY2FsIHJlZ2lvbiByZXByZXNlbnRhdGlvbnMsIHdoaWNoIGxpbWl0cyB0aGVpciB0cmFuc2ZlcmFiaWxpdHkgdG8gcmVnaW9uLWxldmVsIGRvd25zdHJlYW0gdGFza3MsIHN1Y2ggYXMgb2JqZWN0IGRldGVjdGlvbi4gVG8gaW1wcm92ZSB0aGUgdHJhbnNmZXJhYmlsaXR5IG9mIHByZS10cmFpbmVkIGZlYXR1cmVzIHRvIG9iamVjdCBkZXRlY3Rpb24sIHdlIHByZXNlbnQgRGVlcGx5IFVuc3VwZXJ2aXNlZCBQYXRjaCBSZS1JRCAoRFVQUiksIGEgc2ltcGxlIHlldCBlZmZlY3RpdmUgbWV0aG9kIGZvciB1bnN1cGVydmlzZWQgdmlzdWFsIHJlcHJlc2VudGF0aW9uIGxlYXJuaW5nLiBUaGUgcGF0Y2ggUmUtSUQgdGFzayB0cmVhdHMgaW5kaXZpZHVhbCBwYXRjaCBhcyBhIHBzZXVkby1pZGVudGl0eSBhbmQgY29udHJhc3RpdmVseSBsZWFybnMgaXRzIGNvcnJlc3BvbmRlbmNlIGluIHR3byB2aWV3cywgZW5hYmxpbmcgdXMgdG8gb2J0YWluIGRpc2NyaW1pbmF0aXZlIGxvY2FsIGZlYXR1cmVzIGZvciBvYmplY3QgZGV0ZWN0aW9uLiBUaGVuIHRoZSBwcm9wb3NlZCBwYXRjaCBSZS1JRCBpcyBwZXJmb3JtZWQgaW4gYSBkZWVwbHkgdW5zdXBlcnZpc2VkIG1hbm5lciwgYXBwZWFsaW5nIHRvIG9iamVjdCBkZXRlY3Rpb24sIHdoaWNoIHVzdWFsbHkgcmVxdWlyZXMgbXVsdGlsZXZlbCBmZWF0dXJlIG1hcHMuIEV4dGVuc2l2ZSBleHBlcmltZW50cyBkZW1vbnN0cmF0ZSB0aGF0IERVUFIgb3V0cGVyZm9ybXMgc3RhdGUtb2YtdGhlLWFydCB1bnN1cGVydmlzZWQgcHJlLXRyYWluaW5ncyBhbmQgZXZlbiB0aGUgSW1hZ2VOZXQgc3VwZXJ2aXNlZCBwcmUtdHJhaW5pbmcgb24gdmFyaW91cyBkb3duc3RyZWFtIHRhc2tzIHJlbGF0ZWQgdG8gb2JqZWN0IGRldGVjdGlvbi48L2Rlc2NyaXB0aW9uPgogICAgPGRlc2NyaXB0aW9uIGRlc2NyaXB0aW9uVHlwZT0iT3RoZXIiPkFjY2VwdGVkIHRvIElFRUUgVFBBTUk8L2Rlc2NyaXB0aW9uPgogIDwvZGVzY3JpcHRpb25zPgo8L3Jlc291cmNlPg==","url":"https://arxiv.org/abs/2103.04814","contentUrl":null,"metadataVersion":1,"schemaVersion":"http://datacite.org/schema/kernel-4","source":"mds","isActive":true,"state":"findable","reason":null,"viewCount":0,"viewsOverTime":[],"downloadCount":0,"downloadsOverTime":[],"referenceCount":0,"citationCount":0,"citationsOverTime":[],"partCount":0,"partOfCount":0,"versionCount":0,"versionOfCount":1,"created":"2022-02-22T04:24:35.000Z","registered":"2022-02-22T04:24:37.000Z","published":"2021","updated":"2022-04-12T03:02:36.000Z"},"relationships":{"client":{"data":{"id":"arxiv.content","type":"clients"}},"provider":{"data":{"id":"arxiv","type":"providers"}},"media":{"data":{"id":"10.48550/arxiv.2103.04814","type":"media"}},"references":{"data":[]},"citations":{"data":[]},"parts":{"data":[]},"partOf":{"data":[]},"versions":{"data":[]},"versionOf":{"data":[{"id":"10.1109/tpami.2022.3164911","type":"dois"}]}}}}