{"data":{"id":"10.48550/arxiv.2207.08095","type":"dois","attributes":{"doi":"10.48550/arxiv.2207.08095","prefix":"10.48550","suffix":"arxiv.2207.08095","identifiers":[{"identifier":"2207.08095","identifierType":"arXiv"}],"alternateIdentifiers":[{"alternateIdentifierType":"arXiv","alternateIdentifier":"2207.08095"}],"creators":[{"name":"Tang, Yansong","nameType":"Personal","givenName":"Yansong","familyName":"Tang","affiliation":[],"nameIdentifiers":[]},{"name":"Liu, Xingyu","nameType":"Personal","givenName":"Xingyu","familyName":"Liu","affiliation":[],"nameIdentifiers":[]},{"name":"Yu, Xumin","nameType":"Personal","givenName":"Xumin","familyName":"Yu","affiliation":[],"nameIdentifiers":[]},{"name":"Zhang, Danyang","nameType":"Personal","givenName":"Danyang","familyName":"Zhang","affiliation":[],"nameIdentifiers":[]},{"name":"Lu, Jiwen","nameType":"Personal","givenName":"Jiwen","familyName":"Lu","affiliation":[],"nameIdentifiers":[]},{"name":"Zhou, Jie","nameType":"Personal","givenName":"Jie","familyName":"Zhou","affiliation":[],"nameIdentifiers":[]}],"titles":[{"title":"Learning from Temporal Spatial Cubism for Cross-Dataset Skeleton-based Action Recognition"}],"publisher":"arXiv","container":{},"publicationYear":2022,"subjects":[{"lang":"en","subject":"Computer Vision and Pattern Recognition (cs.CV)","subjectScheme":"arXiv"},{"subject":"FOS: Computer and information sciences","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Computer and information sciences","schemeUri":"http://www.oecd.org/science/inno/38235147.pdf","subjectScheme":"Fields of Science and Technology (FOS)"}],"contributors":[],"dates":[{"date":"2022-07-17T07:05:39Z","dateType":"Submitted","dateInformation":"v1"},{"date":"2022-07-19T00:17:21Z","dateType":"Updated","dateInformation":"v1"},{"date":"2022-07","dateType":"Available","dateInformation":"v1"},{"date":"2022","dateType":"Issued"}],"language":null,"types":{"ris":"RPRT","bibtex":"article","citeproc":"article-journal","schemaOrg":"ScholarlyArticle","resourceType":"Article","resourceTypeGeneral":"Text"},"relatedIdentifiers":[{"relationType":"IsVersionOf","relatedIdentifier":"10.1145/3472722","relatedIdentifierType":"DOI"}],"relatedItems":[],"sizes":[],"formats":[],"version":"1","rightsList":[{"rights":"arXiv.org perpetual, non-exclusive license","rightsUri":"http://arxiv.org/licenses/nonexclusive-distrib/1.0/"}],"descriptions":[{"description":"Rapid progress and superior performance have been achieved for skeleton-based action recognition recently. In this article, we investigate this problem under a cross-dataset setting, which is a new, pragmatic, and challenging task in real-world scenarios. Following the unsupervised domain adaptation (UDA) paradigm, the action labels are only available on a source dataset, but unavailable on a target dataset in the training stage. Different from the conventional adversarial learning-based approaches for UDA, we utilize a self-supervision scheme to reduce the domain shift between two skeleton-based action datasets. Our inspiration is drawn from Cubism, an art genre from the early 20th century, which breaks and reassembles the objects to convey a greater context. By segmenting and permuting temporal segments or human body parts, we design two self-supervised learning classification tasks to explore the temporal and spatial dependency of a skeleton-based action and improve the generalization ability of the model. We conduct experiments on six datasets for skeleton-based action recognition, including three large-scale datasets (NTU RGB+D, PKU-MMD, and Kinetics) where new cross-dataset settings and benchmarks are established. Extensive results demonstrate that our method outperforms state-of-the-art approaches. The source codes of our model and all the compared methods are available at https://github.com/shanice-l/st-cubism.","descriptionType":"Abstract"},{"description":"Accepted by ACM TOMM, https://dl.acm.org/doi/10.1145/3472722","descriptionType":"Other"}],"geoLocations":[],"fundingReferences":[],"xml":"PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4KPHJlc291cmNlIHhtbG5zPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSIgeHNpOnNjaGVtYUxvY2F0aW9uPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCBodHRwOi8vc2NoZW1hLmRhdGFjaXRlLm9yZy9tZXRhL2tlcm5lbC00LjMvbWV0YWRhdGEueHNkIj4KICA8aWRlbnRpZmllciBpZGVudGlmaWVyVHlwZT0iRE9JIj4xMC40ODU1MC9BUlhJVi4yMjA3LjA4MDk1PC9pZGVudGlmaWVyPgogIDxhbHRlcm5hdGVJZGVudGlmaWVycz4KICAgIDxhbHRlcm5hdGVJZGVudGlmaWVyIGFsdGVybmF0ZUlkZW50aWZpZXJUeXBlPSJhclhpdiI+MjIwNy4wODA5NTwvYWx0ZXJuYXRlSWRlbnRpZmllcj4KICA8L2FsdGVybmF0ZUlkZW50aWZpZXJzPgogIDxjcmVhdG9ycz4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5UYW5nLCBZYW5zb25nPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5ZYW5zb25nPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPlRhbmc8L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgICA8Y3JlYXRvcj4KICAgICAgPGNyZWF0b3JOYW1lIG5hbWVUeXBlPSJQZXJzb25hbCI+TGl1LCBYaW5neXU8L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPlhpbmd5dTwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5MaXU8L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgICA8Y3JlYXRvcj4KICAgICAgPGNyZWF0b3JOYW1lIG5hbWVUeXBlPSJQZXJzb25hbCI+WXUsIFh1bWluPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5YdW1pbjwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5ZdTwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5aaGFuZywgRGFueWFuZzwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+RGFueWFuZzwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5aaGFuZzwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5MdSwgSml3ZW48L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPkppd2VuPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPkx1PC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogICAgPGNyZWF0b3I+CiAgICAgIDxjcmVhdG9yTmFtZSBuYW1lVHlwZT0iUGVyc29uYWwiPlpob3UsIEppZTwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+SmllPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPlpob3U8L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgPC9jcmVhdG9ycz4KICA8dGl0bGVzPgogICAgPHRpdGxlPkxlYXJuaW5nIGZyb20gVGVtcG9yYWwgU3BhdGlhbCBDdWJpc20gZm9yIENyb3NzLURhdGFzZXQgU2tlbGV0b24tYmFzZWQgQWN0aW9uIFJlY29nbml0aW9uPC90aXRsZT4KICA8L3RpdGxlcz4KICA8cHVibGlzaGVyPmFyWGl2PC9wdWJsaXNoZXI+CiAgPHB1YmxpY2F0aW9uWWVhcj4yMDIyPC9wdWJsaWNhdGlvblllYXI+CiAgPHN1YmplY3RzPgogICAgPHN1YmplY3QgeG1sOmxhbmc9ImVuIiBzdWJqZWN0U2NoZW1lPSJhclhpdiI+Q29tcHV0ZXIgVmlzaW9uIGFuZCBQYXR0ZXJuIFJlY29nbml0aW9uIChjcy5DVik8L3N1YmplY3Q+CiAgICA8c3ViamVjdCBzdWJqZWN0U2NoZW1lPSJGaWVsZHMgb2YgU2NpZW5jZSBhbmQgVGVjaG5vbG9neSAoRk9TKSI+Rk9TOiBDb21wdXRlciBhbmQgaW5mb3JtYXRpb24gc2NpZW5jZXM8L3N1YmplY3Q+CiAgPC9zdWJqZWN0cz4KICA8ZGF0ZXM+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iU3VibWl0dGVkIiBkYXRlSW5mb3JtYXRpb249InYxIj4yMDIyLTA3LTE3VDA3OjA1OjM5WjwvZGF0ZT4KICAgIDxkYXRlIGRhdGVUeXBlPSJVcGRhdGVkIiBkYXRlSW5mb3JtYXRpb249InYxIj4yMDIyLTA3LTE5VDAwOjE3OjIxWjwvZGF0ZT4KICAgIDxkYXRlIGRhdGVUeXBlPSJBdmFpbGFibGUiIGRhdGVJbmZvcm1hdGlvbj0idjEiPjIwMjItMDc8L2RhdGU+CiAgPC9kYXRlcz4KICA8cmVzb3VyY2VUeXBlIHJlc291cmNlVHlwZUdlbmVyYWw9IlRleHQiPkFydGljbGU8L3Jlc291cmNlVHlwZT4KICA8cmVsYXRlZElkZW50aWZpZXJzPgogICAgPHJlbGF0ZWRJZGVudGlmaWVyIHJlbGF0ZWRJZGVudGlmaWVyVHlwZT0iRE9JIiByZWxhdGlvblR5cGU9IklzVmVyc2lvbk9mIj4xMC4xMTQ1LzM0NzI3MjI8L3JlbGF0ZWRJZGVudGlmaWVyPgogIDwvcmVsYXRlZElkZW50aWZpZXJzPgogIDx2ZXJzaW9uPjE8L3ZlcnNpb24+CiAgPHJpZ2h0c0xpc3Q+CiAgICA8cmlnaHRzIHJpZ2h0c1VSST0iaHR0cDovL2FyeGl2Lm9yZy9saWNlbnNlcy9ub25leGNsdXNpdmUtZGlzdHJpYi8xLjAvIj5hclhpdi5vcmcgcGVycGV0dWFsLCBub24tZXhjbHVzaXZlIGxpY2Vuc2U8L3JpZ2h0cz4KICA8L3JpZ2h0c0xpc3Q+CiAgPGRlc2NyaXB0aW9ucz4KICAgIDxkZXNjcmlwdGlvbiBkZXNjcmlwdGlvblR5cGU9IkFic3RyYWN0Ij5SYXBpZCBwcm9ncmVzcyBhbmQgc3VwZXJpb3IgcGVyZm9ybWFuY2UgaGF2ZSBiZWVuIGFjaGlldmVkIGZvciBza2VsZXRvbi1iYXNlZCBhY3Rpb24gcmVjb2duaXRpb24gcmVjZW50bHkuIEluIHRoaXMgYXJ0aWNsZSwgd2UgaW52ZXN0aWdhdGUgdGhpcyBwcm9ibGVtIHVuZGVyIGEgY3Jvc3MtZGF0YXNldCBzZXR0aW5nLCB3aGljaCBpcyBhIG5ldywgcHJhZ21hdGljLCBhbmQgY2hhbGxlbmdpbmcgdGFzayBpbiByZWFsLXdvcmxkIHNjZW5hcmlvcy4gRm9sbG93aW5nIHRoZSB1bnN1cGVydmlzZWQgZG9tYWluIGFkYXB0YXRpb24gKFVEQSkgcGFyYWRpZ20sIHRoZSBhY3Rpb24gbGFiZWxzIGFyZSBvbmx5IGF2YWlsYWJsZSBvbiBhIHNvdXJjZSBkYXRhc2V0LCBidXQgdW5hdmFpbGFibGUgb24gYSB0YXJnZXQgZGF0YXNldCBpbiB0aGUgdHJhaW5pbmcgc3RhZ2UuIERpZmZlcmVudCBmcm9tIHRoZSBjb252ZW50aW9uYWwgYWR2ZXJzYXJpYWwgbGVhcm5pbmctYmFzZWQgYXBwcm9hY2hlcyBmb3IgVURBLCB3ZSB1dGlsaXplIGEgc2VsZi1zdXBlcnZpc2lvbiBzY2hlbWUgdG8gcmVkdWNlIHRoZSBkb21haW4gc2hpZnQgYmV0d2VlbiB0d28gc2tlbGV0b24tYmFzZWQgYWN0aW9uIGRhdGFzZXRzLiBPdXIgaW5zcGlyYXRpb24gaXMgZHJhd24gZnJvbSBDdWJpc20sIGFuIGFydCBnZW5yZSBmcm9tIHRoZSBlYXJseSAyMHRoIGNlbnR1cnksIHdoaWNoIGJyZWFrcyBhbmQgcmVhc3NlbWJsZXMgdGhlIG9iamVjdHMgdG8gY29udmV5IGEgZ3JlYXRlciBjb250ZXh0LiBCeSBzZWdtZW50aW5nIGFuZCBwZXJtdXRpbmcgdGVtcG9yYWwgc2VnbWVudHMgb3IgaHVtYW4gYm9keSBwYXJ0cywgd2UgZGVzaWduIHR3byBzZWxmLXN1cGVydmlzZWQgbGVhcm5pbmcgY2xhc3NpZmljYXRpb24gdGFza3MgdG8gZXhwbG9yZSB0aGUgdGVtcG9yYWwgYW5kIHNwYXRpYWwgZGVwZW5kZW5jeSBvZiBhIHNrZWxldG9uLWJhc2VkIGFjdGlvbiBhbmQgaW1wcm92ZSB0aGUgZ2VuZXJhbGl6YXRpb24gYWJpbGl0eSBvZiB0aGUgbW9kZWwuIFdlIGNvbmR1Y3QgZXhwZXJpbWVudHMgb24gc2l4IGRhdGFzZXRzIGZvciBza2VsZXRvbi1iYXNlZCBhY3Rpb24gcmVjb2duaXRpb24sIGluY2x1ZGluZyB0aHJlZSBsYXJnZS1zY2FsZSBkYXRhc2V0cyAoTlRVIFJHQitELCBQS1UtTU1ELCBhbmQgS2luZXRpY3MpIHdoZXJlIG5ldyBjcm9zcy1kYXRhc2V0IHNldHRpbmdzIGFuZCBiZW5jaG1hcmtzIGFyZSBlc3RhYmxpc2hlZC4gRXh0ZW5zaXZlIHJlc3VsdHMgZGVtb25zdHJhdGUgdGhhdCBvdXIgbWV0aG9kIG91dHBlcmZvcm1zIHN0YXRlLW9mLXRoZS1hcnQgYXBwcm9hY2hlcy4gVGhlIHNvdXJjZSBjb2RlcyBvZiBvdXIgbW9kZWwgYW5kIGFsbCB0aGUgY29tcGFyZWQgbWV0aG9kcyBhcmUgYXZhaWxhYmxlIGF0IGh0dHBzOi8vZ2l0aHViLmNvbS9zaGFuaWNlLWwvc3QtY3ViaXNtLjwvZGVzY3JpcHRpb24+CiAgICA8ZGVzY3JpcHRpb24gZGVzY3JpcHRpb25UeXBlPSJPdGhlciI+QWNjZXB0ZWQgYnkgQUNNIFRPTU0sIGh0dHBzOi8vZGwuYWNtLm9yZy9kb2kvMTAuMTE0NS8zNDcyNzIyPC9kZXNjcmlwdGlvbj4KICA8L2Rlc2NyaXB0aW9ucz4KPC9yZXNvdXJjZT4=","url":"https://arxiv.org/abs/2207.08095","contentUrl":null,"metadataVersion":0,"schemaVersion":"http://datacite.org/schema/kernel-4","source":"mds","isActive":true,"state":"findable","reason":null,"viewCount":0,"viewsOverTime":[],"downloadCount":0,"downloadsOverTime":[],"referenceCount":0,"citationCount":0,"citationsOverTime":[],"partCount":0,"partOfCount":0,"versionCount":0,"versionOfCount":0,"created":"2022-07-19T01:31:57.000Z","registered":"2022-07-19T01:31:58.000Z","published":"2022","updated":"2022-07-19T01:31:58.000Z"},"relationships":{"client":{"data":{"id":"arxiv.content","type":"clients"}},"provider":{"data":{"id":"arxiv","type":"providers"}},"media":{"data":{"id":"10.48550/arxiv.2207.08095","type":"media"}},"references":{"data":[]},"citations":{"data":[]},"parts":{"data":[]},"partOf":{"data":[]},"versions":{"data":[]},"versionOf":{"data":[]}}}}