{"data":{"id":"10.48550/arxiv.2312.15717","type":"dois","attributes":{"doi":"10.48550/arxiv.2312.15717","prefix":"10.48550","suffix":"arxiv.2312.15717","identifiers":[{"identifier":"2312.15717","identifierType":"arXiv"}],"alternateIdentifiers":[{"alternateIdentifierType":"arXiv","alternateIdentifier":"2312.15717"}],"creators":[{"name":"Zhang, Zhaofan","nameType":"Personal","givenName":"Zhaofan","familyName":"Zhang","affiliation":[],"nameIdentifiers":[]},{"name":"Xiao, Yanan","nameType":"Personal","givenName":"Yanan","familyName":"Xiao","affiliation":[],"nameIdentifiers":[]},{"name":"Jiang, Lu","nameType":"Personal","givenName":"Lu","familyName":"Jiang","affiliation":[],"nameIdentifiers":[]},{"name":"Yang, Dingqi","nameType":"Personal","givenName":"Dingqi","familyName":"Yang","affiliation":[],"nameIdentifiers":[]},{"name":"Yin, Minghao","nameType":"Personal","givenName":"Minghao","familyName":"Yin","affiliation":[],"nameIdentifiers":[]},{"name":"Wang, Pengyang","nameType":"Personal","givenName":"Pengyang","familyName":"Wang","affiliation":[],"nameIdentifiers":[]}],"titles":[{"title":"Spatial-Temporal Interplay in Human Mobility: A Hierarchical Reinforcement Learning Approach with Hypergraph Representation"}],"publisher":"arXiv","container":{},"publicationYear":2023,"subjects":[{"lang":"en","subject":"Artificial Intelligence (cs.AI)","subjectScheme":"arXiv"},{"lang":"en","subject":"Computers and Society (cs.CY)","subjectScheme":"arXiv"},{"lang":"en","subject":"Machine Learning (cs.LG)","subjectScheme":"arXiv"},{"subject":"FOS: Computer and information sciences","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Computer and information sciences","schemeUri":"http://www.oecd.org/science/inno/38235147.pdf","subjectScheme":"Fields of Science and Technology (FOS)"}],"contributors":[],"dates":[{"date":"2023-12-25T13:00:05Z","dateType":"Submitted","dateInformation":"v1"},{"date":"2023-12-27T01:44:09Z","dateType":"Updated","dateInformation":"v1"},{"date":"2023-12","dateType":"Available","dateInformation":"v1"},{"date":"2023","dateType":"Issued"}],"language":null,"types":{"ris":"GEN","bibtex":"misc","citeproc":"article","schemaOrg":"CreativeWork","resourceType":"Article","resourceTypeGeneral":"Preprint"},"relatedIdentifiers":[],"relatedItems":[],"sizes":[],"formats":[],"version":"1","rightsList":[{"rights":"arXiv.org perpetual, non-exclusive license","rightsUri":"http://arxiv.org/licenses/nonexclusive-distrib/1.0/"}],"descriptions":[{"description":"In the realm of human mobility, the decision-making process for selecting the next-visit location is intricately influenced by a trade-off between spatial and temporal constraints, which are reflective of individual needs and preferences. This trade-off, however, varies across individuals, making the modeling of these spatial-temporal dynamics a formidable challenge. To address the problem, in this work, we introduce the \"Spatial-temporal Induced Hierarchical Reinforcement Learning\" (STI-HRL) framework, for capturing the interplay between spatial and temporal factors in human mobility decision-making. Specifically, STI-HRL employs a two-tiered decision-making process: the low-level focuses on disentangling spatial and temporal preferences using dedicated agents, while the high-level integrates these considerations to finalize the decision. To complement the hierarchical decision setting, we construct a hypergraph to organize historical data, encapsulating the multi-aspect semantics of human mobility. We propose a cross-channel hypergraph embedding module to learn the representations as the states to facilitate the decision-making cycle. Our extensive experiments on two real-world datasets validate the superiority of STI-HRL over state-of-the-art methods in predicting users' next visits across various performance metrics.","descriptionType":"Abstract"},{"description":"Accepted to AAAI 2024","descriptionType":"Other"}],"geoLocations":[],"fundingReferences":[],"xml":"PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4KPHJlc291cmNlIHhtbG5zPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSIgeHNpOnNjaGVtYUxvY2F0aW9uPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCBodHRwOi8vc2NoZW1hLmRhdGFjaXRlLm9yZy9tZXRhL2tlcm5lbC00LjMvbWV0YWRhdGEueHNkIj4KICA8aWRlbnRpZmllciBpZGVudGlmaWVyVHlwZT0iRE9JIj4xMC40ODU1MC9BUlhJVi4yMzEyLjE1NzE3PC9pZGVudGlmaWVyPgogIDxhbHRlcm5hdGVJZGVudGlmaWVycz4KICAgIDxhbHRlcm5hdGVJZGVudGlmaWVyIGFsdGVybmF0ZUlkZW50aWZpZXJUeXBlPSJhclhpdiI+MjMxMi4xNTcxNzwvYWx0ZXJuYXRlSWRlbnRpZmllcj4KICA8L2FsdGVybmF0ZUlkZW50aWZpZXJzPgogIDxjcmVhdG9ycz4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5aaGFuZywgWmhhb2ZhbjwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+Wmhhb2ZhbjwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5aaGFuZzwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5YaWFvLCBZYW5hbjwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+WWFuYW48L2dpdmVuTmFtZT4KICAgICAgPGZhbWlseU5hbWU+WGlhbzwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5KaWFuZywgTHU8L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPkx1PC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPkppYW5nPC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogICAgPGNyZWF0b3I+CiAgICAgIDxjcmVhdG9yTmFtZSBuYW1lVHlwZT0iUGVyc29uYWwiPllhbmcsIERpbmdxaTwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+RGluZ3FpPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPllhbmc8L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgICA8Y3JlYXRvcj4KICAgICAgPGNyZWF0b3JOYW1lIG5hbWVUeXBlPSJQZXJzb25hbCI+WWluLCBNaW5naGFvPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5NaW5naGFvPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPllpbjwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5XYW5nLCBQZW5neWFuZzwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+UGVuZ3lhbmc8L2dpdmVuTmFtZT4KICAgICAgPGZhbWlseU5hbWU+V2FuZzwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICA8L2NyZWF0b3JzPgogIDx0aXRsZXM+CiAgICA8dGl0bGU+U3BhdGlhbC1UZW1wb3JhbCBJbnRlcnBsYXkgaW4gSHVtYW4gTW9iaWxpdHk6IEEgSGllcmFyY2hpY2FsIFJlaW5mb3JjZW1lbnQgTGVhcm5pbmcgQXBwcm9hY2ggd2l0aCBIeXBlcmdyYXBoIFJlcHJlc2VudGF0aW9uPC90aXRsZT4KICA8L3RpdGxlcz4KICA8cHVibGlzaGVyPmFyWGl2PC9wdWJsaXNoZXI+CiAgPHB1YmxpY2F0aW9uWWVhcj4yMDIzPC9wdWJsaWNhdGlvblllYXI+CiAgPHN1YmplY3RzPgogICAgPHN1YmplY3QgeG1sOmxhbmc9ImVuIiBzdWJqZWN0U2NoZW1lPSJhclhpdiI+QXJ0aWZpY2lhbCBJbnRlbGxpZ2VuY2UgKGNzLkFJKTwvc3ViamVjdD4KICAgIDxzdWJqZWN0IHhtbDpsYW5nPSJlbiIgc3ViamVjdFNjaGVtZT0iYXJYaXYiPkNvbXB1dGVycyBhbmQgU29jaWV0eSAoY3MuQ1kpPC9zdWJqZWN0PgogICAgPHN1YmplY3QgeG1sOmxhbmc9ImVuIiBzdWJqZWN0U2NoZW1lPSJhclhpdiI+TWFjaGluZSBMZWFybmluZyAoY3MuTEcpPC9zdWJqZWN0PgogICAgPHN1YmplY3Qgc3ViamVjdFNjaGVtZT0iRmllbGRzIG9mIFNjaWVuY2UgYW5kIFRlY2hub2xvZ3kgKEZPUykiPkZPUzogQ29tcHV0ZXIgYW5kIGluZm9ybWF0aW9uIHNjaWVuY2VzPC9zdWJqZWN0PgogIDwvc3ViamVjdHM+CiAgPGRhdGVzPgogICAgPGRhdGUgZGF0ZVR5cGU9IlN1Ym1pdHRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2MSI+MjAyMy0xMi0yNVQxMzowMDowNVo8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iVXBkYXRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2MSI+MjAyMy0xMi0yN1QwMTo0NDowOVo8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iQXZhaWxhYmxlIiBkYXRlSW5mb3JtYXRpb249InYxIj4yMDIzLTEyPC9kYXRlPgogIDwvZGF0ZXM+CiAgPHJlc291cmNlVHlwZSByZXNvdXJjZVR5cGVHZW5lcmFsPSJQcmVwcmludCI+QXJ0aWNsZTwvcmVzb3VyY2VUeXBlPgogIDx2ZXJzaW9uPjE8L3ZlcnNpb24+CiAgPHJpZ2h0c0xpc3Q+CiAgICA8cmlnaHRzIHJpZ2h0c1VSST0iaHR0cDovL2FyeGl2Lm9yZy9saWNlbnNlcy9ub25leGNsdXNpdmUtZGlzdHJpYi8xLjAvIj5hclhpdi5vcmcgcGVycGV0dWFsLCBub24tZXhjbHVzaXZlIGxpY2Vuc2U8L3JpZ2h0cz4KICA8L3JpZ2h0c0xpc3Q+CiAgPGRlc2NyaXB0aW9ucz4KICAgIDxkZXNjcmlwdGlvbiBkZXNjcmlwdGlvblR5cGU9IkFic3RyYWN0Ij5JbiB0aGUgcmVhbG0gb2YgaHVtYW4gbW9iaWxpdHksIHRoZSBkZWNpc2lvbi1tYWtpbmcgcHJvY2VzcyBmb3Igc2VsZWN0aW5nIHRoZSBuZXh0LXZpc2l0IGxvY2F0aW9uIGlzIGludHJpY2F0ZWx5IGluZmx1ZW5jZWQgYnkgYSB0cmFkZS1vZmYgYmV0d2VlbiBzcGF0aWFsIGFuZCB0ZW1wb3JhbCBjb25zdHJhaW50cywgd2hpY2ggYXJlIHJlZmxlY3RpdmUgb2YgaW5kaXZpZHVhbCBuZWVkcyBhbmQgcHJlZmVyZW5jZXMuIFRoaXMgdHJhZGUtb2ZmLCBob3dldmVyLCB2YXJpZXMgYWNyb3NzIGluZGl2aWR1YWxzLCBtYWtpbmcgdGhlIG1vZGVsaW5nIG9mIHRoZXNlIHNwYXRpYWwtdGVtcG9yYWwgZHluYW1pY3MgYSBmb3JtaWRhYmxlIGNoYWxsZW5nZS4gVG8gYWRkcmVzcyB0aGUgcHJvYmxlbSwgaW4gdGhpcyB3b3JrLCB3ZSBpbnRyb2R1Y2UgdGhlICJTcGF0aWFsLXRlbXBvcmFsIEluZHVjZWQgSGllcmFyY2hpY2FsIFJlaW5mb3JjZW1lbnQgTGVhcm5pbmciIChTVEktSFJMKSBmcmFtZXdvcmssIGZvciBjYXB0dXJpbmcgdGhlIGludGVycGxheSBiZXR3ZWVuIHNwYXRpYWwgYW5kIHRlbXBvcmFsIGZhY3RvcnMgaW4gaHVtYW4gbW9iaWxpdHkgZGVjaXNpb24tbWFraW5nLiBTcGVjaWZpY2FsbHksIFNUSS1IUkwgZW1wbG95cyBhIHR3by10aWVyZWQgZGVjaXNpb24tbWFraW5nIHByb2Nlc3M6IHRoZSBsb3ctbGV2ZWwgZm9jdXNlcyBvbiBkaXNlbnRhbmdsaW5nIHNwYXRpYWwgYW5kIHRlbXBvcmFsIHByZWZlcmVuY2VzIHVzaW5nIGRlZGljYXRlZCBhZ2VudHMsIHdoaWxlIHRoZSBoaWdoLWxldmVsIGludGVncmF0ZXMgdGhlc2UgY29uc2lkZXJhdGlvbnMgdG8gZmluYWxpemUgdGhlIGRlY2lzaW9uLiBUbyBjb21wbGVtZW50IHRoZSBoaWVyYXJjaGljYWwgZGVjaXNpb24gc2V0dGluZywgd2UgY29uc3RydWN0IGEgaHlwZXJncmFwaCB0byBvcmdhbml6ZSBoaXN0b3JpY2FsIGRhdGEsIGVuY2Fwc3VsYXRpbmcgdGhlIG11bHRpLWFzcGVjdCBzZW1hbnRpY3Mgb2YgaHVtYW4gbW9iaWxpdHkuIFdlIHByb3Bvc2UgYSBjcm9zcy1jaGFubmVsIGh5cGVyZ3JhcGggZW1iZWRkaW5nIG1vZHVsZSB0byBsZWFybiB0aGUgcmVwcmVzZW50YXRpb25zIGFzIHRoZSBzdGF0ZXMgdG8gZmFjaWxpdGF0ZSB0aGUgZGVjaXNpb24tbWFraW5nIGN5Y2xlLiBPdXIgZXh0ZW5zaXZlIGV4cGVyaW1lbnRzIG9uIHR3byByZWFsLXdvcmxkIGRhdGFzZXRzIHZhbGlkYXRlIHRoZSBzdXBlcmlvcml0eSBvZiBTVEktSFJMIG92ZXIgc3RhdGUtb2YtdGhlLWFydCBtZXRob2RzIGluIHByZWRpY3RpbmcgdXNlcnMnIG5leHQgdmlzaXRzIGFjcm9zcyB2YXJpb3VzIHBlcmZvcm1hbmNlIG1ldHJpY3MuPC9kZXNjcmlwdGlvbj4KICAgIDxkZXNjcmlwdGlvbiBkZXNjcmlwdGlvblR5cGU9Ik90aGVyIj5BY2NlcHRlZCB0byBBQUFJIDIwMjQ8L2Rlc2NyaXB0aW9uPgogIDwvZGVzY3JpcHRpb25zPgo8L3Jlc291cmNlPg==","url":"https://arxiv.org/abs/2312.15717","contentUrl":null,"metadataVersion":0,"schemaVersion":"http://datacite.org/schema/kernel-4","source":"mds","isActive":true,"state":"findable","reason":null,"viewCount":0,"viewsOverTime":[],"downloadCount":0,"downloadsOverTime":[],"referenceCount":0,"citationCount":0,"citationsOverTime":[],"partCount":0,"partOfCount":0,"versionCount":0,"versionOfCount":0,"created":"2023-12-27T03:39:19.000Z","registered":"2023-12-27T03:39:19.000Z","published":"2023","updated":"2023-12-27T03:39:19.000Z"},"relationships":{"client":{"data":{"id":"arxiv.content","type":"clients"}},"provider":{"data":{"id":"arxiv","type":"providers"}},"media":{"data":{"id":"10.48550/arxiv.2312.15717","type":"media"}},"references":{"data":[]},"citations":{"data":[]},"parts":{"data":[]},"partOf":{"data":[]},"versions":{"data":[]},"versionOf":{"data":[]}}}}