{"data":{"id":"10.48550/arxiv.1912.01698","type":"dois","attributes":{"doi":"10.48550/arxiv.1912.01698","prefix":"10.48550","suffix":"arxiv.1912.01698","identifiers":[{"identifier":"1912.01698","identifierType":"arXiv"}],"alternateIdentifiers":[{"alternateIdentifierType":"arXiv","alternateIdentifier":"1912.01698"}],"creators":[{"name":"Roy, Abhishek","nameType":"Personal","givenName":"Abhishek","familyName":"Roy","affiliation":[],"nameIdentifiers":[]},{"name":"Chen, Yifang","nameType":"Personal","givenName":"Yifang","familyName":"Chen","affiliation":[],"nameIdentifiers":[]},{"name":"Balasubramanian, Krishnakumar","nameType":"Personal","givenName":"Krishnakumar","familyName":"Balasubramanian","affiliation":[],"nameIdentifiers":[]},{"name":"Mohapatra, Prasant","nameType":"Personal","givenName":"Prasant","familyName":"Mohapatra","affiliation":[],"nameIdentifiers":[]}],"titles":[{"title":"Online and Bandit Algorithms for Nonstationary Stochastic Saddle-Point Optimization"}],"publisher":"arXiv","container":{},"publicationYear":2019,"subjects":[{"lang":"en","subject":"Optimization and Control (math.OC)","subjectScheme":"arXiv"},{"lang":"en","subject":"Data Structures and Algorithms (cs.DS)","subjectScheme":"arXiv"},{"lang":"en","subject":"Statistics Theory (math.ST)","subjectScheme":"arXiv"},{"lang":"en","subject":"Machine Learning (stat.ML)","subjectScheme":"arXiv"},{"subject":"FOS: Mathematics","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Mathematics","schemeUri":"http://www.oecd.org/science/inno/38235147.pdf","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Computer and information sciences","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Computer and information sciences","schemeUri":"http://www.oecd.org/science/inno/38235147.pdf","subjectScheme":"Fields of Science and Technology (FOS)"}],"contributors":[],"dates":[{"date":"2019-12-03T21:52:38Z","dateType":"Submitted","dateInformation":"v1"},{"date":"2019-12-05T01:03:43Z","dateType":"Updated","dateInformation":"v1"},{"date":"2019-12","dateType":"Available","dateInformation":"v1"},{"date":"2019","dateType":"Issued"}],"language":null,"types":{"ris":"GEN","bibtex":"misc","citeproc":"article","schemaOrg":"CreativeWork","resourceType":"Article","resourceTypeGeneral":"Preprint"},"relatedIdentifiers":[],"relatedItems":[],"sizes":[],"formats":[],"version":"1","rightsList":[{"rights":"arXiv.org perpetual, non-exclusive license","rightsUri":"http://arxiv.org/licenses/nonexclusive-distrib/1.0/"}],"descriptions":[{"description":"Saddle-point optimization problems are an important class of optimization problems with applications to game theory, multi-agent reinforcement learning and machine learning. A majority of the rich literature available for saddle-point optimization has focused on the offline setting. In this paper, we study nonstationary versions of stochastic, smooth, strongly-convex and strongly-concave saddle-point optimization problem, in both online (or first-order) and multi-point bandit (or zeroth-order) settings. We first propose natural notions of regret for such nonstationary saddle-point optimization problems. We then analyze extragradient and Frank-Wolfe algorithms, for the unconstrained and constrained settings respectively, for the above class of nonstationary saddle-point optimization problems. We establish sub-linear regret bounds on the proposed notions of regret in both the online and bandit setting.","descriptionType":"Abstract"}],"geoLocations":[],"fundingReferences":[],"xml":"PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4KPHJlc291cmNlIHhtbG5zPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSIgeHNpOnNjaGVtYUxvY2F0aW9uPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCBodHRwOi8vc2NoZW1hLmRhdGFjaXRlLm9yZy9tZXRhL2tlcm5lbC00LjMvbWV0YWRhdGEueHNkIj4KICA8aWRlbnRpZmllciBpZGVudGlmaWVyVHlwZT0iRE9JIj4xMC40ODU1MC9BUlhJVi4xOTEyLjAxNjk4PC9pZGVudGlmaWVyPgogIDxhbHRlcm5hdGVJZGVudGlmaWVycz4KICAgIDxhbHRlcm5hdGVJZGVudGlmaWVyIGFsdGVybmF0ZUlkZW50aWZpZXJUeXBlPSJhclhpdiI+MTkxMi4wMTY5ODwvYWx0ZXJuYXRlSWRlbnRpZmllcj4KICA8L2FsdGVybmF0ZUlkZW50aWZpZXJzPgogIDxjcmVhdG9ycz4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5Sb3ksIEFiaGlzaGVrPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5BYmhpc2hlazwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5Sb3k8L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgICA8Y3JlYXRvcj4KICAgICAgPGNyZWF0b3JOYW1lIG5hbWVUeXBlPSJQZXJzb25hbCI+Q2hlbiwgWWlmYW5nPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5ZaWZhbmc8L2dpdmVuTmFtZT4KICAgICAgPGZhbWlseU5hbWU+Q2hlbjwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5CYWxhc3VicmFtYW5pYW4sIEtyaXNobmFrdW1hcjwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+S3Jpc2huYWt1bWFyPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPkJhbGFzdWJyYW1hbmlhbjwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5Nb2hhcGF0cmEsIFByYXNhbnQ8L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPlByYXNhbnQ8L2dpdmVuTmFtZT4KICAgICAgPGZhbWlseU5hbWU+TW9oYXBhdHJhPC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogIDwvY3JlYXRvcnM+CiAgPHRpdGxlcz4KICAgIDx0aXRsZT5PbmxpbmUgYW5kIEJhbmRpdCBBbGdvcml0aG1zIGZvciBOb25zdGF0aW9uYXJ5IFN0b2NoYXN0aWMgU2FkZGxlLVBvaW50IE9wdGltaXphdGlvbjwvdGl0bGU+CiAgPC90aXRsZXM+CiAgPHB1Ymxpc2hlcj5hclhpdjwvcHVibGlzaGVyPgogIDxwdWJsaWNhdGlvblllYXI+MjAxOTwvcHVibGljYXRpb25ZZWFyPgogIDxzdWJqZWN0cz4KICAgIDxzdWJqZWN0IHhtbDpsYW5nPSJlbiIgc3ViamVjdFNjaGVtZT0iYXJYaXYiPk9wdGltaXphdGlvbiBhbmQgQ29udHJvbCAobWF0aC5PQyk8L3N1YmplY3Q+CiAgICA8c3ViamVjdCB4bWw6bGFuZz0iZW4iIHN1YmplY3RTY2hlbWU9ImFyWGl2Ij5EYXRhIFN0cnVjdHVyZXMgYW5kIEFsZ29yaXRobXMgKGNzLkRTKTwvc3ViamVjdD4KICAgIDxzdWJqZWN0IHhtbDpsYW5nPSJlbiIgc3ViamVjdFNjaGVtZT0iYXJYaXYiPlN0YXRpc3RpY3MgVGhlb3J5IChtYXRoLlNUKTwvc3ViamVjdD4KICAgIDxzdWJqZWN0IHhtbDpsYW5nPSJlbiIgc3ViamVjdFNjaGVtZT0iYXJYaXYiPk1hY2hpbmUgTGVhcm5pbmcgKHN0YXQuTUwpPC9zdWJqZWN0PgogICAgPHN1YmplY3Qgc3ViamVjdFNjaGVtZT0iRmllbGRzIG9mIFNjaWVuY2UgYW5kIFRlY2hub2xvZ3kgKEZPUykiPkZPUzogTWF0aGVtYXRpY3M8L3N1YmplY3Q+CiAgICA8c3ViamVjdCBzdWJqZWN0U2NoZW1lPSJGaWVsZHMgb2YgU2NpZW5jZSBhbmQgVGVjaG5vbG9neSAoRk9TKSI+Rk9TOiBDb21wdXRlciBhbmQgaW5mb3JtYXRpb24gc2NpZW5jZXM8L3N1YmplY3Q+CiAgPC9zdWJqZWN0cz4KICA8ZGF0ZXM+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iU3VibWl0dGVkIiBkYXRlSW5mb3JtYXRpb249InYxIj4yMDE5LTEyLTAzVDIxOjUyOjM4WjwvZGF0ZT4KICAgIDxkYXRlIGRhdGVUeXBlPSJVcGRhdGVkIiBkYXRlSW5mb3JtYXRpb249InYxIj4yMDE5LTEyLTA1VDAxOjAzOjQzWjwvZGF0ZT4KICAgIDxkYXRlIGRhdGVUeXBlPSJBdmFpbGFibGUiIGRhdGVJbmZvcm1hdGlvbj0idjEiPjIwMTktMTI8L2RhdGU+CiAgPC9kYXRlcz4KICA8cmVzb3VyY2VUeXBlIHJlc291cmNlVHlwZUdlbmVyYWw9IlByZXByaW50Ij5BcnRpY2xlPC9yZXNvdXJjZVR5cGU+CiAgPHZlcnNpb24+MTwvdmVyc2lvbj4KICA8cmlnaHRzTGlzdD4KICAgIDxyaWdodHMgcmlnaHRzVVJJPSJodHRwOi8vYXJ4aXYub3JnL2xpY2Vuc2VzL25vbmV4Y2x1c2l2ZS1kaXN0cmliLzEuMC8iPmFyWGl2Lm9yZyBwZXJwZXR1YWwsIG5vbi1leGNsdXNpdmUgbGljZW5zZTwvcmlnaHRzPgogIDwvcmlnaHRzTGlzdD4KICA8ZGVzY3JpcHRpb25zPgogICAgPGRlc2NyaXB0aW9uIGRlc2NyaXB0aW9uVHlwZT0iQWJzdHJhY3QiPlNhZGRsZS1wb2ludCBvcHRpbWl6YXRpb24gcHJvYmxlbXMgYXJlIGFuIGltcG9ydGFudCBjbGFzcyBvZiBvcHRpbWl6YXRpb24gcHJvYmxlbXMgd2l0aCBhcHBsaWNhdGlvbnMgdG8gZ2FtZSB0aGVvcnksIG11bHRpLWFnZW50IHJlaW5mb3JjZW1lbnQgbGVhcm5pbmcgYW5kIG1hY2hpbmUgbGVhcm5pbmcuIEEgbWFqb3JpdHkgb2YgdGhlIHJpY2ggbGl0ZXJhdHVyZSBhdmFpbGFibGUgZm9yIHNhZGRsZS1wb2ludCBvcHRpbWl6YXRpb24gaGFzIGZvY3VzZWQgb24gdGhlIG9mZmxpbmUgc2V0dGluZy4gSW4gdGhpcyBwYXBlciwgd2Ugc3R1ZHkgbm9uc3RhdGlvbmFyeSB2ZXJzaW9ucyBvZiBzdG9jaGFzdGljLCBzbW9vdGgsIHN0cm9uZ2x5LWNvbnZleCBhbmQgc3Ryb25nbHktY29uY2F2ZSBzYWRkbGUtcG9pbnQgb3B0aW1pemF0aW9uIHByb2JsZW0sIGluIGJvdGggb25saW5lIChvciBmaXJzdC1vcmRlcikgYW5kIG11bHRpLXBvaW50IGJhbmRpdCAob3IgemVyb3RoLW9yZGVyKSBzZXR0aW5ncy4gV2UgZmlyc3QgcHJvcG9zZSBuYXR1cmFsIG5vdGlvbnMgb2YgcmVncmV0IGZvciBzdWNoIG5vbnN0YXRpb25hcnkgc2FkZGxlLXBvaW50IG9wdGltaXphdGlvbiBwcm9ibGVtcy4gV2UgdGhlbiBhbmFseXplIGV4dHJhZ3JhZGllbnQgYW5kIEZyYW5rLVdvbGZlIGFsZ29yaXRobXMsIGZvciB0aGUgdW5jb25zdHJhaW5lZCBhbmQgY29uc3RyYWluZWQgc2V0dGluZ3MgcmVzcGVjdGl2ZWx5LCBmb3IgdGhlIGFib3ZlIGNsYXNzIG9mIG5vbnN0YXRpb25hcnkgc2FkZGxlLXBvaW50IG9wdGltaXphdGlvbiBwcm9ibGVtcy4gV2UgZXN0YWJsaXNoIHN1Yi1saW5lYXIgcmVncmV0IGJvdW5kcyBvbiB0aGUgcHJvcG9zZWQgbm90aW9ucyBvZiByZWdyZXQgaW4gYm90aCB0aGUgb25saW5lIGFuZCBiYW5kaXQgc2V0dGluZy48L2Rlc2NyaXB0aW9uPgogIDwvZGVzY3JpcHRpb25zPgo8L3Jlc291cmNlPg==","url":"https://arxiv.org/abs/1912.01698","contentUrl":null,"metadataVersion":0,"schemaVersion":"http://datacite.org/schema/kernel-4","source":"mds","isActive":true,"state":"findable","reason":null,"viewCount":0,"viewsOverTime":[],"downloadCount":0,"downloadsOverTime":[],"referenceCount":0,"citationCount":0,"citationsOverTime":[],"partCount":0,"partOfCount":0,"versionCount":0,"versionOfCount":0,"created":"2022-02-26T20:20:23.000Z","registered":"2022-02-26T20:20:24.000Z","published":"2019","updated":"2022-02-26T20:20:24.000Z"},"relationships":{"client":{"data":{"id":"arxiv.content","type":"clients"}},"provider":{"data":{"id":"arxiv","type":"providers"}},"media":{"data":{"id":"10.48550/arxiv.1912.01698","type":"media"}},"references":{"data":[]},"citations":{"data":[]},"parts":{"data":[]},"partOf":{"data":[]},"versions":{"data":[]},"versionOf":{"data":[]}}}}