{"data":{"id":"10.48550/arxiv.1904.11585","type":"dois","attributes":{"doi":"10.48550/arxiv.1904.11585","prefix":"10.48550","suffix":"arxiv.1904.11585","identifiers":[{"identifier":"1904.11585","identifierType":"arXiv"}],"alternateIdentifiers":[{"alternateIdentifierType":"arXiv","alternateIdentifier":"1904.11585"}],"creators":[{"name":"Larson, Jeffrey","nameType":"Personal","givenName":"Jeffrey","familyName":"Larson","affiliation":[],"nameIdentifiers":[]},{"name":"Menickelly, Matt","nameType":"Personal","givenName":"Matt","familyName":"Menickelly","affiliation":[],"nameIdentifiers":[]},{"name":"Wild, Stefan M.","nameType":"Personal","givenName":"Stefan M.","familyName":"Wild","affiliation":[],"nameIdentifiers":[]}],"titles":[{"title":"Derivative-free optimization methods"}],"publisher":"arXiv","container":{},"publicationYear":2019,"subjects":[{"lang":"en","subject":"Optimization and Control (math.OC)","subjectScheme":"arXiv"},{"subject":"FOS: Mathematics","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Mathematics","schemeUri":"http://www.oecd.org/science/inno/38235147.pdf","subjectScheme":"Fields of Science and Technology (FOS)"}],"contributors":[],"dates":[{"date":"2019-04-25T20:58:33Z","dateType":"Submitted","dateInformation":"v1"},{"date":"2019-04-29T00:04:37Z","dateType":"Updated","dateInformation":"v1"},{"date":"2019-06-25T18:54:52Z","dateType":"Submitted","dateInformation":"v2"},{"date":"2019-08-15T12:53:35Z","dateType":"Updated","dateInformation":"v2"},{"date":"2019-04","dateType":"Available","dateInformation":"v1"},{"date":"2019","dateType":"Issued"}],"language":null,"types":{"ris":"RPRT","bibtex":"article","citeproc":"article-journal","schemaOrg":"ScholarlyArticle","resourceType":"Article","resourceTypeGeneral":"Text"},"relatedIdentifiers":[{"relationType":"IsVersionOf","relatedIdentifier":"10.1017/s0962492919000060","relatedIdentifierType":"DOI"}],"relatedItems":[],"sizes":[],"formats":[],"version":"2","rightsList":[{"rights":"arXiv.org perpetual, non-exclusive license","rightsUri":"http://arxiv.org/licenses/nonexclusive-distrib/1.0/"}],"descriptions":[{"description":"In many optimization problems arising from scientific, engineering and artificial intelligence applications, objective and constraint functions are available only as the output of a black-box or simulation oracle that does not provide derivative information. Such settings necessitate the use of methods for derivative-free, or zeroth-order, optimization. We provide a review and perspectives on developments in these methods, with an emphasis on highlighting recent developments and on unifying treatment of such problems in the non-linear optimization and machine learning literature. We categorize methods based on assumed properties of the black-box functions, as well as features of the methods. We first overview the primary setting of deterministic methods applied to unconstrained, non-convex optimization problems where the objective function is defined by a deterministic black-box oracle. We then discuss developments in randomized methods, methods that assume some additional structure about the objective (including convexity, separability and general non-smooth compositions), methods for problems where the output of the black-box oracle is stochastic, and methods for handling different types of constraints.","descriptionType":"Abstract"}],"geoLocations":[],"fundingReferences":[],"xml":"PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4KPHJlc291cmNlIHhtbG5zPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSIgeHNpOnNjaGVtYUxvY2F0aW9uPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCBodHRwOi8vc2NoZW1hLmRhdGFjaXRlLm9yZy9tZXRhL2tlcm5lbC00LjMvbWV0YWRhdGEueHNkIj4KICA8aWRlbnRpZmllciBpZGVudGlmaWVyVHlwZT0iRE9JIj4xMC40ODU1MC9BUlhJVi4xOTA0LjExNTg1PC9pZGVudGlmaWVyPgogIDxhbHRlcm5hdGVJZGVudGlmaWVycz4KICAgIDxhbHRlcm5hdGVJZGVudGlmaWVyIGFsdGVybmF0ZUlkZW50aWZpZXJUeXBlPSJhclhpdiI+MTkwNC4xMTU4NTwvYWx0ZXJuYXRlSWRlbnRpZmllcj4KICA8L2FsdGVybmF0ZUlkZW50aWZpZXJzPgogIDxjcmVhdG9ycz4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5MYXJzb24sIEplZmZyZXk8L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPkplZmZyZXk8L2dpdmVuTmFtZT4KICAgICAgPGZhbWlseU5hbWU+TGFyc29uPC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogICAgPGNyZWF0b3I+CiAgICAgIDxjcmVhdG9yTmFtZSBuYW1lVHlwZT0iUGVyc29uYWwiPk1lbmlja2VsbHksIE1hdHQ8L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPk1hdHQ8L2dpdmVuTmFtZT4KICAgICAgPGZhbWlseU5hbWU+TWVuaWNrZWxseTwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5XaWxkLCBTdGVmYW4gTS48L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPlN0ZWZhbiBNLjwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5XaWxkPC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogIDwvY3JlYXRvcnM+CiAgPHRpdGxlcz4KICAgIDx0aXRsZT5EZXJpdmF0aXZlLWZyZWUgb3B0aW1pemF0aW9uIG1ldGhvZHM8L3RpdGxlPgogIDwvdGl0bGVzPgogIDxwdWJsaXNoZXI+YXJYaXY8L3B1Ymxpc2hlcj4KICA8cHVibGljYXRpb25ZZWFyPjIwMTk8L3B1YmxpY2F0aW9uWWVhcj4KICA8c3ViamVjdHM+CiAgICA8c3ViamVjdCB4bWw6bGFuZz0iZW4iIHN1YmplY3RTY2hlbWU9ImFyWGl2Ij5PcHRpbWl6YXRpb24gYW5kIENvbnRyb2wgKG1hdGguT0MpPC9zdWJqZWN0PgogICAgPHN1YmplY3Qgc3ViamVjdFNjaGVtZT0iRmllbGRzIG9mIFNjaWVuY2UgYW5kIFRlY2hub2xvZ3kgKEZPUykiPkZPUzogTWF0aGVtYXRpY3M8L3N1YmplY3Q+CiAgPC9zdWJqZWN0cz4KICA8ZGF0ZXM+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iU3VibWl0dGVkIiBkYXRlSW5mb3JtYXRpb249InYxIj4yMDE5LTA0LTI1VDIwOjU4OjMzWjwvZGF0ZT4KICAgIDxkYXRlIGRhdGVUeXBlPSJVcGRhdGVkIiBkYXRlSW5mb3JtYXRpb249InYxIj4yMDE5LTA0LTI5VDAwOjA0OjM3WjwvZGF0ZT4KICAgIDxkYXRlIGRhdGVUeXBlPSJTdWJtaXR0ZWQiIGRhdGVJbmZvcm1hdGlvbj0idjIiPjIwMTktMDYtMjVUMTg6NTQ6NTJaPC9kYXRlPgogICAgPGRhdGUgZGF0ZVR5cGU9IlVwZGF0ZWQiIGRhdGVJbmZvcm1hdGlvbj0idjIiPjIwMTktMDgtMTVUMTI6NTM6MzVaPC9kYXRlPgogICAgPGRhdGUgZGF0ZVR5cGU9IkF2YWlsYWJsZSIgZGF0ZUluZm9ybWF0aW9uPSJ2MSI+MjAxOS0wNDwvZGF0ZT4KICA8L2RhdGVzPgogIDxyZXNvdXJjZVR5cGUgcmVzb3VyY2VUeXBlR2VuZXJhbD0iVGV4dCI+QXJ0aWNsZTwvcmVzb3VyY2VUeXBlPgogIDxyZWxhdGVkSWRlbnRpZmllcnM+CiAgICA8cmVsYXRlZElkZW50aWZpZXIgcmVsYXRlZElkZW50aWZpZXJUeXBlPSJET0kiIHJlbGF0aW9uVHlwZT0iSXNWZXJzaW9uT2YiPjEwLjEwMTcvUzA5NjI0OTI5MTkwMDAwNjA8L3JlbGF0ZWRJZGVudGlmaWVyPgogIDwvcmVsYXRlZElkZW50aWZpZXJzPgogIDx2ZXJzaW9uPjI8L3ZlcnNpb24+CiAgPHJpZ2h0c0xpc3Q+CiAgICA8cmlnaHRzIHJpZ2h0c1VSST0iaHR0cDovL2FyeGl2Lm9yZy9saWNlbnNlcy9ub25leGNsdXNpdmUtZGlzdHJpYi8xLjAvIj5hclhpdi5vcmcgcGVycGV0dWFsLCBub24tZXhjbHVzaXZlIGxpY2Vuc2U8L3JpZ2h0cz4KICA8L3JpZ2h0c0xpc3Q+CiAgPGRlc2NyaXB0aW9ucz4KICAgIDxkZXNjcmlwdGlvbiBkZXNjcmlwdGlvblR5cGU9IkFic3RyYWN0Ij5JbiBtYW55IG9wdGltaXphdGlvbiBwcm9ibGVtcyBhcmlzaW5nIGZyb20gc2NpZW50aWZpYywgZW5naW5lZXJpbmcgYW5kIGFydGlmaWNpYWwgaW50ZWxsaWdlbmNlIGFwcGxpY2F0aW9ucywgb2JqZWN0aXZlIGFuZCBjb25zdHJhaW50IGZ1bmN0aW9ucyBhcmUgYXZhaWxhYmxlIG9ubHkgYXMgdGhlIG91dHB1dCBvZiBhIGJsYWNrLWJveCBvciBzaW11bGF0aW9uIG9yYWNsZSB0aGF0IGRvZXMgbm90IHByb3ZpZGUgZGVyaXZhdGl2ZSBpbmZvcm1hdGlvbi4gU3VjaCBzZXR0aW5ncyBuZWNlc3NpdGF0ZSB0aGUgdXNlIG9mIG1ldGhvZHMgZm9yIGRlcml2YXRpdmUtZnJlZSwgb3IgemVyb3RoLW9yZGVyLCBvcHRpbWl6YXRpb24uIFdlIHByb3ZpZGUgYSByZXZpZXcgYW5kIHBlcnNwZWN0aXZlcyBvbiBkZXZlbG9wbWVudHMgaW4gdGhlc2UgbWV0aG9kcywgd2l0aCBhbiBlbXBoYXNpcyBvbiBoaWdobGlnaHRpbmcgcmVjZW50IGRldmVsb3BtZW50cyBhbmQgb24gdW5pZnlpbmcgdHJlYXRtZW50IG9mIHN1Y2ggcHJvYmxlbXMgaW4gdGhlIG5vbi1saW5lYXIgb3B0aW1pemF0aW9uIGFuZCBtYWNoaW5lIGxlYXJuaW5nIGxpdGVyYXR1cmUuIFdlIGNhdGVnb3JpemUgbWV0aG9kcyBiYXNlZCBvbiBhc3N1bWVkIHByb3BlcnRpZXMgb2YgdGhlIGJsYWNrLWJveCBmdW5jdGlvbnMsIGFzIHdlbGwgYXMgZmVhdHVyZXMgb2YgdGhlIG1ldGhvZHMuIFdlIGZpcnN0IG92ZXJ2aWV3IHRoZSBwcmltYXJ5IHNldHRpbmcgb2YgZGV0ZXJtaW5pc3RpYyBtZXRob2RzIGFwcGxpZWQgdG8gdW5jb25zdHJhaW5lZCwgbm9uLWNvbnZleCBvcHRpbWl6YXRpb24gcHJvYmxlbXMgd2hlcmUgdGhlIG9iamVjdGl2ZSBmdW5jdGlvbiBpcyBkZWZpbmVkIGJ5IGEgZGV0ZXJtaW5pc3RpYyBibGFjay1ib3ggb3JhY2xlLiBXZSB0aGVuIGRpc2N1c3MgZGV2ZWxvcG1lbnRzIGluIHJhbmRvbWl6ZWQgbWV0aG9kcywgbWV0aG9kcyB0aGF0IGFzc3VtZSBzb21lIGFkZGl0aW9uYWwgc3RydWN0dXJlIGFib3V0IHRoZSBvYmplY3RpdmUgKGluY2x1ZGluZyBjb252ZXhpdHksIHNlcGFyYWJpbGl0eSBhbmQgZ2VuZXJhbCBub24tc21vb3RoIGNvbXBvc2l0aW9ucyksIG1ldGhvZHMgZm9yIHByb2JsZW1zIHdoZXJlIHRoZSBvdXRwdXQgb2YgdGhlIGJsYWNrLWJveCBvcmFjbGUgaXMgc3RvY2hhc3RpYywgYW5kIG1ldGhvZHMgZm9yIGhhbmRsaW5nIGRpZmZlcmVudCB0eXBlcyBvZiBjb25zdHJhaW50cy48L2Rlc2NyaXB0aW9uPgogIDwvZGVzY3JpcHRpb25zPgo8L3Jlc291cmNlPg==","url":"https://arxiv.org/abs/1904.11585","contentUrl":null,"metadataVersion":0,"schemaVersion":"http://datacite.org/schema/kernel-4","source":"mds","isActive":true,"state":"findable","reason":null,"viewCount":0,"viewsOverTime":[],"downloadCount":0,"downloadsOverTime":[],"referenceCount":0,"citationCount":0,"citationsOverTime":[],"partCount":0,"partOfCount":0,"versionCount":0,"versionOfCount":0,"created":"2022-02-28T06:51:52.000Z","registered":"2022-02-28T06:51:54.000Z","published":"2019","updated":"2025-05-28T02:29:05.000Z"},"relationships":{"client":{"data":{"id":"arxiv.content","type":"clients"}},"provider":{"data":{"id":"arxiv","type":"providers"}},"media":{"data":{"id":"10.48550/arxiv.1904.11585","type":"media"}},"references":{"data":[]},"citations":{"data":[]},"parts":{"data":[]},"partOf":{"data":[]},"versions":{"data":[]},"versionOf":{"data":[]}}}}