{"data":{"id":"10.48550/arxiv.2006.09855","type":"dois","attributes":{"doi":"10.48550/arxiv.2006.09855","prefix":"10.48550","suffix":"arxiv.2006.09855","identifiers":[{"identifier":"2006.09855","identifierType":"arXiv"}],"alternateIdentifiers":[{"alternateIdentifierType":"arXiv","alternateIdentifier":"2006.09855"}],"creators":[{"name":"Jankovic, Anja","nameType":"Personal","givenName":"Anja","familyName":"Jankovic","affiliation":[],"nameIdentifiers":[]},{"name":"Doerr, Carola","nameType":"Personal","givenName":"Carola","familyName":"Doerr","affiliation":[],"nameIdentifiers":[]}],"titles":[{"title":"Landscape-Aware Fixed-Budget Performance Regression and Algorithm Selection for Modular CMA-ES Variants"}],"publisher":"arXiv","container":{},"publicationYear":2020,"subjects":[{"lang":"en","subject":"Neural and Evolutionary Computing (cs.NE)","subjectScheme":"arXiv"},{"lang":"en","subject":"Machine Learning (cs.LG)","subjectScheme":"arXiv"},{"subject":"FOS: Computer and information sciences","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Computer and information sciences","schemeUri":"http://www.oecd.org/science/inno/38235147.pdf","subjectScheme":"Fields of Science and Technology (FOS)"}],"contributors":[],"dates":[{"date":"2020-06-17T13:34:57Z","dateType":"Submitted","dateInformation":"v1"},{"date":"2020-06-18T00:16:12Z","dateType":"Updated","dateInformation":"v1"},{"date":"2020-06","dateType":"Available","dateInformation":"v1"},{"date":"2020","dateType":"Issued"}],"language":null,"types":{"ris":"RPRT","bibtex":"article","citeproc":"article-journal","schemaOrg":"ScholarlyArticle","resourceType":"Article","resourceTypeGeneral":"Text"},"relatedIdentifiers":[{"relationType":"IsVersionOf","relatedIdentifier":"10.1145/3377930.3390183","relatedIdentifierType":"DOI"}],"relatedItems":[],"sizes":[],"formats":[],"version":"1","rightsList":[{"rights":"arXiv.org perpetual, non-exclusive license","rightsUri":"http://arxiv.org/licenses/nonexclusive-distrib/1.0/"}],"descriptions":[{"description":"Automated algorithm selection promises to support the user in the decisive task of selecting a most suitable algorithm for a given problem. A common component of these machine-trained techniques are regression models which predict the performance of a given algorithm on a previously unseen problem instance. In the context of numerical black-box optimization, such regression models typically build on exploratory landscape analysis (ELA), which quantifies several characteristics of the problem. These measures can be used to train a supervised performance regression model. First steps towards ELA-based performance regression have been made in the context of a fixed-target setting. In many applications, however, the user needs to select an algorithm that performs best within a given budget of function evaluations. Adopting this fixed-budget setting, we demonstrate that it is possible to achieve high-quality performance predictions with off-the-shelf supervised learning approaches, by suitably combining two differently trained regression models. We test this approach on a very challenging problem: algorithm selection on a portfolio of very similar algorithms, which we choose from the family of modular CMA-ES algorithms.","descriptionType":"Abstract"},{"description":"To appear in Proc. of Genetic and Evolutionary Computation Conference (GECCO'20)","descriptionType":"Other"}],"geoLocations":[],"fundingReferences":[],"xml":"PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4KPHJlc291cmNlIHhtbG5zPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSIgeHNpOnNjaGVtYUxvY2F0aW9uPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCBodHRwOi8vc2NoZW1hLmRhdGFjaXRlLm9yZy9tZXRhL2tlcm5lbC00LjMvbWV0YWRhdGEueHNkIj4KICA8aWRlbnRpZmllciBpZGVudGlmaWVyVHlwZT0iRE9JIj4xMC40ODU1MC9BUlhJVi4yMDA2LjA5ODU1PC9pZGVudGlmaWVyPgogIDxhbHRlcm5hdGVJZGVudGlmaWVycz4KICAgIDxhbHRlcm5hdGVJZGVudGlmaWVyIGFsdGVybmF0ZUlkZW50aWZpZXJUeXBlPSJhclhpdiI+MjAwNi4wOTg1NTwvYWx0ZXJuYXRlSWRlbnRpZmllcj4KICA8L2FsdGVybmF0ZUlkZW50aWZpZXJzPgogIDxjcmVhdG9ycz4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5KYW5rb3ZpYywgQW5qYTwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+QW5qYTwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5KYW5rb3ZpYzwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5Eb2VyciwgQ2Fyb2xhPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5DYXJvbGE8L2dpdmVuTmFtZT4KICAgICAgPGZhbWlseU5hbWU+RG9lcnI8L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgPC9jcmVhdG9ycz4KICA8dGl0bGVzPgogICAgPHRpdGxlPkxhbmRzY2FwZS1Bd2FyZSBGaXhlZC1CdWRnZXQgUGVyZm9ybWFuY2UgUmVncmVzc2lvbiBhbmQgQWxnb3JpdGhtIFNlbGVjdGlvbiBmb3IgTW9kdWxhciBDTUEtRVMgVmFyaWFudHM8L3RpdGxlPgogIDwvdGl0bGVzPgogIDxwdWJsaXNoZXI+YXJYaXY8L3B1Ymxpc2hlcj4KICA8cHVibGljYXRpb25ZZWFyPjIwMjA8L3B1YmxpY2F0aW9uWWVhcj4KICA8c3ViamVjdHM+CiAgICA8c3ViamVjdCB4bWw6bGFuZz0iZW4iIHN1YmplY3RTY2hlbWU9ImFyWGl2Ij5OZXVyYWwgYW5kIEV2b2x1dGlvbmFyeSBDb21wdXRpbmcgKGNzLk5FKTwvc3ViamVjdD4KICAgIDxzdWJqZWN0IHhtbDpsYW5nPSJlbiIgc3ViamVjdFNjaGVtZT0iYXJYaXYiPk1hY2hpbmUgTGVhcm5pbmcgKGNzLkxHKTwvc3ViamVjdD4KICAgIDxzdWJqZWN0IHN1YmplY3RTY2hlbWU9IkZpZWxkcyBvZiBTY2llbmNlIGFuZCBUZWNobm9sb2d5IChGT1MpIj5GT1M6IENvbXB1dGVyIGFuZCBpbmZvcm1hdGlvbiBzY2llbmNlczwvc3ViamVjdD4KICA8L3N1YmplY3RzPgogIDxkYXRlcz4KICAgIDxkYXRlIGRhdGVUeXBlPSJTdWJtaXR0ZWQiIGRhdGVJbmZvcm1hdGlvbj0idjEiPjIwMjAtMDYtMTdUMTM6MzQ6NTdaPC9kYXRlPgogICAgPGRhdGUgZGF0ZVR5cGU9IlVwZGF0ZWQiIGRhdGVJbmZvcm1hdGlvbj0idjEiPjIwMjAtMDYtMThUMDA6MTY6MTJaPC9kYXRlPgogICAgPGRhdGUgZGF0ZVR5cGU9IkF2YWlsYWJsZSIgZGF0ZUluZm9ybWF0aW9uPSJ2MSI+MjAyMC0wNjwvZGF0ZT4KICA8L2RhdGVzPgogIDxyZXNvdXJjZVR5cGUgcmVzb3VyY2VUeXBlR2VuZXJhbD0iVGV4dCI+QXJ0aWNsZTwvcmVzb3VyY2VUeXBlPgogIDxyZWxhdGVkSWRlbnRpZmllcnM+CiAgICA8cmVsYXRlZElkZW50aWZpZXIgcmVsYXRlZElkZW50aWZpZXJUeXBlPSJET0kiIHJlbGF0aW9uVHlwZT0iSXNWZXJzaW9uT2YiPjEwLjExNDUvMzM3NzkzMC4zMzkwMTgzPC9yZWxhdGVkSWRlbnRpZmllcj4KICA8L3JlbGF0ZWRJZGVudGlmaWVycz4KICA8dmVyc2lvbj4xPC92ZXJzaW9uPgogIDxyaWdodHNMaXN0PgogICAgPHJpZ2h0cyByaWdodHNVUkk9Imh0dHA6Ly9hcnhpdi5vcmcvbGljZW5zZXMvbm9uZXhjbHVzaXZlLWRpc3RyaWIvMS4wLyI+YXJYaXYub3JnIHBlcnBldHVhbCwgbm9uLWV4Y2x1c2l2ZSBsaWNlbnNlPC9yaWdodHM+CiAgPC9yaWdodHNMaXN0PgogIDxkZXNjcmlwdGlvbnM+CiAgICA8ZGVzY3JpcHRpb24gZGVzY3JpcHRpb25UeXBlPSJBYnN0cmFjdCI+QXV0b21hdGVkIGFsZ29yaXRobSBzZWxlY3Rpb24gcHJvbWlzZXMgdG8gc3VwcG9ydCB0aGUgdXNlciBpbiB0aGUgZGVjaXNpdmUgdGFzayBvZiBzZWxlY3RpbmcgYSBtb3N0IHN1aXRhYmxlIGFsZ29yaXRobSBmb3IgYSBnaXZlbiBwcm9ibGVtLiBBIGNvbW1vbiBjb21wb25lbnQgb2YgdGhlc2UgbWFjaGluZS10cmFpbmVkIHRlY2huaXF1ZXMgYXJlIHJlZ3Jlc3Npb24gbW9kZWxzIHdoaWNoIHByZWRpY3QgdGhlIHBlcmZvcm1hbmNlIG9mIGEgZ2l2ZW4gYWxnb3JpdGhtIG9uIGEgcHJldmlvdXNseSB1bnNlZW4gcHJvYmxlbSBpbnN0YW5jZS4gSW4gdGhlIGNvbnRleHQgb2YgbnVtZXJpY2FsIGJsYWNrLWJveCBvcHRpbWl6YXRpb24sIHN1Y2ggcmVncmVzc2lvbiBtb2RlbHMgdHlwaWNhbGx5IGJ1aWxkIG9uIGV4cGxvcmF0b3J5IGxhbmRzY2FwZSBhbmFseXNpcyAoRUxBKSwgd2hpY2ggcXVhbnRpZmllcyBzZXZlcmFsIGNoYXJhY3RlcmlzdGljcyBvZiB0aGUgcHJvYmxlbS4gVGhlc2UgbWVhc3VyZXMgY2FuIGJlIHVzZWQgdG8gdHJhaW4gYSBzdXBlcnZpc2VkIHBlcmZvcm1hbmNlIHJlZ3Jlc3Npb24gbW9kZWwuCiAgRmlyc3Qgc3RlcHMgdG93YXJkcyBFTEEtYmFzZWQgcGVyZm9ybWFuY2UgcmVncmVzc2lvbiBoYXZlIGJlZW4gbWFkZSBpbiB0aGUgY29udGV4dCBvZiBhIGZpeGVkLXRhcmdldCBzZXR0aW5nLiBJbiBtYW55IGFwcGxpY2F0aW9ucywgaG93ZXZlciwgdGhlIHVzZXIgbmVlZHMgdG8gc2VsZWN0IGFuIGFsZ29yaXRobSB0aGF0IHBlcmZvcm1zIGJlc3Qgd2l0aGluIGEgZ2l2ZW4gYnVkZ2V0IG9mIGZ1bmN0aW9uIGV2YWx1YXRpb25zLiBBZG9wdGluZyB0aGlzIGZpeGVkLWJ1ZGdldCBzZXR0aW5nLCB3ZSBkZW1vbnN0cmF0ZSB0aGF0IGl0IGlzIHBvc3NpYmxlIHRvIGFjaGlldmUgaGlnaC1xdWFsaXR5IHBlcmZvcm1hbmNlIHByZWRpY3Rpb25zIHdpdGggb2ZmLXRoZS1zaGVsZiBzdXBlcnZpc2VkIGxlYXJuaW5nIGFwcHJvYWNoZXMsIGJ5IHN1aXRhYmx5IGNvbWJpbmluZyB0d28gZGlmZmVyZW50bHkgdHJhaW5lZCByZWdyZXNzaW9uIG1vZGVscy4gV2UgdGVzdCB0aGlzIGFwcHJvYWNoIG9uIGEgdmVyeSBjaGFsbGVuZ2luZyBwcm9ibGVtOiBhbGdvcml0aG0gc2VsZWN0aW9uIG9uIGEgcG9ydGZvbGlvIG9mIHZlcnkgc2ltaWxhciBhbGdvcml0aG1zLCB3aGljaCB3ZSBjaG9vc2UgZnJvbSB0aGUgZmFtaWx5IG9mIG1vZHVsYXIgQ01BLUVTIGFsZ29yaXRobXMuPC9kZXNjcmlwdGlvbj4KICAgIDxkZXNjcmlwdGlvbiBkZXNjcmlwdGlvblR5cGU9Ik90aGVyIj5UbyBhcHBlYXIgaW4gUHJvYy4gb2YgR2VuZXRpYyBhbmQgRXZvbHV0aW9uYXJ5IENvbXB1dGF0aW9uIENvbmZlcmVuY2UgKEdFQ0NPJzIwKTwvZGVzY3JpcHRpb24+CiAgPC9kZXNjcmlwdGlvbnM+CjwvcmVzb3VyY2U+","url":"https://arxiv.org/abs/2006.09855","contentUrl":null,"metadataVersion":0,"schemaVersion":"http://datacite.org/schema/kernel-4","source":"mds","isActive":true,"state":"findable","reason":null,"viewCount":0,"viewsOverTime":[],"downloadCount":0,"downloadsOverTime":[],"referenceCount":0,"citationCount":0,"citationsOverTime":[],"partCount":0,"partOfCount":0,"versionCount":0,"versionOfCount":0,"created":"2022-02-24T21:42:44.000Z","registered":"2022-02-24T21:42:45.000Z","published":"2020","updated":"2022-02-24T21:42:45.000Z"},"relationships":{"client":{"data":{"id":"arxiv.content","type":"clients"}},"provider":{"data":{"id":"arxiv","type":"providers"}},"media":{"data":{"id":"10.48550/arxiv.2006.09855","type":"media"}},"references":{"data":[]},"citations":{"data":[]},"parts":{"data":[]},"partOf":{"data":[]},"versions":{"data":[]},"versionOf":{"data":[]}}}}