{"data":{"id":"10.48550/arxiv.2005.14670","type":"dois","attributes":{"doi":"10.48550/arxiv.2005.14670","prefix":"10.48550","suffix":"arxiv.2005.14670","identifiers":[{"identifier":"2005.14670","identifierType":"arXiv"}],"alternateIdentifiers":[{"alternateIdentifierType":"arXiv","alternateIdentifier":"2005.14670"}],"creators":[{"name":"Ziel, Florian","nameType":"Personal","givenName":"Florian","familyName":"Ziel","affiliation":[],"nameIdentifiers":[]}],"titles":[{"title":"The energy distance for ensemble and scenario reduction"}],"publisher":"arXiv","container":{},"publicationYear":2020,"subjects":[{"lang":"en","subject":"Machine Learning (stat.ML)","subjectScheme":"arXiv"},{"lang":"en","subject":"Machine Learning (cs.LG)","subjectScheme":"arXiv"},{"lang":"en","subject":"Optimization and Control (math.OC)","subjectScheme":"arXiv"},{"lang":"en","subject":"Risk Management (q-fin.RM)","subjectScheme":"arXiv"},{"lang":"en","subject":"Applications (stat.AP)","subjectScheme":"arXiv"},{"subject":"FOS: Computer and information sciences","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Computer and information sciences","schemeUri":"http://www.oecd.org/science/inno/38235147.pdf","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Mathematics","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Mathematics","schemeUri":"http://www.oecd.org/science/inno/38235147.pdf","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Economics and business","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Economics and business","schemeUri":"http://www.oecd.org/science/inno/38235147.pdf","subjectScheme":"Fields of Science and Technology (FOS)"},{"lang":"en","subject":"G.1.6; G.1.2; G.3; I.2.8; I.5; I.6; J.2","subjectScheme":"ACM"},{"lang":"en","subject":"90C59, 90C90, 90-08, 60E05, 62E17","subjectScheme":"MSC"}],"contributors":[],"dates":[{"date":"2020-05-29T16:52:23Z","dateType":"Submitted","dateInformation":"v1"},{"date":"2020-06-01T00:15:24Z","dateType":"Updated","dateInformation":"v1"},{"date":"2020-10-03T18:46:10Z","dateType":"Submitted","dateInformation":"v2"},{"date":"2021-07-07T13:37:51Z","dateType":"Updated","dateInformation":"v2"},{"date":"2020-05","dateType":"Available","dateInformation":"v1"},{"date":"2020","dateType":"Issued"}],"language":null,"types":{"ris":"RPRT","bibtex":"article","citeproc":"article-journal","schemaOrg":"ScholarlyArticle","resourceType":"Article","resourceTypeGeneral":"Text"},"relatedIdentifiers":[{"relationType":"IsVersionOf","relatedIdentifier":"10.1098/rsta.2019.0431","relatedIdentifierType":"DOI"}],"relatedItems":[],"sizes":[],"formats":[],"version":"2","rightsList":[{"rights":"arXiv.org perpetual, non-exclusive license","rightsUri":"http://arxiv.org/licenses/nonexclusive-distrib/1.0/"}],"descriptions":[{"description":"Scenario reduction techniques are widely applied for solving sophisticated dynamic and stochastic programs, especially in energy and power systems, but also used in probabilistic forecasting, clustering and estimating generative adversarial networks (GANs). We propose a new method for ensemble and scenario reduction based on the energy distance which is a special case of the maximum mean discrepancy (MMD). We discuss the choice of energy distance in detail, especially in comparison to the popular Wasserstein distance which is dominating the scenario reduction literature. The energy distance is a metric between probability measures that allows for powerful tests for equality of arbitrary multivariate distributions or independence. Thanks to the latter, it is a suitable candidate for ensemble and scenario reduction problems. The theoretical properties and considered examples indicate clearly that the reduced scenario sets tend to exhibit better statistical properties for the energy distance than a corresponding reduction with respect to the Wasserstein distance. We show applications to a Bernoulli random walk and two real data based examples for electricity demand profiles and day-ahead electricity prices.","descriptionType":"Abstract"},{"description":"Accepted for publication in Philosophical Transactions A","descriptionType":"Other"}],"geoLocations":[],"fundingReferences":[],"xml":"PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4KPHJlc291cmNlIHhtbG5zPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSIgeHNpOnNjaGVtYUxvY2F0aW9uPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCBodHRwOi8vc2NoZW1hLmRhdGFjaXRlLm9yZy9tZXRhL2tlcm5lbC00LjMvbWV0YWRhdGEueHNkIj4KICA8aWRlbnRpZmllciBpZGVudGlmaWVyVHlwZT0iRE9JIj4xMC40ODU1MC9BUlhJVi4yMDA1LjE0NjcwPC9pZGVudGlmaWVyPgogIDxhbHRlcm5hdGVJZGVudGlmaWVycz4KICAgIDxhbHRlcm5hdGVJZGVudGlmaWVyIGFsdGVybmF0ZUlkZW50aWZpZXJUeXBlPSJhclhpdiI+MjAwNS4xNDY3MDwvYWx0ZXJuYXRlSWRlbnRpZmllcj4KICA8L2FsdGVybmF0ZUlkZW50aWZpZXJzPgogIDxjcmVhdG9ycz4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5aaWVsLCBGbG9yaWFuPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5GbG9yaWFuPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPlppZWw8L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgPC9jcmVhdG9ycz4KICA8dGl0bGVzPgogICAgPHRpdGxlPlRoZSBlbmVyZ3kgZGlzdGFuY2UgZm9yIGVuc2VtYmxlIGFuZCBzY2VuYXJpbyByZWR1Y3Rpb248L3RpdGxlPgogIDwvdGl0bGVzPgogIDxwdWJsaXNoZXI+YXJYaXY8L3B1Ymxpc2hlcj4KICA8cHVibGljYXRpb25ZZWFyPjIwMjA8L3B1YmxpY2F0aW9uWWVhcj4KICA8c3ViamVjdHM+CiAgICA8c3ViamVjdCB4bWw6bGFuZz0iZW4iIHN1YmplY3RTY2hlbWU9ImFyWGl2Ij5NYWNoaW5lIExlYXJuaW5nIChzdGF0Lk1MKTwvc3ViamVjdD4KICAgIDxzdWJqZWN0IHhtbDpsYW5nPSJlbiIgc3ViamVjdFNjaGVtZT0iYXJYaXYiPk1hY2hpbmUgTGVhcm5pbmcgKGNzLkxHKTwvc3ViamVjdD4KICAgIDxzdWJqZWN0IHhtbDpsYW5nPSJlbiIgc3ViamVjdFNjaGVtZT0iYXJYaXYiPk9wdGltaXphdGlvbiBhbmQgQ29udHJvbCAobWF0aC5PQyk8L3N1YmplY3Q+CiAgICA8c3ViamVjdCB4bWw6bGFuZz0iZW4iIHN1YmplY3RTY2hlbWU9ImFyWGl2Ij5SaXNrIE1hbmFnZW1lbnQgKHEtZmluLlJNKTwvc3ViamVjdD4KICAgIDxzdWJqZWN0IHhtbDpsYW5nPSJlbiIgc3ViamVjdFNjaGVtZT0iYXJYaXYiPkFwcGxpY2F0aW9ucyAoc3RhdC5BUCk8L3N1YmplY3Q+CiAgICA8c3ViamVjdCBzdWJqZWN0U2NoZW1lPSJGaWVsZHMgb2YgU2NpZW5jZSBhbmQgVGVjaG5vbG9neSAoRk9TKSI+Rk9TOiBDb21wdXRlciBhbmQgaW5mb3JtYXRpb24gc2NpZW5jZXM8L3N1YmplY3Q+CiAgICA8c3ViamVjdCBzdWJqZWN0U2NoZW1lPSJGaWVsZHMgb2YgU2NpZW5jZSBhbmQgVGVjaG5vbG9neSAoRk9TKSI+Rk9TOiBNYXRoZW1hdGljczwvc3ViamVjdD4KICAgIDxzdWJqZWN0IHN1YmplY3RTY2hlbWU9IkZpZWxkcyBvZiBTY2llbmNlIGFuZCBUZWNobm9sb2d5IChGT1MpIj5GT1M6IEVjb25vbWljcyBhbmQgYnVzaW5lc3M8L3N1YmplY3Q+CiAgICA8c3ViamVjdCB4bWw6bGFuZz0iZW4iIHN1YmplY3RTY2hlbWU9IkFDTSI+Ry4xLjY7IEcuMS4yOyBHLjM7IEkuMi44OyBJLjU7IEkuNjsgSi4yPC9zdWJqZWN0PgogICAgPHN1YmplY3QgeG1sOmxhbmc9ImVuIiBzdWJqZWN0U2NoZW1lPSJNU0MiPjkwQzU5LCA5MEM5MCwgOTAtMDgsIDYwRTA1LCA2MkUxNzwvc3ViamVjdD4KICA8L3N1YmplY3RzPgogIDxkYXRlcz4KICAgIDxkYXRlIGRhdGVUeXBlPSJTdWJtaXR0ZWQiIGRhdGVJbmZvcm1hdGlvbj0idjEiPjIwMjAtMDUtMjlUMTY6NTI6MjNaPC9kYXRlPgogICAgPGRhdGUgZGF0ZVR5cGU9IlVwZGF0ZWQiIGRhdGVJbmZvcm1hdGlvbj0idjEiPjIwMjAtMDYtMDFUMDA6MTU6MjRaPC9kYXRlPgogICAgPGRhdGUgZGF0ZVR5cGU9IlN1Ym1pdHRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2MiI+MjAyMC0xMC0wM1QxODo0NjoxMFo8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iVXBkYXRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2MiI+MjAyMS0wNy0wN1QxMzozNzo1MVo8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iQXZhaWxhYmxlIiBkYXRlSW5mb3JtYXRpb249InYxIj4yMDIwLTA1PC9kYXRlPgogIDwvZGF0ZXM+CiAgPHJlc291cmNlVHlwZSByZXNvdXJjZVR5cGVHZW5lcmFsPSJUZXh0Ij5BcnRpY2xlPC9yZXNvdXJjZVR5cGU+CiAgPHJlbGF0ZWRJZGVudGlmaWVycz4KICAgIDxyZWxhdGVkSWRlbnRpZmllciByZWxhdGVkSWRlbnRpZmllclR5cGU9IkRPSSIgcmVsYXRpb25UeXBlPSJJc1ZlcnNpb25PZiI+MTAuMTA5OC9yc3RhLjIwMTkuMDQzMTwvcmVsYXRlZElkZW50aWZpZXI+CiAgPC9yZWxhdGVkSWRlbnRpZmllcnM+CiAgPHZlcnNpb24+MjwvdmVyc2lvbj4KICA8cmlnaHRzTGlzdD4KICAgIDxyaWdodHMgcmlnaHRzVVJJPSJodHRwOi8vYXJ4aXYub3JnL2xpY2Vuc2VzL25vbmV4Y2x1c2l2ZS1kaXN0cmliLzEuMC8iPmFyWGl2Lm9yZyBwZXJwZXR1YWwsIG5vbi1leGNsdXNpdmUgbGljZW5zZTwvcmlnaHRzPgogIDwvcmlnaHRzTGlzdD4KICA8ZGVzY3JpcHRpb25zPgogICAgPGRlc2NyaXB0aW9uIGRlc2NyaXB0aW9uVHlwZT0iQWJzdHJhY3QiPlNjZW5hcmlvIHJlZHVjdGlvbiB0ZWNobmlxdWVzIGFyZSB3aWRlbHkgYXBwbGllZCBmb3Igc29sdmluZyBzb3BoaXN0aWNhdGVkIGR5bmFtaWMgYW5kIHN0b2NoYXN0aWMgcHJvZ3JhbXMsIGVzcGVjaWFsbHkgaW4gZW5lcmd5IGFuZCBwb3dlciBzeXN0ZW1zLCBidXQgYWxzbyB1c2VkIGluIHByb2JhYmlsaXN0aWMgZm9yZWNhc3RpbmcsIGNsdXN0ZXJpbmcgYW5kIGVzdGltYXRpbmcgZ2VuZXJhdGl2ZSBhZHZlcnNhcmlhbCBuZXR3b3JrcyAoR0FOcykuIFdlIHByb3Bvc2UgYSBuZXcgbWV0aG9kIGZvciBlbnNlbWJsZSBhbmQgc2NlbmFyaW8gcmVkdWN0aW9uIGJhc2VkIG9uIHRoZSBlbmVyZ3kgZGlzdGFuY2Ugd2hpY2ggaXMgYSBzcGVjaWFsIGNhc2Ugb2YgdGhlIG1heGltdW0gbWVhbiBkaXNjcmVwYW5jeSAoTU1EKS4gV2UgZGlzY3VzcyB0aGUgY2hvaWNlIG9mIGVuZXJneSBkaXN0YW5jZSBpbiBkZXRhaWwsIGVzcGVjaWFsbHkgaW4gY29tcGFyaXNvbiB0byB0aGUgcG9wdWxhciBXYXNzZXJzdGVpbiBkaXN0YW5jZSB3aGljaCBpcyBkb21pbmF0aW5nIHRoZSBzY2VuYXJpbyByZWR1Y3Rpb24gbGl0ZXJhdHVyZS4gVGhlIGVuZXJneSBkaXN0YW5jZSBpcyBhIG1ldHJpYyBiZXR3ZWVuIHByb2JhYmlsaXR5IG1lYXN1cmVzIHRoYXQgYWxsb3dzIGZvciBwb3dlcmZ1bCB0ZXN0cyBmb3IgZXF1YWxpdHkgb2YgYXJiaXRyYXJ5IG11bHRpdmFyaWF0ZSBkaXN0cmlidXRpb25zIG9yIGluZGVwZW5kZW5jZS4gVGhhbmtzIHRvIHRoZSBsYXR0ZXIsIGl0IGlzIGEgc3VpdGFibGUgY2FuZGlkYXRlIGZvciBlbnNlbWJsZSBhbmQgc2NlbmFyaW8gcmVkdWN0aW9uIHByb2JsZW1zLiBUaGUgdGhlb3JldGljYWwgcHJvcGVydGllcyBhbmQgY29uc2lkZXJlZCBleGFtcGxlcyBpbmRpY2F0ZSBjbGVhcmx5IHRoYXQgdGhlIHJlZHVjZWQgc2NlbmFyaW8gc2V0cyB0ZW5kIHRvIGV4aGliaXQgYmV0dGVyIHN0YXRpc3RpY2FsIHByb3BlcnRpZXMgZm9yIHRoZSBlbmVyZ3kgZGlzdGFuY2UgdGhhbiBhIGNvcnJlc3BvbmRpbmcgcmVkdWN0aW9uIHdpdGggcmVzcGVjdCB0byB0aGUgV2Fzc2Vyc3RlaW4gZGlzdGFuY2UuIFdlIHNob3cgYXBwbGljYXRpb25zIHRvIGEgQmVybm91bGxpIHJhbmRvbSB3YWxrIGFuZCB0d28gcmVhbCBkYXRhIGJhc2VkIGV4YW1wbGVzIGZvciBlbGVjdHJpY2l0eSBkZW1hbmQgcHJvZmlsZXMgYW5kIGRheS1haGVhZCBlbGVjdHJpY2l0eSBwcmljZXMuPC9kZXNjcmlwdGlvbj4KICAgIDxkZXNjcmlwdGlvbiBkZXNjcmlwdGlvblR5cGU9Ik90aGVyIj5BY2NlcHRlZCBmb3IgcHVibGljYXRpb24gaW4gUGhpbG9zb3BoaWNhbCBUcmFuc2FjdGlvbnMgQTwvZGVzY3JpcHRpb24+CiAgPC9kZXNjcmlwdGlvbnM+CjwvcmVzb3VyY2U+","url":"https://arxiv.org/abs/2005.14670","contentUrl":null,"metadataVersion":0,"schemaVersion":"http://datacite.org/schema/kernel-4","source":"mds","isActive":true,"state":"findable","reason":null,"viewCount":0,"viewsOverTime":[],"downloadCount":0,"downloadsOverTime":[],"referenceCount":0,"citationCount":0,"citationsOverTime":[],"partCount":0,"partOfCount":0,"versionCount":0,"versionOfCount":0,"created":"2022-02-25T17:54:37.000Z","registered":"2022-02-25T17:54:38.000Z","published":"2020","updated":"2022-02-25T17:54:38.000Z"},"relationships":{"client":{"data":{"id":"arxiv.content","type":"clients"}},"provider":{"data":{"id":"arxiv","type":"providers"}},"media":{"data":{"id":"10.48550/arxiv.2005.14670","type":"media"}},"references":{"data":[]},"citations":{"data":[]},"parts":{"data":[]},"partOf":{"data":[]},"versions":{"data":[]},"versionOf":{"data":[]}}}}