{"data":{"id":"10.48550/arxiv.1507.01972","type":"dois","attributes":{"doi":"10.48550/arxiv.1507.01972","prefix":"10.48550","suffix":"arxiv.1507.01972","identifiers":[{"identifier":"1507.01972","identifierType":"arXiv"}],"alternateIdentifiers":[{"alternateIdentifierType":"arXiv","alternateIdentifier":"1507.01972"}],"creators":[{"name":"Montavon, Grégoire","nameType":"Personal","givenName":"Grégoire","familyName":"Montavon","affiliation":[],"nameIdentifiers":[]},{"name":"Müller, Klaus-Robert","nameType":"Personal","givenName":"Klaus-Robert","familyName":"Müller","affiliation":[],"nameIdentifiers":[]},{"name":"Cuturi, Marco","nameType":"Personal","givenName":"Marco","familyName":"Cuturi","affiliation":[],"nameIdentifiers":[]}],"titles":[{"title":"Wasserstein Training of Boltzmann Machines"}],"publisher":"arXiv","container":{},"publicationYear":2015,"subjects":[{"lang":"en","subject":"Machine Learning (stat.ML)","subjectScheme":"arXiv"},{"lang":"en","subject":"Machine Learning (cs.LG)","subjectScheme":"arXiv"},{"subject":"FOS: Computer and information sciences","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Computer and information sciences","schemeUri":"http://www.oecd.org/science/inno/38235147.pdf","subjectScheme":"Fields of Science and Technology (FOS)"}],"contributors":[],"dates":[{"date":"2015-07-07T21:30:36Z","dateType":"Submitted","dateInformation":"v1"},{"date":"2015-07-09T00:01:46Z","dateType":"Updated","dateInformation":"v1"},{"date":"2015-07","dateType":"Available","dateInformation":"v1"},{"date":"2015","dateType":"Issued"}],"language":null,"types":{"ris":"GEN","bibtex":"misc","citeproc":"article","schemaOrg":"CreativeWork","resourceType":"Article","resourceTypeGeneral":"Preprint"},"relatedIdentifiers":[],"relatedItems":[],"sizes":[],"formats":[],"version":"1","rightsList":[{"rights":"arXiv.org perpetual, non-exclusive license","rightsUri":"http://arxiv.org/licenses/nonexclusive-distrib/1.0/"}],"descriptions":[{"description":"The Boltzmann machine provides a useful framework to learn highly complex, multimodal and multiscale data distributions that occur in the real world. The default method to learn its parameters consists of minimizing the Kullback-Leibler (KL) divergence from training samples to the Boltzmann model. We propose in this work a novel approach for Boltzmann training which assumes that a meaningful metric between observations is given. This metric can be represented by the Wasserstein distance between distributions, for which we derive a gradient with respect to the model parameters. Minimization of this new Wasserstein objective leads to generative models that are better when considering the metric and that have a cluster-like structure. We demonstrate the practical potential of these models for data completion and denoising, for which the metric between observations plays a crucial role.","descriptionType":"Abstract"},{"description":"9 pages, 6 figures","descriptionType":"Other"}],"geoLocations":[],"fundingReferences":[],"xml":"PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4KPHJlc291cmNlIHhtbG5zPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSIgeHNpOnNjaGVtYUxvY2F0aW9uPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCBodHRwOi8vc2NoZW1hLmRhdGFjaXRlLm9yZy9tZXRhL2tlcm5lbC00LjMvbWV0YWRhdGEueHNkIj4KICA8aWRlbnRpZmllciBpZGVudGlmaWVyVHlwZT0iRE9JIj4xMC40ODU1MC9BUlhJVi4xNTA3LjAxOTcyPC9pZGVudGlmaWVyPgogIDxhbHRlcm5hdGVJZGVudGlmaWVycz4KICAgIDxhbHRlcm5hdGVJZGVudGlmaWVyIGFsdGVybmF0ZUlkZW50aWZpZXJUeXBlPSJhclhpdiI+MTUwNy4wMTk3MjwvYWx0ZXJuYXRlSWRlbnRpZmllcj4KICA8L2FsdGVybmF0ZUlkZW50aWZpZXJzPgogIDxjcmVhdG9ycz4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5Nb250YXZvbiwgR3LDqWdvaXJlPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5HcsOpZ29pcmU8L2dpdmVuTmFtZT4KICAgICAgPGZhbWlseU5hbWU+TW9udGF2b248L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgICA8Y3JlYXRvcj4KICAgICAgPGNyZWF0b3JOYW1lIG5hbWVUeXBlPSJQZXJzb25hbCI+TcO8bGxlciwgS2xhdXMtUm9iZXJ0PC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5LbGF1cy1Sb2JlcnQ8L2dpdmVuTmFtZT4KICAgICAgPGZhbWlseU5hbWU+TcO8bGxlcjwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5DdXR1cmksIE1hcmNvPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5NYXJjbzwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5DdXR1cmk8L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgPC9jcmVhdG9ycz4KICA8dGl0bGVzPgogICAgPHRpdGxlPldhc3NlcnN0ZWluIFRyYWluaW5nIG9mIEJvbHR6bWFubiBNYWNoaW5lczwvdGl0bGU+CiAgPC90aXRsZXM+CiAgPHB1Ymxpc2hlcj5hclhpdjwvcHVibGlzaGVyPgogIDxwdWJsaWNhdGlvblllYXI+MjAxNTwvcHVibGljYXRpb25ZZWFyPgogIDxzdWJqZWN0cz4KICAgIDxzdWJqZWN0IHhtbDpsYW5nPSJlbiIgc3ViamVjdFNjaGVtZT0iYXJYaXYiPk1hY2hpbmUgTGVhcm5pbmcgKHN0YXQuTUwpPC9zdWJqZWN0PgogICAgPHN1YmplY3QgeG1sOmxhbmc9ImVuIiBzdWJqZWN0U2NoZW1lPSJhclhpdiI+TWFjaGluZSBMZWFybmluZyAoY3MuTEcpPC9zdWJqZWN0PgogICAgPHN1YmplY3Qgc3ViamVjdFNjaGVtZT0iRmllbGRzIG9mIFNjaWVuY2UgYW5kIFRlY2hub2xvZ3kgKEZPUykiPkZPUzogQ29tcHV0ZXIgYW5kIGluZm9ybWF0aW9uIHNjaWVuY2VzPC9zdWJqZWN0PgogIDwvc3ViamVjdHM+CiAgPGRhdGVzPgogICAgPGRhdGUgZGF0ZVR5cGU9IlN1Ym1pdHRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2MSI+MjAxNS0wNy0wN1QyMTozMDozNlo8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iVXBkYXRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2MSI+MjAxNS0wNy0wOVQwMDowMTo0Nlo8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iQXZhaWxhYmxlIiBkYXRlSW5mb3JtYXRpb249InYxIj4yMDE1LTA3PC9kYXRlPgogIDwvZGF0ZXM+CiAgPHJlc291cmNlVHlwZSByZXNvdXJjZVR5cGVHZW5lcmFsPSJQcmVwcmludCI+QXJ0aWNsZTwvcmVzb3VyY2VUeXBlPgogIDx2ZXJzaW9uPjE8L3ZlcnNpb24+CiAgPHJpZ2h0c0xpc3Q+CiAgICA8cmlnaHRzIHJpZ2h0c1VSST0iaHR0cDovL2FyeGl2Lm9yZy9saWNlbnNlcy9ub25leGNsdXNpdmUtZGlzdHJpYi8xLjAvIj5hclhpdi5vcmcgcGVycGV0dWFsLCBub24tZXhjbHVzaXZlIGxpY2Vuc2U8L3JpZ2h0cz4KICA8L3JpZ2h0c0xpc3Q+CiAgPGRlc2NyaXB0aW9ucz4KICAgIDxkZXNjcmlwdGlvbiBkZXNjcmlwdGlvblR5cGU9IkFic3RyYWN0Ij5UaGUgQm9sdHptYW5uIG1hY2hpbmUgcHJvdmlkZXMgYSB1c2VmdWwgZnJhbWV3b3JrIHRvIGxlYXJuIGhpZ2hseSBjb21wbGV4LCBtdWx0aW1vZGFsIGFuZCBtdWx0aXNjYWxlIGRhdGEgZGlzdHJpYnV0aW9ucyB0aGF0IG9jY3VyIGluIHRoZSByZWFsIHdvcmxkLiBUaGUgZGVmYXVsdCBtZXRob2QgdG8gbGVhcm4gaXRzIHBhcmFtZXRlcnMgY29uc2lzdHMgb2YgbWluaW1pemluZyB0aGUgS3VsbGJhY2stTGVpYmxlciAoS0wpIGRpdmVyZ2VuY2UgZnJvbSB0cmFpbmluZyBzYW1wbGVzIHRvIHRoZSBCb2x0em1hbm4gbW9kZWwuIFdlIHByb3Bvc2UgaW4gdGhpcyB3b3JrIGEgbm92ZWwgYXBwcm9hY2ggZm9yIEJvbHR6bWFubiB0cmFpbmluZyB3aGljaCBhc3N1bWVzIHRoYXQgYSBtZWFuaW5nZnVsIG1ldHJpYyBiZXR3ZWVuIG9ic2VydmF0aW9ucyBpcyBnaXZlbi4gVGhpcyBtZXRyaWMgY2FuIGJlIHJlcHJlc2VudGVkIGJ5IHRoZSBXYXNzZXJzdGVpbiBkaXN0YW5jZSBiZXR3ZWVuIGRpc3RyaWJ1dGlvbnMsIGZvciB3aGljaCB3ZSBkZXJpdmUgYSBncmFkaWVudCB3aXRoIHJlc3BlY3QgdG8gdGhlIG1vZGVsIHBhcmFtZXRlcnMuIE1pbmltaXphdGlvbiBvZiB0aGlzIG5ldyBXYXNzZXJzdGVpbiBvYmplY3RpdmUgbGVhZHMgdG8gZ2VuZXJhdGl2ZSBtb2RlbHMgdGhhdCBhcmUgYmV0dGVyIHdoZW4gY29uc2lkZXJpbmcgdGhlIG1ldHJpYyBhbmQgdGhhdCBoYXZlIGEgY2x1c3Rlci1saWtlIHN0cnVjdHVyZS4gV2UgZGVtb25zdHJhdGUgdGhlIHByYWN0aWNhbCBwb3RlbnRpYWwgb2YgdGhlc2UgbW9kZWxzIGZvciBkYXRhIGNvbXBsZXRpb24gYW5kIGRlbm9pc2luZywgZm9yIHdoaWNoIHRoZSBtZXRyaWMgYmV0d2VlbiBvYnNlcnZhdGlvbnMgcGxheXMgYSBjcnVjaWFsIHJvbGUuPC9kZXNjcmlwdGlvbj4KICAgIDxkZXNjcmlwdGlvbiBkZXNjcmlwdGlvblR5cGU9Ik90aGVyIj45IHBhZ2VzLCA2IGZpZ3VyZXM8L2Rlc2NyaXB0aW9uPgogIDwvZGVzY3JpcHRpb25zPgo8L3Jlc291cmNlPg==","url":"https://arxiv.org/abs/1507.01972","contentUrl":null,"metadataVersion":0,"schemaVersion":"http://datacite.org/schema/kernel-4","source":"mds","isActive":true,"state":"findable","reason":null,"viewCount":0,"viewsOverTime":[],"downloadCount":0,"downloadsOverTime":[],"referenceCount":0,"citationCount":0,"citationsOverTime":[],"partCount":0,"partOfCount":0,"versionCount":0,"versionOfCount":0,"created":"2022-03-07T15:32:37.000Z","registered":"2022-03-07T15:32:39.000Z","published":"2015","updated":"2022-03-07T15:32:39.000Z"},"relationships":{"client":{"data":{"id":"arxiv.content","type":"clients"}},"provider":{"data":{"id":"arxiv","type":"providers"}},"media":{"data":{"id":"10.48550/arxiv.1507.01972","type":"media"}},"references":{"data":[]},"citations":{"data":[]},"parts":{"data":[]},"partOf":{"data":[]},"versions":{"data":[]},"versionOf":{"data":[]}}}}