{"data":{"id":"10.48550/arxiv.2003.05436","type":"dois","attributes":{"doi":"10.48550/arxiv.2003.05436","prefix":"10.48550","suffix":"arxiv.2003.05436","identifiers":[{"identifier":"2003.05436","identifierType":"arXiv"}],"alternateIdentifiers":[{"alternateIdentifierType":"arXiv","alternateIdentifier":"2003.05436"}],"creators":[{"name":"Yan, Wilson","nameType":"Personal","givenName":"Wilson","familyName":"Yan","affiliation":[],"nameIdentifiers":[]},{"name":"Vangipuram, Ashwin","nameType":"Personal","givenName":"Ashwin","familyName":"Vangipuram","affiliation":[],"nameIdentifiers":[]},{"name":"Abbeel, Pieter","nameType":"Personal","givenName":"Pieter","familyName":"Abbeel","affiliation":[],"nameIdentifiers":[]},{"name":"Pinto, Lerrel","nameType":"Personal","givenName":"Lerrel","familyName":"Pinto","affiliation":[],"nameIdentifiers":[]}],"titles":[{"title":"Learning Predictive Representations for Deformable Objects Using Contrastive Estimation"}],"publisher":"arXiv","container":{},"publicationYear":2020,"subjects":[{"lang":"en","subject":"Machine Learning (cs.LG)","subjectScheme":"arXiv"},{"lang":"en","subject":"Computer Vision and Pattern Recognition (cs.CV)","subjectScheme":"arXiv"},{"lang":"en","subject":"Robotics (cs.RO)","subjectScheme":"arXiv"},{"lang":"en","subject":"Machine Learning (stat.ML)","subjectScheme":"arXiv"},{"subject":"FOS: Computer and information sciences","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Computer and information sciences","schemeUri":"http://www.oecd.org/science/inno/38235147.pdf","subjectScheme":"Fields of Science and Technology (FOS)"}],"contributors":[],"dates":[{"date":"2020-03-11T17:55:15Z","dateType":"Submitted","dateInformation":"v1"},{"date":"2020-03-12T00:18:01Z","dateType":"Updated","dateInformation":"v1"},{"date":"2020-03","dateType":"Available","dateInformation":"v1"},{"date":"2020","dateType":"Issued"}],"language":null,"types":{"ris":"GEN","bibtex":"misc","citeproc":"article","schemaOrg":"CreativeWork","resourceType":"Article","resourceTypeGeneral":"Preprint"},"relatedIdentifiers":[],"relatedItems":[],"sizes":[],"formats":[],"version":"1","rightsList":[{"rights":"arXiv.org perpetual, non-exclusive license","rightsUri":"http://arxiv.org/licenses/nonexclusive-distrib/1.0/"}],"descriptions":[{"description":"Using visual model-based learning for deformable object manipulation is challenging due to difficulties in learning plannable visual representations along with complex dynamic models. In this work, we propose a new learning framework that jointly optimizes both the visual representation model and the dynamics model using contrastive estimation. Using simulation data collected by randomly perturbing deformable objects on a table, we learn latent dynamics models for these objects in an offline fashion. Then, using the learned models, we use simple model-based planning to solve challenging deformable object manipulation tasks such as spreading ropes and cloths. Experimentally, we show substantial improvements in performance over standard model-based learning techniques across our rope and cloth manipulation suite. Finally, we transfer our visual manipulation policies trained on data purely collected in simulation to a real PR2 robot through domain randomization.","descriptionType":"Abstract"},{"description":"Project website: https://sites.google.com/view/contrastive-predictive-model","descriptionType":"Other"}],"geoLocations":[],"fundingReferences":[],"xml":"PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4KPHJlc291cmNlIHhtbG5zPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSIgeHNpOnNjaGVtYUxvY2F0aW9uPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCBodHRwOi8vc2NoZW1hLmRhdGFjaXRlLm9yZy9tZXRhL2tlcm5lbC00LjMvbWV0YWRhdGEueHNkIj4KICA8aWRlbnRpZmllciBpZGVudGlmaWVyVHlwZT0iRE9JIj4xMC40ODU1MC9BUlhJVi4yMDAzLjA1NDM2PC9pZGVudGlmaWVyPgogIDxhbHRlcm5hdGVJZGVudGlmaWVycz4KICAgIDxhbHRlcm5hdGVJZGVudGlmaWVyIGFsdGVybmF0ZUlkZW50aWZpZXJUeXBlPSJhclhpdiI+MjAwMy4wNTQzNjwvYWx0ZXJuYXRlSWRlbnRpZmllcj4KICA8L2FsdGVybmF0ZUlkZW50aWZpZXJzPgogIDxjcmVhdG9ycz4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5ZYW4sIFdpbHNvbjwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+V2lsc29uPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPllhbjwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5WYW5naXB1cmFtLCBBc2h3aW48L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPkFzaHdpbjwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5WYW5naXB1cmFtPC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogICAgPGNyZWF0b3I+CiAgICAgIDxjcmVhdG9yTmFtZSBuYW1lVHlwZT0iUGVyc29uYWwiPkFiYmVlbCwgUGlldGVyPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5QaWV0ZXI8L2dpdmVuTmFtZT4KICAgICAgPGZhbWlseU5hbWU+QWJiZWVsPC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogICAgPGNyZWF0b3I+CiAgICAgIDxjcmVhdG9yTmFtZSBuYW1lVHlwZT0iUGVyc29uYWwiPlBpbnRvLCBMZXJyZWw8L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPkxlcnJlbDwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5QaW50bzwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICA8L2NyZWF0b3JzPgogIDx0aXRsZXM+CiAgICA8dGl0bGU+TGVhcm5pbmcgUHJlZGljdGl2ZSBSZXByZXNlbnRhdGlvbnMgZm9yIERlZm9ybWFibGUgT2JqZWN0cyBVc2luZyBDb250cmFzdGl2ZSBFc3RpbWF0aW9uPC90aXRsZT4KICA8L3RpdGxlcz4KICA8cHVibGlzaGVyPmFyWGl2PC9wdWJsaXNoZXI+CiAgPHB1YmxpY2F0aW9uWWVhcj4yMDIwPC9wdWJsaWNhdGlvblllYXI+CiAgPHN1YmplY3RzPgogICAgPHN1YmplY3QgeG1sOmxhbmc9ImVuIiBzdWJqZWN0U2NoZW1lPSJhclhpdiI+TWFjaGluZSBMZWFybmluZyAoY3MuTEcpPC9zdWJqZWN0PgogICAgPHN1YmplY3QgeG1sOmxhbmc9ImVuIiBzdWJqZWN0U2NoZW1lPSJhclhpdiI+Q29tcHV0ZXIgVmlzaW9uIGFuZCBQYXR0ZXJuIFJlY29nbml0aW9uIChjcy5DVik8L3N1YmplY3Q+CiAgICA8c3ViamVjdCB4bWw6bGFuZz0iZW4iIHN1YmplY3RTY2hlbWU9ImFyWGl2Ij5Sb2JvdGljcyAoY3MuUk8pPC9zdWJqZWN0PgogICAgPHN1YmplY3QgeG1sOmxhbmc9ImVuIiBzdWJqZWN0U2NoZW1lPSJhclhpdiI+TWFjaGluZSBMZWFybmluZyAoc3RhdC5NTCk8L3N1YmplY3Q+CiAgICA8c3ViamVjdCBzdWJqZWN0U2NoZW1lPSJGaWVsZHMgb2YgU2NpZW5jZSBhbmQgVGVjaG5vbG9neSAoRk9TKSI+Rk9TOiBDb21wdXRlciBhbmQgaW5mb3JtYXRpb24gc2NpZW5jZXM8L3N1YmplY3Q+CiAgPC9zdWJqZWN0cz4KICA8ZGF0ZXM+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iU3VibWl0dGVkIiBkYXRlSW5mb3JtYXRpb249InYxIj4yMDIwLTAzLTExVDE3OjU1OjE1WjwvZGF0ZT4KICAgIDxkYXRlIGRhdGVUeXBlPSJVcGRhdGVkIiBkYXRlSW5mb3JtYXRpb249InYxIj4yMDIwLTAzLTEyVDAwOjE4OjAxWjwvZGF0ZT4KICAgIDxkYXRlIGRhdGVUeXBlPSJBdmFpbGFibGUiIGRhdGVJbmZvcm1hdGlvbj0idjEiPjIwMjAtMDM8L2RhdGU+CiAgPC9kYXRlcz4KICA8cmVzb3VyY2VUeXBlIHJlc291cmNlVHlwZUdlbmVyYWw9IlByZXByaW50Ij5BcnRpY2xlPC9yZXNvdXJjZVR5cGU+CiAgPHZlcnNpb24+MTwvdmVyc2lvbj4KICA8cmlnaHRzTGlzdD4KICAgIDxyaWdodHMgcmlnaHRzVVJJPSJodHRwOi8vYXJ4aXYub3JnL2xpY2Vuc2VzL25vbmV4Y2x1c2l2ZS1kaXN0cmliLzEuMC8iPmFyWGl2Lm9yZyBwZXJwZXR1YWwsIG5vbi1leGNsdXNpdmUgbGljZW5zZTwvcmlnaHRzPgogIDwvcmlnaHRzTGlzdD4KICA8ZGVzY3JpcHRpb25zPgogICAgPGRlc2NyaXB0aW9uIGRlc2NyaXB0aW9uVHlwZT0iQWJzdHJhY3QiPlVzaW5nIHZpc3VhbCBtb2RlbC1iYXNlZCBsZWFybmluZyBmb3IgZGVmb3JtYWJsZSBvYmplY3QgbWFuaXB1bGF0aW9uIGlzIGNoYWxsZW5naW5nIGR1ZSB0byBkaWZmaWN1bHRpZXMgaW4gbGVhcm5pbmcgcGxhbm5hYmxlIHZpc3VhbCByZXByZXNlbnRhdGlvbnMgYWxvbmcgd2l0aCBjb21wbGV4IGR5bmFtaWMgbW9kZWxzLiBJbiB0aGlzIHdvcmssIHdlIHByb3Bvc2UgYSBuZXcgbGVhcm5pbmcgZnJhbWV3b3JrIHRoYXQgam9pbnRseSBvcHRpbWl6ZXMgYm90aCB0aGUgdmlzdWFsIHJlcHJlc2VudGF0aW9uIG1vZGVsIGFuZCB0aGUgZHluYW1pY3MgbW9kZWwgdXNpbmcgY29udHJhc3RpdmUgZXN0aW1hdGlvbi4gVXNpbmcgc2ltdWxhdGlvbiBkYXRhIGNvbGxlY3RlZCBieSByYW5kb21seSBwZXJ0dXJiaW5nIGRlZm9ybWFibGUgb2JqZWN0cyBvbiBhIHRhYmxlLCB3ZSBsZWFybiBsYXRlbnQgZHluYW1pY3MgbW9kZWxzIGZvciB0aGVzZSBvYmplY3RzIGluIGFuIG9mZmxpbmUgZmFzaGlvbi4gVGhlbiwgdXNpbmcgdGhlIGxlYXJuZWQgbW9kZWxzLCB3ZSB1c2Ugc2ltcGxlIG1vZGVsLWJhc2VkIHBsYW5uaW5nIHRvIHNvbHZlIGNoYWxsZW5naW5nIGRlZm9ybWFibGUgb2JqZWN0IG1hbmlwdWxhdGlvbiB0YXNrcyBzdWNoIGFzIHNwcmVhZGluZyByb3BlcyBhbmQgY2xvdGhzLiBFeHBlcmltZW50YWxseSwgd2Ugc2hvdyBzdWJzdGFudGlhbCBpbXByb3ZlbWVudHMgaW4gcGVyZm9ybWFuY2Ugb3ZlciBzdGFuZGFyZCBtb2RlbC1iYXNlZCBsZWFybmluZyB0ZWNobmlxdWVzIGFjcm9zcyBvdXIgcm9wZSBhbmQgY2xvdGggbWFuaXB1bGF0aW9uIHN1aXRlLiBGaW5hbGx5LCB3ZSB0cmFuc2ZlciBvdXIgdmlzdWFsIG1hbmlwdWxhdGlvbiBwb2xpY2llcyB0cmFpbmVkIG9uIGRhdGEgcHVyZWx5IGNvbGxlY3RlZCBpbiBzaW11bGF0aW9uIHRvIGEgcmVhbCBQUjIgcm9ib3QgdGhyb3VnaCBkb21haW4gcmFuZG9taXphdGlvbi48L2Rlc2NyaXB0aW9uPgogICAgPGRlc2NyaXB0aW9uIGRlc2NyaXB0aW9uVHlwZT0iT3RoZXIiPlByb2plY3Qgd2Vic2l0ZTogaHR0cHM6Ly9zaXRlcy5nb29nbGUuY29tL3ZpZXcvY29udHJhc3RpdmUtcHJlZGljdGl2ZS1tb2RlbDwvZGVzY3JpcHRpb24+CiAgPC9kZXNjcmlwdGlvbnM+CjwvcmVzb3VyY2U+","url":"https://arxiv.org/abs/2003.05436","contentUrl":null,"metadataVersion":0,"schemaVersion":"http://datacite.org/schema/kernel-4","source":"mds","isActive":true,"state":"findable","reason":null,"viewCount":0,"viewsOverTime":[],"downloadCount":0,"downloadsOverTime":[],"referenceCount":0,"citationCount":0,"citationsOverTime":[],"partCount":0,"partOfCount":0,"versionCount":0,"versionOfCount":0,"created":"2022-02-25T17:49:10.000Z","registered":"2022-02-25T17:49:11.000Z","published":"2020","updated":"2022-02-25T17:49:11.000Z"},"relationships":{"client":{"data":{"id":"arxiv.content","type":"clients"}},"provider":{"data":{"id":"arxiv","type":"providers"}},"media":{"data":{"id":"10.48550/arxiv.2003.05436","type":"media"}},"references":{"data":[]},"citations":{"data":[]},"parts":{"data":[]},"partOf":{"data":[]},"versions":{"data":[]},"versionOf":{"data":[]}}}}