{"data":{"id":"10.48550/arxiv.2206.11892","type":"dois","attributes":{"doi":"10.48550/arxiv.2206.11892","prefix":"10.48550","suffix":"arxiv.2206.11892","identifiers":[{"identifier":"2206.11892","identifierType":"arXiv"}],"alternateIdentifiers":[{"alternateIdentifierType":"arXiv","alternateIdentifier":"2206.11892"}],"creators":[{"name":"Bandara, Wele Gedara Chaminda","nameType":"Personal","givenName":"Wele Gedara Chaminda","familyName":"Bandara","affiliation":[],"nameIdentifiers":[]},{"name":"Nair, Nithin Gopalakrishnan","nameType":"Personal","givenName":"Nithin Gopalakrishnan","familyName":"Nair","affiliation":[],"nameIdentifiers":[]},{"name":"Patel, Vishal M.","nameType":"Personal","givenName":"Vishal M.","familyName":"Patel","affiliation":[],"nameIdentifiers":[]}],"titles":[{"title":"DDPM-CD: Denoising Diffusion Probabilistic Models as Feature Extractors for Change Detection"}],"publisher":"arXiv","container":{},"publicationYear":2022,"subjects":[{"lang":"en","subject":"Computer Vision and Pattern Recognition (cs.CV)","subjectScheme":"arXiv"},{"lang":"en","subject":"Machine Learning (cs.LG)","subjectScheme":"arXiv"},{"subject":"FOS: Computer and information sciences","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Computer and information sciences","schemeUri":"http://www.oecd.org/science/inno/38235147.pdf","subjectScheme":"Fields of Science and Technology (FOS)"}],"contributors":[],"dates":[{"date":"2022-06-23T17:58:29Z","dateType":"Submitted","dateInformation":"v1"},{"date":"2022-06-24T00:21:27Z","dateType":"Updated","dateInformation":"v1"},{"date":"2022-06-27T22:42:39Z","dateType":"Submitted","dateInformation":"v2"},{"date":"2022-06-29T00:04:51Z","dateType":"Updated","dateInformation":"v2"},{"date":"2024-01-12T14:37:36Z","dateType":"Submitted","dateInformation":"v3"},{"date":"2024-01-15T01:26:35Z","dateType":"Updated","dateInformation":"v3"},{"date":"2022-06","dateType":"Available","dateInformation":"v1"},{"date":"2022","dateType":"Issued"}],"language":null,"types":{"ris":"GEN","bibtex":"misc","citeproc":"article","schemaOrg":"CreativeWork","resourceType":"Article","resourceTypeGeneral":"Preprint"},"relatedIdentifiers":[],"relatedItems":[],"sizes":[],"formats":[],"version":"3","rightsList":[{"rights":"Creative Commons Attribution 4.0 International","rightsUri":"https://creativecommons.org/licenses/by/4.0/legalcode","schemeUri":"https://spdx.org/licenses/","rightsIdentifier":"cc-by-4.0","rightsIdentifierScheme":"SPDX"}],"descriptions":[{"description":"Remote sensing change detection is crucial for understanding the dynamics of our planet's surface, facilitating the monitoring of environmental changes, evaluating human impact, predicting future trends, and supporting decision-making. In this work, we introduce a novel approach for change detection that can leverage off-the-shelf, unlabeled remote sensing images in the training process by pre-training a Denoising Diffusion Probabilistic Model (DDPM) - a class of generative models used in image synthesis. DDPMs learn the training data distribution by gradually converting training images into a Gaussian distribution using a Markov chain. During inference (i.e., sampling), they can generate a diverse set of samples closer to the training distribution, starting from Gaussian noise, achieving state-of-the-art image synthesis results. However, in this work, our focus is not on image synthesis but on utilizing it as a pre-trained feature extractor for the downstream application of change detection. Specifically, we fine-tune a lightweight change classifier utilizing the feature representations produced by the pre-trained DDPM alongside change labels. Experiments conducted on the LEVIR-CD, WHU-CD, DSIFN-CD, and CDD datasets demonstrate that the proposed DDPM-CD method significantly outperforms the existing state-of-the-art change detection methods in terms of F1 score, IoU, and overall accuracy, highlighting the pivotal role of pre-trained DDPM as a feature extractor for downstream applications. We have made both the code and pre-trained models available at https://github.com/wgcban/ddpm-cd","descriptionType":"Abstract"},{"description":"Code available at: https://github.com/wgcban/ddpm-cd","descriptionType":"Other"}],"geoLocations":[],"fundingReferences":[],"xml":"PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4KPHJlc291cmNlIHhtbG5zPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSIgeHNpOnNjaGVtYUxvY2F0aW9uPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCBodHRwOi8vc2NoZW1hLmRhdGFjaXRlLm9yZy9tZXRhL2tlcm5lbC00LjMvbWV0YWRhdGEueHNkIj4KICA8aWRlbnRpZmllciBpZGVudGlmaWVyVHlwZT0iRE9JIj4xMC40ODU1MC9BUlhJVi4yMjA2LjExODkyPC9pZGVudGlmaWVyPgogIDxhbHRlcm5hdGVJZGVudGlmaWVycz4KICAgIDxhbHRlcm5hdGVJZGVudGlmaWVyIGFsdGVybmF0ZUlkZW50aWZpZXJUeXBlPSJhclhpdiI+MjIwNi4xMTg5MjwvYWx0ZXJuYXRlSWRlbnRpZmllcj4KICA8L2FsdGVybmF0ZUlkZW50aWZpZXJzPgogIDxjcmVhdG9ycz4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5CYW5kYXJhLCBXZWxlIEdlZGFyYSBDaGFtaW5kYTwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+V2VsZSBHZWRhcmEgQ2hhbWluZGE8L2dpdmVuTmFtZT4KICAgICAgPGZhbWlseU5hbWU+QmFuZGFyYTwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5OYWlyLCBOaXRoaW4gR29wYWxha3Jpc2huYW48L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPk5pdGhpbiBHb3BhbGFrcmlzaG5hbjwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5OYWlyPC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogICAgPGNyZWF0b3I+CiAgICAgIDxjcmVhdG9yTmFtZSBuYW1lVHlwZT0iUGVyc29uYWwiPlBhdGVsLCBWaXNoYWwgTS48L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPlZpc2hhbCBNLjwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5QYXRlbDwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICA8L2NyZWF0b3JzPgogIDx0aXRsZXM+CiAgICA8dGl0bGU+RERQTS1DRDogRGVub2lzaW5nIERpZmZ1c2lvbiBQcm9iYWJpbGlzdGljIE1vZGVscyBhcyBGZWF0dXJlIEV4dHJhY3RvcnMgZm9yIENoYW5nZSBEZXRlY3Rpb248L3RpdGxlPgogIDwvdGl0bGVzPgogIDxwdWJsaXNoZXI+YXJYaXY8L3B1Ymxpc2hlcj4KICA8cHVibGljYXRpb25ZZWFyPjIwMjI8L3B1YmxpY2F0aW9uWWVhcj4KICA8c3ViamVjdHM+CiAgICA8c3ViamVjdCB4bWw6bGFuZz0iZW4iIHN1YmplY3RTY2hlbWU9ImFyWGl2Ij5Db21wdXRlciBWaXNpb24gYW5kIFBhdHRlcm4gUmVjb2duaXRpb24gKGNzLkNWKTwvc3ViamVjdD4KICAgIDxzdWJqZWN0IHhtbDpsYW5nPSJlbiIgc3ViamVjdFNjaGVtZT0iYXJYaXYiPk1hY2hpbmUgTGVhcm5pbmcgKGNzLkxHKTwvc3ViamVjdD4KICAgIDxzdWJqZWN0IHN1YmplY3RTY2hlbWU9IkZpZWxkcyBvZiBTY2llbmNlIGFuZCBUZWNobm9sb2d5IChGT1MpIj5GT1M6IENvbXB1dGVyIGFuZCBpbmZvcm1hdGlvbiBzY2llbmNlczwvc3ViamVjdD4KICA8L3N1YmplY3RzPgogIDxkYXRlcz4KICAgIDxkYXRlIGRhdGVUeXBlPSJTdWJtaXR0ZWQiIGRhdGVJbmZvcm1hdGlvbj0idjEiPjIwMjItMDYtMjNUMTc6NTg6MjlaPC9kYXRlPgogICAgPGRhdGUgZGF0ZVR5cGU9IlVwZGF0ZWQiIGRhdGVJbmZvcm1hdGlvbj0idjEiPjIwMjItMDYtMjRUMDA6MjE6MjdaPC9kYXRlPgogICAgPGRhdGUgZGF0ZVR5cGU9IlN1Ym1pdHRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2MiI+MjAyMi0wNi0yN1QyMjo0MjozOVo8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iVXBkYXRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2MiI+MjAyMi0wNi0yOVQwMDowNDo1MVo8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iU3VibWl0dGVkIiBkYXRlSW5mb3JtYXRpb249InYzIj4yMDI0LTAxLTEyVDE0OjM3OjM2WjwvZGF0ZT4KICAgIDxkYXRlIGRhdGVUeXBlPSJVcGRhdGVkIiBkYXRlSW5mb3JtYXRpb249InYzIj4yMDI0LTAxLTE1VDAxOjI2OjM1WjwvZGF0ZT4KICAgIDxkYXRlIGRhdGVUeXBlPSJBdmFpbGFibGUiIGRhdGVJbmZvcm1hdGlvbj0idjEiPjIwMjItMDY8L2RhdGU+CiAgPC9kYXRlcz4KICA8cmVzb3VyY2VUeXBlIHJlc291cmNlVHlwZUdlbmVyYWw9IlByZXByaW50Ij5BcnRpY2xlPC9yZXNvdXJjZVR5cGU+CiAgPHZlcnNpb24+MzwvdmVyc2lvbj4KICA8cmlnaHRzTGlzdD4KICAgIDxyaWdodHMgcmlnaHRzVVJJPSJodHRwOi8vY3JlYXRpdmVjb21tb25zLm9yZy9saWNlbnNlcy9ieS80LjAvIiByaWdodHNJZGVudGlmaWVyU2NoZW1lPSJTUERYIiByaWdodHNJZGVudGlmaWVyPSJDQy1CWS00LjAiPkNyZWF0aXZlIENvbW1vbnMgQXR0cmlidXRpb24gNC4wIEludGVybmF0aW9uYWw8L3JpZ2h0cz4KICA8L3JpZ2h0c0xpc3Q+CiAgPGRlc2NyaXB0aW9ucz4KICAgIDxkZXNjcmlwdGlvbiBkZXNjcmlwdGlvblR5cGU9IkFic3RyYWN0Ij5SZW1vdGUgc2Vuc2luZyBjaGFuZ2UgZGV0ZWN0aW9uIGlzIGNydWNpYWwgZm9yIHVuZGVyc3RhbmRpbmcgdGhlIGR5bmFtaWNzIG9mIG91ciBwbGFuZXQncyBzdXJmYWNlLCBmYWNpbGl0YXRpbmcgdGhlIG1vbml0b3Jpbmcgb2YgZW52aXJvbm1lbnRhbCBjaGFuZ2VzLCBldmFsdWF0aW5nIGh1bWFuIGltcGFjdCwgcHJlZGljdGluZyBmdXR1cmUgdHJlbmRzLCBhbmQgc3VwcG9ydGluZyBkZWNpc2lvbi1tYWtpbmcuIEluIHRoaXMgd29yaywgd2UgaW50cm9kdWNlIGEgbm92ZWwgYXBwcm9hY2ggZm9yIGNoYW5nZSBkZXRlY3Rpb24gdGhhdCBjYW4gbGV2ZXJhZ2Ugb2ZmLXRoZS1zaGVsZiwgdW5sYWJlbGVkIHJlbW90ZSBzZW5zaW5nIGltYWdlcyBpbiB0aGUgdHJhaW5pbmcgcHJvY2VzcyBieSBwcmUtdHJhaW5pbmcgYSBEZW5vaXNpbmcgRGlmZnVzaW9uIFByb2JhYmlsaXN0aWMgTW9kZWwgKEREUE0pIC0gYSBjbGFzcyBvZiBnZW5lcmF0aXZlIG1vZGVscyB1c2VkIGluIGltYWdlIHN5bnRoZXNpcy4gRERQTXMgbGVhcm4gdGhlIHRyYWluaW5nIGRhdGEgZGlzdHJpYnV0aW9uIGJ5IGdyYWR1YWxseSBjb252ZXJ0aW5nIHRyYWluaW5nIGltYWdlcyBpbnRvIGEgR2F1c3NpYW4gZGlzdHJpYnV0aW9uIHVzaW5nIGEgTWFya292IGNoYWluLiBEdXJpbmcgaW5mZXJlbmNlIChpLmUuLCBzYW1wbGluZyksIHRoZXkgY2FuIGdlbmVyYXRlIGEgZGl2ZXJzZSBzZXQgb2Ygc2FtcGxlcyBjbG9zZXIgdG8gdGhlIHRyYWluaW5nIGRpc3RyaWJ1dGlvbiwgc3RhcnRpbmcgZnJvbSBHYXVzc2lhbiBub2lzZSwgYWNoaWV2aW5nIHN0YXRlLW9mLXRoZS1hcnQgaW1hZ2Ugc3ludGhlc2lzIHJlc3VsdHMuIEhvd2V2ZXIsIGluIHRoaXMgd29yaywgb3VyIGZvY3VzIGlzIG5vdCBvbiBpbWFnZSBzeW50aGVzaXMgYnV0IG9uIHV0aWxpemluZyBpdCBhcyBhIHByZS10cmFpbmVkIGZlYXR1cmUgZXh0cmFjdG9yIGZvciB0aGUgZG93bnN0cmVhbSBhcHBsaWNhdGlvbiBvZiBjaGFuZ2UgZGV0ZWN0aW9uLiBTcGVjaWZpY2FsbHksIHdlIGZpbmUtdHVuZSBhIGxpZ2h0d2VpZ2h0IGNoYW5nZSBjbGFzc2lmaWVyIHV0aWxpemluZyB0aGUgZmVhdHVyZSByZXByZXNlbnRhdGlvbnMgcHJvZHVjZWQgYnkgdGhlIHByZS10cmFpbmVkIEREUE0gYWxvbmdzaWRlIGNoYW5nZSBsYWJlbHMuIEV4cGVyaW1lbnRzIGNvbmR1Y3RlZCBvbiB0aGUgTEVWSVItQ0QsIFdIVS1DRCwgRFNJRk4tQ0QsIGFuZCBDREQgZGF0YXNldHMgZGVtb25zdHJhdGUgdGhhdCB0aGUgcHJvcG9zZWQgRERQTS1DRCBtZXRob2Qgc2lnbmlmaWNhbnRseSBvdXRwZXJmb3JtcyB0aGUgZXhpc3Rpbmcgc3RhdGUtb2YtdGhlLWFydCBjaGFuZ2UgZGV0ZWN0aW9uIG1ldGhvZHMgaW4gdGVybXMgb2YgRjEgc2NvcmUsIElvVSwgYW5kIG92ZXJhbGwgYWNjdXJhY3ksIGhpZ2hsaWdodGluZyB0aGUgcGl2b3RhbCByb2xlIG9mIHByZS10cmFpbmVkIEREUE0gYXMgYSBmZWF0dXJlIGV4dHJhY3RvciBmb3IgZG93bnN0cmVhbSBhcHBsaWNhdGlvbnMuIFdlIGhhdmUgbWFkZSBib3RoIHRoZSBjb2RlIGFuZCBwcmUtdHJhaW5lZCBtb2RlbHMgYXZhaWxhYmxlIGF0IGh0dHBzOi8vZ2l0aHViLmNvbS93Z2NiYW4vZGRwbS1jZDwvZGVzY3JpcHRpb24+CiAgICA8ZGVzY3JpcHRpb24gZGVzY3JpcHRpb25UeXBlPSJPdGhlciI+Q29kZSBhdmFpbGFibGUgYXQ6IGh0dHBzOi8vZ2l0aHViLmNvbS93Z2NiYW4vZGRwbS1jZDwvZGVzY3JpcHRpb24+CiAgPC9kZXNjcmlwdGlvbnM+CjwvcmVzb3VyY2U+","url":"https://arxiv.org/abs/2206.11892","contentUrl":null,"metadataVersion":2,"schemaVersion":"http://datacite.org/schema/kernel-4","source":"mds","isActive":true,"state":"findable","reason":null,"viewCount":0,"viewsOverTime":[],"downloadCount":0,"downloadsOverTime":[],"referenceCount":0,"citationCount":0,"citationsOverTime":[],"partCount":0,"partOfCount":0,"versionCount":0,"versionOfCount":0,"created":"2022-06-24T01:16:11.000Z","registered":"2022-06-24T01:16:11.000Z","published":"2022","updated":"2024-01-15T02:44:51.000Z"},"relationships":{"client":{"data":{"id":"arxiv.content","type":"clients"}},"provider":{"data":{"id":"arxiv","type":"providers"}},"media":{"data":{"id":"10.48550/arxiv.2206.11892","type":"media"}},"references":{"data":[]},"citations":{"data":[]},"parts":{"data":[]},"partOf":{"data":[]},"versions":{"data":[]},"versionOf":{"data":[]}}}}