{"data":{"id":"10.48550/arxiv.1001.3448","type":"dois","attributes":{"doi":"10.48550/arxiv.1001.3448","prefix":"10.48550","suffix":"arxiv.1001.3448","identifiers":[{"identifier":"1001.3448","identifierType":"arXiv"}],"alternateIdentifiers":[{"alternateIdentifierType":"arXiv","alternateIdentifier":"1001.3448"}],"creators":[{"name":"Bayati, Mohsen","nameType":"Personal","givenName":"Mohsen","familyName":"Bayati","affiliation":[],"nameIdentifiers":[]},{"name":"Montanari, Andrea","nameType":"Personal","givenName":"Andrea","familyName":"Montanari","affiliation":[],"nameIdentifiers":[]}],"titles":[{"title":"The dynamics of message passing on dense graphs, with applications to compressed sensing"}],"publisher":"arXiv","container":{},"publicationYear":2010,"subjects":[{"lang":"en","subject":"Information Theory (cs.IT)","subjectScheme":"arXiv"},{"lang":"en","subject":"Machine Learning (cs.LG)","subjectScheme":"arXiv"},{"lang":"en","subject":"Statistics Theory (math.ST)","subjectScheme":"arXiv"},{"subject":"FOS: Computer and information sciences","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Computer and information sciences","schemeUri":"http://www.oecd.org/science/inno/38235147.pdf","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Mathematics","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Mathematics","schemeUri":"http://www.oecd.org/science/inno/38235147.pdf","subjectScheme":"Fields of Science and Technology (FOS)"}],"contributors":[],"dates":[{"date":"2010-01-20T02:57:15Z","dateType":"Submitted","dateInformation":"v1"},{"date":"2010-03-01T18:49:24Z","dateType":"Submitted","dateInformation":"v2"},{"date":"2010-03-05T19:58:54Z","dateType":"Updated","dateInformation":"v2"},{"date":"2010-10-27T07:58:49Z","dateType":"Submitted","dateInformation":"v3"},{"date":"2010-10-28T00:01:15Z","dateType":"Updated","dateInformation":"v3"},{"date":"2011-01-27T18:55:05Z","dateType":"Submitted","dateInformation":"v4"},{"date":"2012-03-06T01:00:32Z","dateType":"Updated","dateInformation":"v4"},{"date":"2010-01","dateType":"Available","dateInformation":"v1"},{"date":"2010","dateType":"Issued"}],"language":null,"types":{"ris":"RPRT","bibtex":"article","citeproc":"article-journal","schemaOrg":"ScholarlyArticle","resourceType":"Article","resourceTypeGeneral":"Text"},"relatedIdentifiers":[{"relationType":"IsVersionOf","relatedIdentifier":"10.1109/tit.2010.2094817","relatedIdentifierType":"DOI"}],"relatedItems":[],"sizes":[],"formats":[],"version":"4","rightsList":[{"rights":"arXiv.org perpetual, non-exclusive license","rightsUri":"http://arxiv.org/licenses/nonexclusive-distrib/1.0/"}],"descriptions":[{"description":"Approximate message passing algorithms proved to be extremely effective in reconstructing sparse signals from a small number of incoherent linear measurements. Extensive numerical experiments further showed that their dynamics is accurately tracked by a simple one-dimensional iteration termed state evolution. In this paper we provide the first rigorous foundation to state evolution. We prove that indeed it holds asymptotically in the large system limit for sensing matrices with independent and identically distributed gaussian entries. While our focus is on message passing algorithms for compressed sensing, the analysis extends beyond this setting, to a general class of algorithms on dense graphs. In this context, state evolution plays the role that density evolution has for sparse graphs. The proof technique is fundamentally different from the standard approach to density evolution, in that it copes with large number of short loops in the underlying factor graph. It relies instead on a conditioning technique recently developed by Erwin Bolthausen in the context of spin glass theory.","descriptionType":"Abstract"},{"description":"41 pages","descriptionType":"Other"}],"geoLocations":[],"fundingReferences":[],"xml":"PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4KPHJlc291cmNlIHhtbG5zPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSIgeHNpOnNjaGVtYUxvY2F0aW9uPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCBodHRwOi8vc2NoZW1hLmRhdGFjaXRlLm9yZy9tZXRhL2tlcm5lbC00LjMvbWV0YWRhdGEueHNkIj4KICA8aWRlbnRpZmllciBpZGVudGlmaWVyVHlwZT0iRE9JIj4xMC40ODU1MC9BUlhJVi4xMDAxLjM0NDg8L2lkZW50aWZpZXI+CiAgPGFsdGVybmF0ZUlkZW50aWZpZXJzPgogICAgPGFsdGVybmF0ZUlkZW50aWZpZXIgYWx0ZXJuYXRlSWRlbnRpZmllclR5cGU9ImFyWGl2Ij4xMDAxLjM0NDg8L2FsdGVybmF0ZUlkZW50aWZpZXI+CiAgPC9hbHRlcm5hdGVJZGVudGlmaWVycz4KICA8Y3JlYXRvcnM+CiAgICA8Y3JlYXRvcj4KICAgICAgPGNyZWF0b3JOYW1lIG5hbWVUeXBlPSJQZXJzb25hbCI+QmF5YXRpLCBNb2hzZW48L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPk1vaHNlbjwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5CYXlhdGk8L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgICA8Y3JlYXRvcj4KICAgICAgPGNyZWF0b3JOYW1lIG5hbWVUeXBlPSJQZXJzb25hbCI+TW9udGFuYXJpLCBBbmRyZWE8L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPkFuZHJlYTwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5Nb250YW5hcmk8L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgPC9jcmVhdG9ycz4KICA8dGl0bGVzPgogICAgPHRpdGxlPlRoZSBkeW5hbWljcyBvZiBtZXNzYWdlIHBhc3Npbmcgb24gZGVuc2UgZ3JhcGhzLCB3aXRoIGFwcGxpY2F0aW9ucyB0byBjb21wcmVzc2VkIHNlbnNpbmc8L3RpdGxlPgogIDwvdGl0bGVzPgogIDxwdWJsaXNoZXI+YXJYaXY8L3B1Ymxpc2hlcj4KICA8cHVibGljYXRpb25ZZWFyPjIwMTA8L3B1YmxpY2F0aW9uWWVhcj4KICA8c3ViamVjdHM+CiAgICA8c3ViamVjdCB4bWw6bGFuZz0iZW4iIHN1YmplY3RTY2hlbWU9ImFyWGl2Ij5JbmZvcm1hdGlvbiBUaGVvcnkgKGNzLklUKTwvc3ViamVjdD4KICAgIDxzdWJqZWN0IHhtbDpsYW5nPSJlbiIgc3ViamVjdFNjaGVtZT0iYXJYaXYiPk1hY2hpbmUgTGVhcm5pbmcgKGNzLkxHKTwvc3ViamVjdD4KICAgIDxzdWJqZWN0IHhtbDpsYW5nPSJlbiIgc3ViamVjdFNjaGVtZT0iYXJYaXYiPlN0YXRpc3RpY3MgVGhlb3J5IChtYXRoLlNUKTwvc3ViamVjdD4KICAgIDxzdWJqZWN0IHN1YmplY3RTY2hlbWU9IkZpZWxkcyBvZiBTY2llbmNlIGFuZCBUZWNobm9sb2d5IChGT1MpIj5GT1M6IENvbXB1dGVyIGFuZCBpbmZvcm1hdGlvbiBzY2llbmNlczwvc3ViamVjdD4KICAgIDxzdWJqZWN0IHN1YmplY3RTY2hlbWU9IkZpZWxkcyBvZiBTY2llbmNlIGFuZCBUZWNobm9sb2d5IChGT1MpIj5GT1M6IE1hdGhlbWF0aWNzPC9zdWJqZWN0PgogIDwvc3ViamVjdHM+CiAgPGRhdGVzPgogICAgPGRhdGUgZGF0ZVR5cGU9IlN1Ym1pdHRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2MSI+MjAxMC0wMS0yMFQwMjo1NzoxNVo8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iU3VibWl0dGVkIiBkYXRlSW5mb3JtYXRpb249InYyIj4yMDEwLTAzLTAxVDE4OjQ5OjI0WjwvZGF0ZT4KICAgIDxkYXRlIGRhdGVUeXBlPSJVcGRhdGVkIiBkYXRlSW5mb3JtYXRpb249InYyIj4yMDEwLTAzLTA1VDE5OjU4OjU0WjwvZGF0ZT4KICAgIDxkYXRlIGRhdGVUeXBlPSJTdWJtaXR0ZWQiIGRhdGVJbmZvcm1hdGlvbj0idjMiPjIwMTAtMTAtMjdUMDc6NTg6NDlaPC9kYXRlPgogICAgPGRhdGUgZGF0ZVR5cGU9IlVwZGF0ZWQiIGRhdGVJbmZvcm1hdGlvbj0idjMiPjIwMTAtMTAtMjhUMDA6MDE6MTVaPC9kYXRlPgogICAgPGRhdGUgZGF0ZVR5cGU9IlN1Ym1pdHRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2NCI+MjAxMS0wMS0yN1QxODo1NTowNVo8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iVXBkYXRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2NCI+MjAxMi0wMy0wNlQwMTowMDozMlo8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iQXZhaWxhYmxlIiBkYXRlSW5mb3JtYXRpb249InYxIj4yMDEwLTAxPC9kYXRlPgogIDwvZGF0ZXM+CiAgPHJlc291cmNlVHlwZSByZXNvdXJjZVR5cGVHZW5lcmFsPSJUZXh0Ij5BcnRpY2xlPC9yZXNvdXJjZVR5cGU+CiAgPHJlbGF0ZWRJZGVudGlmaWVycz4KICAgIDxyZWxhdGVkSWRlbnRpZmllciByZWxhdGVkSWRlbnRpZmllclR5cGU9IkRPSSIgcmVsYXRpb25UeXBlPSJJc1ZlcnNpb25PZiI+MTAuMTEwOS9USVQuMjAxMC4yMDk0ODE3PC9yZWxhdGVkSWRlbnRpZmllcj4KICA8L3JlbGF0ZWRJZGVudGlmaWVycz4KICA8dmVyc2lvbj40PC92ZXJzaW9uPgogIDxyaWdodHNMaXN0PgogICAgPHJpZ2h0cyByaWdodHNVUkk9Imh0dHA6Ly9hcnhpdi5vcmcvbGljZW5zZXMvbm9uZXhjbHVzaXZlLWRpc3RyaWIvMS4wLyI+YXJYaXYub3JnIHBlcnBldHVhbCwgbm9uLWV4Y2x1c2l2ZSBsaWNlbnNlPC9yaWdodHM+CiAgPC9yaWdodHNMaXN0PgogIDxkZXNjcmlwdGlvbnM+CiAgICA8ZGVzY3JpcHRpb24gZGVzY3JpcHRpb25UeXBlPSJBYnN0cmFjdCI+QXBwcm94aW1hdGUgbWVzc2FnZSBwYXNzaW5nIGFsZ29yaXRobXMgcHJvdmVkIHRvIGJlIGV4dHJlbWVseSBlZmZlY3RpdmUgaW4gcmVjb25zdHJ1Y3Rpbmcgc3BhcnNlIHNpZ25hbHMgZnJvbSBhIHNtYWxsIG51bWJlciBvZiBpbmNvaGVyZW50IGxpbmVhciBtZWFzdXJlbWVudHMuIEV4dGVuc2l2ZSBudW1lcmljYWwgZXhwZXJpbWVudHMgZnVydGhlciBzaG93ZWQgdGhhdCB0aGVpciBkeW5hbWljcyBpcyBhY2N1cmF0ZWx5IHRyYWNrZWQgYnkgYSBzaW1wbGUgb25lLWRpbWVuc2lvbmFsIGl0ZXJhdGlvbiB0ZXJtZWQgc3RhdGUgZXZvbHV0aW9uLiBJbiB0aGlzIHBhcGVyIHdlIHByb3ZpZGUgdGhlIGZpcnN0IHJpZ29yb3VzIGZvdW5kYXRpb24gdG8gc3RhdGUgZXZvbHV0aW9uLiBXZSBwcm92ZSB0aGF0IGluZGVlZCBpdCBob2xkcyBhc3ltcHRvdGljYWxseSBpbiB0aGUgbGFyZ2Ugc3lzdGVtIGxpbWl0IGZvciBzZW5zaW5nIG1hdHJpY2VzIHdpdGggaW5kZXBlbmRlbnQgYW5kIGlkZW50aWNhbGx5IGRpc3RyaWJ1dGVkIGdhdXNzaWFuIGVudHJpZXMuCiAgV2hpbGUgb3VyIGZvY3VzIGlzIG9uIG1lc3NhZ2UgcGFzc2luZyBhbGdvcml0aG1zIGZvciBjb21wcmVzc2VkIHNlbnNpbmcsIHRoZSBhbmFseXNpcyBleHRlbmRzIGJleW9uZCB0aGlzIHNldHRpbmcsIHRvIGEgZ2VuZXJhbCBjbGFzcyBvZiBhbGdvcml0aG1zIG9uIGRlbnNlIGdyYXBocy4gSW4gdGhpcyBjb250ZXh0LCBzdGF0ZSBldm9sdXRpb24gcGxheXMgdGhlIHJvbGUgdGhhdCBkZW5zaXR5IGV2b2x1dGlvbiBoYXMgZm9yIHNwYXJzZSBncmFwaHMuCiAgVGhlIHByb29mIHRlY2huaXF1ZSBpcyBmdW5kYW1lbnRhbGx5IGRpZmZlcmVudCBmcm9tIHRoZSBzdGFuZGFyZCBhcHByb2FjaCB0byBkZW5zaXR5IGV2b2x1dGlvbiwgaW4gdGhhdCBpdCBjb3BlcyB3aXRoIGxhcmdlIG51bWJlciBvZiBzaG9ydCBsb29wcyBpbiB0aGUgdW5kZXJseWluZyBmYWN0b3IgZ3JhcGguIEl0IHJlbGllcyBpbnN0ZWFkIG9uIGEgY29uZGl0aW9uaW5nIHRlY2huaXF1ZSByZWNlbnRseSBkZXZlbG9wZWQgYnkgRXJ3aW4gQm9sdGhhdXNlbiBpbiB0aGUgY29udGV4dCBvZiBzcGluIGdsYXNzIHRoZW9yeS48L2Rlc2NyaXB0aW9uPgogICAgPGRlc2NyaXB0aW9uIGRlc2NyaXB0aW9uVHlwZT0iT3RoZXIiPjQxIHBhZ2VzPC9kZXNjcmlwdGlvbj4KICA8L2Rlc2NyaXB0aW9ucz4KPC9yZXNvdXJjZT4=","url":"https://arxiv.org/abs/1001.3448","contentUrl":null,"metadataVersion":0,"schemaVersion":"http://datacite.org/schema/kernel-4","source":"mds","isActive":true,"state":"findable","reason":null,"viewCount":0,"viewsOverTime":[],"downloadCount":0,"downloadsOverTime":[],"referenceCount":0,"citationCount":0,"citationsOverTime":[],"partCount":0,"partOfCount":0,"versionCount":0,"versionOfCount":0,"created":"2022-03-15T20:13:37.000Z","registered":"2022-03-15T20:13:38.000Z","published":"2010","updated":"2022-03-15T20:13:38.000Z"},"relationships":{"client":{"data":{"id":"arxiv.content","type":"clients"}},"provider":{"data":{"id":"arxiv","type":"providers"}},"media":{"data":{"id":"10.48550/arxiv.1001.3448","type":"media"}},"references":{"data":[]},"citations":{"data":[]},"parts":{"data":[]},"partOf":{"data":[]},"versions":{"data":[]},"versionOf":{"data":[]}}}}