{"data":{"id":"10.48550/arxiv.math/0605740","type":"dois","attributes":{"doi":"10.48550/arxiv.math/0605740","prefix":"10.48550","suffix":"arxiv.math/0605740","identifiers":[{"identifier":"math/0605740","identifierType":"arXiv"}],"alternateIdentifiers":[{"alternateIdentifierType":"arXiv","alternateIdentifier":"math/0605740"}],"creators":[{"name":"Wainwright, Martin J.","nameType":"Personal","givenName":"Martin J.","familyName":"Wainwright","affiliation":[],"nameIdentifiers":[]}],"titles":[{"title":"Sharp thresholds for high-dimensional and noisy recovery of sparsity"}],"publisher":"arXiv","container":{},"publicationYear":2006,"subjects":[{"lang":"en","subject":"Statistics Theory (math.ST)","subjectScheme":"arXiv"},{"lang":"en","subject":"Information Theory (cs.IT)","subjectScheme":"arXiv"},{"subject":"FOS: Mathematics","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Mathematics","schemeUri":"http://www.oecd.org/science/inno/38235147.pdf","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Computer and information sciences","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Computer and information sciences","schemeUri":"http://www.oecd.org/science/inno/38235147.pdf","subjectScheme":"Fields of Science and Technology (FOS)"}],"contributors":[],"dates":[{"date":"2006-05-30T05:49:04Z","dateType":"Submitted","dateInformation":"v1"},{"date":"2009-12-01T07:29:48Z","dateType":"Updated","dateInformation":"v1"},{"date":"2006-05","dateType":"Available","dateInformation":"v1"},{"date":"2006","dateType":"Issued"}],"language":null,"types":{"ris":"GEN","bibtex":"misc","citeproc":"article","schemaOrg":"CreativeWork","resourceType":"Article","resourceTypeGeneral":"Preprint"},"relatedIdentifiers":[],"relatedItems":[],"sizes":[],"formats":[],"version":"1","rightsList":[{"rights":"Assumed arXiv.org perpetual, non-exclusive license to distribute this article for submissions made before January 2004","rightsUri":"http://arxiv.org/licenses/assumed-1991-2003/"}],"descriptions":[{"description":"The problem of consistently estimating the sparsity pattern of a vector $\\betastar \\in \\real^\\mdim$ based on observations contaminated by noise arises in various contexts, including subset selection in regression, structure estimation in graphical models, sparse approximation, and signal denoising. We analyze the behavior of $\\ell_1$-constrained quadratic programming (QP), also referred to as the Lasso, for recovering the sparsity pattern. Our main result is to establish a sharp relation between the problem dimension $\\mdim$, the number $\\spindex$ of non-zero elements in $\\betastar$, and the number of observations $\\numobs$ that are required for reliable recovery. For a broad class of Gaussian ensembles satisfying mutual incoherence conditions, we establish existence and compute explicit values of thresholds $\\ThreshLow$ and $\\ThreshUp$ with the following properties: for any $ε\u0026gt; 0$, if $\\numobs \u0026gt; 2 (\\ThreshUp + ε) \\log (\\mdim - \\spindex) + \\spindex + 1$, then the Lasso succeeds in recovering the sparsity pattern with probability converging to one for large problems, whereas for $\\numobs \u0026lt; 2 (\\ThreshLow - ε) \\log (\\mdim - \\spindex) + \\spindex + 1$, then the probability of successful recovery converges to zero. For the special case of the uniform Gaussian ensemble, we show that $\\ThreshLow = \\ThreshUp = 1$, so that the threshold is sharp and exactly determined.","descriptionType":"Abstract"},{"description":"Appeared as Technical Report 708, Department of Statistics, UC Berkeley","descriptionType":"Other"}],"geoLocations":[],"fundingReferences":[],"xml":"PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4KPHJlc291cmNlIHhtbG5zPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSIgeHNpOnNjaGVtYUxvY2F0aW9uPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCBodHRwOi8vc2NoZW1hLmRhdGFjaXRlLm9yZy9tZXRhL2tlcm5lbC00LjMvbWV0YWRhdGEueHNkIj4KICA8aWRlbnRpZmllciBpZGVudGlmaWVyVHlwZT0iRE9JIj4xMC40ODU1MC9BUlhJVi5NQVRILzA2MDU3NDA8L2lkZW50aWZpZXI+CiAgPGFsdGVybmF0ZUlkZW50aWZpZXJzPgogICAgPGFsdGVybmF0ZUlkZW50aWZpZXIgYWx0ZXJuYXRlSWRlbnRpZmllclR5cGU9ImFyWGl2Ij5tYXRoLzA2MDU3NDA8L2FsdGVybmF0ZUlkZW50aWZpZXI+CiAgPC9hbHRlcm5hdGVJZGVudGlmaWVycz4KICA8Y3JlYXRvcnM+CiAgICA8Y3JlYXRvcj4KICAgICAgPGNyZWF0b3JOYW1lIG5hbWVUeXBlPSJQZXJzb25hbCI+V2FpbndyaWdodCwgTWFydGluIEouPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5NYXJ0aW4gSi48L2dpdmVuTmFtZT4KICAgICAgPGZhbWlseU5hbWU+V2FpbndyaWdodDwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICA8L2NyZWF0b3JzPgogIDx0aXRsZXM+CiAgICA8dGl0bGU+U2hhcnAgdGhyZXNob2xkcyBmb3IgaGlnaC1kaW1lbnNpb25hbCBhbmQgbm9pc3kgcmVjb3Zlcnkgb2Ygc3BhcnNpdHk8L3RpdGxlPgogIDwvdGl0bGVzPgogIDxwdWJsaXNoZXI+YXJYaXY8L3B1Ymxpc2hlcj4KICA8cHVibGljYXRpb25ZZWFyPjIwMDY8L3B1YmxpY2F0aW9uWWVhcj4KICA8c3ViamVjdHM+CiAgICA8c3ViamVjdCB4bWw6bGFuZz0iZW4iIHN1YmplY3RTY2hlbWU9ImFyWGl2Ij5TdGF0aXN0aWNzIFRoZW9yeSAobWF0aC5TVCk8L3N1YmplY3Q+CiAgICA8c3ViamVjdCB4bWw6bGFuZz0iZW4iIHN1YmplY3RTY2hlbWU9ImFyWGl2Ij5JbmZvcm1hdGlvbiBUaGVvcnkgKGNzLklUKTwvc3ViamVjdD4KICAgIDxzdWJqZWN0IHN1YmplY3RTY2hlbWU9IkZpZWxkcyBvZiBTY2llbmNlIGFuZCBUZWNobm9sb2d5IChGT1MpIj5GT1M6IE1hdGhlbWF0aWNzPC9zdWJqZWN0PgogICAgPHN1YmplY3Qgc3ViamVjdFNjaGVtZT0iRmllbGRzIG9mIFNjaWVuY2UgYW5kIFRlY2hub2xvZ3kgKEZPUykiPkZPUzogQ29tcHV0ZXIgYW5kIGluZm9ybWF0aW9uIHNjaWVuY2VzPC9zdWJqZWN0PgogIDwvc3ViamVjdHM+CiAgPGRhdGVzPgogICAgPGRhdGUgZGF0ZVR5cGU9IlN1Ym1pdHRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2MSI+MjAwNi0wNS0zMFQwNTo0OTowNFo8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iVXBkYXRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2MSI+MjAwOS0xMi0wMVQwNzoyOTo0OFo8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iQXZhaWxhYmxlIiBkYXRlSW5mb3JtYXRpb249InYxIj4yMDA2LTA1PC9kYXRlPgogIDwvZGF0ZXM+CiAgPHJlc291cmNlVHlwZSByZXNvdXJjZVR5cGVHZW5lcmFsPSJQcmVwcmludCI+QXJ0aWNsZTwvcmVzb3VyY2VUeXBlPgogIDx2ZXJzaW9uPjE8L3ZlcnNpb24+CiAgPHJpZ2h0c0xpc3Q+CiAgICA8cmlnaHRzIHJpZ2h0c1VSST0iaHR0cDovL2FyeGl2Lm9yZy9saWNlbnNlcy9hc3N1bWVkLTE5OTEtMjAwMy8iPkFzc3VtZWQgYXJYaXYub3JnIHBlcnBldHVhbCwgbm9uLWV4Y2x1c2l2ZSBsaWNlbnNlIHRvIGRpc3RyaWJ1dGUgdGhpcyBhcnRpY2xlIGZvciBzdWJtaXNzaW9ucyBtYWRlIGJlZm9yZSBKYW51YXJ5IDIwMDQ8L3JpZ2h0cz4KICA8L3JpZ2h0c0xpc3Q+CiAgPGRlc2NyaXB0aW9ucz4KICAgIDxkZXNjcmlwdGlvbiBkZXNjcmlwdGlvblR5cGU9IkFic3RyYWN0Ij5UaGUgcHJvYmxlbSBvZiBjb25zaXN0ZW50bHkgZXN0aW1hdGluZyB0aGUgc3BhcnNpdHkgcGF0dGVybiBvZiBhIHZlY3RvciAkXGJldGFzdGFyIFxpbiBccmVhbF5cbWRpbSQgYmFzZWQgb24gb2JzZXJ2YXRpb25zIGNvbnRhbWluYXRlZCBieSBub2lzZSBhcmlzZXMgaW4gdmFyaW91cyBjb250ZXh0cywgaW5jbHVkaW5nIHN1YnNldCBzZWxlY3Rpb24gaW4gcmVncmVzc2lvbiwgc3RydWN0dXJlIGVzdGltYXRpb24gaW4gZ3JhcGhpY2FsIG1vZGVscywgc3BhcnNlIGFwcHJveGltYXRpb24sIGFuZCBzaWduYWwgZGVub2lzaW5nLiBXZSBhbmFseXplIHRoZSBiZWhhdmlvciBvZiAkXGVsbF8xJC1jb25zdHJhaW5lZCBxdWFkcmF0aWMgcHJvZ3JhbW1pbmcgKFFQKSwgYWxzbyByZWZlcnJlZCB0byBhcyB0aGUgTGFzc28sIGZvciByZWNvdmVyaW5nIHRoZSBzcGFyc2l0eSBwYXR0ZXJuLiBPdXIgbWFpbiByZXN1bHQgaXMgdG8gZXN0YWJsaXNoIGEgc2hhcnAgcmVsYXRpb24gYmV0d2VlbiB0aGUgcHJvYmxlbSBkaW1lbnNpb24gJFxtZGltJCwgdGhlIG51bWJlciAkXHNwaW5kZXgkIG9mIG5vbi16ZXJvIGVsZW1lbnRzIGluICRcYmV0YXN0YXIkLCBhbmQgdGhlIG51bWJlciBvZiBvYnNlcnZhdGlvbnMgJFxudW1vYnMkIHRoYXQgYXJlIHJlcXVpcmVkIGZvciByZWxpYWJsZSByZWNvdmVyeS4gRm9yIGEgYnJvYWQgY2xhc3Mgb2YgR2F1c3NpYW4gZW5zZW1ibGVzIHNhdGlzZnlpbmcgbXV0dWFsIGluY29oZXJlbmNlIGNvbmRpdGlvbnMsIHdlIGVzdGFibGlzaCBleGlzdGVuY2UgYW5kIGNvbXB1dGUgZXhwbGljaXQgdmFsdWVzIG9mIHRocmVzaG9sZHMgJFxUaHJlc2hMb3ckIGFuZCAkXFRocmVzaFVwJCB3aXRoIHRoZSBmb2xsb3dpbmcgcHJvcGVydGllczogZm9yIGFueSAkzrUmZ3Q7IDAkLCBpZiAkXG51bW9icyAmZ3Q7IDIgKFxUaHJlc2hVcCArIM61KSBcbG9nIChcbWRpbSAtIFxzcGluZGV4KSArIFxzcGluZGV4ICsgMSQsIHRoZW4gdGhlIExhc3NvIHN1Y2NlZWRzIGluIHJlY292ZXJpbmcgdGhlIHNwYXJzaXR5IHBhdHRlcm4gd2l0aCBwcm9iYWJpbGl0eSBjb252ZXJnaW5nIHRvIG9uZSBmb3IgbGFyZ2UgcHJvYmxlbXMsIHdoZXJlYXMgZm9yICRcbnVtb2JzICZsdDsgMiAoXFRocmVzaExvdyAtIM61KSBcbG9nIChcbWRpbSAtIFxzcGluZGV4KSArIFxzcGluZGV4ICsgMSQsIHRoZW4gdGhlIHByb2JhYmlsaXR5IG9mIHN1Y2Nlc3NmdWwgcmVjb3ZlcnkgY29udmVyZ2VzIHRvIHplcm8uIEZvciB0aGUgc3BlY2lhbCBjYXNlIG9mIHRoZSB1bmlmb3JtIEdhdXNzaWFuIGVuc2VtYmxlLCB3ZSBzaG93IHRoYXQgJFxUaHJlc2hMb3cgPSBcVGhyZXNoVXAgPSAxJCwgc28gdGhhdCB0aGUgdGhyZXNob2xkIGlzIHNoYXJwIGFuZCBleGFjdGx5IGRldGVybWluZWQuPC9kZXNjcmlwdGlvbj4KICAgIDxkZXNjcmlwdGlvbiBkZXNjcmlwdGlvblR5cGU9Ik90aGVyIj5BcHBlYXJlZCBhcyBUZWNobmljYWwgUmVwb3J0IDcwOCwgRGVwYXJ0bWVudCBvZiBTdGF0aXN0aWNzLCBVQyBCZXJrZWxleTwvZGVzY3JpcHRpb24+CiAgPC9kZXNjcmlwdGlvbnM+CjwvcmVzb3VyY2U+","url":"https://arxiv.org/abs/math/0605740","contentUrl":null,"metadataVersion":0,"schemaVersion":"http://datacite.org/schema/kernel-4","source":"mds","isActive":true,"state":"findable","reason":null,"viewCount":0,"viewsOverTime":[],"downloadCount":0,"downloadsOverTime":[],"referenceCount":0,"citationCount":0,"citationsOverTime":[],"partCount":0,"partOfCount":0,"versionCount":0,"versionOfCount":0,"created":"2022-03-21T23:32:28.000Z","registered":"2022-03-21T23:32:29.000Z","published":"2006","updated":"2022-03-21T23:32:29.000Z"},"relationships":{"client":{"data":{"id":"arxiv.content","type":"clients"}},"provider":{"data":{"id":"arxiv","type":"providers"}},"media":{"data":{"id":"10.48550/arxiv.math/0605740","type":"media"}},"references":{"data":[]},"citations":{"data":[]},"parts":{"data":[]},"partOf":{"data":[]},"versions":{"data":[]},"versionOf":{"data":[]}}}}