{"data":{"id":"10.48550/arxiv.2006.15733","type":"dois","attributes":{"doi":"10.48550/arxiv.2006.15733","prefix":"10.48550","suffix":"arxiv.2006.15733","identifiers":[{"identifier":"2006.15733","identifierType":"arXiv"}],"alternateIdentifiers":[{"alternateIdentifierType":"arXiv","alternateIdentifier":"2006.15733"}],"creators":[{"name":"Luo, Tao","nameType":"Personal","givenName":"Tao","familyName":"Luo","affiliation":[],"nameIdentifiers":[]},{"name":"Yang, Haizhao","nameType":"Personal","givenName":"Haizhao","familyName":"Yang","affiliation":[],"nameIdentifiers":[]}],"titles":[{"title":"Two-Layer Neural Networks for Partial Differential Equations: Optimization and Generalization Theory"}],"publisher":"arXiv","container":{},"publicationYear":2020,"subjects":[{"lang":"en","subject":"Numerical Analysis (math.NA)","subjectScheme":"arXiv"},{"lang":"en","subject":"Machine Learning (cs.LG)","subjectScheme":"arXiv"},{"lang":"en","subject":"Optimization and Control (math.OC)","subjectScheme":"arXiv"},{"subject":"FOS: Mathematics","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Mathematics","schemeUri":"http://www.oecd.org/science/inno/38235147.pdf","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Computer and information sciences","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Computer and information sciences","schemeUri":"http://www.oecd.org/science/inno/38235147.pdf","subjectScheme":"Fields of Science and Technology (FOS)"}],"contributors":[],"dates":[{"date":"2020-06-28T22:24:51Z","dateType":"Submitted","dateInformation":"v1"},{"date":"2020-06-30T00:24:19Z","dateType":"Updated","dateInformation":"v1"},{"date":"2020-12-10T20:43:11Z","dateType":"Submitted","dateInformation":"v2"},{"date":"2020-12-14T01:02:49Z","dateType":"Updated","dateInformation":"v2"},{"date":"2020-06","dateType":"Available","dateInformation":"v1"},{"date":"2020","dateType":"Issued"}],"language":null,"types":{"ris":"GEN","bibtex":"misc","citeproc":"article","schemaOrg":"CreativeWork","resourceType":"Article","resourceTypeGeneral":"Preprint"},"relatedIdentifiers":[],"relatedItems":[],"sizes":[],"formats":[],"version":"2","rightsList":[{"rights":"arXiv.org perpetual, non-exclusive license","rightsUri":"http://arxiv.org/licenses/nonexclusive-distrib/1.0/"}],"descriptions":[{"description":"The problem of solving partial differential equations (PDEs) can be formulated into a least-squares minimization problem, where neural networks are used to parametrize PDE solutions. A global minimizer corresponds to a neural network that solves the given PDE. In this paper, we show that the gradient descent method can identify a global minimizer of the least-squares optimization for solving second-order linear PDEs with two-layer neural networks under the assumption of over-parametrization. We also analyze the generalization error of the least-squares optimization for second-order linear PDEs and two-layer neural networks, when the right-hand-side function of the PDE is in a Barron-type space and the least-squares optimization is regularized with a Barron-type norm, without the over-parametrization assumption.","descriptionType":"Abstract"}],"geoLocations":[],"fundingReferences":[],"xml":"PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4KPHJlc291cmNlIHhtbG5zPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSIgeHNpOnNjaGVtYUxvY2F0aW9uPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCBodHRwOi8vc2NoZW1hLmRhdGFjaXRlLm9yZy9tZXRhL2tlcm5lbC00LjMvbWV0YWRhdGEueHNkIj4KICA8aWRlbnRpZmllciBpZGVudGlmaWVyVHlwZT0iRE9JIj4xMC40ODU1MC9BUlhJVi4yMDA2LjE1NzMzPC9pZGVudGlmaWVyPgogIDxhbHRlcm5hdGVJZGVudGlmaWVycz4KICAgIDxhbHRlcm5hdGVJZGVudGlmaWVyIGFsdGVybmF0ZUlkZW50aWZpZXJUeXBlPSJhclhpdiI+MjAwNi4xNTczMzwvYWx0ZXJuYXRlSWRlbnRpZmllcj4KICA8L2FsdGVybmF0ZUlkZW50aWZpZXJzPgogIDxjcmVhdG9ycz4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5MdW8sIFRhbzwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+VGFvPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPkx1bzwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5ZYW5nLCBIYWl6aGFvPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5IYWl6aGFvPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPllhbmc8L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgPC9jcmVhdG9ycz4KICA8dGl0bGVzPgogICAgPHRpdGxlPlR3by1MYXllciBOZXVyYWwgTmV0d29ya3MgZm9yIFBhcnRpYWwgRGlmZmVyZW50aWFsIEVxdWF0aW9uczogT3B0aW1pemF0aW9uIGFuZCBHZW5lcmFsaXphdGlvbiBUaGVvcnk8L3RpdGxlPgogIDwvdGl0bGVzPgogIDxwdWJsaXNoZXI+YXJYaXY8L3B1Ymxpc2hlcj4KICA8cHVibGljYXRpb25ZZWFyPjIwMjA8L3B1YmxpY2F0aW9uWWVhcj4KICA8c3ViamVjdHM+CiAgICA8c3ViamVjdCB4bWw6bGFuZz0iZW4iIHN1YmplY3RTY2hlbWU9ImFyWGl2Ij5OdW1lcmljYWwgQW5hbHlzaXMgKG1hdGguTkEpPC9zdWJqZWN0PgogICAgPHN1YmplY3QgeG1sOmxhbmc9ImVuIiBzdWJqZWN0U2NoZW1lPSJhclhpdiI+TWFjaGluZSBMZWFybmluZyAoY3MuTEcpPC9zdWJqZWN0PgogICAgPHN1YmplY3QgeG1sOmxhbmc9ImVuIiBzdWJqZWN0U2NoZW1lPSJhclhpdiI+T3B0aW1pemF0aW9uIGFuZCBDb250cm9sIChtYXRoLk9DKTwvc3ViamVjdD4KICAgIDxzdWJqZWN0IHN1YmplY3RTY2hlbWU9IkZpZWxkcyBvZiBTY2llbmNlIGFuZCBUZWNobm9sb2d5IChGT1MpIj5GT1M6IE1hdGhlbWF0aWNzPC9zdWJqZWN0PgogICAgPHN1YmplY3Qgc3ViamVjdFNjaGVtZT0iRmllbGRzIG9mIFNjaWVuY2UgYW5kIFRlY2hub2xvZ3kgKEZPUykiPkZPUzogQ29tcHV0ZXIgYW5kIGluZm9ybWF0aW9uIHNjaWVuY2VzPC9zdWJqZWN0PgogIDwvc3ViamVjdHM+CiAgPGRhdGVzPgogICAgPGRhdGUgZGF0ZVR5cGU9IlN1Ym1pdHRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2MSI+MjAyMC0wNi0yOFQyMjoyNDo1MVo8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iVXBkYXRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2MSI+MjAyMC0wNi0zMFQwMDoyNDoxOVo8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iU3VibWl0dGVkIiBkYXRlSW5mb3JtYXRpb249InYyIj4yMDIwLTEyLTEwVDIwOjQzOjExWjwvZGF0ZT4KICAgIDxkYXRlIGRhdGVUeXBlPSJVcGRhdGVkIiBkYXRlSW5mb3JtYXRpb249InYyIj4yMDIwLTEyLTE0VDAxOjAyOjQ5WjwvZGF0ZT4KICAgIDxkYXRlIGRhdGVUeXBlPSJBdmFpbGFibGUiIGRhdGVJbmZvcm1hdGlvbj0idjEiPjIwMjAtMDY8L2RhdGU+CiAgPC9kYXRlcz4KICA8cmVzb3VyY2VUeXBlIHJlc291cmNlVHlwZUdlbmVyYWw9IlByZXByaW50Ij5BcnRpY2xlPC9yZXNvdXJjZVR5cGU+CiAgPHZlcnNpb24+MjwvdmVyc2lvbj4KICA8cmlnaHRzTGlzdD4KICAgIDxyaWdodHMgcmlnaHRzVVJJPSJodHRwOi8vYXJ4aXYub3JnL2xpY2Vuc2VzL25vbmV4Y2x1c2l2ZS1kaXN0cmliLzEuMC8iPmFyWGl2Lm9yZyBwZXJwZXR1YWwsIG5vbi1leGNsdXNpdmUgbGljZW5zZTwvcmlnaHRzPgogIDwvcmlnaHRzTGlzdD4KICA8ZGVzY3JpcHRpb25zPgogICAgPGRlc2NyaXB0aW9uIGRlc2NyaXB0aW9uVHlwZT0iQWJzdHJhY3QiPlRoZSBwcm9ibGVtIG9mIHNvbHZpbmcgcGFydGlhbCBkaWZmZXJlbnRpYWwgZXF1YXRpb25zIChQREVzKSBjYW4gYmUgZm9ybXVsYXRlZCBpbnRvIGEgbGVhc3Qtc3F1YXJlcyBtaW5pbWl6YXRpb24gcHJvYmxlbSwgd2hlcmUgbmV1cmFsIG5ldHdvcmtzIGFyZSB1c2VkIHRvIHBhcmFtZXRyaXplIFBERSBzb2x1dGlvbnMuIEEgZ2xvYmFsIG1pbmltaXplciBjb3JyZXNwb25kcyB0byBhIG5ldXJhbCBuZXR3b3JrIHRoYXQgc29sdmVzIHRoZSBnaXZlbiBQREUuIEluIHRoaXMgcGFwZXIsIHdlIHNob3cgdGhhdCB0aGUgZ3JhZGllbnQgZGVzY2VudCBtZXRob2QgY2FuIGlkZW50aWZ5IGEgZ2xvYmFsIG1pbmltaXplciBvZiB0aGUgbGVhc3Qtc3F1YXJlcyBvcHRpbWl6YXRpb24gZm9yIHNvbHZpbmcgc2Vjb25kLW9yZGVyIGxpbmVhciBQREVzIHdpdGggdHdvLWxheWVyIG5ldXJhbCBuZXR3b3JrcyB1bmRlciB0aGUgYXNzdW1wdGlvbiBvZiBvdmVyLXBhcmFtZXRyaXphdGlvbi4gV2UgYWxzbyBhbmFseXplIHRoZSBnZW5lcmFsaXphdGlvbiBlcnJvciBvZiB0aGUgbGVhc3Qtc3F1YXJlcyBvcHRpbWl6YXRpb24gZm9yIHNlY29uZC1vcmRlciBsaW5lYXIgUERFcyBhbmQgdHdvLWxheWVyIG5ldXJhbCBuZXR3b3Jrcywgd2hlbiB0aGUgcmlnaHQtaGFuZC1zaWRlIGZ1bmN0aW9uIG9mIHRoZSBQREUgaXMgaW4gYSBCYXJyb24tdHlwZSBzcGFjZSBhbmQgdGhlIGxlYXN0LXNxdWFyZXMgb3B0aW1pemF0aW9uIGlzIHJlZ3VsYXJpemVkIHdpdGggYSBCYXJyb24tdHlwZSBub3JtLCB3aXRob3V0IHRoZSBvdmVyLXBhcmFtZXRyaXphdGlvbiBhc3N1bXB0aW9uLjwvZGVzY3JpcHRpb24+CiAgPC9kZXNjcmlwdGlvbnM+CjwvcmVzb3VyY2U+","url":"https://arxiv.org/abs/2006.15733","contentUrl":null,"metadataVersion":0,"schemaVersion":"http://datacite.org/schema/kernel-4","source":"mds","isActive":true,"state":"findable","reason":null,"viewCount":0,"viewsOverTime":[],"downloadCount":0,"downloadsOverTime":[],"referenceCount":0,"citationCount":0,"citationsOverTime":[],"partCount":0,"partOfCount":0,"versionCount":0,"versionOfCount":0,"created":"2022-02-25T07:44:27.000Z","registered":"2022-02-25T07:44:28.000Z","published":"2020","updated":"2022-02-25T07:44:28.000Z"},"relationships":{"client":{"data":{"id":"arxiv.content","type":"clients"}},"provider":{"data":{"id":"arxiv","type":"providers"}},"media":{"data":{"id":"10.48550/arxiv.2006.15733","type":"media"}},"references":{"data":[]},"citations":{"data":[]},"parts":{"data":[]},"partOf":{"data":[]},"versions":{"data":[]},"versionOf":{"data":[]}}}}