{"data":{"id":"10.48550/arxiv.2212.13285","type":"dois","attributes":{"doi":"10.48550/arxiv.2212.13285","prefix":"10.48550","suffix":"arxiv.2212.13285","identifiers":[{"identifier":"2212.13285","identifierType":"arXiv"}],"alternateIdentifiers":[{"alternateIdentifierType":"arXiv","alternateIdentifier":"2212.13285"}],"creators":[{"name":"Wang, Binxu","nameType":"Personal","givenName":"Binxu","familyName":"Wang","affiliation":[],"nameIdentifiers":[]},{"name":"Ponce, Carlos R.","nameType":"Personal","givenName":"Carlos R.","familyName":"Ponce","affiliation":[],"nameIdentifiers":[]}],"titles":[{"title":"On the Level Sets and Invariance of Neural Tuning Landscapes"}],"publisher":"arXiv","container":{},"publicationYear":2022,"subjects":[{"lang":"en","subject":"Neurons and Cognition (q-bio.NC)","subjectScheme":"arXiv"},{"lang":"en","subject":"Artificial Intelligence (cs.AI)","subjectScheme":"arXiv"},{"lang":"en","subject":"Computational Geometry (cs.CG)","subjectScheme":"arXiv"},{"lang":"en","subject":"Computer Vision and Pattern Recognition (cs.CV)","subjectScheme":"arXiv"},{"lang":"en","subject":"Neural and Evolutionary Computing (cs.NE)","subjectScheme":"arXiv"},{"subject":"FOS: Biological sciences","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Biological sciences","schemeUri":"http://www.oecd.org/science/inno/38235147.pdf","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Computer and information sciences","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Computer and information sciences","schemeUri":"http://www.oecd.org/science/inno/38235147.pdf","subjectScheme":"Fields of Science and Technology (FOS)"}],"contributors":[],"dates":[{"date":"2022-12-26T19:53:29Z","dateType":"Submitted","dateInformation":"v1"},{"date":"2022-12-29T01:00:51Z","dateType":"Updated","dateInformation":"v1"},{"date":"2022-12","dateType":"Available","dateInformation":"v1"},{"date":"2022","dateType":"Issued"}],"language":null,"types":{"ris":"GEN","bibtex":"misc","citeproc":"article","schemaOrg":"CreativeWork","resourceType":"Article","resourceTypeGeneral":"Preprint"},"relatedIdentifiers":[],"relatedItems":[],"sizes":[],"formats":[],"version":"1","rightsList":[{"rights":"Creative Commons Attribution 4.0 International","rightsUri":"https://creativecommons.org/licenses/by/4.0/legalcode","schemeUri":"https://spdx.org/licenses/","rightsIdentifier":"cc-by-4.0","rightsIdentifierScheme":"SPDX"}],"descriptions":[{"description":"Visual representations can be defined as the activations of neuronal populations in response to images. The activation of a neuron as a function over all image space has been described as a \"tuning landscape\". As a function over a high-dimensional space, what is the structure of this landscape? In this study, we characterize tuning landscapes through the lens of level sets and Morse theory. A recent study measured the in vivo two-dimensional tuning maps of neurons in different brain regions. Here, we developed a statistically reliable signature for these maps based on the change of topology in level sets. We found this topological signature changed progressively throughout the cortical hierarchy, with similar trends found for units in convolutional neural networks (CNNs). Further, we analyzed the geometry of level sets on the tuning landscapes of CNN units. We advanced the hypothesis that higher-order units can be locally regarded as isotropic radial basis functions, but not globally. This shows the power of level sets as a conceptual tool to understand neuronal activations over image space.","descriptionType":"Abstract"},{"description":"24 pages, 13 figures. Published in NeurIPS 2022 Workshop on Symmetry and Geometry in Neural Representations, and PMLR volume 197","descriptionType":"Other"}],"geoLocations":[],"fundingReferences":[],"xml":"PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4KPHJlc291cmNlIHhtbG5zPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSIgeHNpOnNjaGVtYUxvY2F0aW9uPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCBodHRwOi8vc2NoZW1hLmRhdGFjaXRlLm9yZy9tZXRhL2tlcm5lbC00LjMvbWV0YWRhdGEueHNkIj4KICA8aWRlbnRpZmllciBpZGVudGlmaWVyVHlwZT0iRE9JIj4xMC40ODU1MC9BUlhJVi4yMjEyLjEzMjg1PC9pZGVudGlmaWVyPgogIDxhbHRlcm5hdGVJZGVudGlmaWVycz4KICAgIDxhbHRlcm5hdGVJZGVudGlmaWVyIGFsdGVybmF0ZUlkZW50aWZpZXJUeXBlPSJhclhpdiI+MjIxMi4xMzI4NTwvYWx0ZXJuYXRlSWRlbnRpZmllcj4KICA8L2FsdGVybmF0ZUlkZW50aWZpZXJzPgogIDxjcmVhdG9ycz4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5XYW5nLCBCaW54dTwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+QmlueHU8L2dpdmVuTmFtZT4KICAgICAgPGZhbWlseU5hbWU+V2FuZzwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5Qb25jZSwgQ2FybG9zIFIuPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5DYXJsb3MgUi48L2dpdmVuTmFtZT4KICAgICAgPGZhbWlseU5hbWU+UG9uY2U8L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgPC9jcmVhdG9ycz4KICA8dGl0bGVzPgogICAgPHRpdGxlPk9uIHRoZSBMZXZlbCBTZXRzIGFuZCBJbnZhcmlhbmNlIG9mIE5ldXJhbCBUdW5pbmcgTGFuZHNjYXBlczwvdGl0bGU+CiAgPC90aXRsZXM+CiAgPHB1Ymxpc2hlcj5hclhpdjwvcHVibGlzaGVyPgogIDxwdWJsaWNhdGlvblllYXI+MjAyMjwvcHVibGljYXRpb25ZZWFyPgogIDxzdWJqZWN0cz4KICAgIDxzdWJqZWN0IHhtbDpsYW5nPSJlbiIgc3ViamVjdFNjaGVtZT0iYXJYaXYiPk5ldXJvbnMgYW5kIENvZ25pdGlvbiAocS1iaW8uTkMpPC9zdWJqZWN0PgogICAgPHN1YmplY3QgeG1sOmxhbmc9ImVuIiBzdWJqZWN0U2NoZW1lPSJhclhpdiI+QXJ0aWZpY2lhbCBJbnRlbGxpZ2VuY2UgKGNzLkFJKTwvc3ViamVjdD4KICAgIDxzdWJqZWN0IHhtbDpsYW5nPSJlbiIgc3ViamVjdFNjaGVtZT0iYXJYaXYiPkNvbXB1dGF0aW9uYWwgR2VvbWV0cnkgKGNzLkNHKTwvc3ViamVjdD4KICAgIDxzdWJqZWN0IHhtbDpsYW5nPSJlbiIgc3ViamVjdFNjaGVtZT0iYXJYaXYiPkNvbXB1dGVyIFZpc2lvbiBhbmQgUGF0dGVybiBSZWNvZ25pdGlvbiAoY3MuQ1YpPC9zdWJqZWN0PgogICAgPHN1YmplY3QgeG1sOmxhbmc9ImVuIiBzdWJqZWN0U2NoZW1lPSJhclhpdiI+TmV1cmFsIGFuZCBFdm9sdXRpb25hcnkgQ29tcHV0aW5nIChjcy5ORSk8L3N1YmplY3Q+CiAgICA8c3ViamVjdCBzdWJqZWN0U2NoZW1lPSJGaWVsZHMgb2YgU2NpZW5jZSBhbmQgVGVjaG5vbG9neSAoRk9TKSI+Rk9TOiBCaW9sb2dpY2FsIHNjaWVuY2VzPC9zdWJqZWN0PgogICAgPHN1YmplY3Qgc3ViamVjdFNjaGVtZT0iRmllbGRzIG9mIFNjaWVuY2UgYW5kIFRlY2hub2xvZ3kgKEZPUykiPkZPUzogQ29tcHV0ZXIgYW5kIGluZm9ybWF0aW9uIHNjaWVuY2VzPC9zdWJqZWN0PgogIDwvc3ViamVjdHM+CiAgPGRhdGVzPgogICAgPGRhdGUgZGF0ZVR5cGU9IlN1Ym1pdHRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2MSI+MjAyMi0xMi0yNlQxOTo1MzoyOVo8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iVXBkYXRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2MSI+MjAyMi0xMi0yOVQwMTowMDo1MVo8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iQXZhaWxhYmxlIiBkYXRlSW5mb3JtYXRpb249InYxIj4yMDIyLTEyPC9kYXRlPgogIDwvZGF0ZXM+CiAgPHJlc291cmNlVHlwZSByZXNvdXJjZVR5cGVHZW5lcmFsPSJQcmVwcmludCI+QXJ0aWNsZTwvcmVzb3VyY2VUeXBlPgogIDx2ZXJzaW9uPjE8L3ZlcnNpb24+CiAgPHJpZ2h0c0xpc3Q+CiAgICA8cmlnaHRzIHJpZ2h0c1VSST0iaHR0cDovL2NyZWF0aXZlY29tbW9ucy5vcmcvbGljZW5zZXMvYnkvNC4wLyIgcmlnaHRzSWRlbnRpZmllclNjaGVtZT0iU1BEWCIgcmlnaHRzSWRlbnRpZmllcj0iQ0MtQlktNC4wIj5DcmVhdGl2ZSBDb21tb25zIEF0dHJpYnV0aW9uIDQuMCBJbnRlcm5hdGlvbmFsPC9yaWdodHM+CiAgPC9yaWdodHNMaXN0PgogIDxkZXNjcmlwdGlvbnM+CiAgICA8ZGVzY3JpcHRpb24gZGVzY3JpcHRpb25UeXBlPSJBYnN0cmFjdCI+VmlzdWFsIHJlcHJlc2VudGF0aW9ucyBjYW4gYmUgZGVmaW5lZCBhcyB0aGUgYWN0aXZhdGlvbnMgb2YgbmV1cm9uYWwgcG9wdWxhdGlvbnMgaW4gcmVzcG9uc2UgdG8gaW1hZ2VzLiBUaGUgYWN0aXZhdGlvbiBvZiBhIG5ldXJvbiBhcyBhIGZ1bmN0aW9uIG92ZXIgYWxsIGltYWdlIHNwYWNlIGhhcyBiZWVuIGRlc2NyaWJlZCBhcyBhICJ0dW5pbmcgbGFuZHNjYXBlIi4gQXMgYSBmdW5jdGlvbiBvdmVyIGEgaGlnaC1kaW1lbnNpb25hbCBzcGFjZSwgd2hhdCBpcyB0aGUgc3RydWN0dXJlIG9mIHRoaXMgbGFuZHNjYXBlPyBJbiB0aGlzIHN0dWR5LCB3ZSBjaGFyYWN0ZXJpemUgdHVuaW5nIGxhbmRzY2FwZXMgdGhyb3VnaCB0aGUgbGVucyBvZiBsZXZlbCBzZXRzIGFuZCBNb3JzZSB0aGVvcnkuIEEgcmVjZW50IHN0dWR5IG1lYXN1cmVkIHRoZSBpbiB2aXZvIHR3by1kaW1lbnNpb25hbCB0dW5pbmcgbWFwcyBvZiBuZXVyb25zIGluIGRpZmZlcmVudCBicmFpbiByZWdpb25zLiBIZXJlLCB3ZSBkZXZlbG9wZWQgYSBzdGF0aXN0aWNhbGx5IHJlbGlhYmxlIHNpZ25hdHVyZSBmb3IgdGhlc2UgbWFwcyBiYXNlZCBvbiB0aGUgY2hhbmdlIG9mIHRvcG9sb2d5IGluIGxldmVsIHNldHMuIFdlIGZvdW5kIHRoaXMgdG9wb2xvZ2ljYWwgc2lnbmF0dXJlIGNoYW5nZWQgcHJvZ3Jlc3NpdmVseSB0aHJvdWdob3V0IHRoZSBjb3J0aWNhbCBoaWVyYXJjaHksIHdpdGggc2ltaWxhciB0cmVuZHMgZm91bmQgZm9yIHVuaXRzIGluIGNvbnZvbHV0aW9uYWwgbmV1cmFsIG5ldHdvcmtzIChDTk5zKS4gRnVydGhlciwgd2UgYW5hbHl6ZWQgdGhlIGdlb21ldHJ5IG9mIGxldmVsIHNldHMgb24gdGhlIHR1bmluZyBsYW5kc2NhcGVzIG9mIENOTiB1bml0cy4gV2UgYWR2YW5jZWQgdGhlIGh5cG90aGVzaXMgdGhhdCBoaWdoZXItb3JkZXIgdW5pdHMgY2FuIGJlIGxvY2FsbHkgcmVnYXJkZWQgYXMgaXNvdHJvcGljIHJhZGlhbCBiYXNpcyBmdW5jdGlvbnMsIGJ1dCBub3QgZ2xvYmFsbHkuIFRoaXMgc2hvd3MgdGhlIHBvd2VyIG9mIGxldmVsIHNldHMgYXMgYSBjb25jZXB0dWFsIHRvb2wgdG8gdW5kZXJzdGFuZCBuZXVyb25hbCBhY3RpdmF0aW9ucyBvdmVyIGltYWdlIHNwYWNlLjwvZGVzY3JpcHRpb24+CiAgICA8ZGVzY3JpcHRpb24gZGVzY3JpcHRpb25UeXBlPSJPdGhlciI+MjQgcGFnZXMsIDEzIGZpZ3VyZXMuIFB1Ymxpc2hlZCBpbiBOZXVySVBTIDIwMjIgV29ya3Nob3Agb24gU3ltbWV0cnkgYW5kIEdlb21ldHJ5IGluIE5ldXJhbCBSZXByZXNlbnRhdGlvbnMsIGFuZCBQTUxSIHZvbHVtZSAxOTc8L2Rlc2NyaXB0aW9uPgogIDwvZGVzY3JpcHRpb25zPgo8L3Jlc291cmNlPg==","url":"https://arxiv.org/abs/2212.13285","contentUrl":null,"metadataVersion":0,"schemaVersion":"http://datacite.org/schema/kernel-4","source":"mds","isActive":true,"state":"findable","reason":null,"viewCount":0,"viewsOverTime":[],"downloadCount":0,"downloadsOverTime":[],"referenceCount":0,"citationCount":0,"citationsOverTime":[],"partCount":0,"partOfCount":0,"versionCount":0,"versionOfCount":0,"created":"2022-12-29T01:47:25.000Z","registered":"2022-12-29T01:47:26.000Z","published":"2022","updated":"2023-02-23T23:07:10.000Z"},"relationships":{"client":{"data":{"id":"arxiv.content","type":"clients"}},"provider":{"data":{"id":"arxiv","type":"providers"}},"media":{"data":{"id":"10.48550/arxiv.2212.13285","type":"media"}},"references":{"data":[]},"citations":{"data":[]},"parts":{"data":[]},"partOf":{"data":[]},"versions":{"data":[]},"versionOf":{"data":[]}}}}