{"data":{"id":"10.48550/arxiv.2102.06966","type":"dois","attributes":{"doi":"10.48550/arxiv.2102.06966","prefix":"10.48550","suffix":"arxiv.2102.06966","identifiers":[{"identifier":"2102.06966","identifierType":"arXiv"}],"alternateIdentifiers":[{"alternateIdentifierType":"arXiv","alternateIdentifier":"2102.06966"}],"creators":[{"name":"Baranwal, Aseem","nameType":"Personal","givenName":"Aseem","familyName":"Baranwal","affiliation":[],"nameIdentifiers":[]},{"name":"Fountoulakis, Kimon","nameType":"Personal","givenName":"Kimon","familyName":"Fountoulakis","affiliation":[],"nameIdentifiers":[]},{"name":"Jagannath, Aukosh","nameType":"Personal","givenName":"Aukosh","familyName":"Jagannath","affiliation":[],"nameIdentifiers":[]}],"titles":[{"title":"Graph Convolution for Semi-Supervised Classification: Improved Linear Separability and Out-of-Distribution Generalization"}],"publisher":"arXiv","container":{},"publicationYear":2021,"subjects":[{"lang":"en","subject":"Machine Learning (cs.LG)","subjectScheme":"arXiv"},{"lang":"en","subject":"Machine Learning (stat.ML)","subjectScheme":"arXiv"},{"subject":"FOS: Computer and information sciences","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Computer and information sciences","schemeUri":"http://www.oecd.org/science/inno/38235147.pdf","subjectScheme":"Fields of Science and Technology (FOS)"}],"contributors":[],"dates":[{"date":"2021-02-13T17:46:57Z","dateType":"Submitted","dateInformation":"v1"},{"date":"2021-02-16T01:12:43Z","dateType":"Updated","dateInformation":"v1"},{"date":"2021-02-22T20:17:15Z","dateType":"Submitted","dateInformation":"v2"},{"date":"2021-02-24T01:02:24Z","dateType":"Updated","dateInformation":"v2"},{"date":"2021-07-07T09:32:50Z","dateType":"Submitted","dateInformation":"v3"},{"date":"2021-07-08T00:13:48Z","dateType":"Updated","dateInformation":"v3"},{"date":"2022-02-04T06:46:58Z","dateType":"Submitted","dateInformation":"v4"},{"date":"2022-02-07T01:08:52Z","dateType":"Updated","dateInformation":"v4"},{"date":"2021-02","dateType":"Available","dateInformation":"v1"},{"date":"2021","dateType":"Issued"}],"language":null,"types":{"ris":"GEN","bibtex":"misc","citeproc":"article","schemaOrg":"CreativeWork","resourceType":"Article","resourceTypeGeneral":"Preprint"},"relatedIdentifiers":[],"relatedItems":[],"sizes":[],"formats":[],"version":"4","rightsList":[{"rights":"arXiv.org perpetual, non-exclusive license","rightsUri":"http://arxiv.org/licenses/nonexclusive-distrib/1.0/"}],"descriptions":[{"description":"Recently there has been increased interest in semi-supervised classification in the presence of graphical information. A new class of learning models has emerged that relies, at its most basic level, on classifying the data after first applying a graph convolution. To understand the merits of this approach, we study the classification of a mixture of Gaussians, where the data corresponds to the node attributes of a stochastic block model. We show that graph convolution extends the regime in which the data is linearly separable by a factor of roughly $1/\\sqrt{D}$, where $D$ is the expected degree of a node, as compared to the mixture model data on its own. Furthermore, we find that the linear classifier obtained by minimizing the cross-entropy loss after the graph convolution generalizes to out-of-distribution data where the unseen data can have different intra- and inter-class edge probabilities from the training data.","descriptionType":"Abstract"},{"description":"30 pages, 9 figures, 2 tables","descriptionType":"Other"}],"geoLocations":[],"fundingReferences":[],"xml":"PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4KPHJlc291cmNlIHhtbG5zPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSIgeHNpOnNjaGVtYUxvY2F0aW9uPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCBodHRwOi8vc2NoZW1hLmRhdGFjaXRlLm9yZy9tZXRhL2tlcm5lbC00LjMvbWV0YWRhdGEueHNkIj4KICA8aWRlbnRpZmllciBpZGVudGlmaWVyVHlwZT0iRE9JIj4xMC40ODU1MC9BUlhJVi4yMTAyLjA2OTY2PC9pZGVudGlmaWVyPgogIDxhbHRlcm5hdGVJZGVudGlmaWVycz4KICAgIDxhbHRlcm5hdGVJZGVudGlmaWVyIGFsdGVybmF0ZUlkZW50aWZpZXJUeXBlPSJhclhpdiI+MjEwMi4wNjk2NjwvYWx0ZXJuYXRlSWRlbnRpZmllcj4KICA8L2FsdGVybmF0ZUlkZW50aWZpZXJzPgogIDxjcmVhdG9ycz4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5CYXJhbndhbCwgQXNlZW08L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPkFzZWVtPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPkJhcmFud2FsPC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogICAgPGNyZWF0b3I+CiAgICAgIDxjcmVhdG9yTmFtZSBuYW1lVHlwZT0iUGVyc29uYWwiPkZvdW50b3VsYWtpcywgS2ltb248L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPktpbW9uPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPkZvdW50b3VsYWtpczwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5KYWdhbm5hdGgsIEF1a29zaDwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+QXVrb3NoPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPkphZ2FubmF0aDwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICA8L2NyZWF0b3JzPgogIDx0aXRsZXM+CiAgICA8dGl0bGU+R3JhcGggQ29udm9sdXRpb24gZm9yIFNlbWktU3VwZXJ2aXNlZCBDbGFzc2lmaWNhdGlvbjogSW1wcm92ZWQgTGluZWFyIFNlcGFyYWJpbGl0eSBhbmQgT3V0LW9mLURpc3RyaWJ1dGlvbiBHZW5lcmFsaXphdGlvbjwvdGl0bGU+CiAgPC90aXRsZXM+CiAgPHB1Ymxpc2hlcj5hclhpdjwvcHVibGlzaGVyPgogIDxwdWJsaWNhdGlvblllYXI+MjAyMTwvcHVibGljYXRpb25ZZWFyPgogIDxzdWJqZWN0cz4KICAgIDxzdWJqZWN0IHhtbDpsYW5nPSJlbiIgc3ViamVjdFNjaGVtZT0iYXJYaXYiPk1hY2hpbmUgTGVhcm5pbmcgKGNzLkxHKTwvc3ViamVjdD4KICAgIDxzdWJqZWN0IHhtbDpsYW5nPSJlbiIgc3ViamVjdFNjaGVtZT0iYXJYaXYiPk1hY2hpbmUgTGVhcm5pbmcgKHN0YXQuTUwpPC9zdWJqZWN0PgogICAgPHN1YmplY3Qgc3ViamVjdFNjaGVtZT0iRmllbGRzIG9mIFNjaWVuY2UgYW5kIFRlY2hub2xvZ3kgKEZPUykiPkZPUzogQ29tcHV0ZXIgYW5kIGluZm9ybWF0aW9uIHNjaWVuY2VzPC9zdWJqZWN0PgogIDwvc3ViamVjdHM+CiAgPGRhdGVzPgogICAgPGRhdGUgZGF0ZVR5cGU9IlN1Ym1pdHRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2MSI+MjAyMS0wMi0xM1QxNzo0Njo1N1o8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iVXBkYXRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2MSI+MjAyMS0wMi0xNlQwMToxMjo0M1o8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iU3VibWl0dGVkIiBkYXRlSW5mb3JtYXRpb249InYyIj4yMDIxLTAyLTIyVDIwOjE3OjE1WjwvZGF0ZT4KICAgIDxkYXRlIGRhdGVUeXBlPSJVcGRhdGVkIiBkYXRlSW5mb3JtYXRpb249InYyIj4yMDIxLTAyLTI0VDAxOjAyOjI0WjwvZGF0ZT4KICAgIDxkYXRlIGRhdGVUeXBlPSJTdWJtaXR0ZWQiIGRhdGVJbmZvcm1hdGlvbj0idjMiPjIwMjEtMDctMDdUMDk6MzI6NTBaPC9kYXRlPgogICAgPGRhdGUgZGF0ZVR5cGU9IlVwZGF0ZWQiIGRhdGVJbmZvcm1hdGlvbj0idjMiPjIwMjEtMDctMDhUMDA6MTM6NDhaPC9kYXRlPgogICAgPGRhdGUgZGF0ZVR5cGU9IlN1Ym1pdHRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2NCI+MjAyMi0wMi0wNFQwNjo0Njo1OFo8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iVXBkYXRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2NCI+MjAyMi0wMi0wN1QwMTowODo1Mlo8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iQXZhaWxhYmxlIiBkYXRlSW5mb3JtYXRpb249InYxIj4yMDIxLTAyPC9kYXRlPgogIDwvZGF0ZXM+CiAgPHJlc291cmNlVHlwZSByZXNvdXJjZVR5cGVHZW5lcmFsPSJQcmVwcmludCI+QXJ0aWNsZTwvcmVzb3VyY2VUeXBlPgogIDx2ZXJzaW9uPjQ8L3ZlcnNpb24+CiAgPHJpZ2h0c0xpc3Q+CiAgICA8cmlnaHRzIHJpZ2h0c1VSST0iaHR0cDovL2FyeGl2Lm9yZy9saWNlbnNlcy9ub25leGNsdXNpdmUtZGlzdHJpYi8xLjAvIj5hclhpdi5vcmcgcGVycGV0dWFsLCBub24tZXhjbHVzaXZlIGxpY2Vuc2U8L3JpZ2h0cz4KICA8L3JpZ2h0c0xpc3Q+CiAgPGRlc2NyaXB0aW9ucz4KICAgIDxkZXNjcmlwdGlvbiBkZXNjcmlwdGlvblR5cGU9IkFic3RyYWN0Ij5SZWNlbnRseSB0aGVyZSBoYXMgYmVlbiBpbmNyZWFzZWQgaW50ZXJlc3QgaW4gc2VtaS1zdXBlcnZpc2VkIGNsYXNzaWZpY2F0aW9uIGluIHRoZSBwcmVzZW5jZSBvZiBncmFwaGljYWwgaW5mb3JtYXRpb24uIEEgbmV3IGNsYXNzIG9mIGxlYXJuaW5nIG1vZGVscyBoYXMgZW1lcmdlZCB0aGF0IHJlbGllcywgYXQgaXRzIG1vc3QgYmFzaWMgbGV2ZWwsIG9uIGNsYXNzaWZ5aW5nIHRoZSBkYXRhIGFmdGVyIGZpcnN0IGFwcGx5aW5nIGEgZ3JhcGggY29udm9sdXRpb24uIFRvIHVuZGVyc3RhbmQgdGhlIG1lcml0cyBvZiB0aGlzIGFwcHJvYWNoLCB3ZSBzdHVkeSB0aGUgY2xhc3NpZmljYXRpb24gb2YgYSBtaXh0dXJlIG9mIEdhdXNzaWFucywgd2hlcmUgdGhlIGRhdGEgY29ycmVzcG9uZHMgdG8gdGhlIG5vZGUgYXR0cmlidXRlcyBvZiBhIHN0b2NoYXN0aWMgYmxvY2sgbW9kZWwuIFdlIHNob3cgdGhhdCBncmFwaCBjb252b2x1dGlvbiBleHRlbmRzIHRoZSByZWdpbWUgaW4gd2hpY2ggdGhlIGRhdGEgaXMgbGluZWFybHkgc2VwYXJhYmxlIGJ5IGEgZmFjdG9yIG9mIHJvdWdobHkgJDEvXHNxcnR7RH0kLCB3aGVyZSAkRCQgaXMgdGhlIGV4cGVjdGVkIGRlZ3JlZSBvZiBhIG5vZGUsIGFzIGNvbXBhcmVkIHRvIHRoZSBtaXh0dXJlIG1vZGVsIGRhdGEgb24gaXRzIG93bi4gRnVydGhlcm1vcmUsIHdlIGZpbmQgdGhhdCB0aGUgbGluZWFyIGNsYXNzaWZpZXIgb2J0YWluZWQgYnkgbWluaW1pemluZyB0aGUgY3Jvc3MtZW50cm9weSBsb3NzIGFmdGVyIHRoZSBncmFwaCBjb252b2x1dGlvbiBnZW5lcmFsaXplcyB0byBvdXQtb2YtZGlzdHJpYnV0aW9uIGRhdGEgd2hlcmUgdGhlIHVuc2VlbiBkYXRhIGNhbiBoYXZlIGRpZmZlcmVudCBpbnRyYS0gYW5kIGludGVyLWNsYXNzIGVkZ2UgcHJvYmFiaWxpdGllcyBmcm9tIHRoZSB0cmFpbmluZyBkYXRhLjwvZGVzY3JpcHRpb24+CiAgICA8ZGVzY3JpcHRpb24gZGVzY3JpcHRpb25UeXBlPSJPdGhlciI+MzAgcGFnZXMsIDkgZmlndXJlcywgMiB0YWJsZXM8L2Rlc2NyaXB0aW9uPgogIDwvZGVzY3JpcHRpb25zPgo8L3Jlc291cmNlPg==","url":"https://arxiv.org/abs/2102.06966","contentUrl":null,"metadataVersion":0,"schemaVersion":"http://datacite.org/schema/kernel-4","source":"mds","isActive":true,"state":"findable","reason":null,"viewCount":0,"viewsOverTime":[],"downloadCount":0,"downloadsOverTime":[],"referenceCount":0,"citationCount":0,"citationsOverTime":[],"partCount":0,"partOfCount":0,"versionCount":0,"versionOfCount":0,"created":"2022-02-23T18:19:10.000Z","registered":"2022-02-23T18:19:11.000Z","published":"2021","updated":"2022-02-23T18:19:11.000Z"},"relationships":{"client":{"data":{"id":"arxiv.content","type":"clients"}},"provider":{"data":{"id":"arxiv","type":"providers"}},"media":{"data":{"id":"10.48550/arxiv.2102.06966","type":"media"}},"references":{"data":[]},"citations":{"data":[]},"parts":{"data":[]},"partOf":{"data":[]},"versions":{"data":[]},"versionOf":{"data":[]}}}}