{"data":{"id":"10.48550/arxiv.2202.12598","type":"dois","attributes":{"doi":"10.48550/arxiv.2202.12598","prefix":"10.48550","suffix":"arxiv.2202.12598","identifiers":[{"identifier":"2202.12598","identifierType":"arXiv"}],"alternateIdentifiers":[{"alternateIdentifierType":"arXiv","alternateIdentifier":"2202.12598"}],"creators":[{"name":"Wu, Di","nameType":"Personal","givenName":"Di","familyName":"Wu","affiliation":[],"nameIdentifiers":[]},{"name":"Yang, Jie","nameType":"Personal","givenName":"Jie","familyName":"Yang","affiliation":[],"nameIdentifiers":[]},{"name":"Sawan, Mohamad","nameType":"Personal","givenName":"Mohamad","familyName":"Sawan","affiliation":[],"nameIdentifiers":[]}],"titles":[{"title":"Bridging the Gap Between Patient-specific and Patient-independent Seizure Prediction via Knowledge Distillation"}],"publisher":"arXiv","container":{},"publicationYear":2022,"subjects":[{"lang":"en","subject":"Machine Learning (cs.LG)","subjectScheme":"arXiv"},{"lang":"en","subject":"Artificial Intelligence (cs.AI)","subjectScheme":"arXiv"},{"lang":"en","subject":"Signal Processing (eess.SP)","subjectScheme":"arXiv"},{"subject":"FOS: Computer and information sciences","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Computer and information sciences","schemeUri":"http://www.oecd.org/science/inno/38235147.pdf","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Electrical engineering, electronic engineering, information engineering","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Electrical engineering, electronic engineering, information engineering","schemeUri":"http://www.oecd.org/science/inno/38235147.pdf","subjectScheme":"Fields of Science and Technology (FOS)"}],"contributors":[],"dates":[{"date":"2022-02-25T10:30:29Z","dateType":"Submitted","dateInformation":"v1"},{"date":"2022-02-28T01:16:38Z","dateType":"Updated","dateInformation":"v1"},{"date":"2022-06-13T02:14:34Z","dateType":"Submitted","dateInformation":"v2"},{"date":"2022-06-14T00:21:47Z","dateType":"Updated","dateInformation":"v2"},{"date":"2022-02","dateType":"Available","dateInformation":"v1"},{"date":"2022","dateType":"Issued"}],"language":null,"types":{"ris":"RPRT","bibtex":"article","citeproc":"article-journal","schemaOrg":"ScholarlyArticle","resourceType":"Article","resourceTypeGeneral":"Text"},"relatedIdentifiers":[{"relationType":"IsVersionOf","relatedIdentifier":"10.1088/1741-2552/ac73b3","relatedIdentifierType":"DOI"}],"relatedItems":[],"sizes":[],"formats":[],"version":"2","rightsList":[{"rights":"arXiv.org perpetual, non-exclusive license","rightsUri":"http://arxiv.org/licenses/nonexclusive-distrib/1.0/"}],"descriptions":[{"description":"Objective. Deep neural networks (DNNs) have shown unprecedented success in various brain-machine interface applications such as epileptic seizure prediction. However, existing approaches typically train models in a patient-specific fashion due to the highly personalized characteristics of epileptic signals. Therefore, only a limited number of labeled recordings from each subject can be used for training. As a consequence, current DNN based methods demonstrate poor generalization ability to some extent due to the insufficiency of training data. On the other hand, patient-independent models attempt to utilize more patient data to train a universal model for all patients by pooling patient data together. Despite different techniques applied, results show that patient-independent models perform worse than patient-specific models due to high individual variation across patients. A substantial gap thus exists between patient-specific and patient-independent models. Approach. In this paper, we propose a novel training scheme based on knowledge distillation which makes use of a large amount of data from multiple subjects. It first distills informative features from signals of all available subjects with a pre-trained general model. A patient-specific model can then be obtained with the help of distilled knowledge and additional personalized data. Main results. Four state-of-the-art seizure prediction methods are trained on the Children's Hospital of Boston-MIT sEEG database with our proposed scheme. The resulting accuracy, sensitivity, and false prediction rate show that our proposed training scheme consistently improves the prediction performance of state-of-the-art methods by a large margin. Significance. The proposed training scheme significantly improves the performance of patient-specific seizure predictors and bridges the gap between patient-specific and patient-independent predictors.","descriptionType":"Abstract"}],"geoLocations":[],"fundingReferences":[],"xml":"PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4KPHJlc291cmNlIHhtbG5zPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSIgeHNpOnNjaGVtYUxvY2F0aW9uPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCBodHRwOi8vc2NoZW1hLmRhdGFjaXRlLm9yZy9tZXRhL2tlcm5lbC00LjMvbWV0YWRhdGEueHNkIj4KICA8aWRlbnRpZmllciBpZGVudGlmaWVyVHlwZT0iRE9JIj4xMC40ODU1MC9BUlhJVi4yMjAyLjEyNTk4PC9pZGVudGlmaWVyPgogIDxhbHRlcm5hdGVJZGVudGlmaWVycz4KICAgIDxhbHRlcm5hdGVJZGVudGlmaWVyIGFsdGVybmF0ZUlkZW50aWZpZXJUeXBlPSJhclhpdiI+MjIwMi4xMjU5ODwvYWx0ZXJuYXRlSWRlbnRpZmllcj4KICA8L2FsdGVybmF0ZUlkZW50aWZpZXJzPgogIDxjcmVhdG9ycz4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5XdSwgRGk8L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPkRpPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPld1PC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogICAgPGNyZWF0b3I+CiAgICAgIDxjcmVhdG9yTmFtZSBuYW1lVHlwZT0iUGVyc29uYWwiPllhbmcsIEppZTwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+SmllPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPllhbmc8L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgICA8Y3JlYXRvcj4KICAgICAgPGNyZWF0b3JOYW1lIG5hbWVUeXBlPSJQZXJzb25hbCI+U2F3YW4sIE1vaGFtYWQ8L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPk1vaGFtYWQ8L2dpdmVuTmFtZT4KICAgICAgPGZhbWlseU5hbWU+U2F3YW48L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgPC9jcmVhdG9ycz4KICA8dGl0bGVzPgogICAgPHRpdGxlPkJyaWRnaW5nIHRoZSBHYXAgQmV0d2VlbiBQYXRpZW50LXNwZWNpZmljIGFuZCBQYXRpZW50LWluZGVwZW5kZW50IFNlaXp1cmUgUHJlZGljdGlvbiB2aWEgS25vd2xlZGdlIERpc3RpbGxhdGlvbjwvdGl0bGU+CiAgPC90aXRsZXM+CiAgPHB1Ymxpc2hlcj5hclhpdjwvcHVibGlzaGVyPgogIDxwdWJsaWNhdGlvblllYXI+MjAyMjwvcHVibGljYXRpb25ZZWFyPgogIDxzdWJqZWN0cz4KICAgIDxzdWJqZWN0IHhtbDpsYW5nPSJlbiIgc3ViamVjdFNjaGVtZT0iYXJYaXYiPk1hY2hpbmUgTGVhcm5pbmcgKGNzLkxHKTwvc3ViamVjdD4KICAgIDxzdWJqZWN0IHhtbDpsYW5nPSJlbiIgc3ViamVjdFNjaGVtZT0iYXJYaXYiPkFydGlmaWNpYWwgSW50ZWxsaWdlbmNlIChjcy5BSSk8L3N1YmplY3Q+CiAgICA8c3ViamVjdCB4bWw6bGFuZz0iZW4iIHN1YmplY3RTY2hlbWU9ImFyWGl2Ij5TaWduYWwgUHJvY2Vzc2luZyAoZWVzcy5TUCk8L3N1YmplY3Q+CiAgICA8c3ViamVjdCBzdWJqZWN0U2NoZW1lPSJGaWVsZHMgb2YgU2NpZW5jZSBhbmQgVGVjaG5vbG9neSAoRk9TKSI+Rk9TOiBDb21wdXRlciBhbmQgaW5mb3JtYXRpb24gc2NpZW5jZXM8L3N1YmplY3Q+CiAgICA8c3ViamVjdCBzdWJqZWN0U2NoZW1lPSJGaWVsZHMgb2YgU2NpZW5jZSBhbmQgVGVjaG5vbG9neSAoRk9TKSI+Rk9TOiBFbGVjdHJpY2FsIGVuZ2luZWVyaW5nLCBlbGVjdHJvbmljIGVuZ2luZWVyaW5nLCBpbmZvcm1hdGlvbiBlbmdpbmVlcmluZzwvc3ViamVjdD4KICA8L3N1YmplY3RzPgogIDxkYXRlcz4KICAgIDxkYXRlIGRhdGVUeXBlPSJTdWJtaXR0ZWQiIGRhdGVJbmZvcm1hdGlvbj0idjEiPjIwMjItMDItMjVUMTA6MzA6MjlaPC9kYXRlPgogICAgPGRhdGUgZGF0ZVR5cGU9IlVwZGF0ZWQiIGRhdGVJbmZvcm1hdGlvbj0idjEiPjIwMjItMDItMjhUMDE6MTY6MzhaPC9kYXRlPgogICAgPGRhdGUgZGF0ZVR5cGU9IlN1Ym1pdHRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2MiI+MjAyMi0wNi0xM1QwMjoxNDozNFo8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iVXBkYXRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2MiI+MjAyMi0wNi0xNFQwMDoyMTo0N1o8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iQXZhaWxhYmxlIiBkYXRlSW5mb3JtYXRpb249InYxIj4yMDIyLTAyPC9kYXRlPgogIDwvZGF0ZXM+CiAgPHJlc291cmNlVHlwZSByZXNvdXJjZVR5cGVHZW5lcmFsPSJUZXh0Ij5BcnRpY2xlPC9yZXNvdXJjZVR5cGU+CiAgPHJlbGF0ZWRJZGVudGlmaWVycz4KICAgIDxyZWxhdGVkSWRlbnRpZmllciByZWxhdGVkSWRlbnRpZmllclR5cGU9IkRPSSIgcmVsYXRpb25UeXBlPSJJc1ZlcnNpb25PZiI+MTAuMTA4OC8xNzQxLTI1NTIvYWM3M2IzPC9yZWxhdGVkSWRlbnRpZmllcj4KICA8L3JlbGF0ZWRJZGVudGlmaWVycz4KICA8dmVyc2lvbj4yPC92ZXJzaW9uPgogIDxyaWdodHNMaXN0PgogICAgPHJpZ2h0cyByaWdodHNVUkk9Imh0dHA6Ly9hcnhpdi5vcmcvbGljZW5zZXMvbm9uZXhjbHVzaXZlLWRpc3RyaWIvMS4wLyI+YXJYaXYub3JnIHBlcnBldHVhbCwgbm9uLWV4Y2x1c2l2ZSBsaWNlbnNlPC9yaWdodHM+CiAgPC9yaWdodHNMaXN0PgogIDxkZXNjcmlwdGlvbnM+CiAgICA8ZGVzY3JpcHRpb24gZGVzY3JpcHRpb25UeXBlPSJBYnN0cmFjdCI+T2JqZWN0aXZlLiBEZWVwIG5ldXJhbCBuZXR3b3JrcyAoRE5OcykgaGF2ZSBzaG93biB1bnByZWNlZGVudGVkIHN1Y2Nlc3MgaW4gdmFyaW91cyBicmFpbi1tYWNoaW5lIGludGVyZmFjZSBhcHBsaWNhdGlvbnMgc3VjaCBhcyBlcGlsZXB0aWMgc2VpenVyZSBwcmVkaWN0aW9uLiBIb3dldmVyLCBleGlzdGluZyBhcHByb2FjaGVzIHR5cGljYWxseSB0cmFpbiBtb2RlbHMgaW4gYSBwYXRpZW50LXNwZWNpZmljIGZhc2hpb24gZHVlIHRvIHRoZSBoaWdobHkgcGVyc29uYWxpemVkIGNoYXJhY3RlcmlzdGljcyBvZiBlcGlsZXB0aWMgc2lnbmFscy4gVGhlcmVmb3JlLCBvbmx5IGEgbGltaXRlZCBudW1iZXIgb2YgbGFiZWxlZCByZWNvcmRpbmdzIGZyb20gZWFjaCBzdWJqZWN0IGNhbiBiZSB1c2VkIGZvciB0cmFpbmluZy4gQXMgYSBjb25zZXF1ZW5jZSwgY3VycmVudCBETk4gYmFzZWQgbWV0aG9kcyBkZW1vbnN0cmF0ZSBwb29yIGdlbmVyYWxpemF0aW9uIGFiaWxpdHkgdG8gc29tZSBleHRlbnQgZHVlIHRvIHRoZSBpbnN1ZmZpY2llbmN5IG9mIHRyYWluaW5nIGRhdGEuIE9uIHRoZSBvdGhlciBoYW5kLCBwYXRpZW50LWluZGVwZW5kZW50IG1vZGVscyBhdHRlbXB0IHRvIHV0aWxpemUgbW9yZSBwYXRpZW50IGRhdGEgdG8gdHJhaW4gYSB1bml2ZXJzYWwgbW9kZWwgZm9yIGFsbCBwYXRpZW50cyBieSBwb29saW5nIHBhdGllbnQgZGF0YSB0b2dldGhlci4gRGVzcGl0ZSBkaWZmZXJlbnQgdGVjaG5pcXVlcyBhcHBsaWVkLCByZXN1bHRzIHNob3cgdGhhdCBwYXRpZW50LWluZGVwZW5kZW50IG1vZGVscyBwZXJmb3JtIHdvcnNlIHRoYW4gcGF0aWVudC1zcGVjaWZpYyBtb2RlbHMgZHVlIHRvIGhpZ2ggaW5kaXZpZHVhbCB2YXJpYXRpb24gYWNyb3NzIHBhdGllbnRzLiBBIHN1YnN0YW50aWFsIGdhcCB0aHVzIGV4aXN0cyBiZXR3ZWVuIHBhdGllbnQtc3BlY2lmaWMgYW5kIHBhdGllbnQtaW5kZXBlbmRlbnQgbW9kZWxzLiBBcHByb2FjaC4gSW4gdGhpcyBwYXBlciwgd2UgcHJvcG9zZSBhIG5vdmVsIHRyYWluaW5nIHNjaGVtZSBiYXNlZCBvbiBrbm93bGVkZ2UgZGlzdGlsbGF0aW9uIHdoaWNoIG1ha2VzIHVzZSBvZiBhIGxhcmdlIGFtb3VudCBvZiBkYXRhIGZyb20gbXVsdGlwbGUgc3ViamVjdHMuIEl0IGZpcnN0IGRpc3RpbGxzIGluZm9ybWF0aXZlIGZlYXR1cmVzIGZyb20gc2lnbmFscyBvZiBhbGwgYXZhaWxhYmxlIHN1YmplY3RzIHdpdGggYSBwcmUtdHJhaW5lZCBnZW5lcmFsIG1vZGVsLiBBIHBhdGllbnQtc3BlY2lmaWMgbW9kZWwgY2FuIHRoZW4gYmUgb2J0YWluZWQgd2l0aCB0aGUgaGVscCBvZiBkaXN0aWxsZWQga25vd2xlZGdlIGFuZCBhZGRpdGlvbmFsIHBlcnNvbmFsaXplZCBkYXRhLiBNYWluIHJlc3VsdHMuIEZvdXIgc3RhdGUtb2YtdGhlLWFydCBzZWl6dXJlIHByZWRpY3Rpb24gbWV0aG9kcyBhcmUgdHJhaW5lZCBvbiB0aGUgQ2hpbGRyZW4ncyBIb3NwaXRhbCBvZiBCb3N0b24tTUlUIHNFRUcgZGF0YWJhc2Ugd2l0aCBvdXIgcHJvcG9zZWQgc2NoZW1lLiBUaGUgcmVzdWx0aW5nIGFjY3VyYWN5LCBzZW5zaXRpdml0eSwgYW5kIGZhbHNlIHByZWRpY3Rpb24gcmF0ZSBzaG93IHRoYXQgb3VyIHByb3Bvc2VkIHRyYWluaW5nIHNjaGVtZSBjb25zaXN0ZW50bHkgaW1wcm92ZXMgdGhlIHByZWRpY3Rpb24gcGVyZm9ybWFuY2Ugb2Ygc3RhdGUtb2YtdGhlLWFydCBtZXRob2RzIGJ5IGEgbGFyZ2UgbWFyZ2luLiBTaWduaWZpY2FuY2UuIFRoZSBwcm9wb3NlZCB0cmFpbmluZyBzY2hlbWUgc2lnbmlmaWNhbnRseSBpbXByb3ZlcyB0aGUgcGVyZm9ybWFuY2Ugb2YgcGF0aWVudC1zcGVjaWZpYyBzZWl6dXJlIHByZWRpY3RvcnMgYW5kIGJyaWRnZXMgdGhlIGdhcCBiZXR3ZWVuIHBhdGllbnQtc3BlY2lmaWMgYW5kIHBhdGllbnQtaW5kZXBlbmRlbnQgcHJlZGljdG9ycy48L2Rlc2NyaXB0aW9uPgogIDwvZGVzY3JpcHRpb25zPgo8L3Jlc291cmNlPg==","url":"https://arxiv.org/abs/2202.12598","contentUrl":null,"metadataVersion":1,"schemaVersion":"http://datacite.org/schema/kernel-4","source":"mds","isActive":true,"state":"findable","reason":null,"viewCount":0,"viewsOverTime":[],"downloadCount":0,"downloadsOverTime":[],"referenceCount":0,"citationCount":0,"citationsOverTime":[],"partCount":0,"partOfCount":0,"versionCount":0,"versionOfCount":1,"created":"2022-02-28T02:35:19.000Z","registered":"2022-02-28T02:35:25.000Z","published":"2022","updated":"2022-06-14T02:17:07.000Z"},"relationships":{"client":{"data":{"id":"arxiv.content","type":"clients"}},"provider":{"data":{"id":"arxiv","type":"providers"}},"media":{"data":{"id":"10.48550/arxiv.2202.12598","type":"media"}},"references":{"data":[]},"citations":{"data":[]},"parts":{"data":[]},"partOf":{"data":[]},"versions":{"data":[]},"versionOf":{"data":[{"id":"10.1088/1741-2552/ac73b3","type":"dois"}]}}}}