{"data":{"id":"10.48550/arxiv.1802.04865","type":"dois","attributes":{"doi":"10.48550/arxiv.1802.04865","prefix":"10.48550","suffix":"arxiv.1802.04865","identifiers":[{"identifier":"1802.04865","identifierType":"arXiv"}],"alternateIdentifiers":[{"alternateIdentifierType":"arXiv","alternateIdentifier":"1802.04865"}],"creators":[{"name":"DeVries, Terrance","nameType":"Personal","givenName":"Terrance","familyName":"DeVries","affiliation":[],"nameIdentifiers":[]},{"name":"Taylor, Graham W.","nameType":"Personal","givenName":"Graham W.","familyName":"Taylor","affiliation":[],"nameIdentifiers":[]}],"titles":[{"title":"Learning Confidence for Out-of-Distribution Detection in Neural Networks"}],"publisher":"arXiv","container":{},"publicationYear":2018,"subjects":[{"lang":"en","subject":"Machine Learning (stat.ML)","subjectScheme":"arXiv"},{"lang":"en","subject":"Machine Learning (cs.LG)","subjectScheme":"arXiv"},{"subject":"FOS: Computer and information sciences","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Computer and information sciences","schemeUri":"http://www.oecd.org/science/inno/38235147.pdf","subjectScheme":"Fields of Science and Technology (FOS)"}],"contributors":[],"dates":[{"date":"2018-02-13T21:31:36Z","dateType":"Submitted","dateInformation":"v1"},{"date":"2018-02-15T01:02:03Z","dateType":"Updated","dateInformation":"v1"},{"date":"2018-02","dateType":"Available","dateInformation":"v1"},{"date":"2018","dateType":"Issued"}],"language":null,"types":{"ris":"GEN","bibtex":"misc","citeproc":"article","schemaOrg":"CreativeWork","resourceType":"Article","resourceTypeGeneral":"Preprint"},"relatedIdentifiers":[],"relatedItems":[],"sizes":[],"formats":[],"version":"1","rightsList":[{"rights":"arXiv.org perpetual, non-exclusive license","rightsUri":"http://arxiv.org/licenses/nonexclusive-distrib/1.0/"}],"descriptions":[{"description":"Modern neural networks are very powerful predictive models, but they are often incapable of recognizing when their predictions may be wrong. Closely related to this is the task of out-of-distribution detection, where a network must determine whether or not an input is outside of the set on which it is expected to safely perform. To jointly address these issues, we propose a method of learning confidence estimates for neural networks that is simple to implement and produces intuitively interpretable outputs. We demonstrate that on the task of out-of-distribution detection, our technique surpasses recently proposed techniques which construct confidence based on the network's output distribution, without requiring any additional labels or access to out-of-distribution examples. Additionally, we address the problem of calibrating out-of-distribution detectors, where we demonstrate that misclassified in-distribution examples can be used as a proxy for out-of-distribution examples.","descriptionType":"Abstract"}],"geoLocations":[],"fundingReferences":[],"xml":"PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4KPHJlc291cmNlIHhtbG5zPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSIgeHNpOnNjaGVtYUxvY2F0aW9uPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCBodHRwOi8vc2NoZW1hLmRhdGFjaXRlLm9yZy9tZXRhL2tlcm5lbC00LjMvbWV0YWRhdGEueHNkIj4KICA8aWRlbnRpZmllciBpZGVudGlmaWVyVHlwZT0iRE9JIj4xMC40ODU1MC9BUlhJVi4xODAyLjA0ODY1PC9pZGVudGlmaWVyPgogIDxhbHRlcm5hdGVJZGVudGlmaWVycz4KICAgIDxhbHRlcm5hdGVJZGVudGlmaWVyIGFsdGVybmF0ZUlkZW50aWZpZXJUeXBlPSJhclhpdiI+MTgwMi4wNDg2NTwvYWx0ZXJuYXRlSWRlbnRpZmllcj4KICA8L2FsdGVybmF0ZUlkZW50aWZpZXJzPgogIDxjcmVhdG9ycz4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5EZVZyaWVzLCBUZXJyYW5jZTwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+VGVycmFuY2U8L2dpdmVuTmFtZT4KICAgICAgPGZhbWlseU5hbWU+RGVWcmllczwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5UYXlsb3IsIEdyYWhhbSBXLjwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+R3JhaGFtIFcuPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPlRheWxvcjwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICA8L2NyZWF0b3JzPgogIDx0aXRsZXM+CiAgICA8dGl0bGU+TGVhcm5pbmcgQ29uZmlkZW5jZSBmb3IgT3V0LW9mLURpc3RyaWJ1dGlvbiBEZXRlY3Rpb24gaW4gTmV1cmFsIE5ldHdvcmtzPC90aXRsZT4KICA8L3RpdGxlcz4KICA8cHVibGlzaGVyPmFyWGl2PC9wdWJsaXNoZXI+CiAgPHB1YmxpY2F0aW9uWWVhcj4yMDE4PC9wdWJsaWNhdGlvblllYXI+CiAgPHN1YmplY3RzPgogICAgPHN1YmplY3QgeG1sOmxhbmc9ImVuIiBzdWJqZWN0U2NoZW1lPSJhclhpdiI+TWFjaGluZSBMZWFybmluZyAoc3RhdC5NTCk8L3N1YmplY3Q+CiAgICA8c3ViamVjdCB4bWw6bGFuZz0iZW4iIHN1YmplY3RTY2hlbWU9ImFyWGl2Ij5NYWNoaW5lIExlYXJuaW5nIChjcy5MRyk8L3N1YmplY3Q+CiAgICA8c3ViamVjdCBzdWJqZWN0U2NoZW1lPSJGaWVsZHMgb2YgU2NpZW5jZSBhbmQgVGVjaG5vbG9neSAoRk9TKSI+Rk9TOiBDb21wdXRlciBhbmQgaW5mb3JtYXRpb24gc2NpZW5jZXM8L3N1YmplY3Q+CiAgPC9zdWJqZWN0cz4KICA8ZGF0ZXM+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iU3VibWl0dGVkIiBkYXRlSW5mb3JtYXRpb249InYxIj4yMDE4LTAyLTEzVDIxOjMxOjM2WjwvZGF0ZT4KICAgIDxkYXRlIGRhdGVUeXBlPSJVcGRhdGVkIiBkYXRlSW5mb3JtYXRpb249InYxIj4yMDE4LTAyLTE1VDAxOjAyOjAzWjwvZGF0ZT4KICAgIDxkYXRlIGRhdGVUeXBlPSJBdmFpbGFibGUiIGRhdGVJbmZvcm1hdGlvbj0idjEiPjIwMTgtMDI8L2RhdGU+CiAgPC9kYXRlcz4KICA8cmVzb3VyY2VUeXBlIHJlc291cmNlVHlwZUdlbmVyYWw9IlByZXByaW50Ij5BcnRpY2xlPC9yZXNvdXJjZVR5cGU+CiAgPHZlcnNpb24+MTwvdmVyc2lvbj4KICA8cmlnaHRzTGlzdD4KICAgIDxyaWdodHMgcmlnaHRzVVJJPSJodHRwOi8vYXJ4aXYub3JnL2xpY2Vuc2VzL25vbmV4Y2x1c2l2ZS1kaXN0cmliLzEuMC8iPmFyWGl2Lm9yZyBwZXJwZXR1YWwsIG5vbi1leGNsdXNpdmUgbGljZW5zZTwvcmlnaHRzPgogIDwvcmlnaHRzTGlzdD4KICA8ZGVzY3JpcHRpb25zPgogICAgPGRlc2NyaXB0aW9uIGRlc2NyaXB0aW9uVHlwZT0iQWJzdHJhY3QiPk1vZGVybiBuZXVyYWwgbmV0d29ya3MgYXJlIHZlcnkgcG93ZXJmdWwgcHJlZGljdGl2ZSBtb2RlbHMsIGJ1dCB0aGV5IGFyZSBvZnRlbiBpbmNhcGFibGUgb2YgcmVjb2duaXppbmcgd2hlbiB0aGVpciBwcmVkaWN0aW9ucyBtYXkgYmUgd3JvbmcuIENsb3NlbHkgcmVsYXRlZCB0byB0aGlzIGlzIHRoZSB0YXNrIG9mIG91dC1vZi1kaXN0cmlidXRpb24gZGV0ZWN0aW9uLCB3aGVyZSBhIG5ldHdvcmsgbXVzdCBkZXRlcm1pbmUgd2hldGhlciBvciBub3QgYW4gaW5wdXQgaXMgb3V0c2lkZSBvZiB0aGUgc2V0IG9uIHdoaWNoIGl0IGlzIGV4cGVjdGVkIHRvIHNhZmVseSBwZXJmb3JtLiBUbyBqb2ludGx5IGFkZHJlc3MgdGhlc2UgaXNzdWVzLCB3ZSBwcm9wb3NlIGEgbWV0aG9kIG9mIGxlYXJuaW5nIGNvbmZpZGVuY2UgZXN0aW1hdGVzIGZvciBuZXVyYWwgbmV0d29ya3MgdGhhdCBpcyBzaW1wbGUgdG8gaW1wbGVtZW50IGFuZCBwcm9kdWNlcyBpbnR1aXRpdmVseSBpbnRlcnByZXRhYmxlIG91dHB1dHMuIFdlIGRlbW9uc3RyYXRlIHRoYXQgb24gdGhlIHRhc2sgb2Ygb3V0LW9mLWRpc3RyaWJ1dGlvbiBkZXRlY3Rpb24sIG91ciB0ZWNobmlxdWUgc3VycGFzc2VzIHJlY2VudGx5IHByb3Bvc2VkIHRlY2huaXF1ZXMgd2hpY2ggY29uc3RydWN0IGNvbmZpZGVuY2UgYmFzZWQgb24gdGhlIG5ldHdvcmsncyBvdXRwdXQgZGlzdHJpYnV0aW9uLCB3aXRob3V0IHJlcXVpcmluZyBhbnkgYWRkaXRpb25hbCBsYWJlbHMgb3IgYWNjZXNzIHRvIG91dC1vZi1kaXN0cmlidXRpb24gZXhhbXBsZXMuIEFkZGl0aW9uYWxseSwgd2UgYWRkcmVzcyB0aGUgcHJvYmxlbSBvZiBjYWxpYnJhdGluZyBvdXQtb2YtZGlzdHJpYnV0aW9uIGRldGVjdG9ycywgd2hlcmUgd2UgZGVtb25zdHJhdGUgdGhhdCBtaXNjbGFzc2lmaWVkIGluLWRpc3RyaWJ1dGlvbiBleGFtcGxlcyBjYW4gYmUgdXNlZCBhcyBhIHByb3h5IGZvciBvdXQtb2YtZGlzdHJpYnV0aW9uIGV4YW1wbGVzLjwvZGVzY3JpcHRpb24+CiAgPC9kZXNjcmlwdGlvbnM+CjwvcmVzb3VyY2U+","url":"https://arxiv.org/abs/1802.04865","contentUrl":null,"metadataVersion":0,"schemaVersion":"http://datacite.org/schema/kernel-4","source":"mds","isActive":true,"state":"findable","reason":null,"viewCount":0,"viewsOverTime":[],"downloadCount":0,"downloadsOverTime":[],"referenceCount":0,"citationCount":0,"citationsOverTime":[],"partCount":0,"partOfCount":0,"versionCount":0,"versionOfCount":0,"created":"2022-03-02T18:39:04.000Z","registered":"2022-03-02T18:39:05.000Z","published":"2018","updated":"2022-03-02T18:39:05.000Z"},"relationships":{"client":{"data":{"id":"arxiv.content","type":"clients"}},"provider":{"data":{"id":"arxiv","type":"providers"}},"media":{"data":{"id":"10.48550/arxiv.1802.04865","type":"media"}},"references":{"data":[]},"citations":{"data":[]},"parts":{"data":[]},"partOf":{"data":[]},"versions":{"data":[]},"versionOf":{"data":[]}}}}