{"data":{"id":"10.48550/arxiv.1911.00105","type":"dois","attributes":{"doi":"10.48550/arxiv.1911.00105","prefix":"10.48550","suffix":"arxiv.1911.00105","identifiers":[{"identifier":"1911.00105","identifierType":"arXiv"}],"alternateIdentifiers":[{"alternateIdentifierType":"arXiv","alternateIdentifier":"1911.00105"}],"creators":[{"name":"Lu, Qing","nameType":"Personal","givenName":"Qing","familyName":"Lu","affiliation":[],"nameIdentifiers":[]},{"name":"Jiang, Weiwen","nameType":"Personal","givenName":"Weiwen","familyName":"Jiang","affiliation":[],"nameIdentifiers":[]},{"name":"Xu, Xiaowei","nameType":"Personal","givenName":"Xiaowei","familyName":"Xu","affiliation":[],"nameIdentifiers":[]},{"name":"Shi, Yiyu","nameType":"Personal","givenName":"Yiyu","familyName":"Shi","affiliation":[],"nameIdentifiers":[]},{"name":"Hu, Jingtong","nameType":"Personal","givenName":"Jingtong","familyName":"Hu","affiliation":[],"nameIdentifiers":[]}],"titles":[{"title":"On Neural Architecture Search for Resource-Constrained Hardware Platforms"}],"publisher":"arXiv","container":{},"publicationYear":2019,"subjects":[{"lang":"en","subject":"Machine Learning (cs.LG)","subjectScheme":"arXiv"},{"lang":"en","subject":"Neural and Evolutionary Computing (cs.NE)","subjectScheme":"arXiv"},{"lang":"en","subject":"Signal Processing (eess.SP)","subjectScheme":"arXiv"},{"subject":"FOS: Computer and information sciences","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Computer and information sciences","schemeUri":"http://www.oecd.org/science/inno/38235147.pdf","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Electrical engineering, electronic engineering, information engineering","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Electrical engineering, electronic engineering, information engineering","schemeUri":"http://www.oecd.org/science/inno/38235147.pdf","subjectScheme":"Fields of Science and Technology (FOS)"}],"contributors":[],"dates":[{"date":"2019-10-31T21:02:23Z","dateType":"Submitted","dateInformation":"v1"},{"date":"2019-11-04T01:03:07Z","dateType":"Updated","dateInformation":"v1"},{"date":"2019-11","dateType":"Available","dateInformation":"v1"},{"date":"2019","dateType":"Issued"}],"language":null,"types":{"ris":"GEN","bibtex":"misc","citeproc":"article","schemaOrg":"CreativeWork","resourceType":"Article","resourceTypeGeneral":"Preprint"},"relatedIdentifiers":[],"relatedItems":[],"sizes":[],"formats":[],"version":"1","rightsList":[{"rights":"arXiv.org perpetual, non-exclusive license","rightsUri":"http://arxiv.org/licenses/nonexclusive-distrib/1.0/"}],"descriptions":[{"description":"In the recent past, the success of Neural Architecture Search (NAS) has enabled researchers to broadly explore the design space using learning-based methods. Apart from finding better neural network architectures, the idea of automation has also inspired to improve their implementations on hardware. While some practices of hardware machine-learning automation have achieved remarkable performance, the traditional design concept is still followed: a network architecture is first structured with excellent test accuracy, and then compressed and optimized to fit into a target platform. Such a design flow will easily lead to inferior local-optimal solutions. To address this problem, we propose a new framework to jointly explore the space of neural architecture, hardware implementation, and quantization. Our objective is to find a quantized architecture with the highest accuracy that is implementable on given hardware specifications. We employ FPGAs to implement and test our designs with limited loop-up tables (LUTs) and required throughput. Compared to the separate design/searching methods, our framework has demonstrated much better performance under strict specifications and generated designs of higher accuracy by 18\\% to 68\\% in the task of classifying CIFAR10 images. With 30,000 LUTs, a light-weight design is found to achieve 82.98\\% accuracy and 1293 images/second throughput, compared to which, under the same constraints, the traditional method even fails to find a valid solution.","descriptionType":"Abstract"},{"description":"8 pages, ICCAD 2019","descriptionType":"Other"}],"geoLocations":[],"fundingReferences":[],"xml":"PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4KPHJlc291cmNlIHhtbG5zPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSIgeHNpOnNjaGVtYUxvY2F0aW9uPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCBodHRwOi8vc2NoZW1hLmRhdGFjaXRlLm9yZy9tZXRhL2tlcm5lbC00LjMvbWV0YWRhdGEueHNkIj4KICA8aWRlbnRpZmllciBpZGVudGlmaWVyVHlwZT0iRE9JIj4xMC40ODU1MC9BUlhJVi4xOTExLjAwMTA1PC9pZGVudGlmaWVyPgogIDxhbHRlcm5hdGVJZGVudGlmaWVycz4KICAgIDxhbHRlcm5hdGVJZGVudGlmaWVyIGFsdGVybmF0ZUlkZW50aWZpZXJUeXBlPSJhclhpdiI+MTkxMS4wMDEwNTwvYWx0ZXJuYXRlSWRlbnRpZmllcj4KICA8L2FsdGVybmF0ZUlkZW50aWZpZXJzPgogIDxjcmVhdG9ycz4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5MdSwgUWluZzwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+UWluZzwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5MdTwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5KaWFuZywgV2Vpd2VuPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5XZWl3ZW48L2dpdmVuTmFtZT4KICAgICAgPGZhbWlseU5hbWU+Smlhbmc8L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgICA8Y3JlYXRvcj4KICAgICAgPGNyZWF0b3JOYW1lIG5hbWVUeXBlPSJQZXJzb25hbCI+WHUsIFhpYW93ZWk8L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPlhpYW93ZWk8L2dpdmVuTmFtZT4KICAgICAgPGZhbWlseU5hbWU+WHU8L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgICA8Y3JlYXRvcj4KICAgICAgPGNyZWF0b3JOYW1lIG5hbWVUeXBlPSJQZXJzb25hbCI+U2hpLCBZaXl1PC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5ZaXl1PC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPlNoaTwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5IdSwgSmluZ3Rvbmc8L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPkppbmd0b25nPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPkh1PC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogIDwvY3JlYXRvcnM+CiAgPHRpdGxlcz4KICAgIDx0aXRsZT5PbiBOZXVyYWwgQXJjaGl0ZWN0dXJlIFNlYXJjaCBmb3IgUmVzb3VyY2UtQ29uc3RyYWluZWQgSGFyZHdhcmUgUGxhdGZvcm1zPC90aXRsZT4KICA8L3RpdGxlcz4KICA8cHVibGlzaGVyPmFyWGl2PC9wdWJsaXNoZXI+CiAgPHB1YmxpY2F0aW9uWWVhcj4yMDE5PC9wdWJsaWNhdGlvblllYXI+CiAgPHN1YmplY3RzPgogICAgPHN1YmplY3QgeG1sOmxhbmc9ImVuIiBzdWJqZWN0U2NoZW1lPSJhclhpdiI+TWFjaGluZSBMZWFybmluZyAoY3MuTEcpPC9zdWJqZWN0PgogICAgPHN1YmplY3QgeG1sOmxhbmc9ImVuIiBzdWJqZWN0U2NoZW1lPSJhclhpdiI+TmV1cmFsIGFuZCBFdm9sdXRpb25hcnkgQ29tcHV0aW5nIChjcy5ORSk8L3N1YmplY3Q+CiAgICA8c3ViamVjdCB4bWw6bGFuZz0iZW4iIHN1YmplY3RTY2hlbWU9ImFyWGl2Ij5TaWduYWwgUHJvY2Vzc2luZyAoZWVzcy5TUCk8L3N1YmplY3Q+CiAgICA8c3ViamVjdCBzdWJqZWN0U2NoZW1lPSJGaWVsZHMgb2YgU2NpZW5jZSBhbmQgVGVjaG5vbG9neSAoRk9TKSI+Rk9TOiBDb21wdXRlciBhbmQgaW5mb3JtYXRpb24gc2NpZW5jZXM8L3N1YmplY3Q+CiAgICA8c3ViamVjdCBzdWJqZWN0U2NoZW1lPSJGaWVsZHMgb2YgU2NpZW5jZSBhbmQgVGVjaG5vbG9neSAoRk9TKSI+Rk9TOiBFbGVjdHJpY2FsIGVuZ2luZWVyaW5nLCBlbGVjdHJvbmljIGVuZ2luZWVyaW5nLCBpbmZvcm1hdGlvbiBlbmdpbmVlcmluZzwvc3ViamVjdD4KICA8L3N1YmplY3RzPgogIDxkYXRlcz4KICAgIDxkYXRlIGRhdGVUeXBlPSJTdWJtaXR0ZWQiIGRhdGVJbmZvcm1hdGlvbj0idjEiPjIwMTktMTAtMzFUMjE6MDI6MjNaPC9kYXRlPgogICAgPGRhdGUgZGF0ZVR5cGU9IlVwZGF0ZWQiIGRhdGVJbmZvcm1hdGlvbj0idjEiPjIwMTktMTEtMDRUMDE6MDM6MDdaPC9kYXRlPgogICAgPGRhdGUgZGF0ZVR5cGU9IkF2YWlsYWJsZSIgZGF0ZUluZm9ybWF0aW9uPSJ2MSI+MjAxOS0xMTwvZGF0ZT4KICA8L2RhdGVzPgogIDxyZXNvdXJjZVR5cGUgcmVzb3VyY2VUeXBlR2VuZXJhbD0iUHJlcHJpbnQiPkFydGljbGU8L3Jlc291cmNlVHlwZT4KICA8dmVyc2lvbj4xPC92ZXJzaW9uPgogIDxyaWdodHNMaXN0PgogICAgPHJpZ2h0cyByaWdodHNVUkk9Imh0dHA6Ly9hcnhpdi5vcmcvbGljZW5zZXMvbm9uZXhjbHVzaXZlLWRpc3RyaWIvMS4wLyI+YXJYaXYub3JnIHBlcnBldHVhbCwgbm9uLWV4Y2x1c2l2ZSBsaWNlbnNlPC9yaWdodHM+CiAgPC9yaWdodHNMaXN0PgogIDxkZXNjcmlwdGlvbnM+CiAgICA8ZGVzY3JpcHRpb24gZGVzY3JpcHRpb25UeXBlPSJBYnN0cmFjdCI+SW4gdGhlIHJlY2VudCBwYXN0LCB0aGUgc3VjY2VzcyBvZiBOZXVyYWwgQXJjaGl0ZWN0dXJlIFNlYXJjaCAoTkFTKSBoYXMgZW5hYmxlZCByZXNlYXJjaGVycyB0byBicm9hZGx5IGV4cGxvcmUgdGhlIGRlc2lnbiBzcGFjZSB1c2luZyBsZWFybmluZy1iYXNlZCBtZXRob2RzLiBBcGFydCBmcm9tIGZpbmRpbmcgYmV0dGVyIG5ldXJhbCBuZXR3b3JrIGFyY2hpdGVjdHVyZXMsIHRoZSBpZGVhIG9mIGF1dG9tYXRpb24gaGFzIGFsc28gaW5zcGlyZWQgdG8gaW1wcm92ZSB0aGVpciBpbXBsZW1lbnRhdGlvbnMgb24gaGFyZHdhcmUuIFdoaWxlIHNvbWUgcHJhY3RpY2VzIG9mIGhhcmR3YXJlIG1hY2hpbmUtbGVhcm5pbmcgYXV0b21hdGlvbiBoYXZlIGFjaGlldmVkIHJlbWFya2FibGUgcGVyZm9ybWFuY2UsIHRoZSB0cmFkaXRpb25hbCBkZXNpZ24gY29uY2VwdCBpcyBzdGlsbCBmb2xsb3dlZDogYSBuZXR3b3JrIGFyY2hpdGVjdHVyZSBpcyBmaXJzdCBzdHJ1Y3R1cmVkIHdpdGggZXhjZWxsZW50IHRlc3QgYWNjdXJhY3ksIGFuZCB0aGVuIGNvbXByZXNzZWQgYW5kIG9wdGltaXplZCB0byBmaXQgaW50byBhIHRhcmdldCBwbGF0Zm9ybS4gU3VjaCBhIGRlc2lnbiBmbG93IHdpbGwgZWFzaWx5IGxlYWQgdG8gaW5mZXJpb3IgbG9jYWwtb3B0aW1hbCBzb2x1dGlvbnMuIFRvIGFkZHJlc3MgdGhpcyBwcm9ibGVtLCB3ZSBwcm9wb3NlIGEgbmV3IGZyYW1ld29yayB0byBqb2ludGx5IGV4cGxvcmUgdGhlIHNwYWNlIG9mIG5ldXJhbCBhcmNoaXRlY3R1cmUsIGhhcmR3YXJlIGltcGxlbWVudGF0aW9uLCBhbmQgcXVhbnRpemF0aW9uLiBPdXIgb2JqZWN0aXZlIGlzIHRvIGZpbmQgYSBxdWFudGl6ZWQgYXJjaGl0ZWN0dXJlIHdpdGggdGhlIGhpZ2hlc3QgYWNjdXJhY3kgdGhhdCBpcyBpbXBsZW1lbnRhYmxlIG9uIGdpdmVuIGhhcmR3YXJlIHNwZWNpZmljYXRpb25zLiBXZSBlbXBsb3kgRlBHQXMgdG8gaW1wbGVtZW50IGFuZCB0ZXN0IG91ciBkZXNpZ25zIHdpdGggbGltaXRlZCBsb29wLXVwIHRhYmxlcyAoTFVUcykgYW5kIHJlcXVpcmVkIHRocm91Z2hwdXQuIENvbXBhcmVkIHRvIHRoZSBzZXBhcmF0ZSBkZXNpZ24vc2VhcmNoaW5nIG1ldGhvZHMsIG91ciBmcmFtZXdvcmsgaGFzIGRlbW9uc3RyYXRlZCBtdWNoIGJldHRlciBwZXJmb3JtYW5jZSB1bmRlciBzdHJpY3Qgc3BlY2lmaWNhdGlvbnMgYW5kIGdlbmVyYXRlZCBkZXNpZ25zIG9mIGhpZ2hlciBhY2N1cmFjeSBieSAxOFwlIHRvIDY4XCUgaW4gdGhlIHRhc2sgb2YgY2xhc3NpZnlpbmcgQ0lGQVIxMCBpbWFnZXMuIFdpdGggMzAsMDAwIExVVHMsIGEgbGlnaHQtd2VpZ2h0IGRlc2lnbiBpcyBmb3VuZCB0byBhY2hpZXZlIDgyLjk4XCUgYWNjdXJhY3kgYW5kIDEyOTMgaW1hZ2VzL3NlY29uZCB0aHJvdWdocHV0LCBjb21wYXJlZCB0byB3aGljaCwgdW5kZXIgdGhlIHNhbWUgY29uc3RyYWludHMsIHRoZSB0cmFkaXRpb25hbCBtZXRob2QgZXZlbiBmYWlscyB0byBmaW5kIGEgdmFsaWQgc29sdXRpb24uPC9kZXNjcmlwdGlvbj4KICAgIDxkZXNjcmlwdGlvbiBkZXNjcmlwdGlvblR5cGU9Ik90aGVyIj44IHBhZ2VzLCBJQ0NBRCAyMDE5PC9kZXNjcmlwdGlvbj4KICA8L2Rlc2NyaXB0aW9ucz4KPC9yZXNvdXJjZT4=","url":"https://arxiv.org/abs/1911.00105","contentUrl":null,"metadataVersion":0,"schemaVersion":"http://datacite.org/schema/kernel-4","source":"mds","isActive":true,"state":"findable","reason":null,"viewCount":0,"viewsOverTime":[],"downloadCount":0,"downloadsOverTime":[],"referenceCount":0,"citationCount":0,"citationsOverTime":[],"partCount":0,"partOfCount":0,"versionCount":0,"versionOfCount":0,"created":"2022-02-26T19:11:55.000Z","registered":"2022-02-26T19:11:56.000Z","published":"2019","updated":"2022-02-26T19:11:56.000Z"},"relationships":{"client":{"data":{"id":"arxiv.content","type":"clients"}},"provider":{"data":{"id":"arxiv","type":"providers"}},"media":{"data":{"id":"10.48550/arxiv.1911.00105","type":"media"}},"references":{"data":[]},"citations":{"data":[]},"parts":{"data":[]},"partOf":{"data":[]},"versions":{"data":[]},"versionOf":{"data":[]}}}}