{"data":{"id":"10.48550/arxiv.1808.09187","type":"dois","attributes":{"doi":"10.48550/arxiv.1808.09187","prefix":"10.48550","suffix":"arxiv.1808.09187","identifiers":[{"identifier":"1808.09187","identifierType":"arXiv"}],"alternateIdentifiers":[{"alternateIdentifierType":"arXiv","alternateIdentifier":"1808.09187"}],"creators":[{"name":"Wu, Bowen","nameType":"Personal","givenName":"Bowen","familyName":"Wu","affiliation":[],"nameIdentifiers":[]},{"name":"Jiang, Nan","nameType":"Personal","givenName":"Nan","familyName":"Jiang","affiliation":[],"nameIdentifiers":[]},{"name":"Gao, Zhifeng","nameType":"Personal","givenName":"Zhifeng","familyName":"Gao","affiliation":[],"nameIdentifiers":[]},{"name":"Li, Mengyuan","nameType":"Personal","givenName":"Mengyuan","familyName":"Li","affiliation":[],"nameIdentifiers":[]},{"name":"Wang, Zongsheng","nameType":"Personal","givenName":"Zongsheng","familyName":"Wang","affiliation":[],"nameIdentifiers":[]},{"name":"Li, Suke","nameType":"Personal","givenName":"Suke","familyName":"Li","affiliation":[],"nameIdentifiers":[]},{"name":"Feng, Qihang","nameType":"Personal","givenName":"Qihang","familyName":"Feng","affiliation":[],"nameIdentifiers":[]},{"name":"Rong, Wenge","nameType":"Personal","givenName":"Wenge","familyName":"Rong","affiliation":[],"nameIdentifiers":[]},{"name":"Wang, Baoxun","nameType":"Personal","givenName":"Baoxun","familyName":"Wang","affiliation":[],"nameIdentifiers":[]}],"titles":[{"title":"Why Do Neural Response Generation Models Prefer Universal Replies?"}],"publisher":"arXiv","container":{},"publicationYear":2018,"subjects":[{"lang":"en","subject":"Computation and Language (cs.CL)","subjectScheme":"arXiv"},{"subject":"FOS: Computer and information sciences","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Computer and information sciences","schemeUri":"http://www.oecd.org/science/inno/38235147.pdf","subjectScheme":"Fields of Science and Technology (FOS)"}],"contributors":[],"dates":[{"date":"2018-08-28T09:11:49Z","dateType":"Submitted","dateInformation":"v1"},{"date":"2018-08-29T00:07:40Z","dateType":"Updated","dateInformation":"v1"},{"date":"2019-12-11T08:31:23Z","dateType":"Submitted","dateInformation":"v2"},{"date":"2019-12-12T01:08:58Z","dateType":"Updated","dateInformation":"v2"},{"date":"2018-08","dateType":"Available","dateInformation":"v1"},{"date":"2018","dateType":"Issued"}],"language":null,"types":{"ris":"GEN","bibtex":"misc","citeproc":"article","schemaOrg":"CreativeWork","resourceType":"Article","resourceTypeGeneral":"Preprint"},"relatedIdentifiers":[],"relatedItems":[],"sizes":[],"formats":[],"version":"2","rightsList":[{"rights":"arXiv.org perpetual, non-exclusive license","rightsUri":"http://arxiv.org/licenses/nonexclusive-distrib/1.0/"}],"descriptions":[{"description":"Recent advances in sequence-to-sequence learning reveal a purely data-driven approach to the response generation task. Despite its diverse applications, existing neural models are prone to producing short and generic replies, making it infeasible to tackle open-domain challenges. In this research, we analyze this critical issue in light of the model's optimization goal and the specific characteristics of the human-to-human dialog corpus. By decomposing the black box into parts, a detailed analysis of the probability limit was conducted to reveal the reason behind these universal replies. Based on these analyses, we propose a max-margin ranking regularization term to avoid the models leaning to these replies. Finally, empirical experiments on case studies and benchmarks with several metrics validate this approach.","descriptionType":"Abstract"},{"description":"Preprint of the paper presented to the AAAI 2020 Workshop on Interactive and Conversational Recommendation Systems (WICRS)","descriptionType":"Other"}],"geoLocations":[],"fundingReferences":[],"xml":"PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4KPHJlc291cmNlIHhtbG5zPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSIgeHNpOnNjaGVtYUxvY2F0aW9uPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCBodHRwOi8vc2NoZW1hLmRhdGFjaXRlLm9yZy9tZXRhL2tlcm5lbC00LjMvbWV0YWRhdGEueHNkIj4KICA8aWRlbnRpZmllciBpZGVudGlmaWVyVHlwZT0iRE9JIj4xMC40ODU1MC9BUlhJVi4xODA4LjA5MTg3PC9pZGVudGlmaWVyPgogIDxhbHRlcm5hdGVJZGVudGlmaWVycz4KICAgIDxhbHRlcm5hdGVJZGVudGlmaWVyIGFsdGVybmF0ZUlkZW50aWZpZXJUeXBlPSJhclhpdiI+MTgwOC4wOTE4NzwvYWx0ZXJuYXRlSWRlbnRpZmllcj4KICA8L2FsdGVybmF0ZUlkZW50aWZpZXJzPgogIDxjcmVhdG9ycz4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5XdSwgQm93ZW48L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPkJvd2VuPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPld1PC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogICAgPGNyZWF0b3I+CiAgICAgIDxjcmVhdG9yTmFtZSBuYW1lVHlwZT0iUGVyc29uYWwiPkppYW5nLCBOYW48L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPk5hbjwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5KaWFuZzwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5HYW8sIFpoaWZlbmc8L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPlpoaWZlbmc8L2dpdmVuTmFtZT4KICAgICAgPGZhbWlseU5hbWU+R2FvPC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogICAgPGNyZWF0b3I+CiAgICAgIDxjcmVhdG9yTmFtZSBuYW1lVHlwZT0iUGVyc29uYWwiPkxpLCBNZW5neXVhbjwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+TWVuZ3l1YW48L2dpdmVuTmFtZT4KICAgICAgPGZhbWlseU5hbWU+TGk8L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgICA8Y3JlYXRvcj4KICAgICAgPGNyZWF0b3JOYW1lIG5hbWVUeXBlPSJQZXJzb25hbCI+V2FuZywgWm9uZ3NoZW5nPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5ab25nc2hlbmc8L2dpdmVuTmFtZT4KICAgICAgPGZhbWlseU5hbWU+V2FuZzwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5MaSwgU3VrZTwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+U3VrZTwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5MaTwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5GZW5nLCBRaWhhbmc8L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPlFpaGFuZzwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5GZW5nPC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogICAgPGNyZWF0b3I+CiAgICAgIDxjcmVhdG9yTmFtZSBuYW1lVHlwZT0iUGVyc29uYWwiPlJvbmcsIFdlbmdlPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5XZW5nZTwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5Sb25nPC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogICAgPGNyZWF0b3I+CiAgICAgIDxjcmVhdG9yTmFtZSBuYW1lVHlwZT0iUGVyc29uYWwiPldhbmcsIEJhb3h1bjwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+QmFveHVuPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPldhbmc8L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgPC9jcmVhdG9ycz4KICA8dGl0bGVzPgogICAgPHRpdGxlPldoeSBEbyBOZXVyYWwgUmVzcG9uc2UgR2VuZXJhdGlvbiBNb2RlbHMgUHJlZmVyIFVuaXZlcnNhbCBSZXBsaWVzPzwvdGl0bGU+CiAgPC90aXRsZXM+CiAgPHB1Ymxpc2hlcj5hclhpdjwvcHVibGlzaGVyPgogIDxwdWJsaWNhdGlvblllYXI+MjAxODwvcHVibGljYXRpb25ZZWFyPgogIDxzdWJqZWN0cz4KICAgIDxzdWJqZWN0IHhtbDpsYW5nPSJlbiIgc3ViamVjdFNjaGVtZT0iYXJYaXYiPkNvbXB1dGF0aW9uIGFuZCBMYW5ndWFnZSAoY3MuQ0wpPC9zdWJqZWN0PgogICAgPHN1YmplY3Qgc3ViamVjdFNjaGVtZT0iRmllbGRzIG9mIFNjaWVuY2UgYW5kIFRlY2hub2xvZ3kgKEZPUykiPkZPUzogQ29tcHV0ZXIgYW5kIGluZm9ybWF0aW9uIHNjaWVuY2VzPC9zdWJqZWN0PgogIDwvc3ViamVjdHM+CiAgPGRhdGVzPgogICAgPGRhdGUgZGF0ZVR5cGU9IlN1Ym1pdHRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2MSI+MjAxOC0wOC0yOFQwOToxMTo0OVo8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iVXBkYXRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2MSI+MjAxOC0wOC0yOVQwMDowNzo0MFo8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iU3VibWl0dGVkIiBkYXRlSW5mb3JtYXRpb249InYyIj4yMDE5LTEyLTExVDA4OjMxOjIzWjwvZGF0ZT4KICAgIDxkYXRlIGRhdGVUeXBlPSJVcGRhdGVkIiBkYXRlSW5mb3JtYXRpb249InYyIj4yMDE5LTEyLTEyVDAxOjA4OjU4WjwvZGF0ZT4KICAgIDxkYXRlIGRhdGVUeXBlPSJBdmFpbGFibGUiIGRhdGVJbmZvcm1hdGlvbj0idjEiPjIwMTgtMDg8L2RhdGU+CiAgPC9kYXRlcz4KICA8cmVzb3VyY2VUeXBlIHJlc291cmNlVHlwZUdlbmVyYWw9IlByZXByaW50Ij5BcnRpY2xlPC9yZXNvdXJjZVR5cGU+CiAgPHZlcnNpb24+MjwvdmVyc2lvbj4KICA8cmlnaHRzTGlzdD4KICAgIDxyaWdodHMgcmlnaHRzVVJJPSJodHRwOi8vYXJ4aXYub3JnL2xpY2Vuc2VzL25vbmV4Y2x1c2l2ZS1kaXN0cmliLzEuMC8iPmFyWGl2Lm9yZyBwZXJwZXR1YWwsIG5vbi1leGNsdXNpdmUgbGljZW5zZTwvcmlnaHRzPgogIDwvcmlnaHRzTGlzdD4KICA8ZGVzY3JpcHRpb25zPgogICAgPGRlc2NyaXB0aW9uIGRlc2NyaXB0aW9uVHlwZT0iQWJzdHJhY3QiPlJlY2VudCBhZHZhbmNlcyBpbiBzZXF1ZW5jZS10by1zZXF1ZW5jZSBsZWFybmluZyByZXZlYWwgYSBwdXJlbHkgZGF0YS1kcml2ZW4gYXBwcm9hY2ggdG8gdGhlIHJlc3BvbnNlIGdlbmVyYXRpb24gdGFzay4gRGVzcGl0ZSBpdHMgZGl2ZXJzZSBhcHBsaWNhdGlvbnMsIGV4aXN0aW5nIG5ldXJhbCBtb2RlbHMgYXJlIHByb25lIHRvIHByb2R1Y2luZyBzaG9ydCBhbmQgZ2VuZXJpYyByZXBsaWVzLCBtYWtpbmcgaXQgaW5mZWFzaWJsZSB0byB0YWNrbGUgb3Blbi1kb21haW4gY2hhbGxlbmdlcy4gSW4gdGhpcyByZXNlYXJjaCwgd2UgYW5hbHl6ZSB0aGlzIGNyaXRpY2FsIGlzc3VlIGluIGxpZ2h0IG9mIHRoZSBtb2RlbCdzIG9wdGltaXphdGlvbiBnb2FsIGFuZCB0aGUgc3BlY2lmaWMgY2hhcmFjdGVyaXN0aWNzIG9mIHRoZSBodW1hbi10by1odW1hbiBkaWFsb2cgY29ycHVzLiBCeSBkZWNvbXBvc2luZyB0aGUgYmxhY2sgYm94IGludG8gcGFydHMsIGEgZGV0YWlsZWQgYW5hbHlzaXMgb2YgdGhlIHByb2JhYmlsaXR5IGxpbWl0IHdhcyBjb25kdWN0ZWQgdG8gcmV2ZWFsIHRoZSByZWFzb24gYmVoaW5kIHRoZXNlIHVuaXZlcnNhbCByZXBsaWVzLiBCYXNlZCBvbiB0aGVzZSBhbmFseXNlcywgd2UgcHJvcG9zZSBhIG1heC1tYXJnaW4gcmFua2luZyByZWd1bGFyaXphdGlvbiB0ZXJtIHRvIGF2b2lkIHRoZSBtb2RlbHMgbGVhbmluZyB0byB0aGVzZSByZXBsaWVzLiBGaW5hbGx5LCBlbXBpcmljYWwgZXhwZXJpbWVudHMgb24gY2FzZSBzdHVkaWVzIGFuZCBiZW5jaG1hcmtzIHdpdGggc2V2ZXJhbCBtZXRyaWNzIHZhbGlkYXRlIHRoaXMgYXBwcm9hY2guPC9kZXNjcmlwdGlvbj4KICAgIDxkZXNjcmlwdGlvbiBkZXNjcmlwdGlvblR5cGU9Ik90aGVyIj5QcmVwcmludCBvZiB0aGUgcGFwZXIgcHJlc2VudGVkIHRvIHRoZSBBQUFJIDIwMjAgV29ya3Nob3Agb24gSW50ZXJhY3RpdmUgYW5kIENvbnZlcnNhdGlvbmFsIFJlY29tbWVuZGF0aW9uIFN5c3RlbXMgKFdJQ1JTKTwvZGVzY3JpcHRpb24+CiAgPC9kZXNjcmlwdGlvbnM+CjwvcmVzb3VyY2U+","url":"https://arxiv.org/abs/1808.09187","contentUrl":null,"metadataVersion":0,"schemaVersion":"http://datacite.org/schema/kernel-4","source":"mds","isActive":true,"state":"findable","reason":null,"viewCount":0,"viewsOverTime":[],"downloadCount":0,"downloadsOverTime":[],"referenceCount":0,"citationCount":0,"citationsOverTime":[],"partCount":0,"partOfCount":0,"versionCount":0,"versionOfCount":0,"created":"2022-03-02T05:36:46.000Z","registered":"2022-03-02T05:36:47.000Z","published":"2018","updated":"2022-03-02T05:36:47.000Z"},"relationships":{"client":{"data":{"id":"arxiv.content","type":"clients"}},"provider":{"data":{"id":"arxiv","type":"providers"}},"media":{"data":{"id":"10.48550/arxiv.1808.09187","type":"media"}},"references":{"data":[]},"citations":{"data":[]},"parts":{"data":[]},"partOf":{"data":[]},"versions":{"data":[]},"versionOf":{"data":[]}}}}