{"data":{"id":"10.48550/arxiv.2006.11632","type":"dois","attributes":{"doi":"10.48550/arxiv.2006.11632","prefix":"10.48550","suffix":"arxiv.2006.11632","identifiers":[{"identifier":"2006.11632","identifierType":"arXiv"}],"alternateIdentifiers":[{"alternateIdentifierType":"arXiv","alternateIdentifier":"2006.11632"}],"creators":[{"name":"Huang, Jui-Ting","nameType":"Personal","givenName":"Jui-Ting","familyName":"Huang","affiliation":[],"nameIdentifiers":[]},{"name":"Sharma, Ashish","nameType":"Personal","givenName":"Ashish","familyName":"Sharma","affiliation":[],"nameIdentifiers":[]},{"name":"Sun, Shuying","nameType":"Personal","givenName":"Shuying","familyName":"Sun","affiliation":[],"nameIdentifiers":[]},{"name":"Xia, Li","nameType":"Personal","givenName":"Li","familyName":"Xia","affiliation":[],"nameIdentifiers":[]},{"name":"Zhang, David","nameType":"Personal","givenName":"David","familyName":"Zhang","affiliation":[],"nameIdentifiers":[]},{"name":"Pronin, Philip","nameType":"Personal","givenName":"Philip","familyName":"Pronin","affiliation":[],"nameIdentifiers":[]},{"name":"Padmanabhan, Janani","nameType":"Personal","givenName":"Janani","familyName":"Padmanabhan","affiliation":[],"nameIdentifiers":[]},{"name":"Ottaviano, Giuseppe","nameType":"Personal","givenName":"Giuseppe","familyName":"Ottaviano","affiliation":[],"nameIdentifiers":[]},{"name":"Yang, Linjun","nameType":"Personal","givenName":"Linjun","familyName":"Yang","affiliation":[],"nameIdentifiers":[]}],"titles":[{"title":"Embedding-based Retrieval in Facebook Search"}],"publisher":"arXiv","container":{},"publicationYear":2020,"subjects":[{"lang":"en","subject":"Information Retrieval (cs.IR)","subjectScheme":"arXiv"},{"subject":"FOS: Computer and information sciences","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Computer and information sciences","schemeUri":"http://www.oecd.org/science/inno/38235147.pdf","subjectScheme":"Fields of Science and Technology (FOS)"}],"contributors":[],"dates":[{"date":"2020-06-20T18:34:09Z","dateType":"Submitted","dateInformation":"v1"},{"date":"2020-06-23T00:14:09Z","dateType":"Updated","dateInformation":"v1"},{"date":"2020-07-29T20:30:39Z","dateType":"Submitted","dateInformation":"v2"},{"date":"2020-07-31T00:03:34Z","dateType":"Updated","dateInformation":"v2"},{"date":"2020-06","dateType":"Available","dateInformation":"v1"},{"date":"2020","dateType":"Issued"}],"language":null,"types":{"ris":"RPRT","bibtex":"article","citeproc":"article-journal","schemaOrg":"ScholarlyArticle","resourceType":"Article","resourceTypeGeneral":"Text"},"relatedIdentifiers":[{"relationType":"IsVersionOf","relatedIdentifier":"10.1145/3394486.3403305","relatedIdentifierType":"DOI"}],"relatedItems":[],"sizes":[],"formats":[],"version":"2","rightsList":[{"rights":"Creative Commons Attribution 4.0 International","rightsUri":"https://creativecommons.org/licenses/by/4.0/legalcode","schemeUri":"https://spdx.org/licenses/","rightsIdentifier":"cc-by-4.0","rightsIdentifierScheme":"SPDX"}],"descriptions":[{"description":"Search in social networks such as Facebook poses different challenges than in classical web search: besides the query text, it is important to take into account the searcher's context to provide relevant results. Their social graph is an integral part of this context and is a unique aspect of Facebook search. While embedding-based retrieval (EBR) has been applied in eb search engines for years, Facebook search was still mainly based on a Boolean matching model. In this paper, we discuss the techniques for applying EBR to a Facebook Search system. We introduce the unified embedding framework developed to model semantic embeddings for personalized search, and the system to serve embedding-based retrieval in a typical search system based on an inverted index. We discuss various tricks and experiences on end-to-end optimization of the whole system, including ANN parameter tuning and full-stack optimization. Finally, we present our progress on two selected advanced topics about modeling. We evaluated EBR on verticals for Facebook Search with significant metrics gains observed in online A/B experiments. We believe this paper will provide useful insights and experiences to help people on developing embedding-based retrieval systems in search engines.","descriptionType":"Abstract"},{"description":"9 pages, 3 figures, 3 tables, to be published in KDD '20","descriptionType":"Other"}],"geoLocations":[],"fundingReferences":[],"xml":"PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4KPHJlc291cmNlIHhtbG5zPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSIgeHNpOnNjaGVtYUxvY2F0aW9uPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCBodHRwOi8vc2NoZW1hLmRhdGFjaXRlLm9yZy9tZXRhL2tlcm5lbC00LjMvbWV0YWRhdGEueHNkIj4KICA8aWRlbnRpZmllciBpZGVudGlmaWVyVHlwZT0iRE9JIj4xMC40ODU1MC9BUlhJVi4yMDA2LjExNjMyPC9pZGVudGlmaWVyPgogIDxhbHRlcm5hdGVJZGVudGlmaWVycz4KICAgIDxhbHRlcm5hdGVJZGVudGlmaWVyIGFsdGVybmF0ZUlkZW50aWZpZXJUeXBlPSJhclhpdiI+MjAwNi4xMTYzMjwvYWx0ZXJuYXRlSWRlbnRpZmllcj4KICA8L2FsdGVybmF0ZUlkZW50aWZpZXJzPgogIDxjcmVhdG9ycz4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5IdWFuZywgSnVpLVRpbmc8L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPkp1aS1UaW5nPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPkh1YW5nPC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogICAgPGNyZWF0b3I+CiAgICAgIDxjcmVhdG9yTmFtZSBuYW1lVHlwZT0iUGVyc29uYWwiPlNoYXJtYSwgQXNoaXNoPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5Bc2hpc2g8L2dpdmVuTmFtZT4KICAgICAgPGZhbWlseU5hbWU+U2hhcm1hPC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogICAgPGNyZWF0b3I+CiAgICAgIDxjcmVhdG9yTmFtZSBuYW1lVHlwZT0iUGVyc29uYWwiPlN1biwgU2h1eWluZzwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+U2h1eWluZzwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5TdW48L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgICA8Y3JlYXRvcj4KICAgICAgPGNyZWF0b3JOYW1lIG5hbWVUeXBlPSJQZXJzb25hbCI+WGlhLCBMaTwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+TGk8L2dpdmVuTmFtZT4KICAgICAgPGZhbWlseU5hbWU+WGlhPC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogICAgPGNyZWF0b3I+CiAgICAgIDxjcmVhdG9yTmFtZSBuYW1lVHlwZT0iUGVyc29uYWwiPlpoYW5nLCBEYXZpZDwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+RGF2aWQ8L2dpdmVuTmFtZT4KICAgICAgPGZhbWlseU5hbWU+Wmhhbmc8L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgICA8Y3JlYXRvcj4KICAgICAgPGNyZWF0b3JOYW1lIG5hbWVUeXBlPSJQZXJzb25hbCI+UHJvbmluLCBQaGlsaXA8L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPlBoaWxpcDwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5Qcm9uaW48L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgICA8Y3JlYXRvcj4KICAgICAgPGNyZWF0b3JOYW1lIG5hbWVUeXBlPSJQZXJzb25hbCI+UGFkbWFuYWJoYW4sIEphbmFuaTwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+SmFuYW5pPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPlBhZG1hbmFiaGFuPC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogICAgPGNyZWF0b3I+CiAgICAgIDxjcmVhdG9yTmFtZSBuYW1lVHlwZT0iUGVyc29uYWwiPk90dGF2aWFubywgR2l1c2VwcGU8L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPkdpdXNlcHBlPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPk90dGF2aWFubzwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5ZYW5nLCBMaW5qdW48L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPkxpbmp1bjwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5ZYW5nPC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogIDwvY3JlYXRvcnM+CiAgPHRpdGxlcz4KICAgIDx0aXRsZT5FbWJlZGRpbmctYmFzZWQgUmV0cmlldmFsIGluIEZhY2Vib29rIFNlYXJjaDwvdGl0bGU+CiAgPC90aXRsZXM+CiAgPHB1Ymxpc2hlcj5hclhpdjwvcHVibGlzaGVyPgogIDxwdWJsaWNhdGlvblllYXI+MjAyMDwvcHVibGljYXRpb25ZZWFyPgogIDxzdWJqZWN0cz4KICAgIDxzdWJqZWN0IHhtbDpsYW5nPSJlbiIgc3ViamVjdFNjaGVtZT0iYXJYaXYiPkluZm9ybWF0aW9uIFJldHJpZXZhbCAoY3MuSVIpPC9zdWJqZWN0PgogICAgPHN1YmplY3Qgc3ViamVjdFNjaGVtZT0iRmllbGRzIG9mIFNjaWVuY2UgYW5kIFRlY2hub2xvZ3kgKEZPUykiPkZPUzogQ29tcHV0ZXIgYW5kIGluZm9ybWF0aW9uIHNjaWVuY2VzPC9zdWJqZWN0PgogIDwvc3ViamVjdHM+CiAgPGRhdGVzPgogICAgPGRhdGUgZGF0ZVR5cGU9IlN1Ym1pdHRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2MSI+MjAyMC0wNi0yMFQxODozNDowOVo8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iVXBkYXRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2MSI+MjAyMC0wNi0yM1QwMDoxNDowOVo8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iU3VibWl0dGVkIiBkYXRlSW5mb3JtYXRpb249InYyIj4yMDIwLTA3LTI5VDIwOjMwOjM5WjwvZGF0ZT4KICAgIDxkYXRlIGRhdGVUeXBlPSJVcGRhdGVkIiBkYXRlSW5mb3JtYXRpb249InYyIj4yMDIwLTA3LTMxVDAwOjAzOjM0WjwvZGF0ZT4KICAgIDxkYXRlIGRhdGVUeXBlPSJBdmFpbGFibGUiIGRhdGVJbmZvcm1hdGlvbj0idjEiPjIwMjAtMDY8L2RhdGU+CiAgPC9kYXRlcz4KICA8cmVzb3VyY2VUeXBlIHJlc291cmNlVHlwZUdlbmVyYWw9IlRleHQiPkFydGljbGU8L3Jlc291cmNlVHlwZT4KICA8cmVsYXRlZElkZW50aWZpZXJzPgogICAgPHJlbGF0ZWRJZGVudGlmaWVyIHJlbGF0ZWRJZGVudGlmaWVyVHlwZT0iRE9JIiByZWxhdGlvblR5cGU9IklzVmVyc2lvbk9mIj4xMC4xMTQ1LzMzOTQ0ODYuMzQwMzMwNTwvcmVsYXRlZElkZW50aWZpZXI+CiAgPC9yZWxhdGVkSWRlbnRpZmllcnM+CiAgPHZlcnNpb24+MjwvdmVyc2lvbj4KICA8cmlnaHRzTGlzdD4KICAgIDxyaWdodHMgcmlnaHRzVVJJPSJodHRwOi8vY3JlYXRpdmVjb21tb25zLm9yZy9saWNlbnNlcy9ieS80LjAvIiByaWdodHNJZGVudGlmaWVyU2NoZW1lPSJTUERYIiByaWdodHNJZGVudGlmaWVyPSJDQy1CWS00LjAiPkNyZWF0aXZlIENvbW1vbnMgQXR0cmlidXRpb24gNC4wIEludGVybmF0aW9uYWw8L3JpZ2h0cz4KICA8L3JpZ2h0c0xpc3Q+CiAgPGRlc2NyaXB0aW9ucz4KICAgIDxkZXNjcmlwdGlvbiBkZXNjcmlwdGlvblR5cGU9IkFic3RyYWN0Ij5TZWFyY2ggaW4gc29jaWFsIG5ldHdvcmtzIHN1Y2ggYXMgRmFjZWJvb2sgcG9zZXMgZGlmZmVyZW50IGNoYWxsZW5nZXMgdGhhbiBpbiBjbGFzc2ljYWwgd2ViIHNlYXJjaDogYmVzaWRlcyB0aGUgcXVlcnkgdGV4dCwgaXQgaXMgaW1wb3J0YW50IHRvIHRha2UgaW50byBhY2NvdW50IHRoZSBzZWFyY2hlcidzIGNvbnRleHQgdG8gcHJvdmlkZSByZWxldmFudCByZXN1bHRzLiBUaGVpciBzb2NpYWwgZ3JhcGggaXMgYW4gaW50ZWdyYWwgcGFydCBvZiB0aGlzIGNvbnRleHQgYW5kIGlzIGEgdW5pcXVlIGFzcGVjdCBvZiBGYWNlYm9vayBzZWFyY2guIFdoaWxlIGVtYmVkZGluZy1iYXNlZCByZXRyaWV2YWwgKEVCUikgaGFzIGJlZW4gYXBwbGllZCBpbiBlYiBzZWFyY2ggZW5naW5lcyBmb3IgeWVhcnMsIEZhY2Vib29rIHNlYXJjaCB3YXMgc3RpbGwgbWFpbmx5IGJhc2VkIG9uIGEgQm9vbGVhbiBtYXRjaGluZyBtb2RlbC4gSW4gdGhpcyBwYXBlciwgd2UgZGlzY3VzcyB0aGUgdGVjaG5pcXVlcyBmb3IgYXBwbHlpbmcgRUJSIHRvIGEgRmFjZWJvb2sgU2VhcmNoIHN5c3RlbS4gV2UgaW50cm9kdWNlIHRoZSB1bmlmaWVkIGVtYmVkZGluZyBmcmFtZXdvcmsgZGV2ZWxvcGVkIHRvIG1vZGVsIHNlbWFudGljIGVtYmVkZGluZ3MgZm9yIHBlcnNvbmFsaXplZCBzZWFyY2gsIGFuZCB0aGUgc3lzdGVtIHRvIHNlcnZlIGVtYmVkZGluZy1iYXNlZCByZXRyaWV2YWwgaW4gYSB0eXBpY2FsIHNlYXJjaCBzeXN0ZW0gYmFzZWQgb24gYW4gaW52ZXJ0ZWQgaW5kZXguIFdlIGRpc2N1c3MgdmFyaW91cyB0cmlja3MgYW5kIGV4cGVyaWVuY2VzIG9uIGVuZC10by1lbmQgb3B0aW1pemF0aW9uIG9mIHRoZSB3aG9sZSBzeXN0ZW0sIGluY2x1ZGluZyBBTk4gcGFyYW1ldGVyIHR1bmluZyBhbmQgZnVsbC1zdGFjayBvcHRpbWl6YXRpb24uIEZpbmFsbHksIHdlIHByZXNlbnQgb3VyIHByb2dyZXNzIG9uIHR3byBzZWxlY3RlZCBhZHZhbmNlZCB0b3BpY3MgYWJvdXQgbW9kZWxpbmcuIFdlIGV2YWx1YXRlZCBFQlIgb24gdmVydGljYWxzIGZvciBGYWNlYm9vayBTZWFyY2ggd2l0aCBzaWduaWZpY2FudCBtZXRyaWNzIGdhaW5zIG9ic2VydmVkIGluIG9ubGluZSBBL0IgZXhwZXJpbWVudHMuIFdlIGJlbGlldmUgdGhpcyBwYXBlciB3aWxsIHByb3ZpZGUgdXNlZnVsIGluc2lnaHRzIGFuZCBleHBlcmllbmNlcyB0byBoZWxwIHBlb3BsZSBvbiBkZXZlbG9waW5nIGVtYmVkZGluZy1iYXNlZCByZXRyaWV2YWwgc3lzdGVtcyBpbiBzZWFyY2ggZW5naW5lcy48L2Rlc2NyaXB0aW9uPgogICAgPGRlc2NyaXB0aW9uIGRlc2NyaXB0aW9uVHlwZT0iT3RoZXIiPjkgcGFnZXMsIDMgZmlndXJlcywgMyB0YWJsZXMsIHRvIGJlIHB1Ymxpc2hlZCBpbiBLREQgJzIwPC9kZXNjcmlwdGlvbj4KICA8L2Rlc2NyaXB0aW9ucz4KPC9yZXNvdXJjZT4=","url":"https://arxiv.org/abs/2006.11632","contentUrl":null,"metadataVersion":0,"schemaVersion":"http://datacite.org/schema/kernel-4","source":"mds","isActive":true,"state":"findable","reason":null,"viewCount":0,"viewsOverTime":[],"downloadCount":0,"downloadsOverTime":[],"referenceCount":0,"citationCount":0,"citationsOverTime":[],"partCount":0,"partOfCount":0,"versionCount":0,"versionOfCount":0,"created":"2022-02-25T04:15:27.000Z","registered":"2022-02-25T04:15:28.000Z","published":"2020","updated":"2022-02-25T04:15:28.000Z"},"relationships":{"client":{"data":{"id":"arxiv.content","type":"clients"}},"provider":{"data":{"id":"arxiv","type":"providers"}},"media":{"data":{"id":"10.48550/arxiv.2006.11632","type":"media"}},"references":{"data":[]},"citations":{"data":[]},"parts":{"data":[]},"partOf":{"data":[]},"versions":{"data":[]},"versionOf":{"data":[]}}}}