{"data":{"id":"10.48550/arxiv.2205.05131","type":"dois","attributes":{"doi":"10.48550/arxiv.2205.05131","prefix":"10.48550","suffix":"arxiv.2205.05131","identifiers":[{"identifier":"2205.05131","identifierType":"arXiv"}],"alternateIdentifiers":[{"alternateIdentifierType":"arXiv","alternateIdentifier":"2205.05131"}],"creators":[{"name":"Tay, Yi","nameType":"Personal","givenName":"Yi","familyName":"Tay","affiliation":[],"nameIdentifiers":[]},{"name":"Dehghani, Mostafa","nameType":"Personal","givenName":"Mostafa","familyName":"Dehghani","affiliation":[],"nameIdentifiers":[]},{"name":"Tran, Vinh Q.","nameType":"Personal","givenName":"Vinh Q.","familyName":"Tran","affiliation":[],"nameIdentifiers":[]},{"name":"Garcia, Xavier","nameType":"Personal","givenName":"Xavier","familyName":"Garcia","affiliation":[],"nameIdentifiers":[]},{"name":"Wei, Jason","nameType":"Personal","givenName":"Jason","familyName":"Wei","affiliation":[],"nameIdentifiers":[]},{"name":"Wang, Xuezhi","nameType":"Personal","givenName":"Xuezhi","familyName":"Wang","affiliation":[],"nameIdentifiers":[]},{"name":"Chung, Hyung Won","nameType":"Personal","givenName":"Hyung Won","familyName":"Chung","affiliation":[],"nameIdentifiers":[]},{"name":"Shakeri, Siamak","nameType":"Personal","givenName":"Siamak","familyName":"Shakeri","affiliation":[],"nameIdentifiers":[]},{"name":"Bahri, Dara","nameType":"Personal","givenName":"Dara","familyName":"Bahri","affiliation":[],"nameIdentifiers":[]},{"name":"Schuster, Tal","nameType":"Personal","givenName":"Tal","familyName":"Schuster","affiliation":[],"nameIdentifiers":[]},{"name":"Zheng, Huaixiu Steven","nameType":"Personal","givenName":"Huaixiu Steven","familyName":"Zheng","affiliation":[],"nameIdentifiers":[]},{"name":"Zhou, Denny","nameType":"Personal","givenName":"Denny","familyName":"Zhou","affiliation":[],"nameIdentifiers":[]},{"name":"Houlsby, Neil","nameType":"Personal","givenName":"Neil","familyName":"Houlsby","affiliation":[],"nameIdentifiers":[]},{"name":"Metzler, Donald","nameType":"Personal","givenName":"Donald","familyName":"Metzler","affiliation":[],"nameIdentifiers":[]}],"titles":[{"title":"UL2: Unifying Language Learning Paradigms"}],"publisher":"arXiv","container":{},"publicationYear":2022,"subjects":[{"lang":"en","subject":"Computation and Language (cs.CL)","subjectScheme":"arXiv"},{"subject":"FOS: Computer and information sciences","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Computer and information sciences","schemeUri":"http://www.oecd.org/science/inno/38235147.pdf","subjectScheme":"Fields of Science and Technology (FOS)"}],"contributors":[],"dates":[{"date":"2022-05-10T19:32:20Z","dateType":"Submitted","dateInformation":"v1"},{"date":"2022-05-12T00:02:22Z","dateType":"Updated","dateInformation":"v1"},{"date":"2022-10-08T22:46:47Z","dateType":"Submitted","dateInformation":"v2"},{"date":"2022-10-11T00:12:34Z","dateType":"Updated","dateInformation":"v2"},{"date":"2023-02-28T17:20:36Z","dateType":"Submitted","dateInformation":"v3"},{"date":"2023-03-01T01:22:21Z","dateType":"Updated","dateInformation":"v3"},{"date":"2022-05","dateType":"Available","dateInformation":"v1"},{"date":"2022","dateType":"Issued"}],"language":null,"types":{"ris":"GEN","bibtex":"misc","citeproc":"article","schemaOrg":"CreativeWork","resourceType":"Article","resourceTypeGeneral":"Preprint"},"relatedIdentifiers":[],"relatedItems":[],"sizes":[],"formats":[],"version":"3","rightsList":[{"rights":"arXiv.org perpetual, non-exclusive license","rightsUri":"http://arxiv.org/licenses/nonexclusive-distrib/1.0/"}],"descriptions":[{"description":"Existing pre-trained models are generally geared towards a particular class of problems. To date, there seems to be still no consensus on what the right architecture and pre-training setup should be. This paper presents a unified framework for pre-training models that are universally effective across datasets and setups. We begin by disentangling architectural archetypes with pre-training objectives -- two concepts that are commonly conflated. Next, we present a generalized \u0026amp; unified perspective for self-supervision in NLP and show how different pre-training objectives can be cast as one another and how interpolating between different objectives can be effective. We then propose Mixture-of-Denoisers (MoD), a pre-training objective that combines diverse pre-training paradigms together. We furthermore introduce a notion of mode switching, wherein downstream fine-tuning is associated with specific pre-training schemes. We conduct extensive ablative experiments to compare multiple pre-training objectives and find that our method pushes the Pareto-frontier by outperforming T5 \u0026amp; GPT-like models across multiple diverse setups. By scaling our model up to 20B parameters, we achieve SOTA performance on 50 well-established supervised finetuning based NLP tasks. Our model also achieve strong results at in-context learning, outperforming 175B GPT-3 on zero-shot SuperGLUE and tripling the performance of T5-XXL on one-shot summarization. On 0-shot MMLU, UL2 20B outperforms T0 and T5 models. UL2 20B also works well with chain-of-thought prompting and reasoning, making it an appealing choice for research into reasoning at a small to medium scale of 20B parameters. Finally, we apply FLAN instruction tuning to the UL2 20B model, achieving MMLU and Big-Bench scores competitive to FLAN-PaLM 62B. We release Flax-based T5X checkpoints for the UL2 20B \u0026amp; Flan-UL2 20B.","descriptionType":"Abstract"},{"description":"Updated Q1 2023 with Flan-UL2 20B release! :)","descriptionType":"Other"}],"geoLocations":[],"fundingReferences":[],"xml":"PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4KPHJlc291cmNlIHhtbG5zPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSIgeHNpOnNjaGVtYUxvY2F0aW9uPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCBodHRwOi8vc2NoZW1hLmRhdGFjaXRlLm9yZy9tZXRhL2tlcm5lbC00LjMvbWV0YWRhdGEueHNkIj4KICA8aWRlbnRpZmllciBpZGVudGlmaWVyVHlwZT0iRE9JIj4xMC40ODU1MC9BUlhJVi4yMjA1LjA1MTMxPC9pZGVudGlmaWVyPgogIDxhbHRlcm5hdGVJZGVudGlmaWVycz4KICAgIDxhbHRlcm5hdGVJZGVudGlmaWVyIGFsdGVybmF0ZUlkZW50aWZpZXJUeXBlPSJhclhpdiI+MjIwNS4wNTEzMTwvYWx0ZXJuYXRlSWRlbnRpZmllcj4KICA8L2FsdGVybmF0ZUlkZW50aWZpZXJzPgogIDxjcmVhdG9ycz4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5UYXksIFlpPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5ZaTwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5UYXk8L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgICA8Y3JlYXRvcj4KICAgICAgPGNyZWF0b3JOYW1lIG5hbWVUeXBlPSJQZXJzb25hbCI+RGVoZ2hhbmksIE1vc3RhZmE8L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPk1vc3RhZmE8L2dpdmVuTmFtZT4KICAgICAgPGZhbWlseU5hbWU+RGVoZ2hhbmk8L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgICA8Y3JlYXRvcj4KICAgICAgPGNyZWF0b3JOYW1lIG5hbWVUeXBlPSJQZXJzb25hbCI+VHJhbiwgVmluaCBRLjwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+VmluaCBRLjwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5UcmFuPC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogICAgPGNyZWF0b3I+CiAgICAgIDxjcmVhdG9yTmFtZSBuYW1lVHlwZT0iUGVyc29uYWwiPkdhcmNpYSwgWGF2aWVyPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5YYXZpZXI8L2dpdmVuTmFtZT4KICAgICAgPGZhbWlseU5hbWU+R2FyY2lhPC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogICAgPGNyZWF0b3I+CiAgICAgIDxjcmVhdG9yTmFtZSBuYW1lVHlwZT0iUGVyc29uYWwiPldlaSwgSmFzb248L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPkphc29uPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPldlaTwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5XYW5nLCBYdWV6aGk8L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPlh1ZXpoaTwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5XYW5nPC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogICAgPGNyZWF0b3I+CiAgICAgIDxjcmVhdG9yTmFtZSBuYW1lVHlwZT0iUGVyc29uYWwiPkNodW5nLCBIeXVuZyBXb248L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPkh5dW5nIFdvbjwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5DaHVuZzwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5TaGFrZXJpLCBTaWFtYWs8L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPlNpYW1hazwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5TaGFrZXJpPC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogICAgPGNyZWF0b3I+CiAgICAgIDxjcmVhdG9yTmFtZSBuYW1lVHlwZT0iUGVyc29uYWwiPkJhaHJpLCBEYXJhPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5EYXJhPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPkJhaHJpPC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogICAgPGNyZWF0b3I+CiAgICAgIDxjcmVhdG9yTmFtZSBuYW1lVHlwZT0iUGVyc29uYWwiPlNjaHVzdGVyLCBUYWw8L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPlRhbDwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5TY2h1c3RlcjwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5aaGVuZywgSHVhaXhpdSBTdGV2ZW48L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPkh1YWl4aXUgU3RldmVuPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPlpoZW5nPC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogICAgPGNyZWF0b3I+CiAgICAgIDxjcmVhdG9yTmFtZSBuYW1lVHlwZT0iUGVyc29uYWwiPlpob3UsIERlbm55PC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5EZW5ueTwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5aaG91PC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogICAgPGNyZWF0b3I+CiAgICAgIDxjcmVhdG9yTmFtZSBuYW1lVHlwZT0iUGVyc29uYWwiPkhvdWxzYnksIE5laWw8L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPk5laWw8L2dpdmVuTmFtZT4KICAgICAgPGZhbWlseU5hbWU+SG91bHNieTwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5NZXR6bGVyLCBEb25hbGQ8L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPkRvbmFsZDwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5NZXR6bGVyPC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogIDwvY3JlYXRvcnM+CiAgPHRpdGxlcz4KICAgIDx0aXRsZT5VTDI6IFVuaWZ5aW5nIExhbmd1YWdlIExlYXJuaW5nIFBhcmFkaWdtczwvdGl0bGU+CiAgPC90aXRsZXM+CiAgPHB1Ymxpc2hlcj5hclhpdjwvcHVibGlzaGVyPgogIDxwdWJsaWNhdGlvblllYXI+MjAyMjwvcHVibGljYXRpb25ZZWFyPgogIDxzdWJqZWN0cz4KICAgIDxzdWJqZWN0IHhtbDpsYW5nPSJlbiIgc3ViamVjdFNjaGVtZT0iYXJYaXYiPkNvbXB1dGF0aW9uIGFuZCBMYW5ndWFnZSAoY3MuQ0wpPC9zdWJqZWN0PgogICAgPHN1YmplY3Qgc3ViamVjdFNjaGVtZT0iRmllbGRzIG9mIFNjaWVuY2UgYW5kIFRlY2hub2xvZ3kgKEZPUykiPkZPUzogQ29tcHV0ZXIgYW5kIGluZm9ybWF0aW9uIHNjaWVuY2VzPC9zdWJqZWN0PgogIDwvc3ViamVjdHM+CiAgPGRhdGVzPgogICAgPGRhdGUgZGF0ZVR5cGU9IlN1Ym1pdHRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2MSI+MjAyMi0wNS0xMFQxOTozMjoyMFo8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iVXBkYXRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2MSI+MjAyMi0wNS0xMlQwMDowMjoyMlo8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iU3VibWl0dGVkIiBkYXRlSW5mb3JtYXRpb249InYyIj4yMDIyLTEwLTA4VDIyOjQ2OjQ3WjwvZGF0ZT4KICAgIDxkYXRlIGRhdGVUeXBlPSJVcGRhdGVkIiBkYXRlSW5mb3JtYXRpb249InYyIj4yMDIyLTEwLTExVDAwOjEyOjM0WjwvZGF0ZT4KICAgIDxkYXRlIGRhdGVUeXBlPSJTdWJtaXR0ZWQiIGRhdGVJbmZvcm1hdGlvbj0idjMiPjIwMjMtMDItMjhUMTc6MjA6MzZaPC9kYXRlPgogICAgPGRhdGUgZGF0ZVR5cGU9IlVwZGF0ZWQiIGRhdGVJbmZvcm1hdGlvbj0idjMiPjIwMjMtMDMtMDFUMDE6MjI6MjFaPC9kYXRlPgogICAgPGRhdGUgZGF0ZVR5cGU9IkF2YWlsYWJsZSIgZGF0ZUluZm9ybWF0aW9uPSJ2MSI+MjAyMi0wNTwvZGF0ZT4KICA8L2RhdGVzPgogIDxyZXNvdXJjZVR5cGUgcmVzb3VyY2VUeXBlR2VuZXJhbD0iUHJlcHJpbnQiPkFydGljbGU8L3Jlc291cmNlVHlwZT4KICA8dmVyc2lvbj4zPC92ZXJzaW9uPgogIDxyaWdodHNMaXN0PgogICAgPHJpZ2h0cyByaWdodHNVUkk9Imh0dHA6Ly9hcnhpdi5vcmcvbGljZW5zZXMvbm9uZXhjbHVzaXZlLWRpc3RyaWIvMS4wLyI+YXJYaXYub3JnIHBlcnBldHVhbCwgbm9uLWV4Y2x1c2l2ZSBsaWNlbnNlPC9yaWdodHM+CiAgPC9yaWdodHNMaXN0PgogIDxkZXNjcmlwdGlvbnM+CiAgICA8ZGVzY3JpcHRpb24gZGVzY3JpcHRpb25UeXBlPSJBYnN0cmFjdCI+RXhpc3RpbmcgcHJlLXRyYWluZWQgbW9kZWxzIGFyZSBnZW5lcmFsbHkgZ2VhcmVkIHRvd2FyZHMgYSBwYXJ0aWN1bGFyIGNsYXNzIG9mIHByb2JsZW1zLiBUbyBkYXRlLCB0aGVyZSBzZWVtcyB0byBiZSBzdGlsbCBubyBjb25zZW5zdXMgb24gd2hhdCB0aGUgcmlnaHQgYXJjaGl0ZWN0dXJlIGFuZCBwcmUtdHJhaW5pbmcgc2V0dXAgc2hvdWxkIGJlLiBUaGlzIHBhcGVyIHByZXNlbnRzIGEgdW5pZmllZCBmcmFtZXdvcmsgZm9yIHByZS10cmFpbmluZyBtb2RlbHMgdGhhdCBhcmUgdW5pdmVyc2FsbHkgZWZmZWN0aXZlIGFjcm9zcyBkYXRhc2V0cyBhbmQgc2V0dXBzLiBXZSBiZWdpbiBieSBkaXNlbnRhbmdsaW5nIGFyY2hpdGVjdHVyYWwgYXJjaGV0eXBlcyB3aXRoIHByZS10cmFpbmluZyBvYmplY3RpdmVzIC0tIHR3byBjb25jZXB0cyB0aGF0IGFyZSBjb21tb25seSBjb25mbGF0ZWQuIE5leHQsIHdlIHByZXNlbnQgYSBnZW5lcmFsaXplZCAmYW1wOyB1bmlmaWVkIHBlcnNwZWN0aXZlIGZvciBzZWxmLXN1cGVydmlzaW9uIGluIE5MUCBhbmQgc2hvdyBob3cgZGlmZmVyZW50IHByZS10cmFpbmluZyBvYmplY3RpdmVzIGNhbiBiZSBjYXN0IGFzIG9uZSBhbm90aGVyIGFuZCBob3cgaW50ZXJwb2xhdGluZyBiZXR3ZWVuIGRpZmZlcmVudCBvYmplY3RpdmVzIGNhbiBiZSBlZmZlY3RpdmUuIFdlIHRoZW4gcHJvcG9zZSBNaXh0dXJlLW9mLURlbm9pc2VycyAoTW9EKSwgYSBwcmUtdHJhaW5pbmcgb2JqZWN0aXZlIHRoYXQgY29tYmluZXMgZGl2ZXJzZSBwcmUtdHJhaW5pbmcgcGFyYWRpZ21zIHRvZ2V0aGVyLiBXZSBmdXJ0aGVybW9yZSBpbnRyb2R1Y2UgYSBub3Rpb24gb2YgbW9kZSBzd2l0Y2hpbmcsIHdoZXJlaW4gZG93bnN0cmVhbSBmaW5lLXR1bmluZyBpcyBhc3NvY2lhdGVkIHdpdGggc3BlY2lmaWMgcHJlLXRyYWluaW5nIHNjaGVtZXMuIFdlIGNvbmR1Y3QgZXh0ZW5zaXZlIGFibGF0aXZlIGV4cGVyaW1lbnRzIHRvIGNvbXBhcmUgbXVsdGlwbGUgcHJlLXRyYWluaW5nIG9iamVjdGl2ZXMgYW5kIGZpbmQgdGhhdCBvdXIgbWV0aG9kIHB1c2hlcyB0aGUgUGFyZXRvLWZyb250aWVyIGJ5IG91dHBlcmZvcm1pbmcgVDUgJmFtcDsgR1BULWxpa2UgbW9kZWxzIGFjcm9zcyBtdWx0aXBsZSBkaXZlcnNlIHNldHVwcy4gQnkgc2NhbGluZyBvdXIgbW9kZWwgdXAgdG8gMjBCIHBhcmFtZXRlcnMsIHdlIGFjaGlldmUgU09UQSBwZXJmb3JtYW5jZSBvbiA1MCB3ZWxsLWVzdGFibGlzaGVkIHN1cGVydmlzZWQgZmluZXR1bmluZyBiYXNlZCBOTFAgdGFza3MuIE91ciBtb2RlbCBhbHNvIGFjaGlldmUgc3Ryb25nIHJlc3VsdHMgYXQgaW4tY29udGV4dCBsZWFybmluZywgb3V0cGVyZm9ybWluZyAxNzVCIEdQVC0zIG9uIHplcm8tc2hvdCBTdXBlckdMVUUgYW5kIHRyaXBsaW5nIHRoZSBwZXJmb3JtYW5jZSBvZiBUNS1YWEwgb24gb25lLXNob3Qgc3VtbWFyaXphdGlvbi4gT24gMC1zaG90IE1NTFUsIFVMMiAyMEIgb3V0cGVyZm9ybXMgVDAgYW5kIFQ1IG1vZGVscy4gVUwyIDIwQiBhbHNvIHdvcmtzIHdlbGwgd2l0aCBjaGFpbi1vZi10aG91Z2h0IHByb21wdGluZyBhbmQgcmVhc29uaW5nLCBtYWtpbmcgaXQgYW4gYXBwZWFsaW5nIGNob2ljZSBmb3IgcmVzZWFyY2ggaW50byByZWFzb25pbmcgYXQgYSBzbWFsbCB0byBtZWRpdW0gc2NhbGUgb2YgMjBCIHBhcmFtZXRlcnMuIEZpbmFsbHksIHdlIGFwcGx5IEZMQU4gaW5zdHJ1Y3Rpb24gdHVuaW5nIHRvIHRoZSBVTDIgMjBCIG1vZGVsLCBhY2hpZXZpbmcgTU1MVSBhbmQgQmlnLUJlbmNoIHNjb3JlcyBjb21wZXRpdGl2ZSB0byBGTEFOLVBhTE0gNjJCLiBXZSByZWxlYXNlIEZsYXgtYmFzZWQgVDVYIGNoZWNrcG9pbnRzIGZvciB0aGUgVUwyIDIwQiAmYW1wOyBGbGFuLVVMMiAyMEIuPC9kZXNjcmlwdGlvbj4KICAgIDxkZXNjcmlwdGlvbiBkZXNjcmlwdGlvblR5cGU9Ik90aGVyIj5VcGRhdGVkIFExIDIwMjMgd2l0aCBGbGFuLVVMMiAyMEIgcmVsZWFzZSEgOik8L2Rlc2NyaXB0aW9uPgogIDwvZGVzY3JpcHRpb25zPgo8L3Jlc291cmNlPg==","url":"https://arxiv.org/abs/2205.05131","contentUrl":null,"metadataVersion":2,"schemaVersion":"http://datacite.org/schema/kernel-4","source":"mds","isActive":true,"state":"findable","reason":null,"viewCount":0,"viewsOverTime":[],"downloadCount":0,"downloadsOverTime":[],"referenceCount":0,"citationCount":0,"citationsOverTime":[],"partCount":0,"partOfCount":0,"versionCount":0,"versionOfCount":0,"created":"2022-05-12T00:58:45.000Z","registered":"2022-05-12T00:58:46.000Z","published":"2022","updated":"2023-03-01T02:16:21.000Z"},"relationships":{"client":{"data":{"id":"arxiv.content","type":"clients"}},"provider":{"data":{"id":"arxiv","type":"providers"}},"media":{"data":{"id":"10.48550/arxiv.2205.05131","type":"media"}},"references":{"data":[]},"citations":{"data":[]},"parts":{"data":[]},"partOf":{"data":[]},"versions":{"data":[]},"versionOf":{"data":[]}}}}