{"data":{"id":"10.4121/c08cb26b-3fad-4a2e-bdcf-2986d704f342","type":"dois","attributes":{"doi":"10.4121/c08cb26b-3fad-4a2e-bdcf-2986d704f342","prefix":"10.4121","suffix":"c08cb26b-3fad-4a2e-bdcf-2986d704f342","identifiers":[],"alternateIdentifiers":[],"creators":[{"name":"Strafforello, Ombretta","givenName":"Ombretta","familyName":"Strafforello","affiliation":[],"nameIdentifiers":[]},{"name":"Schutte , Klamer","nameType":"Personal","givenName":"Klamer","familyName":"Schutte ","nameIdentifiers":[{"nameIdentifier":"0000-0002-9954-0685","nameIdentifierScheme":"https://orcid.org/"}],"affiliation":[]},{"name":"van Gemert, Jan","nameType":"Personal","givenName":"Jan","familyName":"van Gemert","nameIdentifiers":[{"nameIdentifier":"0000-0002-6913-0482","nameIdentifierScheme":"https://orcid.org/"}],"affiliation":[]},{"name":"Kayhan, Osman","givenName":"Osman","familyName":"Kayhan","affiliation":[],"nameIdentifiers":[]}],"titles":[{"title":"Code and data underlying the paper: \"Aligning object detector bounding boxes with human preference\""}],"publisher":"4TU.ResearchData","container":{},"publicationYear":2024,"subjects":[{"subject":"Artificial Intelligence and Image Processing","subjectScheme":"Australian and New Zealand Standard Research Classification (ANZSRC), 2008","classificationCode":"0801"},{"subject":"FOS: Computer and information sciences","schemeUri":"http://www.oecd.org/science/inno/38235147.pdf","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"Information and Computing Sciences","subjectScheme":"Australian and New Zealand Standard Research Classification (ANZSRC), 2008","classificationCode":"08"},{"subject":"Computer vision"},{"subject":"Object detectors"},{"subject":"Human preference"}],"contributors":[{"name":"TU Delft, TU Delft, Faculty Of Electrical Engineering, Mathematics And Computer Science, Department Of Intelligent Systems, Computer Vision Lab","nameType":"Organizational","affiliation":[],"contributorType":"Other","nameIdentifiers":[]},{"name":"TNO, Netherlands Organisation For Applied Scientific Research, Intelligent Imaging Group","nameType":"Organizational","affiliation":[],"contributorType":"Other","nameIdentifiers":[]}],"dates":[{"date":"2024-05-31","dateType":"Issued"}],"language":"en","types":{"ris":"DATA","bibtex":"misc","citeproc":"dataset","schemaOrg":"Dataset","resourceType":"Dataset","resourceTypeGeneral":"Dataset"},"relatedIdentifiers":[],"relatedItems":[],"sizes":[],"formats":["Zip file containing python and HTML code. URL to Google drive."],"version":"1","rightsList":[{"rights":"Creative Commons Zero v1.0 Universal","rightsUri":"https://creativecommons.org/publicdomain/zero/1.0/legalcode","schemeUri":"https://spdx.org/licenses/","rightsIdentifier":"cc0-1.0","rightsIdentifierScheme":"SPDX"}],"descriptions":[{"description":"Previous work shows that humans tend to prefer large bounding boxes over small bounding boxes with the same IoU. However, we show here that commonly used object detectors predict large and small boxes equally often. In this work, we investigate how to align automatic detected object boxes with human preference and study whether this improves human quality perception. We evaluate the performance of three commonly used object detectors through a user study with more than 120 participants. We find that humans prefer object detections that are upscaled with factors of 1.5 or 2, even if the corresponding AP is close to 0. Motivated by this result, we propose an asymmetric bounding box regression loss that encourages large over small predicted bounding boxes. Our evaluation study shows that object detectors fine-tuned with the asymmetric loss are better aligned with human preference and are preferred over fixed scaling factors. In this repository, we provide our code, including the evaluation of object detection size and the implementation of the user studies. We share a Google drive link to the images used in our user studies.","descriptionType":"Abstract"}],"geoLocations":[],"fundingReferences":[],"xml":"PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0iVVRGLTgiPz4KPHJlc291cmNlIHhtbG5zPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSIgeHNpOnNjaGVtYUxvY2F0aW9uPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCBodHRwOi8vc2NoZW1hLmRhdGFjaXRlLm9yZy9tZXRhL2tlcm5lbC00LjQvbWV0YWRhdGEueHNkIj4KICA8aWRlbnRpZmllciBpZGVudGlmaWVyVHlwZT0iRE9JIj4xMC40MTIxL0MwOENCMjZCLTNGQUQtNEEyRS1CRENGLTI5ODZENzA0RjM0MjwvaWRlbnRpZmllcj4KICA8Y3JlYXRvcnM+CiAgICA8Y3JlYXRvcj4KICAgICAgPGNyZWF0b3JOYW1lPk9tYnJldHRhIFN0cmFmZm9yZWxsbzwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+T21icmV0dGE8L2dpdmVuTmFtZT4KICAgICAgPGZhbWlseU5hbWU+U3RyYWZmb3JlbGxvPC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogICAgPGNyZWF0b3I+CiAgICAgIDxjcmVhdG9yTmFtZSBuYW1lVHlwZT0iUGVyc29uYWwiPktsYW1lciBTY2h1dHRlIDwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+S2xhbWVyPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPlNjaHV0dGUgPC9mYW1pbHlOYW1lPgogICAgICA8bmFtZUlkZW50aWZpZXIgbmFtZUlkZW50aWZpZXJTY2hlbWU9Imh0dHBzOi8vb3JjaWQub3JnLyI+MDAwMC0wMDAyLTk5NTQtMDY4NTwvbmFtZUlkZW50aWZpZXI+CiAgICA8L2NyZWF0b3I+CiAgICA8Y3JlYXRvcj4KICAgICAgPGNyZWF0b3JOYW1lIG5hbWVUeXBlPSJQZXJzb25hbCI+SmFuIHZhbiBHZW1lcnQ8L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPkphbjwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT52YW4gR2VtZXJ0PC9mYW1pbHlOYW1lPgogICAgICA8bmFtZUlkZW50aWZpZXIgbmFtZUlkZW50aWZpZXJTY2hlbWU9Imh0dHBzOi8vb3JjaWQub3JnLyI+MDAwMC0wMDAyLTY5MTMtMDQ4MjwvbmFtZUlkZW50aWZpZXI+CiAgICA8L2NyZWF0b3I+CiAgICA8Y3JlYXRvcj4KICAgICAgPGNyZWF0b3JOYW1lPk9zbWFuIEtheWhhbjwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+T3NtYW48L2dpdmVuTmFtZT4KICAgICAgPGZhbWlseU5hbWU+S2F5aGFuPC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogIDwvY3JlYXRvcnM+CiAgPHRpdGxlcz4KICAgIDx0aXRsZT5Db2RlIGFuZCBkYXRhIHVuZGVybHlpbmcgdGhlIHBhcGVyOiAiQWxpZ25pbmcgb2JqZWN0IGRldGVjdG9yIGJvdW5kaW5nIGJveGVzIHdpdGggaHVtYW4gcHJlZmVyZW5jZSI8L3RpdGxlPgogIDwvdGl0bGVzPgogIDxwdWJsaXNoZXI+NFRVLlJlc2VhcmNoRGF0YTwvcHVibGlzaGVyPgogIDxwdWJsaWNhdGlvblllYXI+MjAyNDwvcHVibGljYXRpb25ZZWFyPgogIDxyZXNvdXJjZVR5cGUgcmVzb3VyY2VUeXBlR2VuZXJhbD0iRGF0YXNldCI+RGF0YXNldDwvcmVzb3VyY2VUeXBlPgogIDxzdWJqZWN0cz4KICAgIDxzdWJqZWN0IHN1YmplY3RTY2hlbWU9IkF1c3RyYWxpYW4gYW5kIE5ldyBaZWFsYW5kIFN0YW5kYXJkIFJlc2VhcmNoIENsYXNzaWZpY2F0aW9uIChBTlpTUkMpLCAyMDA4IiBjbGFzc2lmaWNhdGlvbkNvZGU9IjA4MDEiPkFydGlmaWNpYWwgSW50ZWxsaWdlbmNlIGFuZCBJbWFnZSBQcm9jZXNzaW5nPC9zdWJqZWN0PgogICAgPHN1YmplY3Qgc3ViamVjdFNjaGVtZT0iQXVzdHJhbGlhbiBhbmQgTmV3IFplYWxhbmQgU3RhbmRhcmQgUmVzZWFyY2ggQ2xhc3NpZmljYXRpb24gKEFOWlNSQyksIDIwMDgiIGNsYXNzaWZpY2F0aW9uQ29kZT0iMDgiPkluZm9ybWF0aW9uIGFuZCBDb21wdXRpbmcgU2NpZW5jZXM8L3N1YmplY3Q+CiAgICA8c3ViamVjdD5Db21wdXRlciB2aXNpb248L3N1YmplY3Q+CiAgICA8c3ViamVjdD5PYmplY3QgZGV0ZWN0b3JzPC9zdWJqZWN0PgogICAgPHN1YmplY3Q+SHVtYW4gcHJlZmVyZW5jZTwvc3ViamVjdD4KICA8L3N1YmplY3RzPgogIDxjb250cmlidXRvcnM+CiAgICA8Y29udHJpYnV0b3IgY29udHJpYnV0b3JUeXBlPSJPdGhlciI+CiAgICAgIDxjb250cmlidXRvck5hbWUgbmFtZVR5cGU9Ik9yZ2FuaXphdGlvbmFsIj5UVSBEZWxmdCwgVFUgRGVsZnQsIEZhY3VsdHkgb2YgRWxlY3RyaWNhbCBFbmdpbmVlcmluZywgTWF0aGVtYXRpY3MgYW5kIENvbXB1dGVyIFNjaWVuY2UsIERlcGFydG1lbnQgb2YgSW50ZWxsaWdlbnQgU3lzdGVtcywgQ29tcHV0ZXIgVmlzaW9uIExhYjwvY29udHJpYnV0b3JOYW1lPgogICAgPC9jb250cmlidXRvcj4KICAgIDxjb250cmlidXRvciBjb250cmlidXRvclR5cGU9Ik90aGVyIj4KICAgICAgPGNvbnRyaWJ1dG9yTmFtZSBuYW1lVHlwZT0iT3JnYW5pemF0aW9uYWwiPlROTywgTmV0aGVybGFuZHMgT3JnYW5pc2F0aW9uIGZvciBBcHBsaWVkIFNjaWVudGlmaWMgUmVzZWFyY2gsIEludGVsbGlnZW50IEltYWdpbmcgR3JvdXA8L2NvbnRyaWJ1dG9yTmFtZT4KICAgIDwvY29udHJpYnV0b3I+CiAgPC9jb250cmlidXRvcnM+CiAgPGRhdGVzPgogICAgPGRhdGUgZGF0ZVR5cGU9Iklzc3VlZCI+MjAyNC0wNS0zMTwvZGF0ZT4KICA8L2RhdGVzPgogIDxsYW5ndWFnZT5lbjwvbGFuZ3VhZ2U+CiAgPGZvcm1hdHM+CiAgICA8Zm9ybWF0PlppcCBmaWxlIGNvbnRhaW5pbmcgcHl0aG9uIGFuZCBIVE1MIGNvZGUuIFVSTCB0byBHb29nbGUgZHJpdmUuIDwvZm9ybWF0PgogIDwvZm9ybWF0cz4KICA8dmVyc2lvbj4xPC92ZXJzaW9uPgogIDxyaWdodHNMaXN0PgogICAgPHJpZ2h0cyByaWdodHNVUkk9Imh0dHBzOi8vY3JlYXRpdmVjb21tb25zLm9yZy9wdWJsaWNkb21haW4vemVyby8xLjAvIj5DQzA8L3JpZ2h0cz4KICA8L3JpZ2h0c0xpc3Q+CiAgPGRlc2NyaXB0aW9ucz4KICAgIDxkZXNjcmlwdGlvbiBkZXNjcmlwdGlvblR5cGU9IkFic3RyYWN0Ij4mbHQ7cCZndDtQcmV2aW91cyB3b3JrIHNob3dzIHRoYXQgaHVtYW5zIHRlbmQgdG8gcHJlZmVyIGxhcmdlIGJvdW5kaW5nIGJveGVzIG92ZXIgc21hbGwgYm91bmRpbmcgYm94ZXMgd2l0aCB0aGUgc2FtZSBJb1UuIEhvd2V2ZXIsIHdlIHNob3cgaGVyZSB0aGF0IGNvbW1vbmx5IHVzZWQgb2JqZWN0IGRldGVjdG9ycyBwcmVkaWN0IGxhcmdlIGFuZCBzbWFsbCBib3hlcyBlcXVhbGx5IG9mdGVuLiBJbiB0aGlzIHdvcmssIHdlIGludmVzdGlnYXRlIGhvdyB0byBhbGlnbiBhdXRvbWF0aWMgZGV0ZWN0ZWQgb2JqZWN0IGJveGVzIHdpdGggaHVtYW4gcHJlZmVyZW5jZSBhbmQgc3R1ZHkgd2hldGhlciB0aGlzIGltcHJvdmVzIGh1bWFuIHF1YWxpdHkgcGVyY2VwdGlvbi4gV2UgZXZhbHVhdGUgdGhlIHBlcmZvcm1hbmNlIG9mIHRocmVlIGNvbW1vbmx5IHVzZWQgb2JqZWN0IGRldGVjdG9ycyB0aHJvdWdoIGEgdXNlciBzdHVkeSB3aXRoIG1vcmUgdGhhbiAxMjAgcGFydGljaXBhbnRzLiBXZSBmaW5kIHRoYXQgaHVtYW5zIHByZWZlciBvYmplY3QgZGV0ZWN0aW9ucyB0aGF0IGFyZSB1cHNjYWxlZCB3aXRoIGZhY3RvcnMgb2YgMS41IG9yIDIsIGV2ZW4gaWYgdGhlIGNvcnJlc3BvbmRpbmcgQVAgaXMgY2xvc2UgdG8gMC4gTW90aXZhdGVkIGJ5IHRoaXMgcmVzdWx0LCB3ZSBwcm9wb3NlIGFuIGFzeW1tZXRyaWMgYm91bmRpbmcgYm94IHJlZ3Jlc3Npb24gbG9zcyB0aGF0IGVuY291cmFnZXMgbGFyZ2Ugb3ZlciBzbWFsbCBwcmVkaWN0ZWQgYm91bmRpbmcgYm94ZXMuIE91ciBldmFsdWF0aW9uIHN0dWR5IHNob3dzIHRoYXQgb2JqZWN0IGRldGVjdG9ycyBmaW5lLXR1bmVkIHdpdGggdGhlIGFzeW1tZXRyaWMgbG9zcyBhcmUgYmV0dGVyIGFsaWduZWQgd2l0aCBodW1hbiBwcmVmZXJlbmNlIGFuZCBhcmUgcHJlZmVycmVkIG92ZXIgZml4ZWQgc2NhbGluZyBmYWN0b3JzLiBJbiB0aGlzIHJlcG9zaXRvcnksIHdlIHByb3ZpZGUgb3VyIGNvZGUsIGluY2x1ZGluZyB0aGUgZXZhbHVhdGlvbiBvZiBvYmplY3QgZGV0ZWN0aW9uIHNpemUgYW5kIHRoZSBpbXBsZW1lbnRhdGlvbiBvZiB0aGUgdXNlciBzdHVkaWVzLiBXZSBzaGFyZSBhIEdvb2dsZSBkcml2ZSBsaW5rIHRvIHRoZSBpbWFnZXMgdXNlZCBpbiBvdXIgdXNlciBzdHVkaWVzLiZsdDsvcCZndDs8L2Rlc2NyaXB0aW9uPgogIDwvZGVzY3JpcHRpb25zPgo8L3Jlc291cmNlPg==","url":"https://data.4tu.nl/datasets/c08cb26b-3fad-4a2e-bdcf-2986d704f342","contentUrl":null,"metadataVersion":0,"schemaVersion":"http://datacite.org/schema/kernel-4","source":"api","isActive":true,"state":"findable","reason":null,"viewCount":0,"viewsOverTime":[],"downloadCount":0,"downloadsOverTime":[],"referenceCount":0,"citationCount":0,"citationsOverTime":[],"partCount":0,"partOfCount":0,"versionCount":0,"versionOfCount":0,"created":"2024-05-31T11:32:43.000Z","registered":"2024-05-31T11:32:44.000Z","published":"2024","updated":"2024-05-31T11:32:44.000Z"},"relationships":{"client":{"data":{"id":"delft.data4tu","type":"clients"}},"provider":{"data":{"id":"scpr","type":"providers"}},"media":{"data":{"id":"10.4121/c08cb26b-3fad-4a2e-bdcf-2986d704f342","type":"media"}},"references":{"data":[]},"citations":{"data":[]},"parts":{"data":[]},"partOf":{"data":[]},"versions":{"data":[]},"versionOf":{"data":[]}}}}