{"data":{"id":"10.48550/arxiv.1806.04620","type":"dois","attributes":{"doi":"10.48550/arxiv.1806.04620","prefix":"10.48550","suffix":"arxiv.1806.04620","identifiers":[{"identifier":"1806.04620","identifierType":"arXiv"}],"alternateIdentifiers":[{"alternateIdentifierType":"arXiv","alternateIdentifier":"1806.04620"}],"creators":[{"name":"Furlan, Vinicius S.","nameType":"Personal","givenName":"Vinicius S.","familyName":"Furlan","affiliation":[],"nameIdentifiers":[]},{"name":"Bajcsy, Ruzena","nameType":"Personal","givenName":"Ruzena","familyName":"Bajcsy","affiliation":[],"nameIdentifiers":[]},{"name":"Nascimento, Erickson R.","nameType":"Personal","givenName":"Erickson R.","familyName":"Nascimento","affiliation":[],"nameIdentifiers":[]}],"titles":[{"title":"Fast forwarding Egocentric Videos by Listening and Watching"}],"publisher":"arXiv","container":{},"publicationYear":2018,"subjects":[{"lang":"en","subject":"Computer Vision and Pattern Recognition (cs.CV)","subjectScheme":"arXiv"},{"subject":"FOS: Computer and information sciences","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Computer and information sciences","schemeUri":"http://www.oecd.org/science/inno/38235147.pdf","subjectScheme":"Fields of Science and Technology (FOS)"}],"contributors":[],"dates":[{"date":"2018-06-12T15:58:53Z","dateType":"Submitted","dateInformation":"v1"},{"date":"2018-06-13T00:13:10Z","dateType":"Updated","dateInformation":"v1"},{"date":"2018-06","dateType":"Available","dateInformation":"v1"},{"date":"2018","dateType":"Issued"}],"language":null,"types":{"ris":"GEN","bibtex":"misc","citeproc":"article","schemaOrg":"CreativeWork","resourceType":"Article","resourceTypeGeneral":"Preprint"},"relatedIdentifiers":[],"relatedItems":[],"sizes":[],"formats":[],"version":"1","rightsList":[{"rights":"arXiv.org perpetual, non-exclusive license","rightsUri":"http://arxiv.org/licenses/nonexclusive-distrib/1.0/"}],"descriptions":[{"description":"The remarkable technological advance in well-equipped wearable devices is pushing an increasing production of long first-person videos. However, since most of these videos have long and tedious parts, they are forgotten or never seen. Despite a large number of techniques proposed to fast-forward these videos by highlighting relevant moments, most of them are image based only. Most of these techniques disregard other relevant sensors present in the current devices such as high-definition microphones. In this work, we propose a new approach to fast-forward videos using psychoacoustic metrics extracted from the soundtrack. These metrics can be used to estimate the annoyance of a segment allowing our method to emphasize moments of sound pleasantness. The efficiency of our method is demonstrated through qualitative results and quantitative results as far as of speed-up and instability are concerned.","descriptionType":"Abstract"}],"geoLocations":[],"fundingReferences":[],"xml":"PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4KPHJlc291cmNlIHhtbG5zPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSIgeHNpOnNjaGVtYUxvY2F0aW9uPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCBodHRwOi8vc2NoZW1hLmRhdGFjaXRlLm9yZy9tZXRhL2tlcm5lbC00LjMvbWV0YWRhdGEueHNkIj4KICA8aWRlbnRpZmllciBpZGVudGlmaWVyVHlwZT0iRE9JIj4xMC40ODU1MC9BUlhJVi4xODA2LjA0NjIwPC9pZGVudGlmaWVyPgogIDxhbHRlcm5hdGVJZGVudGlmaWVycz4KICAgIDxhbHRlcm5hdGVJZGVudGlmaWVyIGFsdGVybmF0ZUlkZW50aWZpZXJUeXBlPSJhclhpdiI+MTgwNi4wNDYyMDwvYWx0ZXJuYXRlSWRlbnRpZmllcj4KICA8L2FsdGVybmF0ZUlkZW50aWZpZXJzPgogIDxjcmVhdG9ycz4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5GdXJsYW4sIFZpbmljaXVzIFMuPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5WaW5pY2l1cyBTLjwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5GdXJsYW48L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgICA8Y3JlYXRvcj4KICAgICAgPGNyZWF0b3JOYW1lIG5hbWVUeXBlPSJQZXJzb25hbCI+QmFqY3N5LCBSdXplbmE8L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPlJ1emVuYTwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5CYWpjc3k8L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgICA8Y3JlYXRvcj4KICAgICAgPGNyZWF0b3JOYW1lIG5hbWVUeXBlPSJQZXJzb25hbCI+TmFzY2ltZW50bywgRXJpY2tzb24gUi48L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPkVyaWNrc29uIFIuPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPk5hc2NpbWVudG88L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgPC9jcmVhdG9ycz4KICA8dGl0bGVzPgogICAgPHRpdGxlPkZhc3QgZm9yd2FyZGluZyBFZ29jZW50cmljIFZpZGVvcyBieSBMaXN0ZW5pbmcgYW5kIFdhdGNoaW5nPC90aXRsZT4KICA8L3RpdGxlcz4KICA8cHVibGlzaGVyPmFyWGl2PC9wdWJsaXNoZXI+CiAgPHB1YmxpY2F0aW9uWWVhcj4yMDE4PC9wdWJsaWNhdGlvblllYXI+CiAgPHN1YmplY3RzPgogICAgPHN1YmplY3QgeG1sOmxhbmc9ImVuIiBzdWJqZWN0U2NoZW1lPSJhclhpdiI+Q29tcHV0ZXIgVmlzaW9uIGFuZCBQYXR0ZXJuIFJlY29nbml0aW9uIChjcy5DVik8L3N1YmplY3Q+CiAgICA8c3ViamVjdCBzdWJqZWN0U2NoZW1lPSJGaWVsZHMgb2YgU2NpZW5jZSBhbmQgVGVjaG5vbG9neSAoRk9TKSI+Rk9TOiBDb21wdXRlciBhbmQgaW5mb3JtYXRpb24gc2NpZW5jZXM8L3N1YmplY3Q+CiAgPC9zdWJqZWN0cz4KICA8ZGF0ZXM+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iU3VibWl0dGVkIiBkYXRlSW5mb3JtYXRpb249InYxIj4yMDE4LTA2LTEyVDE1OjU4OjUzWjwvZGF0ZT4KICAgIDxkYXRlIGRhdGVUeXBlPSJVcGRhdGVkIiBkYXRlSW5mb3JtYXRpb249InYxIj4yMDE4LTA2LTEzVDAwOjEzOjEwWjwvZGF0ZT4KICAgIDxkYXRlIGRhdGVUeXBlPSJBdmFpbGFibGUiIGRhdGVJbmZvcm1hdGlvbj0idjEiPjIwMTgtMDY8L2RhdGU+CiAgPC9kYXRlcz4KICA8cmVzb3VyY2VUeXBlIHJlc291cmNlVHlwZUdlbmVyYWw9IlByZXByaW50Ij5BcnRpY2xlPC9yZXNvdXJjZVR5cGU+CiAgPHZlcnNpb24+MTwvdmVyc2lvbj4KICA8cmlnaHRzTGlzdD4KICAgIDxyaWdodHMgcmlnaHRzVVJJPSJodHRwOi8vYXJ4aXYub3JnL2xpY2Vuc2VzL25vbmV4Y2x1c2l2ZS1kaXN0cmliLzEuMC8iPmFyWGl2Lm9yZyBwZXJwZXR1YWwsIG5vbi1leGNsdXNpdmUgbGljZW5zZTwvcmlnaHRzPgogIDwvcmlnaHRzTGlzdD4KICA8ZGVzY3JpcHRpb25zPgogICAgPGRlc2NyaXB0aW9uIGRlc2NyaXB0aW9uVHlwZT0iQWJzdHJhY3QiPlRoZSByZW1hcmthYmxlIHRlY2hub2xvZ2ljYWwgYWR2YW5jZSBpbiB3ZWxsLWVxdWlwcGVkIHdlYXJhYmxlIGRldmljZXMgaXMgcHVzaGluZyBhbiBpbmNyZWFzaW5nIHByb2R1Y3Rpb24gb2YgbG9uZyBmaXJzdC1wZXJzb24gdmlkZW9zLiBIb3dldmVyLCBzaW5jZSBtb3N0IG9mIHRoZXNlIHZpZGVvcyBoYXZlIGxvbmcgYW5kIHRlZGlvdXMgcGFydHMsIHRoZXkgYXJlIGZvcmdvdHRlbiBvciBuZXZlciBzZWVuLiBEZXNwaXRlIGEgbGFyZ2UgbnVtYmVyIG9mIHRlY2huaXF1ZXMgcHJvcG9zZWQgdG8gZmFzdC1mb3J3YXJkIHRoZXNlIHZpZGVvcyBieSBoaWdobGlnaHRpbmcgcmVsZXZhbnQgbW9tZW50cywgbW9zdCBvZiB0aGVtIGFyZSBpbWFnZSBiYXNlZCBvbmx5LiBNb3N0IG9mIHRoZXNlIHRlY2huaXF1ZXMgZGlzcmVnYXJkIG90aGVyIHJlbGV2YW50IHNlbnNvcnMgcHJlc2VudCBpbiB0aGUgY3VycmVudCBkZXZpY2VzIHN1Y2ggYXMgaGlnaC1kZWZpbml0aW9uIG1pY3JvcGhvbmVzLiBJbiB0aGlzIHdvcmssIHdlIHByb3Bvc2UgYSBuZXcgYXBwcm9hY2ggdG8gZmFzdC1mb3J3YXJkIHZpZGVvcyB1c2luZyBwc3ljaG9hY291c3RpYyBtZXRyaWNzIGV4dHJhY3RlZCBmcm9tIHRoZSBzb3VuZHRyYWNrLiBUaGVzZSBtZXRyaWNzIGNhbiBiZSB1c2VkIHRvIGVzdGltYXRlIHRoZSBhbm5veWFuY2Ugb2YgYSBzZWdtZW50IGFsbG93aW5nIG91ciBtZXRob2QgdG8gZW1waGFzaXplIG1vbWVudHMgb2Ygc291bmQgcGxlYXNhbnRuZXNzLiBUaGUgZWZmaWNpZW5jeSBvZiBvdXIgbWV0aG9kIGlzIGRlbW9uc3RyYXRlZCB0aHJvdWdoIHF1YWxpdGF0aXZlIHJlc3VsdHMgYW5kIHF1YW50aXRhdGl2ZSByZXN1bHRzIGFzIGZhciBhcyBvZiBzcGVlZC11cCBhbmQgaW5zdGFiaWxpdHkgYXJlIGNvbmNlcm5lZC48L2Rlc2NyaXB0aW9uPgogIDwvZGVzY3JpcHRpb25zPgo8L3Jlc291cmNlPg==","url":"https://arxiv.org/abs/1806.04620","contentUrl":null,"metadataVersion":0,"schemaVersion":"http://datacite.org/schema/kernel-4","source":"mds","isActive":true,"state":"findable","reason":null,"viewCount":0,"viewsOverTime":[],"downloadCount":0,"downloadsOverTime":[],"referenceCount":0,"citationCount":0,"citationsOverTime":[],"partCount":0,"partOfCount":0,"versionCount":0,"versionOfCount":0,"created":"2022-03-02T03:54:02.000Z","registered":"2022-03-02T03:54:03.000Z","published":"2018","updated":"2022-03-02T03:54:03.000Z"},"relationships":{"client":{"data":{"id":"arxiv.content","type":"clients"}},"provider":{"data":{"id":"arxiv","type":"providers"}},"media":{"data":{"id":"10.48550/arxiv.1806.04620","type":"media"}},"references":{"data":[]},"citations":{"data":[]},"parts":{"data":[]},"partOf":{"data":[]},"versions":{"data":[]},"versionOf":{"data":[]}}}}