Skip to Main content Skip to Navigation
Conference papers

Is There a "Language of Music-Video Clips" ? A Qualitative and Quantitative Study

Laure Prétet 1, 2, 3 Gaël Richard 1, 2 Geoffroy Peeters 1, 2
Abstract : Recommending automatically a video given a music or a music given a video has become an important asset for the audiovisual industry-with user-generated or professional content. While both music and video have specific temporal organizations, most current works do not consider those and only focus on globally recommending a media. As a first step toward the improvement of these recommendation systems, we study in this paper the relationship between music and video temporal organization. We do this for the case of official music videos, with a quantitative and a qualitative approach. Our assumption is that the movement in the music are correlated to the ones in the video. To validate this, we first interview a set of internationally recognized music video experts. We then perform a largescale analysis of official music-video clips (which we manually annotated into video genres) using MIR description tools (downbeats and functional segments estimation) and Computer Vision tools (shot detection). Our study confirms that a "language of music-video clips" exists; i.e. editors favor the co-occurrence of music and video events using strategies such as anticipation. It also highlights that the amount of co-occurrence depends on the music and video genres.
Complete list of metadata

https://hal.telecom-paris.fr/hal-03330800
Contributor : Laure Prétet Connect in order to contact the contributor
Submitted on : Wednesday, September 1, 2021 - 11:33:25 AM
Last modification on : Tuesday, October 19, 2021 - 11:16:31 AM

File

 Restricted access
To satisfy the distribution rights of the publisher, the document is embargoed until : 2021-11-15

Please log in to resquest access to the document

Identifiers

  • HAL Id : hal-03330800, version 1

Collections

Citation

Laure Prétet, Gaël Richard, Geoffroy Peeters. Is There a "Language of Music-Video Clips" ? A Qualitative and Quantitative Study. ISMIR, Nov 2021, Virtual Event, France. ⟨hal-03330800⟩

Share

Metrics

Record views

81