Tom Stoll

ACTION: Cross-Modal Cinematics, Auteur Classification, and Audio-Visual Structure in Film

Digital Music Research Network Workshop
Content-based analysis of video using audio and visual features has previously been used for the automatic tasks of scene/shot segmentation and video summarization. We present new work that extends this research to automatically extract and compare the narrative structure of feature films, discover patterns in the relationship of music, sound, and image, and classify films according to their director using audio, visual, and joint audio-visual features.