Summarising the Visual via the Verbal

By Eleftheria Tomadaki.

Published by The Technology Collection

Format Price
Article: Print $US10.00
Article: Electronic $US5.00

Video summarisation can be costly and time consuming, taking into account the increasing amount and diversity of multimedia information provided by multimedia production industries. Recent automatic film summarisation approaches focus on content-based video retrieval or cross-media retrieval through text summarisation based on statistical approaches. As a range of texts describing film content is freely available on the Internet or provided by video production organisations, this paper introduces a cross-media method, departing from existing textual summaries to produce the corresponding video summaries. A multi-disciplinary approach is suggested, combining cross-document coreference and information extraction and retrieval techniques, to produce on demand film summaries. The method is inspired by the lexical analysis of a corpus of plot summaries, including short overviews of the film story, and a corpus of audio description, including time-coded detailed descriptions by experts narrating what is happening on screen. The user evaluation of the method on one summary shows encouraging results regarding the precision and selection of the retrieved video shots. The suggested approach may also be customised for visually impaired people, adapted for different kinds of data and evaluated in different contexts, such as virtual meeting summarisation and browsing.

Keywords: Cross-Document Coreference, Cross-Media Summarisation, Collateral Text, Information Extraction, Intelligent Multimedia Information Retrieval

The International Journal of Technology, Knowledge and Society, Volume 4, Issue 6, pp.1-12. Article: Print (Spiral Bound). Article: Electronic (PDF File; 975.642KB).

Dr. Eleftheria Tomadaki

The Open University, Milton Keynes, UK

Eleftheria Tomadaki is a research fellow in the Knowledge Media Institute (Open University, UK), focusing on collaborative media, e-Learning and social software. Her role involves the integration of the video conferencing tool Flash Meeting with the Moodle e-Learning environment and the development of a theory and analytical framework to underpin the study of large-scale synchronous collaborative media, in the context of the Open Content Initiative. She received her PhD in information extraction by the University of Surrey. Her PhD research investigated the merging of information from texts describing video content for video annotation by employing cross-document coreference techniques and introduced a new and challenging scenario - film and the variety of collateral text genres narrating its content, including unrestricted sets of events.


There are currently no reviews of this product.

Write a Review