Towards automatic real time preparation of on-line video proceedings for conference talks and presentations

How many times did you miss a conference talk on a parallel track and wish you had a second chance to see it? Or you just wanted to see a few talks from a conference you did not attend? Video proceedings, which contain videos of all the conference talks, would be of a great value in these cases and in many others. With recent progress in digital video, streaming technology, large storage, Internet and especially video indexing and retrieval technology, video proceedings finally become a reality. The key challenge is to create it in an efficient way and to provide the user with easy, intuitive and rapid access to the talks and the snippets of video that he is looking for. This paper describes an application that allows a nearly automatic real time creation of video proceedings. All the talks are captured in video, and are automatically indexed by speech recognition and video analysis tools. The abstracts and speaker´s biography are extracted from the text proceedings and are converted to web pages. Free text search in speech and efficient multi-view video browsing are combined with a table of contents to compose fully searchable and browsable video proceedings. The paper covers different aspects of the problem, an overview of the CueVideo system and examples from two conferences that we have processed using this system.