Automatic indexing of broadcast content using its live chat on the Web

A method of automatically indexing broadcast content using live chat on the Web is proposed. The live chat is a Web bulletin board where the viewers post messages in sync with a TV program. Statistical analysis and pattern recognition of these messages can effectively extract metadata related to viewer´s viewpoints such as important scenes in the program or responses by a particular viewer. Preliminary experiments indicate that the proposed method can efficiently extract metadata such as the intensity of viewers´ responses and degree of emotional delight or depression. They also indicate that a prototype TV viewing system using the extracted metadata enables a new way of viewing TV content from different perspectives reflecting viewers´ viewpoints.