DocumentCode
253710
Title
StoryGraphs: Visualizing Character Interactions as a Timeline
Author
Tapaswi, Makarand ; Bauml, Martin ; Stiefelhagen, Rainer
Author_Institution
Karlsruhe Inst. of Technol., Karlsruhe, Germany
fYear
2014
fDate
23-28 June 2014
Firstpage
827
Lastpage
834
Abstract
We present a novel way to automatically summarize and represent the storyline of a TV episode by visualizing character interactions as a chart. We also propose a scene detection method that lends itself well to generate over-segmented scenes which is used to partition the video. The positioning of character lines in the chart is formulated as an optimization problem which trades between the aesthetics and functionality of the chart. Using automatic person identification, we present StoryGraphs for 3 diverse TV series encompassing a total of 22 episodes. We define quantitative criteria to evaluate StoryGraphs and also compare them against episode summaries to evaluate their ability to provide an overview of the episode.
Keywords
data visualisation; entertainment; image segmentation; object recognition; optimisation; video signal processing; StoryGraphs; TV episode; TV series; automatic person identification; character interaction visualization; character line positioning; episode overview; episode summaries; optimization problem; over-segmented scene generation; scene detection method; storyline representation; storyline summarization; timeline; video partitioning; Dynamic programming; Image color analysis; Motion pictures; Optimization; Silicon; TV; Visualization;
fLanguage
English
Publisher
ieee
Conference_Titel
Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on
Conference_Location
Columbus, OH
Type
conf
DOI
10.1109/CVPR.2014.111
Filename
6909506
Link To Document