Extracting semantic information through illumination classification

A system is presented for automatic classification of the atmosphere in motion pictures scenes. This classification is based solely on the extraction of approximate illumination information from single frames. By using well defined film grammar rules regarding scene lighting, it generates high level semantic descriptors for frames and scenes. These illumination descriptors could be further combined with other descriptors like motion and sound, to generate a complete automatic semantic analysis system of video media.