Automatically constructing blue pages for characters in instructional videos

Abstract

This paper presents our recent work on automatically constructing blue pages for main characters in instructional videos. Specifically, a blue page is a personal profile which contains various types of information such as name, affiliation, portrait and voice that are specific to each individual. To accomplish this, we first extract various types of personal identity information from the video by analyzing multiple media cues; then we carefully correlate them with each other w.r.t. individual video characters based on an advanced video context analysis. When additional information sources are available, the constructed blue pages could be further enriched with advanced data mining and information extraction techniques. To validate the proposed ideas, we have carried out some preliminary experiments on a set of instructional videos with acceptable results obtained. © 2008 IEEE.