Scene text extraction and translation for handheld devices

Abstract

We describe a scene text extraction system for handheld devices to provide enhance information perception services to user. It uses a color camera attached to personal digital assistant as an input device to capture scene images from the real world and it employs image enhancement and segmentation methods to extract written information from the scene, convert them to text information and show them to user so that the user can see both the real world and information together. We implemented a prototype application: an automatic sign/text language translation for foreign travelers where people can use the system whenever they want to see text or signs in their own language where they are originally written in foreign language in the scene.