Optical character recognition (OCR) based systems and methods for extracting and automatically evaluating contextual and identification information and associated metadata from an image utilizing enhanced image processing techniques and image segmentation. A unique, comprehensive integration with an account provider system and other third party systems may be utilized to automate the execution of an action associated with an online account. The system may evaluate text extracted from a captured image utilizing machine learning processing to classify an image type for the captured image, and select an optical character recognition model based on the classified image type. They system may compare a data value extracted from the recognized text for a particular data type with an associated online account data value for the particular data type to evaluate whether to automatically execute an action associated with the online account linked to the image based on the data value comparison.

A detected quadrilateral area is displayed and no group of candidate lines is displayed in a normal state. While a user is selecting a side that the user desires to change, a group of candidate lines corresponding to the selected side is displayed. Then, whether to replace a position of the selected side with a position of a candidate line is determined based on a movement destination position of the selected side.

The technology described herein employs techniques for overlaying (superimposing) translated text on top of (over) scanned text in realtime. The technology recognizes text in an image and identifies a first language in which the text is written. The technology translates the text into a second language and generates an overlay in the second language. The overlay is then inserted into the display over the text in the image.

Biometric data are obtained from biometric sensors on a stand-alone computing device, which may contain an ASIC, connected to or incorporated within it. The computing device and ASIC, in combination or individually, capture biometric samples, extract biometric features and match them to one or more locally stored, encrypted templates. The biometric matching may be enhanced by the use of an entered PIN. The biometric templates and other sensitive data at rest are encrypted using hardware elements of the computing device and ASIC, and/or a PIN hash. A stored obfuscated PassWord is de-obfuscated and may be released to the authentication mechanism in response to successfully decrypted templates and matching biometric samples. A different de-obfuscated password may be released to authenticate the user to a remote or local computer and to encrypt data in transit. This eliminates the need for the user to remember and enter complex passwords on the device.

During an information-extraction technique, visual suitability indicators may be displayed to a user of the electronic device to assist the user in acquiring an image of a document that is suitable for subsequent extraction of textual information. For example, an imaging application executed by the electronic device may display, in a window associated with the imaging application, a visual suitability indicator of a tilt orientation of the electronic device relative to a plane of the document. When the tilt orientation falls within a predefined range, the electronic device may modify the visual suitability indicators to provide visual feedback to the user. Then, the electronic device may acquire the image of the document using an imaging device, which is integrated into the electronic device. Next, the electronic device may extract the textual information from the image of the document using optical character recognition.

An image processing method of processing a gray-scale image of character strings arranged in a plurality of lines of text, for character recognition, includes setting at least a part of a range, in which the character strings in the gray-scale image area are distributed, as a search area, and setting, for each of a plurality of points arranged along one of two axes, representing coordinates in the image, corresponding to an arrangement of the line of text, a plurality of lines extending across the search area, with the point as a starting point, and accumulating, for each of the lines, pixel data in the line within the search area.

A method and system. An initial angle of rotation is determined by sampling test angles of rotation of a captured digital image and analyzing resultant rotated images to determine a resultant rotated image with a highest number of substantially empty lines. The captured digital image is rotated by the initial angle of rotation to generate a first rotated image. A representative line of each line area of multiple text line areas of the first rotated image is generated. A slope of each representative line is calculated. An aggregated slope of the representative lines is determined. The aggregated slope is converted to a refining angle of rotation. The refining angle of rotation is validated by finding points of intersection of lines connecting opposing ends of adjacent representative lines. The first rotated image is rotated by the refining angle of rotation to result in a final rotated image.

The technology described herein employs techniques for overlaying (superimposing) translated text on top of (over) scanned text in realtime. The technology recognizes text in an image and identifies a first language in which the text is written. The technology translates the text into a second language and generates an overlay in the second language. The overlay is then inserted into the display over the text in the image.

An information processing apparatus includes a reading unit, an edge extraction unit, a feature point search unit, a document area size calculation unit, a user operation unit, and a multi-feed determination unit. The reading unit optically reads a document to generate image data. The edge extraction unit extracts an edge of the document from the image data. The feature point search unit searches edge data of the edge extracted by the edge extraction unit for a feature point. The document area size calculation unit calculates a document area size from the feature point found by the feature point search unit. The user operation unit is used by a user to specify a document size. The multi-feed determination unit compares the document area size calculated by the document area size calculation unit with the user-specified document size so as to determine whether multi-feed of the document has occurred.

A method implemented on a mobile device for selecting information on a paper document using a hand-held scanning device. The method provides an interface to the user, receives information from the hand-held pen scanning device connected to the mobile device and determines if the received information is valid information for the type of information to be selected. The invention further relates to using a remote computer for performing image processing and data extraction when more powerful resources are needed.