Provided is a method of providing an interpretation result using visual information, and the method includes: acquiring a spatial domain image including line-of-sight information of a user and gaze position information in the spatial domain image; segmenting the acquired spatial domain image into a plurality of images; detecting text areas including text for each of the segmented images; generating text blocks, each of which is a text recognition result for each of the detected text areas, and determining the text block corresponding to the gaze position information; converting a first language included in the determined text block into a second language that is a target language; and providing the user with a conversion result of the second language.

An OCR system acquires the position of an image code in a document image, acquires data indicated by the image code, and acquires the position of a handwriting input field in the document image on the basis of the position of the image code in the acquired document image, the position of the image code in the document included in the acquired data, and the position of the handwriting input field in the document included in the acquired data.

A non-transitory computer readable medium containing program instructions that when executed, cause a computer to: generate a graphical user interface; process object model(s) to generate document model(s); and process the document model(s) to generate rendered document(s). A computing system comprising one or more processors; and one or more memories storing instructions that, when executed by the one or more processors, cause the computing system to: generate a graphical user interface; process object model(s) to generate document model(s); and process the document model(s) to generate rendered document(s). A computer-implemented method for improving rendering of multiple documents via one or more document models, the method comprising: generating a graphical user interface; processing object model(s) to generate document model(s); and processing the document model(s) to generate rendered document(s).

A computer-implemented method of preloading content includes generating a user interface; receiving a set of object models; processing the received object models; based on detecting an event: (i) receiving a document model; and (ii) rendering the document model via a viewport. A non-transitory computer readable medium contains program instructions that when executed, cause a computer to generate a user interface; receive a set of object models; process the received object models; detect an event; receive a document model; and render the document model via a viewport. A computing system includes a processor and a memory storing instructions that when executed by the process, cause the computing system to generate a user interface; receive a set of object models; process the received object models; detect an event; receive a document model; and render the document model via a viewport.

Systems and methods for opening documents and incrementally loading document fragments are provided. Upon generating a user interface associated with the document, a client device may generate a document fragment model of a portion of the document for display via the user interface. As the user navigates through the document, document fragment models of additional portions of the document are predictively generated for low-latency display via the user interface.

Systems and methods for previewing documents associated with a headless object are provided. A client device may generate a primary user interface having a first viewport with a first object focus. In response to a first event, the first object focus may be set to a document model corresponding to the object. The document model may be loaded into a data memory of the client device, and the first object focus may be set to display a rendering of the document model. In response to a second event, a secondary interface of the client device may display the rendering of the document model that was loaded into the data memory.

Systems and methods for contextual highlighting and redaction of documents are provided. Upon receiving highlighting data corresponding to a document, a client device may evaluate the highlighting data to generate a highlighting model, which may be stored in a cache of the client device. In response to an event, the highlighting model may be retrieved from the cache, and analyzed to determine a highlighting portion of a document model. A rendering of the document model including highlighting in the highlighted portion of the document model may then be displayed.

A system and method for automated generation of study cards stores digital images of user highlighted content. A digital image is captured of highlighted print media by photo or scanning. Highlighted content from digitally displayed content is captured by electronic file or screenshot. Highlighted areas from captured content is determined and isolated, displayed for confirmation or correction, and labeled, organized stored or printed by the user.

A method, apparatus, electronic device, and storage medium for character recognition are provided. The method may perform image processing on an acquired original image to obtain a region to be recognized. The region may include a character. The method may determine an area ratio of the region to be recognized on the original image. The method may determine an angle between the region to be recognized and a preset direction. The method may determine a character density of the region to be recognized. The method may perform character recognition on the character in the region to be recognized in response to determining that the area ratio is greater than a ratio threshold, the angle is less than an angle threshold, and the character density is less than a density threshold.

A computer-implemented method (300) for extracting content (302) from a physical writing surface (304), the method (300) comprising the steps of:

(a) receiving a reference frame (306) including image data relating to at least a portion of the physical writing surface (304), the image data including a set of data points;

(b) determining an extraction region (308), the extraction region (308) including a subset of the set of data points from which content (302) is to be extracted;

(c) extracting content (302) from the extraction region (308) and writing the content (302) to a display frame (394);

(d) receiving a subsequent frame (406) including subsequent image data relating to at least a portion of the physical writing surface (304), the subsequent image data including a subsequent set of data points;

(e) determining a subsequent extraction region (408), the subsequent extraction region (408) including a subset of the subsequent set of data points from which content (402) is to be extracted; and

(f) extracting subsequent content (402) from the subsequent extraction region (408) and writing the subsequent content (402) to the display frame (394).