Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, modifying queries based on non-textual content. In one aspect, a method includes receiving, from a user device, a query including a plurality of terms; determining active non-textual data displayed in an application environment on the user device; determining, from the non-textual textual data, modification data for the query; generating a set of modified queries based on the query and the modification parameters; scoring the modified queries according to one or more scoring criteria; selecting one of the modified queries based on the scoring; and providing, to the user device, search results responsive to the selected modified query.

A computerized method, system for, and computer-readable medium operable to: retrieve program details data about at least one media program. Retrieve social media posts involving the at least one media program. Match the retrieved program details data with the retrieved social media posts to find matching locations. Store time offset data corresponding to the matched locations within the at least one media program into at least one micropost. Rank the at least one media program by the number of microposts corresponding to the at least one media program. Present the at least one media program, each of the at least one media program with at least one micropost, wherein the at least one micropost comprises a link to the original social media page hosting the social media post and a video deeplink that plays a time off-set video, the time off-set video starting from the stored time offset data.

A system for selecting an image to accompany text from a user in connection with a social media post. The system includes receiving text from the user; identifying one or more search terms based on the text; identifying candidate images from images in one or more image databases using the search terms, where the candidate images comprise a sponsored image; presenting one or more candidate images to the user, where the sponsored image is presented preferentially compared to other candidate images; receiving from the user a selected image from the one or more candidate images; generating the social media post comprising the selected image and the user-submitted text; and transmitting the social media post for display.

Systems and methods of providing content selection are provided. For instance, one or more signals indicative of a user selection of an object displayed within a user interface can be received. Responsive to receiving the one or more signals, a content attribute associated with one or more objects displayed within the user interface can be identified. A content entity can be determined based at least in part on the content attribute and the user selection. One or more relevant actions can then be determined based at least in part on the determined content entity. Data indicative of the relevant actions can then be provided for display.

A system and method for matching a second electronic document to a first electronic document, the first electronic document including at least partially unstructured data of a transaction. The method includes: analyzing the at least partially unstructured data to determine at least one transaction parameter; creating a template for the first electronic document, wherein the template is a structured dataset including the determined at least one transaction parameter; determining, based on the template, a portion of the first electronic document requiring evidence; searching, based on the template, for a second electronic document, wherein the second electronic document indicates of the evidence-requiring portion; and associating the second electronic document with the first electronic document.

There is presented a method and system for providing a compact graphical user interface for flexible filtering of data. The method comprises showing a search interface on a display device for filtering a content set by a plurality of domains, including a first domain, displaying, within the search interface, a first graphical representation of a parameter set of the first domain in response to a selecting of the first domain, receiving a first parameter subset from the first graphical representation, filtering a content set using the first parameter subset to obtain a search result, and displaying the search result on a display device. The search interface includes a temporally visible menu for selecting parameter sets of the domains and a compact single line query box to display graphical representations of parameter sets or to provide a conventional text entry box.

According to one embodiment, in response to a search query received from a client, a search is performed in a content database to identify a list of one or more content items based on one or more keywords of the search query. A first search is performed in an image store to identify a first set of one or more images using a first image searching method. A second search is performed in the image store to identify a second set of one or more images using a second image searching method that is different than the first image searching method. A search result is transmitted to the client, the search result having at least a portion of the content items to the client. Each content item is associated with one of the images selected from the first set of images or the second set of images.

Systems and methods to improve the optical character recognition of records, and in particular health records, are provided. An image of a medical record is received, and an initial optical image recognition (OCR) on the image is performed to identify text information. The OCR signal quality may be measured, and areas of insufficient OCR signal quality may be isolated. The signal quality is determined by a weighted average of semantic analysis of the resulting text, and/or OCR accuracy measures. The OCR process may be repeated on the isolated regions of lower signal quality, each time using a different OCR transform, until all regions are completed with a desired degree of signal quality (accuracy). All the regions of the document may then be recompiled into a single document for outputting.

An augmented reality (AR) overlay augments traditional menu items with corresponding photos, thereby facilitating a decision-making process of a user ordering from the menu. In addition to providing imagery of the menu items listed, other information may also be supplied, such as ratings, reviews etc. In this regard, users can visualize what to expect before ordering, and can order with a greater degree of confidence that they will enjoy the menu item they select.

A system and method of identifying objects is provided. In one aspect, the system and method includes a hand-held device with a display, camera and processor. As the camera captures images and displays them on the display, the processor compares the information retrieved in connection with one image with information retrieved in connection with subsequent images. The processor uses the result of such comparison to determine the object that is likely to be of greatest interest to the user. The display simultaneously displays the images the images as they are captured, the location of the object in an image, and information retrieved for the object.