This disclosure describes interactive data processing systems configured to facilitate selection by a human associate of tentative results generated by an automated system from sensor data. In one implementation, an event may take place in a materials handling facility. The event may comprise a pick or place of an item from an inventory location, movement of a user, and so forth. The sensor data associated with the event is processed by an automated system to determine tentative results associated with the event. In some situations, an uncertainty may exist as to which of the tentative results accurately reflects the actual event. The system may then determine whether the event is to be merged with one or more temporally and spatially proximate events and, if so, the sensor data and tentative results for the merged event is sent to a human associate. The associate may select one of the tentative results.

Generally, a system and method for an automatic detection of referee's decisions during a ball-game match are provided. The method may include receiving a plurality of images of a ball-game field generated during the ball-game match; determining, based on predetermined ball-game rules, a first subset of images of the plurality of images representing a first event that is suspected as a specified rule-based event; determining, based on the predetermine ball-game rules, a second subset of images of the plurality of images that represents a second event, wherein the second event is subsequent to the specified rule-based event according to the predetermined ball-game rules; and analyzing, based on the predetermined ball-game rules, the images of the second subset and further determining, based on the analysis thereof, a referee's decision concerning whether the first even is the specified rule-based event.

An image processing apparatus includes: a receiving unit configured to receive an addition instruction for adding a page to album data including a plurality of pages; an image obtaining unit configured to obtain a user selection image as an image to be arranged in the page to be added in response to the addition instruction, the user selection image being selected by a user; a first analysis information obtaining unit configured to obtain analysis information of the user selection image; and a selecting unit configured to select an image to be arranged in the added page other than the user selection image, based on the analysis information of the user selection image.

A contextual query system is configured to perform operations that include: causing display of a graphical user interface at a client device, the graphical user interface including a display of image data that comprises a set of image features; generating a query based on the set of image features of the image data; accessing media content based on the query at a repository, the repository comprising a collection of media content; and causing display of a presentation of the media content within the graphical user interface at the client device.

According to the present invention, there is provided an information processing system (100) including an acquisition unit (11) that acquires an image, which is generated by a camera, of a face, a selection unit (14) that extracts a person in the acquired image, and selects a person who performs a settlement process based on at least one of a distance from a checkout apparatus, an appearance frequency, and an appearance period of time in a case where a plurality of persons are extracted, an identification unit (12) that identifies the selected person based on the image in which the person is included, and database information in which a feature value of a face is registered, a settlement unit (checkout unit (21)) that performs the settlement process with respect to the identified person.

Described herein are a system and methods for generating a record of objects, as well as respective positions for those objects, with respect to a user. In some embodiments, a user may use a user device to scan an area that includes one or more objects. The one or more objects may be identified from image information obtained from the user device. Positional information for each of the one or more objects may be determined from depth information obtained from a depth sensor installed upon the user device. In some embodiments, the one or more objects may be mapped to object models stored in an object model database. The image information displayed on the user device may be augmented so that it depicts the object models associated with the one or more objects instead of the actual objects.

A computer system trains a neural network on an instance segmentation task by casting the problem as one of mapping each pixel to a probability distribution over arbitrary instance labels. This simplifies both the training and inference problems, because the formulation is end-to-end trainable and requires no post-processing to extract maximum a posteriori estimates of the instance labels.

Approaches are described for shape-based graphics search. Each graphics object of a set of graphics objects is analyzed. The analyzing includes determining an outline of the graphics object from graphics data that forms the graphics object. The outline of the graphics object is sampled resulting in sampled points that capture the outline of the graphics object. A shape descriptor of the graphics object is determined which captures local and global geometric properties of the sampled points. Search results of a search query are determined based on a comparison between a shape descriptor of a user identified graphics object and the shape descriptor of at least one graphics object of the set of graphics objects. At least one of the search results can be presented on a user device associated with the search query.

A method, system and computer readable medium for performing a cognitive search operation comprising: receiving training data, the training data comprising information based upon user interaction with cognitive attributes; performing a machine learning operation on the training data; generating a cognitive profile based upon the information generated by performing the machine learning operation; and, performing a cognitive search operation on a corpus of content based upon the cognitive profile, the cognitive search operation returning cognitive results specific to the cognitive profile of the user.

A computer-implemented augmented reality-based method provides a user device access to data content by processing of camera image captured by the user device to identify a candidate visual area, which are then processed to identify visual features indicative of available data content. The identified features are compared to visual features of database objects indicative of available data content, and a determination made regarding the object that corresponds to the identified features. Instructions are then generated to augment a display of the camera image with selectable image features. In response to a selection of one of the selectable image features, a determination is made regarding whether the user device has permission to access the data content associated with the selected image feature. If not, a payment settlement arrangement is implemented for the user device to gain access permission to the data content.