Techniques are described for cognitive analysis for directed control transfer for autonomous vehicles. In-vehicle sensors are used to collect cognitive state data for an individual within a vehicle which has an autonomous mode of operation. The cognitive state data includes infrared, facial, audio, or biosensor data. One or more processors analyze the cognitive state data collected from the individual to produce cognitive state information. The cognitive state information includes a subset or summary of cognitive state data, or an analysis of the cognitive state data. The individual is scored based on the cognitive state information to produce a cognitive scoring metric. A state of operation is determined for the vehicle. A condition of the individual is evaluated based on the cognitive scoring metric. Control is transferred between the vehicle and the individual based on the state of operation of the vehicle and the condition of the individual.

Systems and methods are disclosed to objectively identify sub-second behavioral modules in the three-dimensional (3D) video data that represents the motion of a subject. Defining behavioral modules based upon structure in the 3D video data itself—rather than using a priori definitions for what should constitute a measurable unit of action—identifies a previously-unexplored sub-second regularity that defines a timescale upon which behavior is organized, yields important information about the components and structure of behavior, offers insight into the nature of behavioral change in the subject, and enables objective discovery of subtle alterations in patterned action. The systems and methods of the invention can be applied to drug or gene therapy classification, drug or gene therapy screening, disease study including early detection of the onset of a disease, toxicology research, side-effect study, learning and memory process study, anxiety study, and analysis in consumer behavior.

A method for avoiding obstacles surrounding a mobile vehicle is disclosed. The method discloses that it is more accurate to merge images after a depth information is obtained to construct an environment information. The mobile vehicle set an omnidirectional depth sensing module using a lot of depth sensors for capturing a depth information of an environment surrounding the mobile vehicle and identifying the obstacles on the road upon the depth information. Also, scanning the smooth degree of the road for identifying static obstacles and moved obstacles, Thereby, a control circuit controls the mobile vehicle to lower speed or circumvent the danger.

An information processing apparatus acquires video image data that includes target objects including a person and an object, and specifies, by using graph data that indicates a relationship between each of target objects stored in a storage unit, a relationship between each of the target objects included in the acquired video image data. The information processing apparatus specifies, by using a feature value of the person included in the acquired video image data, a behavior of the person included in the video image data. The information processing apparatus predicts, by inputting the specified behavior of the person and the specified relationship to a probability model, a future behavior or a future state of the person.

Systems and methods for managing visual allocation are provided herein that use models to determine states based on visual data and, based thereon, output feedback based on the determined states. Visual data is initially obtained by a visual allocation management system. The visual data includes eye image sequences of a person in a particular state, such as engaging in a task or activity. Visual features can be identified from the visual data, such that glance information including direction and duration can be calculated. The visual data, information derived therefrom, and/or other contextual data is input into the models, which correspond to states, to calculate probabilities that the particular state that the person is engaged in is one of the modeled states. Based on the state identified as having the highest probability, an optimal feedback, such as a warning or instruction, can be output to a connected devices, systems, or objects.

Various embodiments described herein relate to techniques for forecasting with state transitions and confidence factors. In this regard, a system is configured to segment data associated with one or more assets to determine a set of classifications for one or more attributes related to the one or more assets. The system is also configured to generate a state machine associated with a Markov chain model based on the set of classifications for the data. Furthermore, the system is configured to perform a machine learning process associated with the state machine to determine one or more behavior changes associated with the one or more attributes related to the one or more assets. The system is also configured to predict, based on the one or more behavior changes associated with the one or more attributes related to the one or more assets, a change in demand data for the one or more assets during a future interval of time.

A detection-based segmentation-free method and system for license plate recognition. An image of a vehicle is initially captured utilizing an image-capturing unit. A license plate region is located in the image of the vehicle. A set of characters can then be detected in the license plate region and a geometry correction performed based on a location of the set of characters detected in the license plate region. An operation for sweeping an OCR across the license plate region can be performed to infer characters with respect to the set of characters and locations of the characters utilizing a hidden Markov model and leveraging anchored digit/character locations.

A digital medium environment includes an image processing application that performs object segmentation on an input image. An improved object segmentation method implemented by the image processing application comprises receiving an input image that includes an object region to be segmented by a segmentation process, processing the input image to provide a first segmentation that defines the object region, and processing the first segmentation to provide a second segmentation that provides pixel-wise label assignments for the object region. In some implementations, the image processing application performs improved sky segmentation on an input image containing a depiction of a sky.

Techniques and systems are described for performing video segmentation using fully connected object proposals. For example, a number of object proposals for a video sequence are generated. A pruning step can be performed to retain high quality proposals that have sufficient discriminative power. A classifier can be used to provide a rough classification and subsampling of the data to reduce the size of the proposal space, while preserving a large pool of candidate proposals. A final labeling of the candidate proposals can then be determined, such as a foreground or background designation for each object proposal, by solving for a posteriori probability of a fully connected conditional random field, over which an energy function can be defined and minimized.

The playback of media by a playback device is controlled by input gestures. Each user gesture can be first broken down into a base gesture which indicates a specific playback mode. The gesture is then broken down into a second part which contains a modifier command which determines the speed for the playback mode determined from the base command. Media content is then played using the specified playback mode at a speed determined by the modifier command.