According to an aspect of an embodiment, operations may comprise accessing high definition (HD) map data of a region, presenting, via a user interface, information describing the HD map data, receiving instructions, via the user interface, for modifying the HD map data by adding one or more synthetic objects to locations in the HD map data, modifying the HD map data based on the received instructions, and generating a synthetic track in the modified HD map data comprising, for each of one or more vehicle poses, generated synthetic sensor data based on the one or more synthetic objects in the modified HD map data.

A method for training an auto-labeling device is provided. The method includes: (a) inputting a training image to a feature extraction module to generate a feature, (b) inputting the feature to a fitness estimation module to output a fitness value, inputting the feature to a first classification module to output a first class score and a first uncertainty score, inputting the feature to a second classification module to output a second class score and a second uncertainty score, and then generating a scaled second uncertainty score; and (c) (i) training the first classification module and the feature extraction module by referring to the first class score, (ii) training the second classification module and the feature extraction module by referring to the second class score, (iii) updating a scale parameter by referring to the first uncertainty score and the scaled second uncertainty score, and (iv) training the fitness estimation module.

A machine accesses a set of image target models, each image target model being associated with model parameters, the model parameters comprising at least an operational domain, an expected input image quality, and an expected orientation. The machine receives an image for processing by one or more image target models from the set, the image including metadata specifying image parameters of the received image. The machine identifies, based on the image parameters in the metadata of the received image and the model parameters of one or more models in the set, a first subset of the set of image target models including image target models that are capable of processing the received image. The machine provides the received image to at least one image target model in the first subset.

A system and method for vehicle occlusion detection is disclosed. A particular embodiment includes: receiving training image data from a training image data collection system; obtaining ground truth data corresponding to the training image data; performing a training phase to train a plurality of classifiers, a first classifier being trained for processing static images of the training image data, a second classifier being trained for processing image sequences of the training image data; receiving image data from an image data collection system associated with an autonomous vehicle; and performing an operational phase including performing feature extraction on the image data, determining a presence of an extracted feature instance in multiple image frames of the image data by tracing the extracted feature instance back to a previous plurality of N frames relative to a current frame, applying the first trained classifier to the extracted feature instance if the extracted feature instance cannot be determined to be present in multiple image frames of the image data, and applying the second trained classifier to the extracted feature instance if the extracted feature instance can be determined to be present in multiple image frames of the image data.

Apparatuses, systems, and techniques to detect object in images including digital representations of those objects. In at least one embodiment, one or more objects are detected in an image based, at least in part, on one or more pseudo-labels corresponding to said one or more objects.

The disclosure relates to a method for operating a driver assistance system of a motor vehicle. The method includes detecting a first data set of sensor data measured by a sensor device of the driver assistance program. The first data set of sensor data includes missing class allocation information, wherein the class allocation information relates to the objects represented by the sensor data. The method also includes pre-training a classification algorithm of the driver assistance system while taking into consideration the first data set in order to improve the object differentiation of the classification algorithm. The method further includes generating a second data set of simulated sensor data which includes at least one respective piece of class allocation information according to a specific specification. The method also includes training the classification algorithm of the driver assistance system while taking into consideration the second data set in order to improve an allocation assignment of the classification algorithm for objects differentiated by the classification algorithm. The method further includes improving the detection of objects, which are represented by additional measured sensor data, by the driver assistance system.

Systems and method are provided for training an autonomous vehicle. In various embodiments, a method includes: storing, in a data storage device, real world data including a sequence of images of a road environment, the sequence of images generated based on a vehicle traversing the road environment; processing, in an offline simulation environment, the sequence of images with a deep reinforcement learning agent associated with a control feature of the autonomous vehicle to obtain an optimized set of control policies; and training the autonomous vehicle based on the optimized set of control polices.

Embodiments relate to a system, program product, and method for information extraction and annotation of a data set. Neural models are utilized to automatically attach machine annotations to data elements within an unlabeled data set. The attached machine annotations are evaluated and a score is attached to the annotations. The score reflects a confidence of correctness of the annotations. A labeled data set is iteratively expanded with selectively evaluated annotations based on the attached score. The labeled data set is applied to an unexplored corpus to identify matching corpus data to populated instances of the labeled data set.

A computer-implemented method, system, and computer program product are provided for activity recognition. The method includes receiving, by a processor, a plurality of videos, the plurality of videos including labeled videos and unlabeled videos. The method also includes extracting, by the processor with a feature extraction convolutional neural network (CNN), frame features for frames from each of the plurality of videos. The method additionally includes estimating, by the processor with a feature aggregation system, a vector representation for one of the plurality of videos responsive to the frame features. The method further includes classifying, by the processor, an activity from the vector representation. The method also includes controlling an operation of a processor-based machine to react in accordance with the activity.

A computer-implemented method, system, and computer program product are provided for activity recognition in a mobile device. The method includes receiving a plurality of unlabeled videos from one or more cameras. The method also includes generating a classified video for each of the plurality of unlabeled videos by classifying an activity in each of the plurality of unlabeled videos. The method additionally includes storing the classified video in a location in a memory designated for videos of the activity in each of the classified videos.