Patent classifications
G06V10/774
HARD EXAMPLE MINING FOR TRAINING A NEURAL NETWORK
A method for determining hard example sensor data inputs for training a task neural network is described. The task neural network is configured to receive a sensor data input and to generate a respective output for the sensor data input to perform a machine learning task. The method includes: receiving one or more sensor data inputs depicting a same scene of an environment, wherein the one or more sensor data inputs are taken during a predetermined time period; generating a plurality of predictions about a characteristic of an object of the scene; determining a level of inconsistency between the plurality of predictions; determining that the level of inconsistency exceeds a threshold level; and in response to the determining that the level of inconsistency exceeds a threshold level, determining that the one or more sensor data inputs comprise a hard example sensor data input.
AUTOMATIC LABELING OF OBJECTS IN SENSOR DATA
Aspects of the disclosure provide for automatically generating labels for sensor data. For instance, first sensor data, for a vehicle may be identified. This first sensor data may have been captured by a first sensor of the vehicle at a first location during a first point in time and may be associated with a first label for an object. Second sensor data for the vehicle may be identified. The second sensor data may have been captured by a second sensor of the vehicle at a second location at a second point in time outside of the first point in time. The second location is different from the first location. A determination may be made as to whether the object is a static object. Based on the determination that the object is a static object, the first label may be used to automatically generate a second label for the second sensor data.
SYSTEM AND METHOD FOR RARE OBJECT LOCALIZATION AND SEARCH IN OVERHEAD IMAGERY
A feature extractor and novel training objective are provided for content-based image retrieval. For example, a computer-implemented method includes applying a query image and a search image to a neural network of a feature extraction network of a computing device, the query image indicating an object to be searched for in the search image. The feature extraction network includes the neural network, a spatial feature neural network receiving a first output of the neural network pertaining to the search image, and an embedding network receiving a second output of the neural network pertaining to the query image. The method includes generating spatial search features from the spatial feature neural network, generating a query feature from the embedding network, applying the query feature to an artificial neural network (ANN) index, and determining an optimal matching result of an object in the search image based on an operation using the ANN index.
DEFECT INSPECTING SYSTEM AND DEFECT INSPECTING METHOD
A defect inspecting system includes a detector configured to image a sample and a host control device that acquires an inspection image including a defect and a plurality of reference images not including a defect site and generates a pseudo defect image by editing a predetermined reference image among the plurality of acquired reference images. An initial parameter is determined with which the pseudo defect site is detectable from the pseudo defect image. The host control device acquires a defect candidate site from the inspection image using the initial parameter, estimates a high-quality image from an image of a site corresponding to the defect candidate site using the parameter acquired in image quality enhancement, and specifies an actual defect site in the inspection image by executing defect discrimination. A parameter is determined with which a site close to the specified actual defect site is detectable using the inspection image.
METHODS AND APPARATUSES FOR TRAINING MAGNETIC RESONANCE IMAGING MODEL
Methods and apparatuses for training a magnetic resonance imaging model, electronic devices and computer readable storage media are provided. A method may include: acquiring a magnetic resonance image data set; constructing a ring deep neural network to be trained; inputting an under-sampled magnetic resonance image and a full-sampled magnetic resonance image respectively to two neural networks included in the ring deep neural network, to generate respective simulated magnetic resonance images; inputting a first simulated full-sampled magnetic resonance image and the full-sampled magnetic resonance image to a pre-constructed first simulated magnetic resonance image class discrimination model, to obtain a first discrimination result indicating whether or not the first simulated full-sampled magnetic resonance image is of a simulated magnetic resonance image class; and adjusting a network parameter of the ring deep neural network based on a preset loss function, to obtain a trained magnetic resonance imaging model.
METHODS AND APPARATUSES FOR TRAINING MAGNETIC RESONANCE IMAGING MODEL
Methods and apparatuses for training a magnetic resonance imaging model, electronic devices and computer readable storage media are provided. A method may include: acquiring a magnetic resonance image data set; constructing a ring deep neural network to be trained; inputting an under-sampled magnetic resonance image and a full-sampled magnetic resonance image respectively to two neural networks included in the ring deep neural network, to generate respective simulated magnetic resonance images; inputting a first simulated full-sampled magnetic resonance image and the full-sampled magnetic resonance image to a pre-constructed first simulated magnetic resonance image class discrimination model, to obtain a first discrimination result indicating whether or not the first simulated full-sampled magnetic resonance image is of a simulated magnetic resonance image class; and adjusting a network parameter of the ring deep neural network based on a preset loss function, to obtain a trained magnetic resonance imaging model.
METHOD AND SYSTEM FOR AUTOMATED PLANT IMAGE LABELING
The invention relates to a computer-implemented method comprising:—acquiring (406) first training images (108) using a first image acquisition technique (104), each first training image depicting a plant-related motive; —acquiring (402) second training images (106) using a second image acquisition technique (102), each second training image depicting the motive depicted in a respective one of the first training images; —automatically assigning (404) at least one label (150, 152, 154) to each of the acquired second training images; —spatially aligning (408) the first and second training images which are depicting the same one of the motives into an aligned training image pair; —training (410) a machine-learning model (132) as a function of the aligned training image pairs and the labels, wherein during the training the machine-learning model (132) learns to automatically assign one or more labels (250, 252, 254) to any test image (205) acquired with the first image acquisition technique which depicts a plant-related motive; and—providing (412) the trained machine-learning model (132).
METHOD AND SYSTEM FOR AUTOMATED PLANT IMAGE LABELING
The invention relates to a computer-implemented method comprising:—acquiring (406) first training images (108) using a first image acquisition technique (104), each first training image depicting a plant-related motive; —acquiring (402) second training images (106) using a second image acquisition technique (102), each second training image depicting the motive depicted in a respective one of the first training images; —automatically assigning (404) at least one label (150, 152, 154) to each of the acquired second training images; —spatially aligning (408) the first and second training images which are depicting the same one of the motives into an aligned training image pair; —training (410) a machine-learning model (132) as a function of the aligned training image pairs and the labels, wherein during the training the machine-learning model (132) learns to automatically assign one or more labels (250, 252, 254) to any test image (205) acquired with the first image acquisition technique which depicts a plant-related motive; and—providing (412) the trained machine-learning model (132).
A METHOD FOR TRAINING A NEURAL NETWORK TO DESCRIBE AN ENVIRONMENT ON THE BASIS OF AN AUDIO SIGNAL, AND THE CORRESPONDING NEURAL NETWORK
A neural network, a system using this neural network and a method for training a neural network to output a description of the environment in the vicinity of at least one sound acquisition device on the basis of an audio signal acquired by the sound acquisition device, the method including: obtaining audio and image training signals of a scene showing an environment with objects generating sounds, obtaining a target description of the environment seen on the image training signal, inputting the audio training signal to the neural network so that the neural network outputs a training description of the environment, and comparing the target description of the environment with the training description of the environment.
A METHOD FOR TRAINING A NEURAL NETWORK TO DESCRIBE AN ENVIRONMENT ON THE BASIS OF AN AUDIO SIGNAL, AND THE CORRESPONDING NEURAL NETWORK
A neural network, a system using this neural network and a method for training a neural network to output a description of the environment in the vicinity of at least one sound acquisition device on the basis of an audio signal acquired by the sound acquisition device, the method including: obtaining audio and image training signals of a scene showing an environment with objects generating sounds, obtaining a target description of the environment seen on the image training signal, inputting the audio training signal to the neural network so that the neural network outputs a training description of the environment, and comparing the target description of the environment with the training description of the environment.