Patent classifications
G06T2207/30261
Estimating auto exposure values of camera by prioritizing object of interest based on contextual inputs from 3D maps
Systems and methods are provided for operating a vehicle, is provided. The method includes, by a vehicle control system of the vehicle, identifying map data for a present location of the vehicle using a location of the vehicle and pose and trajectory data for the vehicle, identifying a field of view of a camera of the vehicle, and analyzing the map data to identify an object that is expected to be in the field of view of the camera. The method further includes, based on (a) a class of the object, (b) characteristics of a region of interest in the field of view of the vehicle, or (c) both, selecting an automatic exposure (AE) setting for the camera. The method additionally includes causing the camera to use the AE setting when capturing images of the object, and using the camera, capturing the images of the object.
SYSTEM AND METHOD FOR FREE SPACE ESTIMATION
A system and method for estimating free space including applying a machine learning model to camera images of a navigation area, where the navigation area is broken into cells, synchronizing point cloud data from the navigation area with the processed camera images, and associating probabilities that the cell is occupied and object classifications of objects that could occupy the cells with cells in the navigation area based on sensor data, sensor noise, and the machine learning model.
Learning across 2D and 3D pipelines for improved object detection
A method includes accessing a training sample including an image of a scene, depth measurements of the scene, and a predetermined 3D position of an object in the scene. The method includes training a 3D-detection model for detecting 3D positions of objects based the depth measurements and the predetermined 3D position, and training a 2D-detection model for detecting 2D positions of objects within images. Training the 2D-detection model includes generating an estimated 2D position of the object by processing the image using the 2D-detection model, determining a subset of the depth measurements that correspond to the object based on the estimated 2D position and a viewpoint from which the image is captured, generating an estimated 3D position of the object based on the subset of the depth measurements, and updating the 2D-detection model based on a comparison between the estimated 3D position and the predetermined 3D position.
SYSTEMS AND METHODS FOR MONITORING TRAFFIC LANE CONGESTION
Systems and methods are provided for predicting blind spot incursions for a host vehicle. In one implementation, a navigation system for a host vehicle may comprise a processor. The processor may be programmed to receive, from an image capture device located on a rear of the host vehicle, at least one image representative of an environment of the host vehicle. The processor may be programmed to analyze the at least one image to identify an object in the environment of the host vehicle and to determine kinematic information associated with the object. The processor may further be programmed to predict, based on the kinematic information, that the object will travel in a region outside of a field of view of the image capture device and perform a control action based on the prediction.
XR DEVICE AND METHOD FOR CONTROLLING THE SAME
The present disclosure relates to an XR device and a method for controlling the same, and more particularly, is applicable to a 5G communication technology field, a robot technology field, an autonomous technology field and an artificial intelligence (AI) technology field. The method for controlling an XR device of a vehicle includes acquiring a camera view by capturing an image in front of the vehicle; acquiring position information of the vehicle by detecting a position of the vehicle, acquiring movement information of the vehicle by detecting movement of the vehicle, and providing navigation of an augmented reality (AR) mode displaying at least one virtual object for guiding a path by overlapping the at least one virtual object on the camera view based on at least the position information of the vehicle or the movement information of the vehicle.
Smart farming
A method for managing an irrigation system by generating a multi-dimensional model of an environment of the irrigation system; determining irrigation system control options based on the model, a current state of the irrigation system and the environment of the irrigation system; analyzing water spray pattern, wind speed and weather parameters, and beamforming water spray to reach edges of the spray pattern to water a predetermined area; with a drone, inspecting plants or crops for a problem; and controlling the irrigation system to respond to the problem.
SYSTEMS AND METHODS FOR JOINTLY TRAINING A MACHINE-LEARNING-BASED MONOCULAR OPTICAL FLOW, DEPTH, AND SCENE FLOW ESTIMATOR
Systems and methods described herein relate to jointly training a machine-learning-based monocular optical flow, depth, and scene flow estimator. One embodiment processes a pair of temporally adjacent monocular image frames using a first neural network structure to produce a first optical flow estimate; processes the pair of temporally adjacent monocular image frames using a second neural network structure to produce an estimated depth map and an estimated scene flow; processes the estimated depth map and the estimated scene flow using the second neural network structure to produce a second optical flow estimate; and imposes a consistency loss between the first optical flow estimate and the second optical flow estimate that minimizes a difference between the first optical flow estimate and the second optical flow estimate to improve performance of the first neural network structure in estimating optical flow and the second neural network structure in estimating depth and scene flow.
SYSTEMS AND METHODS FOR PREDICTIONS OF STATE OF OBJECTS FOR A MOTORIZED MOBILE SYSTEM
A processing system is for a motorized mobile system that provides powered mobility to one or more users. The motorized mobile system may consist, for example, of one or more of a mobile chair, a mobility scooter, an electronic conveyance vehicle, a riding lawn mower, a grocery cart, an all-terrain vehicle, an off-road vehicle, and a golf cart. The processing system comprises at least one sensor to measure one or more kinematic states of an object proximate to the motorized mobile system and at least one processor to use at least one object kinematic model as at least one state estimator. The at least one processor predicts a first kinematic state estimate of the object at a first time based on a prior knowledge of state for the object. The at least one processor uses the first kinematic state estimate of the object at the first time and a measured kinematic state observed by the sensor at a second time to determine a second kinematic state estimate of the object at the second time, wherein the first time is less than the second time. The at least one processor outputs the first kinematic state estimate at the first time from the object kinematic model for use by at least one other process of the motorized mobile system, wherein the at least one other process causes one or more actions to be taken by the motorized mobile system based on the first kinematic state estimate of the object at the first time. The at least one processor uses the second kinematic state estimate at the second time as an input to the object kinematic model to predict another kinematic state estimate of the object.
Target abnormality determination device
A vehicle control device includes a tracking unit estimating a motion of a moving object, a model selection unit selecting a motion model corresponding to a moving object type, an abnormality determination unit determining a presence or absence of an abnormality of the estimation of the motion of the moving object based on the estimated moving object motion and the motion indicated by the motion model, and a control unit. A control mode in which the control unit controls traveling of a host vehicle when the abnormality determination unit determines that the abnormality is present differs from a control mode in which the control unit controls the traveling of the host vehicle when the abnormality determination unit determines that the abnormality is absent.
Bounding box estimation and object detection
Disclosed are techniques for estimating a 3D bounding box (3DBB) from a 2D bounding box (2DBB). Conventional techniques to estimate 3DBB from 2DBB rely upon classifying target vehicles within the 2DBB. When the target vehicle is misclassified, the projected bounding box from the estimated 3DBB is inaccurate. To address such issues, it is proposed to estimate the 3DBB without relying upon classifying the target vehicle.