The technology relates to controlling a vehicle in an autonomous driving mode. For instance, sensor data identifying an object in an environment of the vehicle may be received. A grid including a plurality of cells may be projected around the object. For each given one of the plurality of cells, a likelihood that the object will enter the given one within a period of time into the future is predicted. A contour is generated based on the predicted likelihoods. The vehicle is then controlled in the autonomous driving mode in order to avoid an area within the contour.

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for determining a location of a particular object relative to a vehicle. In one aspect, a method includes obtaining sensor data captured by one or more sensors of a vehicle. The sensor data is processed by a convolutional neural network to generate a sensor feature representation of the sensor data. Data is obtained which defines a particular spatial region in the sensor data that has been classified as including sensor data that characterizes the particular object. An object feature representation of the particular object is generated from a portion of the sensor feature representation corresponding to the particular spatial region. The object feature representation of the particular object is processed using a localization neural network to generate the location of the particular object relative to the vehicle.

An information processing device includes an acquisition interface and a processor. The acquisition interface acquires a first detection image obtained by capturing an image of a plurality of target objects including a first target object and a second target object, which is more transparent to visible light than the first target object, using the visible light, and a second detection image obtained by capturing an image of the plurality of target objects using infrared light. The processor obtains a first feature amount based on the first detection image, obtains a second feature amount based on the second detection image, and calculates a third feature amount corresponding to a difference between the first feature amount and the second feature amount. The processor detects a position of the second target object in at least one of the first detection image and the second detection image, based on the third feature amount.

A method for tracking after an entity, the method may include tracking, by a monitor of a vehicle, a movement of an entity that appears in various images acquired during a tracking period; generating, by a processing circuitry of the vehicle, an entity movement function that represents the movement of the entity during the tracking period; generating, by the processing circuitry of the vehicle, a compressed representation of the entity movement function; and responding to the compressed representation of the entity movement function.

A robot climbing control method is disclosed. A gravity direction vector in a gravity direction in a camera coordinate system of a robot is obtained. A stair edge of stairs in a scene image is obtained and an edge direction vector of the stair edge in the camera coordinate system is determined. A position parameter of the robot relative to the stairs is determined according to the gravity direction vector and the edge direction vector. Poses of the robot are adjusted according to the position parameter to control the robot to climb the stairs.

System, methods, and other embodiments described herein relate to generating depth estimates from a monocular image. In one embodiment, a method includes, in response to receiving the monocular image, flipping, by a disparity model, the monocular image to generate a flipped image. The disparity model is a machine learning algorithm. The method includes analyzing, using the disparity model, the monocular image and the flipped image to generate disparity maps including a monocular disparity map corresponding to the monocular image and a flipped disparity map corresponding with the flipped image. The method includes generating, in the disparity model, a fused disparity map from the monocular disparity map and the flipped disparity map. The method includes providing the fused disparity map as the depth estimates of objects represented in the monocular image.

In accordance with an aspect of the present disclosure, there is provided an apparatus for estimating a location of a vehicle including, a communication unit configured to receive, from an information providing vehicle, identification information and location information on a driving vehicle in a vicinity of the information providing vehicle, a weighted value obtaining unit configured to obtain a weighted value representing accuracy of the location information based on the received identification information and a location estimating unit configured to estimate a location of the driving vehicle by applying the weighted value to the location information.

Systems and methods for movement detection are provided. In one example embodiment, a computer-implemented method includes obtaining image data and range data representing a scene external to an autonomous vehicle, the image data including at least a first image and a second image that depict the scene. The method includes identifying a set of corresponding image features from the image data, the set of corresponding image features including a first feature in the first image having a correspondence with a second feature in the second image. The method includes determining a respective distance for each of the first feature and the second feature based at least in part on the range data. The method includes determining a velocity associated with a portion of a scene represented by the set of corresponding image features based at least in part on the respective distance for the first feature and the second feature.

Methods and devices for generating a trajectory for a self-driving car (SDC) are disclosed. The method includes: for a given one of the plurality of trajectory points of a given trajectory: (i) determining a presence of plurality of dynamic objects around the SDC, (ii) applying a first algorithm to determine a set of collision candidates, (iii) generating a segment line for the SDC, (iv) generating a bounding box for each of set of collision candidates, (v) for a given one of the set of collision candidates, determining a distance between the segment line and the respective bounding box to determine a separation distance, (vi) in response to the separation distance being lower than a threshold, determining that the given one of the set of collision candidates would cause the collision with the SDC, (vii) amending at least one of the plurality of trajectory points to render a revised candidate trajectory.

An information processing device includes: a collection unit configured to collect monitoring information indicating circumstances of a monitoring area from a plurality of monitoring information acquiring units; an object determining unit configured to detect an object which is located in the monitoring area on the basis of the monitoring information; a map information managing unit configured to update map information of the monitoring area using position information indicating a position of the object; and a map information providing unit configured to provide the map information to a working machine that performs predetermined work in the monitoring area.