An autonomous vehicle is described herein. The autonomous vehicle generates segmentation scenes based upon lidar data generated by a lidar sensor system of the autonomous vehicle. The lidar data includes points indicative of positions of objects in a driving environment of the autonomous vehicle. The segmentation scenes comprise regions that are indicative of the objects in the driving environment. The autonomous vehicle generates scores for each segmentation scene based upon characteristics of each segmentation scenes and selects a segmentation scene based upon the scores. The autonomous vehicle then operates based upon the segmentation scene.

A mobile object control device includes a first controller that recognizes a surrounding situation of a mobile object based on an output of a detection device having a space around the mobile object as a detection range and generates a first movement plan for the mobile object in a first period based on the recognized surrounding situation of the mobile object, and a second controller that generates a second movement plan for the mobile object in a second period shorter than the first period, and when the second controller generates label data in which label information indicating different values depending on at least the presence or absence of a moving object is imparted to each of division elements obtained by dividing the space around the mobile object into a finite number, and generates the second movement plan based on the label data.

An image processing device applied to a driving assistance system, which includes: a driving assistance device that detects a relative position of a lane marking with respect to a vehicle and assists a driving of the vehicle based on a detected positional information; and a head-up display device that projects a display image on a projection area arranged on the vehicle to visually recognize a virtual image of the display image, includes: an acquisition device that acquires the positional information; and a generation device that generates the display image including a predetermined display element. The generation device generates the display image to visually recognize the display element at a position associated with the positional information and to visually recognize the display element as a shape inclined toward the vehicle from the lane marking.

Provided are methods for testing of a control system of a vehicle using generated rulebook based scenarios, which can include determining a simulated environment, receiving a hierarchical plurality of autonomous vehicle rules, determining a trajectory of a simulated vehicle within the simulated environment, generating a plurality of simulated scenarios for the simulated vehicle, identifying at least one violation of at least one autonomous vehicle rule by the simulated vehicle in a set of the simulated scenarios, determining a scenario score for each simulated scenario based on the violations, and identifying at least one simulated scenario for a trained neural network of a vehicle based on the scenario scores.

A method for automatically driving a vehicle for a drive-through includes measuring a location of the vehicle with respect to physical features by a sensor mounted on the vehicle, detecting, by the sensor, nearby vehicles and pedestrians around the vehicle, and controlling driving of the vehicle based on information related to the location of the vehicle, the nearby vehicles, and the pedestrians.

A method includes receiving data relating to pedestrian activity at one or more locations outside of a crosswalk, analyzing the data, based on the data, identifying at least one location of the one or more locations as a constructive crosswalk, and controlling operation of an autonomous vehicle based on the at least one location of the constructive crosswalk.

Methods and systems for controlling navigation of a vehicle are disclosed. The system will first detect a URU within a threshold distance of a drivable area that a vehicle is traversing or will traverse. The system will then receive perception information relating to the URU, and use a plurality of features associated with each of a plurality of entry points on a drivable area boundary that the URU can use to enter the drivable area to determine a likelihood that the URU will enter the drivable area from that entry point. The system will then generate a trajectory of the URU using the plurality of entry points and the corresponding likelihoods, and control navigation of the vehicle while traversing the drivable area to avoid collision with the URU.

The technology employs a holistic approach to passenger pickups and other wayfinding situations. This includes identifying where passengers are relative to the vehicle and/or the pickup location. Information synthesis from different sensors, agent behavior prediction models, and real-time situational awareness are employed to identify the likelihood that the passenger to be picked up is at a given location at a particular point in time, with sufficient confidence. The system can provide adaptive navigation by helping passengers understand their distance and direction to the vehicle, for instance using various cues via an app on the person's device. Rider support tools may be provided, which enable a remote agent to interact with a customer via that person's device, such as using the camera on the device to provide wayfinding support to enable the person to find their vehicle. Ride support may also use sensor information from the vehicle when providing wayfinding support.

A method for perception fields driving related operations, the method may include (i) obtaining object information regarding one or more objects located within an environment of a vehicle; (ii) determining, using one or more neural network (NNs), one or more virtual forces that are applied on the vehicle, wherein the one or more virtual forces represent one or more impacts of the one or more objects on a behavior of the vehicle; wherein the one or more virtual forces belong to a virtual physical model; and (iii) performing one or more driving related operations of the vehicle based on the one or more virtual forces.

A system can use semantic images, lidar images, and/or 3D bounding boxes to determine mobility parameters for objects in the semantic image. In some cases, the system can generate virtual points for an object in a semantic image and associate the virtual points with lidar points to form denser point clouds for the object. The denser point clouds can be used to estimate the mobility parameters for the object. In certain cases, the system can use semantic images, lidar images, and/or 3D bounding boxes to determine an object sequence for an object. The object sequence can indicate a location of the particular object at different times. The system can use the object sequence to estimate the mobility parameters for the object.