According to various embodiments, systems, methods, and media for evaluating an open space planner in an autonomous vehicle are disclosed. In one embodiment, an exemplary method includes receiving, at a profiling application, a record file recorded by the ADV while driving in an open space using the open space planner, and a configuration file specifying parameters of the ADV; extracting planning messages and prediction messages from the record file, each extracted message being associated with the open space planner. The method further includes generating features from the planning message and the prediction messages in view of the specified parameters of the ADV; and calculating statistical metrics from the features. The statistical metrics are then provided to an automatic tuning framework for tuning the open space planner.

An autonomous vehicle includes an array of sensors, a processor, and a switch. The array of sensors generate sensor data related to one or more objects in an external environment of the autonomous vehicle and the processor determines an environmental context. The switch transfers the sensor data from the array of sensors to the processor, where the switch is configured to: (a) receive first sensor data from a first sensor group of the array of sensors; (b) receive second sensor data from a second sensor group of the array of sensors; (c) determine an order of transmission of the first sensor data over the second sensor data in response to the environmental context; and (d) transmit the first sensor data to the processor prior to transmitting the second sensor data based on the order of transmission.

Methods and systems are provided for detecting and responding to dangerous road users. In some aspects, a process can include steps for receiving sensor data of a detected object from an autonomous vehicle, determining whether the detected object is exhibiting a dangerous attribute, generating output data based on the determining of whether the detected object is exhibiting the dangerous attribute, and updating a machine learning model based on the output data relating to the dangerous attribute.

A behavior prediction system predicts human behaviors based on environment-aware information such as camera movement data and geospatial data. The system receives sensor data of a vehicle reflecting a state of the vehicle at a given time and a given location. The system determines a field of concern in images of a video stream and determines one or more portions of images of the video stream that correspond to the field of concern. The system may apply different levels of processing powers to objects in the images based on whether an object is in the field of concern. The system then generates features of objects and identify VRUs from the objects of the video stream. For the identified VRUs, the system inputs a representation of the VRUs and the features into a machine learning model, and outputs from the machine learning model a behavioral risk assessment of the VRUs.

A method for steering a vehicle along a path in a driveway and around obstacles between a starting position into a target position, comprises the steps of determining the vehicle dimensions, steering and driving capabilities, carrying out a path optimization step to evaluate, based on a predetermined cost function, the least costly path between the starting position and the target position avoiding any collisions with obstacles. The method further comprises the further step of applying a path improver step, smoothening the trajectory obtained by the path optimization method by means of numerical optimization while fulfilling dynamical constraints on acceleration and steering rate of the vehicle through planning lateral and longitudinal movement of the vehicle in a joint optimization problem or by means of separate optimization problems.

The invention relates to a method for adjusting fully automatic vehicle guidance functions, which are realized by means of a vehicle system of a motor vehicle, during the operation of the motor vehicles in a predefined navigation environment. A stationary infrastructure device that communicates with the motor vehicles is associated with the navigation environment. Function limits of each vehicle guidance function are defined by means of limit operation parameters of the vehicle guidance function. Current traffic situation information describing dynamic objects in the navigation environment is determined by the infrastructure device by means of environment sensors of the navigation environment. The current traffic situation information is used, together with a digital map describing stationary objects and properties of the navigation environment, to determine at least one piece of risk information for each motor vehicle.

A method for operating at least one automated vehicle, including the steps: detecting road users by sensors with the aid of the at least one automated vehicle and/or with the aid of sensor systems in an infrastructure; ascertaining predicted traffic routes for the road users with the aid of a computing device based on defined criteria; transmitting control data corresponding to the predicted traffic route to the automated vehicle; and operating the automated vehicle according to the control data.

In various examples, a yield scenario may be identified for a first vehicle. A wait element is received that encodes a first path for the first vehicle to traverse a yield area and a second path for a second vehicle to traverse the yield area. The first path is employed to determine a first trajectory in the yield area for the first vehicle based at least on a first location of the first vehicle at a time and the second path is employed to determine a second trajectory in the yield area for the second vehicle based at least on a second location of the second vehicle at the time. To operate the first vehicle in accordance with a wait state, it may be determined whether there is a conflict between the first trajectory and the second trajectory, where the wait state defines a yielding behavior for the first vehicle.

Systems and methods for image-based perception. The methods comprise: capturing images by a plurality of cameras with overlapping fields of view; generating, by a computing device, spatial feature maps indicating locations of features in the images; identifying, by the computing device, overlapping portions of the spatial feature maps; generating, by the computing device, at least one combined spatial feature map by combining the overlapping portions of the spatial feature maps together; and/or using, by the computing device, the at least one combined spatial feature map to define a predicted cuboid for at least one object in the images.

Sensor data is received from an array of sensors configured to capture one or more objects in an external environment of an autonomous vehicle. A first sensor group is selected from the array of sensors based on proximity data or environmental contexts. First sensor data from the first sensor group is prioritized for transmission based on the proximity data or environmental contexts.