An approach is provided for identifying partitions associated with erratic pedestrian behaviors and their correlations to points of interest. For example, the approach involves receiving sensor data associated with a geographic area. The approach also involves based on the sensor data, determining pedestrian-behavior parameter(s) respectively for partition(s). Each respective partition of the partition(s) represents a respective subarea of the geographic area, a respective time period, or a combination thereof. The approach further involves identifying at least one erratic partition from the partition(s) based on determining that a respective pedestrian-behavior parameter associated with the at least one erratic partition deviates from a baseline pedestrian-behavior parameter by at least a threshold extent. The approach further involves determining a correlation of the at least one erratic partition to at least one map feature of a geographic database. The approach further involves providing the correlation as an output.

Connected and automated vehicles (CAVs) have shown the potential to improve safety, increase road throughput, and optimize energy efficiency and emissions in several complicated traffic scenarios. This invention describes a mixed-integer programming (MIP) optimization method for global multi-vehicle decision making and motion planning of CAVs in a highly dynamic environment that consists of multiple human-driven, i.e., conventional or manual, vehicles and multiple conflict zones, such as merging points and intersections. The proposed approach ensures safety, high throughput and energy efficiency by solving a global multi-vehicle constrained optimization problem. The solution provides a feasible and optimal time schedule through road segments and conflict zones for the automated vehicles, by using information from the position, velocity, and destination of the manual vehicles, which cannot be directly controlled. Despite MIP having combinatorial complexity, the proposed formulation remains feasible for real-time implementation in the infrastructure, such as in mobile edge computers (MECs).

An autonomous vehicle includes an array of sensors, a processor, and a switch. The array of sensors generate sensor data related to one or more objects in an external environment of the autonomous vehicle and the processor determines an environmental context. The switch transfers the sensor data from the array of sensors to the processor, where the switch is configured to: (a) receive first sensor data from a first sensor group of the array of sensors; (b) receive second sensor data from a second sensor group of the array of sensors; (c) determine an order of transmission of the first sensor data over the second sensor data in response to the environmental context; and (d) transmit the first sensor data to the processor prior to transmitting the second sensor data based on the order of transmission.

A behavior prediction system predicts human behaviors based on environment-aware information such as camera movement data and geospatial data. The system receives sensor data of a vehicle reflecting a state of the vehicle at a given time and a given location. The system determines a field of concern in images of a video stream and determines one or more portions of images of the video stream that correspond to the field of concern. The system may apply different levels of processing powers to objects in the images based on whether an object is in the field of concern. The system then generates features of objects and identify VRUs from the objects of the video stream. For the identified VRUs, the system inputs a representation of the VRUs and the features into a machine learning model, and outputs from the machine learning model a behavioral risk assessment of the VRUs.

Systems, methods, and computer program products to enhance the situational competency and/or the safe operation of a vehicle, when operating at least partially in an autonomous mode, as a support vehicle for one or more on-road persons engaged in a training or competitive cycling, running, and/or walking activity on a predetermined travel route at a predetermined pace.

A system for method for future forecasting using action priors that include receiving image data associated with a surrounding environment of an ego vehicle and dynamic data associated with dynamic operation of the ego vehicle. The system and method also include analyzing the image data and detecting actions associated with agents located within the surrounding environment of the ego vehicle and analyzing the dynamic data and processing an ego motion history of the ego vehicle. The system and method further include predicting future trajectories of the agents located within the surrounding environment of the ego vehicle and a future ego motion of the ego vehicle within the surrounding environment of the ego vehicle.

Methods and systems for controlling navigation of a vehicle are disclosed. The system will first detect a URU within a threshold distance of a drivable area that a vehicle is traversing or will traverse. The system will then receive perception information relating to the URU, and use a plurality of features associated with each of a plurality of entry points on a drivable area boundary that the URU can use to enter the drivable area to determine a likelihood that the URU will enter the drivable area from that entry point. The system will then generate a trajectory of the URU using the plurality of entry points and the corresponding likelihoods, and control navigation of the vehicle while traversing the drivable area to avoid collision with the URU.

System, methods, and other embodiments described herein relate to training a depth model for joint depth completion and prediction. In one arrangement, a method includes generating depth features from sparse depth data according to a sparse auxiliary network (SAN) of a depth model. The method includes generating a first depth map from a monocular image and a second depth map from the monocular image and the depth features using the depth model. The method includes generating a depth loss from the second depth map and the sparse depth data and an image loss from the first depth map and the sparse depth data. The method includes updating the depth model including the SAN using the depth loss and the image loss.

A method for monitoring the environment of a vehicle includes evaluating physical measurement data obtained from the environment of the vehicle to determine whether at least one person is approaching the vehicle, how many people approach the vehicle may also be recorded. The method includes evaluating physical measurement data obtained from the environment of the vehicle to determine whether at least one person is moving away from the vehicle and, if appropriate, the number of people that are moving away from the vehicle is also recorded. The method further includes carrying out a check as to whether the number of people that have moved away from the vehicle corresponds to the number of people that have previously approached the vehicle. In response to the check resulting in a difference, it is determined that the vehicle is in an unsafe state.

To provide a technology that makes it possible to recognize a target object quickly and accurately. An information processing apparatus according to the present technology includes a controller. The controller recognizes a target object on the basis of event information that is detected by an event-based sensor, and transmits a result of the recognition to a sensor apparatus that includes a sensor section that is capable of acquiring information regarding the target object.