A prediction method and apparatus for an autonomous driving manual takeover, and a system are provided. One example method includes: A first vehicle sends a first message to a second vehicle when detecting that the first vehicle has a manual takeover requirement, where the first message includes information about a first location of the first vehicle, and the information about the first location is used to indicate a location of the first vehicle when the first vehicle detects that the first vehicle has the manual takeover requirement.

A processor is configured to execute instructions stored in a memory to determine, in response to identifying vehicle operational scenarios of a scene, an action for controlling the AV, where the action is from a selected decision component that determined the action based on level of certainty associated with a state factor; generate an explanation as to why the action was selected, such that the explanation includes respective descriptors of the action, the selected decision component, and the state factor; and display the explanation in a graphical view that includes a first graphical indicator of a world object of the selected decision component, a second graphical indicator describing the state factor, and a third graphical indicator describing the action.

In various examples, a yield scenario may be identified for a first vehicle. A wait element is received that encodes a first path for the first vehicle to traverse a yield area and a second path for a second vehicle to traverse the yield area. The first path is employed to determine a first trajectory in the yield area for the first vehicle based at least on a first location of the first vehicle at a time and the second path is employed to determine a second trajectory in the yield area for the second vehicle based at least on a second location of the second vehicle at the time. To operate the first vehicle in accordance with a wait state, it may be determined whether there is a conflict between the first trajectory and the second trajectory, where the wait state defines a yielding behavior for the first vehicle.

A method for intersection assistance, the method may include obtaining sensed information regarding an environment of the vehicle; determining an occurrence of an intersection related situation, based on the sensed information; generating one or more intersection driving related decisions; wherein the generating comprises processing, by one or more narrow AI agents of a group of narrow AI agents, at least one out of (a) at least a first part of the sensed information, and (b) an outcome of a pre-processing of at least a second part of the sensed information; and responding to the one or more intersection driving related decisions; wherein the responding comprises at least one out of (a) executing the one or more intersection driving related decisions, and (b) suggesting executing the one or more intersection driving related decisions.

Aspects of the disclosure relate to determining perceptive range of a vehicle in real time. For instance, a static object defined in pre-stored map information may be identified. Sensor data generated by a sensor of the vehicle may be received. The sensor data may be processed to determine when the static object is first detected in an environment of the vehicle. A distance between the object and a location of the vehicle when the static object was first detected may be determined. This distance may correspond to a perceptive range of the vehicle with respect to the sensor. The vehicle may be controlled in an autonomous driving mode based on the distance.

Aspects of the disclosure relate generally to controlling an autonomous vehicle in a variety of unique circumstances. These include adapting control strategies of the vehicle based on discrepancies between map data and sensor data obtained by the vehicle. These further include adapting position and routing strategies for the vehicle based on changes in the environment and traffic conditions. Other aspects of the disclosure relate to using vehicular sensor data to update hazard information on a centralized map database. Other aspects of the disclosure relate to using sensors independent of the vehicle to compensate for blind spots in the field of view of the vehicular sensors. Other aspects of the disclosure involve communication with other vehicles to indicate that the autonomous vehicle is not under human control, or to give signals to other vehicles about the intended behavior of the autonomous vehicle.

As an example, data identifying characteristics of a road user as well as contextual information about the vehicle's environment is received from the vehicle's perception system. A prediction of the intent of the object including an action of a predetermined list of actions to be initiated by the road user and a point in time for initiation of the action is generated using the data. A prediction of the behavior of the road user for a predetermined period of time into the future indicating that the road user is not going to initiate the action during the predetermined period of time is generated using the data. When the prediction of the behavior indicates that the road user is not going to initiate the action during the predetermined period of time, the vehicle is maneuvered according to the prediction of the intent prior to the vehicle passing the object.

A traffic light detection device includes: an image capture unit capturing an image of surroundings; a traffic light location estimation unit estimating a location of a traffic light around the vehicle and setting a traffic light search area in which the traffic light is estimated to be present; a traffic light detection unit detecting the traffic light by searching the traffic light search area on the image; and an obstruction estimation unit. When the obstruction estimation unit estimates that a continuous obstruction state where a view of the traffic light is continuously obstructed occurs in the traffic light search area, the traffic light location estimation unit selects the traffic light search area based on the continuous obstruction state.

Systems and methods use cameras to provide autonomous navigation features. In one implementation, a method for navigating a user vehicle may include acquiring, using at least one image capture device, a plurality of images of an area in a vicinity of the user vehicle; determining from the plurality of images a first lane constraint on a first side of the user vehicle and a second lane constraint on a second side of the user vehicle opposite to the first side of the user vehicle; enabling the user vehicle to pass a target vehicle if the target vehicle is determined to be in a lane different from the lane in which the user vehicle is traveling; and causing the user vehicle to abort the pass before completion of the pass, if the target vehicle is determined to be entering the lane in which the user vehicle is traveling.

Aspects of the disclosure relate to testing predictions of an autonomous vehicle relating to another vehicle or object in a roadway. For instance, one or more processors may plan to maneuver the autonomous vehicle to complete an action and predict that the other vehicle will take a responsive action. The autonomous vehicle is then maneuvered towards completing the action in a way that would allow the autonomous vehicle to cancel completing the action without causing a collision between the first vehicle and the second vehicle, and in order to indicate to the second vehicle or a driver of the second vehicle that the first vehicle is attempting to complete the action. Thereafter, when the first vehicle is determined to be able to take the action, the action is completed by controlling the first vehicle autonomously using the determination of whether the second vehicle begins to take the particular responsive action.