In an embodiment a vehicle includes a communication module, a display module, an image sensor configured to acquire a front image of the vehicle and a controller configured to determine that the vehicle enters a predetermined range of a destination based on a global positioning system (GPS) signal received through the communication module, compare a feature point of the front image of the vehicle with point cloud map information to determine a first predicted position of the vehicle, based on a difference between the first predicted position and a second predicted position of the vehicle indicated by the GPS signal, determine one of the first predicted position and the second predicted position as a position of the vehicle and control the display module to display an augmented reality (AR) image for performing a route guidance to the destination based on the determined position of the vehicle.

The disclosed embodiments generally provide visual and/or audio cues to a user to guide the user to a vehicle pickup-drop-off (PuDo) location, such as an autonomous vehicle (AV) PuDo. The user’s current location is determined based on information from the user’s mobile device. A path is determined from the user’s current location to the designated PuDo location, and instructions (e.g., turn-by-turn directions) to reach the designated PuDo are displayed on the user’s mobile device, for example, using an augmented reality (AR) interface on their mobile device that is updated in real-time. Disclosed embodiments also allow vehicles to authenticate the identity of a user before allowing entry of the user into the vehicle based on a sequence of hand gestures performed by the user that are detected by exterior sensors (e.g., camera, LiDAR) of the vehicle.

Augmented reality displays for locating vehicles are disclosed herein. An example method includes determining a current location of a mobile device associated with a user, determining a current location of a vehicle, and generating augmented reality view data that includes a first arrow that identifies a path of travel for the ridehail user towards the vehicle. The path of travel is based on the current location of the mobile device and the current location of the vehicle. The first arrow is combined with a view obtained by a camera of the mobile device or a view obtained by a camera of the vehicle.

Embodiments of the present invention provide computer-implemented methods, computer program products and systems. Embodiments of the present invention can receive position and location information. Embodiments of the present invention can generate a risk score for one or more maneuvers associated with a predicted trajectory of a vehicle. Embodiments of the present invention can generate a visual representation for each of the one or more maneuvers associated with the predicted trajectory of the vehicle based on the generated risk score associated with each maneuver. Embodiments of the present invention can integrate the generated visual representation into a user display.

An apparatus and method for controlling a head-up display of a vehicle includes a navigation device that determines a remaining distance from a location of the vehicle to a driving direction change point, a display device that displays vehicle information as an augmented reality image, and a controller configured for determining a vehicle speed at a point where the remaining distance is a specified distance, and determines a projection time point of the augmented reality image based on to the vehicle speed. Therefore, it is possible to provide a safe driving to the driver by allowing the driver to easily recognize the augmented reality image in consideration of the vehicle speed.

Systems and methods are described for improved navigation assistance by providing overview directions focusing on points where other users tend to make mistakes or display emotional responses, such as stress, that indicate that they feel they may make mistakes. In an exemplary method, a navigation process receives information about a present user's navigation route, the present user's status, and the user history. The navigation service compiles the received information and determines an enhanced navigation route.

A mobile device may present a map, the map including a location indication, the location indication indicating a location of a destination. The mobile device may determine that a user has looked away from the mobile device. The mobile device may, in response to determining that the user has looked away from the mobile device, send a direction instruction to a head-mounted device, the direction instruction instructing the head-mounted device to present a direction indication, the direction indication indicating a direction for the user to travel to arrive at the destination, the head-mounted device being mounted on a head of the user.

An information provision device for a vehicle allows information to be provided to a user appropriately, and includes an onboard device having a first control means that operates a display unit, and an external device having a second control means that outputs information from outside the vehicle to the first control means. The display unit includes a first region in which vehicle-status information is displayed and a second region in which the information from outside the vehicle is displayed. The first control means can determine priorities for the vehicle-status information and the information from outside the vehicle. The first control means operates the display unit such that either the first region or the second region, which contains high-priority information, is larger than the other. If prescribed conditions occur, the first control means operates the display unit such that the region containing low-priority information is larger than the other.

The present application discloses a vehicle navigation method and apparatus. In some embodiments, the method includes: collecting a road condition image; deciding whether a lane currently traveled by a vehicle is a navigation lane; determining a lane object in the road condition image on which a guiding track object is to be superimposed and displayed, the guiding track object adapted to instruct the vehicle to travel along the lane currently traveled by the vehicle, or to instruct the vehicle to turn to the navigation lane; and superimposing and displaying the guiding track object on the determined lane object. According to the current vehicle position and the navigation route, by superimposing and displaying the guiding track object on the lane traveled by the vehicle, the driver is intuitively guided to drive the vehicle in the lane where the vehicle should be driven, thus navigating the vehicle more accurately.

Some embodiments provide a mapping application that provides a first map browsing mode for displaying a map that emphasizes a first set of features in a map region. The mapping application also provides a second map browsing mode for displaying a map that de-emphasizes the first set of features while emphasizing a second set of transit-related features in the map region.