Systems and methods are disclosed herein for monitoring a location of a client device associated with a transportation service and generating augmented reality images for display on the client device. The systems and methods use sensor data from the client device and a device localization process to monitor the location of the client device by comparing renderings of images captured by the client device to renderings of the vicinity of the pickup location. The systems and methods determine navigation instructions from the user's current location to the pickup location and select one or more augmented reality elements associated with the navigation instructions and/or landmarks along the route to the pickup location. The systems and methods instruct the client device to overlay the selected augmented reality elements on a video feed of the client device.

Described herein are methods of generating learning data to facilitate de-biasing the labeled location of an object of interest within an image. Methods may include: receiving sensor data, where the sensor data is a first image; determining reference corner locations of an object in the first image using image processing; generating observed corner locations of the object in the first image from the determined reference corner locations; generating a bias transformation based, at least in part, on a difference between the reference corner locations and the observed corner locations of the object in the first image; receiving sensor data from another image sensor of a second image; receiving observed corner locations of an object in the second image from a user; and applying the bias transformation to the observed corner locations of the object in the second image to generate de-biased corners for the object in the second image.

Described are systems and methods to utilize images to determine the position and/or orientation of a vehicle (e.g., an autonomous ground vehicle) operating in an unstructured environment (e.g., environments such as sidewalks which are typically absent lane markings, road markings, etc.). The described systems and methods can determine the vehicle's position and orientation based on an alignment of annotated images captured during operation of the vehicle with a known annotated reference map. The translation and rotation applied to obtain alignment of the annotated images with the known annotated reference map can provide the position and the orientation of the vehicle.

Systems and methods for navigating a host vehicle. The system may perform operations including receiving, from an image capture device, at least one image representative of an environment of the host vehicle; analyzing the at least one image to identify an object in the environment of the host vehicle; determining a location of the host vehicle; receiving map information associated with the determined location of the host vehicle, wherein the map information includes elevation information associated with the environment of the host vehicle; determining a distance from the host vehicle to the object based on at least the elevation information; and determining a navigational action for the host vehicle based on the determined distance.

A method for localizing a vehicle comprises transmitting first position data related to a first position of the vehicle at a first point in time from the vehicle to a server. The server computes second position data related to the first position of the vehicle at the first point in time based on the received first position data. The server transmits the second position data from the server to the vehicle. The vehicle computes third position data related to a second position of the vehicle at a second point in time based on the received second position data. The second point in time is later than the first point in time.

A system and method for large-scale lane marking detection using multimodal sensor data are disclosed. A particular embodiment includes: receiving image data from an image generating device mounted on a vehicle; receiving point cloud data from a distance and intensity measuring device mounted on the vehicle; fusing the image data and the point cloud data to produce a set of lane marking points in three-dimensional (3D) space that correlate to the image data and the point cloud data; and generating a lane marking map from the set of lane marking points.

The present disclosure discloses a map display method performed at a terminal. The method includes: obtaining a real scene image of a current location and target navigation data of navigation from the current location to a destination; determining, according to the current location and the target navigation data, virtual navigation prompt information to be overlaid in the real scene image; determining, according to a device configuration parameter of a target device capturing the real scene image, a first location on which the virtual navigation prompt information is overlaid in the real scene image; performing verification detection on the current device configuration parameter; and overlaying the virtual navigation prompt information on the first location when the current device configuration parameter passes through the verification detection. According to the present disclosure, an AR technology is applied to the navigation field so that map display manners are more diverse and diversified.

An apparatus for updating a map detects a feature in an area around a vehicle traveling on a road from situation data representing the situation around the vehicle, and updates a lane network representing a connection relationship between lanes included in road sections into which the road is divided. The lane network is stored in a storage unit and updated to match a connection relationship between lanes indicated by the detected feature.

A method of operation of a navigation system comprising: receiving multiple frames, including a first frame and a second frame, of images; detecting a traffic sign from the images between the first frame and the second frame based on a sign recognition model; extracting a first image from the first frame and a second image from the second frame; matching the traffic sign is the same in the first image and the second image based on a similarity model; generating a sign location of the traffic sign with an inertial measurement unit reading based on the first image and the second image; and generating a global coordinate for the sign location for displaying on a navigation map.

A navigation device for a vehicle including a display unit, and a processor configured to determine a location of the navigation device, detect an object loaded into the vehicle by wirelessly communicating with the object, identify the detected object based on attribute information of the detected object, save a destination history of the identified object including destination information of the vehicle having the loaded identified object, and display at least one recommended destination on the display unit based on the destination history of the object in response to the identified object again being loaded into the vehicle after the destination history has been saved.