A navigation system may include at least one processing device configured to determine, based on an output of one or more position sensors associated with the navigation system, a current location of at least one component associated with the navigation system and determine a destination location different from the current location. The navigation system may also acquire, from one or more image acquisition devices, a plurality of images representative of an environment of a user of the navigation system and derive, from the plurality of images, visual information associated with at least one object in the environment. The system may also determine one or more instructions for navigating from the current location to the destination location, wherein the one or more instructions include at least one reference to the visual information derived from the plurality of images. The system may also deliver to the user the one or more instructions.

A route from a current location of a portable device to a destination is determined, where the route includes a sequence of directed sections. Navigation instructions to guide a user of the portable device along the route to the destination are generated. To this end, candidate navigation landmarks perceptible within a 360-degree range of the current location of the portable device are identified, a navigation landmark disposed in a direction substantially opposite to the direction of the first one in the sequence of directed sections is selected from among the candidate navigation landmarks, and an initial instruction in the navigation instructions is generated and provided via a user interface of the portable device. The initial instruction references the selected navigation landmark.

Techniques for improving the display of markers on a map include pre-computing cells for multiple locations on the map and associating points of interest with the pre-computed cells. In response to a request from a user device to display points of interest for a particular location, stored data specifying the pre-computed cells for the particular location is accessed and, for each of the cells, a point of interest is selected from the points of interests associated with that cell. The user device is caused to display the map with a marker in each of the cells for the selected point of interest.

Systems and methods of processing crowdsourced navigation information for use in autonomous vehicle navigation are disclosed. A method may include processing, by a mapping server, crowdsourced navigation information from a plurality of vehicles obtained by sensors coupled to the plurality of vehicles, wherein the navigation information describes road lanes of a road segment; collecting data about landmarks identified proximate to the road segment, the landmarking including a traffic sign; generating, by the mapping server, an autonomous vehicle map for the road segment, wherein the autonomous vehicle map includes a spline corresponding to a lane in the road segment and the landmarks identified proximate to the road segment; and distributing, by the mapping server, the autonomous vehicle map to an autonomous vehicle for use in autonomous navigation over the road segment.

A method includes: selecting a set of access points in a focus zone that identifies an area around the travel destination; determining access paths through one or more access points in the set of selected access points; listing crossings that the access paths pass through; for each of the listed crossings: determining a probability that the listed crossing is passed through by an access path; determining at least one complexity score of the listed crossing; determining a set of points of interest (POIs) along access paths passing through the listed crossing; and determining quality scores for the POIs, respectively, the quality score of one of the POIs reflecting a utility of that one of the POIs to facilitate orientation; selecting POIs from the set of POIs based on the quality scores; generating the access map including the access paths and the selected POIs; and outputting the access map.

Example embodiments described herein therefore relate to an AR guidance system to perform operations that include: detecting a client device at a location within a geo-fenced area, wherein the geo-fenced area may include within it, a destination of interest; determining a route to the destination of interest from the location of the client device within the geo-fenced area; causing display of a presentation of an environment within an AR interface at the client device; detecting a display of real-world signage within the presentation of the environment; generating a media item in response to the detecting the display of the signage within the presentation of the environment, wherein the media item is based on the route to the destination of interest; and causing display of the media item within the AR interface based on the position of the signage within the presentation of the environment.

A navigation system for providing driving instructions to a driver of a vehicle traveling on a route is provided. The driving instructions are generated by executing a multimodal fusion method that comprises extracting features from sensor measurements, annotating the features with directions for the vehicle to follow the route with respect to objects sensed by the sensors, and encoding the annotated features with a multimodal attention neural network to produce encodings. The encodings are transformed into a common latent space, and the transformed encodings are fused using an attention mechanism producing an encoded representation of the scene. The method further comprises decoding the encoded representation with a sentence generation neural network to generate a driving instruction and submitting the driving instruction to an output device.

Systems and methods for communicating information related to a wearable device are disclosed. Exemplary information includes audio information.

A method for landmark-based localization of a vehicle involves forming a plurality of position hypotheses for a vehicle position based on a forming of associations between sensor landmark objects detected by sensor and map landmark objects stored in a digital map. A most likely vehicle position is ascertained as the localization result on the basis of a probabilistic filtering of the position hypotheses, and a guaranteed position area is ascertained, in which a predefined error upper limit is not exceeded. This is performed several times with different set-ups of the probabilistic filtering. The localization result with the smallest guaranteed position area is selected as vehicle position if the guaranteed position areas overlap fully in pairs.

A method, a system, and a computer program product may be provided for generating map data associated with one or more objects in a region. The method includes receiving point cloud data associated with the region. The method further includes generating a georeferenced top down raster image of the region, based on the point cloud data. The georeferenced top down raster image is indicative of a top surface of each of the one or more objects. The method further includes determining boundary data of the top surface of each of the one or more objects, based on the georeferenced top down raster image and generating the map data associated with the one or more objects, based on the boundary data of the top surface of each of the one or more objects.