The present disclosure relates to navigation and to systems and methods for using a dual sensor readout channel to allow for frequency detection. In one implementation, at least one processing device may receive a plurality of images acquired by a camera onboard a host vehicle, wherein the plurality of images are received via a first channel and via a second channel, and wherein the first channel is associated with a first frame capture rate, and the second channel is associated with a second frame capture rate different from the first frame capture rate. The processing device may use images received via the first channel to detect flickering and non-flickering light sources in an environment of the host vehicle; and provide, based on images received via the second channel, images for showing on one or more human-viewable displays.

Image quality is to be improved. An imaging control device includes: an imaging data obtaining unit that obtains imaging data; a frame setting unit that sets a predetermined frame in the imaging data obtained by the imaging data obtaining unit; a luminance value obtaining unit that obtains luminance values of imaging data in a range of the frame set by the frame setting unit; a representative value calculating unit that calculates a representative value from the luminance values obtained by the luminance value obtaining unit; and a converting unit that performs gamma conversion of the imaging data obtained by the imaging data obtaining unit.

Methods and devices for using a relationship between activities of different traffic signals in a network to improve traffic signal state estimation are disclosed. An example method includes determining that a vehicle is approaching an upcoming traffic signal. The method may further include determining a state of one or more traffic signals other than the upcoming traffic signal. Additionally, the method may also include determining an estimate of a state of the upcoming traffic signal based on a relationship between the state of the one or more traffic signals other than the upcoming traffic signal and the state of the upcoming traffic signal.

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for planning a trajectory of a vehicle. One of the methods includes obtaining input data for planning a driving trajectory for a vehicle, the input data comprising an intended route for the vehicle and data characterizing an environment in a vicinity of the vehicle; processing the input data using an input encoder neural network to generate feature data that includes a respective feature representation for each of a plurality of locations in the environment; applying spatial attention to the feature representations to generate a respective attention weight for each of the plurality of locations; generating a respective attended feature representation for each of the plurality of locations; generating a bottlenecked representation of the attended feature representations; and generating a planned future trajectory from at least the bottlenecked representation.

Techniques for determining a location and type of traffic-related features and using such features in route planning are discussed herein. The techniques may include determining that sensor data represents a feature such as a traffic light, road segment, building type, and the like. The techniques further include determining a cost of a feature, whereby the cost is associated with the effect of a feature on a vehicle traversing an environment. A feature database can be updated based on features in the environment. A cost of the feature can be used to update costs of routes associated with the location of the feature.

An image recognition device (image recognition system 100) according to the present disclosure includes an imaging unit (10) and a recognition unit (14). The imaging unit (10) captures a plurality of images at the same exposure start timing in one frame period by using imaging pixels having different sensitivities to generate image data. The recognition unit (14) recognizes a subject from each of the image data. The imaging unit (10) includes a pixel array in which a plurality of imaging pixels having different exposure times, different light transmittances of color filters, or different light receiving areas are two-dimensionally arranged.

A device for identifying a signaling unit on a road on which a vehicle is traveling is described. The device is configured to determine an arrangement of one or more signal signs of the signaling unit on the basis of environmental data of one or more environmental sensors of the vehicle. The device is further configured to assign the one or more signal signs to one or more corresponding grid cells of a signal sign grid based on assignment logic.

A vehicle behavior of a monitored vehicle is learned. A vehicle illumination of the monitored vehicle is detected and monitored. If a light-pattern occurs in the detected vehicle illumination, wherein the light-pattern corresponds to a frequency, intensity and/or color dependent glowing of the vehicle illumination, and further wherein the light-pattern starts with a flashing up of the detected vehicle illumination and ends after a certain time without glowing of the respective part of the detected vehicle illumination, then the method further monitors the light-pattern; monitors a vehicle movement of the monitored vehicle during the occurrence of the light-pattern; and compares the monitored light-pattern with a known light-pattern from a light-pattern data entry stored in an light-pattern database. If the comparison results in the monitored light-pattern being unknown, the method stores the light-pattern and the vehicle movement together as a new light-pattern data entry in the light-pattern database.

Systems and methods are provided for vehicle navigation. In one implementation, a system may comprise at least one processor. The processor may be programmed to receive images representative of an environment of the host vehicle and analyze the images to identify a first object and a second object. The processor may determine a first predefined navigational constraint implicated by the first object and a second predefined navigational constraint implicated by the second object, wherein the first and second predefined navigational constraints cannot both be satisfied, and the second predefined navigational constraint has a priority higher than the first predefined navigational constraint. The processor may determine a navigational action for the host vehicle satisfying the second predefined navigational constraint, but not satisfying the first predefined navigational constraint and, cause an adjustment of a navigational actuator of the host vehicle in response to the determined navigational action.

An electronic device attachable to a vehicle, according to various embodiments of the present invention, comprises: a communication interface; a memory for storing instructions; and at least one processor connected to the communication interface and the memory, wherein the at least one processor can be configured so as to execute the stored instructions in order to: acquire, from another device embedded in the vehicle, information on a plurality of objects located within a designated distance from the vehicle; identify, among the plurality of objects, a designated object located within a designated distance from the vehicle; generate configuration information of at least one piece of content to be displayed through a head-up display (HUD), on the basis of a state of the designated object; and display, through the HUD, content for guiding the operation of the vehicle, on the basis of the generated configuration information.