Among other things, we describe techniques for detecting objects in the environment surrounding a vehicle. A computer system is configured to receive a set of measurements from a sensor of a vehicle. The set of measurements includes a plurality of data points that represent a plurality of objects in a 3D space surrounding the vehicle. The system divides the 3D space into a plurality of pillars. The system then assigns each data point of the plurality of data points to a pillar in the plurality of pillars. The system generates a pseudo-image based on the plurality of pillars. The pseudo-image includes, for each pillar of the plurality of pillars, a corresponding feature representation of data points assigned to the pillar. The system detects the plurality of objects based on an analysis of the pseudo-image. The system then operates the vehicle based upon the detecting of the objects.

Calibrating a camera and/or a lidar sensor of a vehicle or a robot involves a camera capturing images of a vehicle or robot environment. The lidar sensor emits a real pattern into the vehicle or robot environment in at least one portion of a detection range of the camera, and the real pattern is captured by the camera. A virtual pattern generated in a coordinate system of the lidar sensor is projected onto a virtual plane in the vehicle or robot environment by the lidar sensor. Laser radiation emitted by the lidar sensor penetrates the virtual plane and the real pattern correlating with the virtual pattern is generated on a real projection surface. The real pattern captured by the camera is recalculated onto the virtual plane based on a surface profile of the real projection surface. A rectified virtual pattern is generated in a coordinate system of the camera and the camera and/or lidar sensor is/are calibrated by comparing the virtual pattern and the rectified virtual pattern.

An optoelectronic sensor for detecting objects in a monitored zone is provided, wherein the sensor has a scanning unit that is movable about an axis of rotation and that has a plurality of scanning modules accommodated therein for a periodic scanning of the monitored zone and for a generation of corresponding received signals and that has a control and evaluation unit for acquiring information on the objects from the received signals; and wherein the scanning modules each comprise a light transmitter for transmitting a light beam and a light receiver for generating a respective received signal from the light beam remitted by the objects. A respective mirror element is here associated with the scanning modules to set an angle of elevation of a respective scanning plane detected by a scanning module with respect to a central scanning plane perpendicular to the axis of rotation.

An optoelectronic sensor for detecting objects in a monitored zone is provided, wherein the sensor has a scanning unit that is movable about an axis of rotation and that has a plurality of scanning modules accommodated therein for a periodic scanning of the monitored zone and for a generation of corresponding received signals and that has a control and evaluation unit for acquiring information on the objects from the received signals; and wherein the scanning modules each comprise a light transmitter for transmitting a light beam and a light receiver for generating a respective received signal from the light beam remitted by the objects. A respective mirror element is here associated with the scanning modules to set an angle of elevation of a respective scanning plane detected by a scanning module with respect to a central scanning plane perpendicular to the axis of rotation.

A LiDAR system for tracking small flying objects. Multitude of individual LiDAR heads are placed on arcuate frames that intersect to define a dome. Each LiDAR head can be independently rotated with six degrees of freedom. Optical data signals are routed from each LiDAR to a central mirror disposed within the dome and then to a spectrometer for data processing. Upon detection of a possible target by one or more of the LiDAR heads, additional LiDAR heads are rotated to also focus on the possible target, thereby enhancing imaging of the target.

A LiDAR system for tracking small flying objects. Multitude of individual LiDAR heads are placed on arcuate frames that intersect to define a dome. Each LiDAR head can be independently rotated with six degrees of freedom. Optical data signals are routed from each LiDAR to a central mirror disposed within the dome and then to a spectrometer for data processing. Upon detection of a possible target by one or more of the LiDAR heads, additional LiDAR heads are rotated to also focus on the possible target, thereby enhancing imaging of the target.

An optical scan device includes an optical waveguide array, including a plurality of optical waveguides each of which propagates light along a first direction, that emits a light beam, the plurality of optical waveguides being arranged in a second direction that intersects the first direction, a phase shifter array including a plurality of phase shifters connected separately to each of the plurality of optical waveguides, a control circuit that controls a phase shift amount of each of the plurality of phase shifters and/or inputting of light to each of the plurality of phase shifters and thereby controls a direction and shape of the light beam that is emitted from the optical waveguide array, a photodetector that detects the light beam reflected by a physical object, and a signal processing circuit that generates distance distribution data on the basis of output from the photodetector.

Sensing apparatus includes a transparent window and a LiDAR assembly, including a beam source, which is configured to emit one or more beams of optical radiation along a beam axis, and which is configured to scan the one or more beams over an angular range about the beam axis. A diffractive structure is mounted approximately parallel to the transparent window and positioned to intercept the one or more beams emitted by the LiDAR assembly and turn the beam axis to pass through the transparent window at an angle greater than 30° relative to a normal to a surface of the transparent window.

A driver-assist system for a marine vessel may include a camera operable to obtain data comprising images of a view of the camera, and a data processor. The data processor may be programmed to distinguish between portions of the view representing water and/or sky a portion of the view representing an object. The data processor may be programmed to detect an object by causing object detectors to search for objects in respective different subregions of the view. The data processor may be programmed to detect a boat in the view. The data processor may be programmed to cause the marine vessel to follow a detected boat.

A vehicle is provided that includes one or more wheels positioned at a bottom side of the vehicle. The vehicle also includes a first light detection and ranging device (LIDAR) positioned at a top side of the vehicle opposite to the bottom side. The first LIDAR is configured to scan an environment around the vehicle based on rotation of the first LIDAR about an axis. The first LIDAR has a first resolution. The vehicle also includes a second LIDAR configured to scan a field-of-view of the environment that extends away from the vehicle along a viewing direction of the second LIDAR. The second LIDAR has a second resolution. The vehicle also includes a controller configured to operate the vehicle based on the scans of the environment by the first LIDAR and the second LIDAR.