An optical sensor device may include an optical sensor that includes a set of sensor elements; an optical filter that includes one or more channels; a phase mask configured to distribute a plurality of light beams associated with a subject in an encoded pattern on an input surface of the optical filter; and one or more processors. The one or more processors may be configured to obtain, from the optical sensor, sensor data associated with the subject and may determine a distance of the subject from the optical sensor device. The one or more processors may select, based on the distance, a processing technique to process the sensor data, wherein the processing technique is an imaging processing technique or a spectroscopic processing technique. The one or more processors may process, using the selected processing technique, the sensor data to generate output data and may provide the output data.

A method for generating a panoramic image is disclosed. The method includes receiving a three-dimensional model of a target space and an initial panoramic image of the target space, the initial panoramic image having a latitude span less than a preset latitude span; determining a first set of coordinate parameters of a camera associated with the initial panoramic image and with respect to a reference frame associated with the three-dimensional model; mapping, based on the first set of coordinate parameters of the camera, data points of the three-dimensional model to a camera coordinate system associated with the camera to obtain an intermediate panoramic image; and obtaining a final panoramic image by merging the initial panoramic image and the intermediate panoramic image, the final panoramic image having a latitude span greater than or equal to the preset latitude span.

A system includes a processor, a light source controlled by the processor and configured to emit a light, and an event based vision sensor controlled by the processor. The sensor includes a plurality of pixels. At least one of the plurality of pixels includes a photosensor configured to detect incident light and first circuitry configured to output a first signal based on an output from the photosensor. The first signal indicates a change of amount of incident light. The sensor includes a comparator configured to output a comparison result based on the first signal and at least one of a first reference voltage and a second reference voltage. The processor is configured to apply one of the first reference voltage and the second reference voltage to the comparator selectively based on an operation of the light source.

An imaging apparatus of the present disclosure includes: a plurality of pixel blocks that each includes a plurality of light-receiving pixels including color filters of mutually the same color, the plurality of light-receiving pixels being divided into a plurality of pixel pairs each including two light-receiving pixels; and a plurality of lenses provided at respective positions corresponding to the plurality of pixel pairs.

An image processing device replaces pixel values received from an imaging device that includes multiple types of pixels being arranged in a first pixel arrangement to detect different wavelength ranges of light, with pixel values of pixels in a second pixel arrangement different from the first pixel arrangement, by determining whether there is an edge indicating a direction along which pixels having a smaller change in pixel values are aligned that are positioned around a target pixel to be interpolated, and have a same color as the target pixel after replacement; and interpolating, if an edge is determined, a pixel value of the target pixel using the pixel values of the pixels along the direction of the edge, or if no edge, the pixel value of the target pixel using pixel values of pixels along a direction of another edge detected based on brightness around the target pixel.

A multi-spectrum based image fusion apparatus is disclosed, which includes a light acquisition device, an image processor, and an image sensor having five types of photosensitive channels. The five types of photosensitive channels including red, green and blue RGB channels, an infrared IR channel and a full-band W channel. The light acquisition device acquires target light corresponding to incident light. The image sensor converts the target light into an image signal through the RGB channels, the IR channel and the W channel. The image processor analyzes the image signal into RGB color signals and a brightness signal, and fuses the RGB color signals and the brightness signal to obtain a fused image. The collection of the channels based on which the RGB color signals and the brightness signal are obtained includes the five types of photosensitive channels.

An imaging device having an imager that includes first pixels having sensitivity to a first light and second pixels having sensitivity to a second light, a wavelength of the first light being different from a wavelength of the second light. The imager being configured to acquire first image data from the first pixels and being configured to acquire second image data from the second pixels. Each of the first image data and the second image data including an image of a code, the code being configured to output the second light. The imaging device further including an image processor configured to extract an image of the code based on the first image data and the second image data.

System and method for narrowing the transmission curves obtained using a spectral imager in which spectral images are acquired using a MEMS Fabri-Perot (FP) tunable filter. A method includes acquiring a first plurality of broad-band spectral images associated with respective MEMS FP etalon states and processing the first plurality of broad-band spectral images into a second plurality of narrow-band spectral images.

An imaging apparatus includes a first photoelectric conversion unit configured to convert light into charge, a second photoelectric conversion unit configured to convert light into charge, and a comparison unit. The comparison unit includes a first transistor and a second transistor. The first transistor receives a signal that is based on the charge converted by the first photoelectric conversion unit. The second transistor receives a signal that is based on the charge converted by the second photoelectric conversion unit.

An imaging system and method for imaging a scene using a rolling shutter are described. In an embodiment, the method includes illuminating a scene with first and second illumination light; generating frame signals with a photodetector comprising a plurality of pixels arranged in a plurality of rows, wherein the frame signals are based on light received from the scene with sequentially integrated rows of pixels of the plurality of rows, and wherein a frame signal includes signals from pixels of each of the plurality of rows; and generating images of the scene based on an intensity of the frame signals and the proportion of the first illumination light and the second illumination light emitted onto the scene during the first and second frames, wherein a proportion of the first illumination light and the second illumination light in a first frame is different than in a second frame.