An imaging apparatus includes an image sensor, a filter array disposed on an optical path from a target object to the image sensor and including two-dimensionally-arranged optical filters, and a processing circuit that generates at least four pieces of spectral image data based on an image acquired by the image sensor. The optical filters include various types of optical filters with different spectral transmittance. Each of the at least four pieces of spectral image data indicates an image corresponding to one of at least four wavelength bands. The filter array includes at least one characteristic section. The processing circuit detects a relative position between the filter array and the image sensor based on the at least one characteristic section in the image acquired by the image sensor, and compensates for deviation between the relative position and a preliminarily-set relative position when the processing circuit detects the deviation.

Techniques are described for efficient high-resolution output of an image captured using a high-pixel-count image sensor based on pixel binning followed by luminance-guided umsampling. For example, an image sensor array is configured according to a red-green-blue-luminance (RGBL) CFA pattern, such that at least 50-percent of the imaging pixels of the array are luminance (L) pixels. Pixel binning is used during readout of the array to concurrently generate a downsampled RGB capture frame and a downsampled L capture frame. Following the readout, the L capture frame is upsampled (e.g., by upscaling and interpolation) to generate an L guide frame with 100-percent luminance density. An upsampled RGB frame can then be generated by interpolating the RGB capture frame based both on known neighboring RGB information (e.g., from the RGB capture frame and previously interpolated information), as adjusted based on local luminance information from the L guide frame.

An eye tracking system comprising a controller configured to receive a reference image of an eye of a user and a current image of the eye of the user. The controller is also configured to determine a difference between the reference image and the current image to define a differential image. The differential image has a two dimensional pixel array of pixel locations that are arranged in a plurality of rows and columns. Each pixel location has a differential intensity value. The controller is further configured to calculate a plurality of row values by combining the differential intensity values in corresponding rows of the differential image and to determine eyelid data based on the plurality of row values.

Provided are a device and a method for executing gain calculation processing and gain adjustment processing for matching an output of an imaging element of a multispectral camera with an output of a reference machine. As the gain calculation processing for matching an output of an adjustment camera with an output of a reference camera at the time of manufacturing the multispectral camera, a band-corresponding gain is calculated that matches the output of the adjustment camera with the output of the reference camera, on the basis of: a reference machine band-corresponding pixel value that is a pixel value within a specific band acquired on the basis of an output value of an imaging element of the reference camera; and an adjustment machine band-corresponding pixel value that is a pixel value within a specific band acquired on the basis of an output value of an imaging element of the adjustment camera. Furthermore, at the time of using the camera, output value adjustment processing that matches the output of the imaging element with the output of the reference machine is executed, by acquiring the band-corresponding gain from a memory, and multiplying the output of the imaging element by the acquired band-corresponding gain.

A method for contrast-based autofocus of an image capture device. The method includes obtaining sensor data representative of an image captured by the image capture device, wherein the sensor data comprises pixel values from respective sensor pixels of an image sensor of the image capture device. A subset of the pixel values is dynamically selected to generate selected sensor data representative of the subset of the pixel values. The selected sensor data is processed to generate contrast data representative of a contrast-based characteristic of at least a portion of the image. The contrast data is processed to determine a focus setting for the image capture device.

An image processing device includes: an image sensor configured to generate first image data by using a color filter array; and processing circuitry configured to select a processing mode from a plurality of processing modes for the first image data, the selecting being based on information about the first image data; generate second image data by reconstructing the first image data using a neural network processor based on the processing mode; and generate third image data by post-processing the second image data apart from the neural network processor based on the processing mode.

An image sensor includes multiple photoelectric conversion elements and multiple individual color filters to generate multiple colors. The multiple individual color filters are arranged corresponding to the multiple photoelectric conversion elements, respectively. At least one of the multiple individual color filters includes a primary color type individual color filter. The primary color type individual color filter allows light of a corresponding primary color to permeate. The primary color type individual color filter has a first given transmittance for one of other primary colors other than the corresponding primary color, at which one of the other primary colors permeates the primary color type individual color filter. The first given transmittance is higher than a lower limit of a transmittance improving a sensitivity of the image sensor.

A method of reducing noise in an input image by setting, as a local window among color pixels included in the input image, a target pixel and neighboring pixels adjacent to the target pixel, determining color pixel values for the target pixel and each of the neighboring pixels included in the local window, generating local color average values are generated by averaging, color by color, the color pixel values, generating offset color pixel values by converting the color pixel values of the target pixel and the neighboring pixels based on the local color average values, and generating a compensated color pixel value of the target pixel by adjusting the color pixel value of the target pixel based on the offset color pixel values.

An image processing apparatus including at least one processor coupled to a memory, serving as a first obtainment unit to obtain a luminance value of image data corresponding to a first luminance range, a second obtainment unit to obtain information for a second luminance range that is less than the first luminance range, a classification unit to classify, based on a correspondence relationship of luminance value conversion from the first luminance range to the second luminance range, the first luminance range of the image data into a plurality of regions, and a display unit to cause a display device to display an image based on the image data such that a pixel of the image having a luminance value belonging to a region, in which a tone characteristic in the image data can be restored when the luminance value conversion is performed, can be specified in the displayed image.

An electronic device acquires polarization information of a subject based on a plurality of pieces of image data based on a first signal output from a first sensor. The first sensor can capture an optical image of the subject acquired via a polarizing filter provided with areas having different polarization angles. The device further acquires an evaluation value for controlling brightness of an image at the time of capturing the optical image of the subject, based on the plurality of pieces of image data. The plurality of pieces of image data have different polarization angles, by respectively being acquired via areas of the polarizing filter having the plurality of different polarization angles. A degree of weighting to be assigned to the plurality of pieces of image data at the time of acquiring the evaluation value based on the polarization information.