A signal processing method according to one aspect of the present disclosure includes obtaining compressed image data including two-dimensional image information that is obtained by compressing hyperspectral information corresponding to wavelength bands included in a target wavelength range, obtaining setting data including information designating one or more sub-wavelength ranges that are parts of the target wavelength range, and generating, based on the compressed image data, two-dimensional images corresponding to wavelength bands included in the one or more sub-wavelength ranges.

At least one feature pertains to an image sensor having an array of pixels with a configuration that includes a first pixel type configured to detect red light, a second pixel type configured to detect green light, a third pixel type configured to detect blue light and a fourth pixel type configured to detect green light and an array of lenses overlaying the array of pixels that comprises a first lens type, a second lens type, a third lens type and a fourth lens type where the first lens type is configured to pass red light and refract blue light and green light, the second lens type is configured to pass green light and refract blue light and red light, the third lens type is configured to pass blue light and refract red light and green light, and the fourth lens type is configured to pass green light and refract blue light and red light.

A pixel portion includes photodiodes formed on a semiconductor substrate as photoelectric conversion portions, and includes: a high absorption layer (HA layer) for controlling a reflection component of incident light on one surface side of the photodiodes (photoelectric conversion portions), and re-diffusing the incident light in the photoelectric conversion portions, on one surface side of the photodiodes upon which light is incident; and a diffused light suppression structure for suppressing diffused light (caused by light scattering) in a light incident path toward one surface side of the photoelectric conversion portions including the high absorption layer. Due to this, a solid-state imaging apparatus capable of reducing crosstalk between pixels, achieving miniaturization of pixel size, reducing color mixing, and achieving high sensitivity and high performance can be realized.

There is provided an image processing device including: a plurality of light sources each emitting a plurality of lights; a camera outputting a first subject image obtained by photographing a subject; and a control unit controlling each of the plurality of light sources according to an optical coded pattern set based on a complex modulation transfer function during a shutter exposure time of the camera, and outputting a second subject image in which motion blur is removed from the first subject image according to point spread functions for each color channel modulated by the optical coded pattern set.

The disclosure extends to methods, systems, and computer program products for producing an image in light deficient environments and associated structures, methods and features. The features of the systems and methods described herein may include providing improved resolution and color reproduction.

A method and an apparatus for capturing a high quality dynamic image by setting a different row-wise exposure value when capturing a scene are provided. The dynamic image capturing method includes: generating an image by pre-capturing a scene via an event sensor; generating event data from the image; determining a row-wise exposure value of the image based on the event data; and determining a row-wise readout priority order of the image based on the row-wise exposure value of the image.

Provided are a device and a method for executing gain calculation processing and gain adjustment processing for matching an output of an imaging element of a multispectral camera with an output of a reference machine. As the gain calculation processing for matching an output of an adjustment camera with an output of a reference camera at the time of manufacturing the multispectral camera, a band-corresponding gain is calculated that matches the output of the adjustment camera with the output of the reference camera, on the basis of: a reference machine band-corresponding pixel value that is a pixel value within a specific band acquired on the basis of an output value of an imaging element of the reference camera; and an adjustment machine band-corresponding pixel value that is a pixel value within a specific band acquired on the basis of an output value of an imaging element of the adjustment camera. Furthermore, at the time of using the camera, output value adjustment processing that matches the output of the imaging element with the output of the reference machine is executed, by acquiring the band-corresponding gain from a memory, and multiplying the output of the imaging element by the acquired band-corresponding gain.

A method for contrast-based autofocus of an image capture device. The method includes obtaining sensor data representative of an image captured by the image capture device, wherein the sensor data comprises pixel values from respective sensor pixels of an image sensor of the image capture device. A subset of the pixel values is dynamically selected to generate selected sensor data representative of the subset of the pixel values. The selected sensor data is processed to generate contrast data representative of a contrast-based characteristic of at least a portion of the image. The contrast data is processed to determine a focus setting for the image capture device.

An information processing apparatus includes a setting unit configured to set an imaging condition under which an imaging apparatus captures a video, a region determination unit configured to determine a detectable region in which a detection target is detectable in the video, based on the imaging condition, an acquisition unit configured to acquire a desired detection condition under which a user desires detection for the detection target to be executed, and a condition determination unit configured to determine a detection condition under which the detection target is detected from the video, based on the desired detection condition and the detectable region determined based on at least one imaging condition.

An image processing device includes: an image sensor configured to generate first image data by using a color filter array; and processing circuitry configured to select a processing mode from a plurality of processing modes for the first image data, the selecting being based on information about the first image data; generate second image data by reconstructing the first image data using a neural network processor based on the processing mode; and generate third image data by post-processing the second image data apart from the neural network processor based on the processing mode.