An image sensor includes first and second pixels to generate a first electric signal from white illumination light and second electric signals from narrow band illumination light, respectively. Density of the first pixels is higher than density of each color components of the second pixels. An image processing apparatus is configured to: interpolate the first electric signal based on the first pixels surrounding the second pixels to generate an interpolated electric signal; calculate a difference between the interpolated electric signal and the second electric signals to generate a color difference signal; discriminate an interpolation direction based on the color difference signal to interpolate a missing color difference signal at each pixel position, thereby generating an interpolated color difference signal; and generate the second electric signals to be generated by the second pixels, based on the interpolated color difference signal and the interpolated electric signal.

An endoscope includes: a light source for emitting white light or narrow band light; a color filter having a first filter for passing light in WLI and NBI, a second filter for passing light in WLI, a third filter for passing light in NBI; and a demosaicing processor that: generates a color image signal based on a luminance component in WLI under the white light; and performs interpolation for a pixel of a luminance component in WLI at a position of a pixel corresponding to the first filter using a pixel corresponding to the second filter under the narrow band light, and then, performs interpolation for a pixel of a luminance component in NBI at the position of the pixel corresponding to the first filter based on a pixel corresponding to the first filter and the pixel of the luminance component in WLI, thereby generating a color image signal.

Apparatuses, systems and methods for generating color video with a monochrome sensor include the acts of (i) selectively energizing each of a plurality of light sources in a sequence, (ii) capturing a monochrome image of the illuminated sample at a monochrome sensor at each stage of the sequence, and (iii) generating a color video from the monochrome images. The sequence can have a series of stages with each stage of the sequence corresponding to activation of a different wavelength of light from the light sources to illuminate a sample. Generating the monochrome video can include the acts of compiling a plurality of monochrome images captured at the monochrome sensor with a single light source into a series of monochrome video frames comprising the monochrome video.

Apparatuses, systems and methods for generating color video with a monochrome sensor include the acts of (i) selectively energizing each of a plurality of light sources in a sequence, (ii) capturing a monochrome image of the illuminated sample at a monochrome sensor at each stage of the sequence, and (iii) generating a color video from the monochrome images. The sequence can have a series of stages with each stage of the sequence corresponding to activation of a different wavelength of light from the light sources to illuminate a sample. Generating the monochrome video can include the acts of compiling a plurality of monochrome images captured at the monochrome sensor with a single light source into a series of monochrome video frames comprising the monochrome video.

An image sensing apparatus including a pixel array comprising two or more photo-sensor elements, a first optical filter disposed on a first photo-sensor element of the pixel array and a second optical filter disposed on a second photo-sensor element of the pixel array. The first optical filter is configured such that a spectral response of the first optical filter includes a first passband in a first wavelength range and a second passband in a second wavelength range, where the first passband and the second passband are separated by a first stop band. The second optical filter is configured such that a spectral response of the second optical filter includes a third passband in the first wavelength range and a fourth passband in the second wavelength range, where the third passband and the fourth passband are separated by a second stop band.

Some embodiments are directed to an imaging that includes an image sensor; a tunable filter; and a controller operatively connected to the tunable filter and to the image sensor. The imaging system is configured to: tune the tunable filter to a plurality of filter states. The image sensor acquires, at each state of the plurality of states, an image of an object, to provide different images of the object. The controller calculates a state related score, for each state that is indicative of one or more properties of at least one subset of pixels of the at least one image acquired at the state, to provide a plurality of state related scores; and determines, based on at least one of the plurality of state related scores, a desired state of the tunable filter that satisfies a desired state related score criterion; and sets the tunable filter.

The disclosure extends to methods, systems, and computer program products for producing an image in light deficient environments and correction of white balance and/or fixed pattern noise at startup or at any other time during a procedure.

Apparatuses, systems and methods for generating color video with a monochrome sensor include the acts of (i) selectively energizing each of a plurality of light sources in a sequence, (ii) capturing a monochrome image of the illuminated sample at a monochrome sensor at each stage of the sequence, and (iii) generating a color video from the monochrome images. The sequence can have a series of stages with each stage of the sequence corresponding to activation of a different wavelength of light from the light sources to illuminate a sample. Generating the monochrome video can include the acts of compiling a plurality of monochrome images captured at the monochrome sensor with a single light source into a series of monochrome video frames comprising the monochrome video.

An image sensor includes first and second pixels to generate a first electric signal from white illumination light and second electric signals from narrow band illumination light, respectively. Density of the first pixels is higher than density of each color components of the second pixels. An image processing apparatus is configured to: interpolate the first electric signal based on the first pixels surrounding the second pixels to generate an interpolated electric signal; calculate a difference between the interpolated electric signal and the second electric signals to generate a color difference signal; discriminate an interpolation direction based on the color difference signal to interpolate a missing color difference signal at each pixel position, thereby generating an interpolated color difference signal; and generate the second electric signals to be generated by the second pixels, based on the interpolated color difference signal and the interpolated electric signal.

The disclosure extends to methods, systems, and computer program products for producing an image in light deficient environments and correction of white balance and/or fixed pattern noise at startup or at any other time during a procedure.