Techniques are disclosed for capturing stereoscopic images using one or more high color density or full color image sensors and one or more low color density or sparse color image sensors. Low color density image sensors, may include substantially fewer color pixels than the sensor's total number of pixels, as well as fewer color pixels than the total number of color pixels on the full color image sensor. More particularly, the mostly-monochrome image captured by the low color density image sensor may be used to reduce noise and increase the spatial resolution of an imaging system's output image. In addition, the color pixels present in the low color density image sensor may be used to identify and fill in color pixel values, e.g., for regions occluded in the image captured using the full color image sensor. Optical Image Stabilization and/or split photodiodes may be employed on one or more sensors.

Techniques are disclosed for capturing stereoscopic images using one or more high color density or full color image sensors and one or more low color density or sparse color image sensors. Low color density image sensors, may include substantially fewer color pixels than the sensor's total number of pixels, as well as fewer color pixels than the total number of color pixels on the full color image sensor. More particularly, the mostly-monochrome image captured by the low color density image sensor may be used to reduce noise and increase the spatial resolution of an imaging system's output image. In addition, the color pixels present in the low color density image sensor may be used to identify and fill in color pixel values, e.g., for regions occluded in the image captured using the full color image sensor. Optical Image Stabilization and/or split photodiodes may be employed on one or more sensors.

A pseudo H&E image producing method, including: inputting a grayscale interference image or a grayscale reflected image of a pathological sample to a first memory block of an information processing apparatus, and inputting a grayscale fluorescence image of the pathological sample to a second memory block of the information processing apparatus; using the information processing apparatus to perform a first color transform operation on the grayscale interference image or the grayscale reflected image to generate a first RGB image, and using the information processing apparatus to perform a second color transform operation on the grayscale fluorescence image to generate a second RGB image; and using the information processing apparatus to perform an image fusion operation and an intensity reversal operation on the first RGB image and the second RGB image to generate a pseudo H&E image. The present invention also discloses an optical system using the method.

A pseudo H&E image producing method, including: inputting a grayscale interference image or a grayscale reflected image of a pathological sample to a first memory block of an information processing apparatus, and inputting a grayscale fluorescence image of the pathological sample to a second memory block of the information processing apparatus; using the information processing apparatus to perform a first color transform operation on the grayscale interference image or the grayscale reflected image to generate a first RGB image, and using the information processing apparatus to perform a second color transform operation on the grayscale fluorescence image to generate a second RGB image; and using the information processing apparatus to perform an image fusion operation and an intensity reversal operation on the first RGB image and the second RGB image to generate a pseudo H&E image. The present invention also discloses an optical system using the method.

A method of operating a video camera includes capturing a scene of imaging data using a focal plane array (FPA) module of the video camera. The scene of imaging data is characterized by a first bit depth. The method also includes processing, using an image processing module coupled to the FPA module, the scene of imaging data to provide display data characterized by a second bit depth less than the first bit depth. The method further includes forming a super frame including the display data and the scene of imaging data and outputting the super frame.

A method of operating a video camera includes capturing a scene of imaging data using a focal plane array (FPA) module of the video camera. The scene of imaging data is characterized by a first bit depth. The method also includes processing, using an image processing module coupled to the FPA module, the scene of imaging data to provide display data characterized by a second bit depth less than the first bit depth. The method further includes forming a super frame including the display data and the scene of imaging data and outputting the super frame.

Color filters are used for color images obtained using imaging devices such as conventional image sensors. Imaging elements with color filters are sold, and an appropriate combination of the imaging element and a lens or the like is incorporated in an electronic device. Only providing a color filter to overlap a light-receiving region of an image sensor reduces the amount of light reaching the light-receiving region. An imaging system of the present invention includes a solid-state imaging element without a color filter, a storage device, and a learning device. As a selection standard for reducing the amount of learning data, in an HSV color space, saturation is used, and selection is performed so that the saturation has optimal distribution. When colorization disclosed in this specification is performed, the colorization and object highlight processing can be performed at the same time.

Color filters are used for color images obtained using imaging devices such as conventional image sensors. Imaging elements with color filters are sold, and an appropriate combination of the imaging element and a lens or the like is incorporated in an electronic device. Only providing a color filter to overlap a light-receiving region of an image sensor reduces the amount of light reaching the light-receiving region. An imaging system of the present invention includes a solid-state imaging element without a color filter, a storage device, and a learning device. As a selection standard for reducing the amount of learning data, in an HSV color space, saturation is used, and selection is performed so that the saturation has optimal distribution. When colorization disclosed in this specification is performed, the colorization and object highlight processing can be performed at the same time.

Systems and methods are provided for generating color video from a dual-context camera. A dual-context camera provides a first series of video frames encoded in accordance with a full color model and a second series of video frames encoded in accordance with an underdetermined color model. The two series of video frames are interleaved as to form a series of pairs of frames, each comprising a color video frame and an underdetermined video frame. An image merger generates a composite image for each pair of frames in the series of frames. The composite image includes a set of brightness values from the underdetermined video frame and a set of chrominance values from the color video frame. A color video source replaces the underdetermined image in each of the series of pairs of frames with the composite image generated for the pair of frames to provide a color video stream.

Systems and methods are provided for generating color video from a dual-context camera. A dual-context camera provides a first series of video frames encoded in accordance with a full color model and a second series of video frames encoded in accordance with an underdetermined color model. The two series of video frames are interleaved as to form a series of pairs of frames, each comprising a color video frame and an underdetermined video frame. An image merger generates a composite image for each pair of frames in the series of frames. The composite image includes a set of brightness values from the underdetermined video frame and a set of chrominance values from the color video frame. A color video source replaces the underdetermined image in each of the series of pairs of frames with the composite image generated for the pair of frames to provide a color video stream.