Methods and systems are disclosed using camera devices for deep channel and Convolutional Neural Network (CNN) images and formats. In one example, image values are captured by a color sensor array in an image capturing device or camera. The image values provide color channel data. The captured image values by the color sensor array are input to a CNN having at least one CNN layer. The CNN provides CNN channel data for each layer. The color channel data and CNN channel data is to form a deep channel image that stored in a memory. In another example, image values are captured by sensor array. The captured image values by the sensor array are input a CNN having a first CNN layer. An output is generated at the first CNN layer using the captured image values by the color sensor array. The output of the first CNN layer is stored as a feature map of the captured image.

An apparatus includes a camera and a processor circuit. The camera may be configured to capture color images in response to visible light and monochrome infrared images in response to infrared light. The processor circuit may be configured to extract color features from the color images and add color to corresponding monochrome features detected in the monochrome infrared images.

Techniques are described for efficient high-resolution output of an image captured using a high-pixel-count image sensor based on pixel binning followed by luminance-guided umsampling. For example, an image sensor array is configured according to a red-green-blue-luminance (RGBL) CFA pattern, such that at least 50-percent of the imaging pixels of the array are luminance (L) pixels. Pixel binning is used during readout of the array to concurrently generate a downsampled RGB capture frame and a downsampled L capture frame. Following the readout, the L capture frame is upsampled (e.g., by upscaling and interpolation) to generate an L guide frame with 100-percent luminance density. An upsampled RGB frame can then be generated by interpolating the RGB capture frame based both on known neighboring RGB information (e.g., from the RGB capture frame and previously interpolated information), as adjusted based on local luminance information from the L guide frame.

An image capturing apparatus includes an image sensor configured to change an exposure condition for each of a plurality of exposure areas, each of the exposure areas including a single pixel or a plurality of pixels, and an image processing unit configured to perform steps of digital signal processing on a signal of a captured image includes generating a plurality of coupled areas in which the exposure areas are coupled based on a first threshold of the exposure condition, calculating a development parameter for each of the coupled areas, and applying the development parameter to the image processing unit for each of the exposure areas.

Systems and methods for processing video content are disclosed. According to at least one embodiment, a method of processing video content includes: receiving the video content; identifying a portion of the video content based on one or more of a plurality of factors, the plurality of factors including colour, raster percentage, brightness, and temporal factors; and providing an indicator that facilitates visual recognition of the identified portion of the video content.

A method for enhancing digital images during a microsurgery, e.g., an eye surgery, includes collecting digital images of target anatomy using a digital camera as the target anatomy is illuminated by warm white light. The method includes identifying, via a processor in communication with the digital camera, a predetermined stage of the microsurgery. Within the images, the processor digitally isolates a first pixel region, e.g., a pupil pixel region, from a second pixel region, e.g., an iris pixel region, and adjusts a characteristic of constituent pixels thereof. The method, possibly recorded as instructions in a computer-readable medium, may be used to enhance a red reflex at predetermined stages of an eye surgery. A system includes a lighting source for emitting warm white light having a color temperature of less than about 4000° K, the camera, and the processor.

Devices, methods, and non-transitory program storage devices (NPSDs) are disclosed to compensate for the predicted color changes experienced by camera modules after certain amounts of time of real world use. Such color changes may be caused by prolonged exposure of optical components of the camera module to one or more of: solar radiation, high temperature conditions, or high humidity conditions, each of which may, over time, induce deviation in the color response of optical components of the camera module. The techniques disclosed herein may first characterize such predicted optical change to components over time based on particular environmental conditions, and then implement one or more time-varying color models to compensate for predicted changes to the camera module's color calibration values due to the characterized optical change. In some embodiments, optical changes in other types of components, e.g., display devices, caused by prolonged environmental stresses may also be modeled and compensated.

A multi-spectrum based image fusion apparatus is disclosed, which includes a light acquisition device, an image processor, and an image sensor having five types of photosensitive channels. The five types of photosensitive channels including red, green and blue RGB channels, an infrared IR channel and a full-band W channel. The light acquisition device acquires target light corresponding to incident light. The image sensor converts the target light into an image signal through the RGB channels, the IR channel and the W channel. The image processor analyzes the image signal into RGB color signals and a brightness signal, and fuses the RGB color signals and the brightness signal to obtain a fused image. The collection of the channels based on which the RGB color signals and the brightness signal are obtained includes the five types of photosensitive channels.

Provided are an image processing method and device, a mobile terminal, and a storage medium. The method includes: acquiring a first image output by an image sensor; responsive to that a first signal value of the first image after being processed exceeds a saturation value of a first bit width at a preset image processing stage, recording the first signal value of the processed first image as a second signal value with a second bit width, the second bit width being greater than the first bit width; and mapping the second signal value recorded with the second bit width to a third signal value recorded with the first bit width to obtain a second image. Through the method, an operation of increasing a bit width can be used to retain more information of an image and improve the quality of the image, and an implementation is simple and effective.

A system for obtaining color imagery using SPADs includes a SPAD array that has a plurality of SPAD pixels. Each of the plurality of SPAD pixels includes a respective color filter positioned thereover. The system is configurable to capture an image frame using the SPAD array and generate a filtered image by performing a temporal filtering operation using the image frame and at least one preceding image frame. The at least one preceding image frame is captured by the SPAD array at a timepoint that temporally precedes a timepoint associated with the image frame. The system is also configurable to, after performing the temporal filtering operation, generate a color image by demosaicing the filtered image.