The present invention relates to an image sensing device comprising: an image sensing array and an image processing circuit. The image sensing array includes sub-array regions used to obtain sensing signals having different exposure period, wherein in a main frame period, the sensing signals include static sensing signals and dynamic sensing signals, the number of the static sensing signals and the dynamic sensing signals are any different positive integers, the static sensing signals are generated at a first frame rate for a first exposure period, and the dynamic sensing signal are generated at a second frame rate for a second exposure period. The image processing circuit analyzes the static sensing signals and the dynamic sensing signals, outputs sub-frames of the sensing signals having the same frame rate in the sub-array region, and fuses the sub-frames each having a different frame rate by a specific ratio to generate a main frame.

The present invention relates to an image sensing device comprising: an image sensing array and an image processing circuit. The image sensing array includes sub-array regions used to obtain sensing signals having different exposure period, wherein in a main frame period, the sensing signals include static sensing signals and dynamic sensing signals, the number of the static sensing signals and the dynamic sensing signals are any different positive integers, the static sensing signals are generated at a first frame rate for a first exposure period, and the dynamic sensing signal are generated at a second frame rate for a second exposure period. The image processing circuit analyzes the static sensing signals and the dynamic sensing signals, outputs sub-frames of the sensing signals having the same frame rate in the sub-array region, and fuses the sub-frames each having a different frame rate by a specific ratio to generate a main frame.

A method for designing an optical system for providing reliable, robust and successful realization of a distortion variation function is presented. In a preferred embodiment, the proposed distortion variation optical system includes at least two non-symmetrical elements, which are moving in the transverse direction. The proposed freeform lens contains two transmissive refractive surfaces. The freeform elements designed with this method have preferably a flat surface and a non-symmetrical freeform surface. The two plano-surfaces are preferably made to face each other, so that a miniature camera can be offered. The value of the non-symmetrical freeform surface is used to produce variable optical power when the two freeform elements undergo a relative movement in the vertical direction. Using this method, an optical system with an active distortion, smaller form factor, and better imaging quality can be obtained.

A multi-aperture imaging system comprising a first camera with a first sensor that captures a first image and a second camera with a second sensor that captures a second image, the two cameras having either identical or different FOVs. The first sensor may have a standard color filter array (CFA) covering one sensor section and a non-standard color CFA covering another. The second sensor may have either Clear or standard CFA covered sections. Either image may be chosen to be a primary or an auxiliary image, based on a zoom factor. An output image with a point of view determined by the primary image is obtained by registering the auxiliary image to the primary image.

Digital camera systems and methods are described that provide a color digital camera with direct luminance detection. The luminance signals are obtained directly from a broadband image sensor channel without interpolation of RGB data. The chrominance signals are obtained from one or more additional image sensor channels comprising red and/or blue color band detection capability. The red and blue signals are directly combined with the luminance image sensor channel signals. The digital camera generates and outputs an image in YCrCb color space by directly combining outputs of the broadband, red and blue sensors.

An image detecting device includes a color image sensor configured to sense visible light and to output color image data based on the sensed visible light; a first infrared lighting source configured to provide first infrared rays to a subject; a second infrared lighting source configured to provide second infrared rays to the subject; a mono image sensor configured to sense a first infrared light or a second infrared light reflected from the subject and output infrared image data; and an image signal processor configured to, measure an illuminance value based on the color image data, measure a distance value of the subject based on a portion of the infrared image data corresponding to the first infrared light, and obtain an identification image of the subject based on the illuminance value, the distance value, and a portion of the infrared image data corresponding to the second infrared light.

Systems and methods of the invention merge information from multiple image sensors to provide a high dynamic range (HDR) video. The present invention provides for real-time HDR video production using multiple sensors and pipeline processing techniques. According to the invention, multiple sensors with different exposures each produces an ordered stream of frame-independent pixel values. The pixel values are streamed through a pipeline on a processing device. The pipeline includes a kernel operation that identifies saturated ones of the pixel values. The streams of pixel values are merged to produce an HDR video.

Systems and methods for implementing array cameras configured to perform super-resolution processing to generate higher resolution super-resolved images using a plurality of captured images and lens stack arrays that can be utilized in array cameras are disclosed. An imaging device in accordance with one embodiment of the invention includes at least one imager array, and each imager in the array comprises a plurality of light sensing elements and a lens stack including at least one lens surface, where the lens stack is configured to form an image on the light sensing elements, control circuitry configured to capture images formed on the light sensing elements of each of the imagers, and a super-resolution processing module configured to generate at least one higher resolution super-resolved image using a plurality of the captured images.

Digital camera systems and methods are described that provide a color digital camera with direct luminance detection. The luminance signals are obtained directly from a broadband image sensor channel without interpolation of RGB data. The chrominance signals are obtained from one or more additional image sensor channels comprising red and/or blue color band detection capability. The red and blue signals are directly combined with the luminance image sensor channel signals. The digital camera generates and outputs an image in YCrCb color space by directly combining outputs of the broadband, red and blue sensors.

According to one embodiment, an electronic device includes one or more processors. The one or more processors obtain an image captured by a camera with a filter having a first area transmitting light of a first wavelength range and a second area transmitting light of a second wavelength range. The image includes a first color-component image based on the light of the first wavelength range and a second color-component image based on the light of the second wavelength range. The one or more processors notify a user of an effective area for calculation of depth information based on a bias of color information in the first color-component image and the second color-component image.