An image processing device comprises: one or more processors comprising hardware, the one or more processors being configured to: generate a high-resolution combined image by aligning a plurality of time-series images with each other in a high-resolution image space having a resolution higher than the plurality of time-series images based on an amount of displacement between the plurality of time-series images, and combining the plurality of time-series images; generate a low-resolution combined image by aligning the plurality of time-series images with each other in a low-resolution image space having a resolution equal to or lower than the resolution of the plurality of time-series images based on the amount of displacement, combining the plurality of time-series images through weighted addition; calculate a feature quantity pertaining to a pixel-value change direction at each region in the generated low-resolution combined image; and correct the high-resolution combined image based on the calculated feature quantity.

A camera module includes an image acquisition unit configured to acquire a plurality of image frames having a spatial phase difference therebetween, an image generation unit configured to generate image data having a resolution higher than a resolution of each of the plurality of image frames using the plurality of image frames, and a depth information extraction unit configured to extract depth information about an object using the image data.

There is provided an imaging device (10) including: an imaging module (100) including an image sensor (130) in which a plurality of pixels for converting light into an electric signal is arranged; a drive unit (140) that moves a part of the imaging module in a manner that the image sensor can sequentially acquire a reference image under a predetermined pixel phase, a plurality of generation images, and a detection image under the predetermined pixel phase in this order; and a detection unit (220) that detects a moving subject based on a difference between the reference image and the detection image.

Systems and methods for implementing array cameras configured to perform super-resolution processing to generate higher resolution super-resolved images using a plurality of captured images and lens stack arrays that can be utilized in array cameras are disclosed. An imaging device in accordance with one embodiment of the invention includes at least one imager array, and each imager in the array comprises a plurality of light sensing elements and a lens stack including at least one lens surface, where the lens stack is configured to form an image on the light sensing elements, control circuitry configured to capture images formed on the light sensing elements of each of the imagers, and a super-resolution processing module configured to generate at least one higher resolution super-resolved image using a plurality of the captured images.

Techniques for improving the quality of images captured by a remote sensing overhead platform such as a satellite. Sensor shifting is employed in an open-loop fashion to compensate for relative motion of the remote sensing overhead platform to the Earth. Control signals are generated for the sensor shift mechanism by an orbital motion compensation calculation that uses the predicted ephemeris (including orbit dynamics) and image geometry (overhead platform to target). Optionally, the calculation may use attitude and rate errors that are determined from on-board sensors.

An image processing apparatus includes processing circuitry. The processing circuitry is configured to detect a positional shift amount of each of a plurality of images; select a composite target image from the plurality of images based on the detected positional shift amount; and obtain a composite image based on the positional shift amount and the selected composite target image.

An imaging element of an imaging unit 24 divides the exit pupil of an imaging optical system 21 into a plurality of regions and generates a pixel signal for each region. An optical axis position adjustment unit 23 adjusts the optical axis position of the imaging optical system with respect to the imaging element. A control unit 26 calculates a parallax on the basis of the pixel signal for each region after the pupil division and performs focus control of the imaging optical system 21. The control unit 26 also moves the optical axis position using the optical axis position adjustment unit 23, and generates, using the imaging element, pixel signals indicating the same subject region in the plurality of regions after the pupil division. An image processing unit 25 performs binning of a plurality of pixel signals indicating the same subject region generated by moving the optical axis position to generate a high-resolution captured image. Calculation of the parallax and acquisition of a high-resolution captured image can be performed.

An image sensor according to one embodiment may comprise: an image sensing unit which receives light and generates a first Bayer pattern having a first resolution; and a processor which receives a second Bayer pattern that is at least a portion of the first Bayer pattern from the image sensing unit, and then generates a third Bayer pattern having a higher resolution than the second alignment unit on the basis of the received second Bayer pattern.

An optical apparatus includes: an optical system; and a holding member configured to hold the optical system, wherein the holding member includes a first connection portion provided on an object side of the optical system, and a second connection portion provided between the optical system and the first connection portion, and wherein a lens apparatus is detachably mountable to the optical apparatus via the first connection portion, and an optical element is detachably mountable to the optical apparatus via the second connection portion.

A camera module is provided. The camera module may be separately used as a camera, or may be applied to a terminal device such as a mobile phone or a tablet computer, or a vehicle-mounted device. The camera module includes an optical lens component, a light filtering layer, an image sensor and a drive module. The optical lens component is configured to receive a light beam from a photographed object, and transmit the light beam to the light filtering layer. The light filtering layer is configured to move a position under the drive of the drive module, and respectively transmit light signals filtered at different positions to the image sensor. The image sensor is configured to receive the light signals at the different positions from the light filtering layer, and determine image information based on the light signals at the different positions.