An image processing apparatus includes an acquisition unit which acquires a parallax image generated based on a signal of a photoelectric converter among a plurality of photoelectric converters which receive light beams passing through partial pupil regions of an imaging optical system different from each other, and acquires a captured image generated by combining signals of the plurality of photoelectric converters, and an image processing unit which performs correction process so as to reduce a defect included in the parallax image based on the captured image.

A system for generating high-resolution de-warped omni-directional stereo image from captured omni-directional stereo image by correcting optical distortions using projection patterns is provided. The system includes a projection pattern capturing arrangement, a projector or a display, and a de-warping server. The projection pattern capturing arrangement includes one or more omnidirectional cameras to capture projection patterns from the captured omni-directional stereo image from each omni-directional stereo camera. The projector or the display displays the projection patterns. The de-warping server obtain the projection patterns and processes the projection patterns to generate high resolution de-warped omni-directional stereo image by correcting optical distortions in the captured omni-directional stereo image and mapping the captured omni-directional stereo image and the high resolution de-warped omni-directional stereo image.

A multi-eye interchangeable lens is disclosed. In one example, it includes a lens barrel, a movable unit, individual-eye lenses, and a light source. The movable unit is movable along an optical axis with respect to the lens barrel. The individual-eye lenses are integrally movable with the movable unit and are arranged such that emission positions of imaging lights emitted via the individual-eye lenses do not overlap with one another. The light source is movable along the optical axis integrally with the movable unit and the individual-eye lenses, and is arranged such that an emission position of a parallel light emitted to an image sensor provided in a camera body does not overlap with the emission position of the imaging light of each of the plurality of individual-eye lenses.

An apparatus and method are disclosed to produce a stereoscopic image with a hemispherical field of view. In an implementation, the apparatus includes an optical arrangement to receive first light rays from a first fisheye lens and second light rays from a second fisheye lens. The first fisheye lens and the second fisheye lens are positioned adjacent to each other and an object side of each of the first and second fisheye lenses faces a first plane. The optical arrangement is to direct the first light rays and the second light rays onto an image sensor and bend optical axes of the first and second light rays such that the first light rays are projected onto the image sensor alongside the second light rays.

A multi-aperture imaging device includes image sensor means with a plurality of image sensor areas and a plurality of optical channels, wherein each optical channel includes an optic for imaging a partial field of view of a total field of view onto an image sensor area of the image sensor means associated with the optical channel. The plurality of optical channels is configured to image the total field of view completely. A first partial field of view of the total field of view and a second partial field of view of the total field of view are captured by a different number of optical channels.

Provided is a 3D depth sensing system and method of providing an image based on a hybrid sensing array. The 3D sensing system including a light source configured to emit light, a hybrid sensing array comprising a 2D sensing region configured to detect ambient light reflected from an object and a 3D depth sensing region configured to detect the light emitted by the light source and reflected from the object, a metalens on the hybrid sensing array, the metalens being configured to direct the ambient light reflected from the object towards the 2D sensing region, and to direct the light emitted by the light source and reflected from the object towards the 3D depth sensing region, and a processing circuit configured to combine 2D image information provided by the 2D sensing region and 3D information provided by the 3D depth sensing region to generate a combined 3D image.

The present invention provides a holographic imaging device and a holographic imaging method that have improved performance in which the influence of a refractive index of a cube-type beam coupler constituting an optical system is considered. The holographic imaging device 1 comprises the beam coupler 3 consisting of the cube-type beam splitter arranged between the object 4 and the image sensor 5 and the calculation reference light hologram generation unit 14 for generating an inline reference light hologram j.sub.L representing a light wave on the hologram plane 50 by performing a light wave propagation calculation including propagation inside the beam coupler 3, on a spherical wave emitted from the condensing point P2 of the inline spherical wave reference light L. The inline reference light hologram j.sub.L is a computer-generated hologram and used for generating an object light hologram g by removing component of the reference light L from a complex-amplitude inline hologram J.sub.OL representing the object light O and the inline spherical wave reference light L on the hologram plane 50.

Provided is a 3D depth sensing system and method of providing an image based on a hybrid sensing array. The 3D sensing system including a light source configured to emit light, a hybrid sensing array comprising a 2D sensing region configured to detect ambient light reflected from an object and a 3D depth sensing region configured to detect the light emitted by the light source and reflected from the object, a metalens on the hybrid sensing array, the metalens being configured to direct the ambient light reflected from the object towards the 2D sensing region, and to direct the light emitted by the light source and reflected from the object towards the 3D depth sensing region, and a processing circuit configured to combine 2D image information provided by the 2D sensing region and 3D information provided by the 3D depth sensing region to generate a combined 3D image.

A microscopy method for imaging an object includes: imaging the object into an optical image onto an image detector, generating electronic image data from the optical image using the image detector and generating an electronic image from the electronic image data, defining a region of interest in the electronic image, determining a depth distribution in the region of interest and/or in a region of the object corresponding to the region of interest, determining a desired depth region in the depth distribution, selecting at least one imaging parameter with which a size of a depth-of-field region can be changed, and setting the depth-of-field region of the electronic image by changing the at least one selected imaging parameter such that the depth-of-field region covers the desired depth region or covers a specific portion thereof.

Methods and apparatus provide for: capturing an image of a subject from a position; capturing a plurality of images of the subject from a plurality of further positions around the position such that the plurality of captured images of the subject are at least one of different in image quality and view angles than the image of the subject from the position; generating data to be output on a basis of the image captured from the position and the plurality of images captured from the plurality of further positions; synthesizing the image captured from the position and the plurality of images captured from the plurality of further positions; and changing a synthesis ratio according to an image synthesis position.