An image pickup apparatus includes a sensor configured to pick up a plurality of images different in in-focus position in an optical axis direction, an adjustment unit configured to adjust a parameter relating to image pickup to correct influence caused by an effective F-number varied depending on an in-focus position when at least a part of the plurality of images is picked up, and a synthesis unit configured to synthesize the plurality of images.

A control device includes a processor and a storage medium storing a program that, when executed by the processor, causes the processor to obtain a reference distance of a photographing device that includes a height of the photographing device or a distance from the photographing device to a target object, determine a range of a focus distance of the photographing device according to the reference distance, and control the photographing device to shoot a plurality of images while changing the focus distance within the range.

A method of an apparatus includes detecting a focusing state based on an output from a sensor, setting a step width of a focus position, and controlling to perform a plurality of times of image capturing based on a result of focus detection by the detecting and the set step width by the setting. In the setting, a step width from an in-focus position based on the result of focus detection by the detecting toward an infinity side is set to a value different from a step width from the in-focus position based on the result of focus detection by the detecting toward a closest side.

An image processing device including an image sensor array, an image pre-processing unit, a depth information generator, and a focusing unit is provided. The image sensor array takes multiple images of a first object and a second object. The image pre-processing unit processes the images to generate two shift images associated with the two objects. The depth information generator generates depth information according to the two shift images. The depth information includes distance information associated with the first object. The focusing unit generates a pair of focused images that have the first object focused thereon according to the depth information and the two shift images.

A shape measurement system includes one or more lighting units located in a case that illuminate a target object located in the case, one or more image capture units located in the case that capture an image of the target object, a holding unit that holds the image capture units and the lighting units so as to form a polyhedron shape approximating a sphere, a selector that selects at least one of the image capture units and at least one of the lighting units to be operated, and a shape calculator that calculates a 3-D shape of the target object based on image data captured by the selected image capture unit under light emitted by the selected lighting unit.

An optical device is provided that comprises a multi-order diffractive Fresnel lens (MOD-DFL) and an achromatizing compensation mechanism that reduces refractive dispersion created by the MOD-DFL, thereby reducing the focal range of the MOD-DFL. A method is also provided of using the optical device in an image processing system to obtain images of an object and processing the images to perform image enhancement.

An image pickup apparatus includes an imaging optical system, an image pickup element including a plurality of pixels, a lens array configured such that rays from the same position on an object plane are incident on pixels of the image pickup element different from each other depending on a pupil region of the imaging optical system through which the ray passes, an image processing unit configured to perform image processing for the input image acquired by the image pickup element to generate the output images, and a control unit configured to drive the imaging optical system to perform focus control, the image processing unit is configured to acquire information on a refocus control range, and the control unit is configured to perform the focus control based on the information on the refocus control range.

A variable focal length (VFL) lens system is utilized to determine surface Z-height measurements of imaged surfaces. A controller of the system is configured to control a VFL lens (e.g., a tunable acoustic gradient index of refraction lens) to periodically modulate its optical power and thereby periodically modulate a focus position at a first operating frequency, wherein the periodically modulated VFL lens optical power defines a first periodic modulation phase. A phase timing signal is synchronized with a periodic signal in the controller that has the first operating frequency and that has a second periodic modulation phase that has a phase offset relative to the first periodic modulation phase. A phase offset compensating portion is configured to perform a phase offset compensating process that provides Z-height measurements, wherein at least one of Z-height errors or Z-height variations that are related to a phase offset contribution are at least partially eliminated.

A depth estimation from focus method and system includes receiving input image data containing focus information, generating an intermediate attention map by an AI model, normalizing the intermediate attention map into a depth attention map via a normalization function, and deriving expected depth values for the input image data containing focus information from the depth attention map. The AI model for depth estimation can be trained unsupervisedly without ground truth depth maps. The AI model of some embodiments is a shared network estimating a depth map and reconstructing an AiF image from a set of images with different focus positions.

An image pickup apparatus includes a processor configured of hardware functioning as a pixel-shift-combination processing section configured to perform pixel shift combination of a plurality of image data acquired by performing pixel shift photographing in a certain focus position to generate combined image data, a depth-combination processing section configured to perform depth combination of a plurality of combined image data in different focus positions that the depth-combination processing section causes the pixel-shift-combination processing section to generate, and a microcomputer configured to extract a focused region in at least one or more of the plurality of focus positions. The pixel-shift-combination processing section performs, concerning a focus position where the focused region is extracted, the pixel shift combination concerning only a partial image region including the focused region.