Techniques related to 3D image capture with dynamic cameras.

Disclosed herein are methods, systems, and computer-readable storage media for generating three-dimensional (3D) images of a scene. According to an aspect, a method includes capturing a real-time image and a first still image of a scene. Further, the method includes displaying the real-time image of the scene on a display. The method also includes determining one or more properties of the captured images. The method also includes calculating an offset in a real-time display of the scene to indicate a target camera positional offset with respect to the first still image. Further, the method includes determining that a capture device is in a position of the target camera positional offset. The method also includes capturing a second still image. Further, the method includes correcting the captured first and second still images. The method also includes generating the three-dimensional image based on the corrected first and second still images.

A gesture operation method based on depth values and the system thereof are revealed. A stereoscopic-image camera module acquires a first stereoscopic image. Then an algorithm is performed to judge if the first stereoscopic image includes a triggering gesture. Then the stereoscopic-image camera module acquires a second stereoscopic image. Another algorithm is performed to judge if the second stereoscopic image includes a command gesture for performing the corresponding operation of the command gesture.

The present invention relates to a method of real-time generation of a 3D geometry of an object. The method comprises the steps of calibrating at least one RGB camera pair arranged to provide images of the object, receiving input images of the object from the at least on RGB camera pair, and performing a stereo reconstruction in a first hierarchical level using the input images. The stereo reconstruction step further comprises the steps of a) performing a ray marching operation in a first resolution on the input images to determine geometry positions along each view ray of the images; b) applying a uniqueness criterion to the geometry positions; c) determining a normal for each geometry position; d) performing a regularization operation based on the geometry positions and the respective normal, providing updated geometry positions; and e) performing an interpolation operation on the updated geometry positions and respective normal. The method further comprises repeating steps a) and c)-e) in at least one iteration in at least one ascending hierarchical level, wherein the resolution in the ray marching operation is doubled for each iteration, resulting in a geometry buffer for each of the at least one camera pair. The present invention further relates to a 3D image generation device and a system comprising such device.

Systems and methods for learning spaces of three-dimensional shape and appearance from datasets of single-view images can be utilized for generating view renderings of a variety of different objects and/or scenes. The systems and methods can be able to learn effectively from unstructured. in-the-wild data, without incurring the high cost of a full-image discriminator, and while avoiding problems such as mode-dropping that are inherent to adversarial methods.

The present invention provides a system and method for utilizing multiple camera systems for extracting obstructing objects or foreground close to primary camera(s) and filling in the unknown area using pixel information obtained from multiple cameras, i.e. synthesized images where foreground obstructions are removed is provided. This is done by using a primary camera capturing a target scene in the background, obstructed by foreground, and secondary cameras with viewpoints different from the primary camera provide coverage of the scene behind the foreground obstructions. A processing unit will synthesize the image from the primary camera by replacing foreground obstructions with pixels from secondary cameras, or a combination of both to obtain a transparent obstructing object with the background visible through the object. The area to be replaced is identified by calculating depths in the captured area of the primary camera, estimated by comparing images from multiple cameras.

An image processing apparatus that calculates three-dimensional information on a subject by a corresponding point search by taking one of three or more disparity images including the common subject to be a base image and one of the disparity images other than the base image to be a reference image, and includes: a search unit configured to search corresponding points base on an evaluation value in relation to a luminance gradient on an epi-polar line in each of the disparity images other the base image.

Disclosed is a stereo camera-based autonomous driving method and apparatus, the method including estimating a driving situation of a vehicle, determining a parameter to control a stereo camera width of a stereo camera based on the estimated driving situation, controlling a capturer configured to control arrangement between two cameras of the stereo camera for a first direction based on the determined parameter, and measuring a depth of an object located in the first direction based on two images respectively captured by the two cameras with the controlled arrangement.

A system for measuring object points on a three-dimensional object using a planar array of a multi-camera group, and a measuring method, are provided. The system is useful in the field of optical measuring technologies. The method includes establishing a measuring system of at least one four-camera group wherein digital cameras form a 22 array; matching an image object point acquired by the camera group; upon matched object point image coordinates, calculating coordinates of spatial locations of respective object points; upon coordinates of the spatial locations, calculating other three-dimensional dimensions of the measured object to be specially measured to form three-dimensional point clouds and establish a three-dimensional point clouds graph for performing three-dimensional stereoscopic reproduction. Here, full matching is performed for all measured points of the measured object by directly translating, superimposing, and comparing, point-by-point, the pixel points of measured images in X and Y-axes directions. In this way a three-dimensional object may be reproduced.

Some embodiments provide systems and methods to enable object replacement. A central computing system can receive data associated with quantities of like physical objects from remote systems. The central computing system can adjust the first quantity of the like physical objects stored in the first one of the remote systems based on the second quantity of the like physical objects stored in the at least another one of the remote systems. The central computing system can determine the like physical objects are absent from the facility. An autonomous robot device can detect a vacant space at the designated location at which the like physical objects are supposed to be disposed. The autonomous robot device using the image capturing device can capture an image of the vacant space. The central computing system can determine a set of like replacement physical objects to be disposed in the vacant space.