A method of generating a three-dimensional model of an object, is executed by a processor. The method includes executing rendering of the three-dimensional model of the object based on an image captured by the imaging device; and modifying the three-dimensional model.

Various embodiments describe systems and processes for capturing and generating multi-view interactive digital media representations (MIDMRs). In one aspect, a method for automatically generating a MIDMR comprises obtaining a first MIDMR and a second MIDMR. The first MIDMR includes a convex or concave motion capture using a recording device and is a general object MIDMR. The second MIDMR is a specific feature MIDMR. The first and second MIDMRs may be obtained using different capture motions. A third MIDMR is generated from the first and second MIDMRs, and is a combined embedded MIDMR. The combined embedded MIDMR may comprise the second MIDMR being embedded in the first MIDMR, forming an embedded second MIDMR. The third MIDMR may include a general view in which the first MIDMR is displayed for interactive viewing by a user on a user device. The embedded second MIDMR may not be viewable in the general view.

In a system and method of calibrating a stereoscopic camera, a target pattern is electronically displayed on a display. The camera to be calibrated captures images of the target pattern using a stereoscopic camera while the displayed target pattern is altered over time. The captured images are analyzed and calibration parameters for the stereoscopic camera are determined.

Provided is a robot including: a chassis; wheels; electric motors; a network card; sensors; a processor; and a tangible, non-transitory, machine readable medium storing instructions that when executed by the processor effectuates operations including: capturing, with at least one exteroceptive sensor, a first image and a second image; determining, with the processor, an overlapping area of the first image and the second image by comparing the raw pixel intensity values of the first image to the raw pixel intensity values of the second image; combining, with the processor, the first image and the second image at the overlapping area to generate a digital spatial representation of the environment; and estimating, with the processor using a statistical ensemble of simulated positions of the robot, a corrected position of the robot to replace a last known position of the robot within the digital spatial representation of the environment.

While a viewer is viewing a first stereoscopic image comprising a first left image and a first right image, a left vergence angle of a left eye of a viewer and a right vergence angle of a right eye of the viewer are determined. A virtual object depth is determined based at least in part on (i) the left vergence angle of the left eye of the viewer and (ii) the right vergence angle of the right eye of the viewer. A second stereoscopic image comprising a second left image and a second right image for the viewer is rendered on one or more image displays. The second stereoscopic image is subsequent to the first stereoscopic image. The second stereoscopic image is projected from the one or more image displays to a virtual object plane at the virtual object depth.

A three-dimensional (3D) measurement system, a method of measuring 3D coordinates, and a method of generating dense 3D data is provided. The method of measuring 3D coordinates includes using a first 3D measurement device and a second 3D measurement device in a cooperative manner is provided. The method includes acquiring a first set of 3D coordinates with the first 3D measurement device. The first set of 3D coordinates are transferred to the second 3D measurement device. A second set of 3D coordinates is acquired with the second 3D measurement device. The second set of 3D coordinates are registered to the first set of 3D coordinates in real-time while the second 3D measurement device is acquiring the second set of 3D coordinates.

A binocular-vision-based method for tracking fruit space attitude and fruit space motion, the method comprising: establishing a connected base coordinate system by taking a junction of a fruit and a fruit stem as an origin; statically photographing a feature point on the surface of the fruit and a point of the connected base coordinate system established at the junction of the fruit and the fruit stem; storing a photographed image; acquiring an inherent relationship between the feature point and the connected base coordinate system; photographing dynamic motion of the fruit; acquiring absolute coordinates of the feature point on the surface of the fruit; calculating, according to the inherent relationship between the feature point and the connected base coordinate system, absolute coordinates of a point of the connected base coordinate system at each moment corresponding to each frame of image; and respectively calculating the displacement, instantaneous speed and instantaneous acceleration of the fruit, calculating swing angular displacement and swing angular acceleration of the fruit, and calculating a fruit torsion angular speed and a fruit torsion angular acceleration at the moment t. The study of a fruit motion state in the field of forest fruit harvest through vibration is performed, so that the motion of fruits can be better tracked.

A method for generating a quality inspection data block for a distributed ledger includes: determining an identification code associated with a sample to be inspected, inspecting the sample and thereby generating quality inspection data associated with the sample, and after completion of the inspecting of the sample combining the identification code and the quality inspection data into the quality inspection data block. The method also includes adding the quality inspection data block to the distributed ledger. An inspector including a sensor that senses a characteristic of a sample, a memory that stores sensor output data, and a processor configured to: determine an identification code associated with a sample to be inspected, generate quality inspection data based on the sensor output data, and combine the identification code and the quality inspection data into a quality inspection data block. In one example, the inspector is an in-flight 3D inspector.

A CNN operates on the disparity or motion outputs of a block matching hardware module, such as a DMPAC module, to produce refined disparity or motion streams which improve operations in images having ambiguous regions. As the block matching hardware module provides most of the processing, the CNN can be small and thus able to operate in real time, in contrast to CNNs which are performing all of the processing. In one example, the CNN operation is performed only if the block hardware module output confidence level is below a predetermined amount. The CNN can have a number of different configurations and still be sufficiently small to operate in real time on conventional platforms.

A method for obtaining a three-dimensional model of an inspection site, using a perception module, is disclosed. The perception module comprises a detection unit, e.g. comprising one or more cameras and/or a three-dimensional laser scanner, configured to obtain a three-dimensional image. At least one three-dimensional image is obtained by means of the detection unit. A three-dimensional model of surroundings of the perception module is created, based on the obtained three-dimensional image. The created three-dimensional model and a plan of the inspection site are compared and features of the created three-dimensional model and features of the plan of the inspection site are matched. A site-specific three-dimensional model of the inspection site is formed, based on the created three-dimensional model and the plan of the inspection site, and based on the comparison.