A three-dimensional map generating and displaying apparatus according to an exemplary embodiment of the present invention includes an acquiring unit which acquires pose information including position and rotation information on photographing points at which three-dimensional information on a three-dimensional space is acquired with respect to a global coordinate system; a generating unit which generates a plurality of local coordinate systems for the three-dimensional space according to at least one of a spatial contiguity and a temporal contiguity of the photographing points, based on the acquired pose information; and a display unit which when an observer of a virtual reality is located in the three-dimensional space, finds the photographing point corresponding to a point at which the observer is located using the plurality of local coordinate system and generates and displays the three-dimensional map using the three-dimensional information acquired from the photographing point.

A method for decoding a compressed image stream, the image stream having a plurality of frames, each frame consisting of a merged image including pixels from a left image and pixels from a right image. The method involves the steps of receiving each merged image; changing a clock domain from the original input signal to an internal domain; for each merged image, placing at least two adjacent pixels into an input buffer and interpolating an intermediate pixel, for forming a reconstructed left frame and a reconstructed right frame according to provenance of the adjacent pixels; and reconstructing a stereoscopic image stream from the left and right image frames. The invention also teaches a system for decoding a compressed image stream.

The disclosed technology includes systems and methods for enhancing machine vision object recognition based on a plurality of captured images and an accumulation of corresponding classification analysis scores. A method is provided for capturing, with a camera of a mobile computing device, a plurality of images, each image of the plurality of images comprising a first object. The method includes processing, with a classification module comprising a trained neural network processing engine, at least a portion of the plurality of images. The method includes generating, with the classification module and based on the processing, one or more object classification scores associated with the first object. The method includes accumulating, with an accumulating module, the one or more object classification scores. And responsive to a timeout or an accumulated score exceeding a predetermined threshold, the method includes outputting classification information of the first object.

The information processing device includes an image analysis unit (A4-i) and a content rendering unit. The image analysis unit (A4-i) generates spatial position/range information (D4) of a virtual space in which a spatial display performs 3D display based on a captured image of a marker displayed on the spatial display. The content rendering unit performs rendering processing of the spatial video presented in the virtual space, based on the spatial position/range information (D4) and a viewpoint position.

An apparatus includes one or more processors and logic encoded in one or more non-transitory media for execution by the one or more processors and when executed operable to receive a first image of an object, wherein the first image was captured by a first camera in a set of cameras. The logic is further operable to determine first keypoints and a first pose for the object based on the first image. The logic is further operable to receive a second image from a second camera in the set of cameras. The logic is further operable to determine an overlap of the first image and the second image based on locations of the first keypoints, the second keypoints, the first pose, and the second pose. The logic is further operable to determine a synchronization error between the first image and the second image based on the overlap.

A wearable electronic device includes a left-eye display configured to output light of a first color corresponding to a 3D left-eye image, a right-eye display configured to output light of a second color corresponding to a 3D right-eye image, a left-eye optical waveguide configured to adjust a path of the light of the first color and output the light of the first color, a right-eye optical waveguide configured to adjust a path of the light of the second color and output the light of the second color, a left-eye display control circuit configured to supply a driving power and a control signal to the left-eye display, a right-eye display control circuit configured to supply a driving power and a control signal to the right-eye display, a communication module configured to communicate with a mobile electronic device, and a second control circuit configured to supply a driving power and a control signal to the communication module.

Aspects of the technology encompass image encoding, which includes generating image content according to a viewpoint defined by image viewpoint data. Successive output images are generated such that each output image includes image content generated according to one or more viewpoints, and encoding metadata associated with each output image which indicates each viewpoint relating to image content contained in that output image, and which defines which portions of that output image were generated according to each of those viewpoints. An image display method for generating successive display images from successive input images is also provided, which includes re-projecting portions of each input image to form a respective display image, according to any differences between a desired display viewpoint and a particular viewpoint defined for that portion by metadata associated with a respective input image. The metadata indicating viewpoints relating to image content contained in the respective input images.

A method, a system, and a computer program product for dynamically adjusting sampling of a depth map based on detected motion in a current scene. The method includes capturing real-time scan data at a first resolution by a first camera and a second camera of an image capturing device. The method further includes synchronizing a first plurality of frames of the real-time scan data to create a plurality of synchronized frames at a first frame rate. The method further includes analyzing the synchronized frames to determine whether motion exists. The method further includes, in response to determining motion exists: determining, based on the plurality of synchronized frames, a rate of motion within the current scene; and dynamically calculating a target resolution and a target frame rate for a real-time depth map. The method further includes generating a real-time depth map at the target resolution and target frame rate.

Disclosed is a method and apparatus for calibrating parameters of a three-dimensional (3D) display apparatus, the method including acquiring a first captured image of a 3D display apparatus displaying a first pattern image, adjusting a first parameter set of the 3D display apparatus based on the first captured image, acquiring a second captured image of the 3D display apparatus displaying a second pattern image based on the adjusted first parameter set, and adjusting a second parameter set of the 3D display apparatus based on the second captured image.

An image processing method for processing a plurality of images is provided. The image processing method includes: acquiring a plurality of first images, each of the plurality of first images taken with each of a plurality of imaging devices; acquiring first imaging clock times, each of the first imaging clock times corresponding to each of the plurality of first images; selecting a plurality of second images from the plurality of first images; and generating an image set constructed with the plurality of second images. Each of second imaging clock times correspond to each of the plurality of second images. The second imaging clock times are (i) substantially matched with each other and (ii) included in the first imaging clock times.