Patent classifications
H04N2213/003
Unpacking method, unpacking device and unpacking system of packed frame
An unpacking method, an unpacking device and an unpacking system of a packed frame are disclosed. The packed frame is to be displayed on a screen and includes a color frame and a resized depth frame, and the color frame is corresponding to the resized depth frame. The center of the color frame is displayed in the central area of the screen. The unpacking method includes the steps of: extracting the color frame and the resized depth frame from the packed frame; and restoring the resized depth frame to obtain an original depth frame.
System and method for combining text with three dimensional content
A system and method for combining and/or displaying text with three-dimensional content. The system and method inserts text at the same level as the highest depth value in the 3D content. One example of 3D content is a two-dimensional image and an associated depth map. In this case, the depth value of the inserted text is adjusted to match the largest depth value of the given depth map. Another example of 3D content is a plurality of two-dimensional images and associated depth maps. In this case, the depth value of the inserted text is continuously adjusted to match the largest depth value of a given depth map. A further example of 3D content is stereoscopic content having a right eye image and a left eye image. In this case the text in one of the left eye image and right eye image is shifted to match the largest depth value in the stereoscopic image. Yet another example of 3D content is stereoscopic content having a plurality of right eye images and left eye images. In this case the text in one of the left eye images or right eye images is continuously shifted to match the largest depth value in the stereoscopic images. As a result, the system and method of the present disclosure produces text combined with 3D content wherein the text does not obstruct the 3D effects in the 3D content and does not create visual fatigue when viewed by a viewer.
Stereoscopic imaging systems and methods
A stereoscopic imaging system and method is disclosed. In one aspect the system includes an X-ray source that emits a plurality of X-ray fanbeams. The system includes columns of detectors. Each column of detectors is arranged at a preset angle with respect to the X-ray source. The detectors detect a strength of an X-ray fanbeam penetrating an object under inspection. The detectors form transmission images when the object intersects, or moves along a direction intersecting with, the X-ray fanbeams. The system includes a reconstruction apparatus that uses any two of the formed transmission images as a binocular image. The reconstruction apparatus calculates depth information of the object on the transmission images. The reconstruction apparatus superposes and fuses the calculated depth information to obtain 3D information. The reconstruction apparatus performs 3D reconstruction so that the detected object can be presented in a stereoscopic manner from different view angles.
Receiving system and method of processing data
A receiving system that can receive and process 3D images and a data processing method of the same are disclosed. The receiving system includes an image receiving unit and a display unit. The image receiving unit receives a 3-dimensions (3D) image and system information including additional information of the 3D image (i.e., additional 3D image information), generates 3D signaling information based upon the additional 3D image information included in the system information, and transmits the generated 3D signaling information along with the 3D image through a digital interface. And, the display unit receives the 3D signaling information along with the 3D image through the digital interface, formats the 3D image based upon the receiving 3D signaling information, and displays the formatted 3D image.
Reducing disparity and depth ambiguity in three-dimensional (3D) images
A method for three dimensional (3D) image processing is provided that includes receiving an image, wherein each location in the image includes a value indicative of a depth of a pixel in a scene and wherein each value has an associated confidence measure, determining whether each similarity region of a plurality of non-overlapping similarity regions in the image is valid or invalid based on a number of values in the similarity region having sufficiently high confidence measures, wherein a similarity region includes contiguous locations in the image having similar values, and indicating that the values in a similarity region are invalid when the similarity region is determined to be invalid.
IMAGE SYNTHESIS
An image synthesis apparatus comprises a receiver (301) for receiving image parts and associated depth data of images representing a scene from different view poses from an image source. A store (311) stores a depth transition metric for each image part of a set of image parts where the depth transition metric for an image part is indicative of a direction of a depth transition in the image part. A determiner (305) determines a rendering view pose and an image synthesizer (303) synthesizes at least one image from received image part. A selector is arranged to select a first image part of the set of image parts in response to the depth transition metric and a retriever (309) retrieves the first image part from the image source. The synthesis of an image part for the rendering view pose is based on the first image part.
METHODS AND SYSTEMS FOR PRODUCING CONTENT IN MULTIPLE REALITY ENVIRONMENTS
This disclosure contains methods and systems that allow filmmakers to port filmmaking and editing skills to produce content to be used in other environments, such as video game environments, and augmented reality, virtual reality, mixed reality, and non-linear storytelling environments.
MULTI-VIEW CODING WITH EFFICIENT RESIDUAL HANDLING
A gain in multi-view coding is achieved as follows: the residual signal involved with coding a dependent view of the multi-view signal is predicted from a reference residual signal of the current picture of the reference view using block-granular disparity-compensated prediction, i.e. using disparity compensated prediction with a disparity defined at, and varying with, block granularity so that each block of the current picture of the dependent view has its own disparity displacement such as its own disparity vector, associated therewith. In other words, a remaining similarity between the residual signal involved with predictively coding the reference view is used in order to predict the residual signal involved with predictively coding the dependent view.
DEPTH MAP PROCESSING
For multi-view video content represented in the MVD (Multi-view+Depth) format, the depth maps may be processed to improve the coherency therebetween. In one implementation, to process a target view based on an input view, pixels of the input view are first projected into the world coordinate system, then into the target view to form a projected view. The texture of the projected view and the texture of the target view are compared. If the difference at a pixel is small, then the depth of the target view at that pixel is adjusted, for example, replaced by the corresponding depth of the projected view. When the multi-view video content is encoded and decoded in a system, depth map processing may be applied in the pre-processing and post-processing modules to improve video compression efficiency and the rendering quality.
A METHOD AND APPARATUS FOR ENCODING AND RENDERING A 3D SCENE WITH INPAINTING PATCHES
Methods, devices and stream are disclosed for encoding, transporting and decoding a 3D scene prepared to be viewed from the inside of a viewing zone. A central view comprising texture and depth information is encoded by projected points of the 3D scene visible from a central point of view onto an image plane. Patches are generated to encode small parts of the 3D scene not visible from the central point of view. At the rendering, a viewport image is generated for the current point of view. Holes, that is dis-occluded areas, of the viewport are filled using a patch based inpainting algorithm adapted to take the patches, warped according to the rotation and translation between virtual camera used for capturing the patch and the current virtual camera.