Embodiments of the present application disclose a method and apparatus for generating an indoor panoramic video. For each of frames of the fish-eye video, coordinates of each of pixels of this frame in an image coordinate system are converted into coordinates in a spherical coordinate system to obtain a spherical coordinate system-based hemispherical fish-eye image. The frustum parameters of each of the N texture images of N viewing angles for the hemispherical fish-eye image are determined according to a shape of a preset living room. Based on the frustum parameters of each of the N texture images of N viewing angles, the N texture images of N viewing angles for the hemispherical fish-eye image are obtained. The N texture images of N viewing angles are rendered onto the N faces inside the preset living room, to generate the panoramic video image corresponding to the frame. As such, in the embodiment of the present application, a panoramic video image having a stereoscopic effect can be generated. The real-time performance for generating a panoramic video is improved, as no complicated image stitching algorithm is used. In addition, the cost for camera devices can be reduced, as there is no need for several cameras or an aerial camera.

The present disclosure relates to an information processing apparatus and a method capable of more easily providing a higher-quality image while reducing a drop of encoding efficiency. Generated is a file which includes information associated with projection extension as an extension method of a projection system for mapping, on a single plane, a three-dimensional structure image as an image projected on a three-dimensional structure. For example, the present disclosure is applicable to an information processing apparatus, an image processing apparatus, an image encoding apparatus, a file generation apparatus, a file transmission apparatus, a distribution apparatus, a file reception apparatus, an image decoding apparatus, a reproduction apparatus, or the like.

The present disclosure relates to an image processing apparatus and method for transforming image data of a spherical coordinate system corresponding to image data of a planar coordinate system without transforming the image data of the planar coordinate system, and stitching the transformed image data of the spherical coordinate system to the image data of the planar coordinate system.

In an image distance calculator (100), a CPU (104) extracts a frame image from moving images of an object captured by a camera, generates a slice image on the basis of a temporal change in a pixel line on a y-axis at a point x0 in the frame image, calculates a spotting point on the basis of correspondences between pixels in the slice image and pixels in the frame image, obtains pixels in the frame image corresponding to pixels in the slice image by a back-trace process, segments the frame image and slice image into regions, determines a corresponding region corresponding to a segmented region of the slice image, calculates a ratio value from an average q of the numbers of pixels in the corresponding region in the frame image and an average p of the numbers of pixels in the segmented region of the slice image, and calculates the distance z from the camera to the object for each corresponding region using a predetermined distance function.

Systems and methods are provided for allowing stakeholders in the video production industry to perform location scouting and other film-related processes via virtual reality devices. Imagery can be collected from a plurality of different physical locations. Subsequently, directors, location managers, directors of photography, production designers, and others, can virtually view each of the different physical locations using a virtual reality device. Attributes regarding the physical locations that are relative to filming can also be collected and provided to the users.

Methods and apparatus for shared image processing among multiple devices. In one embodiment, an exemplary action camera performs a partial multiband blend. Even though the action camera may not have resources to handle the multiband blend of the entire action camera's footage, it can do a significant portion. The partially blended content can be used in ready-to-share applications, or completely blended by another device.

The present principles relates to a method and device for encoding an input colored point cloud representing the geometry and colors of a 3D object. The method comprises: selecting (100) at least one face (F.sub.i,j) of at least one cube (C.sub.j) of an octree-based structure of projection according to at least one orthogonal projection of the point cloud onto said at least one face; and encoding (120, 130) a pair of one texture image (TI.sub.i,j) and one depth (DI.sub.i,j) image per selected face (F.sub.i,j) of a cube (C.sub.j) by orthogonally projecting the part of the point cloud included in said cube (C.sub.j) onto said selected face (F.sub.i,j).

The present principles relates to a two-steps approach for encoding and decoding the geometry of a point cloud. In a first step, an octree-based structure is obtained by splitting recursively a cube encompassing the point cloud until the leaf cubes associated with the leaf nodes of said octree-based structure reach down an expected size. In a second step, for each leaf cube associated with the leaf nodes of said octree-based structure (IO), the approach determines if a local octree-based structure is associated (or not) with a leaf cube by using a Rate-Distortion Optimisation process that optimizes a trade-off between a bit-rate for encoding a candidate octree-based structure approximating the geometry of points of the point cloud which are included in said leaf cube of the octree-based structure, and a distortion that takes into account spatial distances between, on one hand, said points of the point cloud, and on the other hand, points included in leaf cubes associated with leaf nodes of the candidate octree-based structure.

Some implementations of the disclosure are directed to allowing interactive broadcast streamed video from games and other dynamic content. In accordance with some implementations, a content creator may publish a plurality of video surfaces of an environment for streaming to a plurality of client devices for video playback. The plurality of video surfaces may correspond, for example, to a cube map of a gaming environment captured from the perspective of a player. Upon receiving a stream including multiple video surfaces such as a cubemap, a media player of a viewer may generate a fully-rendered three-dimensional view of the environment.

A method and an apparatus for transmitting and receiving video content including 3D data are provided. According to an embodiment, a method for transmitting data related to content including an omnidirectional image and a point cloud object is provided. The method includes generating media data and metadata for the content including the omnidirectional image and the point cloud object; and transmitting the generated media data and the generated metadata, wherein the metadata comprises information for specifying sub-spaces of a bounding space related to the point cloud object.