The present disclosure relates to methods, apparatus or systems for formatting of backward compatible immersive video streams. At least one legacy rectangular video is captured from an immersive video obtained from a source (82). A set of camera control data are used to determine which parts of the immersive video will constitute legacy videos (84). These part are removed from the immersive video (83) and every prepared videos are packaged in a stream (85). The structure from the stream is a container. Information data about the location and size of removed parts may be added in the stream.

An apparatus for processing a wide viewing angle image may include: a correction parameter generating unit for analyzing an image input from a camera to generate a correction parameter, a projection geometry generating unit for generating a projection geometry to output a wide viewing angle image by using the correction parameter, and a wide viewing angle image packaging unit for encoding the input image, the correction parameter and the projection geometry to generate a wide viewing angle image package. A method for processing a wide viewing angle image may be performed using the apparatus.

Innovations in reconstruction and rendering of panoramic video are described. For example, a view-dependent operation controller of a panoramic video playback system receives an indication of a view direction for an application and, based at least in part on the view direction, identifies a section of a picture of panoramic video in an input projection. The view-dependent operation controller limits operations of a color converter, video decoder, and/or streaming controller to the identified section. In this way, the panoramic video playback system can avoid performing operations to reconstruct sections of the picture of panoramic video that will not be viewed. As another example, a mapper of a panoramic video playback system re-projects at least some sample values in an input flat projection towards a center location for a view direction, producing an output flat projection, which an application can use to generate one or more screen projections.

Innovations in reconstruction and rendering of panoramic video are described. For example, a view-dependent operation controller of a panoramic video playback system receives an indication of a view direction for an application and, based at least in part on the view direction, identifies a section of a picture of panoramic video in an input projection. The view-dependent operation controller limits operations of a color converter, video decoder, and/or streaming controller to the identified section. In this way, the panoramic video playback system can avoid performing operations to reconstruct sections of the picture of panoramic video that will not be viewed. As another example, a mapper of a panoramic video playback system re-projects at least some sample values in an input flat projection towards a center location for a view direction, producing an output flat projection, which an application can use to generate one or more screen projections.

The invention relates to a method for generating a three-dimensional facial model the shape of which can changed on the basis of a plurality of images of faces of persons, including the steps that involve: generating a facial template; acquiring shapes from examples of faces of persons; repeatedly changing the shape of the template for each example of a face of a person, so that the shape of the changed template corresponds to the shape of the face example, and determining the change in shape between the initial template and the changed template; and generating the facial model as a linear combination of the shape of the template and the changes in shape between the initial template and the changed template, for each example of a face of a person. The invention also relates to a method for processing an image of a face of a person such as to generate a three-dimensional image of the face of the person from of said deformable model.

Hyper-hemispherical images may be combined to generate a rectangular projection of a spherical image having an equatorial stitch line along of a line of lowest distortion in the two images. First and second circular images are received representing respective hyper-hemispherical fields of view. A video processing device may project each circular image to a respective rectangular image by mapping an outer edge of the circular image to a first edge of the rectangular image and mapping a center point of the circular image to a second edge of the first rectangular image. The rectangular images may be stitched together along the edges corresponding to the outer edge of the original circular image.

In a camera which electronically realizes panning, tilting, and zooming, on the basis of the luminance detected in each frame period (n1), a condition of exposure for two frame periods thereafter (n+1), and digital gain for three frame periods thereafter (n+2) are set. When an instruction for changing the extracted region is received in a certain frame period (n1), the region extracted from the image is changed three frame periods thereafter. It is possible to achieve a stable exposure control by which the luminance of the image varies little even when the region extracted from the image is switched.

A position determination unit determines, in a fisheye image, a position of a clipping portion clipped from the fisheye image. Based on the position of the clipping portion determined by the position determination unit, a determination unit determines a moving amount of the clipping portion for moving the clipping portion.

A scanning system comprises a scanning device and a computing device. The scanning device scans an object to produce an original image, wherein the original image contains a plurality of colors. The computing device is electrically connected to the scanning device and performs an image processing method including steps: receiving the original image generated by the scanning device; specifying a number of the plurality of layers; assigning each color of the original image to one of the plurality of layers; determining a height of each layer; and mapping the height of each layer to the original image based on each color contained by each layer to produce a height image.

A system captures a first hemispherical image and a second hemispherical image, each hemispherical image including an overlap portion, the overlap portions capturing a same field of view, the two hemispherical images collectively comprising a spherical FOV and separated along a longitudinal plane. The system maps a modified first hemispherical image to a first portion of the 2D projection of a cubic image, the modified first hemispherical image including a non-overlap portion of the first hemispherical image, and maps a modified second hemispherical image to a second portion of the 2D projection of the cubic image, the modified second hemispherical image also including a non-overlap portion. The system maps the overlap portions of the first hemispherical image and the second hemispherical image to the 2D projection of the cubic image, and encodes the 2D projection of the cubic image to generate an encoded image representative of the spherical FOV.