H04N13/117

VR 360 video for remote end users

An apparatus for delivering virtual reality data portions to a client device, including a processing unit configured to perform the following in each one of a plurality of iterations: (1) receive from a network a current orientation data indicating a current orientation of a client device, (2) apply a rotation to a segment of a sphere defined in a virtual reality (VR) video file according to the current orientation, (3) crop from the rotated segment of the sphere in an equirectangular projection format an extended field of view (EFOV) frame in the equirectangular projection format according to the current orientation, and (4) instruct the network to transmit the EFOV frame to the client device.

METHOD AND APPARATUS FOR REALIZING 3D DISPLAY, AND 3D DISPLAY TERMINAL
20220417493 · 2022-12-29 ·

Provided is a method for realizing 3D display, comprising: acquiring an image having eye space information of a user; acquiring eye positions of the user according to the image having the eye space information of the user and by means of a displacement sensor that operates independently relative to a main control chip of a 3D display terminal; and generating 3D display content according to a to-be-displayed image and the eye positions of the user. According to the present disclosure, the displacement sensor that operates independently relative to a main control chip of a 3D display terminal is used to directly process the acquired image having eye space information of a user, instead of processing the image by means of the main control chip of the 3D display terminal. Further provided are an apparatus for realizing 3D display and a 3D display terminal.

System and method for modifying content of a virtual environment

A system for modifying data representing a virtual environment includes: an environment navigation unit operable to control navigation within the virtual environment to generate one or more viewpoints within the virtual environment, an environment identification unit operable to identify one or more aspects of the geometry of the virtual environment visible in the one or more viewpoints, a geometry evaluation unit operable to evaluate the visibility of one or more aspects of the geometry based upon the identification for each of one or more viewpoints, and a data modification unit operable to modify one or more elements of data representing the virtual environment.

System and method for modifying content of a virtual environment

A system for modifying data representing a virtual environment includes: an environment navigation unit operable to control navigation within the virtual environment to generate one or more viewpoints within the virtual environment, an environment identification unit operable to identify one or more aspects of the geometry of the virtual environment visible in the one or more viewpoints, a geometry evaluation unit operable to evaluate the visibility of one or more aspects of the geometry based upon the identification for each of one or more viewpoints, and a data modification unit operable to modify one or more elements of data representing the virtual environment.

DISPLAY METHOD, ELECTRONIC DEVICE, AND SYSTEM
20220404631 · 2022-12-22 ·

A display method, an electronic device, and a system for correcting display of images on a head-mounted display device are described. In a method, an electronic device may obtain an inter-pupillary distance (IPD) of a user based on user operations entered by the user based on user interfaces displayed on a head-mounted display device, correct a source image based on the IPD of the user to obtain target images used to be displayed on the head-mounted display device, and send the target images to the head-mounted display device. In this way, the user can comfortably and truly experience a 3D scenario when wearing the head-mounted display device.

3D DISPLAY DEVICE, METHOD AND TERMINAL
20220408077 · 2022-12-22 ·

A 3D display device is provided, comprising: a multi-viewpoint 3D display screen, comprising a plurality of composite pixels, wherein each composite pixel in the plurality of composite pixels comprises a plurality of composite subpixels, and each composite subpixel in the plurality of composite subpixels comprises a plurality of subpixels corresponding to a plurality of viewpoints; an eye positioning apparatus, configured to acquire spatial positions of eyes of a user; and a 3D processing apparatus, configured to determine the viewpoints by the spatial positions of the eyes of the user, and render the subpixels, corresponding to the viewpoints, in the plurality of composite subpixels based on received 3D signals. According to the above 3D display device, the flexibility of 3D display can be improved. A 3D display method, a 3D display terminal, a computer-readable storage medium and a computer program product are also provided.

3D DISPLAY DEVICE, METHOD AND TERMINAL
20220408077 · 2022-12-22 ·

A 3D display device is provided, comprising: a multi-viewpoint 3D display screen, comprising a plurality of composite pixels, wherein each composite pixel in the plurality of composite pixels comprises a plurality of composite subpixels, and each composite subpixel in the plurality of composite subpixels comprises a plurality of subpixels corresponding to a plurality of viewpoints; an eye positioning apparatus, configured to acquire spatial positions of eyes of a user; and a 3D processing apparatus, configured to determine the viewpoints by the spatial positions of the eyes of the user, and render the subpixels, corresponding to the viewpoints, in the plurality of composite subpixels based on received 3D signals. According to the above 3D display device, the flexibility of 3D display can be improved. A 3D display method, a 3D display terminal, a computer-readable storage medium and a computer program product are also provided.

INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING METHOD, AND STORAGE MEDIUM
20220408069 · 2022-12-22 ·

The information processing apparatus obtains first viewpoint information for specifying a virtual viewpoint corresponding to a virtual viewpoint image and second viewpoint information representing a viewpoint of a first image capturing apparatus existing in an image capturing range of a second image capturing apparatus that is used for generating the virtual viewpoint image and performs control so that the image captured by the first image capturing apparatus is output in a case where a position of the first image capturing apparatus specified by the second viewpoint information is included in a field of view of the virtual viewpoint specified by the first viewpoint information.

INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING METHOD, AND STORAGE MEDIUM
20220408069 · 2022-12-22 ·

The information processing apparatus obtains first viewpoint information for specifying a virtual viewpoint corresponding to a virtual viewpoint image and second viewpoint information representing a viewpoint of a first image capturing apparatus existing in an image capturing range of a second image capturing apparatus that is used for generating the virtual viewpoint image and performs control so that the image captured by the first image capturing apparatus is output in a case where a position of the first image capturing apparatus specified by the second viewpoint information is included in a field of view of the virtual viewpoint specified by the first viewpoint information.

Method to configure a virtual camera path

A computer-implemented system and method of configuring a path of a virtual camera. The method comprises receiving user steering information to control the path of the virtual camera in a scene; determining a primary target based upon a field of view of the virtual camera; and estimating a future path and a corresponding future field of view of the virtual camera, based on the received steering information. The method further comprises determining a secondary target of the scene proximate to the estimated future path of the virtual camera based on a preferred perspective of the secondary target; and configuring the path to capture the secondary target from the preferred perspective.