Disclosed are a method and an input device for inputting information such as user commands to a computer a person wearing a virtual retinal display device that allows the person to concurrently see the real world.

An information processing apparatus determines which of a first method for generating virtual viewpoint video upon receiving from an external apparatus object data used for generation of the virtual viewpoint video or a second method for receiving from the external apparatus virtual viewpoint video generated upon a virtual viewpoint designated for generation of the virtual viewpoint video to use as a delivery method for delivery of the virtual viewpoint video; and obtains the virtual viewpoint video by using the determined delivery method.

An information processing apparatus determines which of a first method for generating virtual viewpoint video upon receiving from an external apparatus object data used for generation of the virtual viewpoint video or a second method for receiving from the external apparatus virtual viewpoint video generated upon a virtual viewpoint designated for generation of the virtual viewpoint video to use as a delivery method for delivery of the virtual viewpoint video; and obtains the virtual viewpoint video by using the determined delivery method.

Methods, apparatuses and streams are disclosed for transmitting tiled volumetric video and, at the receiver, for generating an atlas image compatible with a legacy decoder. At the server side, viewport information is obtained and a first list of central tiles and a second list of border tiles are selected. A central tile is a part of an image obtained by projecting the 3D scene onto an image plane according to a central point of view. A border tile is an image comprising dis-occluding patches. Sizes and shapes of border tiles are function of size and shape of central tiles. At the client side, tiles are arranged according to a layout selected in a set of layouts according to the number, sizes and shapes of border tiles.

FIG. 8.

A three-dimensional model distribution method includes generating a depth image from a three-dimensional model; and distributing the depth image and information for restoring the three-dimensional model from the depth image.

A three-dimensional model distribution method includes generating a depth image from a three-dimensional model; and distributing the depth image and information for restoring the three-dimensional model from the depth image.

An information processing apparatus forms a virtual space that is viewable by a user by using a display device, and includes an information acquirer configured to acquire information that causes at least one of movement of a position of the user and a change in an orientation of the user in the virtual space. The information processing apparatus includes a control circuit configured to output, to the display device, based on the information that is acquired, an image in which a scene being viewed by the user in the virtual space is changed in a predetermined time range.

An information processing apparatus forms a virtual space that is viewable by a user by using a display device, and includes an information acquirer configured to acquire information that causes at least one of movement of a position of the user and a change in an orientation of the user in the virtual space. The information processing apparatus includes a control circuit configured to output, to the display device, based on the information that is acquired, an image in which a scene being viewed by the user in the virtual space is changed in a predetermined time range.

A dynamic event capturing and rendering system collects and aggregates video, audio, positional, and motion data to create a comprehensive user perspective 360-degree rendering of a field of play. An object associated with a user collects data that is stitched together and synchronized to provide post event analysis and training. Through an interface actions that occurred during an event can be recreated providing the viewer with information on what the user associated with the object was experiencing, where the user was looking, and how certain actions may have changed the outcome. Using the collected data, a virtual realty environment is created that can be manipulated to present alternative courses of action and outcomes.

Various embodiments describe systems and processes for capturing and generating multi-view interactive digital media representations (MIDMRs). In one aspect, a method for automatically generating a MIDMR comprises obtaining a first MIDMR and a second MIDMR. The first MIDMR includes a convex or concave motion capture using a recording device and is a general object MIDMR. The second MIDMR is a specific feature MIDMR. The first and second MIDMRs may be obtained using different capture motions. A third MIDMR is generated from the first and second MIDMRs, and is a combined embedded MIDMR. The combined embedded MIDMR may comprise the second MIDMR being embedded in the first MIDMR, forming an embedded second MIDMR. The third MIDMR may include a general view in which the first MIDMR is displayed for interactive viewing by a user on a user device. The embedded second MIDMR may not be viewable in the general view.