In a method and supporting system for intelligent buffering of large scale videos, a video presentation includes a plurality of sub-videos, each associated with a field of view. During presentation of the large scale video, sub-videos within a user's field of view are loaded and presented to the user, and sub-videos in proximate fields of view are loaded for potential presentation. On identifying a change in the user's field of view to one of the proximate fields of view, sub-videos are loaded for presentation within the new field of view. In a method and supporting system for seamless transitions in large scale videos, a video having a plurality of sub-videos is provided for presentation to a user, and distraction levels based on video content and user interactions are tracked. A transition point for the video is identified based on one or both distraction levels, and a sub-video is changed to a different sub-video at the transition point.

According to one embodiment, a basic format for a 3D signal having a first area to arrange main video data, a second area to arrange graphic data, a third area to arrange depth information of pixels of the main video data, and a fourth area to arrange depth information of pixels of the graphic data are defined. When depth information of pixels of the main video data is generated, a 3D processing module can select whether to use a first pattern obtained by inserting the graphic data into the main video data and a second pattern obtained by not inserting the graphic data into the main video data. A 3D related controller decides on the first or second pattern to be used by the 3D processing module.

A display control apparatus configured to control displaying of a virtual viewpoint video image generated based on a plurality of captured images acquired from a plurality of cameras configured to capture an image of an image capturing target space from a different direction includes a reception unit configured to receive a user operation relating to a position and an orientation of a virtual viewpoint, a generation unit configured to generate a virtual viewpoint video image based on the user operation received by the reception unit, and a switch unit configured to switch a mode from a first mode of displaying a virtual viewpoint video image received from a server to a second mode of displaying the virtual viewpoint video image generated by the generation unit based on the user operation, in response to detection of a predetermined user operation during the first mode.

The techniques described herein relate to methods, apparatus, and computer readable media configured to accessing multimedia data that includes a plurality of media tracks that each include an associated series of samples of media data, and a derived track comprising a set of derivation operations to perform to generate a series of samples of media data for the derived track. A derivation operation of the set is performed to generate a portion of media data for the derived track, which includes: determining, based on the derivation operation, a group of media tracks from the plurality by determining each media track in the group meets a grouping criteria, selecting one media track from the group of media tracks, and adding a sample from the one media track to the derived track to generate the portion of the derived track.

The present invention discloses a multiple camera sensor system and a method for any application and for a large number of different fields. The present invention is solving certain problems related to existing camera technology issues by introducing the possibility of getting several different camera inputs from the same source or moving shots/images without physically moving any cameras. It will minimize the physical presence of existing camera technology, size, weight and design and also to large extent avoid physical laws like gravity, vibrations, acceleration, retardation and speed. This may be implemented by means of a software virtually moving camera using multiple cameras sensors mounted consecutively along some attachment solution. This attachment solution may include e.g. tape or strips. The invention can be utilized in areas like industry and production support, medical appliances, AV production, Video Conferencing, Broadcast, Surveillance and Security among others.

A video processing apparatus specifies, from a plurality of image capturing apparatuses, an image capturing apparatus including an object designated by a user in an image capturing range based on three dimensional shape information corresponding to the object, the object existing in an image capturing area captured by the plurality of image capturing apparatuses, and outputs display information including presentation of the specified image capturing apparatus.

A method and a device for transmitting viewpoint switching capabilities in a Virtual Reality 360 (VR360) application are provided. The method for transmitting viewpoint switching capabilities in a VR360 application includes determining a configuration for switching between viewpoints in the VR360 application; and signaling the configuration to the VR360 application.

An information processing system includes a user-specified video creation unit configured to create a user-specified video to be distributed to a user terminal from a free-viewpoint video created based on a plurality of captured images captured by a plurality of cameras, an accepting unit configured to accept an instruction of changing setting of a virtual camera from the user terminal, a determination unit configured to determine whether a user needs assistance in setting a viewpoint of the virtual camera based on the instruction from the user accepted by the accepting unit, and a switching unit configured to switch an image being displayed on the user terminal to another image when the determination unit determines that the user needs assistance in setting the viewpoint.

Provided are an image sensor with one or more image receivers for image combining, and an imaging system and method therefor. The image sensor includes an image sensor array to generate first image data for a first image; a receiver to receive, into the image sensor, second image data for a second image; an image combination circuit coupled to the image sensor array and the receiver to receive the first image data and the second image data and combine the first image data and the second image data into combined image data for a single combined image, according to one or more image combination criteria, and at least one of the first image data and the second image data; and a transmitter coupled to the image combination circuit to transmit the combined image data for the combined image from the image sensor.

Time information of an output video and setting information of an imaging apparatus at least a switch time included in the time information are obtained. Setting information of a virtual viewpoint at the switch time included in the time information in which setting information of the virtual viewpoint at the switch time is set based on the obtained setting information of the imaging apparatus is obtained. An image processing apparatus generates a virtual viewpoint video based on the setting information of the virtual viewpoint. The image processing apparatus and a storage apparatus storing the captured video synchronously output frames of the same time based on the time information. The virtual viewpoint video and the captured video received from the image processing apparatus and the storage apparatus are outputted while being switched from one video to another at the switch time.