The invention relates to a method and apparatus for implementing the method. The method comprises receiving a first captured stream of an event from a first multicamera; providing on a head mounted display a presentation of the first captured stream; receiving at least a second captured stream of the event from at least a second multicamera, wherein the first and the second captured streams have been captured simultaneously from different perspectives of the event; switching the presentation of the first captured stream on the head mounted display to a presentation of the second captured stream, wherein the switching comprises rendering on the head mounted display a presentation of at least one view between the first and second multicameras, wherein the rendering depends on the intrinsic and extrinsic parameters of the at least two multicameras.

An image processing method includes: obtaining, by a first position sensor, a first lens position of a first camera; obtaining, by a second position sensor, a second lens position of a second camera; calculating, by a processing circuit, a relative optical geometry of the first camera and the second camera according to the first lens position and the second lens position; and performing, by the processing circuit, an image switch, an image fusion, or a depth calculation based on the relative optical geometry on the condition that an optical image stabilization is enabled to at least one of the first camera and the second camera.

A system includes one or more hardware processors, a display device, a memory storing 2-dimensional (2D) content and 3-dimensional (3D) content associated with a content item, and a playback engine. The playback engine is configured to receive the 2D content, the 2D content including one or more reference identifiers (IDs), display the 2D content on the display device for a user and, during display of the 2D content, receive an indication of a transition event. The playback engine is also configured to determine a transition reference identifier (ID) from the one or more reference IDs, identify the 3D content based on the transition reference ID, render a 3D environment based on the 3D content, and transition the display device from the displaying the 2D content to the 3D environment.

Apparatus and methods disclosed herein operate to monitor times of receipt of start-of-frame indications associated with frames received from multiple image sensors at a video controller. Time differences between the times of receipt of the frames are calculated. Embodiments herein alter one or more frame period determining parameter values associated with the image sensors if the time differences equal or exceed frame synchronization hysteresis threshold values. Parameter values are adjusted positively and/or negatively to decrease the time differences. The parameter values may be reset at each image sensor when the time differences become less than the frame synchronization hysteresis threshold value as additional frames are received at the video controller.

Disclosed herein are methods and systems for classifying pixels as foreground using both short-range depth data and long-range depth data. One embodiment takes the form of a process that includes obtaining video data depicting at least a portion of a user. The process also includes obtaining short-range depth data associated with the video data. The process also includes obtaining long-range depth data associated with the video data. The video data, short-range depth data, and long-range depth data may be obtained via a single 3-D video camera. The process also includes classifying pixels of the video data as foreground based at least in part on both the short-range depth data and the long-range depth data. In some embodiments, classifying pixels of the video data as foreground comprises employing an alpha mask. The alpha mask may comprise binary foreground (hard) indicators. The alpha mask may comprise foreground-likelihood (soft) indicators.

A display control apparatus configured to control displaying of a virtual viewpoint video image generated based on a plurality of captured images acquired from a plurality of cameras configured to capture an image of an image capturing target space from a different direction includes a reception unit configured to receive a user operation relating to a position and an orientation of a virtual viewpoint, a generation unit configured to generate a virtual viewpoint video image based on the user operation received by the reception unit, and a switch unit configured to switch a mode from a first mode of displaying a virtual viewpoint video image received from a server to a second mode of displaying the virtual viewpoint video image generated by the generation unit based on the user operation, in response to detection of a predetermined user operation during the first mode.

Provided is a technique for enhancing the display quality of a stereoscopic image. A display apparatus includes a parallax barrier, a detector, a predictor, and a controller. The detector detects a position of an observer. The predictor predicts, on the basis of a plurality of positions detected by the detector at past times, the position of the observer at a time coming after the past times, at which the plurality of positions have been detected. The controller determines a parallax barrier pattern selectively switching a plurality of barriers to a light transmissive state, and controls the parallax barrier on the basis of the parallax barrier pattern.

There is provided an image processing apparatus which is connected to a camera head capable of imaging a left eye image and a right eye image having parallax on one screen based on light at a target site incident on an optical instrument, the apparatus including: an image processor that performs the signal processing of the left eye image and the right eye image which are imaged by the camera head; and an output controller that outputs the left eye image and the right eye image on which the signal processing is performed to a monitor, in which the image processor adjusts an extraction position of at least one of the left eye image and the right eye image in accordance with a user operation based on the left eye image and the right eye image which are displayed on the monitor.

Apparatus and methods disclosed herein operate to monitor times of receipt of start-of-frame indications associated with frames received from multiple image sensors at a video controller. Time differences between the times of receipt of the frames are calculated. Embodiments herein alter one or more frame period determining parameter values associated with the image sensors if the time differences equal or exceed frame synchronization hysteresis threshold values. Parameter values are adjusted positively and/or negatively to decrease the time differences. The parameter values may be reset at each image sensor when the time differences become less than the frame synchronization hysteresis threshold value as additional frames are received at the video controller.

The electronic apparatus includes: a plurality of image sensors including a first image sensor and a second image sensor; and a processor electrically connected to the plurality of image sensors and configured to output a read control signal and a synchronization signal to the plurality of image sensors, wherein the processor is further configured to: output a first read control signal to the first image sensor and receive first data read from the first image sensor; output a second read control signal to the second image sensor and store second data read from the second image sensor in a temporary memory; and output the second data stored in the temporary memory based on an output control signal generated between the first read control signal and a next first read control signal and generate merged data in which the first data and the second data are merged.