A camera system for generating an eye contact image view of a person with a gaze direction that is offset from a camera position, the camera system includes a camera configured to obtain image data of the person, a processing circuitry configured to be operatively connected to the camera and configured to obtain a camera view of the person from a camera position, and generate a synthetic camera view of the person from a virtual camera position.

There is provided a system and method for reinstating directionality of onscreen displays of three-dimensional (3D) imagery using sensor data capturing eye location of a user. The method can include: receiving the sensor data capturing the eye location of the user; tracking the location of the eyes of the user relative to a screen using the captured sensor data; determining an updated rendering of the onscreen imagery using off-axis projective geometry based on the tracked location of the eyes of the user to simulate an angled viewpoint of the onscreen imagery from the perspective of the location of the user; and outputting the updated rendering of the onscreen imagery on a display screen.

Provided is an image processing apparatus including: a virtual viewpoint image generating unit that generates a virtual viewpoint image which is a video, based on captured images captured by image capturing apparatuses from different directions; an electronic sign information obtaining unit that obtains information indicating a timing at which a content displayed on an electronic sign changes, the electronic sign being contained in the virtual viewpoint image and configured to change the content to be displayed on a time basis; and a control unit that performs control to cause a display unit to display the virtual viewpoint image having a virtual content inserted, the virtual content being a content that is virtual and not contained in the captured images. Based on the information, the control unit controls how the virtual content is displayed on the virtual viewpoint image.

A distribution device for delivering a selected viewport stream of virtual reality (VR) data to each of a plurality of client devices, comprising a processor configured for receiving a plurality of extended viewport streams of a VR video file each comprising a sequence of extended field of view (EFOV) frames created for a respective one of a plurality of overlapping segments constituting a sphere defined in the VR video file and delivering a selected one of the plurality of extended viewport streams to each of a plurality of client devices by performing the following for each of the client devices in each of a plurality of iterations: (1) receiving a current orientation data of the respective client device; (2) selecting one of the plurality of extended viewport streams according to the current orientation data; and (3) transmitting the selected extended viewport stream to the respective client device.

A distribution device for delivering a selected viewport stream of virtual reality (VR) data to each of a plurality of client devices, comprising a processor configured for receiving a plurality of extended viewport streams of a VR video file each comprising a sequence of extended field of view (EFOV) frames created for a respective one of a plurality of overlapping segments constituting a sphere defined in the VR video file and delivering a selected one of the plurality of extended viewport streams to each of a plurality of client devices by performing the following for each of the client devices in each of a plurality of iterations: (1) receiving a current orientation data of the respective client device; (2) selecting one of the plurality of extended viewport streams according to the current orientation data; and (3) transmitting the selected extended viewport stream to the respective client device.

A data processing apparatus transmits a virtual viewpoint image generated on the basis of a captured image to a device. The data processing apparatus acquires first data regarding a reproduction history and/or registration data of the virtual viewpoint image, and performs control for transmitting second data regarding the virtual viewpoint image to the device on the basis of the acquired first data.

A data processing apparatus transmits a virtual viewpoint image generated on the basis of a captured image to a device. The data processing apparatus acquires first data regarding a reproduction history and/or registration data of the virtual viewpoint image, and performs control for transmitting second data regarding the virtual viewpoint image to the device on the basis of the acquired first data.

An information processing apparatus includes a processor, and a memory built in or connected to the processor, in which the processor acquires a subject image showing a subject present inside a three-dimensional region, which is an observation target, in a case in which an inside of the three-dimensional region is observed from a viewpoint position determined based on coordinates inside the three-dimensional region corresponding to an indication position that is indicated inside the three-dimensional region or that is indicated inside a reference image showing a state of the inside of the three-dimensional region in a case in which the inside of the three-dimensional region is observed from a reference position.

An information processing apparatus includes a processor, and a memory built in or connected to the processor, in which the processor acquires a subject image showing a subject present inside a three-dimensional region, which is an observation target, in a case in which an inside of the three-dimensional region is observed from a viewpoint position determined based on coordinates inside the three-dimensional region corresponding to an indication position that is indicated inside the three-dimensional region or that is indicated inside a reference image showing a state of the inside of the three-dimensional region in a case in which the inside of the three-dimensional region is observed from a reference position.

Disclosed are a method and an input device for inputting information such as user commands to a computer a person wearing a virtual retinal display device that allows the person to concurrently see the real world.