Patent classifications
H04N13/158
Electronic device and method for displaying and generating panoramic image
Disclosed is a method for displaying a panoramic image by an electronic device. According to an example embodiment of the present disclosure, a method for generating a panoramic image may comprise sensing a direction that a first side surface of the electronic device faces through a sensor included in the electronic device, displaying a first partial image of the panoramic image corresponding to the sensed direction of the first side surface, determining a direction corresponding to the reference view information with respect to the first partial image if information regarding the first partial image differs from reference view information indicating a reference view for the panoramic image, and providing information about the determined direction.
Image processing apparatus, camera apparatus, and image processing method
There is provided an image processing apparatus which is connected to a camera head capable of imaging a left eye image and a right eye image having parallax on one screen based on light at a target site incident on an optical instrument, the apparatus including: an image processor that performs the signal processing of the left eye image and the right eye image which are imaged by the camera head; and an output controller that outputs the left eye image and the right eye image on which the signal processing is performed to a monitor, in which the image processor adjusts an extraction position of at least one of the left eye image and the right eye image in accordance with a user operation based on the left eye image and the right eye image which are displayed on the monitor.
CARRIAGE OF PCC IN ISOBMFF FOR FLEXIBLE COMBINATION
An electronic device, non-transitory computer readable medium and a method for point cloud compression (PCC) is provided. The method includes receiving a PCC stream; mapping the PCC stream to a plurality of video ISO base media file format (ISOBMFF) streams; generating a ISOBMFF elementary stream including configuration information indicating a logical grouping of the plurality of video ISOBMFF streams into the PCC stream; and transmitting the ISOBMFF elementary stream and the plurality of video ISOBMFF streams to a client device.
IMAGE PROCESSING DEVICE AND SYSTEM
A video providing device for providing video content having a plurality of viewpoints, the device includes: a video storage unit operable to store a plurality of versions of a video for each of a plurality of the viewpoints in the video content, the videos being encoded such that each video includes a region of high resolution corresponding to that viewpoint, where a plurality of the videos each include the same region of high resolution, and each video having the same region of high resolution is encoded with a temporal offset of the group of pictures relative to those other videos with the same region of high resolution, the group of pictures offsets defining video switching times for each video, a viewpoint determining unit operable to determine a requested viewpoint in the video content, a timing identification unit operable to identify a next suitable video switching time from amongst the plurality of video switching times, a video selection unit operable to select a video with a high resolution region corresponding to the requested viewpoint and the identified video switching time, and a video transmitting unit operable to transmit the selected video to a video receiving device.
CONDITIONAL FORCED PERSPECTIVE IN SPHERICAL VIDEO
A processor-implemented method in a digital media player includes receiving data defining a user's viewport in relation to spherical video frames displayed by the digital media player; and where a forced perspective event is to be triggered at the time of display of a spherical frame, triggering the forced perspective event conditionally based at least on the orientation of the user's viewport in relation to the spherical video frames. A digital media player includes processing structure for receiving data defining a user's viewport in relation to spherical video frames displayed by the digital media player; and processing structure for, where a forced perspective event is to be triggered at the time of display of a spherical frame, triggering the forced perspective event conditionally based at least on the orientation of the user's viewport in relation to the spherical video frames. A processor-readable medium embodying a computer program for a digital media player is provided. The computer program includes program code for receiving data defining a user's viewport in relation to spherical video frames displayed by the digital media player; and program code for, where a forced perspective event is to be triggered at the time of display of a spherical frame, triggering the forced perspective event conditionally based at least on the orientation of the user's viewport in relation to the spherical video frames.
MULTI-PERSPECTIVE AUGMENTED REALITY EXPERIENCE
The present disclosure relates to methods and systems for providing a multi-perspective augmented reality experience. A volumetric video of a three-dimensional space is captured. The volumetric video of the three-dimensional space includes a volumetric representation of a first user within the three-dimensional space. The volumetric video is displayed by a display device worn by a second user, and the second user sees the volumetric representation of the first user within the three-dimensional space. Input indicative of an interaction (e.g., entering or leaving) of the second user with the volumetric representation of the first user is detected. Based on detecting the input indicative of the interaction, the display device switches to a display of a recorded perspective of the first user. Thus, by interacting with a volumetric representation of the first user in a volumetric video, the second user views the first user's perspective of the three-dimensional space.
Monitoring of video streaming events
Systems and methods described herein provide for monitoring of video streaming events. Techniques disclosed include rendering a first omnidirectional video associated with a first viewpoint. In response to a request to access an omnidirectional video associated with another viewpoint, a time of the request and information identifying the other viewpoint is recorded. Techniques disclosed also include identifying a time of switching into rendering of a second omnidirectional video associated with a second viewpoint, and reporting a viewpoint switching latency, representing a difference between the identified switching time and a recorded request time associated with information identifying the second viewpoint.
METHOD, APPARATUS AND DEVICE FOR PROCESSING IMMERSIVE MEDIA DATA, STORAGE MEDIUM
This application discloses a method for processing immersive media data performed by a computer device. The method includes: generating an interaction feedback message corresponding to an interaction operation in response to the interaction operation aiming at a first immersive media content, the interaction feedback message carrying a business key field, the business key field being used for describing a business event indicated by the interaction operation; transmitting the interaction feedback message to determine the business event indicated by the interaction operation based on the business key field in the interaction feedback message, and acquires a second immersive media content used for responding to the interaction operation based on the business event indicated by the interaction operation; and receiving the second immersive media content returned by the server for rendering the second immersive media content on a display associated with the computer device.
Method, Computer Storage Media, and Client for Switching Scenes of Panoramic Video
A method, a computer storage medium, and a client for switching scenes of a panoramic video are provided. The method includes playing a first primary video stream in a first video stream group associated with a first perspective of a user; determining a video stream switching time when a perspective of the user is switched from the first perspective to a second perspective, the video stream switching time being associated with a time length of a video slice in a second backup video stream; and switching from the first primary video stream to the second backup video stream when a play time of the first primary video stream reaches the video stream switching time, so that content of the second backup video stream starting from the video stream switching time is played. The present application can improve the effects of switching between scenes of the panoramic video.
Methods and apparatus for controlling a viewing position
Methods and apparatus for allowing a user to switch viewing positions and/or perspective while viewing an environment, e.g., as part of a 3D playback/viewing experience, are described. In various embodiments images of the environment are captured using cameras placed at multiple camera positions. During viewing a user can select which camera position he/she would like to experience the environment from. While experiencing the environment from the perspective of a first camera position the user may switch from the first to a second camera position by looking at the second position. A visual indication is provided to the user to indicate that the user can select the other camera position as his/her viewing position. If a user input indicates a desired viewing position change, a switch to the alternate viewing position is made and the user is presented with images captured from the perspective of the user selected alternative viewing position.