Patent classifications
G09G5/391
Systems and Methods for Head-Mounted Display Adapted to Human Visual Mechanism
Systems and methods are provided for rendering of a dual eye-specific display. The system tracks the user's eye movements and/or positions, in some implementations, based on electroencephalography (EEG) of the user, to correctly label the central (foveal) and peripheral (extra-foveal) areas of the display. Foveal data is fully rendered while extra-foveal data is reduced in resolution and, in some implementations, shared between the two displays.
Systems and Methods for Head-Mounted Display Adapted to Human Visual Mechanism
Systems and methods are provided for rendering of a dual eye-specific display. The system tracks the user's eye movements and/or positions, in some implementations, based on electroencephalography (EEG) of the user, to correctly label the central (foveal) and peripheral (extra-foveal) areas of the display. Foveal data is fully rendered while extra-foveal data is reduced in resolution and, in some implementations, shared between the two displays.
REAL-TIME USER ADAPTIVE FOVEATED RENDERING
Foveated rendering based on user gaze tracking may be adjusted to account for the realities of human vision. Gaze tracking error and state parameters may be determined from gaze tracking data representing a user's gaze with respect to one or more images presented to a user. Adjusted foveation data representing an adjusted size and/or shape of one or more regions of interest in one or more images to be subsequently presented to a user may be generated based on the one or more gaze tracking error or state parameters. Foveated image data representing one or more foveated images may be generated with the adjusted foveation data. The foveated images are characterized by level of detail within the one or more regions of interest and lower level of detail outside the one or more regions of interest. The foveated images may then be presented to the user.
REAL-TIME USER ADAPTIVE FOVEATED RENDERING
Foveated rendering based on user gaze tracking may be adjusted to account for the realities of human vision. Gaze tracking error and state parameters may be determined from gaze tracking data representing a user's gaze with respect to one or more images presented to a user. Adjusted foveation data representing an adjusted size and/or shape of one or more regions of interest in one or more images to be subsequently presented to a user may be generated based on the one or more gaze tracking error or state parameters. Foveated image data representing one or more foveated images may be generated with the adjusted foveation data. The foveated images are characterized by level of detail within the one or more regions of interest and lower level of detail outside the one or more regions of interest. The foveated images may then be presented to the user.
Information processing device and information processing method
An information processing device including a control unit that senses a state that causes decrease of a display frame rate of a virtual object presented to a user and dynamically change a display detail level of the virtual object in accordance with a result of the sensing is provided.
Image processing device, image processing method, and image display system
An image processing device includes a memory that stores a program and a processor that executes the program stored in the memory to perform a process. The process includes obtaining input image data that is generated by combining, in a horizontal direction, an effective display area of first image data and an effective display area obtained by expanding an effective display area of second image data in the vertical direction, the vertical size of the second image data being smaller than the vertical size of the first image data; and generating second output image data corresponding to the second image data by reducing the vertical size of second intermediate image data among first intermediate image data and the second intermediate image data, which are obtained by dividing the input image data in the horizontal direction, based on the vertical size of the effective display area of the second image data.
SYSTEMS AND METHOD FOR GPU BASED VIRTUAL REALITY VIDEO STREAMING SERVER
Systems and methods of processing and streaming a virtual reality video using a graphics processing unit (GPU) are provided. A video server is configured to cause a processor to read, from a video data source, source video data including multiple spherical image frame data and store the source video data in a first memory. The video server is further configured to cause the GPU to convert, in response to storing first spherical image frame data in a first frame buffer of a second memory, the first spherical image frame data to first equirectangular image frame data that correspond to a portion of spherical image represented by the first spherical image frame data, encode the converted first equirectangular image frame data and store the encoded first equirectangular image frame data in an encoded frame buffer of the second memory.
INFORMATION PROCESSING APPARATUS, METHOD OF CONTROLLING THE SAME AND NON-TRANSITORY COMPUTER-READABLE STORAGE MEDIUM
An information processing apparatus that has a display unit and a plurality of graphic controllers, the apparatus comprises: a detection unit that detects an event that is generated by a user operation on the display unit; a determination unit that determines, when the event is detected by the detection unit, which of the plurality of graphic controllers an application displaying a screen on the display unit uses; and a transmission unit that, based on a resolution of the display unit and information of the application for which the determination is made by the determination unit, converts coordinate information of the user operation that the event indicates to a value of a coordinate system corresponding to the graphic controller that the application uses, and transmits a result of the conversion to the application.
INFORMATION PROCESSING APPARATUS, METHOD OF CONTROLLING THE SAME AND NON-TRANSITORY COMPUTER-READABLE STORAGE MEDIUM
An information processing apparatus that has a display unit and a plurality of graphic controllers, the apparatus comprises: a detection unit that detects an event that is generated by a user operation on the display unit; a determination unit that determines, when the event is detected by the detection unit, which of the plurality of graphic controllers an application displaying a screen on the display unit uses; and a transmission unit that, based on a resolution of the display unit and information of the application for which the determination is made by the determination unit, converts coordinate information of the user operation that the event indicates to a value of a coordinate system corresponding to the graphic controller that the application uses, and transmits a result of the conversion to the application.
INFORMATION PROCESSING APPARATUS AND CONTROL METHOD
[Object] To provide an information processing apparatus and a control method that can differentiate between an area that can be visually recognized only by a specified user and an area that can be visually recognized by all users on an information presentation surface that is simultaneously viewed by a plurality of people. [Solution] Provided is an information processing apparatus, including: a line-of-sight detection unit configured to detect lines of sight of a plurality of users with respect to presentation information; and an area determination unit configured to determine, on the basis of the detected lines of sight of the plurality of users, a shared area that is visually recognized by the plurality of users to share information and a confidential area that is not visually recognized by another user to keep information of each user confidential.