Patent classifications
H04N13/344
Optimizing 360-degree video streaming with video content analysis
Aspects of the subject disclosure may include, for example, a method performed by a processing system of determining a present orientation of a display region presented at a first time on a display of a video viewer, predicting a future orientation of the display region occurring at a second time based on data collected, to obtain a predicted orientation of the display region to be presented at the second time on the display of the video viewer, identifying, based on the predicted orientation of the display region, a first group of tiles from a video frame of a panoramic video being displayed by the video viewer, wherein the first group of tiles covers the display region in the video frame at the predicted orientation, and a plurality of objects moving in the video frame from the first time to the second time, wherein each object of the plurality of objects is located in a separate spatial region of the video frame at the second time, wherein a second group of tiles collectively covers the separate spatial regions, wherein tiles in the first group of tiles and tiles in the second group of tiles are different, and facilitating wireless transmission of the first group of tiles and a second tile from the second group of tiles, for presentation at the video viewer at the second time. Other embodiments are disclosed.
Surgical navigation system and method
The present disclosure relates to a surgical navigation system for the alignment of a surgical instrument and methods for its use, wherein the surgical navigation system may comprise a head-mounted display comprising a lens. The surgical navigation system may further comprise tracking unit, herein the tracking unit may be configured to track a patient tracker and/or a surgical instrument. Patient data may be registered to the patient tracker. The surgical instrument may define an instrument axis. The surgical navigation system may be configured to plan one or more trajectories based on the patient data. The head-mounted display may be configured to display augmented reality visualization, including an augmented reality position alignment visualization and/or an augmented reality angular alignment visualization related to the surgical instrument on the lens of the head-mounted display.
Surgical navigation system and method
The present disclosure relates to a surgical navigation system for the alignment of a surgical instrument and methods for its use, wherein the surgical navigation system may comprise a head-mounted display comprising a lens. The surgical navigation system may further comprise tracking unit, herein the tracking unit may be configured to track a patient tracker and/or a surgical instrument. Patient data may be registered to the patient tracker. The surgical instrument may define an instrument axis. The surgical navigation system may be configured to plan one or more trajectories based on the patient data. The head-mounted display may be configured to display augmented reality visualization, including an augmented reality position alignment visualization and/or an augmented reality angular alignment visualization related to the surgical instrument on the lens of the head-mounted display.
Presenting video streams on a head-mountable device
In various implementations, a method of presenting video streams at a head-mountable device (HMD) includes generating a first video stream at a first frame rate for a first display portion. In some implementations, the first frame rate indicates a rate at which frames are presented by the first display portion. In various implementations, the method includes generating a second video stream at a second frame rate for a second display portion. In some implementations, the second frame rate indicates a rate at which frames are presented by the second display portion. In some implementations, the second frame rate is within a threshold relative to the first frame rate. In various implementations, the method includes temporally shifting the second video stream relative to the first video stream so that a majority of refresh times of the first display portion are different from refresh times of the second display portion.
Presenting video streams on a head-mountable device
In various implementations, a method of presenting video streams at a head-mountable device (HMD) includes generating a first video stream at a first frame rate for a first display portion. In some implementations, the first frame rate indicates a rate at which frames are presented by the first display portion. In various implementations, the method includes generating a second video stream at a second frame rate for a second display portion. In some implementations, the second frame rate indicates a rate at which frames are presented by the second display portion. In some implementations, the second frame rate is within a threshold relative to the first frame rate. In various implementations, the method includes temporally shifting the second video stream relative to the first video stream so that a majority of refresh times of the first display portion are different from refresh times of the second display portion.
IMAGE DISPLAY DEVICE, IMAGE DISPLAY METHOD, AND RECORDING MEDIUM
Provided is an image display device used by being mounted to a head or a face of a user, including a first display unit that displays an internal image seen from a side of the user, a second display unit that displays an external image seen from outside the image display device, and a control unit that controls display of the internal image and the external image.
Binocular See-Through AR Head-Mounted Display Device and Information Display Method Therefor
A binocular see-through AR head-mounted display device is disclosed. Based on that the mapping relationships f.sub.c.fwdarw.s and f.sub.d.fwdarw.i are pre-stored in the head-mounted device, the position of the target object in the camera image is obtained through an image tracking method, and is mapped to the screen coordinate system of the head-mounted device for calculating the left/right image display position. Through a monocular distance finding method, the distance between the target object and the camera is real-time calculated referring to the imaging scale of the camera, so as to calculate a left-right image distance, thereby calculating the right or the right image display position. Correspondingly, the present invention also provides an information display method for a binocular see-through AR head-mounted display device and an augmented reality information display system. The present invention is highly reliable with low cost. The conventional depth of field adjustment is to change an image distance of an optical element. However, the present invention breaks conventional thinking, which calculates the left and the right image display positions for depth of field adjustment without changing a structure of an optical device. The present invention is novel and practical compared to changing an optical focal length.
ADVANCED REFRACTIVE OPTICS FOR IMMERSIVE VIRTUAL REALITY
A display device has a display, operable to generate a real image, and an optical system, comprising one or more lenslets, arranged to generate a virtual sub-image from a partial real image on the display, by each lenslet projecting light from the display to an eye position. The sub-images combine to form a virtual image viewable from the eye position. At least one lenslet is symmetric with respect to a plane, and the display surface is cylindrical with its axis perpendicular to that plane.
HEAD MOUNTED DEVICE
The present invention provides a head mounted device. Said head mounted device includes a visual reality helmet (1), a control section (2), a transmission line (4) and a head band portion. Said visual reality helmet (1) includes a mask proximate to user's face and a display screen in front of the mask. The control section (2) is connected with the visual reality helmet (1) as a whole via the transmission line (4), in order to control the operation of the head mounted device. The head band portion is intended to mount this visual reality helmet (1) onto the head of a user. By providing a control section (2) to be connected with the visual reality helmet (1), the head mounted device disclosed herein does not need to connect with other peripheral devices and thus enhance the portability and the compatibility thereof. In preferred embodiments, by providing a microphone (10) and a camera module so as to enhance the man-machine interaction capability of the head mounted device; by providing an earphone seat (3) on the transmission line (4), and by providing a rotatable head band (6) and an adjusting head band which are detachable and adjustable, the comfort of wearing this head mounted device is improved.
TRANSFER CONTROL APPARATUS, CONTROL METHOD, AND MIXED-REALITY PRESENTATION APPARATUS
A transfer control apparatus transfers video data obtained by image capturing in an image capturing and displaying apparatus to an image processing apparatus, and transfers video data generated by the image processing apparatus to the image capturing and displaying apparatus. In the transfer control apparatus, a first converter outputs an optical signal converted from an electrical signal representing the video data, an optical fiber transfers the optical signal, a second converter outputs an electrical signal converted from the optical signal transferred by the optical fiber, and a metal wire transfers a control signal indicating whether it is possible to communicate the video data by a communication unit of the image capturing and displaying apparatus. Operations of the first and second converters are controlled based on the control signal.