Patent classifications
H04N13/344
DISPLAY SYSTEM WITH MACHINE LEARNING (ML) BASED STEREOSCOPIC VIEW SYNTHESIS OVER A WIDE FIELD OF VIEW
According to examples, a display system may include a head-mounted display (HMD) headset. The HMD may comprise at least one exterior-facing RBG camera mounted on a front face of the HMD and on a same visual plane of a user's eye. The at least one exterior-facing RBG camera may collects images for view synthesis. The HMD may include a processor, and a memory storing instructions, which when executed by the processor, cause the processor to provide view synthesis in accordance with a machine-learning (ML) based technique comprising at least one of the following: depth estimation, imaging to sharpening, forward splatting, disocclusion filtering, or fusion.
DISPLAY SYSTEM WITH MACHINE LEARNING (ML) BASED STEREOSCOPIC VIEW SYNTHESIS OVER A WIDE FIELD OF VIEW
According to examples, a display system may include a head-mounted display (HMD) headset. The HMD may comprise at least one exterior-facing RBG camera mounted on a front face of the HMD and on a same visual plane of a user's eye. The at least one exterior-facing RBG camera may collects images for view synthesis. The HMD may include a processor, and a memory storing instructions, which when executed by the processor, cause the processor to provide view synthesis in accordance with a machine-learning (ML) based technique comprising at least one of the following: depth estimation, imaging to sharpening, forward splatting, disocclusion filtering, or fusion.
Systems and methods for machine perception
A system to determine a position of one or more objects includes a transmitter to emit a beam of photons to sequentially illuminate regions of one or more objects; multiple cameras that are spaced-apart with each camera having an array of pixels to detect photons; and one or more processor devices that execute stored instructions to perform actions of a method, including: directing the transmitter to sequentially illuminate regions of one or more objects with the beam of photons; for each of the regions, receiving, from the cameras, an array position of each pixel that detected photons of the beam reflected or scattered by the region of the one or more objects; and, for each of the regions detected by the cameras, determining a position of the regions using the received array positions of the pixels that detected the photons of the beam reflected or scattered by that region.
Systems and methods for machine perception
A system to determine a position of one or more objects includes a transmitter to emit a beam of photons to sequentially illuminate regions of one or more objects; multiple cameras that are spaced-apart with each camera having an array of pixels to detect photons; and one or more processor devices that execute stored instructions to perform actions of a method, including: directing the transmitter to sequentially illuminate regions of one or more objects with the beam of photons; for each of the regions, receiving, from the cameras, an array position of each pixel that detected photons of the beam reflected or scattered by the region of the one or more objects; and, for each of the regions detected by the cameras, determining a position of the regions using the received array positions of the pixels that detected the photons of the beam reflected or scattered by that region.
Enabling motion parallax with multilayer 360-degree video
Systems and methods are described for simulating motion parallax in 360-degree video. In an exemplary embodiment for producing video content, a method includes obtaining a source video, based on information received from a client device, determining a selected number of depth layers, producing, from the source video, a plurality of depth layer videos corresponding to the selected number of depth layers, wherein each depth layer video is associated with at least one respective depth value, and wherein each depth layer video includes regions of the source video having depth values corresponding to the respective associated depth value, and sending the plurality of depth layer videos to the client device.
Enabling motion parallax with multilayer 360-degree video
Systems and methods are described for simulating motion parallax in 360-degree video. In an exemplary embodiment for producing video content, a method includes obtaining a source video, based on information received from a client device, determining a selected number of depth layers, producing, from the source video, a plurality of depth layer videos corresponding to the selected number of depth layers, wherein each depth layer video is associated with at least one respective depth value, and wherein each depth layer video includes regions of the source video having depth values corresponding to the respective associated depth value, and sending the plurality of depth layer videos to the client device.
Systems and devices for controlling camera privacy in wearable devices
Systems and devices for controlling camera privacy in wearable devices are described. A camera cover can be provided that is movable between a closed position and an open position. In the closed position, the camera cover can occlude a field of view of a camera, such that the camera cannot capture meaningful data. In the open position, the camera cover can be at least partially out of the field of view of the camera, such that the camera can capture meaningful data. The camera cover can be positioned within a housing of the wearable device, and an actuator can be positioned external to the housing of the wearable device. A user can move the camera cover by moving the actuator.
Systems and devices for controlling camera privacy in wearable devices
Systems and devices for controlling camera privacy in wearable devices are described. A camera cover can be provided that is movable between a closed position and an open position. In the closed position, the camera cover can occlude a field of view of a camera, such that the camera cannot capture meaningful data. In the open position, the camera cover can be at least partially out of the field of view of the camera, such that the camera can capture meaningful data. The camera cover can be positioned within a housing of the wearable device, and an actuator can be positioned external to the housing of the wearable device. A user can move the camera cover by moving the actuator.
VIRTUAL REALITY FILM HYBRIDIZATION
Described are methods, systems, and media for immersive content. Also described herein are camera assemblies for capturing unidirectional immersive three-dimensional images and video with wide ranges of focal lengths.
VIRTUAL REALITY FILM HYBRIDIZATION
Described are methods, systems, and media for immersive content. Also described herein are camera assemblies for capturing unidirectional immersive three-dimensional images and video with wide ranges of focal lengths.