H04N2013/0096

Live action volumetric video compression/decompression and playback
11025882 · 2021-06-01 · ·

A method for compressing geometric data and video is disclosed. The method includes receiving video and associated geometric data for a physical location, generating a background video from the video, and generating background geometric data for the geometric data outside of a predetermined distance from a capture point for the video as a skybox sphere at a non-parallax distance. The method further includes generating a geometric shape for a first detected object within the predetermined distance from the capture point from the geometric data, generating shape textures for the geometric shape from the video, and encoding the background video and shape textures as compressed video along with the geometric shape and the background geometric data as encoded volumetric video.

FASTER STATE TRANSITIONING FOR CONTINUOUS ADJUSTABLE 3DEEPS FILER SPECTACLES USING MULTI-LAYERED VARIABLE TINT MATERIALS
20210152811 · 2021-05-20 ·

An electrically controlled spectacle includes a spectacle frame and optoelectronic lenses housed in the frame. The lenses include a left lens and a right lens, each of the optoelectrical lenses having a plurality of states, wherein the state of the left lens is independent of the state of the right lens. The electrically controlled spectacle also includes a control unit housed in the frame, the control unit being adapted to control the state of each of the lenses independently.

IMAGE PROCESSING APPARATUS, IMAGE PROCESSING METHOD, AND STORAGE MEDIUM
20210136344 · 2021-05-06 ·

Provided is an image processing apparatus including: a virtual viewpoint image generating unit that generates a virtual viewpoint image which is a video, based on captured images captured by image capturing apparatuses from different directions; an electronic sign information obtaining unit that obtains information indicating a timing at which a content displayed on an electronic sign changes, the electronic sign being contained in the virtual viewpoint image and configured to change the content to be displayed on a time basis; and a control unit that performs control to cause a display unit to display the virtual viewpoint image having a virtual content inserted, the virtual content being a content that is virtual and not contained in the captured images. Based on the information, the control unit controls how the virtual content is displayed on the virtual viewpoint image.

VIRTUAL REALITY DISPLAY METHOD, DEVICE, SYSTEM AND STORAGE MEDIUM

Disclosed are a virtual reality display method, a device, a system, and a storage medium. The method is applicable to a terminal in the virtual reality display system which includes a virtual reality device and a terminal. The method includes: rendering a first virtual reality image at a first rendering resolution to acquire a first rendered image; sending the first rendered image to the virtual reality device; rendering a second virtual reality image at a second rendering resolution to acquire a second rendered image; and sending the second rendered image to the virtual reality device, wherein the first rendering resolution is less than the second rendering resolution, and the first and the second virtual reality images are two adjacent frames of images.

Faster state transitioning for continuous adjustable 3Deeps filer spectacles using multi-layered variable tint materials
10951881 · 2021-03-16 ·

An electrically controlled spectacle includes a spectacle frame and optoelectronic lenses housed in the frame. The lenses include a left lens and a right lens, each of the optoelectrical lenses having a plurality of states, wherein the state of the left lens is independent of the state of the right lens. The electrically controlled spectacle also includes a control unit housed in the frame, the control unit being adapted to control the state of each of the lenses independently.

Sensor fusion augmented reality eyewear device
10922888 · 2021-02-16 ·

An augmented reality eyewear device to operate augmented reality applications and provides a wide-angle field view, is disclosed. The eyewear device comprises a frame which is associated with a processor, a sensor assembly, a camera assembly, and a user interface control assembly coupled to the processor. The sensor assembly coupled to the processor comprises at least two inertial measurement unit (IMU) sensor to transmit raw IMU data of at least one IMU sensor and an android connected IMU data of at least one IMU sensor. The camera assembly coupled to the processor comprises at least two wide angle cameras synchronized with one another is configured to transmit camera feed data from the camera assembly to the processor. The processor is configured to dually synchronize raw IMU Data and android connected IMU data with the camera feed data providing a seamless display of 3D content of the augmented reality applications.

Using dynamic vision sensors for motion detection in head mounted displays

Systems and methods may provide for using one or more stereoscopic devices for gesture control and tracking in a head mounted display (HMD). Each of the one or more stereoscopic devices may include a pair of dynamic vision sensors (DVS) arranged to have complementary fields of view (FOV) to detect one or more of a leading and a trailing edge of an object moving in a range or area to be detected. The DVS sensors determine how the object is moving based on a change in light intensity of pixels without having to detect, transfer, or process all of the pixels. The system and method may thereby provide motion tracking and gesture control functions at very low latency and processing bandwidth.

METHOD AND SYSTEM FOR THREE-DIMENSIONAL SURFACE MEASUREMENT WITH A MOBILE DEVICE

A three-dimensional (3D) imaging system includes a mobile device that has a display screen configured to display a series of patterns onto an object that is to be imaged. The mobile device also includes a front-facing camera configured to capture reflections of the series of patterns off of the object. The system also includes a controller that is configured to control a timing of the series of patterns that appear on the display screen and activation of the front-facing camera in relation to the appearance of the series of patterns.

A MULTI-SPECTRAL SYSTEM FOR PROVIDING PRECOLLISION ALERTS
20200349846 · 2020-11-05 ·

A multi-spectral vehicular system for providing pre-collision alerts, comprising two pairs of stereoscopic infrared (IR) and visible light (VL) sensors, each of which providing acquired image streams from a mutual field of view, which are synchronized to provide stereoscopic vision; a data fusion module for mutually processing the data streams, to detect objects within the field of view and calculating distances to detected objects; a cellular based communication module for allowing communication between the sensors and mobile phones/Infotainment systems of the vehicle. The module runs a dedicated background application that is adapted to monitor the vicinity of the vehicle to detect other vehicles having a similar system; calculate speed and heading azimuth of each of the other vehicles; and provide alerts to the driver of the vehicle whenever other vehicles having a similar system are in a path of collision with the vehicle, based on the calculation and on the speed of the vehicle.

FASTER STATE TRANSITIONING FOR CONTINUOUS ADJUSTABLE 3DEEPS FILER SPECTACLES USING MULTI-LAYERED VARIABLE TINT MATERIALS
20200329230 · 2020-10-15 ·

An electrically controlled spectacle includes a spectacle frame and optoelectronic lenses housed in the frame. The lenses include a left lens and a right lens, each of the optoelectrical lenses having a plurality of states, wherein the state of the left lens is independent of the state of the right lens. The electrically controlled spectacle also includes a control unit housed in the frame, the control unit being adapted to control the state of each of the lenses independently.