H04N2013/0096

Dynamically adjusting sampling of a real-time depth map

A method, a system, and a computer program product for dynamically adjusting sampling of a depth map based on detected motion in a current scene. The method includes capturing real-time scan data at a first resolution by a first camera and a second camera of an image capturing device. The method further includes synchronizing a first plurality of frames of the real-time scan data to create a plurality of synchronized frames at a first frame rate. The method further includes analyzing the synchronized frames to determine whether motion exists. The method further includes, in response to determining motion exists: determining, based on the plurality of synchronized frames, a rate of motion within the current scene; and dynamically calculating a target resolution and a target frame rate for a real-time depth map. The method further includes generating a real-time depth map at the target resolution and target frame rate.

Method and apparatus for generating projection image, method for mapping between image pixel and depth value

Disclosed is a projection image generating method for a 3D space. An exemplary embodiment of the present disclosure provides a projection image generating method, including: estimating a plurality of image obtaining poses and a plurality of depth obtaining poses including obtaining positions and obtaining angles of a plurality of obtained images and a plurality of obtained depth values obtained in an actual 3D space, respectively, with respect to a reference coordinate system; obtaining a user pose including a location and an angle of the user in a virtual 3D space corresponding to the actual 3D space with respect to the reference coordinate system; and generating a projection image obtained by projecting the plurality of obtained depth values into at least one of the plurality of obtained images, based on the corresponding image obtaining pose corresponding to the user pose and at least one corresponding depth obtaining pose.

ELECTRONIC DEVICE AND SCREEN IMAGE DISPLAY METHOD FOR ELECTRONIC DEVICE
20200090704 · 2020-03-19 ·

According to various embodiments of the present invention, an electronic device can comprise: a display for displaying at least a part of an image corresponding to a designated direction in image data on a screen as a partial image; a communication circuit for receiving information related to an external electronic device; and a processor for performing a control so as to display a first partial image of the image data through the display, to check information on a second partial image, being displayed on the external electronic device, of the image data from the information received through the communication circuit, and to allow the information on the second partial image the information on the second partial image to be displayed through the display while the first partial image is being displayed on the screen through the display. The various embodiments of the present invention can allow other embodiments to be possible.

Synchronization controller unit for sensor node

A vehicular synchronization system includes an image sensor of a vehicle. The image sensor captures image data for an image sensor field of view. The vehicular synchronization system also includes a light sensor having a radial view. The light sensor captures light data from around the vehicle in a full rotation. The vehicular synchronization system includes a synchronization control unit having a data receiving module, a trigger time determination module, a timer module, and a sensor trigger module. The data receiving module receives a data packet from the light sensor. The trigger time determination module determines a trigger time when a desired light sensor orientation overlaps with the image sensor field of view. The timer module sets a timer to elapse at the trigger time. The sensor trigger module controls the image sensor to capture image data at the trigger time when the timer elapses.

PROCESS AND SYSTEM FOR ENCODING AND PLAYBACK OF STEREOSCOPIC VIDEO SEQUENCES

A method for decoding a compressed image stream, the image stream having a plurality of frames, each frame consisting of a merged image including pixels from a left image and pixels from a right image. The method involves the steps of receiving each merged image; changing a clock domain from the original input signal to an internal domain; for each merged image, placing at least two adjacent pixels into an input buffer and interpolating an intermediate pixel, for forming a reconstructed left frame and a reconstructed right frame according to provenance of the adjacent pixels; and reconstructing a stereoscopic image stream from the left and right image frames. The invention also teaches a system for decoding a compressed image stream.

Method and system for alignment of data
11943420 · 2024-03-26 · ·

A user monitoring system receives a first data stream from a first recording device and a second data stream from a second recording device. Each of the first data stream and the second data stream include data relating to an eye of the user. The first data stream and the second data stream overlap temporally. The system processes the first data stream to determine a first blink sequence of the user, processes the second data stream to determine a second blink sequence of the user, and compares the first blink sequence and the second blink sequence to detect a blink pattern present in both the first blink sequence and the second blink sequence. The system determines a temporal offset of the first data stream and the second data stream by comparing respective positions of the blink pattern in the first data stream and the second data stream.

Method and system for 360-degree video playback

The disclosure proposes a method and a system for 360-degree video playback. The method is applicable to a video playback system and includes at least the following steps. A current frame of a 360-degree video having a sequence of frames is received. Candidate objects in the current frame are detected, and a main object is selected from the candidate objects by using a selector recurrent neural network (RNN) model based on information of the candidate objects in the current frame. A viewing angle corresponding to the current frame is computed by using a regressor RNN model based on the main object in the current frame. The current frame is displayed on the screen according to the viewing angle.

Display control methods and apparatuses
10440345 · 2019-10-08 · ·

Embodiments of the present application disclose various display control methods and apparatuses. One of the display control methods comprises: determining a first display area of a first light field display device and play sequence alignment reference information, wherein the first display area is used to play a first video; and controlling, according to the play sequence alignment reference information, a second display device to display, within at least one first frame interval of the first video, at least one second frame of a second video in the first display area, wherein the first video and the second video are different parts obtained by performing time-domain downsampling of a same content source. This solution can improve a gain of a time resolution actually displayed in a light field information content source, and improve the flexibility of time-domain display control.

Digital signage system and data processing method in the same
10432909 · 2019-10-01 · ·

A digital signage system including a first display device; a second display device arranged a first spatial interval from the first display device and having a display screen that at least partially overlaps a display screen on the first display device; and a controller configured to control the first display device to display single image data at a first time, and control the second display device to display the single image data at a second time based on the first spatial interval between the first display device and the second display device. Further, at least one of the first display device and the second display device is a transparent display.

SYSTEMS AND METHODS FOR ENHANCING MACHINE VISION OBJECT RECOGNITION THROUGH ACCUMULATED CLASSIFICATIONS

The disclosed technology includes systems and methods for enhancing machine vision object recognition based on a plurality of captured images and an accumulation of corresponding classification analysis scores. A method is provided for capturing, with a camera of a mobile computing device, a plurality of images, each image of the plurality of images comprising a first object. The method includes processing, with a classification module comprising a trained neural network processing engine, at least a portion of the plurality of images. The method includes generating, with the classification module and based on the processing, one or more object classification scores associated with the first object. The method includes accumulating, with an accumulating module, the one or more object classification scores. And responsive to a timeout or an accumulated score exceeding a predetermined threshold, the method includes outputting classification information of the first object.