A device for decoding encoded point cloud data can be configured to, for a point of a point cloud, determine a first color value for a first color component based on a first predicted value and a first residual value; apply a scaling factor to the first residual value to determine a predicted second residual value, wherein the scaling factor has one or both of a non-integer value or an absolute value greater than one; for the point of the point cloud, receive a second residual value in the encoded point cloud data; determine a final second residual value based on the predicted second residual value and the received second residual value; and for the point of the point cloud, determine a second color value for a second color component based on a second predicted value and the final second residual value.

Mechanisms for generating compressed images are provided. More particularly, methods, systems, and media for capturing, reconstructing, compressing, and rendering view-dependent immersive light field video with a layered mesh representation are provided.

A 3D-HEVC inter-frame information hiding method based on visual perception includes steps of information embedding and information extraction. In the step of information embedding, the human visual perception characteristic is considered, stereo salient images are obtained by a stereo image salient model, and the stereo salient images are divided into salient blocks and non-salient blocks with an otsu threshold. The coding quantization parameters are modified according to different modulation rules for different regions. Then, based on the modified quantization parameters, the coding-tree-units are coded to complete the information embedding. In the step of information extraction, no original video is needed, no any side information needs to be transmitted, and the secret information can be blindly extracted. The present invention combines with the human visual perception characteristic, and selects P frames and B frames as embedded frames for effectively reducing the decrease of the stereo video subjective quality.

In various embodiments, methods and systems reprojecting three-dimensional (3D) virtual scenes using discontinuity depth late stage reprojection are provided. A reconstruction point, that indicates camera pose information, is accessed. The reconstruction point is associated with a plurality of sample points of a three-dimensional (3D) virtual scene. One or more closest sample points, relative to the reconstruction point, are identified, from the plurality of sample points. Each of the one or more closest sample points is associated with a cube map of color data and depth data. A relative convergence score is determined for each of the one or more closest sample points based on performing a depth-aware cube map late stage reprojection operation in relation to the reconstruction point. A subset of the one or more closest sample points is identified based on the relative convergence score. A reconstructed 3D virtual image is generated using the subset.

A vehicular vision system includes a plurality of cameras and a processor operable to process image data captured by the cameras. The plurality of cameras includes a front camera, a rear camera, a driver-side camera and a passenger-side camera. Images derived from image data captured by at least some of the cameras are displayed on a display screen of the vehicle for viewing by a driver of the vehicle during a driving maneuver of the vehicle. During the driving maneuver of the vehicle, the display screen displays a three dimensional vehicle representation as would be viewed from a viewpoint exterior to the vehicle. A portion of the displayed three dimensional vehicle representation is at least partially transparent. A degree of transparency of the portion of the displayed three dimensional vehicle representation is adjustable.

A vehicular vision system includes a plurality of cameras and a processor operable to process image data captured by the cameras. The plurality of cameras includes a front camera, a rear camera, a driver-side camera and a passenger-side camera. Images derived from image data captured by at least some of the cameras are displayed on a display screen of the vehicle for viewing by a driver of the vehicle during a driving maneuver of the vehicle. During the driving maneuver of the vehicle, the display screen displays a three dimensional vehicle representation as would be viewed from a viewpoint exterior to the vehicle. A portion of the displayed three dimensional vehicle representation is at least partially transparent. A degree of transparency of the portion of the displayed three dimensional vehicle representation is adjustable.

A system for displaying three-dimensional objects using two-dimensional visualization means simultaneously providing at least effects of binocular parallax and motion parallax, the system comprising: a display configured to display a sequence of images; a pair of glasses configured to provide stereoscopic separation of images, the glasses comprising at least two optical shutters and at least two markers; two optical sensor arrays; two reading and processing devices configured to read data from an area of the optical sensor array and to determine 2D coordinates of the markers; a marker coordinates prediction device configured to extrapolate coordinates of the markers so as effective overall delay does not exceed 5 ms; a marker 3D coordinates calculation device; a 3D scene formation device; and at least one image output device. The invention also includes a corresponding method of displaying three-dimensional objects and provides realistic representation of three-dimensional objects for one or more viewers.

Hyperspectral, fluorescence, and laser mapping imaging with a minimal area image sensor are disclosed. A system includes an emitter for emitting pulses of electromagnetic radiation and an image sensor comprising a pixel array for sensing reflected electromagnetic radiation, wherein the pixel array comprises active pixels and optical black pixels. The system includes a black clamp circuit providing offset control for data generated by the pixel array. The system is such that at least a portion of the pulses of electromagnetic radiation emitted by the emitter comprises one or more of: electromagnetic radiation having a wavelength from about 513 nm to about 545 nm; electromagnetic radiation having a wavelength from about 565 nm to about 585 nm; electromagnetic radiation having a wavelength from about 900 nm to about 1000 nm; an excitation wavelength of electromagnetic radiation that causes a reagent to fluoresce; or a laser mapping pattern.

Hyperspectral, fluorescence, and laser mapping imaging with a minimal area image sensor are disclosed. A system includes an emitter for emitting pulses of electromagnetic radiation and an image sensor comprising a pixel array for sensing reflected electromagnetic radiation, wherein the pixel array comprises active pixels and optical black pixels. The system includes a black clamp circuit providing offset control for data generated by the pixel array. The system is such that at least a portion of the pulses of electromagnetic radiation emitted by the emitter comprises one or more of: electromagnetic radiation having a wavelength from about 513 nm to about 545 nm; electromagnetic radiation having a wavelength from about 565 nm to about 585 nm; electromagnetic radiation having a wavelength from about 900 nm to about 1000 nm; an excitation wavelength of electromagnetic radiation that causes a reagent to fluoresce; or a laser mapping pattern.

A disparity determination method and apparatus are provided. The disparity determination method includes receiving first signals of an event from a first sensor disposed at a first location and second signals of the event from a second sensor disposed at a second location that is different than the first location, and extracting a movement direction of the event, based on at least one among the first signals and the second signals. The disparity determination method further includes determining a disparity between the first sensor and the second sensor, based on the movement direction, a difference between times at which the event is sensed by corresponding pixels in the first sensor, and a difference between times at which the event is sensed by corresponding pixels in the first sensor and the second sensor.