Aspects of the disclosure provide a device for processing frames with aliasing artifacts. For example, the device can include a motion estimation circuit, a warping circuit coupled to the motion estimation circuit, and a temporal decision circuit coupled to the warping circuit. The motion estimation circuit can estimate a motion value between a current frame and a previous frame. The warping circuit can warp the previous frame based on the motion value such that the warped previous frame is aligned with the current frame and determine whether the current frame and the warped previous frame are consistent. The temporal decision circuit can generate an output frame, the output frame including either the current frame and the warped previous frame when the current frame and the warped previous frame are consistent, or the current frame when the current frame and the warped previous frame are not consistent.

An electronic device and method for 3D modeling based on 2D warping is disclosed. The electronic device acquires a color image of a face of a user, depth information corresponding to the color image, and a point cloud of the face. A 3D mean-shape model of a reference 3D face is acquired, and rigid aligned with the point cloud. A 2D projection of the aligned 3D mean-shape model is generated. The 2D projection includes a set of landmark points associated with the aligned 3D mean-shape model. The 2D projection is warped such that the set of landmark points in the 2D projection is aligned with a corresponding set of feature points in the color image. A 3D correspondence between the aligned 3D mean-shape model and the point cloud is determined for a non-rigid alignment of the aligned 3D mean-shape model, based on the warped 2D projection and the depth information.

In the case in which a loss of the viewpoint position of a driver occurs when a viewpoint position follow-up warping control is executed to update warping parameters according to the viewpoint position of the driver, and then the viewpoint position is re-detected, it is suppressed that the appearance of an image instantaneously changes in accordance with the update of the warping parameters and the driver is caused to feel uneasy. When the viewpoint loss in which at least one position of the right and left viewpoints becomes unclear is detected, a control unit, which executes the viewpoint position follow-up warping control, maintains, in a viewpoint loss period, the warping parameters set immediately before the viewpoint loss period, and, when the viewpoint position is re-detected after the viewpoint loss period, invalidates at least one warping process using the warping parameters corresponding to the re-detected viewpoint position.

An image processing system is disclosed, comprising: an M-lens camera, a compensation device and a correspondence generator. The M-lens camera generates M lens images. The compensation device generates a projection image according to a first vertex list and the M lens images. The correspondence generator is configured to conduct calibration for vertices to define vertex mappings, horizontally and vertically scan each lens image to determine texture coordinates of its image center, determine texture coordinates of control points according to the vertex mappings, and P1 control points in each overlap region in the projection image; and, determine two adjacent control points and a coefficient blending weight for each vertex in each lens image according to the texture coordinates of the control points and the image center in each lens image to generate the first vertex list, where M>=2.

An apparatus and method for optically remapping projected pixels to maximize the utilization and to optimize the distribution of remapped projection pixels to achieve optimal visual performance (generally uniform resolution and luminance). A device interposed between a projector and an imaging surface for optically remapping projected pixel locations with minimal aberration. When this device is interposed between a projector and an imaging surface, it changes the terminal location of each focused pixel such that it maximally coincides with the imaging surface, which is often a surface of complex curvature and very different from the native focal surface of the projector. One implementation of the technology includes a device that uses multiple optical surfaces.

Certain aspects of the technology disclosed herein involve combining images to generate a wide view image of a surrounding environment. Images can be recorded using an stand-alone imaging device having wide angle lenses and/or normal lenses. Images from the imaging device can be combined using methods described herein. In an embodiment, a pixel correspondence between a first image and a second image can be determined, based on a corresponding overlap area associated with the first image and the second image. Corresponding pixels in the corresponding overlap area associated with the first image and the second image can be merged based on a weight assigned to each of the corresponding pixels.

Embodiments shifts the color fields of a rendered image frame based on the eye tracking data (e.g. position of the user's pupils). An MR device obtains a first image frame having a set of color fields. The first image frame corresponds to a first position of the pupils of the viewer. The MR device then determines a second position of the pupils of the viewer based on, for example, data receive from an eye tracking device coupled to the MR device. The MR device generates, based on the first image frame, a second image frame corresponding to the second position of the pupils. The second image frame is generated by shifting color fields by a shift value based on the second position of the pupils of the viewer. The MR device transmits the second image frame to a display device of the MR device to be displayed thereon.

A method and apparatus for generating a face-harmonized image are disclosed. The method of generating a face-harmonized image includes receiving an input image, extracting facial landmarks from a target image and the input image, generating a face-removed image of the target image based on a facial mask region, extracting a user face image from the input image, transforming the user face image to correspond to the facial mask region, generating a face-blended image by blending the transformed user face image with the target image, extracting a feature map of the face-blended image, generating a combined feature map based on the feature map of the face-blended image and a feature map of the target image, generating a face harmonization result image based on the combined feature map, and providing the generated face harmonization result image.

A system for determining volume of a selectable region is configurable to (i) obtain user input directed to a 3D representation of a set of 2D images and (ii) based on the user input, selectively modify one or more mask pixels of one or more respective selection masks. Each 2D image of the set of 2D images is associated with a respective selection mask. The 3D representation represents pixels of the set of 2D images with corresponding voxels. The user input selects one or more voxels of the 3D representation. The one or more mask pixels is associated with one or more pixels of the set of 2D images that correspond to the one or more voxels of the 3D representation selected via the user input.

The present invention relates to an image warping system capable of quickly performing image warping with low costs by using a cache memory, and a method thereof. The image warping system is provided to generate a transformed image by warping an input image with the help of a cache based WARP engine. The WARP engine accesses the input image and loads a portion of the image to the cache memory for speeding up the engine process. The WARP engine performs interpolation on the input image to generate an output image which is devoid of distortions. The output image obtained is then stored in the DDR of an electronic device.