In one aspect, a computerized method for rendering a three-dimensional (3D) digital image for automated facial morphing includes the step scanning of the user's face with a digital camera to obtain a set of digital images of the user's face. The method includes the step of determining that a user's face is in a compliant state. The method includes the step of implementing an analysis of the set of digital images and implementing a set of pre-rendering steps. Each digital image comprises a depth data, a red/green/blue (RGB) data, and a facemask data. The method then implements an iterative closest path (ICP) algorithm that correlates the set of digital images together by stitching together the cloud of points of the facemask data of each digital image and outputs a set of transformation matrices. The method includes the step of implementing a truncated signed distance function (TSDF) algorithm on the set of transformation matrices. The TSDF algorithm represents each point of the transformation matrices in a regularized voxel grid and outputs a set of voxel representations as a one-dimension (1-D) array of voxels. The method includes the step of implementing a marching cubes algorithm that obtains each voxel representation of the 1-D array of voxels and creates a three-dimensional (3D) mesh out of the per-voxel values provided by the TSDF and outputs a mesh representation. The mesh representation comprises a set of triangles and vertices. The method comprises the step of implementing a cleaning algorithm that obtains the mesh representation and cleans the floating vertices and triangles and outputs a mesh. The mesh comprises a set of scattered points with a normal per point. The method includes the step of implementing a Poisson algorithm on the mesh output and fills in any holes of the mesh. The Poisson algorithm outputs a reconstructed mesh. The method fits the reconstructed mesh on a trained three-dimensional (3D) face model and a specified machine learning algorithm is used to fit the trained 3D face model to the 3D landmarks in the reconstructed mesh.

In one aspect, a computerized method for rendering a three-dimensional (3D) digital image for automated facial morphing includes the step scanning of the user's face with a digital camera to obtain a set of digital images of the user's face. The method includes the step of determining that a user's face is in a compliant state. The method includes the step of implementing an analysis of the set of digital images and implementing a set of pre-rendering steps. Each digital image comprises a depth data, a red/green/blue (RGB) data, and a facemask data. The method then implements an iterative closest path (ICP) algorithm that correlates the set of digital images together by stitching together the cloud of points of the facemask data of each digital image and outputs a set of transformation matrices. The method includes the step of implementing a truncated signed distance function (TSDF) algorithm on the set of transformation matrices. The TSDF algorithm represents each point of the transformation matrices in a regularized voxel grid and outputs a set of voxel representations as a one-dimension (1-D) array of voxels. The method includes the step of implementing a marching cubes algorithm that obtains each voxel representation of the 1-D array of voxels and creates a three-dimensional (3D) mesh out of the per-voxel values provided by the TSDF and outputs a mesh representation. The mesh representation comprises a set of triangles and vertices. The method comprises the step of implementing a cleaning algorithm that obtains the mesh representation and cleans the floating vertices and triangles and outputs a mesh. The mesh comprises a set of scattered points with a normal per point. The method includes the step of implementing a Poisson algorithm on the mesh output and fills in any holes of the mesh. The Poisson algorithm outputs a reconstructed mesh. The method fits the reconstructed mesh on a trained three-dimensional (3D) face model and a specified machine learning algorithm is used to fit the trained 3D face model to the 3D landmarks in the reconstructed mesh.

A virtual, augmented, or mixed reality display system includes a display configured to display virtual, augmented, or mixed reality image data, the display including one or more optical components which introduce optical distortions or aberrations to the image data. The system also includes a display controller configured to provide the image data to the display. The display controller includes memory for storing optical distortion correction information, and one or more processing elements to at least partially correct the image data for the optical distortions or aberrations using the optical distortion correction information.

A method and an apparatus for generating a 3D face comprising at least one deformed region are disclosed. A curvature exaggeration face is obtained from at least one region of a first 3D face, and a proportion exaggeration deformation is obtained for said least one region of said first 3D face. The curvature exaggeration face and the proportion exaggeration deformation for obtaining said at least one deformed region of said 3D face are combined.

Provided is an image editing method including: displaying a setting image including a first image and a second image; receiving a first operation of designating a first point on the first image from a user; receiving a second operation of designating a second point on the second image from the user; receiving a third operation of designating a third point on the first image from the user; receiving a fourth operation of designating a fourth point on the second image from the user; and deforming the first image into a third image by making the first point correspond to the second point and making the third point correspond to the fourth point.

An encryption and decryption system is provided, which includes a transmitting device and a receiving device. The transmitting device is configured to store original images and a correspondence table. The receiving device is connected to the transmitting device for storing the correspondence table, wherein the transmitting device generates an encrypted string. The transmitting device selects a representative morphed image from multiple morphed images according to the encrypted string. The transmitting device transmits the representative morphed image to the receiving device and does not transmit the encrypted string to the receiving device. The receiving device recognizes the first original image serial number and the second original image serial number from the representative morphed image. The receiving device looks up the correspondence table according to the first original image serial number and the second original image serial number to generate the encrypted string.

In a computer-implemented method of augmenting a dataset used in facial expression analysis, a first facial image and a second facial image are added to a training/testing dataset and mapped to two respective points in a continuous dimensional emotion space. The position of a third point in the continuous dimensional emotion space between the first two points is determined. Augmentation is achieved when a labelled facial image is derived from the third point based on its position relative to the first and second facial expression.

Disclosed are systems and methods for portrait animation. An example method includes receiving, by a computing device, a scenario video, where the scenario video includes at least one input frame and the at least one input frame includes a first face, receiving, by the computing device, a target image, where the target image includes a second face, determining, by the computing device and based on the at least one input frame and the target image, two-dimensional (2D) deformations of the second face in the target image, where the 2D deformations, when applied to the second face, modify the second face to imitate at least a facial expression of the first face, and applying, by the computing device, the 2D deformations to the target image to obtain at least one output frame of an output video.

A virtual, augmented, or mixed reality display system includes a display configured to display virtual, augmented, or mixed reality image data, the display including one or more optical components which introduce optical distortions or aberrations to the image data. The system also includes a display controller configured to provide the image data to the display. The display controller includes memory for storing optical distortion correction information, and one or more processing elements to at least partially correct the image data for the optical distortions or aberrations using the optical distortion correction information.

Methods and systems for constructing a three-dimensional (3D) model of a user in a virtual environment for full body virtual reality (VR) applications are described. The method includes receiving an image of the user captured using an RGB camera; detecting a body bounding box associated with the user using a first trained neural network; determining a segmentation map of the user, based on the body bounding box; determining a two-dimensional (2D) contour of the user from the segmentation map; forming a 3D extrusion model by extruding the 2D contour; and constructing the 3D model of the user in the virtual environment by applying a geometric transformation to the 3D extrusion model. Applications of full body VR include physical training and fitness sessions, games, control of computing devices, manipulation and display of data, interactive social media with VR, and the like.