G06T2210/44

Virtual, augmented, and mixed reality systems and methods

A virtual, augmented, or mixed reality display system includes a display configured to display virtual, augmented, or mixed reality image data, the display including one or more optical components which introduce optical distortions or aberrations to the image data. The system also includes a display controller configured to provide the image data to the display. The display controller includes memory for storing optical distortion correction information, and one or more processing elements to at least partially correct the image data for the optical distortions or aberrations using the optical distortion correction information.

Additive manufacturing including compensation modeling methodology with shape transformation

An additive manufacturing (AM) system includes a process distortion compensation computing system and an AM peripheral device. The process distortion compensation computing system determines a digital nominal model that represents a physical target object excluding a distortion, and a digital distortion model that represents the physical target object including at least one distortion. The AM peripheral device forms a three-dimensional (3D) physical object based on a digital compensation model. The process distortion compensation computing system also determines a digital skeletal model indicating a predicted change in at least one of the shape and volume of the nominal model, and generates the digital compensation model based on the skeletal model that compensates for the at least one distortion.

CREATING VIDEOS WITH FACIAL EXPRESSIONS
20210264139 · 2021-08-26 ·

The present disclosure relates to creating videos. A mobile device creates a graphic user interface to capture by the camera of the device multiple photographic facial images of a user for respective multiple facial expressions of a character in the video. Using the multiple photographic facial images, the device modifies stored character images by matching facial features of the character to facial features of the user for the multiple facial expressions of the character in the video and creates the video based on the modified character images. The facial expression of the user is used to influence the facial expression of the character. This method enables replacement of certain visual style elements with a given user's own style elements.

GENERATING GAZE CORRECTED IMAGES USING BIDIRECTIONALLY TRAINED NETWORK
20210248714 · 2021-08-12 ·

An example apparatus for adjusting eye gaze in images one or more processors to execute instructions to bidirectionally train a neural network; access a target angle and an input image, the input image including an eye in a first position; generate a vector field with the neural network; and generate a gaze-adjusted image based on the vector field, the gaze-adjusted image including the eye in a second position.

Method, apparatus and device for processing deformation of virtual object, and storage medium

A method and apparatus for processing a virtual object, a device, and a storage medium are provided. The method for processing a virtual object includes: acquiring first bone parameters and first blend deformation data corresponding to a preset three-dimensional virtual object model comprising a plurality of bones, the first blend deformation data indicating a degree of deformation of the preset three-dimensional virtual object; acquiring second bone parameters corresponding to a target three-dimensional virtual object model, and determining a transformation relationship of the second bone parameters with the first bone parameters; and determining second blend deformation data corresponding to the target three-dimensional virtual object model, according to the transformation relationship of the second bone parameters with the first bone parameters, and the first blend deformation data.

Character morphing system
11080916 · 2021-08-03 · ·

A user selection of character settings for a character associated with a playing user of the online gaming system is received. Responsive to detecting an access to the online game by the character associated with the playing user, whether the morphing settings have been specified for the online game is determined. Whether the one or more components of the character that correspond to the first components identified by the morphing settings are permitted to be changed is determined. Responsive to determining the morphing settings have been specified for the online game and determining that the one or more components of the character that correspond to the first components identified by the morphing settings are permitted to be changed, generation of a first morphed character for presentation within the online game by changing the one or more components of the character in accordance with the morphing settings is caused.

EXERCISE PRESCRIPTION APPARATUS AND METHOD
20210304865 · 2021-09-30 ·

An exercise prescription apparatus includes a body shape measurement device that measures a body shape of a user changing with a progress of an exercise based on a previously prescribed exercise guide and a processor that predicts a future body shape of the user based on body shape history information obtained through the measured body shape of the user and to re-prescribe an exercise guide based on a body shape difference between the predicted future body shape and a target body shape.

METHOD FOR PREDICTING A DENTAL SITUATION

A method for predicting a future dental situation for a patient. Acquiring historical data including at least: previous time point and context parameter values. Acquiring at a time point all the data related to the current dental situation, including at least: the current time point, context parameter values at the current time point, statistical analysis of the historical data and the current data, so as to predict, at a future time point, at least one future dental situation for the current patient. Depending on the future dental situation, (re)evaluation of the benefit of an orthodontic treatment. Steps may include creating a three-dimensional digital reference model, acquiring at least one two-dimensional image, analysing each updated image and creation, searching, for each updated image, and collecting data relative to the updated reference model and relative to the orthodontic appliance.

Photorealistic real-time portrait animation

Provided are systems and methods for photorealistic real-time portrait animation. An example method includes receiving a scenario video with at least one input frame. The input frame includes a first face. The method further includes receiving a target image with a second face. The method further includes determining, based on the at least one input frame and the target image, two-dimensional (2D) deformations, wherein the 2D deformations, when applied to the second face, modify the second face to imitate at least a facial expression and a head orientation of the first face. The method further includes applying, by the computing device, the 2D deformations to the target image to obtain at least one output frame of an output video.

SEMANTIC DEEP FACE MODELS

Techniques are disclosed for training and applying nonlinear face models. In embodiments, a nonlinear face model includes an identity encoder, an expression encoder, and a decoder. The identity encoder takes as input a representation of a facial identity, such as a neutral face mesh minus a reference mesh, and outputs a code associated with the facial identity. The expression encoder takes as input a representation of a target expression, such as a set of blendweight values, and outputs a code associated with the target expression. The codes associated with the facial identity and the facial expression can be concatenated and input into the decoder, which outputs a representation of a face having the facial identity and expression. The representation of the face can include vertex displacements for deforming the reference mesh.