Patent classifications
G06T13/20
Systems and methods to generate and utilize content styles for animation
Systems and methods to generate content styles for animation, and to adjust content styles by adjusting virtual style sliders for the content styles are disclosed. Exemplary implementations may: receive, from client computing platforms associated with users, style assignments for final compiled animation scenes; provide a style dial model with the style assignments and the corresponding final compiled animation scenes; train, from i) the style assignments, ii) the corresponding final compiled animation scenes, and iii) animation scene information that defines the final compiled animation scenes, the style dial model to determine individual style correlation values; receive user entry of levels of correlation to individual ones of multiple different content styles; input the animation scene and the levels of correlation to a model that outputs adjusted animation scene information that defines a styled compiled animation scene that has the selected levels of correlation to the individual content styles.
Animation effect attachment based on audio characteristics
Systems and methods for rendering a video effect to a display are described. More specifically, video data and audio data are obtained. The video data is analyzed to determine one or more attachment points of a target object that appears in the video data. The audio data is analyzed to determine audio characteristics. A video effect associated with an animation to be added to the one or more attachment points is determined based on the audio characteristics. A rendered video is generated by applying the video effect to the video data.
METHOD AND APPARATUS FOR GENERATING SPECIAL EFFECT IN VIRTUAL ENVIRONMENT, DEVICE, AND STORAGE MEDIUM
A method for generating a special effect for social networking interaction in a virtual environment of a game is performed by an electronic device. The method includes: displaying an object presentation interface of a target battle of the game when loading a virtual scene corresponding to the target battle, the object presentation interface being used for displaying a plurality of virtual objects participating in the target battle; receiving a special effect generating instruction for a first virtual object of the plurality of virtual objects, the special effect generating instruction being used for instructing to generate a special effect based on the first virtual object, and the first virtual object corresponding to a user of the electronic device triggering the special effect; and generating the special effect identifying the first virtual object in the object presentation interface.
METHOD AND APPARATUS FOR GENERATING SPECIAL EFFECT IN VIRTUAL ENVIRONMENT, DEVICE, AND STORAGE MEDIUM
A method for generating a special effect for social networking interaction in a virtual environment of a game is performed by an electronic device. The method includes: displaying an object presentation interface of a target battle of the game when loading a virtual scene corresponding to the target battle, the object presentation interface being used for displaying a plurality of virtual objects participating in the target battle; receiving a special effect generating instruction for a first virtual object of the plurality of virtual objects, the special effect generating instruction being used for instructing to generate a special effect based on the first virtual object, and the first virtual object corresponding to a user of the electronic device triggering the special effect; and generating the special effect identifying the first virtual object in the object presentation interface.
DIFFERENTIABLE SIMULATOR FOR ROBOTIC CUTTING
A differentiable simulator for simulating the cutting of soft materials by a cutting instrument is provided. In accordance with one aspect of the disclosure, a method for simulating a cutting operation includes: receiving a mesh for an object, modifying the mesh to add virtual nodes associated with a predefined cutting plane, optimizing a set of parameters associated with a simulator based on ground-truth data, and running a simulation via the simulator to generate outputs that include trajectories associated with a cutting instrument. Optimizing the set of parameters can include performing inference based on a set of ground-truth trajectories captured using sensors to measure real-world cutting operations. The inference techniques can employ stochastic gradient descent, stochastic gradient Langevin dynamics, or a Bayesian approach. In an embodiment, the simulator can be utilized to generate control signals for a robot based on the simulated trajectories.
DEVICE AND METHOD FOR GENERATING SPEECH VIDEO
A speech video generation device according to an embodiment includes a first encoder that receives an input of a first person background image of a predetermined person partially hidden by a first mask, and extracts a first image feature vector from the first person background image, a second encoder, which receives an input of a second person background image of the person partially hidden by a second mask, and extracts a second image feature vector from the second person background image, a third encoder, which receives an input of a speech audio signal of the person, and extracts a voice feature vector from the speech audio signal, a combining unit, which generates a combined vector of the first image feature vector, the second image feature vector, and the voice feature vector, and a decoder, which reconstructs a speech video of the person using the combined vector as an input.
Computationally-Efficient Generation of Simulations of Cloth-Like Materials Using Bilinear Element Models
A computer implemented method simulates a flexible material. The method includes representing the flexible material with a mesh that includes bilinear quadrilateral mesh elements with a specified number of degrees of freedom per vertex. The method also includes computing a per-element deformation strain value for the mesh elements, wherein deformation strain values depend on a second order function with respect to the degrees of freedom of the vertices of the mesh elements. The method also includes simulating motion of the flexible material using the deformation strains of each mesh element to simulate motion of the vertices along the specified number degrees of freedom.
Computationally-Efficient Generation of Simulations of Cloth-Like Materials Using Bilinear Element Models
A computer implemented method simulates a flexible material. The method includes representing the flexible material with a mesh that includes bilinear quadrilateral mesh elements with a specified number of degrees of freedom per vertex. The method also includes computing a per-element deformation strain value for the mesh elements, wherein deformation strain values depend on a second order function with respect to the degrees of freedom of the vertices of the mesh elements. The method also includes simulating motion of the flexible material using the deformation strains of each mesh element to simulate motion of the vertices along the specified number degrees of freedom.
Method for predicting collision and avoiding conflict between multiple moving bodies
Disclosed is a method for predicting collisions and conflicts between multiple moving bodies. A method for predicting and avoiding collisions and conflicts between multiple moving bodies comprises the steps of: creating objects by modeling the shape of each of multiple moving bodies; creating two-dimensional circles by modeling the objects by using size information of the objects; modeling the two-dimensional circles into moving disks by using at least one of the moving speeds of the moving bodies, the monitoring time window for the moving bodies, and the size information of the two-dimensional circles; computing a Voronoi diagram between the moving disks and calculating edges of the Voronoi diagram; and during the monitoring time window for the moving bodies, calculating a flipping event in which at least one of the edges of the Voronoi diagram is converted into a vertex and then converted into another edge, and a collision event by which a collision between a pair of moving disks defining an edge of the Voronoi diagram is predicted, and calculating whether actual collisions occur between moving disks triggering the flipping event and between moving disks triggering the collision event, in chronological order of the occurrence of the flipping event and the collision event.
Display control device, communication device, display control method, and recording medium
An disclosure includes: moving image acquisition unit configured to acquire moving image data obtained through moving image capturing of at least a mouth part of an utterer; a lip detection unit configured to detect a lip part from the moving image data and detect motion of the lip part; a moving image processing unit configured to generate a moving image enhanced to increase the motion of the lip part detected by the lip detection unit; and a display control unit configured to control a display panel to display the moving image generated by the moving image processing unit.