Systems and methods are disclosed for generating, a source image sequence using an image sensor of the computing device, the source image sequence comprising a plurality of source images depicting a head and face, identifying driving image sequence data to modify face image feature data in the source image sequence, generating, using an image transformation neural network, a modified source image sequence comprising a plurality of modified source images depicting modified versions of the head and face, and storing the modified source image sequence on the computing device.

Various implementations disclosed herein include devices, systems, and methods for controlling motion of CGR objects. In various implementations, a device includes a non-transitory memory and one or more processors coupled with the non-transitory memory. In some implementations, a method includes determining, by a first animation controller, values for a first set of animation parameters associated with a first animation for a computer-generated reality (CGR) object. In some implementations, the CGR object is associated with a plurality of joints. In some implementations, the method includes generating, by a motion controller, respective joint movements for the plurality of joints based on the values for the first set of animation parameters. In some implementations, the method includes manipulating the CGR object in accordance with the respective joint movements for the plurality of joints in order to provide an appearance that CGR object is moving within a degree of similarity to the first animation.

Various implementations disclosed herein include devices, systems, and methods for controlling motion of CGR objects. In various implementations, a device includes a non-transitory memory and one or more processors coupled with the non-transitory memory. In some implementations, a method includes determining, by a first animation controller, values for a first set of animation parameters associated with a first animation for a computer-generated reality (CGR) object. In some implementations, the CGR object is associated with a plurality of joints. In some implementations, the method includes generating, by a motion controller, respective joint movements for the plurality of joints based on the values for the first set of animation parameters. In some implementations, the method includes manipulating the CGR object in accordance with the respective joint movements for the plurality of joints in order to provide an appearance that CGR object is moving within a degree of similarity to the first animation.

A method for providing an augmented reality service using an AR sticker comprises: a step where a mobile terminal requests, from a server, an AR sticker template enabling a user to edit an AR sticker, and the server transmits the AR sticker template; a step where the mobile terminal directly edits the AR sticker image using the AR sticker template and creates AR content corresponding to the AR sticker image; a step where the server receives the AR sticker image and the AR content from the mobile terminal and stores same in an AR database, and creates an AR sticker including the AR sticker image and the AR content; a step where the mobile terminal receives the AR sticker, transmits the AR sticker to a printer, and requests printing of the AR sticker; and a step where the printer prints the AR sticker and conveys the printed AR sticker.

A method for providing an augmented reality service using an AR sticker comprises: a step where a mobile terminal requests, from a server, an AR sticker template enabling a user to edit an AR sticker, and the server transmits the AR sticker template; a step where the mobile terminal directly edits the AR sticker image using the AR sticker template and creates AR content corresponding to the AR sticker image; a step where the server receives the AR sticker image and the AR content from the mobile terminal and stores same in an AR database, and creates an AR sticker including the AR sticker image and the AR content; a step where the mobile terminal receives the AR sticker, transmits the AR sticker to a printer, and requests printing of the AR sticker; and a step where the printer prints the AR sticker and conveys the printed AR sticker.

An image processing method and apparatus, and a device and a medium are provided. The image processing method comprises: determining a motion state of a first recognition object in an initial video image; determining a motion state of a material object according to the motion state of the first recognition object; if the motion state of the material object is a first state, synthesizing the material object and a first-style video image according to the motion state of the material object, to obtain a first target video image; and if the motion state of the material object is a second state, synthesizing the material object and a second-style video image according to the motion state of the material object, to obtain a second target video image. The first-style video image and the second-style video image are images of different styles obtained from the initial video image.

Aspects of this disclosure provide techniques for generating a viseme and corresponding intensity pair. In some embodiments, the method includes generating, by a server, a viseme and corresponding intensity pair based at least on one of a clean vocal track or corresponding transcription. The method may include generating, by the server, a compressed audio file based at least on one of the viseme, the corresponding intensity, music, or visual offset. The method may further include generating, by the server or a client end application, a buffer of raw pulse-code modulated (PCM) data based on decoding at least a part of the compressed audio file, where the viseme is scheduled to align with a corresponding phoneme.

Aspects of this disclosure provide techniques for generating a viseme and corresponding intensity pair. In some embodiments, the method includes generating, by a server, a viseme and corresponding intensity pair based at least on one of a clean vocal track or corresponding transcription. The method may include generating, by the server, a compressed audio file based at least on one of the viseme, the corresponding intensity, music, or visual offset. The method may further include generating, by the server or a client end application, a buffer of raw pulse-code modulated (PCM) data based on decoding at least a part of the compressed audio file, where the viseme is scheduled to align with a corresponding phoneme.

An augmented reality (AR) display device can display a virtual assistant character that interacts with the user of the AR device. The virtual assistant may be represented by a robot (or other) avatar that assists the user with contextual objects and suggestions depending on what virtual content the user is interacting with. Animated images may be displayed above the robot's head to display its intents to the user. For example, the robot can run up to a menu and suggest an action and show the animated images. The robot can materialize virtual objects that appear on its hands. The user can remove such an object from the robot's hands and place it in the environment. If the user does not interact with the object, the robot can dematerialize it. The robot can rotate its head to keep looking at the user and/or an object that the user has picked up.

The present disclosure provide a special-effect editing method and apparatus, the method including: by an editor, receiving a first editing operation, generating a corresponding first editing instruction, and writing the first editing instruction into an instruction cache queue; by a resource manager, executing editing instructions in the instruction cache queue in sequence, and when executing the first editing instruction, editing a first object corresponding to the first editing instruction; by a graphic engine, loading objects corresponding to the editing instructions in the instruction cache queue in sequence, and when loading an object corresponding to the first editing instruction, sending request information for requesting loading a second object to the resource manager, the second object being an object obtained by editing the first object; sending the second object to the graphic engine in response to the request information by the resource manager; and rendering the second object by the graphic engine.