According to a general aspect, a method can include receiving a photo of a virtual conference participant, and a depth map based on the photo, and generating a plurality of synthesized images based on the photo. The plurality of synthesized images can have respective simulated gaze directions of the virtual conference participant. The method can also include receiving, during a virtual conference, an indication of a current gaze direction of the virtual conference participant. The method can further include animating, in a display of the virtual conference, an avatar corresponding with the virtual conference participant. The avatar can be based on the photo. Animating the avatar can be based on the photo, the depth map and at least one synthesized image of the plurality of synthesized images, the at least one synthesized image corresponding with the current gaze direction.

An exercise method and an exercise equipment are provided. The exercise method includes: determining an exercise guiding video according to a selected music input/audio signal, wherein the exercise guiding video includes a first exercise guiding video and/or a second exercise guiding video, the first exercise guiding video is a live video automatically generated according to the selected music input/audio signal, the second exercise guiding video is a video previously recorded according to the selected music input/audio signal; generating CGA and special-effect/animated feedbacks corresponding to the music information/audio signal and instruction/cuing in the exercise guiding video; playing the exercise guiding video, the CGA, the special-effect/animated feedbacks and the selected music input/audio signal on a display and computing device; receiving user performance data; displaying interactive feedback data on the display and computing device, according to a result obtained by matching the user performance data with music information/audio signal analyzed from selected music input/audio signal.

Systems and methods are provided for performing operations including: receiving, by a messaging application, input that selects an option to generate a message using an avatar with a caption; presenting, by the messaging application, the avatar and a caption entry region proximate to the avatar; populating, by the messaging application, the caption entry region with a text string comprising one or more words; determining, by the messaging application, context based on the one or more words in the text string; and modifying, by the messaging application, an expression of the avatar based on the determined context.

Systems and methods are provided for performing operations including: receiving, by a messaging application, input that selects an option to generate a message using an avatar with a caption; presenting, by the messaging application, the avatar and a caption entry region proximate to the avatar; populating, by the messaging application, the caption entry region with a text string comprising one or more words; determining, by the messaging application, context based on the one or more words in the text string; and modifying, by the messaging application, an expression of the avatar based on the determined context.

An information processing device 11 including: a control data generation unit that inputs analysis data X that is to be processed, to a trained model that has learnt a relationship between analysis data X that represents a time series of musical notes, and control data Y for controlling movements of an object that represents a performer, thereby generating control data Y according to the analysis data X.

A method for providing an animated art experience to a user includes a user device receiving an image of an art piece selected by the user. The user device obtains information about the art piece. The user device presents a three-dimensional (3D) animated image that corresponds with the selected art image. Upon receiving an action by the user caused by a rotation or tilt of the user device, the user device provides a depth perspective view in correlation with the action and associated viewer angle of the art image such that further portions of the art image become visible. A background and a foreground of the image appear to move naturally as actions and associated viewer angles change.

An augmented reality (AR) application authoring system is disclosed. The AR application authoring system enables the real-time creation of freehand interactive AR applications with freehand inputs. The AR application authoring system enables intuitive authoring of customized freehand gesture inputs through embodied demonstration while using the surrounding environment as a contextual reference. A visual programming interface is provided with which users can define freehand interactions by matching the freehand gestures with reactions of virtual AR assets. Thus, users can create personalized freehand interactions through simple trigger-action programming logic. Further, with the support of a real-time hand gesture detection algorithm, users can seamlessly test and iterate on the authored AR experience.

An augmented reality (AR) application authoring system is disclosed. The AR application authoring system enables the real-time creation of freehand interactive AR applications with freehand inputs. The AR application authoring system enables intuitive authoring of customized freehand gesture inputs through embodied demonstration while using the surrounding environment as a contextual reference. A visual programming interface is provided with which users can define freehand interactions by matching the freehand gestures with reactions of virtual AR assets. Thus, users can create personalized freehand interactions through simple trigger-action programming logic. Further, with the support of a real-time hand gesture detection algorithm, users can seamlessly test and iterate on the authored AR experience.

In some embodiments, the present specification describes methods for displaying a three-dimensional image of an isolated threat object or region of interest with a single touch or click and providing spatial and contextual information relative to the object, while also executing a view dependent virtual cut-away or rendering occluding portions of the reconstructed image data as transparent. In some embodiments, the method includes allowing operators to associate audio comments with a scan image of an object. In some embodiments, the method also includes highlighting a plurality of voxels, which are indicative of at least one potential threat item, in a mask having a plurality of variable color intensities, where the intensities may be varied based on the potential threat items.

In some embodiments, the present specification describes methods for displaying a three-dimensional image of an isolated threat object or region of interest with a single touch or click and providing spatial and contextual information relative to the object, while also executing a view dependent virtual cut-away or rendering occluding portions of the reconstructed image data as transparent. In some embodiments, the method includes allowing operators to associate audio comments with a scan image of an object. In some embodiments, the method also includes highlighting a plurality of voxels, which are indicative of at least one potential threat item, in a mask having a plurality of variable color intensities, where the intensities may be varied based on the potential threat items.