Embodiments of the present disclosure provide an expression recognition method, apparatus, electronic device and storage medium. An expression recognition model includes a convolutional neural network model, a fully connected network model and a bilinear network model. During an expression recognition process, after an image to be recognized is pre-processed to obtain a facial image and a key point coordinate vector, the facial image is computed by the convolutional neural network model to output a first feature vector, the key point coordinate vector is computed by the fully connected network model to output a second feature vector, the first feature vector and the second feature vector are computed by the bilinear network model to obtain second-order information, and an expression recognition result in turn is obtained according to the second-order information. During this process, robustness of gestures and illuminations is better, and accuracy of expression recognition is improved.

A system receives an input comprising an image of a face of a person and determines landmarks on the face, indicating properties of predetermined anatomical portions of the face, by analyzing the image using a set of image processing and deep learning algorithms. The system compares the landmarks to a model generated based on faces scored for a plurality of perceptive traits through scientifically validated surveys by people. The system determines, using the model, a score for each of the plurality of perceptive traits for the face based on the comparison. The system determines, using the model, a first impression for the face collectively based on the scores for all of the perceptive traits determined by the model for the face. The system provides an output comprising the first impression and the scores for the perceptive traits determined by the model for the face.

A wearable apparatus is provided for capturing and processing images from an environment of a user. In one implementation, a wearable apparatus for monitoring activities includes a wearable image sensor configured to capture a plurality of images from an environment of a user of the wearable apparatus. The wearable apparatus also includes at least one processing device programmed to analyze the plurality of images to identify in one or more of the plurality of images at least one indicator of an activity, and to transmit, to an external device, the at least one indicator of the activity.

The present disclosure generally relates to generating and modifying virtual avatars. An electronic device having a camera and a display apparatus displays a virtual avatar that changes appearance in response to changes in a face in a field of view of the camera. In response to detecting changes in one or more physical features of the face in the field of view of the camera, the electronic device modifies one or more features of the virtual avatar.

The present disclosure relates to creating videos. A mobile device creates a graphic user interface to capture by the camera of the device multiple photographic facial images of a user for respective multiple facial expressions of a character in the video. Using the multiple photographic facial images, the device modifies stored character images by matching facial features of the character to facial features of the user for the multiple facial expressions of the character in the video and creates the video based on the modified character images. The facial expression of the user is used to influence the facial expression of the character. This method enables replacement of certain visual style elements with a given user's own style elements.

Techniques for reconstructing three-dimensional face images are described herein. The disclosed techniques include acquiring a real two-dimensional face key point and a predicted two-dimensional face key point; solving a first loss function consisting of the real two-dimensional face key point, the predicted two-dimensional face key point and a preset additional regular constraint term to iteratively optimize an expression coefficient, where the additional regular constraint term is used for constraining the expression coefficient such that the expression coefficient represents a real state of a face; and reconstructing a three-dimensional face image based on the expression coefficient.

This application provides a facial animation implementation method performed at a computing device. The method includes: capturing a facial image; extracting facial feature points in the facial image; comparing the facial feature points with standard feature points, to obtain a first deformation coefficient corresponding to a geometrical feature; extracting a local region according to the facial feature points for processing, to obtain a second deformation coefficient corresponding to an appearance feature; and driving a three-dimensional virtual object according to the first deformation coefficient and the second deformation coefficient to perform a corresponding expression.

A method, an electronic device and a storage medium for expression driving are disclosed. The method may include: performing facial key point detection on a driven character in a first image to obtain a first facial key point sequence; performing the following processing for each second image of a plurality of second images obtained successively: performing facial key point detection on a driving character in the second image to obtain a second facial key point sequence; obtaining a difference between the second facial key point sequence and an expressionless key point sequence which has been determined previously according to an analysis on the second facial key point sequence for a previous second image, and performing expression drive rendering on the driven character based on the difference and the first facial key point sequence. The technical solution may enhance flexibility, interactivity, accuracy etc.

An information processing system comprises an image capturing apparatus and an information processing apparatus, the image capturing apparatus includes an image capturing device; a first evaluation unit configured to perform first evaluation on a captured image; and a first transmission unit configured to transmit the captured image to the information processing apparatus, and the information processing apparatus includes a reception unit configured to receive the captured image; a second evaluation unit configured to perform second evaluation on the captured image; and a second transmission unit configured to transmit an evaluation result to the image capturing apparatus, the image capturing apparatus further including a sorting unit configured to receive the evaluation result of the second evaluation, and sort the captured image using an evaluation results of the first evaluation and the second evaluation.

Devices and methods for conducting a remote photography session are described. In some instances, a computing device at a photography station receives messages from a photography station controller which is remote from the photography station. In some examples, the computing device receives one or more messages instructing the computing device to capture an image from an image capture device. The computing device can also receive one or more messages instructing the computing device to adjust the image capture device. Additionally, the messages may instruct the computing device to present instructions to a subject of the photography session. These instructions can prompt the subject to make adjustments to meet a criteria for a photograph in the photography session.