H04N2005/2726

Skeleton-based effects and background replacement

Various embodiments of the present invention relate generally to systems and methods for analyzing and manipulating images and video. In particular, a multi-view interactive digital media representation (MVIDMR) of a person can be generated from live images of a person captured from a hand-held camera. Using the image data from the live images, a skeleton of the person and a boundary between the person and a background can be determined from different viewing angles and across multiple images. Using the skeleton and the boundary data, effects can be added to the person, such as wings. The effects can change from image to image to account for the different viewing angles of the person captured in each image.

RECORDING MEDIUM, INFORMATION PROCESSING SYSTEM, AND DISPLAY METHOD

A program is executed by a processor causes the processor to identify at least one of a position and a posture of a first camera in a real space in which an object is arranged. The first camera is configured to capture an image of the real space. The program causes the processor to display, on a display, a first image generated based on a result of the image captured by the first camera; and display, at a position that is based on an identification result obtained by identifying the at least one of the position and the posture of the first camera within the display, a second image that corresponds to the object.

Systems and methods for implementing personal camera that adapts to its surroundings, both co-located and remote

A computerized system comprising a processing unit and a memory, the system operating in connection with a real-time video conference stream containing a video of a user, wherein the memory embodies a set of computer-executable instructions, which cause the computerized system to perform a method involving: receiving the real time video conference stream containing the video of the user; detecting and separating the background in the received real time video conference stream from the user; and replacing the separated background with a background received from a system of a second user or with a pre-recorded background.

Systems and methods for performing virtual application of makeup effects based on a source image
10762665 · 2020-09-01 · ·

A computing device obtains a source image depicting a facial region having one or more makeup effects. The computing device performs facial alignment and defines a plurality of source regions having the one or more makeup effects, the source regions corresponding to facial features in the source image. The computing device extracts attributes of the one or more makeup effects for each source region and identifies a closest matching feature template for each source region based on the attributes. The computing device obtains a digital image of a facial region of a user. The computing device performs facial alignment and identifies a plurality of target regions corresponding to the plurality of source regions. The computing device applies a matching feature template of a corresponding source region to each of the target regions.

ELECTRONIC DEVICE FOR PROVIDING SHOOTING MODE BASED ON VIRTUAL CHARACTER AND OPERATION METHOD THEREOF

An electronic device according to an embodiment may include: a camera module; a display; and a processor, wherein the processor may be configured to: obtain a preview image corresponding to an external object using the camera module; determine attributes of the external object, based on the obtained preview image; synthesize the preview image with a virtual character image, based on the attributes of the external object; and output the synthesized preview image through the display. Other embodiments may be provided.

Method and system for providing camera effect

Disclosed is a method and system for providing a camera effect. An effect providing method of an electronic device configured as a computer includes determining an emotion for a camera image of the electronic device as a criterion for selecting an effect to be applied to the camera image of the electronic device; and immediately applying, to the camera image, an effect that is randomly selected from among effects representing the determined emotion.

SYSTEMS AND METHODS FOR PROVIDING PERSONALIZED VIDEOS FEATURING MULTIPLE PERSONS

Disclosed are systems and methods for providing personalized videos featuring multiple persons. An example method includes receiving a user selection of a video having at least one frame with at least a target face and at least one further target face and receiving an image of a source face and a further image of a further source face. The method further includes modifying the image of the source face to generate an image of a modified source face and modifying the further image of the further source face to generate an image of a modified further source face. In the at least one frame of the video, the target face is replaced with the image of modified source face and the at least one further face is replaced with the modified further source face to generate a personalized video. The personalized video is sent to at least one further user.

Computer-implemented methods and computer systems configured for generating photorealistic-imitating synthetic representations of subjects

In some embodiments, an exemplary inventive computer-implemented method may include steps, performed by a processor, of: obtaining training real representations of a real subject; obtaining a training synthetic representation having a visual effect applied to a synthetic subject; training a first neural network and a second neural network by: presenting the first neural network with training real representation and candidate meta-parameters of latent variables for the visual effect to generate a training photorealistic-imitating synthetic representation of the real subject with the visual effect; presenting the second neural network with the training photorealistic-imitating synthetic representation and the training synthetic representation to determine actual meta-parameters of the latent variables of the visual effect, where the actual meta-parameters are meta-parameters at which the second neural network has identified that the training photorealistic-imitating synthetic representation is realistic, and presenting to the first neural network another real representation and the actual meta-parameters of the latent variables of the visual effect to incorporate the visual effect into another real subject.

INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING METHOD, AND COMPUTER PROGRAM PRODUCT
20200228729 · 2020-07-16 ·

An information processing apparatus includes a detector, a generator, and a compositor. The detector detects a first image region including a specific part of a subject from a first image obtained by photographing the subject. A generator generates a plurality of mask images for specifying a region to be composited with a second image including the first image region. The compositor composites the first image with the second image using the mask images. The mask images each include a region having higher luminance than luminance of the other regions out of regions of the first image, in a region in contact with another mask image or a region overlapping another mask image.

Ring size measurement system and method for digitally measuring ring size
10692237 · 2020-06-23 ·

A ring size measuring system to digitally measure a ring size of a user's finger including an image capturing device configured to capture a digital image of the user's finger, one or more processors, memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for: receiving a digital image of a user's hand using the image capturing device, determining a distance between the image capturing device and the user's hand, and defining at least one-dimension point pair of a selected finger from the received digital image, wherein the one or more processors calculate a distance between the dimension point pair to calculate a diameter of the selected finger.