An electronic device includes a camera, a display, and a processor. The processor displays a user interface including menu items supporting entry into an edit mode for a body part of an emoji displayed on the display. The processor captures a user face image using the camera, upon a user requesting facial expression edit mode from the interface. The processor generates a facial expression motion file from the user face image. The processor captures a user body image using the camera upon the user requesting body motion edit mode. The processor generates a body motion file from the user body image. The processor adjusts sync for combining the generated facial expression motion file and body motion file. The processor generates a customized emoji sticker on which user facial expression and body movement are reflected by combining the sync-adjusted facial expression motion file and body motion file.

The system for in-vehicle video conferencing (200) includes:

an acquisition module (201) for acquiring data of facial characteristic points of a user (A) in the vehicle (100) during a video conference call in which said user (A) participates;
a video synthesizer (202A) for producing an artificial video of the face of the user in the vehicle (100) from the acquired data of facial characteristic points,
a communication device (203) for transmitting the artificial video of the face of the user through a communication network (300) in the video conference call.

Distance estimation is optimized in virtual or augmented reality. A distance map of a surgical instrument to a region of interest is determined, at least at the beginning and when a position of the surgical instrument has changed. A render-image is rendered based on a medical 3D image and the position of the surgical instrument, at least at the beginning and when the position of the surgical instrument has changed. At least the region of interest and those parts of the surgical instrument positioned in the volume of the render-image are shown in the render-image. Based on the distance map, at least for a predefined area of the region of interest, visible, acoustic, and/or haptic distance-information is added.

The consistent use of lighting in different instances of digital media may help ensure that objects are depicted in a similar manner in the digital media. However, in some cases, a three-dimensional (3D) model may depict an object under lighting conditions that differ from the lighting conditions depicted in other digital media. The present disclosure provides systems and methods for generating 3D models to include lighting that is consistent with the lighting used in other digital media. According to an embodiment, a lighting template is determined based on digital media depicting a first physical object. A modified 3D model of a second physical object is then generated based on the lighting template to light the second physical object according to the lighting template.

Augmenting real-time views of a patient with three-dimensional (3D) data. In one embodiment, a method may include identifying 3D data for a patient with the 3D data including an outer layer and multiple inner layers, determining virtual morphometric measurements of the outer layer from the 3D data, registering a real-time position of the outer layer of the patient in a 3D space, determining real-time morphometric measurements of the outer layer of the patient, automatically registering the position of the outer layer from the 3D data to align with the registered real-time position of the outer layer of the patient in the 3D space using the virtual morphometric measurements and using the real-time morphometric measurements, and displaying, in an augmented reality (AR) headset, one of the inner layers from the 3D data projected onto real-time views of the outer layer of the patient.

Systems and methods create and distribute addressable virtual content with interactivity. The virtual content may depict a live event and may be customized for each individual user based on dynamic characteristics (e.g., habits, preferences, etc.) of the user that are captured during user interaction with the virtual content. The virtual content is generated with low latency between the actual event and the live content that allows the user to interactively participate in actions related to the live event. The virtual content may represent a studio with multiple display screens that each show different live content (of the same or different live events), and may also include graphic displays that include related data such as statistics corresponding to the live event, athletes at the event, and so on. The content of the display screens and graphics may be automatically selected based on the dynamic characteristics of the user.

A messaging system performs neural network hair rendering for images provided by users of the messaging system. A method of neural network hair rendering includes processing a three-dimensional (3D) model of fake hair and a first real hair image depicting a first person to generate a fake hair structure, and encoding, using a fake hair encoder neural subnetwork, the fake hair structure to generate a coded fake hair structure. The method further includes processing, using a cross-domain structure embedding neural subnetwork, the coded fake hair structure to generate a fake and real hair structure, and encoding, using an appearance encoder neural subnetwork, a second real hair image depicting a second person having a second head to generate an appearance map. The method further includes processing, using a real appearance renderer neural subnetwork, the appearance map and the fake and real hair structure to generate a synthesized real image.

A user’s environment is scanned and an augmented reality game such as a treasure is set up based on the scan. The user needs to use a phone to uncover clues in a game environment that is customized to user’s own personal real-world environment, which is discovered using SLAM or GPS so that a map of furniture can be built. The game hides a virtual object behind a virtualized image of the real-world furniture. Machine learning may be used to train a model with common objects and where interesting hidden spaces could exist. Given the user’s inputted data, real world physical room data and objects are used to determine a likely location to hide a virtual object.

A method for measuring regions of a tooth in a mouth including: measuring at least one surface point on a surface of the tooth with respect to an element mechanically coupled to said surface point; determining a location of at least one visible reference mechanically coupled to said surface point with respect to said element; estimating a location of said surface point with respect to said visible reference. A device used for such measuring may include a main body comprising a final optical element of an imager which defines an optical field of view directed in a first direction; and a measurement element coupled to said main body extending generally in said first direction; where a tip of said measurement element is sized and shaped to be inserted between a tooth and adjacent gingiva; where said optical field of view is sized to image at least part of a tooth.

A route from a current location of a portable device to a destination is determined, where the route includes a sequence of directed sections. Navigation instructions to guide a user of the portable device along the route to the destination are generated. To this end, candidate navigation landmarks perceptible within a 360-degree range of the current location of the portable device are identified, a navigation landmark disposed in a direction substantially opposite to the direction of the first one in the sequence of directed sections is selected from among the candidate navigation landmarks, and an initial instruction in the navigation instructions is generated and provided via a user interface of the portable device. The initial instruction references the selected navigation landmark.