G06T2219/2024

METHODS AND SYSTEMS FOR AUTOMATIC GENERATION OF MASSIVE TRAINING DATA SETS FROM 3D MODELS FOR TRAINING DEEP LEARNING NETWORKS
20220044070 · 2022-02-10 ·

Disclosed are systems and methods for generating large data sets for training deep learning networks (DLNs) for 3D measurements extraction from 2D images taken using a mobile device camera. The method includes the steps of receiving a 3D model of a 3D object; extracting spatial features from the 3D model; generating a first type of augmentation data for the 3D model, such as but not limited to skin color, face contour, hair style, virtual clothing, and/or lighting conditions; augmenting the 3D model with the first type of augmentation data to generate an augmented 3D model; generating at least one 2D image from the augmented 3D model by performing a projection of the augmented 3D model onto at least one plane; and generating a training data set to train the deep learning network (DLN) for spatial feature extraction by aggregating the spatial features and the at least one 2D image.

TRAINING DEVICE, CORRESPONDING AREA SPECIFYING METHOD, AND PROGRAM
20170242482 · 2017-08-24 ·

A training device, which is used to cause a user to be trained to operate an extra part based on a measurement result of user's brain activity, causes the user to view an image in which the extra part is operating.

Object interactivity in virtual space
11244516 · 2022-02-08 · ·

A method performed by an augmented reality (AR) system includes receiving a command that is input by the user through the AR system. The augmented reality (AR) system includes a hardware processor and an AR display configured to present virtual content in an environment of a user. The command specifies a type of virtual object to be presented in the environment. In response to the command, virtual objects of the specified type are presented in the environment, and a presentation of at least one of the virtual objects is altered in response to detecting a movement of the user in proximity to the at least one virtual object.

Method and system for rule based display of sets of images using image content derived parameters
11244495 · 2022-02-08 · ·

The invention provides, in some aspects, a system for implementing a rule derived basis to display image sets. In various embodiments of the invention, the selection of the images to be displayed, the layout of the images, as well as the rendering parameters and styles can be determined using a rule derived basis. The rules are based on meta data of the examination as well as image content that is being analyzed by neuronal networks. In an embodiment of the present invention, the user is presented with images displayed based on their preferences without having to first manually adjust parameters.

Methods and systems for providing a vehicle recommendation

A computer-implemented method for providing a vehicle recommendation may include obtaining characteristic data of a user-defined vehicle based on one or more interactive activities of a user with a first three-dimensional model of a model vehicle; generating a second three-dimensional model of the user-defined vehicle based on the first three-dimensional model and the characteristic data; obtaining one or more images of the second three-dimensional model; generating a selection of one or more pre-stored vehicles based on a comparison between the one or more images of the second three-dimensional model and pre-stored image data of the one or more pre-stored vehicles other than the user-defined vehicle; obtaining user feedback data based on the selection of the one or more pre-stored vehicles; generating the vehicle recommendation for the user based on the user feedback data; and transmitting, to a device associated with the user, a notification indicative of the vehicle recommendation.

AVATARS IN VIRTUAL ENVIRONMENTS

Techniques of generating a virtual environment in a virtual reality system involves changing, within a user interface of the second user, an attribute of an avatar representing the first user while maintaining a spatial position of an object with which the first user is interacting. In this way, the second user may see only non-threatening or otherwise pleasant avatars within their user interface while other users may not perceive any change to the virtual environment as displayed in their respective user interfaces.

Method, system and apparatus for removing a marker projected in a scene

A method of removing a marker projected in a scene from a view of the scene. A first image of the scene is captured using a camera (e.g., 127A). A second image of the scene is captured, using the camera (127A), following a marker (310) being projected onto an object in the scene to indicate a reference location in the scene for positioning a virtual object, the second image containing a representation of the projected marker. The second image is interleaved with the first image. A data stream is formed using at least the first and second image to generate a view of the scene, the data stream containing data representing the virtual object as part of the captured images of the scene. The virtual object is positioned relative to the projected marker captured in the second image. Pixels from the first image are used as pixel values at pixel locations where the projected marker was located in the second image to remove the projected marker from the generated view of the scene.

GENERATION AND SIMULTANEOUS DISPLAY OF MULTIPLE DIGITALLY GARMENTED AVATARS

Systems and methods for generating and simultaneously displaying multiple photorealistic digital avatars wearing garments. One specific method embodiment comprises the steps of: receiving a selection of one or more garments from a user; producing an electronic avatar for each of the selected garments; retrieving a plurality of body measurements of the user; generating a multi-dimensional space based upon the plurality of body measurements of the user; generating an interpolation measurement space for each electronic avatar for each of the selected garments, with each avatar wearing a selected garment; interpolating between two avatars to generate a realistic customized electronic avatar of the user wearing one of the garments; adding photorealistic imagery of the user's face and hair to each rendered customized animated garmented avatar to create a complete digital garmented avatar for the user for each of the selected garments; transmitting each complete digital garmented avatar to a user device; and simultaneously displaying on the user device each complete digital garmented avatar.

Information processing apparatus, information processing method, and non-transitory storage medium

An information processing apparatus according to the invention includes: an acquisition unit that acquires a two-dimensional image of a person and a three-dimensional registered image of a registrant; and a generation unit that, when superimposing the two-dimensional image and the three-dimensional registered image to generate a composite image, performs an editing process for changing an appearance of the person or the registrant for at least one of the two-dimensional image, the three-dimensional registered image, and the composite image.

UNCERTAINTY DISPLAY FOR A MULTI-DIMENSIONAL MESH
20210407196 · 2021-12-30 ·

In various example embodiments, techniques are provided for representing uncertainty when displaying a rendered view of a multi-dimensional mesh (e.g., created by SfM photogrammetry) in a user interface by applying a real-time, obfuscation filter that modifies the rendered view based on uncertainty in screen space. Where the multi-dimensional mesh is within a limit of data accuracy, the rendered view is shown without modification (i.e. as normal), and a user may trust the information displayed. Where the multi-dimensional mesh is beyond the limit of data accuracy, the obfuscation filter obfuscates detail (e.g., by blurring, pixilating, edge enforcing, etc.) in the rendered view so that a user may visually perceive the uncertainty. The amount of obfuscation may be weighted based on uncertainty to allow the user to visually quantify uncertainty.