High-fidelity three-dimensional (3D) models and other high-fidelity digital media that depict objects with a high-level of detail may be computationally demanding to display on some devices. According to some embodiments of the present disclosure, digital media may be supplemented with one or more 3D models to improve the overall level of detail provided by the digital media without excessively increasing computational requirements. An example computer-implemented method includes instructing a user device to display digital media depicting an object, receiving an indication selecting a region of the depicted object, and instructing the user device to display a 3D model corresponding to the selected region of the depicted object, where the 3D model is different from the digital media.

In a method for performing gaze redirection, a video stream of a user is received, each video frame from the video stream including a depiction of a gaze of the user. For each video frame from the video stream, an estimated gaze direction of the gaze of the user in that video frame is determined. A field of view (FOV) for a virtual representation associated with the user in a virtual environment is determined. An updated video frame including a modified gaze direction of the user different from the estimated gaze direction of the gaze of the user is generated.

The disclosed systems, components, methods, and processing steps are directed to determining user-item fit characteristics of an item for a user body part by accessing a three-dimensional (3D) reconstructed model of the user body part, accessing information about one or more 3D reference models of the item, the information for each 3D reference model including respective dimensional measurement, spatial, and geometrical attributes, performing a 3D matching process based on the 3D reconstructed model and the accessed information of the one or more 3D reference models to determine a best-fitting 3D reference model from the one or more 3D reference models, integrating the best-fitting 3D reference model with the 3D reconstructed model to provide a 3D best fit representation and displaying the 3D best fit representation along with visual indications of user-item fit characteristics.

A method for real-time compositing, rendering and delivery of complex geometric models and textures, includes storing a plurality of three-dimensional models of at least two sub-parts of a whole three-dimensional object, storing a plurality of image textures for each of the plurality of three-dimensional models, receiving instructions from a user, the instructions including a selection of at least two of the plurality of three-dimensional models, each of the at least two of the plurality of three-dimensional models being one of the at least two sub-parts of the whole three-dimensional object, and generating the whole three-dimensional object including the at least one of the plurality of image textures for each of the at least two of the plurality of three-dimensional models applied according to the instructions to the at least two of the plurality of three-dimensional models.

The present technology generates a simplified version of a complex avatar by capturing images and 3-D volume information of segments of the complex avatar while the complex avatar is rendered. When the complex avatar is requested in an environment in which it is not desirable to display the complex avatar, the captured images and 3-D volume information can be used to provide a simplified version of the avatar. The simplified version of the avatar can have a similar visual appearance but can be easier to render. However, the present technology permits the user with the complex avatar to continue to have approximately the same visual appearance while avoiding the degraded performance on systems not capable of rendering the complex avatar quickly enough.

Technologies for 3D virtual environment placement of 3D models based on 2D images are disclosed. At least an outline of a 3D virtual environment may be generated. A 2D image of one or more 2D images may be identified. A first product from the first 2D image may be identified. At least one 3D model of one or more 3D models based, at least, on the first product may be determined. A first location for placement of the first product in the 3D virtual environment may be identified. The at least one 3D model may be added within the 3D virtual environment based, at least, on the first location. The 3D virtual environment may be rendered into a visually interpretable form. A second product may be identified from the first 2D image, forming a first grouping of products. A starting element for the first grouping of products may be determined.

Three-dimensional (3D) point cloud generation using a stationary laser scanner and a mobile scanner. The method includes scanning a first part of a surrounding with the stationary laser scanner, obtaining a first 3D point cloud, scanning a second part of the surrounding with the mobile scanner, obtaining a second 3D point cloud, whereby there is an overlap region of the first part and the second part, and aligning the second 3D point cloud to the first 3D point cloud to form a combined 3D point cloud. The positional accuracy of points of the second 3D point cloud is increased by automatically referencing second scanner data of the overlap region, generated by the mobile scanner, to first scanner data of the overlap region, generated by the stationary laser scanner. Therewith, deformations of the second 3D point cloud and its alignment with the first 3D point cloud are corrected.

A method and system for improving damage assessment by automatic measurement of virtual objects within an augmented reality (AR) representation of a physical environment are disclosed. A user interacts with a mobile computing device to position and resize virtual objects within a virtual space corresponding to a physical environment, which is presented to the user as an AR environment generated by the mobile computing device. The virtual objects are positioned and sized to match damaged physical objects within the physical environment. The sizes of the physical objects are automatically determined using the virtual sizes of the virtual objects, which physical sizes are further used to determine the extent of damage.

An information playback method and device, a computer readable storage medium, and an electronic device, relating to the technical field of computers. Said method comprises: performing identification on a spatial image in a 3D model and obtaining an information display device and a display area in the spatial image (201); determining the display position information corresponding to the display area (202); overlaying an information playback layer in the display area according to the display position information so as to play back display information in the information playback layer (203). By overlaying an information playback layer on the information display device in a 3D model, further information exchange can be implemented in the 3D model, so that user can experience a more reality-like scenario in the 3D model, thereby enhancing user experience.

An object detection unit 31 detects, for example, a moving object and a detection target object that coincides with a registered object registered in an object database from an input image. A map processing unit 32 updates information of an area corresponding to the detected object in a 3D map including a signed distance, a weight parameter, and an object ID label according to an object detection result by the object detection unit 31. For example, when the moving object is detected, the map processing unit 32 initializes information of an area corresponding to the moving object in the 3D map. The map processing unit 32 registers an object map of the detected moving object in the object database. When the detection target object is detected, the map processing unit 32 converts an object map of the registered object that coincides with the detection target object according to a posture of the detection target object and integrates the same with the 3D map. Movement of the object may be quickly reflected on the map.