An image processing method includes: determining an area to be processed according to a line feature in an image frame to be processed; building a space model according to the image frame to be processed; and embedding a special effect material to be embedded into the area to be processed according to the space model, to generate a special effect image frame.

In some examples, an unmanned aerial vehicle (UAV) may determine, based on a three-dimensional (3D) model including a plurality of points corresponding to a scan target, a scan plan for scanning at least a portion of the scan target. For instance, the scan plan may include a plurality of poses for the UAV to assume to capture images of the scan target. The UAV may capture with one or more image sensors, one or more images of the scan target from one or more poses of the plurality of poses. Further, the UAV may determine an update to the 3D model based at least in part on the one or more images. Additionally, the UAV may update the scan plan based at least in part on the update to the 3D model.

Systems and methods for providing an AR visual display to save are described. A camera of a computing device scans an area and an AR engine of the computing device extrapolates flat portions of the area. A digital representation of the area is displayed via a GUI of the computing device to allow a user to place digitally created content. The digitally created content is textual content, 2D content, 3D content, video content, and/or audio content. The AR engine receives, from a user, an action executed on a surface and at a location of the digital representation to add a tag or an anchor. The AR engine utilizes planes as indicators to save the placement of the tag or the anchor and transmits the placement of the tag or the anchor to a server. The placement of the tag or the anchor allows for viewing from other computing devices.

When three-dimensional audio is produced by using headphones, particular HRTF-filters are used to modify sound for the left and right channels of the headphone. As the morphology of every ear is different, it is beneficial to have HRTF-filters particularly designed for the user of headphones. Such filters may be produced by deriving ear geometry from a plurality of images taken with an ordinary camera, detecting necessary features from images and fitting said features to a model that has been produced from accurately scanned ears comprising representative values for different sizes and shapes. Taken images are sent to a server (52) that performs the necessary computations and submits the data further or produces the requested filter.

A system and method for providing positional error correction for particles of destructible objects in a three-dimensional volume in a virtual space includes electronic storage to store center-of-mass information of a set of objects, using a high-precision floating point format. Prior to runtime and/or interactive manipulation of the set of objects, a texture map is generated that includes positional information in a floating point format having less precision than the high-precision floating point format. A simulation uses this texture map to determine simulated center-of-mass information of the set of objects. This simulated center-of-mass information is compared with the previously stored center-of-mass information to determine which objects have positional errors, and which offsets are needed to correct the positional errors. The stored center-of-mass information is adjusted by the determined offsets, such that subsequent use, during interactive runtime, has no or reduced positional errors and/or artifacts caused by positional errors.

An image processing method suitable for 3D display is provided. The image processing method includes: determining, by a processor in a display-processing element, a current display mode of the 3D display according to a detected user command for activating on-screen display (OSD) menu; in response to the current display mode not being a specific 3D display mode, the processor outputting the OSD menu at a preset position, and outputting an input image; and in response to the current display mode being the specific 3D display mode, the processor outputting the OSD menu at an adjusted position, and outputting the input image, wherein the adjusted position is different from the preset position.

An extended reality (XR) system includes an extended reality application executing on a processor within the XR system. The XR system receives, via a client device, a selection of an extended reality (XR) object located within an XR environment. The XR system receives, via the client device, a request to move the selected XR object within the XR environment. The XR system calculates a first distance between a first feature of the XR object and a first plane associated with a first physical object within the XR environment. The XR system determines that the first distance is within a particular distance. In response to determining that the first distance is within the particular distance, the XR system positions the first feature within the XR environment such that the first feature is coplanar with the first plane.

Aspects include a system and method for detection of computer-aided design (CAD) objects in point clouds. An example method includes obtaining, by a processing device, a labeled data set. The method further includes training, by the processing device, a model on the labeled data set using a two-dimensional (2D) object detector to calculate a three-dimensional (3D) box out of a detected 2D box by mapping coordinates on a geometric primitive image into 3D. The method further includes fitting, by the processing device, a computer-aided design (CAD) model into the 3D box.

Systems, methods, and computer-readable media are described herein to model divergent beam ray paths between locations on a roof (e.g., of a structure) and modeled locations of the sun at different times of the day and different days during a week, month, year, or another time period. A graphical user interface allows for visualization of the modeled ray paths and graphical manipulation of the resolution and parameters of the modeling process.

A method includes receiving an image of a real environment captured using a camera worn by a user, the image comprising a hand of the user and determining a pose of the hand based on the image. Based on a three-dimensional model of the hand having the determined pose, generating a two-dimensional surface representing the hand as viewed from a first viewpoint of the user and positioning the two-dimensional surface representing the hand and one or more virtual-object representations in a three-dimensional space. The method further includes determining that a portion of the two-dimensional surface representing the hand is visible from a second viewpoint in the three-dimensional space, and generating an output image, wherein a set of image pixels of the output image corresponding to the portion of the two-dimensional surface that is visible is configured to cause a display to tur off a set of corresponding display pixels.