Disclosed herein are various embodiments for a headset-based interface and menu system. An embodiment operates by determining a first position of a headset, configured to display and enable interactions with an interface of a computing system, is less than a threshold. A second position of the headset is detected and it is determined that the second position of the headset is greater than the threshold. Responsive to the determining that the second position of the headset is greater than the threshold, a menu is provided for display in the interface visible via the headset overlaying the interface.

Introduced here computer programs and associated computer-implemented techniques for establishing the dimensions of interior spaces. These computer programs are able to accomplish this by combining knowledge of these interior spaces with spatial information that is output by an augmented reality (AR) framework. Such an approach allows two-dimensional (2D) layouts to be seamlessly created through guided corner-to-corner measurement of interior spaces.

A damage assessment module operating on a computer system automatically evaluates a roof, estimating damage to the roof by analyzing a point cloud of a roof. The damage assessment module identifies individual shingles from the point cloud and detects potentially damaged areas on each of the shingles. The damage assessment module then maps the potentially damaged areas of each shingle back to the point cloud to determine which areas of the roof are damaged. Based on the estimation, the damage assessment module generates a report on the roof damage.

Methods and systems identify frequently-used CAD components and apply machine learning techniques to predict mateable entities and corresponding mate types for those components to automatically add components to a CAD model. An example method includes accessing information regarding CAD model parts and related mate information stored in a computer database, and dividing parts into a plurality of clusters having parts with similar global shape signatures. In response to a new part being added, contextual signatures of entities of the new part are input into a mateability predictor neural network to determine a mateable entity of the new part. Input into a mate-type predictor neural network is (i) a contextual signature of the mateable entity and (ii) a contextual signature of an entity of another part of the CAD model to determine a mate type between the entities. A mate between the new part and the other part is automatically added based on the determined mate type.

Methods and systems for developing a sizing system through categorization and selection of prototypes, which can be regarded as the most appropriate fit model, is described. Once categorized and prototypes are selected, recommendations for the sizing of a target body part may be issued.

Provided are a design assistance device, a design assistance system, a server, and a design assistance method that displays shapes and specification information of plural items included in an item group so that a user can easily view the items. The design assistance device includes: a three-dimensional data acquisition unit that acquires three-dimensional data of an item group including a plurality of items; a display data generation unit that generates two-dimensional display data including a two-dimensional display representing an appearance of the item group and specification information of at least one of the items in one observation direction in the three-dimensional data; and a display mode determination unit that determines a display mode of the specification information in the two-dimensional display based on a shape of each of the items as well as relative positions and relative orientations between the items as viewed in the one observation direction.

A method for is provided. The method can include receiving data characterizing a first measurement image having a first state and a first set of three-dimensional coordinate data corresponding to the first measurement image. The first measurement image can include two-dimensional image data. The method can also include receiving data characterizing at least one geometric dimension determined for the first measurement image. The method can further include receiving data characterizing a second measurement image having a second state and a second set of three-dimensional coordinate data corresponding to the second measurement image. The method can also include applying the first state of the first measurement image to the second measurement image. The method can further include displaying at least one second geometric dimension determined using the second set of three-dimensional coordinate data. Related systems performing the method are also provided.

A method relating to ATM repair is provided. The method includes: receiving, by an electronic device associated with a repair provider, diagnostic data from an ATM; capturing, by the electronic device, an image or a video of the ATM; initiating, by the electronic device, a communication session with a remote location computing system; transmitting, by the electronic device and to the remote location computing system, at least one of the image or the video of the ATM and the diagnostic data; receiving, by the electronic device and from the remote location computing system, repair instructions including a modified version of the at least one image or video; outputting, by the electronic device, the repair instructions; receiving, by the electronic device, a user input identifying a component of the modified version of the at least one image or video; and outputting, by the electronic device, diagnostic information for the identified component.

Disclosed herein are various embodiments for an augmented reality interaction, modeling, and annotation system. An embodiment operates by displaying a digital model of an object within an interface of an augmented reality computing system, wherein the model is associated with a first set of dimensions corresponding to a size of the object and a second set of dimensions corresponding to a size of the digital model. A command to resize the digital model to a third set of dimensions different from the second set of dimensions is received from a user. The digital model is resized within the interface in accordance with the third set of dimensions. The resized digital model of the object is displayed in accordance with the third set of dimensions, wherein the first set of dimensions corresponding to the size of the object remains unchanged within the augmented reality computing system.

A method of evaluating a bone fracture reduction includes imaging, intraoperatively, a fractured bone to obtain a representation of the fractured bone in a computing system. The fractured bone defines at least first and second bone fragments separated by a fracture. The method includes imaging a contralateral bone of the patient to obtain a representation of the contralateral bone in the computing system and further includes generating, intraoperatively in the computing system, a virtual model of the fractured bone from data presented in the representation of the fractured bone and a virtual model of the contralateral bone from data presented in the representation of the contralateral bone. The method includes comparing, intraoperatively in the computing system, a spatial dimension measured with respect to the virtual model of the fractured bone with a corresponding spatial dimension measured with respect to the virtual model of the contralateral bone.