G06T2219/004

AUGMENTED-REALITY ENDOSCOPIC VESSEL HARVESTING

An endoscopic vessel harvesting system for surgical removal of a blood vessel to be used for coronary bypass uses endoscopic instruments for isolating and severing the vessel. An endoscopic camera in the endoscopic instruments captures images from a distal tip of the instrument within a dissected tunnel around the vessel. An image processor assembles a three-dimensional model of the tunnel from a series of images captured by the endoscopic camera. An augmented-reality display coupled to the image processor renders (e.g., visibly displays to the user in their field of view) a consolidated map representing the three-dimensional model along with a marker in association with the map indicating a current location of the distal tip.

METHODS AND SYSTEMS FOR OBTAINING A SCALE REFERENCE AND MEASUREMENTS OF 3D OBJECTS FROM 2D PHOTOS
20230052613 · 2023-02-16 ·

Disclosed are systems and methods for obtaining a scale factor and 3D measurements of objects from a series of 2D images. An object to be measured is selected from a menu of an Augmented Reality (AR) based measurement application being executed by a mobile computing device. Measurement instructions corresponding to the selected object are retrieved and used to generate a series of image capture screens. A series of image capture screens assist the user in positioning the device relative to the object in a plurality of imaging positions to capture the series of 2D images. The images are used to determine one or more scale factors and to build a complete scaled 3D model of the object in virtual 3D space. The 3D model is used to generate one or more measurements of the object.

CONSTRUCTION SITE DIGITAL FIELD BOOK FOR THREE-DIMENSIONAL SCANNERS
20230047975 · 2023-02-16 ·

A method, system, and computer product that track scanning data acquired by a three-dimensional (3D) coordinate scanner is provided. The method includes storing a digital representation of an environment in memory of a mobile computing device. A first scan is performed with the 3D coordinate scanner in an area of the environment. A location of the first scan is determined on the digital representation. The first scan is registered with the digital representation. The location of the 3D coordinate scanner is indicated on the digital representation at the time of the first scan.

Adaptive model updates for dynamic and static scenes

In one embodiment, a computing system may update a first 3D model of a region of an environment based on comparisons between the first 3D model and first depth measurements of the region generated during a first time period. The computing system may determine that the region is static by comparing the first 3D model to second depth measurements of the region generated during a second time period. The computing system may in response to determining that the region is static, detect whether the region changed after the second time period based on comparisons between a second 3D model of the region and third depth measurements of the region generated after the second time period, the second 3D model having a lower resolution than the first 3D model. The computing system may in response to detecting a change in the region, update the first 3D model of the region.

Insertion of annotation labels in a CAD drawing
11580266 · 2023-02-14 · ·

The current invention concerns a computer-implemented method, a computer system, and a computer program product for annotation positioning in a CAD drawing. A CAD drawing comprising N anchor points is obtained, with N≥2. A candidate set comprising multiple candidate points is obtained. From the candidate set, N placement points are selected. With each anchor point, a placement point is associated based on combinatorial optimization of an objective function dependent on distances. Each distance is thereby in between an anchor and a placement point. In the CAD drawing, for each anchor point, a leader line in between the anchor point and the associated placement point and an annotation label at or near the associated placement point are inserted.

Apparatus and methods for augmented reality vehicle condition inspection

Methods, apparatus, systems and articles of manufacture are disclosed for augmented reality vehicle condition inspection. An example apparatus disclosed herein includes a location analyzer to determine whether a camera is at an inspection location and directed towards a first vehicle in an inspection profile, the inspection location corresponding to a location of the camera relative to the first vehicle, an interface generator to generate an indication on a display that the camera is at the inspection location, the indication associated with an inspection image being captured, and an image analyzer to compare the inspection image captured at the inspection location with a reference image taken of a reference vehicle of a same type as the first vehicle, and determine a vehicle part condition or a vehicle condition based on the comparison of the inspection image and the reference image.

Viewpoint dependent brick selection for fast volumetric reconstruction

A method to culling parts of a 3D reconstruction volume is provided. The method makes available to a wide variety of mobile XR applications fresh, accurate and comprehensive 3D reconstruction data with low usage of computational resources and storage spaces. The method includes culling parts of the 3D reconstruction volume against a depth image. The depth image has a plurality of pixels, each of which represents a distance to a surface in a scene. In some embodiments, the method includes culling parts of the 3D reconstruction volume against a frustum. The frustum is derived from a field of view of an image sensor, from which image data to create the 3D reconstruction is obtained.

CORE MODEL AUGMENTED REALITY

A method of registering geological data at a formation core tracking system includes, at the tracking system, registering a formation core provided within a field of view of an optical imaging system of the tracking system; tracking the orientation of the formation core relative to the tracking system and the distance of the formation core relative to the tracking system; obtaining data associated with a first section of the formation core which is located at a predetermined distance from the tracking system, displaying the data together with an image of the formation core such that an augmented reality image is provided on a display device of the tracking system, changing the distance between the tracking system and the core; and updating the displayed data by obtaining data associated with a second section of the formation core which is located at said predetermined distance from the tracking system.

Tooth modeling system
11553989 · 2023-01-17 · ·

Systems and methods are disclosed for treating teeth to correct for malocclusions. This may be accomplished by applying a series of labels to a digital dental model and applying a rolling ball process to identify tooth boundaries separating one tooth from a neighboring tooth and to also determine the crown/gum margin. The user may further assign regions to the dental model to indicate hard regions and soft regions. With the dental model labeled and defined, the user may then generate a treatment plan for moving the labeled and defined tooth or teeth relative to one another to correct for any malocclusions. Upon approval of the treatment plan, a series of 3D printed dental appliances or aligners to be worn in series by the patient may be fabricated to ultimately move the tooth or teeth to a desired position.

Systems and methods for generating three dimensional geometry
11574439 · 2023-02-07 · ·

Systems and methods are described for creating three dimensional models of building objects by creating a point cloud from a plurality of input images, defining edges of the building object's surfaces represented by the point cloud, creating simplified geometries of the building object's surfaces and constructing a building model based on the simplified geometries. Input images may include ground, orthographic, or oblique images. The resultant model may be scaled according to correlation with select image types and textured.