The present teaching relates to method, system, medium, and implementations for estimating 3D coordinate of a 3D virtual model. Two pairs of feature points are obtained. Each of the pairs includes a respective 2D feature point on an organ observed in a 2D image, acquired during a medical procedure, and a respective corresponding 3D feature point from a 3D virtual model, constructed for the organ prior to the procedure based on a plurality of images of the organ. The first and the second 3D feature points have different depths. A 3D coordinate of a 3D feature point is determined based on the pairs of feature points so that a projection of the 3D virtual model from the 3D coordinate substantially matches the organ observed in the 2D image.

An intraoral scanner generates 2D images of a dental site and 3D intraoral scans of the dental site. The computing device receives the 2D images of the dental site and the 3D intraoral scans of the dental site from the intraoral scanner, generates a 3D model of the dental site based on the 3D intraoral scans of the dental site, and processes at least one of a) one or more of the 2D images of the dental site, b) one or more of the 3D intraoral scans of the dental site, or c) data from the 3D model of the dental site to identify one or more intraoral areas of interest (AOIs) at the dental site. The computing device determines a dental condition associated with the one or more intraoral AOIs, and determines a manner for scanning the one or more intraoral AOIs.

A method for alignment of volumetric and surface scan images, said method comprising the steps of: receiving a volumetric image and surface scan image, wherein the volumetric image is a three-dimensional voxel array of a maxillofacial anatomy of a patient and the surface scan image is a polygonal mesh corresponding to the maxillofacial anatomy of the same patient; segmenting the volumetric image and surface scan image into a set of distinct anatomical structures by assigning each voxel in the volumetric image an identifier by structure and assigning each vertex or face of the mesh from the surface scan image an identifier by structure, wherein at least one of the distinct anatomical structures are in common between the volumetric and the surface scan image; extracting a polygonal mesh from the volumetric image featuring common structures with the polygonal mesh from the surface scan image; converting both meshes from the volumetric image and from the surface scan to a point cloud; and aligning the converted meshes via point clouds using a point set registration.

A method for processing positioning data of a mobile device is provided, comprising: acquiring a first original point set and a target point set by measuring an object surface with the mobile device; extracting feature points from the first original point set to obtain an original key point set; extracting feature points from the target point set to obtain a target key point set; performing a first registration operation on the original key point set and the target key point set to obtain a first model transformation parameter; transforming the first original point set by the first model transformation parameter to obtain a second original point set; performing a second registration operation on the second original point set and the target point set to obtain a second model transformation parameter; and acquiring third model transformation parameter based on the first model transformation parameter and the second model transformation parameter.

Embodiments of the disclosure provide methods and systems for multi-modality joint analysis of a plurality of vascular images. The exemplary system may include a communication interface configured to receive the plurality of vascular images acquired using a plurality of imaging modalities. The system may further include at least one processor, configured to extract a plurality of vessel models for a vessel of interest from the plurality of vascular images. The plurality of vessel models are associated with the plurality of imaging modalities, respectively. The at least one processor is also configured to fuse the plurality of vessel models associated with the plurality of imaging modalities to generate a fused model for the vessel of interest. The at least one processor is further configured to provide a diagnostic analysis result based on the fused model of the vessel of interest.

Systems and methods are disclosed for capturing multiple sequences of views of a three-dimensional object using a plurality of virtual cameras. The systems and methods generate aligned sequences from the multiple sequences based on an arrangement of the plurality of virtual cameras in relation to the three-dimensional object. Using a convolutional network, the systems and methods classify the three-dimensional object based on the aligned sequences and identify the three-dimensional object using the classification.

Disclosed are computer-implemented methods which encompass determining whether two medical images were taken of the same patient. In a first aspect, this is done by analysing a registration of the two images with one another. The registration may be a direct registration between the two images or an indirect registration, for example via an atlas to which each image is registered. In other aspects, a machine learning algorithm is trained on the basis of image registrations to determine whether the two images were taken of the same patient. The disclosed methods serve the purpose of being able to group medical images together which were taken of the same patient without having to provide or otherwise process data about the identity of the patient.

Disclosed are systems and methods for generating data sets for training deep learning networks for key point annotations and measurements extraction from photos taken using a mobile device camera. The method includes the steps of receiving a 3D scan model of a 3D object or subject captured from a 3D scanner and a 2D photograph of the same 3D object or subject at a virtual workspace. The 3D scan model is rigged with one or more key points. A superimposed image of a pose-adjusted and aligned 3D scan model superimposed over the 2D photograph is captured by a virtual camera in the virtual workspace. Training data for a key point annotation DLN is generated by repeating the steps for a plurality of objects belonging to a plurality of object categories. The key point annotation DLN learns from the training data to produce key point annotations of objects from 2D photographs captured using any mobile device camera.

A model dataset is generated based on first image data. The model dataset and second image data map at least a common part of an examination region at a second detail level. The model dataset and the second image data are pre-aligned at a first detail level below the second detail level based on first features that are mapped at the first detail level in the model dataset and the second image data and/or an acquisition geometry of the second image data. The model dataset and the second image data are registered at the second detail level based on second features that are mapped at the second detail level in the model dataset and the second image data. The second class of features is mappable at the second detail level or above. The registered second image data and/or the registered model dataset is provided.

A method (10) that encodes electrode locations to a mean scalp mesh for adaptation to subsequent image scans.