A method for predicting the morphological changes of liver tumor after ablation based on deep learning includes: obtaining a medical image of liver tumor before ablation and a medical image of liver tumor after ablation; preprocessing the medical image of liver tumor before ablation and the medical image of liver tumor after ablation; obtaining a preoperative liver region map, postoperative liver region map, and postoperative liver tumor residual image map; obtaining a transformation matrix by a Coherent Point Drift (CPD) algorithm and obtaining a registration result map according to the transformation matrix; training the network by a random gradient descent method to obtain a liver tumor prediction model; using the liver tumor prediction model to predict the morphological changes of liver tumor after ablation. The method provides the basis for quantitatively evaluating whether the ablation area completely covers the tumor and facilitates the postoperative treatment plan for the patient.

Methods and systems are disclosed for performing operations comprising: receiving an image that includes a depiction of a face of a user; generating a plurality of landmarks of the face based on the received image; removing a set of interfering landmarks from the plurality of landmarks resulting in a remaining set of landmarks of the plurality of landmarks; obtaining a depth map for the face of the user; and computing a real-world scale of the face of the user based on the depth map and the remaining set of landmarks.

A method, apparatus, device, and storage medium for transforming a hairstyle are provided. The method may include: determining a face bounding box according to information on face key points of acquired face image; constructing grids according to the face bounding box; deforming, by using an acquired target hairstyle function, edge lines of at least a part of the constructed grids, which comprises the hairstyle, to obtain a deformed grid curve; determining a deformed hairstyle in the face image according to the deformed grid curve.

There is provided a method for generating a personalized Head Related Transfer Function (HRTF). The method can include capturing an image of an ear using a portable device, auto-scaling the captured image to determine physical geometries of the ear and obtaining a personalized HRTF based on the determined physical geometries of the ear.

Methods and systems are disclosed for performing operations for applying augmented reality elements to a fashion item. The operations include receiving an image that includes a depiction of a person wearing a fashion item. The operations include generating a segmentation of the fashion item worn by the person depicted in the image. The operations include extracting a portion of the image corresponding to the segmentation of the fashion item; estimating an angle of each pixel in the portion of the image relative to a camera used to capture the image. The operations include applying one or more augmented reality elements to the fashion item in the image based on the estimated angle of each pixel in the portion of the image relative to the camera used to capture the image.

A surgical instrument navigation system and method of use is provided that visually simulates a virtual volumetric scene of a body cavity of a patient from a point of view of a surgical instrument residing in the cavity of the patient, wherein the surgical instrument, as provided, may be a steerable surgical catheter with a biopsy device and/or a surgical catheter with a side-exiting medical instrument, among others. Additionally, systems, methods and devices are provided for forming a respiratory-gated point cloud of a patient's respiratory system and for placing a localization element in an organ of a patient.

Techniques are described for determining a pre-morbid shape of an anatomical object. A method includes receiving first image data of a first anatomical structure and second image data of a second anatomical structure. The first and second anatomical structures are anatomically related. The method includes determining a first shape model based on the first image data and a joint statistical shape model (SSM). The method includes determining a second shape model based on the first shape model, the first image data, and the second image data, the second shape model including a second estimated shape of the first anatomical structure and a second estimated shape for the second anatomical structure. The method includes generating anatomical information indicative of the pre-morbid shape of at least the second anatomical structure based on the second shape model.

Disclosed is a medical imaging conversion method, automatically converting: at least one or more real x-ray images of a patient, including at least a first anatomical structure of the patient and a second anatomical structure of the patient, into at least one digitally reconstructed radiograph (DRR) of the patient representing the first anatomical structure without representing the second anatomical structure, by a single operation using either one convolutional neural network (CNN) or a group of convolutional neural networks (CNN) which is preliminarily trained to, both or simultaneously: differentiate the first anatomical structure from the second anatomical structure, and convert a real x-ray image into at least one digitally reconstructed radiograph (DRR).

Described herein are systems, methods, and instrumentalities associated with segmenting and/or determining the shape of an anatomical structure. An artificial neural network (ANN) is used to perform these tasks based on a statistical shape model of the anatomical structure. The ANN is trained by evaluating and backpropagating multiple losses associated with shape estimation and segmentation mask generation. The model obtained using these techniques may be used for different clinical purposes including, for example, motion estimation and motion tracking.

The present disclosure relates to an image processing method. The method may include: obtaining image data; reconstructing an image based on the image data, the image including one or more first edges; obtaining a model, the model including one or more second edges corresponding to the one or more first edges; matching the model and the image; and adjusting the one or more second edges of the model based on the one or more first edges.