Provided is an image processing device including a matching unit that performs matching processing between a predetermined pattern on a surface of a 3D model of a biological tissue including an operating site generated on the basis of a preoperative diagnosis image and a predetermined pattern on a surface of the biological tissue included in a captured image during surgery, a shift amount estimation unit that estimates an amount of deformation from a preoperative state of the biological tissue on the basis of a result of the matching processing and information regarding a three-dimensional position of a photographing region which is a region photographed during surgery on the surface of the biological tissue, and a 3D model update unit that updates the 3D model generated before surgery on the basis of the estimated amount of deformation of the biological tissue.

A computer readable recording medium stores a program that causes a computer to execute a process. The process includes: voxelizing a three-dimensional model to generate a voxel model; performing inversion processing on an area in three-dimensional space including the generated voxel model to invert an area set as voxels and an area not set as voxels; extracting an area including specific two points from the area set as voxels after the inversion processing, the area to be extracted allowing center of a specific sphere having a predetermined size to pass anywhere therein; determining a shortest path between the specific two points within the extracted area; and outputting the shortest path.

A computer readable recording medium stores a program that causes a computer to execute a process. The process includes: voxelizing a three-dimensional model to generate a voxel model; performing inversion processing on an area in three-dimensional space including the generated voxel model to invert an area set as voxels and an area not set as voxels; extracting an area including specific two points from the area set as voxels after the inversion processing, the area to be extracted allowing center of a specific sphere having a predetermined size to pass anywhere therein; determining a shortest path between the specific two points within the extracted area; and outputting the shortest path.

An ultrasonic diagnosis apparatus includes a position detector, and control circuitry. The position detector detects a position in a three-dimensional space of one of an ultrasonic image and an ultrasonic probe. The control circuitry uses a vivisection view defined in a three-dimensional space. The control circuitry associates a structure related to a subject included in the ultrasonic image with a structure included in the vivisection view using a position and orientation in a first three-dimensional coordinate system of the structure related to the subject included in the ultrasonic image and a position and orientation in a second three-dimensional coordinate system of the structure included in the vivisection view.

A machine-based learning method estimates a probability of bone fractures in a 3D image, more specifically vertebral fractures. The method and system utilizing such method utilize a data-driven computational model to learn 3D image features for classifying vertebra fractures. A three-dimensional medical image analysis system for predicting a presence of a vertebral fracture in a subject includes a 3D image processor for receiving and processing 3D image data of a 3D image of the subject, producing two or more sets of 3D voxels. Each of the sets of 3D voxels corresponds to an entirety of the 3D image and each of the sets of 3D voxels consists of equal 3D voxels of different dimensions. The system also includes a voxel classifier for assigning the 3D voxels one or more class probabilities each of the 3D voxels contains a fracture using a computational model, and a fracture probability estimator for estimating a probability of the presence of a vertebral fracture in the subject.

A machine-based learning method estimates a probability of bone fractures in a 3D image, more specifically vertebral fractures. The method and system utilizing such method utilize a data-driven computational model to learn 3D image features for classifying vertebra fractures. A three-dimensional medical image analysis system for predicting a presence of a vertebral fracture in a subject includes a 3D image processor for receiving and processing 3D image data of a 3D image of the subject, producing two or more sets of 3D voxels. Each of the sets of 3D voxels corresponds to an entirety of the 3D image and each of the sets of 3D voxels consists of equal 3D voxels of different dimensions. The system also includes a voxel classifier for assigning the 3D voxels one or more class probabilities each of the 3D voxels contains a fracture using a computational model, and a fracture probability estimator for estimating a probability of the presence of a vertebral fracture in the subject.

The present disclosure provides a method of medical procedure using augmented reality for superimposing a patient's medical images (e.g., CT or MRI) over a real-time camera view of the patient. Prior to the medical procedure, the patient's medical images are processed to generate a 3D model that represents a skin contour of the patient's body. The 3D model is further processed to generate a skin marker that comprises only selected portions of the 3D model. At the time of the medical procedure, 3D images of the patient's body are captured using a camera, which are then registered with the skin marker. Then, the patient's medical images can be superimposed over the real-time camera view that is presented to the person performing the medical procedure.

The present disclosure provides a method of medical procedure using augmented reality for superimposing a patient's medical images (e.g., CT or MRI) over a real-time camera view of the patient. Prior to the medical procedure, the patient's medical images are processed to generate a 3D model that represents a skin contour of the patient's body. The 3D model is further processed to generate a skin marker that comprises only selected portions of the 3D model. At the time of the medical procedure, 3D images of the patient's body are captured using a camera, which are then registered with the skin marker. Then, the patient's medical images can be superimposed over the real-time camera view that is presented to the person performing the medical procedure.

A three-dimensional data creation method includes: creating first three-dimensional data from information detected by a sensor; receiving encoded three-dimensional data that is obtained by encoding second three-dimensional data; decoding the received encoded three-dimensional data to obtain the second three-dimensional data; and merging the first three-dimensional data with the second three-dimensional data to create third three-dimensional data.

A three-dimensional data creation method includes: creating first three-dimensional data from information detected by a sensor; receiving encoded three-dimensional data that is obtained by encoding second three-dimensional data; decoding the received encoded three-dimensional data to obtain the second three-dimensional data; and merging the first three-dimensional data with the second three-dimensional data to create third three-dimensional data.