SHAPE CONFORMING PROJECTIONS OF MEDICAL INFORMATION

Abstract

A projection system for projecting medical information onto the surface of the human body such that the medical information conforms and registers to the contour of the underlying shape of the region it is being projected upon. The projection system is in communication with one or more projectors and one or more sensors which capture the topography/area/volume of the region of interest and/or the view of the user, and alter the medical information such that the medical information remains accurate in dimensions when projected into the area of interest.

Claims

1. A method of projecting medical information onto body of a subject such that the information being projected conforms to a shape of a region or anatomy being projected upon while maintaining accuracy of the original shape, wherein: a. projected information registers or aligns to the region/anatomy being projected upon; b. projected information is configured to adapt to movement of the projection surface; c. projected information is altered by the user while maintaining conformation to the underlying shape; d. projected information is adapted to best fit the shape of the region/anatomy projected upon by integrating contour, shape or volume of the region being projected upon into mathematical consideration; and e. projected information is configured to be interacted with by the user using via multiple interaction modalities.

2. The method of claim 1, wherein the projected image interacts with a surface agent placed on the area being projected upon which marks the information onto the surface being projected upon.

3. The method of claim 1, wherein the projected information adapts to a movement of a view point of the user.

Description

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING(S)

[0008] The features and advantages of the present invention will become apparent from a consideration of the following detailed description presented in connection with the accompanying drawings in which:

[0009] FIGS. 1A-1B show surgical marking (dotted line) for breast reconstruction being projected upon by the present invention. As seen in FIG. 1B, the dotted line surgical markings conform to the region being projected upon (breast) such that the surgical marking bend around the contour of the breast. Without such a system, significant distortion of the medical information may be encountered, altering the accuracy of the surgical markings.

[0010] FIG. 2A shows a projection of a checkerboard pattern onto the breast without shape conformation. As seen in the image, the checkerboard pattern is distorted by the contour of the breast causing the angles of each box to be obtuse angles rather than 90 degrees.

[0011] FIG. 2B shows a projection of a checkerboard pattern onto the breast with shape conformation. As seen in the image, the checkerboard pattern conforms to the contour which is demonstrated by the ability to maintain the angles of each box at 90 degrees.

[0012] FIG. 3 shows an embodiment of the system comprising one or more tiled (to increase coverage or resolution) or superimposed (to increase brightness) projectors, and one or more sensors (e.g. visible camera, depth camera or IR cameras). It also shows the interactive hand or device (e.g. ruler, laser pointer, scalpel).

[0013] FIG. 4 shows a non-limiting embodiment of the system that includes a head/eye tracking device and a projection unit.

[0014] FIG. 5 shows another non-limiting embodiment of the system that includes multiple ceiling-mounted head/eye tracking devices and a projection unit.

DETAILED DESCRIPTION OF THE INVENTION

[0015] Referring now to FIGS. 1A-5, in some embodiments, the present invention features a system and method of projecting any medical information (i.e. CT scans, X-rays, blood flow map, thermal maps, surgical guides) onto the anatomy (or anatomical models) such that the projection both registers and conforms to the contour of the anatomical region it is being projected upon (i.e. nose, cheeks, breasts, chest, ears etc.), thereby maintaining the accuracy (length, angles positioning) of the medical information.

[0016] In another aspect of the present invention, medical information (i.e. CT scans, X-rays, blood flow map, thermal maps, surgical guides) is projected onto the anatomy (or anatomical models) such that the projection adapts to the movement of the surface it is being projected upon (breathing, facial expression) while maintaining conformation to the underlying shape.

[0017] In some embodiments, medical information (i.e. CT scans, X-rays, blood flow map, thermal maps, surgical guides) is projected onto the anatomy (or anatomical models) such that the projection can be altered by the user (i.e. stretched, scaled, rotated, repositioned) while maintaining conformation to the underlying shape.

[0018] In other embodiments, medical information (i.e. CT scans, X-rays, blood flow map, thermal maps, surgical guides) is projected onto the anatomy (or anatomical models) such that the projection is correct from the single preferred user's (i.e. surgeon) point of view and projection change with the user's head position, in order to correctly visualize internal data (e.g. bones, blood vessels) on the surface.

[0019] In some other embodiments, medical information (i.e. CT scans, X-rays, blood flow map, thermal maps, surgical guides) is projected onto the anatomy (or anatomical models) such that the projected information can be adapted to best fit the shape of the area projected upon by integrating contour, shape and volume of the region being projected upon into mathematical consideration.

[0020] In additional embodiments of the present invention, projected medical information can be interacted with by the user using via multiple interaction modalities like laser pointers, hand gestures, markers or digital pens, scalpels, tablets or other mobile devices while maintaining conformation to the underlying shape.

[0021] In further embodiments of the present invention projected medical information can interact with a surface agent, such as a light activated dye or heat activated dye, placed on the area being projected upon which marks (i.e. Tattoos) the information onto the surface being projected upon.

Example

[0022] The following is a non-limiting example of the present invention. It is to be understood that said example is not intended to limit the present invention in any way. Equivalents or substitutes are within the scope of the present invention.

Example 1

[0023] A surgeon may acquire medical information such as blood flow and vascularity of a patient's breast tissue using and infrared camera or dye-based imaging system and project this medical information on the patient's breast tissue in such a way that the projection conforms to the contour of the breast such that the areas of poor blood flow are accurately demarcated using the projection system. The area of poor blood flow which is projected can be traced using a marker. The traced region can then be surgically removed by the surgeon.

Example 2

[0024] A surgeon may acquire information on the location of major blood vessels in the abdomen using CT scans prior to performing surgery. Intraoperatively the physician can project the preoperative CT scan onto the abdomen in such a way that the projection conforms to the exact contour of the patient's abdomen as well as the view point of the surgeon. Using this technique, the physician can actually identify the location of the major blood vessels for surgical dissection.

Example 3

[0025] Referring to FIGS. 1A-1B, a surgeon may create a computerized patient specific stencil for breast reduction before surgery which they can use during surgery to make their surgical markings. The surgeon can project this stencil on the breast intraoperatively. The computerized template remains accurate (length, angles) while conforming to the area of the breast it is projected upon. The surgeon can alter the projected stencil (stretch, rotate, alter limbs of the stencil) using hand gesture, laser pointer etc. All the while the image shape conforms as it is being altered.

Example 4

[0026] A surgeon preforming craniofacial surgery may project a virtual plan onto the surface of the skull guiding them where to make cuts into the mandible. The projected information registers and conforms to the contour of the mandible maintaining accuracy of the cutting locations that were planned before surgery.

Example 5

[0027] Referring to FIGS. 4-5, a medical student can project an X-ray of the chest onto the chest of an anatomical model such that the projected X-ray registers and conforms to the shape of the chest of the anatomical model and from the student's perspective.

[0028] Although there has been shown and described the preferred embodiment of the present invention, it will be readily apparent to those skilled in the art that modifications may be made thereto which do not exceed the scope of the appended claims. Therefore, the scope of the invention is only to be limited by the following claims. In some embodiments, the figures presented in this patent application are drawn to scale, including the angles, ratios of dimensions, etc. In some embodiments, the figures are representative only and the claims are not limited by the dimensions of the figures. In some embodiments, descriptions of the inventions described herein using the phrase comprising includes embodiments that could be described as consisting essentially of or consisting of, and as such the written description requirement for claiming one or more embodiments of the present invention using the phrase consisting essentially of or consisting of is met.