The present technology relates to devices and systems for multidimensional data visualization and interaction in an augmented reality, virtual reality, or mixed reality environment. The disclosed embodiment provides a tool for a physician or other medical specialist to load and review medical scans in an AR/VR/MR environment, assisting medical diagnostics, surgical planning, medical education, or patient engagement.

Systems and methods are described herein to generate a 3D surface scan of a surface profile of a patient's anatomy. The 3D surface scan may be generated by reflections of structured light off the surface profile of the anatomy. The 3D surface scan may be used during intra-operative surgical navigation by a localization system. Optionally, a pre-operative medical image may also be registered to the localization system or used to enhance the 3D surface scan.

A patient marker couples to an anchoring device via a base having a base axis, base connections and a first indicator. The marker includes: an adapter having a first surface with connections configured to mate with the base connections, and a second surface with connections congruent with the base connections, and at least one second indicator. The marker includes an alignment target, having a target region with an alignment pattern, and a socket connected to the target region with socket connections congruent with the first surface connections. In a first configuration the socket couples to the base by mating the first surface connections with the base connections and mating the socket connections with the second surface connections. In a second configuration, the socket fits onto the base by mating the socket connections with the base connections. One of the indicators indicates a target orientation angle about the base axis.

A method for analyzing a real dental situation of a patient. The method includes steps, as follows, in succession. At an updated instant, acquisition of an updated image representing a real dental scene as observed by an operator. Determination of a virtual dental scene as a function of the representation of the real dental scene on the updated image. Presentation of the virtual dental scene in transparent mode and overlaid on the real dental scene, or display of the updated image on a screen and presentation of the virtual dental scene overlaid with the representation of the real dental scene on the updated image displayed on the screen, in transparent mode or not on the representation.

A system and method for improved medical device navigation is disclosed. An example system can include a processor configured to determine an emplacement of a 2D medical image in a 3D virtual space, determine an emplacement of a virtual medical device in the 3D space, determine an intersection based on the emplacement of the 2D medical image and the emplacement of the virtual medical device, and/or determine a dynamic point-of-projection location for the virtual medical device based at least in part on the determined intersection. The processor can cause a display to display a rendering of the 2D medical image and a projection of the virtual medical device onto the 2D medical image from a perspective of the dynamic point-of-projection location. The display can be communicatively coupled to an imaging medical device. The viewing area can be parallel to a 2D region associated with the 2D medical image.

A method of evaluating soft tissue of a human joint which includes two or more bones and ligaments, wherein the ligaments are under anatomical tension to connect the bones together, creating a load-bearing articulating joint, the method includes: inserting into the joint a tensioner-balancer that includes a means of controlling a distraction force; providing an electronic receiving device; moving the joint through at least a portion of its range of motion; while moving the joint, controlling the distraction force, and collecting displacement and distraction load data of the bones; processing the collected data to produce a digital geometric model of the joint, wherein the model includes: ligament displacement data along a range of flexion angles and ligament load data along a range of flexion angles; and storing the digital geometric model for further use.

A head-mounted visualization unit is proposed having an at least partially light-transmissive optical system, wherein the optical system has a first optical channel, which is assigned to a first eye of a user of the head-mounted visualization unit, and a second optical channel, which is assigned to a second eye of the user, wherein the first optical channel is substantially transmissive to optical radiation of a first polarization and substantially opaque to optical radiation of a second polarization, with the first polarization substantially being orthogonal to the second polarization, wherein the second optical channel is substantially transmissive to optical radiation of the second polarization and substantially opaque to optical radiation of the first polarization, wherein at least in the first optical channel a polarizer and a light attenuator are arranged, and wherein the light attenuator is arranged downstream of the polarizer in a direction toward the first eye of the user.

The invention relates to an automated system for performing hair restoration, which comprises automated harvest means, comprising a harvesting needle mechanism and a temporal storage means for harvested follicles; automated transplanting means, comprising a transplanting needle mechanism and a temporal storage means from which harvested follicles are extracted for transplantations; displacement means, onto which one of the automated harvest means or one of the automated transplanting means are movably connected for being displaced to desirable harvest or transplantation target points of a patient head; image acquisition means for acquiring images of a patient's scalp; mechanical support means for supporting and stabilizing the patient and particularly the patient's head during the restoration procedure; a control module, comprising suitable data processing and storage hardware and software configured to receive and process images acquired by the two or more image acquisition by image processing algorithms, map the initial patient's hair distribution, identify qualifying candidate follicles for transplantation, and finally to generate an optimized harvest and transplantation plan considering aesthetic, efficiency and safety optimization parameters. The control module is further configured to operate the at least one automated harvest means, the at least one automated transplanting means and the at least one displacement means to harvest and to transplant hair follicles in accordance with the generated optimized harvest and transplantation plan.

Methods, non-transitory computer readable media, serial monitor devices, fiducial tracking knee braces devices, and systems that facilitate generation of improved three-dimensional models from two-dimensional multi-planar images are disclosed. With this technology, correspondence of a patient's knee angle is substantially maintained across x-ray images to improve fiducial-marker-to-bone relationships within the images and facilitate improved scaling and registration of the images to generate a three-dimensional model of the knee. In particular, orientation sensor(s) attached to an improved knee brace device allows a user to substantially match the position of the knee across anterior/posterior and lateral x-ray images so that the images can be scaled and oriented more effectively, resulting in more accurate three-dimensional models and improved preoperative planning for patients.

A facilitation system for facilitating remote presentation of a physical world includes a first object and an operating environment of the first object. The facilitation system includes a processing system configured to obtain an image frame depicting the physical world, identify a depiction of the first object in the image frame, and obtain a first spatial registration registering an object model with the first object in the physical world. The object model is of the first object. The processing system is further configured to obtain an updated object model corresponding to the object model updated with a current state of the first object, and generate a hybrid frame using the image frame, the first spatial registration, and the updated object model. The hybrid frame includes the image frame with the depiction of the first object replaced by a depiction of the updated object model.