System and method for use of mixed and augmented reality Imaging surgical suite and an augmented reality device are provided. A 2D/3D virtual grid having a head-up display with augmented reality is provided. The head-up display can display a 2D radiographic image or 3D volumetric representation or shape model of image, and can further display an augmented reality grid/indicator which can be depicted as a grid, implant, instrument or bone avatar/figure representing shapes, orientations, and positions relative to an anatomical image or model. The augmented reality indicator can be displayed directly in a surgeon's field of view to provide a live, intra-operative situational environment and navigational guidance for the surgeon. The head-up display can show avatar grids/indicators that are outside of the surgeon's field of view within a patient's body.

System and method for use of mixed and augmented reality Imaging surgical suite and an augmented reality device are provided. A 2D/3D virtual grid having a head-up display with augmented reality is provided. The head-up display can display a 2D radiographic image or 3D volumetric representation or shape model of image, and can further display an augmented reality grid/indicator which can be depicted as a grid, implant, instrument or bone avatar/figure representing shapes, orientations, and positions relative to an anatomical image or model. The augmented reality indicator can be displayed directly in a surgeon's field of view to provide a live, intra-operative situational environment and navigational guidance for the surgeon. The head-up display can show avatar grids/indicators that are outside of the surgeon's field of view within a patient's body.

A head-mounted display (HMD) system includes an HMD device wearable upon a head of a user, and a peripheral device that is dockable with the HMD device. The peripheral device comprises a plurality of light source elements disposed along a perimeter of a face of the peripheral device and a peripheral electronic control system. The peripheral electronic control system is configured to form an optically detectable light pattern with the plurality of light source elements by controlling each of the light source elements. The HMD device is configured to detect the optically detectable light pattern with a camera and to display an augmented reality (AR) content based on the identified optically detectable light pattern.

System and method for use of mixed and augmented reality Imaging surgical suite and an augmented reality device are provided. A 2D/3D virtual grid having a head-up display with augmented reality is provided. The head-up display can display a 2D radiographic image or 3D volumetric representation or shape model of image, and can further display an augmented reality grid/indicator which can be depicted as a grid, implant, instrument or bone avatar/figure representing shapes, orientations, and positions relative to an anatomical image or model. The augmented reality indicator can be displayed directly in a surgeon's field of view to provide a live, intra-operative situational environment and navigational guidance for the surgeon. The head-up display can show avatar grids/indicators that are outside of the surgeon's field of view within a patient's body.