Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for determining whether content rendered on a display is actually visible to a user. In one aspect, a method includes generating and transmitting content presentation data that causes a user device to present, at a display and over a first time period, a content item that includes one or more content portions that are each designated for presentation in a respective first color. For a second time period, the respective first color of a particular content portion is changed to a second color. Visual representation data that includes a visual representation of the display during the second time period is generated and provided. Using the visual representation, an amount of the content item that was visible at the display is determined based on an amount of the particular content portion presented in the second color.

Certain aspects of the technology disclosed herein involve combining images to generate a wide view image of a surrounding environment. Images can be recorded using an stand-alone imaging device having wide angle lenses and/or normal lenses. Images from the imaging device can be combined using methods described herein. In an embodiment, a pixel correspondence between a first image and a second image can be determined, based on a corresponding overlap area associated with the first image and the second image. Corresponding pixels in the corresponding overlap area associated with the first image and the second image can be merged based on a weight assigned to each of the corresponding pixels.

A system for executing a three-dimensional (3D) intraoperative scan of a patient is disclosed. A 3D scanner controller projects the object points included onto a first image plane and the object points onto a second image plane. The 3D scanner controller determines first epipolar lines associated with the first image plane and second epipolar lines associated with the second image plane based on an epipolar plane that triangulates the object points included in the first 2D intraoperative image to the object points included in the second 2D intraoperative image. Each epipolar lines provides a depth of each object as projected onto the first image plane and the second image plane. The 3D scanner controller converts the first 2D intraoperative image and the second 2D intraoperative image to the 3D intraoperative scan of the patient based on the depth of each object point provided by each corresponding epipolar line.

A system for executing a three-dimensional (3D) intraoperative scan of a patient is disclosed. A 3D scanner controller projects the object points included onto a first image plane and the object points onto a second image plane. The 3D scanner controller determines first epipolar lines associated with the first image plane and second epipolar lines associated with the second image plane based on an epipolar plane that triangulates the object points included in the first 2D intraoperative image to the object points included in the second 2D intraoperative image. Each epipolar lines provides a depth of each object as projected onto the first image plane and the second image plane. The 3D scanner controller converts the first 2D intraoperative image and the second 2D intraoperative image to the 3D intraoperative scan of the patient based on the depth of each object point provided by each corresponding epipolar line.

An apparatus and method for successive multi-frame image denoising are herein disclosed. The apparatus includes a first subtractor including a first input to receive a frame of the image, a second input to receive a reference frame, and an output; an absolute value function block including an input connected to the output of the first subtractor and an output; a second subtractor including a first input connected to the output of the absolute value function block, a second input for receiving a first predetermined value, and an output; and a maximum value divider function block including an input connected to the output of the second subtractor and an output for outputting filter weights.

The present disclosure provides a method of medical procedure using augmented reality for superimposing a patient's medical images (e.g., CT or MRI) over a real-time camera view of the patient. Prior to the medical procedure, the patient's medical images are processed to generate a 3D model that represents a skin contour of the patient's body. The 3D model is further processed to generate a skin marker that comprises only selected portions of the 3D model. At the time of the medical procedure, 3D images of the patient's body are captured using a camera, which are then registered with the skin marker. Then, the patient's medical images can be superimposed over the real-time camera view that is presented to the person performing the medical procedure.

The present disclosure provides a method of medical procedure using augmented reality for superimposing a patient's medical images (e.g., CT or MRI) over a real-time camera view of the patient. Prior to the medical procedure, the patient's medical images are processed to generate a 3D model that represents a skin contour of the patient's body. The 3D model is further processed to generate a skin marker that comprises only selected portions of the 3D model. At the time of the medical procedure, 3D images of the patient's body are captured using a camera, which are then registered with the skin marker. Then, the patient's medical images can be superimposed over the real-time camera view that is presented to the person performing the medical procedure.

A photoacoustic image evaluation apparatus includes a processor configured to acquire a first photoacoustic image generated at a first point in time and a second photoacoustic image generated at a second point in time before the first point in time, the first and second photoacoustic images being photoacoustic images generated by detecting photoacoustic waves generated inside a subject, who has been subjected to blood vessel regeneration treatment, by emission of light into the subject; acquire a blood vessel regeneration index, which indicates a state of a blood vessel by the regeneration treatment, based on a difference between a blood vessel included in the first photoacoustic image and a blood vessel included in the second photoacoustic image; and display the blood vessel regeneration index on a display.

Systems and methods are disclosed for use in electronic guidance systems for surgical navigation. A sensor is provided with an optical sensor, to provide optical information, and a measuring sensor, to provide measurements for determining a direction of gravity. The sensor communicates optical information and measurements to an inter-operative computing unit. In an embodiment, the inter-operative computing unit receives first optical information for a registration device and a patient anatomy and a measurement to determine a direction of gravity to perform a registration step. The inter-operative computing unit receives second optical information for the patient anatomy and an object and determines and presents measurements relative to the anatomy. The measurements relative to the anatomy are determined from the second optical information, and in relation to the registration of the anatomy of the patient.

Many embodiments can comprise a system. The system can comprise a processor and a memory coupled to the processor. The memory can include instructions that, when executed by the processor, cause the processor to: determine a direction of gravity in each image of a sequence of images around an object; estimate a center of mass of the object in each image of the sequence of images using the direction of gravity and dimensions of the object; stabilize each image in the sequence of images using the center of mass; and generate a 360 degree display of the object using each image in the stabilized sequence of images. Other embodiments are disclosed herein.