A system for visualizing an anatomical target includes an imaging device (105) configured to collect real-time images of an anatomical target. A three-dimensional model (136) is generated from pre- or intra-operative images and includes images of structures below a surface of the anatomical target not visible in the images from the scope. An image processing module (148) is configured to generate an overlay (107) registered to the real-time images and to indicate the structures below the surface and a depth of the structures below the surface. A display device (118) is configured to concurrently display the real-time images and the overlay.

A plenoptic endoscope includes a fiber bundle with a distal end configured to receive light from a target imaging region, a sensor end disposed opposite the distal end, and a plurality of fiber optic strands each extending from the distal end to the sensor end. The plenoptic endoscope also includes an image sensor coupled to the sensor end of the fiber bundle, and a plurality of microlenses disposed between the image sensor and the sensor end of the fiber bundle, the plurality of microlens elements forming an array that receives light from one or more of the plurality of fiber optic strands of the fiber bundle and directs the light onto the image sensor. The plurality of microlens elements and the image sensor together form a plenoptic camera configured to capture information about a light field emanating from the target imaging region.

Methods and apparatuses for generating and displaying a model of a subject's teeth. Described herein are intraoral scanning methods and apparatuses for generating a three-dimensional model of a subject's intraoral region (e.g., teeth). These methods and apparatuses may be used for identifying and evaluating lesions, caries and cracks in the teeth.

An endoscope system includes an endoscope that captures a living tissue in a body cavity, and an image processing unit. The endoscope includes an objective lens provided on a front side of a light receiving surface of an image sensor and configured to simultaneously form images of the living tissue, obtained through a plurality of windows, on the light receiving surface as the captured image. The image processing unit includes a three-dimensional expansion processor configured to calculate different directions of a feature part visible through the plurality of windows based on position information in each of images of the feature part, which is distinguishably identified from other parts and included in common in the plurality of images obtained through the plurality of windows in the captured image captured by the endoscope, and to expand two-dimensional information of the images of the feature part to three-dimensional information.

Systems and methods for assisting user with hearing by amplifying sound using an amplifier with gain and amplitude controls for a plurality of frequencies; and applying a learning machine to identify an aural environment and adjust the amplifiers for optimum hearing.

Surgical systems are provided. The surgical system includes an energy applying surgical instrument configured to apply energy to a natural body lumen or organ. A first scope device is configured to transmit image data of a first scene within a field of view. A second scope device is configured to transmit image data of a second scene within a field of view. A controller is configured to receive the transmitted image data of the first and second scenes and to provide a merged image of first and second scenes, where the merged image facilitates coordination of a location of energy to be applied to an inner surface of a tissue wall at a surgical site relative to an intended interaction location of a second instrument on an outer surface of the tissue wall in a subsequent procedure step at the surgical site.

In general, devices, systems, and methods for multi-source imaging are provided.

A computer-implemented system is provided that includes at least one processor that is adapted to analyze a plurality of frames from a real-time video to identify frames during which an operator is interacting with an image device to examine areas of a patient. The at least one processor is further configured to generate, from the identified frames, data representations of a first area examined by the operator interacting with the image device and further generate data representations of one or more further areas examined by the operator interacting with the image device. The at least one processor is also configured to aggregate the data representations of the first area with the data representations of the one or more further areas and determine, using the aggregated data representations, an examination quality level of the areas examined by the operator and present, on a display device during the medical procedure, a graphical representation indicating the examination quality level of the areas examined by the operator.

Systems, devices, and methods for controlling cooperative surgical instruments with variable surgical site access trajectories are provided. Various aspects of the present disclosure provide for coordinated operation of surgical instruments accessing a common surgical site from different approach and/or separate body cavities to achieve a common surgical purpose. For example, various methods, devices, and systems disclosed herein can enable the coordinated treatment of tissue by disparate minimally invasive surgical systems that approach the tissue from varying anatomical spaces and must operate differently, but in concert with one another, to effect a desired surgical treatment.

A method of displaying an area of interest within a surgical site includes modeling a patient's lungs and identifying a location of an area of interest within the model of the patient's lungs. The topography of the surface of the patient's lungs is determined using an endoscope having a first camera, a light source, and a structured light pattern source. Real-time images of the patient's lungs are displayed on a monitor and the real-time images are registered to the model of the patient's lungs using the determined topography of the patient's lungs. A marker indicative of the location of the area of interest is superimposed over the real-time images of the patient's lungs. If the marker falls outside of the field-of view of the endoscope, an arrow is superimposed over the real-time images to indicate the direction in which the marker is located relative to the field of view.