Various embodiments of the invention provide systems and methods to assist or guide an arthroscopic surgery (e.g., surgery of the shoulder, knee, hip or spine) or other surgical procedure by providing measurements intraoperatively. The systems and methods comprise steps of receiving a video stream from an arthroscopic imaging device; receiving one or more sets of coordinates of one or more points, paths, or area; calculating a length, a surface area, or a volume measurement based at least in part on the one or more sets of coordinates; overlaying the selected one or more sets of coordinates and the measurement on the video stream or on an expanded view of a region of surgery; and displaying the overlay on one or more display devices intraoperatively so as to be used by an operator during the arthroscopic procedure.

A system and method are provided for tracking magnetically-labeled substances, such as transplanted cells, in subjects using magnetic resonance imaging (MRI). The method includes obtaining a quantity of a substance that comprises an MRI contrast compound or is otherwise magnetically-labeled for purposes of an MRI scan, administering the substance into a region of interest of a subject, performing an imaging scan of a portion of the subject comprising the region of interest, obtaining an imaging data set from the scan, reducing the dataset into pixel groupings based on intensity profiles, where the pixel groupings have a pixel size larger than the expected pixel size of a unit of the MRI contrast compound or magnetically-labeled substance, extracting candidate pixel matrices from the imaging data, training a machine learning (ML) module by using the candidate pixel matrices, quantifying the presence, number and/or location of units of the substance within the subject by using the ML module, and displaying a visual representation of an identification of the substances within the subject as a result of using the ML module.

Adaptive imaging methods and systems for generating enhanced low light video of an object for medical visualization are disclosed and include acquiring, with an image acquisition assembly, a sequence of reference frames and/or a sequence of low light video frames depicting the object, assessing relative movement between the image acquisition assembly and the object based on at least a portion of the acquired sequence of reference video frames or the acquired sequence of low light video frames, adjusting a level of image processing of the low light video frames based at least in part on the relative movement between the image acquisition assembly and the object, and generating a characteristic low light video output from a quantity of the low light video frames, wherein the quantity of the low light video frames is based on the adjusted level of image processing of the low light video frames.

Data derivable from remotely detected electromagnetic radiation (16) emitted or reflected by a subject (12) is processed. The data includes physiological information. An input signal is received and indicative entities are transmitted. The indicative entities being indicative of physiological information representative of at least one vital parameter (17; 150) in a subject (12) of interest, wherein the indicative entities are detected under consideration of at least one defined descriptive model (114) describing a relation between physical skin appearance characteristics and a corresponding representation in the input signal such that non-indicative side information represented by non-indicative entities in the input signal is substantially undetectable in a resulting transmitted signal. The at least one vital parameter (17; 150) is detected from the transmitted signal including the indicative entities. The at least one vital parameter (17; 150) is extracted under consideration of detected skin color properties representing circulatory activity.

An opto-mechanical system for operation with a container containing a fluid to be administered in an eye or a container such as a syringe for example to administer an insulin injection. The mount of the system is equipped with an optical system and a processing/recording means configured to receive optical data, from light (visual or infra-red) reflected by an area in the vicinity of the eye, which data represents temporal and spatial characteristics of a process of administering drops of the fluid from the container into the eye. Image analysis software or human observation may be used to analyze the recorded images.

A system, method, and apparatus for displaying a fused reconstructed image with a multidimensional image are disclosed. An example imaging system receives a selection corresponding to a portion of a displayed multidimensional visualization of a surgical site. At the selected portion of the multidimensional visualization, the imaging system displays a portion of a three-dimensional image which corresponds to the selected multidimensional visualization such that the displayed portion of the at least one of the three-dimensional image or model is fused with the displayed multidimensional visualization.

Systems and methods utilize an infrared probe and discriminating software to rapidly discriminate normal tissue processes from normal tissue during surgery, physical examination of in-situ lesions, and in the assessment of biopsy and resected tissue specimens. Examples demonstrate discrimination of cancerous from noncancerous tissues. The discriminating software, i.e. the metrics, algorithms, calibrant spectra, and decision equations, allows tissue to be identified as abnormal or normal using a minimum of infrared (IR) wavelengths in order to be measured rapidly. The probe records IR metrics approximately 1000 times faster than current commercial instruments, i.e. on a timescale fast enough for clinical use. The probe uses a tunable mid-infrared laser with a small set of selected wavelengths that are optimized for detecting the chemical and molecular signatures of tissue specific lesions to include, but not limited to, cancer, preneoplasia, intracellular accumulations (e.g. steatosis), inflammation, and wound healing.

There is provided a method for use in determining whether a subject is allergic to a substance. The method comprises: receiving a first set of spatially distributed light intensity values covering a skin region of the subject including a location at which the substance has been applied; wherein the light intensity values in the first set are intensities of visible light; receiving a second set of spatially distributed light intensity values covering the skin region, wherein the light intensity values in the second set are intensities of infrared, IR, light; generating a first spatial distribution of photoplethysmogram, PPG, pulse amplitudes based on the first set of light intensity values; generating a second spatial distribution of PPG pulse amplitudes based on the second set of light intensity values; comparing the first spatial distribution to the second spatial distribution, and to the location at which the substance has been applied; and outputting an indication of whether the subject is experiencing an allergic reaction to the substance based on the comparing.

Autoregressive modelling is used to identify periodic physiological signals such as heart rate or breathing rate in an image of a subject. The colour channels of a video signal are windowed and normalised by dividing each signal by its mean. The ratios of the normalised channels to each other are found and principal component analyses conducted on the ratio signals. The most periodic of the principal components is selected and autoregressive models of one or more different orders are fitted to the selected component. Poles of the fitted autoregressive models of different orders are taken and pure sinusoids corresponding to the frequency of each pole are generated and their cross-correlation with the original component is found. Whichever pole corresponds to the sinusoid with the maximum cross-correlation is selected as the best estimate of the frequency of periodic physiological information in the original video signal. The method may be used in a patient monitor or in a webcam-enabled device such as a tablet computer or smart phone.

Described is an assistance device for providing imaging support to an operating surgeon during a surgical procedure involving at least one medical instrument. The assistance device comprises a camera, a display unit, a manipulator coupled to the camera, a manipulator controller and an image processing unit. The image processing unit includes an instrument detection module for detecting at least one target structure that represents the instrument being used in the frame in question by identifying a predetermined distinguishing feature, and for extracting position information that indicates the position of the target structure in the frame. The instrument detection module identifies an image segment as the predetermined distinguishing feature, said image segment being characterized by a color saturation that is equal to or less than a predefined color saturation and by a contour line that delimits the image segment and has at least one rectilinear section.