Surgical kit inspection systems and methods are provided for inspecting surgical kits having parts of different types. The surgical kit inspection system comprises a vision unit including a first camera unit and a second camera unit to capture images of parts of a first type and a second type in each kit and to capture images of loose parts from each kit that are placed on a light surface. A robot supports the vision unit to move the first and second camera units relative to the parts in each surgical kit. One or more controllers obtain unique inspection instructions for each of the surgical kits to control inspection of each of the surgical kits and control movement of the robot and the vision unit accordingly to provide output indicating inspection results for each of the surgical kits.

A system for monitoring a patient in a patient area having one or more detection zones, the system comprising one or more cameras, a user interface, and a computing system configured to receive a chronological series of frames from the one or more cameras, identify liquid candidates by comparing a current frame with a plurality of previous frames of the chronological series, determine locations of the liquid candidates, identify thermal signatures of the liquid candidates, determine types of liquids of the liquid candidates based on the locations and thermal signatures of the liquid candidates, and generate an alert with the user interface corresponding to the determined types of liquids.

A spatial orientation determining system includes an imaging device configured for obtaining an image of a surgical site, a surgical tool defining a central axis, a processor, and a memory. The surgical tool configured for operating at the surgical site and disposed thereon, a fiducial marker generated by a machine learning network. The fiducial marker includes a distinct pattern. The memory, includes instructions which when executed by the processor, cause the system to: access an image from the imaging device, the image including a portion of the fiducial marker; determine a spatial positioning of the surgical tool based on at least a visible portion of the fiducial marker and the distinct pattern; and determine, based on the spatial positioning, a positioning, an orientation, and/or a rotational angle of the surgical tool.

An image recording system includes a processor. The processor acquires a time series RAW image group including a plurality of time series RAW images in a first time section. The processor extracts, from the time series RAW image group, a recording candidate RAW image group included in a second time section as a part of the first time section. The processor records at least one RAW image included in the recording candidate RAW image group as a recording target RAW image which is a RAW image to be recorded. The processor selects the recording target RAW image from the recording candidate RAW image group. The processor converts the RAW image which is not selected as the recording target RAW image from the recording candidate RAW image group or the time series RAW image group to compressed data, and records the compressed data.

An image processing apparatus includes a processor including hardware, the processor being configured to: estimate, based on image information from a medical device that includes at least an endoscope, a plurality of procedure actions of an operator of the endoscope; perform different supports respectively for procedures by the operator, according to an estimation result of the procedure actions; and output a display for the supports to a display.

Disclosed is a computer-implemented method of transmitting identification information of a medical instrument. The method encompasses comparing a digital image of an instrument tray and an instrument to a digital image of just the instrument tray to determine the identity of the instrument. A characteristic geometry such as its envelope is assigned to the instrument, and a characteristic quantity of the envelope such as its aspect ratio may be used to identify the instrument. Based on determining, from the image of the instrument and the instrument tray, the relative position between those two entities, the method determines whether the instrument has been taken from the instrument tray, and accordingly instructs a medical computing system about this determination. The medical computing system may then determine whether the correct instrument has been taken from the instrument has been taken from the instrument tray, for example by comparison with medical procedure planning data.

The present disclosure relates to a system and method for recognizing objects used in a medical procedure using a convolutional neural network. No database of image information for such objects is used or required. Rather, the neural network is trained to recognize the objects, and does not require any such image database. The system is able to reconcile the recognized objects against a ‘counted-in’ list of objects for the procedure, to ensure that all such objects are accounted for prior to closing the procedure.

The present disclosure relates to systems, devices, and methods to augment a two-dimensional image.

A surgical system includes a detector, comprising an array of pixels configured to detect light reflected by a surgical instrument and generate a first signal comprising a first dataset representative of a visible image of the surgical instrument. The surgical system also includes a processor configured to receive the first signal, generate a modified image of the surgical instrument that includes a control panel. The control panel includes one or more control elements representative of one or more operating parameters of the surgical instrument. The processor is further configured to receive an input to the control panel from a user, the input being effective to change one of the operating parameters. The processor is also configured to generate a command signal based on the input to change the one of the operating parameters.

Systems, methods, and instrumentalities are disclosed for computer vision-based surgical workflow recognition using natural language processing (NLP) techniques. Surgical video of surgical procedures may be processed and analyzed, for example, to achieve workflow recognition. Surgical phases may be determined based on the surgical video and segmented to generate an annotated video representation. The annotated video representation of the surgical video may provide information associated with the surgical procedure. For example, the annotated video representation may provide information on surgical phases, surgical events, surgical tool usage, and/or the like.