Medical procedure monitoring system
09788799 · 2017-10-17
Assignee
Inventors
- David W. Wagner (New York, NY, US)
- Marco Zenati (Belmont, MA, US)
- J. C. Flaherty (Auburndale, FL, US)
- R. M. Flaherty (Auburndale, FL, US)
- Jason Maron (Allston, MA, US)
Cpc classification
A61B5/7282
HUMAN NECESSITIES
G16H20/40
PHYSICS
A61B90/50
HUMAN NECESSITIES
A61B2017/00207
HUMAN NECESSITIES
A61B90/90
HUMAN NECESSITIES
G16H40/20
PHYSICS
H04R2201/107
ELECTRICITY
A61B5/7278
HUMAN NECESSITIES
A61B5/746
HUMAN NECESSITIES
International classification
A61B5/00
HUMAN NECESSITIES
A61B90/00
HUMAN NECESSITIES
A61B90/90
HUMAN NECESSITIES
Abstract
A system and method for monitoring a medical procedure performed in a clinical environment is provided. An audio recorder is configured to produce a verbal data signal that is representative of a verbal communication occurring in the clinical environment, and a data analyzer is configured to detect an adverse condition based upon the verbal data signal. An alert module is configured to alert an operator upon the detection of an adverse condition.
Claims
1. A system for monitoring a medical procedure performed in a clinical environment comprising: an input module for receiving a checklist comprising a proper protocol for the medical procedure and adapted to be customized by an operator; an audio receiver constructed and arranged to produce a verbal data signal representative of verbal communication that occurs in the clinical environment; a data analyzer constructed and arranged to (i) receive the verbal data signal from the audio receiver, (ii) analyze the verbal data signal to determine real-time events, (iii) compare the real-time events to the checklist, and (iv) detect at least one adverse condition when a real-time event falls outside of the proper protocol; and an alert module constructed and arranged to alert at least one operator when the at least one adverse condition is detected by the data analyzer.
2. The system of claim 1 wherein the medical procedure comprises at least one of: a surgical procedure; a minimally invasive surgical procedure; a laparoscopic surgical procedure; an open surgical procedure; an interventional procedure; a reconstructive surgery; a robotic procedure; a robotically-enabled procedure; an outpatient procedure; a dental procedures; a fully anesthetized dental procedure; and combinations thereof.
3. The system of claim 1 wherein the clinical environment comprises at least one of: an operating room; a catheterization lab; an intensive care unit; a control room for an operating room; an outpatient surgery treatment room; a dentist's office; a surgeon's office; a maxillofacial surgeon's office; and combinations thereof.
4. The system of claim 1 wherein the audio receiver comprises at least one microphone.
5. The system of claim 1 wherein the audio receiver comprises multiple microphones.
6. The system of claim 5 wherein the multiple microphones are in proximity to the at least one operator.
7. The system of claim 5 wherein the multiple microphones comprise a first microphone positioned in proximity to a first operator and a second microphone in proximity to a second operator.
8. The system of claim 1 wherein the audio receiver comprises at least one of: a microphone; an operator-worn microphone; an operator-worn headset; a room microphone; an omnidirectional microphone; a Bluetooth device; a telephone; a mobile telephone; a wireless device; and combinations thereof.
9. The system of claim 1 wherein the audio receiver comprises an operator-worn headset.
10. The system of claim 9 wherein each operator of the at least one operator wears a headset.
11. The system of claim 10 wherein each headset comprises an identifier associated with a respective operator.
12. The system of claim 1 wherein the audio receiver comprises an intercom system.
13. The system of claim 1 wherein the audio receiver is further constructed and arranged to produce a non-verbal data signal.
14. The system of claim 13 wherein the non-verbal data signal comprises audio signals produced by equipment positioned in the clinical environment.
15. The system of claim 14 wherein the data analyzer is further constructed and arranged to receive the non-verbal data signal from the audio receiver, analyze the non-verbal data signal and detect an equipment status signal.
16. The system of claim 15 wherein the equipment status signal comprises an equipment warning signal.
17. The system of claim 1 further comprising a video camera constructed and arranged to produce a video data signal.
18. The system of claim 17 wherein the data analyzer is further constructed and arranged to receive the video data signal from the video camera and analyze the video data signal.
19. The system of claim 18 wherein the data analyzer is further constructed and arranged to detect an operator gesture.
20. A method for monitoring a medical procedure performed in a clinical environment comprising: receiving at an input module a checklist comprising a proper protocol for the medical procedure and adapted to be customized by an operator; producing using an audio receiver a verbal data signal representative of verbal communication that occurs in the clinical environment; analyzing the verbal data signal with a data analyzer to determine real-time events; comparing the real-time events to the checklist using the data analyzer; detecting with the data analyzer at least one adverse condition when a real-time event falls outside of the proper protocol; and alerting at least one operator with an alert module when the at least one adverse condition is detected.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1)
(2)
(3)
(4)
DETAILED DESCRIPTION OF THE DRAWINGS
(5) Reference will now be made in detail to the present embodiments of the technology, examples of which are illustrated in the accompanying drawings. The same reference numbers are used throughout the drawings to refer to the same or like parts.
(6) The systems, devices and methods disclosed herein are configured to detect and analyze a wide array of adverse events occurring during a medical procedure such as communication breakdown, fatigue, inappropriate staffing, interruptions and inappropriate protocol. Further, the medical team can be alerted of such adverse events, thus improving the outcome for both the patient and the medical team.
(7) The term “operator” shall refer to one or more individuals, singly or in combination, who provide input data and/or receive output data from the system of the present inventive concepts. Operators can include but are not limited to: surgeons; surgeons' assistants; nurses; health care providers; insurance providers; patients; and combinations of these.
(8)
(9) System 10 may be utilized during various types of medical procedures. For example, system 10 may be used during a surgical procedure, such as a minimally invasive surgical procedure, a laparoscopic surgical procedure and an open surgical procedure. Alternatively or additionally, system 10 may be used during an interventional medical procedure. Applicable medical procedures can include but are not limited to: reconstructive surgery; concomitant surgery; a robotic or robotically-enabled procedure; an outpatient procedure; a dental procedure such as a fully anesthetized dental procedure; and combinations of these.
(10) System 10 may be used in various clinical environments, such as a clinical setting selected from the group consisting of: an operating room; a catheterization lab; an intensive care unit; a control room for an operating room; an outpatient surgery treatment room; a dentist's office; a surgeon's office such as a maxillofacial surgeon's office; and combinations of these.
(11) System 10 may be configured to interface with one or more operators. An operator can be any member of the hospital staff, for example a surgeon; an anesthesiologist; a scrub nurse; a circulating nurse; and a hospital administrator. In some embodiments, the patient is an operator of the system such as when a spoken word of the patient is recorded by audio recorder 115 and/or another component of input module 110 and analyzed from data analyzer 120.
(12) In some embodiments, an operator, for example a primary user such as a surgeon, can enter data into input module 110, such as via audio recorder 115 and/or non-audio recorder 116, at any time prior to, during and/or subsequent to a medical procedure performed on a patient. Audio recorder 115 can include one or more audio recording devices selected from the group consisting of: a microphone; an operator-worn microphone or headset (wireless or with cable); a room microphone; an omnidirectional microphone; a Bluetooth device; a wireless device; a telephone; a mobile telephone; and combinations of these. Non-audio recorder 116 can include one or more devices selected from the group consisting of: a keyboard; a touch screen; a motion-sensing input device; a mouse; a tablet; a cell phone; a handheld electronic organizer; a hospital computer or computer network; a wireless connection such as a cellular service; an internet connection; an electronic file transfer port such as USB port; a memory storage device such as a USB memory stick; and combinations of these. An application can be stored in one or more modules of system 10 enabling an operator to select a particular type and/or form of information to be communicated by system 10 to one or more operators. In some embodiments, an operator selects one or more patient and/or procedural parameters to be communicated and recorded by system 10, such as a communication made by an operator and/or produced by output module 130. Additionally, an operator can customize which particular operator should report the information and how frequently it should be reported by an operator and/or output module 130. Further, the customization can include to whom the information should be reported. For example, an operator can identify a particular operator that should report (e.g. verbally state) the patient's blood pressure. In some embodiments, the frequency of reporting can be included, such as reporting needing to occur at least every five minutes. In some embodiments, an operator can identify a particular adverse condition that should be monitored for by data analyzer 120. In some embodiments, an operator can enter quantitative data into input module 110, such as a quantitative value for a threshold, where data analyzer 120 includes an algorithm configured to compare the threshold to a verbal data signal. In some embodiments an operator can enter a library of keywords associated with a parameter, such as a patient and/or procedural parameter that may be requested during a medical procedure (e.g. “blood pressure”, “ACT level”, “EKG status”, and the like) Input module 110 may be configured to receive a library of keywords associated with one or more particular adverse conditions, and data analyzer 120 configured to identify these keywords. Non-limiting examples of non-technical keywords include: “help”; “code”; “tanking”; “slipping”; “falling”; “burning”; “lethal”; “fatal”; “overdose”; “pale”; “hot”; “cold”; “unstable”. Non-limiting examples of technical keywords include: “hyperthermic”; “hypothermic”; “hypoxic”; “hyperoxic”; “hypocapnic”; “hypercapnic”; “asystole”; “tachycardia”; “bradycardia”; “fibrillating”; “a-fib”; “v-fib”; “hypoglycemic”; “hyperglycemic”; “long-QT”; and combinations of these.
(13) In some embodiments, system 10 can be configured such that audio recorder 115 receives voice data, e.g. at least one spoken word, from each operator of system 10. This voice data can be used by data analyzer 120 to identify a particular operator's voice based on the stored word or words.
(14) System 10 can be configured to allow an operator to import, record or otherwise enter various forms of data via input module 110, such as via non-audio recorder 116. Data may include non-patient data, hereinafter “external data”, which can include medical treatises, medical statistics, or any other medical information that is publicly or privately available. External data to be included can be selected and/or filtered by an operator of system 10. For example, an operator can enter and/or filter external information that is particularly relevant to the procedure to be performed or relevant to the particular patient's medical history and/or the patient's current medical status. Alternatively, entire treatises, books, or other medical sources can be entered into system 10 via input module 110.
(15) System 10 can be configured to allow an operator to import, record or otherwise enter patient data via input module 110, such as patient data collected prior to the medical procedure being performed. Patient data can include but is not limited to: sex; age; height; weight; race; medical history; and combinations of these.
(16) Data entered into input module 110 can be entered prior to, during and/or subsequent to a medical procedure such as surgery. The data entered can be updated, deleted, or otherwise modified at any time prior to, during and/or subsequent to the procedure by one or more of the operators, such as by an authorized or otherwise pre-determined operator. In some embodiments, system 10 may be configured to permit a limited number or subset of operators to enter, update, delete, or otherwise modify one or more sets of data entered into and/or contained within system 10.
(17) In some embodiments, system 10 can communicate with a healthcare information system, for example input module 110 can receive information from the healthcare information system such as information relevant to the particular patient and/or procedure to be performed, for example patient or non-patient clinical, historic data. Such information includes but is not limited to: pre-operative risk calculations for surgical morbidities; intraoperative risk calculations for surgical morbidities; success rate of sub-procedures given health record; and combinations of these.
(18) System 10 includes audio recorder 115 configured to record a verbal communication and produce a verbal data signal that is representative of the verbal communication. The verbal communication can be a communication occurring prior to, during, and/or subsequent to a medical procedure. For example, a verbal communication occurring prior to a procedure can include input data being entered into input module 110 via audio recorder 115. A verbal communication occurring during a procedure can include but is not limited to: a notification of a patient, procedural and/or equipment parameter; a request for data; an acknowledgment of received data; and combinations of these.
(19) Audio recorder 115 can include at least one microphone, and in some cases, audio recorder 115 includes multiple microphones. In some embodiments, a microphone can be in proximity to each operator, for example, a first microphone can be positioned in proximity to a first operator, and a second microphone can be positioned in proximity to a second operator.
(20) In some embodiments, audio recorder 115 includes a headset worn by each operator. The system can receive and/or transmit audio to each operator wearing a headset, or the system can receive and/or transmit audio to a particular operator. In some embodiments, each headset comprises a unique identifier associated with each operator such that data analyzer 120 can correlate a verbal data signal to a specific operator, for example an identifier such as a SIM card. Alternatively or additionally, audio recorder 115 can include an intercom system such that all operators can receive and/or transmit audio simultaneously. In some embodiments, audio recorder 115 can be configured such that only a particular operator's verbal communications is transmitted to the remaining operators present in the clinical environment while the remaining operators are muted, for example in a case where the particular operator is the lead surgeon and he or she desires to communicate data to all other operators present in the clinical environment.
(21) Alternatively or additionally, audio recorder 115 and/or non-audio recorder 116 can include a video camera configured to produce a video data signal. The video camera can detect an operator gesture, for example a gesture including but not limited to a head nod or other affirmatory response; a head shake or other non-affirmatory response; a shrug; an indecisive response; and combinations of these. The video camera can also detect the speech of an operator. The gestures and/or speech are converted to a video data signal such that the video data signal can be analyzed by data analyzer 120, such as to detect an adverse condition. In some embodiments, input module 110 comprises a video camera and at least one microphone such that data analyzer 120 combines a verbal data signal with the video data signal and analyzes the combined signal. In cases where the verbal data is not heard, data analyzer 120 can analyze the video data signal to detect an adverse condition. Conversely, if the video data is not seen, data analyzer 120 can analyze the verbal data signal to detect an adverse event.
(22) A verbal data signal can be representative of a verbal communication received from a single operator and/or multiple operators. In the case of multiple operators, system 10 is configured to differentiate verbal data signals from a first operator and verbal data signals from a second operator. The verbal data signal can be representative of verbal communication occurring prior to, during, and/or after the medial procedure.
(23) In some embodiments, system 10 is configured to produce non-verbal data signals. In some embodiments, the non-verbal data signal can include an audio signal produced by a piece of equipment located in the clinical environment in the form of an equipment status signal. For example, if a piece of equipment requires maintenance, an operator can be alerted to the condition via an equipment warning signal.
(24) System 10 can further comprise a memory storage device, memory module 150, which is configured to store data, such as data entered into input module 110 and/or produced by data analyzer 120. In some embodiments, at least a portion of the verbal data signals and/or video data signals that are received and/or processed (i.e. analyzed by data analyzer 120) as well as the verbal communications and gestures captured by audio recorder 115, can be stored in the memory module. System 10 can include a method of replaying audio, video and/or other recordings, such as via output module 130.
(25) System 10 includes data analyzer 120 configured to receive a verbal data signal from audio recorder 110, analyze the verbal data signal, and detect at least one adverse condition. Data analyzer 120 includes various electronic and other componentry, such as componentry selected from the group consisting of: microprocessor; microcontroller; analog to digital converter; digital to analog converter; and combinations of these. Data analyzer 120 can include spoken word recognition software employing at least one algorithm that converts the verbal data signal to text data. In some embodiments, the algorithm can be biased to correlate at least a portion of the verbal data signal to one or more medical terms. System 10 can further comprise a library of medical terms, such as a library of medical terms stored in memory module 150 where the algorithm's bias is based on the library of medical terms. The library of medical terms can be imported via input module 110, such as data input to system 10 by an operator and/or an external data source. The external data source can include medical treatises, medical statistics, or any other medical information that is publicly or privately available.
(26) Data analyzer 120 can include an algorithm configured to extract the patient historic data stored in the memory module from the verbal data signal. In some embodiments, data analyzer 120 can include an algorithm that is biased to correlate at least a portion of the verbal data signal to at least one quantitative value input by a primary user. The algorithm can be biased to a range of values. In one example, the range of values can include values that are typically associated with a particular parameter, so for instance, if a blood pressure reading typically ranges within 100/60 to 120/80, for patients in general and/or for a particular patient, and data analyzer 120 correlates the received verbal data signal to both the value 115/75 and the value 300/75, data analyzer 120 can record the value of 115/75 due to the bias in the algorithm toward the range 100/60 to 120/80. In some embodiments, the algorithm can be biased toward a previously received verbal data signal such as the last received verbal data signal. For example, if the last received verbal data signal includes a blood pressure reading of 115/75, and data analyzer 120 correlates the currently received verbal data signal to both the value 115/75 and the value of 300/75, data analyzer 120 can record the value of 115/75 due to a bias toward the value's proximity to the previously recorded value of 115/75.
(27) Data analyzer 120 can identify and analyze verbal data signals recorded by input module 110. The verbal data signal can include patient data, such as data including but not limited to: ACT; blood pressure; heart rate; pulse rate; respiratory rate; glucose levels; saturated O.sub.2 pressure; saturated CO.sub.2 pressure; core body temperature; skin temperature; total lung capacity; residual volume; expiratory reserve volume; vital capacity; tidal volume; alveolar gas volume; actual lung volume; EEG bands such as Delta, Theta, Alpha, Beta, Gamma and Mu; EKG information such as RR interval, P wave length/amplitude, PR interval, amplitude of QRS complex, J-point detection, absolute and relative refractory periods, QT interval, and U & J Wave detection; blood volume; extra embolic gases; heparin volume; protamine sulfate volume; and combinations of these. Recorded data may be associated not only with a parameter level but a recording time. For example, the verbal communication “blood pressure is 150 over 90” can be identified by data analyzer 120 as ‘blood pressure=150/90 @ time’. If an operator, such as the patient's primary caregiver (e.g. the surgeon), has specified that this parameter should be communicated by an operator associated with the verbal communication, then when that operator states the proper information, the stated value can be logged into memory module 150 with a time stamp.
(28) Data analyzer 120 can identify verbal data signals including equipment data such as data including but not limited to: instructions to turn a piece of equipment on or off; instructions to modify the settings of one or more pieces of equipment; and combinations of these. Data analyzer 120 can identify non-verbal data signals including equipment data, such as audio data recorded from a piece of equipment (e.g. audio data recorded by a microphone of audio recorder 115), visual data recorded from a piece of equipment (e.g. visual data recorded by a camera of non-audio recorder 116), or electronic data output by a piece of equipment (e.g. via a wired or wireless communication between a piece of equipment and non-audio recorder 116).
(29) Data analyzer 120 can identify verbal data signals including procedural data, such as procedural data selected from the group consisting of: total procedural length; length of a procedural step; time of initiation of a procedural step; time since last administration of a drug or other agent (e.g. time since infusion of heparin, protamine sulfate and/or cardioplegia); and combinations of these. Procedural steps include but are not limited to: patient preparation; anesthesia induction; opening/sternotomy; initiation of bypass; cardiac repair; termination of bypass; closure; post-op; anesthesia; insufflation; laparoscopic insertion such as laparoscopic insertion prior to a cholecystectomy; diagnosis confirmation; port incisions; removing bile; grasping a structure such as a gallbladder; isolating and dividing structures; separation of a first structure from a second structure such as a gallbladder from a liver; removal of a structure such as a gallbladder; irrigation such as abdominal wall irrigation; prostatectomy such as a robotic prostatectomy; docking of a robot; dissection such as SV dissection; hemostasis; completion of anastamosis; removal of drapes; and combinations of these.
(30) Data analyzer 120 can identify a request for data from an operator recorded by audio recorder 115. Data requests can in a request for data selected from the group consisting of: a patient parameter; a procedural parameter; an equipment parameter; external data; patient historic data; and combinations of these. System 10 can be configured to respond to an operator's request quantitatively and/or qualitatively via output module 130. For example, an operator, e.g. the primary surgeon, can request the patient's blood pressure during a procedure, and system 10 will retrieve the patient parameter from the memory module and deliver the requested value to the operator, for example via an operator-worn headset or a visual display.
(31) Data analyzer 120 can be configured to identify and/or require an acknowledgment of receipt of data. When a value is delivered to an operator, either pursuant to an impromptu request or the customized cadence input into input module 110, data analyzer 120 can identify the acknowledgement of receipt of the data based on a library of acceptable responses. For example, prior to a procedure being performed on a patient, a library of acceptable acknowledgement responses can be entered into input module 110, including but not limited to responses such as, “yeah”, “yes”, “okay”, “gotcha”, “thanks”, and the like.
(32) Data analyzer 120 can correlate the verbal data signal to a particular operator, for example using voice data entered into input module 110 prior to the procedure. In some embodiments, data analyzer 120 comprises an algorithm where the algorithm performs a first analysis on a verbal data signal correlated to a first operator and a second, different analysis on a verbal data signal correlated to a second operator. In some embodiments, data analyzer 120 correlates the verbal data signal of the first operator based on a first identifier and correlates the verbal data signal of the second operator based on a second, different identifier, for example where a headset worn by the first and second operators includes the identifier, such as an embedded electronic ID. In one example, the identifier can include a SIM card included in each headset worn by the first and second operator. These embodiments can apply to a clinical environment including one or multiple operators. Additionally, data analyzer 120 can correlate the verbal data signal to a particular operator type, each type comprising one or more operators of system 10. Operator types can include but are not limited to: a surgeon; an anesthesiologist; a scrub nurse; a circulating nurse; a hospital administrator; a patient; and combinations of these. Data analyzer 120 can employ an algorithm that determines an adverse condition has occurred based on the particular operator and/or operator type providing data via audio recorder 115 and/or another component of input module 110.
(33) Data analyzer 120 can be configured to filter and/or segregate verbal data signals that are received by an operator. The verbal data signals can be filtered based on operator hierarchy and/or the importance of a particular value based on data entered into input module 110 prior to or during the procedure. For example, if a surgeon operator customizes system 10 such that a nurse or anesthesiologist operator should recite blood pressure readings every five minutes, data analyzer 120 can filter the nurse's speech based upon the value it is seeking, i.e. identify the nurse's recitation of blood pressure readings every five minutes. In instances where a desired reading is not identified in the predetermined time period (e.g. five minutes), system 10 can be configured to request the information, such as via output module 130.
(34) Data analyzer 120 analyzes the verbal data signal recorded by audio recorder 115 to detect at least one adverse condition. In some embodiments, the verbal data signal is analyzed and/or compared to additional data entered into input module 110, as discussed above, such as data stored in memory module 150. In some embodiments, the adverse condition can be detected based on an analysis of the verbal data signal whose output exceeds a threshold. For example, if an operator entered a maximum acceptable value for the patient's blood pressure into input module 110, the data analyzer 120 will detect an adverse condition if the maximum acceptable value is exceeded.
(35) In some embodiments, the adverse condition can be detected based on the identification of a keyword in the verbal data signal. In some embodiments, the adverse condition can be detected based on the identification of an unrecognized term or value in the verbal data signal. In some embodiments, the adverse condition can be detected based on the identification of an unrecognized or inaudible voice in the verbal data signal. In some embodiments, the adverse condition can be detected based on a determination that a particular operator has been active and/or present in the clinical environment past a threshold of time. For example, when an operator is the surgeon, data analyzer 120 can determine that the surgeon has been performing a complex procedure for a length of time that has been previously determined to exceed a safety threshold. The length of an operator's presence can be determined by data analyzer 120 receiving a verbal data signal and/or a video data signal from the particular operator, thus associating the receipt of the signal with the operator's presence. Additionally or alternatively, the operator's presence can be determined automatically, for example by a motion sensor, or manually, for example by a timecard entry assembly.
(36) In some embodiments, the adverse condition can be detected based on the heightened frequency of recognized terms at a time other than that customized by the operator. In some embodiments, the adverse condition can be detected based on the non-receipt of information such as when an identified operator does not provide a particular piece of information at the proper time. In some embodiments, the adverse condition can be detected based on a determination that multiple pieces of similar data have not been received within a pre-determined time interval where the time interval can be an operator adjustable time interval that can be adjusted prior to and/or during a procedure. In some embodiments, the adverse condition can be detected based on a determination that a particular operator is not present. In some embodiments, the adverse condition can be detected based on an analysis of patient historic data and/or based on an analysis of a set of medical statistics such as a comparison of patient historic data to a set of medical statistics. In some embodiments, an adverse condition can be detected based on the identification of the patient's voice and/or gestures. For example, if the patient is no longer fully anesthetized and is able to speak and/or move, the data analyzer 120 can identify the patient's speech. In some embodiments, a library of evidence-based practices, for example a proper protocol or set of standards for a particular type of medical procedure can be entered into input module 110 prior to or during a procedure, where the real-time events occurring during the procedure can be recorded and compared and/or analyzed according to the evidence based information. An adverse event can be detected by data analyzer 120 when an event is detected that falls outside of the proper protocol or acceptable set of standards.
(37) Output module 130 can include alert module 135 configured to alert at least one operator upon the detection of at least one adverse condition by data analyzer 120. Alert module 135 can alert one or all operators in the clinical environment, and any number of operators in between. In some embodiments, alert module 135 can be configured to alert a specific operator based on a unique identifier, for example an identifier included in that specific operator's headset, as discussed hereabove. In one embodiment, alert module 135 can include an audio transducer configured to produce an audible beep when an adverse condition is detected. The audible beep can include a first audible pattern associated with a first adverse condition, and a second, different audible pattern associated with a second, different adverse condition. In addition or alternative to an audible beep, the audio transducer can produce voice alert such as a computer generated voice or a recording of a human voice. Additionally or alternatively, alert module 135 can include a visual display, for example a visual display that provides alphanumeric text and/or graphic images when an adverse condition is detected. Additionally or alternatively, alert module 135 can include a tactile transducer such as an operator-worn tactile transducer and/or a vibrating transducer. Non-limiting examples of additional or alternative alert modules include: an audio transducer such as speaker and a piezo transducer; a visual transducer such as an LCD screen, a touch screen, and a light such as an LED; and a tactile transducer such as a vibrating transducer and a thermal transducer.
(38) In addition to alert module 135, output module 130 may include numerous output components, such as to provide both alert and non-alert information to an operator of system 10. Output module 130 can be configured to provide an analysis of information to one or more operators such as patient and/or procedural information in real-time, i.e. during a procedure, or after completion of a procedure. In some embodiments, the information provided by output module 130 is information requested by at least one operator, for example information after the completion of a procedure in order to evaluate the overall performance of the operators as well as the relationship between team behavior and real-time changes in patient status. Additionally, a full audio transcript of the entire procedure can be provided and/or for each individual operator. Other types of information can be provided such as information selected from the group consisting of: a current (real-time) parameter; a historic parameter; an average of multiple parameter values; a maximum of multiple parameter values; and combinations of these. Other information can include one or more of: one or more adverse conditions detected; an operator's entry and/or exit time into the clinical setting; a procedure event that surpasses a threshold; an evidence-based decision support reminder; a captured video; a recommendation generated by the data analyzer; and combinations of these. The information can be provided to at least one operator or all operators in the form of a generated report, for example a hard copy and/or an electronic report. In some cases, system 10 can refer to a library of evidence-based practices, for example a library of data entered into input module 110, and system 10 can perform a quantitative or qualitative calculation related to clinical approach efficacy, appropriateness and/or timeliness. The report can then be transferred to a healthcare information system. Additionally, output module 130 can create a post-operative debrief in the form of an interactive montage of critical events, for example an output including procedure video, audio, transcripts of audio, patient vital signs during the procedure, corresponding pre-operative thresholds/scores, any relevant medical imaging, and any other desired information.
(39) Data analyzer 120 can further include a data monitoring algorithm that confirms proper information is received by audio recorder 115, non-audio recorder 116, sensor 117, and/or data analyzer 120. Additionally, the data monitoring algorithm can confirm that proper information is received within one or more predetermined time intervals. The lack of receipt of information can lead to detection of an adverse event by data analyzer 120, such as has been described hereabove.
(40) In addition to audio recorder 115 and non-audio recorder 116, input module 110 may include at least one sensor 117. Sensor 117 can comprise a sensor selected from the group consisting of: a temperature sensor; an acoustic sensor; an electromagnetic sensor; a pressure sensor; a motion sensor; and combinations of these. Output of these sensors may be included in one or more analyses of data analyzer 120, such as to determine if an adverse event has occurred or to produce other calculated data.
(41) System 10 can further comprise a treatment device, such as treatment device 200 as shown in
(42) Alert module 135 and other components of output module 130 can include numerous forms of user output components, such as components selected from the group consisting of: visual display such as an alphanumeric color display monitor; touchscreen display; indicator light such as an LED; audio transducer such as a speaker or piezo alert; tactile transducer such as an operator-worn assembly configured to vibrate on demand; USB port; wireless transmitter; internet connection; and combinations of these.
(43) System 10 can further comprise a checklist. In some embodiments, data analyzer 120 can detect an adverse condition based upon an analysis of the checklist. The checklist can include a pre-operative, intra-operative, and/or a post-operative checklist that can be automatically and/or manually initiated. The checklist can comprise at least a portion that can be customized, such as a customization associated with one or more operators of system 10. The customization can be performed at any time, such as a time just prior to the performance of a medical procedure using system 10.
(44)
(45) The method may be performed during various types of medical procedures and may be performed in various clinical environments as described hereabove.
(46) In STEP 200, the system is configured. Configuring the system can include entering data into an input module, for example, data entered into input module 110 as described in reference to
(47) The data input module can include one or more devices selected from the group consisting of: a keyboard; a touch screen; a motion-sensing input device; a mouse; a tablet; a cell phone; a handheld electronic organizer; a hospital computer or computer network; a wireless connection such as a cellular service; an internet connection; an electronic file transfer port such as USB port; a memory storage device such as a USB memory stick; and combinations of these. An application can be stored in one or more modules of the system enabling an operator to select a particular type and/or form of information to be communicated by the system to one or more operators. In some embodiments, an operator selects one or more patient and/or procedural parameters to be communicated and recorded by the system. Additionally, an operator can customize which particular operator should report the information and how frequently it should be reported by an operator and/or an output module such as output module 130 of
(48) Voice data can be entered into the input module, e.g. at least one spoken word, from each operator to be present during the medical procedure such that the data analyzer can identify an operator's voice based on the stored word or words.
(49) External data which can include medical treatises, medical statistics, or any other medical information that is publicly or privately available can also be entered into the input module. The external data can be selected and/or filtered by an operator. For example, the operator can enter external information that is particularly relevant to the procedure to be performed or relevant to the particular patient's medical history and/or current medical status. Alternatively, entire treatises, books, or other medical sources can be entered into the input module.
(50) Patient data, such as data including but not limited to, sex; age; height; weight; race; medical history; and combinations of these can also be entered into the input module.
(51) In STEP 210, audio is recorded, for example via audio recorder 115 of
(52) Alternatively or additionally, video data can be recorded, for example via a video camera that can detect an operator gesture, for example a gesture including but not limited to a head nod or other affirmatory response; a head shake or other non-affirmatory response; a shrug; an indecisive response; and combinations of these. The video camera can also detect the speech of an operator. The gestures and/or speech are converted to a video data signal such that the video data signal can be analyzed by the data analyzer to detect an adverse condition. In some embodiments, an input module comprises a video camera and at least one microphone such that the data analyzer combines the verbal data signal with the video data signal and analyzes the combined signal. In cases where the verbal data is not heard, the data analyzer can analyze the video data signal to detect an adverse condition. Conversely, if the video data is not seen, the data analyzer can analyze the verbal data signal to detect an adverse event.
(53) The recorded signals can be representative of a verbal communication received from a single operator and/or multiple operators. In the case of multiple operators, the system is configured to differentiate verbal data signals from a first operator and verbal data signals from a second operator. The verbal data signal can be representative of verbal communication occurring prior to, during, and/or after the medial procedure.
(54) In some embodiments, non-verbal data signals are produced such as audio signals produced by a piece of equipment located in the clinical environment in the form of an equipment status signal, as has been described in reference to
(55) In STEP 220, the data signals are analyzed, for example via data analyzer 120 of
(56) The analysis can include an analysis of patient data; equipment data; procedural data; and combinations of these, examples of each provided hereabove.
(57) The analysis can include an identification of a request for information, including but not limited to a request for a patient parameter; a procedural parameter; an equipment parameter; and combinations of these. The system is configured to respond to the operator's request quantitatively and/or qualitatively via the audio recorder. For example, an operator, e.g. the primary surgeon, can request the patient's blood pressure during a procedure, and the system will retrieve the patient parameter from the memory module and deliver the requested value to the operator, for example via an operator-worn headset and/or a visual display.
(58) The analysis can include an identification of an acknowledgment of receipt of data. Alternatively or additionally, the analysis can identify when data has been provided to an operator and require that an acknowledgement be provided by the operator. As described above, a library of acceptable responses can be entered into an input module and the acknowledgement can be identified based upon the library.
(59) The analysis can include a correlation of the verbal data signal to a particular operator, for example using the voice data entered into the input module prior to a procedure. In some embodiments, an algorithm performs a first analysis on a verbal data signal correlated to a first operator and a second, different analysis on a verbal data signal correlated to a second operator. In some embodiments, the correlation of a verbal data signal of the first operator is based on a first identifier and the correlation of the verbal data signal of the second operator is based on a second, different identifier, for example where a headset worn by the first and second operators includes the identifier, such as an embedded electronic ID. In one example, the identifier can include a SIM card included in each headset worn by the first and second operator. These embodiments can apply to a clinical environment including one, two, or multiple operators. Additionally, the analysis can include a correlation of the verbal data signal to a particular operator type, each type comprising one or more operators. Operator types can include but are not limited to a surgeon; an anesthesiologist; a scrub nurse; a circulating nurse; a hospital administrator; a patient; and combinations of these. An algorithm can be employed that determines an adverse condition has occurred based on the particular operator and/or operator type providing data via an audio recorder and/or other input module.
(60) In STEP 230, one or more keywords are identified via the data analyzer. The identification can be based on a library of keywords associated with a parameter that may be requested during a medical procedure, for example keywords that are typically associated with a patient and/or procedural parameter such as the keyword “blood pressure”. The library of keywords can be entered into the input module, for example by an operator prior to, during and/or subsequent to a procedure.
(61) In STEP 240, data is extracted via the data analyzer. The data can be extracted based on operator hierarchy and/or the importance of a particular value based on data entered into an input module prior to, during and/or subsequent to the procedure. For example, if an operator customizes the system such that the nurse should recite blood pressure readings every five minutes, data analyzer can filter the nurse's speech based upon the value it is seeking, i.e. identify the nurse's recitation of blood pressure readings every five minutes. Additionally, the extracted data can be logged into the system such as recording and storing the data in a memory module with a time stamp.
(62) In STEP 250, the extracted data is compared to a threshold, for example a threshold entered into an input module where the data analyzer includes an algorithm configured to compare the threshold to the data. In one embodiment, an adverse condition can be detected based on an analysis of the data exceeding a threshold. For example, if an operator entered a maximum acceptable value for the patient's blood pressure into the input module, the data analyzer will detect an adverse condition if the maximum acceptable value is exceeded.
(63) If the data is within the acceptable limits, i.e. does not exceed a threshold, the method begins at STEP 210, and the steps are repeated. However, if the data exceeds the threshold, STEP 260 is performed where an alert mode is entered. In this step, an alert module, for example alert module 135 of
(64) In STEP 270, the alert mode is cleared, and if cleared, then the method begins at STEP 210, and the steps are repeated. The system will remain in the alert mode until cleared. The alert mode can be cleared by remedying any of the adverse conditions described herein.
(65) In some embodiments, the alert module can be configured so as to automatically reset a threshold value if the alert mode is ignored. For example, if an adverse condition is detected based upon a blood pressure reading of 150/80, exceeding the threshold value of 145/75, the system will enter an alert mode. Continuing with this example, if the alert is ignored three times, the threshold value will reset to 150/80 or some value higher than its previous value. Statistical Process Control (SPC) can be used to handle error detection, or monitor alerts and any ignoring of alerts, such as to modify a threshold for entering an alert state after an alert is ignored a number of times.
(66) The method can further comprise storing any of the data entered into the input module, as well as any verbal data signals that are received and/or processed, i.e. analyzed by the data analyzer, during a procedure, for example via a memory module.
(67) In some embodiments, the method further comprises detecting an adverse condition based on the identification of a keyword in the verbal data signal. In some embodiments, the adverse condition can be detected based on the identification of an unrecognized term or value in the verbal data signal. In some embodiments, the adverse condition can be detected based on the identification of an unrecognized or inaudible voice in the verbal data signal. In some embodiments, the adverse condition can be detected based on a determination that a particular operator has been active and/or present in the clinical environment past a threshold of time. For example, when an operator is the surgeon, the data analyzer can determine that the surgeon has been performing a complex procedure for a length of time that has been previously determined to exceed a safety threshold. The length of an operator's presence can be determined by the data analyzer receiving a verbal data signal and/or a video data signal from the particular operator, thus associating the receipt of the signal with the operator's presence. Additionally or alternatively, the operator's presence can be determined automatically, for example by a motion sensor, or manually, for example by a timecard entry assembly. In some embodiments, the adverse condition can be detected based on the heightened frequency of recognized terms at a time other than that customized by the operator. In some embodiments, the adverse condition can be detected based on the non-receipt of information such as when an identified operator does not provide a particular piece of information at the proper time. In some embodiments, the adverse condition can be detected based on a determination that multiple pieces of similar data have not been received within a pre-determined time interval where the time interval can be an operator adjustable time interval that can be adjusted prior to and/or during a procedure. In some embodiments, the adverse condition can be detected based on a determination that a particular operator is not present. In some embodiments, the adverse condition can be detected based on an analysis of patient historic data and/or based on an analysis of a set of medical statistics such as a comparison of patient historic data to a set of medical statistics. In some embodiments, the adverse condition can be detected based on the identification of the patient's voice and/or gestures. For example, if the patient is no longer fully anesthetized and is able to speak and/or move, the data analyzer can identify the patient's speech. In some embodiments, a library of evidence-based practices, for example a proper protocol or set of standards for a particular type of medical procedure can be entered into the input module prior to or during a procedure, where the real-time events occurring during the procedure can be recorded and compared and/or analyzed according to the evidence based information. An adverse event can be detected by the data analyzer if an event is detected that falls outside of the proper protocol or acceptable set of standards. In some embodiments, the adverse condition can be detected based upon an analysis of a checklist. For example, the checklist can include a pre-operative, intra-operative, and/or a post-operative checklist that can be automatically and/or manually initiated. The checklist can be modified or include a portion that is modified or customized for a particular operator or set of operators.
(68) The method can further comprise providing an analysis of information to one or more operators such as patient and/or procedural information in real-time, i.e. during a procedure, or after completion of a procedure. In some embodiments, the information is provided by an output module for example information requested by at least one operator, such as information after the completion of a procedure in order to evaluate the overall performance of the operators, as well as the relationship between team behavior and real-time changes in patient status. Additionally, a full audio transcript of the entire procedure can be provided and/or a transcript for each individual operator can be provided. Other types of information can be provided such as information selected from the group consisting of: a current (real-time) parameter; a historic parameter; an average of multiple parameter values; a maximum of multiple parameter values; and combinations of these. Other information can include one or more adverse conditions detected; an operator's entry and/or exit time into the clinical setting; a procedure event that surpasses a threshold; an evidence-based decision support reminder; a captured video; a recommendation generated by the data analyzer; and combinations of these. The information can be provided to at least one operator or all operators in the form of a generated report, for example a hard copy and/or an electronic report. In some cases, the system can refer to a library of evidence-based practices, for example a library of data entered into the input module, and the system can discern whether the clinical approach was efficacious, appropriate and done in a timely manner. The report can then be transferred to a healthcare information system. Additionally, output module can create a post-operative debrief in the form of an interactive montage of critical events, for example an output including procedure video, audio, transcripts of audio, patient vital signs during the procedure, corresponding pre-operative thresholds/scores, any relevant medical imaging, and any other desired information.
(69) The method can further comprise confirming proper information is received by the audio recorder and/or the data analyzer, for example via a data monitoring algorithm. Additionally, a confirmation that proper information is received by the audio recorder and/or the data analyzer within one or more predetermined time intervals can be performed. The lack of receipt of information can lead to the detection of an adverse event, as has been described hereabove.
(70) The method can further comprise sensing at least one adverse condition via at least one sensor, for example a sensor such as a temperature sensor; an acoustic sensor; an electromagnetic sensor; a pressure sensor; a motion sensor; and combinations of these.
(71) In some embodiments, the method further comprises communicating with a healthcare information system, for example the input module can receive information from the healthcare information system such as information relevant to the particular patient and/or procedure to be performed, for example patient historic data. Similarly, the data provided by the output module can be communicated to the healthcare information system.
(72) The method can further comprise treating a patient via a treatment device, for example treatment device 200 described in reference to
(73)
(74) In STEP 310, a speech recognition step is performed. In some embodiments, speech recognition software comprising an algorithm performs an analysis on the received verbal data signal and correlates the verbal data signal to the specific operator. In some embodiments, the correlation of the verbal data signal of the operator is based on an identifier, for example where a headset worn by the operator includes the identifier. In one embodiment, the identifier can include a SIM card included in the operator's headset.
(75) In STEP 320, a confirmation that the operator requesting the data is a valid operator is performed. In one embodiment, the validity of the operator is confirmed based on the data an operator entered into an input module such as input module 110 of
(76) The system can also be configured more narrowly, for example, by designating both a valid operator and correlating that operator to a particular piece of data, such as a particular patient parameter. For example, if the primary user customizes the system such that the nurse shall provide and/or request blood pressure readings, the data analyzer can identify the nurse's speech and determine if it is in fact the nurse requesting and/or providing the blood pressure reading. As discussed above, the data analyzer can comprise speech recognition software employing an algorithm to detect the operator's speech, in this case the nurse, or alternatively, the nurse can wear a headset comprising an identifier such as a SIM card.
(77) If the operator is determined to be a valid operator, a check for the requested data is performed, as shown in STEP 330. As described in STEP 230 240 of
(78) However, if the operator is determined to be an invalid operator and/or the requested data is not stored in the memory module, an alert mode will be entered as shown in STEP 360. The alert mode is similar to that described in STEP 260 of
(79) Once the operator is determined to be a valid operator and the requested data has been retrieved from the memory module, STEP 340 can be performed where the requested data is transmitted to the requesting operator. In one embodiment, each operator wears a headset, and requested data can be transmitted to the requesting operator's headset. In some embodiments, each headset comprises a unique identifier associated with each operator such that the data analyzer can correlate a verbal data signal to a specific operator, for example an identifier such as a SIM card. In some embodiments, speech recognition software comprising an algorithm performs an analysis on the received verbal data signal and correlates the verbal data signal to the requesting operator via a headset worn by that operator. In some embodiments, the requested data can be transmitted to other operators in addition to the requesting operator, for example two or all operators in the clinical environment. The information can be transmitted to the operator(s) via a headset. Alternatively or additionally, the information can be transmitted via an intercom system and/or a visual display such that all operators can receive and/or transmit audio simultaneously.
(80) In STEP 350, the request for data is logged, for example in the memory module. An output module, such as output module 130 of
(81)
(82) In STEP 400, a start time T1 of an operator is recorded and logged into a memory module, for example the memory module, as has been described herein. In one embodiment, a data analyzer, for example data analyzer 120 of
(83) In STEP 410, the operator's time at T2 is recorded and logged into the memory module. T2 can be recorded and logged similarly to T1.
(84) In STEP 420, the operator's presence, represented by the value equaling T2 minus T1, is compared to a threshold. The threshold value can be a value that is predetermined for patient safety based upon the complexity of the procedure being performed. In the example where the operator is the surgeon, the threshold value can be determined based upon the ability and/or experience of the surgeon; whether or not the surgeon has performed other procedures within a particular amount of time such as within the last eight hours; the length of time the surgeon has performed the current procedure without a relief; whether or not the assistant surgeon has left early or during a critical phase; and combinations of these. The threshold value can be entered into an input module, for example input module 110 of
(85) If the operator's presence, i.e. T2 minus T1, does not exceed a threshold value, the steps can be repeated, beginning with STEP 410. However, if the operator's presence does exceed a threshold value, an alert mode will be entered as shown in STEP 430. The alert mode is similar to that described in STEP 260 of
(86) The foregoing description and accompanying drawings set forth a number of examples of representative embodiments at the present time. Various modifications, additions and alternative designs will become apparent to those skilled in the art in light of the foregoing teachings without departing from the spirit hereof, or exceeding the scope hereof, which is indicated by the following claims rather than by the foregoing description. All changes and variations that fall within the meaning and range of equivalency of the claims are to be embraced within their scope.