Video recording and image capture device
09936862 ยท 2018-04-10
Assignee
Inventors
Cpc classification
H04N5/775
ELECTRICITY
A61B1/042
HUMAN NECESSITIES
A61B1/0005
HUMAN NECESSITIES
H04N5/765
ELECTRICITY
International classification
A61B1/04
HUMAN NECESSITIES
H04N9/804
ELECTRICITY
A61B1/00
HUMAN NECESSITIES
Abstract
A video recording and image capture device for documenting surgical procedures that includes a main board for executing a plurality of software, a multimedia interface operable to receive a video signal and process it into an MPEG layer stream, the video interface connected on a first bus to the main board, a hard drive to record an MPEG layer stream as a file, an optical media drive to write an MPEG layer stream as a file, the hard drive and the optical media drive operably connected on a second bus, the bus being vertically stacked and connected to the main board, and a touchscreen interactive for user control, connected to the main board on a second bus to control the video interface.
Claims
1. A medical video instrument having touch screen control comprising: a touch screen for entering control commands to control said medical video instrument; said medical video instrument for inserting into a body cavity and generating an image stream representative of the body cavity and displayed on said touch screen; a processor coupled to said touch screen and the medical video instrument such that said processor receives said control commands from said touch screen and generates control signals to operate said medical video instrument, said processor further provided for receiving the image stream; and a medical instrument housing enclosing said processor, said touch screen movable between a first position at least partially within a footprint of said medical instrument housing and a second position extended from said footprint of said medical instrument housing, said touch screen deflectable about an axis of said medical instrument housing wherein said touch screen is unpluggable from said medical instrument housing such that said touch screen may be disconnected from said medical instrument housing.
2. The medical instrument of claim 1 in which said medical instrument housing includes a stackable mating plug portion.
3. The medical instrument of claim 2 in which said touch screen includes a stackable mating plug portion.
4. The medical instrument of claim 1 in which said touch screen can be used by a plurality of medical instruments.
5. The medical video instrument according to claim 1 wherein said medical video instrument generates video data that is displayed on said touch screen.
6. The medical video instrument according to claim 1 wherein said medical video instrument further comprises a storage for storing the image stream.
7. The medical video instrument according to claim 1 wherein when said touch screen is in the first position, said touch screen is positioned within an interior cavity of said medical instrument housing and when said touch screen is moved to the second position, the touch screen positioned at least partially outside of said cavity.
8. A medical video instrument having touch screen control comprising: a touch screen for entering control commands to control said medical video instrument; said medical video instrument for inserting into a body cavity and generating an image stream representative of the body cavity and displayed on said touch screen; a processor coupled to said touch screen and the medical video instrument such that said processor receives said control commands from said touch screen and generates control signals to operate said medical video instrument, said processor further provided for receiving the image stream; and a medical instrument housing enclosing said processor, said touch screen movable between a first position at least partially within a footprint of said medical instrument housing and a second position extended from said footprint of said medical instrument housing, said touch screen deflectable about an axis of said medical instrument housing which said touch screen is easier to deflect in one direction than in the other direction.
9. The medical instrument of claim 1 in which said touch screen is more difficult to deflect in the opening direction than in the closing direction.
10. The medical instrument of claim 1 in which said touch screen presents a keyboard to a user.
11. The medical instrument of claim 1 further comprising a sensor in communication with said processor, said sensor receiving control signals to operate said medical instrument.
12. The medical instrument of claim 1 further comprising a speech recognition module executing on said processor, said speech recognition module receiving voice signals that control said medical instrument.
13. The medical instrument of claim 1 further comprising a expert system executing on said processor, said expert system generating control signals to operate said medical instrument.
14. The medical instrument of claim 1 in which said touch screen slides out of said medical instrument housing.
15. The medical instrument of claim 1 in which said touch screen slides out of said medical instrument housing and is deflectable.
16. A medical video instrument having touch screen control comprising: a touch screen for entering control commands to control said medical video instrument; said medical video instrument for inserting into a body cavity and generating an image stream representative of the body cavity and displayed on said touch screen; a processor coupled to said touch screen and the medical video instrument such that said processor receives said control commands from said touch screen and generates control signals to operate said medical video instrument, said processor further provided for receiving the image stream; and a medical instrument housing enclosing said processor, said touch screen movable between a first position at least partially within a footprint of said medical instrument housing and a second position extended from said footprint of said medical instrument housing, said touch screen deflectable about an axis of said medical instrument housing; wherein said touch screen is unpluggable from said medical instrument housing such that said touch screen may be disconnected from said medical instrument housing.
17. The medical instrument of claim 16 in which said medical instrument housing includes a stackable mating plug portion.
18. The medical instrument of claim 17 in which said touch screen includes a stackable mating plug portion.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
DETAILED DESCRIPTION OF THE DRAWINGS
(11) The present invention will be described as used in connection with one or more endoscopes. It will be understood that other applications may be used equally effectively. Various frame displays and icons having particular graphical representations are described in connection with the functions of the present invention. It will be understood that other graphical representations may be used equally effectively in communicating to users the function performed therein.
(12) Herein, image and image stream refer to the perception of the user utilizing their audiovisual capabilities; an image stream may also include an auditory component. Video signal, digital signal, analog signal, data stream, or the like refer to electrical signals in the present invention and electrical equipment operably connected and/or associated with the present invention.
(13)
(14) As user 10 manipulates endoscope 15, user 10 controls camera head 20 with camera control unit (CCU) 30 and observes image stream 25 on a display unit, for example external video screen 35. Imager 100 is operably connected to CCU 30 to receive video signal 300. Device is also operably connected to external video screen 35, microphone 40, printer 45, and network 50 through standard ports. In one embodiment, imager 100 is operably connected to camera head 20 to receive video signal 300 and control camera head 20, obviating the need for CCU 30.
(15) As user 10 examines and treats patient 5, imager 100 is recording a digital data stream representing image stream 25 on optical media drive (OMD) 125 (see
(16) Upon encountering a situation requiring further investigation, user 10 utilizes an image capture mode to save and freeze a first image from image stream 25 for further investigation. Using imager 100, a second image substantially like the first image can be superimposed on image stream 25. Upon encountering further situations that attracts the attention of user 10, a plurality of second images substantially corresponding to respective first images found of interest can be saved and concurrently superimposed on image stream 25. A file corresponding to second image can be printed with printer 45 and/or forwarded over network 50 to other persons for consultation.
(17)
(18) Power supply 110 is connected to an AC power supply with an electric cord at power port 110a located on chassis back panel 105b. When power switch 110b of chassis front panel 105c is engaged, power supply 110 provides suitable power to components of imager 100. Power supply 110 conforms to IEC 601-1 isolation requirements, provides power meeting medical grade standards of 145 Watts, includes a power correction factor, and is capable of automatically handling automatically an AC voltage range of 100 to 250 VAC, 50-60 Hz.
(19) Microprocessor main board (MMB) 115 executes software and includes a central processor unit (processor), random access memory, a plurality of expansion slots, a BIOS chip, and on-board sound and graphics capabilities on a footprint convenient for chassis 105. Therein, it may be that an Intel Pentium III with a processing speed of at least 800 MHz; an Intel 815 chip set; at least three (3) PCI and one (1) AGP slot; SDRAM of at least 128 MB; on-board AGP graphics; and a flash upgradeable BIOS chip wherein a customized logo may be loaded, is provided on an ATX motherboard. Further, MMB 115 preferably includes port panel 115a to connect to other devices and or networks via serial, parallel, USB and ethernet, and to connect to mouse, keyboard, and video monitor; a Intel 40-pin DVO motherboard connector, or similar, and support for the connector.
(20) Hard drive (HDD) 120 and optical media drive (OMD) 125 maybe IDE or Enhanced IDE (alternatively IDE) compatible data storage media drives operably connected MMB 115 by a vertically stacked IDE bus 116. HDD 120 maybe a magnetic hard drive having at least 40 Gigabytes of storage and minimal access time, as such a drive from Maxtor having EIDE access time of 8.0 ms, 7200 rpm disk speed is preferred. OMD 125 is preferably a DVD+RW drive capable of reading and writing data to an optical media disk, such as a compact disk (CD) and/or a digital versatile disk (DVD).
(21) Communication interface 130 is any kind of network or proprietary communications interface. Therein, for example, a network card that is capable of interfacing with the Karl Storz, Inc. Storz Communication Bus (SCB) is preferred.
(22) Multimedia interface 135 connects to MMB 115 via a Peripheral Component Interconnect (PCI) local bus to provide record and write image stream 25 originating from camera head 20. Speaker 140 is housed in chassis 105 and provides auditory capabilities for imager 100.
(23) Digital video interface 150 is operably connected to MMB 115 to create a video signal conforming to the digital visual interface (DVI) standard. Therein, a digital video interface 150 is preferably physically implemented as a printed circuit board having an Intel 40-pin DVO connector, or similar, to MMB 115 and a DVI-D output connector in expansion slot 105d. As illustrated in
(24) A touchscreen 145 is provided as illustrated on
(25) Touchscreen 145 is advantageously housed in tray 105a (see
(26) TAS 146 allows user 10 to advantageously use the space available when equipment is racked. User 10 presses a button or other releasing mechanism to release touchscreen 145 and slides touchscreen 145 away from chassis 105 and out of tray 105a as indicated by the arrows as depicted in accordance with one embodiment of the present invention in
(27)
(28)
(29) Platform 144 may be of any suitable design to hold touchscreen 145 even when placed at an angle from horizontal. Touchscreen 145 is operative with imager 100 through cables and connectors.
(30) Rails 143a and 143b have stops 143c (only partially shown for clarity) operable with tracks 147a and 147b to prevent advancing touchscreen 145 beyond a predetermined point.
(31) TAS 146 includes on or more hinge 142, such as edged hinge 142a and 142b, or center hinge 143c a center hinge as depicted in accordance with one embodiment of the present invention in
(32)
(33) Resident on multimedia interface 135 is an Inter-IC bus operatively controlled by controller 200. Controller 200 implements the Inter-IC bus as a multi-master bus to connect circuits to PCI interface 210. Router 220 is provided as a field programmable gate array and has programmable read only memory that is accessible via a port, such as a JTAG port.
(34) In recording mode, imager 100 receives the input of video signal 300 and audio signal 315 and contemporaneously encodes both signals while writing the data stream to HDD 120 (see
(35) Video signal 300 is received by multimedia interface 135 as analog video signal 304i or digital video signal 306i in input ports located in expansion slot 105d (see
(36) A relay 205 is operative to bypass video signal 300 to an exit port corresponding to the input port for display by an external monitor when imager 100 is not powered or imager 100 is in standby mode. Therein, relay 205 includes a receiver for receiving a sense signal from software to indicate that the recording mode is engaged. If the sense signal is not received with a predetermined time, video signal 300 is bypassed. If imager 100 is not powered, a default mode of relay 205 bypasses the signal to the corresponding port, i.e. video signal 300 input on the S-video input is bypassed to an S-video output port.
(37) Analog video signal 304i is received using composite video input or S-Video input. If analog video signal 304i is received when imager 100 is not electrically powered or recording mode is not engaged, video signal 300 is bypassed using bypass relay 205. Received analog video signal 304i is digitized using analog to digital converter 240. Therein, the NTSC or PAL standard analog video signal 304i is digitized to first internal data stream, digital data stream (DDS) 310. A digitized data stream having 4:2:2 luminance to chrominance (YUV) pixels is preferred. Other data stream configurations may also be used. In particular, a data stream having 8:2:2 YUV may be advantageously used in connection with CCU 30 (see
(38) Digital video signal 306i is received using the SDI digital video signal input. If digital video signal 306i is received when imager 100 is not electrically powered or recording mode is not engaged, video signal 300 is bypassed using bypass relay 205. Received signal 306i is processed by SDI receiver 250 and converted to a first internal data stream, DDS 310. A digitized data stream having a 4:2:2 luminance to chrominance (YUV) pixels is preferred; although other data stream configurations may also be used. DDS 310 is streamed via router 220 to V-codec 230 where it is encoded.
(39) Inputs for audio signal 314i originating from a stereo line and audio signal 316i originating from microphone 40 are provided for recording a desired audio signal such as dictation. Both inputs may be combined to create a single audio signal 315 or used individually. Audio signal 315 is received by audio compression and decompression integrated circuit (A-codec) 260 and converted to a second internal data stream, digital data stream for audio (DDSA) 312, and passed to automatic gain control 270 disposed on the Inter-IC bus. DDSA 312 is then streamed to V-codec 230.
(40) V-codec 230 is provided as embedded software, preferably operating on a LINUX or UNIX embedded platform, on one or more integrated circuits on the Inter-IC bus and operatively connected to controller 200. Also operatively connected are one or more buffer memories, such as SDRAM integrated circuits. Configuration settings of V-codec 230 are stored on an associated erasable electronic programmable read only memory (EEPROM or EPROM) circuit, or similar. The embedded software of V-codec 230 executes an algorithm to decode and/or encode a Motion Picture Experts Group (MPEG) layer, such as MPEG, MPEG-2 and/or MPEG-4, data stream (MDS) 320. MDS 320 advantageously utilizes high compression rates achieved by using an index frame and noting a sequence of changes to that index frame in subsequent images. Therein, MDS 320 is comprised of a stream of frames 322.
(41) Algorithms of this type are known to execute file formatting appropriate for CD-R and a plurality of DVD media storage and play. Typically, MDS 320 is preferred to encode in a file format designated as VOB applicable to DVD+RW media storage and play. It should be appreciated that the present invention may be adapted readily to utilize other compression and decompression algorithms.
(42) V-codec 230 multiplexes DDS 310 and DDSA 312 into MDS 320 which is then streamed to MMB 115. From there, MDS 320 is streamed to HDD 120 and to OMD 125 via vertically stacked IDE bus 116. Therein, HDD 120 writes MDS 320 to a magnetic disk and streams a copy to OMD 125 for writing to an optical disk such as a CD-R or DVD media to create contemporaneous documentary recording file while the surgery is being conducted by user 10. If the write process on OMD 125 is interrupted or fails, a backup copy resides on HDD 120 for a subsequent write attempt after the conclusion of the surgery.
(43) A means for a video signal to be displayed by a display unit during recording mode is provided. The display unit may be external video screen 35 or touchscreen 145.
(44) Touchscreen 145 is operable to receive a video signal in digital visual interface (DVI) format, and an embodiment of video screen 35, external video screen 35b having touchscreen capabilities, is operable to receive a video signal in digital visual interface (DVI) format or analog monitor format. Therein, MMB 115 streams a copy of MDS 320 to resident AGP graphics support and/or DVI graphics support and digital video interface 150 for output to touchscreen 145 and video screen 35b as required by the active output.
(45) Image capture mode is provided for saving a frame 322 (see
(46) Frame buffer 295 can be implemented as an integrated circuit, capable of storing and identifying a plurality n of frames 322 corresponding to maximum number n frames capable of being stored according to the buffer size (hereinafter frame 322.sub.1 designating the first frame 322 stored, frame 322.sub.2 the second . . . , and frame 322.sub.n the last frame stored). As shown, identification may be implemented by designating a first-in-first-out order, or similar order. Upon receipt of frame 322.sub.1, buffer 295 forwards a copy to router 220. Router 220 multiplexes frame 322.sub.1 with DDS 310 and streams the combined signal to the active output port for display as combined image. As described further herein in connection with image capture mode, user 10 is able to manipulate the position and size of the combined image within image stream 25 and on a display unit.
(47) A copy of frame 322.sub.1 is saved to HDD 120, preferably in file format Joint Picture Experts Group JPEG layer corresponding to the MPEG layer such as MPEG, MPEG-2 and/or MPEG-4 layer, as a graphic file. A software application for conversion to other formats such as TIFF, BMP, and/or FPX, or similar, is provided.
(48) Upon additional instruction by user 10 to capture further images, further corresponding frames 322 are saved in the manner described. Therein, frame 322.sub.2 is multiplexed with frame 322.sub.1 and DDS 310 and the combined signal streamed to the active output for display on a display unit.
(49) An archival mode is provided for review, edit and playback of documentary recording file and a graphic file. Therein, the recording file is accessed and a digital data stream corresponding to MDS 320 is read from media of HDD 120 and/or OMD 125 and is streamed to V-codec 230 and is decompressed into a digital data stream corresponding to DDS 310. The decompressed digital data stream is then routed to the active port for display or transferred to MMB 115 for display on a display unit.
(50)
(51) Upon powering of imager 100, it is in standby mode and page 410 is shown as depicted in
(52) Surgical information block 600 includes fields for biographical patient information, identity of treating physician, and additional information as may be convenient and necessary. If the field requires an alpha-numeric entry, alpha-numeric keyboard page 420 is displayed on top of page 410, as depicted in
(53) Returning to
(54) To place device in recording mode to record a video file to a disk properly loaded in OMD 125, user 10 touches the designated icon, here illustrated as icon 632, in control panel icon 630. In response, icon 632 may change design, such as becoming highlighted. Concurrently, in image panel 620, image 25 is displayed in image window 624 and image status bar 622 displays confirmation of recording and elapsed recording as depicted in
(55) To mute audio recording or conversely engage audio recording, user 10 touches the designated icon, here illustrated as icon 636, in control panel 630. In response, icon 636 may change design, such as becoming highlighted. To reverse the action, user 10 touches icon 636 which in response may change design, preferably returning to its previous design.
(56) To capture an image that is being displayed in image window 624, user 10 touches the designated icon, here illustrated as icon 634, in control panel 630 and imager 100 is placed in image capture mode and the instruction is processed as described above. In response, icon 634 may change design, such as becoming highlighted, and a confirmation message that the desired action is being performed will be displayed. Similarly, image capture mode can be accessed if user 10 engages the appropriate control on CCU 30 to capture image 26 that is being displayed in image window 624. Instruction is processed as described above and icon 634 may change design, such as becoming highlighted, and a confirmation message that the desired action is being performed will be displayed.
(57) To allow user 10 to monitor available resources on a multimedia disc, multimedia status 610 includes fields identifying the remaining capacity of disc and the number of images captured and the length of time of image stream 25 recorded.
(58) The archival mode is accessible from control panel 630 to review and/or manipulate saved documentary recording files and graphics file. User 10 touches the designated icon, here illustrated as icon 638, and review page 440 is displayed as depicted in
(59) Therein, a graphic file may be printed to printer 45 located in the surgical suite so that it is immediately available for review by user 10. Software is provided to enlarge and view and manipulate the graphic file such as providing visual contrast, inserting a scaled file object corresponding to a physical prosthesis and thus determining whether such prosthesis fits patient 5.
(60) In accordance with one embodiment of the present invention, sensor 318 (see
(61) In accordance with one embodiment of the present invention, a system for speech recognition is provided for user 10 interaction with imager 100. Microphone 40 receives user 10 voice commands, which are routed to speech recognition module 319. Speech recognition module 319 is software that executes on Microprocessor main board (MMB) 115 to receive voice signals that control the medical instrument.
(62) In accordance with one embodiment of the present invention, database module 321 provides a database server and/or database management application that is operatively provided to enable user 10 to access, manage and/or update data in imager 100. Database module 321 is software that executes on Microprocessor main board (MMB) 115 to establish control signals to operate the hard drive and the optical media drive.
(63) In accordance with one embodiment of the present invention, expert system 323 is provided wherein characteristics of video signal 300 meeting predetermined characteristics are automatically brought to the attention of user 10 and/or saved as graphic files 810. Expert system 323 is software that executes on Microprocessor main board (MMB) 115 to generate control signals to operate the medical instrument.
(64) In accordance with one embodiment of the invention, a stereoscopic module 324 is provided for associating a plurality of video signals 300 with each other, as such providing stereoscopic images on a display unit. Stereoscopic module 324 is software that executes on Microprocessor main board (MMB) 115 to associate a plurality of files to provide stereoscopic images on a multimedia interface.