VIDEO PROCESSING APPARATUS WITH NOISE EFFECT MITIGATION
20240275510 ยท 2024-08-15
Assignee
Inventors
- Jean-Fran?ois Jacques Andr? PACCARD (Vanl?se, DK)
- Sten CARLSEN (Sengel?se, DK)
- J?rgen Reinhold OLSSON (Lomma, SE)
- Tobias Michael ?STERGREN (K?benhavn N, DK)
Cpc classification
H04B17/23
ELECTRICITY
A61B2018/00982
HUMAN NECESSITIES
International classification
Abstract
A visualization system including an endoscope, a display unit and a communication bus. The endoscope includes: an insertion cord and a handle or interface including a handle or interface housing and a handle or interface printed circuit board, the insertion cord extending from the handle or interface and including an insertion tube, a bending section and a distal tip unit including a camera module including an image sensor and an image sensor circuitry; the display unit including an input circuitry; and the communication bus configured to enable a communication between the image sensor circuitry, the handle or interface printed circuit board and the input circuitry; wherein the input circuitry of the display unit is configured to check for a high frequency noise and electrical disturbance on the communication bus.
Claims
1. A visualization system comprising: a video processing apparatus including an input circuitry and a noise mitigation logic, the input circuitry adapted to communicate with an endoscope, the endoscope including a communications bus and an image sensor, wherein the noise mitigation logic is configured to cease transmission of configuration data to the image sensor via the communication bus in case of a high frequency noise and electrical disturbance on the communication bus.
2. The visualization system of claim 1, wherein the configuration data comprises at least one configuration parameter of the image sensor, wherein the video processing apparatus is configured to receive images generated by the image sensor and to continue receiving the images while transmission of the configuration data to the image sensor is ceased.
3. (canceled)
4. The visualization system of claim 2, wherein the noise mitigation logic is configured to periodically check for the high frequency noise and electrical disturbance on the communication bus.
5. (canceled)
6. The visualization system of claim 1, wherein the input circuitry is configured to set a communication line output signal of a communication line of the communication bus, and to compare the communication line output signal with a communication line input signal, of the communication line, received from the endoscope, to determine a presence of the high frequency noise and electrical disturbance on the communication bus.
7. The visualization system of claim 6, wherein the communication line output signal is an output clock signal of a clock line of the communication bus and the communication line input signal is an input clock signal of the clock line of the communication bus, and the input circuitry -is configured to initially set the output clock signal, and to compare the output clock signal with the input clock signal received from the endoscope, to determine the presence of the high frequency noise and electrical disturbance on the communication bus.
8. The visualization system of claim 6, wherein the input circuitry is configured to generate a comparison signal based on a comparison of the communication line output signal and the communication line input signal, and to determine the presence of the high frequency noise and electrical disturbance in case the comparison signal exceeds a predetermined threshold.
9. The visualization system of claim 1, further comprising the endoscope, wherein the endoscope further comprises a working channel and a detector circuit , the working channel configured to receive an electrosurgical tool , and the detector circuit configured to detect the high frequency noise and electrical disturbance arising from operation of the electrosurgical tool and to provide a noise detection signal via the communications bus responsive to detecting a presence of the high frequency noise and electrical disturbance on the communication bus.
10. (canceled)
11. The visualization system of claim 9, wherein the noise mitigation logic is configured to: a) determine whether the noise detection signal is received; and b) block the communication bus in case the noise detection signal is received.
12. The visualization system of claim 11, wherein the noise mitigation logic is further configured to: c) check for a further noise detection signal for a first predetermined time period; d) in case no further noise detection signal is received at c), restart an operation of the communication bus; and e) in case the further noise detection signal is received at c), wait until no noise detection signal is received for the first predetermined time period, which indicates that an end of a burst of pulses emitted by the electrosurgical tool has been reached.
13. Visualization system according to The visualization system of claim 12, wherein the noise mitigation logic is further configured to: f) at the end of the burst of pulses at e), wait for a second predetermined time period and determine whether there is a further burst of pulses detected during the second predetermined time period; g) in case no further burst of pulses is detected at f), restart the operation of the communication bus; and h) in case a further burst of pulses is detected at f), repeat e) until no further burst of pulses is detected at step f).
14. The visualization system of claim 9, wherein the detector circuit comprises: a sensor part configured to detect the presence of the high frequency noise and electrical disturbance, and a circuit part electrically connected with the sensor part and configured to provide an output signal indicating the presence of the high frequency noise and electrical disturbance.
15. The visualization system of claim 14, wherein the circuit part is configured to set a threshold voltage and to change the state of the output signal when the voltage transmitted from the sensor part exceeds the threshold.
16. The visualization system of claim 14, wherein the circuit part is configured to set an upper threshold voltage and a lower threshold voltage, and the output signal of the circuit part is changed when the voltage transmitted from the sensor part is above the upper threshold voltage or below the lower threshold voltage.
17. (canceled)
18. An endoscope comprising: handle or interface comprising a housing, a working channel access port and a printed circuit board positioned inside the housing; an insertion cord extending from the housing and comprising an insertion tube, a bending section and a distal tip unit, wherein the distal tip unit comprises a camera module connected with the printed circuit board; a working channel extending from the working channel access port to the distal tip unit of the insertion cord; and a detector circuit configured to detect a presence of a high frequency noise and electrical disturbance arising from a use of an electrosurgical tool in the working channel.
19. to the endoscope of claim 18, wherein the detector circuit comprises: a sensor part configured to detect the presence of the high frequency noise and electrical disturbance, and a circuit part electrically connected with the sensor part and configured to provide an output signal indicating the presence of the high frequency noise and electrical disturbance.
20. The endoscope of claim 19, wherein the sensor part is configured to input a voltage to the circuit part, and the circuit part is configured to output the output signal based on the voltage input to the circuit part from the sensor part.
21. The endoscope of claim 20, wherein the circuit part is configured to set an upper threshold voltage and a lower threshold voltage, and the output signal of the circuit part is changed when the voltage transmitted from the sensor part is above the upper threshold voltage or below the lower threshold voltage.
22. The endoscope of claim 20, wherein the circuit part is integrated in the printed circuit board provided in the housing.
23. The endoscope of claim 20, wherein the circuit part comprises a window comparator.
24. The endoscope of claim 19, wherein the sensor part at least partly surrounds the working channel.
25-28. (canceled)
Description
BRIEF DESCRIPTION OF FIGURES
[0071] The disclosure is explained in more detail below using preferred embodiments and referring to the accompanying figures.
[0072]
[0073]
[0074]
[0075]
[0076]
[0077]
[0078]
[0079]
[0080]
[0081]
[0082]
[0083]
[0084]
[0085]
[0086]
[0087]
[0088]
[0089] The figures are schematic in nature and serve only to understand the disclosure. The features of the different embodiments can be interchanged among each other.
DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS
[0090] The present disclosure may be further understood with reference to the following description and appended drawings, wherein like elements are referred to with the same reference numerals.
[0091] In
[0092] In some variations, the endoscope 2 comprises an electrical noise detector and logic configured to transmit a noise detected signal to the VPA. The VPA may determine that there is electrical noise based on the noise detected signal or based on a mismatch between configuration parameters transmitted from an output buffer and read from an input buffer.
[0093] Advantages of the visualization system include, among others, prevention or mitigation of malfunction of the camera module while the electrosurgical tool is operated, reduction of the size of the insertion cord of the endoscope, and endoscope cost reductions. Size and cost reductions are possible when the malfunction is mitigated by means that do not require addition of electrical shielding between the electrosurgical tool and the communication wires in the endoscope, whether such shielding comprises shield braiding the communication wires or metallization and grounding of the working channel.
[0094] The endoscope 2 is preferably a single-use endoscope being essentially formed from parts of plastic/polymer material. The endoscope 2 comprises a proximal endoscope handle 4 designed to be held by an operator and being configured to accommodate operating parts of the endoscope 2. Here, the presence of a handle 4 is the preferred embodiment. However, it might be also possible to apply an interface instead of the handle which interface is adapted to be coupled to the distal end of a robotic arm or the like. Since such an interface has same functions as a handle but is substantially only different in outer shape, the handle is just shown in the figures as a synonym for both, handle and interface. Further, the endoscope 2 comprises an insertion cord 6, which is configured to be inserted into a patient's body cavity. The insertion cord 6 comprises an (flexible/passive bending) insertion tube 8, a (actively actuatable) bending section 10 and a distal tip unit 12, extending in this order from the endoscope handle 4.
[0095] At/in the distal tip unit 12, a camera module 13 is provided. The camera module 13 comprises an image sensor circuitry 42 and an image sensor 14. The image sensor circuitry 42 is configured to enable a setting up of the image sensor 14. The camera module 13 may comprise a light source such as light-emitting diodes or optical fibers connected to a light source, such that the patient's body cavity can be illuminated and inspected. The image sensor circuitry 42 may include, for example, a voltage regulator, capacitors and other passive devices to condition signals for the image sensor and the light sources. An image captured by the image sensor 14 can be shown on a display 16 of the display unit 18. The endoscope 2 may be connected with the display unit 18 via a plug and socket connection 20. The endoscope 2 may comprise a plug, which can be inserted into a socket of the display unit 18. It is to be understood that the display unit 18 does not necessarily comprise the display 16. Alternatively, there may be provided an external monitor/display which is not a part of the display unit 18 and which is connected with the display unit 18.
[0096] The endoscope 2 has an internal working channel 22. The working channel 22 is basically formed by a biopsy connector/Y-connector 76, a bendable/flexible polymer tube, i.e. a working channel tube 65, connected to the Y-connector 76 and a tip housing of the distal tip unit 12 at/in which the working channel 22 forms an opening to the environment. The Y-connector 76 comprises an access port 24 for introducing instruments into the working channel 22. The working channel tube 65 is provided in/inside the insertion cord 6 and extends from the Y-connector 76 provided in the endoscope handle 4 towards the distal tip unit 12. The working channel 22 is accessible via the access port 24. In particular, an electrosurgical tool 25 is an example of a minimal instrument that may be guided through the working channel 22 into the patient's body cavity via the Y-connector 76 and the working channel tube 65. The operator is thus able to perform medical procedures with tool 25 within the patient's body cavity.
[0097] The endoscope handle 4 comprises two operating units 26, 28, namely a first operating unit 26 and a second operating unit 28, for actively steering/bending the bending section 10 thereby orientating the distal tip unit 12 into determined directions. The endoscope handle 4 may alternatively comprise just one operating unit 26, 28. The operating unit 26, 28 may be a handle wheel or a lever. In the embodiment shown, a rotation/turning force can be applied to both the first operating unit 26 and the second operating unit 28 by the operator. As can be derived from
[0098] The distal tip unit 12 may be orientated into different directions by bending the bending section 10, respectively. The endoscope 2 shown in
[0099] For achieving the above bending movements, the bending section 10 may comprise a plurality of segments, wherein two adjacent segments among the plurality of segments, i.e. a pair of segments, may be connected via corresponding flexible hinge members, respectively. The bending section 10 may be molded in a single piece including the segments and the hinge members connecting them, as is known in the art. The bending section 10 may be largely covered by a flexible tube-like outer cover 30 for preventing contamination.
[0100] The endoscope 2 may comprise steering wires 31 (not shown in
[0101] The endoscope 2, in particular the endoscope handle 4, further comprises two valves, namely a gas/water injection valve 32 and a suction valve 34. The endoscope handle 4 may alternatively only comprise one valve 32, 34. The gas/water injection valve 32 and the suction valve 34 are arranged side by side on a top surface 36 of a handle housing 38 (in particular formed from two half shells) of the endoscope handle 4.
[0102]
[0103]
[0104]
[0105] The display unit 18 is electrically connected and in electrical communication with the handle printed circuit board 40 via electrical wires 46 when the endoscope 2 and the display unit 18 are connected via the plug and socket connection 20 and is configured to power the handle printed circuit board 40, the image sensor circuitry 42 and the image sensor 14. In particular, the display unit 18 can communicate with the image sensor 14 via a communication bus 48 to transmit configuration information and may be referred to as a configuration bus. The image sensor circuitry 42 at the distal tip unit 12 is configured to handle communications via the communication bus 48. The communication between the display unit 18 and the handle PCB 40 may alternatively be wireless and the handle PCB 40 may alternatively be powered by a battery. Images captured by the image sensor 14 may be transferred to the display unit 18 via a separate image data bus (not shown), where they are processed. For this purpose, the display unit 18 comprises an input circuitry 50 comprising logic for communicating with the handle PCB 40 and for receiving the images captured by the image sensor 14. The input circuitry 50 may be a circuit board.
[0106] In the present embodiment, the configuration bus may operate at about 200 Kbits/second and the image data bus may operate at about 320 Mbits/second. The configuration bus may be a serial bus and the image data bus may be a MIPI bus comprising one or more differential data lines. Some examples of serial communication buses include I.sup.2C and SCCB (Serial camera control bus), which have both turned out to be suitable serial communication buses in accordance with the present disclosure. Parallel communication buses may also be used in circumstances where the insertion cord size allows for a larger communication bus.
[0107] In other embodiments, a single bus may be used to send configuration data and receive image data.
[0108] The input circuitry 50 may be implemented using a logic circuit, a FPGA (field programmable gate array) 52, or a DSP (digital signal processor) and so on. The input circuitry 50 comprises noise mitigation logic 51 configured to implement a noise mitigation method described with reference to
[0109] In particular, the input circuitry 50 is implemented using a FPGA 52 according to a preferred embodiment of the present disclosure. The display unit 18 is configured to display the processed images on the display 16. The FPGA 52 may comprise the noise mitigation logic 51. The FPGA 52 may comprise output and input buffers connected to a common pad. The output buffer is toggled to generate a clock signal on a clock line of the bus. The input buffer is used to read the present state of the clock line. The same setup can be used to control the data line of the bus.
[0110] The term logic as used herein includes software and/or firmware executing on one or more programmable processing devices, application-specific integrated circuits, field-programmable gate arrays, digital signal processors, hardwired logic, or combinations thereof. Therefore, in accordance with the embodiments, various logic may be implemented in any appropriate fashion and would remain in accordance with the embodiments herein disclosed. Logic may comprise processing instructions embedded in non-transitory machine-readable media (e.g. memory).
[0111] As indicated in
[0112] To better appreciate the physical relation between the working channel and the communication bus it is helpful to note that the outer diameter of the insertion cord might be less than 5 mm, preferably less than 4 mm and even 3 mm or less. Within the outer diameter are included, in a cross-section, the walls of the bending section, the walls of the tube forming the working channel, and the camera module. Furthermore, the wires 44 may abut the wall of the working channel tube and be separated from the electrosurgical tool 25 merely by the thickness of the working channel tube wall. Since structures, including wire and wall thicknesses, impede flexure of the distal end of the insertion cord, and the insertion cord diameter is reduced to reduce the invasiveness of the medical procedures, it is desirable to minimize structure, e.g. wire and wall thicknesses, and reduce the outer diameters, which in turn increases the noise picked up by the communication bus and exacerbates the problem solved by the present solutions.
[0113] Moreover, the display unit 18 is configured to write exposure data to the image sensor 14 via the communication bus 48, in specific the wires 44. The exposure data and other data that sets up the functioning of the image sensor are referred to as configuration data. The configuration data may include shutter speed, orientation, white balance, etc. The configuration data is written to registers provided in the image sensor for that purpose. The registers can also be read. Thus, the VPA may write to a register and then read from it to confirm that the data was written correctly.
[0114] In particular, during data transmission over the communication bus 48, data are written in one register in the image sensor 14 with, for example, four bytes including device address, two register addresses and configuration data. During operation of the electrosurgical tool 25, the high frequency noise and electrical disturbance on the communication bus 48 may cause in wrong bit insertion and bits missing of the data transmitted during the data transmission.
[0115] Therefore, as shown in
[0116] When a high frequency voltage is present in the working channel 22, the sensor part 62 is configured to input a noise detected signal, e.g. a voltage, into the circuit part 64. The circuit part 64 is configured to provide an output signal, which is communicated to the display unit 18. The output signal is dependent on the voltage input to the circuit part 64 from the sensor part 62. In particular, the output signal may indicate that a high frequency noise and electrical disturbance is present, or may indicate that no high frequency noise and electrical disturbance is present. The output signal of the circuit part 64 serves as an input to the display unit 18, which based on the input signal temporarily may terminate some or all communications on the communication bus 48. In one variation, the display unit or VPA 18 ceases transmission of configuration data but continues to receive image data based on the configuration data last transmitted to the camera module (e.g. before the noise was detected). The camera module is unaware of the noise. Due to the timing of the high frequency voltage when the electrosurgical tool 25 is actuated and the timing of the communications, the output signal may be transmitted to the VPA 18 before configuration data is transmitted to the camera module while the electrical noise is present. Additionally, a stop command/signal may be transmitted over the communication bus to cause the camera module to cease reception of the configuration data.
[0117] The output signal is transmitted via the wires 46 from the handle printed circuit board 40 to the display unit 18. In this way, an already existing bus like the communication bus 48 (which is basically used for the transmission of images) may be used to transmit the output signal and there is no need to provide an additional communication bus according to the present disclosure. The output signal of the circuit part 64 may be considered as a trigger signal. In particular, when the output signal/trigger signal turns low, a communication line like the clock line of the communication bus 48 may be pulled down. Alternatively, the output signal may also be directly transmitted to the display unit 18. The present disclosure provides embodiments of algorithm/methods which are performed when the output signal indicating the presence of a high frequency noise and electrical disturbance is directly or indirectly received by the input circuitry 50 of the display unit 18. The display unit 18 is configured to continuously check for the presence of a high frequency noise and electrical disturbance in the working channel 22 which may affect the communication bus 48. As will be described in more detail below, the display unit 18 terminates the communication on the communication bus 48 at least for a certain period of time in case of the presence of the high frequency noise and electrical disturbance.
[0118]
[0119] In
[0120] The sensor part 62 may be made of a conductive material. In particular, the sensor part 62 is formed as an electrically conductive foil or tape in
[0121] As better shown in
[0122]
[0123] As mentioned above, the detector circuit 60 outputs a signal, the noise detection signal, which the VPA 18 may use to determine that there is electrical noise. The noise detection signal can be generated by the detector circuit 60 when the input signal exceeds a threshold and communicated by changing the state of a line of the configuration bus 48. The sensor part 62 may comprise the capacitor 84 but other sensors that detect significant changes in the quantity of electrical energy may be used, for example wires functioning as antennas, inductors, etc. The circuit part 64 potentially amplifies the input signal so that it can be used by the remaining parts of the circuit, sets the value of the threshold, and generates the output signal when the input signal (or the amplified input signal) crosses the threshold.
[0124] In some embodiments, the circuit part 64 is a window comparator. The window comparator has two thresholds instead of one. The functioning of the window comparator is better understood with reference to
[0125] Having described the functionality of a window comparator, attention is now directed to the detection of noise. In some embodiments, described with reference to
[0126]
[0127] Functionally, the capacitor 84 is charged by the high frequency noise and electrical disturbance generated during operation of the electrosurgical tool 25 inside the working channel 22. As described with reference to
[0128] In electrical detail, in
[0129] Similarly, the capacitor 84 in
[0130] Further, a bias circuit can be provided at the input of the window comparator circuit electrically connected with the capacitor 84 using a voltage divider with two resistors 112, 114 in both
[0131] The lower and upper threshold voltages 92, 96 are preferably set using a voltage divider network formed of three resistors 116, 118, 120. The three resistors 116, 118, 120 may be chosen to have equal resistance values. The voltage may thus drop across each resistor by one third of the voltage supply Vcc. Therefore, the upper threshold voltage 96 in this example may be set to ? Vcc and the lower threshold voltage may be set to ? Vcc. The resistors 116, 118 and 120 may be set at any values for adjusting the lower and upper threshold voltages 92, 96.
[0132] Additionally, the pull up resistor 122 can be provided at the output of the window comparator circuit, which can be connected to the same power supply as the window comparator or to a separate power supply available in the handle PCB 40.
[0133] The circuits in
[0134] In an alternative practical embodiment, no detector circuit 60 is provided in the endoscope 2. According to said alternative embodiment, the input circuitry 50 continuously checks or monitors a communication line on the communication bus 48. The communication bus 48 between the display unit 18, the handle PCB 40 and the camera module 13 in the distal tip unit 12 may be based on master/slave protocol. The input circuitry 50 at the display unit 18 is preferably the master and may pull down or raise, i.e. may set, (a signal of) the communication line on the communication bus 48. The input circuitry 50 may then continuously check or monitor whether the (signal of the) communication line is actually as originally set. The input circuitry 50 is configured to determine whether the communication line is in an unexpected state, i.e. in a state which has not been initially set by the input circuitry 50. This may be interpreted by the input circuitry 50 as a presence of a high frequency noise and electrical disturbance on the communication bus 48, described below as a mismatch or collision.
[0135] In particular, the input circuitry 50 as the master may control the clock line and send a clock signal via the clock line. The handle PCB 40 may be the slave and may receive the clock signal from the master via the clock line. If the output signal of the clock line set by the input circuitry 50 for instance is pulled down to low, but the clock line of the communication bus 48 is suddenly in an unexpected high state, the input circuitry 50 may consider it as a presence of the high frequency noise and electrical disturbance on the communication bus 48. This comparison of the output signal of the clock line set by the input circuitry 50 and the input signal of the clock line received from the handle PCB 40 is performed by the input circuitry 50. An input/output signal mismatch is indicative of noise and may be described below as a collision.
[0136] A comparison signal, which indicates the result of the comparison, may be generated by the input circuitry 50. Once the difference of the comparison exceeds a predetermined threshold, the input circuitry 50 may pull down the comparison signal to low, which is considered as a presence of the high frequency noise and electrical disturbance on the communication bus 48.
[0137] To sum up, the method according to the alternative practical embodiment is implemented on the input circuitry 50 of the display unit 18 and is configured to continuously check for a high frequency noise and electrical disturbance on the communication bus 48, by monitoring a communication line on the communication bus 48. Preferably, the input circuitry 50 compares an output signal of the clock line set by the input circuitry 50 (as controller/master) with the input signal of the clock line from the handle PCB 40 (as peripheral/slave) to determine a presence of the high frequency noise and electrical disturbance on the communication bus 48 without using a detector circuit 60.
[0138] As discussed above, the present disclosure has been developed considering the nature of electrosurgical (e.g. plasma surgical) tools 25 used in endoscopic procedures. Usually such electrosurgical tools 25 emit electrical noise signals comprising a burst of (individual) pulses/bursts of (individual) pulses comprising high voltage pulses and a wide range of frequencies, and there is the risk that an individual pulse of the burst(s) of pulses may disturb the communication bus 48 (e.g. the I.sup.2C bus).
[0139] Electrosurgical tools may be operated in different modes to perform a desired medical procedure.
[0140] Referring to
[0141] Generally, the method of mitigating the effect of high frequency noise is timed based on a profiling of the noise. As described above, in the example of the high frequency noise the pulse bursts are spaced 60 milliseconds apart. Thus, two bursts span 120 milliseconds. If more than 60 milliseconds pass after the last detected burst, it is possible to conclude that the high frequency pulses have ended, but a safer approach is to wait more than 120 milliseconds (two burst cycles plus the duration of a burst), for example 125 milliseconds, during which time if the tool was operational there would be two or three bursts, thus if no bursts are detected in that time it is safe to conclude that the tool is not operational or not operating in a mode that creates noise. The safe time of 125 milliseconds will be referred to as t2 and corresponds to a burst cycle of 60 milliseconds. If the tool is profiled and the profile has a different burst cycle, t2 will be adjusted accordingly. Of course a time greater than one cycle but less than approximately two cycles plus the burst duration could be used.
[0142] The method senses signal collisions (lines have values different than the values commanded or an endoscope wire indicates that the sensor detected noise) periodically during short windows, e.g. t1, to detect the collisions indicative of high frequency pulse bursts and, optionally, prevent termination of communications on the configuration bus if the collision is a random event. If noise is detected, the method terminates communications on the configuration bus using one or more of several techniques discussed below. Once the noise stops for a safe period of time, e.g. t2, the method restarts communications on the configuration bus. The method can be enhanced to avoid detecting collisions during signal transition periods, e.g. transition edges based on rise/fall times. Embodiments of the method are described in more detail with reference to
[0143] In the flow chart shown in
[0160] In particular, at B, the noise mitigation logic determines first (step S1) whether noise is present. The presence of noise can be determined when the noise mitigation logic receives a noise detection signal. The noise detection signal can be the output signal received indirectly or directly from the detector circuit 60 or a comparison signal generated by the input circuitry 50 of the display unit 18, as described below.
[0161] In case no noise detection signal is received (No), the operation of the communication bus 48 is continued, at C. In case the noise detection signal is received (Yes), the communication bus 48 is immediately blocked, i.e. the communication on the communication bus 48 is terminated/stopped temporarily, at E. Therefore, it is prevented that an individual pulse causes a disturbance of the communication bus 48. In some embodiments, when the particular communication bus protocol permits doing so, if the noise is detected while a transmission of a command/configuration packet is in progress, a stop condition command is transmitted on the bus to gracefully end the transmission of the packet, then the bus is blocked responsive to a command from the noise mitigation logic.
[0162] Then at F, (as a step S2) the noise mitigation logic checks/looks for further noise/for a further noise detection signal for a first, short period of time t1, e.g. for 1 ms. In case no further noise/no further noise detection signal is received during the first, short period of time t1 (No), the noise detection signal received in step S1 was random noise. In particular, individual pulses of a burst of pulses are usually spaced by about 50 ?s. The first, short period of time is thus set such that it is sufficiently longer than 50 ?s (e.g. 1 ms) so that one certainly knows that the individual pulse detected in S1 is not part of a burst of pulses. In case it is determined that the noise detection signal received in S1 was random noise (i.e. in case no further noise is received during the time t1), communication on the communication bus 48 is continued, at G.
[0163] In case further noise/a further noise detection signal is received during the first, short period of time t1 (Yes), the noise mitigation logic is configured to wait again for the first, short period of time t1 and to determine whether a further noise/a further noise detection signal is received during said period of time t1, at J (step S3). In case of a further noise (Yes) this process is repeated. The noise mitigation logic is thus configured to wait until no further noise detection signal has been received for the period of time t1. When no further noise detection signal has been received for the period of time t1, this means that an end of a burst of pulses 130 has been reached.
[0164] In a next step, at K, the noise mitigation logic is configured to wait for a second, long period of time t2, e.g. 125 ms. The second, long period of time is set such that another burst of pulses in the fast pulse mode would be detected. It is thus prevented that communication of the communication bus 48 is continued during a fast pulse mode operation of the electrosurgical tool 25. In case a further burst of pulses 130 is detected during the second, long period of time t2, at L (step S4), the method returns to detecting during periods t1 until the end of the burst is detected, and then again wait for the second, long period of time t2. This process is repeated as long as a further burst of pulses 130 is detected during a second, long period of time t2. Only if no further burst of pulses 130 is detected during the second, long period of time t2, the operation of the communication bus 48 is restarted, at M.
[0165] In a practical implementation of the present disclosure, the method shown in
[0166] Referring now to
[0167] At 150, the noise mitigation logic 51 begins to check whether there is a collision, by first determining, at 152, whether any lines in the communications bus were intentionally toggled. In one example, these lines include the SCL or SDA lines, corresponding to the clock and data lines. The communications bus in this embodiment comprises a configuration bus, which is used to transmit commands to the image sensor. A separate image data bus, having a faster data transfer rate, is provided to allow the image sensor to transmit the images to the VPA 18. It has been found experientially that while noise is observed on the configuration bus, the same noise source does not appear to generate noise on the image data bus.
[0168] At 154, the noise mitigation logic 51 ignores a collision that may be the result of such toggling, by ignoring the edges of the transitions caused by toggling the lines of the configuration bus, by for example waiting X clock cycles, at 156. In one example, X equals 4 cycles. The number of cycles is not entirely arbitrary, it is a number sufficiently high to prevent false positives but short enough to quickly detect noise. More or less cycles can be sufficient, depending on the clock rate and hardware used, to ensure that the edges of the toggle transition are not considered when evaluating whether a collision occurred.
[0169] After the X clock cycles passed, the noise mitigation logic 51 compares, at 160, the state of the configuration bus lines (input state) to the state previously commanded (output state).
[0170] If the states match, i.e. are the same, then there has not been a collision. If, on the other hand, the states do not match, at 162, the noise mitigation logic 51 asserts the high frequency noise flag. Asserting the high frequency noise flag can simply mean that the logic state of a register is toggled from de-asserted to asserted. Of course the state of a flag can be tracked and changed in any manner known in the art. In one example, the FPGA has a pad for each line of the configuration bus (e.g. SCL and SDA). The pad is connected to an input buffer and an output buffer of the FPGA. The noise mitigation logic 51 remembers the last state the output buffer was set to and reads the input buffer, then compares the two states and determines whether a collision occurred based on the comparison. The natural state of the lines can be a high impedance high state.
[0171] After determining that a collision occurred, the noise mitigation logic 51 determines whether the collision was random, at 164. To do so, the noise mitigation logic 51 performs the comparison again, at 166, during a period of time t1. If the comparison does not indicate another collision occurred, the mismatch was random and the noise mitigation logic 51 de-asserts the high frequency noise flag, at 168. If the comparison indicates another collision occurred, the noise mitigation logic 51 determines that the collision was not random and a burst of high frequency voltages is underway and waits for the end of the burst, at 170. It does so by periodically comparing the input and output buffers, at 172, during periods t1, until the comparison indicates no collision.
[0172] The time t1 is set in relation to the pulse rate in the high frequency mode of the electrosurgical tool. The burst period is between 12-15 milliseconds, therefore t1 was chosen to be between 5-10% of the burst period, which provides an adequate balance between responsiveness and computational cost.
[0173] At 174, the noise mitigation logic 51 waits for another burst during a time period t2, at 176. If another burst is detected (by again performing the comparison), the noise mitigation logic 51 returns to 170 to hunt for the end of the burst. If another burst is not detected, the noise mitigation logic 51 de-asserts the high frequency noise flag, at 168.
[0174] When the high frequency noise flag is asserted, the noise mitigation logic 51 pauses configuration of the image sensor to prevent that the configuration data, transmitted over the configuration bus, becomes corrupted by the noise and thus causes a malfunction of the camera module. The camera module continues to transmit the image data, over the image data bus, based on the last set of configuration data received by the image sensor. When the high frequency noise flag is de-asserted, the noise mitigation logic 51 again sends the configuration data to the image sensor. The configuration data may comprise, for example, automatic exposure settings (AES) to control, substantially on an image by image basis, the exposure setting of the image sensor. While transmission of the configuration data is paused, the image sensor does not receive configuration data, such AES commands, but continues generating images using the last transmitted AES command.
[0175] A collision can occur in different ways. If the detector circuit 60 is provided in the endoscope 2, the detector circuit 60 can bring down the output signal and thus bring down the SCL or the SDA lines. By forcing a state change on either line, the detector circuit causes a change at the input buffer which results in the determination that a collision occurred.
[0176] The noise caused by the electrosurgical tool 25 can also change the state of the configuration bus. The change of state, which is not a command from the VPA 18, causes the change at the input buffer which results in the determination that a collision occurred.
[0177] The noise mitigation logic 51 can pause configuration of the image sensor in different ways. First, the noise mitigation logic 51 can simply stop transmitting commands over the configuration bus. Second, the noise mitigation logic 51, as the configuration bus master, can transmit a stop command over the configuration bus. The stop command provides a graceful way to command the image sensor to stop reading the configuration bus and, thus, to prevent problems when noise appears mid-transmission, when a packet has been at least partly transmitted. Third, the noise mitigation logic 51, as the configuration bus master, can set the state of the lines to end a transmission and prevent subsequent packets from being transmitted. One or more of these options may be implemented, based on the configuration bus protocol and, potentially, on the timing of an in-progress transmission.
[0178]
[0179] Additional exemplary embodiments of the foregoing aspects of the present disclosure are set out in the following exemplary items:
[0180] 1. System comprising: a display unit (18); the display unit (18) comprising an input circuitry (50) configured to communicate with the handle or interface printed circuit board (40) and with the image sensor circuitry (42) via the communication bus (48); and the communication bus (48) connecting the endoscope (2) and the display unit (18) and configured to enable a communication between the image sensor circuitry (42), the handle or interface printed circuit board (40) and the input circuitry (50); wherein the input circuitry (50) of the display unit (18) is configured to, preferably continuously or pulsatively, check for a high frequency noise and electrical disturbance on the communication bus (48).
[0181] 2. System according to item 1, wherein the input circuitry (50) is configured to terminate a communication via the communication bus (48) in case of a high frequency noise and electrical disturbance on the communication bus (48).
[0182] 3. System according to item 1 or 2, wherein the communication between the input circuitry (50), the handle or interface printed circuit board (40) and the image sensor circuitry (42) is based on master-slave, wherein the input circuitry (50) is the master and the handle or interface printed circuit board (40) and the image sensor circuitry (42) are slaves.
[0183] 4. System according to item 3, wherein the input circuitry (50) is configured to initially set a communication line output signal of a communication line of the communication bus (48), and to compare the communication line output signal with a communication line input signal of the communication line received from the handle or interface printed circuit board (40), to determine a presence of the high frequency noise and electrical disturbance on the communication bus (48).
[0184] 5. System according to item 4, wherein the communication line output signal is an output clock signal of a clock line of the communication bus (48) and the communication line input signal is an input clock signal of the clock line of the communication bus (48), and the input circuitry (50) is configured to initially set the output clock signal, and to compare the output clock signal with the input clock signal received from the handle or interface printed circuit board (40), to determine the presence of the high frequency noise and electrical disturbance on the communication bus (48).
[0185] 6. System according to item 4 or 5, wherein the input circuitry (50) is configured to generate a comparison signal based on a comparison of the communication line output signal and the communication line input signal, and to determine the presence of the high frequency noise and electrical disturbance in case the comparison signal exceeds a predetermined threshold.
[0186] 7. System according to any one of items 1 to 3, wherein the endoscope (2) further comprises a working channel (22) configured for insertion of an electrosurgical tool (25) into a patient's body cavity; and a detector circuit (60) configured to detect the high frequency noise and electrical disturbance, arising from a use and an operation of the electrosurgical tool (25) and affecting the communication bus (48), in the working channel (22).
[0187] 8. System according to item 7, wherein the detector circuit (60) is configured to provide an output signal indicating a presence of the high frequency noise and electrical disturbance on the communication bus (48).
[0188] 9. System according to any one of the preceding items 1 to 8, wherein the input circuitry (50) is configured to: [0189] a) determine whether a noise detection signal is received; and [0190] b) block the communication bus (48) in case the noise detection signal is received.
[0191] 10. System according to item 9, wherein the input circuitry (50) is further configured to: [0192] c) look for a further noise detection signal for a first predetermined time period; [0193] d) in case no further noise detection signal is received in step c), restart an operation of the communication bus (48); and [0194] e) in case a further noise detection signal is received in step c), wait until no noise detection signal is received for the first predetermined time period, i.e. until an end of a burst of pulses (130) emitted by an electrosurgical tool (25) is reached.
[0195] 11. System according to item 10, wherein the input circuitry (50) is further configured to: [0196] f) at the end of the burst of pulses (130), wait for a second predetermined time period and determine whether there is a further burst of pulses (130) detected during the second predetermined time period; [0197] g) in case no further burst of pulses (130) is detected in step f), restart the operation of the communication bus (48); and [0198] h) in case a further burst of pulses (130) is detected in step f), repeat step e) until no further burst of pulses (130) is detected in step f).
[0199] 12. System according to any one of the preceding items 1 to 11, further comprising an electrosurgical tool (25) configured to be inserted into a working channel (22) of the endoscope (2) and emitting an electrical high frequency noise signal comprising a burst of pulses (130) with a wide range of frequencies during operation.
[0200] 13. Display unit (18) comprising an input circuitry (50) configured to, preferably continuously or pulsatively, check for a high frequency noise and electrical disturbance on a communication bus (48), via which the display unit (18) is connectable to an endoscope (2) and which enables a communication between the input circuitry (50) and the endoscope (2).
[0201] 14. Display unit (18) according to item 13, wherein the input circuitry (50) is configured to terminate the communication via the communication bus (48) in case of a high frequency noise and electrical disturbance on the communication bus (48).
[0202] 15. Method of, preferably continuously or pulsatively, checking for a high frequency noise and electrical disturbance on a communication bus (48), via which a display unit (18) is connectable to an endoscope (2) and which enables a communication between the display unit (18) and the endoscope (2), and preferably of terminating the communication via the communication bus (48) in case of a high frequency noise and electrical disturbance on the communication bus (48).
[0203] 16. Endoscope (2) comprising a proximal endoscope handle or interface (4) comprising a handle or interface housing (38), a working channel access port (24) and a printed circuit board (40), wherein the printed circuit board (40) is accommodated inside the handle or interface housing (38); an insertion cord (6) extending from the proximal endoscope handle or interface (4) and comprising an insertion tube (8), a bending section (10) and a distal tip unit (12), wherein the distal tip unit (12) comprises a camera module (13) connected with the printed circuit board (40); a working channel (22) extending from the working channel access port (24) of the endoscope handle or interface (4) to the distal tip unit (12) of the insertion cord (6); and a detector circuit (60) configured to detect a presence of a high frequency noise and electrical disturbance arising from a use and an operation of an electrosurgical tool (25) in the working channel (22).
[0204] 17. Endoscope (2) according to item 16, wherein the detector circuit (60) comprises: a sensor part (62) configured to detect the presence of the high frequency noise and electrical disturbance, and a circuit part (64) electrically connected with the sensor part (62) and configured to provide an output signal indicating the presence of the high frequency noise and electrical disturbance.
[0205] 18. Endoscope (2) according to item 17, wherein the sensor part (62) is configured to input a voltage to the circuit part (64), and the circuit part (64) is configured to output the output signal based on the voltage input to the circuit part (64) from the sensor part (62).
[0206] 19. Endoscope (2) according to item 18, wherein the circuit part (64) is configured to set an upper threshold voltage (96, U1) and a lower threshold voltage (92, U2), and the output signal of the circuit part is changed when the voltage transmitted from the sensor part (62) is above the upper threshold voltage (96, U1) or below the lower threshold voltage (92, U2).
[0207] 20. Endoscope (2) according to any one of items 17 to 19, wherein the circuit part (64) is integrated in the printed circuit board (40) provided in the endoscope handle or interface (4).
[0208] 21. Endoscope (2) according to any one of items 17 to 20, wherein the circuit part (64) comprises a window comparator (84, 124, 126).
[0209] 22. Endoscope (2) according to any one of items 17 to 21, wherein the sensor part (62) is positioned around the working channel (22) so as to at least partly surround the working channel (22).
[0210] 23. Endoscope (2) according to any one of items 17 to 22, wherein the working channel (22) is formed by a connector part (76) comprising the access port (24), by a working channel tube (65) and by a tip housing of the distal tip unit (12), and the sensor part (62) is positioned on an outer surface of the connector part (76) or on an outer surface of the working channel tube (65).
[0211] 24. Endoscope (2) according to any one of items 17 to 23, wherein the sensor part (62) is an electrically conductive part and is configured so as to function as a capacitor (84).
[0212] 25. Endoscope (2) according to any one of items 17 to 24, wherein the sensor part (62) is formed as an electrically conductive foil or tape or as a flexible printed circuit board, so as to be able to be bent and shaped in order to follow an outer contour of the working channel (22).
[0213] 26. Endoscope (2) according to any one of items 17 to 22, wherein the sensor part (62) is arranged inside the proximal endoscope handle or interface (4).
[0214] 27. System comprising: an endoscope (2) according to any one of the preceding items 16 to 26; and a display unit (18) being connected with the printed circuit board (40) accommodated in the handle or interface housing (38) of the endoscope handle or interface (4), being configured to communicate with the camera module (13) provided in the distal tip unit (12) of the insertion cord (6) via a communication bus (48), and being configured to terminate a communication via the communication bus (48) when the detector circuit (60) detects the presence of the high frequency noise and electrical disturbance.
[0215] 28. System according to item 27, wherein the display unit (18) comprises an input circuitry (50) comprising a logic circuitry for communicating with the printed circuit board (40) accommodated in the handle or interface housing (38) of the endoscope handle or interface (4) and with the camera module (13) provided in the distal tip unit (12) of the endoscope (2), the input circuitry (50) being configured to indirectly or directly receive an output signal from the detector circuit (60).
[0216] 29. System according to item 27 or 28, further comprising: an electrosurgical tool (25) configured to be operated by high voltage pulses generating a high frequency noise and electrical disturbance during operation.
[0217] 30. System according to item 29, wherein the electrosurgical tool (25) is provided to be inserted into the working channel (22) of the endoscope (2), the high voltage pulses result in an electrical field, and the electrical field charges a sensor part (62) of the detector circuit (60) when the electrosurgical tool (25) is accommodated and operated inside the working channel (22).
[0218] The terms comprise(s), include(s), having, has, can, contain(s), and variants thereof, as used herein, are intended to be open-ended transitional terms that do not preclude the possibility of additional acts or structures. By contrast, the term consists, as used herein, is intended to be a closed-ended transitional term that precludes the possibility of additional acts or structures.
LIST OF REFERENCE SIGNS
[0219] 2 endoscope
[0220] 4 endoscope handle
[0221] 6 insertion cord
[0222] 8 insertion tube
[0223] 10 bending section
[0224] 12 distal tip unit
[0225] 13 camera module
[0226] 14 image sensor
[0227] 16 monitor/screen
[0228] 18 display unit
[0229] 19 image processing device
[0230] 20 plug and socket connection
[0231] 22 working channel
[0232] 24 access port
[0233] 25 electrosurgical tool
[0234] 26 first operating unit
[0235] 28 second operating unit
[0236] 30 cover
[0237] 31 steering wire
[0238] 32 gas/water injection valve
[0239] 34 suction valve
[0240] 36 top surface
[0241] 38 handle housing
[0242] 40 handle printed circuit board
[0243] 42 image sensor circuitry
[0244] 44 electrical wires
[0245] 46 electrical wires
[0246] 48 communication bus
[0247] 50 input circuit board
[0248] 51 noise mitigation logic
[0249] 52 FPGA
[0250] 56 working channel orifice
[0251] 58 cable
[0252] 60 detector circuit
[0253] 62 sensor part
[0254] 64 circuit part
[0255] 65 working channel tube
[0256] 66 waterjet tube
[0257] 68 rinsing tube
[0258] 70 insufflation tube
[0259] 72 first cable conduit
[0260] 73 first inlet channel
[0261] 74 second inlet channel
[0262] 75 outlet channel
[0263] 76 Y-connector
[0264] 78 cable
[0265] 80 second cable conduit
[0266] 84 capacitor
[0267] 86 IC chip
[0268] 90 input voltage
[0269] 92 lower threshold voltage
[0270] 94 output voltage
[0271] 96 upper threshold voltage
[0272] 98 capacitor
[0273] 100 zener diode
[0274] 102 resistor
[0275] 104 zener diode
[0276] 106 zener diode
[0277] 108 resistor
[0278] 110 capacitor
[0279] 112 resistor
[0280] 114 resistor
[0281] 116 resistor
[0282] 118 resistor
[0283] 120 resistor
[0284] 122 pull-up resistor
[0285] 124 first op-amp
[0286] 126 second op-amp
[0287] 130 burst of pulses