METHODS OF USING AN ANGLED ENDOSCOPE FOR VISUALIZING A BODY CAVITY WITH ROBOTIC SURGICAL SYSTEMS

Abstract

A method of visualizing a body cavity during a surgical procedure including positioning an elongated body of an angled endoscope in a first position within a body cavity of a patient, rotating the elongated body about a longitudinal axis in response to a command point, capturing a plurality of images with an image capture device positioned within the elongated body as the elongated body is rotated, and generating a panoramic view of the body cavity from the plurality of images. In the first position of the elongated body, a surgical site is within a field of view of the image capture device. The field of view of the image capture device capturing a first volume of the body cavity, including the surgical site, when the angled endoscope is in the first position.

Claims

1-20. (canceled)

21. A method of visualizing a body cavity during a surgical procedure, the method comprising: positioning an elongated body of an angled endoscope in a first position within a body cavity of a patient such that a surgical site and an end effector of a surgical instrument are within a field of view of an image capture device positioned in a distal end portion of the elongated body; capturing a first plurality of images with the image capture device in the first position; translating the elongated body of the angled endoscope from the first position to a second position within the body cavity in response to a command point; rotating the elongated body about a longitudinal axis thereof in the second position; capturing a second plurality of images with the image capture device in the second position as the elongated body is rotated; and generating a panoramic view of the body cavity from the second plurality of images.

22. The method according to claim 21, wherein the end effector is not within the field of view in the second position.

23. The method according to claim 21, further comprising: generating the command point when the end effector is not within the field of view.

24. The method according to claim 23, further comprising swapping the end effector with a second end effector when the end effector is not within the field of view.

25. The method according to claim 23, further comprising introducing another surgical instrument to the surgical site when the surgical instrument is not within the field of view.

26. The method according to claim 21, further comprising: returning the elongated body to the first position after the panoramic view of the body cavity has been generated from the plurality of images.

27. The method according to claim 21, wherein the elongated body is pivoted at a pivot point and pivotable about a pitch axis orthogonal to the longitudinal axis.

28. The method according to claim 27, wherein the elongated body is pivotable about a yaw axis that is orthogonal to the pitch axis and the longitudinal axis, and wherein the pitch, longitudinal, and yaw axes intersect at the pivot point.

29. The method according to claim 21, wherein the panoramic view of the body cavity is panned or zoomed.

30. A surgical system comprising: a surgical instrument; an end effector configured to act on tissue at a surgical site; and an endoscope having an elongated body, configured to be positioned in a first position within a body cavity of a patient such that the surgical site and the end effector are within a field of view of an image capture device positioned in a distal end portion of the elongated body, and configured to capture a first plurality of images of the body cavity by the image capture device in the first position, wherein the elongated body of the endoscope is translated from the first position to a second position and rotated about a longitudinal axis thereof in the second position within the body cavity in response to a command point, wherein the image capture device captures a second plurality of images in the second position as the elongated body is rotated, and wherein the surgical system generates a panoramic view from the second plurality of images.

31. The surgical system according to claim 30, wherein the end effector is not within the field of view in the second position.

32. The surgical system according to claim 30, wherein the command point is generated when the end effector is not within the field of view.

33. The surgical system according to claim 32, wherein the end effector is not within the field of view when the end effector is swapped with a second end effector.

34. The surgical system according to claim 32, wherein the surgical instrument is not within the field of view when another surgical instrument is introduced to the surgical site.

35. The surgical system according to claim 30, wherein the elongated body is returned to the first position after the panoramic view of the body cavity has been generated from the second plurality of images.

36. The surgical system according to claim 30, wherein the elongated body includes a pivot point and pivotable about a pitch axis orthogonal to the longitudinal axis.

37. The surgical system according to claim 36, wherein the elongated body is pivotable about a yaw axis that is orthogonal to the pitch axis and the longitudinal axis, and wherein the pitch, longitudinal, and yaw axes intersect at the pivot point.

38. The surgical system according to claim 30, further comprising a user interface including a wearable display configured to display the panoramic view such that movement of the wearable display updates a view of a clinician of the panoramic view.

39. The surgical system according to claim 30, wherein the panoramic view of the body cavity is panned or zoomed.

40. A robotic surgical system comprising: a first linkage connected with an end effector; a second linkage connected with an endoscope having an elongated body, the endoscope being configured to act on tissue of a patient at a surgical site within a body cavity of a patient such that the surgical site and the end effector are within a field of view of an image capture device positioned in a distal end portion of the elongated body and configured to capture a first plurality of images of the body cavity by the image capture device in the first position; and a robot base providing a base for the first and second linkages, wherein the elongated body of the endoscope is translated from the first position to a second position and rotated about a longitudinal axis thereof in the second position within the body cavity in response to a command point, wherein the image capture device captures a second plurality of images in the second position as the elongated body is rotated, and wherein the system generates a panoramic view from the second plurality of images.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Various aspects of the present disclosure are described hereinbelow with reference to the drawings, which are incorporated in and constitute a part of this specification, wherein:

[0014] FIG. 1 is a schematic, side view of an endoscope provided in accordance with the present disclosure;

[0015] FIG. 2 is a cut-away view of a body cavity of a patient with the endoscope of FIG. 1 in a first position and a surgical instrument positioned at a surgical site within a field of view of the endoscope;

[0016] FIG. 3 is a cut-away view of the body cavity of the patient of FIG. 2 with the surgical instrument withdrawn from the field of view of the endoscope;

[0017] FIG. 4 is a cut-away view of the body cavity of the patient of FIG. 2 with the endoscope in a second position and with the surgical instrument recaptured in the field of view of the endoscope;

[0018] FIG. 5 is a schematic illustration of a user interface and a robotic system in accordance with the present disclosure; and

[0019] FIG. 6 is a flow diagram of a method of viewing a body cavity of a patient in accordance with the present disclosure.

DETAILED DESCRIPTION

[0020] Embodiments of the present disclosure are now described in detail with reference to the drawings in which like reference numerals designate identical or corresponding elements in each of the several views. As used herein, the term “clinician” refers to a doctor, a nurse, or any other care provider and may include support personnel. Throughout this description, the term “proximal” refers to the portion of the device or component thereof that is closest to the clinician and the term “distal” refers to the portion of the device or component thereof that is farthest from the clinician.

[0021] Generally, this disclosure relates to methods and devices for visualizing a body cavity of a patient during a minimally invasive surgical procedure with an endoscope. Specifically, this disclosure details the use of an angled endoscope for use with a robotic surgical system that can function in the role of a 0° endoscope and provides panoramic views of a surgical site within a body cavity of a patient. As detailed below, the angled endoscope may be function as a 0° endoscope view of the surgical site where a tool is acting on tissue and may be repositionable to provide a panoramic view of the body cavity surrounding the surgical site. The angled endoscope may automatically provide such a panoramic view at a predetermined command point or time interval (e.g., at predetermined time intervals or at a particular step during the surgical procedure). Additionally or alternatively, the angled endoscope may provide such a panoramic view in response to a user generated command point (e.g., at the request of a clinician). The endoscope may be used as a standalone instrument or may be used as part of a robotic surgical system.

[0022] Referring now to FIG. 1, an angled endoscope 10 is provided in accordance with the present disclosure and includes an elongated body 12 that defines a longitudinal axis “A-A” of the angled endoscope 10. The elongated body 12 extends to a distal end portion 14 that includes an angled distal end 16 that defines an angle “θ” from a line or plane that extends perpendicular to the longitudinal axis “A-A”. As shown, the angle “θ” is about 30°; however, the angle “θ” may be in a range of about 0° to about 60°.

[0023] The angled endoscope 10 includes an image capture device 18 (e.g., a camera) that captures images of the body cavity “C” (FIG. 2) through the distal end 16 of the elongated body 12. The images may be in the form of still images or video. As shown, the image capture device 18 is positioned in the distal end portion 14 of the elongated body 12; however, it is contemplated that the image capture device 18 may be positioned anywhere within the elongated body 12. It is also contemplated that the image capture device 18 may be positioned outside of the elongated body 12 and may include a fiber optic cable (not shown) positioned within the elongated body 12 to capture images through the distal end 16 of the elongated body 12. The image capture device 18 has a conical field of view “FV” through the distal end 16 of the elongated body 12 such that one edge or a first edge of the field of view “FV” is approximately parallel to the longitudinal axis “A-A” and another, opposite, or second edge of the field of view “FV” extends at an angle “α” of approximately 30° with the longitudinal axis “A-A”. It will be appreciated that for different angles “θ” the angle of the second edge of the field of view “FV” will also change.

[0024] With additional reference to FIG. 2, the angled endoscope 10 is inserted through an opening “O” in a body cavity “C” of a patient for visualizing the body cavity “C” during a surgical procedure. The opening “O” may be a naturally occurring orifice or an incision. The angled endoscope 10 may be inserted through a cannula 110 that is positioned within the opening “O”.

[0025] During a surgical procedure, the elongated body 12 is positioned such that the longitudinal axis “A-A” passes through the surgical site “S” such that the entire surgical site “S” is within the conical field of view “FV”. With particular reference to FIG. 1, the angled endoscope 10 is moveable in at least four degrees of freedom to align the longitudinal axis “A-A” with the surgical site “S” and to view the body cavity with the image capture device 18. First, the elongated body 12 is translatable in and out along the longitudinal axis “A-A”. Second, the elongated body 12 is rollable or rotatable about the longitudinal axis “A-A”. Thirdly, the elongated body is pivotable about a pitch axis that intersects and is orthogonal to the longitudinal axis “A-A” at pivot point “P”. Finally, the elongated body 12 is pivotable about a yaw axis that intersects and is orthogonal to the longitudinal axis “A-A” and orthogonal to the pitch axis at the pivot point “P”. As shown in FIG. 2, the pivot point “P” is the point where the longitudinal axis “A-A” passes through a wall “W” defining the body cavity “C”.

[0026] Continuing to refer to FIG. 2, during a surgical procedure, a surgical instrument 200 is inserted through an opening “O” in the wall “W” defining the body cavity “C”. The surgical instrument 200 may be inserted through the same opening “O” as the angled endoscope 10 or through a different opening “O” as shown in FIG. 2. The surgical instrument 200 includes an end effector 210 to act on tissue of a patient at the surgical site “S”. The elongated body 12 of the angled endoscope 10 is positioned to visualize a volume of the body cavity “C” such that surgical site “S” and the end effector 210 of the surgical instrument 200 are within the field of view “FV” of the image capture device 18. The elongated body 12 of the angled endoscope 10 is positioned such that the end effector 210 of the surgical instrument 200 and the surgical site “S” are within the field of view “FV” of the image capture device 18. The angled endoscope 10 may operate as a 0° endoscope to view the surgical site “S” by manipulating the elongated body 12 (e.g., pivoting the angled endoscope 10 about its yaw and pivot axes). It will be appreciated that as the distance between the image capture device 18 and the surgical site “S” is reduced, details of images of the surgical site “S” captured by the image capture device 18 is increased.

[0027] Referring to FIG. 3, during the surgical procedure the surgical instrument 200 may be withdrawn from the surgical site “S” or out of the body cavity “C” such that the end effector 210 of the surgical instrument 200 is withdrawn from the surgical site “S” and the field of view “FV” of the image capture device 18. The surgical instrument 200 may be withdrawn from the surgical site “S” for various reasons including, but not limited to, to swapping the surgical instrument 200 for another surgical instrument (not shown), to reloading the end effector 210, and repositioning the end effector 210. As the surgical instrument 200 is withdrawn from the field of view “FV”, the surgical instrument 200 may contact tissue within the body cavity “C” outside of the field of view “FV” of the image capture device 18.

[0028] With reference to FIG. 4, the angled endoscope 10 may be translated out of the body cavity “C”, along the longitudinal axis “A-A”, such that the distal end 16 of the angled endoscope 10 is moved away from the surgical site “S”. As the distal end 16 of the angled endoscope 10 is moved away from the surgical site “S”, the field of view “FV” of the image capture device 18 encompasses a larger volume of the body cavity “C”, wherein the end effector 210 of the surgical instrument 200 is within the field of view “FV” when the end effector 210 is withdrawn from the surgical site “S” while remaining within the body cavity “C” such that tissue surrounding the end effector 210 is within the field of view “FV” of the image capture device 18. In addition, the angled endoscope 10 may be rolled or rotated about the longitudinal axis “A-A” to capture a plurality of images within a panoramic field of view “PV” that includes the original field of view “FV”. This panoramic field of view “PV” is a panoramic view of the surgical site “S” created by stitching together the plurality of images captured during the rolling or rotation of the angled endoscope 10. The panoramic field of view “PV” provides visualization of the body cavity “C” surrounding the surgical site “S” to allow a clinician greater visualization of the body cavity “C”. It is contemplated that during the rolling or rotation of the angled endoscope 10, the angled endoscope 10 may also be pivoted about the pitch axis and/or the yaw axis (FIG. 1) to adjust a focal point of the image capture device 18, to increase the panoramic field of view “PV”.

[0029] As detailed above, the rolling or rotation of the angled endoscope 10 about the longitudinal axis “A-A” is a full rotation of 360°; however, the rotation of the angled endoscope 10 may be a partial rotation of less than 360°. When the angled endoscope 10 is only partially rolled or rotated to generate a panoramic field of view “PV”, the angled endoscope 10 may be rolled or rotated back to a pre-rotated position. It is contemplated that the full or partial rolling or rotation of the angled endoscope 10 has a duration of approximately 1.0 seconds; however, the full or partial rotation of the angled endoscope may have a duration of about 0.1 seconds to about 2.0 seconds.

[0030] The generation of a panoramic field of view “PV” may be initiated automatically at a predetermined command point or when a command point is initiated by a clinician. Some examples of a predetermined command point include, but are not limited to, when the end effector 210 is withdrawn from the surgical site “S”, when a surgical instrument (e.g., surgical instrument 200) is inserted through an opening “O”, when a surgical instrument is withdrawn from an opening “O”, when a surgical instrument is withdrawn from the field of view “FV”, or at time intervals.

[0031] Referring to FIG. 5, the angled endoscope 10 and the surgical instrument 200 may be part of a robotic surgical system 301 in accordance with the present disclosure. The robotic surgical system 301 includes a robotic system 310, a processing unit 330, and a user interface 340. The robotic system 310 generally includes linkages 312 and a robot base 318. The linkages 312 moveably support a tool (e.g., angled endoscope 10 or surgical instrument 200). The linkages 312 may be in the form of arms each having an end 314 that supports a tool. The user interface 340 is in communication with the robot base 318 through the processing unit 330.

[0032] The user interface 340 includes a display device 344 which is configured to display three-dimensional images. The display device 344 displays three-dimensional images of the surgical site “S” which may include data captured by imaging devices positioned on the ends 314 of the linkages 312 (e.g., angled endoscope 10) and/or include data captured by imaging devices that are positioned about the surgical theater (e.g., an imaging device positioned within the surgical site “S”, an imaging device positioned adjacent the patient, imaging device 356 positioned at a distal end of an imaging arm 352). The imaging devices may capture visual images, infra-red images, ultrasound images, X-ray images, thermal images, and/or any other known real-time images of the surgical site “S”. The imaging devices transmit captured imaging data to the processing unit 330 which creates three-dimensional images of the surgical site “S” in real-time from the imaging data and transmits the three-dimensional images to the display device 344 for display.

[0033] The user interface 340 also includes input arms or handles 342 which allow a clinician to manipulate the robotic system 310 (e.g., move the linkages 312, the ends 314 of the linkages 312, and/or the tools). Each of the input handles 342 is in communication with the processing unit 330 to transmit control signals thereto and to receive feedback signals therefrom. Each of the input handles 342 may include an input device which allow the surgeon to manipulate (e.g., clamp, grasp, fire, open, close, rotate, thrust, slice, etc.) the tools supported at the ends 314 of the linkages 312.

[0034] During a surgical procedure, the robot system 310 may operate the angled endoscope 10 to function as a 0° endoscope while a clinician is engaged with the user interface 340 by manipulating the linkages 312. When a clinician disengages from the user interface 340 (e.g., when the clinician releases the input handles 342, when the clinician looks away from the display 344) the user interface 340 may generate a command point such that the processing unit 330 sends a signal to the robot system 310 to generate a panoramic view of the surgical site “S” with the angled endoscope 10, as detailed above. Additionally, the robotic system 310 may use kinematic tracking to generate a command point when a tool (e.g., surgical instrument 200) completes a particular movement (e.g., when the tool is withdrawn beyond a threshold distance, when one tool is exchanged for another tool).

[0035] The user interface 340 then displays the panoramic view of the surgical site “S” on the display 344. As detailed above the display 344 may be a 3D display such that the panoramic view of the surgical site “S” is displayed in 3D. The display 344 may be an interactive display such that a clinician may pan, rotate, zoom in, and/or zoom out of areas of interest within the panoramic view of the surgical site. Additionally or alternatively, it is contemplated that the display 344 may include a display helmet 344a such that the movement of a head of clinician may allow a clinician to interact with the panoramic view of the surgical site “S”. The helmet 344a may use inertial tracking to detect movement of the head of a clinician. Further, it is contemplated that the user interface 340 may include a portable display or monitor 344b that is moveable relative to the display 344. The portable display 344b displays a view of the surgical site “S” and may use inertia tracking to update the view of the surgical site “S” on the portable display 344b as the portable display 344b is moved relative to the display 344. In addition, a clinician may interact with the portable display 344b to update the view of the surgical site “S” on the portable display 344b. It is also contemplated that the portable display 344b may be used without the display 344.

[0036] Referring now to FIG. 6, a method 400 of visualizing a body cavity during a surgical procedure is described in accordance with the present disclosure utilizing an angled endoscope (e.g., angled endoscope 10). Initially, the angled endoscope is positioned within a body cavity “C” of a patient (Step 410). During the surgical procedure the angled endoscope may be operated as a 0° endoscope (Step 420). The angled endoscope may be operated as a 0° endoscope by manipulating the angled endoscope about its pitch, yaw, and longitudinal axes as detailed above.

[0037] During the surgical procedure, a command point is generated (Step 430). In response to the command point, the angled endoscope is rotated about is longitudinal axis (Step 440). The angled endoscope may be withdrawn within the body cavity “C” before the angled endoscope is rotated and returned to the position it had before being withdrawn after the angled endoscope is rotated (Step 444). As the angled endoscope is rotated, an image capture device 18 is disposed within the angled endoscope captures a plurality of images (Step 450). A panoramic view of the body cavity “C” is generated from the plurality of images (Step 460). The panoramic view is displayed to a clinician as detailed above (Step 470). The clinician may interact with the panoramic view as detailed above.

[0038] While several embodiments of the disclosure have been shown in the drawings, it is not intended that the disclosure be limited thereto, as it is intended that the disclosure be as broad in scope as the art will allow and that the specification be read likewise. Any combination of the above embodiments is also envisioned and is within the scope of the appended claims. Therefore, the above description should not be construed as limiting, but merely as exemplifications of particular embodiments. Those skilled in the art will envision other modifications within the scope of the claims appended hereto.