Endoscopy Device and Endoscopy System with Annular View
20230181014 · 2023-06-15
Assignee
Inventors
Cpc classification
A61B1/05
HUMAN NECESSITIES
A61B1/0005
HUMAN NECESSITIES
International classification
A61B1/00
HUMAN NECESSITIES
Abstract
An endoscopic device comprising a housing, first imaging means in the housing for detecting light emanating from objects from a predetermined first surrounding region annularly surrounding the endoscopic device and for producing a first image of the first surrounding region, a first image sensor for detecting the first image and for producing a first image signal, a first image sensor for sensing the first image and for generating a first image signal representing the first image, a second imaging means in the housing for sensing light emanating from objects in a predetermined second surrounding region and for generating a second image of the second surrounding region, and a second image sensor for sensing the second image and for generating a second image signal representing the second image. The first imaging device comprises a catadioptric imaging system with a first reflective surface, a second reflective surface, and a light refracting interface.
Claims
1. An endoscopy apparatus, comprising: a housing; a first imaging means in said housing for collecting light reflected, scattered, or emitted from objects in a predetermined first surrounding region annularly surrounding endoscopic device, and for generating a first image of said first surrounding area; a first image sensor for generating said first image, and for generating a first image signal representing said first image; a second imaging means in said housing for collecting light reflected, scattered, or emitted from objects in a predetermined second surrounding region, and for generating a second image of said second surrounding region; and a second image sensor for generating said second image, and generating a second image signal representing said second image, wherein said first imaging means comprises a catadioptric imaging means having a first reflective surface and a second reflective surface and a light refracting interface.
2. The endoscopy device of claim 1, wherein the first image sensor and the second image sensor are arranged back-to-back.
3. The endoscopy device of claim 2, wherein surface normals of photosensitive surfaces of the first image sensor and the second image sensor are orthogonal or substantially orthogonal to at least either an axis of symmetry of the first surrounding region or an axis of symmetry of the second surrounding region.
4. The endoscopy device of claim 1, further comprising: a line for transmitting at least either electrical power or a control signal to the second image sensor or for transmitting the second image signal from the second image sensor, wherein the line obscures a view of a portion of the first surrounding area; and a drive means for moving the conduit between a first position and a second position, wherein the portion of the view of the first surrounding area obscured in the first position of the line and the portion of the view of the first surrounding area obscured in the second position of the conduit do not overlap.
5. The endoscopic device of claim 1, wherein the first imaging device comprises a catadioptric lens with an optically transparent body, having a first reflective surface region and a second reflective surface region, wherein the first reflective surface region is concave and the second reflective surface region is convex relative to light propagating within the catadioptric lens, and an optical path from an object in the predetermined first surrounding region to the first image sensor extends from an entrance into the optically transparent body of the catadioptric lens with a reflection at the first concave reflecting surface, a reflection at the second convex reflecting surface, and an exit from the optically transparent body of the catadioptric lens.
6. The endoscopy device of claim 1, wherein the second imaging device is a catadioptric imaging device having a first reflective surface and a second reflective surface and a light refracting interface.
7. The endoscopy device of claim 5, wherein the second imaging device is a catadioptric imaging device having a first reflective surface and a second reflective surface and a light refracting interface.
8. The endoscopy device of claim 7, wherein the first surrounding region and the second surrounding region overlap.
9. The endoscopy device of claim 8, further comprising: A line for at least one of transmitting electrical power or a control signal to at least either the first image sensor or the second image sensor, and/or transmitting the image signal from either or both of the first and second image sensors, wherein the conduit obscures a portion of the first surrounding region and a portion of the second surrounding region, wherein the portion of the first surrounding region obscured by is circumferentially offset from the portion of the second surrounding region obscured.
10. The endoscopy device of claim 9, further comprising: a drive for moving said first imaging means and said second imaging means a predetermined distance along a predetermined path parallel to an axis of symmetry of said first imaging means and said second imaging means between a first position and a second position.
11. The endoscopy device of claim 9, further comprising: a drive for rotating said first imaging means and said second imaging means a predetermined circumferential distance about a predetermined path parallel to an to at least either an axis of symmetry of the first surrounding region or an axis of symmetry of the second surrounding region, between a first position and a second position.
12. The endoscopy device of claim 1, further comprising: means for projecting a light pattern onto objects in the first surrounding region.
13. The endoscopy device of claim 1, further comprising: optical coherence tomography means for detecting distances of objects from the distal end portion of the housing.
14. An endoscopy system comprising: The endoscopy device of claim 1; and an image processing device for receiving the first image signal from the first image sensor and the second image signal from the second image sensor.
15. The endoscopy system of claim 14, wherein the image processing means is further provided and adapted for providing a third image signal for controlling a combined rendering of the first image and the second image, wherein the first image annularly surrounds the second image.
16. The endoscopy system of claim 15 further comprising a line for transmitting at least either electrical power or a control signal to the second image sensor or for transmitting the second image signal from the second image sensor, wherein the line obscures a view of a portion of the first surrounding area; and a drive means for moving the conduit between a first position and a second position, wherein the portion of the view of the first surrounding area obscured in the first position of the line and the portion of the view of the first surrounding area obscured in the second position of the conduit do not overlap, wherein the image processing means is configured to provide a third image signal for controlling a rendering of an image in which an obscured area in a first image acquired in a first position is substituted by an unobscured area in a second image acquired in a second position.
17. The endoscopy system of claim 15, wherein the first and second imaging devices are catadioptric imaging devices each having a first reflective surface and a second reflective surface and a light refracting interface, wherein the first surrounding region and the second surrounding region overlap, and wherein the image processing means is further provided and adapted for at least either providing a third image signal for controlling a stereoscopic rendering of the first image for the left eye and the second image for the right eye of a viewer, or for determining a radial distance of an object from the endoscopic device from the positions of an object in the first image and in the second image.
18. The endoscopy system of claim 15 further comprising a means for projecting a light pattern onto objects in the first surrounding region, wherein the image processing means is further provided and adapted for determining a radial distance of an object from the distal end portion of the endoscopic device from a position of the light pattern in the first image.
19. The endoscopy system of claim 15 further comprising an optical coherence tomography means for detecting distances of objects from the distal end portion of the housing, wherein the image processing means is further provided and adapted for determining a radial distance of an object from the distal end portion of the endoscopic device from a position of the light pattern in the first image.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0068] In the following, embodiments are explained in more detail with reference to the accompanying figures.
[0069]
[0070]
[0071]
[0072]
[0073]
[0074]
[0075]
[0076]
[0077]
DETAILED DESCRIPTION OF THE INVENTION
[0078]
[0079] Endoscope 10 is an example of an endoscopy device for visually inspecting a natural or artificial cavity in a patient's body or other cavity. Another example of an endoscopy device in which many of the features, characteristics, and functions described below can be realized is an endoscopic capsule, which can be swallowed by a patient, for visually inspecting the internal surface of the digestive tract during passage of the capsule through the digestive tract.
[0080]
[0081] The endoscope 10 includes a housing 20 having a distal end portion 22. The housing 20, and in particular the distal end region 22 of the housing 20, may comprise one or more rigid or resilient materials. Portions of the housing may be opaque to light visible to the healthy human eye. However, the distal end portion 22 of the housing 20 includes a first optically transparent window portion 24 that forms an annular band around the housing. An annular first surrounding region 26 externally adjoining the first optically transparent window region 24, that is, the field of view, can be visually detected by means of the endoscope, as described below.
[0082] A plurality of first light sources 28 are provided within the distal end region 22 of the housing 20 for generating illumination light, for example broadband light perceived as white by the healthy human eye. Alternatively or additionally, the first light sources 28 or parts thereof are provided for generating excitation light for exciting fluorescence. Illumination light and/or excitation light generated by the first light sources 28 exits the distal end 12 of the endoscope through the first optically transparent window region 24 to illuminate and/or excite fluorescence on or in objects in the first surrounding region 26.
[0083] A catadioptric lens 40 is further disposed within the distal end portion 22 of the housing 20. The catadioptric lens 40 comprises a body of glass or other optically transparent material having an annular and curved light input surface 42, an annular and curved first reflective surface area 44, an annular and curved second reflective surface area 46, and a curved and single contiguous light output surface 48. The entire catadioptric lens 40 is rotationally symmetric with respect to the longitudinal and symmetric axis 18 of the distal end portion 22 of the housing 20.
[0084] Further provided within the distal end portion 22 of the housing 20 are another lens 50 and a first image sensor 54 having a light sensitive layer 56. The image sensor 54 is, for example, a CCD or CMOS sensor. The light-sensitive layer 56 of the image sensor 54 is arranged at or near a surface of the image sensor 54 facing the further lens 50 and is laterally divided into a plurality of light-sensitive cells or pixels generally arranged in a matrix-like manner.
[0085] Illumination light reflected , scattered, or emitted from an object in the first surrounding region 26, may enter the distal end region 22 of the housing 20 through the first optically transparent window region 24. Light entering the interior of the distal end region 22 of the housing through the first optically transparent window region enters the catadioptric lens 40 through the light entry surface 42, is sequentially reflected within the catadioptric lens first at the first reflective surface region 44 and then at the second reflective surface region 46, then exits the catadioptric lens 40 through the light exit surface 48, and is focused into the photosensitive layer 56 of the first image sensor 54 by the further lens 50. Thus, an image of the annular first surrounding region 26 is formed in the light sensitive layer 56 of the first image sensor 54. The first image sensor 54 generates an analog or digital image signal representing this image.
[0086] The distal end portion 22 of the housing 20 further includes a second optically transparent window portion 64. In the illustrated example, the second optically transparent window region 64 is provided on a distal end surface of the distal end region 22 of the housing 20. A second surrounding region 66 externally adjacent to the second optically transparent window region 64 may be visually detected by the endoscope as described below.
[0087] The distal end portion 22 of the housing 20 further includes a plurality of second light sources 68 for generating illumination light, such as broadband light perceived as white by the healthy human eye. Alternatively or additionally, the second light sources 68 or portions thereof are provided for generating excitation light for exciting fluorescence. In the example shown, the second light sources 68 are disposed on the distal end surface of the distal end portion 22 of the housing 20. Illumination light and/or excitation light generated by the second light sources 68 illuminates objects in the second surrounding region 66 and/or excites fluorescence on or in them.
[0088] A further lens 80 forming a second imaging device is further disposed within the distal end region 22 of the housing 22. The second imaging device 80 is disposed proximally of the second optically transparent window region 64.
[0089] A second image sensor 84 having a photosensitive layer 86 is further disposed within the distal end portion 22 of the housing 22 and proximal to the second imaging device 80.
[0090] The second image sensor 84 is, for example, a CCD or CMOS sensor. The light-sensitive layer 86 of the second image sensor 84 is arranged in particular at or near a surface of the image sensor 54 facing the second imaging device 80 and is laterally subdivided into a plurality of light-sensitive cells or pixels arranged generally in a matrix-like manner.
[0091] Electrical lines/leads/conduits 30 (usually referred to as “lines” throughout the disclosure) are further provided within the distal end portion 22 of the housing 22, the distal ends of which are connected to the second image sensor 66, to the first light sources 28, and to the second light sources 68. The lines 30 are provided and configured for transmitting electrical power and control signals to the second image sensor 64, to the first light sources 28, and to the second light sources 68, and for electrically or optically transmitting analog or digital image signals from the second image sensor 64. To this end, proximal ends of the lines 30 may be directly or indirectly connected to a power source and/or light controller and to a camera control unit (CCU).
[0092] The lines 30 are arranged laterally of the catadioptric lens 40 between the first optically transparent window region 24 of the housing and the light entrance surface 42 of the catadioptric lens 40. The lines 30 may be concentrated in a single bundle or strand or, as indicated in
[0093] Illumination light reflected, scattered or emitted from an object in the second surrounding region 66 can enter the distal end region 22 of the housing 20 through the second optically transparent window region 64. Light entering the interior of the distal end region 22 of the housing through the second optically transparent window region 66 is focused into the photosensitive layer 86 of the second image sensor 84 by the second imaging device 80. Thus, an image of the second surrounding region 66 is formed in the photosensitive layer 86 of the second image sensor 84. The second image sensor 84 generates an analog or digital image signal representing this image.
[0094] In the embodiment shown in
[0095] A drive device 90 is further provided in the housing 20. The housing 20 includes an annular resilient region 92 proximal to the distal end region 22, and a rotational bearing within the annular resilient region 92 that is only indicated in
[0096] Alternatively, and in a departure from the illustration in
[0097] A projection device 94 may be further provided in the distal end region 22 for projecting a pattern of light onto objects in the first surrounding region 26. This projection device 94 may occupy a significantly larger spatial area than schematically indicated in
[0098] The projection device 94 may comprise one or more laser diodes and/or other light-emitting diodes or other light sources and one or more light-refracting and/or light-reflecting surfaces, in order to generate a light pattern which, on the one hand, has the highest possible contrast and, on the other hand, is distributed over the largest possible spatial area. The projection device is generally designed to project points or lines onto objects in the first surrounding area 26.
[0099] Based on the positions of the light pattern in an image of the first surrounding region 26 captured by the first image sensor 54, the distances of the surface regions onto which the light pattern is projected from the distal end region 22 of the housing 20 can be calculated by triangulation, as is known in the art.
[0100] An optical coherence tomography device 96 may be further provided in the distal end region 22 as an alternative or in addition to the projection device 94. The optical coherence tomography device enables optical coherence tomography in the first surrounding region 26 or in a part of the first surrounding region 26 and/or in an adjacent spatial region. Optical coherence tomography can be used to acquire a three-dimensional image not only of a surface of tissue, but also of structures underlying that surface.
[0101]
[0102] In
[0103] In their first rotational positions shown in solid lines, the conduits 30 visually block portions 32 of the first surrounding region 30 outlined and shaded in solid lines. In the image of the first surrounding region 26 produced by the first imaging device comprising the first catadioptric lens 40 and the further lens 50, and captured by the first image sensor 54, the portions 32 of the first surrounding region 26 shown in solid lines are obscured by the lines 30.
[0104] In their second rotational positions shown in dashed lines, the lines 30 visually block portions 32 of the first surrounding region 26 outlined and shaded in dashed lines. In the image of the first surrounding area 26 generated by the first imaging device 40, 50 and captured by the first image sensor 54, the portions 32 of the first surrounding region 26 shown in dashed lines are visually blocked/obscured by the lines 30.
[0105] The portions 32 of the first surrounding region 26 visually blocked or obscured at the two positions of the lines 30 shown in
[0106] Depending on the design of the optical coherence tomography device, portions in the images acquired by the optical coherence tomography device may also be visually blocked or obscured by the lines 30. The oscillating rotation of the distal end portion 22 of the housing or at least of the lines 30 may also allow substitution of occluded portions in the images acquired by the optical coherence tomography device, and thus reconstruction of a complete image.
[0107]
[0108] As in the embodiment shown by reference to
[0109]
[0110] As in the embodiments illustrated with reference to
[0111] Both imaging devices 40, 50; 70, 80 are arranged mirror-symmetrically to a mirror plane orthogonal to the longitudinal and symmetrical axis 18 of the distal end region 22 of the housing 20. Both imaging devices 40, 50; 70, 80 are each rotationally symmetrical with respect to the longitudinal and symmetrical axis 18 of the distal end region 22 of the housing 20. Both imaging devices 40, 50; 70, 80 each comprise a catadioptric lens 40, 70 and a further lens 50, 80. The catadioptric lens 40 of the first imaging device comprises a body of glass or other optically transparent material having an annular and curved light input surface 42, an annular and curved first reflective surface area 44, an annular and curved second reflective surface area 46 and a curved and single contiguous light output surface 48. The catadioptric lens 70 of the second imaging device includes a body of glass or other optically transparent material having an annular and curved light input surface 72, an annular and curved first reflective surface area 74, an annular and curved second reflective surface area 76, and a curved and single contiguous light output surface 78.
[0112] In the embodiment shown in
[0113] To the extent that the surrounding areas overlap, the embodiment shown in
[0114] Alternatively or additionally, an image processing device such as an image processor including image processing circuitry, can determine the distances of structures recognizable in both images by triangulation. Thus, data about the spatial shape of objects, in particular surfaces of objects in the first surrounding area, can be obtained from the two images. Therefore, the embodiment shown in
[0115] In the example shown in
[0116] A light source 28 is indicated between the two catadioptric lenses 40, 70, which emits illumination light and/or excitation light. Illumination light and/or excitation light generated by the light source 28 exits the housing 20 through the optically transparent window area 24 of the housing 20 and falls on objects in the surrounding areas.
[0117] Alternatively to or in addition to the light source 28, further devices may be arranged between the catadioptric lenses 40, 70.
[0118]
[0119] As in the embodiment shown in
[0120] In a departure from the illustration in
[0121] Alternatively, and also differing from the illustration in
[0122] Deviating from the embodiment shown in
[0123] In contrast to the illustration in
[0124] In the embodiment shown in
[0125] In the embodiment shown in
[0126]
[0127] In
[0128] The area of the first surrounding region 26 occluded by the lines 30 and the area of the second surrounding region 66 occluded by the lines 30 are located at different positions in the circumferential direction. Therefore, in the image of the first surrounding region 26 captured by the first image sensor 54, the occluded region 26 may be substituted by regions from the image of the second surrounding region 66 captured by the second image sensor 85, and vice versa to the extent that the surrounding regions 26, 66 overlap each other. If a plurality of images are captured by both image sensors 54, 84 during a movement of the distal end region 22 of the housing 20 parallel to its longitudinal and symmetrical axis 18, images captured at different times in the same or similar positions of the image sensors may be used for mutual substitution.
[0129] To this end, the drive device shown in
[0130] From an endoscope according to one of the embodiments illustrated with reference to
[0131]
[0132] The first predetermined surrounding region 26 at the first point in time shown in solid lines and the second predetermined surrounding region 26 at the second point in time shown in dashed lines are different, i.e., offset from each other, but overlap.
[0133] The schematic diagram in
[0134] In
[0135] In
[0136]
[0137]
REFERENCE SIGN
[0138] 10 Endoscope as an example of an endoscopy device [0139] 12 distal end of the endoscope 10 [0140] 14 Endoscope shaft [0141] 16 Proximal end of endoscope 10 [0142] 18 Symmetry axis [0143] 20 Shaft housing [0144] 22 distal end area of the housing 20 [0145] 24 first optically transparent window area of the housing 20 [0146] 26 first predetermined surrounding region of distal end portion [0147] 28 first light source of the endoscope 10 [0148] 30 Line/lead/electrical conduit for transmitting electrical power, control signals, and/or a video signal [0149] 32 Part of first surrounding region 26 shaded by line 30 [0150] 36 Part of second surrounding region shaded by line 30 [0151] 40 (first) catadioptric lens of a first imaging device [0152] 42 Curved light entrance surface of the (first) catadioptric lens 40 [0153] 44 first reflective surface area of the (first) catadioptric lens 40 [0154] 46 second reflective surface area of the (first) catadioptric lens 40 [0155] 48 Light-emitting surface of the (first) catadioptric lens 40 [0156] 50 further lens of the first imaging device [0157] 52 Reflective surface [0158] 54 First image sensor of the endoscope 10 [0159] 56 photosensitive layer of the first image sensor 50 [0160] 58 Board [0161] 64 second optically transparent window area of the housing 20 [0162] 66 second predetermined surrounding area of distal end portion 22 [0163] 68 second light source of the endoscope 10 [0164] 70 second catadioptric lens of a second imaging device [0165] 72 Curved light entrance surface of the second catadioptric lens 70 [0166] 74 first reflective surface area of second catadioptric lens 70 [0167] 76 second reflective surface area of second catadioptric lens 70 [0168] 78 Light-emitting surface of the second catadioptric lens 70 [0169] 80 (further) lens of the second imaging device [0170] 82 Reflective surface [0171] 84 Second image sensor of the endoscope 10 [0172] 86 photosensitive layer of the second image sensor 84 [0173] 90 Drive device for moving the distal end portion 22 [0174] 92 Elastic area of the housing 20 [0175] 94 Projection device for projecting a light pattern onto objects in the first surrounding region 26 [0176] 96 Optical coherence tomography device [0177] 140 Hollow organ/lumen