CAPSULE ENDOSCOPE SYSTEM
20170196442 ยท 2017-07-13
Assignee
Inventors
Cpc classification
International classification
Abstract
A system includes: a capsule endoscope configured to be introduced into a subject to generate an image signal, and a control device for generating an image of the subject. The capsule endoscope includes: a first transmitter for sending information indicating a posture of the capsule endoscope; a first receiver for receiving a control signal from the control device; and a changing mechanism for changing the posture of the capsule endoscope based on the control signal. The control device includes: a second receiver for acquiring the information indicating the posture; a detector for detecting the posture of the capsule endoscope based on the information indicating the posture; a calculator for calculating a target posture of the capsule endoscope based on the image; and a signal generator for generating the control signal based on a detection result of the posture of the capsule endoscope and on the target posture.
Claims
1. A capsule endoscope system comprising: a capsule endoscope configured to be introduced into a subject, configured to perform imaging to generate an image signal, and configured to wirelessly transmit the image signal; and a control device configured to receive the image signal to generate an image of an inside of the subject based on the image signal, wherein the capsule endoscope comprises: a first transmitter configured to send information indicating a posture of the capsule endoscope; a first receiver configured to receive a signal transmitted from the control device; and a posture changing mechanism configured to change the posture of the capsule endoscope, wherein the control device comprises: a second receiver configured to acquire the information indicating the posture sent by the first transmitter; a posture detector configured to detect the posture of the capsule endoscope based on the information indicating the posture; a target posture calculator configured to calculate a target posture of the capsule endoscope based on the image; a posture control signal generator configured to generate a control signal for changing the posture of the capsule endoscope based on a detection result of the posture of the capsule endoscope and based on the target posture; and a second transmitter configured to transmit the control signal to the capsule endoscope, wherein the first receiver is configured to receive the control signal transmitted by the second transmitter, and the posture changing mechanism is configured to change the posture of the capsule endoscope based on the control signal received by the first receiver.
2. The capsule endoscope system according to claim 1, wherein the first transmitter comprises a coil configured to receive power supply to generate a magnetic field, the second receiver comprises a plurality of coils configured to detect the magnetic field to output a plurality of detection signals, respectively, and the posture detector is configured to detect the posture of the capsule endoscope based on the plurality of detection signals respectively output by the plurality of coils.
3. The capsule endoscope system according to claim 1, wherein the first transmitter is configured to transmit the image through a radio wave, the second receiver comprises a plurality of antennas configured to receive the radio wave, and the posture detector is configured to detect the posture of the capsule endoscope based on intensity of the radio wave received by each of the plurality of antennas.
4. The capsule endoscope system according to claim 1, wherein the posture changing mechanism is configured to change the posture of the capsule endoscope by changing a position of a center of gravity of the capsule endoscope.
5. The capsule endoscope system according to claim 1, wherein the target posture calculator is configured to calculate the target posture such that a specific portion of the subject shown in the image coincides with a center of an imaging visual field of the capsule endoscope.
6. The capsule endoscope system according to claim 1, further comprising an input unit configured to input a signal in response to an operation from outside into the target posture calculator, wherein when an input for specifying a specific portion in the image is input into the target posture calculator from the input unit, the target posture calculator is configured to calculate the target posture such that a position of the subject corresponding to the specified specific portion coincides with a center of an imaging visual field of the capsule endoscope.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0008]
[0009]
[0010]
[0011]
[0012]
[0013]
[0014]
[0015]
[0016]
[0017]
[0018]
[0019]
[0020]
[0021]
[0022]
[0023]
DETAILED DESCRIPTION
[0024] Hereinafter, a capsule endoscope system according to embodiments of the present invention will be described with reference the drawings. In the description below, each drawing merely schematically illustrates shapes, sizes, and positional relationships in a degree such that contents of the present invention can be understood. Therefore, the present invention is not limited to the sizes, the shapes, and the positional relationships illustrated in each drawing. The same reference signs are used to designate the same elements throughout the drawings.
First Embodiment
[0025]
[0026]
[0027] The capsule endoscope 10 is configured to be introduced into the subject by, for example, oral ingestion, and thereafter moves in a lumen (digestive canal) of the subject, and is finally discharged to the outside of the subject. During that time, the capsule endoscope 10 captures images of the inside of an organ of the subject, generates image signals, and sequentially wirelessly transmits the image signals to the outside of the subject.
[0028]
[0029] The capsule-shaped casing 100 includes a tubular casing 101 and dome-shaped casings 102 and 103 and is formed by closing open ends of both sides of the tubular casing 101 with the dome-shaped casings 102 and 103. The tubular casing 101 is a colored casing that is substantially opaque to visible light. On the other hand, the dome-shaped casings 102 and 103 are dome-shaped optical members that are transparent to light of a predetermined wavelength band such as visible light. The capsule-shaped casing 100 internally includes the imaging unit 11, the control unit 12, the wireless transmitting unit 13, the position and posture information sending unit 14, the receiving unit 15, the posture changing unit 16, and the power source unit 17 in a liquid-tight manner.
[0030] Each imaging unit 11 has an illumination unit 111 which is formed of an LED (Light Emitting Diode), an LD (Laser Diode), or the like and emits illumination light such as white light, an optical system 112 such as a condenser lens, and an image sensor 113 formed of a CMOS image sensor, a CCD, or the like. The illumination unit 111 emits illumination light to the subject in a visual field V of each image sensor 113 through the dome-shaped casing 102 or 103. The optical system 112 condenses reflection light from the visual field V and forms an image on an imaging surface of the image sensor 113. The image sensor 113 converts the reflection light (optical signal) from the visual field V, which is received on the imaging surface, into an electrical signal and outputs the electrical signal as an image signal.
[0031] The two imaging units 11 are arranged such that optical axes of the optical systems 112 of the imaging units 11 are substantially in parallel with or substantially coincident with a long axis La which is a center axis in a longer direction of the capsule-shaped casing 100 and the visual fields V of the two imaging units 11 face directions opposite to each other. In other words, the two imaging units 11 are mounted such that the imaging surface of each image sensor 113 is perpendicular to the long axis La.
[0032] The first embodiment employs a multiple-camera capsule endoscope in which the two imaging units 11 capture images, respectively, in both directions (front and rear directions) of the long axis La of the capsule endoscope 10. However, a single-camera capsule endoscope may be employed in which only one imaging unit 11 is provided to capture images in one direction of the long axis La.
[0033] The control unit 12 controls each operation of the imaging unit 11, the wireless transmitting unit 13, the position and posture information sending unit 14, the receiving unit 15, and the posture changing unit 16 and controls input and output of signals between these units. Further, the control unit 12 sets an imaging frame rate of the imaging unit 11, causes the image sensor 113 to capture images of the subject in the visual field V illuminated by the illumination unit 111, and performs predetermined signal processing on the image signal output from the image sensor 113.
[0034] The wireless transmitting unit 13 includes an antenna (not illustrated in the drawings) for transmitting a wireless signal. The wireless transmitting unit 13 acquires the image signal on which the signal processing is performed by the control unit 12, generates a wireless signal by performing modulation processing and the like on the image signal, and transmits the wireless signal to the control device 20 through the antenna.
[0035] The position and posture information sending unit 14 (first transmitter) includes a coil 141 that forms a part of a resonance circuit and generates a magnetic field by receiving a power supply and a capacitor 142 that forms the resonance circuit along with the coil 141. The position and posture information sending unit 14 generates a magnetic field of a predetermined frequency by receiving a power supply from the power source unit 17 under control of the control unit 12. In the first embodiment, the magnetic field is used as information that represents the position and posture.
[0036] The receiving unit 15 (first receiver) is a control signal receiving unit that receives various control signals wirelessly transmitted from the control device 20 and outputs the control signals to the control unit 12. Specifically, the control signals include a posture control signal for changing the posture of the capsule endoscope 10.
[0037] The posture changing unit 16 (posture changing mechanism) changes the posture of the capsule endoscope 10 according to the posture control signal received by the receiving unit 15 under control of the control unit 12.
[0038] As illustrated in
[0039] Here, the posture of the capsule endoscope 10 can be represented by various variables.
[0040] The power source unit 17 is a power storage unit such as a button-type battery or a capacitor and has a switch unit such as a magnetic switch or an optical switch. When the power source unit 17 is configured to have a magnetic switch, the power source unit 17 switches between ON and OFF of a power source by a magnetic field applied from outside. When the power source is in an ON state, the power source unit 17 supplies power of the power storage unit to each element (the imaging unit 11, the control unit 12, and the wireless transmitting unit 13, the position and posture information sending unit 14, the receiving unit 15, and the posture changing unit 16) of the capsule endoscope 10. When the power source is in an OFF state, the power source unit 17 stops power supply to each element of the capsule endoscope 10.
[0041] Referring to
[0042] The image signal receiving unit 21 includes a plurality of receiving antennas and sequentially receives wireless signals transmitted by the capsule endoscope 10 through the receiving antennas. The plurality of antennas is arranged on a body surface of the subject and used. The image signal receiving unit 21 selects a receiving antenna whose reception electric field intensity is the highest from among the receiving antennas, extracts an image signal from a wireless signal received through the selected receiving antenna by performing demodulation processing on the wireless signal, and outputs the image signal to the image processing unit 22.
[0043] The image processing unit 22 generates display image data that represents an image of inside of the subject by performing image processing such as white balance processing, demosaicing, color conversion, density conversion (gamma conversion or the like), smoothing (noise removal and the like), and sharpening (edge enhancement and the like) on the image signal output from the image signal receiving unit 21.
[0044] The display unit 23 has a screen formed from any kind of display such as a liquid crystal display and displays an image based on the image data generated by the image processing unit 22, the position and posture of the capsule endoscope 10 detected by the position and posture detection unit 25 described later, and other various information on the screen.
[0045] The position and posture information acquisition unit 24 (second receiver) has a plurality of sensing coils 24a (see
[0046] The position and posture detection unit 25 (posture detector) receives a plurality of detection signals (electrical currents respectively generated in the plurality of sensing coils 24a) from the position and posture information acquisition unit 24 and extracts magnetic field information including the amplitude and phase of the magnetic field transmitted from the capsule endoscope 10 by performing signal processing such as waveform shaping, amplification, A/D conversion, and FFT on the detection signals. Further, the position and posture detection unit 25 calculates three-dimensional coordinates, the elevation angle , and the turning angle (see
[0047] The target posture calculation unit 26 (target posture calculator) calculates the target posture of the capsule endoscope 10 based on an image captured from the current visual field V of the capsule endoscope 10.
[0048] The posture control signal generation unit 27 (posture control signal generator) generates a posture control signal for changing the posture of the capsule endoscope 10 from the current posture to the target posture based on the current posture information of the capsule endoscope 10 output from the position and posture detection unit 25 and the target posture of the capsule endoscope 10 output from the target posture calculation unit 26.
[0049] The control signal transmitting unit 28 (second transmitter) wirelessly transmits the posture control signal generated by the posture control signal generation unit 27 to the capsule endoscope 10.
[0050] Next, an operation of the capsule endoscope system 1 will be described with reference to
[0051] First, as illustrated in
[0052] In the following step S12, the wireless transmitting unit 13 starts wireless transmission of an image signal which is output from the imaging unit 11 and on which signal processing is performed by the control unit 12.
[0053] In step S13, the control unit 12 causes the position and posture information sending unit 14 to start sending of information indicating the position and posture. Specifically, the control unit 12 causes the power source unit 17 to start power supply to the position and posture information sending unit 14 and causes the position and posture information sending unit 14 to generate a magnetic field. In this case, it is preferable that the control unit 12 controls the power supply to the position and posture information sending unit 14 in synchronization with the imaging frame rate of the imaging unit 11, thereby causing the position and posture information sending unit 14 to generate a pulse signal of magnetic field.
[0054] Meanwhile, as illustrated in
[0055] In the following step S21, the image processing unit 22 receives the image signal from the image signal receiving unit 21 and performs image processing such as white balance processing, demosaicing, color conversion, density conversion (gamma conversion or the like), smoothing (noise removal and the like), and sharpening (edge enhancement and the like) on the image signal. In this way, the image processing unit 22 generates display image data, outputs the image data to the display unit 23, and starts display of images of inside of the subject.
[0056] In step S22, the position and posture information acquisition unit 24 starts detection of the magnetic field generated by the capsule endoscope 10 as an acquisition operation of the position and posture information.
[0057] In step S23, the position and posture detection unit 25 receives a detection signal of the magnetic field from the position and posture information acquisition unit 24 and starts detection of the position and posture of the capsule endoscope 10 based on the detection signal.
[0058] At this stage, a user (a medical worker in charge of examination) confirms that the capsule endoscope 10 starts operation and then have the subject to swallow the capsule endoscope 10. Specifically, the user confirms whether the illumination unit 111 of the capsule endoscope 10 emits light periodically, whether the control device 20 receives the wireless signal transmitted from the capsule endoscope 10, or whether an image captured from a visual field of the capsule endoscope 10 is displayed on the display unit 23.
[0059] In step S24, from the image processing unit 22, the target posture calculation unit 26 receives image data based on an image signal wirelessly transmitted at a timing around (preferably, immediately before) transmission of information (generation of magnetic field) representing the position and posture that is used to detect the current position and posture of the capsule endoscope 10, and calculates the target posture of the capsule endoscope 10 based on an image corresponding to the image data.
[0060] Here, as illustrated in
[0061] Therefore, the target posture calculation unit 26 first detects the position of the central portion C in the lumen direction from the image m1. As a detection method of the central portion C in the lumen direction, it is possible to apply various known methods. As an example, the target posture calculation unit 26 estimates a distance between the capsule endoscope 10 and the subject (a mucosal surface inside the lumen G) shown in the image m1 based on pixel values of pixels in the image m1 and defines that a point where the distance is the greatest is the central portion C in the lumen direction. The distance between the capsule endoscope 10 and the subject can be estimated from R value of pixel values (R value, G value, and B value) and the brightness of each pixel in the image m1. Here, since a red component (R component) of the illumination light (white light) emitted from the capsule endoscope 10 is farthest away from an absorption band of blood and is a longest wavelength component, the red component is less likely to be affected by absorption or scattering in a living body. Therefore, the intensity of the R component best reflects the length of an optical path of the illumination light which is emitted from the capsule endoscope 10, is reflected by the subject, and enters the capsule endoscope 10. Specifically, the longer the distance between the capsule endoscope 10 and the subject, the smaller the R value and the brightness.
[0062] Then, the target posture calculation unit 26 calculates a directional vector v directed from a center point O of the image m1 corresponding to the center of the visual field V of the capsule endoscope 10 to the central portion C in the lumen direction on the image m1. Further, the target posture calculation unit 26 calculates a posture where the center of the visual field V of the capsule endoscope 10 faces the lumen direction as the target posture of the capsule endoscope 10 from the length (the number of pixels in the image m1) and the orientation of the directional vector v.
[0063] In the following step S25, the posture control signal generation unit 27 generates a posture control signal for changing the posture of the capsule endoscope 10 based on the current posture of the capsule endoscope 10 detected in step S23 and the target posture calculated in step S24. Specifically, the posture control signal generation unit 27 calculates a posture (elevation angle +, turning angle +) where the target posture is added to the current posture of the capsule endoscope 10 (elevation angle and turning angle , see
[0064] In step S26, the control signal transmitting unit 28 wirelessly transmits information indicating the rotation angles of the eccentric motors 161 and 162 calculated in step S25 to the capsule endoscope 10 as the posture control signal.
[0065] In step S14 illustrated in
[0066] When the receiving unit 15 has received the posture control signal (step S14: Yes), the control unit 12 outputs the posture control signal to the posture changing unit 16 and changes the posture of the capsule endoscope 10 (step S15). Specifically, the control unit 12 changes the rotation angles of the eccentric motors 161 and 162 of the posture changing unit 16, thereby changing the position of the center of gravity of the capsule endoscope 10. In this way, as illustrated in
[0067] On the other hand, if the receiving unit 15 has not received the posture control signal (step S14: No), the operation of the capsule endoscope 10 directly proceeds to step S16.
[0068] In step S16, the control unit 12 determines whether or not to end the imaging. Specifically, the control unit 12 determines to end the imaging when a predetermined period of time or more has elapsed since the capsule endoscope 10 was turned on, the amount of remaining power of the power source unit 17 becomes smaller than or equal to a predetermined value, or a signal indicating the end of examination is transmitted from the control device 20. When not ending the imaging (step S16: No), the operation of the capsule endoscope 10 returns to step S14. On the other hand, when ending the imaging (step S16: Yes), the capsule endoscope 10 ends the operation.
[0069] In step S27 illustrated in
[0070] As described above, according to the first embodiment, information indicating the current posture of the capsule endoscope 10 and the posture control signal for changing the posture of the capsule endoscope 10 are transmitted and received through bidirectional communication between the capsule endoscope 10 and the control device 20, and it is possible to cause the capsule endoscope 10 to change the posture of the capsule endoscope 10 based on the posture control signal. Therefore, even when the posture of the capsule endoscope 10 is involuntarily changed by peristaltic action of the subject, it is possible to stabilize the posture of the capsule endoscope 10 by causing the capsule endoscope 10 to change its own posture, which makes it possible to cause the capsule endoscope 10 to continue the imaging with an appropriate visual field.
[0071] In the first embodiment described above, the target posture is set such that the center of the visual field V of the capsule endoscope 10 faces the lumen direction. However, the setting method of the target posture is not limited to this. For example, the target posture may be set such that the center of the visual field V faces a characteristic portion of the subject shown in the image displayed on the display unit 23. As a specific example, on the basis of pixel information in the image displayed on the display unit 23, a portion that is estimated to a lesion (for example, a strong red portion) is automatically detected from the image and a direction from the center point of the image to the portion is set as the target posture.
First Modified Example
[0072] Next, a first modified example of the first embodiment of the present invention will be described.
[0073]
[0074] A posture changing unit 16A in the first modified example has two gravity center position adjusting units 163 and 164 and a power supply unit (not illustrated in the drawings) that supplies power to the gravity center position adjusting units 163 and 164.
[0075] The gravity center position adjusting unit 163 has an electromagnet 16a, a magnetic body 16b formed by a permanent magnet, an iron core, and the like, and a spring 16c whose one end is fixed to a predetermined position in the capsule-shaped casing 100. The magnetic body 16b is connected to the spring 16c and is movable along the long axis La of the capsule-shaped casing 100. When the electromagnet 16a receives power supply and is magnetized, the magnetic body 16b moves to a position determined by a balance between a magnetic force of the electromagnet 16a and an elastic force of the spring 16c. In this way, the position of the center of gravity on the long axis La changes.
[0076] The gravity center position adjusting unit 164 has an electromagnet 16d, a magnetic body 16e formed by a permanent magnet, an iron core, and the like, and a spring 16f whose one end is fixed to a predetermined position in the capsule-shaped casing 100. The magnetic body 16e is connected to the spring 16f and is movable along a line Lb on a plane perpendicular to the long axis La of the capsule-shaped casing 100. When the electromagnet 16d receives power supply and is magnetized, the magnetic body 16e moves to a position determined by a balance between a magnetic force of the electromagnet 16d and an elastic force of the spring 16f. In this way, the position of the center of gravity on the line Lb changes.
[0077] In the first modified example, the posture changing unit 16A changes the posture (elevation angle , turning angle ) of the capsule endoscope 10 by adjusting the power supplied to the electromagnets 16a and 16d according to the posture control signal wirelessly transmitted from the control device 20 and changing the position of the center of gravity of the capsule endoscope 10.
Second Modified Example
[0078] Next, a second modified example of the first embodiment of the present invention will be described.
[0079]
[0080] A posture changing unit 16B in the second modified example has a weight 165 attached inside the capsule-shaped casing 100 through six springs 166, three spring winding units 167, a winding drive unit (not illustrated in the drawings) that drives the spring winding units 167. The weight 165 is provided movably in three directions, which include a direction of the long axis La of the capsule-shaped casing 100 and two directions (p direction and q direction) perpendicular to each other on a plane perpendicular to the long axis La, by the six springs 166. The three spring winding units 167 are provided in the direction of the long axis La, the p direction, and the q direction, respectively.
[0081] In the second modified example, the posture changing unit 16B changes the position of the weight 165 by adjusting the amount of winding of each spring 166 wound by the spring winding unit 167 according to the posture control signal wirelessly transmitted from the control device. Hence, the position of the center of gravity of the capsule endoscope 10 is changed, thereby changing the posture (elevation angle , turning angle ) of the capsule endoscope 10.
Second Embodiment
[0082] Next, a second embodiment of the present invention will be described.
[0083]
[0084] Although operations of elements of the capsule endoscope 30 illustrated in
[0085] The control device 40 includes a position and posture detection unit 41 instead of the position and posture information acquisition unit 24 and the position and posture detection unit 25 illustrated in
[0086] The position and posture detection unit 41 receives wireless signals through a plurality of receiving antennas included in the image signal receiving unit 21 and detects the position and posture of the capsule endoscope 30 based on the intensity distribution of the wireless signals. As a detection method of the position and posture of the capsule endoscope 30, it is possible to use various known methods. As an example, it is possible to obtain the position and posture of the capsule endoscope 30 by appropriately setting an initial value of the position of the capsule endoscope 30 and repeating processing of calculating an estimated value of the position and posture by using the Gauss-Newton method until a difference between the calculated estimated value and the previous estimated value becomes smaller than or equal to a predetermined value (for example, see JP 2007-283001 A). The configuration and operation of each unit other than the position and posture detection unit 41 in the control device 40 are the same as those in the first embodiment.
[0087] As described above, according to the second embodiment of the present invention, since the wireless signal transmitted from the capsule endoscope 30 is used as information related to the position and posture, it is not necessary to provide a dedicated configuration (such as the resonance circuit including the coil 141 and the capacitor 142 illustrated in
Third Embodiment
[0088] Next, a third embodiment of the present invention will be described.
[0089]
[0090] The control device 50 includes an input unit 51, which is used when a user inputs various commands and information, in addition to the elements of the control device 20 illustrated in
[0091] Next, an operation of the capsule endoscope system 3 will be described with reference to
[0092] After step S21, the display unit 23 of the control device 50 displays images of inside of the subject based on image signals sequentially wirelessly transmitted from the capsule endoscope 10. A user observes these images and when the user wants to change a direction of the visual field of the capsule endoscope 10, the user specifies a portion in an image, which the user wants to move to the center of the image, by using the input unit 51. For example, as illustrated in
[0093] In step S31 that follows step S23, the target posture calculation unit 52 determines whether or not a signal indicating coordinates on an image displayed on the display unit 23 is input from the input unit 51.
[0094] When the signal indicating coordinates on the image is input (step S31: Yes), the target posture calculation unit 52 calculates the target posture of the capsule endoscope 10 (step S32). Specifically, the target posture calculation unit 52 calculates a directional vector directed from a center point of the image to the coordinates input in step S31 and calculates the target posture based on the directional vector.
[0095] For example, when the coordinates of the central portion C in the lumen direction illustrated in
[0096] If the signal indicating coordinates is not input (step S31: No), the operation of the control device 50 proceeds to step S27.
[0097] As described above, according to the third embodiment of the present invention, it is possible to cause the capsule endoscope 10 to change the posture of the capsule endoscope 10 such that the visual field of the capsule endoscope 10 faces a portion desired by a user.
[0098] In the first to the third embodiment described above, the exemplary capsule endoscope has been described which is configured to be orally introduced into the subject and captures images a lumen of the subject. However, the present invention is not limited by these embodiments. It is possible to apply the present invention to various endoscopes which have a capsule shape and which are introduced into a subject and capture images.
[0099] The first to the third embodiments and the modified examples of the embodiments described above are merely examples for implementing the present invention, and the present invention is not limited to these embodiments and modified examples. The present invention can form various inventions by appropriately combining a plurality of elements disclosed in the first to the third embodiments and the modified examples. From the above description, it is obvious that the present invention can be variously modified according to specifications and the like, and further, other various embodiments are possible within the scope of the present invention.
[0100] According to some embodiments, the information indicating the posture of the capsule endoscope and the control signal to change the posture of the capsule endoscope are transmitted and received through bidirectional communication between the capsule endoscope and the control device and the posture changing unit that changes the posture of the capsule endoscope based on the control signal is provided in the capsule endoscope. With this feature, even after the capsule endoscope is introduced into the subject, the capsule endoscope can change the posture by itself.
[0101] Additional advantages and modifications will readily occur to those skilled in the art. Therefore, the invention in its broader aspects is not limited to the specific details and representative embodiments shown and described herein. Accordingly, various modifications may be made without departing from the spirit or scope of the general inventive concept as defined by the appended claims and their equivalents.