System and method for wireless capsule endoscope with adaptive frame rate

Abstract

The present invention discloses a system for wireless capsule endoscope with adaptive frame rate, comprising: a recorder data processor to filter the first posture information of a capsule endoscope and the second posture information of a portable recorder to obtain a quaternion p.sub.0 of the first posture information and a quaternion p.sub.1 of the second posture information, and to calculate an interpolated median s.sub.0 between p.sub.0 and p.sub.1 at time t.sub.0, and an interpolated median s.sub.1 between p′.sub.0 and p′.sub.1 at time t.sub.1; the recorder data processor also calculates a difference diff.sub.0 between the interpolated median s.sub.0 and s.sub.1, and works out the dot product of the difference diff.sub.0 and unit quaternion [1, 0, 0, 0].

Claims

1. A system for wireless capsule endoscope with an adaptive frame rate, comprising: a capsule endoscope (1) including a capsule data processor (1.4) and a first 6-axis sensor (1.5), and a portable recorder (2) including a second 6-axis sensor (2.2) and a recorder data processor (2.3), wherein: the first 6-axis sensor (1.5) is configured to collect a first posture information of the capsule endoscope (1); the second 6-axis sensor (2.2) is configured to collect a second posture information of the portable recorder (2); the recorder data processor (2.3) is configured to filter the first posture information and the second posture information to obtain a quaternion p.sub.0 of the first posture information and a quaternion p.sub.1 of the second posture information, and to calculate an interpolated median s.sub.0 between p.sub.0 and p.sub.1 at time t.sub.0, and an interpolated median s.sub.1 between p′.sub.0 and p′.sub.1 at time t.sub.1; the recorder data processor (2.3) is also configured to calculate a difference diff_0 between the interpolated median s.sub.0 and s.sub.1, and work out the dot product of the difference diff.sub.0 and unit quaternion [1, 0, 0, 0]; if the result of the dot product calculation |diff.sub.0.Math.[1,0,0,0]|.sup.2∈(0.01,1], the recorder data processor determines that there is a relative movement between the capsule endoscope (1) and the portable recorder (2), otherwise the recorder data processer determines that there is no relative movement between the capsule endoscope (1) and portable recorder (2); according to the determination, a corresponding command signal is generated and transmitted to the capsule endoscope (1) by the portable recorder (2); and the capsule data processor (1.4) is configured to receive the command signal transmitted by the portable recorder (2), and adjust frame rate of the capsule endoscope (1) according to the command signal.

2. The system of claim 1, wherein the frame rate of the capsule endoscope (1) is configured to be adjusted using the following steps: transmitting the result as a command signal to the capsule data processor (1.4) by the recorder data processor (2.3); when a relative movement between the capsule endoscope (1) and the portable recorder (2) is determined by the recorder data processor, collecting a current frame rate value of the camera unit (1.2) by the capsule data processor (1.4); if the current frame rate of the camera unit (1.2) reaches a maximum value, an adjustment is not performed, otherwise increasing the frame rate of the camera unit (1.2) by the capsule data processor (1.4); and when no relative movement between the capsule endoscope (1) and the portable recorder (2) is determined by the recorder data processor, reducing the frame rate of the camera unit (1.2) by the capsule data processor (1.4).

3. The system of claim 2, wherein the camera unit (1.2) has multiple possible frame rates, called levels; when the capsule data processor (1.4) increases the frame rate, the camera unit (1.2) increases frame rate to the next higher level to get a higher frame rate.

4. The system of claim 2, wherein the camera unit (1.2) has multiple possible frame rates, called levels; when the frame rate is reduced via the capsule data processor (1.4), the camera unit (1.2) reduces the frame rate to the next lower level to get a lower frame rate, wherein if the current frame rate is already at a minimum value, a downward adjustment of the frame rate does not occur.

5. The system of claim 1, wherein the frame rate of the capsule endoscope (1) is configured to be adjusted using the following steps: when a relative movement between the capsule endoscope (1) and the portable recorder (2) is determined by the recorder data processor (2.3), the recorder data processor (2.3) gets the current frame rate value of the camera unit (1.2); if the current frame rate of the camera unit (1.2) reaches a maximum value, transmitting a command signal for not adjusting the frame rate to the capsule data processor (1.4) by the recorder data processor (2.3), otherwise transmitting a command signal for increasing the frame rate of the camera unit (1.2) to the capsule data processor (1.4) by the recorder data processor (2.3); when no relative movement between the capsule endoscope (1) and the portable recorder (2) is determined by the recorder data processor (2.3), transmitting a command signal for reducing the frame rate of the camera unit (1.2) to the capsule data processor (1.4) by the recorder data processor (2.3); and after receiving the command signal, adjusting the frame rate of the capsule endoscope (1) by the capsule data processor (1.4) according to the signal.

6. The system of claim 1, wherein the first posture information collected by the first 6-axis sensor (1.5) and the second posture information collected by the second 6-axis sensor (2.2) are synchronous.

7. The system of claim 1, wherein the capsule endoscope (1) further comprises a first RF transmission device (1.3), and the portable recorder (2) further comprises a second RF transmission device (2.1): the first 6-axis sensor (1.5) transmits the first posture information collected to the recorder data processor (2.3) via the first RF transmission device (1.3) and the second RF transmission device (2.1); and the second 6-axis sensor (2.2) transmits the second posture information collected to the recorder data processor (2.3).

8. The system of claim 1, wherein the recorder data processor (2.3) solves the first posture information using Mahony filter fusion algorithm, and obtains a normalized quaternion of the first posture information; the recorder data processor (2.3) also solves the second posture information using Mahony filter fusion algorithm, and obtains a normalized quaternion of the second posture information.

9. The system of claim 1, wherein the interpolated median s.sub.0 between the quaternion p.sub.0 of the first posture information and the quaternion p.sub.1 of the second posture information at time t.sub.0 is calculated by a formula s.sub.0=p.sub.0+τ(p.sub.1−p.sub.0); the interpolated median s.sub.1 between the quaternion p′.sub.0 of the first posture information and the quaternion p′.sub.1 of the second posture information at time t.sub.1 is calculated by a formula s.sub.1=p′.sub.0+τ(p′.sub.1−p′.sub.0).

10. A method for frame rate adaptation using the wireless capsule endoscope system of claim 1, comprising the following steps: step 1: the first 6-axis sensor (1.5) collects a first posture information of the capsule endoscope (1); the second 6-axis sensor (2.2) collects a second posture information of the portable recorder (2); step 2: the recorder data processor (2.3) filters the first posture information and the second posture information to obtain a quaternion p.sub.0 of the first posture information and a quaternion p.sub.1 of the second posture information, and to calculate an interpolated median s.sub.0 between p.sub.0 and p.sub.1 at time t.sub.0, and an interpolated median s.sub.1 between p′.sub.0 and p′.sub.1 at time t.sub.1; step 3: the recorder data processor (2.3) calculates a difference diff.sub.0 between the interpolated median s.sub.0 and s.sub.1, and works out the dot product of the difference diff.sub.0 and unit quaternion [1, 0, 0, 0]; if the result of the dot product calculation |diff.sub.0.Math.[1,0,0,0]|.sup.2∈(0.01,1], a relative movement between the capsule endoscope (1) and the portable recorder (2) is determined by the recorder data processor, otherwise there is no relative movement between the capsule endoscope (1) and the portable recorder (2) is determined by the recorder data processor according to the determination, a corresponding command signal is generated and transmitted to the capsule endoscope (1); the capsule data processor (1.4) receives the command signal transmitted by the portable recorder (2), and adjusts frame rate of the capsule endoscope (1) according to the command signal.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

(1) FIG. 1 shows a structural view of a wireless capsule endoscope system according to the present invention.

(2) FIG. 2 shows a process flow diagram of the method for frame rate adaptation according to the present invention.

(3) Wherein, 1—Capsule endoscope, 1.1—Internal power supply unit, 1.2—Camera unit, 1.3—First RF transmission device, 1.4—Capsule data processor, 1.5—First 6-axis sensor, 2—Portable recorder, 2.1—Second RF transmission device, 2.2—Second 6-axis sensor, 2.3—Recorder data processor.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

(4) The present invention is herein described, by way of preferred embodiments, with reference to accompanying drawings.

(5) The present invention discloses a wireless capsule endoscope system with an adaptive frame rate, as shown in FIG. 1, comprising a capsule endoscope 1 and a portable recorder 2. The capsule endoscope 1 comprises an internal power supply unit 1.1, a camera unit 1.2, a first RF transmission device 1.3, a capsule data processor 1.4 and a first 6-axis sensor 1.5. The portable recorder 2 comprises a second RF transmission device 2.1, a second 6-axis sensor 2.2 and a recorder data processor 2.3.

(6) The signal output port of the camera unit 1.2 is connected to the image signal input port of the capsule data processor 1.4, the data communication port of the capsule data processor 1.4 is connected to the first RF communication port of the first RF transmission device 1.3, the signal output port of the first 6-axis sensor 1.5 is connected to the second RF communication port of the first RF transmission device 1.3, the third communication port of the first RF transmission device 1.3 is wirelessly connected by RF signal to the first communication port of the second RF transmission device 2.1, the signal output port of the second 6-axis sensor 2.2 is connected to the first data communication port of the recorder data processor 2.3, and the second data communication port of the recorder data processor 2.3 is connected to the second communication port of the second RF transmission device 2.1.

(7) The first 6-axis sensor 1.5 is configured to collect a first posture information of the capsule endoscope 1; the second 6-axis sensor 2.2 is configured to collect a second posture information of the portable recorder 2. The portable recorder 2 is fixed to a position outside the subject, such as the abdomen, by a belt or a vest or the like at the time of use. The posture information collected by the first 6-axis sensor 1.5 is transmitted to the recorder data processor 2.3 through the first RF transmission device 1.3 and the second RF transmission device 2.1.

(8) The recorder data processor 2.3 is configured to receive the first posture information collected by the first 6-axis sensor 1.5 and the second posture information collected by the second 6-axis sensor 2.2, and determine whether or not there is a relative movement between the capsule endoscope 1 and the portable recorder 2 according to the first posture information and the second posture information. According to the determination result, a corresponding command signal is generated and transmitted to the capsule endoscope 1. The capsule data processor 1.4 is configured to receive a command signal transmitted by the portable recorder 2, and adjust the frame rate of the capsule endoscope 1 according to the command signal. The command signal may be the result of a determination of whether or not there is a relative movement between the capsule endoscope 1 and the portable recorder 2. At this point, the capsule data processor 1.4 collects the current image frame rate value of the camera unit 1.2 and adjusts the frame rate of the capsule endoscope 1 according to the command signal and the current image frame rate value collected. In addition, the command signal may also be a signal for adjusting the image frame rate of the camera unit 1.2; that is, the recorder data processor 2.3 gets the current image frame rate value of the camera unit 1.2 and generates a signal for adjusting the image frame rate of the capsule endoscope 1 according to the command signal and the current frame rate value collected.

(9) In the preferred embodiment of the present invention, the recorder data processor 2.3 determines whether there is a relative movement between the capsule endoscope 1 and the portable recorder 2 by the following steps: filter the first posture information of the capsule endoscope 1 and the second posture information of the portable recorder 2 with a filter fusion algorithm to obtain a quaternion p.sub.0 of the first posture information and a quaternion p.sub.1 of the second posture information; both of the quaternion p.sub.0 of the first posture information and the quaternion p.sub.1 of the second posture information represent a four-dimensional space vector of posture information; calculate an interpolated median s.sub.0 between p.sub.0 and p.sub.1 at time t.sub.0, and an interpolated median s.sub.1 between p′.sub.0 and p′.sub.1 at time t.sub.1; calculate a difference diff.sub.0 between the interpolated median s.sub.0 and s.sub.1, and work out the dot product of the difference diff.sub.0 and unit quaternion [1, 0, 0, 0]. If the result of the dot product calculation |diff.sub.0.Math.[1,0,0,0]|.sup.2∈(0.01,1], it is determined that there is a relative movement between the capsule endoscope 1 and the portable recorder 2; otherwise there is no relative movement between the capsule endoscope 1 and the portable recorder 2. In the preferred embodiment of the present invention, the diff.sub.0 is calculated by diff.sub.0=s.sub.0.sup.−1 s.sub.1.

(10) In the preferred embodiment of the present invention, if the command signal demonstrates that there is relative movement between the capsule endoscope 1 and the portable recorder 2, the frame rate of the capsule endoscope 1 is adjusted as follows: The recorder data processor 2.3 transmits the result as a command signal to the capsule data processor 1.4. When there is relative movement between the capsule endoscope 1 and the portable recorder 2, the capsule data processor 1.4 collects the current frame rate value of the camera unit 1.2. If the current frame rate of the camera unit 1.2 reaches the maximum value, an adjustment is not needed; otherwise if not at maximum value the image frame rate of the camera unit 1.2 is increased by the capsule data processor 1.4; when there is no relative movement between the capsule endoscope 1 and the portable recorder 2, the image frame rate of the camera unit 1.2 is reduced by the capsule data processor 1.4.

(11) In the preferred embodiment of the present invention, if the command signal is a signal used to adjust the image frame rate of the camera unit 1.2, the frame rate of the capsule endoscope 1 is adjusted as follows: When there is a relative movement between the capsule endoscope 1 and the portable recorder 2, the recorder data processor 2.3 gets the current frame rate value of the camera unit 1.2; if the current frame rate of the camera unit 1.2 is at the maximum value, a command signal for not adjusting the frame rate is transmitted to the capsule data processor 1.4; otherwise a command signal for increasing the image frame rate of the camera unit 1.2 is transmitted to the capsule data processor 1.4. When there is no relative movement between the capsule endoscope 1 and the portable recorder 2, a command signal for reducing the image frame rate of the camera unit 1.2 is transmitted to the capsule data processor 1.4. According to the received command signal, the frame rate of the capsule endoscope 1 is adjusted with the capsule data processor 1.4.

(12) Adjustments carried out to the frame rate of the capsule endoscope 1 according to the command signal include: When the command signal is not to adjust the frame rate, the capsule data processor 1.4 does not adjust the frame rate of the capsule endoscope 1, that is, maintains the current frame rate; when the command signal is to increase the frame rate of the camera unit 1.2, the capsule data processor 1.4 increases the frame rate of the capsule endoscope 1; when the command signal is to reduce the frame rate of the camera unit 1.2, the capsule data processor 1.4 reduces the frame rate of the capsule endoscope 1.

(13) In the preferred embodiment of the present invention, the camera unit 1.2 is used to capture video images which are images in the body of the examinee, and the examinee may be a human being, an animal, or a digestive tract bionic model.

(14) In the preferred embodiment of the present invention, the first posture information collected by the first 6-axis sensor 1.5 and the second posture information collected by the second 6-axis sensor 2.2 are synchronous.

(15) In the preferred embodiment of the present invention, the camera unit 1.2, the first RF transmission device 1.3, the capsule data processor 1.4 and the first 6-axis sensor 1.5 are powered by the power supply unit 1.1 inside the capsule.

(16) In the preferred embodiment of the present invention, the first 6-axis sensor 1.5 transmits the first posture information collected to the recorder data processor 2.3 via the first RF transmission device 1.3 and the second RF transmission device 2.1. The recorder data processor 2.3 solves the first posture information using a Mahony filter fusion algorithm and obtains a normalized quaternion of the first posture information; the second 6-axis sensor 2.2 transmits the second posture information collected to the recorder data processor 2.3. The recorder data processor 2.3 solves the second posture information using a Mahony filter fusion algorithm and obtains a normalized quaternion of the second posture information.

(17) In the preferred embodiment of the present invention, when there is relative movement between the capsule endoscope 1 and the portable recorder 2, the capsule data processor 1.4 collects the current frame rate value of the camera unit 1.2. If the current frame rate of the camera unit 1.2 is at the maximum value (e.g. 15 fps), an adjustment is not needed; otherwise the frame rate of the camera unit 1.2 is increased by the capsule data processor 1.4. The frame rate of the camera unit 1.2 is divided into multiple levels, and each level corresponds to a different frame rate, such as 4 levels (0.5 fps, 5 fps, 10 fps and 15 fps). When the capsule data processor increases the frame rate, the camera unit 1.2 increases the current frame rate up by one level to get a larger frame rate. For example, when the current frame rate is 5 fps, the camera unit 1.2 lifts it up to 15 fps.

(18) In the preferred embodiment of the present invention, when there is no relative movement between the capsule endoscope 1 and the portable recorder 2, the frame rate of the camera unit 1.2 is reduced by the capsule data processor 1.4. When the capsule data processor 1.4 reduces the frame rate, the camera unit 1.2 lowers the frame rate down by one level to get a smaller frame rate. For example, if the current frame rate is 5 fps, the camera unit 1.2 reduces it to 0.5 fps. If the current frame rate is already at the minimum value (0.5 fps), an adjustment is not needed.

(19) In the preferred embodiment of the present invention, the interpolated median s.sub.0 between the quaternion p.sub.0 of the first posture information and the quaternion p.sub.1 of the second posture information at time t.sub.0 is calculated by a formula s.sub.0=p.sub.0+τ(p.sub.1−p.sub.0). In the formula, the “τ” is a dimensionless coefficient. τ=0.5 represents the median, τ=0.1 closer to p.sub.0 and τ=0.9 closer to p.sub.1. Similarly, the interpolated median s.sub.1 between the quaternion p′.sub.0 of the first posture information and the quaternion p′.sub.1 of the second posture information at time t.sub.1 is calculated by a formula s.sub.1=p′.sub.0+τ(p′.sub.1−p′.sub.0).

(20) The present invention discloses a method for frame rate adaptation based on the wireless capsule endoscope system, as shown in FIG. 2, comprising the following steps:

(21) Step 1: The first 6-axis sensor 1.5 collects a first posture information of the capsule endoscope 1; the second 6-axis sensor 2.2 collects a second posture information of the portable recorder 2;

(22) Step 2: The first 6-axis sensor 1.5 and the second 6-axis sensor 2.2 transmit the first posture information and the second posture information to the recorder data processor 2.3. The recorder data processor 2.3 filters the first posture information and the second posture information with a filter fusion algorithm to obtain a quaternion p.sub.0 of the first posture information and a quaternion p.sub.1 of the second posture information, both of which represent a four-dimensional space vector of posture information, and to calculate an interpolated median s.sub.0 between p.sub.0 and p.sub.1 at time t.sub.0, and an interpolated median s.sub.1 between p′.sub.0 and p′.sub.1 at time t.sub.1;

(23) Step 3: The recorder data processor 2.3 calculates a difference diff.sub.0 between the interpolated median s.sub.0 and s.sub.1, and works out the dot product of the difference diff.sub.0 and unit quaternion [1, 0, 0, 0]. If the result of the dot product calculation |diff.sub.0.Math.[1,0,0,0]|.sup.2∈(0.01,1], it is determined that there is relative movement between the capsule endoscope 1 and the portable recorder 2, otherwise there is no relative movement between the capsule endoscope 1 and the portable recorder 2; when there is a relative movement between the capsule endoscope 1 and the portable recorder 2, the capsule data processor 1.4 collects the current frame rate value of the camera unit 1.2. If the current frame rate of the camera unit 1.2 is at the maximum value, an adjustment is not needed; otherwise the frame rate of the camera unit 1.2 is increased by the capsule data processor 1.4. When there is no relative movement between the capsule endoscope 1 and the portable recorder 2, the frame rate of the camera unit 1.2 is reduced by the capsule data processor 1.4.

(24) According to the frame rate adjustment process disclosed herein, it is required to determine first whether the current frame rate is the maximum value. If not, and there is a relative movement determined according to the above calculation, the frame rate needs to be increased; if it is the maximum frame rate, maintain the current value; if it is determined according to the relative difference calculated that there is no relative movement between the capsule endoscope 1 and the portable recorder 2, the frame rate needs to be reduced and it should be reduced to 1 fps or less to avoid repetition of images captured until the next determination that there is relative movement. The adjustment process can be executed cyclically to realize a control of the frame rate adaptation to thereby control the frame rate and avoid the problem of relative position misalignment caused by the positioning of the capsule endoscope itself so that the frame rate can be adjusted more accurately and the operating efficiency of the capsule endoscope can be improved.

(25) Although certain disclosed embodiments of the present disclosure have been specifically described, the present disclosure is not to be construed as being limited thereto.

(26) Various changes or modifications may be made to the present disclosure without departing from the scope and spirit of the present disclosure.