DISTANCE MEASUREMENT DEVICE AND IMAGING SYSTEM
20180310860 ยท 2018-11-01
Inventors
Cpc classification
A61B1/00165
HUMAN NECESSITIES
A61B5/1076
HUMAN NECESSITIES
A61B1/04
HUMAN NECESSITIES
A61B5/0084
HUMAN NECESSITIES
G01B9/02041
PHYSICS
G01S17/86
PHYSICS
A61B1/317
HUMAN NECESSITIES
A61B5/6886
HUMAN NECESSITIES
International classification
A61B5/107
HUMAN NECESSITIES
A61B1/00
HUMAN NECESSITIES
A61B1/317
HUMAN NECESSITIES
A61B1/04
HUMAN NECESSITIES
A61B5/00
HUMAN NECESSITIES
Abstract
A distance measurement device according to the present disclosure includes: a light source configured to emit pulsed laser light; a superimposition portion configured to superimpose reflection light obtained by reflection of the pulsed laser light by an object to be measured and reference light that is the pulsed laser light; a saturation output portion, on which the reference light and the reflection light superimposed on each other are made incident, configured to output light having a saturated light quantity when incident light reaches a predetermined light quantity due to superimposition of pulses of the reflection light and the reference light; and a light-receiving portion configured to receive the light outputted from the saturation output portion.
Claims
1. A distance measurement device comprising: a light source configured to emit pulsed laser light; a superimposition portion configured to superimpose reflection light obtained by reflection of the pulsed laser light by an object to be measured and reference light that is the pulsed laser light; a saturation output portion, on which the reference light and the reflection light superimposed on each other are made incident, configured to output light having a saturated light quantity when incident light reaches a predetermined light quantity due to superimposition of pulses of the reflection light and the reference light; and a light-receiving portion configured to receive the light outputted from the saturation output portion.
2. The distance measurement device according to claim 1, wherein the superimposition portion includes a superimposition mirror configured to reflect the reference light superimpose the reference light on the reflection light, and the distance measurement device includes a distance measuring portion configured to obtain a distance to the object to be measured from a relationship between a position of the superimposition mirror and an output of the light having the saturated light quantity.
3. The distance measurement device according to claim 2, wherein the pulsed laser light is radiated from an endoscope to the object to be measured and the reflection light from the object to be measured is superimposed on the reference light, the superimposition mirror is arranged at a first position where the output of the saturation output portion is saturated at a time of calibration during which the pulsed laser light is reflected at a tip position of the endoscope, the superimposition mirror is arranged at a second position where the output of the saturation output portion is saturated at a time of measurement during which the pulsed laser light is reflected by the object to be measured, and the distance measuring portion obtains the distance to the object to be measured on a basis of the first position and the second position.
4. The distance measurement device according to claim 1, wherein the light source includes an MOPA and has a pulse repetition frequency of 2.8 GHz or less.
5. The distance measurement device according to claim 1, wherein the saturation output portion includes an SOA.
6. An imaging system comprising: a distance measuring unit including a light source configured to emit pulsed laser light, a superimposition portion configured to superimpose reflection light obtained by reflection of the pulsed laser light by an object to be measured and reference light that is the pulsed laser light, a saturation output portion, on which the reference light and the reflection light superimposed on each other are made incident, configured to output light having a saturated light quantity when incident light reaches a predetermined light quantity due to superimposition of pulses of the reflection light and the reference light, and a light-receiving portion configured to receive the light outputted from the saturation output portion; and an endoscope unit including an endoscope configured to emit the pulsed laser light made incident in the endoscope to the object to be measured, an imaging element configured to image the object to be measured as an object by the endoscope, and an adjustment portion configured to adjust a direction of the pulsed laser light such that the pulsed laser light is radiated to a specified location of the object to be measured.
7. The imaging system according to claim 6, wherein the superimposition portion includes a superimposition mirror for reflecting the reference light to superimpose the reference light on the reflection light, and the imaging system includes a distance measuring portion configured to obtain a distance to the object to be measured from a relationship between a position of the superimposition mirror and an output of the light having the saturated light quantity.
8. The imaging system according to claim 7, wherein the pulsed laser light is radiated from the endoscope to the object to be measured and the reflection light from the object to be measured is superimposed on the reference light, the superimposition mirror is arranged at a first position where the output of the saturation output portion is saturated at a time of calibration during which the pulsed laser light is reflected at a tip position of the endoscope, the superimposition mirror is arranged at a second position where the output of the saturation output portion is saturated at a time of measurement during which the pulsed laser light is reflected by the object to be measured, and the distance measuring portion obtains the distance to the object to be measured on a basis of the first position and the second position.
9. The imaging system according to claim 7, comprising: a correction portion configured to correct the distance to the object to be measured on a basis of the distance to the object to be measured obtained by the distance measuring portion, the specified location on an image captured by the imaging element, and an optical characteristic of curvature aberration in imaging of the imaging element.
10. The imaging system according to claim 6, wherein the light source includes an MOPA and has a pulse repetition frequency of 2.8 GHz or less.
11. The imaging system according to claim 6, wherein the saturation output portion includes an SOA.
Description
BRIEF DESCRIPTION OF DRAWINGS
[0013]
[0014]
[0015]
[0016]
[0017]
[0018]
[0019]
[0020]
[0021]
[0022]
[0023]
[0024]
[0025]
[0026]
[0027]
MODE(S) FOR CARRYING OUT THE INVENTION
[0028] Hereinafter, (a) preferred embodiment(s) of the present disclosure will be described in detail with reference to the appended drawings. Note that, in this specification and the appended drawings, structural elements that have substantially the same function and structure are denoted with the same reference numerals, and repeated explanation of these structural elements is omitted.
[0029] Note that description will be provided in the following order.
[0030] 1. Distance measuring unit according to present embodiment
[0031] 2. Configuration examples of distance measuring system
[0032] 3. Configurations of signal processing block
[0033] 4. Specific configuration examples of distance measuring unit
[0034] 5. Processing for measuring distance
[0035] 1. Distance Measuring Unit According to Present Embodiment
[0036]
[0037] In the present embodiment, the distance measurement is performed by radiating a pulsed laser to an object to be measured similarly to the technology described above.
[0038] In
[0039] Further, a detection resolution of 0.1 [mm] is converted to 0.5 [psec] in terms of time. In the case of using a method in which a center is estimated from shapes on both sides, the center can be estimated in a range of about 2 [mm]. Thus, a condition of a pulse width corresponding to 2 [mm] is preferably set to about 10 [psec] or less.
[0040]
[0041] Next is an explanation of how an output characteristic of a light-receiving element 300 changes in accordance with a temporal difference between the reference light and the reflection light by referring to
[0042] In such a configuration, if the output signal from the SOA 200 is received by the light-receiving element having a response frequency of, for example, about 10 [MHz], it is difficult to measure an individual light pulse emitted at a frequency of 850 [MHz] as shown in
[0043]
[0044] 2. Configuration Examples of Distance Measuring System
[0045]
[0046] This system 1000 measures a distance L to an object D to be measured by radiating a pulsed laser focused in a spot shape from the light source 100 to the object to be measured while being observed by the endoscope 700 through a control of galvano mirrors 610 and 620 of the scan unit 600, and obtaining a time required for return light to return from a position of the object. The distance measuring unit 500 and the scan unit 600 are connected via an optical fiber. A combined distance of the endoscope 700 and the optical fiber is generally longer than 35 [cm] corresponding to a space interval of the pulsed light having a frequency of 850 [MHz]. Thus, when the system is used in combination with the endoscope 700, a mirror is arranged at a position of a specimen-side end surface 710 of the endoscope 700 to perform a calibration once at this position. The position x of the mirror 150 on a reference light side is adjusted at the time of calibration, so that a moving distance of the mirror 150 from a position at the time of calibration corresponds to the distance L from the end surface 710 of the endoscope 700 to the object D to be measured.
[0047] In other words, the configuration is performed such that temporal phases of the reference light and the reflection light coincide with each other at the time of calibration. If a distance from the end surface 710 to the object D to be measured is L at the time of measurement, an optical path of the reflection light increases by 2L. Then, a moving amount x of the mirror 150 is obtained by moving the mirror 150 from the position at the time of calibration to a position where the output of the SOA 200 is saturated, that is, a position where the output of the light-receiving element 300 shown in
[0048] In
[0049] 3. Configurations of Signal Processing Block
[0050]
[0051] The CCU 800, which is a unit for mainly controlling the endoscope 700, acquires image data obtained by imaging of the imaging element 705. The image data acquired by the CCU 800 are sent to the PC 950 and the distance measuring unit 500.
[0052] The scan mirror control unit 900 receives information regarding an object area of which distance measurement data is obtained from the distance measuring unit 500 and sends a control signal for controlling the galvano mirrors 610 and 620 to the scan unit 600 on the basis of this information, thereby controlling the galvano mirrors 610 and 620. This operation allows the laser light emitted from the light source 100 to radiate to the object area.
[0053] The PC 950 sends the information regarding the object area of which the distance measurement data is obtained to the distance measuring unit 500. The distance measuring unit 500 makes the distance measurement in the object area and sends the distance measurement data obtained from the output signal of the light-receiving element 300 to the PC 950. In this configuration, the PC 950 has no need to include a keyboard, a display, and the like, as long as it has a function of performing a necessary arithmetic operation.
[0054] The distance measuring unit 500 includes a distance measuring portion 510 that obtains the distance to the object D to be measured from a relationship between the position x of the mirror 150 and light-receiving characteristics of the light receiving element 200 for a saturated light quantity outputted from the SOA 200. Note that the distance measuring portion 500 may be included in the PC 950.
[0055] 4. Specific Configuration Examples of Distance Measuring Unit
[0056]
[0057] Further, as shown in
[0058] Note that a signal light-receiving portion in which light amplified by the SOA 200 is received by the light-receiving element 300 may be, for example, a device having characteristics such that an output is saturated with a large instantaneous signal, such as a Geiger counter. As an example of the device in which the output is saturated with a first large instantaneous signal, a PMT or the like can be mentioned. However, the PMT includes a plurality of amplification means, thus time information becomes obscured as a transition is made from an initial amplification stage to a later amplification stage after several stages. In the present embodiment, even if two pulses of the reference light and the reflection light are slightly shifted to each other, these two pulses overlap in a temporal manner in a later amplification stage. Thus, it is anticipated that detection accuracy decreases as compared to the case of using the SOA 200 having frequency characteristics sufficient for accurate signal detection.
[0059] Note that, since this signal deterioration is caused by a large number of the amplification stages in the PMT, the signal deterioration can be reduced by using an HPD (Hybrid Photo Detector) or the like having less number of the amplification stages than the PMT. Further, if the light quantity of the return light is relatively sufficient, an APD (Avalanche Photo Diode) can also be used.
[0060] Note that, in the signal light-receiving system described above, signal sensitivity increases most in the case where intensities of the reference light and the reflection light from the specimen are substantially equal to each other, thus as shown in
[0061] Further, in the case where a light reception signal in the light-receiving element 300 is deteriorated and results in a signal shown in
[0062] A wavelength of the reference light used in the present embodiment is not particularly limited, however, in the case where a measurement is made in an underwater environment, loss of the reflection light from the specimen can be reduced by using light having a wavelength that attenuates less when propagating in water (e.g., 405 [nm]).
[0063] 5. Processing of Measuring Distance
[0064] Next, an explanation is given to actual processing of the distance measurement of an observation image in the system in
[0065] As shown in
[0066] The reference laser light is a visible light laser beam that is introduced into the scan unit 600 from a light source different from the light source 100. The reference laser beam is superimposed on the laser light from the light source 100 and radiated to the object D to be measured via the scan unit 600 and the endoscopes 700. This causes a mark made by the reference laser light to appear at the irradiation position Q shown in
[0067] The reference laser light can be placed on a location where the measurement is desired to be made by a measuring person by controlling the galvano mirrors 610 and 620. The measuring person initiates the distance measurement after confirming from the image that the irradiation position Q indicated by the reference laser beam reaches a desired measurement location. The reference laser beam is preferably switched off during the distance measurement, or the reference laser beam may be blocked by a wavelength filter or the like not to enter the SOA 200.
[0068] As described above, the position x of the mirror 150 on the reference light side is adjusted at the time of calibration, so that the moving distance of the mirror 150 from the position at the time of calibration corresponds to the distance L from the end surface of the endoscope 700 to the irradiation position Q.
[0069] In accordance with the procedures described above, it is possible to obtain distance information regarding a site desired to be measured (the irradiation position Q). In the procedures, in the case where the optical system of the endoscope 700 is a fisheye lens, position correction is performed by correcting curvature aberration or the like using design data of the optical system or measured data of the optical system, and an XYZ position (a coordinate) in a space is calculated from an XY position on the image and a measured optical propagation time from the end surface of the endoscope 00.
[0070] In the case of the arthroscope, a lens 730 is arranged symmetrically about an optical axis. That is, a cylindrical lens is not included. Further, a center (an optical axis C) of a barrel of the arthroscope forms a straight line. Further, information regarding mechanical variation in connecting a barrel 750 with a camera 760 of the arthroscope can be obtained from a camera image.
[0071]
[0072] Specifically, the XYZ coordinates of an arbitrary point on the image can be calculated by the following processings from step 0 to step 4.
(Step 0)
[0073] Coordinates of the optical axis C of the endoscope 700 on the image are obtained. In this example, the origin XY coordinates (X0, Y0) representing a center of the barrel of the arthroscope 700 are obtained from boundaries of the image (contours of the visual field) in regions A1 to A4 in
(Step 1)
[0074] Coordinates (X1, Y1) of the observation point (the irradiation position Q) where the distance measurement is desired to be made are obtained.
(Step 2)
[0075] A distance P on the image data between the coordinates (X1, Y1) of the observation point (the irradiation position Q) and the origin coordinates (X0, Y0) is calculated by the following formula.
P=((X1X0).sup.2+(Y1Y0).sup.2).sup.0.5
(Step 3)
[0076] The angle of the observation point (the irradiation position Q) from the optical axis C is obtained from a conversion table using the measured distance L from the end surface 710 to the object D to be measured and the calculated distance P. An example of the conversion table is shown below. Note that the angle can be obtained by applying the distance P into a vertical axis of the conversion table and applying the distance L into a lateral axis of the conversion table.
TABLE-US-00001 TABLE 1 Distance (L) 0 1 2 3 4 5 delta P 0 0 0 0 0 0 0 50 5.720202 5.748803 5.777547 5.806435 5.835467 5.864644 100 11.38325 11.44017 11.49737 11.55485 11.61263 11.67069 150 16.93256 17.01722 17.10231 17.18782 17.27376 17.36013 200 22.31269 22.42425 22.53637 22.64905 22.7623 22.87611 250 27.46987 27.60722 27.74526 27.88398 28.0234 28.16352 300 32.35258 32.51435 32.67692 32.8403 33.00451 33.16953 350 36.91204 37.0966 37.28209 37.4685 37.65584 37.84412 400 41.10269 41.3082 41.51474 41.72232 41.93093 42.14058
(Step 4)
[0077] The XYZ coordinates are obtained using L and .
X=L.Math.sin .Math.cos , Y=L.Math.sin .Math.sin , Z=L.Math.cos
[0078] Once the XYZ coordinates of the arbitrary point on the image are obtained as described above, the distance between two points on the image can be calculated from the XYZ coordinates of the respective points.
[0079] The calculation of the XYZ coordinates and the arithmetic operation of the distance between two points described above are respectively performed by a coordinate calculation portion 952 and a 2-point distance calculation portion 954 in the PC 950. Further, an operation input portion 956 in the PC 950 acquires information regarding an object area where the distance measurement data are obtained (the coordinates (X1, Y1) of the irradiation position Q) by an operation input from a user. Further, a distance measurement data acquisition portion 958 in the PC 950 acquires distance measurement data L from the distance measuring unit 500. The coordinate calculation portion 952 acquires the origin XY coordinates (X0, Y0) from the image data obtained by imaging of the imaging element 705 and calculates the XYZ coordinates of the observation point (the irradiation position Q) in accordance with (step 1) to (step 4). Further, the 2-point distance calculation portion 954 calculates a distance between arbitrary 2 points on the basis of the XYZ coordinates of these 2 points. Note that the coordinate calculation portion 952 and the 2-point distance calculation portion 954 may be provided on a side of the distance measuring unit 500.
[0080] As described above, according to the present embodiment, it becomes possible to make an accurate distance measurement in an optical system environment with strong curvature aberration, such as a fisheye lens, for example, in an a small-diameter endoscopic observation environment, to which it is difficult to apply a usual distance measurement method, such as a stereoscopic measurement method.
[0081] The preferred embodiment(s) of the present disclosure has/have been described above with reference to the accompanying drawings, whilst the present disclosure is not limited to the above examples. A person skilled in the art may find various alterations and modifications within the scope of the appended claims, and it should be understood that they will naturally come under the technical scope of the present disclosure.
[0082] Further, the effects described in this specification are merely illustrative or exemplified effects, and are not limitative. That is, with or in the place of the above effects, the technology according to the present disclosure may achieve other effects that are clear to those skilled in the art from the description of this specification.
[0083] Additionally, the present technology may also be configured as below.
(1)
[0084] A distance measurement device including:
[0085] a light source configured to emit pulsed laser light;
[0086] a superimposition portion configured to superimpose reflection light obtained by reflection of the pulsed laser light by an object to be measured and reference light that is the pulsed laser light;
[0087] a saturation output portion, on which the reference light and the reflection light superimposed on each other are made incident, configured to output light having a saturated light quantity when incident light reaches a predetermined light quantity due to superimposition of pulses of the reflection light and the reference light; and a light-receiving portion configured to receive the light outputted from the saturation output portion.
(2)
[0088] The distance measurement device according to (1), in which
[0089] the superimposition portion includes a superimposition mirror configured to reflect the reference light superimpose the reference light on the reflection light, and
[0090] the distance measurement device includes a distance measuring portion configured to obtain a distance to the object to be measured from a relationship between a position of the superimposition mirror and an output of the light having the saturated light quantity.
(3)
[0091] The distance measurement device according to (2), in which
[0092] the pulsed laser light is radiated from an endoscope to the object to be measured and the reflection light from the object to be measured is superimposed on the reference light,
[0093] the superimposition mirror is arranged at a first position where the output of the saturation output portion is saturated at a time of calibration during which the pulsed laser light is reflected at a tip position of the endoscope,
[0094] the superimposition mirror is arranged at a second position where the output of the saturation output portion is saturated at a time of measurement during which the pulsed laser light is reflected by the object to be measured, and
[0095] the distance measuring portion obtains the distance to the object to be measured on a basis of the first position and the second position.
(4)
[0096] The distance measurement device according to any of (1) to (3), in which the light source includes an MOPA and has a pulse repetition frequency of 2.8 GHz or less.
(5)
[0097] The distance measurement device according to any of (1) to (4), in which the saturation output portion includes an SOA.
(6)
[0098] An imaging system including:
[0099] a distance measuring unit including a light source configured to emit pulsed laser light, a superimposition portion configured to superimpose reflection light obtained by reflection of the pulsed laser light by an object to be measured and reference light that is the pulsed laser light, a saturation output portion, on which the reference light and the reflection light superimposed on each other are made incident, configured to output light having a saturated light quantity when incident light reaches a predetermined light quantity due to superimposition of pulses of the reflection light and the reference light, and a light-receiving portion configured to receive the light outputted from the saturation output portion; and
[0100] an endoscope unit including an endoscope configured to emit the pulsed laser light made incident in the endoscope to the object to be measured, an imaging element configured to image the object to be measured as an object by the endoscope, and an adjustment portion configured to adjust a direction of the pulsed laser light such that the pulsed laser light is radiated to a specified location of the object to be measured.
(7)
[0101] The imaging system according to (6), in which
[0102] the superimposition portion includes a superimposition mirror for reflecting the reference light to superimpose the reference light on the reflection light, and
[0103] the imaging system includes a distance measuring portion configured to obtain a distance to the object to be measured from a relationship between a position of the superimposition mirror and an output of the light having the saturated light quantity.
(8)
[0104] The imaging system according to (7), in which
[0105] the pulsed laser light is radiated from the endoscope to the object to be measured and the reflection light from the object to be measured is superimposed on the reference light,
[0106] the superimposition mirror is arranged at a first position where the output of the saturation output portion is saturated at a time of calibration during which the pulsed laser light is reflected at a tip position of the endoscope,
[0107] the superimposition mirror is arranged at a second position where the output of the saturation output portion is saturated at a time of measurement during which the pulsed laser light is reflected by the object to be measured, and
[0108] the distance measuring portion obtains the distance to the object to be measured on a basis of the first position and the second position.
(9)
[0109] The imaging system according to (7), including:
[0110] a correction portion configured to correct the distance to the object to be measured on a basis of the distance to the object to be measured obtained by the distance measuring portion, the specified location on an image captured by the imaging element, and an optical characteristic of curvature aberration in imaging of the imaging element.
(10)
[0111] The imaging system according to any of (6) to (9), in which the light source includes an MOPA and has a pulse repetition frequency of 2.8 GHz or less.
(11)
[0112] The imaging system according to any of (6) to (10), in which the saturation output portion includes an SOA.
REFERENCE SIGNS LIST
[0113] 100 light source [0114] 150 mirror [0115] 200 SOA [0116] 300 light-receiving element [0117] 500 distance measuring unit [0118] 1000 system