Measurement support device, endoscope system, and processor measuring size of subject using measurement auxiliary light

Abstract

A measurement support device including a head configured to emit measurement auxiliary light, an imaging unit to capture an image of a subject on which a spot is formed by the measurement auxiliary light via an imaging optical system, a measurement unit to measure a position of the spot in the image, and a display control unit to display an indicator figure, and information indicating a trajectory along which the spot moves on the image when an imaging distance of the image is changed, wherein, in a case where an optical axis of the measurement auxiliary light is projected on a plane including an optical axis of the imaging optical system, the head emits the measurement auxiliary light that has an inclination angle, which is not 0 degrees with respect to the optical axis of the imaging optical system, and crosses an angle of view of the imaging optical system.

Claims

1. A measurement support device comprising: a head configured to emit measurement auxiliary light; an imaging unit configured to capture an image of a subject on which a spot is formed by the measurement auxiliary light via an imaging optical system and an imaging element; a processor configured to function as: a measurement unit configured to measure a position of the spot in the image; and a display control unit configured to display an indicator figure, which indicates an actual size of a specific region in the subject and has a size set according to the position of the spot in the image, and information indicating a trajectory along which the spot moves on the image when an imaging distance of the image is changed, in the vicinity of the position of the spot in the image of the subject, wherein, in a case where an optical axis of the measurement auxiliary light is projected on a plane including an optical axis of the imaging optical system, the head emits the measurement auxiliary light that has an inclination angle, which is not 0 degrees with respect to the optical axis of the imaging optical system, and crosses an angle of view of the imaging optical system.

2. The measurement support device according to claim 1, wherein the display control unit displays the information indicating the trajectory in different aspects between a region where measurement of the specific region by the indicator figure displayed in the vicinity of the position of the spot is effective and a region where measurement of the specific region by the indicator figure displayed in the vicinity of the position of the spot is not effective, in the trajectory.

3. The measurement support device according to claim 2, wherein, in a case where the position of the spot is within a measurable region set for the image, the display control unit determines that measurement of the specific region by the indicator figure is effective.

4. The measurement support device according to claim 2, wherein, in a case where the imaging distance of the image calculated on the basis of the position of the spot is within a measurable range, the display control unit determines that measurement of the specific region by the indicator figure is effective.

5. The measurement support device according to claim 2, wherein the display control unit changes at least one of characters, figures, symbols, or colors used for displaying the information indicating the trajectory between a case where measurement of the specific region by the indicator figure is effective and a case where measurement of the specific region by the indicator figure is not effective.

6. The measurement support device according to claim 2, wherein, in a case where measurement of the specific region by the indicator figure is not effective at the measured position of the spot, the display control unit outputs information for guiding the position of the spot to a range where measurement of the specific region by the indicator figure is effective.

7. The measurement support device according to claim 2, wherein the display control unit displays the indicator figure in different aspects between a case where measurement of a size of the specific region by the indicator figure is effective and a case where measurement of a size of the specific region by the indicator is not effective.

8. The measurement support device according to claim 1, wherein the processor is further configured to function as: an image recording unit configured to record the image of the subject on which the spot is formed, wherein the display control unit reads the image of the subject recorded in the image recording unit, and displays the indicator figure to be superimposed on the read image of the subject.

9. The measurement support device according to claim 8, wherein the image recording unit records the image of the subject and the indicator figure in an association manner, and the display control unit reads the indicator figure and the image of the subject which are recorded in the image recording unit, and displays the read indicator figure to be superimposed on the read image of the subject.

10. An endoscope system comprising: the measurement support device according to claim 1; and an endoscope including an insertion part which is to be inserted into the subject, and has a distal end hard part, a bending part connected to a proximal end side of the distal end hard part, and a flexible part connected to a proximal end side of the bending part, and an operating part connected to a proximal end side of the insertion part, wherein the head and an imaging lens that forms an optical image of the spot on the imaging element are provided in the distal end hard part.

11. The endoscope system according to claim 10, wherein the endoscope includes an information storage unit, comprising a memory, configured to store information indicating the trajectory.

12. The endoscope system according to claim 10, wherein the processor is further configured to function as: a display condition setting unit configured to set a display condition of the trajectory and the indicator figure.

13. A processor for the endoscope system according to claim 10, the processor comprising: the measurement unit; and the display control unit.

14. The processor according to claim 13, wherein the processor is further configured to function as: an information acquisition unit configured to acquire information of the endoscope, wherein the display control unit determines whether measurement of the specific region by the displayed indicator figure is effective on the basis of the acquired information.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

(1) FIG. 1 is a view illustrating an entire configuration of an endoscope system according to a first embodiment of the invention.

(2) FIG. 2 is a block diagram illustrating the configuration of the endoscope system according to the first embodiment of the invention.

(3) FIG. 3 is a view illustrating a configuration of a distal-end-side end surface of a distal end hard part.

(4) FIG. 4 is a view illustrating a configuration of a laser module.

(5) FIG. 5 is a sectional view illustrating a configuration of a laser light source module.

(6) FIG. 6 is a view illustrating a relationship between an optical axis of an imaging optical system, and an optical axis of measurement auxiliary light.

(7) FIG. 7 is a view illustrating a state where an insertion part of the endoscope is inserted into a subject.

(8) FIG. 8 is a flowchart illustrating processing of a measurement support method.

(9) FIG. 9 is a view illustrating a state where the optical axis of the measurement auxiliary light crosses an imaging angle of view of the imaging optical system.

(10) FIG. 10 is a view illustrating a state where a spot position is changed depending on a imaging distance.

(11) FIG. 11 is a view illustrating a relationship between a wavelength and a sensitivity of color filters.

(12) FIGS. 12A to 12C are views illustrating procedures of an operation using a movement trajectory of a spot.

(13) FIG. 13 is a view illustrating a state where coordinates of points indicating a circular marker are stored for a plurality of points in a movement trajectory of a spot.

(14) FIG. 14 is a view illustrating a relationship between a spot position and coordinates of points indicating a circular marker.

(15) FIG. 15 is a view illustrating a state where a spot position and coordinates of points indicating a circular marker are stored in an association manner.

(16) FIG. 16 is a view illustrating an example of a display condition setting screen.

(17) FIG. 17 is another view illustrating an example of the display condition setting screen.

(18) FIG. 18 is still another view illustrating an example of the display condition setting screen.

(19) FIG. 19 is a view illustrating an example of a screen on which a marker and a movement trajectory of a spot are displayed.

(20) FIG. 20 is a view illustrating a state where the display aspects of the trajectory are changed between a measurement effective region and other regions.

(21) FIGS. 21A and 21B are views for describing a measurement effective region.

(22) FIG. 22 is a view illustrating an example in which endpoints of a measurement effective region are displayed in a movement trajectory of a spot.

(23) FIGS. 23A to 23C are views illustrating a state where the display aspect of the marker is changed in regions other than the measurement effective region.

(24) FIG. 24 is a view illustrating a state where information for guiding a position of a spot to a measurement effective region is displayed.

(25) FIG. 25 is a view illustrating an image on which a spot is formed.

(26) FIG. 26 is a view illustrating a state where an image on which a spot is formed is stored.

(27) FIG. 27 is a view illustrating a state where a marker read from an image recording unit is displayed to be superimposed on an image of a subject.

(28) FIG. 28 is a view illustrating a state where an image of a subject and coordinates of points indicating a marker are stored in an association manner.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

(29) Hereinafter, embodiments of a measurement support device, an endoscope system, and a processor for an endoscope system according to the invention will be described in detail, referring to the accompanying drawings.

First Embodiment

(30) FIG. 1 is an external view illustrating an endoscope system 10 (measurement support device, endoscope system, and processor) according to a first embodiment, and FIG. 2 is a block diagram illustrating the configuration of main parts of the endoscope system 10. As illustrated in FIGS. 1 and 2, the endoscope system 10 includes an endoscope body 100 (endoscope), a processor 200 (processor), a light source device 300, and a monitor 400 (display device).

(31) <Configuration of Endoscope Body>

(32) The endoscope body 100 comprises a proximal operating part 102 (operating part), and an insertion part 104 (insertion part) provided to be connected to the proximal operating part 102. An operator (user) grips the proximal operating part 102, and inserts the insertion part 104 into the body of a subject to observe the body. The proximal operating part 102 is provided with a memory 139 (information storage unit), and information indicating a trajectory along which a spot of measurement auxiliary light moves on an image when an imaging distance of the image is changed is stored in the memory 139. As the memory 139, a non-volatile recording medium (non-temporary recording medium) such as a read only memory (ROM), an electronically erasable and programmable read only memory (EEPROM) can be used. In addition, the proximal operating part 102 is provided with an air-supply and water-supply button BT1, a suction button BT2, and a function button BT3 to which various functions (switching between a normal mode and a measurement mode, and the like) can be assigned. The insertion part 104 is constituted of a flexible part 112 (flexible part), a bending part 114 (bending part), and a distal end hard part 116 (distal end hard part) sequentially from the proximal operating part 102 side. By operating the proximal operating part 102, the bending part 114 can be bent to change the orientation of the distal end hard part 116 vertically and horizontally. The distal end hard part 116 is provided with an imaging optical system 130 (imaging unit), an illumination unit 123, a forceps port 126, a laser module 500, and the like (refer to FIGS. 1 to 3). A case in which the memory 139 is provided in the proximal operating part 102 is described in FIG. 2, but the memory 139 may be provided in a light guide connector 108 or may be provided in an electrical connector 109 which connects the processor 200 and the endoscope body 100 (refer to FIG. 1).

(33) <Acquisition of Trajectory Information>

(34) The information indicating a movement trajectory of the spot can be acquired, for example, by imaging a grid chart while changing the imaging distance and measuring a spot position corresponding to the imaging distance. A shape of the trajectory is uniquely determined in accordance with a relationship between an optical axis L1 of the measurement auxiliary light and an optical axis L2 of the imaging optical system 130 (refer to FIGS. 9 and 10). However, in a case where there is distortion in the imaging optical system 130, the shape of the trajectory is distorted depending on the distortion. The information can be stored in the memory 139 (the information storage unit).

(35) During observation or treatment, visible light, infrared light, or both can be radiated from illumination lenses 123A and 123B of the illumination unit 123 by the operation of the operating part 208 (refer to FIG. 2). Additionally, washing water is released from a water supply nozzle (not illustrated) by the operation of the air-supply and water-supply button BT1, so that an imaging lens 132 (imaging lens) of the imaging optical system 130 and the illumination lenses 123A and 123B can be washed. A pipe line (not illustrated) communicates with the forceps port 126 that opens at the distal end hard part 116, and a treatment tool (not illustrated) for tumor removal or the like is inserted through the pipe line and is appropriately moved forward and backward so as to perform treatment required for the subject.

(36) As illustrated in FIGS. 1 to 3, the imaging lens 132 is disposed on a distal-end-side end surface 116A of the distal end hard part 116. A complementary metal-oxide semiconductor (CMOS) type imaging element 134 (imaging element and color imaging element), a driving circuit 136, and an analog front end (AFE) 138 are disposed at the back of the imaging lens 132 so as to output image signals. The imaging element 134 is a color imaging element, and comprises a plurality of pixels constituted of a plurality of light receiving elements arranged in a matrix (two-dimensional array) in a specific pattern arrangement (Bayer arrangement, X-Trans (registered trademark) arrangement, honeycomb arrangement, or the like). Each pixel of the imaging element 134 includes a microlens, a red (R), green (G), or blue (B) color filter, and a photoelectric conversion part (photodiode or the like). The imaging optical system 130 can generate a color image from pixel signals of three colors of red, green, and blue, or can generate an image from pixel signals of any one color or two colors among red, green, and blue.

(37) In addition, in the first embodiment, a case where the imaging element 134 is a CMOS type imaging element is described. However, the imaging element 134 may be of charge coupled device (CCD) type.

(38) An image of the subject (a tumor part or a lesion part) or an optical image of a spot (to be described below) is formed on a light-receiving surface (imaging surface) of the imaging element 134 by the imaging lens 132, and is converted into electrical signals, and the electrical signals are output to the processor 200 via a signal cable (not illustrated) and are converted into video signals. Accordingly, an observation image, a circular marker, a movement trajectory of a spot, and the like are displayed on the monitor 400 connected to the processor 200. A touch panel may be provided on the monitor 400 for performing a display condition setting operation (refer to FIGS. 16 to 19) to be described below via a screen.

(39) Additionally, the illumination lens 123A (for visible light) and the illumination lens 123B (for infrared light) of the illumination unit 123 are provided on the distal-end-side end surface 116A of the distal end hard part 116 so as to be adjacent to the imaging lens 132. An exit end of a light guide 170 to be described below is disposed at the back of the illumination lenses 123A and 123B, the light guide 170 is inserted through the insertion part 104, the proximal operating part 102, and a universal cable 106, and an incidence end of the light guide 170 is disposed within the light guide connector 108.

(40) The distal-end-side end surface 116A is further provided with a laser head 506 (head) of the laser module 500, and the laser head 506 radiates spot light (measurement auxiliary light) via a prism 512 (refer to FIG. 4). The configuration of the laser module 500 will be described later. In addition, in the first embodiment, as illustrated in FIG. 3, the laser head 506 is provided separately from the forceps port 126. However, the laser head 506 may be removably inserted through the pipe line (not illustrated) communicating with the forceps port 126 that opens at the distal end hard part 116. Additionally, the laser head 506 may be provided between the imaging lens 132 and the forceps port 126.

(41) <Configuration of Laser Module>

(42) As illustrated in FIGS. 2 and 4, the laser module 500 comprises a laser light source module 502, an optical fiber 504, and a laser head 506 (head). A proximal end side (laser light source module 502 side) of the optical fiber 504 is covered with a fiber covering 501, a distal end side (a side from which laser light is emitted) thereof is inserted into and is bonded to a ferrule 508 by an adhesive, and an end surface is polished. A graded index (GRIN) lens 510 is mounted on a distal end side of the ferrule 508, and the prism 512 is mounted on a distal end side of the GRIN lens 510 so as to form a joined body. The ferrule 508 is a member for holding and connecting the optical fiber 504, and a hole for allowing the optical fiber 504 to be inserted therethrough is made empty in an axial direction (leftward-rightward direction of FIG. 4) at a central part of the ferrule. A reinforcing member 507 is provided outside the ferrule 508 and the fiber covering 501 to protect the optical fiber 504 or the like. The ferrule 508, the GRIN lens 510, and the prism 512 are housed in a housing 509 and are integrated with the reinforcing member 507 and the fiber covering 501 to constitute the laser head 506.

(43) In the laser head 506, for example, one having a diameter of 0.8 mm to 1.25 mm can be used as the ferrule 508. A fine-diameter ferrule is more preferable for miniaturization. By virtue of the above-described configuration, the total diameter of the laser head 506 can be 1.0 mm to 1.5 mm.

(44) The laser module 500 configured in this way is mounted in the insertion part 104. Specifically, as illustrated in FIG. 2, the laser light source module 502 is provided at the proximal operating part 102, the laser head 506 is provided at the distal end hard part 116, and the optical fiber 504 guides the laser light from the laser light source module 502 to the laser head 506. In addition, the laser light source module 502 may be provided within the light source device 300 so as to guide the laser light to the distal end hard part 116 with the optical fiber 504.

(45) As illustrated in FIG. 5, the laser light source module 502 is a pigtail type module (transmitter optical sub-assembly (TOSA)) comprising a visible laser diode (VLD) that is supplied with electrical power from a power source (not illustrated) and emits laser light, and a condensing lens 503 that condenses the laser light emitted from the VLD. The laser light can be emitted as necessary by the control of the processor 200 (CPU 210). By emitting the laser light only in a case where measurement is performed (measurement mode), the endoscope body can be used similarly to a normal endoscope during non-emission of laser light (normal mode).

(46) In the first embodiment, the laser light emitted by the VLD can be red laser light with a wavelength of 650 nm by a semiconductor laser. However, the wavelength of the laser light in the invention is not limited to this aspect. The laser light condensed by the condensing lens 503 is guided up to the GRIN lens 510 by the optical fiber 504. The optical fiber 504 is an optical fiber that propagates the laser light in a single transverse mode, and can form a clear spot with a small diameter, so that the size of the subject (measurement target) can be accurately measured. A relay connector may be provided in the middle of the optical fiber 504. In addition, in a case where the size of the diameter or clearness of the spot does not pose a measurement problem depending on observation conditions such as the type or size of the subject, an optical fiber that propagates the laser light in a multi-mode may be used as the optical fiber 504. Additionally, as the light source, a light-emitting diode (LED) may be used instead of the semiconductor laser, or the semiconductor laser may be used in an LED light emission state equal to or less than an oscillation threshold value.

(47) The GRIN lens 510 is a cylindrical graded index type lens (radial type) of which the refractive index is highest on the optical axis and decreases radially outward, and functions as a collimator that makes the laser light, which is guided by the optical fiber 504 and enters, into a parallel beam and emits the parallel beam. The spread of the beam emitted from the GRIN lens 510 can be adjusted by adjusting the length of the GRIN lens 510, and about λ/4 pitch (λ is the wavelength of the laser light) or the like may be used to emit the laser light as the parallel beam.

(48) The prism 512 is mounted on a distal end side of the GRIN lens 510. The prism 512 is an optical member for changing the emission direction of the measurement auxiliary light. By changing the emission direction, in a case where the optical axis of the measurement auxiliary light is projected on a plane including the optical axis of the imaging optical system, the optical axis of the measurement auxiliary light has an inclination angle, which is not 0 degrees with respect to the optical axis of the imaging optical system, and the measurement auxiliary light crosses the angle of view of the imaging optical system. The prism 512 is formed to have a size close to the lens diameter of the GRIN lens 510, and a distal end surface thereof is cut obliquely so that the prism 512 has an apex angle AL1 according to the above-described inclination angle. The value of the apex angle AL1 can be set in accordance with the emission direction of the laser light and other conditions.

(49) <Relationship Between Optical Axis of Imaging Optical System and Optical Axis of Measurement Auxiliary Light>

(50) FIG. 6 is a view illustrating a state where the distal end hard part 116 according to the first embodiment is seen from the front (subject side), and is a view corresponding to the configuration of FIG. 3. In the first embodiment, an optical axis L1 of the measurement auxiliary light and an optical axis L2 of the imaging optical system are present on the same plane and intersect each other on the same plane. Hence, in a case where the distal end hard part 116 is seen from the front (subject side), as illustrated in FIG. 6, the optical axis L1 appears to pass on the optical axis L2.

(51) In addition, the relationship between the optical axis L1 of the measurement auxiliary light and the optical axis L2 of the imaging optical system in the invention may not be limited to the above-described aspect in which “the optical axis of the measurement auxiliary light and the optical axis of the imaging optical system are present on the same plane and intersect each other on the same plane”, and the optical axis of the measurement auxiliary light may not be present on the same plane as the optical axis of the imaging optical system. However, even in such a case, in a case where the optical axis of the measurement auxiliary light is projected on the plane including the optical axis of the imaging optical system, the optical axis of the measurement auxiliary light has the inclination angle, which is not 0 degrees with respect to the optical axis of the imaging optical system, and crosses the angle of view of the imaging optical system.

(52) In a case where the measurement using the measurement auxiliary light is performed, if the optical axis of the measurement auxiliary light is parallel to the optical axis of the imaging optical system (the inclination angle is 0 degrees), the distance up to a point where the optical axis of the measurement auxiliary light crosses the angle of view of the imaging optical system becomes long depending on the spacing between the optical axes. As a result, a spot cannot be imaged in a closest distance, and the measurement becomes difficult. Additionally, if the optical axis of the measurement auxiliary light is parallel to the optical axis of the imaging optical system, there is a case where the sensitivity of a spot position change with respect to a change in observation distance is low and sufficient measurement accuracy is not obtained. In contrast, as in the first embodiment, a configuration “in a case where the optical axis of the measurement auxiliary light is projected on the plane including the optical axis of the imaging optical system, the optical axis of the measurement auxiliary light has the inclination angle, which is not 0 degrees with respect to the optical axis of the imaging optical system, and crosses the angle of view of the imaging optical system” is adopted. With this configuration, the measurement can be made at an observation distance of a wide range from the closest distance to a long distance. Additionally, since the sensitivity of the spot position change with respect to the distance change is high, the measurement can be made with high accuracy.

(53) <Configuration of Light Source Device>

(54) As illustrated in FIG. 2, the light source device 300 is constituted of a light source 310 for illumination, a stop 330, a condensing lens 340, a light source control unit 350, and the like, and makes illumination light (the visible light or infrared light) incident on the light guide 170. The light source 310 comprises a visible light source 310A and an infrared light source 310B, and is capable of radiating one or both the visible light and the infrared light. The illuminance of the illumination light by the visible light source 310A and the infrared light source 310B is controlled by the light source control unit 350, and the illuminance of the illumination light can be lowered or the illumination can be stopped as necessary in a case where a spot is imaged and measured (in the measurement mode).

(55) By coupling the light guide connector 108 (refer to FIG. 1) to the light source device 300, the illumination light radiated from the light source device 300 is transmitted to the illumination lenses 123A and 123B via the light guide 170 and is radiated to an observation range from the illumination lenses 123A and 123B.

(56) <Configuration of Processor>

(57) Next, the configuration of the processor 200 (a measurement unit and a display control unit) will be described with reference to FIG. 2. The processor 200 receives the image signals output from the endoscope body 100 via an image input controller 202, and performs required image processing by an image processing unit 204 (the measurement unit, the display control unit, the display condition setting unit, and the information acquisition unit) to output the image signals via a video output unit 206. Accordingly, an observation image is displayed on the monitor 400 (display device). These kinds of processing are performed under the control of a central processing unit (CPU) 210. That is, the CPU 210 has functions as the measurement unit, the display control unit, the display condition setting unit, and the information acquisition unit. In the image processing unit 204, switching and superimposition display of images displayed on the monitor 400, electronic zooming processing, display of images according to operation modes, extraction of a specific component (for example, a brightness signal) from the image signals, and the like are performed in addition to image processing, such as white balance adjustment. Additionally, the image processing unit 204 performs measurement of spot positions on the imaging surface of the imaging element 134, calculation of the size (the number of pixels) of a marker based on the measured positions, and the like (will be described below). An image of the subject on which the spot is formed and the like are recorded in an image recording unit 207. A sound processing unit 209 outputs a warning message (sound) at the time of display condition setting and sound information for guiding the spot position to the measurement effective region, through a speaker 209A under the control of the CPU 210 and the image processing unit 204.

(58) Examples of the specific hardware structure of the image processing unit 204 include processors (electric circuits) such as a central processing unit (CPU), a field programmable gate array (FPGA), and an application specific integrated circuit (ASIC). The image processing unit 204 may be constituted of one processor, or may be constituted of a combination of a plurality of processors. The memory 212 includes a storage element for temporary storage during various processing and a nonvolatile storage element (a non-temporary recording medium), and in the measurement processing, coordinates of spots and coordinates of points indicating the circular marker indicating the actual size of the measurement target in the subject are stored in the memory 212 in an association manner (will be described below) under the control of the CPU 210 and/or the image processing unit 204. Additionally, computer-readable codes of the program that makes the CPU 210 and/or the image processing unit 204 execute a measurement support method to be described below are stored in the memory 212.

(59) Additionally, the processor 200 comprises the operating part 208. The operating part 208 comprises an operation mode setting switch (not illustrated) and the like, and can operate radiation of the visible light and/or the infrared light. Additionally, the operating part 208 includes devices such as a keyboard and a mouse, which are not illustrated, and the user can input various processing conditions, display conditions, and the like via these devices. The display condition setting by the operating part 208 will be described below in detail (refer to FIGS. 16 to 19). The setting of the operation mode may be performed by assigning operation mode setting functions (switching between the measurement mode and the normal mode and the like) to the function button BT3 (refer to FIG. 1) of the proximal operating part 102 as described above.

(60) <Observation by Endoscope>

(61) FIG. 7 is a view illustrating a state where the insertion part 104 of the endoscope body 100 is inserted into the subject, and illustrates a state where an observation image is acquired for an imaging range IA via the imaging optical system 130. FIG. 7 illustrates a state where a spot SP0 is formed in the vicinity of a tumor tm (a portion that bulges in black).

(62) <Flow of Measurement Processing>

(63) Next, the measurement support method for the subject using the endoscope system 10 will be described. FIG. 8 is a flowchart illustrating processing of the measurement support method.

(64) First, the insertion part 104 of the endoscope body 100 is inserted into the subject, and the endoscope system 10 is set to a normal observation mode (Step S10). The normal observation mode is a mode in which the subject is irradiated with the illumination light radiated from the light source device 300 to acquire an image and the subject is observed. The setting to the normal observation mode may be automatically performed by the processor 200 at the time of the startup of the endoscope system 10 or may be performed in accordance with the operation of the operating part 208 by a user.

(65) In a case where the endoscope system 10 is set to the normal observation mode, the illumination light is radiated to image the subject, and the obtained image is displayed on the monitor 400 (Step S12). As the image of the subject, a still image may be captured or a moving image may be captured. During the imaging, it is preferable to switch the type (the visible light or the infrared light) of the illumination light in accordance with the type of the subject, the purposes of observation, or the like. The user moves the insertion part 104 forward or backward and/or operates to bend the insertion part 104 to direct the distal end hard part 116 to an observation target while viewing an image displayed on the monitor 400 so that the subject to be measured is imaged.

(66) Next, in Step S14, whether or not the normal observation mode shifts to a measurement mode is determined. This determination may be performed on the basis of the presence or absence of a user's operation via the operating part 208, or may be performed on the basis of the presence or absence of a switching command from the processor 200. Additionally, the processor 200 may alternately set the normal observation mode and the measurement mode at constant frame intervals (such as every one frame or every two frames). In a case where the determination of Step S14 is negative, the process returns to Step S12 and the imaging in the normal observation mode is continued, and in a case where the determination of Step S14 is positive, the process proceeds to Step S16 where switching to the measurement mode is performed.

(67) The measurement mode is a mode in which the laser light (measurement auxiliary light) is radiated from the laser head 506 to form a spot on the subject, and a marker for measuring the size (length) of the subject on the basis of the image of the subject on which the spot is formed is generated and displayed. In the measurement mode, information indicating a trajectory along which the spot moves on the image when the imaging distance is changed is also displayed. In the first embodiment, the red laser light is used as the measurement auxiliary light. However, since much of a digestive tract is reddish in an endoscope image, there is a case where the spot is not easily recognized depending on the measurement conditions. Thus, in the measurement mode, during the image acquisition and the position measurement of the spot, the illumination light is turned off or the illuminance is lowered to such a degree that the recognition of the spot is not affected (Step S18), and the measurement auxiliary light is radiated from the laser head 506 (Step S20). Such control can be performed by the processor 200 and the light source control unit 350.

(68) In Step S22, an image of the subject on which the spot is formed with the measurement auxiliary light is captured. In a case where the observation distance is within a measurement range, the spot is formed within the imaging angle of view of the imaging optical system 130. As will be described below in detail, the positions of spots within an image (on the imaging element) are different in accordance with the observation distance, and the sizes (the numbers of pixels) of markers to be displayed are different in accordance with the positions of the spots.

(69) <Change in Spot Positions according to Observation Distance>

(70) In the first embodiment, in a case where the optical axis L1 of the measurement auxiliary light is projected on the plane including the optical axis L2 of the imaging optical system, the optical axis L1 has the inclination angle, which is not 0 degrees with respect to the optical axis L2, and crosses the angle of view of the imaging optical system 130. Hence, the positions of spots in an image (imaging element) are different depending on the distance up to the subject. For example, as illustrated in FIG. 9 (a view illustrating a state where the distal end hard part 116 is seen from a lateral direction within the plane including the optical axis L1 and the optical axis L2), it is assumed that observation is possible in a range R1 of the observation distance. In this case, at a nearest end E1, a distance E2 in the vicinity of the center, and a farthest end E3 in the range R1, it can be understood that the positions of spots (points where the respective arrows and the optical axis L1 intersect each other) in imaging ranges (indicated by arrows Q1, Q2, and Q3) at the respective points are different from each other. In addition, in FIG. 9, the inside of solid lines is the imaging angle of view of the imaging optical system 130, and the inside of one-dot chain lines is a measurement angle of view. Measurement is performed at a central portion with a small aberration in the imaging angle of view of the imaging optical system 130. The range R1 and the measurement angle of view in FIG. 9 correspond to a “range where size measurement of a measurement target by a circular marker is effective in the captured image” (measurement effective region).

(71) FIG. 10 is a view illustrating a state where the distal end hard part 116 is seen from the front similarly to FIG. 6, and is a view virtually illustrating a relationship between the optical axis L2 of the imaging optical system 130, the optical axis L1 of the measurement auxiliary light, and an imaging range R2 of the imaging element 134. FIG. 10 illustrates a case where the optical axes L1 and L2 are present on the same plane and intersect each other on the plane. In FIG. 10, spot positions P4, P5, and P6 (corresponding to cases where the observation distances are in the vicinity of the nearest end, in the vicinity of the center, and in the vicinity of the farthest end, respectively) according to the observation distance are illustrated.

(72) As illustrated in FIG. 10, it can be understood that the spot position P4 in a case where the observation distance is in the vicinity of the nearest end and the spot position P6 in a case where the observation distance is in the vicinity of the farthest end are located opposite to each other with respect to the optical axis L2 of the imaging optical system 130. Hence, in the first embodiment, the sensitivity of the movement of the spot positions with respect to the change in the observation distance is high, and the size of subject can be measured with high accuracy.

(73) In this way, although the spot positions within the captured image (on the imaging element 134) are different in accordance with the relationship between the optical axis L2 of the imaging optical system 130 and the optical axis L1 of the measurement auxiliary light, and the observation distance. However, the number of pixels indicating the same actual size (for example, diameter of 5 mm) increases in a case where the observation distance is near, and the number of pixels decreases in a case where the observation distance is far. Hence, as will be described below in detail, coordinates of points indicating a circular marker can be acquired by storing the position (coordinates) of a spot, and coordinates of points indicating a circular marker indicating an actual size of a measurement target (for example, a specific region such as a tumor and a lesion) in a subject in an association manner in the memory 139, and referring to the stored information in accordance with the measured spot positions (coordinates). In the measurement processing, the information stored in the memory 139 may be expanded in the memory 212 and the information expanded in the memory 212 may be referred to. In the first embodiment, since it is not necessary to measure the observation distance itself in a case where the coordinates of the points indicating the circular marker are acquired, the configuration is simple, and the processing load is low.

(74) Referring to the flowchart of FIG. 8, the position measurement of a spot (Step S24) on the imaging surface of the imaging element 134 will be described. The position measurement of the spot in Step S24 is performed by an image generated by pixel signals of pixels in which a color filter of a red (R) color is disposed. Here, a relationship between the wavelength and sensitivity in color filters of respective colors (red, green, and blue) disposed in respective pixels of the imaging element 134 is as illustrated in FIG. 11. Additionally, the laser light emitted from the laser head 506 is red laser light with a wavelength of 650 nm. That is, the measurement of the spot positions is performed on the basis of the image generated by the image signals of the pixels (R pixels) in which a color filter of a red color with the highest sensitivity with respect to the wavelength of the laser light among red, green, and blue color filters is disposed. In this case, the position of the spot can be recognized at high speed by providing a threshold value to the signal intensity of the R pixels of bit map data or raw image format (RAW) data of the pixel signals to perform binarization and calculating the center of gravity of a white portion (a pixel having a higher signal intensity than the threshold value). In addition, in a case a spot is recognized by an actual image (an image generated by pixel signals of all colors), it is preferable that pixel signals of pixels (G pixels and B pixels) in which green and blue color filters are disposed are provided with threshold values, and only the pixels in which values of the pixel signals of the G pixels and the B pixels having the bit map data are equal to or smaller than the threshold values are extracted.

(75) In addition, in the measurement mode, as described above, during the image acquisition (Step S22) and the position measurement (Step S24) of the spot, the illumination light is turned off or the illuminance is lowered to such a degree that the recognition of the spot is not affected (Step S18), and the measurement auxiliary light is radiated from the laser head 506 (Step S20). Accordingly, an image with a clear spot can be acquired, the position of the spot can be accurately measured, and a marker having a suitable size can be generated and displayed.

(76) In Step S26, the processor 200 (the CPU 210 and the image processing unit 204) acquires coordinates of points indicating a circular marker indicating the actual size of the measurement target in the subject. As described above, the sizes of markers on the monitor 400 are different in accordance with the positions of spots within an image (namely, on the imaging surface of the imaging element 134). Thus, coordinates of a spot, and coordinates of points indicating the circular marker indicating an actual size of the measurement target in the subject are stored in an association manner in the memory 139 (or the information of the memory 139 is acquired to be stored in the memory 212). The processor 200 refers to the memory 139 (or the memory 212) in accordance with the spot position measured in Step S24, and acquires the coordinates of the points indicating the circular marker. A procedure of obtaining a relationship between the spot positions and the coordinates of the points indicating the circular marker will be described below in detail. In addition, in Step S26, the processor 200 also acquires information indicating the movement trajectory of the spot from the memory 139 (or the memory 212).

(77) In Step S28, the observation image, the circular marker, and the movement trajectory of the spot are displayed on the monitor 400 on the basis of the set display conditions (refer to examples of FIGS. 19, 20, 22, 23, and the like). In this case, the circular marker being displayed at a position away from the spot is inaccurate as an indicator, the circular marker is displayed in the vicinity of the spot (with the spot as a center) in the observation image. Circular markers having different actual sizes (for example, 3 mm, 5 mm, and the like) may be concentrically displayed, and other markers (for example, cross markers) may be displayed in addition to the circular markers. In addition, the movement trajectory of the spot is displayed by the processor 200 (the CPU 210 and the image processing unit 204) acquiring the information stored in the memory 139. At the time of the display, the information stored in the memory 139 may be expanded in the memory 212, and the processor 200 may refer to the memory 212 (the same applies to the circular marker). As described above, the processor 200 acquires and displays the information stored in the endoscope body 100, and thus the processor 200 can cope with various endoscope bodies.

(78) The display conditions (the type, number, actual size, and color of the marker, and the like) can be set by the user's operation via the operating part 208 (display condition setting unit) which will be described below (refer to FIGS. 16 to 18).

(79) <Operation Using Movement Trajectory of Spot>

(80) The operation using the movement trajectory of spots will be described. First, the operator operates the proximal operating part 102 to change the orientation of the distal end hard part 116 vertically and horizontally, and finds a lesion by screening (circular observation: Procedure 1). The state of Procedure 1 is illustrated in FIG. 12A. In the state of Procedure 1, a spot SP2 and a circular marker M2 (centered on the spot SP2) are present at a position separated from a tumor tm2, and the circular marker M2 is not effective as a measurement indicator. Then, the operator operates the proximal operating part 102 to change the orientation of the distal end hard part 116 vertically and horizontally, and causes the tumor tm2 to be placed on a movement trajectory T2 of the spot as in FIG. 12B (Procedure 2). Since the movement trajectory T2 indicates a movement trajectory of a spot in a case where the imaging distance is changed, the spot SP2 can be placed on the tumor tm2 by pushing and pulling the insertion part 104 from the state of Procedure 2. In the first embodiment, since the lower left in FIGS. 12A to 12C is the nearest end side of the imaging distance and the upper right in FIGS. 12A to 12C is the farthest end side, the spot SP2 is moved to the nearest end side on the movement trajectory T2 by pulling the insertion part 104 toward the proximal side from the state in FIG. 12B, and the spot SP2 can be placed on the tumor tm2 as in FIG. 12C (Procedure 3). Since the circular marker M2 is superimposed on the tumor tm2 by Procedure 3, the operator compares the actual size (for example, 5 mm) of the circular marker M2 with the tumor tm2 to measure the size of the tumor tm2 (Procedure 4). Further, a release operation (an operation for instructing recording of an image) is performed on the proximal operating part 102 (or the operating part 208) as necessary, and the image on which the spot Sp2 is formed is recorded in the image recording unit 207 (image recording unit) (Procedure 5). As described below in detail, in a case where an image, a spot position, and the like are recorded in the image recording unit 207, processing such as display of a circular marker and the like can be performed through post-processing (refer to FIGS. 25 to 28).

(81) In this manner, in the first embodiment, since the circular marker having a size set according to the position of the spot in the image and the movement trajectory of the spot are displayed in the vicinity of the spot, the operator can easily grasp how the spot and the circular marker move by the operation of the endoscope, and can swiftly and easily perform measurement.

(82) In a case where the measurement and recording of the image are completed, in Step S30, whether the measurement mode is ended is determined. This determination may be performed on the basis of the user's operation (for example, operation of the button B04 in the screen display of FIG. 19) via the operating part 208, or may be performed on the basis of the presence or absence of a switching command from the processor 200. Additionally, similarly to the case of shifting to the measurement mode, in a case where a certain number of frames have elapsed, the measurement mode may be automatically ended and may return to the normal observation mode. In a case where the determination of Step S30 is negative, the process return to Step S20 and the processing of Step S20 to Step S28 is repeated. In a case where the determination of Step S30 is positive, the process proceeds to Step S32 where the measurement auxiliary light is turned off, subsequently the illuminance of the illumination light is returned to normal illuminance in Step S34, and the mode returns to the normal observation mode (returning to Step S10). In addition, in a case where there is no hindrance in the observation in the normal observation mode, the measurement auxiliary light may not be turned off.

(83) As described above, in the endoscope system 10 according to the first embodiment, since a circular marker having a size set according to the position of the spot in the image and the movement trajectory of the spot are displayed in the vicinity of the spot, the measurement can be swiftly and easily performed.

(84) <Details of Processing of Measurement Support Method>

(85) Hereinafter, processing of the measurement support method described above will be described in detail.

(86) <Storage and Acquisition of Coordinates of Circular Marker>

(87) In the first embodiment, a position of a spot, and coordinates of points indicating a circular marker in the imaging surface of the imaging element 134 are stored in an association manner in the memory 212 (storage unit), and coordinates are acquired with reference to the memory 212 in accordance with the measured spot position. Hereinafter, storage of the coordinates will be described.

(88) <Storage of Coordinates of Marker>

(89) In the first embodiment, coordinates of points indicating a circular marker are stored for a plurality of points in a trajectory along which the spot moves on the captured image when the observation distance (imaging distance) is changed. The movement trajectory of the spot in the captured image in a case where the imaging distance is changed is determined depending on the relationship between the optical axis L1 of the measurement auxiliary light and the optical axis L2 of the imaging optical system 130, and is a straight line in the case of the relationship illustrated in FIG. 10, but is distorted in accordance with distortion in a case where the distortion is present in the imaging optical system 130.

(90) FIG. 13 is a view illustrating an aspect of the coordinate storage, and illustrates a state where coordinates of points indicating a circular marker are stored for K points (points P1 to PK; K is an integer of 2 or more) in a movement trajectory T1 of a spot. The point P1 to the point PK are a measurement effective region (a solid line portion of the movement trajectory T1; corresponding to the inside of the one-dot chain lines in FIG. 9) in which a size measurement by the circular marker is effective. The point P1 indicates a spot position in a case where the point P1 is the nearest end of the measurement effective region, and the point PK indicates a spot position in a case where the point PK is the farthest end of the measurement effective region. In addition, the movement trajectory T1 in FIG. 13 is virtually illustrated.

(91) In a case where the spot is present in a dotted line portion of the movement trajectory T1 (the peripheral portion of the captured image), the distortion becomes large. In addition, there are problems in that a part of the circular marker is out of the image in a case where the spot is present on the nearest end side (a portion of a region T1N indicated by a dotted line) of the movement trajectory T1, or the marker becomes small in a case where the spot is present on the farthest end side (a portion of a region T1F indicated by a dotted line), and any of these cases is not suitable for measurement. Thus, in the first embodiment, coordinates are stored in correspondence with the range of the spot position (a portion of a region T1E indicated by a solid line) where the size measurement of the measurement target by the circular marker is effective.

(92) FIG. 14 is a view illustrating a relationship between a spot position and coordinates of points indicating a circular marker, and illustrates the circular marker with L points (points Pi1, Pi2, . . . , Pij, . . . , PiL; L is an integer) centering on a point Pi (the position of a spot). The value of L can be determined on the basis of the required shape accuracy of the marker, and an accurate marker can be displayed as the number of points increases. The L points may be connected to each other by a straight line or a curved line. Additionally, FIG. 15 is a view illustrating a state where the spot position and the coordinates of the points indicating the circular marker are stored in an association manner.

(93) <Acquisition of Coordinates>

(94) In a case where the circular marker is displayed, the processor 200 (the CPU 210 and the image processing unit 204) acquires coordinates of the points indicating the circular marker with reference to the memory 212 (storage unit) on the basis of the measured coordinates of the spot. The “acquisition” herein includes using the stored coordinates and using the coordinates generated on the basis of the stored coordinates.

(95) The coordinates of the L points indicating the circular marker as illustrated in FIG. 14 are stored for each of the K points (spot positions) which are the points P1 to PK illustrated in FIG. 13. For example, coordinates of the points Pi1 to PiL are stored for the point Pi on the movement trajectory T1. Specifically, as illustrated in FIG. 15, the spot positions and the coordinates of the points indicating the circular marker are stored in an association manner in the memory 212. In this case, the coordinates may be stored to correspond to each of the plurality of actual sizes (for example, 2 mm, 3 mm, 5 mm, 7 mm, and 10 mm), and the actual size of the displayed circular marker may be switched in accordance with the measurement purpose. As the number of spot positions (K in the examples of FIGS. 13 to 15) of which the coordinates are stored, and the number of points indicating the circular marker (L in the examples of FIGS. 13 to 15) increase, the circular marker can be more accurately displayed.

(96) The coordinates of the points indicating the circular marker may be stored for some points (for example, K points of the points P1 to PK in the example of FIG. 13) on the movement trajectory T1. In this case, for the point (spot position) of which the coordinates are not stored, it is possible to acquire the coordinates of the marker by an aspect (first aspect) in which the coordinates stored for the points of which the distance from the measured spot position is within a threshold value are used. In addition, coordinates of the marker can be acquired by an aspect (second aspect) in which coordinates are acquired by interpolating the coordinates corresponding to two or more points that sandwich the measured spot, an aspect (third aspect) in which coordinates are acquired by extrapolating the coordinates corresponding to two or more points that do not sandwich the measured spot, and the like.

(97) Meanwhile, coordinates may be stored for all points (pixels) on the movement trajectory T1, and the stored coordinates may be acquired as they are. In the case of using such aspects, distance calculation, interpolation calculation, and the like between the points can be omitted.

(98) <Generation of Coordinates>

(99) Coordinates of points (the points Pi1 to PiL in the example of FIG. 14) indicating the circular marker can be generated by the following method, for example. Specifically, a square grid chart is imaged while the imaging distance is changed. In this case, the proximal operating part is operated to position the spot at an intersection of the grid, and coordinates of four points on the top, bottom, right, and left side of the spot are measured. Coordinates of other points are generated by interpolating the measured coordinates of the point. In the chart to be imaged, it is preferable that the interval of the grid is equal to or smaller than the actual size, and the interval is as fine as possible. Additionally, in order to position the “four points on the top, bottom, right, and left side of the spot” described above at intersections of the grid, in the chart to be imaged, it is preferable that the interval of the grid is an interval (1/integer) of a desired actual size (in a case where the actual size of the circular marker has a diameter of 5 mm, the interval of the grid is 0.5 mm, 1 mm, 1.25 mm, 2.5 mm, or the like). In addition, coordinates of the points indicating a marker having another shape such as a cross may be generated on the basis of the measured spot position and the four points on the top, bottom, right, and left side of the spot.

(100) <Setting of Screen Display Condition>

(101) The display condition setting such as the captured image, the circular marker, the movement trajectory of the spot, and the like, and display aspects depending on the set conditions will be described. FIG. 16 is a view illustrating an example of an entire screen for setting screen display conditions. FIG. 16 illustrates condition names (regions C01 to C11), contents of the set condition (numerical value or the like; regions V01 to V11), and buttons A01 to A11 for the condition setting for items of the screen display conditions. The buttons B01, B02, and B03 provided in a lower portion of the screen are respectively for confirming the display condition, for canceling the condition change, and for clearing the condition change (returning to initial values). The screen of FIG. 16 is displayed on the monitor 400, and the display conditions can be set by the user's operation via a touch panel of the monitor 400 and/or a keyboard and a mouse (not illustrated) of the operating part 208. Such display condition setting may be performed at any time during the execution of the flowchart of FIG. 8. The layout and the display items of the display condition setting screen to be described below are examples of the display condition setting, and other aspects can be adopted as needed.

(102) The regions C01 and V01 indicate whether a movement trajectory of a spot is displayed, and the display of the movement trajectory can be turned on or off by a selection operation via the button A01. The regions C02 and V02 indicate an aspect of the measurement effective region (display aspect) in the movement trajectory of the spot, and a solid line, a dotted line, or the like can be selected by an operation via the button A02. The regions C03 and V03 indicate a color of the measurement effective region in the movement trajectory of the spot, and a color such as white or blue can be selected by an operation via the button A03. The regions C04 and V04 indicate an aspect of the measurement non-effective region (display aspect) in the movement trajectory of the spot, and a dotted line, a chain line, or the like can be selected by a selection operation via the button A04. The regions C05 and V05 indicate a color of the measurement non-effective region in the movement trajectory of the spot, and a color such as red or black can be selected by a selection operation via the button A05. The regions C06 and V06 indicate whether information (for example, a triangular figure illustrated in FIG. 24) for guiding the position of the spot to the measurement effective region is output, and whether the information is output (output or no output) can be selected by an operation via the button A06. The regions C07 and V07 indicate whether endpoints of the measurement effective region are displayed, and whether the endpoints are displayed (displayed or not displayed) can be selected by an operation via the button A07. The regions C08 and V08 indicate whether a marker is displayed, and ON or OFF of the display can be selected by an operation via the button A08. The regions C09 and V09 indicate a shape of a marker to be displayed, and an aspect such as a circle or a cross can be selected by an operation via the button A09. The regions C10 and V10 indicate a color of a marker to be displayed, and a color such as white or blue can be selected by an operation via the button A10. The regions C11 and V11 indicate an actual size of a marker to be displayed, and a size such as 2 mm, 3 mm, or 5 mm can be selected by a selection operation via the button A11 (refer to FIG. 18).

(103) <Specific Example of Display Condition Setting>

(104) The specific example of the display condition setting operation will be described. FIG. 17 is a view illustrating an example of a screen for setting the aspect (display aspect) of the measurement effective region in the movement trajectory of the spot. In the screen of FIG. 16, in a case where the button A02 is designated by an operation on the touch panel of the monitor 400 or an operation via the operating part 208 (the same applies to other items), the region V02 is displayed in a pull-down manner and transitions to a state of FIG. 17. The illustration for items other than the aspect of the measurement effective region in FIG. 17 is omitted. In FIG. 17, conditions (in this case, solid line, dotted line, and one-dot chain line) that can be set as display aspects in the measurement effective region are displayed in the region V02, and the user moves a selection range up and down with buttons A02a and A02b and a slide bar A02c to select the aspect (for example, solid line) and determines the display aspect by designating the button B01 (OK button).

(105) FIG. 18 is a view illustrating an example of a screen for setting an actual size (size) of the marker. In the screen of FIG. 16, in a case where the button A11 is designated, the region V11 is displayed in a pull-down manner and transitions to a state of FIG. 18 (the illustration for items other than the actual size is omitted). In the example of FIG. 18, the actual size of the marker can be selected from “2 mm, 3 mm, 5 mm, 7 mm, and 10 mm”, and the user moves a selection range up and down with buttons A11a and A11b and a slide bar A11c to select the actual size (5 mm in FIG. 18), and designates the button B01. Additionally, the expression “the actual size of the marker is 5 mm” means that “a marker having a size (the number of pixels) corresponding to 5 mm is displayed on the screen of the monitor 400”, and the size of marker on the screen of the monitor 400 does not have to be 5 mm.

(106) In the setting of the display condition described above, in a case where the conditions respectively set for the items do not match, a warning message may be output via the monitor 400 and/or the speaker 209A.

(107) <Setting of Display Condition by Other Operation Means>

(108) In the above-described example, the case in which the display conditions of the marker are set by the touch panel of the monitor 400 and/or a keyboard and a mouse (not illustrated) of the operating part 208 has been described. However, the display conditions may be set by other operation means. For example, the display condition may be set by assigning a function to the function button BT3 of the proximal operating part 102. In addition, the display condition may be set by a foot pedal, a voice input, a gaze input, a gesture input, and the like. The user may not be able to freely move both hands during the operation of the endoscope body 100, and in such a case, the operation means is effective.

(109) <Specific Example of Screen Display>

(110) An example of the screen display with the conditions illustrated in FIG. 16 is illustrated in FIG. 19. As illustrated in FIG. 19, the screen displayed on the monitor 400 is constituted of an image display region D01 and an information display region D02. In the image display region D01, a spot SP1 is formed on a tumor tm1, and a circular marker M1 (actual size with a diameter of 5 mm) centered on the spot SP1 is displayed in white. In addition, the movement trajectory T1 of the spot is displayed, and is displayed in different aspects between a region T1E where measurement by the circular marker M1 is effective and other regions (a region T1N on the nearest end side and a region T1F on the farthest end side). Markers M1N and M1F are displayed at endpoints of the region T1E.

(111) Meanwhile, in the information display region D02, the fact that the endoscope system 10 is the “measurement mode” is displayed in a region D02A and current display conditions are displayed in a region D02B. In a case where the button B04 is designated, the mode is changed to the normal observation mode, and in a case where the button B05 is designated, the display condition setting screen as in FIG. 16 is displayed.

(112) In the endoscope system 10 according to the first embodiment, the display conditions can be easily checked and changed by the above-described information display region D02, and thus the measurement can be swiftly and easily performed. The information display region D02 may be a separate screen, and the image display region D01 may be widened by hiding or reducing the information display region D02 during the observation mode.

(113) <Display Aspect of Marker and Movement Trajectory of Spot>

(114) In the invention, the marker (indicator figure) and the movement trajectory of the spot may be displayed in the following aspects.

(115) <Identification Display of Measurement Effective Region>

(116) FIG. 20 is a view illustrating an example in which display aspects of the movement trajectory of the spot are changed between the region where the measurement by the marker is effective and the region where the measurement by the marker is not effective. In FIG. 20, in the movement trajectory T1, a region T1E where measurement of a tumor tm3 by a circular marker M3 centering on a spot SP3 is effective is illustrated using a solid line, and a region T1N on the nearest end side and a region T1F on the farthest end side where the measurement by the circular maker M3 is not effective are illustrated using dotted lines. That is, in FIG. 20, in a case where a spot is present in the region T1E, the measurement is effective, and in a case where a spot is present in the region T1N or the region T1F, the measurement is not effective. The “region where measurement is effective” in the identification display is a region (corresponding to the range R1 of FIG. 9) which is in the vicinity of the center of the captured image and in which the influence of the distortion of the imaging optical system 130 is small and the marker does not extend beyond the image or become too small. In such a region, it is possible to perform accurate measurement. In the identification display, without being limited to the aspect of using the solid line and the dotted line, other kinds of a line may be used, and the thickness of the line, color, a figure and/or a symbol to be used, and the like may be changed.

(117) Whether the measurement by the marker is effective or not can be easily determined by the identification display of the measurement effective region as illustrated in FIG. 20 (the display aspects of the movement trajectory of the spot are changed between a region where measurement by a marker is effective and a region where measurement by a marker is not effective), and thus the measurement can be swiftly and easily performed. Additionally, in addition to the identification display of the measurement effective region, the movement trajectory may be displayed in different aspects in accordance with the imaging distance. For example, conditions such as kinds of a line, a thickness of a line, a color, a figure, and a symbol may be changed in a region where the imaging distance is close and in a region where the imaging distance is far.

(118) The above-described “region where measurement by a marker is effective” (measurement effective region) may be set to a part of the image or may be set for a range of the imaging distance. For example, a grid chart on which a spot is formed is imaged while the imaging distance is changed, the size of the grid, the distortion degree of the grid, and the like are measured at each distance, and the measurement effective region can be set on the basis of the measurement result. FIG. 21A conceptually illustrates a measurable range (D1 to D2) set for the imaging distance in the above-described procedure, and spot positions (X coordinate is from X1 to X2) corresponding to the measurable range. Further, FIG. 21B conceptually illustrates the measurable range (D1 to D2) set for the imaging distance, and spot positions (Y coordinate is from Y1 to Y2) corresponding to the measurable range. In the example of FIGS. 21A and 21B, in a case where the X coordinate of the spot positions is from X1 to X2 and the Y coordinate thereof is from Y1 to Y2 (an inside of the measurable region) and in a case where the imaging distance is within the measurable range (imaging distance is from D1 to D2), it is determined that “measurement by the marker is effective”. Such information of the measurement effective region is stored in the memory 139, and the processor 200 (the CPU 210 and the image processing unit 204) can acquire such information to determine “whether measurement by the marker is effective”. By determining the effectiveness of the measurement on the basis of the information of the endoscope body 100 connected to the processor 200 in this manner, the processor 200 can cope with various endoscopes.

(119) <Identification Display of Endpoints of Measurement Effective Region>

(120) FIG. 22 is a view illustrating an example in which endpoints of the region where measurement by a marker is effective are displayed to be identified, and displays endpoints of the region T1E where measurement of a tumor tm4 by a circular marker M4 is effective, using markers M4N and M4F. Whether the measurement by the circular marker M4 is effective or not can be easily determined by the identification display of the endpoints, and thus the measurement can be swiftly and easily performed. Further, FIG. 22 illustrates the case where the identification display of the endpoints is combined with the identification display illustrated in FIG. 20 (in the movement trajectory T1 of the spot, the region T1E where the measurement by the circular marker M3 is effective is displayed using a solid line, and the regions T1N and T1F where the measurement by the circular marker M3 is not effective are displayed using dotted lines). However, only the endpoints may be displayed to be identified.

(121) <Display Aspect of Marker according to Effectiveness of Measurement>

(122) FIGS. 23A to 23C are views illustrating an example in which the display aspects of the marker are changed between a region where measurement by the marker is effective and other regions. Specifically, in a case where a spot SP5N is present in a region T1N on the nearest end side of a movement trajectory T1 as illustrated in FIG. 23A and in a case where a spot SP5F is present in a region T1F on the farthest side of the movement trajectory T1 as illustrated in FIG. 23C, since the measurement of a tumor tm5 by circular markers M5N and M5F are not effective, the circular markers M5N and M5F are respectively displayed using dotted lines. In FIGS. 23A and 23C, the circular markers on the nearest end side and the farthest side are displayed using dotted lines, but different kinds of a line may be used or different colors may be used for the circular markers on the nearest end side and the farthest side. Meanwhile, in a case where a spot SP5 is present in a region T1E where the measurement by a circular marker M5 is effective as illustrated in FIG. 23B, the circular marker M5 is displayed using a solid line.

(123) Whether the measurement by the marker is effective or not can be easily determined by the display aspects of the marker as described above, and thus the measurement can be swiftly and easily performed.

(124) <Guiding to Measurement Effective Region>

(125) In a case where the circular marker is not present in the above-described measurement effective region, information for guiding to the measurement effective region may be output. For example, in a case where the spot SP5F is present in the region T1F (farthest end side) where the measurement is not effective as illustrated in FIG. 24, a figure G1 indicating an operation direction of the insertion part 104 can be displayed. The figure G1 has a triangular shape, the operator (user) can easily grasp that “the circular marker is guided to the measurement effective region (direction of the tumor tm7) by operating the insertion part 104 in the apex direction of the triangle (pulling the insertion part toward the proximal side)” by the figure G1. The information for guiding to the measurement effective region is not limited to the figure G1, other symbols such as an arrow can be used as the information for guiding to the measurement effective region, and colors or sizes which can be easily identified can be set. An animation in which a figure or the like is dynamically changed may be displayed. In addition, characters or symbols may be used instead of the figure or in addition to the figure. Further, guiding may be performed using a sound (for example, “please, push the cope” or “please, pull the scope”) by the sound processing unit 209 and the speaker 209A (refer to FIG. 2) instead of the visual display or in addition to the visual display. By outputting such information, guiding to the measurement effective region becomes easy, and the measurement can be swiftly and easily performed.

(126) <Offline Processing by Recording Image>

(127) In the endoscope system 10 according to the first embodiment, processing such as the marker display or the like and the measurement based on the processing may be performed in real time (display of a marker or a trajectory for each time an image on which a spot is formed is acquired or for every plural frames), or offline processing (post-processing) may be performed as described below. In order to perform the offline processing, an image on which a spot SP6 is formed on a tumor tm6 as in FIG. 25 is stored in the image recording unit 207. In this case, as illustrated in FIG. 26, the image (image file) and the spot position (coordinates) are recorded in an association manner. As described above, since the spot positions and the coordinates of the points indicating the circular marker are stored in an association manner in the memory 139 (or the memory 212) (refer to FIG. 15), the coordinates of the points indicating the circular marker can be acquired by referring to the memory 139 (or the memory 212) on the basis of the spot positions recorded in association with the image. Hence, by the acquisition of the coordinates, the circular marker can be displayed to be superimposed on the image read from the image recording unit 207. FIG. 27 is an example of display by the post-processing, and the circular marker M6 centered on the spot SP6 is displayed to be superimposed on an image of the tumor tm6.

(128) In addition to the above-described aspects, the image and the circular marker may be recorded in an association manner. For example, as illustrated in FIG. 28, an image (image file), a spot position (coordinates), and coordinates of points indicating a circular marker (which can be acquired by referring to the memory 139 or the memory 212) are recorded in an association manner in the image recording unit 207. Accordingly, the recorded image and the recorded coordinates of the points indicating the circular marker can be read and the circular marker can be displayed to be superimposed on the image (refer to FIG. 27).

(129) As described above, by recording the captured image, the spot position, the coordinates of the points indicating the circular marker, and the like in an association manner, the post-processing such as the display of the circular marker or the like and the measurement can be performed, and thus it is possible to shorten the time during which the endoscope is inserted into the subject and thus to reduce the burden on the subject. As the image or the like used for the measurement, not only the images recorded in the image recording unit 207 may be used, but also images acquired from a non-temporary recording medium such as a compact disk (CD) or a digital versatile disc (DVD) via the image input interface 205 (refer to FIG. 2) may be used.

(130) <Others>

(131) The measurement support device, the endoscope system, and the processor according to the embodiments of the invention can also be applied to cases where subjects, which are not living bodies, such as a pipe, are measured in addition to measuring the subject that is a living body. Additionally, the measurement support device according to the embodiments of the invention can be applied not only to the endoscope but also to the cases of measuring the dimensions and shapes of an industrial part or the like.

(132) Although the embodiments of the invention have been described above, it is obvious that the invention is not limited to the above-described aspects, and various modifications can be made without departing from the spirit of the invention.

EXPLANATION OF REFERENCES

(133) 10: endoscope system 100: endoscope body 102: proximal operating part 104: insertion part 106: universal cable 108: light guide connector 109: electrical connector 112: flexible part 114: bending part 116: distal end hard part 116A: distal-end-side end surface 123: illumination unit 123A: illumination lens 123B: illumination lens 126: forceps port 130: imaging optical system 132: imaging lens 134: imaging element 136: driving circuit 138: AFE 139: memory 170: light guide 200: processor 202: image input controller 204: image processing unit 205: image input interface 206: video output unit 207: image recording unit 208: operating part 209: sound processing unit 209A: speaker 210: CPU 212: memory 300: light source device 310: light source 310A: visible light source 310B: infrared light source 330: stop 340: condensing lens 350: light source control unit 400: monitor 500: laser module 501: fiber covering 502: laser light source module 503: condensing lens 504: optical fiber 506: laser head 507: reinforcing member 508: ferrule 509: housing 510: GRIN lens 512: prism A01: button A02: button A02a: button A02c: slide bar A03: button A04: button A05: button A06: button A07: button A08: button A09: button A10: button A11: button A11a: button A11c: slide bar AL1: apex angle B01: button B02: button B03: button B04: button B05: button BT1: air-supply and water-supply button BT2: suction button BT3: function button C01: region C02: region C03: region C04: region C05: region C06: region C07: region C08: region C09: region C10: region C11: region D01: image display region D02: information display region D02A: region D02B: region E1: nearest end E2: distance E3: farthest end G1: figure IA: imaging range L1: optical axis L2: optical axis M1: circular marker M1N: marker M2: circular marker M3: circular marker M4: circular marker M4N: marker M5: circular marker M5N: circular marker M6: circular marker P4: spot position P5: spot position P6: spot position Q1: arrow Q2: arrow Q3: arrow R1: range R2: imaging range S10 to S34: respective steps of measurement support method SP0: spot SP1: spot SP2: spot SP3: spot SP5: spot SP5F: spot SP5N: spot SP6: spot T1: movement trajectory T1E: region T1F: region T1N: region T2: movement trajectory V01: region V02: region V03: region V04: region V05: region V06: region V07: region V08: region V09: region V10: region V11: region tm: tumor tm1: tumor tm2: tumor tm3: tumor tm4: tumor tm5: tumor tm6: tumor tm7: tumor