Echo image display device
10386459 ยท 2019-08-20
Assignee
Inventors
Cpc classification
International classification
Abstract
An echo image display device includes a receiver, an information memory, an intermediate image production component, and a display component. The receiver is configured to receive a reception signal that is a reflection of a transmitted signal. The information memory is configured to store detection information about the reception signal received by the receiver and position information about the reception signal in association with each other. The intermediate image production component is configured to produce an intermediate image based on at least the detection information for the reception signal at an N-th scan, and the detection information for the reception signal at an N1-th scan having the same position information as the position information for the reception signal at the N-th scan. The display component is configured to display the intermediate image produced by the intermediate image production component.
Claims
1. An echo image display device comprising: a receiver configured to receive a reception signal that is a reflection of a transmitted signal; an information memory configured to store detection information about the reception signal received by the receiver and position information about the reception signal in association with each other; processing circuitry configured to produce an intermediate image based on at least the detection information for the reception signal at a current scan, and the detection information for the reception signal at a previous scan having the same position information as the position information for the reception signal at the current scan; and a display that displays the intermediate image produced by the processing circuitry after displaying a previous echo image based on the reception signal at the previous scan and before displaying a current echo image based on the reception signal at the current scan.
2. The echo image display device according to claim 1, wherein the processing circuitry is configured to produce the intermediate image by linear interpolation using the detection information for the reception signal at the current scan, and the detection information for the reception signal at the previous scan having the same position information as the position information for the reception signal at the current scan.
3. The echo image display device according to claim 2, wherein the information memory is configured to store the position information and the detection information for a specific detection region, and the processing circuitry is configured to produce the intermediate image for the detection region every time the entire detection region is scanned.
4. The echo image display device according to claim 3, wherein the processing circuitry is configured to produce multiple intermediate images based on at least the detection information for the reception signal at the current scan, and the detection information for the reception signal at the previous scan having the same position information as the position information for the reception signal; and the display displays the multiple intermediate images produced by the processing circuitry after displaying a previous echo image based on the reception signal at the previous scan and before displaying a current echo image based on the reception signal at the current scan.
5. The echo image display device according to claim 2, further comprising an estimator configured to estimate a future change in an echo image produced based on the reception signal, the echo image produced based on the reception signal at the current scan being a future echo image estimated by the estimator.
6. The echo image display device according to claim 2, wherein the processing circuitry is configured to produce multiple intermediate images based on at least the detection information for the reception signal at the current scan, and the detection information for the reception signal at the previous scan having the same position information as the position information for the reception signal; and the display displays the multiple intermediate images produced by the processing circuitry after displaying a previous echo image based on the reception signal at the previous scan and before displaying a current echo image based on the reception signal at the current scan.
7. The echo image display device according to claim 1, wherein the processing circuitry is configured to produce the intermediate image by curve interpolation using at least the detection information for the reception signal at the current scan, the detection information for the reception signal at the previous scan having the same position information as the position information for the reception signal at the current scan, and the detection information for the reception signal at a scan before the previous scan having the same position information as the position information for the reception signal at the current scan.
8. The echo image display device according to claim 7, wherein the information memory is configured to store the position information and the detection information for a specific detection region, and the processing circuitry is configured to produce the intermediate image for the detection region every time the entire detection region is scanned.
9. The echo image display device according to claim 7, further comprising an estimator configured to estimate a future change in an echo image produced based on the reception signal, the echo image produced based on the reception signal at the current scan being a future echo image estimated by the estimator.
10. The echo image display device according to claim 7, wherein the processing circuitry is configured to produce multiple intermediate images based on at least the detection information for the reception signal at the current scan, and the detection information for the reception signal at the previous scan having the same position information as the position information for the reception signal; and the display displays the multiple intermediate images produced by the processing circuitry after displaying a previous echo image based on the reception signal at the previous scan and before displaying a current echo image based on the reception signal at the current scan.
11. The echo image display device according to claim 1, wherein the processing circuitry is configured to produce the intermediate image based on at least a motion vector estimating a motion of an image between an echo image produced based on the reception signal at the current scan and an echo image produced based on the reception signal at the previous scan.
12. The echo image display device according to claim 11, wherein the information memory is configured to store the position information and the detection information for a specific detection region, and the processing circuitry is configured to produce the intermediate image for the detection region every time the entire detection region is scanned.
13. The echo image display device according to claim 11, further comprising an estimator configured to estimate a future change in an echo image produced based on the reception signal, the echo image produced based on the reception signal at the current scan being a future echo image estimated by the estimator.
14. The echo image display device according to claim 11, wherein the processing circuitry is configured to produce multiple intermediate images based on at least the detection information for the reception signal at the current scan, and the detection information for the reception signal at the previous scan having the same position information as the position information for the reception signal; and the display displays the multiple intermediate images produced by the processing circuitry after displaying a previous echo image based on the reception signal at the previous scan and before displaying a current echo image based on the reception signal at the current scan.
15. The echo image display device according to claim 1, wherein the information memory is configured to store the position information and the detection information for a specific detection region, and the processing circuitry is configured to produce the intermediate image for the detection region every time the entire detection region is scanned.
16. The echo image display device according to claim 15, further comprising an estimator configured to estimate a future change in an echo image produced based on the reception signal, the echo image produced based on the reception signal at the current scan being a future echo image estimated by the estimator.
17. The echo image display device according to claim 15, wherein the processing circuitry is configured to produce multiple intermediate images based on at least the detection information for the reception signal at the current scan, and the detection information for the reception signal at the previous scan having the same position information as the position information for the reception signal; and the display displays the multiple intermediate images produced by the processing circuitry after displaying a previous echo image based on the reception signal at the previous scan and before displaying a current echo image based on the reception signal at the current scan.
18. The echo image display device according to claim 1, further comprising an estimator configured to estimate a future change in an echo image produced based on the reception signal, the echo image produced based on the reception signal at the current scan being a future echo image estimated by the estimator.
19. The echo image display device according to claim 18, wherein the processing circuitry is configured to produce multiple intermediate images based on at least the detection information for the reception signal at the current scan, and the detection information for the reception signal at the previous scan having the same position information as the position information for the reception signal; and the display displays the multiple intermediate images produced by the processing circuitry after displaying a previous echo image based on the reception signal at the previous scan and before displaying a current echo image based on the reception signal at the current scan.
20. The echo image display device according to claim 1, wherein the processing circuitry is configured to produce multiple intermediate images based on at least the detection information for the reception signal at the current scan, and the detection information for the reception signal at the previous scan having the same position information as the position information for the reception signal; and the display displays the multiple intermediate images produced by the processing circuitry after displaying a previous echo image based on the reception signal at the previous scan and before displaying a current echo image based on the reception signal at the current scan.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) Referring now to the attached drawings which form a part of this original disclosure:
(2)
(3)
(4)
(5)
(6)
DETAILED DESCRIPTION OF EMBODIMENTS
(7) Selected embodiments will now be explained with reference to the drawings. It will be apparent to those skilled in the art from this disclosure that the following descriptions of the embodiments are provided for illustration only and not for the purpose of limiting the invention as defined by the appended claims and their equivalents.
(8)
(9) The radar image display device (echo image display device) 100 in the first embodiment functions as a display component in a radar device installed on a ship (moving body). This radar image display device 100 is electrically connected to a radar antenna 90, receives reception signals from this radar antenna 90, and can produce and display radar images that reflect the status of a detection object (detection region).
(10) The radar antenna 90 is configured to be able to rotate 360 in a horizontal plane, and detects information about an island, another vessel, or another such target (detection object) around the ship by scanning the surrounding region by transmitting microwaves (electromagnetic waves, etc.) with a short wavelength as a detection signal (transmission signal). More specifically, the radar antenna 90 transmits electromagnetic waves with high directionality, and receives echoes (reflected waves) from targets within the detection region, thereby acquiring information about the targets, and outputs the acquired information to the radar image display device 100.
(11) The radar image display device 100 receives information as a reception signal from the radar antenna 90, finds the distance, size, and azimuth of a target based on the received reception signal, produces a radar image (echo image), and displays this on a display (display component) 10.
(12) As shown in
(13) The display 10 is constituted by a liquid crystal display or the like, and can display a radar image in response to a display command from the information processor 30. This radar image is a two-dimensional expression of the position and shape of a detection object in a circular detection region.
(14) The interface 20 is disposed near the display 10, and comprises suitable input members. Examples of input members include a track ball, buttons, and a keyboard, but these are not the only options. The user operates the interface 20 to give various instructions to the radar image display device 100 (such as designating the detection region, or switching between a mode in which an intermediate image (discussed below) is displayed and a mode in which it is not displayed).
(15) As shown in
(16) The radar signal transceiver 31 can produce transmission signals (such as electromagnetic waves) at a specific transmission timing and output them to the radar antenna 90. The radar signal transceiver 31 can then input as a reception signal the information from the reflected wave of the detection signal transmitted by the radar antenna 90, and subject this reception signal to amplification, filtering, A/D conversion, etc.
(17) The radar signal processor 32 subjects the reception signal inputted from the radar signal transceiver 31 to pulse compression processing, gain adjustment, processing to remove sea return and the like, scan correlation, and other such processing. The radar signal processor 32 then outputs the reception signal that has undergone signal processing to the radar image production component 33.
(18) The radar image production component 33 is configured to produce a radar image in PPI (plan position indicator) scope format based on the reception signal that has undergone signal processing. The radar image production component 33 acquires the distance to a target based on the time difference between the point at which the radar antenna 90 transmitted the transmission signal and the point at which the reflected wave was received. The radar image production component 33 also acquires the direction in which the target is located based on the orientation of the radar antenna 90 at the point when the transmission signal was transmitted.
(19) Specifically, the radar image produced by the radar image production component 33 includes various kinds of detection information obtained by the transmission and reception of signals. After producing a radar image, the radar image production component 33 outputs that radar image to the image memory 34 and the intermediate image production component 35.
(20) The image memory 34 can store the radar image inputted from the radar image production component 33 for at least the two immediately prior scans. In this Specification, the term scan refers to an operation in which the entire detection region is scanned one time. A scan in a radar device means an operation in which the radar antenna 90 makes one rotation.
(21) To describe this in more specific terms, every time the radar antenna 90 makes one scan, the radar image production component 33 outputs to the image memory 34 a radar image P produced based on the reception signal received for that scan. Every time a radar image P is inputted from the radar image production component 33, the image memory 34 discards the radar image for the oldest scan from the memory content, and newly stores the inputted radar image. Therefore, if we call the latest scan the N-th scan, the image memory 34 functions as a buffer that always stores a radar image P.sub.N based on the N-th scan and a radar image P.sub.N-1 based on the N1-th scan. The image memory 34 can output the stored radar images P.sub.N and P.sub.N-1 to the intermediate image production component 35 as needed.
(22) In this embodiment, the radar image P defines polar coordinates (r,) centered on the radar antenna 90, and is expressed as a grouping of signal strength data S at these coordinates (r,). The image memory 34 can store the signal strength data (detection information) S in association with the coordinates (position information) at which the signal was acquired.
(23) The intermediate image production component 35 produces an image (intermediate image) for compensating for the interval between the radar images P.sub.N and P.sub.N-1 based on the two radar images P.sub.N and P.sub.N-1 inputted from the image memory 34, and outputs this image to the display 10.
(24) As described above, the radar image display device 100 in this embodiment comprises the intermediate image production component 35, and can produce an intermediate image of the radar images P.sub.N and P.sub.N-1 obtained for two continuous scans, and display this image on the display 10. Consequently, coarse changes in the radar image at each scan can be suppressed, and how the status of the detection region changes can be expressed more smoothly.
(25) The graph in
(26) Points S.sub.0 to S.sub.7 in
(27) With a conventional radar device, the display strength of a radar image at certain coordinates (r,) changes at the point when the sweep line (scan line) that rotates over the radar image passes through the above-mentioned positional coordinates, and does not change at any other point. Therefore, with a conventional radar device, the display strength of a radar image changes intermittently as indicated by the thin line that changes in steps every time one scan period elapses in the graph in
(28) In this regard, the radar image display device 100 in this embodiment is configured such that the display strength at the current time t.sub.CUR at certain coordinates (r,) will be an intermediate signal strength S.sub.M calculated so as to compensated for the interval between the strength S.sub.7 based on the latest scan and the strength S.sub.6 based on the scan just before that. This intermediate signal strength S.sub.M is calculated so as to exhibit a value close to S.sub.7 if the point in time that is one scan period T.sub.SCAN in the past from the current time t.sub.CUR is closer to the timing of the latest scan (the time t.sub.1 at which the signal of S.sub.7 was obtained), and to exhibit a value that is close to S.sub.6 if this point in time is closer to the timing of the scan just before that (the time t.sub.6 at which the signal of S.sub.6 was obtained).
(29) To put the above-mentioned processing another way, focusing on the image, the image displayed on the display 10 at the current time t.sub.CUR will be an intermediate image P.sub.M calculated so as to compensate for the interval between the radar image P.sub.7 based on the latest scan and the radar image P.sub.6 based on the scan just before that.
(30) Only one of the radar images P.sub.0 to Pi is obtained during one scan period, but as many of the intermediate images P.sub.M can be produced as the calculation load will allow. Therefore, the image refresh time interval can be shorted in the display 10, and the change in the status of the detection region can be expressed as a smooth change in the image.
(31) The specific processing performed by the intermediate image production component 35 will now be described. In this embodiment, the radar image P produced by the radar image production component 33 is represented as a grouping of signal strength data S corresponding to the coordinates (r,) in the above-mentioned polar coordinate system.
(32) If we let S.sub.N be the signal strength obtained in the latest (N-th) scan at certain coordinates (r,), t.sub.N be the time at which this signal strength was obtained, S.sub.N-1 be the signal strength obtained one scan before (the N1-th) at the same coordinates (r,), and t.sub.N-1 be the time at which this signal strength was obtained, the intermediate image production component 35 uses the following formula (1) to find the display strength S.sub.CUR (intermediate signal strength S.sub.M) at these coordinates at the current time t.sub.CUR.
(33)
Here, T.sub.SCAN is one scan period.
(34) The intermediate image P.sub.M is obtained by calculating the intermediate signal strength S.sub.M based on this linear interpolation formula for all of the coordinates (r,). The intermediate image P.sub.M thus obtained is then transiently displayed, so that the process by which the status of the detection region changes can be continuously expressed with an ample amount of information.
(35)
(36) Linear interpolation is used as the method for producing the intermediate image P.sub.M in this embodiment. This allows the calculation processing to be simplified. However, the configuration may, for example, be such that three or more radar images (in other words, the signal strength S.sub.N at the latest scan, the signal strength S.sub.N-1 at the scan just before that, and the signal strength S.sub.N-2 two scans before that) can be stored in the image memory 34, and curve interpolation (such as interpolation with a quadratic curve) may be performed based on these radar images. In this case, an even more natural change in the display content can be achieved.
(37) Also, the motion vector of a block (target) can be calculated by block matching, and the intermediate image (interpolation image) P.sub.M can be produced based on the calculated motion vector (motion vector interpolation). Since motion vector interpolation is well known, it will not be described in detail herein. This configuration allows a change in the situation surrounding the host vessel to be expressed more naturally.
(38) The intermediate image P.sub.M need not be produced for the entire detection region. For instance, if a certain partial region is designated and the radar image is displayed in a separate window, the production and display of the intermediate image P.sub.M may be performed for just this partial region. In this case, the image memory 34 can be configured to store the radar images P.sub.N and P.sub.N-1 for the above-mentioned partial region.
(39) With the configuration in this embodiment, as understood from that there is a term T.sub.SCAN in the formula (1) above, there is a time lag equivalent to one scan interval until a change in the surrounding situation is reflected in a change in the radar image (see the thick line in the graph in
(40) In this respect, with the radar image display device 100 in this embodiment the user can operate the interface 20 to switch between a mode in which this intermediate image is displayed and a mode in which the intermediate image is not displayed. In the mode in which the intermediate image is not displayed, the image produced by the radar image production component 33 shown in
(41) As described above, the radar image display device 100 in this embodiment comprises the radar signal transceiver 31, the image memory 34, the intermediate image production component 35, and the display 10. The radar signal transceiver 31 receives a reception signal produced when a transmitted signal is reflected. The image memory 34 stores the strength S of the reception signal received by the radar signal transceiver 31 in association with the coordinates (r,) indicating the position of the reception signal. The intermediate image production component 35 produces the intermediate image P.sub.M based on at least the strength S.sub.N of the reception signal received at the N-th scan, and the strength S.sub.N-1 of the reception signal received at the N1-th scan having the same coordinates (r,) as the coordinates (r,) of the reception signal. The display 10 displays the intermediate image P.sub.M produced by the intermediate image production component 35.
(42) Consequently, by producing the intermediate image P.sub.M separately from the radar images P.sub.N and P.sub.N-1 produced based on the received reception signals, an image can be obtained that reflects information about the detection object (detection region). Therefore, with the above configuration, a change in the information about the detection object (detection region) can be expressed with an ample amount of information.
(43) A second embodiment will now be described.
(44) As shown in
(45) In the description of this embodiment, the next (future) scan is called the N-th scan. Therefore, the latest scan for which a radar image has already been obtained corresponds to the N1-th scan, and the scan just before that corresponds to the N2-th scan.
(46) The radar image P.sub.N (the radar image for the next scan) estimated by the radar image estimator 36 is outputted to the intermediate image production component 35. The intermediate image production component 35 produces the intermediate image P.sub.M so as to compensate for the interval between the radar image P.sub.N obtained by estimation and the radar image P.sub.N-1 obtained in the latest scan, and displays the result. Consequently, the lag equal to one scan period in the first embodiment above is eliminated, so the intermediate image P.sub.M can be displayed earlier, making the display of the radar image more real-time.
(47) A number of preferred embodiments of the present invention were described above, but the above configuration can be modified as follows, for example.
(48) In the above embodiment, the switching between a mode in which the intermediate image is displayed and a mode in which it is not displayed is performed by user input. However, the configuration may be such that if the speed of the host vessel is above a certain value, for example, or if it is detected that the target is approaching the host vessel, the system automatically switches from a mode in which the intermediate image is displayed to a mode in which it is not displayed.
(49) The polar coordinates (r,) were used in the above embodiments as the coordinates used for producing the intermediate image, but some other coordinates may be used instead (such as a rectangular coordinate system (X,Y)).
(50) The intermediate image need not be just simply displayed on the display 10, and can also be used for target tracking (TT), which is a known technique for detecting the movement of a target, for example.
(51) Some other method may be used to produce the intermediate image (such as a known image processing method called morphing).
(52) With a Doppler radar in which the movement speed of a target is acquired by utilizing the Doppler effect, an intermediate image may be produced in order to compensate for the interval between radar images expressing the Doppler speed, which is detection information.
(53) In the above embodiment, a rotating sweep line is not displayed on the display 10 because the image changes smoothly. However, the configuration can be such that a sweep line is displayed on the display 10.
(54) The radar can also be installed in a moving body other than a ship, and can be installed in something other than a moving body (such as a building).
(55) The present invention is not limited to a device for displaying the echo images of a radar. For instance, it can also be applied to a device for displaying echo images in sonar, which detects objects in the water by using sound waves.
(56) In understanding the scope of the present invention, the term comprising and its derivatives, as used herein, are intended to be open ended terms that specify the presence of the stated features, elements, components, groups, integers, and/or steps, but do not exclude the presence of other unstated features, elements, components, groups, integers and/or steps. The foregoing also applies to words having similar meanings such as the terms, including, having and their derivatives. Also, the terms part, section, portion, member or element when used in the singular can have the dual meaning of a single part or a plurality of parts.
(57) While only a selected embodiment has been chosen to illustrate the present invention, it will be apparent to those skilled in the art from this disclosure that various changes and modifications can be made herein without departing from the scope of the invention as defined in the appended claims. Furthermore, the foregoing descriptions of the embodiments according to the present invention are provided for illustration only, and not for the purpose of limiting the invention as defined by the appended claims and their equivalents.