Periphery monitoring device for crawler-type working machine
10927527 ยท 2021-02-23
Assignee
Inventors
Cpc classification
B60R2300/306
PERFORMING OPERATIONS; TRANSPORTING
B60R2300/303
PERFORMING OPERATIONS; TRANSPORTING
H04N7/181
ELECTRICITY
B60R2300/80
PERFORMING OPERATIONS; TRANSPORTING
B60R1/00
PERFORMING OPERATIONS; TRANSPORTING
G06V20/58
PHYSICS
B60R2300/607
PERFORMING OPERATIONS; TRANSPORTING
E02F3/32
FIXED CONSTRUCTIONS
H04N5/272
ELECTRICITY
International classification
B60R1/00
PERFORMING OPERATIONS; TRANSPORTING
H04N7/18
ELECTRICITY
Abstract
A surroundings monitoring device of a crawler-type work machine includes: cameras configured to take images of surroundings of the crawler-type work machine; a display unit configured to display the images taken by the cameras; and a controller configured to superimpose an outer-edge guide image generated based on the farthest position of an undercarriage from a revolution center of the crawler-type work machine on the display unit.
Claims
1. A surroundings monitoring device of a crawler-type work machine comprising a crawler-type undercarriage and an upper revolving body, the surroundings monitoring device comprising: a camera configured to take an image of surroundings of the crawler-type work machine; a display unit configured to display an overview image generated from the image taken by the camera; and a controller configured to superimpose, on the overview image displayed on the display unit, an outer-edge guide image generated so as to be circumscribed to a circle around a revolution center of the crawler-type work machine in the overview image, the circle having a radius that is a distance from the revolution center to a farthest portion of the undercarriage in the overview image, wherein the outer-edge guide image includes a plurality of straight lines that touch portions of the circle and an arc that connects the plurality of straight lines to each other, wherein the controller is configured to determine a square that circumscribes the circle, wherein each of the plurality of straight lines is a portion of a face of the square, and has a length corresponding to a width of the upper revolving body in the overview image projected to the face of the square, and wherein the plurality of straight lines comprises: a first straight line that is a portion of a first face of the square, the first straight line having a first length corresponding to a first width of the upper revolving body projected to the first face of the square in a state in which the upper revolving body is in a first orientation with respect to the undercarriage in the overview image, and a second straight line that is a portion of a second face of the square, the second straight line having a second length corresponding to a second width of the upper revolving body projected to the second face of the square in a state in which the upper revolving body is in a second orientation with respect to the undercarriage in the overview image.
2. The surroundings monitoring device according to claim 1, wherein the controller is configured to change the outer-edge guide image by receiving a signal by a switch operation or a detector, the signal indicating that the distance from the revolution center to the farthest position of the undercarriage is changed.
3. The surroundings monitoring device according to claim 1, wherein the image taken by the camera is converted to the overview image, or is a single-camera image.
4. The surroundings monitoring device according to claim 1, wherein the display unit is provided to a remote control seat in the crawler-type work machine, a display device provided in a control room for controlling the crawler-type work machine, or a mobile terminal.
5. The surroundings monitoring device according to claim 1, further comprising: a guideline changer configured to change a size of the outer-edge guide image based on presence or absence of a blade in the crawler-type work machine; and a guideline superimposing unit configured to superimpose the outer-edge guide image changed by the guideline changer on the overview image.
6. The surroundings monitoring device according to claim 1, wherein the controller is configured to enable a user to recognize a distance between an obstacle and the farthest position from the revolution center by superimposing the outer-edge guide image at a position in the display unit corresponding to the farthest position of the undercarriage.
7. The surroundings monitoring device according to claim 1, wherein the controller is configured to superimpose the outer-edge guide image at a position in the display unit corresponding to the farthest position of the undercarriage that is within a range of an arm of the crawler-type work machine.
8. The surroundings monitoring device according to claim 1, wherein the farthest position of the undercarriage is disposed at an outer end of the undercarriage in the overview image.
9. The surroundings monitoring device according to claim 1, wherein the circle touches an outer end of the undercarriage in the overview image.
10. The surroundings monitoring device according to claim 1, wherein the arc connects an end of the first straight line to an end of the second straight line, and is disposed between the circle and the square.
11. The surroundings monitoring device according to claim 1, wherein the second orientation is rotated 90 degrees from the first orientation.
12. The surroundings monitoring device according to claim 1, wherein the outer-edge guide image is a single line displayed on the display unit, and the circle is not displayed on the display unit.
13. The surroundings monitoring device according to claim 1, wherein the overview image is generated by converting the image taken by the camera to an image that is projected to an imaginary projection surface from a view point above the crawler- type work machine.
Description
BRIEF DESCRIPTION OF DRAWING(S)
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
(15)
DESCRIPTION OF EMBODIMENT(S)
First Exemplary Embodiment
(16) (1) Overall Arrangement
(17) As shown in
(18) The right and left traveling devices 21 can independently drive the respective drive wheels (to move the hydraulic excavator 1 forward and backward). When the right crawler and the left crawler are simultaneously moved forward, the hydraulic excavator 1 is moved forward. When the right crawler and the left crawler are simultaneously moved backward, the hydraulic excavator 1 is moved backward. When the first drive wheel of the traveling devices 21 is driven in a direction reverse to a direction in which the second wheel of the traveling devices 21 is driven, for instance, when the right crawler is moved forward and the left crawler is moved backward at the same time, the hydraulic excavator 1 can be revolved around the revolution center by the undercarriage 2. Such a revolving method is called an ultra pivot turn.
(19) As shown in
(20) The upper revolving body 3 is revolvably provided on the truck frame of the undercarriage 2. It should be noted that a revolution center O at the ultra pivot turn of the undercarriage 2 may coincide with a revolution center O of the upper revolving body 3 as shown in
(21) The upper revolving body 3 includes the cab 4 in which the operator sits and operates the hydraulic excavator 1. In the cab 4, an operator's seat (not shown) is provided and working equipment levers (not shown) are provided on both sides of the operator. A travel lever for travel operation is provided on a floor of the cab 4.
(22) Further, a monitor 65 (not shown in
(23) When a direction in which the working equipment 5 of the upper revolving body 3 faces is defined as a front direction, the working equipment 5 is provided on a right side of the cab 4. The working equipment 5 includes a boom 51, an arm 52 and a bucket 53. The boom 51, the arm 52 and the bucket 53 are respectively rotated by a boom cylinder 51A, an arm cylinder 52A and a bucket cylinder 53A. The cylinders 51A, 52A and 53A are hydraulic cylinders. A hydraulic source for the cylinders is a hydraulic pump drivable by an engine (not shown) provided to the upper revolving body 3.
(24) (2) Arrangement of Surroundings Monitoring Device 60
(25)
(26) The left-backward camera 61 is provided to a left rear side of the upper revolving body 3 as shown in
(27) The monitor 65 includes a display 65A and an operation unit (switch) 65B. The above-described various information including the engine water temperature, the residual fuel amount and the like are displayed on the display 65A. By operating the operation unit 65B, a monitor controller (not shown) is controlled to change the contents displayed on the display 65A. The operation unit 65B includes: a switch usable for operations on the menu screen and the maintenance screen; and a switch usable for inputting various settings on a work mode, a travel mode, an air conditioner and the like. The monitor 65 may be provided by a touch panel integrally including the display 65A and the operation unit 65B. Alternatively, the operation unit 65B and the display 65A are provided by separate bodies. The operation unit 65B may be provided in a different location within the cab.
(28) The monitor 65 also functions as a display unit that displays the images taken by the cameras 61 to 64. When the operation unit 65B of the monitor 65 is operated to input an operational command to the surroundings monitoring controller 66, the monitor 65 is configured to switch the camera image displayed on the display 65A, for instance, from the camera image taken by the backward camera 64 to the camera image taken by the rightward camera 62.
(29) As shown in
(30) The conversion information is in terms of the imaginary projection surface GL. For instance, a dimension M1 of a target OB whose image is taken from obliquely above by the camera 61 is converted to a dimension M2 on the imaginary projection surface GL. After converting the image data taken by the four cameras 61 to 64 to the respective top view images, the overview image generator 67 synthesizes the converted image data to generate a single overview image to allow the operator to see surroundings of the hydraulic excavator 1 from above.
(31) As shown in the overview image G2 in
(32) The guideline superimposing unit 69 superimposes a guideline GB generated by the guideline changer 71 (described later) on the overview image G2 and the single-camera image G3 (see
(33) The guideline changer 71 generates a guideline according to a drawing method described below.
(34) In
(35) In
(36) In
(37) Since the top face image GA and the guideline GB of the upper revolving body 3 are superimposed on the overview image G2, when the upper revolving body 3 is revolved, the overview image G2 displays the surroundings image and the undercarriage 2 whose image is unintentionally taken by the cameras 61 to 64 in a rotating manner while the upper revolving body 3 and the guideline GB are kept fixed (described later). Moreover, when the ultra pivot turn is conducted (when the upper revolving body and the undercarriage 2 are simultaneously revolved), the overview image G2 displays that only the surroundings image is rotating while the upper revolving body 3, the guideline GB and the undercarriage 2 whose image is unintentionally taken by the cameras 61 to 64 are kept fixed.
(38) In the positional relationship between the upper revolving body 3 and the undercarriage 2 as shown in
(39) The display image outputting unit 70 in
(40) In the exemplary embodiment, the display image outputting unit 70 also displays the single-camera image G3 taken by any one of the cameras 61 to 64 on the display image G1. As shown in the single-camera image G3, the guideline GB may be superimposed on the single-camera image.
(41) Moreover, the display image outputting unit 70 also displays a single-camera image positional icon G4. The single-camera image positional icon G4 is an icon for showing which one of the backward, right-backward, right-forward and leftward images taken by the cameras 61 to 64 for the hydraulic excavator 1 is displayed as the single-camera image G3 displayed on the display unit of the monitor 65. For instance, when the single-camera image positional icon G4 is disposed near the single-camera image G3 on the display unit in
(42) A service meter image G5 and a work mode image G6 are displayed on an upper part of the display image G1 shown in
(43) As shown in
Second Exemplary Embodiment
(44) In a second exemplary embodiment, a hydraulic excavator 1A including a blade for ground leveling, the blade being attached to a front side of the undercarriage, will be described below.
(45) The hydraulic excavator 1A shown in
(46) In the second exemplary embodiment, a drawing method of the guideline by the guideline changer 71 will be described.
(47) In the first exemplary embodiment as shown in
(48) A drawing method of the guideline based on the circle L11 with the radius R1 around the revolution center O is exactly the same as the method described in
(49) In the same manner as in the first exemplary embodiment, the guideline changer 71 generates the guideline GC to be displayed at the position corresponding to the farthest position of the undercarriage 2 from the revolution center O of the hydraulic excavator 1A (the front end E1 of the blade 23 in the exemplary embodiment). Subsequently, the guideline changer 71 superimposes the guideline GC on the overview image or the single-camera image generated by the overview image generator 67.
(50)
(51) The guideline changer 71 in
(52) As shown in
(53) It should be noted that the overview image G2 displays the image of the blade 23 as shown in
(54) Moreover, the guideline GB may also be superimposed on the single-camera image G3 as shown in
(55) (3) Operations and Effects in First and Second Exemplary Embodiments
(56) Next, operations in the first and second exemplary embodiments will be described with reference to the flowchart shown in
(57) Firstly, the overview image generator 67 generates the overview image G2 based on the images of the cameras 61 to 64 (Step 51). The image superimposing unit 68 retrieves the overview image G2 generated by the overview image generator 67 (Step S2) and superimposes the top face image GA of the hydraulic excavator 1 on the overview image G2 (Step S3). The guideline superimposing unit 69 superimposes the guidelines GB and GC inputted from the guideline changer 71 on the overview image G2 (Step S4). The display image outputting unit 70 displays on the monitor 65 the top face image GA and the overview image G2 on which the guidelines GB and GC are superimposed (Step S5).
(58) While the overview image G2 is kept displayed, the guideline-change starting unit 72 monitors whether or not the inspector or the like operates the monitor 65 to input the model information (Step S6). When the model information is inputted, the guideline-change starting unit 72 outputs a signal to instruct the guideline changer 71 to change the size of the guideline according to the inputted model, thereby changing the size of the guideline (Step S7).
(59) According to the above first and second exemplary embodiments, the following effects are obtained.
(60) Since the guideline changer 71 is provided, when the inspector or the like inputs the model information, the guidelines GB and GC are generated based on the farthest position of the undercarriage 2 from the revolution center O in the hydraulic excavators 1 and 1A depending on the model and are superimposed on the overview image and the like. Accordingly, since the operator can judge the distance from the obstacle based on the positions of the guidelines GB and GC displayed on the monitor 65, the operator can perform operations without collision with the obstacle and the like. Specifically, when the obstacle exists outside the guidelines GB and GC, the crawlers 22, the blade 23 and the like do not collide with the obstacle even when the ultra pivot turn is performed.
(61) Moreover, since the guideline-change starting unit 72 is provided, only a specific person (e.g., a mechanical inspector) is allowed to change the guideline. An ordinary operator may not be allowed to change the guideline. This arrangement prevents the operator from erroneously operating to display a guideline smaller than the guideline corresponding to the farthest position of the undercarriage 2 from the revolution center O of the hydraulic excavators 1 and 1A.
(62) (4) Modification(s) of Exemplary Embodiment(s)
(63) The invention is not limited to the above exemplary embodiments, but encompasses modifications described below.
(64) In the above exemplary embodiments, the guideline-change starting unit 72 monitors the information inputted using the monitor 65 and starts the guideline changer 71. However, the invention is not limited thereto. The guideline changer 71 may be started based on whether or not a predetermined operation switch provided in the cab 4 is operated, or by detecting that the blade 23 is attached according to a detection signal of various sensors (detectors). With this arrangement, even if the inspector forgets inputting the information using the monitor 65, the detectors detect that the blade is attached, so that the guideline changer 71 is automatically started.
(65) In the above exemplary embodiments, the guidelines (examples of the outer-edge guide images) GB and GC are provided by a combination of the straight line and the arc. However, the shape of the guideline is not limited thereto but may be a circle around the revolution center at the ultra pivot turn or a circle around the revolution center of the upper revolving body, the circle being circumscribed to the outer ends of the crawlers 22 and the blade front ends or being provided by a circle slightly larger than the circle circumscribed to the outer ends of the crawlers 22 and the like. Further, the shape of the guideline is not limited to the circle. Alternatively, the outer-edge guide image may be provided by points, any marks and the like in a row. The outer-edge guide image is not necessarily arranged in a straight line. Further, only a single outer-edge guide image is displayed in the above exemplary embodiments, but a plurality of outer-edge guide images having different sizes may be simultaneously displayed.
(66) In the above exemplary embodiments, the size and the display position of each of the guidelines GB and GC are determined based on the distance from the revolution center O of the hydraulic excavator 1, but are not limited thereto. The size and the display position of the guideline may be determined based on a distance from a predetermined position on the hydraulic excavator 1 when the hydraulic excavator 1 is seen from the above viewpoint.
(67) In addition to the above exemplary embodiments, when a hydraulic excavator including the crawlers 22 having a long length and/or a large width is selected as the model information, in which the farthest position of the undercarriage from the revolution center O is changed, the guideline is also changed.
(68) Further, in the above exemplary embodiments, the guidelines GB and GC are generated based on the farthest position of the undercarriage 2 from the revolution center O, but not limited thereto.
(69) For instance, when the farthest position from the revolution center O in the hydraulic excavator (except for the working equipment) is not on the undercarriage but at any position on the upper revolving body (except for the working equipment), the guideline may be generated based on the any position on the upper revolving body (except for the working equipment), for instance, based on the position of the rear end (counterweight) of the upper revolving body. At this time, the size of the guideline may be changed according to the model selected as the model information, specifically, based on whether the model of a typical type is selected or the model of a type with a heavier counterweight and a longer rear end than those of the typical type (in other words, the farthest position from the revolution center O in the hydraulic excavator is further apart from that in the typical hydraulic excavator) is selected.
(70) Further, when the information indicating that the posterior counterweight is attached is inputted as the model information, since the rear end of the upper revolving body is extended by the posterior counterweight, the size of the guideline may be changed.
(71) Moreover, in the above exemplary embodiments, the overview image is generated by the four cameras attached to the upper revolving body. However, the number of the cameras is not limited as long as two or more cameras are provided.
(72) In the above exemplary embodiments, the overview image and the single-camera image are simultaneously displayed on a standard screen, but the invention is not limited thereto. Only one of the overview image and the single-camera image may be displayed. Alternatively, the overview image and the single-camera image may be alternately displayed by switching the screen without being displayed on the standard screen.
(73) Moreover, in the above exemplary embodiments, the monitor 65 is disposed in the cab 4 of the work machine. However, the monitor 65 may be disposed in other places such as a remote control seat for conducting a remote control of the work machine or a control room for controlling and managing an entirety of a plurality of work machines in a construction site. Further, the monitor 65 may be provided by a mobile terminal so that the operator can check the overview image and the single-camera image displayed on the mobile terminal. In this arrangement, when the overview image is displayed on the monitor 65 in the remote control seat and the control room and when the mobile terminal is used as the monitor 65, any communication unit may be provided to each of the work machine, the remote control seat, the control room and the mobile terminal, through which information such as the overview image is transmitted and received.
(74) In addition, other configuration(s) may be employed as long as an object of the invention is compatible with it.