USER INTERFACE AND EARTH-MOVING MACHINE

Abstract

A user interface and an earth-moving machine are described. The user interface includes displaying means and a control unit (CU). The displaying means includes a transparent display unit for displaying virtual earth-moving images. The images are displayed at a virtual image distance from the displaying unit.

Claims

1. A user interface of an earth-moving machine, the user interface comprising: at least one control unit configured to receive data and process the received data; and displaying means for displaying data received from the control unit, wherein the displaying means are based on a head-up display system comprising at least one transparent display unit, which is provided with a display surface, the control unit provided with earth-moving data and configured to generate at least one virtual earth-moving image, the at least one virtual earth-moving image comprising at least one of earth-moving plan and selectable execution model of an earth-moving work task executable at a work site of the earth-moving device, the control unit configured to receive position data of the earth-moving machine and an earth-moving tool of the earth-moving machine, the control unit configured to compare the received position data to the at least one of earth-moving plan and selected execution model and configured to generate instruction data for guiding an operator of the earth-moving machine, the displaying means configured to display at least one selected virtual earth-moving image, wherein one of the at least one selected virtual earth-moving images comprises the at least one of earth-moving plan and the selected execution model and comprises the illustration of the instruction data by means of the transparent display unit, the displaying means provided with an adjusting device adapted to display the virtual earth-moving image three-dimensionally at a virtual image distance from the display surface, whereby the displayed virtual earth-moving image appears to locate at a visual depth compared to the display surface.

2. The user interface as claimed in claim 1, wherein the adjusting device is adapted to display the virtual earth-moving image to have a virtual image distance at least at 2 meters depth from the display surface.

3. The user interface as claimed in claim 1, wherein the location of the displayed virtual earth-moving image is fixed in a depth direction, whereby stereoscopic effect of the displayed virtual earth-moving image is constant.

4. The user interface as claimed in claim 1, wherein the control unit is configured to receive position data of a selected movable object of the earth-moving machine and is configured to monitor the selected movable object, the control unit configured to control the adjusting device to change the virtual image distance of the displayed virtual earth-moving image in response to the position data of the monitored object, whereby the stereoscopic effect of the displayed virtual earth-moving image is adjusted in accordance with the position of the monitored object.

5. The user interface as claimed in claim 1, wherein the displaying means comprise at least one projector and at least one combiner serving as the transparent display unit and being located at a first distance from the projector, the combiner provided with a projection surface for receiving and displaying the virtual earth-moving images projected by means of the projector, the adjusting device configured to control the projector to display the virtual earth-moving image at a virtual depth direction greater than the mentioned first distance.

6. The user interface as claimed in claim 1, wherein the adjusting device comprises an adjustable optical system for generating stereoscopic effect for the displayed virtual earth-moving image.

7. The user interface as claimed in claim 1, wherein the transparent display unit is mounted on an inside surface of a windscreen of an earth-moving machine.

8. The user interface as claimed in claim 1, wherein the transparent display unit is an inseparable part of a windscreen of an earth-moving machine.

9. The user interface as claimed in claim 1, wherein the displayed visual earth-moving image comprises at least one of the following visual elements: vector graphics, 3D primitive object, numeral element, text element, indicator element, alarm signal element, instruction element, graphical icon element.

10. The user interface as claimed in claim 1, wherein the displayed visual earth-moving image comprises at least one 3D primitive object as a visual element.

11. The user interface as claimed in claim 1, wherein the earth-moving data comprises identification data of the at least one of earth-moving plan and selectable execution model, the displayed visual earth-moving image illustrating identification data.

12. The user interface as claimed in claim 1, wherein the earth-moving data comprises fleet management data relating to earth-moving operations executed at the earth-moving work site, the displayed visual earth-moving image illustrating the fleet management data.

13. The user interface as claimed in claim 1, wherein the earth-moving data comprises communication data relating to earth-moving operations executed at the earth-moving work site, the displayed visual earth-moving image illustrating the communication data.

14. The user interface as claimed in claim 1, wherein the earth-moving data comprises system data relating to operating systems of the earth-moving machine, the displayed visual earth-moving image illustrating the system data.

15. The user interface as claimed in claim 1, wherein the earth-moving data comprises positioning data relating to the current position of the earth-moving machine at the earth-moving work site, the displayed visual earth-moving image illustrating the positioning data.

16. The user interface as claimed in claim 1, wherein the earth-moving data comprises satellite positioning condition data relating to satellite signal availability at the current position of the earth-moving machine at the earth-moving work site, the displayed visual earth-moving image illustrating the satellite positioning condition data.

17. An earth-moving machine, the machine comprising: a movable carrier; at least one earth-moving tool; actuating means for moving the earth-moving tool in relation to the carrier; a control system for controlling the operation of the earth-moving machine; comprising sensing means for providing the system with position data of the earth-moving tool and the carrier, wherein the control system comprises a user interface for interaction between an operator and the control system, wherein the user interface is configured to enable displaying augmented reality relating to earth-moving data by means of a head-up display system, the user interface comprising: at least one control unit configured to receive data and process the received data; and displaying means for displaying data received from the control unit, wherein the displaying means are based on a head-up display system comprising at least one transparent display unit, which is provided with a display surface, the control unit provided with earth-moving data and configured to generate at least one virtual earth-moving image, the at least one virtual earth-moving image comprising at least one of earth-moving plan and selectable execution model of an earth-moving work task executable at a work site of the earth-moving device, the control unit configured to receive position data of the earth-moving machine and an earth-moving tool of the earth-moving machine, the control unit configured to compare the received position data to the at least one of earth-moving plan and selected execution model and configured to generate instruction data for guiding an operator of the earth-moving machine, the displaying means configured to display at least one selected virtual earth-moving image, wherein one of the at least one selected virtual earth-moving images comprises the at least one of earth-moving plan and the selected execution model and comprises the illustration of the instruction data by means of the transparent display unit, the displaying means provided with an adjusting device adapted to display the virtual earth-moving image three-dimensionally at a virtual image distance from the display surface, whereby the displayed virtual earth-moving image appears to locate at a visual depth compared to the display surface.

18. The earth-moving machine as claimed in claim 17, wherein the earth-moving machine is one of the following: excavator, bulldozer, motor grader, compaction machine, piling machine, deep stabilization machine.

19. The earth-moving machine as claimed in claim 17, wherein the adjusting device is adapted to display the virtual earth-moving image to have a virtual image distance at least at 2 meters depth from the display surface.

20. The earth-moving machine as claimed in claim 17, wherein the location of the displayed virtual earth-moving image is fixed in a depth direction, whereby stereoscopic effect of the displayed virtual earth-moving image is constant.

21. The earth-moving machine as claimed in claim 17, wherein the control unit is configured to receive position data of a selected movable object of the earth-moving machine and is configured to monitor the selected movable object, the control unit configured to control the adjusting device to change the virtual image distance of the displayed virtual earth-moving image in response to the position data of the monitored object, whereby the stereoscopic effect of the displayed virtual earth-moving image is adjusted in accordance with the position of the monitored object.

22. The earth-moving machine as claimed in claim 17, wherein the displaying means comprise at least one projector and at least one combiner serving as the transparent display unit and being located at a first distance from the projector, the combiner provided with a projection surface for receiving and displaying the virtual earth-moving images projected by means of the projector, the adjusting device configured to control the projector to display the virtual earth-moving image at a virtual depth direction greater than the mentioned first distance.

23. The earth-moving machine as claimed in claim 17, wherein the adjusting device comprises an adjustable optical system for generating stereoscopic effect for the displayed virtual earth-moving image.

24. The earth-moving machine as claimed in claim 17, wherein the transparent display unit is mounted on an inside surface of a windscreen of an earth-moving machine.

25. The earth-moving machine as claimed in claim 17, wherein the transparent display unit is an inseparable part of a windscreen of an earth-moving machine.

26. The earth-moving machine as claimed in claim 17, wherein the displayed visual earth-moving image comprises at least one of the following visual elements: vector graphics, 3D primitive object, numeral element, text element, indicator element, alarm signal element, instruction element, graphical icon element.

27. The earth-moving machine as claimed in claim 17, wherein the displayed visual earth-moving image comprises at least one 3D primitive object as a visual element.

28. The earth-moving machine as claimed in claim 17, wherein the earth-moving data comprises identification data of the at least one of earth-moving plan and selectable execution model, the displayed visual earth-moving image illustrating identification data.

29. The earth-moving machine as claimed in claim 17, wherein the earth-moving data comprises fleet management data relating to earth-moving operations executed at the earth-moving work site, the displayed visual earth-moving image illustrating the fleet management data.

30. The earth-moving machine as claimed in claim 17, wherein the earth-moving data comprises communication data relating to earth-moving operations executed at the earth-moving work site, the displayed visual earth-moving image illustrating the communication data.

31. The earth-moving machine as claimed in claim 17, wherein the earth-moving data comprises system data relating to operating systems of the earth-moving machine. the displayed visual earth-moving image illustrating the system data.

32. The earth-moving machine as claimed in claim 17, wherein the earth-moving data comprises positioning data relating to the current position of the earth-moving machine at the earth-moving work site, the displayed visual earth-moving image illustrating the positioning data.

33. The earth-moving machine as claimed in claim 17, wherein the earth-moving data comprises satellite positioning condition data relating to satellite signal availability at the current position of the earth-moving machine at the earth-moving work site, the displayed visual earth-moving image illustrating the satellite positioning condition data.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0037] Some embodiments are described in more detail in the accompanying drawings, in which

[0038] FIG. 1 is a schematic side view of an excavating machine provided with a visual user interface for generating aid for an operator,

[0039] FIG. 2 shows schematically principle of showing earth-moving images at a visual distance from a display surface of a transparent display unit,

[0040] FIG. 3 is a schematic diagram showing components and features of a visual user interface,

[0041] FIG. 4 is a schematic diagram showing some feasible visual elements of displayed earth-moving images,

[0042] FIG. 5 is a schematic diagram showing some feasible earth-moving data elements and features,

[0043] FIG. 6 is a schematic diagram showing some feasible earth-moving machines,

[0044] FIGS. 7a-7c are schematic side views of some possible arrangements for displaying earth-moving images on a transparent display unit,

[0045] FIG. 8 is a schematic front view of a headset provided with one or two head-mounted display units, and

[0046] FIG. 9 is a schematic front view of a helmet provided with a head-mounted display unit.

[0047] For the sake of clarity, the figures show some embodiments of the disclosed solution in a simplified manner. In the figures, like reference numerals identify like elements.

DETAILED DESCRIPTION

[0048] FIG. 1 shows an earth-moving machine E, which is in this case an excavator comprising a movable carrier 1 on which a boom 2 is arranged. At a distal end of the boom 2 is a tool 3, in this case a bucket. The boom 2 may be moved in a versatile manner. On the carrier 1 is a control cabin 4 for an operator 5. Inside the cabin 4 is a visual user interface system VUI, which comprises at least one transparent display unit 6 through which the operator 5 may monitor operation of the tool 3. Visual line 7 or sight line between eyes of the operator 5 and the tool 3 is also indicated. As discussed above in this patent application, the system adjusts the displayed images so that they appear to locate at a visual distance 8 from the transparent display unit 6. A visual augmented view 9 at depth position is shown in a simplified manner. Then the operator 5 will experience a three-dimensional visual effect and the displayed images are well shown at visual field of the operator 5 without a need to focus eyes of the operator. The transparent display unit 6 may be a separate device, which is arranged close to a windscreen 10 of the cabin 4. The transparent display unit 6 may be in a data communication with one or more control units CU.

[0049] FIG. 1 further discloses that the machine E and its operational components may be equipped with sensors 11 and measuring devices for gathering position data, for example. Moreover, the machine E may comprise one or more navigation or position determining systems 12, such as GNNS positioning systems for determining position and direction of the machine E. The data received from the measuring devices 11 and 12 may have effect on how the earth-moving images are displayed and on the other hand the measuring results may be part of the earth-moving data itself.

[0050] FIG. 2 discloses some features of a visual user interface VIU system. The system comprises a control unit CU and displaying means 13. The displaying means 13 comprise a transparent display unit 6 serving as a head-up display system together with a projector P. The displaying unit 6 may be a combiner on which the projector projects the images. The displaying means 13 also comprises an adjusting device AD for adapting the displaying unit 6 to show a view 9 at a visual depth. Depth position of the view 9 may be adjusted 14 in accordance with position and movement M of a tool 3, for example. The depth adjustment 14 may be limited by means of a pre-determined depth range 15. The view 9 may comprise one or more visual elements 16a-16d and each of them may comprise one or more earth-moving images or data objects. In FIG. 2 an eye 17 of the operator is shown in a simplified manner.

[0051] FIG. 3 discloses components and features relating to the visual interface which is in accordance with the present patent application. These features and components are already discussed above.

[0052] FIGS. 4-6 show feasible features and alternatives, which are already been disclosed above in this patent application.

[0053] FIG. 7a discloses a separate transparent displaying unit 6 or combiner arranged at a distance from a windscreen 10. FIG. 7b discloses a solution wherein a combiner 6 is fastened to an inner surface of the windscreen 10. FIG. 7c discloses an integrated solution wherein the transparent displaying unit 6 is located inside a structure of the windscreen 10.

[0054] FIG. 8 discloses a headset 18 or media glasses provided with one or more transparent displaying units 6. The headset 18 may communicate with one or more external or internal control units CU through one or more data communication 19. The same applies also for a helmet 20, which is also provided with the transparent displaying units 6. In both arrangements the earth-moving images and data elements may be displayed so that they appear to locate at a visual distance from the transparent displaying units 6, which are located close to eyes of the operator.

[0055] The drawings and the related description are only intended to illustrate the idea of the invention. In its details, the invention may vary within the scope of the claims.