METHOD FOR OPERATING A DISPLAY DEVICE ARRANGED IN A MOTOR VEHICLE AND DISPLAY DEVICE FOR USE IN A MOTOR VEHICLE

20210188088 · 2021-06-24

Assignee

Inventors

Cpc classification

International classification

Abstract

During a journey using a motor vehicle, a virtual environment is displayed by use of a display device and additionally a virtual representation of a route layout located in front of the motor vehicle is also displayed by use of the display device within the virtual environment. The display device may be used in the motor vehicle.

Claims

1.-10. (canceled)

11. A method for operating a display device arranged in a motor vehicle, the method comprising: displaying a virtual environment, using the display device, during a journey of the motor vehicle; and while displaying the virtual environment, simultaneously displaying, using the display device, a virtual representation of a route layout located in front of the motor vehicle within the virtual environment.

12. The method according to claim 11, wherein displaying the virtual representation of the route layout located in front of the motor vehicle includes displaying the virtual representation in a predetermined scale, and displaying the virtual environment includes changing a virtual position of a vehicle occupant using the display device within the virtual environment in accordance with a real position change of the motor vehicle.

13. The method according to claim 11, wherein displaying the virtual representation of the route layout located in front of the motor vehicle includes overlaying the virtual representation of the route layout located in front of the motor vehicle in a form of a representation reduced in size.

14. The method according to claim 13, wherein the virtual representation of the route layout located in front of the motor vehicle is overlaid in a form of a map representation.

15. The method according to claim 11, wherein displaying the virtual representation of the route layout located in front of the motor vehicle includes displaying the virtual representation of the route layout located in front of the motor vehicle so as to correspond to a curve and height profile of the route layout.

16. The method according to claim 11, further comprising: determining a locomotion of the motor vehicle by using a satellite-based registration device of the motor vehicle; and identifying, by the display device, the locomotion of the motor vehicle determined using the satellite-based registration device.

17. The method according to claim 16, further comprising: overlaying a moving virtual representation of the motor vehicle based on the locomotion of the motor vehicle determined using the satellite-based registration device; and/or changing a virtual perspective of the virtual environment displayed using the display device, based on the locomotion of the motor vehicle determined using the satellite-based registration device.

18. The method according to claim 11, further comprising: while displaying the virtual environment, simultaneously displaying, using the display device, a virtual representation of a route layout already travelled by the motor vehicle within the virtual environment.

19. A display device for use in a motor vehicle, the display device comprising: a memory to store instructions; and a processor configured to execute the instructions stored in the memory to: display a virtual environment during a journey of the motor vehicle, and while displaying the virtual environment, simultaneously display a virtual representation of a route layout located in front of the motor vehicle within the virtual environment.

20. The display device according to claim 19, wherein the display device includes virtual reality glasses, augmented reality glasses, an augmented reality contact lens, or a vehicle-side display device.

21. The display device according to claim 19, wherein the processor is configured to execute the instructions stored in the memory to: display the virtual representation of the route layout located in front of the motor vehicle by displaying the virtual representation in a predetermined scale, and display the virtual environment by changing a virtual position of a vehicle occupant using the display device within the virtual environment in accordance with a real position change of the motor vehicle.

22. The display device according to claim 19, wherein the processor is configured to execute the instructions stored in the memory to: display the virtual representation of the route layout located in front of the motor vehicle by overlaying the virtual representation of the route layout located in front of the motor vehicle in a form of a representation reduced in size.

23. The display device according to claim 22, wherein the processor is configured to execute the instructions stored in the memory to: overlay the virtual representation of the route layout located in front of the motor vehicle in a form of a map representation.

24. The display device according to claim 19, wherein the processor is configured to execute the instructions stored in the memory to: display the virtual representation of the route layout located in front of the motor vehicle by displaying the virtual representation of the route layout located in front of the motor vehicle so as to correspond to a curve and height profile of the route layout.

25. The display device according to claim 19, wherein the processor is configured to execute the instructions stored in the memory to: determine a locomotion of the motor vehicle by using a satellite-based registration device of the motor vehicle, and identify the locomotion of the motor vehicle determined using the satellite-based registration device.

26. The display device according to claim 25, wherein the processor is configured to execute the instructions stored in the memory to: overlay a moving virtual representation of the motor vehicle based on the locomotion of the motor vehicle determined using the satellite-based registration device, and/or change a virtual perspective of the virtual environment displayed using the display device, based on the locomotion of the motor vehicle determined using the satellite-based registration device.

27. The display device according to claim 19, wherein the processor is configured to execute the instructions stored in the memory to: while the virtual environment is displayed, simultaneously display a virtual representation of a route layout already travelled by the motor vehicle within the virtual environment.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0022] These and other aspects and advantages will become more apparent and more readily appreciated from the following description of the example embodiments, taken in conjunction with the accompanying drawings, in which:

[0023] FIG. 1 is a schematic illustration of a motor vehicle in which a vehicle occupant is seated who is wearing virtual reality glasses; and

[0024] FIG. 2 is a schematic illustration of a virtual environment which is displayed by use of the virtual reality glasses, wherein a map representation is overlaid in a top left corner of the virtual environment, by use of which a route layout located in front of the motor vehicle is identified.

DETAILED DESCRIPTION

[0025] In the drawings, identical reference characters each identify functionally-identical elements.

[0026] A motor vehicle 1 is shown in a schematic illustration in FIG. 1. A vehicle occupant 2, who is wearing virtual reality glasses 3, is seated in the motor vehicle 1. The motor vehicle 1 moreover also includes a satellite-based registration device 4, by use of which a position of the motor vehicle 1 can be ascertained or registered progressively. The registration device 4 can be, for example, part of a navigation system (not shown in greater detail) of the motor vehicle 1 or can simply be only a GPS sensor. The explanations presented hereinafter in conjunction with the virtual reality glasses 3 also apply for the case that the vehicle occupant 2 uses augmented reality glasses, augmented reality contact lenses, or vehicle-side display devices instead of the virtual reality glasses 3.

[0027] During the journey with the motor vehicle 1, a virtual environment is displayed by use of the virtual reality glasses 3. In addition, a virtual representation of a route layout located in front of the motor vehicle 1 is also displayed by use of the virtual reality glasses 3, so that the vehicle occupant 2 can adjust to the still imminent intrinsic movements of the motor vehicle 1 due to the route layout located in front of the motor vehicle 1. Kinetosis in the vehicle occupant 2 is thus counteracted, for example simulator sickness may be avoided. The kinetosis can result if greater discrepancies result between visual stimuli and feedback of the equilibrium organ. This can be the case if the vehicle occupant 2 moves differently virtually within the displayed virtual environment, for example, than he does in reality due to the intrinsic movement of the motor vehicle 1.

[0028] The virtual environment 5, which is displayed by use of the virtual reality glasses 3, is shown schematically in FIG. 2. A map representation 6 is overlaid in a top left corner of the virtual environment 5. A virtual representation of the motor vehicle 7—simply by the triangle in the present illustration—is overlaid in the map representation 6. Moreover, the route layout located in front of the motor vehicle 1 is also overlaid as a virtual representation 8 and an already covered route layout is also overlaid as a virtual representation 9. In the remaining display region of the virtual reality glasses 3, the vehicle occupant 2 can thus enjoy the overlaid virtual environment 5, wherein he receives an indication at all times by the map representation 6 of how the route layout located in front of the motor vehicle 1 is provided. The vehicle occupant 2, even when completely visually closed off from his environment, can thus adjust well to how the motor vehicle 1 and thus he himself will move in reality.

[0029] It is also conceivable that a curve and height profile of the real route layout located in front of the motor vehicle 1 is displayed by use of the virtual reality glasses 3. The vehicle occupant 2 can thus adjust particularly well to which lateral movements and which up-and-down movements he has to expect in reality due to the route layout still located in front of the motor vehicle 1. A locomotion of the motor vehicle 1 can be ascertained by use of the registration device 4, wherein the ascertained locomotion of the motor vehicle 1 can be identified by use of the virtual reality glasses 3 in the form of the moving triangle 7. It is also conceivable that the triangle 7 remains at the same position, wherein the representations 8, 9 of the route layout located in front of the motor vehicle 1 and the already covered route layout simply travel farther and farther in accordance with the real locomotion of the motor vehicle 1.

[0030] Contrary to the schematic illustration in FIG. 2, it is also possible that the virtual representation 8 of the route layout located in front of the motor vehicle 1 is displayed, for example, in the scale 1:1. Other scales—whether they are increases or decreases in size—are also possible. A virtual position of the vehicle occupant 2 who is wearing the virtual reality glasses 3 changes in this case within the displayed virtual environment 5 in accordance with his real position change, i.e., in accordance with the real position change of the motor vehicle 1. It is thus possible, for example, that a virtual car race is displayed by use of the virtual reality glasses 3, wherein the vehicle occupant 2 moves within the virtual car race precisely as he does so by use of the motor vehicle 1 within reality. A route layout of a virtual racetrack can be displayed, for example, so that the route layout of the overlaid virtual racetrack corresponds to the real route layout still located in front of the motor vehicle 1. The vehicle occupant 2, in spite of total visual shutoff from reality, can thus adjust particularly well to how the motor vehicle 1 will move in reality.

[0031] Instead of the virtual reality glasses 3, for example, augmented reality glasses or also augmented reality contact lenses can also be used. In this case, the vehicle occupant 2 can still perceive his real environment, wherein this can be overlaid at different strengths by virtual contents which form the virtual environment 5. It can also be reasonable in this case to identify the real route layout located in front of the motor vehicle 1 in the form of the virtual representation 8, so that the vehicle occupant 2 can adjust to the still imminent intrinsic movements of the motor vehicle 1. It is also conceivable that instead of the virtual reality glasses 3, greatly varying vehicle-side display devices, for example displays, head-up displays, contact-analog displays, and the like are used. By use of these display devices it is also possible to display the virtual environment 5, wherein a virtual representation 8 of the route layout located in front of the motor vehicle 1 is also displayed within the virtual environment 5 in this case, which induces the same or at least a similar effect, namely that kinetosis can be counteracted, since the vehicle occupant 2 can adjust to the still imminent real intrinsic movements of the motor vehicle 1.

[0032] A description has been provided with reference to various examples, but it will be understood that variations and modifications can be effected within the spirit and scope of the claims which may include the phrase “at least one of A, B and C” as an alternative expression that means one or more of A, B and C may be used, contrary to the holding in Superguide v. DIRECTV, 358 F3d 870, 69 USPQ2d 1865 (Fed. Cir. 2004).