OPERATING SYSTEM WITH PORTABLE INTERFACE UNIT, AND MOTOR VEHICLE HAVING THE OPERATING SYSTEM

Abstract

An operating system for a motor vehicle includes an interface having an operating surface and a projector configured to project display content onto the operating surface of the interface. The interface is a portable item freely movable in the motor vehicle. The operating system further includes a capturing device configured to determine an inclination vector of a relative inclination of the operating surface with respect to the projector, and an image processing device configured to generate the display content by graphically distorting an original display content by use of a predetermined pre-distortion function based on the determined inclination vector. The pre-distortion function is set inversely to an optical distortion that occurs due to the relative inclination of the operating surface during the projection of the display content onto the operating surface.

Claims

1.-10. (canceled)

11. An operating system fora motor vehicle, comprising: a portable interface, movable in the motor vehicle, having an operating surface; a projector, separate from the interface, configured to project display content onto the operating surface of the interface; a capturing device configured to determine an inclination vector of a relative inclination of the operating surface with respect to the projector; and an image processing device configured to generate the display content by graphically distorting an original display content by use of a predetermined pre-distortion function based on the determined inclination vector, the pre-distortion function being set inversely to an optical distortion that occurs due to the relative inclination during the projection of the display content onto the operating surface.

12. The operating system according to claim 11, wherein the interface includes a plurality of operating surfaces, and the capturing device is configured to select, as the operating surface onto which the display content is to be projected, an operating surface among the plurality of operating surfaces having a normal vector with a smallest inclination angle defined with respect to a connecting line between the interface and the projector.

13. The operating system according to claim 12, wherein a respective original display content is assigned to each of the plurality of operating surfaces, and the image processing device is configured to select the original display content based on which of the plurality of operating surfaces is selected as the operating surface onto which the display content is to be projected.

14. The operating system according to claim 11, wherein the capturing device includes a recognition feature, which is provided at the interface, and the recognition feature includes at least one of a marker element, disposed at the interface unit, and a predetermined shape of the interface, and the operating system further comprises a sensor device, disposed at a distance from the interface and sensitive to the recognition feature, wherein the sensor device is configured to determine the inclination vector by contactlessly detecting a spatial orientation of the recognition feature.

15. The operating system according to claim 11, further comprising an input device configured to: capture an operating input that a user performs at the interface, and generate, based on a currently running operating function of the motor vehicle and the captured operating input, a control signal to control a vehicle component of the motor vehicle.

16. The operating system according to claim 15, wherein the input device includes at least one of: a time of flight (TOF) camera configured to capture the operating input based on image data that are generated by the TOF camera and describe a relative position of an input element of the user with respect to the interface, and a touchpad disposed at the interface.

17. The operating system according to claim 11, wherein the interface is made from at least one of an elastic material, a foam, and an artificial leather.

18. The operating system according to claim 11, wherein the interface includes exclusively rounded corners and edges, with a radius of curvature of greater than 5 millimeters, in an external profile.

19. The operating system according to claim 11, wherein at least one of: the operating surface is white, and the interface is plate-shaped and the operating surface is planar.

20. A motor vehicle, comprising: a passenger compartment; and an operating system, including: a portable interface, movable in the passenger compartment, having an operating surface, a projector, separate from the interface, configured to project display content onto the operating surface of the interface, a capturing device configured to determine an inclination vector of a relative inclination of the operating surface with respect to the projector, and an image processing device configured to generate the display content by graphically distorting an original display content by use of a predetermined pre-distortion function based on the determined inclination vector, the pre-distortion function being set inversely to an optical distortion that occurs due to the relative inclination during the projection of the display content onto the operating surface.

21. The motor vehicle according to claim 20, wherein the interface includes a plurality of operating surfaces, and the capturing device is configured to select, as the operating surface onto which the display content is to be projected, an operating surface among the plurality of operating surfaces having a normal vector with a smallest inclination angle defined with respect to a connecting line between the interface and the projector.

22. The motor vehicle according to claim 21, wherein a respective original display content is assigned to each of the plurality of operating surfaces, and the image processing device is configured to select the original display content based on which of the plurality of operating surfaces is selected as the operating surface onto which the display content is to be projected.

23. The motor vehicle according to claim 20, wherein the capturing device includes a recognition feature, which is provided at the interface, the recognition feature includes at least one of a marker element, disposed at the interface unit, and a predetermined shape of the interface, and the operating system further includes a sensor device, disposed at a distance from the interface and sensitive to the recognition feature, wherein the sensor device is configured to determine the inclination vector by contactlessly detecting a spatial orientation of the recognition feature.

24. The motor vehicle according to claim 20, further comprising a vehicle component, wherein the operating system further includes an input device configured to: capture an operating input that a user performs at the interface, and generate, based on a currently running operating function of the motor vehicle and the captured operating input, a control signal to control the vehicle component.

25. The motor vehicle according to claim 24, wherein the input device includes at least one of: a time of flight (TOF) camera configured to capture the operating input based on image data that are generated by the TOF camera and describe a relative position of an input element of the user with respect to the interface, and a touchpad disposed at the interface.

26. The motor vehicle according to claim 20, wherein the interface is made from at least one of an elastic material, a foam, and an artificial leather.

27. The motor vehicle according to claim 20, wherein the interface includes exclusively rounded corners and edges, with a radius of curvature of greater than 5 millimeters, in an external profile.

28. The motor vehicle according to claim 20, wherein at least one of: the operating surface is white, and the interface is plate-shaped and the operating surface is planar.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0026] These and other aspects and advantages will become more apparent and more readily appreciated from the following description of example embodiments, taken in conjunction with the accompanying drawings, of which:

[0027] FIG. 1 is a schematic illustration of an embodiment of the motor vehicle according to an example of the disclosure; and

[0028] FIG. 2 is a schematic illustration of an operating system, as may be provided in the motor vehicle of FIG. 1, according to an example of the disclosure.

DETAILED DESCRIPTION

[0029] The example embodiments discussed below are examples of the disclosure. In the example embodiments, the described components of the embodiments each represent individual features that should be considered independently of one another and also develop the disclosure in each case independently of one another. The disclosure is therefore also intended to include combinations of the features of the embodiments other than those illustrated. Furthermore, the described embodiments may also be supplemented by further features that have already been described.

[0030] In the drawings, identical reference signs each denote elements of identical function.

[0031] FIG. 1 shows a schematic illustration of a passenger compartment 11 from a bird's eye perspective of a motor vehicle 10. For reference purposes, a vehicle seat 12 and a steering wheel 13 are shown. The vehicle seat 12 can be set in a lying position, in which a backrest 14 of the vehicle seat 12 is inclined backward or pivoted toward the ground when compared to an upright seat position. In this way, a distance 15 between the shoulder of a user (not illustrated) lying in the vehicle seat 12 and for example a control panel 16 can be so great that the user can no longer reach the control panel 16 using their arm while in the lying position. Nevertheless, the user in the motor vehicle 10 is enabled to operate at least one vehicle component 17 from the vehicle seat 12 in the lying position and/or to view the output thereof.

[0032] For this purpose, an operating system 18 is provided in the motor vehicle 10, which, first, provides a portable interface unit 19 for the user that the user can hold in one hand, for example, and, second, provides a projection unit 20, which can project a display content 21 onto an operating surface 22 of the interface unit 19 by use of light 23. The projection unit 20 can be provided at a distance from the interface unit 19 in the motor vehicle 10, for example it may be arranged on a ceiling of the passenger compartment 11. The user can provide an operating input 25 at the operating surface 22 by use of an input element 24. For example, the display content 21 can present an operating menu 26, and the user can use the input element 24 to select or activate a menu element or an operating area 27 of the operating menu 26. An input device 28 can register the operating input 25, and, in dependence on the operating input 25 and a currently activated operating function 29, the input device 28 can generate a control signal 30 for the at least one vehicle component 17 so as to control the at least one vehicle component 17 in accordance with the selection or operating input 25 made by the user.

[0033] A touchpad can be provided at the interface unit 19 itself as an integral part of the input device 28. As an alternative, the interface unit 19 can be entirely without sensors and/or completely free from any electronic components. For example, the interface unit 19 may be a plate made of a plastics material. The input device 28 can in that case may capture the operating input 25 by use of a capturing device 31, for example a TOF camera, a relative orientation of the input element 24 with respect to the interface unit 19. The TOF camera can generate image data D of the passenger compartment 11 in which the interface unit 19 and the surrounding area thereof are mapped or described. The TOF camera can for example be a time-of-flight camera.

[0034] Since the display content 21 is projected onto the operating surface 22, an optical distortion of the display content 21 occurs in dependence on the angle or the inclination at which the operating surface 22 is held with respect to the projection unit 20. The reason for this is that, depending on the inclination of the operating surface 22, the light 23 is incident thereon obliquely.

[0035] Nevertheless, the user in the motor vehicle 10 with its operating system 18 will perceive a display content 21, the distortion of which does not change or remains unchanged if the user moves or pivots or tilts the interface unit 19 in a manner such that the inclination thereof relative to the projection unit 20 changes. The reason is that “dynamic projection mapping” is provided, for which an image processing device 32 may be provided in the operating system 18.

[0036] One possible mode of operation of the image processing device 32 is described in connection with FIG. 2.

[0037] FIG. 2 again schematically illustrates a side view of the projection unit 20, the interface unit 19, the capturing device 31 for example in the form of the camera, for example the TOF camera, and the image processing device 32. The image processing device 32 can be provided for example on the basis of a processor device with at least one microprocessor and/or at least one microcontroller. The method operations described can be realized on the basis of software for the processor device. The software can be stored in a data memory of the processor device.

[0038] FIG. 2 shows how the operating surface 22 of the interface unit 19 can be aligned obliquely with respect to the projection unit 20 in the passenger compartment 11, as a result of which a normal vector 33 of the operating surface 22 is aligned at a non-zero inclination angle 34 with respect to a connecting line 35 between the interface unit 19 and the projection unit 20.

[0039] This relative inclination 36 of the interface unit 19 with respect to the projection unit 20 can be captured by the capturing device 31 and be described or indicated as an inclination vector 37 by the image processing device 32. The inclination vector 37 can describe an alignment of the normal vector 33 in space. The display content 21 can be formed by the image processing device 32 on the basis of an original display content 38, with respect to which for example graphics data may be stored. A presentation 39 of the original display content 38 is likewise illustrated by way of example in FIG. 2. It is shown how, in the presentation 39 of the original display content 38, the operating menu 26 with the operating areas 27 for example for two different operating functions F1, F2 can be represented and presented without distortion.

[0040] In order to compensate for the optical distortion during the projection of the light 23 onto the operating surface 22, the display content 21 can be generated, that is to say corresponding digital image data can be calculated, by the image processing device 32 from the original display content 38 by use of a pre-distortion function 40. FIG. 2 illustrates a presentation 41 of the pre-distorted display contents 21, which has not yet been projected. It can be seen that the operating menu 26 is shown to be compressed along one spatial direction 42. The pre-distortion function 40 is obtained from the geometric conditions as they occur for the incident light 23 on the operating surface 22 due to the inclination vector 37. As a general rule, what is known as oblique parallel projection can be used as the basis here.

[0041] When projecting the compressed presentation 41 of the original display content 38 onto the operating surface 22 by use of the light 23, a projection or presentation that corresponds to the presentation 39 of the original display content 38 can be obtained on the operating surface 22 due to the optical distortion in the form of stretching.

[0042] The interface unit 19 can have at least one further operating surface 22′, so that two possible operating surfaces 22, 22′ are provided. The operating surface 22′ can also have a corresponding normal vector 33′. The corresponding associated operating surface 22, 22′ is selected for projecting the display content 21 depending on the normal vector 33, 33′ that has the smaller inclination angle 34 toward the connecting line 35. The angle 34 can be ascertained for example by use of the capturing device 31. In order to identify which operating surface 22, 22′ is located where, at least one recognition feature 43 (for example a marker element 44) may be provided at the interface unit 19. In the illustrated example, the capturing device 31 can use for example the camera TOF as the sensor device 45 for capturing the recognition feature 43.

[0043] The operating system 18 thus provides hardware that for example has a white operating surface for the purpose of projecting a user interface that is capable of being operated onto the operating surface. At the same time, the operating surface is movable because it is arranged on a portable interface unit 19. Despite the movability, the display of the operating interface remains undistorted, which is achieved by use of “dynamic projection mapping” in the manner described above.

[0044] By using an algorithm for “dynamic projection mapping”, an operating surface can be projected onto a (for example) single-color surface. The surface for example has the size of a tablet. This surface, which may not be spatially fixed, can be moved freely within the vehicle. Owing to the described possible material selection, the interface unit can have a crash-proof design, which means that it does not break in the case of an accident or crash. There is also no need for any electronic system or glass to be incorporated.

[0045] The operating surface can be detected due to its shape or by way of a marker, for example in camera-based fashion.

[0046] The operating actions taking place on the operating surface (for example touch gestures) can be captured by a TOF camera or by different tracking technology.

[0047] The projection takes place for example using a projector of the projection unit. The projection is adapted to the change in location of the surface. The change in location is here likewise captured for example by a TOF camera or by different tracking technology.

[0048] The processed signals can in turn control the vehicle-side vehicle components (for example the infotainment).

[0049] The examples show overall how a portable interface unit can be operated as a virtual tablet as described herein.

[0050] A description has been provided with reference to various examples, but it will be understood that variations and modifications can be effected within the spirit and scope of the claims which may include the phrase “at least one of A, B, and C” as an alternative expression that means one or more of A, B, and C may be used, contrary to the holding in Superguide v. DIRECTV, 358 F3d 870, 69 USPQ2d 1865 (Fed. Cir. 2004). As an example, the scope of the expression “at least one of A, B, and C” is intended to include: (1) at least one of A, (2) at least one of B, (3) at least one of C, (4) at least one of A and at least one of B, (5) at least one of A and at least one of C, (6) at least one of B and at least one of C, and (7) at least one of A, at least one of B, and at least one of C.