Method for the Contactless Shifting of Visual Information

Abstract

The disclosure relates to a method for the contactless shifting of visual information, in which at least one viewing direction, a movement of a hand and/or a movement of a head of a user are detected. After the detection of the visual information in a first display area, and after a motion indicating a shift, the visual information is shown in the second display area upon the completion of the pivoting movement or movements.

Claims

1. A method for the contactless shifting of visual information, comprising: associating a movement of a hand or head combined with a viewing direction with a control command for shifting visual information displayed in a first display area inside a motor vehicle to a second display area spatially decoupled from the first display area in the motor vehicle; initiating by a pivoting movement of the hand or of the head of the user combined with the viewing direction, wherein the visual information is shown in the second display area upon the completion of the pivoting movement or movements.

2. The method according to claim 1, wherein the visual information is shifted into a display area to which the look and a finger of the user is directed.

3. The method according to claim 1, wherein a successful shifting of the visual information is reported acoustically, haptic-ly and/or visually.

4. The method according to claim 1, wherein during the shifting of the visual information, operating rights or user rights coupled to the visual information are transferred.

5. The method according to claim 1, wherein during the shifting of the visual information, operating rights coupled to the visual information are associated with at least one other user.

6. The method according to claim 1, wherein the visual information is transmitted to a display area bound to a seat if another user on the seat is registered.

7. The method according to claim 1, wherein the control command for shifting the visual information is combined with acoustic information of the user.

8. The method according to claim 1, wherein the visual information is shifted into a display area of a mobile device.

9. The method according to claim 1, wherein the visual information is shifted into a display area localized outside of the motor vehicle.

10. The method according to claim 1, wherein during the shifting of the visual information data representing the visual information is transferred via a wireless network.

11. The method according to claim 1, wherein visual information representing the second display area is represented in the first display area, wherein the visual information is shifted into the display area when the look and/or a finger of the user is directed toward the second display area representing visual information.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0033] Other details, features and advantages of embodiments of the invention result from the following description of exemplary embodiments with reference made to the associated drawings. In the drawings:

[0034] FIG. 1 shows a schematic view of an arrangement for using the method according to the aspects disclosed herein, and

[0035] FIG. 2 shows a schematic view for explaining the functioning of the method of FIG. 1,

[0036] FIG. 3 shows a schematic view for explaining an embodiment of the method according the aspects disclosed herein, and

[0037] FIG. 4 shows a schematic view for explaining another embodiment of a method according to the aspects disclosed herein.

DETAILED DESCRIPTION

[0038] The invention is described more fully hereinafter with references to the accompanying drawings, in which exemplary embodiments of the invention are shown. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these exemplary embodiments are provided so that this disclosure is thorough, and will fully convey the scope of the invention to those skilled in the art. It will be understood that for the purposes of this disclosure, “at least one of each” will be interpreted to mean any combination the enumerated elements following the respective language, including combination of multiples of the enumerated elements. For example, “at least one of X, Y, and Z” will be construed to mean X only, Y only, Z only, or any combination of two or more items X, Y, and Z (e.g. XYZ, XZ, YZ, X). Throughout the drawings and the detailed description, unless otherwise described, the same drawing reference numerals are understood to refer to the same elements, features, and structures. The relative size and depiction of these elements may be exaggerated for clarity, illustration, and convenience.

[0039] FIG. 1 shows a schematic view of an arrangement 1 for using the method according to the invention. The arrangement 1 comprises a first display area 2 and at least one second, not shown, other display area for displaying visual information, a sensor 10 for detecting movements of the eye 4 and therefore for detecting the viewing direction 5 of the eyes 4 of the user 3 as well as a sensor 8 for detecting movements of the hand 6 and of a pointing direction 7 of the index finger of the hand 6 of the user 3. The user 3 can be the driver of the motor vehicle.

[0040] In a variant which is not shown here the arrangement 1 can alternatively or additionally to the sensor 10 for detecting movements of the eye 4 also comprise a sensor for detecting the movement of the head 9 of the user 3.

[0041] FIG. 2 shows a schematic view for explaining the functioning of the method of the invention when used in an arrangement 1, as is shown in FIG. 1.

[0042] A piece of visual information is characterized by the reference numeral 11 and which is shown in the first display area 2 which can be, for example, the projected display area of a head-up display. In the present example the visual information 11 is shown as a rectangular switching surface which is coupled to a function for activating a navigation system. Reference numeral 5 characterizes the viewing direction of the eyes 4 of the user 3, wherein the look in viewing direction 5 is directed onto the visual information 11 represented by the rectangular switching surface. Furthermore, the hand 6 of the user 3 is shown, wherein an index figure is directed in the pointing direction 7 toward the visual information 11. The arrow characterized by the reference numeral 12 represents a pivoting movement 12 executed by the hand 6 of the user 3 which begins at the starting point 12.1 and terminates at the endpoint 12.2. The pivoting movement 12 takes place here, for example, in the air or on a surface.

[0043] The reference numeral 14 characterizes another, second display area 14 spatially decoupled from the first display area 2. It can be another display area 14 localized in the motor vehicle and such as an instrument display, a display arranged integrated in the seat for passengers on the back seat, or computer displays. However, there is also the possibility that the display area 14 is the display of a smartphone which can be present in the motor vehicle or outside of the motor vehicle. Furthermore, it is conceivable that the display area 14 is a display of a home computer localized at a pre-set network address. The visual information 11 represented by the rectangular switching surface is displayed in the display area 14 after it was shifted from the first display area 2. The shifting 13 of the visual information 11 from the first display area 2 into the second display area 14 is appropriately represented by a transfer arrow, wherein a transfer technology is used for transferring the data representing the visual information 11 from a device coupled to the first display area 2 to a device coupled to the second, other display area 14.

[0044] For the contactless shifting of the visual information 11 shown in the first display area 2 into the spatially decoupled, second display area 14, the viewing direction 5 and the pivoting movement 12 of the hand 6 and/or of the index finger of the user 3 are detected. The detecting of the viewing direction 5 can take place, as is shown, for example, in FIG. 1, by a sensor 10 for detecting movements of the eye 4, wherein for the detecting of the movement of the hand 6 a capacitive or optical camera sensory mechanism can be used. Alternatively or additionally to the detecting of the movement of the hand 6, the movement of the head 9 of the user 3 can also be detected.

[0045] In the present example the user 3 aims at the visual information 11 with his eyes 4 and the index finger of his hand 6. In order to detect or mark the visual information 11 aimed at by the user 3, the viewing direction 5 and the pointing direction 7 are combined, wherein a successful detecting of the selected visual information 11 is reported back to the user 3 by graphically emphasizing the visual information 11.

[0046] In another embodiment it can also be provided that the selection and detection or marking of the visual information 11 takes place exclusively by the viewing direction 5 or exclusively by the pointing direction 7. Furthermore, an embodiment is also conceivable in which a selection and detection of the visual information 11 is realized in that the user 3 touches a user surface.

[0047] According to the method of the invention, in the present example a pivoting movement 12 of the hand 6 combined with the viewing direction 5 in which the index finger of the hand 6 is pivoted from the starting point 12.1 to the end point 12.2 is associated with a control command by which a shifting 13 of the visual information 11 is initiated. Upon the completion of the pivoting movement 12 at the end point 12.2 the visual information 11 is displayed in the second display area 14.

[0048] During the shifting 13 of the visual information 11 into the second display area 14 the data representing the visual information 11 and the user rights coupled with the visual information 11 are transferred by a wireless network to the device coupled to the second display area 14. As a consequence, it is possible that functions coupled to the visual information 11 can be executed starting from the second display area 14.

[0049] In the present example the navigation system can be turned on and operated by the second display area 14. It can be provided that a bidirectional communication connection is established between the device coupled to the first display area 2 and the device coupled to the second display area 14.

[0050] The method according to the invention can be designed in such a manner that the visual information 11 is shifted onto all other display areas 14 present in the motor vehicle if the pivoting movement 12 is executed as a free, non-specific movement in space. Furthermore, it can also be provided that a directed pivoting movement 12 is executed in which the visual information 11 is shifted into several other display areas 14 which are arranged in the direction of the executed pivoting movement 12. In this manner a pivoting movement 12 which is directed from front to back relative to the user 3 can bring it about that the visual information 11 is shifted only to display areas 14 arranged in the back motor vehicle area.

[0051] In another embodiment of the method according to the invention it can also be provided that the visual information 11 is shifted into a second display area 14 to which the finger of the hand 6 and/or the look of the eyes 4 of the user 3 is/are directed. A shifting of the visual information 11 then takes place only into the second display area 14 aimed at by the finger and/or by the look of the user 3.

[0052] FIG. 3 shows a schematic view for explaining an embodiment of the method according to the invention. In distinction to the embodiment shown in FIG. 2, the visual information 11 shown in the display area 2 as a rectangular field is detected only by the viewing direction 5 of the eyes 4 of the user 3. Furthermore, a change to viewing direction 5.1 of the eyes 4 of the user 3 onto the second display area 14 is shown. According to the method of the invention, in the present example a pivoting movement 12 of the hand 6 combined with a viewing direction 5 in which the index finger of the hand 6 is pivoted from the starting point 12.1 to the end point 12.2 is associated with a control command by which a shifting 13 of the visual information 11 is initiated. The visual information 11 is shifted into a second display area 14 onto which the viewing direction 5.1 of the eyes 4 of the user 3 is directed upon the completion of the pivoting movement 12 at the end point 12.2. As in FIG. 2, the visual information 11 is shown upon completion of the pivoting movement 12 at the end point 12.2 in the second display area 14. In this embodiment the visual information 11 is shifted and displayed only into the second display area 14 aimed at by the user 3 in viewing direction 5.1.

[0053] FIG. 4 shows a schematic view for explaining another exemplary embodiment of the method according to the invention in which a second, not shown display area display area 14 representing visual information 15 is graphically shown in display area 2. The visual information 15 representing the second display area 14 can be pre-set for a certain second display area 14. Furthermore, there is the possibility that the visual information 15 is inserted in the display area 2 as soon as a device comprising a second display area 14 or a device coupled to a second display area 14 is bundled into or registered in the communication network of the motor vehicle. This can be, for example, a smartphone or a smartwatch which is bundled via a wireless network into the communication network of the motor vehicle so that visual information can also be shifted into the display areas of such mobile end devices.

[0054] In order for the visual information 11 shown in the example as a navigation symbol in the display area 2 to be detected by the user 3, as in the embodiment shown in FIG. 2, the viewing direction 5 of the eyes 4 of the user 3 and the pointing direction 7 of a finger of the hand 6 of the user 3 are detected. A successful detection of the aimed-at visual information 11 can be reported back to the user 3 by a graphically visual, haptic and/or acoustic signal.

[0055] It can be provided in the present example that the changing of the viewing direction 5 to the viewing direction 5.1 and/or the pivoting movement 12 of the hand 6 or of the finger of the user 3 is/are simultaneously shown graphically in the first display area 2 as is indicated by the dotted arrow 16. As a consequence, it is possible for the user to move the visual information 11 similar to a mouse pointer or a mouse cursor over the display area 2.

[0056] In accordance with the invention, even in the present example a pivoting movement 12 of the hand 6 combined with a viewing direction 5 in which the index finger of the hand 6 is pivoted from the starting point 12.1 to the end point 12.2 is associated with a control command by which a shifting of the visual information 11 is initiated. As a consequence of the change of the viewing direction from the viewing direction 5 to the viewing direction 5.1 of the user 3, the visual information 11 in the display area 2 can be moved by the user 3 to the position of the visual information 15, as a result of which the visual information 11 is shifted into the second, not shown display area 14 represented by the visual information 15.