Touch sensing display device and method of detecting user input from a driver side or passenger side in a motor vehicle

Abstract

A touch-sensitive display apparatus and a control apparatus are included in an operating device of a motor vehicle. The control apparatus is configured, in a first operating mode, to display on the display apparatus a screen keyboard for receiving a character sequence from a user. A driver is not to operate the on-screen keyboard during a journey. A sensor apparatus is configured to detect an approach of an object to the display apparatus, a distinction being drawn between a driver approach from a predetermined driver side and a passenger approach from a passenger side opposite the driver side. The control apparatus is configured to deactivate the first operating mode in the event of a detected driver approach of the object and, instead, to activate an alternative operating mode that is different from the first operating mode.

Claims

1. An operating device for a motor vehicle having a driver side and a passenger-side opposite the driver side, the operating device comprising: a touch-sensitive display; a sensor configured to detect whether an object that approaches the touch-sensitive display is a driver-side approach by the object from the driver side or a passenger-side approach by the object from the passenger side; and a controller configured to, in a first operating mode, control the touch-sensitive display to display a screen keyboard to receive an input of a character sequence from a user on the touch-sensitive display, and, when the sensor detects the driver-side approach by the object from the driver side and the motor vehicle moves at a driving speed greater than a predetermined driving speed while in the first operating mode, the controller is further configured: to deactivate the first operating mode in which the screen keyboard is displayed on the touch-sensitive display so that the screen keyboard is not available to a driver positioned on the driver side, and to activate a second operating mode which differs from the first operating mode and in which an alternative input to receive the character sequence from the driver positioned on the driver side is provided through an alternative screen keyboard provided on the touch-sensitive display while the motor vehicle moves at the driving speed greater than the predetermined driving speed.

2. The operating device as claimed in claim 1, wherein the second operating mode includes a handwritten input for the driver instead of the screen keyboard, and the controller is configured to capture a character trace of the handwritten input on the touch-sensitive display using the touch-sensitive display, and/or to control a camera to capture a hand movement of the handwritten input freely carried out by the driver in space in a contactless manner, as the character trace, and/or to control the camera to capture a finger movement of the handwritten input freely carried out by the driver in space in the contactless manner, as the character trace.

3. The operating device as claimed in claim 1, wherein the controller is configured to, in the second operating mode, control the touch-sensitive display to display a reduced number of operating areas and/or larger-sized operating areas to receive the character sequence through the alternative screen keyboard, in comparison with a number and/or a size of keys of the screen keyboard displayed on the touch-sensitive display in the first operating mode.

4. The operating device as claimed in claim 1, wherein the controller is configured to activate voice recognition to receive the alternative input of at least a portion of the character sequence for the second operating mode.

5. The operating device as claimed in claim 1, wherein the controller is configured to provide input feedback for the second operating mode by controlling the touch-sensitive display to display a character in the character sequence which has been captured and/or by controlling a synthetic voice output to acoustically announce the character.

6. The operating device as claimed in claim 1, wherein the controller is configured to change maintain the first operating mode when the sensor detects the driver-side approach by the object from the driver side while the motor vehicle moves at a driving speed equal to or less than the predetermined driving speed.

7. The operating device as claimed in claim 1, wherein the controller is configured to retain a partial character sequence, which has been input in the first operating mode, in the event of a change from the first operating mode to the second operating mode, and to continue a further input of a remaining portion of the character sequence in the second operating mode.

8. The operating device as claimed in claim 1, wherein the controller is configured to deactivate the second operating mode when the sensor signals to the controller an absence of the driver-side approach by the object from the driver side or when the sensor signals to the controller a passenger-side approach by the object from the passenger side.

9. A motor vehicle, comprising: a chassis; a first seat disposed on a driver side of the motor vehicle; a second seat disposed on a passenger-side of the motor vehicle, opposite the driver side; and an operating device, including: a touch-sensitive display disposed between the first seat and the second seat, a sensor configured to detect whether an object that approaches the touch-sensitive display is a driver-side approach by the object from the driver side or a passenger-side approach by the object from the passenger side, and a controller configured to, in a first operating mode, control the touch-sensitive display to display a screen keyboard to receive an input of a character sequence from a user on the touch-sensitive display, and, when the sensor detects the driver-side approach by the object from the driver side and the motor vehicle moves at a driving speed greater than a predetermined driving speed while in the first operating mode, the controller is further configured: to deactivate the first operating mode in which the screen keyboard is displayed on the touch-sensitive display so that the screen keyboard is not available to a driver positioned on the driver side, and to activate a second operating mode which differs from the first operating mode and in which an alternative input to receive the character sequence from the driver positioned on the driver side is provided through an alternative screen keyboard provided on the touch-sensitive display while the motor vehicle moves at the driving speed greater than the predetermined driving speed.

10. The motor vehicle as claimed in claim 9, wherein the sensor is configured to transmit a signal to the controller indicating that the object approaches the touch-sensitive display only when the approach is the driver-side approach by the object from the driver side and the operating device is in the first operating mode.

11. The motor vehicle as claimed in claim 10, wherein the controller is configured to, in the first operating mode, continue to operate in the first operating mode when the sensor detects the passenger-side approach by the object from the passenger side.

12. The method as claimed in claim 10, further comprising: transmitting, via the sensor, a signal to the controller indicating that the object approaches the touch-sensitive display only when the approach is the driver-side approach by the object from the driver side; and while the first operating mode is activated, maintaining the first operating mode when the sensor detects the passenger-side approach by the object from the passenger side.

13. The motor vehicle as claimed in claim 9, wherein the alternative screen keyboard includes a touch-sensitive portion of the touch-sensitive display configured to receive a handwritten input by the object from the driver side, the controller is configured to recognize a character trace of the handwritten input on the touch-sensitive portion of the touch-sensitive display, and the controller is configured to convert the recognized character trace into a character which is displayed in an output field provided on another portion of the touch-sensitive display.

14. The motor vehicle as claimed in claim 9, wherein the alternative screen keyboard includes touch-sensitive areas of the touch-sensitive display configured to display predetermined characters for the alternative input to receive the character sequence, and a number of the touch-sensitive areas of the alternative screen keyboard in the second operating mode are less than a number of touch-sensitive areas configured to display characters for the input of the character sequence in the first operating mode and/or a size of the touch-sensitive areas of the alternative screen keyboard in the second operating mode is greater than a size of touch-sensitive areas configured to display characters for the input of the character sequence in the first operating mode.

15. The motor vehicle as claimed in claim 9, wherein the alternative screen keyboard includes touch-sensitive areas of the touch-sensitive display configured to display predetermined characters for the alternative input to receive the character sequence, and the controller determines the predetermined characters to be displayed in the touch-sensitive areas based on at least one of a previously input character sequence or an input character sequence designated as a favorite by a user.

16. The motor vehicle as claimed in claim 9, wherein the sensor is configured to ignore the passenger-side approach by the object from the passenger side in the first operating mode such that the sensor does not signal to the controller that the passenger-side approach by the object from the passenger side occurs and the first operating mode is maintained, and the sensor is configured to signal to the controller the passenger-side approach by the object from the passenger side in the second operating mode such that the controller deactivates the second operating mode and activates the first operating mode.

17. A method for receiving a character sequence from a user by an operating device in a motor vehicle, the method comprising: displaying, in a first operating mode, via a controller of the operating device, a screen keyboard for receiving the character sequence on a touch-sensitive display; detecting, via a sensor, whether an object that approaches the touch-sensitive display apparatus is a driver-side approach by the object from a driver side of the motor vehicle or a passenger-side approach by the object from a passenger side of the motor vehicle opposite the driver side; and when the driver-side approach by the object from the driver side is detected and the motor vehicle moves at a driving speed greater than a predetermined driving speed while in the first operating mode, deactivating, via the controller, the first operating mode in which the screen keyboard is displayed on the touch-sensitive display so that the screen keyboard is not available to a driver positioned on the driver side, and activating a second operating mode which differs from the first operating mode and in which an alternative input for receiving the character sequence from the driver positioned on the driver side is provided through an alternative screen keyboard provided on the touch-sensitive display while the motor vehicle moves at the driving speed greater than the predetermined driving speed.

18. The method as claimed in claim 17, further comprising: displaying, in the second operating mode, the alternative screen keyboard which includes a touch-sensitive region of the touch-sensitive display to receive a handwritten input by the object from the driver side; receiving the handwritten input by the object from the driver side on the touch-sensitive region of the touch-sensitive display; recognizing, via the controller, a character trace of the handwritten input; converting, via the controller, the recognized character trace into a recognized character; and displaying the recognized character in an output field provided on another region of the touch-sensitive display.

19. The method as claimed in claim 17, further comprising: displaying, in the second operating mode, the alternative screen keyboard which includes touch-sensitive areas of the touch-sensitive display to display predetermined characters for the alternative input to receive the character sequence, and wherein a number of the touch-sensitive areas of the alternative screen keyboard in the second operating mode are less than a number of touch-sensitive areas configured to display characters for the input of the character sequence in the first operating mode and/or a size of the touch-sensitive areas of the alternative screen keyboard in the second operating mode is greater than a size of touch-sensitive areas configured to display characters for the input of the character sequence in the first operating mode.

20. The method as claimed in claim 17, further comprising: displaying, in the second operating mode, the alternative screen keyboard which includes touch-sensitive areas of the touch-sensitive display to display predetermined characters for the alternative input to receive the character sequence, and determining, by the controller, the predetermined characters to be displayed in the touch-sensitive areas based on at least one of a previously input character sequence or an input character sequence designated as a favorite by a user.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

(1) These and other aspects and advantages will become more apparent and more readily appreciated from the following example embodiment is described below. In this respect, the single drawing is a schematic illustration of a motor vehicle having the operating device described herein.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT

(2) Reference will now be made in detail to example embodiments with reference to the accompanying drawing, wherein like reference numerals refer to like elements throughout.

(3) In the example embodiments explained below, the described components are each individual features which can be considered independently of one another and which each also develop the disclosure independently of one another and can therefore also be considered to be part of the disclosure individually or in a combination other than that shown. Furthermore, the described embodiments can also be supplemented with further features which have been described.

(4) The single drawing shows a passenger compartment or a vehicle interior 2 of a motor vehicle 1 from the perspective of a driver 3, of whom only a forearm 4, a hand 5 and a finger 6 are illustrated in the single drawing. The motor vehicle 1 may be, for example, an automobile, for example a passenger automobile. A dashboard 7, a steering wheel 8 and a windshield 9 are illustrated.

(5) The motor vehicle 1 may have an operating device 10 which can be used by the driver 3 to operate one or more vehicle components 11. The operating device 10 generates control signals 12 for controlling or setting the vehicle components 11. For this purpose, the operating device 10 has a control apparatus 13 and a touchscreen 14. The touchscreen 14 is a touch-sensitive output apparatus. The control apparatus 13 can be implemented, for example, on the basis of a processor apparatus, for example a microcontroller or microprocessor.

(6) For the further explanation of the example, it is assumed that the operating device 10 controls a navigation apparatus or a navigation system as a vehicle component 11. The driver 3 would like to input a navigation destination as a character sequence, that is to say a city name, for example. In order to input the character sequence, the control apparatus 13 first of all displays a screen keyboard 15 having character keys 16 on the touchscreen 14 in an operating mode B1. For the sake of clarity, only a few of the character keys 16 are provided with a reference symbol in the single drawing. In this situation, it is possible for a passenger (not illustrated), for example, to tap the character keys 16 on the touchscreen 14 in succession and hereby input the navigation destination letter-by-letter as text. The recognized characters which have been indicated can be displayed on the touchscreen 14, for example in an output field 17.

(7) However, the operation of the screen keyboard 15 requires such a high degree of attentiveness that, in the case of the motor vehicle 1, the driver 3 is prevented from being able to use the screen keyboard 15 in the described manner during a journey of the motor vehicle 1.

(8) In order to prevent use, a sensor apparatus 18 is provided in the motor vehicle 1 and detects whether an object, for example the hand 5, approaches the touch screen 14 from a driver's side 19. A sensor signal 21 from the sensor apparatus 19 therefore signals an approach from the driver's side 19. In the case of an approach from an opposite passenger side 20, the sensor apparatus 18 either does not signal anything at all or signals a passenger-side approach. The distinction between a driver-side approach and a passenger-side approach may therefore also involve the sensor signal 21 actually signaling an approach only in the case of a driver-side approach or an indication of the driver side/passenger side direction expressly being signaled.

(9) The sensor apparatus 18 can therefore monitor, for example, a virtual separating plane 22, the penetration of which by the hand 5 of the driver 3 causing the sensor signal 21 containing the driver-side approach to be transmitted to the control apparatus 13. The sensor apparatus 18 may be implemented, for example, on the basis of one or more proximity sensors, for example capacitive proximity sensors, and/or on the basis of one or more infrared sensors. The sensor apparatus 18 may also be implemented on the basis of a camera and an image processing apparatus.

(10) If a driver-side approach of an object, for example the hand 5, is detected, the control apparatus changes over from the operating mode B1 with the screen keyboard 15 to an alternative operating mode B2 which does not have a keyboard, that is to say without the screen keyboard 15. This alternative operating mode B2 is likewise illustrated in the single drawing. For example, provision may be made for an input area 23 for a handwritten input to be provided on the touchscreen 14 for the driver. The driver can use his finger 6 to draw a character trace 24 on the input area 23. A handwriting recognition apparatus 25 of the control apparatus 13 then converts the character trace 24, in a manner known per se, into a recognized character 26 which in turn can be displayed in the output field 17, for example. This makes it possible for the user to check the correct recognition of the character trace 24.

(11) In addition or as an alternative to the handwritten input, provision may be made for the driver 3 to speak a voice command 27 which is represented by sound waves in the single drawing. A sound capture apparatus 28, for example a microphone or an arrangement of a plurality of microphones, can capture the voice command 27 and can make it available to the control apparatus 13 as a voice signal 29. The control apparatus 13 can use a voice recognition apparatus 30 to likewise generate a character sequence from the voice input 27, which character sequence can be used as an input instead of a keyboard input.

(12) Additionally or alternatively, larger and fewer operating keys can also be displayed in the alternative operating mode B2 instead of the character keys 16, which operating keys are provided for the purpose of inputting entire character sequences which are already prefabricated and indicate, for example, predetermined navigation destinations, for example navigation favorites, and/or navigation destinations which have already been previously indicated.

(13) After a character sequence has been input in the alternative operating mode B2, the control apparatus 13 uses the character sequence to generate a corresponding control signal 12 in order to configure the vehicle component 11, that is to say the navigation system, for example.

(14) It therefore becomes possible to provide two operating modes B1, B2 for a text input, namely a screen keyboard and a handwritten input, for example. If the system recognizes that the driver wishes to carry out the input himself during the journey, the operating device 11 automatically changes over to the handwritten input mode, that is to say the alternative operating mode B2. In contrast, if the operating device 11 recognizes that the passenger is operating it, it allows the operating mode B1 and automatically switches to the screen keyboard 15 or makes it possible to use both operating modes B1, B2. A selection switch can then be provided for this purpose on the touchscreen 14, for example, which selection switch allows the passenger to choose between the operating modes B1, B2.

(15) Therefore, there is no safety risk to the driver as a result of distraction while operating the operating device 10 since the distracting screen keyboard 15 is not available to him. In the event of an approach with an object or a hand from the driver's side 19, the touchscreen 14 is blocked for operation, that is to say is switched off for example, or the alternative operating mode B2 is activated, whereas the touchscreen 14 remains enabled as a result of approach of the passenger from the passenger side 20.

(16) If the screen keyboard 15 is displayed on the touchscreen 14 and can be operated, the screen keyboard 15 is hidden during the journey in the event of approach from the driver's side 19. The input field 23 for the handwritten input, for example, is displayed instead. In the event of an approach from the passenger side 20, the screen keyboard 15 is not hidden.

(17) The driver is prevented from being distracted for inputs which are not absolutely necessary or are not allowed during the journey, for example the keyboard input of a location in the navigation system.

(18) The sensor apparatus 18 can determine, for example by using gesture recognition, from where the hand 5 or an object approaches the touchscreen 14 and can accordingly block or enable the touchscreen 14. In connection with gesture operation, the relevant angles of approach with respect to the touchscreen 14 can be determined in this case by use of experiments. Alternatively, sensors which can monitor the described virtual separating plane 22 can be provided.

(19) Overall, the example shows how a keyboard on a touchscreen can be blocked when the driver approaches from the driver's side and can be enabled when the passenger approaches from the passenger side by the operating device described herein.

(20) A description has been provided with reference to example embodiments thereof and examples, but it will be understood that variations and modifications can be effected within the spirit and scope of the claims which may include the phrase at least one of A, B and C as an alternative expression that means one or more of A, B and C may be used, contrary to the holding in Superguide v. DIRECTV, 358 F3d 870, 69 USPQ2d 1865 (Fed. Cir. 2004).