Method and device for coupling electronic appliances to a motor vehicle

Abstract

A system, consisting of a vehicle having an infotainment system, a mobile data processing device and a motion sensing device, wherein a first communication interface is set up to transmit control commands I.sub.S from the motion sensing device to the mobile data processing device, the mobile data processing device is set up to translate the control commands I.sub.S into instructions I.sub.A to the infotainment system, and a second communication interface is set up to transmit the instructions I.sub.A from the mobile data processing device to the infotainment system.

Claims

1. A system comprising: a vehicle having an infotainment system having a touch-sensitive screen, a mobile data processing device having a display screen for displaying information in regard to coupling and existing connections, and a motion sensing device that is configured to be worn by a driver of the vehicle, wherein a first communication interface is set up to transmit control commands Is from the motion sensing device to the mobile data processing device, the mobile data processing device is set up to translate the control commands Is into instructions IA to the infotainment system, the mobile data processing device is set up to translate acknowledgement responses into responses to the motion sensing device wherein the acknowledgements being converted into sensory feedback, and a second communication interface is set up to transmit the instructions IA from the mobile data processing device to the infotainment system.

2. The system as claimed in claim 1, wherein the mobile data processing device is set up to combine multiple control commands I.sub.S into one or more instructions I.sub.A.

3. The system as claimed in claim 2, wherein the first communication interface is set up to use a Bluetooth Low Energy protocol, and the second communication interface is set up to use a Bluetooth or Wireless Fidelity or USB protocol or a radio transmission.

4. The system as claimed in claim 2, wherein the control commands I.sub.S are provided for navigating and selecting functions and/or information of the infotainment system.

5. The system as claimed in claim 2, wherein the second communication interface is set up to transmit acknowledgement responses I.sub.RA from the infotainment system to the mobile data processing device, the mobile data processing device is set up to translate acknowledgement responses I.sub.RA into responses I.sub.R to the motion sensing device, and the first communication interface is set up to transmit the responses I.sub.R from the mobile data processing device to the motion sensing device.

6. The system as claimed in claim 2, wherein the mobile data processing device is set up to translate acknowledgement responses I.sub.RA, as an alternative or addition to the responses I.sub.A, into in each case one or more acknowledgements I.sub.RM, I.sub.RM to one or more output devices, and to transmit said acknowledgements via one or more further communication interfaces, the one or more acknowledgements I.sub.RM, I.sub.RM being converted into sensory feedback by the one or more output devices.

7. The system as claimed in claim 1, wherein the first communication interface is set up to use a Bluetooth Low Energy protocol, and the second communication interface is set up to use a Bluetooth or Wireless Fidelity or USB protocol or a radio transmission.

8. The system as claimed in claim 7, wherein the control commands I.sub.S are provided for navigating and selecting functions and/or information of the infotainment system.

9. The system as claimed in claim 7, wherein the second communication interface is set up to transmit acknowledgement responses I.sub.RA from the infotainment system to the mobile data processing device, the mobile data processing device is set up to translate acknowledgement responses I.sub.RA into responses I.sub.R to the motion sensing device, and the first communication interface is set up to transmit the responses I.sub.R from the mobile data processing device to the motion sensing device.

10. The system as claimed in claim 7, wherein the mobile data processing device is set up to translate acknowledgement responses I.sub.RA, as an alternative or addition to the responses I.sub.A, into in each case one or more acknowledgements I.sub.RM, I.sub.RM to one or more output devices, and to transmit said acknowledgements via one or more further communication interfaces, the one or more acknowledgements I.sub.RM, I.sub.RM being converted into sensory feedback by the one or more output devices.

11. The system as claimed in claim 1, wherein the control commands I.sub.S are provided for navigating and selecting functions and/or information of the infotainment system.

12. The system as claimed in claim 11, wherein the mobile data processing device is set up to translate acknowledgement responses I.sub.RA, as an alternative or addition to the responses I.sub.A, into in each case one or more acknowledgements I.sub.RM, I.sub.RM to one or more output devices, and to transmit said acknowledgements via one or more further communication interfaces, the one or more acknowledgements I.sub.RM, I.sub.RM being converted into sensory feedback by the one or more output devices.

13. The system as claimed in claim 11, wherein the second communication interface is set up to transmit acknowledgement responses I.sub.RA from the infotainment system to the mobile data processing device, the mobile data processing device is set up to translate acknowledgement responses I.sub.RA into responses I.sub.R to the motion sensing device, and the first communication interface is set up to transmit the responses I.sub.R from the mobile data processing device to the motion sensing device.

14. The system as claimed in claim 1, wherein the second communication interface is set up to transmit acknowledgement responses I.sub.RA from the infotainment system to the mobile data processing device, the mobile data processing device is set up to translate acknowledgement responses I.sub.RA into responses I.sub.R to the motion sensing device, and the first communication interface is set up to transmit the responses I.sub.R from the mobile data processing device to the motion sensing device.

15. A use of a mobile data processing device, having a display screen for displaying information in regard to coupling and existing connections, for transmitting control commands Is of a motion sensing device that is configured to be worn by a driver of a vehicle to an infotainment system, having a touch-sensitive screen, in the vehicle in the form of instructions IA, wherein the control commands Is sent by the motion sensing device are received by the mobile data processing device via a first communication interface, the received control commands Is are translated into the instructions IA to the infotainment system by the mobile data processing device, the mobile data processing device is set up to translate acknowledgement responses into responses to the motion sensing device wherein the acknowledgements being converted into sensory feedback, and the translated instructions I.sub.A are sent from the mobile data processing device to the infotainment system via a second communication interface.

16. A method for transmitting control commands Is from a motion sensing device that is configured to be worn by a driver of a vehicle to an infotainment system having a touch-sensitive screen in the vehicle, at least comprising the steps of: a) sending the control commands Is to a mobile data processing device, having a display screen for displaying information in regard to coupling and existing connections, via a first communication interface, b) translating the control commands Is into instructions I.sub.A in the mobile data processing device, the mobile data processing device is set up to translate acknowledgement responses into responses to the motion sensing device wherein the acknowledgements being converted into sensory feedback and c) sending the instructions IA from the mobile data processing device to the infotainment system via a second communication interface.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

(1) The invention and the technical field will be explained in more detail below on the basis of the figures. It should be pointed out that the figures show a particularly preferred variant embodiment of the invention, to which the invention is, however, not restricted. Identical components and functions are provided with the same reference signs in the figures, in which, by way of example and schematically:

(2) FIG. 1 shows a system according to the invention,

(3) FIG. 2 shows a sequence for the use of a mobile data processing device as a network node in accordance with the invention.

DETAILED DESCRIPTION

(4) FIG. 1 shows a motion sensing device 10, in this case an armband for sensing muscle contractions in the lower arm of a user (Myo armband). Control commands I.sub.S 15 are generated by the motion sensing device 10 from detected movements and/or gestures of a user. The motion sensing device 10 sends the control commands I.sub.S 15 and receives responses I.sub.R 16. Both the control commands I.sub.S 15 and the responses I.sub.R 16 are transmitted via a first communication interface 40. The first communication interface 40 uses a Bluetooth Low Energy protocol (BLE protocol) for this. The first communication interface 40 communicatively connects the motion sensing device 10 to a mobile data processing device 20. The mobile data processing device 20 is a smartphone in this case. The mobile data processing device comprises a screen 21. The screen 21 can be used to display information in regard to coupling, existing connections and the like, inter alia. The mobile data processing device sends the responses I.sub.R 16 to the motion sensing device 10 and receives the control commands I.sub.S 15 from the motion sensing device 10 via the first communication interface 40. Instructions I.sub.A 25 are generated by the mobile data processing device 20 from the control commands I.sub.S 15. At this point, mapping onto the API prescribed by an infotainment system 30 takes place for the supported input operations. By way of example, the currently supported direction operations may differ from one infotainment system to another, e.g. in regard to granularity of the direction (8 directions or 12 directions) or in regard to intensity or step size in one direction. The responses I.sub.R 16 are generated by the mobile data processing device 20 from acknowledgement responses I.sub.RA 26. The mobile data processing device sends the instructions I.sub.A 25 and receives the acknowledgement responses I.sub.RA 26. Both the instructions I.sub.A 25 and the acknowledgement responses I.sub.RA 26 are transmitted via a second communication interface 41. The second communication interface 41 uses a Wireless Fidelity protocol (WiFi protocol) for this. The second communication interface 41 communicatively connects the mobile data processing device 20 to an infotainment system 30. The infotainment system 30 is depicted as a combination system comprising navigation system, DVD player, radio, on-board computer and mobile radio unit by way of example in this case. The infotainment system 30 can also comprise any selection of said components (navigation system, DVD player, radio, onboard computer, mobile radio unit). The infotainment system 30 comprises a touch-sensitive screen (touchscreen) 31. The screen 31 can be used to display information in regard to coupling, existing connections and the like, and also information from the infotainment system 30 (roadmap with navigation advice/visualizations, DVD films/tracks, radio stations, information from the on-board computer, information about the connected smartphone, etc.), inter alia. Further, FIG. 1 shows the optional output devices 60, 60, which each have a further communication interface 50, 50 to the mobile data processing device 20. On obtaining e.g. a confirmation report in the form of an acknowledgement response I.sub.RA 26 via the communication interface 41, the mobile data processing device 20 uses the communication interfaces 50, 50 to send respective acknowledgements I.sub.RM 66, I.sub.RM 66. It is alternatively possible for rejections of the command to be passed on in this way.

(5) The motion sensing device 10 sends control commands I.sub.S 15 to the mobile data processing device 20 and receives responses I.sub.R 16. The infotainment system 30 sends the acknowledgement responses I.sub.RA 26 to the mobile data processing device 20 and receives the instructions I.sub.A 25 from the mobile data processing device 20 via the second communication interface 41. In this case, the mobile data processing device 20 can make adjustments for the purpose of flow control toward the infotainment system 30.

(6) The instructions I.sub.A 25 are converted into specific actions by the infotainment system 30 and, as a result, information is output (sound and/or image), or are executed as functions (e.g. navigation in a menu, changing tracks or stations and the like). As confirmation of successful execution of at least one instruction I.sub.A 25, the infotainment system uses an acknowledgement (feedback) to send at least one acknowledgement response I.sub.RA 26 to the mobile data processing device 20 via the second communication interface 41. The response I.sub.R 16 or the acknowledgement response I.sub.RA 26 can be evaluated from at least four aspects:

(7) 1. The acknowledgement response I.sub.RA 26 can be used for local flow control in the mobile data processing device 20 in regard to the sending of instructions I.sub.A 25 to the infotainment system 30.

(8) 2. The response I.sub.R 16 can be used for local flow control in the motion sensing device 10 in regard to the sending of instructions I.sub.S 15 to the mobile data processing device 20.

(9) 3. The acknowledgement response I.sub.RA 26 can initiate the sending of the response I.sub.R 16 to the motion sensing device 10 for the purpose of output of a sensory effect, e.g. in regard to confirmation or rejection of a control command I.sub.S 15.

(10) 4. The acknowledgement response I.sub.RA 26 can initiate the sending of acknowledgements I.sub.RM 66, I.sub.RM 66 to the output devices 60, 60 for the purpose of output of sensory effects, e.g. in regard to confirmation or rejection of a control command I.sub.S 15.

(11) FIG. 2 shows the sequence for the control of the infotainment system 30 by the motion sensing device 10 using the mobile data processing device 20. The motion sensing device 10 detects a movement and/or gesture. The detected movement and/or gesture is converted into at least one control command I.sub.S 15. The control command I.sub.S 15 is transmitted to the mobile data processing device 20 via the first communication interface 40 by a BLE transceiver of the motion sensing device 10, for example. The mobile data processing device 20 receives the control command I.sub.S 15, by way of example, via a BLE transceiver of the mobile data processing device 20 using a BLE application of the mobile data processing device 20. The control command I.sub.S 15 is evaluated by a program on the mobile data processing device 20 and converted into an instruction I.sub.A 25 in the process. Subsequently, the program maps the control command I.sub.S 15 or the instruction I.sub.A 25, that is to say the evaluation result, for example on instruction in regard to direction and/or intensity. This involves instructions I.sub.A that are already waiting and have not yet been processed further being included in the mapping as well, so that in the possible event of there being two or more identical instructions I.sub.A, these are mapped into a single instruction I.sub.A having an appropriately adjusted step size. The instruction I.sub.A 25 is transferred to a WiFi application of the mobile data processing device 20 and, by way of example, transmitted to the infotainment system 30 via the second communication interface 41 by a WiFi transceiver of the mobile data processing device 20 using a WiFi application of the mobile data processing device 20. The infotainment system 30 receives the instruction I.sub.A 25, by way of example, via a WiFi transceiver of the infotainment system 30 using a WiFi application of the infotainment system 30. The instruction I.sub.A 25 is detected by the infotainment system 30 and forwarded to an input event handling process. The input event handling process receives the instruction I.sub.A 25 and evaluates it in regard to the action to be accomplished (functionality). The input event handling process forwards the instruction I.sub.A 25 to an applicable processing process in a local representation of a generic interface for instruction I.sub.A 25 (input event). The processing process, for example an application process responsible for media, obtains the input event (corresponding to the instruction I.sub.A 25), e.g. next track, which results in the current music track being changed to the next. In this case, the application process cannot distinguish whether the input event comes from the motion sensing device or, for example, an input via the touch-sensitive screen 31 of the infotainment system itself. Control of the infotainment system by means of inputs on the mobile data processing device 20 is also possible. Finally, the infotainment system 30 executes the input event and therefore the instruction I.sub.A 25 and starts playing the next music track.

(12) An analogous sequence of the communication between infotainment system 30 and motion sensing device 10 or for the optional output devices 60, 60 via the mobile data processing device 20 is obtained for the aforementioned acknowledgement to confirm successfully executed instructions I.sub.A 25 by detection of gestures.