System and method for determining a user role and user settings associated with a vehicle

Abstract

A system includes a vehicle, the vehicle comprising a vehicle network. The system further includes a wearable device in operative communication with the vehicle network. The vehicle is configured to determine user settings for the vehicle from data received from the wearable device and implement the user settings for the vehicle. A method for adjusting user settings associated with a vehicle based on data from a wearable device includes acquiring user data from a wearable device at a vehicle, based on the user data, determining by the vehicle one or more user settings, and automatically adjusting by the vehicle of one or more vehicle features based on the one or more user settings.

Claims

1. A system comprising: a vehicle, the vehicle comprising a vehicle network; and a wireless earpiece worn by a user in operative communication with the vehicle network; wherein the vehicle is configured to acquire sensor data from the wireless earpiece; wherein the wireless earpiece is configured to confirm an identity of the user using sensor data stored on the wireless earpiece; wherein the vehicle is configured to determine a role of the user and user settings for the vehicle from the sensor data received from the wireless earpiece and an action performed by the user on the vehicle, wherein the sensor data includes inertial data from an inertial sensor of the wireless earpiece; and wherein the vehicle is further configured to implement the user settings in accordance with the role of the user in response to the confirmation of the identity of the user by the wireless earpiece.

2. The system of claim 1 wherein the data includes biometric data.

3. The system of claim 2 wherein the biometric data is determined using one or more sensors of the wireless earpiece.

4. The system of claim 3 wherein the one or more sensors includes a physiological sensor.

5. The system of claim 2 wherein the biometric data comprises biometric data stored on the wireless earpiece.

6. The system of claim 2 wherein the user settings comprise seat settings and wherein the biometric data includes height information.

7. The system of claim 1 wherein the user settings comprise entertainment settings and wherein the data comprises entertainment data.

8. The system of claim 7 wherein the entertainment settings include radio presets and wherein the entertainment data comprises music preferences.

9. The system of claim 7 wherein recommendations associated with the seat settings are provided by the wireless earpiece in accordance with the biometric data of the user.

10. A method for adjusting one or more user settings associated with a vehicle based on user data from a wireless earpiece worn by a user, the method comprising: acquiring, by the vehicle, the user data stored on the wireless earpiece worn by the user via a wireless linkage between the vehicle and the wireless earpiece, wherein the user data includes data from an inertial sensor of the wireless earpiece; confirming by the wireless earpiece, based on the user data, an identity of the user; determining by the vehicle, based on the user data and vehicle data, a role of the user; determining whether the user has access rights to perform various functions over the vehicle; communicating data and/or commands over the vehicle network to perform the various functions over the vehicle;

11. The method of claim 10, further comprising the step of determining by the vehicle, based on the user data the one or more user settings.

12. The method of claim 11, further comprising the step of automatically adjusting, by the vehicle, one or more vehicle features based on the one or more user settings in accordance with the role of the user in response to the confirmation of the identity of the user by the wireless earpiece.

13. The method of claim 10, wherein the user data comprises music preference data.

14. The method of claim 12, wherein the user settings include entertainment system settings.

15. The method of claim 13, wherein the entertainment system settings include radio preset settings.

16. The method of claim 14, wherein the confirmation of the identity of the user is further determined from answers provided by the user in response to questions communicated to the user by the wireless earpiece, wherein the questions are associated with activities of the user.

17. The method of claim 16, further comprising the step of identifying the access rights needed to perform various vehicle functions.

18. The method of claim 17, further comprising the inputting commands to the vehicle through the wireless earpiece.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0021] FIG. 1 illustrates one example of a vehicle which integrates with wearable technology.

[0022] FIG. 2 illustrates one example of a set of wearable devices in the form of ear pieces.

[0023] FIG. 3 is a block diagram of one example of a wearable device in the form of an earpiece.

[0024] FIG. 4 is a diagram of wearable devices communicating with a vehicle network.

[0025] FIG. 5 is a flow diagram illustrating one example of a method for determining user identity and/or user role.

[0026] FIG. 6 illustrates another diagram of wearable devices communicating with a vehicle network.

DETAILED DESCRIPTION

[0027] Some of the most important factors in selecting a vehicle such as car may be the technology available to enhance the experience. This may be of importance in certain vehicle segments such as for luxury vehicles. Another important factor in selecting a vehicle may be the available safety features. According to various aspects, the present invention allows for wearable devices including ear pieces to enhance the experience of vehicles and according to some aspects, the present invention allows for wearable devices such as earpieces to enhance the overall safety of the vehicle. Therefore, it is expected the technology described herein will make any vehicle so equipped more desirable to customers, more satisfying to customers, and potentially more profitable for the vehicle manufacturer. Similarly, at least some of the various aspects may be added to existing vehicles as after-market accessories to improve the safety or experience of existing vehicles.

[0028] FIG. 1 illustrates one example of use of a wearable device in conjunction with a vehicle. A shown in FIG. 1 there is a vehicle 2. Although the vehicle shown is a full-size sedan, it is contemplated the vehicle may be of any number of types of cars, trucks, sport utility vehicles, vans, mini-vans, automotive vehicles, commercial vehicles, agricultural vehicles, construction vehicles, specialty vehicles, recreational vehicles, buses, motorcycles, aircraft, boats, ships, yachts, spacecraft, or other types of vehicles. The vehicle may be gas-powered, diesel powered, electric, solar-powered, or human-powered. The vehicle may be actively operated by a driver or may be partially or completely autonomous or self-driving. The vehicle 2 may have a vehicle control system 40. The vehicle control system is a system which may include any number of mechanical and electromechanical subsystems. As shown in FIG. 1, such systems may include a navigation system 42, an entertainment system 44, a vehicle security system 45, an audio system 46, a safety system 47, a communications system 48 preferably with a wireless transceiver, a driver assistance system 49, a passenger comfort system 50, and an engine/transmission, chassis electronics system(s) 51. Of course, other examples of vehicle control sub-systems are contemplated. In addition, it is to be understood there may be overlap between some of these different vehicle systems and the presence or absence of these vehicle systems as well as other vehicle systems may depend upon the type of vehicle, the type of fuel or propulsion system, the size of the vehicle, and other factors and variables. In the automotive context, examples of the driver assistance system 49 may include one or more subsystems such as a lane assist system, a speed assist system, a blind spot detection system, a park assist system, and an adaptive cruise control system. In the automotive context, examples of the passenger comfort system 50 may include one or more subsystems such as automatic climate control, electronic seat adjustment, automatic wipers, automatic headlamps, and automatic cooling. In the automotive context, examples of the safety system 47 may include active safety systems such as air bags, hill descent control, and an emergency brake assist system. Aspects of the navigation system 42, the entertainment system 44, the audio system 46, and the communications system 48 may be combined into an infotainment system.

[0029] One or more wearable devices such as a set of earpieces 10 including a left earpiece 12A and a right earpiece 12B may in operative communication with the vehicle control system 40 such as through the communication system 48. For example, the communication system 48 may provide a Bluetooth or BLE or Wi-Fi link to wearable devices or may otherwise provide for communications with the wearable devices preferably through wireless communications. The vehicle 2 may communicate with the wearable device(s) directly, or alternatively, or in addition, the vehicle 2 may communicate with the wearable device(s) through an intermediary device such as a mobile device 4 which may be a mobile phone, a tablet, or other type of mobile device or other computing device.

[0030] As will be explained in further details with respect to various examples, the wearable device(s) 10 interact with the vehicle control system 40 in any number of different ways. For example, the wearable device(s) 10 may provide sensor data, identity information, stored information, streamed information, or other types of information to the vehicle. Based on this information, the vehicle may take any number of actions which may include one or more actions taken by the vehicle control system (or subsystems thereof). In addition, the vehicle 2 may communicate sensor data, identity information, stored information, streamed information or other types of information to the wearable device(s) 10.

[0031] FIG. 2 illustrates one example of a wearable device in the form of a set of ear pieces 10 in greater detail. FIG. 1 illustrates a set of earpiece wearables 10 which includes a left earpiece 12A and a right earpiece 12B. Each of the earpiece wearables 12A, 12B has an earpiece wearable housing 14A, 14B which may be in the form of a protective shell or casing and may be an in-the-ear earpiece housing. A left infrared through ultraviolet spectrometer 16A and right infrared through ultraviolet spectrometer 16B is also shown. Each earpiece 12A, 12B may include one or more microphones 70A, 70B. Note the air microphones 70A, 70B are outward facing so the air microphones 70A, 70B may capture ambient environmental sound. It is to be understood any number of microphones may be present including air conduction microphones, bone conduction microphones, or other audio sensors.

[0032] FIG. 3 is a block diagram illustrating a device. The device may include one or more LEDs 20 electrically connected to an intelligent control system 30. The intelligent control system 30 may include one or more processors, microcontrollers, application specific integrated circuits, or other types of integrated circuits. The intelligent control system 30 may also be electrically connected to one or more sensors 32. Where the device is an earpiece, the sensor(s) may include an inertial sensor 74, another inertial sensor 76. Each inertial sensor 74, 76 may include an accelerometer, a gyro sensor or gyrometer, a magnetometer or other type of inertial sensor. The sensor(s) 32 may also include one or more contact sensors 72, one or more bone conduction microphones 71, one or more air conduction microphones 70, one or more chemical sensors 79, a pulse oximeter 76, a temperature sensor 80, or other physiological or biological sensor(s). Further examples of physiological or biological sensors include an alcohol sensor 83, glucose sensor 85, or bilirubin sensor 87. Other examples of physiological or biological sensors may also be included in the device. These may include a blood pressure sensor 82, an electroencephalogram (EEG) 84, an Adenosine Triphosphate (ATP) sensor, a lactic acid sensor 88, a hemoglobin sensor 90, a hematocrit sensor 92 or other biological or chemical sensor.

[0033] A spectrometer 16 is also shown. The spectrometer 16 may be an infrared (IR) through ultraviolet (UV) spectrometer although it is contemplated any number of wavelengths in the infrared, visible, or ultraviolet spectrums may be detected. The spectrometer 16 is preferably adapted to measure environmental wavelengths for analysis and recommendations and thus preferably is located on or at the external facing side of the device.

[0034] A gesture control interface 36 is also operatively connected to or integrated into the intelligent control system 30. The gesture control interface 36 may include one or more emitters 82 and one or more detectors 84 for sensing user gestures. The emitters may be of any number of types including infrared LEDs. The device may include a transceiver 35 which may allow for induction transmissions such as through near field magnetic induction. A short-range transceiver 34 using Bluetooth, BLE, UWB, or other means of radio communication may also be present. The short-range transceiver 34 may be used to communicate with the vehicle control system. In operation, the intelligent control system 30 may be configured to convey different information using one or more of the LED(s) 20 based on context or mode of operation of the device. The various sensors 32, the intelligent control system 30, and other electronic components may be located on the printed circuit board of the device. One or more speakers 73 may also be operatively connected to the intelligent control system 30. A memory 31 is shown. The memory 31 may be used for various purposes. This may include storage of biometric information, storage of user settings, or other data.

[0035] An electromagnetic (E/M) field transceiver 37 or other type of electromagnetic field receiver is also operatively connected to the intelligent control system 30 to link the intelligent control system 30 to the electromagnetic field of the user. The use of the E/M transceiver 37 allows the device to link electromagnetically into a personal area network or body area network or another device.

[0036] According to another aspect, earpiece wearables may be used to identify one or more users. Each earpiece wearable may include its own identifier. In addition, each earpiece may be used to determine or confirm identity of an individual wearing it. This may be accomplished in various ways including through voice imprint. An individual may speak, and their voice analyzed by the earpiece and compared to known samples or metrics related to characteristics such as pitch, tone, cadence, and frequency to identify the individual. Alternatively, identify may be established through other biometric information collected by the earpiece including based on movements such as gait collected with the inertial sensor or heart rate variability.

[0037] Other types of user identification and authentication may also be used. For example, an individual may be asked to specify other information to the earpiece to confirm identity. This may include answering specific questions. For example, the ear piece may ask multiple questions with yes or no or multiple-choice answers which the correct individual will know but others are not likely to know. These questions may be stored within a database and are questions which the individual specifically provided answers. These questions may also be based on activities of the user which are stored on the earpiece or are retrievable from a system in operative communication with the ear piece. These may include information about physical activities, locations, or other activities.

[0038] Alternatively, instead of the earpiece performing the analysis associated with user identification and authentication, necessary information such as voice samples or voice or gestural responses of biometric information may be collected by the ear piece and communicated to the vehicle, mobile device, or other device for performing the analysis.

[0039] Once a user has been identified the user may be authorized to perform various functions in various ways. For example, the vehicle may be unlocked such as by a person saying unlock or the vehicle may be remote started and environmental controls set by a person saying, start my car and set temperature to 72 degrees. These actions may be taken by the vehicle control system or its subsystems such as an access and security subsystem or a climate control subsystem. In addition, actions may be taken based on proximity of the individual to the user or based on other contextual information.

[0040] Various types of vehicle controls may be a part of the vehicle access and security subsystems. These may include actuators such as actuators associated with door locks or locks associated with other compartments. Other types of vehicle controls may include an ignition lock switch which may be unlocked or locked. Other types of vehicle controls may include actuators associated with windows. In addition to these functions, any number of different vehicle functions may be performed. The vehicle functions performed by a properly identified individual may be the same types of vehicle functions an individual may perform as a driver of the vehicle. Other types of vehicle controls may include any number of settings such as audio system settings, temperature control settings, entertainment system settings, navigation settings, or other types of settings.

[0041] FIG. 4 illustrates another example. In FIG. 4, a vehicle network 100 is shown. According to one aspect, the wearable devices 12A, 12B may communicate information through a vehicle network 100 associated with a vehicle 2. Thus, once an identity of a user has been established, commands may be communicated over the vehicle network 100 or vehicle bus to perform one or more vehicle functions. Protocols which are used may include a Controller Area Network (CAN), Local Interconnect Network (LIN), or others including proprietary network protocols or network protocol overlays.

[0042] Various types of electronic control modules 102, 104, 106, 108 or electronic control units may communicate over the network 100 of the vehicle. These may include electronic modules such as an engine control unit (ECU), a transmission control unit (TCU), an anti-lock braking system (ABS), a body control module (BCM), a door control unit (DCU), an electric power steering control unit (PSCU), a human-machine interface (HMI), powertrain control module (PCM), speed control unit (SCU), telematic control unit (TCU), brake control unit (BCM), battery management system, and numerous others. Any number of electronic control modules may be operatively connected to the vehicle network 100.

[0043] In one embodiment a wireless transceiver module 110 is operatively connected to a vehicle network 100 and it is the wireless transceiver module 110 which is in operative communication with one or more wearable devices such as wearable ear piece 12A, 12B. Once a wearable device 12A, 12B or the vehicle 2 has identified a user, then the user is permitted to give instructions which are translated into commands which are communicated over the vehicle network 100 to an appropriate system or component of the vehicle or to communicate data such as data from one or more sensors of the wearable device 12A, 12B. Data from the wearable device may be used by any number of different electronic control modules or electronic control units 102, 104, 106, 108 connected to the vehicle network 100 to perform any number of different vehicle functions.

[0044] FIG. 5 illustrates one example of a methodology. As shown in FIG. 5 at step 120 sensor data is obtained at one or more wearable devices. As previously explained the sensor data can be of any number of types. For example, the sensor data may be voice data or other biometric data. In step 122 a determination is made of the user identity based on the sensor data. Where the sensor data is voice data this determination may be as the result of a voice print or voice sample analysis. Any number of different products or components may be used to perform this analysis. Examples of commercial products for performing such functionality include Nuance VocalPassword, VoiceIT, and numerous others. It should be further understood other types of biometric data may be used. For example, where the wearable device is a pair of glasses then retina identification and authentication may be used. Where the wearable device is a pair of gloves than finger print analysis may be used. The determination of the user identity based on sensor data may be performed in one of several different locations based on the type of analysis and available computational resources. For example, the determination may be performed on or at the wearable device itself. Alternatively, the determination may be performed on or at the vehicle. Alternatively, still, the determination may be performed by a mobile device such as a smart phone which is in operative communication with either the wearable device(s) or the vehicle, or both. Where determinations are made by the wearable it may be performed by the intelligent control system.

[0045] Once the individual has been identified, in step 123, the role of the user may be determined based on sensor data or other data associated with one or more wearable devices. This determination may be performed in various ways. For example, data from one or more inertial sensors may be correlated with vehicle data. Thus, if sensor data shows a downward movement and the vehicle shows opening of a door, then this data may be correlated, and a determination may be made the user wearing the wearable device is the user who opened the door and entered the vehicle. If the door is the driver's door, the system may make the determination the user is the driver. Similarly, if sensor data shows movement of the hands or wrists of a user consistent with the placing their hands on the steering wheel then it may be inferred the user is the driver. Similarly, if the sensor data includes image information such as from a camera associated with the wearable device, the information may be processed to determine the role of the user. In addition, the wearable device may be used to determine a location such as a seat location of a user within the vehicle. The role may then be determined based on the seat location.

[0046] Once the individual has been identified or recognized, in step 124 a determination is made as to whether the user has access rights. In one implementation, if the user is identified then the user has appropriate access rights. In alternative implementations, identifying the user does not necessarily give the individual all rights. Where the user has appropriate access rights, or none are required, in step 126 data or commands may be communicated over the vehicle network to perform various vehicle functions. Data from the wearable device(s) may be used by any electronic control modules associated with the vehicle network to provide input to be used in any number of different decision-making processes. Similarly, commands may be given from the user to the vehicle using the wearable device such as when the wearable device is an earpiece and the commands may be given through voice input from the user.

[0047] It is further contemplated commands may be automatically communicated based on the identity of the user. In other words, once the user has been identified the vehicle may perform one or more vehicle functions automatically based on the identity of the user. These functions may be any number of different functions previously discussed or other functions including functions granting access or deny access to the user.

[0048] According to another aspect, one or more wearable devices may be used to identify an individual and the role of the individual as a driver or passenger of a vehicle. Once the driver has been identified several different actions may be taken by vehicle control systems. This may include automatically adjusting various settings within the vehicle based on user preferences. Thus, for example, seats may be adjusted to the position preferred by the user including through adjusting the seat forward or back, upward or downward, or adjusting the angle of the seat. Similarly, the position of the rearview mirrors or other mirrors may be adjusted based on preferences associated with the driver. In addition, steering wheel position may be adjusted based on preferences associated with the driver. These various adjustments may be performed in various ways including using servo motors or other types of motors, switches, or other actuators.

[0049] Similarly, various other types of settings may be stored which are associated with an individual whether driver or passenger. These may include navigation settings. Thus, navigation settings associated with an individual may be used. Thus, for example where an individual has previously identified a location (such as Peter's house) within the navigation system, those locations may be associated with the individual and automatically available. Note, locations associated with one or more passengers may also be added to the system as well.

[0050] Other types of settings such as radio station or satellite radio presets or favorites may also be loaded. Other settings associated with an entertainment system or infotainment system may also be made. Again, these settings may be associated with the driver and/or one or more passengers.

[0051] Various other types of settings may be also be associated with a user. The settings may include door lock settings, climate settings, light settings, and any number of other personalized settings. The settings may further include other navigation settings and preferences, camera settings and preferences, vehicle settings and preferences, system settings and preferences, phone settings and preferences, info settings and preferences, audio settings, and preferences, and any number of other electronic or electro-mechanical settings, preferences, or adjustments which may be made by the vehicle.

[0052] Where there is more than one individual within the vehicle with a wearable device, it is contemplated a determination may be made as to which individual is the driver and which individual or individuals are passengers. It is contemplated this determination may be made in any number of ways. For example, where the wearable device is in the form of two earpieces, it is contemplated the position of a user may be found within the vehicle by using directional range finding or similar techniques to determine position. Where the wearable device includes one or more inertial sensors, it is contemplated the identity of one or more users may be determined based on movement of the user. For example, where the wearable device is a watch, movement of the wrist consistent with placing the hand on a steering wheel may be indicative of which user is the driver. Where the wearable device is a set of earpieces, the timing of the movement of the head relative to the opening and closing of the driver's door may be indicative of which user is the driver. Similarly, the timing of the movement of the head relative to the opening and closing of a passenger's door may be indicative of which user is the passenger. In addition, a single individual may be associated with the vehicle as a primary driver with one or more other individuals associated as secondary drivers. Alternatively, the vehicle or wearable device may prompt one or more individuals to ask, Who is driving or Are you driving or Who is driving, Peter or Jim Senior?

[0053] According to another aspect, information from a wearable device may be used to improve comfort and safety of a driver or passenger by suggesting user settings for optimum comfort and/or safety. Where a wearable device includes one or more physiological sensors and/or other physiological data, or biometric data is available, this data may be used to suggest specific user settings. For example, recommendations may be made for seat settings based on a known height of an individual, known measurements of their legs or torso, arm length, or other body measurements.

[0054] Similarly, where the wearable device contains music such as a plurality of audio files or playlists, this information may be communicated to the vehicle and based on this information the vehicle may determine a set of radio presets based, for example, on the type or types of music present on the wearable device.

[0055] One application of this aspect is when an individual wearing an appropriate wearable device enters a vehicle the first time, such as when selecting a vehicle to buy. Based on available biometric information from the wearable device, the vehicle may self-adjust to settings consistent with the known biometric information to increase the comfort of the individual, better accommodate the individual, and/or provide an enhanced initial experience with the vehicle. Similarly, if an individual prefers other settings than those recommended, information about those settings may be communicated to the wearable device, stored, and communicated to other vehicles or other devices which the driver may operate. It is also contemplated in some applications, once a user has set vehicle settings in the manner desired by the user, the user may have the vehicle send those settings to the wearable device to be stored by the wearable device. In addition to the vehicle settings the data stored may include information about the make and/or model of vehicle and other information. Thus, the wearable device may store user settings for a vehicle which have previously been used in a vehicle such as the same vehicle or a different vehicle of the same or similar type. This may be especially convenient and enhance safety where an individual regularly drives different vehicles such as different rental vehicles, different fleet vehicles, or for other vehicles which are shared between multiple users.

[0056] FIG. 6 illustrates another example of a system. As shown in FIG. 6, a wearable device 12 includes a wireless transceiver. The wearable device may be an ear piece, a set of ear pieces, a watch, glasses, integrated into an article of clothing, or other type of wearable device. The wearable device 12 communicates user data to a wireless transceiver associated with an electronic module 110 of a vehicle. The user data may include biometric data, user setting data, stored data, inertial sensor data, physiological sensor data, music preference data, or other types of data. Such data may be translated into user settings of the vehicle and communicated to the appropriate modules over the vehicle network 100. The other modules may then provide for automatically adjusting one or more vehicle features or controlled based on the user settings.

[0057] Various methods, system, and apparatus have been shown and described relating to vehicles with wearable integration or communication. The present invention is not to be limited to these specific examples but contemplates any number of related methods, system, and apparatus and these examples may vary based on the specific type of vehicle, the specific type of wearable device, and other considerations.