INTERACTIVE SYSTEM

Abstract

The invention relates to a system for interacting with an occupant of a motor vehicle comprising: a. a measuring device comprising at least one sensor arranged to acquire at least one parameter associated with the occupant of said vehicle; b. an on-board processing unit arranged to receive said parameter and to define a data item representing the emotional state of said occupant by means of said model, said representative data item being a comfort index score (CISn) of said occupant; c. the representative data item corresponding to a point in a two-dimensional space (anvn) for characterising the emotional state of the occupant; d. characterised in that an emotional comfort index is computed on the basis of the representative data item; e. and in that at least one actuator is configured to activate at least one multi-sensory stimulus for interacting with the occupant, said stimulus allowing the emotional state of said occupant to be changed.

Claims

1. An interactive system which interacts with an occupant of a motor vehicle, comprising: a measurement device comprising at least one sensor configured to acquire at least one parameter linked to the occupant of said vehicle, an on-board processing unit configured to receive said parameter and define an item of data representative of the emotional state of said occupant by said model, said representative item of data being a comfort index score of said occupant, the representative item of data corresponding to a point in a two-dimensional space for characterizing the emotional state of the occupant, wherein an emotional comfort index is calculated from the representative item of data, and at least one actuator is configured to activate at least one multisensory stimulus in order to interact with the occupant, said stimulus allowing the emotional state of said occupant to be modified.

2. The interactive system as claimed in claim 1, wherein the emotional comfort index (CI) is calculated using the formula: $\mathrm{CI}=\left[\underset{1}{\overset{n}{.Math.}}{\mathrm{CIS}}_n\right]/n$ CI being the emotional comfort index and CIS.sub.n being a score of the comfort index determined at a time n.

3. The interactive system as claimed in claim 2, wherein the score of the comfort index is a function of valence and of arousal.

4. The interactive system as claimed in claim 2, wherein the score of the comfort index is calculated using the following formula: ${\mathrm{CIS}}_n=\frac{v_n+\left(3\times a_n\right)}{2}$

5. The interactive system as claimed in claim 1, wherein the sensors are formed by at least one ultra-wideband radar and an infrared camera.

6. The interactive system as claimed in claim 1, wherein the ultra-wideband radar has a frequency between 50 GHz and 160 GHz.

7. The interactive system as claimed in claim 1, wherein the infrared camera detects wavelengths between 25 μm and 100 μm.

8. The interactive system as claimed in claim 1, wherein the at least one multisensory stimulus is at least one selected from the group consisting of: a perfume, essential oils, a nebulizer, lighting, a sound, music, a vibration, a massage, an air flow and light.

9. The interactive system as claimed in claim 1, further comprising a learning loop allowing the processing of the model for evaluating emotion to be improved.

10. A method for interacting with an occupant of a motor vehicle, comprising: measuring a parameter linked to an occupant of a vehicle by at least one sensor; analyzing the parameter by means of a processing unit and determining a score of the comfort index of the emotional state of the occupant; calculating an emotional comfort index from the score of the comfort index; and actuating an actuator so as to activate at least one multisensory stimulus in order to interact with the occupant, said stimulus allowing the emotional state of said occupant to be modified in order to interact with said occupant on the basis of the emotional comfort index.

Description

[0041] FIG. 1 is a schematic diagram of at least part of the method according to the invention,

[0042] FIG. 2 is a schematic depiction of a two-dimensional space AV used in one of the steps of the method of FIG. 1,

[0043] FIG. 3 is a schematic depiction of the analysis step of the method of FIG. 1,

[0044] FIG. 4 is a schematic depiction of the analysis step of the method of FIG. 1,

[0045] FIG. 5 is a schematic depiction of the multisensory map used in the method of FIG. 1,

[0046] FIG. 6 is a schematic depiction of the construction of the map of FIG. 5.

[0047] The interactive system proposed in the invention uses a method having five steps. These five steps, which are shown schematically in [FIG. 1], consist of: [0048] a) a measurement step M carried out by a measurement device and during which one or more parameters relating to the one or more occupants are collected, [0049] b) an analysis step A for mapping the emotional state of the occupant, [0050] c) a calculation step C in which an emotional comfort index CI is determined, [0051] d) an action step Ac in which at least one multisensory stimulus is applied so as to modify the emotional state of the one or more occupants. The one or more stimuli are chosen on the basis of the value of the emotional comfort index CI calculated in the previous step, [0052] e) an optional information step Int in which the occupant is informed of his emotional state and of the stimuli applied.

[0053] In the measurement step M, the measurement device will acquire one or more parameters describing the status and therefore the emotional state of the occupant (what is described for one occupant may of course be applied to a plurality of occupants of the vehicle simultaneously). Parameters describing the environment in which the occupant finds himself may also be collected so as to deduce therefrom their potential effect on the emotional state of the occupant.

[0054] The device described in the preceding paragraphs is formed by one or more sensors. These sensors are preferably sensors built into the vehicle, such as for example one or more cameras, sensors for detecting vital signs, one or more microphones or indeed contact sensors.

[0055] In one preferred embodiment, the measurements are carried out by cameras, in particular infrared cameras which take images in the infrared domain. These cameras are directed toward the expected positions of the various occupants of the vehicle: the driver's seat, passenger seat, rear bench seat, etc. In particular, one or more very wide-angle cameras (for example of the “fisheye” type) may cover a plurality of positions simultaneously. The infrared cameras preferably detect wavelengths between 0.7 μm and 100 μm, preferably 25 μm and 100 μm.

[0056] These cameras comprise, advantageously, near-infrared (NIR) cameras and/or far-infrared (FIR) cameras.

[0057] The images from the near-infrared cameras may for example serve to delimit the position, dimensions and movements of various parts of the body of an occupant of the vehicle. The images from the far-infrared cameras may for example serve to identify the parts of the body of the occupant exchanging the most heat with the vehicle interior, for example the head and hands, which are not covered with clothes and will thus appear hotter. The FIR and RGB NIR cameras may be fused in order to better identify a fixed location on the more precise RGB camera and follow it on the FIR camera.

[0058] The images from the near-infrared cameras may for example serve to delimit the position, dimensions and movements of various parts of the body of an occupant of the vehicle. The images from the far-infrared cameras may for example serve to identify the parts of the body of the occupant exchanging the most heat with the vehicle interior, for example the head and hands, which are not covered with clothes and will thus appear hotter.

[0059] As explained above, the measurement device also allows the environment of the one or more passengers to be determined, the environment possibly influencing their emotional state. Thus, data such as temperature, luminous intensity, noise, the speed of the vehicle, etc. will possibly be collected.

[0060] Other types of parameters will also be collected by means of other sensors.

[0061] The measurement device comprises at least one microphone allowing the voice of the one or more passengers to be recorded.

[0062] The measurement device may also comprise biosensors able to detect parameters such as organic compounds, ions, bacteria, etc.

[0063] The measurement device may also be composed of sensors for detecting vital signs. These may for example take the form of contactless sensors such as for example a radar, a camera, or indeed wearable elements (watch, shirt, bracelet, etc.).

[0064] Sensors for detecting vital signs in contact with the passenger may also be used. They take for example the form of conductive elements installed in parts of the vehicle (armrest, steering wheel, seat, etc.). These sensors for detecting vital signs measure parameters such as heart rate and/or frequency, breathing frequency and/or amplitude, the conductivity of the skin, brain waves, etc.

[0065] One preferred embodiment uses an ultra-wideband short-range radar. The frequency of the radar may for example be between 10 GHz and 1 THz, preferably between 50 GHz and 160 GHz.

[0066] The following analysis step A consists in evaluating and interpreting the parameters obtained in the measurement step M. These parameters will thus be translated into a representative item of data easily represented in a two-dimensional space or 2D space anvn for characterizing the emotional state. This 2D space is shown in [FIG. 3]. It is formed of a first axis corresponding to valence v.sub.n and of a second axis corresponding to arousal an.

[0067] Valence characterizes the level of pleasure or unpleasantness associated with an emotion while arousal may be defined as being the intensity of the impacts and of the response generated by this emotion.

[0068] The individual's state of control may also be assessed from measurements performed on the vehicle. Reference is then made to dominance. The space that is used is then a three-dimensional space and no longer a two-dimensional space.

[0069] [FIG. 3] illustrates the placement of the representative item of data described above in the two-dimensional space a.sub.nv.sub.n. This item of data varies over the course of the time spent by the occupant in the vehicle. Thus, a first representative item of data is provided for a time t.sub.0 while the representative item of data corresponding to the present is illustrated by t.sub.actual. Continuous measurements are preferably carried out, so as to obtain the curve shown in [FIG. 3]. However, discrete measurements may also be performed.

[0070] The emotional state of the occupant according to the placement of the representative item of data on the 2D space a.sub.nv.sub.n may then be given.

[0071] One example of the previously described map is shown in [FIG. 4]. This map of the emotional state of the occupant will then be correlated with one or more maps corresponding to various stimuli. These stimuli are based on the five senses: sight, smell, taste, touch, hearing. The maps corresponding to each of the five senses are shown in FIG. 5.

[0072] The map of the five senses is created in three steps, which are illustrated in [FIG. 6]. Specifically, the initial settings of the vehicle may be described as being those corresponding to the primary emotional state of the occupant, that is to say an emotional state in which the occupant primarily reacts.

[0073] The map is then modified to take account of the impact of the culture and/or of the education of the occupant. This step may, for example, be carried out by deep learning, allowing a user profile to be obtained for each occupant.

[0074] The last step in the construction of the map relates to the impact of the personal life and/or of the experience of the occupant. This step is preferably performed by machine learning, thus allowing the map to be adjusted in real time.

[0075] The calculation step C of calculating the emotional comfort index CI is performed using a plurality of measurements of the score of the comfort index CIS.sub.n, that are able to be deduced from the representative item of data described above, and therefore from the values of valence v.sub.n and of arousal a.sub.n at a given time.

[0076] The score CIS.sub.n is calculated from a function whose variables are valence v.sub.n and arousal a.sub.n, respectively representing the positive or negative experience of the occupant, as well as the importance of said experience.

[0077] The score of the comfort index CIS.sub.n may be calculated using the following formula:

[00002]$\mathrm{CI}=\frac{\left[{.Math.}_1^n{\mathrm{CIS}}_n\right]}{n},$

wherein v.sub.n is valence and a.sub.n is arousal.

[0078] However, the score of the comfort index CIS.sub.n may be calculated using a more complex formula dependent on valence v.sub.n and arousal a.sub.n.

[0079] The emotional comfort index CI may then be calculated from the average of various scores CIS.sub.n calculated for given times. This may be deduced from the following formula:

[00003]${\mathrm{CIS}}_n=\frac{v_n+\left(3\times a_n\right)}{2},$

wherein CI is the emotional comfort index and CISn is the score of the comfort index obtained at a time n.

[0080] A plurality of successive evaluations, preferably evaluations that are carried out discretely, are performed based on measurements performed in the vehicle over a duration that may for example be between 0.1 sec and 5 sec. The sampling period may for example be between 10 milliseconds and 300 milliseconds.

[0081] The action step Ac shown in [FIG. 1] corresponds to the application of one or more stimuli. The choice of the stimulus depends on the desired effect. After having calculated the emotional comfort index as explained above, various types of action may be selected.

[0082] The multisensory stimuli used may, for example, be: [0083] a) For sight: use of interior lighting with various colors and/or of various intensities, [0084] b) For smell: use of a diffuser of perfume, essential oils or indeed pheromones, [0085] c) For touch: use of radiant panels, nebulization of water, use of jets of hot and/or cold air, [0086] d) For hearing: selection of ambient noises or music, [0087] e) For taste: diffusion of perfume or nebulization possibly creating pheromones combining the five main flavors (savory, sour, bitter, sweet, umami).

[0088] There may be display means allowing the occupant to be informed of his emotional state. The interactive system may have one or more display means. Said means may for example take the form of a wearable or portable device, in particular a watch and/or glasses and/or a bracelet and/or a belt and/or a shirt and/or a mobile telephone.

[0089] The display means may also take the form of a text and/or a color and/or a sound and/or a vibration.