Method for determining the orientation of a sensor frame of reference tied to a mobile terminal carried or worn by a user
11002547 · 2021-05-11
Assignee
Inventors
Cpc classification
G01P13/00
PHYSICS
G01C21/166
PHYSICS
International classification
G01C21/16
PHYSICS
G01P13/00
PHYSICS
Abstract
Method for determining the orientation of the trajectory followed by a pedestrian, associated with a trajectory frame, with respect to a reference frame is provided. At least one motion sensor associated with the pedestrian generates data representative of the motion of the sensor housing on the basis of said sensor assembly in the reference frame. A first rotation transformation operator representative of the orientation of the reference frame with respect to the trajectory frame is calculated. The data representative of the motion after transformation by said first operator exhibits at least one characteristic of a set of characteristics which are representative of signals of walking or running motion of a pedestrian and are expressed in the pedestrian frame.
Claims
1. A method for determining an orientation of a trajectory being traversed by a pedestrian with respect to a reference frame, said pedestrian being furnished with a sensor housing comprising a sensor assembly comprising at least one motion sensor including at least one accelerometer, comprising the steps of: generating data representative of motion of the sensor housing using said sensor assembly in the reference frame, said motion of the sensor housing caused by the pedestrian traversing the trajectory, wherein the sensor housing is not permanently fixed to said pedestrian, thereby having an orientation with respect to said pedestrian that is initially unknown and can change during use, determining at least one of a footstep frequency and a stride frequency using an acceleration signal from the at least one accelerometer in relation to a vertical axis in a pedestrian frame defined by the pedestrian's antero-posterior, medio-lateral, and vertical axes, said pedestrian frame being tied to a trajectory frame of said trajectory, computing a first rotation transformation operator representative of the orientation of the reference frame with respect to the trajectory frame, compensating for the initially unknown orientation of the sensor housing with respect to said pedestrian, that transforms the generated data representative of the motion to cause exhibition of a medio-lateral motion characteristic, wherein the medio-lateral motion characteristic is one characteristic of a set of characteristics which are representative of signals of walking or running motion of a pedestrian and are expressed in the trajectory frame and exhibition of an antero-posterior motion characteristic, wherein the antero-posterior motion characteristic is another characteristic of a set of characteristics which are representative of signals of walking or running motion of a pedestrian and are expressed in the trajectory frame, wherein the first rotation transformation operator is computed by at least one of: i) maximizing the antereo-posterior motion characteristic and minimizing the medio-lateral characteristic at the footstep frequency; and ii) minimizing the antereo-posterior motion characteristic and maximizing the medio-lateral motion characteristic at the stride frequency, and determining the orientation of the trajectory traversed by the pedestrian using the computed first rotation transformation operator.
2. The method as claimed in claim 1, in which the reference frame is a terrestrial frame, and said generation of the data representative of the motion of the sensor housing is obtained using said sensor assembly in the reference frame by applying a second rotation transformation operator, so as to determine the orientation of the trajectory frame in said terrestrial frame.
3. The method as claimed in claim 2, in which the reference frame and the trajectory frame comprise a common axis, so that the first rotation transformation operator reduces to a rotation transformation operator in relation to the common axis.
4. The method as claimed in claim 3, in which the common axis is oriented along the direction of terrestrial gravity, in such a way that the first rotation transformation operator is reduced to a rotation transformation operator in relation to a direction axis of terrestrial gravity.
5. The method as claimed in claim 2, in which the orientation of the sensor housing in the trajectory frame is determined by composition of the second operator with the first operator.
6. The method as claimed in claim 2, in which an attitude platform function is carried out, providing a value of the second operator of the sensor housing in the reference frame.
7. The method as claimed in claim 6, in which the attitude platform function computes the second operator using a combination of data provided by at least two of accelerometric, gyrometric and magnetic inertial motion sensors present in said sensor housing.
8. The method as claimed in claim 1, in which said set of characteristics representative of motion signals of a chest, thorax or pelvis of the pedestrian comprises the following characteristics: a signal due to a translation motion in relation to the medio-lateral axis exhibits power at the stride rate; a signal due to a translation motion in relation to the antero-posterior axis exhibits power at the footstep rate; a signal due to a translation motion in relation to the vertical axis exhibits power at the footstep rate; signals due to translation motions in relation to the vertical axis and in relation to the antero-posterior axis, at the footstep frequency, exhibit a substantially constant phase shift; the footstep rate is substantially twice the stride rate; a signal due to a rotation motion in relation to the medio-lateral axis exhibits power at the footstep rate; a signal due to a rotation motion in relation to the antero-posterior axis exhibits power at the stride rate; and a signal due to a rotation motion in relation to the vertical axis exhibits power at the stride rate.
9. The method as claimed in claim 1, in which said set of characteristics representative of motion signals of a free limb of the pedestrian comprises the following characteristics: a signal due to a translation motion in relation to the antero-posterior axis exhibits power at the stride rate; a signal due to a translation motion in relation to the vertical axis exhibits power at the footstep rate; a signal due to a rotation motion in relation to the medio-lateral axis exhibits power at the stride rate; and a rotation signal due to a rotation motion in relation to the vertical axis exhibits power at the stride rate.
10. The method as claimed in claim 8, in which said data representative of the motion of the sensor housing in the reference frame are generated using the at least one accelerometer, wherein the at least one accelerometer comprises at least 2 measurement axes, and for which at least one characteristic from among said characteristic or said characteristics is that an acceleration signal due to walking/running along a principal direction of the trajectory or along the antero-posterior axis exhibits a power spike at the footstep rate.
11. The method as claimed in claim 10, in which the rotation transformation operator in relation to the vertical axis is furthermore determined so that a phase shift between the acceleration due to walking/running measured along the vertical axis and an acceleration due to walking/running at the footstep frequency and transformed by said operator along an axis AP lies between 0 and π, and equals π/2.
12. The method as claimed in claim 10, according to which the rotation transformation operator in relation to the vertical axis is determined using amplitudes, at the footstep frequency, of two horizontal components of the acceleration signal in the reference frame.
13. The method as claimed in claim 12, in which the amplitude of the acceleration signal at the frequency of the footsteps is determined by matched filtering of the acceleration signal in the reference frame, according to the filter of the vertical acceleration signal.
14. The method as claimed in claim 8, in which said data representative of the motion of the sensor housing in the reference frame are generated using the at least one accelerometer, wherein the at least one accelerometer comprises at least 2 measurement axes, and for which at least one characteristic from among said characteristic or said characteristics is that an acceleration signal due to walking/running along a perpendicular and horizontal direction to a principal direction of the trajectory or along the medio-lateral axis exhibits a power spike at the stride rate.
15. The method as claimed in claim 14, in which the rotation transformation operator in relation to the vertical axis is determined using amplitudes, at the stride frequency, of two horizontal components of the acceleration signal in the reference frame.
16. The method as claimed in claim 8, in which, said characteristic or said characteristics are selected from the set of characteristics of the motions of the chest of the pedestrian as claimed in claim 8 or from the set of characteristics of the motions of a free limb of the pedestrian as claimed in claim 9, using an indicator characterizing a nature of a mechanical link between the sensor housing and the pedestrian.
17. The method as claimed in claim 9, in which said data representative of the motion of the sensor housing in the reference frame are generated using at least one gyrometer with at least two measurement axes, and for which at least one characteristic from among said characteristic or said characteristics is that the rotation speed signal due to walking/running along the medio lateral axis exhibits a power spike at the stride rate.
18. The method as claimed in claim 1, in which, when motions impressed on said sensor assembly are due to a motion of the chest-thorax-pelvis assembly of the pedestrian, use is made of at least the characteristic according to which a motion signal in translation at the footstep frequency exhibits power along the antero-posterior axis, and, when the motions impressed on said sensor assembly are due to the motion of a free limb of the pedestrian, use is made of at least the characteristic according to which a motion signal in rotation at the stride frequency exhibits power in relation to the medio lateral axis.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) The invention will be better understood on studying a few embodiments described by way of wholly non-limiting examples and illustrated by the appended drawings in which:
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
(15)
DETAILED DESCRIPTION
(16) In the set of figures, the elements having the same references are similar.
(17)
(18) A sensor housing BC comprises a sensor assembly EC furnished with at least one motion sensor. A housing frame R.sub.B is associated with the sensor housing BC.
(19) A reference frame R.sub.R is also determined. A rotation transformation operator for rotating between the housing frame R.sub.B and the reference frame R.sub.R is denoted Q.sub.BR. This operator may evolve over time.
(20) A pedestrian P is furnished with a pedestrian frame R.sub.P. A trajectory frame R.sub.T is associated with the trajectory followed by the pedestrian P. An operator Q.sub.PT between the trajectory frame and the pedestrian frame is defined. This operator is defined by convention of the pedestrian frame R.sub.P and trajectory frame R.sub.T.
(21) The pedestrian P and the sensor housing BC are of course tied by a mechanical coupling.
(22) The present invention makes it possible to determine the orientation of the trajectory followed by the pedestrian P, associated with the trajectory frame R.sub.T, with respect to the reference frame R.sub.R. This orientation is denoted Q.sub.RT and may evolve over time.
(23) Depending on the choice of the reference frame R.sub.R, the applications of the invention can differ.
(24) When the reference frame R.sub.R is tied to the sensor housing BC, the invention makes it possible to always know the orientation of the sensor housing BC with respect to the pedestrian P (trajectory frame R.sub.T) furnished with a terminal comprising the sensor housing BC, and to be able to activate the terminal differently, as a function of this orientation. The terminal can be a mobile terminal such as a mobile telephone or touchpad tablet, gaming station, interactive spectacles, or bracelet worn on the wrist, etc.
(25) The invention also makes it possible, when the reference frame R.sub.R is tied to the Earth, to know the orientation of the frame tied to the Earth in the trajectory frame R.sub.T and to be able to thus determine the heading of the pedestrian, an essential component for being able to apply the techniques of “dead reckoning”.
(26) The method comprises the steps consisting in: generating data representative of the motion of the sensor housing BC on the basis of said sensor assembly in the reference frame R.sub.R, computing the value of a first rotation transformation operator Q.sub.RT representative of the orientation of the reference frame R.sub.R with respect to the trajectory frame R.sub.T, in such a way that the data representative of the motion which are thus obtained in the previous step, in the reference frame R.sub.R, and transformed by said first operator Q.sub.RT, exhibit at least one characteristic of a set of characteristics that are representative of motion signals of a pedestrian and are expressed in the pedestrian frame.
(27) The general objective is to determine the direction of the trajectory followed by a pedestrian, at each instant, said trajectory being characterized by a trajectory frame at the current instant denoted R.sub.T (cf
(28) The complexity of the problem posed stems from the fact that we have no direct measurement of the heading of the pedestrian in the reference frame R.sub.R, but more indirectly we do have measurements arising from motion sensors for a housing BC carried by the pedestrian. Indeed, the position and the orientation of the housing BC on the pedestrian are not known. Thus, even if it may be considered that the orientation of the housing BC with respect to the reference frame R.sub.R is known, or more probably or practically, can be obtained on the basis of the motion sensors present in the housing, it is not possible to determine the orientation of the pedestrian (and therefore of his trajectory) in the reference frame R.sub.R.
(29) It is considered that the pedestrian is furnished with a sensor housing BC comprising motion sensors and that he is moving by walking or running with the housing. The housing BC comprises for example, sensors of accelerometer and/or magnetometer and/or gyrometer type, which are commonly available with three measurement axes. Thus an accelerometer A directly provides the acceleration field which can be represented by a vector with three components. The same goes for a magnetometer M, which directly provides the magnetic field, representable by a vector with three components. Likewise, a gyrometer G provides the rotation speeds in relation to its three axes, the rotation speed is also representable by a three-dimensional vector. These three sensors are commonly available and mobile telephones or smartphones, or touchpad tablets are now commonly equipped with them. The sensors provide their measurements in the frame of the sensor or frame of the housing BC.
(30) The most emblematic portable device is a mobile telephone or a tablet, or indeed a laptop computer. It can also be any other object equipped with motion sensors, such as interactive spectacles, or accessories carried or worn by the user. Such sensors are now commonly embedded in mobile telephones, tablets or computers. Interactive spectacles can easily be equipped with such sensors. The electronic accessories carried or worn by a person are also commonly equipped with motion sensors, notably those which are intended for monitoring people's physical activity. Specialized radio terminals for isolated workers also form part of the devices in which such sensors may be embedded. The invention applies to any electronic device carried or worn by a person and equipped with at least one motion sensor. All the electronic devices cited are moreover provided with computation means, means of connecting and of communicating data to computing networks. The entire computation implementing the invention can be carried out aboard the electronic device, without needing any communication with a network. It is one of the advantages of the invention to thus be able at each instant to estimate, solely on the basis of the measurements of motion sensors embedded in the device, the heading of the person carrying or wearing it so as to estimate his trajectory. One is thus independent of any infrastructure.
(31) To fix matters it is possible to contemplate an emblematic scenario of the present invention, in which the pedestrian is furnished with a mobile telephone or smartphone comprising or being considered to be a sensor housing BC, equipped with motion sensors, and that the objective consists in estimating the trajectory of the pedestrian with the aid solely of the motion sensors present aboard the sensor housing BC or smartphone. Giving, at each instant, the velocity vector of the pedestrian in the reference frame makes it possible to apply the technique of Dead Reckoning. The velocity vector can be decomposed into a modulus (the speed of displacement of the pedestrian in the reference frame) and the datum regarding his orientation in the reference frame R.sub.R. We are principally concerned with the determination of this orientation information which is very complex, insofar as the pedestrian is free to carry his mobile telephone in various ways and that thus the orientation of the mobile telephone does not determine the heading of the trajectory. In the majority of industrially relevant cases, the pedestrian moves on horizontal planes with respect to a terrestrial frame. In this type of scenario, providing the orientation of the velocity vector of the pedestrian in the reference frame R.sub.R is then limited to the provision of a single angle of heading of his trajectory on the horizontal displacement plane.
(32) The motion sensors principally considered (A, G and M) provide three-dimensional measurement vectors. The sensors are rigidly tied to the sensor housing BC. It is therefore possible to consider that the sensors thus deliver their vector measurements in one and the same frame, tied to this sensor housing BC. The person skilled in the art is aware of the procedures which make it possible to correct, if necessary, possible misalignments between the axes of the sensors proper and which thus provide the measurements of the sensors in this same, single housing frame R.sub.B. For small misalignments, the invention can nevertheless be applied.
(33) As was mentioned previously, techniques are known for providing the orientation of the housing BC in the reference frame R.sub.R, when this reference frame is defined as tied to the Earth. It should indeed for example be noted that the sensors A, G, M, conventionally present in smartphones make it possible to construct an attitude platform or “Inertial Measurement Unit” (acronym IMU) which, for example, through a sensor data fusion technique, provides the orientation of the housing frame R.sub.B with respect to a reference frame tied to the Earth, that is to say the rotation transformation operator Q.sub.BR. Numerous combinations are possible between the sensors A, G, M so as to arrive at a satisfactory estimation of Q.sub.BR. If the housing is provided with very efficacious sensors, for example a low-drift gyrometer with very good calibration, it is possible to estimate at each instant this orientation with respect to a Terrestrial frame solely on the basis of the gyrometer over a horizon of several tens of minutes, or indeed of hours. Note, however, that the problem of not knowing the heading of the pedestrian remains, since the orientation, even accurate, of the sensor housing does not in any way determine the heading of the trajectory.
(34) A rotation transformation operator can be represented in various forms, a rotation matrix, a quaternion, several rotation matrices operated in series, for example according to the Euler or Cardan conventions. In
(35) To complete the conventions regarding frames and notation, it is considered that the pedestrian is furnished with a pedestrian frame R.sub.P according to
(36) To solve the problem of determining the orientation of the trajectory of the pedestrian P, if the mechanical coupling between the sensor housing BC and the pedestrian P were known (by giving an operator for rotating between the housing frame RB and the pedestrian frame RP which we denote by Q.sub.PB), we could easily find the orientation Q.sub.RT of the trajectory by composition of the orientation Q.sub.BR of the housing BC in the terrestrial frame R.sub.R with this rotation operator Q.sub.PB. However, it is assumed that this orientation is unknown, since the pedestrian can carry his housing (for example his smartphone) in various a priori unknown ways, and he can moreover change mode of carriage during use.
(37) The rotation operator Q.sub.RT is computed by composition of the rotation operator Q.sub.PB with the rotation operator Q.sub.BR.
(38) As specified in the previous paragraph and recalled again subsequently, procedures well known to the person skilled in the art make it possible to estimate the orientation Q.sub.BR of the sensor housing BC in the reference frame R.sub.R. The problem of estimating the orientation Q.sub.RT of the trajectory in the reference frame R.sub.R is therefore equivalent to that of determining the orientation of the housing BC with respect to the trajectory (or to the pedestrian frame R.sub.P, which are equivalent), Q.sub.PB. If it is known how to determine the rotation operator Q.sub.RT then it is possible to compute the rotation operator Q.sub.PB, and vice versa. The present invention makes it possible to solve both problems. The determination of the trajectory of the pedestrian P exhibits all sorts of dividends in regard to locating him at each instant, by applying dead reckoning techniques.
(39) The invention therefore exhibits a major benefit, notably in regard to cases in which the conventional principles of location are not operational. The most widespread conventional system is GPS (“Global Positioning System”) based on utilizing the so-called GNSS or GLONASS (for “global navigation satellite system”) principle. GPS makes it possible to provide an absolute location at each instant on the basis of the reception of signals generated by satellites in orbit around the Earth. It makes it possible to locate vehicles, pedestrians, etc. However, for situations in which the GPS signal is not satisfactory, or absent, the satellite-based location is not correct or unavailable. Thus urban situations for which the presence of buildings impedes GPS reception are dubbed Canyon Effect. The mobile object to be located is no longer in direct sight of a sufficient number of satellites and its location is then no longer satisfactory. Worse, in indoor situations, GPS signals are not available and location is not possible.
(40) The invention makes it possible to feed or provide with input data an estimator of the trajectory followed by the pedestrian P by the Dead Reckoning procedure, while providing the heading of the pedestrian independently of the manner of carriage of the sensor housing. The invention makes it possible to base oneself solely on the data of motion sensors for a housing BC carried by the pedestrian P and operating even indoors, without any instrumentation of the environment. We note also that the dead reckoning technique proposed makes it possible to supplement an inaccurate absolute location or one which is available from time to time by interpolating between the absolute position measurements provided by other systems. It is then also possible, for example, to limit calls to absolute positioning techniques and thus to reduce the electrical consumption of positioning systems by using the present invention. The present invention can therefore, for example, participate in a gamut of so-called Assisted GPS technologies where the GPS location solution is assisted by instantaneous trajectory data. The present invention also constitutes a significant supplement to radio-based location techniques of WIFI type for example which are by nature inaccurate.
(41) An assumption is that the sensors are carried by a human being, and that here the latter's activity is walking (or running), it is possible to expect a little more information induced by the walking scheme (or “walking”), and therefore specific motions and motion measurements are induced on the housing's motion sensors. Stated otherwise, the motions impressed on the sensor housing BC, due to the manner of carriage of the sensor housing BC by the pedestrian, and due to the walking or running activity of the pedestrian P, are not random and exhibit distinctive characteristics. These particular motions are impressed on the sensor housing BC and are therefore measured by its embedded motion sensors.
(42) In what follows, this assumption is considered to be realized (the sensors are carried by the pedestrian, who is walking or running).
(43) As first consequence, and in accordance with the foregoing, i.e. that the pedestrian is a human being who is walking (or running), there is therefore a natural direct relation between the orientation of his body within the reference framework and the trajectory that he is following. As shown by
(44) Therefore, the problem to be solved to determine the unknown rotation operator Q.sub.RT amounts to solving the problem for the unknown rotation operator which ties the trajectory frame R.sub.T and the frame of the body of the user or pedestrian frame R.sub.P, since it is assumed that the orientation of the pedestrian frame provides the heading of the trajectory.
(45) The proposed solution operates under this assumption (the heading of the trajectory is equal or equivalent to the heading of the antero-posterior axis), which is not a limitation for a normal case of walking or running. The housing frame R.sub.B can be tied to the reference frame R.sub.R by the rotation transformation operator Q.sub.BR, since it is considered that the sensor housing BC is able to provide its orientation in the reference frame R.sub.R via the conventional IMU attitude computation, known to the person skilled in the art.
(46) A carrier pedestrian bearing a motion sensor housing BC and performing a walking or running activity is considered. The sensor housing BC can be carried in the hand, for example for a smartphone or a tablet, in consultation mode (typical use of a smartphone or tablet), or carried in the hand while swinging, or be placed in a pocket tied to the thorax, in a trouser pocket, in a bag carried slung over the shoulder, or in a rucksack. It can also be carried in the hand in telephone mode, thus close to the ear. These positions are nonlimiting examples. They remain valid for other electronic devices such as interactive spectacles (then the manner of carriage is tied to the head of the user), electronic accessories. These various cases are illustrated in
(47) As disclosed by patent FR2942388, the walking activity generates motions some characteristics of which are distinctive. A stride is the basic period of walking (or running) reproduced substantially identically over time. Each stride comprises the movement of the left foot, and then of the right foot (or in the reverse order, according to convention). The term stride will be used to designate the basic period of walking (or running) and the term footstep will be used to describe the period of the signal corresponding to the alternate planting of the right foot and of the left foot. As illustrated in
(48) The frequency generally noted for a walking activity is restricted to the band of frequencies from 0.5 to 2 Hz. The high frequency is bigger if one desires to include running activities. It will therefore be commonplace and useful to restrict the motion signals studied (for walking/running) to this band of frequencies, for example through a bandpass filter.
(49) It is therefore relevant to note that the motion signals sensed by a sensor substantially bound to the thorax or to the pelvis of a pedestrian then exhibit two power spikes at two distinctive frequencies, one related to the stride rate, the other related to the motions of each leg, the footstep rate. For non-pathological, symmetric walking gaits, these two frequencies are related in a ratio equal to about two.
(50) It is therefore known that the walking activity induces motions with distinctive characteristics. We propose to give a description thereof in the pedestrian frame R.sub.P such as defined in
(51) It is thus noted that there exists an item of information related to the orientation of the body, which is present on motion signals induced by the motions of the pedestrian's body. Thus, when the motion signals sensed by the motion sensors are expressed in the housing frame R.sub.B, information is available related to the orientation of the body with respect to the sensor housing BC. Likewise, if the motion signals sensed by the motion sensors are expressed in another frame (for example the reference frame R.sub.R), then information is available related to the orientation of the body of the pedestrian with respect to the reference frame R.sub.R. Thus, more specifically, and to fix matters by using a canonical case, when a housing equipped with a translation motion sensor with three axes (X,Y,Z), such as an accelerometer which is commonly employed as sensor of motions tied to translations, is fixed or bound to the thorax or pelvis, and when the frame of the housing BC in which the sensor delivers its signals is aligned with the pedestrian frame R.sub.p (ML, AP, VT), the signal of the motion sensor in relation to the axis X exhibits all the distinctive properties of the motion signal in relation to the Medio-Lateral axis ML (i.e. essentially a power spike at the stride frequency), the signal of the motion sensor in relation to the axis Y exhibits all the distinctive properties of the motion signal in relation to the Antero-Posterior axis AP (i.e. essentially a power spike at the footstep frequency), the signal of the motion sensor in relation to the axis Z exhibits all the distinctive properties of the motion signal in relation to the Vertical axis VT (i.e. essentially a power spike at the footstep frequency). The motion signals delivered by the housing BC therefore exhibit distinctive characteristics due to the alignment of the housing BC with the pedestrian frame R.sub.P (ML, AP, VT). Finally the distinctive properties of phase shift between translation motion signals in relation to AP and VT lie on the signals of the motion sensors between Y and Z. For the rotation motions, it would for example be appropriate to utilize a rotation sensor, such as a gyrometer. In a manner similar to the characteristics of translations explained hereinabove, when the frame of the sensor housing is identical to the pedestrian frame, all the distinctive characteristics of the rotation motions of the pedestrian are found on the rotation motion signals (the rotation signals in relation to the axis ML essentially exhibit power at the footstep frequency, in relation to the axis AP, they essentially exhibit power at the stride frequency, as listed hereinabove.
(52) When the orientation of the sensor housing BC is aligned with the Pedestrian frame R.sub.P (therefore the trajectory frame R.sub.T), these distinctive properties are therefore necessarily found on each of the measurement axes. It is now possible to describe the fundamental principle of the invention. Indeed, in accordance with the foregoing, when this orientation is arbitrary, that is to say when the transformation operator Q.sub.PB is not restricted to the identity as described previously (the orientation of the sensor housing BC is not “identical” to that of the pedestrian or of the trajectory), but unknown, it is therefore deduced therefrom that a good estimator of Q.sub.PB should make it possible to find these distinctive properties, on the motion signals arising from the sensor housing BC and transformed by the operator Q.sub.PB. Indeed, the pedestrian's raw motion signals arising from the sensor housing BC, then exhibit mixtures of the distinctive properties (because they are each combinations of the signals in relation to ML, AP, VT), but their transform by application of the operator Q.sub.PB provides the signals in the pedestrian frame R.sub.P (or trajectory frame R.sub.T) and these transforms should then again exhibit the distinctive properties identified on the axes of the pedestrian frame R.sub.P (ML, AP, VT). It is thus the object of the invention to utilize these distinctive properties so as to estimate the unknown operators Q.sub.PB (or Q.sub.RT).
(53) The concrete example of the case in which the motion signals are expressed in the housing frame R.sub.B proposes to utilize the distinctive characteristics of a pedestrian's walking motion signals to estimate the unknown rotation operator Q.sub.PB for rotating between the housing frame R.sub.B and the pedestrian frame R.sub.P. Besides, the same principle applies simply between the pedestrian frame R.sub.P and any frame in which it is possible to express the motion signals. Thus, by knowing the orientation of the sensor housing BC in a reference frame R.sub.R (such as the Terrestrial frame), it is then possible to express the raw motion signals measured by the sensor housing in the reference frame R.sub.R and thereafter to apply the same principle as previously so as to estimate the rotation operator Q.sub.RP or Q.sub.RT for rotating between the reference frame R.sub.R and the pedestrian frame R.sub.P. It is then possible to estimate this unknown operator Q.sub.RT, just as we have proposed to estimate the unknown operator Q.sub.PB.
(54) The person skilled in the art knows numerous procedures which can in practice implement the principle of the invention. Indeed, our invention starts from the principle that a good estimator of the unknown orientation (for example Q.sub.PB) should transform the signals from the frame in which they are expressed (for example housing frame or other reference frame, for example tied to the Earth) in such a way that they again exhibit (all or part) the distinctive characteristics of the pedestrian's motion signals in the pedestrian frame. According to the sophistication of the procedure, the motion sensors available, and the computation power available, it is possible to utilize all or part of the distinctive characteristics of the pedestrian's motion signals. The person skilled in the art can utilize procedures for searching for the parameters of the rotation transformation operator (three independent parameters) for example by a technique of minimization (or maximization) of criteria built on compliance with the distinctive characteristics.
(55) It is indeed possible to build criteria which are representative of the mismatch between the characteristics of the motion signals transformed by a candidate orientation operator and the distinctive characteristics of the motion signals in the pedestrian frame, and to take as better estimator of the unknown orientation the one which generates the best criterion. In the case of a mismatch criterion (the less the characteristics of the signals transformed by the candidate rotation operator comply with the characteristics of the motions in the pedestrian frame, the larger the criterion), the best estimator will be the one which generates the smallest mismatches. Thus, for example, as long as the translation motion signals measured (which are optionally transformed on the basis of the signals arising from the housing in a chosen reference frame) and transformed by the candidate operator and thus potentially representing the signals in relation to the Antero-Posterior axis AP of the pedestrian thus predicted by the candidate operator do not exhibit a power essentially at the footstep frequency, then the mismatch remains large and the candidate operator is not retained. Indeed, the candidate operator is not the appropriate one as long as we do not retrieve this distinctive characteristic of the translation motion signals in relation to the Antero-Posterior axis AP. It is possible to build procedures for searching for the best candidate operator by iteration for example, by proposing successive candidate operators and by retaining that which possesses the best criteria. It is possible to traverse the whole of the space of rotation transformation operators and choose that which provides the best criterion as solution. It is advantageously possible to use more efficacious procedures for searching for a minimum or maximum, such as gradient descents for example. This entails traversing a landscape whose coordinates are the parameters of a rotation transformation operator (i.e. three independent parameters), computing the value of the distinctive characteristics compliance criterion after having transformed the motion signals into the frame of the pedestrian predicted by the candidate operator.
(56) In addition to these automatic search procedures based on criterion optimization, it is also possible to analyze a particular criterion and to propose a direct analytical solution which, in a single computation, provides the best estimator of the unknown rotation operator. It is also possible to provide mixed solutions by combining direct analytical solutions when possible and optimization procedures when a direct expression is not possible.
(57) It is for example possible to design a method for estimating the operator Q.sub.PB, which exhibits candidate operators (taken from the set of possible rotation transformation operators), the best candidate or candidates which is or are retained as rotation estimator Q.sub.PB is or are that or those transforming the motion signals measured in the frame of the housing into signals which exhibit (all or part) of the distinctive characteristics of the motion signals of the pedestrian frame R.sub.P (ML, AP, VT). The best solution (the best candidate operator, the “winner”) is then that for which the correspondence between the properties of the signals transformed by this best solution and the distinctive properties of the walking/running signals in the pedestrian frame is the best. It is seen that it is potentially useful to combine several distinctive properties, in such a way as to best estimate the unknown operator, limit the indeterminacy, and provide the most noise-insensitive estimator. We note that certain distinctive characteristics may be more difficult to observe than others. It is then not relevant to retain them in the criterion. Indeed according to the nature and performance of the sensors, the type of walking analyzed, certain distinctive characteristics will be easier or harder to identify on the signals, it is therefore appropriate for the person skilled in the art to choose them from the list, in order to build an effective estimator.
(58) It is therefore apparent that it is not at all obvious, as the prior art would lead one to think, that the direction of the trajectory of the pedestrian is given automatically merely by detecting the direction of a “powerful” translation motion signal. In an illustrative manner, we show that certain signals of significant power occur along the medio-lateral axis ML of the pedestrian, perpendicular to the direction of displacement of the pedestrian. It is possible to refer to
(59) In a mode of implementation of the invention, use is made of these distinctive characteristics of the motions tied to the thorax or to the pelvis of the pedestrian: the signals of the translation motions performed by the thorax or the pelvis of the pedestrian during a walking activity (generalizable to running) along the Vertical axis VT essentially exhibit power at the footstep period (also known as the “step cadency”), the signals of the translation motions performed by the thorax or the pelvis of the pedestrian during a walking activity (generalizable to running) along the Antero-Posterior axis AP essentially exhibit power at the footstep period (also known as the “step cadency”), and the signals of the translation motions performed by the thorax or the pelvis of the pedestrian during a walking activity (generalizable to running) along the Medio-Lateral axis ML essentially exhibit power at the stride frequency (also known as the “stride cadency”), and the stride frequency is half as large as the frequency of the footsteps and corresponds to the stride frequency.
(60) Moreover, it is also noted that the phase shift between the pedestrian's translation motion signals in relation to the Vertical VT and Antero-Posterior AP axes (both exhibiting one and the same characteristic of power essentially present at the footstep frequency) is close to π/2. This phase shift is therefore also a distinctive characteristic that we can introduce into the list of distinctive properties and therefore into an estimator or into a computation sequence for the unknown rotation operator.
(61) We note the following very significant element also. It is not necessary for the motion sensors to be placed directly on the chest, thorax or pelvis of the pedestrian. It is only necessary that, by a mechanical means, a sufficient portion (measurable by sensors) of these motion signals be transmitted to the housing. Thus, it will be noted that the translation motions of the chest of a pedestrian are transmitted to a sensor housing carried in the hand by the pedestrian in consultation mode for example. In this mode of carriage, the arm constitutes a mechanical element which transmits the motions of the chest to the hand and these motions can then be measured. The head is also a position wherein these properties are well transmitted. The case of hanging limbs (swinging arm when walking for example), legs constitute exceptions and the distinctive properties of the motions of the pelvis, chest must then be revised.
(62) When the pedestrian undertakes a walking or running activity, the set of characteristics representative of the pedestrian's chest translation motion signals represented in a pedestrian frame R.sub.P=(AP, ML, VT) defined by the pedestrian's Antero-Posterior AP, Medio-Lateral ML, and Vertical VT axes comprises: the signal due to the translation motion in relation to the Medio-Lateral axis ML essentially exhibits power at the stride rate; the signal due to the translation motion in relation to the Antero-Posterior axis AP essentially exhibits power at the footstep rate; the signal due to the translation motion in relation to the Vertical axis VT essentially exhibits power at the footstep rate; the signals due to the translation motions in relation to the Vertical axis VT and along the Antero-Posterior axis AP exhibit a substantially constant phase shift of close to π/2; and the footstep rate is substantially twice the stride rate.
(63) Moreover, other distinctive characteristics of the motion signals of the chest of the pedestrian P, this time in rotation, can be utilized. Just as the accelerometer constitutes a first simple and potentially low-cost choice for sensing the translation motions of a pedestrian, a gyrometer is then for example a good choice of sensor for rotation motion signals. Low-cost gyrometers make it possible to measure instantaneous rotation speeds and are suitable for sensing the rotation motions of the housing into which they are inserted.
(64) We then have the following complementary list of distinctive properties in the rotation motions of the chest or thorax or pelvis: the signal due to the rotation motion in relation to the Medio-Lateral axis ML essentially exhibits power at the footstep rate; the signal due to the rotation motion in relation to the Antero-Posterior axis AP essentially exhibits power at the stride rate; and the signal due to the rotation motion in relation to the Vertical axis VT essentially exhibits power at the stride rate.
(65) Thus, the set of distinctive characteristics of the motion signals of the chest of the pedestrian is bigger than the set of distinctive characteristics of the motion signals of translation alone. It is possible to add thereto a set of characteristics related to the rotation motions. It will be possible therefore to include in the process for computing the unknown orientation operator a combination of the distinctive translation and/or rotation characteristics, so as for example to improve the robustness of the estimator or its sensitivity to noise, to resolve indeterminacies.
(66) We also note that it is also possible to utilize a set of distinctive characteristics of the motions of a pedestrian that would be related to a dangling arm, for example. If the motion sensor is rather sensitive to the swinging motion of the arm, e.g. in the case of the sensor being carried in the hand and the arm being used swinging while walking or running, then it is possible to utilize the characteristics which follow.
(67) When the pedestrian undertakes a walking or running activity, the set of characteristics representative of the pedestrian's arm motion signals represented in a pedestrian frame (RP=(AP, ML, VT)) defined by the pedestrian's antero-posterior AP, medio-lateral ML, and vertical VT axes, comprises: the signal due to the translation motion in relation to the Antero-Posterior axis AP essentially exhibits power at the stride rate; the signal due to the translation motion in relation to the vertical axis VT essentially exhibits power at the footstep rate; the signal due to the translation motion in relation to the axis ML essentially exhibits power at the stride rate; the signal due to the rotation motion in relation to the medio-lateral axis ML essentially exhibits power at the stride rate; and the rotation signal due to the rotation motion in relation to the vertical axis VT essentially exhibits power at the stride rate, this property being characteristic of a swinging motion of the arm.
(68) Other distinctive characteristics can be added to the previous lists, to take account of the specific features of the motions of other parts of the body of a pedestrian. If the motion sensor is essentially marked by the motions of the chest or of a limb of the pedestrian, according to the nature of the measurement thereof (for example rotation or translation), it is necessary to utilize all or part of the corresponding subset of distinctive characteristics.
(69) The principle of the invention to utilize the existence of distinctive characteristics of the motions of a pedestrian in a walking/running situation has been set forth. It makes it possible to estimate the unknown rotation operator for rotating between the frame in which the motion signals are generated (on the basis of the sensors of a housing carried by the pedestrian) and the frame of the pedestrian R.sub.P. The frame of the pedestrian R.sub.p being equivalent to the trajectory frame R.sub.T, the rotation operator estimated by the invention therefore links the frame in which the motion signals are generated to the trajectory frame R.sub.T. The principle of estimating the unknown operator consists in computing, for a candidate operator, a criterion comparing the characteristics of the motion signals transformed by this candidate operator, and the distinctive characteristics of the motions of the pedestrian in the pedestrian frame R.sub.P. For a set of candidate operators, the best estimator will be that which exhibits the best criterion, i.e. which indeed makes it possible to retrieve the distinctive characteristics of the motions of a pedestrian in the pedestrian frame R.sub.P. The computation can be conducted analytically and/or by a computer which implements a criterion minimization procedure.
(70) Moreover the set of distinctive characteristics of the motions of a pedestrian can be composed of several elements and that thus, it was possible to introduce more information into our estimator. A larger quantity of information allows better estimation of the unknown rotation operator, with doubtless a higher cost of computation and potentially the need to integrate several types of sensors in the housing.
(71) We also note that several housings distributed at various places on the body of the pedestrian can collaborate and consolidate the pedestrian's trajectory orientation estimator. Indeed, a configuration that can commonly be envisaged is that the pedestrian is provided both with his smartphone and also with an additional accessory connected to the smartphone, such as interactive spectacles and/or an accessory carried or worn on the wrist, one and/or the other being equipped with motion sensors. Thus, the invention can apply to both items of equipment and deliver their estimated orientation of the trajectory of the pedestrian, by the method of the invention. The principle applies to multiple items of equipment. This multiple configuration is per se beneficial, since the information redundancy makes it possible to build a better orientation estimator by fusing the multiple estimations. The fusion procedure can be simple and for example combine the estimated multiples or estimations into an average. It is also possible to weight the estimated multiples for example considering a priori their reliability according to their position on the body. Thus, for an item of equipment of a priori fixed position on the pedestrian, such as spectacles placed on the head or a bracelet placed on the wrist, the estimator will be able to be considered to provide a greater reliability than that of an item of equipment which is a priori liable to change position on the body of the pedestrian, such as a smartphone. The weighting of the various estimators is then fixed a priori. We also note that the weighting may be dynamic, that is to say not fixed over time. Indeed, as is the subject matter of French patent application FR 1353616, filed, but not published, by applying a detector of change of position of the sensor housing on the pedestrian, for example by detecting variations of horizontally of the sensor housing, it is possible to weight the estimation dynamically over time. Indeed, during the transitions, the trajectory orientation estimator is presumed to be less reliable, since the estimator takes a certain time to converge.
(72) We propose here a particular embodiment of interest in numerous cases regularly encountered in practice.
(73) A rotation operator is completely determined by three parameters. In a previous paragraph we cited as determining parameters a rotation axis (therefore a unit vector with two independent parameters) and an angle of rotation about this axis. This is the way rotation transformation operators are represented according to the formalism of Quaternions. According to the equivalent formalism of Euler or Cardan angles, the rotation transformation operator is determined by three angles of rotation. It therefore possesses three degrees of freedom. In all the numerous possible representations of a rotation transformation operator, three independent parameters are necessary to fix the operator. It is then necessary to use a sufficient number of distinctive characteristics to correctly and uniquely determine these three degrees of freedom. The apposite set of distinctive characteristics is not always simple to determine. To simplify this estimation, it is proposed to utilize a horizontal reference frame tied to the Earth, and the signals arising from the sensor housing BC are expressed in this reference frame R.sub.R, before estimating the rotation operator Q.sub.RT. The reference frame then exhibits a vertical axis, and two horizontal axes. As the commonest pedestrian frame is (ML, AP, VT) which also exhibits a vertical axis and two horizontal axes, the unknown operator for transforming between the reference frame and the pedestrian frame is limited to a rotation with vertical axis. The problem is then equivalent to a problem with a single unknown angle, instead of three angles or three parameters in the general case. This mode of implementation is suitable for a large number of regularly encountered situations, such as those of a user of a smartphone, of interactive spectacles or of an accessory carried by the user, equipped with the sensors regularly encountered in this type of apparatus.
(74) By definition of the frame tied to the human body such as defined in
(75) Thus, the problem to be solved in order to determine the unknown orientation between the frame in which the motion signals are expressed and the pedestrian frame R.sub.p is to find the rotation transformation operator Q.sub.RT which transforms the signals frame into the pedestrian frame R.sub.P. It is readily noted straight away that this transformation operator must already transform the plane of the signals frame into a horizontal plane, since the pedestrian frame possesses a horizontal plane such as this, thereby determining two of the three unknowns of the rotation transformation operator. It is therefore practical to immediately express the motion signals in a horizontal frame, by virtue of a rotation transformation operator provided or estimated with the aid of the motion sensors. The remaining unknown operator is now merely a rotation transformation operator in relation to the vertical axis alone (i.e. an angle of heading) and it will then be possible to estimate it more readily by the principle of the invention. It will thus be possible to limit the distinctive characteristics to be utilized, reduce the uncertainty of the estimator.
(76) In a large number of situations, it is possible, on the basis of the sensors present in the housing BC carried by the pedestrian, to estimate the first operator which transforms the housing frame R.sub.B into a horizontal reference frame and to express therein the motion signals measured by the sensors of the housing BC. Indeed inertial sensors commonly present in smartphones make it possible to compute the orientation of the housing BC in the terrestrial frame R.sub.R.
(77) The last unknown is then related to the orientation in terms of heading of the body of the pedestrian. This is precisely one of the applications of the invention, utilizing the distinctive characteristics of the motions of the body, consisting in retrieving the latter unknown angle.
(78) It is therefore advantageous to choose a reference frame tied to the Earth, in which the motion signals measured by the sensors of the housing BC are expressed.
(79) The motion sensors principally considered (such Accelerometers, Gyrometers and Magnetometers) provide three-dimensional measurement vectors. The sensors are rigidly tied to the sensor housing BC. It may therefore be considered that the sensors thus deliver their vector measurements in one and the same frame R.sub.B, tied to this housing BC, which is denoted R.sub.B. The person skilled in the art is aware of the procedures which make it possible to correct possible misalignments between the axes of the sensors proper and which thus provide the measurements of the sensors in this same, single housing frame R.sub.B.
(80) As mentioned previously, techniques are also known for providing the orientation of the housing BC in the reference frame R.sub.R thus determined, fixed with respect to the Earth and exhibiting a horizontal plane and a given heading. It should indeed be noted that the sensors A, G, M, conventionally present in smartphones, make it possible to construct an attitude platform (also known as an “Inertial Measurement Unit”) which, for example by a sensors data fusion technique, provides the orientation of the housing frame R.sub.B with respect to a reference frame R.sub.R tied to the Earth, that is to say the rotation transformation operator Q.sub.BR. Numerous combinations are possible between the sensors A, G, M in order to arrive at a satisfactory estimation of Q.sub.BR.
(81) The operator remaining to be estimated is then the operator Q.sub.RT which reduces to a rotation operator in relation to the Vertical axis VT. It is determined by a single angle, thereby considerably reducing the dimension of the space of possible solutions. Indeed, even in the case of a poorly optimized search, it will suffice to traverse the space of possible angles, this space being reduced to a single dimension, to form the corresponding rotation operator in relation to Z, compute the mismatch in the distinctive characteristics. The smallest mismatch makes it possible to select the unknown angle. The dimension of the search space is thus reduced from three to one dimension.
(82) We thereafter present in a detailed manner a particular mode of implementation of the invention, which utilizes this particular feature.
(83) The present invention can be applied to any location problem, be it indoors or outdoors. For certain particular cases, for which a location solution would be sought in places in motion with respect to the terrestrial frame, such as a ship, the present invention would still apply, a person skilled in the art would be able to apply a correction angle so as to reorient the map of the place moving in the terrestrial reference frame if need be.
(84) The input of the method is a three-axis motion signal provided by a three-axis accelerometer, a three-axis magnetometer, or a three-axis gyrometer. The invention can be applied to each of these three sensors, or to a combination of these sensors. When a motion signal related to the acceleration of a body is sought, the best sensor to choose is an acceleration sensor. When a motion signal related to the rotation of a body is sought, it is possible to choose a gyrometer or a magnetometer. The method of the invention applies whatever choice is made. In order to better evaluate the unknown angle of rotation, it is possible to envisage using a combination of sensors A, G, M.
(85) On the basis of the signals of the sensor housing BC, the orientation Q.sub.BR of the sensor housing BC in the terrestrial reference frame R.sub.R is estimated for example by a method of inertial platform type. The reference frame thus chosen is tied to the Earth. It exhibits a horizontal plane formed by the axes XR and YR, the axis ZR being vertical. The unknown transformation operator Q.sub.RT for transforming between such a reference frame R.sub.R and the trajectory frame R.sub.T (that it will be recalled is equivalent to the pedestrian frame R.sub.p and is taken here equal to the pedestrian frame R.sub.p) is then restricted a rotation operator in relation to the vertical axis. Known techniques of the prior art make it possible to estimate the orientation of the sensor housing BC in a reference frame R.sub.R on the basis of a combination of inertial sensors, such as accelerometers which easily provide information related to the roll and pitch angles in the terrestrial reference frame, Gyrometers which provide the rotation speeds of the sensor housing, magnetometers which measure the magnetic field of the Earth and make it possible to determine a heading of the sensor housing with respect to the North of the Earth. Depending on the class of sensors used, it will advantageously be possible to implement Gyrometer only solutions, Accelerometer-Gyrometer or Accelerometer-Gyrometer-Magnetometer solutions. We note that the definition of the heading of the reference frame R.sub.R can be chosen according to convenience. The trajectory orientation estimator which is the subject of the invention will then provide the heading of the trajectory with respect to the reference frame. Thus, a reference frame whose heading is known with respect to the conventions of the maps conventionally used for geographical charting will be advantageous. Maps are conventionally charted with respect to geographical North, hence a reference frame having a similar convention will advantageously be used.
(86) In the example of a smartphone, of an accessory, of interactive spectacles, the sensors present make it possible to estimate this housing orientation operator Q.sub.BR in the terrestrial reference frame. The software solutions for computing the operator are often also embedded. As is well known to a person skilled in the art, basing oneself solely on an accelerometer provides a noisy estimation for this operator since the accelerometers provide the sum of the gravity signals, which contain the useful signals for estimating the roll and pitch angles, and the inherent acceleration of the sensor housing, because of the trajectory of the sensor assembly, this acceleration component being considered to be noise for the best estimation of the roll and pitch angles. Moreover, the angle of heading of the reference frame may not be determined by a solution based only on the accelerometer.
(87) However, when the motion is periodic, it is possible to reduce the effect of the inherent acceleration by applying a low-pass filter to the data of the accelerometer and thus obtain a better estimation of the roll and pitch angles. Anyway, a solution based solely on an accelerometer does not provide any information about the angle of yaw, which remains unknown. Other procedures combining accelerometers and magnetometers offer the possibility of estimating the angle of yaw, always to the detriment of the sensitivity to the inherent acceleration and therefore requiring a certain cleaning by previously cited filters.
(88) A solution based on a gyrometer is also possible. The person skilled in the art is aware of the methods for computing an orientation on the basis of a gyrometer signal which delivers rotation speeds. This sensor makes it possible, by an integration procedure, to retrieve the orientation traversed from the first instant considered in the integration computation. If the orientation is known at the first instant of integration, then the absolute orientation of the sensor housing is known at each instant. In addition to the necessity to know an absolute orientation at a given instant, this method also exhibits limitations related to the class of the gyrometric sensor. Indeed, a sensor exhibiting defects of bias or of sensitivity may generate significant errors on output from the integration method. For example, the more poorly the bias is known, the faster will be the drift observed. Current sensors of “consumer” class exhibit drifts of the order of a few degrees per minute, thereby limiting the methods based solely on gyrometers with very short scenarios of use. Sensors of better class, which might be anticipated to become available at ever lower cost, exhibit drifts of the order of a few degrees for scenarios of the order of an hour. When a high-performance gyrometer is available, it alone makes it possible, depending on its performance, to compute the operator Q.sub.BR at each instant, on the basis of initially giving the orientation of the housing. Performance attitude platforms, independent of magnetic signals, of large accelerations, and fairly drift-free for time periods ranging from several tens of minutes to a few hours are thus available.
(89) The best combination comprises a combination of an accelerometer, magnetometer and gyrometer, which makes it possible to provide the complete orientation of the sensor housing in the terrestrial reference frame. Not only does it provide complete information regarding orientation, but it is insensitive to the inherent acceleration and to the effect of the angular drift of the gyrometer.
(90) Numerous techniques, such as those described in documents FR2934043, or FR2930335, or FR 1154915 can be applied to obtain the operator Q.sub.BR, and this invention can therefore be applied.
(91) It is now considered that one possesses sufficient information about the rotation operator Q.sub.BR linking the sensor housing to the terrestrial reference frame. This operator is completely defined. As described previously, the techniques known to the person skilled in the art are capable of providing this rotation operator Q.sub.BR. For the sake of clarity, it is considered in this part that the body's motion information is provided by the accelerometer of the sensor housing. As described previously, it is possible to apply the procedure which follows to the gyrometer signals or to the magnetometer signals or to a combination of A, G, M signals. As mentioned hereinabove, and used in this mode, the motion signal can be expressed in a terrestrial reference frame by virtue of the application of the operator Q.sub.BR and only an angle of rotation about the vertical axis is unknown and must be determined so as to pass from the reference frame to the pedestrian frame (or trajectory frame since they are equivalent). It is therefore possible to use just a limited subset of motion characteristics of the walking of the pedestrian to provide the unknown angle of heading of the pedestrian in the terrestrial reference frame, which is the unknown that we seek.
(92) In what follows, a mode is presented which counts on only a few characteristics of the translation motions of the chest of the body of a pedestrian undertaking a walking or running activity.
(93) We note in passing that when the pedestrian has stopped, it is no longer possible to estimate his heading insofar as the distinctive characteristics of the motions of the pedestrian are no longer visible. This does not constitute a problem insofar as specifically, the pedestrian is not moving. The heading information is then meaningless.
(94) On the basis of the three-measurement-axis accelerometer signals 3A provided in the sensor housing, and of the knowledge of the rotation transformation operator Q.sub.BR which provides the rotation between the frame of the sensor housing R.sub.B and the terrestrial reference frame R.sub.R, it is easily possible to compute the motion signals sensed by the accelerometer in the reference frame R.sub.R, one of whose axes named Z.sub.R is vertical (i.e. collinear with the gravity), the other axes X.sub.R and Y.sub.R therefore being in the horizontal plane. A natural reference frame is the North, East, Vertical terrestrial frame. The axis Z.sub.R being the vertical axis, the axis Y.sub.R can be considered to be the North direction. The axis X.sub.R is selected to define an orthonormal base (it is then said to be pointing East). We have therefore defined our terrestrial reference frame, the axis Z.sub.R of which is vertical, and the axis X.sub.R may be North, the axis Y.sub.R then being East. We are then able to provide the acceleration signals initially provided in the frame R.sub.B of the sensor housing BC in this terrestrial frame, that is to say we obtain the acceleration AccX along the axis X.sub.R, the acceleration AccY along the axis Y.sub.R, and the acceleration AccV along the axis Z.sub.R which is equal to the vertical axis VT.
(95) In a preferred embodiment, this intermediate reference frame can be the terrestrial reference frame, defined by a “vertical” axis, a “North” axis and an “East” axis.
(96) The relevant step consists in obtaining motion information (in this instance the acceleration signals) in a frame, one of whose axes is vertical, therefore equal to the axis VT of the pedestrian frame R.sub.P. The inventive steps are then envisaged which provide the remaining unknown angle which makes it possible to obtain the remaining rotation operator Q.sub.RT for rotating from the reference frame R.sub.R to the pedestrian frame R.sub.P. Sensor signals are therefore considered which are provided in the terrestrial frame, one of whose axes is aligned with gravity Z.sub.R. Once again, it is considered that the pedestrian frame R.sub.P and the trajectory frame R.sub.T are equal, and therefore that the operators Q.sub.RT and Q.sub.RP are equal.
(97) A rotation in relation to a single axis linking the pedestrian frame R.sub.P to the reference terrestrial frame R.sub.R is now unknown but we know that it is a rotation about the vertical axis with an unknown angle that we will denote by θ. This angle θ is the angle of heading of the pedestrian in the terrestrial reference frame. Hence, finding θ makes it possible to solve the trajectory heading problem, which is an aim of the invention. The aim of the invention is now to provide an estimation of this unknown angle θ, so that the rotation operator relating the terrestrial reference frame and the pedestrian frame is completely defined.
(98) Recall that the method according to the invention is divided into three principal steps and uses the distinctive characteristics of the motion of the human body, as described previously.
(99) We present a complete computation method, also comprising the estimation of the pedestrian's walking rate. This information can be obtained in a different manner to that presented here according to different modes known to the person skilled in the art. The aim of the first step is to determine the footstep rate of the walking. In this first step, we have, as an intermediate step, the delivery of the principal frequency of the walking (that is to say, to be specific, the footstep frequency) of the walking or running activity. A preferred embodiment consists in estimating the footstep frequency using the motion signal in relation to the vertical axis and exhibiting the maximum power. Since here the aim is to estimate the footstep frequency, any other procedure is suitable for the following steps, as long as they provide the footstep frequency. The person skilled in the art is aware of numerous different procedures for computing the footstep frequency.
(100) Computing the footstep frequency on the basis of the vertical axis motion signal is a preferred embodiment. It is possible to estimate the footstep frequency by another method, by using another motion sensor, and/or by using the norm of the acceleration, or with the aid of another detection axis, to perform the estimation of the footstep frequency by using signals in the sensor frame. As seen previously, utilizing the vertical axis is advantageous since, when considering translation motions, one of the significant characteristics listed is that the translation signal in relation to the vertical axis essentially exhibits power at the footstep frequency, this being what we are seeking in this first step.
(101) Since the walking activity provides a footstep frequency generally in a limited passband width, it is possible to improve any method through a high-pass filtering, a low-pass filtering or a bandpass filtering which filters the motion signal in the passband of the footstep frequency. The conventional values for a walking activity are 1.0 Hz to 2.5 Hz. A person skilled in the art knows that there are several techniques for estimating the footstep frequency of a pedestrian on the basis of motion signals. It is for example possible to apply for example the technique of patent FR2942388. Time domain or frequency domain techniques may be applied.
(102) The advantage of a procedure based on the motion signal in relation to the vertical axis that we describe as an example, is that the motion signal exhibits the interesting property of having a maximum energy spike centered around the footstep frequency and, for example, of not being subject to the problem of mixing of the footstep frequency and of the stride frequency, thereby easing the processing to obtain a reliable and accurate estimation of the footstep frequency.
(103) In this first step, once the footstep frequency has been estimated, the second sub-step of the first step is to provide the amplitude, the energy or the power of the motion signals in relation to the axis X.sub.R and the axis Y.sub.R (i.e. the acceleration signals AccX and AccY) for the footstep frequency. It is easily possible to understand that the aim of this power estimation is to be able to match up the distinctive characteristics of the human gait which are that along the Antero-Posterior axis AP of the pedestrian frame R.sub.P, the signal of a translation motion exhibits a power spike at the footstep frequency, whereas on the Medio-Lateral axis, it does not exhibit any noticeable spike at this same frequency. For such power estimation, it is possible to use, for example, the output of the Fourier transform of the signals AccX and AccY for the footstep frequency. Other techniques can be applied, in the time domain for example. A person skilled in the art knows how to evaluate the amplitude, the energy or the power of the signals AccX and AccY for the footstep frequency. A narrow filter centered around the footstep rate frequency can be applied to the signals AccX and AccY, and the amplitude of the filtered signal can be computed to provide the result.
(104) In the numerous variants intended to estimate the power of the signal on AccX and AccY at the footstep rate, it is also possible to apply a matched filter to the signals AccX and AccY to estimate the power of the signal at the footstep frequency. This procedure deserves a short description since it is suitable for our case of a pedestrian. For this application, it is possible to choose the temporal signal in relation to AccV (that is to say in relation to the vertical) as impulse response of the matched filter. Indeed, it is known, as is listed in the list of distinctive characteristics of the motion signals of a pedestrian in a walking situation, that the acceleration signal in relation to the vertical component essentially exhibits power at the footstep frequency. It is also known that the signal in relation to the axis AP is essentially marked by power at the footstep frequency, and, interestingly, that this signal is phase-shifted from AccV by a constant value (about π/2). Consequently, taking the acceleration signal in relation to the vertical direction as impulse response of a matched filter makes it possible, by applying this filter to the signals AccX and AccY, to extract from these two components, the signal which is best correlated with AccV and thus to estimate the power, on AccX and AccY of the signal at the footstep rate.
(105) Once the power of the signal at the footstep frequency has been extracted from AccX and AccY, the second step provides the still unknown angle of rotation between the two-dimensional or 2D frame (X.sub.R, Y.sub.R), X.sub.R and Y.sub.R being the horizontal axes of the reference frame and the Medio-Lateral ML and Antero-Posterior AP axes of the pedestrian frame R.sub.P. This step is based on distinctive characteristics of the frequencies of the human walking activity, which is that the motion along the Medio-Lateral axis ML does not exhibit any footstep frequency (but a stride frequency signal), while the motion along the Antero-Posterior axis AP exhibits a footstep frequency signal (and not stride frequency signal). Thus the unknown angle makes it possible to transform AccX and AccY into the acceleration signals in relation to the axes AP and ML. This rotation transformation in relation to the vertical of angle θ must therefore be such that, after transformation, the entire power of acceleration signals at the walking rate lies solely along the axis AP.
(106) We could apply the same logic as in steps 1 and 2 while focusing on the stride frequency. We would then firstly seek, on the basis of an estimate of the stride rate (or stride frequency) the power of the signals in relation to AccX and AccY at this frequency. This frequency could simply be deduced from the footstep frequency by dividing the latter by a factor of 2, since the stride frequency is half the footstep frequency. We could then seek the power of the signal at the stride frequency thus determined for example by a frequency transform technique. Next, on the basis of the power values of the signals AccX and AccY, retrieve the angle which transforms AccX and AccY into AP and ML, by seeking this time that the power spike of the signal after transformation lies essentially along the axis ML obtained with the candidate angle, insofar as it is known that the power of the acceleration signal at the stride frequency lies essentially along the axis ML of a pedestrian.
(107) As noted, this second step provides the unknown rotation heading angle modulo π. We therefore obtain the direction of the axis AP, or direction of walking of the pedestrian. On completion of the second step, we cannot yet find the sense of the Antero-Posterior axis AP, which is positive or negative, implying that we do not know the sense in which the pedestrian is moving. Therefore, it is not possible to determine whether the pedestrian is going in one direction or the opposite direction, thus leaving two possible solutions. With this lone distinctive characteristic of the walking motion, we always have a heading solution which is under-determined to within π.
(108) With this lone distinctive characteristic of the human walking motion, we always have an under-determined solution.
(109) The third step provides the selection of the sense and removes the indeterminacy of the modulo π, of the passage from the frame (ML, AP) to the frame (X.sub.R, Y.sub.R) on the basis of the analysis of the distinctive characteristic of phase shift between the signals of the accelerometer along the Antero-Posterior AP and vertical VT axes which is π/2.
(110) The overall block diagram of an embodiment of the invention is represented in
(111) It is pointed out that it is easily possible to modify the solution presented here in detail so as to exploit the other distinctive characteristics of human walking, such as the presence of a power spike on the Medio-Lateral axis ML at the stride frequency and no power spike at the stride frequency on the Antero-Posterior axis AP. This is a direct extension of the detailed solution presented here. It is also possible to use the same characteristics, in a different order or according to procedures equivalent to that described.
(112)
(113) In the subsequent description, we present details of implementation of the solution presented above, according to the block diagram of the processing presented in
(114) Herein follows the detailed description of the first step (frequency analysis).
(115) As presented above, we concentrate on the characteristic of the translation signals (measured here with an accelerometer) which essentially exhibit, along the Vertical VT and Antero-Posterior AP axes, power at the footstep frequency, whereas this frequency is absent along the Medio-Lateral axis ML. A detailed mode of obtaining the footstep frequency on the basis of the acceleration signal in relation to the Vertical axis VT is presented, and the computation of the power of the signal in relation to the horizontal axes AccX and AccY is presented.
(116) The principal frequency of the motion signals in relation to the Vertical axes VT (R.sub.z) is firstly computed. To compute this frequency, it is possible to compute the DFT (discrete Fourier transform) on the motion signals in relation to the Vertical axis VT in the frequency span corresponding to the span of walking frequencies (for example 1 Hz-2.5 Hz). An index corresponding to the power frequency (or frequency of maximum amplitude) is obtained. Thereafter, for this index, the DFT of the acceleration signals AccX and AccY is computed, these representing the amplitude at the walking frequency (here the footstep frequency). To compute these discrete Fourier transforms or DFTs, it is firstly necessary to choose the size of the time window and of the signals sampling frequency. The person skilled in the art knows how to select the size of the time window, the signals sampling frequency, the precise computational mode. However, by way of example, we present an applied method, and this will allow the person skilled in the art to apply variants with a solid basis of comparison.
(117) Accordingly, the maximum frequency considered is 2.5 Hz, and Shannon's theorem gives a minimum sampling frequency of 5 Hz. In practice, we choose a sampling frequency greater than this frequency, for example a sampling period of 20 Hz.
F.sub.e=20 Hz (1)
The minimum frequency that it is desired to distinguish is half the minimum footstep frequency (0.5 Hz), corresponding to the minimum frequency of the acceleration signal in relation to the Medio-Lateral axis ML. Thus, the time window used for the analysis of the frequency must contain at least one signal period of this minimum frequency.
Window=2s (2)
The Fourier transform computations are implemented so as to extract firstly the value of the footstep frequency on the basis of the acceleration signal in relation to the vertical axis, and then secondly, the power (or amplitude) of the acceleration signals in relation to the horizontal axes for this footstep frequency. We note that the proposed procedure is one of the numerous possible procedures. The illustration implementing a Fourier transform is particularly simple to understand, since it is an operator known to the person skilled in the art. Other techniques, for example based on an AutoRegressive model (AR) of the signal, or on matched filtering, make it possible to achieve the same ends. The objective is to extract the two powers of the horizontal acceleration signals at the footstep frequency, so as thereafter to apply the distinctive characteristic of the translation motions of the chest, thorax, or pelvis of a pedestrian, along the Antero-Posterior AP and Medio-Lateral ML axes. The Fourier transforms or DFTs do not need to be computed for all the frequencies, thereby considerably lightening the computations.
(118) A procedure is presented here which makes it possible to compute in a recursive manner a particular element of the DFT, which is given by the following formula:
(119)
in which: x.sub.k represents the samples of the signal to be analyzed; n represents the number of samples in a time window (in this instance 40); and j represents a discrete frequency index defined by:
(120)
(121) The direct computation of a DFT element requires n−1 complex products and n complex additions. Furthermore, the DFT is computed over a sliding window, by proposing the recursive DFT computation:
(122)
(123) This recursive version of the DFT requires two complex products and of two complex sums. This is more optimized than the FFT algorithm when the computation is done on a sliding window and for a small number of frequency indices. On the Vertical axis VT, it is necessary to compute DFTj for j varying from 2 to 5, corresponding to the frequency interval from 1 Hz to 2.5 Hz (equation (4)). Thereafter, the maximum of these 4 DFT values is found so as to get the index jw corresponding to the walking frequency.
(124) For the axes X and Y, it is only necessary to compute DFTj.sub.W. Two ways of computing this DFT are proposed: 1. Recursively compute DFTj for j=2, . . . , 5 by means of equation (5) and then select the value corresponding to jw. 2. Recursively compute DFTj.sub.W by means of equation (5) each when j.sub.w(t+1)=j.sub.w(t) or compute DFTj.sub.W by means of equation (3) when j.sub.w(t+1)≠j.sub.w(t).
(125) The choice of procedure depends on the variation of j.sub.w, if j.sub.w varies a lot (more than once a second), it is necessary to choose the first computation procedure, otherwise the second. In this instance, the second is chosen.
(126) In a preferred embodiment of the second step of computing the unknown angle of rotation, we use the fact that once we have computed the powers or amplitudes of the acceleration signals AccX and AccY in relation to the two horizontal axes, at the footstep frequency, i.e. DFTx(idx) and DFTy(idx), it is necessary to apply the principle of the invention so as to retrieve the angle by which it is necessary to effect a rotation of the frame with axes X.sub.R,Y.sub.R in such a way as to retrieve the pedestrian frame, defined by the axes ML and AP, in which the distinctive characteristic is expressed.
(127) To express the unknown angle of rotation, the following step of the method consists in computing the angle of rotation between the 2D frame formed of the axes X.sub.R and Y.sub.R and the frame formed of the axes ML and AP. These two frames are represented in
(128) Equation (6) provides the rotation transformation in relation to the vertical axis of the amplitude values of the acceleration signals on the basis of the reference frame in which the estimation of the amplitude in the pedestrian frame is obtained. It may be said that the rotation matrix thus formed with the angle θ represents the candidate operator. If the candidate operator is appropriate then:
(129)
(130) Indeed, to apply the distinctive characteristic due to the walking motion of the pedestrian, it is necessary to retrieve, through the transformation (6) applied to the doublet (DFTx(idx), DFTy(idx)), also denoted (DFTx.sub.jw, DFTy.sub.jw) with j.sub.w corresponding to the footstep frequency, that DFT.sub.AP is a maximum, whereas DFT.sub.ML is a minimum. In the example detailed, it is proposed to search for the angle of rotation which maximizes the value of DFT.sub.AP. It is shown thereafter that the search for this angle is possible with direct equations, hence, it is not necessary to deploy iterative procedures to search for the angle.
(131) Hence, we search for the rotation which maximizes the modulus of DFT.sub.AP.sub.
max.sub.θF(θ)=max.sub.θ∥DFTx.sub.jw sin(θ)+DFTy.sub.jw cos(θ)∥.sup.2 (7)
It is possible to find an analytical solution to equation (7). Other procedures are nonetheless possible. We present a mode of computation.
The following notation may be taken:
DFTx.sub.jw=a.sub.1+ib.sub.1,DFTy.sub.jw=a.sub.2+ib.sub.2 (8)
We insert equation (8) into equation (7), and obtain:
F(θ)=(a.sub.1 sin(θ)+a.sub.2 cos(θ)).sup.2+(b.sub.1 sin(θ)+b.sub.2 cos(θ)).sup.2 (9)
Solving equation (7) is equivalent to finding the solution of the following equation:
F′(θ)=A cos(θ)sin(θ)+B(cos.sup.2(θ)−sin.sup.2(θ))=0 (10)
in which:
A=a.sub.1.sup.2−a.sub.2.sup.2+b.sub.1.sup.2−b.sub.2.sup.2,B=a.sub.1a.sub.2+b.sub.1b.sub.2 (11)
Equation (10) is equivalent to:
(132)
This equation has two solutions for tan(θ), defined in equation (13), corresponding to the minimum and maximum of equation (9):
(133)
Hence, the two possible solutions of equation (7) are:
θ.sub.1=a tan(S.sub.1), or θ.sub.2=a tan(S.sub.2) (14)
(134) To find the appropriate solution, we evaluate DFT.sub.AP.sub.
(135) In addition to the walking heading, it is possible to compute a value of “confidence” of the heading computation thus determined. Indeed, to compute the heading, we maximize the power at the footstep frequency in relation to the axis AP. It is also possible to compute the residual power in relation to the axis ML. If the difference between these two values is large, i.e. greater than a threshold, we have confidence in the computed heading.
(136)
(137) Thus, we build a value lying between 0 and 1 which tends to 1 if the entire power indeed lies on the axis AP and which tends to 0 if the powers are distributed between the axis AP and the axis ML.
(138)
(139) In a preferred embodiment of the third step, this indeterminacy is removed. On completion of the precedence step, which uses the distinctive characteristic of the translation motions of the chest at the footstep frequency, the angle of heading is estimated to within modulo π. An indeterminacy therefore remains with regard to the sense of the pedestrian frame R.sub.P with respect to the reference frame R.sub.R (i.e. between walking forwards and walking backwards). To remove this indeterminacy, it is possible to introduce an additional characteristic, relating the phase mismatch (or delay) between the acceleration signals in relation to the vertical axis VT and in relation to the Antero-Posterior axis AP. According to this distinctive characteristic, due to the motion of a pedestrian in a walking or running situation, the phase shift must be close to π/2.
(140) The final heading angle is equal to the angle computed in the previous step e to within modulo π. To remove this uncertainty, we compute the phase shift ϕ between the DFT of the axis VT and of the axis AP.
ϕ=angle(DFT.sub.AP.sub.
(141) If the computed phase shift is close to π/2, we do not apply the correction to the angle, if it is close to 3π/2, a correction of π is applied to the angle. In practice, we compare ϕ with π in order to take a decision.
(142)
(143) In the examples which follow, the position of the sensor considered in the experiments, we present the results for which the orientation of the sensor housing tied to the position of the trajectory is known: hand, in consultation mode, portrait orientation, for which the orientation of the sensor is approximately equal to the heading of the trajectory, landscape orientation, for which the orientation of the sensor has a constant mismatch of 90° with the heading of the trajectory.
(144) The trajectory used for the experimentation is a rectangular path as represented in
(145) For the first test, the user is walking with his smartphone in the portrait orientation. Hence, the user is walking in the direction of the heading of the trajectory.
(146) As illustrated in
(147) Stated otherwise,
(148)
(149)
(150) In the following test, the user holds his smartphone in the landscape orientation. The smartphone is pointing toward the right. Thus, the shift between the smartphone trajectory and the heading of the trajectory provided by the invention must be 90 degrees, this being correct, as illustrated in
(151) The steps of the method described hereinabove can be carried out by one or more programmable processors executing a computer program to carry out the functions of the invention by acting on input data and by generating output data, in the device according to the invention.
(152) A computer program can be written in any programming language, such as compiled or interpreted languages, and the computer program can be deployed in any form, including in the guise of autonomous program or as a subprogram or function, or any other form appropriate for use in a computing environment.
(153) A computer program can be deployed to be executed on a computer or on several computers on a single site or on several distributed sites linked together by a communication network.