Method and system of topological localization in a built environment

Abstract

A system and method of topological localization of a person or an object that is moved by one or more people in a built environment includes at least one sensor for detecting the movement of the person or object in that environment, configured to provide differential data over time; a transmission unit of differential movement information detected by the sensor mechanically coupled to the person or object; a reception unit of the differential movement information transmitted by the transmission unit; and a processing unit configured to perform an evaluation procedure of the differential movement information, which recognizes the presence of a voluntary movement activity as opposed to an involuntary movement, and, in the event of a voluntary movement activity, recognizes a path within the environment by comparing differential movement parameters, using models of execution of voluntary movement activities in a plurality of predefined paths within the same built environment.

Claims

1. A system of topological localization of a person or an object moved by one or more people in a built environment, the system comprising: at least one sensor for detecting a differential movements of the person or object in the built environment; at least one transmission unit of differential movement information detected by the sensor that is mechanically coupled to the person or object; at least one receiving unit of the differential movement information transmitted by the transmission unit; at least one processing unit comprising a program in which instructions for realizing a classification of the differential movement information as relating to a voluntary action of movement or to an involuntary action imposed by events extraneous to will are encoded, making the processing unit adapted to carry out out the classification, wherein the classification is provided in combination with a recognition of a path within the built environment by comparing differential movement parameters, including one or more of a speed of variation of a position, a duration of a change in the variation of position, a speed of change in direction, or a duration of the change of direction, with models for performing voluntary movement activities in a plurality of predefined paths in the built environment.

2. The system according to claim 1, wherein at least a corresponding set of one or more differential movement parameters are associated with the path in an appropriate sequence, including the speed of variation of the position along the path, or the duration of the variation of the position, the speed of change of direction along the path, or the duration of the change of direction.

3. The system according to claim 1, wherein models of execution of voluntary movement activities are customized due to a training or calibration step in which information is acquired on peculiarities of differential movement of the person or object moved by one or more persons whose position requires to be determined, corresponding to conditions of usual behaviour when moving along a specific path, a classification algorithm being available as inductive or deductive algorithm, including a computational model based on neural network or other approximation algorithms configured to execute training cycles during current use.

4. The system according to claim 1, wherein said at least one differential sensor is coupled to the person or object moved by one or more persons to be topologically located within the built environment, and wherein said at least one differential sensor includes a combination of one or more environmental and/or biometroc sensors selected among accelerometers, gyroscopes, magnetometers, or temperature, heart rate, or other biometric sensors.

5. The system according to claim 1, wherein the occurrence of movements is recognised by comparing a rate of change in position, the duration of the change in position, a rate of change in direction, or the duration of the change in direction from one or more of the sensors with one or more parameters, which include one or more threshold parameters or indicators.

6. The system according to claim 5, wherein a voluntary movement activity is recognized by analyzing data resulting from accelerometers, gyroscopes or magnetometers, or also from other sensors of differential nature based on similar principles by comparisons with models of execution of voluntary movement activities in a plurality of predefined paths in the built environment.

7. The system according to claim 1, wherein data resulting from sensors related to the rate of change in position, the duration of the change in position, the rate of change in direction, or the duration of the change in direction are analysed with inductive algorithms, based on recurrent neural networks, so as to detect voluntary movement activities.

8. The system according to claim 1, wherein the processing unit is configured to represent a topological map of the environment in which it is necessary to perform a topological localization process of a person or object moved by one or more persons, the topological map being made up of a set of points of interest corresponding to zones, areas, or rooms, and the system foreseeing an availability of differential movement information between different points of interest resulting from sensors associated with the person or object.

9. A method of topological localization of persons and objects moved by one or more persons in a built environment, each person or object being associated with at least one differential movement detection sensor of that person or object in said environment, comprising: (a) detecting differential motion by at least one sensor mechanically coupled to that person or object; (b) transmitting a signal containing such differential motion information; (c) receiving the signal emitted by a monitoring unit; (d) processing the differential movement information received; (e) recognizing a presence of a voluntary movement activity versus an involuntary movement based on one or more threshold parameters or indicators; (f) if there is a voluntary movement activity, recognizing a path within the built environment by comparing differential movement parameters, including the speed of variation of position, the duration of the variation in position, the speed of variation of the direction, or the duration of the variation in direction, using models of execution of voluntary movement activities in a plurality of predefined paths in the same built environment.

10. The method according to claim 9, further comprising a step of customizing execution patterns of voluntary movement activities through a learning or calibration phase, in which information is collected on particularities of differential movement of the person or object moved by one or more people whose topological location needs to be determined, corresponding to conditions of usual behavior in following a specific path, a classification algorithm being available as an inductive or deductive algorithm, including a computational model based on a neural network or other approximation configured to perform learning cycles during current use.

11. The method according claim 9, wherein the inductive algorithms use either internal environmental or external references, to perform tri-lateration or multi-lateration as in known systems, to improve accuracy of localization procedure.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0031] These and other characteristics and advantages of the present invention will become clearer from the following description of some executive examples illustrated in the attached drawings in which:

[0032] FIG. 1 shows four points of interest (PI) labeled PI0, PI1, PI2, PI3, within a map of a built environment with possible paths between them;

[0033] FIG. 2 shows the same map in which an intermediate PI (PI1) is highlighted, through which it is necessary to transit in order to carry out both the path from PI0 to PI2, and the reverse path from PI2 to PI0;

[0034] FIG. 3 shows an example of a conceptual scheme of the topological localization system object of the present invention, in which relevant functional blocks are highlighted with labels S1, S1′, S2, T3, R4, E5, A10 and A20;

[0035] FIG. 4 shows a variant of the diagram in FIG. 3 in which the use of an intermediate interface device, labeled I103, is envisaged, such as for example a smartwatch or similar wearable devices, between sensors and transmission units;

[0036] FIG. 5 shows a further communication architecture, in which possible instances of relevant functional modules are highlighted with the labels T3, R4, I103.

DETAILED DESCRIPTION OF EMBODIMENTS OF THE INVENTION

[0037] Before proceeding to the description of the system according to a possible embodiment of the invention, it is appropriate to introduce some definitions.

[0038] A “point of interest” (PI) means an area or an area or a room or similar within a built environment in which a person performs an activity that does not cause that person's position to change significantly, or in which there is an object not moved by any person. For simplicity, we can indicate with IPI the set of all points of interest in this environment. Each PI in the IPI can be assigned a consecutive integer identifier starting from zero, for example PI0, PI1, and so on.

[0039] With “path” (P) we mean any curve in space that joins two points of interest Ph and PE in IPI, with i and j distinct, and that satisfies the following properties:

[0040] (a) compliance with the structural constraints relating to the built environment in which the topological location process takes place, for which, for example, the curve cannot pass through walls or other structural obstacles between zones and/or areas and/or rooms;

[0041] (b) piecewise regularity, for which the curve has no cusp points or corner points according to the common definition;

[0042] (c) minimality of the length, for which given L the length of the curve and given LO the length of the ideal curve between Ph and PIj, such that the path of this ideal curve satisfies the properties referred to in points a) and b), it must be that the difference between L and LO must be less than an a priori definable threshold, such that the two distances are similar, as it is easy to observe how people tend to use an optimal path to reach a given PI, and in any case to move objects following this optimal path.

[0043] Given two points of interest PIi and PIj in IPI, with i and j distinct, it is possible to indicate with Pij the path that joins the point of interest PIi with the point of interest PE. It is also possible to indicate with IP the set of all paths defined as described among all the IPs in IPI relating to the built environment in which the topological localization process is defined. A possible representation of various points of interest and paths is shown in FIG. 1. Given two points of interest PIi and PE in IPI, with i and j distinct, it is assumed that there is always a path Pij that allows reaching PE starting from Phi.

[0044] There could be built environments in which, in order to reach a given point of interest PE in IPI starting from a given point of interest PIi in IPI, with i different from j, it is necessary to pass through another PIk in IPI, with different k from i and j, as highlighted in FIG. 2, and that therefore a path Pij in IP can be advantageously treated as the composition of two paths Pik and Pkj in IP. However, it is useful to distinguish the case in which PIk in IPI is a point of interest in which the person or object moved by one or more people settles for a certain time, or the case in which it corresponds to a simple point of occasional passage, and therefore the said Pij path must advantageously be considered distinct from the union of such Pik and Pkj.

[0045] Each P in IP can be assigned a consecutive integer identifier starting from zero, for example P0, P1, and so on. One possible way to do this is to list all the paths, sort them first by source, and then by destination.

[0046] Each path P in IP can be associated with at least a corresponding series of one or more differential movement parameters in a suitable sequence, such as the speed of variation of the position and/or the duration of this variation and/or the speed of variation of the direction and/or the duration of this variation.

[0047] By “voluntary movement activity” or “voluntary movement” is meant any instance of curve in space that corresponds to a path as defined above.

[0048] By “involuntary movement” we mean any instance of a curve in space that begins and ends in the same point of interest Ph in IPI, and which does not deviate significantly from it and in any case such as not to lead to a point of interest PE in IPI, with i and j distinct.

[0049] FIG. 3 illustrates an example of a possible scheme of the topological localization system object of the present invention. This system can comprise one or more sensors S1, S1′, S2, for detecting the differential movement of a person or of an object moved by one or more people, one or more units T3 for transmitting the differential movement information detected by the sensors S1, S1′, S2, a receiving unit R4 and a processing unit E5. In the specific example shown in the figure, sensors S1 and S1′ are associated with a first person or first object moved by one or more people A10 while the sensor S2 is associated with a second person or second object moved by one or more people A20. It is obviously possible to consider any number of people or objects moved by one or more people, each associated with any number of sensors. In a common case, the person or object moved by one or more people are the only ones associated with a single sensor.

[0050] Sensors of a differential nature can for example be accelerometers, gyroscopes, magnetometers, or sensors based on similar principles. If these sensors are mechanically coupled to a person, these can also be advantageously but optionally supported by sensors of different types such as for example temperature or heartbeat sensors, or other biometric sensors.

[0051] FIG. 4 shows a particular configuration of the system according to the present invention specific for a process of topological localization of a person in which there is a smartwatch or similar device I103 for the interface between the sensors S1, S1′, S2, and the smartphone or similar device T3, to facilitate the data collection operation.

[0052] In the figures, the connections between the various components are shown in dashed lines to highlight how it can be wireless communications of any kind where appropriate, such as GSM, Wi-Fi, Zigbee, Bluetooth, UWB, RFID. However, this does not exclude that at least part of them are based on physical cables, such as the connection between the R4 receiving unit and the E5 processing unit or between the sensors S1, S1′, S2, and the smartwatch or device. similar I103, and the smartphone or similar device T3, for example via USB, USB-C or HDMI.

[0053] An example of how the data can be collected to be processed is now described in the particular case of the configuration of the topological localization system shown in FIG. 4. The data acquisition is carried out through an algorithm that can be partially implemented on the smartwatch or device similar I103 and partly on the smartphone or similar device T3. A remote computer is used to collect information from all the devices used. The aforementioned algorithm can acquire data from sensors such as accelerometers, gyroscopes or magnetometers, or even from other sensors of a differential nature based on similar principles. Data of a different nature can also be acquired, such as those provided by temperature or heart rate sensors, or other biometric sensors. A particularly advantageous version of this algorithm can allow the simultaneous acquisition of data provided by sensors present on different devices, thus allowing to locate different people who can in turn also wear more than one device.

[0054] An example of a data communication protocol is now described in the particular case of the configuration shown in FIG. 4. In this example, the smartwatch or similar device I103 does not communicate directly with the R4 receiving unit, but with it via a smartphone or similar device. T3 according to the system architecture shown in FIG. 5. Specifically, this smartwatch or similar device I103 could record data and transmit them to this smartphone or similar device T3 using wireless communication of any kind, such as GSM, Wi-Fi, Zigbee, Bluetooth, UWB, RFID. The smartphone or similar device T3 can communicate the data generated by it and those that can arrive from all other smartwatches or similar devices connected to I103 to the R4 receiving unit. On the remote computer E5 there is an algorithm that, starting from the collected data, is able to:

[0055] (a) process the differential movement information received;

[0056] (b) recognize the presence of a voluntary movement activity as opposed to an involuntary movement;

[0057] (c) if there is a voluntary movement activity, recognize a path within the built environment by comparing differential movement parameters, such as the speed of variation of the position and/or the duration of this variation and/or the speed of variation of the direction and/or the duration of such variation, with models of execution of voluntary movement activities in a plurality of predefined paths in the same built environment, obtained for example by means of inductive algorithms.

[0058] In order to recognize the presence of voluntary movement activities, an advantageous implementation of such an algorithm could for example:

[0059] consider a priori as involuntary movements all instances of curves in which the speed of variation of the position and/or the duration of this variation and/or the speed of variation of the direction and/or the duration of this variation are lower than a parameter threshold W suitably defined;

[0060] consider a priori as involuntary movements all instances of curves shorter than a certain threshold parameter X suitably defined;

[0061] distinguish between voluntary movement and involuntary movement activities using data deriving from accelerometers, gyroscopes or magnetometers, or also from other sensors of a differential nature based on similar principles, for example by comparisons with models of performing differential movement activities in a plurality of predefined paths in the built environment, obtained for example by means of inductive algorithms;

[0062] in the case of a voluntary movement corresponding to a path Pij in IP, consider this Pij as a unique path and not in relation to any paths of the type Pik and Pkj, where k is distinct from i and j, and that the corresponding PIk in IPI corresponds to a simple occasional crossing point.

[0063] This advantageous implementation requires to appropriately define the threshold parameter W, the threshold parameter X, and the choice and/or design of an inductive algorithm for the creation of the models and for the recognition of voluntary versus involuntary movements.

[0064] By way of example, the inventors were able to observe how, as regards the threshold parameter W, the choice of an inappropriate value by default could cause the recognition of motion activities that do not exist in reality, even of significant duration, while a value not excessively appropriate could come to exclude voluntary movement activities characterized by reduced speed of variation of the position and/or the duration of this variation and/or the speed of variation of the direction and/or the duration of such variation.

[0065] Again by way of example, the inventors were also able to observe how, as regards parameter X, the choice of an inappropriate value by default could cause the separation of a voluntary movement activity into several movement activities in the event that there was a brief interruption of the movement, while the choice of an inappropriate value for excess could cause the recognition as a single activity of voluntary movement of two activities that are actually separate, particularly if the waiting times between an activity and a other were too short.

[0066] Again by way of example, the inventors were also able to observe how through the use of inductive algorithms, for example based on neural networks, and in particular recurrent neural networks, it is possible to recognize the paths of a person or a moved object. by one or more people in an environment built from the analysis of only the differential movement data of the person or object themselves provided by a magnetometer mechanically coupled to that person or object, without the need to use references, whether internal to the environment or external, with which to carry out the tri-lateration or multi-lateration as in known systems.

[0067] Again by way of example, the inventors were also able to observe how, if inductive algorithms are used, for example based on neural networks, and in particular recurrent neural networks, the result of this algorithm at a certain moment also depends on the result. of this algorithm in the previous states, a property that is interesting because a result, for example a right turn in a path Pij, with distinct i and j, obtained by analyzing the differential movement data, could be identifying a different path, for example Pik, with distinct iek and distinct jek, if a left or a right turn was previously detected.

[0068] Again by way of example, the inventors were also able to observe how, if inductive algorithms are used, for example based on neural networks, and in particular recurrent neural networks, the algorithm is able to identify paths with different lengths, given the fact that different paths between different points of interest are typically characterized by different lengths.

[0069] Again by way of example, the inventors have also been able to observe how such inductive algorithms can advantageously make use of additional internal or external references to the environment, with which to perform tri-lateration or multi-lateration as in known systems, despite such references are not necessary, to the greater advantage of the accuracy of the topological localization procedure.