Method for reconstructing the map of an environment surrounding a wireless device and wireless device implementing such method

RE049189 · 2022-08-23

Assignee

Inventors

Cpc classification

International classification

Abstract

A method for reconstructing the map of an environment (20) surrounding a wireless device (100), the environment (20) being equipped with one or more radio frequency tags (1) set in a number dependent on the level of detail to be obtained in the reconstruction, the method including the steps of: receiving identification and localization data of the one or more radio frequency tags (1) over a wireless connection by at least one wireless receiver (3) of the wireless device (100); storing the identification and localization data of the one or more radio frequency tags (1) into a filing and/or storage component (5,6) by a processor (2) of the wireless device (100); and providing on an output component (7) of the wireless device (100) at least one map of the environment (20) built on the basis of the identification and localization data of the radio frequency tags (1).

Claims

1. A method for .Iadd.graphically .Iaddend.reconstructing .[.graphically.]. a map of an environment .[.surrounding.]. .Iadd.in .Iaddend.a wireless device.Iadd., the wireless device providing a graphic representation of the environment where the device is located without having previously obtained information about the environment.Iaddend., said environment .[.being equipped with a plurality of.]. .Iadd.comprising a plurality of complex environmental structures, each of the plurality of complex environmental structures comprising a physical structure being made of a plurality of simple elements each having a radio frequency tag associated therewith, the .Iaddend.radio frequency tags .Iadd.being .Iaddend.set in a number dependent on a level of detail to be obtained in said reconstruction, said device comprising: .[.at least one.]. .Iadd.a .Iaddend.wireless receiver .Iadd.other than a radio frequency tag reader .Iaddend.configured to receive identification and localization data of said radio frequency tags associated with .Iadd.the simple .Iaddend.elements present in said environment; .[.at least one.]. .Iadd.a .Iaddend.processor; .[.at least one.]. .Iadd.a .Iaddend.filing and/or storage component; .[.at least one.]. .Iadd.an .Iaddend.output component configured to provide visual information about said environment, said method comprising the steps of: receiving .Iadd.by said wireless receiver .Iaddend.identification and localization data .[.of said plurality of.]. .Iadd.for each of said .Iaddend.radio frequency tags available in said environment over a wireless connection.[.by said at least one wireless receiver.]., wherein said identification and localization data .Iadd.for each radio frequency tag .Iaddend.comprises .[.associated.]. information about .[.at least one.]. .Iadd.a location of the associated simple .Iaddend.element present in said environment and about an element type .[.thereof.]. .Iadd.of the associated simple element.Iaddend.; storing said identification and localization data .[.and said associated.]. .Iadd.for each of said radio frequency tags including the .Iaddend.information .[.of said one or more radio frequency tags.]. .Iadd.about the location and element type of each associated simple element .Iaddend.into said filing and/or storage component by said processor; providing on said output component at least one map of said environment, wherein the map is reconstructed by said processor .[.by.]. .Iadd.graphically .Iaddend.representing .[.graphically the environmental.]. .Iadd.said simple .Iaddend.elements .Iadd.of the environment .Iaddend.associated to said radio frequency tags based on .[.their position, associated element.]. .Iadd.the information about the location .Iaddend.and element type .Iadd.of each simple element.Iaddend., wherein .[.single.]. .Iadd.simple .Iaddend.elements belonging to the same .Iadd.element .Iaddend.type are characterized .Iadd.in said map .Iaddend.by the same graphic representation.Iadd.; wherein said identification and localization data comprises a different identifier for each simple element of the environment; .Iaddend. .[.and connected to other elements of the same type.]. .Iadd.wherein the simple elements pertaining to a same complex environmental structure are .Iaddend.individuated .Iadd.from the other simple elements .Iaddend.by a common identification datum .Iadd.within said identification and localization data.Iaddend., when pertaining to a complex environmental structure .Iadd.of the environment .Iaddend.made up of .Iadd.the .Iaddend.multiple .Iadd.simple .Iaddend.elements; .Iadd.wherein at least one of the plurality of complex environmental structures is rebuilt in the map by graphically connecting one to the other the graphic representations of the simple elements of the same element type individuated by said common identification datum according to a particular order indicated in said identification and localization data so as to produce a graphic representation of the corresponding physical structure;.Iaddend. wherein said identification and localization data are stored in .[.the.]. .Iadd.a .Iaddend.form of at least one table, and .[.that.]. .Iadd.wherein .Iaddend.in said at least one table there is at least one row for each of said radio frequency tags.[., and that in columns of said table are represented, either fully or partially,.]. .Iadd.and .Iaddend.at least the following fields belonging to said identification and localization data of said radio frequency tags.[.;.]. .Iadd.are represented in columns of said at least one table, either fully or partially:.Iaddend. univocal identifier of one of said radio frequency tags; coordinates, .[.in particular.]. .Iadd.comprising one or more of: .Iaddend.latitude, longitude, elevation, or geographical position.Iadd., .Iaddend.of .Iadd.said radio frequency tag associated with .Iaddend.one .Iadd.simple .Iaddend.element of said environment.[.associated with the radio frequency tag.].; .[.type of radio frequency tag defining at least one element.]. .Iadd.element type .Iaddend.present in said environment which the radio frequency tag is associated with.

2. A method according to claim 1, wherein said radio frequency tags are replaced or supplemented with QR codes, or bidimensional bar codes.

3. A method according to claim 2, wherein the values corresponding to the QR codes .Iadd.or to the bidimensional bar codes.Iaddend., learnt on the basis of a signalling available in said environment, are entered manually by the user of the wireless device.

.[.4. A method according to claim 3, wherein said identification and localization data of a radio frequency tag comprise information about further elements of interest, different from one another but equally present in the reference environment..].

.[.5. A method according to claim 4, wherein said at least one table includes additional rows and/or columns containing information about said further elements of interest..].

.[.6. A method according to claim 1, wherein the elements of said complex environmental structure are connected to each other according to a particular order indicated in said associated information..].

7. A method according to claim 1, wherein said wireless device comprises a reader of radio frequency tags, configured to detect said radio frequency tags present within its own coverage range, the method further comprising .Iadd.the .Iaddend.step of.Iadd.: .Iaddend.receiving radio signals from at least one of said radio frequency tags, .[.of.]. estimating the position thereof through said .[.at least one.]. processor on the basis of the received radio signals, and .[.of.]. providing on said output component said estimated position within said map of said environment.

8. A method according to claim 1, wherein .[.the information.]. .Iadd.said identification and localization data .Iaddend.necessary for building said map has .[.the.]. .Iadd.an .Iaddend.order of magnitude of tens of bytes for each one of said radio frequency tags.

9. A wireless device comprising: .[.at least one.]. .Iadd.the .Iaddend.wireless receiver .Iadd.used in claim 1.Iaddend.; .[.at least one.]. .Iadd.the .Iaddend.processor .Iadd.used in claim 1.Iaddend.; .[.at least one.]. .Iadd.the .Iaddend.filing and/or storage component .Iadd.used in claim 1.Iaddend.; .[.at least one.]. .Iadd.the .Iaddend.output component.[.,.]. .Iadd.used in claim 1; and .Iaddend. which are configured to implement said method .Iadd.steps carried out by said receiver, processor and said components .Iaddend.according to claim .[.3.]. .Iadd.1.Iaddend..

10. A device according to claim 9, wherein said output component comprises at least one display and/or at least one touch screen and/or an audio playback unit, and/or a tactile-stimulus production unit, configured to reproduce information about the .[.reference.]. environment on said map, respectively as a graphic, audio or tactile reproduction.

.[.11. A method for reconstructing graphically a map of an environment by an electronic device, starting from a table comprising a plurality of references to elements of interest of said environment, said device comprising: at least one processor; at least one filing and/or storage component; at least one output component configured to provide visual information about said environment, said method comprising the steps of: storing in said filing and/or storage component for each of said element of interest a row of said table comprising fields indicating identification and localization data, wherein said data comprises the position of the element in the environment and the indication of an element type; acquiring from said filing and/or storage component said identification and localization data of said plurality of elements of interests, and; providing on said output component at least one map of said environment, wherein the map is reconstructed by said processor by representing graphically the environmental elements of interest based on their position, associated element and element type and wherein single elements belonging to the same type are characterized by the same graphic representation and connected to other elements of the same type individuated by a common identification datum stored in said table, when pertaining to a complex environmental structure made up of multiple elements; wherein said identification and localization data are stored in the form of at least one table, and that in said at least one table there is at least one row for each of said radio frequency tags, and that in columns of said table are represented, either fully or partially, at least the following fields belonging to said identification and localization data of said radio frequency tags: univocal identifier of one of said radio frequency tags; coordinates, in particular latitude, longitude, elevation, or geographical position of one element of said environment associated with the radio frequency tag; type of radio frequency tag defining at least one element present in said environment which the radio frequency tag is associated with..].

.[.12. The method according to claim 11, wherein the elements of said complex environmental structure are connected to each other according to a particular order indicated in said data..].

.[.13. The method according to claim 11, wherein the actual distances of the environment represented by said map can be deduced from said localization data and are represented on the basis of a given scale, which scale can be resized by means of a specific command available on the device..].

.[.14. An electronic device comprising at least one processor; at least one filing and/or storage component; at least one output component, which are configured to implement the method according to claim 11..].

15. The method according to claim 1, wherein the actual distances of the environment represented by said map .[.can be.]. .Iadd.are .Iaddend.deduced from said localization data and are represented on the basis of a given scale, which scale .[.can be resized.]. .Iadd.is resizable .Iaddend.by means of a specific command available on the device.

16. The method according to claim 1, wherein the .Iadd.receiving by said .Iaddend.wireless receiver .[.is configured to receive.]. said identification and localization data .Iadd.is performed .Iaddend.in the part received in clear from a Wi-Fi access point.

.Iadd.17. A method according to claim 1, wherein the graphic representations of the simple elements of the rebuilt complex environmental structure are graphically connected together by lines so as to form a closed loop that graphically represents the corresponding physical structure..Iaddend.

.Iadd.18. A method according to claim 1, further comprising at least the following field belonging to said identification and localization data of said radio frequency tags being represented in a column of said at least one table: a type ID, which has a different value for each distinct complex environmental structure of the environment pertaining to the same type and a same value for each simple element pertaining to the same complex environmental structure to be represented on the map..Iaddend.

.Iadd.19. A method according to claim 1, wherein the plurality of simple elements for each complex environmental structure comprises at least three simple elements..Iaddend.

.Iadd.20. A wireless device comprising the wireless receiver, the processor, the filing and/or storage component and the output component of claim 1 being configured to jointly implement the method for graphically reconstructing a map of an environment according to claim 1, said environment being equipped with a plurality of radio frequency tags set in a number dependent on a level of detail to be obtained in said reconstruction; wherein said device further comprises a reader of radio frequency tags; said reader being configured to detect said radio frequency tags present within its own coverage range, said processor being configured to receive radio signals from at least one of said radio frequency tags by means of said reader, to estimate the position thereof on the basis of the received radio signals, and to provide on said output component said estimated position within said map of said environment..Iaddend.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

(1) The above objects will become more apparent from the following detailed description of a method for reconstructing the map of a surrounding environment and of a wireless device implementing such method, with particular reference to the annexed drawings, wherein:

(2) FIG. 1 is a block diagram showing the operation of a preferred embodiment of the device according to the invention;

(3) FIG. 2 shows the structure of a possible reference environment;

(4) FIG. 3 shows a possible arrangement of radio frequency tags in the reference environment of FIG. 2;

(5) FIG. 4 shows some values of a table of identification and localization data relating to the radio frequency tags of FIG. 3;

(6) FIG. 5 shows the current position of a wireless device according to the invention in the reference environment of FIG. 2.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

(7) As aforementioned, the object of the present invention is a method which, by using information about the radio frequency tags 1, in particular RFID tags, can provide an approximate map of the premises where a device 100 according to the present invention is located.

(8) In FIG. 1 one can see that said device 100, in order to be able to operate, comprises: at least one wireless reception means 3 for receiving data; at least one processing means 2, e.g. consisting of at least one CPU; at least one filing means 5 and/or one storage means 6; optionally, at least one reader 4 of radio frequency tags 1, for detecting and subsequently reading one or more radio frequency tags 1 arranged within a reference environment in accordance with a predefined layout; at least one output means, e.g. consisting of at least one display 7, for displaying the results, preferably as at least one map of said environment.

(9) It is also conceivable that the output means, instead of consisting of said display 7, consists of one or more different audio playback devices 8 or tactile-stimulus generators 9, which would make the map recognizable also to blind people.

(10) The processing means 2 receives, through the wireless reception means 3, identification and localization information about the radio frequency tags 1 via radio signals 16, and stores it into the storage means 6 and/or the filing means 5. Upon receiving a command from the processing means 2, the reader 4 of radio frequency tags 1 may optionally detect the presence of any radio frequency tags 1 within its own coverage range through radio signals 16 received by said reader 4 in a manner substantially known in the art.

(11) Then the processing means 2 updates the storage means 6 that contains the data for localization of the radio frequency tags 1, and subsequently it processes the localization data of the radio frequency tags 1 in the storage means 6 and outputs an updated map through the output means, e.g. by displaying it on the display 7 (or equivalent), possibly also indicating the current position.

(12) The above-described operating cycle is carried out repeatedly, so as to allow for constant updating of the map being displayed as the user of the wireless device 100 is moving.

(13) The data received through the wireless reception means 3 can be stored, for example, in the form of a table like the one shown in FIG. 4, wherein the number of rows and fields corresponds to the number of described radio frequency tags 1, the columns showing all or some of the following pieces of information: univocal identifier of the radio frequency tag 1; coordinates of the position of the device (latitude, longitude), or its three-dimensional position relative to a given geographical point; floor number; type of radio frequency tag 1 (perimeter, door, window, room, corridor); area identifier.

(14) It should not however be excluded that other rather different elements of interest present in the environment may also be included as references, such as: lifts, ramps, fire extinguishers, power outlets, trap doors, radiators, boilers, air intakes, and the like. For example, the display 7 may show symbols indicating the single radio frequency tags 1, in particular: different types of radio frequency tags 1 are characterized by different symbols; in some cases, the information may be arranged in a particular order, so as to provide a sorted sequence of steps (e.g. radio frequency tags 1 for a corridor may be identified in a predetermined order that allows reconstructing a sequence of linear steps; likewise, radio frequency tags 1 of a perimeter of a certain area may be represented by means of a continuous line going through them in an orderly manner); radio frequency identifiers 1 belonging to the same logic geographical unit or to a more complex environmental structure made up of multiple elements (e.g. doors and windows afferent to the same room, or rooms belonging to the same department or office) are characterized by a common identification datum which allows to group them and to represent them within the area involved; the actual distances, which can be deduced from the coordinate indication, are represented on the basis of a given scale such that they appear as realistic as possible, which scale may be resized by means of a specific command available on the device (e.g. buttons 10 or on-screen commands 7).

(15) The devices capable of efficiently implementing the method described herein may be of different types, such as: mobile devices (e.g. smartphones), comprising a display 7 (possibly, but not necessarily, a touch screen 9), a reader 4 of radio frequency tags 1 and/or an optical sensor 11, a wireless reception means 3, a processor 2, a storage means 6 and/or a filing means 5, as well as possible further components such as buttons 10 or audio playback devices 8; devices for blind users, comprising button or voice commands 10, an audible-signal generator 8 or a tactile-stimulus generator 9, a reader 4 of radio frequency tags and/or an optical sensor 11, a wireless reception means 3 equipped with a processor 2, a storage means 6 and a filing means 5.

(16) Any different configurations of said device 100 observing the same principle of operation as the above-described preferred embodiments will still fall within the protection scope of the present invention.

(17) The information about the radio frequency tags 1 may be transmitted by suitable apparatuses 14 through any radio protocol, and is such that it can be received and interpreted by the wireless device 100 through the radio signals 18. Preferably, the information can be transmitted through a Wi-Fi network protocol, i.e. according to any standard of the IEEE 802.11 set. In particular, it is advantageous to transmit said information in the part transmitted in clear by any Wi-Fi access point, e.g. in the Wi-Fi beacon, so that any wireless device adapted to receive Wi-Fi signals can interpret it without any limitation due to the information security provided by these standards. It will thus be possible to use 35 existing Wi-Fi networks already in use in public buildings to transmit orientation information without interfering with secure information used by authorized users having access to said networks.

(18) FIG. 2 shows one possible reference environment 20 consisting of a floor of a building, comprising perimeter walls, partition walls, windows, doors and rooms.

(19) FIG. 3 shows one possible arrangement of radio frequency tags 1 in the environment 20 shown in FIG. 2. In particular, by way of example, there are radio frequency tags 1 on doors, windows, corners of perimeter walls, and ceilings of rooms and corridors. This creates a grid of points in the environment, which allows a wireless device 100 located in the reference environment 20 to acquire information about the most significant elements present therein (rooms, corridors, passageways, escapes etc.) and to reconstruct a representation of a map of the environment that will help the user orientate him/herself.

(20) FIG. 4 shows one possible table built by the processing means 2 based on the identification and localization data stored in the storage means 5 and/or contained in the filing means 6. Each row corresponds to at least one radio frequency tag 1 and comprises a univocal identifier (Tag ID), data about its geographical position (Latitude, Longitude and Elevation), information about the type of element of the reference environment 20 associated with the radio frequency tag 1 (e.g. Perimeter, Door, Room, Window), about the identification of said element (Room ID, Corridor ID, Perimeter ID) and about the position thereof within the environment 20 (e.g. Floor, Wing, Department, Section).

(21) FIG. 5 shows one possible graphic representation of the environment map that can be obtained by the wireless device 100 by starting from the data contained in the table of FIG. 4; in this representation, the radio frequency tags 1 mentioned in said table have been highlighted by way of example. It roughly indicates the profile defined by the perimeter walls, the position of windows and doors, as well as the area, approximated by defect, taken up by the rooms 52, 53, 54, 55, 56, 57, 58, wherein the associated radio frequency tags 1 (of door, window and ceiling) are characterized by the same room identifier (Room ID in FIG. 4).

(22) For example, the area 54 of FIG. 5 is approximately defined by the region that includes all those radio frequency tags 1 whose Room ID is 5.

(23) The corridor radio frequency tags 1 in FIG. 5 indicate the area occupied by the corridor and may advantageously be associated with a sorted sequence, so as to indicate to the wireless device 100 a path to be followed in order to reach an escape or an emergency exit. Likewise, a sorted sequence may be associated with other types of radio frequency tags, e.g. the perimeter ones, to indicate to the wireless device 100 how to trace the profile of the perimeter walls for the purpose of obtaining a correct graphic representation, which can be done by drawing a line consecutively joining the various points (e.g. the points of a corridor that winds across the building, or of the perimetric profile of the building).

(24) In order to avoid adding a field specifically dedicated to said sorted sequence, the latter may be implicitly indicated through a suitable selection or structure of the radio frequency tag (Tag ID), which may take appropriately increasing or decreasing numerical values to indicate that order.

(25) If the wireless device 100 is equipped with a reader 4 of radio frequency tags, it receives radio signals 16 emitted by radio frequency tags sufficiently close to one another, which signals contain data about its geographical position and about the radio signal transmission power or other data useful for determining the distance travelled by them to reach a receiver. When radio signals 16 are received from at least three different radio frequency tags 1, the device 100 can establish its own position based on the knowledge of the position of the emitting radio frequency tags and of its own distance from such tags, which can be determined through the use of any known distance estimation technique by applying, according to the case, the known triangulation or multilateration system.

(26) In the example of FIG. 5 it is assumed that the wireless device 100 is located in the point 500 and is receiving radio signals 16 from the three radio frequency tags 1A, 1B e 1C. In this case, the device 100 can estimate its own position by starting from the knowledge of the positions of 1A, 1B and 1C, received through the radio signals emitted by them, and by estimating the distance from each of them based on said radio signals by using any known technique and by applying the triangulation system to the data thus obtained. In this way, the wireless device 100 can calculate its own position through the processing means 2 and can represent it in one way or another through an output means 7, e.g. graphically on a map screen as a suitable graphic symbol or through an audible message emitted by an audio player under the control of a voice synthesizer, which for example says to the user “You are in room 4 on the first floor”. When the map of the environment is reconstructed as a graphic representation, the actual distances (deduced from the analysis of the coordinates of the radio frequency tags 1) will be reduced according to a scale which is adequate for representing them on the display of the device (possibly resizable through a suitable command entered through a touch screen 7 or buttons 10).

(27) The map thus built will then be filled with the points indicating doors, windows, corridors, rooms, etc. Points sharing the same area identifier (room, corridor, perimeter) may be highlighted with a special stroke or colour, thus grouping them into one set.

(28) Aiming at limiting the number of applied radio frequency tags 1, and at reducing the quantity of information transmitted to the device 100 through the Wi-Fi beacon, the radio frequency tags 1 relating to any internal partition walls in the environment will not be indicated: the resulting representation of the environment will have a certain degree of approximation, which will however be such as to ensure the perception of one's position with respect to the surrounding environment.

(29) If the device 100 is equipped with a compass, it will also be possible to indicate the directional orientation on the map.

(30) The choice pertaining to the arrangement of the radio frequency tags 1 within the environment can be made in such a way as to ensure an even coverage of the environmental areas which are considered to be of interest: said positions are then recorded and archived to be easily made available to the device 100.

(31) It is also conceivable that the device 100 has an internal logic which can give the user (whether graphically on the display 7 or by means of audible and/or tactile signals produced by suitable audible 8 or tactile 9 signal generators) information about the environment 20 where he/she currently is, such as the type and the position of elements belonging to said environment 20 and the direction to be followed in order to reach a certain destination, which can be selected, for example, through a touch screen 7, a voice command system or buttons 10.

(32) The advantage offered by the solution described herein is therefore apparent, in that this solution, in addition to what was already available from the prior art, adds the possibility of reconstructing, for example as a graphic representation, the approximate map of the environment 20 where a person is, the particular points of interest of which are highlighted in order to make it easier for the user to orientate him/herself in an unknown or unfamiliar place; furthermore, the radio frequency tags 1 employed may be passive ones, i.e. commercially available at low cost, and there may be a large number of them arranged in the environment as necessary.

(33) Another clear advantage derives from the fact that the map can be reconstructed by using a very small quantity of information (approx. ten bytes per radio frequency tag 1).

(34) Within the frame of a different implementation of the invention, it is also conceivable to replace or supplement the radio frequency tags 1 with simple QR codes or bidimensional bar codes 15, which can be easily read through the camera built in a common smartphone device: just like the radio frequency tags 1, said code can provide a simple univocal identifier.

(35) Finally, for simpler devices lacking a radio frequency tag reader 4 or a camera, it is possible to conceive a variant of the present invention which allows the user to manually enter the QR code 15, which he/she may have learnt from a signalling available in the reference environment.

(36) The method for reconstructing the map of an environment surrounding a wireless device and the wireless device implementing such method described herein by way of example may be subject to many possible variations without departing from the novelty spirit of the inventive idea; it is also clear that in the practical implementation of the invention the illustrated details may have different shapes or be replaced with other technically equivalent elements.

(37) It can therefore be easily understood that the present invention is not limited to a method for reconstructing the map of an environment surrounding a wireless device and a wireless device implementing such method, but may be subject to many modifications, improvements or replacements of equivalent parts and elements without departing from the novelty spirit of the inventive idea, as clearly specified in the following claims.