Guiding people using acoustic signals
10441495 ยท 2019-10-15
Assignee
Inventors
Cpc classification
G01C21/3629
PHYSICS
G09B21/003
PHYSICS
G01C21/3652
PHYSICS
G06F3/167
PHYSICS
A61H2201/5048
HUMAN NECESSITIES
International classification
Abstract
In order to guide a person along a path, audible acoustic signals are used, which are generated by signal generators arranged in an area. The person can orient themselves in the area using these acoustic signals. As the person moves along the path towards a destination, the signal generator arranged next in line on the path generates an acoustic signal, in which direction the person can then move. A signal generator generates an acoustic signal of this type, when it receives a control command from a mobile device carried with the person or from a control device.
Claims
1. A method for guiding a person in an area, in which a plurality of signal generators are arranged at specified locations, the method comprising: determining a current position of a mobile device in the area, wherein the current position is determined as a result of the mobile device communicating with a first signal generator or a control device; identifying a next signal generator which will be reached by the mobile device starting from the current position; sending a control command to the identified next signal generator, wherein the control command causes the identified next signal generator to generate a signal perceptible by the person; and wherein the mobile device communicating with the first signal generator includes a transmission to the first signal generator by the mobile device of a mobile device identification, wherein the first signal generator then communicates with a control device which determines a location of the mobile device to be associated with a location of the first signal generator.
2. The method according to claim 1, wherein the first signal generator communicating with the control device includes a transmission to the control device by the mobile device of its location as determined by the mobile device using a Global Positioning System (GPS) or Indoor Positioning System (IPS) system.
3. The method according to claim 2, in which the identification of the next signal generator is performed by the mobile device and the sending of the control command to the identified next signal generator is executed by the mobile device.
4. The method according to claim 1, in which the identification of the next signal generator is performed by the control device, and the sending of the control command to the identified next signal generator is executed by the control device.
5. The method according to claim 1, further comprising: based on the current position, generating at least one destination suggestion, wherein the at least one destination suggestion is reachable from the current position via a path; transmitting the at least one destination suggestion to the mobile device and receiving a selection of a particular destination from the mobile device; based on the particular destination selection, identifying a signal generator, which is arranged at the destination; and sending the control command to the signal generator arranged at the destination in order to generate the perceptible signal, using the signal generator.
6. The method according to claim 1, in which the signal generators and the mobile device are equipped with and communicate using Bluetooth technology.
7. The method according to claim 1, in which the generated signal is an acoustic signal.
8. A system for guiding a person in an area, comprising: a mobile device; a plurality of signal generators, which are arranged at fixed locations in the area, and a processor having a software program for guidance, which is executable in the processor, wherein in operation the processor: determines a current position of the mobile device in the area, wherein the current position is determined when the mobile device communicates with a first signal generator; identifies a next signal generator; which will be reached by the mobile device starting from the current position; sends a control command to the identified next signal generator, wherein the control command causes the identified next signal generator to generate a signal which is perceptible by the person; and wherein the mobile device communicating with the first signal generator includes a transmission to the first signal generator by the mobile device of a mobile device identification, wherein the first signal generator then communicates with a control device which determines a location of the mobile device to be associated with a location of the first signal generator.
9. The system according to claim 8, in which the processor is arranged in the mobile device.
10. The system according to claim 8, in which the processor is arranged in a control device.
11. The system according to claim 8, in which the signal generators are equipped with Bluetooth technology.
12. The system according to claim 8, wherein each signal generator has an assigned network address, and a control device determines an identity of a particular signal generator based on the signal generator's network address.
13. The system according to claim 8, wherein the mobile device communicating with the first signal generator includes a transmission to a control device by the mobile device of its location as determined by the mobile device using a Global Positioning System (GPS) or Indoor Positioning System (IPS) system.
14. A system for guiding a person in an area, comprising: a mobile device; a plurality of signal generators, which are arranged at fixed locations in the area, and a processor having a software program for guidance, which is executable in the processor, wherein in operation the processor: determines a current position of the mobile device in the area, wherein the current position is determined when the mobile device communicates with a first signal generator; identifies a next signal generator which will be reached by the mobile device starting from the current position; sends a control command to the identified next signal generator, wherein the control command causes the identified next signal generator to generate a signal which is perceptible by the person; and wherein the mobile device communicating with the first signal generator includes a transmission by the first signal generator of its identification to the mobile device, wherein the mobile device utilizes the first signal generator identification to determine a location of the first signal generator from a pre-stored list of locations and determines a location of the mobile device as being associated with the location of the first signal generator.
15. The system according to claim 14, in which the processor is arranged in the mobile device.
16. The system according to claim 14, in which the processor is arranged in a control device.
17. The system according to claim 14, in which the signal generators are equipped with Bluetooth technology.
18. The system according to claim 14, wherein each signal generator has an assigned network address, and a control device determines an identity of a particular signal generator based on the signal generator's network address.
19. The system according to claim 14, wherein the mobile device communicating with the first signal generator includes a transmission to a control device by the mobile device of its location as determined by the mobile device using a Global Positioning System (GPS) or Indoor Positioning System (IPS) system.
20. A method for guiding a person in an area, in which a plurality of signal generators are arranged at specified locations, the method comprising: determining a current position of a mobile device in the area, wherein the current position is determined as a result of the mobile device communicating with a first signal generator or a control device; identifying a next signal generator which will be reached by the mobile device starting from the current position; sending a control command to the identified next signal generator, wherein the control command causes the identified next signal generator to generate a signal perceptible by the person; and wherein the mobile device communicating with the first signal generator includes a transmission by the first signal generator of its identification to the mobile device, wherein the mobile device utilizes the first signal generator identification to determine a location of the first signal generator from a pre-stored list of locations and determine a location of the mobile device as being associated with the location of the first signal generator.
21. The method according to claim 20, wherein the first signal generator communicating with the control device includes a transmission to the control device by the mobile device of its location as determined by the mobile device using a Global Positioning System (GPS) or Indoor Positioning System (IPS) system.
22. The method according to claim 20, in which the identification of the next signal generator is performed by the mobile device and the sending of the control command to the identified next signal generator is executed by the mobile device.
23. The method according to claim 20, in which the identification of the next signal generator is performed by the control device, and the sending of the control command to the identified next signal generator is executed by the control device.
24. The method according to claim 20, further comprising: based on the current position, generating at least one destination suggestion, wherein the at least one destination suggestion is reachable from the current position via a path; transmitting the at least one destination suggestion to the mobile device and receiving a selection of a particular destination from the mobile device; based on the particular destination selection, identifying a signal generator, which is arranged at the destination; and sending the control command to the signal generator arranged at the destination in order to generate the perceptible signal, using the signal generator.
25. The method according to claim 20, in which the signal generators and the mobile device are equipped with and communicate using Bluetooth technology.
26. The method according to claim 20, in which the generated signal is an acoustic signal.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) Below, different aspects of the improved technology are described in greater detail on the basis of exemplary embodiments and in conjunction with the figures. In the figures, identical elements have the same reference numerals, wherein:
(2)
(3)
(4)
(5)
(6)
DETAILED DESCRIPTION OF EMBODIMENTS OF THE INVENTION
(7)
(8) In the exemplary situation shown in
(9) The path 8 can be specified in different ways. The person 2 can, for example, have the intention to go from a starting point to a (single) destination, possibly via one or more intermediate destinations or places of interest. In one exemplary embodiment, the person 2 can enter the desired destination on the mobile device 6 already at the starting location. The path 8 to the destination is thus specified before the person 2 begins to move along the path 8. In this case, the path 8 defines the route between the starting location and the destination. With knowledge of the starting location, the destination and associated mapping material (e.g. building plan, city map, etc.), the path 8 and associated guidance information can be determined, in order to guide the person 2 safely and efficiently to their destination. On the basis of a current location of the person 2 or a signal generator 4 which is present there, the next signal generator 4 along the path 8 is identified and is caused to generate a signal perceptible by the person 2. In one exemplary embodiment an audible acoustic signal is generated. This procedure is repeated automatically at each signal generator 4 located on the path 8 and without further action by the person 2, until they reach their destination.
(10) In another case, the person 2 does not specify a destination. Instead, they can select a destination at their current whereabouts. Based on the current whereabouts, the technology described here offers the person 2 possible destinations, from which the person 2 can select one. In this case, the path 8 consists of the route from the current location to the next destination, and the technology described here guides the person 2 along the path 8 to the next destination. If another destination is selected there, a new path 8 is determined.
(11)
(12) Applied to the situation of
(13) A similar situation can obtain, for example, in a building 1 with a plurality of adjacent offices 14 or workstations, or in a shopping centre with adjacent shops. If the person 2 is moving in this kind of environment, the mobile device 2 can indicate, for example, the names of the people working in the offices 14, or the names of the shops. The person 2, for example, inside or in front of an office 14 or shop, can choose which person or which shop they would like to reach.
(14) The signal generators 4 can be activated individually, in order to trigger the generation of a signal. To enable the activation, each signal generator 4 can be addressed via an individual identifier or address; for example, in one exemplary embodiment the mobile device 6 addresses a control command to the desired signal generator 4. Alternatively, in another exemplary embodiment each signal generator 4 is networked with a control device 17 (see
(15) Referring to
(16) In one exemplary embodiment, the mobile device 6, which the person 2 is carrying, is designed to receive data from a signal generator 4 (for example, its identification number or identifier), by means of which a current location of the mobile device 10 can be determined. The reception takes place in a contactless manner, for example by scanning an optical code (e.g. QR code, barcode, colour code) or establishing a wireless connection based on one of the known technologies for near-field communication (NFC), Wi-Fi Direct, RFID or Bluetooth.
(17) In another exemplary embodiment, the mobile device 6 has a facility for position determination, for example, a device for the Global Positioning System (GPS). For determining the position of the mobile device 6 it is also possible to use a positioning system for buildings, also known as an Indoor Positioning System (IPS). Such an IPS can be implemented by appropriately arranged local radio cells (e.g. WLAN nodes).
(18) In some of the exemplary embodiments described here, the position determination takes place by means of the signal generator 4. In these exemplary embodiments, the mobile device 6 is a Bluetooth-enabled smartphone, and the signal generators 4 are also similarly Bluetooth-enabled. Such a signal generator 4 is, therefore, designated hereafter as a beacon or as a Bluetooth beacon. The communication between the mobile device 6 (smartphone) and the beacons thus takes place in accordance with the Bluetooth standard, such as Bluetooth standard 4.0 (Bluetooth Low Energy (BLE)) or any other Bluetooth standard. Such beacons are usually battery-powered transmitters with low power consumption, which permanently broadcast a unique identification number (identifier) at short intervals of approximately one second in accordance with a specified transmission protocol. A beacon is addressable, for example by its MAC address (Media Access Control).
(19) As mentioned, a beacon always broadcasts the same data, for example its identification number (e.g. ID=5). If the mobile device 6 (with the Bluetooth function activated) is in radio range of the beacon, the mobile device 6 receives the broadcast data. The person skilled in the art will recognize that a plurality of mobile devices can be in radio range and that each of these mobile devices can then receive the data. These data can be used to determine that the mobile device 6 is currently located, for example, in the vicinity of the beacon with ID=5. Accordingly, no data is received when the mobile device 6 is located outside of the radio range again. The person skilled in the art will recognize that in one exemplary embodiment a pairing, well-known from Bluetooth technology, is not provided, for example because of the plurality of beacons distributed in the building 1 and any (one-time) visitors that may be present in the building 1. If it should be provided, however, it is assumed here that a first communicative contact (i.e. the pairing) between the mobile device 6 and the beacons has already occurred. During pairing the communication partners exchange identification data, so that they automatically recognize each other the next time.
(20) The capability of a beacon to be able to enter into a communicative connection with the mobile device 6, is illustrated in
(21) In another exemplary embodiment, a loudspeaker or buzzer can also be arranged separately from the beacon. The speaker or buzzer can be connected to the beacon either via a cable or wirelessly. If the Beacon receives a control command from the mobile device 6, the beacon activates the loudspeaker or buzzer in accordance with the control command.
(22) A beacon with a buzzer or loudspeaker not only broadcasts the identification number mentioned, but can also receive a control command addressed thereto. The beacon has an electronic circuit for receiving a corresponding radio signal for this purpose. A control command can, for example, cause the buzzer to activate in order to generate an acoustic signal.
(23) With the understanding of the described function of a beacon it is apparent that even a Bluetooth-enabled smartphone can be used as a kind of beacon, even if it cannot be considered a stationary beacon. The smartphone broadcasts its identifier at regular intervals, which can then be received by another Bluetooth-enabled device which is located within range. In one exemplary embodiment, the terminal 16 shown in
(24) In the exemplary embodiment shown in
(25) The communication system shown in
(26) In contrast to the signal generators 4 shown in
(27) If the current position, on the other hand, is to be determined by means of the location of the signal generator 4A, then in one embodiment the signal generator 4A can also be designed with a radio module (e.g. as a Bluetooth radio module), which communicates with the mobile device 6. As soon as a communicative connection is established between the radio module of the signal generator 4A and the mobile device 6, the signal generator 4A receives the ID of the mobile device 6 and transmits it in a message to the control device 17 over the network 11. The control device 17 has a processor, in which a software program for route guidance can be executed. The message may contain an address of the transmitting signal generator 4A and/or arrive at a signal input of the control device 17 provided for the transmitting signal generator 4A. The locations of the individual signal generators 4A are stored in the control device 17. With knowledge of the address and/or the signal input, the control device 17 can identify the transmitting signal generator 4A and determine its location. The control device 17 therefore knows that the mobile device 6 is located near the transmitting signal generator 4A.
(28) As a further function of the route guidance, the control unit 17 then determines the signal generator 4A, which is next along the path 8. The control device 17 then sends a control command to this signal generator 4A, either addressed to it or from a signal output that is specified for this signal generator 4A. In response to the control command, the signal generator 4A generates the signal.
(29) From the foregoing, the person skilled in the art will recognize that the technology for route guidance described here can be implemented either in the mobile device 6 (see
(30)
(31) The smartphone as an example of a mobile device 6 supports the person 2 during the guidance. Since the person 2 is visually impaired or blind and visual indications on a display 30 of the mobile device 6 may be poorly detected by the person 2 or not at all, the smartphone can be designed specifically for such handicaps. The smartphone can be designed, for example, in hardware and/or software (e.g. by means of a software application) for speech input and speech output, so that the person 2, for example with voice support, is guided through a menu and can make a desired selection and/or input by spoken commands. The mobile device 6 can, for example, detect a destination spoken by the person 2, process this and generate guidance information. As an illustration of examples of selection options
(32) With the understanding of the principal system components described above (mobile device 6, signal generator 4, signal generator 4A) and their functionalities, in the following a description of an example method for route guidance is given by reference to
(33) The mobile device 6 and the beacons are part of a system that supports the guidance of the person 2 along the path 8. In this system the mobile device 6 interacts with the beacons, wherein the individual identifier (e.g. ID=5) of a beacon is received by the mobile device 6. In a step S2, the current position of the mobile device 6 can thereby be determined. The mobile device 6 (or a software application installed thereon for route guidance (guidance app)) uses the received identifier of a beacon, to determine the location of this beacon and thus its own location. The identification can either be performed locally by the guidance app, or else by means of an access to a remotely arranged database initiated by the guidance app.
(34) In the case of local determination, the guidance app uses building plan information and data records that are stored in the mobile device 6 in the storage device 38. Each data record stores the location of a beacon together with its identifier. The number of such data records is equal to the number of beacons. The building plan information can be stored, for example, during the installation of the guidance app on the mobile device 6, so that it is already present when the person 2 inputs the destination. If the guidance app receives the identifier of the beacon, then it can then be used to determine the location of the beacon in the building 1 (e.g. ID=5 at access 22).
(35) In the case of determination by access to a remote database, the guidance app initiates an access to a database using a wireless connection. In this database the identifier is associated with data relating to a location at which this beacon is arranged. The database can be held in a storage system of a building management system, a storage system of a service provider or a storage system of the lift controller 18. When accessing the database, an identification parameter (e.g. telephone number and/or device ID code (Media Access Control (MAC) address)) of the mobile device 6 accessing the database can also be transmitted.
(36) The person skilled in the art will recognize that in another exemplary embodiment, the current position of the mobile device 6 can also be determined using one of the above-mentioned GPS and IPS systems.
(37) Irrespective of how and where the determination takes place, the guidance app sets the determined location in relation to the path 8. In one exemplary embodiment, the mobile device 6 can represent the path 8 graphically on a building plan. In addition, it can show the current location along the path 8 graphically on the building plan. The mobile device 6 can generate a corresponding voice message to communicate this information to the person 8, especially if their eyesight is severely impaired.
(38) With knowledge of the location of the beacon and, hence, of the mobile device 6, in a step S3 the guidance app determines the beacon that is next in sequence along the path 8. In a step S4 the guidance app generates a control command, which causes this beacon to generate an acoustic signal, for example by means of a buzzer. The nature of the signal can be defined by the person 2 using the guidance app, so that the person 2 detects his/her signal, even if multiple signals are generated in their environment for other guidance purposes. The person 2 hears this acoustic signal and can go in the direction of the beacon generating the acoustic signal. This process repeats itself along the way on the path 8 at each beacon located along the path 8, until the person 2 reaches their destination.
(39) In one exemplary embodiment, the acoustic signal can also comprise a warning signal or a voice message, for example, to warn of an obstacle. The voice message may also in some cases indicate the type of obstacle. As mentioned above, an obstacle can be either permanent or temporary.
(40) As is explained in detail elsewhere in this description, in one embodiment the person 2 orients themselves with the technology described here using the beacons, which generate an acoustic signal. The person skilled in the art will recognize, however, that information for the guidance can nevertheless also be transmitted to the person 2 by means of the mobile device 6. Depending on the degree of an existing visual impairment of the person 2, this information can be presented on the display 30, e.g. as text, graphical symbols (e.g. arrows), maps and/or pictures of places, communicated by means of speech or another mechanism, for example by means of a vibration of the mobile device 6. The guidance information informs or instructs the person 2, for example, where they should go next and/or how large the distance to the next waypoint is. If a lift 10 must be used, it can also be communicated to the person 2, for example, which elevator 10 must be used, when it arrives on a particular floor, and/or how long the waiting time is until an elevator cabin arrives. The person skilled in the art will also recognize that the guidance information can be communicated to the person 2 also by means of so-called smartwatches or other wearable devices (e.g. glasses with display and loudspeaker, possibly in conjunction with technology that allows the function of augmented reality).