System for Determining a Location of a User
20170123047 ยท 2017-05-04
Assignee
Inventors
Cpc classification
H04W64/00
ELECTRICITY
G01S2201/02
PHYSICS
International classification
G01S5/00
PHYSICS
Abstract
A system for determining a location of a user is provided that comprises a plurality of transmitters, each associated with a predefined physical location and each comprising a light source to provide an optical location signal; and at least one head-worn locator device with an optical receiver for receiving at least one of the optical location signals. To allow the determination of a location of a user that is wearing the head-worn locator device, each transmitter is configured to provide location information in the respectively provided optical location signal, wherein said location information corresponds to said predefined physical location of the respective transmitter.
Claims
1.-20. (canceled)
21. A system for determining a location of a user, comprising a plurality of transmitters, each associated with a predefined physical location and each comprising a light source to provide optical location signals; and a headset with at least a headband, an earphone audio driver, and an optical receiver, which headset is a head-worn locator device; wherein said optical receiver being arranged on the headband and being oriented, at least during use, substantially vertical for receiving at least one of the optical location signals; and wherein the transmitters are configured to provide location information in their respective optical location signal, wherein said location information corresponds to said predefined physical location of the respective transmitter.
22. The system according to claim 21, wherein said headset is additionally configured to provide audio feedback using the earphone audio driver, said audio feedback corresponding to the location information.
23. The system according to claim 22, wherein said audio feedback is provided upon the reception of location information.
24. The system according to claim 21, wherein said headset comprises a viewing direction detector to determine viewing information, comprising at least a horizontal viewing angle of the user.
25. The system according to claim 24, wherein said viewing information additionally comprises a vertical viewing angle of the user.
26. The system according to claim 24, wherein the headset is configured to determine refined physical location data from received location information and the determined viewing information.
27. The system according to claim 24, wherein said headset is additionally configured to provide audio feedback using the earphone audio driver corresponding to the determined viewing information.
28. The system according to claim 24, wherein the viewing direction detector comprises one or more secondary optical receivers.
29. The system according to claim 28, wherein the one or more secondary optical receivers are configured to receive optical location signals of one or more further transmitters.
30. The system according to claim 29, wherein said one or more further transmitters are horizontally aligned.
31. The system according to claim 29, wherein said one or more further transmitters are wall-, furniture- or shelf-mountable transmitters.
32. The system according to claim 21, wherein said headset additionally comprises a wireless communications interface and is configured to transmit at least the received location information to a mapping device.
33. The system according to claim 21, wherein said headset comprises mapping memory with mapping information and said headset is configured to determine the predefined physical location of at least one of the plurality of transmitters by comparing said received location information with said mapping information.
34. The system according to claim 21, wherein the headset is configured to receive two or more optical location signals simultaneously.
35. The system according to claim 34, wherein the headset is configured to determine an intermediate physical location from said two or more optical location signals.
36. The system according to claim 21, wherein the location information provided by the plurality of transmitters corresponds to their respective absolute physical locations.
37. The system according to claim 21, wherein the optical received is arranged substantially centered on the headband.
38. The system according to claim 21, wherein the headset is configured to transmit location information, received from one of or more of the plurality of transmitters, to a further device.
39. The system according to claim 38, wherein the further device is a mobile device.
40. A headset for use in a system for determining a location of a user, comprising at least a headband, an earphone audio driver, and an optical receiver which headset is a head-worn locator device; wherein said optical receiver being arranged on the headband and being oriented, at least during use, substantially vertical for receiving at least one optical location signal; said at least one optical location signal comprises location information, corresponding to a predefined physical location.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0011] In the drawings,
[0012]
[0013]
[0014]
[0015]
[0016]
[0017]
[0018]
[0019]
[0020]
[0021]
[0022]
[0023]
[0024]
[0025]
[0026]
[0027]
DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS
[0028] Technical features described in this application can be used to construct various embodiments of systems and methods for determining a location of a user according to the preceding and following description. Some embodiments of the invention are discussed so as to enable one skilled in the art to make and use the invention.
[0029] In the following explanation of the present invention according to the embodiments described, the terms connected to or connected with are used to indicate a data connection/transmission link between at least two components, devices, units, or modules. Such a connection may be direct between the respective components, devices, units, or modules or indirect, i.e. over intermediate components, devices, units, or modules. The connection may be permanent or temporary; wireless or conductor based.
[0030] For example, a connection may be provided over a WAN (wide area network), LAN (local area network), PAN (personal area network), comprising the Internet, Ethernet networks, cellular networks, Bluetooth networks, Zigbee networks, and/or Wi-Fi networks using a corresponding suitable communications protocol.
[0031] According to a first exemplary aspect, a system for determining a location of a user is provided, comprising a head-worn locator device and a plurality of transmitters.
[0032] The head-worn locator device comprises at least one optical receiver, configured to receive at least one optical location signal from at least one of the transmitters, i.e., when said head-worn locator device is in transmission range of the respective transmitter.
[0033] The head-worn locator device may be of any suitable type and may certainly comprise one or more additional components. The term head-worn locator device, also referred to as head mounted wearable locator device or head-wearable device, in this context is understood to refer to a device, which is configured to at least during use be worn on or attached to the user's head and/or neck.
[0034] For example, the head-worn locator device may be provided as or being integrated with a head mounted display, glasses, a hat, or a headset. It is noted that in the context of this application, the term headset comprises all types of headsets, headphones, and other head-worn audio devices, such as for example circumaural and supra-aural headphones, earbuds, in-ear headphones, and earphones. Head-worn devices provide an excellent reception of the optical location signal in particular in case of a ceiling-mount transmitter array, while allowing hands-free operation. In one embodiment, the head-worn device may be battery powered and at least during use cordless.
[0035] In the context of the present explanation, the term optical location signal is understood as providing optical communication using visible, infrared, and/or ultraviolet light. The terms location signal and optical communication are used herein interchangeably with optical location signal.
[0036] As discussed above, the head-worn locator device comprises the at least one optical receiver for receiving said optical location signal. The optical receiver may be of any suitable type and may be adapted to the requirements of the respective signal type of the location signal. For example, the optical receiver may comprise one or more photo detectors, photodiodes, and/or camera modules, adapted for the respective wavelength or wavelength range of the optical location signal.
[0037] In a one alternative or additional example, the optical location signal is a short-range signal, for example having a transmission/reception range of a maximum of 5 m from the respective transmitter.
[0038] Each transmitter of the system for determining a location of a user according to the present aspect is associated with a predefined physical location and comprises at least the light source to provide said optical location signal. The light source may be of any suitable type and may comprise one or more LEDs, lasers, incandescent lamps, halogen lamps, and/or other type of light generating device. The light source may emit visible, IR, and/or UV light. In one embodiment, the transmitter is formed integrally with a light fixture, such as a ceiling or wall light fixture.
[0039] It should be apparent that the light source of the transmitter should be configured to communicate with the receiver of the locator device, using an identical and/or at least compatible wavelength and signal type. In an embodiment, each transmitter comprises multiple light sources, wherein at least some of the light sources provide the optical location signal.
[0040] Each transmitter is configured to provide location information in the respectively emitted location signal. The location information is thus wirelessly provided to the head-worn locator device, when the latter is in transmission range of the signal of the respective transmitter. According to the present aspect, the location information transmitted corresponds to the predefined physical location of the associated transmitter and thus allows the head-worn locator device to determine the location of the user.
[0041] In the context of the present explanation, the term predefined physical location refers to a physical or geographical location of the respective transmitter. The predefined physical location may correspond to an absolute location, as identified by longitude, latitude, and/or elevation, correspond to a relative location, such as a defined position, relative to a reference, and/or correspond to a logically defined position, such as a room, building, section, or department, e.g., identified by a room number or department identifier. While multiple transmitters may be associated with the same predefined physical location, e.g., to provide redundancy, the predefined physical location of at least two of said plurality of transmitters differs from each other. In one embodiment, the predefined physical locations are quasi-unique, providing that at least in the respectively defined logical space of the system, such as the respective building or room, each predefined physical location is unique.
[0042] The transmitted location information may at least comprise said predefined physical location of the respective transmitter or correspond at least to said predefined physical location. In the latter case, the predefined physical location may be determined by the head-worn locator device from a location ID or code, transmitted in said optical location signal, using an internal or external lookup table, map, and/or database, as will be discussed in more detail in the following description.
[0043] The location information may be encoded in said location signal according to any analog or digital communications protocol, suitable for the respective transmission type. In one embodiment, the location information is digital location information and provided in said optical location signal using amplitude, phase, and/or frequency modulation. For example, on-off keying (OOK) may be used to provide the digital location information. In one additional embodiment and in case of an optical communication using visible light, the frequency of modulation is selected to be at least 60 Hz.
[0044] Using the transmitted location information, it is possible for the head-worn locator device to determine its location or position and thus the location or position of the user when she or he is wearing the locator device, even in areas without GPS reception, such as indoors. It is noted that the term location in this context may refer to a relative or an absolute location, as discussed in the preceding with reference to the term predefined physical location.
[0045] According to the present aspect, the system for determining a location of the user comprises at least a head-worn locator device and a plurality of transmitters. Certainly, the system may comprise more than one head-worn locator device, e.g., for locating multiple users. The number of transmitters in the system according to the present aspect can be selected according to the respective application. In general, the number will depend on the desired location resolution, i.e., the positioning accuracy or spatial resolution. It should be apparent that a higher number of transmitters typically results in a higher positioning accuracy than a lower number of transmitters.
[0046] The head-worn locator device and the transmitters may be of any suitable type and in particular comprise a computing device, having at least a processor with memory/storage comprising a suitable programming/software to provide at least part of the functionality discussed in the preceding and also in the following description. The software can include a kernel, operating system and/or a shell or interface. One or more application programs or modules may be loaded, i.e., transferred from storage into memory for execution by the processor of the respective device.
[0047] In one embodiment, the system is adapted for indoor operation, i.e., for indoor positioning/indoor location determination.
[0048] In another additional or alternative embodiment, the transmitters are fixed-location or fixed-position transmitters. For example, the transmitters may have a suitable mounting base for at least one of ceiling, wall, floor, and furniture fixation, such as, e.g., shelf mounting. In a further alternative or additional embodiment, the transmitters are formed integrally with a further device, such as a lighting unit, as will be explained in detail in the following description.
[0049] As discussed in the preceding, the number of transmitters in the system is not limited. In a typical embodiment, the system may comprise more than two transmitters and in particular more than 10 transmitters. In typical exemplary setups, the system may comprise tens or hundreds of transmitters, depending on the application and the desired positioning accuracy.
[0050] The positioning of the transmitters may be chosen according to the application. For example, in a typical office building one transmitter per room may provide sufficient results for many applications. Certainly, it is possible to increase the location resolution by decreasing the spacing of the transmitters. For example, it the above-mentioned office building setup, the transmitters may be arranged with a 1 m spacing for high resolution location detection.
[0051] In one embodiment, a plurality of transmitters is arranged in at least one array, e.g., in rows and/or columns. For example, the transmitters may be arranged in said array with a consistent or even spacing to each other, i.e., equidistant. It is noted that in additional embodiments, the system may comprise multiple arrays of transmitters, such as wall and/or ceiling arrays. Furthermore, the array(s) in additional embodiments may comprise all or some of the transmitters of the system. The system in the latter case comprises array-arranged transmitters and non array-arranged transmitters. At least one array may be a one-dimensional array.
[0052] In a further additional or alternative embodiment, at least one array is a two-dimensional array, arranged in a transmitter array plane. A two-dimensional array arrangement may, e.g., be useful for ceiling-mount or wall-mount applications, such as for office buildings. Correspondingly, the transmitter array plane may, e.g., be arranged horizontally or vertically. In another embodiment, the transmitters are configured so that the light sources emit substantially perpendicular to the transmitter array plane, along or parallel to a transmitter optical axis.
[0053] According to a further alternative or additional embodiment, the optical receiver of said head-worn locator device at least during use is aligned substantially with said transmitter optical axis, i.e., oriented substantially perpendicular to the transmitter array plane. The present embodiment allows to safely receive one of the optical location signals. It will be apparent that when using non-collimated light to emit the location signal, a cone of light is emitted by the light source of the respective transmitter. Accordingly, angular deviations of approx. 20 to 60 degrees between the transmitter optical axis of the light source and an optical axis of the receiver are possible.
[0054] In an exemplary horizontal ceiling-mount transmitter array arrangement, the light source and/or the optical receiver are oriented substantially vertically (e.g., +45). The two components thus are arranged facing each other, i.e., arranged for transmission and reception aligned with a vertical optical axis.
[0055] In an additional or alternative embodiment, the head-worn locator device is configured to provide audio feedback to the user upon the reception of location information, e.g., of the determined physical location and/or viewing information. The head-worn locator device may be configured to provide the audio feedback using a connected or integrated audio component, such as in the case of the head-worn locator device being formed integrally with a headset, using the corresponding headphones of the headset.
[0056] In one additional embodiment, said head-worn locator device additionally comprises a viewing direction detector to additionally determine viewing information of the user. The present embodiment allows, for example in a supermarket or department store environment, not only to determine the location of the user, e.g., the respective aisle and location along the aisle, but also the viewing direction and thus the respective shelf or product the user is looking at. It should be apparent that the determination of the viewing direction is based on the user wearing the locator device on his head. In the following, the term viewing direction is also is referred to as orientation with respect to the locator device, and horizontal viewing angle with respect to a reference axis, such as the North-South cardinal direction.
[0057] In one embodiment, the viewing information additionally comprises a vertical viewing angle of the user. In this embodiment, the viewing direction detector is additionally configured to determine said vertical viewing angle of the user with respect to a horizontal reference plane.
[0058] The viewing direction detector may be of any suitable type and may for example comprise a compass, a gyrocompass, an acceleration sensor, an inclinometer, and/or any other type of tilt/pan sensor to obtain the viewing information.
[0059] In another embodiment, the viewing direction detector determines the horizontal viewing angle from the optical receiver. For example, in case the receiver comprises a camera module, it is possible to obtain the orientation of the locator device and thus the horizontal viewing angle of the user by determining the relative positioning of multiple transmitters that are present in the field of view of the camera module. It should be apparent that, e.g., in case a first transmitter is on the left side of the field of view of the camera module and a second transmitter is on the right side of the field of view of the camera module, it is possible to determine the orientation if at least the positioning of both transmitters relative to each other are known. Higher resolution angles can be obtained by determining the detailed position of the transmitters in the camera's field of view.
[0060] Certainly, instead of the use of a camera module, determination of the orientation of the locator device is also possible in case the optical receiver comprises multiple photo detectors or photodiodes to receive signals from multiple transmitters at the same time.
[0061] In another alternative or additional embodiment, the viewing direction detector comprises one or more secondary optical receivers, configured to receive optical location signals of further transmitters, such as wall- or shelf-mounted transmitter. In one example, at least one of the secondary optical receivers is oriented or aligned along the user's viewing axis at least during use, i.e., when the user is wearing the head-worn locator device. In case the secondary optical receivers comprise camera modules, a more precise viewing angle may be calculated by determining the position of the detected location signal, e.g., of a wall- or shelf-mounted transmitter, in the field of view of the camera module.
[0062] As discussed in the preceding, the location information may comprise the predefined physical location of the respective transmitter in range or correspond to the predefined physical location, e.g., in the latter case comprising a location identifier (ID) or location code.
[0063] In one further additional or alternative embodiment, the head-worn locator device additionally comprises a communication interface and is configured to at least transmit the received location information using said communication interface to a mapping device. The mapping device in an additional embodiment comprises the aforementioned lookup table, map, and/or database and is configured to determine the predefined physical location, associated with the respective transmitter from which the optical location signal was received by the head-worn locator device. In another additional embodiment, the mapping device is configured to provide the predefined physical location back to the head-worn locator device, e.g., using again the communication interface.
[0064] Certainly, the present embodiment may be used in conjunction with the determination of the viewing angles of the user, as described in the preceding. In an according embodiment, the head-worn locator device in addition to the location information transmits the viewing information, e.g., the horizontal viewing angle and/or the vertical viewing angle, to the mapping device. In this case, the mapping device may additionally provide user view field information back to the head-worn locator device.
[0065] The communication interface may be of any suitable type to communicate with the mapping device over a wired and/or wireless communication medium. For example, the communication interface may be adapted for communication using the Internet Protocol over a WAN, LAN, cellular connection, Bluetooth connection, and/or Wi-Fi Network. Certainly, the communication interface may be adapted for further communication methods and protocols, such as IR-Transmission, Zigbee or any other suitable method and protocol.
[0066] The mapping device may be of any suitable type and in particular comprise a computing device. For example, the mapping device may be a computer, server, smart phone, smart watch, or other smart device, e.g., with a suitable programming/software.
[0067] In another embodiment, the head-worn locator device comprises a mapping memory with mapping information. The head-worn locator device in this embodiment is configured to determine said predefined physical location of said transmitter by comparing said location information with said mapping information. According to the present embodiment, the determination of the predefined physical location is conducted locally, e.g., without the necessity of an external device. The mapping information accordingly may comprise the aforementioned lookup table, map, and/or database that allows to associate the received location information with a predefined physical location of a transmitter. Certainly and corresponding to the preceding, the mapping information in another embodiment additionally or alternatively may comprise user view field information. The mapping memory may be of any suitable type, such as RAM, ROM, a HDD, an SSD, or flash memory.
[0068] According to a further alternative or additional embodiment, said optical location signal of each of the transmitters comprises redundant location information. The present embodiment provides a further improved location detection reliability due to the redundancy, i.e., that the location information can be derived from the optical location signal even if only part of said location signal is received by the head-worn locator device, such as under non-optimal reception conditions. For example, the optical location signal could comprise convolutionally encoded location information and/or one or more checksums.
[0069] In another alternative or additional embodiment, the head-worn locator device is configured to receive two or more optical location signals simultaneously. To allow the simultaneous reception of two or more optical location signals, the optical receiver may be correspondingly configured, e.g., with two or more photo detectors or photodiodes or with one or more camera modules, as discussed in the preceding.
[0070] The present embodiment allows increasing the location resolution without the necessity of providing further transmitter or decreasing the spacing between the transmitters. For example, in case two transmitters are in the field of view of a camera module, where both of the transmitters provide location information, it is possible to obtain an intermediate physical location by interpolation. The respective interpolation could be conducted by the head-worn locator device or by the mapping device, discussed in the preceding.
[0071] In one example of an arrayed setup of the transmitters, if two or more transmitters are detected simultaneously along a given array axis, the location of the head-worn device is determined at the center of the segment, that connects the detected transmitters.
[0072] As will be apparent, it is thus possible to obtain finer-grained information location with fewer transmitters.
[0073] Reference will now be made to the drawings in which the various elements of embodiments will be given numerical designations and in which further embodiments will be discussed.
[0074] Specific references to components, process steps, and other elements are not intended to be limiting. Further, it is understood that like parts bear the same reference numerals, when referring to alternate figures. It is further noted that the figures are schematic and provided for guidance to the skilled reader and are not necessarily drawn to scale. Rather, the various drawing scales, aspect ratios, and numbers of components shown in the figures may be purposely distorted to make certain features or relationships easier to understand.
[0075]
[0076] The headset 2 according to the embodiment of
[0077] The camera module 11 is connected to a microprocessor 14, as shown in the block diagram of headset 2 of
[0078] Microprocessor 14 receives video image information from said camera module 11 and detects the presence of an optical location signal in said video information and thus, whether the user is near to one of the transmitters 3. The microprocessor 14 further controls and processes the audio I/O of microphone 12 and the earphone drivers 9, 10, the latter of which are connected to microprocessor 14 over an audio amplifier 12b. It is noted that microprocessor 14 comprises an integrated digital sound processor (DSP) to process the audio I/O and in particular an audio input signal of microphone 12 and an audio output signal for amplifier 12b.
[0079] The headset 2 further comprises a communication interface 15, which provides a wireless connection to a smart phone (not shown) using the Bluetooth protocol. A worn state (don/doff) detector 16 is connected with microprocessor 14 to determine, whether the user is wearing the headset 2 or not. A memory unit 17 is provided that stores suitable programming to allow the microprocessor 14 to provide at least the operation, discussed in the following with reference to
[0080] As discussed in the preceding with reference to
[0081] Memory 20 comprises, after being programmed, the respective location information. In addition, memory 20 comprises suitable programming to allow the LED controller 18 to operate the LED modules 4, as discussed in the preceding. Transmitter 3 further comprises a mains power source (not shown) to power the aforementioned components.
[0082] In the following exemplary explanation of the operation of indoor location determination system 1, a plurality of light fixtures with integrated transmitters 3 are installed in a drop ceiling of a department store.
[0083] After the installation of the transmitters 3 in the ceiling, each transmitter 3 is programmed with location information that corresponds to a predefined physical location over the Ethernet connection 21 of network interface 19. The predefined physical location according to the present example is a relative location of a section or a department of the department store according to the following database table. It is noted that depending on the size of the respective department and the desired location resolution, multiple of the transmitters 3 may share the same predefined physical location.
[0084] While the respective location information, comprising a location identifier (ID), is provided by said transmitters 3 in the optical location signals, the associated predefined physical locations are stored together with the location information in a remote lookup database table, which is stored in the central mapping server, discussed above. As will be apparent from the database table, the location information in this example is of 8 bits length.
TABLE-US-00001 Remote lookup database Transmitter Predefined physical Location information No. location (with location ID) 1 Women's clothing - Coats 01011011 2 Women's clothing - Dresses 00100010 3 Women's clothing - Sports wear 01010101 4 Men's clothing - Suits 00000111 5 Men's clothing - Coats & jackets 00011110 6 Women's shoes 00111000 7 Men's shoes 01011100 8 Children's clothing 01011111 9 Toys 00000000 10 Cosmetics 11111111
[0085] Once the transmitters 3 are programmed, the LED controller 18 of the respective transmitter 3 causes the corresponding LED modules 4 to emit the optical location signal with location information by digitally modulating the output light, provided that the respective LED modules 4 are in the ON state, i.e., that the general illumination in the part of the department store is switched on. The modulating frequency is selected greater than 60 Hz so that no visible flicker in the emitted light is caused by the modulation. The location signal is emitted repeatedly until the respective LED modules 4 are switched off, such as after closing of the department store.
[0086]
[0087] Powering on the headset 2 in step 40 initializes the same and initiates the location determination. The microprocessor 14 in step 41 queries the camera module 11 for said video image information and determines in step 42, whether the video information comprises an optical location signal from one of the transmitters 3. If this is not the case, the procedure returns to step 41.
[0088] If an optical location signal is received in step 42, the microprocessor 14 decodes/demodulates the received signal in step 43, in the present embodiment to obtain the location information, i.e., the location ID of the respective transmitter 3 from which the location signal was received.
[0089] In step 44, the location information is transmitted to a smart phone (not shown) over the communication interface 15 using Bluetooth. The smart phone then connects to the remote lookup database, provided on the mapping server (not shown), over a Wi-Fi connection to obtain the respective predefined physical location, associated with the received location information. The smart phone accordingly transmits the received location ID to said mapping server and receives back the associated predefined physical location of the respective transmitter 3. For example, if the location ID 00111000 is received, the predefined physical location, determined by the mapping server in accordance with the above table is Women's shoes.
[0090] The smart phone may use the predefined physical location for example to show the user's location on a displayed map of the department store or to provide current shopping deals of the respective department to the user.
[0091] Once the location information is transmitted to the smart phone in step 45, microprocessor 14 queries the camera module 11 again in step 41 and repeats the aforesaid process steps until the headset 2 is powered off.
[0092]
[0093] The viewing direction detector 50 according to the present embodiment is arranged in one of the left or a right earphone housings 6, 7 of the headset 52 and comprises an MPU-9250 motion-tracking device, marketed by InvenSense, Inc., San Jose, Calif., USA, which allows to determine a compass direction and a tilt/pan angle. The mapping memory 51 of headset 52 according to the present embodiment comprises a local lookup database to obtain the respective predefined physical location once the location information is received.
[0094] As will be apparent, the present embodiment allows to obtain user view field information and thus to determine what is in the user's field of view. In the preceding example of the use of the system 1 in a department store, the present embodiment allows to determine what product segment the user is looking at more precisely, which may be particularly useful for visually impaired persons.
[0095] In the present embodiment, the following information is stored in the local lookup database of mapping memory 51. For reasons of clarity, only two transmitter locations are discussed in the database table. However, it is noted that the embodiment certainly is not limited thereto and can comprise a different number of database transmitter entries. Furthermore, an average height of 6 feet of the user and a centered position in the respective aisle of the department store, i.e., directly under the transmitter/lighting fixture 3 is assumed to match the vertical viewing angle with the view field information provided.
TABLE-US-00002 Local lookup database Transmitter Predefined physical View field Location information Horizontal Vertical No. location information (location ID) angle angle 1 Women's clothing Winter coats 01011011 5-160 all rack 1 Women's clothing Summer 01011011 190-340 all coats rack . . . . . . . . . . . . . . . 6 Women's shoes Size 6 shelf 00111000 25-140 120-130 6 Women's shoes Size 7 shelf 00111000 25-140 110-120 6 Women's shoes Size 8 shelf 00111000 25-140 100-110 . . . . . . . . . . . . . . .
[0096] The operation of headset 52 is shown in the schematic flow chart of
[0097] Powering on the headset 2 in step 60 initializes the same and initiates the location determination. The microprocessor 14 in step 61 queries the camera module 11 for said video image information and determines in step 62, whether the video information comprises an optical location signal from one of the transmitters 3. If this is not the case, the operation returns to step 61.
[0098] If an optical location signal is received in step 62, the microprocessor 14 decodes/demodulates the location signal in step 63 to obtain the respective location information of the optical location signal received.
[0099] In step 64, the horizontal viewing angle and the vertical viewing angle is determined by querying viewing direction detector 50. Subsequently in step 65, microprocessor 14 determines the predefined physical location associated with the determined location information and the user view field information according to the readings of the viewing direction detector 50 from mapping memory 51.
[0100] For example, in case that the location information received from the associated transmitter comprises 00111000, the horizontal viewing angle/orientation is east, i.e., 90, and the horizontal viewing angle is 115, the predefined physical location is determined as Women's shoes and the user view field information is Size 7 shelf.
[0101] Accordingly in step 66, the microprocessor 14 provides the following audio output to the user: You are in the women's shoes department. You are looking at the size 7 shelf. The procedure is then repeated as explained in the preceding with reference to
[0102] Deviations from the average height and centered position, as discussed above, are interpolated in this embodiment by microprocessor 14 of headset 52 in steps 63 and 64 to further improve the view field information accuracy. The actual height of the user, and thus the headset 52 when being worn, may be pre-set in the headset 52 during an initial setup stage or a calibration step. Microprocessor 14 then adjusts the vertical angle of the local lookup database on the basis of the difference between the actual height of the user and the average height.
[0103] A deviation from the centered position with respect to the transmitter 3 is also used to adjust the vertical viewing angle, comprised in the local lookup database. A corresponding deviation is detected by the microprocessor 14 by determining the relative position of the optical location signal of transmitter 3 in the pixel video information, provided by camera module 11. In case of an offset, i.e., the optical location signal being non-centered in the video information, said offset is also used to adjust the vertical viewing angle to improve the angular accuracy.
[0104] Both deviations, height and position, are calculated using standard trigonometry and interpolation.
[0105]
[0106]
[0107] The headset 72 according to the embodiment of
[0108] A schematic block diagram of a transmitter 93 is shown in
[0109] During operation, the transmitters 93 provide location information to head-worn locator devices, such as headset 72, using amplitude modulated infrared light. According to the present embodiment, the location information comprises the respective predefined physical location, namely the respective name of the painting according to the following table.
TABLE-US-00003 Transmitter Predefined physical location/ No. Location information 93a Three Musicians - Pablo Picasso 93b The Night Watch - Rembrandt van Rijn 93c Starry Night - Vincent van Gogh . . . . . . . . . . . .
[0110] Certainly, the bit length of the location information in this embodiment is increased compared to the transmission of a location ID according to the preceding embodiments.
[0111] The operation of the present embodiment is shown in a schematic block diagram in
[0112] The procedure is then repeated as explained in the preceding with reference to
[0113]
[0114] Corresponding to the embodiment of
TABLE-US-00004 Remote lookup database - Absolute geographic position Transmitter Predefined physical Location information No. location (with location ID) 3a 36.986783, 122.036732 01011011 3b 36.986804, 122.036722 00100010 3c 36.986794, 122.036712 01010101 3d 36.986786, 122.036732 00000111 3e 36.986786, 122.036734 00011110 . . . . . . . . . . . . . . . . . .
[0115] Once the transmitters 3 are programmed, the LED controller 18 (not shown in
[0116] The operation during the determination of the location of headset 2, and thus the user, in the system 100 of
[0117] In case the camera module 11 of headset 2 determines multiple transmitters 3 to be present in the camera module's 11 field of view, the location information of all received location signals are transmitted to the smart phone and then to the mapping server (not shown) together with the relative position of the received location in the pixel video information. For example, the transmitted information may comprise:
TABLE-US-00005 Location ID Image x Image y 01011011 3 14 00100010 26 2
[0118] The mapping server interpolates the exact position of the headset 2 and thus the user using the known positions of the detected transmitters 3 according to the lookup table.
[0119] Certainly, the system for determining an indoor location of a user 100 according to the embodiment of
[0120]
[0121]
[0122] The operation of the embodiments of
[0123]
[0124] While the invention has been illustrated and described in detail in the drawings and foregoing description, such illustration and description are to be considered illustrative or exemplary and not restrictive; the invention is not limited to the disclosed embodiments.
[0125] For example, it is possible to operate the invention in an embodiment in which: [0126] the camera module 11, instead of being arranged on head band 8, is arranged on extension arm 12a of headset 2, 162, [0127] in addition to camera module 11 on head band 8, a further camera module is arranged on extension arm 12a of headset 2, 162, [0128] instead of providing one LED controller 18 in each transmitter 3, 93, a common LED controller drives all transmitters 3, 93 of the system 1 with the respective location data, [0129] transmitter 3, 93 does not comprise a network interface 19, and the location information is hard coded in memory 20 of the respective transmitter 3, 93, [0130] the communication interface 15 of headset 2, 52, 72, 162 is additionally or alternatively configured for Wi-Fi (IEEE 802.11) communication, cellular communication, or another RF communication protocol to connect to a smart phone or a different type of smart device or computing device, [0131] network interface 19 of transmitter 3, 93, instead of being configured for Ethernet communication, being configured for Wi-Fi (IEEE 802.11), Bluetooth, or Zigbee communication, or is configured for a different type of WAN (wide area network) and/or LAN (local area network) communication, [0132] instead of or additional to the LED modules 4 of transmitter 3, comprising white light LEDS, the LED modules 4 comprise color/RGB LEDs, [0133] instead of a location ID comprising 8 bits, the location ID comprises a different bit length, e.g., 16 bits or 32 bits, [0134] instead of digital amplitude modulated location information in the optical location signals, emitted by transmitters 3, 93, phase (e.g., phase shift keying), polarization and/or wavelength modulation is used for encoding the location information, [0135] each transmitter 3, 93 has a unique phase, amplitude, polarization, or wavelength that distinguishes its location and thus provides location information, [0136] instead of or additionally to the transmitters 3, 93 being configured for ceiling, wall, or shelf mounting, the transmitters 3, 93 being configured for floor mounting, [0137] the optical location signals comprise redundant location information, so that the location information can be derived from one of the optical location signals even if only part of said optical location signal is received, [0138] in the embodiment of
[0144] Other variations to the disclosed embodiments can be understood and effected by those skilled in the art in practicing the claimed invention, from a study of the drawings, the disclosure, and the appended claims. In the claims, the word comprising does not exclude other elements or steps, and the indefinite article a or an does not exclude a plurality. A single processor, module or other unit may fulfill the functions of several items recited in the claims.
[0145] The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measured cannot be used to advantage. A computer program may be stored/distributed on a suitable medium, such as an optical storage medium or a solid-state medium supplied together with or as part of other hardware, but may also be distributed in other forms, such as via the Internet or other wired or wireless telecommunication systems. Any reference signs in the claims should not be construed as limiting the scope.