RFID and robots for multichannel shopping
09747480 · 2017-08-29
Assignee
Inventors
Cpc classification
G01S13/751
PHYSICS
G01S13/878
PHYSICS
G06K7/10376
PHYSICS
International classification
G06K7/10
PHYSICS
G01S13/75
PHYSICS
H01Q1/36
ELECTRICITY
Abstract
The present invention relates to systems, methods, and devices for consumers using RFID-tagged items for multichannel shopping using smartphones, tablets, and indoor navigation, preservation of consumer's privacy related to RFID-tagged items that they leave a retail store with, and automatically reading and locating retail inventory without directly using store labor. Robots and aerial mobile automated RFID reading devices are disclosed.
Claims
1. A two-wheeled robot for scanning RAID transponders comprising: a counterbalance located below the axles of the two wheels movable fore and aft relative to a body of the robot; a UHF antenna configured to form a directional beam pattern; the antenna mounted for rotation about an axis; a shaft encoder configured to measure the angle of rotation of the antenna; an RFID interrogator connected to the antenna; and a controller connected to the RFID interrogator, wherein the controller is configured to cause the RFID interrogator to transmit commands and listen for backscattered replies from RFID transponders as the antenna rotates and enable orientation in a wide range of angles relative to the tagged merchandize, giving the tags a view from many different angles while maintaining a focused beam of RF energy on the transponder population of interest.
2. The robot of claim 1, wherein the counterbalance comprises a battery.
3. The robot of claim 1, wherein the UHF antenna is a planar high gain antenna.
4. The system of claim 1, further comprising a beam sweep motor to rotate the antenna.
5. The robot of claim 1, wherein the controller is an iPad tablet.
6. The robot of claim 1, wherein the interrogator listens for backscattered replies containing serialized global trade item number (SGTIN-96).
7. The robot of claim 1, further comprising a camera for indoor navigation.
8. The robot of claim 1, further comprising ultrasonic sonar modules.
Description
DRAWINGS
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
(15)
(16)
(17)
(18)
(19)
(20)
(21)
(22)
(23)
(24)
(25)
(26)
(27)
(28)
(29)
(30)
(31)
(32)
(33)
DESCRIPTION OF THE INVENTION
(34) The present invention provides systems, methods, and devices for bridging online and physical retail environments and to automatically detect accurate inventory location. Consumers are utilizing online shipping to research what they want and save their choices in an online bag or cart. Downloading their bag of selected items into a mobile phone is a step in this consumer-centric shopping process. The next step is for an efficient high-touch shopping experience where the shopper and the retailer cooperate to experience more of what they both want by using less time from the shopper and the store employees. Both the shopper and the store spend less time and money in the steps that are required to complete a sale, and in the optimal case, the retailer sells more goods than without the present invention.
(35) Making reference to various figures of the drawings, possible embodiments of the present invention are described and those skilled in the art will understand that alternative configurations and combinations of components may be substituted without subtracting from the invention. Also, in some figures certain components are omitted to more clearly illustrate the invention, similar features share common reference numbers.
(36) To clarify certain aspects of the present invention, certain embodiments are described in a possible environment—as identification means for retail items that are bought and used by consumers. In these instances, certain methods make reference to items such as clothing, garments, shoes, consumables, electronics, and tires, but other items may be used by these methods. Certain embodiments of the present invention are directed for identifying objects using RFID transponders in supply chains, retail stores, and in consumer's homes.
(37) Some terms are used interchangeably as a convenience and, accordingly, are not intended as a limitation. For example, transponder is a term for wireless sensors that is often used interchangeably with the term tags and the term inlay, which is used interchangeably with inlet. This document generally uses the term tag or RF tag to refer to passive inlay transponders, which do not include a battery, but include an antenna structure coupled to an RFID chip to form an inlay which is generally thin and flat and substantially co-planar and may be constructed on top of a layer of foam standoff, a dielectric material, or a folded substrate. One common type of passive inlay transponder further includes a pressure-sensitive adhesive backing positioned opposite an inlay carrier layer. Chipless RFID transponders are manufactured using polymers instead of silicon for cost reduction. Graphene tags offer similar benefits. Inlays are frequently embedded in hang tags, pocket flashers, product packaging, and smart labels. A third type: a battery-assist tag is a hybrid RFID transponder that uses a battery to power the RFID chip and a backscatter return link to the interrogator.
(38) The systems, methods, and devices of the present invention utilize an RFID transponder or wireless sensors as a component. Certain RFID transponders and wireless sensors operate at Low Frequencies (LF), High Frequencies (HF), Ultra High Frequencies (UHF), and microwave frequencies. HF is the band of the electromagnetic spectrum that is centered around 13.56 MHz. UHF for RFID applications spans globally from about 860 MHz to 960 MHz. Transponders and tags responsive to these frequency bands generally have some form of antenna. For LF or HF there is typically an inductive loop. For UHF there is often an inductive element and one or more dipoles or a microstrip patch or other microstrip elements in their antenna structure. Such RFID transponders and wireless sensors utilize any range of possible modulation schemes including: amplitude modulation, amplitude shift keying (ASK), double-sideband ASK, phase-shift keying, phase-reversal ASK, frequency-shift keying (FSK), phase jitter modulation, time-division multiplexing (TDM), or Ultra Wide Band (UWB) method of transmitting radio pulses across a very wide spectrum of frequencies spanning several gigahertz of bandwidth. Modulation techniques may also include the use of Orthogonal Frequency Division Multiplexing (OFDM) to derive superior data encoding and data recovery from low power radio signals. OFDM and UWB provide a robust radio link in RF noisy or multi-path environments and improved performance through and around RF absorbing or reflecting materials compared to narrowband, spread spectrum, or frequency-hopping radio systems. Wireless sensors are reused according to certain methods disclosed herein. UWB wireless sensors may be combined with narrowband, spread spectrum, or frequency-hopping inlays or wireless sensors.
(39) Privacy Preservation
(40) Preserving privacy is a concern. The present invention teaches how privacy preserving ready (PPR) EPC Class 1 Gen 2 transponders with privacy-preserving recommissioning features are coded to provide privacy for consumers that prefer to keep transponders operational after they acquire ownership of the tag and the object it is attached to. PPR tags are defined as having means for preserving privacy and lack unchangeable promiscuously readable serial number fields.
(41) A first degree of privacy is defined as the elimination of uniqueness. Serial numbers are unique when combined with the object that they serialize. Removing all serial numbers from PPR tags removes publicly viewable uniqueness.
(42) A second degree of privacy is achieved by changing the identity of the PPR transponder so that an attacker cannot rely upon previous observations of an item or a person for example wearing an item to confidently determine the identity of the item or person in the future.
(43) The documents EPC Radio-Frequency Identification Protocols Class-1 Generation-2 UHF RFID Protocol for Communications at 860-960 MHz Version 1.2.0 and EPC Tag Data Standard Version 1.5 are incorporated by reference herein.
(44) EPC Class 2 Gen 2 is under development. It is likely to someday become a standard transponder that offers a high degree of privacy preservation. Such a Class 2 PPR privacy preserving transponder will contain an internal cryptographic engine. Preferred embodiments will contain a random number generator and the ability to dynamically change its response to interrogation by RFID readers. Preferred PPR embodiments will use a cryptographic challenge-response protocol. Upon first use, the transponder will need to be initially impregnated with a secret cryptographic key or code.
(45) Preferred embodiments of the present invention operate with either EPC Class 1 or Class 2 PPR transponders as a privacy preserving system by securely transferring control of item-identifying transponders between trading partners and consumers.
(46)
(47) Smartphones and Privacy-Preservation
(48) Consumer device 12 is a device such as a mobile smart phone with database 12a for storing and accessing information about items purchased and owned by the customer. Preferred smart phones include iPhone4, 4S, 5 Android phones, and Win CE phones having processor 12b. Preferred embodiments use SQLite or other database for mobile devices. Also operating at UHF is RFID Interrogator 12d communicates with transponders 13a,b,c that are attached to retail items or the various hang tags that are attached to retail items. Preferred embodiments of RFID Interrogator 12d use austriamicrosystems AG of Unterpremstaetten, Austria model AS3992/3 UHF Gen 2 reader chip. Other preferred embodiments use the PR9000 from Phychips of Daejeon, Korea. I/O 12c preferably includes Wi-Fi, Bluetooth, and near field communications (NFC) for communicating with Point of Sale 11 and other devices.
(49) Referring to
(50) EPC Class 1 Gen 2 transponders promiscuously emit the contents of the UII (Bank 01) to any reader thus making that memory bank vulnerable to privacy attacks. The password registers in EPC memory Bank 00 however are not readable unless the transponder is in the secured state, and even then, only Kill Password 23c is readable. Therefore the only registers that can be used to hide a secret in a PPR EPC Class-1 Gen-2 compliant transponder are the Access Password 23d and Kill Password 23c.
(51) PPR transponders will preferably not allow themselves to be programmed unless the interrogator can successfully unlock its secured memory banks. In a preferred embodiment each authorized RFID transponder converter company uses one or more encryption keys to generate passwords that lock the RF tags, whereby preventing them from being programmed unless they are unlocked using the same password. Passwords of this type are specified in the EPC Gen 2 specification and in ISO standards. The passwords are preferably generated by processing means using a public key from publicly readable data such as an asset number or a transponder serial number. A shared key is then used by an encryption algorithm such as AES in order to create a password or a collection of passwords to lock or unlock one or several RF tags.
(52) For certain encoder embodiments, passwords are encoded into transponders or wireless sensors when they are commissioned. Passwords are safeguarded using cloaking, obfuscation, cryptographic techniques, secure and trusted channels, locked memory, and other methods that are commonly used to protect confidential information. Passwords are generated or retrieved from data encoded in an RFID transponder to generate an index into one or more databases that contain a one dimensional array of passwords, a two dimensional array of passwords, a multidimensional array of passwords, or an array of actual or pointers to algorithms used to generate passwords from transponder data, for example. Alternatively, cryptographic algorithms are used to generate passwords from transponder data.
(53) This type of data production and/or replication process is very fast and efficient. There is no absolute need to query a database in real time; hence there is no need for continuous wireless network connectivity. This simplification eliminates the possibilities for non-deterministic network delays. Non-deterministic delays are delays that cannot be guaranteed, usually due to the probabilistic nature of packet collisions that are common in Ethernet and Wi-Fi. By eliminating the need to access a network database, the variable non-deterministic delays caused by changing database sizes, changing record counts, and database user load fluctuations are completely circumvented. Reduction or outright elimination of non-deterministic delays helps manual labor operate at maximum efficiency, allowing them to achieve a regular and dependable cadence in their transponder application processes.
(54) Although serialized SGTIN's are vital to the functioning of transponders in supply chains, the uniqueness of the number poses a threat to consumer privacy. In preferred embodiments, unique SGTINs are produced using quasi-autonomous RFID transponder encoding. That is achieved when an external number issuance authority allocates to remotely located encoders, blocks of numbers for specific object classes. A preferred embodiment for quasi-autonomous transponder encoding authority is realized when large pre-authorized blocks of serial numbers are made available to encoder device to utilize on object classes as objects of a class are presented for tagging. A preferred method of providing large blocks of pre-authorized blocks of object class serial numbers is to subdivide the entire object class serial number space into sectors that are defined by a limited number of MSB's (Most Significant Bits) of the serial number field. The object class serial number space is defined by the number of serial number bits that are used in a specific standard, such as a particular EPCglobal key type, for example an SGTIN-96 and is defined in a corresponding specification such as the GS1 EPCglobal EPC Tag Data Standard. Again using the SGTIN-96 as an example, there are a total of 38 bits used to define the entire serial number space which contains 2.sup.38 unique numbers. For example the upper 14 bits could be designated as the most significant bits for a particular embodiment. In that case the object class serial number space would be comprised of 16,384 sectors. Since in this example there are 14 most significant bits within a 38 bit serial number field, there must be 38 minus 14 bits of lesser significance, which equals 24 bits. Therefore the lower 24 bits represent 16,777,216 unique serial number values. Once a sector is allocated to a lower level within an authority hierarchy, it is referred to as a block. Each allocated block of serial numbers represents authority for encoding objects of an object class that can either be used by an encoder for encoding transponders, or allocated to a lower level in the authority hierarchy.
(55) GS1 is a leading global organization dedicated to the design and implementation of global standards and solutions to improve the efficiency & and visibility of supply and demand chains. GS1 defines EPCglobal SGTIN number fields as having a company prefix, an item reference, a partition value, and a filter value that comprise the object class information. A unique serial number is then added to that information to create each unique instance within each object class.
(56) Use of object class numbers without the unique serial number described above is useful for privacy preservation. Object class numbers without the object class instance reveal no more information than a stock keeping unit number, GTIN, or UPC bar code.
(57) For greater levels of privacy, publicly readable numbers are preferably changed from time to time. Preferred embodiments change the number every time the number is read, however this requires a transponder that is capable of changing its own numbers. Such a transponder within the EPC realm is possible within a category of new transponders that include EPC Class 2 Gen 2.
(58) Preferred privacy preserving systems transfer unique serialized information that is associated with a PPR transponder to portions of transponder memory that can only be read by an authorized interrogator and also transfer unique serialized information to an authorized consumer device with data storage that is not generally accessible by an attacker or any unauthorized person or device.
(59)
(60) Preferred embodiments of the present invention use Access Password 23d and Kill Password 23c for anti-cloning, anti-counterfeiting, authentication, and for consumers more detailed identification of the transponder while it is in this first privacy preserving mode. The reason for this is that secret information can be retained in Access Password 23d and Kill Password 23c as described above for
(61) Preferred embodiments retain a 32-bit portion of the 38-bit serial number (SN) 30e in Kill Password 23c which can only be read when the transponder is in the secured state. The process of changing a 38-bit SN to a 32-bit serial number has three preferred methods: Using a one-way hash to reduce 38 bits to a 32-bit digest; truncation of the 38 bits to 32 bits; or splitting the 38-bit SN 30e into a 6-bit and a 32-bit portion.
(62) The one-way hash function accepts a 38-bit serial number and produces a 32-bit message digest that is stored in Kill Password 23c. The truncation method replaces the six most significant bits with zeros or some other fixed value, and copies the lower 32 bits into Kill Password 23c. The hash and truncation methods are not reversible.
(63) The split method retains the six most significant bits and copies the lower 32 bits into Kill Password 23c. Each method is useful for securely preserving a degree of uniqueness that is adequate for use at home by consumers.
(64) Referring now to
(65) The consumer can subsequently and periodically change Asset ID 42c into Asset ID 42d using asset transformation AN2 41d. Increasing the frequency of use of AN2 generally results in an increase in privacy for the consumer. Such transformations are preferably performed outside of the range of potential eavesdroppers. Certain preferred embodiments use foil-linings inside of the walls of the rooms where process AN2 is performed. Additional anti-eavesdropping countermeasures preferably include radio signal absorbing foam, blocking tags, and active radio interference.
(66) Referring now to
(67) Referring now to
(68) Returning now to the first embodiment, the consumer preferably acquires all rights to the items purchased and the SGTIN data that was stored on the transponder that was attached to that item. Point of sale device POS 11 preferably initiates a transaction with consumer device 12 such as a smart phone by sending to an appropriate I/O device 12c Transaction Request 14a. The request is preferably comprised of POS authentication and identification information. Consumer device 12 preferably responds with a list of Item Identifiers 14b that correspond to Asset ID 42c of
(69) Asset ID setting operation 14e is the step that implements one of the transformations shown in
(70) POS 11 in preferred embodiments provides Transaction ID 14g to PPR transponder 13a to store in the kill password such that it cannot be read by a privacy attacker. This step is in lieu of a step described above where the lower 32 bits of Serial Number 30e are stored in Kill Password 23c. This Transaction ID is preferably a 32-bit number that is unique within a retailer's transaction database such that it could be used by a retailer to confirm a transaction when the corresponding customer returns an item for exchange or refund. During the returns process the original SGTIN could be rewritten to PPR transponder 13a, preferably with the original access and kill passwords in reserved memory 23 that were preferably saved in the retailer's store computer system. Ack 14h is then preferably sent by PPR transponder 13a to POS 11.
(71) POS 11 then completes the recommissioning process by either the access or kill password method by locking the transponder memory banks. Memory Lock 14i is used to set lock bits for UII Memory 22, User Memory 26, Access Password 23d, and Kill Password 23c. Ack 14j is the confirmation from transponder 13a to complete this process. Transponder 13a is then preferably returned to the ready or arbitrate state before powering it down.
(72) Confirmation step 14k preferably includes the transfer of all SGTIN numbers and the associated Asset ID numbers 42c to Consumer Device 12 through I/O 12c for storage in database 12a. Consumer device 12 then preferably replies with Acknowledgement 14m to complete the recommissioning process for all transponders in the consumer's present purchase transaction.
(73) Referring now to
(74) In step 62 POS 11 obtains either an access password or a kill password based on whether transponder 13a was found to implement standard EPC recommissioning or not. If transponder 13a does implement standard EPC recommissioning but has already been recommissioned, then the transponder cannot be recommissioned a second time. Obtaining the required password is preferably a cryptographic process in which publicly readable transponder data is used with a cryptographic key and a cryptographic transform to produce a cryptographic result that is used all or in part as a password. For EPC Class 2 transponders secure privacy preserving access to the transponder may or may not use the passwords and XPC bits as defined for EPC Class 1 transponders.
(75) In step 63 transponder 13a enters the secured state where it can execute all access commands and change lockbits. Preferred embodiments of EPC Class 2 transponders have the same or a corresponding state that is indicative of authorized transponder access.
(76) In step 64 lockbits are reset in order to provide access to memory banks that are to be cleared or rewritten during the recommissioning process.
(77) In step 65 preferred embodiments change UII Memory 22 according to the transformations shown in either
(78) In step 66 the transformation is completed preferably by locking memory banks that were changed and exiting the secured state to the ready or arbitrate state. A corresponding action is preferably performed in embodiments that use EPC Class 2 privacy preserving transponders to return them to a non-privileged state for use in public.
(79) Non-Unique Tag ID 24a is typically written and permalocked when the RFID chip or inlay is manufactured. If this number does not have a unique serial number concatenated onto a base number that identifies the manufacturer and model number of the RFID logic circuit, then it can be used in a privacy preserving transponder as a Non-Unique Tag ID 24a. On the contrary if TID Memory Bank 10 contains a TID with a unique foundry-serialized number that cannot be muted, masked, erased, or truncated, then it poses a high risk to privacy since it too is promiscuously readable by any RFID reader. Impinj of Seattle, Wash. promotes the use of serialized TID numbers for UII serialization. A transponder with a unique TID that is completely factory permalocked should not be used if privacy preservation is a requirement.
(80) User Memory (Bank 11) 26 if it exists in a particular transponder is preferably disabled or cleared to all zeros in order to eliminate potentially distinguishable information. Certain supply chain applications make use of User Memory 26 for supplemental information. The UMI (User Memory Indicator) bit should therefore be clear. The UMI bit is PC bit 15h as defined in the EPC Tag Data Standard.
(81) Extended Protocol Control (XPC) bits are also somewhat distinctive and pose a threat to privacy if an attacker can use distinctive XPC bit patterns to help identify a person or item with higher confidence.
(82) The benefit of PPR privacy preserving transponders is apparent when consumers use supply chain transponders at home in combination with PPR transponders in retail stores. For example a person holding consumer device 12 such as a mobile smart phone with visual and audio inputs and outputs would in a preferred embodiment use a voice assistant such as the Apple SIRI or Android IRIS to ask the mobile computer questions such as: “What pants, belt, and shoes should I buy to go with my blue shirt at home?”
(83) Preferred embodiments include a retail shopping store having a plurality of objects, each having a unique code stored in an attached RFID transponder. The RFID transponder is preferably responsive to radio signals in the 860 MHz to 960 MHz range.
(84) The mobile computer is preferably a smart phone or tablet computer equipped with an RFID reader. The RFID reader is preferably embedded in the mobile computer, but can also be mounted externally from the mobile computer's enclosure. In preferred embodiment a consumer's smart phone connects with RFID readers that are operational within a retail store. Wireless data can be provided through a connection or a connectionless transfer of data packets. Wi-Fi or Bluetooth are preferred for such wireless data transfers. TCP packets would be for connection to a socket on a store server or UDP packets can be received in a broadcast mode of operation from RFID readers that multiple listeners can all have realtime shared access to raw RFID read data in a retail store if there is adequate bandwidth to convey the data traffic.
(85) Conversation with the mobile computer is preferably natural and fluid, with suggestions that arise from coded data that is representative of your tastes, your existing wardrobe, your budget, and what is currently on the sales floor, preferably on sale!
(86) RFID smart phone and tablet Apps enable dialog like: “Show me how this couch would look in my living room” or “Are all my clothes back from the dry cleaners?”.
(87) In a possible embodiment, a PPR transponder includes mechanically alterable characteristics that result in a reduced operating range. For example RFID transponders with detachable antenna material have been proposed as a solution for increasing consumer privacy for goods after they leave the point of sale. A problem with this solution is that once the antenna material has been removed, it cannot, in general be reattached. In other words the privacy preservation step is not reversible.
(88) Certain PPR privacy preserving transponders are sewn in to garments. Transponders are preferably encoded when the sewn-in transponder is being sewn in to the garment. Preferred embodiments also encode security information such as pedigree assurance codes into the transponder at that point in the product lifecycle.
(89) For a consumer to use RFID transponders at home, some consumers may wish to be assured that the royalties have been paid. Preferred embodiments use the acquired SGTIN information to determine pedigree and authenticity of the purchased goods and preferably reward shoppers for their cooperation
(90) Referring now to
(91) At stage 82 transponder 13a is used by a contract manufacturer or a brand owner's manufacturing plant to identify retail items using a uniquely serialized SGTIN. Preferred methods for serialization are described above, including quasi-autonomous encoding to remotely assure uniqueness at any manufacturing location in the world.
(92) At stage 83 the transponder is used by the brand owner to transfer items to retail stores using RFID uniqueness for product visibility.
(93) At stage 84 transponder 13a is used by a retailer to track and count inventory which again requires each transponder 13a to be uniquely numbered.
(94) At stage 89 a pedigree database 91a is queried through Network I/O 91c and 12c using software running on processor 91b and 12b, preferably prior to making a purchase of item tagged with transponders 13a-c using Consumer Device 12, database 12a, and RFID Interrogator 12d according to the diagram shown in
(95) At stage 85 a customer buys the retail item and the transponder that is attached to it. POS 11, Consumer Device 12, and transponder 13a implement a data exchange according to the method illustrated in
(96) RFID-Enabled Smartphones
(97) Retail sales are increasingly becoming a multi-channel business that involves three complimentary channels: in-store, online, and catalog sales. Retail store inventory is increasingly used to fulfill online and catalog orders and is a major reason that inventory accuracy is preferably at least 97% accurate. Consumers are increasingly planning in-store shopping visits to retail stores by shopping online first and saving items of interest to an online shopping bag or wish list. That list is then optimally used to find, touch, and try selected items while the shopper is in the retail store, presumably using precious time and wishing to focus mainly on items of interest.
(98) Shoppers use smart phones to look up products online using bar codes, RFID, or visual object recognition to identify products of interest. Shoppers access coupons in smart phones and purchase items online when products are out of stock at store.
(99) Smart phones provide an immersive shopping experience, customer check-in and check-out, and a high degree of customer service and retailers learn shopper behaviors.
(100) To focus on items of interest the shopper needs to know where to go in the store to see and feel the items such as apparel, footwear, and electronics. A preferred way to do this is to use an in-store map or planogram to locate items.
(101) For a planogram-based in-store mapping system to work effectively, inventory chaos must be controlled and limited to a minimum level. Inventory clearance sales are a particular problem for retailers because eager shoppers are physically very disruptive to inventory, resulting in vast amounts of misplaced and messed up merchandise. Store employees work to restore order during these high velocity sales. RFID tagging can help make this process work more efficiently by guiding the employee to the misplaced items so that they can be returned to the place that they should be in, as is preferably indicated in the store planogram.
(102) In other preferred embodiments, handheld RFID readers are used to periodically scan store inventory and in that process also reading RFID transponders that indicate physical positions within the retail store. GS1 recommends that SGLN encodings be used for reporting a transponder's physical location. Whenever inventory items are read they are correlated with a position that maps to the store planogram.
(103) Near real-time item position information is preferably updated as on hand store floor inventory that maintains a high correlation to the store planogram. This method then enables a more efficient and successful bridging of the online and in-store shopping experiences by making it easier for shoppers to find what they are looking for, in their preferred style, size, and color.
(104) Referring now to
(105) Mapped Retail Store 103 is preferably adapted for use by an indoor navigation system and includes points of reference such as radio beacons such as DASH7 (ISO18000-7 433 MHz) or extensions of Bluetooth 4.0 nodes and Wi-Fi access points, RFID transponders such as UHF or NFC tags, optical references such as barcodes, LEDs, lamps, light fixtures, or overhead optical location reference strips 160.
(106) Digital Planogram 101 is comprised of database 101a that contains a detailed map of the locations of each stock keeping unit (SKU). Each SKU maps to a GTIN and each GTIN maps to one or more serialized SGTIN instances. Processor 101b works with Network I/O 101c to serve planogram content to consumers that are using either online shopping tools or mobile devices such as smart phones. Consumer Device 12 is such a tablet or smart phone device that is used by the shopper as an interactive shopping tool. Certain retailers preferably offer the use of a tablet such as an Apple iPad, Samsung Galaxy Tab, or a commercial grade tablet such as a Motorola tablet for consumers to use while shopping in their retail store to help them locate and find information about products that they are interested in. Preferably Consumer Device 12 also performs as a point of sale to present a list of items as a transaction, tender the sale, and complete a transaction as previously described for POS 11 and Consumer Device 12 as separate devices could be combined and performed in a single device.
(107) Preferred embodiments use augmented reality to enhance the shopper's experience in a retail store by for example superimposing three dimensional views of objects into a scene that is viewed by camera 111 in tablet or smart phone 12 or camera 198 in tablet 197 of
(108) Database 12a preferably contains a copy of the shopper's online shopping bag that indicates the items that the shopper is interested in seeing, touching, and potentially buying. Processor 12b operates preferred application programs that provide one or more layers of content onto a representation of the physical store in which the shopper is looking for items of interest. The application uses I/O 12c including smart phone sensors to sense points of reference such as radio beacons such as Bluetooth nodes and Wi-Fi access points, RFID transponders such as UHF or NFC tags, optical references such as barcodes, LEDs, lamps, or light fixtures that are sensed by a camera. Accelerometers and magnetometers are also used in preferred embodiments as sensed dynamic inputs that are used between any of the fixed points of reference described above.
(109) The shopper is shown and guided to items of probable interest using Human Interface 102a that preferably includes a high resolution color display and audio cues including synthesized voice and audio tones.
(110) Referring to
(111) Preferred embodiments of retail stores use fixed readers such as reader 180 at points of interest for shoppers to use their personal consumer device 12 having RFID reader 12d eavesdrop by synchronizing with the RF hop sequence of the store's readers. The hop sequence is preferably published to consumer devices 12 using Wi-Fi UDP broadcast packets that also serve to synchronize the hop times of readers in the store. If all readers, including consumer devices 12 use the same hop sequence, then reader 12d can sense that it is close to a reader that is at a certain place in the prescribed hop sequence and tune to that frequency, whereby enabling it to down convert to base band the data that the store's reader sends and receives from a population of transponders.
(112) Automated Inventory Reading
(113) Automatic and methodical reading of item-level RFID-tagged inventory without the use of direct human labor is herein disclosed comprising mobile devices with either aerial or floor-level mobility for methodically scanning a plurality of RFID transponders.
(114) Referring now to
(115)
(116) The length of tether cable 154 is preferably varied by a servo-controlled winch (not shown); varying the length of tether cable 154 and the individual velocities of propellers 152b and 153b provide complete freedom for controlled scanning of tagged items located throughout a room such as a retail store with a high gain antenna that provides a high degree of transponder location resolution. The tether location and deflection angles, deployed cable length, are used to compute transponder locations.
(117) In another preferred embodiment, one or more of propellers 152b and 153b are coaxially aligned with helical antenna 151. Propulsion and helical antenna are preferably enclosed within a protective plastic cylinder that is open at both ends whereby allowing air to flow through the tube. Direction of air and radio waves results in a highly directional RFID tag reading system.
(118) In another preferred embodiment, flexible or rigid tether cable 154 is suspended from a dual or single mast 255a that extends above robot 250.
(119) Hierarchical SGTIN Storage and Retrieval
(120) Referring to
(121) The 22 leading hexadecimal digits, or embodiments using base ten or other bases can be broken down into components as follows to create a hierarchy of directories or folders for hierarchical H-Files. In another embodiment, the 22 leading hex digits are used as a primary key into an SQL database, however tests have shown that this results in a data storage and retrieval solution that is slower than the H-Files that are described here: tag inst=30048677B2A47FC0004E9927; Dir: \30\04\86\77\B2\A4\7F\C0\00\4E; Path name=\TDB\\30\04\86\77\B2\A4\7F\C0\00\4E\99.txt.
(122) In this example, the first 20 hex characters are used two at a time to create a hierarchy of directory names. The second to last SGTIN hex character pair is used to form the file name. The last two characters are used to encode the instance in a cluster map 133a as described in more detail below.
(123) In a preferred embodiment, a Motorola MC3190Z handheld RFID reader using C# language running on a .NET is used for inventory counting in a retail store. Comparing SQL to H-File on a 100,000 SGTIN instances that are for the most part sequentially numbered, the following results were obtained for binary files. Speed: H-File: 65.4 recs per second (6.7× better), SQL: 9.8 recs per second. Storage: H-File: 0.28 Bytes per SGTIN (4.6× better), SQL: 1.30 Bytes per SGTIN.
(124)
(125) When RFID interrogator 131 reads a transponder SGTIN, as shown in step 71, it is used as a key into hash table 132 which is used to temporarily store all instances of recently read transponders. Hash table 132 can either store one instance per record, or ranges of consecutive instances such that the efficiency of hash table memory is maximized. Using that read event, hash table 132 is then searched for all other SGTIN's that share the same 22 of 24 leading hex characters and setting the bits in cluster map 133a that correspond to those instances. That cluster can then be saved in local file storage and another SGTIN is processed in a similar manner. High efficiency is realized when clusters each have dozens or more of instances found and verified at one time before the relatively slower operation of file storage is performed.
(126) In step 72, asynchronous web query queue 134 is used to read cluster maps 133a from SGTIN server 135 which may be in the store, or remotely located at an Internet IP address. Since network and database delays are non deterministic, the database query process preferably operates in the background so as to not block the progress of the main processing thread.
(127) In step 73, the inventory cluster maps 133a is updated whenever instances of the SGTIN's in that cluster are found through reading of its RFID transponder. Clusters are preferably updated several instances at one time before storing that cluster in a local data storage file or SQL record. In an exemplary embodiment the cluster file is 64 bytes of 256 binary encoded 2-bit pairs for a total of 512 bits.
(128) Results that are returned from SGTIN server 135 are SGTIN cluster maps and GTIN's or product descriptions that are used primarily to help a retail store associate identify items that do not match during the inventory processing steps described above. In many cases the GTIN can be computed directly from the SGTIN, however due to mistakes or license plate tagging, the GTIN must sometimes be fetched from the database. GTIN list 133b is then preferably used to store instances or ranges of SGTIN instances that correspond to a GTIN. For example a preferred list is stored in a hierarchical H-File manner in the same folder as the corresponding cluster map 133a in a directory hierarchy comprised of pairs of SGTIN hex digits.
(129) In step 74, asynchronous web query queue 134 is used to write or store updated cluster maps 133a to SGTIN server 135, whereby indicating to server 135 which instances were found in the retail store. Step 74 preferably includes a reconciliation process that is responsive to the four possible states: an inventory item state of being unexpected and unfound; an unexpected but found state; a commissioned and unfound state; and a commissioned and found state. At a certain point, after the store has been completely scanned, there is a final reconciliation step to resolve occurrences of the a commissioned and unfound state and the unexpected but found state. The former may indicate an item that has been lost, stolen, or transferred to another store. The latter may indicate an item that was returned or exchanged but not properly accounted for.
(130) Aerial Mobile and Overhead RFID Readers and Bridges
(131) Referring now to
(132) In preferred embodiments that use propellers 152b and 153b and a length of cable 154 RFID to Wi-Fi bridge 144 is collocated with antenna ground plane 145 and part of the antenna 150 structure that “flies” under mounting plate 143a. Considerations are mass, cable flexibility, and preferred RFID scan angles. This preferred embodiment offers a higher degree of X, Y, Z, rho, theta, phi freedom of motion of antenna 150.
(133) In another preferred embodiment for reading RFID tags in an office, warehouse, or retail space is to use an unmanned aerial vehicle (UAV) 336 of
(134) UHF Front End 172 of
(135) Wi-Fi Front End 174 is preferably comprised of an IEEE802.11 baseband processor MAC and an RF transceiver and a directional unit to separate transmit from receive signal paths to Wi-Fi Antenna 144a. B&B Electronics is an example of one company that combines such devices with an application processor to produce Wi-Fi serial bridges. In this preferred embodiment, the application processor would also host the UHF RFID reader functions described for Processor 173 below.
(136) Processor 173 preferably balances computational power and energy consumption to provide an efficient low power device for execution of bridging functions between UHF Front End 172 and Wi-Fi Front End 174.
(137) Preferred embodiments also utilize low power modes of operation to reduce power consumption when there is nothing moving. The transponders in the field of Antenna 171 preferably remain in the space covered by that antenna until someone or something moves them. Once motion is detected, UHF Front End 172, Wi-Fi Front End 174 and Processor 173 preferably all wake from lower power states into an operational state to read RFID transponders, filter the list, and report final results through the wireless link to remote servers or attached clients through Wi-Fi Antenna 175 to access point 126.
(138) In another preferred embodiment, Optical Source 176 and an antenna element such as ground plane 145 of antenna 150 in
(139) Parabolic Aluminized Reflector (PAR) lamps is commonly used for illumination in residential, commercial, and retail recessed lighting ceiling cans. Adapting the PAR30, PAR36, and PAR38 lamp cans for a UHF RFID reading luminary is a preferred embodiment of the present invention. The PAR30 bell diameter measures 3.75″, the PAR36 4.5″, and the PAR38 4.75″. These diameters closely match the diameter of a helical, bifilar helical, quadrafilar helical, or an octahelix antenna making the match of axial mode helical antenna to a luminary good in terms of aesthetics and functionality.
(140) For example a 915 MHz helical antenna with a preferred circumference equal to the wavelength would have a helical winding diameter of 4.1″. Adjustment of the diameter to fit the desired PAR lamp size is well within acceptable performance limits of a helical antenna. The PAR38 diameter of 4.75″ would have a circumference to wavelength ratio of 1.15, and at 8 turns, a reflector to wavelength ratio of 0.8, and a winding pitch to wavelength ratio of 0.22, the resulting gain would be 20 dBic, half-power beam width of 34 degrees, a 10.3″ reflector diameter, and an overall helical coil length of 26″. Such a design would be suitable for high ceilings in office and retail spaces even with a power amplifier of 16 dBm or less. Such output ratings, up to 20 dBm are available from the austriamicrosystems AS3992. Preferred embodiments for less visibility of the reflector can be coated metal or comprised of a metal mesh. An endfire helical antenna with a diameter that flares out along the axial length would provide a wider bandwidth and another aesthetic aspect for the design.
(141) For buildings that have fluorescent tubes, the replacement of those tubes with an RFID reading fluorescent or LED tube requires a broadside helical operating in normal mode. By wrapping a helical array around the tube, a field pattern is created which illuminates the space below it with light and a UHF field. These and the following embodiments all preferably derive operating power from conventional AC power mains.
(142) Preferred embodiments do not operate RFID to Wi-Fi bridge 144 at full power and duty cycle on a continuous basis. Movement of people, their hands, or items that they are holding is preferably detected by the lamp in a low power mode whereby fluctuations in reflected light, including infrared light are detected, or changes in reflected UHF signals are detected that are indicative of such movements that would warrant full power operation of RFID to Wi-Fi bridge 144. Limiting the use of these radios helps to reduce the background noise level that other radios must contend with during their operation, therefore reducing the amount of modulated UHF or Wi-Fi signals contributes not only to an environment that is more RF friendly, but also reduces human exposure to radio frequencies. Preferred embodiments restore RFID reading within tens of milliseconds after motion is detected whereby increasing the probability of completing an inventory before the transponder population has changed.
(143) Indoor and Outdoor Navigation
(144) GPS signals are preferably used for guiding robots while reading inventory such as cars in outdoor automobile lots. GPS is also preferably used for geo-fencing to prevent a functioning robot from being stolen from outdoor locations. Upon detecting removal beyond predefined geographic boundaries, the robot would preferably call for help and activate protective countermeasures.
(145) There are many indoor locations where GPS signal strengths are too low for indoor GPS guidance. This section teaches solutions to that problem. Referring now to
(146) In a preferred embodiment, the modulation of arrays 183-184 is used by devices 12 and 198 to determine the optical reference designator for light source 180 within a detection zone. The modulated LEDs having modulation patterns for signaling coded designator numbers for the optical location references. A detection zone may be one of many that are within a retail store, office building, or shopping mall. The modulation of arrays 183-184 preferably uses variations in amplitude and timing to encode the designator number for light source 180. In a preferred embodiment for the designator codes, binary encoding is used with amplitude modulation having 8-32 bit times. Other preferred embodiments use 3-8 lighting intensity levels instead of 2 levels for increased information density within a given period of time. Preferred embodiments use a modulation technique that results in a sufficiently unique number with a geographic are of a store, mall, or office such that the time that is required to complete the modulation is short compared with the amount of relative movement between device 12 and source 180 during the time that the number is being modulated. The modulation speed is constrained by the camera frame rate that preferably samples the image field at the Nyquist rate or faster. So if the frame rate is 30 frames per second, the modulation is preferably slower than 15 symbols per second. If each light source 180 is modulated asynchronously with other light sources 180, then there is preferably a synchronization pulse and data pulses. Data pulses preferably include the designator number and error detection and/or correction data symbols. In preferred embodiments the entire identification sequence is completed in less than 0.5 seconds or less.
(147) Mobile devices consumer device 12 and tablet 197 preferably use internal accelerometers and gyros to detect its pitch, roll, and yaw relative to X, Y, and Z planes to determine the pointing angle of the camera. Using that information, only the best sources 180 are used as points of reference in terms of signal quality, which is determined by the observed intensity, separation from other light sources, signal to noise ratio, and other factors. For example, sources 180 nearer to the horizon may be ignored, even if they are within the field of view of a camera in the mobile devices. Sources 180 that are directly above or nearly so, offer high signal quality and accuracy for indoor navigation.
(148) Using calculations like nautical navigation by the stars is preferably used with camera 111 or 198 for determining the location of the mobile device relative to the location references. Optical location references 160 or 180 are preferably within camera 111 or 198's field of view and are used like stars, the location references of which are received through the optical modulation.
(149) The location references further comprise locations within a constellation map that is communicated to the mobile device. In a preferred embodiment, the three dimensional location of each location reference are compiled to create a constellation map. The constellation map is preferably communicated to each mobile device 12 or 197 through WiFi. In a preferred embodiment, the constellation map of location references is transmitted using either TCP or UDP packets. Using UDP packet, the constellation maps are broadcast such that each mobile device in the vicinity can use an internal dictionary or database to lookup the location of each location reference by its designator number.
(150) In another preferred embodiment, source 180 modulates in synchronization with other sources 180. A preferred system synchronization reference is provided using a WiFi message such as a UDP broadcast at each synchronization point. For example once every second, preferably with compensation for timing delays through the WiFi stacks. Having that information available to each point that is observing light color and or pulses at various times helps to determine which source 180 is being observed with a camera's field of view as is described in further detail below.
(151) In other preferred embodiments, sources 180 are replaced with moving parts that direct a beam or a strip of light in a preferred manner. In certain preferred embodiments, the light source is s laser that is moved using micro-machines and small mirrors in a controller manner.
(152) In other preferred embodiments for retail stores having overhead lighting, including fluorescent or incandescent lighting emit sufficient energy in the form of light, electrostatic fields, or heat that can be harvested to power an optical reference.
(153) In another preferred embodiment, conventional fluorescent tubes are replaced with LED arrays with optical location references built in. LED arrays are commercially available in standard sizes and lengths and do not require a ballast. In the preferred embodiment, a segment of the white LEDs is modulated from time to time at a rate that is slower than the frame rate of camera 111, preferably at about 12 Hz. By using various colors and patterns, coding schemes are possible to encode data such as a different identifier for each LED array. Using data and synchronization pulses sent through the power feeds, the LED tubes can be controlled and updated. By using sufficiently large device numbers, LED tubes can be numbered when manufactured.
(154) Uniquely identified LED tubes offer the dual benefit of more efficient lighting than fluorescent tubes and the opportunity for indoor navigation for smart phones, tablets, and other mobile devices. Camera 111 preferably resolves the LEDs that are switched on or off and using graphics processing in the consumer device 12, calculates relative distances between LEDs that are on or off. The distance to the optical location references are computed using the pixel distance between parts of the optical location reference pattern. The parts of the optical location reference pattern is further comprised of two outer symbols that maintain a known number of LED spaces between them as a spatial reference.
(155) Using accelerometers in each of three planes, the pointing angle of camera 111 or camera 198 of tablet 197 is computed for the mobile device enabling navigations using the encoded sections of each LED tube as a known point in space to reference from. Using at least three such points enables consumer device 12 or robot 120, 150, 199, 200, 210, 230, 240, or 250 to accurately compute its in-store location. Ultrasonic sonar modules 245a-d preferably prevent the robot from colliding with either moving or stationary obstacles by emitting an acoustic pulse and measuring the echo magnitudes and delay times to determine the distance to nearby objects.
(156) Cameras 111 and 197 are also preferably used with tracking the centroid of optical references, optical flow, and vanishing point navigation to recognize and guide a path for robots or shoppers through aisles. Optical flow is the pattern of apparent motion of objects, surfaces, and edges in a retail store caused by the motion of camera 111 or 197. Vanishing point navigation uses the parallel lines of store aisle, shelves, windows, and overhead lighting rails to compute a distant target, such as the end of an aisle; it also provides visual angular alignment for squaring the robot for accurate triangulations and transponder location measurements.
(157) Beams and optical patterns of various types are dispersed through the surrounding space in order to provide an optical point of reference. In some embodiments dispersion is achieved using motion, moving mirrors, and/or other optical elements. In other embodiments, dispersion is achieved using fixed optical elements. In a preferred embodiment color is used to encode angular position relative to a reference angle in any combination of X, Y, or Z planes. A prism or diffraction grating is used in one embodiment to diffract a white light source such as a white LED into red, orange, yellow, green, blue, indigo, and violet. Cameras in mobile devices 12 and 198 preferably use the color encoded information to locate themselves relative to source 180 and an angular reference.
(158)
(159) Sales Floor Mobile Automated Inventory Reading
(160)
(161) Robot 199 reads the identity and actual locations of RFID-tagged merchandise. Robot 199 as shown in
(162) In this preferred embodiment, a helium-filled metallic balloon 190a is tethered to robot 199 at a point midway between the wheels 191a and 191b such that it floats over robot 199 providing a reflective surface to redirect radio waves around obstacles to and from a plurality of transponders. In preferred embodiments, a metallic coating on balloon 190a reflects radio waves from and back to antenna 192. Preferred 0.5 um thick metallization coatings are comprised of aluminum that is preferably grown using a vapor deposition process wherein the metal is heated and evaporated in a vacuum. The metal preferably condenses on a cold polymer film. In any case, metallization of balloon 190a is preferably comprised of one of: PET film, metalized PET, or aluminum foil.
(163) Reflectivity of radio waves from the aluminum skin of a balloon was first investigated by NASA and reported in Technical Note D-115 dated October 1959. George P. Wood and Arlen F. Carter of the Langley Research Center deduce from Maxwell's equations, assuming a sufficiently large wavelength and surface conductivity that the reflectivity of a balloon coated with a 2200 Angstrom aluminum skin is:
R=1−2/SQRT(mu*sigma*lambda*c)
(164) Where: mu=permittivity of free space=4*pi*10.sup.−7 volt-sec/amp-meter, sigma=conductivity of aluminum skin=4*10.sup.6 mho/meter, lambda=wavelength of radio wave=c/f, and c=speed of light=3*10.sup.8 m/sec. The resulting reflectivity R for a range of frequencies between 500 MHz and 2400 MHz is from 99.993% to 99.985%. So therefore, a metalized balloon, having a 2200 to 5000 Angstroms thick aluminum skin will reflect nearly all of the energy that it is directed to its surface by antenna 192.
(165) Further applying the research of Woods and Carter to the calculation of signal loss on a path to the metalized balloon, we implement the following equation:
P.sub.R/P.sub.T=G.sub.A*R*Pi.sup.2/4*D.sub.b.sup.2*Lambda.sup.2/(4*pi)/(16*pi.sup.2*L.sup.4)
(166) Where: P.sub.R=power received, P.sub.T=power transmitted, G.sub.A=Gain of antenna, R=Reflectivity of metalized balloon, D.sub.b=Diameter of metalized balloon, Lambda=wavelength of RFID interrogation signal, L=Path length from antenna to balloon.
(167) The resulting path loss ranges from −12 to −45 dB for a 915 MHz signal that is transmitted and received by an 8 dBi circularly polarized antenna that is aimed into a 0.5 meter diameter metalized balloon with a 0.99991 reflectivity on a tether that is varied from 0.3 to 2.0 meters long.
(168) The path loss is preferably reduced by using a non-spherical balloon shape with a bottom convex surface that has a radius that is much larger than the radius of a spherical balloon with an equal volume. In the above formula D.sub.b.sup.2 would increase by a factor of 100 for a balloon with an apparent radius on the bottom surface that is ten times larger than the equivalent spherical balloon. This can result in a 20 dB improvement in path loss for the reflected signals. This is because of the additional energy reaching a population of transponders and returning much stronger backscattered signals from them to antenna 192.
(169) The reflected 860 to 960 MHz radio waves from balloon bottom surface 190a arrive at RFID transponders in retail stores from angles with a significant horizontal component compared to a direct line of propagation from antenna 192 that originates more nearly at floor level compared to the balloon surface 190a or a reflector 190c.
(170) Using a motor to drive a winch, the length of tether 190b can be varied to provide a range of angles of incidence onto a plurality of RFID transponders. This overcomes a significant problem in retail stores where shelving, fixtures, and merchandise reflect or absorb RFID interrogation signals. Using robot 199 to read RFID transponders in a methodical manner is an improvement over prior art where store employees do not always provide a consistent reading of store inventory. Reflective surfaces of balloon 190a or reflector 190c redirects interrogation signals from antenna 192 such that materials such as shelving and radio absorbent clothing are bypassed so that there is sufficient power reaching transponders and returning along the same signal path to RFID reader 196 with sufficient amplitudes that otherwise unread transponders are read.
(171) Reflector 190c is a reflective surface that is used in certain preferred embodiments. Under FCC rules a passive reflector is considered as part of the antenna assembly of the Part 15 transmitter. At sufficient distances, the passive reflector is allowed so long as it does not increase the overall antenna gain and serves the primary purpose of overcoming RF absorbing obstacles and retro-reflective carrier reflection paths that could saturate the reader's baseband amplifiers. Accordingly, reflector 190c and antenna 192 preferably together form an offset-feed parabolic antenna, the shape of which is an asymmetrical segment of a paraboloid or a near paraboloid shape. Since the gain of a 0.5 meter diameter parabolic antenna for 915 MHz is 11.6 dBi, it is necessary to reduce the transmitter output power in order to comply with FCC regulations. In this preferred embodiment, gain primarily varies with the pointing angle of antenna 192 and as the length of tether 190b changes, resulting in a controlled change in parabolic focal length. For any length of tether 190b that is not equivalent to the focal length, there is an error. Each variation on the order of 8.2 cm, is one quarter of a wavelength and causes a reduction of about 1 dB in antenna gain. Therefore, in order to comply with FCC regulations, certain pre-programmed tether lengths are preferably used to ensure that gain limits for the combined antenna assembly do not exceed part 15 limits. The pointing angle of antenna 192 is controlled using motors 194a,b as angles are sensed by the accelerometers of controller 197.
(172) Battery 195 is mounted below axles 193a and 193b to provide a low center of gravity, the result is inherent stability, unlike that of a classic inverted pendulum robot. A natural tendency on a flat hard floor is therefore that antenna 192 will be oriented with a major lobe of RF power in a generally upward-facing direction.
(173) As robot 199 traverses a retail sales floor or inventory storage areas, it may from time to time encounter obstacles in an otherwise flat surface. Encountering such obstacles can result in antenna 192 suddenly tilting. Robot 199 is preferably comprised of accelerometers and a three-axis gyroscope that detects changes in position and angular orientation. Controller, tablet, or iPad 197 from manufacturers such as Motorola or Samsung preferably detects and responds to changes in orientation under the control of algorithms that take into account the duration of the disturbance and historically related information. Controller 197 preferably learns by recording previous encounters with obstacles at certain locations, and reuses successful maneuvers to escape from known obstacles.
(174) Robot 199 is preferably comprised of proximity sensors such as sonar modules to detect obstacles and boundaries. Sonar modules preferably report range to objects that reflect acoustic waves and enable robot 199 to stop or to take evasive action. Escape maneuvers of robot 199 preferably include reversing, pivoting, and changing direction to go around obstacles such as walls, furniture, and movable objects.
(175) Controller 197 preferably communicates with RFID reader 196 using a wired or wireless connection such as those defined by Apple for iPhone/iPod/iPad accessories. Information from RFID reader 196 is preferably collected and stored using techniques that are described above, including H-Files. In a preferred embodiment, SGTINs are associated with location information which in some cases is provided by reading RFID transponders that are encoded with location codes.
(176) Transponder location information preferably references a system or references points that extend beyond the boundaries of the room or space in which robot 199 is operating. A plurality of transponders can therefore have a distance between them that is greater than the physical dimensions of the space that they are contained within. For example, in a preferred embodiment, RFID location transponders are encoded with high resolution longitude and latitude information. A preferred location identifier for an RFID transponder uses GPS coordinates. Such a location system is preferably used to track the locations of goods on a global scale.
(177) A database preferably collects transponder identities and locations from robot 199 and others like it in retail facilities around the world. The robots periodically upload data to the database as WiFi, 3G, or 4G wireless services are available.
(178) The database preferably comprises means to report the locations of associated transponders to consumer devices wherein the associations are defined by characteristics of the objects that the transponders are attached to. The associations preferably comprise characteristics that include and are defined by fashion, style, or personal preferences. The database preferably accounts for fashion and style changes and alters the associations so that consumers will be more likely result to buy.
(179) The database preferably responds to queries from consumer device 12 such as “where is there a top that goes with these pants at a price under $40?”. Such queries are preferably submitted using a voice command feature such as Apple's Siri.
(180) Referring to
(181) Two-wheeled embodiments of robot 200 preferably have a center of gravity that provides a balance between two important functions: tilting antenna 192 and making movement along a travel path. A center of gravity that is too low will reliably hold mast 201 and tablet 197 in an upright orientation, but will be very difficult to induce into tilted orientations without also inducing oscillation of mast 201 or forward and reverse path motion. Conversely, a center of gravity that is too close to the axis of rotation of wheels 191a,b will be very easy to tilt but may encounter obstacles such as carpet edging that are difficult to pass over without inducing extreme antenna tilting.
(182) Addressing the aforementioned center of gravity challenge, chock 204 is used in certain embodiments to add stability. Chocks like chock 204 on either side of a radiolucent version of wheels 191a and 191b prevent rolling for low center of gravity embodiments, whereby allowing the torque being delivered by motors 194a and 194b through shafts 193a and 193b respectively to wheels 191a and 191b that is used to correct for deviation of robot 200 off of a vertical axis.
(183) Referring now to
(184) In preferred embodiments motors 231a,b are polyphase brushless DC (BLDC) motors. Motor 231a and 231b are preferably three-phase BLDC motors with Hall effect sensors or back EMF sensing to sense the angular velocity and position of the rotor. Motors 231a,b are preferably each comprised of a 100 to 500 watt hub motor measuring about 5 to 9 inches in diameter that benefit from mass production for e-bikes which have recently become globally popular, whereby driving costs down. Preferred robot embodiments using BLDC hub motors 231a,b are an improvement over prior art robots by reducing heavy and expensive gear train parts that prior art robots use to deliver sufficient torque to tilt, roll, and climb in retail store and warehouse environments. Preferred embodiments of robots 199, 200, 210, 230, 240, and 250 using motors 231a,b have sufficient torque and traction to climb ramps and stairs in order to successfully scan all parts of multi-level retail environments. Due to the lack of brushes, BLDC motors 231a,b will not spark, making them better suited for use in environments where there are volatile chemicals or fuels.
(185) Micro-stepping of BLDC motors 231a,b using sine-cosine phasing is used in preferred embodiments. Micro-stepping motor drives preferably include a torque feedback loop that controls the current through an H-bridge on each phase using phase current modulation such as pulse width modulation (PWM) to switch phase current on and off in a controlled manner, allowing freewheel current to circulate through a freewheeling diode for each phase as the magnetic flux gradually subsides in a current waveform that resembles a saw tooth. Preferred embodiments use coreless motors with Litz wire coil windings to reduce eddy current losses and wheel weight. Current and therefore torque delivered to motors 231a,b or motors 194a,b is preferably controlled by a proportional-integral-derivative (PID) control loop for antenna tilt, holding a stable position or posture, or for ascending or descending ramps, unlevel floors, or stairs. PID control loops preferably use accelerometers and gyros to sense and control to certain positions or postures while moving or standing in one place. Torque and speed control are independently controlled for motors 231a,b or 194a,b to move, tilt, or rotate the robot around its central vertical axis or for an active differential for smooth turns about a desired turn radius.
(186) Hub motor 231a, preferably comprising a central axle is coupled to wheel 191a with a disc or spokes to a rim for holding a tire or other traction surface. The same is preferably true for motor 231b and wheel 191b such that robot 210, 230, 240, or 250 preferably comprises two wheel hub motors. The disc or spokes preferably provide an axle height above the floor that enables sufficient clearance for counterbalancing mass and weight to be placed below the axle whereby moving the center of gravity for the entire robot 199, 200, 210, 230, 240, or 250 below the axles. In preferred robot embodiments battery 195 comprises a significant part of that counterbalancing mass and weight. Lead acid, LiNiMnCo, LiFePO4, lithium phosphate, or lithium-ion batteries deliver up to 50 amps to wheel hub motors in preferred embodiments of battery 195.
(187) Reflector 190c is preferably parabolic and is rotated through various angles to redirect the elevation angle of the primary lobe from antenna 211 along central axis 214b that results from incident wave front that is aligned along central axis 214a. Bottom reflector 211a is shown to scale, providing the end-fire functionality of helical antenna 211. Reflector 190c is preferably rotated through various operating angles with a servo-controlled motor. In other preferred embodiments, shape memory wire is used by running a current through it to alter the length of the wire, whereby moving a low mass reflector 190c through a range of scanning angles. In other preferred embodiments a rotating polygon is used to steer beam 214b through a range of elevation angles. Wheels 191a and 191b are counter rotated to sweep beam 214b through azimuth angles.
(188) In preferred embodiments, reflector 190c is a metalized inner surface of an inflatable radiolucent skin. The inflatable radiolucent skin (IRS) preferably has metalized reflective coating selectively applied for form a radio signal reflector, which preferably forms a parabolic reflector that compensates for gain loss and maintains beam focus while redirecting it toward a plurality of RFID transponders. The IRS reflective surface comprises an inflatable radiolucent skin to define and retain a desired shape for aesthetic or safety reasons. IRS is an inverted combination of balloon 190a and reflector 190c from
(189) RFID reader 212 is preferably used in certain preferred embodiments for shopper 219 to read RFID transponders on items for sale. In certain embodiments, reader 212 is not needed, especially if leakage from helical 211 is sufficient for reading transponders or if the feature is not needed. Reader 212 is in the embodiment of
(190) RFID reader 213 is preferably used in certain preferred embodiments to read RFID transponders that report physical locations on floor 218. Transponders reporting physical location are preferably rugged and operate well even if embedded in a concrete floor. UHF, HF, and LF transponders are all candidates; however the lower frequency transponders are generally better suited as floor location markers.
(191) In
(192) Hook 216 carries items that are on hangers and also preferably pass through the field of an on-board RFID reader such as reader 212. In preferred embodiments, hook 216 or a basket have an electronic scale for measuring the weight of goods; weight measurement is preferably used for self-checkout, loss prevention. A preferred embodiment of robot 210 determines when items have been added to or removed from basket or hook 216. Preferred embodiments of
(193) Certain preferred embodiments of robot 210 use iPad 197 to collect payment based on the items that are in basket or hanging hook 216, or otherwise identified as being sold to shopper 219. Payment collection preferably includes the processing of a credit card or a store account. Preferred embodiments of robot 210 have credit card reader that can preferably read magnetic stripe cards, chip cards, or NFC cards and mobile phones. Certain preferred embodiments of iPad 197 or similar devices have NFC (Near Field Communications) readers for wireless transactions with chips and mobile phones like consumer device 12.
(194) Retail store employees also preferably have robot 210 carry or contain an RFID transponder encoder for tagging store merchandise. On-board RFID readers are preferably used for verification of PPR encoded transponders and committing them to an inventory database that preferably includes the location of the tagged item.
(195) Referring to
(196) In an alternative embodiment, helical antenna 211 is replaced by a planar high gain reader and antenna. In this alternative embodiment, reader and antenna 190c directs a focused lobe of energy in a horizontal direction away from shopper 219. In certain preferred embodiments, high gain antenna 190c is a steerable phased array antenna that sweeps radio energy in elevation and azimuth having the advantage of sweeping a beam without using moving mechanical parts. This provides advantages of multiple view points of a tag population and increasing the probability of reading all tags within the target population despite some views having high levels of carrier reflection back into the receiver of the RFID reader.
(197) The figures and descriptions for robots 120, 124, 150, 180, 199, 200, 210, 230, 240, 250, 336, and 337 teach novel solutions to the problem of providing cost effective means for accurately reading inventory counts and locations, even during the hours of regular business operations.
(198) A helpful and interactive shopping experience can be delivered to shoppers with the likely result that they will find what they want to buy, with less time and effort, and will probably recommend the store to their friends and will probably return again for more shopping. Using camera 198 iPad 197 uses visible information from shopper 219 to display images and information about sellable items having RFID transponders attached. These robots interact with consumer devices 12 utilizing the multi-channel shopping solutions described above.
(199) Communication between consumer device 12 and iPad 197 preferably uses a WiFi or Bluetooth connection to exchange information that informs shopper 219 and assists in the sales process. In a preferred embodiment shopper 219 using WiFi calls for assistance from a robot and robot 210 arrives at her location to provide assistance. Once robot 210 arrives, a Bluetooth connection is preferably established to offload the WiFi network and to provide a dedicated and responsive interaction between iPad 197 and consumer device 12. Interactions preferably include evaluation of selected products and suggestion to shopper 219 similar, matching, or compatible products. iPad 197 also preferably helps shopper find items of interest that are on sale, such as an end of season sale. iPad 197 also preferably helps shopper 219 select enough items of interest to reach a total sales amount that qualifies for coupon, gift card, or rebate. As part of this process iPad 197 displays the running tally of goods selected for purchase and suggests interesting items for final purchases that will fulfill the minimum purchase requirements for the retailer's incentive. A preferred result is the shopper 219 enjoys the experience and buys more goods.
(200) To enhance the consumer smartphone experience, in a preferred embodiment, consumer device 12 has an RFID reader that eavesdrops to read RFID transponders that are illuminated by antenna 211. RFID transponders preferably remain powered while a low power reader 12d on consumer device 12 interrogates tags at a larger range that it would otherwise be able to for lack of power. In a preferred embodiment antenna 211 emits continuous wave power to the plurality of transponders, leaving short gaps of time for low power consumer devices 12 to interrogate the same transponders while the transponders are still powered. The preferred result is the ability to read the illuminated transponders at a much greater range. In another preferred embodiment, consumer device 12 and interrogator 12d eavesdrops on the interrogation process that is performed by read and antenna 211. The preferred result is a substantial improvement in range without using battery power from consumer device 12 to power the plurality of transponders.
(201) In preferred embodiments the robot directs its antenna 211 beam toward the place where shopper 219 is reading transponders to illuminate the transponders and make the inventory more visible to consumer device 12. Robot 210 preferably receives information about where shopper is interested by one of several methods including location coordinates from consumer device 12, receiving radio signals from interrogator device 12d, visual information through camera 214, or other means. Preferred embodiments of robot 210 have multiple UHF receivers positioned to sense RF interrogation signals around its perimeter in order to identify the location of shopper 219 and illuminate transponders for the consumer device 12 of shopper 219.
(202) In a preferred embodiment, consumer device 12 initiates a transfer of data to robot 210 that includes wish lists, saved shopping carts from online shopping, size, color, and style preferences. Robot 210 then uses that information to lead shopper 219 to goods on a retail sales floor that is likely to interest shopper 219, whereby increasing the probability of a sale. Robot 210, having physical mobility, detailed inventory location and stocking information, and the desires of shopper 219 preferably result in iPad 197 computing a sales strategy that includes touring of the sales floor with shopper 219 in tow. The touch screen of iPad 197 preferably displays information to shopper 219 that makes informed suggestions, and using audio, visual, or other cues, determines what to do next.
(203) Referring now to
(204) It is important for high gain antenna 211 to move through angle 242 to arrive at antenna positions 211a-d to generate multiple beam path vectors 241a-d that result in multiple read occurrences for triangulation computations to reliably determine the location of each detected transponder. Preferred embodiments use accelerometers on reflector 190c or struts 190b1,2 or a shaft encoder at bearing set 244 so that beam redirection angles can be computed and controlled. In a preferred embodiment this inherently upright reflective structure has an enclosure or an inflatable skin to attain aesthetic or safety features. Ultrasonic sonar modules 245a-d are placed to detect obstacles as described above.
(205) Referring to robot 250 of
(206) Proximity sensors 245c-d, such as sonar modules are used to sense and avoid collisions with obstacles. Additional sensors are preferably on robot 250's perimeter.
(207) Radiolucent skin 254 of robot 250 is preferably comprised of a plastic material that does not absorb or reflect radio waves in the 860 to 2600 MHz range. Skin 254 is preferably adapted to accept an advertising wrap with custom graphics for customizing robot 250 to harmonize with retail store appearance, color, style, attitude, and motif.
(208) Forward and return aisle traversal of robot 250 with swept narrow beam antenna 211 preferably produce tag discovery maps as shown in
(209) Referring now to
(210) Referring to prior art in
(211) Referring now to
(212) Triangulation computations for computing the location of transponder 13a in
(213) The above calculations are based on the use of a narrow beam, high gain antenna directed along selected vectors in order for the triangulation computations to be valid and accurate. In preferred embodiments, the antenna gain has a minimum of 11 dBic in order to form a narrow interrogation field from an RFID interrogator coupled with the antenna, for reading tags in a narrow sector of RFID-tagged inventory items at any one time. This narrowly focused beam reduces the probability that a scan will be blinded by un-modulated carrier being reflected into the receiver or for off-axis transponders to confound location by being illuminated and responsive to the carrier beam. Preferred embodiments detect amplifier saturation from blinding reflections and record the beam vector and location of blinding carrier reflections. Avoidance of or saving points of location reference are preferred uses of that stored information, enabling multi-dimensional alignment of scans from day to day.
(214) Lacking a narrow beam antenna, prior art RFID tag reading methods fail to make proper use of the EPC-defined inventoried state of tags that enter the read field off-axis, since that off-axis distance can be large relative to the read range. Proper use for determining the location of the tags with minimal error requires that the field be swept across the transponders from more than one direction, preferably from multiple directions. Since the EPC protocol provides for inventoried tags to become silent, they will not be read again in that inventory round. In most cases the tag will not be inventoried at the center of the carrier beam, but more likely at some point somewhere between the 3 dB beam edges. This introduces angular error, with greater angular error for wide beams that emerge from low gain antennae. Inventory rounds are preferably swept across the tag from multiple angles, preferably using a high gain antenna in order to reduce the magnitude of location error.
(215) Another cause for tags to not read is for a tag to be located at a null in the carrier field. A solution to this problem is to scan again from a different angle, as prescribed above for reducing location errors.
(216) Much prior art was invented for case level tagging. Now the market needs a different solution for item level tagging. Those skilled in the art did not adequately address retail sales floor scanning needs. Retailers cannot afford to miss item tags; there may be 10 to 500 times more item level tags than case level tags in a retail store environment, each representing an item that must be sold.
(217) Automated movement of two-wheeled robot 199, 200, 210, 230, 240, or 250 is based on two separately driven wheels 191a,b on either side of the robot. It changes its direction by differentially varying the relative rate of rotation of its wheels and does not require an additional steering motion.
(218) Referring now to
(219) Referring to
(220) Synchronized opposing angular velocity pulses 323a and 324a result in a net zero torque resulting in no change in elevation of antenna 211 but does result in robot wheels 191a,b moving into positions 312 to create beam pattern 312p.
(221) The synchronized wheel movements represented by low acceleration angular velocity profiles 323b, 326a, and 326b result in a new position 313 and beam pattern 313p. Additional velocity pulses 327a and 328b result in a rotation of the robot in a clockwise direction. Positions 314-316 and radio beam coverage patterns 314p-316p are the result of synchronized movements of the motors that drive wheels 191a,b at velocities and accelerations that when the inertia of the robot is taken into account, result in elevation angle changes or position changes.
(222) Prior art, if at all, at best teaches the use of RSSI or varying power to determine the range of transponders. Wide interrogation beams are susceptible to more retro-reflections. The present invention additionally teaches the use of narrow radio beams directed at various scan angles into a plurality of transponders, a sub-population of which are preferably privacy-preserving transponders with recommissioning features. The scan angles are produced by torque control of wheels 191a and 191b.
(223) Intermediate transponder location data preferably comprises transponder observations that are used for triangulation computations. Scan results are preferably reported in stages, the second stage comprising: SGTIN; observation point (i.e. location of robot x, y, z); viewing angle (elevation and azimuth); and RF power level (db). Each stage is stored and processed to produce a computation of each tag's location using a descriptor comprising: SGTIN; and computed X, Y, Z Cartesian location. The processing comprises the steps of: 1) Match all first stage SGTIN observations and consolidate the detection records 2) Match any second stage observations to the consolidated first stage records 3) Combine the first and second stage records by formulating the three dimensional vector for both stages and compute the Cartesian point of intersection. 4) Match the result to any previous result of computed X, Y, Z location in a third stage. If there are no matches, then store as final stage transponder location data.
(224)
(225) Aerial robot 124 is shown suspended over table 333b by cables, 122a-d and controlled by servo winches 121a-d. Winch 121c is shown using WiFi antenna 146b to receive commands from a controller to drive cable drum 146a to create proper tension and positioning for controlled aerial mobility at precise altitudes above the sales floor.
(226) Aerial robots 120 and 150 are suspended from the ceiling. Track 121 guides the path of robot 120 for aerial mobility. Luminary readers 176 and 180 are shown over rounders 332a and 332e respectively.
(227) Aerial robots UAV 336 and blimp 337 and two-wheeled robots 199, 200, 210, 230, 240, and 250, rotating rounder reader 148a, and consumer device 12 all preferably use overhead optical location reference strips 160a-c and location tags 148b, 334a1-3,b1-3,c1-2,d1-3 for navigation reference points.
(228) While the invention has been particularly shown and described with reference to certain embodiments, it will be understood by those skilled in the art that various changes in form and detail may be made without departing from the spirit and scope of the invention.