Intelligent shopping cart, intelligent shopping system and implement method therefor
11004053 · 2021-05-11
Inventors
Cpc classification
G06Q20/208
PHYSICS
G07G1/0072
PHYSICS
B62B5/0096
PERFORMING OPERATIONS; TRANSPORTING
International classification
B62B3/14
PERFORMING OPERATIONS; TRANSPORTING
B62B5/00
PERFORMING OPERATIONS; TRANSPORTING
Abstract
An intelligent shopping cart, an intelligent shopping system and an implementation method thereof. The intelligent shopping cart includes a cart body; and the cart body includes a storage unit and a handle, and further includes an intelligent terminal device configured on the handle. The intelligent terminal device is provided with a touchscreen computer having a display function and/or an operation function. The cart body is provided with an RFID tag for storing number information of the intelligent shopping cart. The cart body is further provided with a device in a communication connection to the touchscreen computer, and the device at least includes one or a combination of a weight sensor, a monitoring device, a code-scanning device, a positioning device, and a voice broadcasting device.
Claims
1. An intelligent shopping cart, comprising: a cart body, wherein the cart body comprises a storage unit and a handle; and an intelligent terminal device configured on the handle; wherein the intelligent terminal device is provided with a touchscreen computer having a display function and/or an operation function; the cart body is provided with an RFID tag for storing number information of the intelligent shopping cart; the cart body is provided with a device in a communication connection to the touchscreen computer, and the device comprises a weight sensor, a plurality of monitoring devices, a code-scanning device, a positioning device, and a voice broadcasting device; and wherein the weight sensor is configured to collect weight information of a commodity and send the weight information to the touchscreen computer; the plurality of monitoring devices are configured to read barcode information of the commodity and/or record image information of the commodity, and send the barcode information and the image information to the touchscreen computer; the code-scanning device is configured to read the barcode information of the commodity, and send the barcode information to the touchscreen computer; the positioning device is configured to receive a signal sent by an LED positioning light arranged in a supermarket, decode the signal and send a decoded signal to the touchscreen computer; the voice broadcasting device is configured to play a voice prompt of a shopping operation to a user; the touchscreen computer is configured to receive the weight information of the commodity, the barcode information of the commodity and/or the image information of the commodity, send out, and display the weight information, the barcode information and/or the image information of the commodity after receiving a confirmation instruction; or the touch screen computer is configured to receive and compare the weight information of the commodity, the barcode information of the commodity and/or the image information of the commodity, with original information of the commodity, and then display comparison information of the commodity; when the intelligent shopping cart is in a stationary state, values collected by the weight sensor are all started with “st”, and the collected values can be used as an actual total weight of commodities; when the intelligent shopping cart moves smoothly, an average value of several weight data collected by the weight sensor within 2 seconds is taken as the actual total weight of the commodities; when the intelligent shopping cart is moving strenuously, the values collected by the weight sensor cannot be used as the actual total weight of the commodities; and when the intelligent shopping cart changes from a moving state to the stationary state, and the weight sensor collects six consecutive and identical values starting with “st”, then weight values read by the weight sensor are determined as stable and accurate, and the weight values are used as the actual total weight of the commodities; when the intelligent shopping cart is in an unlocking state, the total weight of the commodities in the shopping cart is continuously detected in real time by the weight sensor; after continuously detecting and obtaining a total weight mn+1 of the commodities in the shopping cart by the weight sensor, the total weight mn+1 of the commodities is compared with a total weight mn of the commodities obtained after a previous selection behavior is completed to obtain a variation value mΔ of the total weight of the commodities; when mΔ>0, determining that the commodities to be purchased are placed in the intelligent shopping cart; when mΔ<0, determining that the commodities to be purchased are taken out from the shopping cart; and when mΔ=0, determining that there is no operation on the commodities to be purchased.
2. The intelligent shopping cart according to claim 1, further comprising a smart bracelet in a communication connection to the touchscreen computer, and the smart bracelet is internally provided with an RFID tag reader for a non-contact reading of price information of the commodity, and transmitting the price information to display on the touch screen computer.
3. The intelligent shopping cart according to claim 1, wherein the intelligent shopping cart is further provided with a charging device, and the charging device is configured to cooperate with an external charging equipment to provide electric energy for components of the intelligent shopping cart requiring power supply driving.
4. The intelligent shopping cart according to claim 1, wherein the intelligent terminal device is provided with an NFC payment device for payment.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1)
(2)
(3)
(4)
(5) In the drawings, 1. handle, 2. peripheral charging port, 3. intelligent terminal device, 4. storage unit, 5. weight sensor, 6. shopping device, 7. RFID tag, 8. monitoring device, 9. code-scanning device, 10. charging device, 11. voice broadcasting device, 12. positioning device, 13. touchscreen computer, 14. NFC payment device, 15. battery.
DETAILED DESCRIPTION OF THE EMBODIMENTS
(6) The principles of the present disclosure will be described with reference to some exemplary embodiments. It should be understood that these embodiments are described only for the purpose of illustration and helping those skilled in the art understand and implement the present disclosure, and are not intended to suggest any limitation to the scope of the present disclosure. The content of the present disclosure described herein can be implemented in various ways other than those described below.
(7) As described herein, the term “include/including” and its various variants may be understood as an open-ended term, which means “include/including but not limited to”. The term “based on” can be understood as “at least partially based on”. The term “one embodiment” can be understood as “at least one embodiment”. The term “another embodiment” can be understood as “at least one other embodiment”.
(8) Referring to
(9) The above-described intelligent shopping cart can be implemented by the following steps:
(10) Step 1: After the user selects the product, the commodity barcode is placed in front of the code-scanning device 9 for reading. Meanwhile, the picture information of the commodity is started to be collected and analyzed by the monitoring device 8 until the user puts the commodity into the shopping device 6 or the time for the user to place the commodity has passed. The on-site information of the commodity to be purchased, that is, the weight of the commodity, the commodity information and the image information in the shopping device 6, is respectively acquired by the weight sensor 5, the code-scanning device 9 and the monitoring device 8 provided on the intelligent shopping cart; and the on-site information is sent to the intelligent terminal device 3 for comparison with the original information. Namely, when the on-site information is consistent with the original information, the selected commodity is added into the commodity purchase list and displayed on the touchscreen computer 13. If the commodity information is inconsistent with the original information, the commodity information is transmitted to the server through the network for recording, meanwhile, the user is prompted that the placed commodity is wrong and the correct commodity needs to be re-put, by the touchscreen computer 13. If the user puts the inconsistent commodities for many times, the shopping cart can be locked, the user can be prohibited from entering and exiting, and alerting is sent to the supermarket management personnel.
(11) Step 2: The original information of the commodity can be stored in the touchscreen computer 13. After receiving the weight information, barcode information and/or image analysis information of the commodity selected by the user, the touchscreen computer compares them with the original information of the commodity. If the information comparative result of the received information with the original information is consistent, the corresponding commodity information is displayed on the touchscreen computer 13; if the information comparative result is inconsistent, the message prompting that the commodity information is wrong is displayed on the touchscreen computer 13.
(12) Step 3: The user can store the personal belongings that need to be stored in the storage unit 4 of the intelligent shopping cart, and has no need to go to the storage cabinet to queue up for storage.
(13) Referring to
(14) The specific method for comparison described above includes: after several commodities are placed in, obtaining the total weight m.sub.2 of the accumulated commodities; when the user completes the shopping and moves towards the automatic settlement exit, weighing the total weight of the user, the placed commodities and the intelligent shopping cart through the loadometer in front of the gate to obtain the final total weight information m.sub.0; meanwhile, sending the information to the server; and performing weight check and calculation by comparing the sum of the original total weight m.sub.1 of the user and the intelligent shopping cart weighted when entering the supermarket and the total weight information m.sub.2 of the purchased commodities with the final total weight information m.sub.0;
(15) 1-1) if m.sub.1+m.sub.2=m.sub.0, sending a payment confirmation message to the user's smartphone through the server, prompting the user whether the total price of the purchased commodities is paid; and the user pays through the smartphone or the NFC payment device 14 on the intelligent shopping cart; after the payment is completed, opening the exit gate; and
(16) 1-2) if m.sub.1+m.sub.2≠m.sub.0, it means that there is an abnormality, sending an alarm message to the security inspector to check. Among them, the original information and the on-site information involved in the present invention include the weight, image, barcode and price of the commodity, and/or the number information of the intelligent shopping cart, etc.
(17) As a preferred solution in this embodiment, the intelligent system is further configured with the following algorithm for weight identification of commodities.
(18) 2-1) The intelligent shopping system is configured for a real-time acquisition of three-axis acceleration of a three-axis acceleration sensor on the intelligent shopping cart. When the intelligent shopping cart is in a stationary state, assume the static accelerations of x, y, and z axes are ax, ay, and az, respectively. When the intelligent shopping cart is moving, the differences between the real-time accelerations and the static accelerations of three axes are axΔ, ayΔ, and azΔ, respectively. When the differences axΔ, ayΔ, and azΔ are within a predetermined range, the intelligent shopping cart is considered to be in the stationary state; otherwise, the intelligent shopping cart is in a motion state.
(19) 2-2) A specific method used by the intelligent shopping system to collect data from the weight sensor is as follows:
(20) when the shopping cart is in a stationary state, the values collected by the weight sensor are all started with “st”, that is, the collected values can be used as the actual total weight of the commodities;
(21) when the shopping cart moves smoothly, the average value of several weight data collected by the weight sensor within 2 seconds is taken as the actual total weight of the commodities;
(22) when the shopping cart is moving strenuously, the values collected by the weight sensor cannot be used as the actual total weight of the commodities; and
(23) when the shopping cart changes from a moving state to a stationary state, and the weight sensor collects six consecutive and identical values starting with “st”, the weight values read by the weight sensor are stable and accurate, and the values can be used as the actual total weight of the commodities.
(24) The above-described method further includes: after obtaining the reported data of the weight sensor, first storing the reported data in a motion data array; if the data starts with “st”, storing the data in a static data array; if not, clearing the static data array. When the static data array includes 6 data, and the data are all equal to each other, the actual weight of the commodities can be output, and the motion data array is cleared at the same time. Otherwise, after the data of the motion data array reaches a certain number, the average value of the data, i.e., the actual total weight of the commodities, is calculated.
(25) 2-3) The intelligent shopping system is configured for receiving the commodity barcode information sent by the code-scanning device, and sending the commodity barcode information to the server to request the original information of the commodity.
(26) Further, the specific method of determining the user's operation action on the selected commodity by receiving the data sent by the weight sensor is as follows.
(27) The total weight of the commodities in the shopping cart is continuously detected in real time by the weight sensor. When the shopping cart is in an unlocking state, the total weight of the commodities in the shopping cart is continuously detected in real time by the weight sensor.
(28) The total weight m.sub.n+1 of the commodities in the shopping cart is continuously detected and obtained by the weight sensor. The total weight m.sub.n+1 of the commodities is compared with the total weight m.sub.n of the commodities obtained after the previous selection behavior is completed to obtain the variation value m.sub.Δ of the total weight of the commodities. When m.sub.Δ>0, it can be determined that the commodity to be purchased is placed in the shopping cart; when m.sub.Δ<0, it can be determined that the commodity to be purchased is taken out from the shopping cart; and when m.sub.Δ=0, it can be determined that there is no operation on the commodities to be purchased.
(29) Further, the absolute value |m.sub.Δ| of the variation value is compared with the standard weight m.sub.0. Specifically, the absolute value |m.sub.Δ| is the actual weight of the commodities to be purchased.
(30) If |m.sub.Δ| falls within the interval value m.sub.min−m.sub.max of m.sub.0, it is determined that |m.sub.Δ| is consistent with m.sub.0, namely, the commodity identification result is: the obtained pre-stored information of commodity is consistent with the information of the commodity to be purchased, and the action information of determination is correct. Then, for the commodities to be purchased that are determined as being placed in the shopping cart, the pre-stored information thereof is saved in the shopping list. For the commodities to be purchased that are determined as being taken out from the shopping cart, the pre-stored information of the commodities to be purchased is prompted to be deleted from the shopping list.
(31) If |m.sub.Δ| is outside the interval value m.sub.min−m.sub.max of m.sub.0, it is determined that |m.sub.Δ| is inconsistent with m.sub.0, namely, the commodity identification result is: the obtained pre-stored information of commodity is inconsistent with the information of the commodity to be purchased, and/or the action information of determination is incorrect. Then, prompting that the commodity information is wrong is performed, and the shopping cart is automatically locked.
(32) As a preferred solution in this embodiment, the intelligent shopping system is further configured with the following algorithm for image identification of commodities.
(33) 3-1) The monitoring device 8 is placed at a position where the picture of the interior of the shopping device 6 can be photographed, the touchscreen computer 13 receives the barcode information sent by the code-scanning device 9, and the algorithm is started. First, a quadrangular frame is drawn along the four sides of the shopping device 6 on the screen of the touchscreen computer 13 as a warning frame A of the shopping device 6.
(34) 3-2) Before the user starts shopping, that is, when no commodities appear above the shopping device 6, a picture of the shopping device is captured at this moment by the monitoring device installed on the touchscreen computer 13, as the background image before the next shopping, and recorded as the background picture P1.
(35) 3-3) When the user is in shopping, the barcode printed on the commodity to be purchased is placed in the infrared code-scanning area in front of the touchscreen computer 13 for scanning, and when the code-scanning device 9 scans the barcode or the two-dimensional code and identifies the information of the commodity, the monitoring device 8 captures the screen containing the target commodity at this moment and records it as P2.
(36) 3-4) The background image P1 is subtracted from the picture P2 containing the target commodity to obtain an initial region R1 of the target commodity. At the moment, R1 is within the range of the warning frame A of shopping device 6 monitored by the monitoring device 8, that is, R1 is included in A.
(37) 3-5) In the following time, the mean shift algorithm is used to track the region R1 in each frame of video, frame by frame. If region R1 does not belong to A, the target commodity is determined to be out of bounds and not placed in the shopping device 6 of the intelligent shopping cart. If R1 always belongs to A within the predetermined time, shopping is determined to be successful and the target commodity is placed in shopping device 6.
(38) In some embodiments, the commodities are added to the shopping list displayed on the touchscreen computer 13 when both the weight algorithm and the video algorithm identify that the commodities are placed in the shopping device.
(39) In some embodiments, the commodities are deleted from the shopping list displayed on the touchscreen computer 13 when both the weight algorithm and the video algorithm identify that the commodities are taken out from the shopping device.
(40) In some embodiments, after the user aims the barcode of the commodity at the code-scanning device on the intelligent shopping cart for scanning, the monitoring device starts to collect image information, and sends all the collected image information to the server, and the server uses the image identification algorithm to store the data. This algorithm is configured inside the touchscreen computer for processing, without the need of the operation of transmitting the image information to the server, which can reduce the network pressure of the supermarket.
(41) When identification results of the above-described weight algorithm and video algorithm are inconsistent, the touchscreen computer 13 prompts the user to re-operate.
(42) In some embodiments, the intelligent shopping system further includes an ultra-high-frequency radio frequency reader arranged at an exit/entrance of the supermarket and in a communication connection to the server. The ultra-high-frequency radio frequency reader is configured to read the number information of the intelligent shopping cart stored on the RFID tag 7 and send the number information to the server. The server, interacting with the touchscreen computer 13, is configured to store the original information of the commodities, receive the on-site information sent by devices connected to the intelligent terminal device 3, compare the on-site information with the corresponding original information, and finally send the prompt information obtained after comparison to the touchscreen computer 13. Regardless of the weight identification algorithm or the video identification algorithm of the commodities, the on-site information should be compared with the original information of the commodities. According to the traditional habits of the supermarket and the settings of this system, the raw data of the commodities are stored in the server. The information can also be stored in a memory of the touchscreen computer. When the commodity information on the server is changed, the touchscreen computer on the shopping cart is updated in real time to ensure the consistency of the original information of the commodity on the touchscreen computer and the server.
(43) In some embodiments, a method for implementing the above-described intelligent shopping system is as follows.
(44) When the user enters the supermarket entrance, the RFID tag 7 at the front end of the intelligent shopping cart is read by the ultra-high-frequency radio frequency reader arranged at the entrance to record the cart information of the intelligent shopping cart. Then, the user login is performed by inputting the mobile phone number, scanning the personal QR code, or scanning the scan code by WeChat through the touchscreen computer 13 on the intelligent shopping cart; and the touchscreen computer 13 is in a communication connection to the server to obtain the basic information of the user. Meanwhile, the initial total weight m.sub.1 of the user and the intelligent shopping cart when entering the supermarket is weighed by the loadometer arranged at the supermarket entrance.
(45) After the user selects one commodity, there are two ways to read the information of the commodity: 1. making the smart bracelet on user's wrist to close to the price tag of the commodity, then reading the commodity information by the RFID tag reader internally provided in the smart bracelet by an non-contact manner, and sending the information to the intelligent shopping cart through the wireless Bluetooth technology; 2. placing the barcode of the commodity in front of the code-scanning device 6, and transmitting the information to the touchscreen computer 13.
(46) Finally, the intelligent shopping cart is connected to the server of the supermarket through the network to obtain the commodity information and display it on the screen of the touchscreen computer 13. After the commodity information is read, the commodity can be placed in the shopping device 6.
(47) Each time a commodity is placed, when the user places the commodity in the shopping device 6, the weight sensor 5 at the bottom of the intelligent shopping cart will sense that an object is placed in. When stable weight information of the commodity is obtained, the weight value is sent to the touchscreen computer 13 of the intelligent shopping cart, meanwhile, the image information of the placed commodity is acquired and collected by each monitoring device 8 to be sent to the touchscreen computer 13 for tracking analysis, and then the obtained weight information and image information is compared with the original information stored in the database. If the commodity information is inconsistent with the original information, a comparison result is transmitted to the server through the network for recording, meanwhile, the user is prompted that the placed commodity is wrong by the touchscreen computer 13, and the user is prompted that the correct commodity needs to be re-put by the voice broadcasting device 11. If the user puts the inconsistent commodities for many times, the shopping cart can be locked, the user is prohibited from entering and exiting, and alerting is sent to the supermarket management personnel. When the on-site recorded information is consistent with the information stored in the database of the server, the on-site recorded information is sent to the touchscreen computer 13, and the selected commodity is added into the commodity purchase list.
(48) As a preferred solution in this embodiment, after several commodities are placed in, the total weight m.sub.2 of the accumulated commodities and the image information of each commodity are obtained. When the user completes the shopping and moves towards the automatic settlement exit; the information of the RFID tag 7 in front of the intelligent shopping cart is read through the ultra-high-frequency radio frequency reader; and the total weight of the user, the placed commodities and the intelligent shopping cart is weighed through the loadometer before the gate to obtain the final total weight information m.sub.0. Meanwhile, the information is sent to the server; and weight check and calculation is performed by comparing the sum of the initial total weight m.sub.1 of the user and the intelligent shopping cart weighted when entering the supermarket and the total weight information m.sub.2 of the purchased commodities with the final total weight information m.sub.0.
(49) If m.sub.1+m.sub.2=m.sub.0, a payment confirmation message is sent to the user's smartphone through the server to prompt the user whether the total price of the purchased commodities is paid; and the user pays through the smartphone or the NFC payment device 14 on the intelligent shopping cart; after the payment is completed, the exit gate is opened; and
(50) if m.sub.1+m.sub.2≠m.sub.0, it means that there is an abnormality, an alarm message is sent to prompt the security inspector to check. When the abnormality has been removed and the payment is completed, the exit gate is opened; and the user is prompted to take the personal belongings and this shopping is over by the voice broadcasting device 11.
(51) In addition, when users purchase commodity, they are troubled by the fact that they cannot find the place where the goods are placed, and often need to find someone to ask. The positioning device 12 receives a signal sent by the positioning tag arranged in the supermarket and sends to the intelligent terminal device 3; the intelligent terminal device retrieves the pre-stored map data to plan the path; and then the touchscreen computer 13 can load the map to formulate a route for the user, and can also implement the push of promotional advertisements in the positioning region.
(52) It should be understood that various portions of the present invention may be implemented by hardware, software, firmware or a combination thereof. In the above-described embodiments, multiple steps or methods may be implemented by software or firmware that is stored in a memory and executed by an appropriate instruction execution system. For example, if the multiple steps or methods are implemented by hardware, as in another embodiment, they can be implemented by any one or combination of the following techniques well known in the art: discrete logic circuit with logic gate circuit for implementing logic functions on data signals, application-specific integrated circuit with appropriate combination logic gate circuit, programmable gate array (PGA), field programmable gate array (FPGA), etc.
(53) In the description of the present specification, the description of reference terms “one embodiment”, “some embodiments”, “example”, “specific example”, “some examples”, etc. means that specific features, structures, materials or characteristics described by the embodiments or examples are included in at least one embodiment or example of the invention. In the present specification, the exemplary illustrations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the described specific features, structures, materials, or characteristics may be combined in an appropriate manner in any one or more embodiments or examples.
(54) In general, the various embodiments of the present disclosure can be implemented by hardware or special purpose circuits, software, logic, or any combination thereof. Some aspects can be implemented by hardware, while others can be implemented by firmware or software. The firmware or software can be executed by a controller, microprocessor or other computing device. Although various aspects of the present disclosure are shown and described as a block diagram, a flow diagram, or represented through some other drawings, it should be understood that the blocks, devices, systems, techniques, or methods described herein may be implemented in a non-limiting manner by hardware, software, firmware, special purpose circuits or logic, general purpose hardware or controller or other computing devices, or some combinations thereof. In addition, although the operations are described in a particular order, this should not be construed that such operations are required to be performed in the illustrated order or in a sequential sequence, or that all illustrated operations are performed to achieve the desired results. In some cases, multitasking or parallel processing may be advantageous. Similarly, although the details of several specific implementations are included in the above discussion, these should not be construed as any limitation to the scope of the present disclosure, but rather the descriptions of the features are only for specific embodiments. Certain features described in some separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features described in a single embodiment can also be implemented separately or in any appropriate sub-combination in multiple embodiments.