Disclosed are visual recognition and sensor fusion weight detection system and method. An example method includes: tracking, by a sensor system, objects and motions within a selected area of a store; activating, by the sensor system, a first computing device positioned in the selected area in response to detecting a presence of a customer within the selected area; identifying, by the sensor system, the customer and at least one item carried by the customer; transmitting, by the sensor system, identifying information of the customer and the at least one item to a computing server system via a communication network; measuring, by the first computing device, a weight of the at least one item; transmitting, by the first computing device, the weight to the computing server system via the communication network; and generating, by the computing server system, via the communication network, transaction information of the at least one item.

A portable checkout unit automatically generates training data for an automatic checkout system as a customer collects items in a store. A customer uses an item scanner of portable checkout unit to generate a virtual shopping list of items collected in the shopping cart. When the customer adds a new item to the shopping cart or on some regular interval, the portable checkout unit captures images of the items contained by the shopping cart and can generate bounding boxes for each product in each image. The bounding boxes can be associated with item identifiers from previously-generated bounding boxes to identify the items captured by the bounding boxes. Each bounding box paired with an item identifier can then be used as training data for an automated checkout system.

A smart product display system has a base on which a product can be placed. A product camera mounted to the base is used to image a field of view over the base. Images from the product camera are analyzed to identify products that are placed on the base and to detect when a customer has interacted with a product, such as by lifting it up. When a product interaction is detected, information about the product is presented on a display. The display can be integrated in a riser extending upwardly from the base. A customer camera can be used to capture images of a person in the vicinity of the system. Images from the customer camera can be analyzed to identify an attribute of an imaged person and an output, such as a content display or an alert, generated responsive to the attribute.

A portable checkout unit automatically generates training data for an automatic checkout system as a customer collects items in a store. A customer uses an item scanner of portable checkout unit to generate a virtual shopping list of items collected in the shopping cart. When the customer adds a new item to the shopping cart or on some regular interval, the portable checkout unit captures images of the items contained by the shopping cart and can generate bounding boxes for each product in each image. The bounding boxes can be associated with item identifiers from previously-generated bounding boxes to identify the items captured by the bounding boxes. Each bounding box paired with an item identifier can then be used as training data for an automated checkout system.

A display includes two-integrated cameras. A first camera is situated in a top right corner of a front display surface of the display and a second camera is situated in a top left corner of the front display surface. The display is connected to a transaction terminal with the first camera focused on a bagging area associated with the transaction terminal and with the second camera focused on a staging area associated with the transaction terminal. Each camera captures images of items and the item images are streamed over a high-speed display port directly to the transaction terminal. The transaction terminal performs item recognition, item tracking, and auditing on the items based the item images during transaction processing at the transaction terminal.

Disclosed are systems and methods for completing a transaction using a shelf and interactive tablet. The systems and methods may include receiving, at an interactive tablet comprising a processor, a captured image associated with an item; identifying, by the interactive tablet, a known image of the item based on the captured image of the item; and retrieving, by the interactive tablet, product information associated with the item based on the known image of the item.

An information processing apparatus includes a processing circuit. The processing circuit has programmed instructions to acquire a first number of commodities specified to be purchased based on first data acquired by a first sensor, acquire a second number of commodities stored in a storing body that stores commodities to be purchased based on second data acquired by a second sensor, compare the first number of commodities with the second number of commodities, and provide a notification to a display device in response to the first number of commodities being different that the second number of commodities.

A non-transitory computer-readable medium whose contents, when executed by a computing system, can cause the computing system to perform operations for an audited shopping system that include receiving scanned product information identifying a current product and an associated weight of the current product. An indication can be determined to place the current product in a selected bag among a plurality of bags. The associated weight of the current product can be added to a previous calculated weight of products in the selected bag to provide a current calculated weight of products in the selected bag and then all previous operations can be repeated until receiving an indication that shopping is done to provide a plurality of products that are distributed among the plurality of bags, wherein each bag has a respective calculated weight of all products in the bag and indicating a selected one of the plurality of bags as an audited bag for weighing.

A self-service checkout counter is disclosed. In implementations of the present specification, the checkout counter includes a countertop for holding at least one product; a lighting panel disposed opposite to the countertop, wherein the lighting panel comprises at least one light source that provides lighting to items placed on the countertop; a pole that connects the countertop and the lighting panel, and supports the lighting panel; and a plurality of cameras that shoot images of items placed on the countertop, wherein the images are used to perform product identification and pricing and at least a part of the plurality of cameras are disposed on the lighting panel.

A non-transitory computer-readable medium whose contents, when executed by a computing system, can cause the computing system to perform operations for an audited shopping system that include receiving scanned product information identifying a current product and an associated weight of the current product. An indication can be determined to place the current product in a selected bag among a plurality of bags. The associated weight of the current product can be added to a previous calculated weight of products in the selected bag to provide a current calculated weight of products in the selected bag and then all previous operations can be repeated until receiving an indication that shopping is done to provide a plurality of products that are distributed among the plurality of bags, wherein each bag has a respective calculated weight of all products in the bag and indicating a selected one of the plurality of bags as an audited bag for weighing.