A system, method, and apparatus for automated object recognition and checkout at a retail kiosk is provided. The system includes a controller configured with a processor and a memory to control operations of the automated retail checkout system. The system further includes an imaging device in communication with the controller and configured to create multiple electronic images of an object, such as a product for purchase. The system also includes an object recognition device in communication with the controller and the imaging device. The processor may execute software to receive electronic images from the imaging device, extract at least one feature from the images, and recognize the object based on a predetermined model being applied to the extracted feature from the images. The system also includes a display device to display an indication of the recognized object from the object recognition device.

An open self-service sales system based on positioning of customers includes an open partitioned weight-sensing rack including multiple storage subareas. The open self-service sales system further includes a positioning module and an automatic weighing unit which are connected to the central control module. The position information of the customer is bound with the subareas to accurately identify customers and the purchasing behaviors. The data flow is simple and reliable, and a large number of computing is avoided, which is suitable for large customer flows.

The present subject matter relates to a system and method of operating one or more self-checkout (SCO) terminals of a SCO environment. The system comprises one or more video sensors configured to capture a plurality of video frames. The video frames are processed by a processing unit to detect a primary subject of interest and a second subject of interest post detection of the primary subject of interest. Further, change in location and time of appearance of the primary subject of interest and the secondary subject of interest is determined, which generates a motion trigger. Based on the motion trigger, a transaction data is received which is compared with the detected secondary subject of interest. A non-scan event alert is generated based on a mismatch in the comparison of the transaction data and the detected one or more secondary subject of interest.

The present invention describes a self checkout system with a cloud server. The system is configured to detect item change caused by customer actions and optimize the camera system and computing resources of a cloud server. The system also can distribute low confidence transactions to persons for review.

A cart robot analyzing a hand motion of a user is disclosed. The cart robot comprises a code input interface obtaining a product identification code, a sensor detecting a hand motion of a user, a weight measuring device measuring a weight of one or more products contained in a product loading space, and a controller. When there is no change in weight of the loaded products, the cart robot updates a shopping list with respect to the products loaded in the product loading space in real time by analyzing the hand motion of the user. Therefore, the convenience of the user is enhanced.

There are provided systems and methods relating to checking and confirming merchandise purchased at shopping facilities. In one form, the system includes: a shopping cart containing merchandise items to be purchased; a sales transaction database; a point-of-sales system that creates transaction records identified by transaction identifiers; and a mobile device used by an employee that includes a sensor to scan a paper or digital receipt to obtain the transaction identifier and a camera to capture images of the items in the shopping cart. The system also includes a control circuit that receives the transaction identifier, accesses the database using the identifier to determine the purchased items; analyzes the images of the merchandise items in the shopping cart and creates a computer vision receipt listing detected items; compares the purchased items with the detected items; and takes an action if there is a discrepancy.

A method, computer program product, and system to perform a sale transaction are provided. The method includes identifying each item of a plurality of items, based on at least one image of the plurality of items, determining a cost for each item, optionally identifying a person based on an image of the person, adding each of the items and each of the costs to a sale transaction, and charging the person for the sale transaction.

A shape identification device includes an accommodation chamber for accommodating an object to be measured such that the same can be removed from and inserted into the accommodation chamber, a first imaging unit for imaging the object accommodated in the accommodation chamber, and an image processing unit for carrying out image processing on the basis of the image information imaged by the first imaging unit and recognizing the external shape of the object. The image processing unit includes a storage unit having, stored therein beforehand, a plurality of types of sample external shapes corresponding to objects to be measured and a shape recognition unit for comparison and discrimination of the external shape information from the first imaging unit and the external shape information stored in the storage unit and recognition of an external shape matching or approximating the external shape information from the first imaging unit.

In some embodiments, systems and methods are provided to recognize retail products, comprising: a model training system configured to: identify a customer; access an associated customer profile; access and apply a set of filtering rules to a product database based on customer data; generate a listing of products specific to the customer; access and apply a model training set of rules to train a machine learning model based on the listing of products and corresponding image data for each of the products in the listing of products; and communicate the trained model to the portable user device associated with first customer.

An image data registration system including a first storage unit and an image processing unit, wherein the first storage unit stores images input from an input unit, and the image processing unit acquires at least one image satisfying a predetermined condition from the images stored in the first storage unit and links the acquired image with the input product code.