A system and method for applications of computer vision in linking users with virtual data that can include detecting digital interaction state of a plurality of subjects in an environment using at least one sensor-based monitoring system; detecting a contextual organization of subjects relative to an operator station; at the operator station, augmenting the user interface based on the contextual organization of subjects which comprises of at least: presenting a set of subject indicators in the user interface with the subject indicators arranged in response to contextual organization, and in response to received user interaction with at least one selected subject indicator, accessing the digital interaction state of the subject associated the at least one subject indicator.

An information processing method according to an aspect of the present disclosure includes: acquiring, from a video, flow line information of a customer; detecting that the customer acquires an item; and storing, in a storage, flow line information of the customer and information on a number of items acquired by the customer, in association with each other.

A method includes receiving a first image of an item captured by a first camera when the item is purchased and linking the first image to a transaction component corresponding to the purchase of the item. The method also includes determining that the first image is linked to the transaction component and, in response to a request from a user device to display the item and in response to determining that the first image is linked to the transaction component, communicating the first image to the user device.

A payment terminal, including: a display, an input device configured to generate input signals indicative of a user input, a payment instrument reader configured to receive payment instrument data from a financial payment instrument, a secure processor connected to the payment instrument reader, a main processor connected to the display, the main processor separate and distinct from the secure processor, a secure input processor connected to the input device and the secure processor, wherein the secure processor is operable between an unsecured mode, wherein the secure processor sends input coordinates based on the input signals received from the secure input processor to the main processor; and a secured mode, wherein the secure input processor ceases input coordinate forwarding to the main processor.

A payment terminal, including: a display, an input device configured to generate input signals indicative of a user input, a payment instrument reader configured to receive payment instrument data from a financial payment instrument, a secure processor connected to the payment instrument reader, a main processor connected to the display, the main processor separate and distinct from the secure processor, a secure input processor connected to the input device and the secure processor, wherein the secure processor is operable between an unsecured mode, wherein the secure processor sends input coordinates based on the input signals received from the secure input processor to the main processor; and a secured mode, wherein the secure input processor ceases input coordinate forwarding to the main processor.

Embodiments herein describe providing feedback to a shopper at a POS system using a computer vision system. Many items at a store may lack barcodes or other identifying marks such as produce. The shopper may have to perform an action to identify the item to the POS system. The computer vision system can double check the identify provided by the shopper to reduce mistakes and deter nefarious actors. If the computer vision system cannot independently confirm that the item being purchased matched the identity provided by the shopper, the POS system can display a graphical user interface (GUI) that includes an image of the item captured by the computer vision system along with identification data of the item identified by the shopper. This gives the shopper a chance to correct any mistakes.

A transaction displaying method includes obtaining data associated with a transaction from a server, where the data includes data associated with one or more displaying groups and data associated with one or more displaying objects in each of the displaying groups. The method further includes, subsequent to the obtaining the data, detecting that the transaction is triggered, selecting, responsive to the detecting, a displaying group from the data, selecting a displaying object in the selected displaying group for display, and displaying the selected displaying object.

A self-checkout apparatus of an embodiment has: a display unit that displays information to inform an operator; a reading unit that is positioned in a lateral side of the display unit and receives input of information of a product by reading a code symbol; and a housing base that is positioned below the display unit, the housing base for placing the product after information reception by the reading unit and for placing a housing tool for housing the product; wherein the reading unit is positioned between the display unit and the housing base in a height direction.

A point of sale application may initially process a transaction between a customer and a merchant. While the point of sale application processes the transaction, an add-on application may monitor a current state of a user interface of the point of sale application. Upon recognizing a triggering event associated with the current state of the user interface, the add-on application may take over the processing of the transaction from the point of sale application. Upon completion of the processing of the transaction, the add-on application may return a result of the transaction to the point of sale application by emulating user actions on the user interface of the point of sale application.

A method and system for generating perceivable data representing a digital order is provided. A GUI receives a user selection of a particular button of a plurality of buttons. Each button of the plurality of buttons is for adding a respective menu or catalog item to a checkout cart. The particular button displays within its border at least one line of copy and at least one emoji, where the at least one emoji indicates the respective menu or catalog item. The at least one line of copy provides a text description of the respective menu or catalog item and is displayed in at least a minimum font point size and at least a minimum color contrast ratio relative to a background of the particular button. The GUI is then updated to indicate that the respective menu or catalog item for the particular button is added to the checkout cart.