ASSOCIATING PRODUCT TYPES AND ELECTRONIC LABELS USING A CAMERA

Abstract

A system (300) and a related method (100) for automatically associating an electronic label (320) in a retail environment to a product type (360) is provided. The system comprises a product unit (350) having a product type (360) and an electronic label (320) arranged to present information associated with a product type (360). The system further comprises a camera (310) arranged to capture an image comprising the electronic label and the product unit and a control unit (370) configured to determine an identity of the electronic label, detect the product unit in the image, determine a product type of the product unit, associating the electronic label with the product type, and cause the camera to transmit a control signal. The control signal comprising an identifier of the electronic label and information associated with the product type. The electronic label is configured to receive the control signal, and changing its optical output based on the control signal.

Claims

1. A method for automatically associating an electronic label in a retail environment to a product type, wherein the electronic label is arranged to present information associated with the product type, and wherein a product unit of the product type and the electronic label are arranged in a field of view of a camera, the method comprising: capturing, by the camera, an image comprising the electronic label and the product unit; determining an identity of the electronic label; detecting the product unit in the image; determining the product type of the product unit; associating the electronic label with the product type; broadcasting a control signal from the camera, the control signal comprising an identifier of the electronic label and information associated with the product type; receiving, by the electronic label, the control signal; and changing an optical output of the electronic label based on that the identifier in the control signal matches an identifier of the electronic label.

2. The method according to claim 1, wherein determining an identity of the electronic label comprises: analyzing an optical output of the electronic label in the image, the optical output being indicative of an identifier of the electronic label.

3. The method according to claim 1, wherein detecting the product unit in the image comprises performing image recognition.

4. The method according to claim 1, wherein the determining the product type of the product unit is based on a predetermined set of product types.

5. The method according to claim 1, further comprising: determining a position of the product unit in the image; determining a position of the electronic label in the image; and wherein associating the electronic label with the product type is based on the determined positions.

6. The method according to claim 1, further comprising: receiving, by the camera, information associated with the product type.

7. The method according to claim 1, wherein the information associated with the product type comprises at least one of a product type, a product type name, a product type price information and a product type information.

8. The method according to claim 1, further comprising: storing the association between the product type and the electronic label.

9. The method according to claim 1, further comprising: determining a position of the product unit in the image; determining an area associated with the product type of the product unit based on the determined position of the product unit; and storing the area associated with the product type.

10. The method according to claim 1, further comprising: detecting, by the camera, a second camera in the field of view of said camera based on at least one of a Wireless, Wifi, signal, an Infrared, IR, signal, a Bluetooth Low Energy, BLE, signal, a Near-Field communication, NFC, signal, a Radio Frequency, RF, signal, an optical signal and a sound signal.

11. The method according to claim 1, further comprising: verifying the change in optical output using the camera.

12. The method according to claim 1, further comprising: receiving, by a server, the control signal transmitted from the camera and transmitting, by the server, the control signal.

13. The method according to claim 1, further comprising: detecting a display device associated with an electronic label by analyzing the image.

14. A system for automatically associating an electronic label in a retail environment to a product type, wherein the system comprises; a product unit having the product type; an electronic label arranged to present information associated with a product type; a camera arranged to capture an image comprising the electronic label and the product unit; and a control unit configured to: determine an identity of the electronic label; detect the product unit in the image; determine a product type of the product unit; associating the electronic label with the product type; cause the camera to broadcast a control signal, the control signal comprising an identifier of the electronic label and information associated with the product type; and wherein the electronic label is configured to receive the control signal, and changing its optical output based on that the identifier in the control signal matches an identifier of the electronic label.

15. The system according to claim 14, wherein the camera is a mobile device.

16. The system according to claim 14, wherein the camera is arranged on at least one of a shelf, a ceiling and a wall.

17. The system according to claim 15, wherein the camera is arranged on at least one of a shelf, a ceiling and a wall.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0091] This and other aspects will now be described in more detail in the following illustrative and non-limiting detailed description of embodiments, with reference to the appended drawings.

[0092] FIG. 1 schematically illustrates a perspective view of the system according to an embodiment.

[0093] FIG. 2 schematically illustrates a perspective view of the system according to an embodiment.

[0094] FIG. 3 schematically illustrates a perspective view of the system according to an embodiment.

[0095] FIG. 4 schematically illustrates a flow chart of the method according to an embodiment.

[0096] All the figures are schematic, not necessarily to scale, and generally only show parts which are necessary in order to elucidate the embodiments, wherein other parts may be omitted. Like reference numerals refer to like elements throughout the description.

DETAILED DESCRIPTION

[0097] FIG. 1 illustrate system 300 for automatically associating an electronic label 320 in a retail environment to a product type according to an embodiment.

[0098] The system 300 may comprise a camera 310. The camera 310 may be arranged to capture at least one image of the electronic label 320 and at least one product unit 326a-c. The electronic label 320 may be associated with a product type 327 of one or more of the at least one product unit 326a-c. The camera may be arranged to transmit a control signal 380, 381. The camera 310 may comprise a transceiver 315 for transmitting and/or receiving communication such as a command or a control signal 380, 381. The camera 310 may also comprise separate means for receiving and transmitting a signal. The transceiver 315 may be arranged to transmit and/or receive at least one of a Radio Frequency, RF, signal, a wireless, WIFI, signal, an Infrared, IR, signal, a Bluetooth, BT, signal, a Near-Field communication, NFC, signal, a Radio Frequency identification, RFID, signal, an optical signal, a sound signal or any signal suitable for communication.

[0099] The electronic label 320 may be arranged at a predetermined range and direction relative the product unit 326a-c. The electronic label 320 may comprise information about the product type 327 it may be associated with, in other words the electronic label may be matched with the product type it may be associated with.

[0100] The electronic label 320 may be adapted to receive the control signal 380 and may be adapted to change its optical output in response to said control signal 380. The electronic label 320 may be arranged in the field of view of the camera 310. There may be a plurality of electronic labels 320 present. Hence, at least one electronic label 320 may be present. The at least one electronic label 320 may comprise an optical output device 340. The optical output device 340 may comprise at least one of a LED, a display and any other visual device. The at least one electronic label 320 may comprise a transceiver 325. The transceiver 325 may be arranged to receive at least one of a Radio Frequency, RF, signal, a wireless, WIFI, signal, an Infrared, IR, signal, a Bluetooth, BT, signal, a Near-Field communication, NFC, signal, a Radio Frequency identification, RFID, signal, an optical signal, a sound signal or any signal suitable for communication.

[0101] The system may further comprise a control unit 330. The control unit 330 may be adapted to communicate with the camera 310 and configured to detect an identifier of the electronic label 320 by analyzing the optical output in the image and configured to determine a position of the electronic label 320 based on the position of the electronic label 320 in the image.

[0102] The control unit 330 may be arranged separately from the camera 310 or arranged within the camera 310. In other words, the camera 310 may comprise the control unit 330.

[0103] The control unit 330 may communicate with the camera by at least one of Radio Frequency, RF, signal, a wireless, WIFI, signal, an Infrared, IR, signal, a Bluetooth, BT, signal, a Near-Field communication, NFC, signal, a Radio Frequency identification, RFID, signal, an optical signal, a sound signal or any signal suitable for communication. The control unit 330 may comprise a transceiver 335. The control unit 330 may, by the transceiver 335, send a control signal 380, 381 arranged to be received by at least one of the server 350, the camera 310 and the electronic label 320, wherein the control signal 380, 381 may control at least one of the camera 310, the server 350 and the electronic label 320.

[0104] The system may further comprise a server 350 and a storage means 360. The server 350 may be communicatively connected to the storage means 360. The server 350 may further comprise a transceiver 355. The server 350 may, by the transceiver 355, send a control signal 380,381 arranged to be received by at least one of the camera 310, the control unit 330 and the electronic label 320, wherein the control signal 380, 381 may control at least one of the camera 310, the server 350 and the electronic label 320.

[0105] The server 350 may be configured to receive the control signal 381 transmitted from the camera 310. The server 350 may further be configured to transmit the control signal 380,381.

[0106] The electronic label 320 may be arranged to receive the control signal 380 transmitted from the server 350.

[0107] The camera 310 may, by the transceiver 315, transmit a signal arranged to be received by the at least one of the control unit 330, the electronic label 320 and the server 350. The signal transmitted from the camera 310 may comprise at least one of a control signal, an image, a determined position, a determined identifier, information associated with the product type 327 and any data relating to the electronic label 320. The control signal may comprise an identifier of the electronic label 320 and information associated with the product type 327. The information associated with the product type may comprise at least one of a product type 327, a product type name, an product type price information and a product type information. The transceiver 315 may have a limited range and the at least one electronic label 320 arranged within the limited range may receive the control signal. Electronic labels being out of range may not receive the control signal and hence, may not change its optical output. The camera 310 may be arranged to detect a display device associated with an electronic label by analyzing the image. The display device may be a device comprising information associated with the product unit and/or product type such as a shelf talker.

[0108] The camera 310 may be powered by at least one of a battery and an external power source. The camera 310 may be arranged on or in at least one of a shelf, a ceiling, a wall and any other suitable position to capture images of the at least one electronic label 320. The camera 310 may also be mobile, i.e. the camera may be movable. The camera 310 may be comprised in a mobile device. In other words, the camera may be comprised in a movable device. The mobile device may comprise at least one of a movable robot, part of a robot such as a moving arm of a stationary or movable robot, a drone, cellular device and any device suitable to carry a camera and being mobile and/or movable. The drone may be a flying drone configured to be autonomously controlled and/or user controlled.

[0109] At least one of the camera 310, the server 350 and the control unit 330 may be arranged to analyze an optical output of the electronic label in the image wherein the optical output is indicative of an identifier of the electronic label in order to determine an identity of the electronic label.

[0110] The camera 310 may determine the identity of the electronic label 320 in the image. The electronic label may be identified by at least one of the optical output of the electronic label 320, a QR code, a bar code and any feature that could identify the electronic label in the image. By the electronic label being identified by the optical output of the electronic label 320 it may be meant that the optical output comprises a text, an QR code, an image or similar that may be detected by the camera 310. By the electronic label 320 being identified by the optical output of the electronic label 320 it may be meant that optical output of the electronic label 320 is changed. The change in optical output may be a characteristic change in optical output that may be associated with an identity and/or an identifier of the electronic label. In other words, in order for the camera 310 to capture an image comprising the identifier the electronic label 320 is controlled to change its optical output, wherein the change in optical output may be a characteristic change in optical output that may be associated with an identifier of the electronic label.

[0111] The identifier may comprise at least one of a numeric code, a hexadecimal code, a binary code and any other means suitable for distinguishing or identifying the electronic label 320.

[0112] The identifier may be a global identifier or a local identifier. By global identifier it may be meant an identifier globally unique for each electronic label 320. Each electronic label 320 produced may have a unique global identifier in order to be able to distinguish an electronic label globally. This may require the allocated space for the identifier to be relatively large in comparison to the local identifier. By local identifier is meant that each electronic label may have a unique identifier locally, i.e. each electronic label 320 may be identified among a number of electronic labels arranged locally. The allocated space for the local identifier may be less in order for storing the local identifier compared to storing a global identifier. Hence, the local identifier may require less storage space. Subsequently, in order to communicate the identity of the electronic labels 320 less data may be transmitted when transmitting the local identifier and in turn this may save bandwidth and/or time while transmitting the identity of the electronic label. The local identifier may be a subset of the global identifier.

[0113] The change in optical output may be triggered by the camera 310 transmitting a control signal 380 directly to be received by the electronic label 320 and/or the change in optical output may be triggered by the camera 310 transmitting a control signal 380, 381 to be received by the electronic label 320 via at least one of the server 350 and the control unit 330 initiating.

[0114] At least one of the camera 310, the control unit 330 and the server 350 may be arranged to transmit the control signal 380, 381. The at least one of the camera 310, the control unit 330 and the server 350 may transmit the control signal 380, 381 without prior knowledge of the recipient, in other words the at least one of the camera 310, the control unit 330 and the server 350 may broadcast the control signal 380, 381. The at least one of the camera 310, the control unit 330 and the server 350 may transmit at least one of a radio signal, a WIFI signal, a BT signal, a NFC signal, a RFID signal, an optical signal, a sound signal or any signal suitable for communication.

[0115] At least one of the camera 310, the control unit 330 and the server 350 may further be configured to detect the product unit 326a-c in the image and determine a product type 327 of the product unit 326a-c. By analyzing the image, the product unit 326a-c may be detected and determined. At least one of the camera 310, the control unit 330 and the server 350 may further be arranged to associate the electronic label 320 with the product type 327. Detecting the product unit in the image may comprise image recognition, hence, at least one of the camera 310, the control unit 330 and the server 350 may be configured to perform image recognition in order to detect the product unit in the image. Image recognition may be used in combination with user interaction. Hence, detecting the product unit in the image may comprise image recognition and user interaction. This may be achieved by a first detection of product units in the image by image recognition, wherein the first detection may output a probability of the product unit to belong a product type. The output may comprise several probabilities when for example product units have a similar appearance. Hence, the first detection of product units in the image may output different probabilities for the detected product unit to belong different product types, wherein one probability may be determined for each product type. A second detection may subsequently be done by user interaction based on the probability of the product unit to belong to different product types. The second detection may be performed only when the probability is below a certain predetermined threshold in the first detection and/or when there is a number of product types above a certain threshold of which the detected product unit is determined to belong to. This may further facilitate the detection of product types by user interaction by a second step of user interaction to verify the image recognition when the image recognition outputs a less definite result.

[0116] In order to determine the product type the system may use a predetermined set of product types to compare the detected product unit with. The predetermined set of product types may be the set of product types known to be arranged in the retail environment. The predetermined set of product types may be a known set of product types 327 located in part of the retail environment where the camera 310 is located.

[0117] The transceiver 325 may be arranged to receive the control signal transmitted from at least one of the camera 310, the control unit 330 and the server 350. In response to reception of the control signal the electronic label 320 may be arranged to change its optical output. In other words, the electronic label 320 may be adapted to receive the control signal 380 and may be adapted to change its optical output in response to said control signal 380.

[0118] The electronic label 320 may be arranged change its optical output based on the control signal 380. In other words, the electronic label 320 may be controlled to change its optical output based on the control signal 380. The change in optical output may be a change in presented information. I.e. the change in optical output may be an update of information associated with the product type 327 comprised in the electronic label 320. Hence, the electronic label 320 may update the presented information associated with the product type 327 based on the control signal 380.

[0119] FIG. 2 schematically illustrates the system 300 similar to that of the system 300 in FIG. 1, except that in FIG. 2 a plurality of electronic labels 320a-320c are arranged within the field of view of the camera 310. Same features discussed to the electronic label 320 in FIG. 1 applies to the plurality of electronic labels 320a-320g in FIG. 2. The control unit 330 and the server 350 illustrated in FIG. 2 has the similar functionality as the control unit 330 and server 350 in FIG. 1.

[0120] At least one of the camera 310, the control unit 330 and the server 350 may further be configured to determine a position of the product unit and a position of the electronic label 320 in the image. Based on the determined positions, the electronic label may be associated with the product type. Hence, by determining the position of the product unit and by determining the type of product unit, i.e. determining the product type, the position for the product type may indirectly be determined. The electronic label may comprise information about the product type it is associated with, in other words the electronic label is matched with the product type is associated with. The product unit may be arranged at a predetermined location relative the electronic label in the image. In other words, the electronic label may be arranged at a preferred predetermined range and direction relative the product unit. For example, in FIG. 2, the product units of product type 327a are arranged to the right of the electronic label 320a associated with the product type 327a. In another example as shown in FIG. 2, the product units of product type 327b are arranged to the left of the electronic label 320b associated with the product type 327b. In a third example also shown in FIG. 2, the product units of product type 327c are arranged such that the electronic label 320c associated with the product type 327c is centered with respect to the product units 327c. Hence, the electronic label 320a-c may be arranged at a predetermined location relative to the product units identified. The system may also calculate a probability of the detected electronic label 320a-c to be associated with the product units and/or product types detected based on the determined position of the product unit in the image and the determined position of the electronic label 320a-320c in the image. Based on the probability the system may associate the electronic label with the product type.

[0121] As previously discussed, the system 300 may be configured to determine a position of the product unit in the image. The system 300 may be configured to determine the product type 327a-c of the detected product units. The system 300 may further be configured to determine an area 328a-c associated with the product type 327a-c. The area 328a-c associated with the product type 327a-c may enclose the product units of the product types 327a-c. The system may store the area 328a-c associated with the product type. The system may analyze the captured image and determine if there are product units of the product types 327a-c missing by comparing to earlier data. Hence, this may provide the possibility of determining when restocking of product units is needed.

[0122] The camera 310 may be configured to receive information associated with the product type. The information associated with the product type may comprise at least one of a product type, a product type name, a product type price information and a product type information. In other words, the camera may be configured to receive at least one of a product type, a product type name, a product type price information and a product type information. The information associated with the product type may be received by the camera by a transmitted signal from the electronic label 320a-320c. In other words, the electronic label 320a-320c may transmit a signal by the transceiver 325 and the signal may be received by the transceiver 315. The information associated with the product type may be received by the camera 310 by capturing an image of the electronic label 320a-320c wherein the image may comprise information associated with the product type. In other words, the camera 310 may receive the information associated with the product type based on the optical output of the electronic label. For example, the image may comprise the electronic label 320a-320c and the electronic label 320a-320c may display, or present, the information associated with the electronic label. In another example, the electronic label 320a-320c may change its optical output such that the change in optical output is detected by the camera 310. The change in optical output may comprise the information associated with the product type and the information associated with the product type may be interpreted by the camera 310 based on detecting the change in optical output. In other words, the change in optical output may be interpreted by the camera 310 such that the information associated with the product type is detected by the camera 310.

[0123] At least one of the camera 310, the control unit 330, the server 350 and the storage device 360 may further be configured to store the association between the product type 327a-327c and the electronic label 320a-320c.

[0124] The system 300 may further comprise a first and a second camera, the second camera may be within the field of view of the first camera, and the first camera may be configured to detect the second camera by analyzing the image. In other words, a second camera 370 may be arranged in the field of view of the camera 310. The first and/or second camera may comprise a visual identifier. The system 300 may be configured to detect the second camera 370 by analyzing the image captured by the camera 310. The first and/or second camera may comprise an optical output and be arranged to change its optical output in response to a control signal. The change in optical output may comprise at least one of a distinct temporal pattern of optical changes, displaying a visual reference, such as at least one of a barcode, a QR code, a number, a letter and the combination thereof or changing a color output of the optical output of the first and/or second camera. The system 300 may be configured to detect the second camera 370 based on at least one of a Wireless, Wifi, signal, an Infrared, IR, signal, a Bluetooth Low Energy, BLE, signal, a Near-Field communication, NFC, signal, a Radio Frequency, RF, signal, an optical signal and a sound signal.

[0125] The first and/or second camera may comprise a unique identifier, wherein the identifier may be a local and/or a global identifier. The change in optical output may be associated with this identifier.

[0126] This may facilitate determining the position of at least one of said first and second camera since a position of one of said first and second camera may be known, and this may further facilitate the determination of position of the other camera. For example, if the position of the second camera is known, a facilitated positioning of the first camera may be achieved by detecting the second camera. Optionally or alternatively, the position of the first camera may be known and hence, determining the position of the second camera may be facilitated by detecting the second camera in an image captured by the first camera.

[0127] The system 300 may further be configured to verify the change in optical output using the camera 310. In other words, the system 300 may be configured to analyze the captured image and based on the analyze of the captured image the system 300 may verify the change in optical output of the electronic label.

[0128] FIG. 3 schematically illustrates a perspective view of the system 300 similar to that of the system 300 in FIGS. 1 and 2, except that in FIG. 3 the transceiver 315 may comprise an optical transmitter 317. FIG. 3 illustrates a camera 310 and an electronic label 320 arranged within the field of view of the camera 310. The optical transmitter 317 may comprise a LED, the LED may be arranged to emit at least one of visible light, UV-light or IR-light.

[0129] The camera 310 may transmit the control signal using at least one of the transceiver 315 and the optical transmitter 317. As previously discussed, the transceiver 315 may have a limited range and only the at least one electronic label 320 arranged within the limited range may receive the control signal. Electronic labels being out of range may not receive the control signal and hence, may not have its optical output changed.

[0130] Analogously, the optical transmitter 317 may have a limited range. The control signal transmitted from the optical transmitter 317 may be directed. This may further facilitate limiting the electronic labels 320 to be controlled to have their optical output changed. In other words, the optical transmitter 317 may be directed to an area, wherein electronic labels 320 within that area may be controlled to have their optical output changed. More specifically, the optical transmitter 317 may be pointing in a direction creating a cone of illuminance transmitted from the optical transmitter, wherein the cone of illuminance comprises the control signal and wherein electronic labels 320 arranged within that cone of illuminance may be controlled to have their optical output changed.

[0131] This is illustrated in FIG. 3, the optical transmitter 317 is transmitting an optical signal, wherein the optical signal may be the cone of illuminance. The optical signal may comprise the control signal. The optical signal may comprise electromagnetic radiation in wavelengths corresponding to wavelengths for at least one of UV, visible or IR radiation. The optical signal may have a limited range in the direction of the light propagation. The optical signal may have a limited area and/or volume being illuminated, as previously described. This may result in a projected area of illuminance in a plane comprising the at least one electronic label 320, in FIG. 3 this plane may be the shelf and/or shelves comprising the at least one electronic label 320. Product units arranged outside this projected area of illuminance, such as the electronic label 321 will not receive the transmitted optical signal. Hence, the electronic label 321 will not be controlled to have its optical output changed. The optical transmitter 317 may be arranged so that the electronic labels 320 being controlled to have their optical output changed matches the electronic labels 320 within the field of view of the camera 310. The optical transmitter 317 and the camera 310 may be arranged to that the camera 310 captures at least one image of a portion of the electronic labels 320 illuminated by the optical transmitter. This is schematically illustrated in FIG. 3, as the cone of illuminance from the optical transmitter is larger than the area imaged by the camera 310 in a plane comprising the electronic labels 320.

[0132] The cone of illuminance from the optical transmitter may further facilitate directing the control signal and hence this may further facilitate limiting the number of electronic labels receiving the control signal. In turn, this may further facilitate saving power when associating an electronic label 320 to a product type 370, communicating with the electronic label 320 and/or controlling the optical output of the electronic label 320.

[0133] The optical transmitter 317 in FIG. 3 is arranged on the camera 310. However, the optical transmitter 317 is not limited to be arranged on the camera 310, but can also be arranged as a separate unit next to the camera 310 or on anyone of the server 350 and the control unit 330 and may be controlled by the camera 310 through a control signal 381. The camera 310 may transmit a control signal 380 directly to be received by the electronic label 320 and/or the camera 310 may transmit a control signal 380, 381 to the electronic label 320 via at least one of the server 350 and the control unit 330.

[0134] As illustrated in FIG. 3, the optical transmitter transmits a signal, wherein the signal comprises the control signal. However, the idea of limiting the number of electronic labels 320 to be controlled to have their optical output changed as illustrated in FIG. 3, is not limited to an optical signal. The signal that may comprise the control signal could be any signal with limitation in range and/or direction know in the art of communication.

[0135] A method 100 for automatically associating an electronic label in a retail environment to a product type, wherein the electronic label is arranged to present information associated with the product type, and wherein a product unit of the product type and the electronic label are arranged in a field of view of a camera, the method comprising capturing 110, by the camera, an image comprising the electronic label and the product unit. The method may further comprise determining 120 an identity of the electronic label. In the step of capturing 110 the method may comprise capturing a plurality of images comprising the electronic label and the product unit in order to determine time dependent changes. By time dependent changes it may be meant changes in the plurality of images over time. The method may determine a pattern of optical changes in the images.

[0136] The method may further comprise detecting 130 the product unit in the image and determining 140 a product type of the product unit. The method may further comprise associating 150 the electronic label with the product type and transmitting 160 a control signal from the camera, the control signal comprising an identifier of the electronic label and information associated with the product type. The step of transmitting 160 may comprise transmitting a control signal from the camera may comprise transmitting at least one of a Wireless, Wifi, signal, an Infrared, IR, signal, a Bluetooth Low Energy, BLE, signal, a Near-Field communication, NFC, signal, a Radio Frequency, RF, signal, an optical signal and a sound signal. The control signal transmitted may be a wireless signal, hence, for example, the optical signal may be a wireless optical signal. Transmitting a control signal from the camera may provide triggering electronic labels arranged in a predetermined range and/or direction from the camera. in this way, the control signal may be limited to the targeted electronic labels arranged in a predetermined range from the camera. Consequently, this may provide that electronic labels arranged in the field of view of the camera to receive the transmitted control signal. This, since there may be a reduced amount of electronic labels reached by the control signal transmitted compared to a system where all electronic labels are controlled to change their optical output or have their positions determined at the same time. The step of transmitting 160 may comprise transmitting the control signal in a direction, further limiting the amount of electronic labels being reached by the control signal. This may provide less power consumption since the electronic labels arranged outside the range of the control signal may not need to receive the control signal and evaluate the signal and determine if the control signal contains information meant for that particular electronic label.

[0137] The method may comprise the steps of receiving 164, by a server, the control signal transmitted from the camera and transmitting 166, by the server, the control signal. The method may further comprise receiving 170, by the electronic label, the control signal. Hence, the control signal may be directly or indirectly be received by the electronic label after it being transmitted from the camera. The method may further comprise changing (180) an optical output of the electronic label based on the control signal.

[0138] The step of determining an identity 120 of the electronic label may further comprise analyzing 190 an optical output of the electronic label in the image, the optical output being indicative of an identifier of the electronic label.

[0139] The step of detecting 130 the product unit in the image may comprise performing image recognition. The image recognition may comprise comparing the detected product unit with a predetermined set of product types. The predetermined set of product types may be the set of product types known to be arranged in the retail environment. The predetermined set of product types may be a list of predetermined set of product types. The predetermined set of product types may be a known set of product types located in part of the retail environment where the camera may be located.

[0140] The step of determining 140 a product type of the product unit may be based on a predetermined set of product types.

[0141] The method may further comprise determining 200 a position of the product unit in the image and determining 210 a position of the electronic label in the image. The step of associating 150 the electronic label with the product type according to the method may be based on the determined positions. In other words, the step of associating 150 a position of the electronic label in the image may be based on the steps of determining 200 a position of the product unit in the image and determining 210 a position of the electronic label in the image.

[0142] The method may further comprise receiving 220, by the camera, information associated with the product type. The information associated with the product type may comprise at least one of a product type, a product type name, a product type price information and a product type information.

[0143] The method may further comprise storing 230 the association between the product type and the electronic label. The storing may be made by at least one of the camera, a server, a storage means and a control unit. Hence, the step of storing the association between the product type and the electronic label may be performed by at least one of the camera, a server, a storage means and a control unit. By storing the association by the camera a local storage may be provided, in turn providing less power consumption since the association between the product type and the electronic label may not need to be transmitted for storing elsewhere.

[0144] The method may further comprise determining 240 a position of the product unit in the image and determining 250 an area associated with the product type of the product unit based on the determined position of the product unit. The method may further comprise storing 260 the area associated with the product type.

[0145] The method may further comprise detecting 270, by the camera, a second camera in the field of view of said camera based on at least one of a Wireless, Wifi, signal, an Infrared, IR, signal, a Bluetooth Low Energy, BLE, signal, a Near-Field communication, NFC, signal, a Radio Frequency, RF, signal, an optical signal and a sound signal. Hence, the second camera in the field of view of the camera may transmit a signal. The signal may be transmitted upon request of transmitting a signal. The request of transmitting a signal may be transmitted by at least one of the camera, the server, and the control unit. By detecting 270, by the camera, a second camera in the field of view of the camera may hence meant that the camera may be arranged to receive the signal transmitted from the second camera. Wherein the signal transmitted from the second camera may comprise at least one of a Wireless, Wifi, signal, an Infrared, IR, signal, a Bluetooth Low Energy, BLE, signal, a Near-Field communication, NFC, signal, a Radio Frequency, RF, signal, an optical signal and a sound signal.

[0146] The method may further comprise verifying 280 the change in optical output using the camera.

[0147] In the step of verifying 280 the change in optical output using the camera, the camera may capture an image comprising the electronic label and analyze the optical output of the electronic label. The camera may compare the optical output of the electronic label in the image to a predetermined optical output. The camera may verify if the change in optical output of the electronic label correspond to the predetermined optical output. The electronic label may change its optical output in a predetermined way verifying that the optical output of the electronic label is changed based on the received control signal. The step of verifying 280 the change in optical output using the camera may also be performed by analyzing the image captured by the camera, wherein analyzing the image may be performed by at least one of the camera, the server, and the control unit.

[0148] The method may comprise detecting 290 a display device associated with an electronic label by analyzing the image. The display device may comprise information detectable by the camera. The display device may comprise at least one of a QR-code, a text, and an optical output.

Itemized List of Examples

[0149] 1. A method (100) for automatically associating an electronic label in a retail environment to a product type, wherein the electronic label is arranged to present information associated with the product type, and wherein at least one product unit of the product type and the electronic label are arranged in a field of view of a camera, the method comprising:

[0150] capturing (110), by the camera, an image comprising the electronic label and the product unit;

[0151] determining (120) an identity of the electronic label;

[0152] detecting (130) the product unit in the image;

[0153] determining (140) a product type of the product unit;

[0154] associating (150) the electronic label with the product type;

[0155] transmitting (160) a control signal from the camera, the control signal comprising an identifier of the electronic label and information associated with the product type;

[0156] receiving (170), by the electronic label, the control signal;

[0157] changing (180) an optical output of the electronic label based on the control signal.

2. The method according to example 1, wherein determining an identity of the electronic label comprises:

[0158] analyzing (190) an optical output of the electronic label in the image, the optical output being indicative of an identifier of the electronic label.

3. The method according to any one of the preceding examples, wherein detecting the product unit in the image comprises performing image recognition.
4. The method according to any one of the preceding examples, wherein the determining a product type of the product unit is based on a predetermined set of product types.
5. The method according to any one of the preceding examples, wherein the method further comprises:

[0159] determining (200) a position of the product unit in the image;

[0160] determining (210) a position of the electronic label in the image; and

[0161] wherein associating the electronic label with the product type is based on the determined positions.

6. The method according to any one of the preceding examples, wherein the method further comprises:

[0162] receiving (220), by the camera, information associated with the product type.

7. The method according to any one of the preceding examples, wherein the information associated with the product type comprises at least one of a product type, a product type name, a product type price information and a product type information.
8. The method according to any one of the preceding examples, wherein the method further comprises:

[0163] storing (230) the association between the product type and the electronic label.

9. The method according to any one of the preceding examples, wherein the method further comprises:

[0164] determining (240) a position of the product unit in the image;

[0165] determining (250) an area associated with the product type of the product unit based on the determined position of the product unit; and

[0166] storing (260) the area associated with the product type.

10. The method according to any one of the preceding examples, wherein the method further comprises;

[0167] detecting (270), by the camera, a second camera in the field of view of said camera based on at least one of a Wireless, Wifi, signal, an Infrared, IR, signal, a Bluetooth Low Energy, BLE, signal, a Near-Field communication, NFC, signal, a Radio Frequency, RF, signal, an optical signal and a sound signal.

11. The method according to any one of the preceding examples, wherein the method further comprises:

[0168] verifying (280) the change in optical output using the camera.

12. The method according to any one of the preceding examples, wherein the method further comprises the step of

[0169] receiving (164), by a server, the control signal transmitted from the camera and

[0170] transmitting (166), by the server, the control signal.

13. The method according to any one of the preceding examples, wherein the method comprises;

[0171] detecting (290) a display device associated with an electronic label by analyzing the image.

14. A system (300) for automatically associating an electronic label (320) in a retail environment to a product type (360), wherein the system comprises;

[0172] a product unit (350) having a product type (360);

[0173] an electronic label (320) arranged to present information associated with a product type (360);

[0174] a camera (310) arranged to capture an image comprising the electronic label and the product unit; and

[0175] a control unit (370) configured to: [0176] determine an identity of the electronic label; [0177] detect the product unit in the image; [0178] determine a product type of the product unit; [0179] associating the electronic label with the product type; [0180] cause the camera to transmit a control signal, the control signal comprising an identifier of the electronic label and information associated with the product type; and

[0181] wherein the electronic label is configured to receive the control signal, and changing its optical output based on the control signal.

15. The system according to example 14, wherein the camera is a mobile device.
16. The system according to any one of examples 14-15, wherein the camera is arranged on at least one of a shelf, a ceiling and a wall.