The disclosed system and method relate to automatically detecting empty spaces on retail store shelves, identifying the missing product(s) and causing the space to be replenished or restocked. For example, stores may use shelf-mounted imaging devices to capture images of shelves across the aisle from the imaging devices. The images captured by the imaging devices may be pre-processed to de-warp, de-skew images and stitch together multiple images in order to retrieve an image that captures a full width of a shelf. The pre-processed images can then be used to detect products on the shelf, identify the detected products. An iterative projection algorithm or product fingerprint matching algorithm can be used to identify the products. When an incorrect product listing or an empty shelf space is encountered, a message may be sent to the store employee to remedy the issue.

The disclosed system and method relate to automatically detecting empty spaces on retail store shelves, identifying the missing product(s) and causing the space to be replenished or restocked. For example, stores may use shelf-mounted imaging devices to capture images of shelves across the aisle from the imaging devices. The images captured by the imaging devices may be pre-processed to de-warp, de-skew images and stitch together multiple images in order to retrieve an image that captures a full width of a shelf. The pre-processed images can then be used to detect products on the shelf, identify the detected products. An iterative projection algorithm or product fingerprint matching algorithm can be used to identify the products. When an incorrect product listing or an empty shelf space is encountered, a message may be sent to the store employee to remedy the issue.

In some embodiments, a method includes receiving an image of produce and an image of marking. The image of produce has a set of pixels, each associated with a position and a color value. The method further includes generating a grayscale image from the image of produce. The method further includes cropping out a portion from the grayscale image. The method further includes locating a marking position pixel on the image of produce by: (a) producing a list of pixels that are part of the cropped portion, (b) selecting, from the list of pixels, a subset of pixels having grayscale pixel values above a threshold, and (c) randomly selecting the marking position pixel from the subset of pixels. The method further includes overlaying the image of marking on the image of produce by coinciding a pixel of the image of marking with the marker position pixel.

A device may receive document image data that includes an image of a document to be digitized. The device may detect, from the document image data, a table of information that is depicted in the image. The device may determine a data extraction score associated with a table image, wherein the data extraction score is associated with using a data conversion technique to convert the table image to digitized table data. The device may perform, based on the data extraction score not satisfying a threshold, a morphological operation on the table image to generate an enhanced table image that corresponds to an enhanced table of information associated with the table of information. The device may process, using the data conversion technique, the enhanced table image to extract the information from the enhanced table. The device may perform an action associated with the extracted information.

An image correction method, applicable to an image to be corrected having two boundary, comprises: extending a first and a second straight line in the image to be corrected to generate a first and a second extended straight line with both of them intersecting the first and second boundary to generate multiple intersection points; performing an extrapolation process based on multiple intersection points, center points of the two boundaries, and a half side length to generate a first and a second extrapolation line, rotating the image to be corrected when the first and second extrapolation lines have different slope values to generate a preliminary corrected image; and performing a Keystone correction process when the first and second extrapolation lines have same slope values or when obtaining the preliminary corrected image to generate a corrected image.

A device may receive document image data that includes an image of a document to be digitized. The device may detect, from the document image data, a table of information that is depicted in the image. The device may determine a data extraction score associated with a table image, wherein the data extraction score is associated with using a data conversion technique to convert the table image to digitized table data. The device may perform, based on the data extraction score not satisfying a threshold, a morphological operation on the table image to generate an enhanced table image that corresponds to an enhanced table of information associated with the table of information. The device may process, using the data conversion technique, the enhanced table image to extract the information from the enhanced table. The device may perform an action associated with the extracted information.

Image de-skewing can include acquiring pixel coordinates of an image captured by a camera adjoining an electronic display device. The pixel coordinates can be mapped to de-skewing coordinates using a predetermined de-skewing transformer that maps the pixel coordinates to de-skewing coordinates. A de-skewed image can be generated based on the de-skewing coordinates such that the de-skewed image is perpendicular to a principal axis extending from a predetermined location of an apparent camera on the electronic display device.

Techniques for desirably translating a document image to an editable electronic textual document are presented. Utilizing respective applications, a document processing management component (DPMC) can convert the document image to a grayscale document image, remove noise from such image, rotate such image to reduce or eliminate any skewing of such image, and perform character recognition on the rotated grayscale document image to extract the textual information from such document to generate an electronic textual document. DPMC can associate a document identifier with the electronic textual document, and such document and document identifier can be stored in a data store. When such document is related to a device or other item, a code or textual string can be associated with the device or item, wherein a communication device can scan the code or textual string. In response, DPMC can retrieve such document, or information relating thereto, from the data store.

A text extraction computing method that comprises calculating an estimated character pixel height of text from a digital image. The method may scale the digital image using the estimated character pixel height and a preferred character pixel height. The method may binarizes the digital image. The method may remove distortions using a neural network trained by a cycle GAN on a set of source text images and a set of clean text images. The set of source text images and clean text images are unpaired. The source text images may be distorted images of text. Calculating the estimated character pixel height may include summarizing the rows of pixels into a horizontal projection, and determining a line-repetition period from the projection, and quantifying the portion of the line-repetition period that corresponds to the text as the estimated character pixel height. The method may extract characters from the digital image using OCR.

A text extraction computing method that comprises calculating an estimated character pixel height of text from a digital image. The method may scale the digital image using the estimated character pixel height and a preferred character pixel height. The method may binarizes the digital image. The method may remove distortions using a neural network trained by a cycle GAN on a set of source text images and a set of clean text images. The set of source text images and clean text images are unpaired. The source text images may be distorted images of text. Calculating the estimated character pixel height may include summarizing the rows of pixels into a horizontal projection, and determining a line-repetition period from the projection, and quantifying the portion of the line-repetition period that corresponds to the text as the estimated character pixel height. The method may extract characters from the digital image using OCR.