121 results about "Planogram" patented technology

The disclosure discloses a method, an apparatus and a robot for out-of-stock detection of shelf commodity. The method includes: acquiring a plurality of shelf RGB images and a plurality of shelf depth images; executing an out-of-stock area detection step to obtain all vacant areas in the shelf for shelf RGB images and shelf depth images; stitching the shelf RGB images into a complete shelf image, merging and de-duplicating on all vacant areas and detection boxes of commodities, shelf label and layer lattice, and mapping them to the complete shelf image; generating a shed grid area corresponding to each commodity for the complete shelf image, and dividing all vacant areas in the shelf based on the shed grid area; and determining an out-of-stock detection result of each commodity based on the position information and the depth information of the vacant area and the shed grid area.

Methods and systems for managing inventory at a retail facility include an image capture device having a field of view that includes a product display shelf of the retail facility, an electronic database that stores a planogram of product display shelves at the retail facility and a computing device. The computing device obtains an image of a product display shelf, detects the individual packages of each of the different products captured in the image, defines different product display areas for the different products on the product display shelf captured in the image, and generates virtual boundary lines that surround each of the defined product display areas. The computing device also determines an identity of a product contained located in each defined product display area, and associates the virtual boundary lines surrounding each defined product display area with an identifier unique to the product contained in the defined product display area.

In some examples, a system may be configured to execute the instructions to, based at least on the modular data of a shelf modular implement a set of modular placement optimization operations that generate a first modular dataset. In some examples, the set of modular placement optimization operations include, determining, from a group of items, a combination of items to place onto a shelf modular, and, for each item of the combination of items, a placement position on the shelf modular, and a number of facings. Additionally, the set of modular placement optimization operations include generating the first modular dataset. Moreover, the system may be configured to execute the instructions to, based at least in part on the first modular dataset, and the draw strategy data, determine whether to implement a set of re-run operations.

Planograms are used to create consistency between store locations, to provide proper shelf space allocation, to improve visual merchandising appeal, and to create product-pairing suggestions. Existing solutions do not have a way to accurately estimate the scale of magnification of the object in the shelf image, so unable to distinguish between size variants of the same product. A system and method for facilitating planogram compliance for inventory management in a retail store have been provided. The scales are calculated with use of a vector convergence technique followed by a center clustering which automatically removes outliers. Initially disclosure comprises calculation of scales and centers, then generation of region proposals using those scales and centers, Next, classification of the regions proposed and generation of similarity scores, and on the basis of similarity scores conflict resolution is performed among overlapped region proposals using non-maximal suppression.

This disclosure describes, in part, techniques for identifying interactions between users and inventory locations. For instance, system(s) may receive image data generated by an imaging device located within a facility. The system(s) may then analyze the image data in order to determine one or more gaze points, where the gaze point(s) indicate location(s) on an inventory location for which a user was looking over a period of time. The system(s) may then generate gaze data indicating period(s) of time that the user was looking at the portion(s) of the inventory location. In some examples, the gaze data represents a heatmap. The system(s) may then use planogram data to determine identifier(s) of item(s) located at the portion(s) of the inventory location. Additionally, the system(s) may generate metrics data representing at least the identifier(s) of the item(s) and the period(s) of time that the user was looking at the item(s).

Disclosed herein is a system and method for matching products detected in an image of a shelf. The match or non-match of the products is then used to make a determination that the products are correctly positioned on the shelf of if the positioning of the products represents a plug or spread situation.

A method for image processing based on image data analysis may include mounting on a first retail shelving unit a first housing comprising an image capture device that is directed to a second retail shelving unit. A second housing comprising a processor is also mounted on the first retail shelving unit at location spaced apart from the first housing. A data conduit is extended between the first housing and second housing, wherein images captured by the image capture device in the first housing are transmitted to the second housing. At least some of the captured images are then transmitted from the second housing to a remote server configured to determine planogram compliance relative to the second retail shelving unit.

An inventory visibility management system utilizes fixed or motorized cameras to scan inventory bearing shelves in a backroom or warehouse of a store, as opposed to store shelves where merchandise is available for purchase, for inventory frequently to keep the system up to date on what boxes of inventory are on the shelf, what is in those boxes and where those boxes are on the shelf. The system may identify a bounding polygon around an identifier corresponding to the product and apply the bounding polygon to a machine-learned model, which may generate a high-resolution crop of the identifier as output. The system registers the identifier to the first bounding polygon and to a location associated with cameras that captured the plurality of low-resolution images. Upon receiving a request from a client device, the system may provide the location associated with the one or more cameras to the client device.

A system for tracking of an inventory of products on one or more shelves includes a mobile device. The mobile device has an image sensor, at least one processor, and a non-transitory computer-readable medium having instructions that, when executed by the processor, causes the processor to: apply a simultaneous localization and mapping in three dimensions program, on images of a shelf input from the image sensor, to thereby generate a plurality of bounding boxes, each bounding box representing a three-dimensional location and boundaries of a product from the inventory; capture a plurality of two-dimensional images of the shelf; assign an identification to each product displayed in the plurality of two-dimensional images using a deep neural network; associate each identified product in a respective two-dimensional image with a corresponding bounding box, and associate each bounding box with a textual identifier signifying the identified product.

A system and method for providing insights regarding retail store performance and / or store layout are described herein. One or more cameras in a store capture and transmit data associated with product inventory, equipment inventory, patrons, and employees in the store to a computing device. The computing device queries a repository to determine identifiable information associated with each of the product inventory, the equipment inventory, the patrons, and the employees. The data is combined with the identifiable information to form a data set. An artificial intelligence (AI) algorithm is applied to the data set to determine a conclusion regarding a performance and / or layout of the store. The data, the data set, and the conclusion are stored the repository. A representation of the conclusion is generated and presented via a graphical user interface (GUI) of the computing device to a user. The representation is a store-specific planogram.

A transmission device according to the present technology includes an image acquisition unit that acquires a first shelf image captured at a first time for a product shelf on which a product is displayed, and a second shelf image captured for the product shelf at a second time after the first time, a region specification unit that specifies a difference region between the first shelf image and the second shelf image, a cut-out processing unit that cuts out a partial image from the second shelf image so that the difference region is included, and a transmission processing unit that transmits the first shelf image and the partial image to a reception device.

Systems and methos for generating a schematic for shelf space in a retail environment include acquiring fixture data for a fixture; acquiring item data for a plurality of items to be displayed on fixture; importing an existing planogram, the imported existing planogram comprising an existing location of each item of the plurality of items on the fixture; based on identified assortment rules, generating an updated planogram for the fixture, the generated updated planogram for the fixture including an optimized placement of the plurality of items on the fixture; and generating the schematic based on the generated updated planogram, the generated recommended schematic including a sequence of the plurality of items included in the generated updated planogram.

The present application discloses a method for out-of-stock detection, an edge computing device and a system for out-of-stock detection on a shelf, which collects a first shelf image, scans the goods in each grid in the first shelf image to obtain the first product border data, and obtains the first product name data based on all the first product border data to obtain the detection result, and sends the detection result message to the edge device management background so that the edge device management background generates the out-of-stock rate of each grid and marks the goods placed in the wrong grid, thereby increasing the amount of data for parallel out-of-stock processing and improving the efficiency of out-of-stock data processing.

The invention discloses a goods shelf management method and system based on target detection, a terminal and a medium, and the method comprises the steps: carrying out the target detection of a goods shelf image, and obtaining a plurality of first commodity frames and a plurality of first vacancy frames in the image, and the position information of each first commodity frame and each first vacancy frame; taking the first commodity frame of which the intersection-to-union ratio with any first vacancy frame is smaller than or equal to a first threshold value as a second commodity frame, layering all the first commodity frames and all the first vacancy frames according to all the position information, and analyzing the width reference quantity of each layer; according to the width reference quantity of the layer where each first vacancy frame is located, the total SKU placement quantity of the shelf vacancy is calculated, and when the total SKU placement quantity is larger than a second threshold value, a reminding signal and the total SKU placement quantity are fed back to the monitoring platform. By adopting the embodiment of the invention, the relationship between the first commodity frames with different overlapping degrees and the shelf vacancy is analyzed respectively, so that the efficient evaluation of the shelf vacancy quantity is realized.

This information processing device can use a conversion rule for mutually converting first position information that is used in an article management device for managing the number of articles and the position of the articles and indicates the position of an article in a shelf, and coordinate information that is used when the result of processing a shelf image obtained by photographing a shelf is associated with a position in the shelf. The information processing device comprises: a first generation unit that uses coordinate information obtained by processing a shelf image to generate area information indicating an area in which an article is present in a shelf and article information indicating the type of the article; and a second generation unit for converting the area information into first position information by using the conversion rule, and generating difference information between a combination of article information and the first position information after the conversion and information stored in the article management device.

To provide merchandise security systems and methods.SOLUTION: A merchandise security system includes a plurality of security devices arranged in a wireless network, wherein the plurality of security devices are arranged in a planogram, each of the plurality of security devices is configured to protect one or more items from theft, and each of the plurality of security devices is configured to wirelessly communicate data with a remote device. The system also includes a plurality of electronic keys arranged in the wireless network and configured to wirelessly communicate data with the plurality of security devices and / or the remote device. Each of the plurality of electronic keys is configured to operate the plurality of security devices. The system also includes a gateway configured to receive the data from the plurality of security devices and the plurality of electronic keys via wireless communication, wherein the gateway is configured to communicate the data to the remote computing device.SELECTED DRAWING: Figure 1

This processing device includes a reference count specification unit and a threshold determination unit. The reference count specification unit specifies, for each product, a reference count that is the number of items detected in an image of a product shelf when the display condition satisfies a reference standard. The threshold determination unit determines, for each product, a shortage determination threshold, which is a threshold for determining a shortage condition, on the basis of the reference count.

A system and method are disclosed for augmented visualization of a planogram of one or more supply chain entities. Embodiments include creating a planogram comprising one or more products, the products associated with a location, and retrieving an image of the planogram and one or more customer segments. Embodiments further include mapping one or more coordinates in an image of a planogram that correspond to the one or more customer segments and rendering an augmented visualization comprising altering the image of a planogram at one or more coordinates to illustrate the one or more customer segments.

To efficiently acquire the situation of use of a promotion activity using the fragrance of a commodity.SOLUTION: An information processing system has: injection means that injects fragrance corresponding to a predetermined commodity according to a customer's operation; first acquisition means that acquires first data obtained by recording the injection date on which the injection means injects the fragrance and identification information for identifying the commodity corresponding to the injected fragrance; detection means that detects the movement of a customer reaching for the commodity from a picked-up image of a display shelf on which the commodity is displayed; second acquisition means that acquires second data obtained by recording the detection date on which the detection means detects the movement of the customer, and identification information on the commodity reached for by the customer in the movement or position information for specifying the display position of the commodity; and data management means that stores the first data and the second data in a storage and stores pieces of data having a time-series relationship in association with each other.SELECTED DRAWING: Figure 1

The present application relates to a RFID-based fixed asset inventory method and system, the present application collects the historical reading data of the current time period, analyzes the historical reading data to obtain the reference inventory period of the current time period. Then analyze the shelf image of multiple time points in the current time period, analyze the activity of RFID tags in each storage unit, shorten the inventory period of the fixed assets with high activity, through high-frequency inventory, the differences can be found and corrected in time, ensure the real-time accuracy of the inventory data of key assets, reduce the risk of information error. For the fixed assets with low activity, the inventory period is extended. The present application concentrates the limited inventory resources (manpower, time) on key fixed assets, avoids wasting resources on low-activity materials, and improves the overall inventory efficiency.

The present disclosure provides a method, apparatus, electronic device, and storage medium for detecting the integrity of a shelf, relating to the field of artificial intelligence technology, specifically to the fields of deep learning, image processing, and computer vision technology. The method includes: performing region detection on a target shelf image to be detected to obtain target region detection information of the target shelf image; the target region detection information includes target detection frames in the target shelf image and target end types to which the target detection frames belong; performing display scene classification on the target shelf image to obtain a target display scene to which the target shelf image belongs; performing straight line detection on the target shelf image to obtain the number of target shelf layers in the target shelf image; determining whether the shelf in the target shelf image is completely photographed based on at least one of the target region detection information, the target display scene, and the number of target shelf layers. Through the above technical solution, the accuracy of shelf integrity detection can be improved.

A merchandiser device includes a storage area including multiple rows, in which each row includes multiple lanes, and in which each lane is configured to store multiple products. The merchandiser device includes a time of flight sensor positioned for use with a lane and configured to produce sensor output indicative of an event associated with a product stored in the lane. An event associated with the product is detected based on the sensor output. Identifying information for the product is determined based on the sensor output and a planogram of the merchandiser device. A quantity of the product associated with the event is determined based on the sensor output and dimensional information associated with the product. Data configured to cause an update to an inventory record associated with the product is then output based on the identifying information and the quantity.

A system and method are disclosed for augmented planogram planning. Embodiments include a server comprising a processor and memory and an instruction builder. Embodiments further include a mobile device comprising a processor and a memory and configured to display instructions on the mobile device comprising rendered instruction blocks and at least one of the instruction blocks comprises a planogram instruction block. Embodiments additionally include a digital display comprising a processor and memory and the digital display is configured to display graphics comprising the rendered instruction blocks.

One variation of a method for tracking placement of products in a store includes: accessing an image recorded by a mobile robotic system within a store; detecting a shelf in a region of the image; based on an address of the shelf, retrieving a list of products assigned to the shelf by a planogram of the store; retrieving a set of template images—from a database of template images—defining visual features of products specified in the list of products; extracting a set of features from the region of the image; determining that a unit of the product is mis-stocked on the shelf in response to deviation between the set of features and features in a template image, in the set of template images, representing the product; and in response to determining that the unit of the product is mis-stocked on the shelf, generating a restocking prompt for the product.

The present application describes a system and method which may enable an enterprise to map existing planograms for a group of stores in order to facilitate a modification of an item category in a planogram for the stores. One or more planograms associated with a desired item category may be chosen, and a list of stores for the planogram(s) may be provided. From the list of stores having a common planogram allocated to the item category, a subset of stores may be chosen for which to change the planogram(s). Changes to a planogram may require the creation of a separate child planogram, in some examples. Updates to the child planograms may apply to all stores in the chosen subset of stores, to avoid a requirement of individual planogram edits.

Consistent with disclosed embodiments, systems, methods, and computer readable media for reading wireless transmitting tags and for automatically generating product distribution planograms may be provided. Embodiments may include at least one processor configured to receive, from a plurality of receivers in an establishment, wireless signals from a plurality of wirelessly tagged products; determine, from the wireless signals, locations in the establishment of each wirelessly tagged product; perform a lookup of an ID of each wirelessly tagged product to determine product classification information associated with each product; and generate a planogram for the establishment using the determined locations of the wirelessly tagged products and the determined product classification information, the planogram indicating on a map of the establishment locations of groups of the wirelessly tagged products sharing common classification information.

To assist creation of a planogram while considering the restocking of commodities.SOLUTION: A planogram assisting method according to an aspect of the present invention calculates the number of faces for each commodity to be displayed in such a way that a product of the number of faces for each commodity to be displayed and the number of pieces of the commodity to be displayed per face becomes greater than or equal to a period average sales number of each commodity to be displayed which is the average of an actual value or a predicted value for the number of pieces for each commodity to be displayed and to be sold within a period after the commodity is displayed and until the commodity is restocked.SELECTED DRAWING: Figure 6

The invention discloses a goods shelf commodity management method and related equipment, and the method comprises the steps: obtaining a goods shelf picture through an equipment end interface, and obtaining a goods shelf detection image according to the pre-defined recognition region configuration; inputting the shelf detection image into a trained commodity recognition model, and performing single forward propagation and non-maximum suppression processing by using the commodity recognition model to generate a commodity recognition result; and matching the commodity identification result with a commodity information list in an application end database, and updating the commodity information list according to a matching result. The method has higher accuracy, reliability and management efficiency, can effectively solve the problems in the existing scheme, and provides a new solution for the field of shelf management.

Systems and methods of constructing and managing virtual planograms are presented. Contemplated systems allow for construction of a virtual planogram, which can be used to present consumers virtual inventory items as being available for purchase via a display device. The display device can include an electronic billboard within an establishment, a mall for example, or include a user's smart device, a cell phone or tablet for example.

Methods for identifying one or more items in close proximity to a mobile device and / or are within a digital image. The location of the mobile device can be determined using outdoor positioning systems (“OPS”), indoor positioning systems (“IPS”), or combinations thereof. The identity of the item or items can be determine using planograms; visual inventory; RFID handheld inventory; RFID overhead inventory; vision system inventory; UR; barcode; NEC; or combinations thereof. In some embodiments, the methods described herein include or involve identifying one or more items within a digital image, such as a photograph or video. The image has an identification (ID) / time stamp that is used to associate the items in the image that have been read in the same area as the image so that the items can be actively searched as a digital image to highlight or list items that are in the image.