50 results about "Planogram" patented technology

Disclosed herein is a system and method for matching products detected in an image of a shelf. The match or non-match of the products is then used to make a determination that the products are correctly positioned on the shelf of if the positioning of the products represents a plug or spread situation.

A method for image processing based on image data analysis may include mounting on a first retail shelving unit a first housing comprising an image capture device that is directed to a second retail shelving unit. A second housing comprising a processor is also mounted on the first retail shelving unit at location spaced apart from the first housing. A data conduit is extended between the first housing and second housing, wherein images captured by the image capture device in the first housing are transmitted to the second housing. At least some of the captured images are then transmitted from the second housing to a remote server configured to determine planogram compliance relative to the second retail shelving unit.

A system and method for providing insights regarding retail store performance and / or store layout are described herein. One or more cameras in a store capture and transmit data associated with product inventory, equipment inventory, patrons, and employees in the store to a computing device. The computing device queries a repository to determine identifiable information associated with each of the product inventory, the equipment inventory, the patrons, and the employees. The data is combined with the identifiable information to form a data set. An artificial intelligence (AI) algorithm is applied to the data set to determine a conclusion regarding a performance and / or layout of the store. The data, the data set, and the conclusion are stored the repository. A representation of the conclusion is generated and presented via a graphical user interface (GUI) of the computing device to a user. The representation is a store-specific planogram.

A transmission device according to the present technology includes an image acquisition unit that acquires a first shelf image captured at a first time for a product shelf on which a product is displayed, and a second shelf image captured for the product shelf at a second time after the first time, a region specification unit that specifies a difference region between the first shelf image and the second shelf image, a cut-out processing unit that cuts out a partial image from the second shelf image so that the difference region is included, and a transmission processing unit that transmits the first shelf image and the partial image to a reception device.

Systems and methos for generating a schematic for shelf space in a retail environment include acquiring fixture data for a fixture; acquiring item data for a plurality of items to be displayed on fixture; importing an existing planogram, the imported existing planogram comprising an existing location of each item of the plurality of items on the fixture; based on identified assortment rules, generating an updated planogram for the fixture, the generated updated planogram for the fixture including an optimized placement of the plurality of items on the fixture; and generating the schematic based on the generated updated planogram, the generated recommended schematic including a sequence of the plurality of items included in the generated updated planogram.

To efficiently acquire the situation of use of a promotion activity using the fragrance of a commodity.SOLUTION: An information processing system has: injection means that injects fragrance corresponding to a predetermined commodity according to a customer's operation; first acquisition means that acquires first data obtained by recording the injection date on which the injection means injects the fragrance and identification information for identifying the commodity corresponding to the injected fragrance; detection means that detects the movement of a customer reaching for the commodity from a picked-up image of a display shelf on which the commodity is displayed; second acquisition means that acquires second data obtained by recording the detection date on which the detection means detects the movement of the customer, and identification information on the commodity reached for by the customer in the movement or position information for specifying the display position of the commodity; and data management means that stores the first data and the second data in a storage and stores pieces of data having a time-series relationship in association with each other.SELECTED DRAWING: Figure 1

The present application relates to a RFID-based fixed asset inventory method and system, the present application collects the historical reading data of the current time period, analyzes the historical reading data to obtain the reference inventory period of the current time period. Then analyze the shelf image of multiple time points in the current time period, analyze the activity of RFID tags in each storage unit, shorten the inventory period of the fixed assets with high activity, through high-frequency inventory, the differences can be found and corrected in time, ensure the real-time accuracy of the inventory data of key assets, reduce the risk of information error. For the fixed assets with low activity, the inventory period is extended. The present application concentrates the limited inventory resources (manpower, time) on key fixed assets, avoids wasting resources on low-activity materials, and improves the overall inventory efficiency.

Methods for identifying one or more items in close proximity to a mobile device and / or are within a digital image. The location of the mobile device can be determined using outdoor positioning systems (“OPS”), indoor positioning systems (“IPS”), or combinations thereof. The identity of the item or items can be determine using planograms; visual inventory; RFID handheld inventory; RFID overhead inventory; vision system inventory; UR; barcode; NEC; or combinations thereof. In some embodiments, the methods described herein include or involve identifying one or more items within a digital image, such as a photograph or video. The image has an identification (ID) / time stamp that is used to associate the items in the image that have been read in the same area as the image so that the items can be actively searched as a digital image to highlight or list items that are in the image.

A training data generation device comprises a shelf-image acquisition unit, a product-image acquisition unit, and a synthesis unit. The shelf-image acquisition unit acquires a shelf image constituting one compartment of a shelf on which a product is displayed. The product-image acquisition unit acquires a product image of the product displayed on the shelf. The synthesis unit generates training data by synthesizing the shelf image and the product image, and the synthesis unit additionally, in accordance with the shape of the shelf and / or the shape of the product, causes the display in the product image to differ and synthesizes the result with the shelf image.

Embodiments of the present application provide an information processing method, device and equipment. Wherein, a shelf picture collected by a mobile robot in a target site is obtained; at least one shelf is deployed in the target site, the at least one shelf respectively displays at least one article and is provided with a first information carrier at a respective display position of the at least one article, the first information carrier carries article information of the corresponding article; the first information carrier and the article information carried by the first information carrier in the shelf picture are identified; and based on the article information of at least one article belonging to the same shelf, shelf display information is generated. The technical scheme provided by the embodiments of the present application realizes efficient and accurate information acquisition.

Systems and methos for generating a schematic for shelf space in a retail environment include acquiring fixture data for a fixture; acquiring item data for a plurality of items to be displayed on fixture; importing an existing planogram, the imported existing planogram comprising an existing location of each item of the plurality of items on the fixture; based on identified assortment rules, generating an updated planogram for the fixture, the generated updated planogram for the fixture including an optimized placement of the plurality of items on the fixture; and generating the schematic based on the generated updated planogram, the generated recommended schematic including a sequence of the plurality of items included in the generated updated planogram.

A system includes a plurality of racks each storing packs of cigarettes, a display device associated with each rack and a master controller coupled to the racks and the display devices. A processor of the master controller is configured to receive a first indication that a scanner has scanned a first code associated with a first rack of the plurality of racks while the scanner is in a product checking mode. In response, the processor obtains from a memory a first rack number of the first rack and a first UPC associated with the rack number based on a planogram. The processor subsequently receives a second UPC scanned by the scanner of a pack actually stored in the first rack. Based on determining that the first and second UPCs do not match, the processor transmits an alert message indicating incorrect product placement in the first rack.

An image recognition method for planogram compliance, comprising the steps of: receiving an input image of a target area to be analysed for planogram compliance; detecting one or more objects in the input image; optionally, detecting one or more gaps in the input image; calculating image similarity scores of the one or more objects detected and a plurality of product images; identifying an associated product for at least one of the one or more objects detected, based on the calculated image similarity scores, and assessing the target area based on the one or more objects detected, the one or more gaps detected and / or the associated products identified of the one or more objects.

The application discloses an electronic price tag position recognition method and system based on image contrast, relates to the technical field of electronic price tags, acquires a target shelf image, determines a plurality of position-to-be-resolved candidates according to a plurality of price tag candidate regions in the target shelf image, electronic price tag binding information Bind and historical position archive information Hist, and establishes a candidate conflict graph Cmap according to the spatial adjacency relationship, the appearance approximation relationship and the storage location corresponding relationship among the plurality of position-to-be-resolved candidates; and selects a target detection set Tset according to the candidate conflict graph Cmap. Thus, the application can uniformly model adjacent price tags, appearance-similar price tags and storage location conflict price tags, and actively confirms the position of the electronic price tag through the image contrast change after the controlled display, thereby reducing the risk of misrecognition of the position of the electronic price tag and mismatch of the goods storage location in the dense shelf scene.

The application discloses an article display information updating method, device, equipment and medium. The method comprises the following steps: obtaining a target shelf image, and detecting the target shelf image based on a target detection model to obtain at least one article single body detection result; determining at least one article single category detection result according to the at least one article single body detection result; and updating article display information of a target shelf according to the article single body detection result and the article single category detection result. The technical scheme solves the problem of low updating efficiency of article display information, can effectively improve the updating efficiency of article display information while ensuring the article recognition accuracy, and reduces the management cost.

Systems and methods for analyzing computer-readable image data to determine deviations from planogram data are disclosed. Image data of at least one physical display unit is obtained. The image data is annotated by an image processing engine to identify at least one item within the image data. Planogram data of a planogram corresponding to the at least one physical display unit is obtained and the at least one item within the image data is compared to an expected aspect of the at least one item within the planogram data. A user interface is generated including the image data and at least one interface indicator at least partially overlapping with the at least one item in the image data. At least one graphical aspect of the interface indicator is selected based on the comparison between the item within the image data and the item within the planogram data.

The application discloses a kind of detection method and device of fresh goods, which comprises the following steps: collecting shelf image, and detecting real fresh basket and price tag on the shelf from the shelf image;Based on the price tag on the shelf, generate virtual fresh basket;According to the position information of the real fresh basket, the position information of the virtual fresh basket is corrected;Based on the real fresh basket and the virtual fresh basket, the fresh goods on the shelf is detected.The application detects the real fresh basket on the shelf from the shelf image, uses virtual fresh basket to assist supplement the possible missed detection, and then detects and divides the fresh goods based on the real fresh basket and the virtual fresh basket, which can improve the detection accuracy of fresh goods, so that the detection algorithm can be better applied in actual scene, has certain detection algorithm fitting degree, improves the algorithm universality, and has the possibility of large-scale use.

This technology provides an easy way to determine if products are displayed correctly. [Solution] The information processing device 2000 includes an image analysis unit 2020 that analyzes a shelf image in which a product shelf has been captured and generates actual display information representing the display status of products on the product shelf; a comparison unit 2040 that compares the actual display information with standard display information representing the standards for displaying products on the product shelf and generates comparison information representing the result of the comparison; and a generation unit 2060 that uses the comparison information to generate a result image representing products that do not conform to the standards indicated by the standard display information. The result image is displayed in a manner that allows for the identification of products that do not conform to the standards indicated by the standard display information and products that conform to the standards indicated by the standard display information. The generation unit 2060 superimposes a heatmap onto the shelf image as superimposed data indicating the result of the comparison, in which the color of the part corresponding to the product that does not conform to the standard display information is relatively dark, and the color of the part corresponding to the product that conforms to the standard display information is relatively light.

The application discloses a method and device for generating a shelf display shelf area, and the method comprises the following steps: obtaining a shelf image to be detected and recognized; inputting the shelf image to be detected and recognized into a pre-trained shelf detection model to detect the shelf image to be detected and recognized and obtain a shelf display shelf area bounding box; the shelf detection model is pre-trained according to a historical shelf image data set and a corresponding shelf area bounding box label data set sample; and outputting the detected shelf display shelf area bounding box information. The shelf detection model can be used to directly detect possible shelf areas on a shelf image, so that the efficiency and accuracy of the shelf area generation are improved.

Methods and systems are disclosed for dynamic adjustment of planograms on electronic door displays of refrigerated display cases. A display system for a refrigerated display case includes: a movable door configured to provide access to the refrigerated display case; a touchscreen display mounted to the door; at least one processor in electronic communication with the touchscreen display and configured to perform operations comprising: providing, for presentation by the touchscreen display, first image data, wherein the first image data depicts one or more products stored within the refrigerated display case; detecting user input at a first location of the touchscreen display, wherein the user input includes a selection of a product stored within the refrigerated display case; and in response to detecting the user input, providing second image data for presentation in addition to the first image data, wherein the second image data depicts information related to the selected product.

Even if the entire shelf does not fit within the field of view of the sensor measuring the shelf, the system can still measure the degree to which the shelf is filled with goods. [Solution] The measurement method involves receiving an image of the shelf and a depth image indicating the distance to the shelf from a sensor that moves along the shelf where the luggage is stored and photographs the shelf. If a predetermined marker placed on the shelf is detected from the image, the position of the detected marker is used as a reference point to set a measurement range in the depth image, and the occupancy rate of the luggage within the set measurement range is measured using the depth image.

The invention discloses a shelf commodity state detection method, device and equipment and a readable storage medium, and is applied to the technical field of intelligent detection, and the method comprises the steps: carrying out the recognition processing of a collected shelf image, extracting shelf data and commodity information, processing the shelf data and the commodity information, and obtaining structured shelf commodity information; determining the commodity width of each layer based on the structured shelf commodity information, obtaining the width of each layer based on the commodity width of each layer, and determining the height of each layer according to the commodity height of each layer and the sub-layer information; drawing a virtual shelf frame based on the width and the height of each layer; and mapping the position information and the feature information of each commodity in the structured shelf commodity information to a corresponding position of a virtual shelf frame to obtain a virtual shelf so as to display a commodity state based on the virtual shelf. Compared with the current manual inspection, the method can visually determine the state of the commodity on the shelf through the virtual shelf, and improves the commodity state determination efficiency.

This disclosure provides a method and system for intelligent scoring of product display images based on dynamic rule configuration. The method includes recognizing and performing basic structured modeling on the collected shelf images to generate a structured data set; identifying a cross-category and spatially continuous set of products to construct a combined display semantic unit with business semantics; semantically reconstructing the original scoring rules through a dynamic rule engine, transforming the single-product rule system into a two-layer rule structure consisting of combination priority rules and single-product supplementary rules; calculating the overall combined score of the combined display semantic unit according to the mapping relationship, performing single-product supplementary scoring on products not covered by the combination priority rules, and merging to generate the shelf scoring result; and re-executing the dynamic rule reconstruction and scoring calculation based on the archived combined display semantic units and structured data set in response to changes in scoring rules. This method solves the problems of slow rule adjustment response, single scoring dimension, and difficulty in reusing historical data.

A system includes a plurality of racks each storing packs of cigarettes, a display device associated with each rack and a master controller coupled to the racks and the display devices. A processor of the master controller is configured to receive a first indication that a scanner has scanned a first code associated with a first rack of the plurality of racks while the scanner is in a product checking mode. In response, the processor obtains from a memory a first rack number of the first rack and a first UPC associated with the rack number based on a planogram. The processor subsequently receives a second UPC scanned by the scanner of a pack actually stored in the first rack. Based on determining that the first and second UPCs do not match, the processor transmits an alert message indicating incorrect product placement in the first rack.

A system and method are disclosed for virtual planogram automation comprising receiving, by a planogram planner comprising a server, image data from imaging devices of products prior to the display of the products in a product display area at a retail entity, detecting changes in a product based on the received image data, performing simulated annealing to generate new planogram options by generating a planogram option in response to received image data and one or more received KPI's, incrementing the planogram option according to neighboring states of the planogram parameters, calculating an objective function measuring optimality of the incremented planogram option, repeating the generating, incrementing and calculating steps until a stopping criterion is met according to the objective function, and determining a final planogram based on the stopping criterion being met.

The invention discloses a multi-modal large model and multi-modal fused warehouse goods SKU automatic detection method, which comprises the following steps: S1, constructing an SKU detection system which comprises a YOLO object detection model, a vector database and a relational database; training the YOLO model on the user-defined shelf image data set; s2, carrying out object detection on the input goods shelf image, identifying and cutting a goods area through a YOLO model, and generating a cut image list; s3, performing text quality evaluation on each cut image, calculating a confidence coefficient by using an OCR (Optical Character Recognition) engine, and filtering low-quality images of which the confidence coefficient is lower than a set threshold value; s4, carrying out OCR text extraction on the reserved cut image, identifying a brand and text content through a multi-modal large model, and calculating an overexposure proportion and an image area at the same time; according to the warehouse goods SKU automatic detection method based on modal large model and multi-modal fusion, warehouse goods SKU identification and retrieval can be automatically completed with high precision and low maintenance cost.

Systems and methods for analyzing computer-readable image data to determine deviations from planogram data are disclosed. Image data of at least one physical display unit is obtained. The image data is annotated by an image processing engine to identify at least one item within the image data. Planogram data of a planogram corresponding to the at least one physical display unit is obtained and the at least one item within the image data is compared to an expected aspect of the at least one item within the planogram data. A user interface is generated including the image data and at least one interface indicator at least partially overlapping with the at least one item in the image data. At least one graphical aspect of the interface indicator is selected based on the comparison between the item within the image data and the item within the planogram data.

There are provided systems and methods for use in arranging merchandise at shelving locations of retailer facilities. In one form, the system may include: a retailer facility with shelving locations for merchandise; a planogram or merchandise database indicating the correspondence of shelving locations to categories of merchandise items; and a pick database containing a first-time pick metric corresponding to each shelving location, the first-time pick metric indicating the frequency of locating the merchandise type at the shelving location. The system may also include a control circuit that determines a set of categories of merchandise items with low first-time pick metrics, determines a subset including certain core merchandise categories and including merchandise categories with the highest sales data, and transmits a notification regarding the subset of categories.

Systems and methods for triggering object recognition and planogram generation via shelf sensors are disclosed herein. An example apparatus may comprise a shelf, at least one sensor affixed to the shelf, at least one camera affixed to the shelf, and at least one server communicatively coupled to the at least one camera and the at least one sensor. The apparatus may be configured such that the at least one sensor is configured to detect that at least one threshold has been met, and the at least one sensor is further configured to trigger an image to be taken by the least one camera; wherein the at least one camera is configured to capture at least one image based on the met threshold, and the at least one server is configured to identify at least one product identifier based on the at least one captured image.