Product management system and product display fixtures

By using indicators longer than the width on the shelves and taking pictures with cameras at specific angles, the problem of inaccurate product quantity calculation in existing technologies has been solved, achieving efficient and reliable product management.

JP2026049453APending Publication Date: 2026-03-18OKAMURA CORP
View PDF 2 Cites 0 Cited by

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-09-06
Publication Date
2026-03-18

AI Technical Summary

Technical Problem

Existing technologies struggle to accurately count the number of products on shelves, especially when multiple shelves are captured by a single camera, making it difficult to detect product markings and leading to inaccurate product management.

Method used

By employing indicators whose length is greater in the depth direction than in the width direction (such as ArUco markers) and capturing images from a specific angle using a camera, combined with matrix arrangement and regional differentiation design, the reliability of indicator detection is improved.

Benefits of technology

It enables reliable management of products on the shelves, reduces false detections when products are out of stock, and improves the accuracy and efficiency of the product management system.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2026049453000001_ABST
    Figure 2026049453000001_ABST
Patent Text Reader

Abstract

This technology provides reliable management of shelf-displayed products based on indicator detection using cameras. [Solution] The product management system for managing the presence or absence of products displayed along the depth direction on the product placement surface 13 of the display member 12 of the product display fixture 1 comprises an indicator M placed on the product placement surface 13, a camera 2 that photographs the product placement surface 13, and a product detection unit that detects whether a product corresponding to the detected indicator M is not present on the product placement surface 13 based on the detection of the indicator M by the camera 2. The length of the indicator M in the depth direction is longer than its length in the width direction.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a product management system for managing the presence or absence of products displayed along the depth direction on a product placement surface in a display member of a product display fixture, and to a product display fixture in which products on display are managed by this product management system.

Background Art

[0002] In the notification system according to Patent Document 1, an image of a product storage shelf photographed by cameras installed on the ceiling, walls, and shelves of a store is analyzed using object detection technology and object recognition technology using deep learning, etc., and the number of products on the product storage shelf is calculated. When the calculated number of products is less than or equal to the minimum number and the current time is within the notification target time zone, the display device corresponding to the product is lit.

[0003] In the inventory status management device according to Patent Document 2, the presence or absence of products on a display shelf is determined based on whether a marker (indicator) provided at the position where the product is placed is detected from a photographed image of the camera. Since the relationship between the marker and the product is managed, when the marker type or the marker generation position is detected by analyzing the photographed image, the corresponding product name is deduced. The product without a marker is provided at the position where the product remains until the end when the products are taken out in order from a tray on which the products are arranged.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0005] In the notification system described in Patent Document 1, the number of products on a shelf is calculated by performing image recognition on an image of the shelf captured by a camera. However, since many products are displayed on a shelf, accurately calculating the number of products from the captured image is difficult even with image recognition technologies such as deep learning. In particular, when multiple shelves are photographed using a single camera (see Figure 1 in Patent Document 1), only a portion of each product is captured, making image recognition difficult.

[0006] In the inventory management device described in Patent Document 2, a product shortage is determined by detecting a product marker (indicator) that appears when a product is no longer available on a display shelf from the captured image. However, even here, each marker in the camera's captured image is not only small in area, but also distorts as it moves away from the camera's central axis. In particular, when trying to capture a large number of markers with a single camera field of view, the problem arises that markers may not be detected.

[0007] In view of the above circumstances, the object of the present invention is to provide a technology that enables reliable management of shelf-displayed products based on indicator detection by a camera. [Means for solving the problem]

[0008] The product management system according to the present invention is a system for managing the presence or absence of products displayed along the depth direction on a product placement surface of a product display fixture, and comprises an indicator placed on the product placement surface, a camera that photographs the product placement surface, and a product detection unit that detects whether the product corresponding to the detected indicator is not present on the product placement surface based on the detection of the indicator by the camera, wherein the length in the depth direction is longer than the length in the width direction.

[0009] With this configuration, the indicator placed on the product placement surface has a length in the depth direction that is greater than its width direction. Therefore, even if the indicator is exposed and captured in the image when a product is removed (picked up), it can be reliably detected even if it is reduced in size and distorted due to its distance from the camera's center axis in the depth direction, enabling reliable management of shelf-displayed products. However, if the indicator is simply enlarged, both the length in the depth direction and the width direction will increase. The increase in the width direction will limit the types of products (product widths) that can be placed corresponding to that indicator, which may cause problems. However, if only the length in the depth direction is increased, or mainly the length in the depth direction is increased, such problems are avoided, which is advantageous. For this reason, indicators with a length in the depth direction that is greater than the length in the width direction have advantages.

[0010] By installing the camera above and in front of the product placement surface, the product placement surface can be efficiently photographed. The field of view of a camera installed in this manner extends in the depth direction of the product placement surface and in the left-right direction (horizontal direction perpendicular to the depth direction). Taking this camera field of view into consideration, the present invention proposes arranging the indicators in a matrix on the product placement surface to form an indicator group.

[0011] Due to the optical properties of camera lenses, the subject shrinks and becomes more distorted as it moves away from the camera's shooting axis in both the depth and width directions. Therefore, indicators located far from the shooting axis have poor detectability, but their detectability can be improved by increasing the area of ​​the indicators to a certain extent. For this reason, the present invention proposes that the area of ​​the indicators provided in the peripheral region of the product placement surface, which is located far in both the depth and width directions from the central region of the product placement surface near the intersection of the product placement surface and the camera's shooting axis, is larger than the area of ​​the indicators provided in the central region.

[0012] In the case of product display fixtures consisting of multi-tiered display members, the camera is positioned diagonally above the product placement surface in order to capture as wide an area of ​​the product placement surface as possible. In images of the product placement surface captured with such a camera arrangement, the length in the depth direction is reduced as the angle between the center axis of the camera and the product contact surface decreases. For example, with a 45-degree camera angle, the length is reduced to about 5 / 7 of its original size. Therefore, it is advantageous to use an indicator with an enlarged length in the depth direction. For this reason, the present invention proposes that the aspect ratio of the indicator be between 1.5 and 2.5. The shape of the indicator can be a rectangle, trapezoid, ellipse, etc., and the aspect ratio in this case is the ratio of the long side to the short side. Note that if the aspect ratio becomes too large, it becomes difficult to detect the indicator, so in the present invention, the upper limit of the aspect ratio is limited to 2.5.

[0013] In this invention, it is proposed that the indicator is a modified ArUco marker. Compared to QR codes (registered trademark) and barcodes, ArUco markers have the advantage of being easily and quickly detected by cameras. For this reason, a modified version of the ArUco marker is used as the indicator and is placed on the product placement surface such that its length in the depth direction is longer than its length in the width direction.

[0014] In this invention, the subject matter is not only the product management system described above, but also a product display fixture for displaying the products managed by this product management system. Such a product display fixture is equipped with display members that display products along the depth direction, and an indicator for managing the presence or absence of the products placed on the product placement surface of the display member is arranged on the product placement surface, and the length of the indicator in the depth direction is longer than the length of the indicator in the width direction. By using such a product display fixture of the present invention, the product management system of the present invention can manage products effectively. [Brief explanation of the drawing]

[0015] [Figure 1] This is a perspective view of a product display fixture as captured by a camera. [Figure 2] This is a side view of a product display fixture. [Figure 3] It is a schematic diagram explaining the arrangement of an index sheet on a merchandise display fixture. [Figure 4] It is a schematic diagram showing another form of the index sheet arranged on the merchandise display fixture. [Figure 5] It is a schematic diagram showing yet another form of the index sheet arranged on the merchandise display fixture. [Figure 6] It is a schematic functional block diagram showing an example of the functional configuration of a merchandise management system. [Figure 7] It is a schematic diagram explaining the relationship between the detected index and the merchandise. [[ID=第十四条]] [Figure 8] It is a schematic diagram showing an example of the operation of creating an index whose length in the depth direction is longer than the length in the width direction and providing it on the merchandise display fixture.

Embodiments for Carrying Out the Invention

[0016] Hereinafter, an example of a merchandise management system according to the present invention will be described with reference to the drawings.

[0017] Note that the index used in this invention has a figure (including characters) in which information is embedded, and its shape is such that the length in the depth direction is longer than the length in the width direction.

[0018] Examples of indicators with figures (including characters) embedded with information include ArUco markers, QR codes (registered trademarks), barcodes, etc. Among them, a barcode is a one-dimensional code that records information horizontally, and ArUco markers and QR codes (registered trademarks) are two-dimensional codes that record information in two directions, vertically and horizontally. ArUco markers have the advantage of being easier and faster to detect by a camera compared to QR codes and barcodes. Therefore, in this embodiment, an ArUco marker is used as the indicator. Note that since generally used ArUco markers are square-shaped, the indicator used in this embodiment is an ArUco marker deformed so that the length in the depth direction is longer than the length in the width direction. Of course, if a marker whose length in the depth direction is originally set to be longer than the length in the width direction is used, the marker can be directly used as the indicator of the present invention.

[0019] In this product management system, products displayed on multiple shelves 12, which are display members of the product display rack 1 (hereinafter simply referred to as the rack 1) shown in FIG. 1, are managed using a camera 2. In FIG. 1, although indicated by arrows, in this specification, the front side (frontward side) of the rack 1 from which products are taken out by customers indicates "front", and the opposite side, that is, the back side (backward side), indicates "back". The left-right direction facing the front of the rack 1 indicates "left" and "right". Hereinafter, the "left-right direction" may be referred to as "horizontal" or "width direction". The "front-back direction" may also be referred to as "vertical" or "depth direction".

[0020] The rack 1 is mainly a product display shelf installed in stores such as supermarkets and convenience stores for displaying and selling products. In the sales floor, a plurality of racks 1 are arranged in parallel or individually. The rack 1 shown in FIG. 1 is mainly composed of columns 10 arranged at intervals left and right, a rear wall plate 11 which is a rear plate provided between the left and right columns 10, and a plurality of shelves 12 extending forward from the left and right columns 10. Note that in FIG. 1, the shelves 12 are arranged only on one side in the front-back direction with respect to the left and right columns 10, but as shown in FIG. 2, they may also be arranged on the other side.

[0021] The top surface of the shelf board 12 is used as a product placement surface 13 on which products are placed. Products are placed on the product placement surface 13 so as to be arranged in the depth direction and width direction. In this case, the product placement surface 13 may be divided by partition plates or the like according to the type (size) of products, and products may be placed in each section (placement section) as a product row.

[0022] In Figure 1, the indicators M are arranged in a row in the width direction in the central region in the depth direction of the product display surface 13. In other words, the indicators M are arranged in a matrix of 1 row and n columns (n ​​is a natural number set according to the width dimension of the product display surface 13). Each column of this matrix corresponds to a product row in which products are displayed in the depth direction, and the same product or product of the same type is placed in each column (product row). At least one product is placed on the indicator M of each column. Therefore, if a product in a column, including a product placed on an indicator M in that column, is removed, the indicator M is exposed to the camera 2 and is captured in the image taken by the camera 2. Products in a product row are removed sequentially from the front, effectively resulting in a front-filling system, so it is possible to detect the absence of a product in the product row corresponding to the indicator M or a decrease in the number of products in the product row through the captured image in which the indicator M is visible.

[0023] Figure 1 is for illustrative purposes only. The product placement surface 13 of the top shelf 12 shows no products, only indicators M arranged in the width direction. The product placement surface 13 of the second shelf 12 from the top shows only products. The product placement surfaces 13 of the remaining shelves 12 omit both indicators M and products.

[0024] As shown in Figure 3, the indicator M used in this embodiment has a length in the depth direction that is longer than the length in the width direction, and such indicators M are arranged in a matrix. To easily place the indicators M (indicator group) on the product display surface 13, indicator group print data is generated in which an indicator group consisting of one row of indicators M is arranged to match the width of the product display, and the indicator sheet MS printed out from the printer PT is affixed to the product display surface 13. For example, in this indicator M, the length in the depth direction: L (e.g., 50 mm) is 2.5 times the length in the width direction: W (e.g., about 20 mm). The shape of the indicator M is not limited to a rectangle, but may also be an ellipse or a trapezoid. However, the length in the depth direction is the longer side (major axis), and the length in the width direction is the shorter side (minor axis). In any case, the ratio of the length in the depth direction to the length in the width direction (aspect ratio) is preferably between 1.5 and 2.5.

[0025] In the fixture 1 of the embodiment shown in Figure 3, the indicators M are arranged on the product placement surface 13 in a matrix of 1 row and n columns (where n is a natural number set according to the width dimension of the product placement surface 13). Alternatively, as shown in Figure 4, the indicators M may be arranged on the product placement surface 13 in a matrix of m rows and n columns (where m is a natural number of 2 or more set according to the depth dimension of the product placement surface 13, and n is a natural number set according to the width dimension of the product placement surface 13).

[0026] As shown in Figure 4, when the indicators M are arranged in an m x n grid, the size of all indicators M may be the same, or, as shown in Figure 5, they may differ depending on their position in the matrix. For example, in Figure 5, the area of ​​the indicator M provided in the peripheral region 13S, which is located in the depth and width directions away from the central region 13C of the product placement surface 13 near the intersection point CP of the camera 2's shooting center axis and the product placement surface 13, is larger than the area of ​​the indicator M provided in the central region 13C. Note that in Figure 5, the area of ​​the indicator M provided in the front region 13F, other than the central region 13C and the peripheral region 13S, is the same as the area of ​​the indicator M provided in the central region 13C. Of course, the area of ​​the indicator M provided in the front region 13F may be approximately the same as the area of ​​the indicator M provided in the peripheral region 13S, or it may be an intermediate size between the area of ​​the indicator M provided in the central region 13C and the area of ​​the indicator M provided in the peripheral region 13S. Furthermore, in Figure 5, the indicators M provided in the central region 13C and the front region 13F appear to be square, but in reality, their length in the depth direction is longer than their length in the width direction. However, the present invention does not exclude the exceptional use of a nearly square indicator M in a specific region of the product placement surface 13 (for example, the central region 13C).

[0027] As shown in Figure 1, camera 2 is positioned above the front of one fixture 1 or two adjacent fixtures 1 so as to capture the exposed indicator M that is not obscured by the merchandise. If it is not possible to capture all the indicators M on one fixture 1 or two adjacent fixtures 1 with one camera 2, multiple cameras 2 or a movable camera 2 may be used.

[0028] Figure 6 shows a functional block diagram illustrating the functional configuration of the product management system. Each shelf of the fixture 1 has a product placement surface 13 on which a group of indicators M arranged in the width direction are placed. Images captured by camera 2, which captures this group of indicators within its field of view, are recorded in the image recording unit 22, which is provided in the relay device of camera 2. Since there are many cameras 2 in the store, images captured by each camera 2 are sent to and recorded in the image recording unit 22.

[0029] An edge computer 4 is provided as a central control device for the control of the product management system. The edge computer 4 has a storage unit and a CPU (Central Processing Unit) that executes programs. The storage unit is composed of, for example, an HDD, ROM (Read Only Memory), or non-volatile memory. The edge computer 4 has an index processing module 3, a data output unit 41, and a real-time control unit 42 as functional units particularly relevant to the present invention. Each functional unit is realized when a program is executed by the CPU of the edge computer 4. The index processing module 3 functions as a product detection unit that detects whether a product corresponding to the detected index M is not present on the product placement surface 13, based on the detection of index M by the camera 2.

[0030] The index processing module 3 acquires captured images from the captured image recording unit 22, and if the captured image contains an index M, it uses the index M to process information about the product removed from the fixture 1 (pickup product), such as the location of the removed product (pickup location), the type of the removed product, and the fixture 1 and product placement surface 13 on which the removed product was placed. For this purpose, the index processing module 3 includes a captured image acquisition unit 31, an extraction unit 32, an index information reading unit 33, a location detection unit 34, a fixture identification unit 35, and a product identification unit 36.

[0031] The image acquisition unit 31 acquires images recorded in the image recording unit 22 based on the set product management schedule and provides them to the extraction unit 32. The extraction unit 32 determines whether the acquired image contains index M, and if it does, it extracts the region of index M detected from the image. The presence of index M in the image means that the product has been removed from the product region corresponding to this index M.

[0032] The indicator information reading unit 33 reads the indicator ID (which may be just a number) assigned to the indicator M extracted by the extraction unit 32, and provides it to the position detection unit 34, the fixture identification unit 35, and the product identification unit 36.

[0033] The position detection unit 34, the fixture identification unit 35, and the product identification unit 36 ​​derive information (data) assigned to the read index ID from a table. For example, the fixture identification unit 35 derives the fixture ID, the mounting surface ID, and the mounting area ID from the index ID, thereby identifying the fixture 1, the product mounting surface 13, and the mounting area (mounting region, mounting row) from which the product was removed (the product was picked up). The position detection unit 34 identifies the position (pickup position) of the product removed from the product mounting surface 13 or the mounting area. The product identification unit 36 ​​identifies the type of product removed from the product mounting surface 13 or the mounting area. In other words, the functions of the position detection unit 34, the fixture identification unit 35, and the product identification unit 36 ​​are related to each other, so they may be integrated into a single product detection unit.

[0034] Here, we will explain an example of a configuration that derives product identification data assigned to a read index ID, using Figure 7.

[0035] When a product is removed and the indicator M that was hidden by the product is exposed on the product placement surface 13, the exposed indicator M is captured in the image taken by the camera 2 and extracted by the extraction unit 32. From the extracted indicator M, the indicator ID (simply shown as ID31 in Figure 7) that was assigned to this indicator M is read. Once the indicator ID is known, the fixture ID, fixture position, placement surface ID, placement surface position, placement area ID, and placement area position associated with it are derived. In other words, the position (row) where the product is no longer present after being removed from the product placement surface 13 is identified. By deriving the product type associated with the placement area ID, the type of product that was removed (product name, etc.) is obtained. In this embodiment, each time the exposed indicator M is photographed by the camera 2, the indicator M is extracted by the extraction unit 32. However, it is not limited to this, and the indicator M may be photographed by the camera 2 and then extracted by the extraction unit 32 after a certain period of time.

[0036] The product removal information (product pickup information) generated in the indicator processing module 3 is preferably output from the data output unit 41 along with the photographic image and time of photography that formed the basis for the information, for product management purposes. This makes it possible to obtain product removal information that is difficult to grasp from POS data (for example, information indicating that after a product is removed from the product placement surface 13 at the pickup location, the product is returned to the product placement surface 13).

[0037] As shown in Figure 6, when the real-time control unit 42 detects that an item has been removed from the item placement surface 13 of the fixture 1, it issues a notification using an alarm device (for example, a flashing light 51 or similar alarm) located near the fixture, prompting store staff to pay attention to product management, such as replenishing the products.

[0038] Each store is equipped with at least one edge computer 4. The processing results (product management information) output from the index processing module 3 by the edge computer 4 are transferred to the host computer 6 via a data communication network such as a private line, the internet, or a public line. The host computer 6 is located within the store or in a management center that manages multiple stores. In this embodiment, the processing results from the index processing module 3 are transferred to the host computer 6 approximately every 5 minutes.

[0039] The host computer 6 processes product management information transmitted from the store's edge computer 4 (primarily based on time-series pickup location data for each fixture 1) to create product analysis information and product display evaluation information, and then provides notification and manages the products. The host computer 6 comprises a calculation unit 6A, a notification unit 6B, a database 6C, and a map generation unit 6D.

[0040] The calculation unit 6A performs statistical calculations and inference calculations using the received product management information and past product management information stored in the database 6C. The map generation unit 6D accesses the database 6C and outputs the requested fixture 1, preferably a store image of the area around the pickup location, or a store map (map), or both, and provides it to the notification unit 6B, etc. The notification unit 6B includes a notification information generation unit 61, a display unit 62, and a printing unit 63. The notification information generation unit 61 generates product analysis information and product display evaluation information using the calculation results of the calculation unit 6A. The product analysis information here is, for example, information showing when, where, and how each product was sold, and the product display evaluation information is information showing the display locations with good sales, product empty spaces, and spaces with missing display items over time. The display unit 62 converts the information into display information (for example, HTML data) and provides it to the host computer 6 or the mobile communication terminal 8 that has accessed the system. Furthermore, the display unit 62 can directly display notification information such as product analysis information and product display evaluation information on the screen of the host computer 6's display device 62a or the screen of the mobile communication terminal 8. The notification unit 6B can also send product analysis information, product display evaluation information, or simply messages regarding the pickup location (such as "Product A has been picked up from the mounting surface ID of the fixture ID") to the registered user's mobile communication terminal 8, such as a smartphone.

[0041] In the above description, the support configuration of camera 2 is not particularly limited. As shown in Figures 1 and 2, camera 2 is positioned above the front of fixture 1 so as to be able to photograph indicator M and not obstruct the passage of shoppers. For this reason, it is preferable that camera 2 is suspended from the ceiling or attached to the ceiling or support column 10 of the opposite fixture 1 via a mounting bracket.

[0042] In the embodiment described above, an ArUco marker whose length in the depth direction is longer than its length in the width direction is used as the index M. An example of a procedure for properly creating such an index M is shown in Figure 8.

[0043] As shown in Figure 8, for example, deformed index data is generated from normal index data (image data) representing index M (hereinafter referred to as normal index NM) generated from the ArUco marker generation program, in which the length in the depth direction is longer than the length in the width direction. By inputting the deformed index print data generated from this deformed index data into the printer PT, index M (hereinafter referred to as deformed index DM) in which the length in the depth direction is longer than the length in the width direction is printed out. If print data generated from normal index data is input into the printer PT, normal index NM will be printed out.

[0044] To find the appropriate deformation indicator DM, various deformation indicators DM with different aspect ratios are printed out and placed on the product placement surface 13 of the product display fixture 1. For comparison, a standard indicator NM may also be printed out and placed on the product placement surface 13 of the product display fixture 1. The deformation indicator DM and standard indicator NM placed on the product placement surface 13 are photographed by a camera 2 installed at a designated location. It is preferable that the camera photographs be taken while changing the arrangement pattern on the product placement surface 13.

[0045] The image captured by camera 2, including the deformation index DM and the normal index NM, is processed to check the detectability of each index M. Based on the results of this detectability check, the deformation index DM that is appropriately detected is determined. An appropriate index M may be selected for each matrix position set on the product placement surface 13, or the index M that shows the best detectability on average on the product placement surface 13 may be selected.

[0046] Once the appropriate (optimal) deformation index DM is determined, index sheet data is created in which the deformation index DM (which may be partially mixed with the normal index NM) is arranged in a matrix. Using this index sheet data, an index sheet MS is printed out and attached to the product placement surface 13. If the display components of the product display fixture 1 are multi-tiered shelves 12, an index sheet MS having different deformation index DMs for each tier of the shelf 12 may be attached.

[0047] [Another embodiment] (1) The form of the fixture 1 shown in the above-described embodiment is just an example, and the fixture 1 may be a freezer or refrigerator, or a flat-lay fixture 1.

[0048] (2) In the above-described embodiment, the camera 2 as a detection device for detecting the indicator M was fixed (including pan-tilt type and scanning type), but the camera 2 may be mounted on an autonomous driving device. Alternatively, a camera 2 capable of scanning in the vertical direction may be used as the detection device.

[0049] (3) In the above-described embodiment, when product shortage information is output, the real-time control unit 42 illuminates the warning light 51 and a predetermined lamp in the fixture management room for a certain period of time in order to notify in real time that product removal has occurred. As a variation of this, if the out-of-stock product is a specific product that has been set in advance (such as a featured product, a sale product, or a promotional product), a different notification method may be used than for normal products. For example, the warning light 51 and a predetermined indicator light in the fixture management room may flash at a different frequency or light up in a different color. In addition, in the case of voice notification by a buzzer or speaker, the tone and volume may be different for specific products and normal products. Furthermore, a message informing that a product, especially a specific product, is out of stock may be sent to the person in charge's mobile communication terminal 8 using a different font color and font size than for normal products.

[0050] (4) In the above-described embodiment, the bottom surface size of the products covering the indicator M was considered to be substantially the same, and the indicator M was arranged in a matrix with equal widths. Of course, similar product management processing is possible even if the bottom surface sizes of the products are different. In that case, indicator M of the same size may be arranged in an uneven matrix according to the bottom surface size of the products. In addition, the shape of the indicator M may be deformed to resemble the bottom surface size of the products.

[0051] (5) The configuration of the edge computer 4, host computer 6, and mobile communication terminal 8 is just one example; the whole may be an integrated configuration, or it may be composed of many additional computer devices.

[0052] (6) Each functional unit in the functional block diagram shown in Figure 6 may be integrated or further divided.

[0053] Furthermore, the configurations disclosed in the above embodiments (including other embodiments, the same applies hereinafter) can be applied in combination with configurations disclosed in other embodiments, as long as no inconsistencies arise. Moreover, the embodiments disclosed herein are illustrative, and the embodiments of the present invention are not limited thereto, and can be modified as appropriate without departing from the object of the present invention. [Industrial applicability]

[0054] The present invention is applicable to a product management system for detecting the location where a displayed product has been removed, and to product display fixtures used in such a system. [Explanation of Symbols]

[0055] 1: Fixtures (merchandise display fixtures) 2: Camera 3: Indicator processing module (product detection unit) 12: Shelf board (display component) 13: Product placement surface 13C: Central partial area 13S: Peripheral area CP: intersection DM: Deformation Index M :Indicator MS: Metric Sheet NM: Normal index PT: Printer

Claims

1. A product management system for managing the presence or absence of products displayed along the depth direction on the product placement surface of a product display fixture, The indicator placed on the product placement surface, A camera for photographing the product placement surface, The system includes a product detection unit that detects, based on the detection of the indicator by the camera, that the product corresponding to the detected indicator is not present on the product placement surface, The aforementioned indicator is a product management system in which the length in the depth direction is longer than the length in the width direction.

2. The product management system according to claim 1, wherein the indicators are arranged in a matrix on the product placement surface to form a group of indicators.

3. The product management system according to claim 1, wherein the area of ​​the indicator provided in the peripheral region of the product placement surface, which is located in the depth and width directions away from the central portion region of the product placement surface near the intersection of the product placement surface and the camera's shooting center axis, is larger than the area of ​​the indicator provided in the central portion region.

4. The product management system according to claim 1, wherein the aspect ratio of the aforementioned indicator is 1.5 to 2.

5.

5. The product management system according to any one of claims 1 to 4, wherein the aforementioned indicator is a modified ArUco marker.

6. A product display fixture equipped with display members for displaying products along the depth direction, A product display fixture wherein an indicator for managing the presence or absence of the products placed on the product placement surface of the display member is arranged on the product placement surface, and the length of the indicator in the depth direction is longer than the length of the indicator in the width direction.

Citation Information

Patent Citations

  • Stock state management method and stock state management device

    JP2012174154A

  • Notification system

    JP2023030341A