Product management system and management unit

Abstract

This product management technology takes into account camera blind spots when managing the presence or absence of products displayed on a product display surface. [Solution] The product management system for managing the presence or absence of products displayed along the depth direction on the product placement surface 13 of the display member 12 of the product display fixture 1 comprises a camera 2 positioned diagonally above the product placement surface 13 so that the product placement surface 13 is within its field of view, an indicator M placed on the product placement surface 13, and a product detection unit that detects whether a product corresponding to the detected indicator M is not present on the product placement surface 13 based on the detection of the indicator M by the camera. The indicator is provided on the indicator placement surface 13V of the product placement surface 13, which is within the field of view of the camera and is located behind the intersection point in the depth direction of the camera optical axis passing through the upper end of the rising portion 14 provided in the front end region of the product placement surface 13 and the product placement surface 13.

Description

Technical Field

[0004] , , , , , , , , , , , ,

[0005] , , , , , , , , ,

[0003]

[0001] The present invention relates to a product management system for managing the presence or absence of products displayed along the depth direction on the product placement surface of a display member of a product display device, and a management unit.

Background Art

[0002] In the notification system according to Patent Document 1, an image of a product storage shelf photographed by cameras installed on the ceiling, wall, and shelf of a store is analyzed using object detection technology and object recognition technology using deep learning, and the number of products on the product storage shelf is calculated. When the calculated number of products is less than or equal to the minimum number and the current time is within the notification target time zone, the display device corresponding to the product is lit.

[0003] In the inventory status management device according to Patent Document 2, the presence or absence of products on the display shelf is determined by whether a marker (indicator) provided at the position where the products are placed is detected from the photographed image of the camera. Since the relationship between the marker and the product is managed, when the marker type or the marker generation position is detected by analyzing the photographed image, the corresponding product name is deduced. The product without a marker is provided at the position where the product remains until the end when the products are taken out in order from the tray on which the products are arranged.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0005] In the notification system described in Patent Document 1, the number of products on a shelf is calculated by performing image recognition on an image of the shelf captured by a camera. However, since many products are displayed on a shelf, accurately calculating the number of products from the captured image is difficult even with image recognition technologies such as deep learning. In particular, when multiple shelves are photographed using a single camera (see Figure 1 in Patent Document 1), only a portion of each product is captured, making image recognition difficult.

[0006] In the inventory management device described in Patent Document 2, a product shortage is determined by detecting a product marker (indicator) that appears when a product is no longer available on a display shelf from the captured image. However, price tags and product name tags are provided on the front of the shelf. This creates blind spots for the camera, and markers that fall within these blind spots are not captured in the image.

[0007] In view of the above circumstances, the object of the present invention is to provide a product management technology that takes into account the blind spots of the camera when managing the presence or absence of products displayed on a product display surface. [Means for solving the problem]

[0008] The product management system according to the present invention is a system for managing the presence or absence of products displayed along the depth direction on a product placement surface of a product display fixture, and comprises a camera installed diagonally above the product placement surface so that the product placement surface is within its field of view, an indicator placed on the product placement surface, and a product detection unit that detects whether the product corresponding to the detected indicator is not present on the product placement surface based on the detection of the indicator by the camera, wherein the indicator is provided on the indicator placement surface of the product placement surface which is within the field of view of the camera and is located behind the intersection point in the depth direction of the camera optical axis passing through the upper end of a rising portion provided in the front end region of the product placement surface and the product placement surface.

[0009] With this configuration, the raised portion provided at the front edge of the product placement surface removes areas that would be camera blind spots on the product placement surface, allowing the indicator to be positioned efficiently and accurately, and enabling reliable determination of the presence or absence of a product on the product placement surface.

[0010] In a product shelf composed of multiple tiers, if product management on this shelf is performed based on images captured by a single camera, the angle between the camera center and the product placement surface of each tier differs. Therefore, the indicator placement surface located behind the intersection of the camera's optical axis and the product placement surface in the depth direction, i.e., the area that is not a blind spot for the camera, will be in a different position for each tier. For this reason, in the present invention, the product shelf is provided in multiple tiers, and the indicator placement surface is set on the product placement surface of the product shelf in each tier of the product shelf.

[0011] In this invention, it is proposed that the indicator is an ArUco marker. Compared to QR codes (registered trademark) and barcodes, ArUco markers have the advantage of being easy and quick to detect by a camera. For this reason, in this invention, it is proposed to use ArUco markers as indicators. For example, since identification data that identifies all products displayed on a product display fixture can be assigned to an ArUco marker, the product detection unit can detect whether a specific product corresponding to the detected ArUco marker is not present on the product display surface by detecting the ArUco marker.

[0012] The front end area of ​​the display components of a product display fixture can be fitted with a price rail that displays the name and price of the displayed product. Price rails are especially essential in retail stores such as supermarkets. Price rails are essential for describing the products placed on the product display surface, but because they rise in front of the product, they create a blind spot for cameras installed above the front of the display component. For this reason, in a product management system for a product display fixture fitted with such a price rail, it is preferable to treat the price rail as the rising portion in this invention.

[0013] In this invention, the subject matter is not only the product management system described above, but also a management unit as a product display fixture to which the product management system can be applied. Such a management unit manages the presence or absence of products displayed along the depth direction on the product placement surface of the display member of the product display fixture, and comprises a camera positioned diagonally above the product placement surface so that the product placement surface is within its field of view, and an indicator placed on the product placement surface, wherein the indicator is located on the indicator placement surface of the product placement surface, which is within the field of view of the camera, and is located behind the point of intersection in the depth direction of the camera optical axis passing through the upper end of a rising portion provided in the front end region of the product placement surface and the product placement surface. By using such a management unit of the present invention, product management using a camera can be performed effectively. [Brief explanation of the drawing]

[0014] [Figure 1] This is an explanatory diagram illustrating the areas of camera blind spots on the product placement surface. [Figure 2] This is a perspective view of a product display fixture as captured by a camera. [Figure 3] This is a schematic diagram illustrating the placement of indicators on product display fixtures. [Figure 4] A schematic functional block diagram illustrating an example of the functional configuration of a product management system. [Figure 5] This is a schematic diagram illustrating the relationship between the detected indicators and the product. [Modes for carrying out the invention]

[0015] Figure 1 shows a product display fixture 1 used in the present invention, and a camera 2 positioned diagonally above the product placement surface 13, which is formed on a shelf board 12 as a display component of the product display fixture 1, so that the product placement surface 13 is within the field of view. An indicator M is placed on the product placement surface 13. In the present invention, the combination of the product display fixture 1 and the camera 2 is called a management unit, and the system that manages the presence or absence of products displayed along the depth direction on the product placement surface 13 of the shelf board 12, which is a display component of the product display fixture 1, is called a product management system. Based on the detection of the indicator M by the camera 2, the product management system can detect whether there are no products in the product row corresponding to the detected indicator M, or whether the number of products in that product row has decreased.

[0016] The indicator M used in this invention has a graphic (including characters) into which information is embedded, such as an ArUco marker, a QR code (registered trademark), or a barcode. A barcode is a one-dimensional code that records information horizontally, while an ArUco marker and a QR code (registered trademark) are two-dimensional codes that record information in two directions, vertically and horizontally. In this embodiment, an ArUco marker is used.

[0017] First, what more characterizes the present invention is that the indicator M disposed on the product placement surface 13 is within the angular field of view of the camera 2 on the product placement surface 13 and is provided on an indicator placement surface located on the rear side in the depth direction from the intersection of the camera optical axis of the camera 2 passing through the upper end of the rising portion 14 (for example, a price rail) provided in the front end region of the product placement surface 13. An example of a specific indicator placement surface will be described below using FIG. 1. In this embodiment, the camera 2 is installed at a position that rises vertically about 2.5 m from a point about 1.5 m in front of the front end of the lowermost shelf board 12 of the product display rack 1. At that time, the shooting angle of the camera 2 with respect to the product display rack 1 is not particularly limited, but an angle of about 45° downward from the horizontal axis is preferable.

[0018] As shown in FIG. 1, when the camera 2 is installed obliquely upward with respect to the product placement surface 13, if a rising portion 14 such as a price rail or a product description plate is provided in the front end region of the product placement surface 13, a dead angle region 13H of the camera 2 occurs behind (in the depth direction) the rising portion 14. Also, depending on the structure of the shelf board 12 and the shooting direction of the camera 2, a dead angle region 13H of the camera 2 also occurs in the rear region of the product placement surface 13 due to being shielded by the upper shelf board 12.

[0019] As can be understood from FIG. 1, in the product placement surface 13 of the uppermost shelf board 12, the dead angle region 13H due to the rising portion 14 is large, and since there is no shelf board 12 above it, there is no rear dead angle region 13H. Therefore, the region behind the dead angle region 13H of the product placement surface 13 is a non-dead angle region 13V and becomes the indicator placement surface (see (a) of FIG. 1).

[0020] In the product placement surface 13 of the middle shelf board 12, the dead angle region 13H due to the rising portion 14 becomes smaller than the dead angle region 13H due to the rising portion 14 at the uppermost stage. Depending on the structure of the shelf board 12 and the shooting direction of the camera 2, a dead angle region 13H due to the upper shelf board 12 occurs. In that case, the region sandwiched between the two dead angle regions 13H becomes the non-dead angle region 13V (see (b) of FIG. 1).

[0021] In the bottom shelf board 12, the dead angle area 13H due to the rising portion 14 becomes smaller, while the dead angle area 13H due to the upper shelf board 12 becomes larger (see (c) of FIG. 1).

[0022] In any case, the index M is arranged on the index arrangement surface which is within the angular coverage of the camera 2 and is the non-dead angle area 13V on the product placement surface 13. In other words, the index M is arranged on the rear side in the depth direction from the intersection of the camera optical axis of the camera 2 passing through the upper end of the rising portion 14 provided in the front end area of the product placement surface 13 and the product placement surface 13.

[0023] As described above, even if the arrangement pattern of the non-dead angle area 13V differs depending on the level of the shelf board 12, the index M is arranged only on the non-dead angle area 13V as the index arrangement surface. Therefore, the product management system can manage the presence or absence of the displayed products based on the reliable detection of the index M.

[0024] An example of the product display fixture 1 with the index M arranged on the index arrangement surface which is the non-dead angle area 13V of the product placement surface 13 is shown in FIG. 2. The products displayed on the product placement surfaces 13 of the multiple-level shelf boards 12 of this product display fixture 1 (hereinafter simply referred to as fixture Ⅰ) are managed using the camera 2. In FIG. 2, although indicated by arrows, in this specification, the front side (frontward side) of the fixture 1 from which the product is taken out by the customer indicates "front", and the opposite side, that is, the back side (backward side) indicates "back". The left-right direction facing the front of the fixture 1 indicates "left" and "right". Hereinafter, the "left-right direction" may be referred to as "horizontal" or "width direction". The "front-back direction" may be referred to as "vertical" or "depth direction". The "front-back direction" is also referred to as "vertical" or "depth direction".

[0025] Fixture 1 is a product display shelf mainly installed in stores such as supermarkets and convenience stores, used to display and sell goods. Multiple fixtures 1 are arranged in parallel or individually in the sales area. Fixture 1 shown in Figure 2 mainly consists of support columns 10 arranged spaced apart to the left and right, a rear wall panel 11 which is a rear panel provided between the left and right support columns 10, and multiple shelves 12 that extend forward from the left and right support columns 10. In Figure 2, the shelves 12 are arranged only on one side in the front-to-back direction relative to the left and right support columns 10, but they may also be arranged on the other side.

[0026] The top surface of the shelf board 12 is used as a product placement surface 13 on which products are placed. Products are placed on the product placement surface 13 so as to be arranged in the depth direction and width direction. At this time, the product placement surface 13 may be divided by partition plates or the like according to the type (size) of products, and products may be placed in each section (placement section) as a product row. Furthermore, indicators M are arranged in a row in the width direction of the indicator placement surface, which is a non-blind spot area 13V of the product placement surface 13. In other words, here the indicators M are arranged in a matrix of 1 row and n columns (n ​​is a natural number set according to the width dimension of the indicator placement surface). Each column of this matrix corresponds to a product row in which products are displayed in the depth direction, and the same product is placed in each column. At least one product can be placed on the indicator M in each column. Therefore, if the products in a column, including the product placed on the indicator M in that column, are removed, the indicator M will be exposed to the camera 2, and the indicator M will be captured in the image taken by the camera 2. Since products in a product row are removed sequentially from the front, effectively resulting in a front-filling system, it is possible to detect, through the captured image in which the indicator M is visible, that there are no products in the product row corresponding to that indicator M. Note that Figure 2 is for illustrative purposes only, so the product placement surface 13 of the top shelf 12 shows only the indicator M arranged in the width direction, without any products, and the product placement surface 13 of the second shelf 12 from the top shows only products. On the product placement surfaces 13 of the remaining shelves 12, both the indicator M and the products are omitted.

[0027] The indicator M used in this embodiment is placed on the product display surface 13 in the form of an indicator sheet MS printed out by a printer PT, as shown in Figure 3. By adopting the form of an indicator sheet MS, the indicator M can be easily placed on the indicator placement surface, which is the non-blind spot area 13V of the product display surface 13. This indicator sheet MS is a long sheet having a size corresponding to the product display surface 13, and when attached to the product display surface 13, it is divided into a non-blind spot area 13V and a blind spot area 13H. In the indicator sheet MS shown in Figure 3, the blind spot area 13H is indicated by diagonal lines. Such an indicator sheet MS is printed out using indicator group print data generated by arranging an indicator group consisting of multiple indicators M according to the product display width.

[0028] As explained using Figure 1, the blind spot area 13H and the non-blind spot area 13V on the product placement surface 13 change depending on the shooting direction of the camera 2 and the shelf position of the shelf board 12. To address this, in this embodiment, as shown in Figure 3, the indicator sheet MS has three forms, namely, a first indicator sheet MS1, a second indicator sheet MS2, and a third indicator sheet MS3. The first indicator sheet MS1 is attached to the upper product placement surface 13, with the front part in the depth direction being the blind spot area 13H and the rear part in the depth direction being the non-blind spot area 13V, and multiple indicators M arranged in a matrix are printed in the non-blind spot area 13V. The indicators M are arranged in a matrix of 3 rows and n columns (where n is a natural number set according to the width dimension of the product placement surface 13). The second indicator sheet MS2 is attached to the middle product placement surface 13. The front and rear portions in the depth direction are blind spot areas 13H, and the central portion sandwiched between the front and rear portions is a non-blind spot area 13V. Multiple indicators M are printed in a matrix arrangement in this non-blind spot area 13V. Here, the indicators M are arranged in a 2xn matrix (where n is a natural number set according to the width dimension of the product placement surface 13). The third indicator sheet MS3 is attached to the lower product placement surface 13. The rear portion in the depth direction and the very front portion, which is almost negligible in size, are blind spot areas 13H, and the front portion in the depth direction is a non-blind spot area 13V. Multiple indicators M are printed in a matrix arrangement in this non-blind spot area 13V. Here, the indicators M are arranged in a 2xn matrix (where n is a natural number set according to the width dimension of the product placement surface 13).

[0029] In the indicator sheet MS shown in Figure 3, the indicator M is arranged on the product placement surface 13 in a matrix of 3 rows and n columns and 2 rows and n columns (where n is a natural number corresponding to the width dimension of the product placement surface 13). Alternatively, the indicator M may be arranged on the product placement surface 13 in a matrix of m rows and n columns (where m is a natural number of 1 or more set according to the depth length in the non-blind spot area 13V of the indicator sheet MS, and n is a natural number set according to the width dimension of the product placement surface 13).

[0030] Figure 4 shows a functional block diagram illustrating the functional configuration of the product management system. Each shelf of the fixture 1 has a product placement surface 13 on which a group of indicators M arranged in the width direction are placed. Images captured by camera 2, which captures this group of indicators within its field of view, are recorded in the image recording unit 22, which is provided in the relay device for camera 2. Since there are many cameras 2 in the store, images captured by each camera 2 are sent to and recorded in the image recording unit 22.

[0031] An edge computer 4 is provided as the central control device for the control of the product management system. The edge computer 4 has a storage unit and a CPU (Central Processing Unit) that executes programs. The storage unit is composed of, for example, an HDD, ROM (Read Only Memory), or non-volatile memory. The edge computer 4 has an index processing module 3, a data output unit 41, and a real-time control unit 42 as functional units particularly relevant to the present invention. Each functional unit is realized when a program is executed by the CPU of the edge computer 4. The index processing module 3 functions as a product detection unit that detects, based on the detection of index M by the camera 2, whether a product corresponding to the detected index M is not present on the product placement surface 13 or whether the number of products in the product row is decreasing.

[0032] The index processing module 3 acquires captured images from the captured image recording unit 22, and if the captured image contains an index M, it uses the index M to process information about the product removed from the fixture 1 (existing product), such as the location (non-existent location) of the removed product, the type of the removed product, and the fixture 1 and product placement surface 13 on which the removed product was placed. For this purpose, the index processing module 3 includes a captured image acquisition unit 31, an extraction unit 32, an index information reading unit 33, a location detection unit 34, a fixture identification unit 35, and a product identification unit 36.

[0033] The image acquisition unit 31 acquires images recorded in the image recording unit 22 based on the set product management schedule and provides them to the extraction unit 32. The extraction unit 32 determines whether the acquired image contains index M, and if it does, it extracts the region of index M detected from the image. The presence of index M in the image means that the product has been removed from the product region corresponding to this index M.

[0034] The indicator information reading unit 33 reads the indicator ID (which may be just a number) assigned to the indicator M extracted by the extraction unit 32, and provides it to the position detection unit 34, the fixture identification unit 35, and the product identification unit 36.

[0035] The position detection unit 34, the fixture identification unit 35, and the product identification unit 36 ​​derive information (data) assigned to the read index ID from a table. For example, the fixture identification unit 35 derives the fixture ID, the mounting surface ID, and the mounting area ID from the index ID, thereby identifying the fixture 1, the product mounting surface 13, and the mounting area (mounting region, mounting row) from which the product was removed (the product was picked up). The position detection unit 34 identifies the position (pickup position) of the product removed from the product mounting surface 13 or the mounting area. The product identification unit 36 ​​identifies the type of product removed from the product mounting surface 13 or the mounting area. In other words, the functions of the position detection unit 34, the fixture identification unit 35, and the product identification unit 36 ​​are related to each other, so they may be integrated into a single product identification unit 36.

[0036] Here, we will explain an example of a configuration that derives product identification data assigned to a read index ID, using Figure 5.

[0037] When a product is removed and the indicator M that was hidden by the product is exposed on the product placement surface 13, the exposed indicator M is captured in the image taken by the camera 2 and extracted by the extraction unit 32. From the extracted indicator M, the indicator ID (simply shown as ID31 in Figure 5) that was assigned to this indicator M is read. Once the placement surface indicator ID is known, the fixture ID, fixture position, placement surface ID, placement surface position, placement area ID, and placement area position associated with it are derived. In other words, the position (row) where the product has been removed from the product placement surface 13 and is no longer present is identified. By deriving the product type associated with the placement area ID, the type of product that was removed (product name, etc.) is obtained. In this embodiment, each time the exposed indicator M is photographed by the camera 2, the indicator M is extracted by the extraction unit 32. However, it is not limited to this, and the indicator M may be photographed by the camera 2 and then extracted by the extraction unit 32 after a certain period of time.

[0038] The product removal information (product pickup information) generated in the indicator processing module 3 is preferably output from the data output unit 41 along with the photographic image and time of photography that formed the basis for the information, for product management purposes. This makes it possible to obtain product removal information that is difficult to grasp from POS data (for example, information indicating that after a product is removed from the product placement surface 13 at the pickup location, the product is returned to the product placement surface 13).

[0039] As shown in Figure 4, when the real-time control unit 42 detects that an item has been removed from the item placement surface 13 of the fixture 1, it uses an alarm device (for example, a flashing light 51 or similar alarm) located near the fixture to alert store staff and others to the need for product management, such as replenishing the stock.

[0040] Each store is equipped with at least one edge computer 4. The processing results (product management information) output from the index processing module 3 by the edge computer 4 are transferred to the host computer 6 via a data communication network such as a private line, the internet, or a public line. The host computer 6 is located within the store or in a management center that manages multiple stores. In this embodiment, the processing results from the index processing module 3 are transferred to the host computer 6 approximately every 5 minutes.

[0041] The host computer 6 processes product management information transmitted from the store's edge computer 4 (primarily based on time-series pickup location data for each fixture 1) to create product analysis information and product display evaluation information, and then provides notification and manages the products. The host computer 6 is equipped with a calculation unit 6A, a notification unit 6B, a database 6C, and a map generation unit 6D.

[0042] The calculation unit 6A performs statistical calculations and inference calculations using the received product management information and past product management information stored in the database 6C. The map generation unit 6D accesses the database 6C and outputs the requested fixture 1, preferably a store image of the area around the pickup location, or a store map (map), or both, and provides it to the notification unit 6B. The notification unit 6B includes a notification information generation unit 61 and a display unit 62. The notification information generation unit 61 generates product analysis information and product display evaluation information using the calculation results of the calculation unit 6A. The product analysis information here is, for example, information showing when, where, and how each product was sold, and the product display evaluation information is information showing the best-selling display locations, empty product sections, and missing product sections over time. The display unit 62 converts the information into display information (for example, HTML data) and provides it to the host computer 6 or the mobile communication terminal 8 that has accessed the system. Furthermore, the display unit 62 can directly display notification information such as product analysis information and product display evaluation information on the screen of the host computer 6's display device 62a or the screen of the mobile communication terminal 8. The notification unit 6B can also send product analysis information, product display evaluation information, or simply messages regarding the pickup location (such as "Product A has been picked up from the mounting surface ID of the fixture ID") to the registered user's mobile communication terminal 8, such as a smartphone.

[0043] In the above description, the support configuration of camera 2 is not particularly limited. As shown in Figure 2, camera 2 is positioned above the front of fixture 1 so as to be able to photograph the indicator M and not obstruct the passage of shoppers. For this reason, it is preferable that camera 2 is suspended from the ceiling or attached to the ceiling or support column 10 of the opposite fixture 1 that is positioned opposite to it via a mounting bracket. In this configuration, cameras 2 attached to two opposing fixtures 1 can photograph each other's indicator M.

[0044] [Another embodiment] (1) The form of the fixture 1 shown in the above-described embodiment is just an example, and the fixture 1 may be a freezer or refrigerator, or a flat-lay fixture 1.

[0045] (2) In the embodiments described above, the index M was made in accordance with the index standard, but a deformed index that has been deformed from such a standard shape may be used as the index M. In that case, a deformed and enlarged index M with excellent index detectability is preferred, taking into consideration the lens characteristics of the camera 2 and the shooting direction of the camera 2.

[0046] (3) In the above-described embodiment, when product shortage information was output, the real-time control unit 42 illuminated the warning light 51 and a predetermined lamp in the fixture management room for a certain period of time in order to notify in real time that product removal had occurred. As a variation of this, if the out-of-stock product is a specific product that has been set in advance (such as a featured product, a sale product, or a promotional product), a different notification method may be used than for normal products. For example, the warning light 51 and a predetermined indicator light in the fixture management room may flash at a different frequency or light up in a different color. In the case of voice notification by a buzzer or speaker, the tone and volume may be different for specific products and normal products. Furthermore, a message informing that a product, especially a specific product, has become out of stock may be sent to the person in charge's mobile communication terminal 8 using a different font color and font size than for normal products.

[0047] (4) The configuration of the edge computer 4, host computer 6, and mobile communication terminal 8 is just one example; the whole may be an integrated configuration, or it may be composed of many additional computer devices.

[0048] (5) Each functional unit in the functional block diagram shown in Figure 4 may be integrated or further divided.

[0049] Furthermore, the configurations disclosed in the above embodiments (including other embodiments, the same applies hereinafter) can be applied in combination with configurations disclosed in other embodiments, as long as no inconsistencies arise. Moreover, the embodiments disclosed herein are illustrative, and the embodiments of the present invention are not limited thereto, and can be modified as appropriate without departing from the object of the present invention. [Industrial applicability]

[0050] The present invention is applicable to a product management system for detecting the location where a displayed product has been removed, and to a management unit used in such a system. [Explanation of Symbols]

[0051] 1: Fixtures (merchandise display fixtures) 2: Camera 3: Indicator processing module (product detection unit) 12: Shelf board (display component) 13: Product placement surface 13H: Blind spot area 13V: Non-blind area (index placement surface) 14: Rising section (price rail) M :Indicator MS: Metric Sheet PT: Printer

Claims

1. A product management system for managing the presence or absence of products displayed along the depth direction on the product placement surface of a product display fixture, A camera is positioned diagonally above the product placement surface so that the product placement surface is within the field of view, An indicator placed on the product placement surface, The system includes a product detection unit that detects, based on the detection of the indicator by the camera, that the product corresponding to the detected indicator is not present on the product placement surface, The indicator is provided on the indicator placement surface of the product placement surface, which is within the field of view of the camera and located behind the intersection point in the depth direction of the camera optical axis passing through the upper end of a raised portion provided in the front end region of the product placement surface and the product placement surface.

2. The aforementioned display members are provided in multiple tiers, The product management system according to claim 1, wherein the indicator placement surface is set on the product placement surface of the display member on each level.

3. The product management system according to claim 1, wherein the aforementioned indicator is an ArUco marker.

4. The product management system according to any one of claims 1 to 3, wherein the rising portion is a price rail.

5. A management unit for managing the presence or absence of products displayed along the depth direction on the product placement surface of a product display fixture, A camera is positioned diagonally above the product placement surface so that the product placement surface is within the field of view, The product placement surface includes an indicator, The indicator is provided on the indicator placement surface of the product placement surface, which is within the field of view of the camera and located behind the point of intersection in the depth direction between the camera optical axis of the camera, which passes through the upper end of a raised portion provided in the front end region of the product placement surface, and the product placement surface.

Images