Commodity management system and commodity display fixture

Abstract

To provide a commodity management system using a simple additional facility and a simple detection evaluation control system.SOLUTION: A product management system for products displayed on a placement surface of a product display fixture 1 includes an index M provided on a detection surface 70, a moving body 7 that moves the detection surface from a first position where the index M is hidden by a product to a second position where the index M is exposed with the detection surface 70 facing forward, a detection device 2 capable of detecting the index M with the detection surface 70 at the second position, and an index processing module capable of identifying a pickup position where a product has been removed in a store based on the index M detected by the detection device 2 and outputting the pickup position. The detection surface 70 moves to the second position when all of the products aligned in the depth direction have been removed.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a product management system capable of outputting the position where a displayed product has been removed, and a product display fixture used in this system. [Background technology]

[0002] Patent Document 1 discloses a product management device that includes a load change detection means for detecting changes in the load placed on the shelves of a display shelf and a position detection means for detecting the position at which a hand approaches the shelf, and that manages products on the display shelf based on the detection results of the load change detection means and the position detection means. In this case, a product taken out of the display shelf is identified by using a product table that links unit load information for each product with display position information for each product on each shelf.

[0003] Conventionally, there has been known a management technology for managing items by attaching a non-contact electromagnetic wave tag to the item and reading the information stored in the electronic tag using a tag reader. As an application example of such a product management technology using an electromagnetic wave tag, Patent Document 2 discloses product management using an electromagnetic wave tag in which an antenna unit for transmitting and receiving electromagnetic waves and a jamming unit for jamming the electromagnetic waves are movable between a jamming position where they are close to each other and a non-jamming position where they are spaced apart. When an item is placed on the jamming unit, the jamming unit swings and moves to cover the antenna unit, blocking electromagnetic wave communication. When the item is removed from above the jamming unit, the jamming unit becomes free and moves away from the antenna unit, allowing electromagnetic wave communication to take place. This is utilized for product management. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 2024-27681 [Patent Document 2] Japanese Patent Application Laid-Open No. 2009-123200 Summary of the Invention [Problem to be solved by the invention]

[0005] The product management device disclosed in Patent Document 1 requires two detection methods—a weight sensor that measures changes in the weight of the shelf and a position detection sensor that detects the position of a hand entering the shelf—and two detection control systems with different evaluation methods for the detection results, resulting in high control costs. The product management technology disclosed in Patent Document 2 determines the presence or absence of a product and the type of product based on the blocking and propagation states of electromagnetic waves caused by changes in the position of the jamming unit. Therefore, if the jamming strength of the jamming unit is too high, a false detection of absence is likely to occur; if the jamming strength of the jamming unit is too high, a false detection of absence is likely to occur; and if the jamming strength of the jamming unit is low, a false detection of presence is likely to occur. This creates a problem of difficulty in balancing the change in position of the jamming unit and the jamming strength of the jamming unit. [Means for solving the problem]

[0006] In view of the above circumstances, an object of the present invention is to provide a merchandise management system using simple additional equipment and a simple detection and evaluation control system, and a merchandise display fixture used in this system.

[0007] The product management system according to the present invention is capable of outputting the position at which a product displayed on the mounting surface of a product display fixture has been removed, and comprises an indicator provided on a detectable surface; a moving body that moves the detectable surface from a first position where the indicator is hidden by the product to a second position where the indicator is exposed with the detectable surface facing forward; a detection device that is capable of detecting the indicator when the detectable surface is in the second position; and an indicator processing module that is capable of identifying the pickup position in the store from which the product has been removed based on the indicator detected by the detection device and outputting the pickup position, and the detectable surface moves to the second position when all of the products in a row lined up in the depth direction have been removed.

[0008] According to this configuration, even if the detection surface on which the indicators detectable by the detection device are provided is hidden from the detection device by the displayed products (first position), when a row of products arranged in the depth direction is removed, the detection surface moves to a state (second position) where the indicators are exposed to the detection device and the detection device can detect the indicators. This movement may be a physical distance movement (from the first position to the second position) or a state change (movement) where the physical distance movement is substantially zero. When an indicator is detected, the indicator processing module can identify the pickup position of the product corresponding to the indicator. This pickup position is the position where the product removed from the display surface of the product display fixture was located until then, so identifying the pickup position enables product management at the time of pickup.

[0009] In the present invention, the detection device is a camera capable of capturing an image of the index, and the index is proposed to be an ArUco marker. Compared to QR codes (registered trademark) and barcodes, ArUco markers are easier and faster to detect with a camera, and their shape and configuration can also be used to estimate the camera's posture. For this reason, by configuring the index as an ArUco marker and the detection device as a camera, even small indices placed in a narrow space in a product display fixture can be reliably detected when the product is removed and the exposed indices are detected.

[0010] Assuming that it is customary for identical products to be lined up in a row in the depth direction, if all products in a row are removed and an indicator is detected by the detection device, this means that the product is out of stock. It is important to promptly notify the user of a product shortage. For this reason, the present invention proposes providing a notification unit that notifies the user of the status of the product displayed on the product display fixture, and the notification unit notifies the user that the product is out of stock when the indicator is detected by the detection device.

[0011] The present invention proposes a product identification unit that identifies the product associated with the pickup position based on the pickup position. For example, if a product identification code (ID code) is assigned to the product placement position on the placement surface, the product identification unit can also identify product information such as the product identification code, i.e., the product name, from the identified pickup position. Identifying the product from the pickup position from which the product was removed has the advantage that product management can be performed at the time of product pickup.

[0012] Supermarkets and other retailers handle a wide variety of products, including confectionery, fresh fish, meat, and beverages. Among these diverse products, some require prompt notification of their pickup, while others do not. This varies depending on the store's sales policy. Furthermore, shortages or out-of-stock of specific products, such as featured items or discounted items, must be avoided as much as possible from a business perspective. Therefore, removal (pickup) of specific products from the display surface (pickup) must be promptly notified and replenished. Since shortages or out-of-stock of specific products are considered more important than those of other regular products, it is preferable to notify shortages or out-of-stock of specific products more conspicuously. For this reason, the present invention includes an alarm unit that notifies the status of the products displayed on the product display fixture. When the product identified by the product identification unit is a specific product, the alarm unit changes its notification mode from when the product is not the specific product. Examples of changing the notification mode include changing the volume and frequency of the alarm sound, the intensity and flashing frequency of the alarm light, etc. The notification message changes the font color and font size.

[0013] Products are typically displayed in rows on a display surface, extending from the front to the depth. Therefore, removing a row of products means that the product is out of stock, and therefore, the products must be quickly replenished. To effectively detect an indicator when a product is removed, it is advantageous for the indicator to shift to a position (posture) that makes it easier for the detector to detect the product as it is removed, thereby improving detection accuracy. Therefore, it is important that the detection surface be configured to quickly detect the removal of a row of products. Therefore, the present invention proposes that the detection surface be tilted along the display surface when a plurality of products from the row of products are placed on the detection surface at the first position, and that when all of the products from the row of products are removed from the detection surface, the detection surface be raised by deformation of the moving body to the second position.

[0014] One embodiment for displacing (moving) an index provided on the detection surface to a position (posture) where it is easily detected in response to the removal of a product is for the detection surface to rise using a biasing force (biasing member) such as self-elasticity or an auxiliary spring so that the index is easily detected in response to the removal of a product. Therefore, the present invention proposes that the movable body has a biasing member that biases the detection surface in the first position forward about a horizontal axis, and that the detection surface is tilted along the placement surface when multiple products from the row of products are placed in the first position, and that when all of the products from the row of products are removed from the detection surface, the detection surface rises about the horizontal axis due to the biasing force of the biasing member to the second position. In this case, the rising of the detection surface is configured to cause the index to enter the detection zone of the detection device.

[0015] Another embodiment for displacing (moving) an index provided on the detection surface to a position (posture) where it is easily detected in response to the removal of a product is to have the detection surface lower using a biasing force (biasing member) such as self-elasticity or an auxiliary spring so that the index is easily detected in response to the removal of a product. Therefore, the present invention proposes that the movable body has a biasing member that biases the detection surface, which is positioned above the placement surface at the first position, forward about a horizontal axis, and that the detection surface is restricted from moving to the second position by contacting the rearmost product of the row of products at the first position, and that the detection surface lowers about the horizontal axis to the second position when all the products in the row of products are removed from the detection surface. In this case, the lowering of the detection surface is configured to cause the index to enter the detection zone of the detection device.

[0016] Another embodiment for displacing (moving) an indicator on the detection surface to a position (posture) where it is easily detected in response to the removal of a product is to configure a movable body such that, each time a product in a row is removed, the remaining products move forward and are positioned on the detection surface behind the last product. As a result, when the last product is removed, the detection surface, i.e., the indicator, moves to the forefront and becomes easily detectable by a detection device. Therefore, the present invention proposes that the movable body has a biasing member that biases the detection surface forward from the first position, and the detection surface is positioned behind the products while facing forward in the first position, and when all the products in the row of products are removed from the placement surface, the biasing force of the biasing member moves the detection surface forward to the second position.

[0017] Through the detection of the indicator, it is possible to derive not only the pickup location where the product was picked up, but also the map location on the display surface where the indicator was placed, and even the location within the store of the product display fixture that includes the display surface (map information). For example, if the index ID assigned to the indicator is linked to the map location of the product display fixture in the store and the map location of the display position on each display surface of each product display fixture, the pickup location can be indicated on the store map through map matching processing. This allows the product manager to easily grasp the pickup location. For this reason, the present invention proposes including a map generation unit capable of generating a map image indicating the pickup location, and a display device that displays the map image generated by the map generation unit.

[0018] When a camera is used to detect the pickup position, the captured image used to detect the pickup position is useful for the merchandise manager to confirm the pickup position. For this reason, the present invention proposes that the detection device is a camera, and that the map image shows an image of the store around the pickup position captured by the detection device.

[0019] If the detection device used to detect indices is fixed, only indices located within the detection range of the detection device can be detected. Therefore, in order to detect all indices, multiple detection devices must be installed to expand the detection range. If the detection device is configured to be able to scan space, the detection range that can be covered by a single detection device can be expanded. Furthermore, if the detection device is installed on an autonomous mobile device, it is also possible to detect all indices with a single detection device. Therefore, the present invention proposes an autonomous mobile device capable of autonomous travel, which includes a mobile device and the detection device, wherein the detection device is capable of detecting the indices while the autonomous mobile device is traveling autonomously, and the indices processing module is capable of identifying the pickup position and outputting the pickup position based on the indices detected by the detection device. In particular, ArUco markers are suitable as indices that are detected while traveling.

[0020] This application covers not only the above-described product management system but also the product display fixture used in this product management system. The product display fixture of the present invention includes the indicators and detection devices described in the above-described product management system, and the detection devices are configured to be able to detect indicators provided on product display fixtures other than the product display fixture equipped with the detection device. In other words, the detection devices provided on each product display fixture can be configured to detect each other's indicators, eliminating the need for construction work such as attaching each detection device to a store's ceiling or other structural structure. [Brief explanation of the drawings]

[0021] [Figure 1] FIG. 1 is a schematic diagram of a product display fixture in which picked-up products are managed by a product management system. [Figure 2] 1 is a schematic diagram showing a specific example of a moving body and a detection surface provided on a product display fixture. [Figure 3] 1 is a schematic diagram showing a specific example of a moving body and a detection surface provided on a product display fixture. [Figure 4] FIG. 3 is a schematic diagram showing a modification of the example shown in FIG. 2. [Figure 5] FIG. 4 is a schematic diagram showing a modification of the example shown in FIG. 3. [Figure 6] 1 is a schematic diagram showing a specific example of a moving body and a detection surface provided on a product display fixture. [Figure 7] 1 is a schematic diagram showing a specific example of a moving body and a detection surface provided on a product display fixture. [Figure 8] FIG. 2 is a schematic functional block diagram illustrating an example of a functional configuration of a product management system. [Figure 9] FIG. 10 is a schematic diagram illustrating the relationship between detected indicators and products. [Figure 10] FIG. 10 is a screen diagram showing an example of notification information displayed on the screen of the mobile communication terminal. [Figure 11] 1 is an information flow diagram for explaining information flowing through major functional blocks. [Figure 12]FIG. 10 is a schematic diagram showing another embodiment in which the detection device is mounted on an autonomous mobile device. DETAILED DESCRIPTION OF THE INVENTION

[0022] Next, the product management system according to the present invention will be described with reference to the drawings.

[0023] This product management system manages products displayed on a product display fixture 1 (hereinafter simply referred to as fixture 1) as shown in Figure 1. In Figure 1, arrows are used to indicate the front side (anterior side) from which products are taken out by customers, and in this specification, the opposite side, i.e., the rear side (rear side), indicates the "rear." The left and right directions as viewed from the front of fixture 1 indicate "left" and "right." Hereinafter, the "left and right direction" may be referred to as "horizontal" or "horizontal direction." The "front and rear direction" may be referred to as "vertical" or "vertical direction."

[0024] The fixture 1 is a product display shelf that is installed primarily in stores such as supermarkets and convenience stores to display and sell products, and multiple fixtures 1 are arranged in parallel or individually in the sales floor. The fixture 1 shown in FIG. 1 is mainly composed of support columns 10 arranged spaced apart on the left and right, a rear panel 11 that is a rear panel provided between the left and right support columns 10, and multiple shelves 12 extending forward from the left and right support columns 10. Note that while the shelf columns 12 are arranged only on one side of the left and right support columns 10 in FIG. 1, they may also be arranged on the other side as shown in FIG. 10.

[0025] The upper surface of the shelf 12 is used as a product placement surface 13, and products are placed on this placement surface 13 or hung above the placement surface 13. In this embodiment, placing products on the placement surface 13 and hanging products above the placement surface 13 are collectively referred to as "display." The placement surface 13 is divided by partitions or the like according to the type (size) of product, and products are displayed on or above each section (placement section). Here, sections lined up in the left-right direction are referred to as placement section rows, and sections lined up in the front-to-back direction are referred to as placement section columns. For simplicity's sake, in the following description, unless otherwise specified, it is assumed that each section is the same size and that the placement section rows and placement section columns are arranged in a matrix so that they have the same placement sections.

[0026] The basics of product management using the product management system of the present invention will be described with reference to the top shelf 12 in Figure 1. When products displayed on the placement surface 13 are removed, it becomes possible to replenish the removed number of products. In the present invention, an index M is provided corresponding to one or more products, and the removal of the products is detected by detecting the index M when one or more products are removed. The product placement space in the fixture 1 is surrounded by shelves 12 on both the top and bottom and is densely packed with products. Therefore, in order to ensure that the index M is easily detected when a product is removed, it is preferable that the index M changes to a position (posture) that makes it easy to detect by a detection device (e.g., camera 2) in response to the removal of the product.

[0027] To this end, a movable body 7 having a detectable surface 70 with an index M (printed or attached, for example) is placed in the placement space. The movable body 7 moves the detectable surface 70 from a first position where the index M is hidden by the products and the detectable surface 70 faces forward, to a second position where the index M is exposed. A camera 2, an example of a detection device, can detect the index M when the detectable surface 70 is in the second position. An index processing module 3 (see FIG. 7 ), which will be described in detail later, identifies the pickup position in the store where the product was removed based on the index M detected by the camera 2 and outputs the pickup position. For example, the detectable surface 70 moves to the second position when all products in a row of products arranged in the depth direction are removed. This indicates that the row of products has been removed, i.e., a shortage of products. Specific examples of the movable body 7, the detectable surface 70, and the index M that function in this manner are shown in FIGS. 2, 3, 4, 5, and 6.

[0028] In the specific example of FIG. 2, a rising member capable of rising and falling movement is used as the moving body 7. When substantially a row of products is placed on this rising member, the pushing force causes the rising member to assume a horizontal position (the position of the rising member in the rightmost row of loading compartments in FIG. 2). When the row of products is removed, the portion formed as a bent section is bent by the biasing force, causing at least a portion of the rising member to rise from the loading surface 13 (the position of the rising member in the second and third row of loading compartments from the rightmost in FIG. 2). The biasing force here is provided by the elastic properties of the moving body 7, such as a highly elastic resin or a shape-memory material. By providing an index M on the detection surface 70 of this rising member as the moving body 7, which faces forward when it is raised, this index M functions as an index M that changes position from a first position hidden by the products to a second position exposed to the front. Furthermore, when this rising member is placed on the placement surface 13 corresponding to the bottom surface of each product, the indicator M provided on the forward-facing moving surface 15a functions as an indicator M that corresponds one-to-one to each product.

[0029] In the specific example of FIG. 3 , a flexible sheet-like member that behaves like a shop curtain (a Japanese noren curtain) is used as the movable body 7. When products are placed in the depth direction of the corresponding storage section, a portion of the sheet-like member (the bent tip portion) serves as a detection surface 70, and the sheet-like member lies flat along the top surfaces of the products lined up in the depth direction, at least the top surfaces of the last product (the position of the sheet-like member in the rightmost storage section row in FIG. 3 ). When a row of products is removed, gravity as a biasing force and the elastic restoring force of the sheet-like member itself cause the detection surface 70 to change position (move) from a flat state to a hanging state (the position of the sheet-like member in the second and third storage section rows from the right end in FIG. 3 ). By providing an index M on the detection surface 70, which is the bent portion of the movable body 7 formed as a sheet-like member, the index M functions as an index M that changes position from a first position where it is hidden by the products from the line of sight of the camera 2 to a second position where it is exposed to the camera 2 (forward).

[0030] The specific examples of FIGS. 4 and 5 are modified versions of the specific examples of FIGS. 2 and 3, respectively, in which the bent portion of the movable body 7 is configured to swing around a horizontal axis. FIG. 4 is a modified version of the specific example of FIG. 2, in which two bent portions of the movable body 7 formed as an upright member are formed as a first horizontal axis P1 and a second horizontal axis P2, respectively. A coil spring is enclosed around the first horizontal axis P1 as a biasing member 7b that generates a swinging biasing force (bending biasing force). A coil spring may also be enclosed around the second horizontal axis P2 as a biasing member 7b that generates a swinging biasing force opposite to that of the first horizontal axis P1. FIG. 5 is a modified version of the specific example of FIG. 3, in which a sheet-like member as the movable body 7 is bent at two locations, at least one of which is formed as the first horizontal axis P1 that is biased to swing by a coil spring as a biasing member 7b. With this configuration, the posture of the detection surface 70 is reliably changed from a lying state to a hanging state (movement from the first position to the second position) by the biasing force of the biasing member 7b, and the detection of the index M is reliably performed. In the specific examples of FIGS. 2 and 3, the swinging biasing force is provided by the elastic properties of the movable body 7, such as a highly elastic resin or a shape-memory material, whereas in the modified examples of FIGS. 4 and 5, the swinging biasing force is provided to the movable body 7 by the biasing member 7b, such as a spring or rubber. In this way, in the present invention, either the biasing force due to the elastic properties of the movable body 7 itself or the biasing force by the biasing member 7b may be selected.

[0031] In the specific example of FIG. 6, products are displayed on the placement surface 13. A plate member 7c is slidably suspended from the hanger rail 7a behind the rearmost product. In this specific example, a biasing member 7b such as a spring is provided to bias the plate member 7c from rear to front, and the product and plate member 7c move forward each time a product is removed. In other words, in this specific example, the hanger rail 7a, biasing member 7b, and plate member 7c constitute the moving body 7. The front surface of the plate member 7c functions as the detection surface 70, and an index M is provided on this detection surface 70. In this specific example, each time a product in the row is removed, the remaining products and the detection surface 70 move forward, and when the last product is removed, the detection surface 70, i.e., the index M, moves to the forefront (moves from the first position to the second position) and is detected by the camera 2.

[0032] The specific example in Figure 7 is the same as the specific example in Figure 6 except that the biasing member 7b is omitted. In other words, the clothes hanger rail 7a and the plate member 7c constitute the moving body 7. The products and the plate member 7c slide forward by natural or manual force. For this reason, it is preferable that the placement surface 13 and the clothes hanger rail 7a be inclined downward toward the front. In either case, when the last product is removed, the detection surface 70, i.e., the index M, moves from a position hidden from the camera's line of sight to a position exposed to the camera's line of sight (moves from the first position to the second position), and is detected by the camera 2.

[0033] The index M is a figure with information embedded therein, such as an ArUco marker, a QR code (registered trademark), or a barcode. A barcode is a one-dimensional code that records information horizontally, while an ArUco marker and a QR code (registered trademark) are two-dimensional codes that record information in two directions, vertically and horizontally. In this embodiment, an ArUco marker is used as the index M. In either case, to read the information embedded in the figure, a detection device that photographs (including scanning) the figure and a computing device that generates information from the image acquired by the detection device are required. The detection device and the computing device can be integrated, but in this embodiment they are configured separately.

[0034] As shown in FIG. 1, in this embodiment, the detection device is a camera 2. The camera 2 is positioned so that it can capture an image of the index M that has moved from above the front of the fixture 1 to a position where it is exposed and not hidden by the merchandise. The camera 2 is positioned above the front of the fixture 1. If it is not possible to capture images of all the indexes M on one fixture 1 using a single camera 2, multiple cameras 2 may be used, or a movable camera 2 may be used. Furthermore, to make it easier to capture the index M, an optical refractor such as a mirror 21, which is a mirror member, may be positioned between the camera 2 and the index M (see FIG. 8).

[0035] Figure 8 shows an outline of a functional block diagram illustrating the functional configuration of the merchandise management system. Camera 2 is installed on fixture 1 and is oriented toward index M provided on detection surface 70 of moving object 7 at a second position. Images captured by this camera 2 are recorded in captured image recording unit 22 provided in the relay device of camera 2. As many cameras 2 are installed in the store, images captured by each camera 2 are sent to and recorded in captured image recording unit 22.

[0036] An edge computer 4 is provided as a central control device for controlling the product management system. The edge computer 4 has a memory unit and a CPU (Central Processing Unit) that executes programs. The memory unit is composed of, for example, a HDD, a ROM (Read Only Memory), or a non-volatile memory. The edge computer 4 has an index processing module 3, a data output unit 41, and a real-time control unit 42 as functional units particularly related to the present invention. In other words, the functional units are realized by the CPU of the edge computer 4 executing the programs.

[0037] The index processing module 3 acquires a photographed image from the photographed image recording unit 22, and if the photographed image contains an index M, it performs information on the product removed from the fixture 1 (picked-up product) based on the index M, such as identifying the position of the removed product (pick-up position), the type of the removed product, and the fixture 1 and placement surface 13 on which the removed product was placed. For this purpose, the index processing module 3 has a photographed image acquisition unit 31, an extraction unit 32, an index information reading unit 33, a position detection unit 34, a fixture identification unit 35, and a product identification unit 36.

[0038] The captured image acquisition unit 31 acquires the captured images recorded in the captured image recording unit 22 based on the set product management schedule and provides them to the extraction unit 32. The captured images include the index M exposed toward the camera 2 and products that block the index M from the camera 2. The extraction unit 32 determines whether the captured captured image includes the index M, and if the index M is included, extracts the area of ​​the index M from the captured image. The presence of the index M in the captured image means that a product has been removed from the position or area corresponding to this index M.

[0039] The index information reading unit 33 reads the index ID assigned to the index M from the index M extracted by the extraction unit 32, and provides it to the position detection unit , the fixture identification unit 35, and the product identification unit .

[0040] The position detection unit 34, fixture identification unit 35, and product identification unit 36 ​​derive information (data) assigned to the read index ID from a table. For example, the fixture identification unit 35 derives the fixture ID, placement surface ID, and placement section ID from the index ID, and thereby identifies the fixture 1, placement surface 13, and placement section from which the product was removed (the product was picked up). The position detection unit 34 determines the position (pickup position) of the product removed from the identified placement surface 13 or placement section. The product identification unit 36 ​​identifies the type of product removed from the identified placement surface 13 or placement section. In other words, the functions of the position detection unit 34, fixture identification unit 35, and product identification unit 36 ​​are related to each other, so they may be integrated into a single pickup position detection unit.

[0041] Next, using Figure 9, a mechanism for deriving data assigned to an exposed index M from the index ID read from the captured image of the index M, that is, a mechanism for identifying the removed product (picked-up product) from the detection of the exposed index M by moving to the second position, will be explained.

[0042] FIG. 9 shows some of the indices M (ArUco markers) arranged horizontally in accordance with the product placement row on fixture 1, movable between a first position and a second position. When all products placed in a specific product placement row are gone, the indices M become exposed (moved to the second position). The exposed indices M are captured in an image captured by camera 2 and extracted by extraction unit 32. The indices ID (simply shown as ID1001 in FIG. 9) assigned to the extracted indices M are read from the index M. Once the indices ID is known, the fixture ID, fixture position, placement surface ID, placement surface position, placement section row ID, and placement section row position associated with the indices ID are derived. In other words, the location of the missing item is identified. Finally, the product type associated with the placement section row ID is derived, thereby obtaining the type of missing item (such as the product name). In the present embodiment, every time the exposed placing surface index HM is photographed by the camera 2, the placing surface index HM is extracted by the extraction unit 32. However, the present invention is not limited to this, and the placing surface index HM may be photographed by the camera 2, and the placing surface index HM may be extracted by the extraction unit 32 after a certain period of time.

[0043] The product removal information (product pick-up information) generated by the index processing module 3 is output from the data output unit 41 for product management, preferably together with the photographed image and the time of photographing that served as the basis for the information. This makes it possible to grasp product pick-up information that is difficult to grasp from POS data (for example, information indicating that a product has been removed from the placement surface 13 at the pickup position and then returned to the placement surface 13).

[0044] As shown in Figure 8, when the real-time control unit 42 detects that a product has been removed from the placement surface 13 of the fixture 1, it issues an alarm using an alarm (for example, a lamp such as a PATLITE (registered trademark) 51) placed near the fixture, to alert store staff and others to take care of product management, such as replenishing products.

[0045] At least one edge computer 4 is installed in a store, and the processing results (product management information) by the index processing module 3 output from the edge computer 4 are transferred to a host computer 6 via a data communication network such as a private line, the Internet, or a public line. The host computer 6 is installed within the store or in a management center that manages multiple stores. In this embodiment, the processing results by the index processing module 3 are transferred to the host computer 6 approximately every five minutes.

[0046] The host computer 6 processes product management information (mainly based on pick-up position data over time for each fixture 1) sent from the store's edge computer 4, creates product analysis information and product display evaluation information, and reports and manages storage of the information. The host computer 6 includes a calculation unit 6A, a reporting unit 6B, a database 6C, and a map generation unit 6D.

[0047] The calculation unit 6A performs statistical calculations and inferential calculations using the received product management information and past product management information stored in the database 6C. The map generation unit 6D accesses the database 6C and outputs the requested fixture 1, preferably a store image around the pickup location, or a store map, or both, and provides them to the notification unit 6B. The notification unit 6B includes a notification information generation unit 61, a display unit 62, and a printing unit 63. The notification information generation unit 61 generates product analysis information and product display evaluation information using the calculation results of the calculation unit 6A. The product analysis information here is, for example, information indicating when, where, and how each product was sold, and the product display evaluation information is information indicating best-selling display positions, vacant product sections, and out-of-stock sections over time. The display unit 62 converts the information into display information (e.g., HTML data) and provides it to a user accessing the host computer 6 or the mobile communication terminal 8. The display unit 62 can also directly display the product analysis information and product display evaluation information on the screen of a display device 62a connected to the host computer 6 or on the screen of a display device (e.g., an attached display) of the mobile communication terminal 8. The notification unit 6B can also send the product analysis information, product display evaluation information, or a message simply regarding the pickup location (e.g., "Product A was picked up from the placement surface ID of the fixture ID") to the mobile communication terminal 8, such as a registered user's smartphone. FIG. 10 shows an example of notification information displayed on the screen of the mobile communication terminal 8. This screen example displays a fixture map within the store showing the number of shortages by type (category) and the locations of the shortages (pickup locations). The locations of shortages are highlighted on the fixture map with colors or arrows. The printing unit 63 converts the information generated by the notification information generation unit 61 into print data and prints it out from the printer 63a. The printed information is sent to the responsible person.

[0048] FIG. 11 is an information flow diagram showing the information (data) that flows through the main functional blocks of the functional blocks described in FIG. 8. Camera 2, which is a detection device, captures a fixture 1. If the captured image is a still image, it is used as is, and if the captured image is a video, a still image extracted from the video is used as the captured image to be processed by edge computer 4. The captured image, to which the shooting time and camera ID are assigned as attribute information, is provided to index processing module 3 of edge computer 4 at a predetermined interval. If one camera 2 cannot cover fixture 1, fixture 1 is captured by multiple cameras 2, so multiple captured images of one fixture 1 become the processing target.

[0049] The captured image provided to the index processing module 3 is transferred to the extraction unit 32, which extracts one or more index images from the captured image. At this time, the extraction unit 32 may extract the index images by dividing one captured image into a plurality of regions. For example, the image region corresponding to the placement surface 13 of each stage in the captured image is determined in advance from the field of view of the camera 2, and therefore the captured image is divided into regions for each stage (each placement surface 13).

[0050] When an index image is extracted, the index information reading unit 33 reads an index ID from the extracted index image. The read index ID is provided to the fixture identification unit 35 to derive the fixture ID or fixture position from which the product was picked up, the read index ID is provided to the position detection unit 34 to derive the product pickup position, i.e., the placement surface position, placement section ID, and placement section position, and the read index ID is provided to the product identification unit 36 ​​to derive the product name of the picked up product.

[0051] When an index M on one of the placement surfaces 13 is exposed and detected, the notification unit 6B issues a notification request for replenishing the corresponding product. When the exposure of the index M means that all of the products corresponding to M have been removed, the notification unit 6B issues a notification that the product is out of stock.

[0052] The edge computer 4 adds the product removal information, the product removal time, a map image of the fixture 1 from which the product was removed, and the photographed image used for the product removal information, and transmits the information to the notification information generation unit 61 of the host computer 6. The notification information generation unit 61 displays, prints, and transmits the product management information and chronological product management information generated from the received information. The product management information includes information about the removed product, specific information about the fixture 1 or display surface 13 from which the product removal occurred, and the time of removal. This allows supervisors and area managers in charge of multiple stores to grasp the product management information of each store without actually visiting each store. The generated product management information is stored in the database 6C as product management history information. The notification information generation unit 61 periodically statistically processes the product management history information and outputs it as chronological product management information including statistical data on product removal.

[0053] When the generated product management information and time-dependent product management information are displayed on the display device 62a or the mobile communication terminal 8, it is advantageous for product management if a predetermined specific product, for example, fresh fish, is displayed in a font, font color, font size, etc. that is different from other products such as meat or prepared foods, as this makes the product type that you particularly want to pay attention to stand out.

[0054] As shown in Figure 8, when the product pickup position is output, the real-time control unit 42 outputs a product pickup signal to remove the product and, in particular, to notify in real time that a shortage has occurred, and for example, turns on a patrol light 51 or a specified lamp in the furniture management room for a certain period of time.

[0055] In the above description, the support form of the camera 2 is not particularly limited. Generally, the camera 2 is placed above the front of the fixture 1 so that it can photograph the index M without interfering with the passage of shoppers. For this reason, the camera 2 is preferably supported by being suspended from the ceiling, or attached via a mounting bracket to the ceiling or support 10 of the opposite fixture 1. In this configuration, the cameras 2 attached to the two opposing fixtures 1 can photograph each other's indexes M. If it is not possible for one camera 2 to photograph all of the indexes M on the front side of one fixture 1, additional cameras 2 with different shooting angles are added, or they are attached via a swivel mount.

[0056] [Another embodiment] (1) The form of the fixture 1 shown in the above-described embodiment is an example, and the fixture 1 may be one that can be frozen or refrigerated, or may be one that is laid flat.

[0057] (2) In the above-described embodiment, the camera 2 serving as the detection device for detecting the index M was fixed (including a swiveling type and a scanning type). However, as schematically shown in FIG. 12 , a detection device (camera 2) for detecting the index M may be mounted on the autonomous mobile device 100. In this case, when at least one detection device is vertically aligned with the shelf 12 of the furniture 1, the index M can be detected (photographed) from approximately the front. Alternatively, a detection device capable of scanning vertically may be used as the detection device. The autonomous mobile device 100 may be configured so that the height position of the part of the autonomous mobile device 100 where the camera 2 is installed is changeable. In this embodiment, the index M is an ArUco marker. Therefore, even when the camera 2 photographs the index M while moving, the index M is more likely to be detected accurately compared to a configuration in which the index M is a QR code (registered trademark) or a barcode.

[0058] (3) In the above-described embodiment, when the product pickup location is output, the real-time control unit 42 turns on the patrol light 51 or a specific lamp in the furniture management room for a certain period of time to notify in real time that the product has been removed. As a variation of this, if the product identification unit 36 ​​identifies a specific product (such as a featured product, a discounted product, or a promotional product) as a pre-defined product, the notification may be different from that for regular products. For example, the patrol light 51 or a specific lamp in the furniture management room may flash at different intervals or light up in different colors. Furthermore, when audio notification is provided using a buzzer or speaker, the tone and volume may be different for specific products and regular products. Furthermore, a message informing the staff member that a product, particularly a specific product, has been picked up may be sent to the staff member's mobile communication terminal 8 using a font color or font size different from that for regular products.

[0059] (4) The configuration of the edge computer 4, the host computer 6, and the mobile communication terminal 8 is an example, and they may be configured as an integrated whole, or may be configured with many additional computer devices.

[0060] (5) The functional units in the functional block diagram shown in FIG. 8 may be integrated or further divided.

[0061] The configurations disclosed in the above embodiments (including other embodiments, the same applies below) can be applied in combination with configurations disclosed in other embodiments, as long as no contradiction arises. Furthermore, the embodiments disclosed in this specification are examples, and the embodiments of the present invention are not limited to these, and can be modified as appropriate within the scope that does not deviate from the purpose of the present invention. [Industrial Applicability]

[0062] The present invention is applicable to a merchandise management system that detects the position where a displayed merchandise has been removed, and to merchandise display fixtures used in such a system. [Explanation of symbols]

[0063] 1: Fixtures (product display fixtures) 2: Camera (detection device) 3: Indicator processing module 4: Edge computers 6: Host computer 6A: Arithmetic unit 6B: Notification Department 6C: Database 6D: Map generation section 7: Moving object 7a: Clothes rail 7b: biasing member 7c: Plate member 8: Mobile communication terminal 10: Strut 11: Rear wall board 12: Shelf 13: Placement surface 15a: Moving surface 21: Mirror 22: Photographed image recording unit 31: Image capture unit 32:Extraction part 33: Index information reading unit 34: Position detection unit 35: Fixtures and Fixtures Department 36:Product Specification Department 41: Data output section 42: Real-time control section 51: Patlite 61: Notification information generation unit 62:Display section 62a:Display device 63: Printing Department 63a: Printer 70: Surface to be detected 100: Autonomous driving device M :Indicator P1: First horizontal axis P2: Second horizontal axis

Claims

1. A product management system capable of outputting the position where a product displayed on a display surface of a product display fixture has been removed, an index provided on the detection surface; a moving body that moves the detection surface from a first position where the indicator is hidden by the commodity to a second position where the detection surface faces forward and the indicator is exposed; a detection device capable of detecting the index when the detection surface is in the second position; an indicator processing module that is capable of identifying a pickup position in the store from which the product was removed based on the indicator detected by the detection device and outputting the pickup position; A product management system in which the detection surface moves to the second position when all of the products in one row arranged in the depth direction are removed.

2. the detection device is a camera capable of capturing an image of the index, The product management system according to claim 1 , wherein the indicator is an ArUco marker.

3. a notification unit that notifies the state of the products displayed on the product display fixture; The product management system according to claim 1 , wherein the notification unit notifies the user that the product is out of stock when the indicator is detected by the detection device.

4. The product management system according to claim 1 , further comprising a product identification unit that identifies the product linked to the pickup location based on the pickup location.

5. a notification unit that notifies the state of the products displayed on the product display fixture; The product management system according to claim 4 , wherein the notification unit changes the notification mode when the product identified by the product identification unit is a specific product from the mode when the product is not the specific product.

6. 2. A product management system as described in claim 1, wherein the detectable surface is laid down along the placement surface when a plurality of the products in the row are placed at the first position, and when all of the products in the row are removed from the detectable surface, the detectable surface is raised by deformation of the moving body to the second position.

7. the movable body has a biasing member that biases the detection surface in the first position forward around a horizontal axis, 2. The product management system of claim 1, wherein the detection surface is caused to recline along the placement surface when a plurality of the products in the row are placed on the detection surface at the first position, and when all of the products in the row are removed from the detection surface, the force of the biasing member causes the detection surface to rise around the horizontal axis to the second position.

8. the movable body has a biasing member that biases the detection surface, which is located at a position spaced above the placement surface at the first position, forward around a horizontal axis, 2. The product management system of claim 1, wherein the detection surface is restricted from moving to the second position by contacting the product located at the rearmost position of the row of products at the first position, and when all of the products in the row of products are removed from the detection surface, the detection surface lowers around the horizontal axis to the second position.

9. the movable body has a biasing member that biases the detection surface forward from the first position, 2. The product management system of claim 1, wherein the detectable surface is located behind the product and faces forward in the first position, and when all of the products in the row are removed from the placement surface, the detectable surface moves forward by the biasing force of the biasing member to the second position.

10. a map generation unit capable of generating a map image showing the pickup position; The product management system according to claim 1 , further comprising: a display device that displays the map image generated by the map generation unit.

11. the detection device is a camera; The merchandise management system according to claim 10 , wherein the map image shows an image of a store around the pickup location captured by the detection device.

12. an autonomous driving device that has a driving device and the detection device and is capable of autonomous driving; the detection device is capable of detecting the indicator while the autonomous driving device is autonomously driving; The product management system according to claim 1 , wherein the indicator processing module is capable of identifying the pickup position based on the indicator detected by the detection device and outputting the pickup position.

13. A product display fixture used in the product management system according to any one of claims 1 to 12, The indicator and the detection device are provided, The detection device is a product display fixture configured to be able to detect the indicator provided on another product display fixture.

Images