Display trays, product display devices, their control methods, programs, and store management systems

Abstract

This display tray includes: a tray body that is movable forward and / or rearward with respect to a reference position; and a movement mechanism that moves commodities placed on the tray body forward.

Description

Display tray, product display device, control method thereof, recording medium, and store management system

[0001] The present invention relates to a display tray, a product display device, a control method therefor, a program, and a store management system.

[0002] An example of a product replenishment system that replenishes products on product shelves is described in Patent Document 1. The control device for controlling the product replenishment system in Patent Document 1 includes a detection unit that detects the sufficiency state of products on the product shelves, a first control unit that issues an instruction to a transport device to transport products required to replenish the product shelves from a storage space toward the product shelves based on the sufficiency state, a second control unit that issues an instruction to the replenishment device to move to the product shelves based on the sufficiency state, a third control unit that issues an instruction to the product shelves to slide an arrangement area where products are placed on the product shelves from inside the product shelves to the front of the product shelves so that the replenishment device can access the arrangement area, and a fourth control unit that allows the replenishment device to lift the products transported by the transport device and replenish the products in the arrangement area that has been slid forward.

[0003] Japanese Patent Application Laid-Open No. 2019-202844

[0004] In the technology described in the above-mentioned document, a replenishment process is carried out when the product shelf's sufficiency ratio falls below a predetermined ratio, but there is a problem in that the product is grasped by a hand portion attached to the tip of the arm of the replenishment device and replenished in the replenishment area of ​​the product shelf, which results in poor work efficiency.

[0005] In view of the above-mentioned problems, an example of an object of the present invention is to provide a display tray, a product display device, a control method therefor, a program, and a store management system that improve the efficiency of product replenishing work.

[0006] The display tray of the present disclosure comprises a tray body that can be moved forward or backward at least in one direction relative to a reference position, and a moving means that moves products placed on the tray body forward.

[0007] The product display device of the present disclosure is used in conjunction with a display shelf having a display tray that can be pulled out forward, and comprises: a holding means for holding a transport tray on which products to be filled are placed; at least one movable part that can move the products; and a control means for controlling the movable part, wherein when the products are to be replenished in the display tray, the control means controls the movable part to move the display tray forward, bring the transport tray adjacent to the display tray, and move the products in the transport tray to the display tray.

[0008] The store management system of the present disclosure comprises a display tray; and a product display device that replenishes products into the display tray, wherein the display tray comprises: a tray body that can be moved at least one way forward and backward relative to a reference position; and a moving means that moves products placed on the bottom surface of the tray body forward, wherein the product display device is used together with a display shelf having the display tray that can be pulled out forward, and comprises: a holding means that holds a transport tray on which the products to be filled are placed; at least one movable part that can move the products; and a control means that controls the movable part, wherein when replenishing the products into the display tray, the control means controls the movable part to move the display tray forward, bring the transport tray adjacent to the display tray, and move the products in the transport tray to the display tray.

[0009] The control method disclosed herein is a control method for a product display device that replenishes products in a display tray having a tray body that can move at least one way forward and backward relative to a reference position, and a moving means that moves products placed on the bottom surface of the tray body forward, wherein the product display device is used in conjunction with a display shelf that has the display tray that can be pulled out forward, and has a holding means that holds a transport tray on which the products to be filled are placed, and at least one movable part that can move the products, and when replenishing the products in the display tray, one or more computers that realize the product display device control the movable part to move the display tray forward, bring the transport tray adjacent to the display tray, and move the products in the transport tray to the display tray.

[0010] The program in the present disclosure is a program for causing a computer that controls the movable part of a product display device that is used in conjunction with a display shelf having a display tray that can be pulled out forward, and that has a holding means for holding a transport tray on which the products to be filled are placed, and at least one movable part that can move the products, to execute the following processes when replenishing the products in the display tray: moving the display tray forward; bringing the transport tray adjacent to the display tray; and moving the products in the transport tray to the display tray.

[0011] Another example of the present disclosure may be a program causing at least one computer to execute the above-disclosed method, or a computer-readable recording medium having such a program recorded thereon. This recording medium includes a non-transitory tangible medium. The computer program includes computer program code that, when executed by a computer, causes the computer to implement the control method and management method on a product display device or a management device.

[0012] Any combination of the above components, and conversion of the present disclosure into a method, device, system, recording medium, computer program, etc., are also valid aspects of the present disclosure.

[0013] Furthermore, the various components of the present disclosure do not necessarily have to be independent entities, but may be formed as a single member by multiple components, one component may be formed from multiple components, one component may be a part of another component, or part of one component may overlap with part of another component, etc.

[0014] Furthermore, although the methods and computer programs disclosed herein describe a number of steps in a sequential order, the order in which the steps are performed does not limit the order in which the steps are performed. Therefore, when implementing the methods and computer programs disclosed herein, the order of the steps can be changed as long as it does not cause any problems in terms of the content.

[0015] Furthermore, the steps of the method and computer program disclosed herein are not limited to being executed at different times, and may be executed while one step is being executed, or may be executed partially or entirely overlapping with another step, etc.

[0016] According to the present disclosure, a display tray, a product display device, a control method therefor, a program, and a store management system that improve the efficiency of product replenishing work can be obtained.

[0017] 16A and 16B are diagrams illustrating trays according to the present disclosure; diagrams illustrating a configuration of a merchandise display device according to the present disclosure; diagrams illustrating a tray according to the present disclosure; diagrams illustrating a merchandise replenishing operation by a merchandise display device according to the present disclosure; diagrams illustrating a tray moving mechanism according to the present disclosure; diagrams illustrating a tray moving mechanism according to the present disclosure; diagrams illustrating a tray moving mechanism according to the present disclosure; diagrams illustrating a detailed structural example of a tray body of a tray according to the present disclosure; diagrams illustrating a detailed structural example of a tray body of a tray according to the present disclosure; diagrams illustrating a detailed structural example of a tray according to the present disclosure; diagrams illustrating a merchandise moving section of a merchandise display device according to the present disclosure; diagrams conceptually illustrating a system configuration of a store management system according to the present disclosure; block diagrams illustrating an example of a hardware configuration of a computer realizing a control device and a server device of a merchandise display device according to the present disclosure; diagrams illustrating an example functional configuration of a control device of a merchandise display device according to the present disclosure; a flowchart illustrating processing operations of a control device of a merchandise display device according to the present disclosure; a flowchart illustrating detailed processing operations of step S109 of FIG. 16A and 16B are diagrams illustrating an example functional configuration of a management device according to the present disclosure; diagrams illustrating an example data structure of robot information according to the present disclosure; diagrams illustrating an example data structure of display shelf inventory management information according to the present disclosure; Fig. 1 is a flowchart showing a processing operation of a management device according to the present disclosure; Fig. 2 is a diagram showing an example of a functional configuration of a management device according to the present disclosure; Fig. 3 is a flowchart showing a processing operation of a management device according to the present disclosure; Fig. 4 is a diagram for explaining a merchandise restocking operation by a merchandise display device according to the present disclosure; Fig. 5 is a diagram for explaining a merchandise restocking operation by a merchandise display device according to the present disclosure.

[0018] Hereinafter, in this disclosure, the drawings relate to one or more embodiments. In all drawings, similar components are denoted by similar reference numerals, and descriptions thereof will be omitted as appropriate. In each of the following drawings, configurations of parts that are not related to the essence of the present disclosure are omitted and are not shown.

[0019] In this disclosure, "acquisition" includes at least one of the following: a device going to retrieve data or information stored in another device or storage medium (active acquisition); and a device inputting data or information output from another device (passive acquisition). Examples of active acquisition include making a request or inquiry to another device and receiving a response, and accessing and reading information from another device or storage medium. Examples of passive acquisition include receiving information that is distributed (or transmitted, push notification, etc.). Furthermore, "acquisition" may also mean selecting and acquiring data or information from received data or information, or selecting and receiving distributed data or information.

[0020] <Configuration Example> Fig. 1 is a diagram illustrating a tray 10 according to the present disclosure. The tray 10 includes a tray main body 12 and a moving mechanism 20. The tray 10 is a display tray that is placed in a display shelf on which products 30 are displayed. The tray main body 12 is movable at least one way forward and backward relative to a reference position P1. The moving mechanism 20 moves the products 30 placed on the tray main body 12 forward (from the reference position P1 to a position P2).

[0021] 1 , when the tray body 12 is pulled forward, the movement mechanism 20 uses a mechanical mechanism to convert the pulling force f1 into a force that pulls the product 30 placed on the tray body 12 forward, thereby moving the product 30 to the front of the tray body 12. In this example, the movement mechanism 20 converts the force f1 that pulls out the tray body 12 into a force that abuts the push-out plate 22 against the product 30 and moves it to the front of the tray body 12 (product-pulling force f2).

[0022] With this tray 10, simply by pulling the tray body 12 forward, the moving mechanism 20 can move the products 30 placed on the tray body 12 forward, freeing up space behind the tray body 12, allowing the products 30 to be replenished in that space. This improves the efficiency of the product replenishment work.

[0023] <Configuration Example> Fig. 2 is a diagram showing the configuration of a commodity display device 100 according to the present disclosure. Hereinafter, the commodity display device 100 will also be referred to as a robot 100. The commodity display device 100 includes a camera 102, at least one arm (movable unit) 104, a robot support 106, a tray holder 112, a movement mechanism 120, and a control device 130 (not shown in Fig. 2).

[0024] The robot 100 is used in conjunction with the display shelf having the display tray 10 that can be pulled out forward. The tray holder 112 holds the transport tray 110 on which the products 30 to be filled are placed to be replenished (displayed) on the display shelf 80. The arm 104 can move the products 30, and can also move the display tray 10 and the transport tray 110. The control device 130 controls the arm 104.

[0025] The robot support 106 is placed on the tray holder 112 and supports the camera 102 and the arm 104. The robot support 106 may or may not be movable. The movement mechanism 120 is controlled by the control device 130 and moves the robot 100 within a predetermined area (for example, within the store 5 and the backroom 7). The movement mechanism 120 is not particularly limited, but moves the robot 100, for example, by rotating a rotating member such as a caterpillar.

[0026] When replenishing the display tray 10 with products 30, the control device 130 controls the arm 104 to move the display tray 10 forward, bring the transport tray 110 adjacent to the display tray 10, and move the products 30 in the transport tray 110 to the display tray 110.

[0027] The camera 102 captures an image of the display shelves 80 in the store 5 and generates an image. The camera 102 may include a mechanism for controlling the orientation of the camera body and lens, zoom control, focusing, etc., in accordance with the position and orientation of the object to be imaged.

[0028] The images generated by the camera 102 are preferably taken in real time and transmitted to the control device 130 or the server device 200. However, the images transmitted to the control device 130 or the server device 200 do not have to be transmitted directly from the camera 102, but may be images delayed by a predetermined time. The images captured by the camera 102 may be temporarily stored in another storage device, and the control device 130 or the server device 200 may read them from the storage device sequentially or at predetermined intervals. Furthermore, the images transmitted to the control device 130 or the server device 200 are preferably moving images, but may also be frame images transmitted at predetermined intervals or still images.

[0029] 3, the front surface of the tray body 12 has a protrusion 24 that can be grasped by the arm 104 of the robot 100. The robot 100 can grasp the protrusion 24 of the tray body 12 with the arm 104 and pull the tray body 12 forward.

[0030] <Operation Example> The replenishing operation of the products 30 by the product display device 100 will be described below with reference to Figure 4. In this example, two types of products, 30a and 30c, are displayed side by side. The product 30a is placed on the display tray 82a, and the product 30c is placed on the display tray 82c. Here, the replenishing operation of the product 30a will be described.

[0031] First, the robot 100 pulls the display tray 82a for the product 30a forward, moving the product 30a in front of the display tray 82a and creating a space behind the display tray 82a for product replenishment. Next, the robot 100 moves the display tray 82a for the product 30a further forward so that it does not overlap with the display tray 82c for the product 30c. In other words, the robot 100 creates a space adjacent to the display tray 82a for the product 30a. The robot 100 places a transport tray 84 adjacent to the created space. Replenishment products 30b are pre-placed on the transport tray 84. The robot 100 then slides the replenishing products 30b that were placed on the transport tray 84 into the space for product replenishment in the adjacent display tray 82a. The robot 100 then removes the transport tray 84 and returns the display tray 82a to its original position.

[0032] This product display device 100 has a tray holding unit 112, an arm 104, and a control device 130. When the control device 130 replenishes products in the display tray 82, it controls the arm 104 to move the display tray 82 forward, bring the transport tray 84 adjacent to the display tray 82, and move the products 30 in the transport tray 84 to the display tray 82.

[0033] As described above, according to this embodiment, the efficiency of product replenishing work can be improved by using the product display device 100 and the trays 10.

[0034] Detailed examples of trays according to the present disclosure will be described below. (First embodiment) <Tray 10> The following description will be made using FIG. 1. The tray 10 includes a tray main body 12 and a moving mechanism 20. The tray 10 is a display tray that is placed in a display shelf that displays products 30. The planar shape of the tray main body 12 is a rectangle with shorter sides on the front and rear sides. The bottom surface of the tray main body 12 is approximately horizontal when stored in the display shelf. In this example, the tray main body 12 is movably placed on the upper surface of a shelf board 81 of the display shelf.

[0035] The tray body 12 is movable at least one way forward and backward relative to the reference position P1. The movement mechanism 20 moves the products 30 placed on the tray body 12 forward (from the reference position P1 to a position P2).

[0036] The tray 10 has a movable member that moves with the movement of the tray body 12. The moving mechanism 20 moves the product 30 forward using the kinetic energy generated in the movable member.

[0037] The movable member is a rotating member, and the movement mechanism 20 includes a pushing member that pushes the product 30 forward as the rotating member rotates.

[0038] 5 to 7, detailed examples of the moving mechanism 20 of the tray 10 will be described. (Example 1) The tray 10 in Fig. 5 has a guide 52, a belt 54, and a push plate 22 as the moving mechanism 20.

[0039] One end of the belt 54 is connected to the push-out plate 22, and the other end is connected to one end 81a of a shelf 81 of the display shelf, and the belt 54 is housed movably within the guide 52. When the tray main body 12 is in the reference position P1, the guide 52 is installed at a location that is located at the center of the back side of the bottom surface of the tray main body 12 along the long side direction of the bottom surface of the tray main body 12. Furthermore, the guide 52 is curved so that the belt 54 extends upward from the back side of the bottom surface of the tray main body 12, and further curves along the curve of the belt 54, one end of which is connected to the push-out plate 22.

[0040] When the tray main body 12 moves from the reference position P1 to the forward position P2 due to the pulling force f1, the pulling force f1 is converted into a force f2 that pushes the product 30 forward. Specifically, the other end of the belt 54 moves to the right in the figure along the guide 52 due to the pulling force f1, so that one end of the belt 54 is pushed in a direction that moves the push plate 22 to the left in the figure, i.e., forward. In this way, the push plate 22 moves forward. Thus, in this example, the belt 54 is both a movable member and a pushing member. The push plate 22 is an example of a pushing member.

[0041] With this tray 10, simply by pulling the tray body 12 forward, the moving mechanism 20 can move the products 30 placed on the tray body 12 forward, freeing up space behind the tray body 12, allowing the products 30 to be replenished in that space. This improves the efficiency of the product replenishment work.

[0042] (Example 2) The tray 10 in Figure 6 has a moving mechanism 20 that includes a first rack 44, a second rack 45, a pinion 46, a gear 48, and a pusher plate 22. The rotation shaft 42 of the pinion 46 and the gear 48 is installed on the rear side of the bottom surface of the tray body 12, parallel to the short side. The second rack 45 is installed on a shelf 81 of a display shelf. When the tray body 12 moves from a reference position P1 to a forward position P2, the second rack 45 moves to the right in the figure, and the gear 48 rotates in a direction that moves forward on the second rack 45. This rotation causes the first rack 44 and the pusher plate 22 to move to the left in the figure, i.e., toward the front of the tray body 12.

[0043] In this example, the pinion 46 and the gear 48 are examples of movable members, and the first rack 44 and the push-out plate 22 are examples of push-out members. In this way, the force f1 that pushes out the tray body 12 is converted into a force f2 that pulls the product 30 forward.

[0044] With this tray 10, simply by pulling the tray body 12 forward, the moving mechanism 20 can move the products 30 placed on the tray body 12 forward, freeing up space behind the tray body 12, allowing the products 30 to be replenished in that space. This improves the efficiency of the product replenishment work.

[0045] (Example 3) The tray 10 in Figure 7 has, as the moving mechanism 20, tires 60, a pair of gears 64, and a belt 66 that meshes with the two spaced-apart gears 64. The belt 66 is configured to move only forward by a ratchet mechanism of the gears 64. The surface of the upper belt 66 is exposed above the bottom surface of the tray body 12, and the products 30 are placed on the surface of the belt 66.

[0046] The rotation shafts 62 of the two gears 64 are provided at the rear and front of the tray body 12, respectively, parallel to the short side direction, and are arranged so that the belt 66 moves along the long side direction of the tray body 12. The tire 60 that moves on the shelf board 81 of the display shelf is installed coaxially with the rotation shaft 62 of the rear gear 64.

[0047] When the tray body 12 moves from the reference position P1 to a forward position P2, the tire 60 rotates and moves on the display shelf. At this time, the gear 64 coaxial with the tire 60 also rotates, causing the belt 66 meshing with the gear 64 to move, and the front gear 64 also rotates. The upper belt 66 moves toward the front of the tray body 12, so the product 30 placed on the top surface of the belt 66 moves toward the front of the tray body 12.

[0048] In this example, the tire 60 and the gear 64 are an example of a rotating member, and the belt 66 is an example of a pushing member.

[0049] With this tray 10, simply by pulling the tray body 12 forward, the moving mechanism 20 can move the products 30 placed on the tray body 12 forward, freeing up space behind the tray body 12, allowing the products 30 to be replenished in that space. This improves the efficiency of the product replenishment work.

[0050] As described above, the tray 10 of this embodiment has a simple structure in that simply by pulling the tray body 12 forward, the moving mechanism 20 can move the products 30 placed on the tray body 12 forward, freeing up space behind the tray body 12 so that the products 30 can be replenished in that space. This improves the efficiency of the product replenishment work.

[0051] <Tray Body 12> Next, detailed examples of the structure of the tray body 12 will be described using Figures 8 to 11. (Example 1) As shown in Figure 8, the tray body 12 of the display tray 82 has a rectangular planar shape with its front and rear sides being shorter. The tray body 12 of the display tray 82 has a side surface 16 on at least one of the longer sides of the rectangle. In the example of Figure 8, the tray body 12 of the display tray 82 also has side surfaces 18 on both of the shorter sides of the rectangle. Furthermore, a label 88 bearing information capable of identifying a product 30 placed on the tray body 12 of the display tray 82 is provided on the front side surface 18 of the tray body 12 of the display tray 82. As will be described later, the label 88 may further include a two-dimensional code or marker bearing information capable of identifying at least one of the tray body 12 of the display tray 82 and the position of the tray body 12.

[0052] As shown in Figure 8(b), when replenishing the display tray 82 with products 30, the transport tray 84 is positioned adjacent to the display tray 82. The tray body 12 of the transport tray 84 has a rectangular planar shape with short sides at the front and rear sides. The tray body 12 of the transport tray 84 has a side surface 16 on one of the long sides of the rectangle that is not adjacent to the display tray 82. Furthermore, the tray body 12 of the transport tray 84 has side surfaces 18 on both short sides of the rectangle.

[0053] The bottom surface 14 of the display tray 82 and the bottom surface 14 of the transport tray 84 are arranged to be flush with each other. In this way, the tray body 12 of the transport tray 84 has a side surface 16 on one of the long sides of the rectangle that is not adjacent to the transport tray 84, so that the products 30 placed on the transport tray 84 can be replenished by sliding them from the transport tray 84 to an empty space in the display tray 82 without having to be lifted.

[0054] (Example 2) As shown in FIG. 9 , a display tray 82 has a moving belt 70 on its bottom surface 14. The moving belt 70 contacts a product 30 and moves the product 30 toward the front of the tray main body 12. The moving belt 70 is, for example, the belt 66 moved by the moving mechanism 20 shown in FIG. 7 . The surface of the moving belt 70 is made of a material that has a surface friction force between the surface of the product 30 and the moving belt 70, and that is greater than or equal to a first threshold and less than or equal to a second threshold. That is, when the surface friction force is greater than or equal to the first threshold, the product 30 moves forward of the tray main body 12 as the moving belt 70 moves. On the other hand, when the surface friction force is less than or equal to the second threshold, the product 30 moves forward of the tray main body 12 and contacts the front side surface 18 of the tray main body 12 or a product 30 placed in front of it. If the moving belt 70 is moving to move another product 30, the product 30 in this state stops, and only the moving belt 70 can move.

[0055] 9(b), the moving belt 70 is inclined relative to the long sides so that it moves from one long side to the other long side as it approaches the front of the tray body 12. The tray body 12 has a side surface 16 on the other long side. Therefore, when the product 30 is pushed to the front of the tray body 12, the side surface 16 moves in the direction of the side surface 16, preventing the product 30 from falling off the other long side where the side surface 16 is not present.

[0056] (Example 3) As shown in Figure 10, the planar shape of the tray body 12 is a rectangle with the front and rear sides being shorter. Multiple tray bodies 12 can be connected in the short-side direction. The tray body 12 in Figure 10 can be used as both a display tray 82 and a transport tray 84. Figure 10(a) shows a state in which two tray bodies 12 are connected. Figure 10(b) shows a state in which three tray bodies 12 are connected. A larger-sized product 30b can be placed on the tray in Figure 10(b) made up of three connected tray bodies 12 than on the tray in Figure 10(a) made up of two connected tray bodies 12.

[0057] However, although not shown in this example, a side surface 16 is provided on one of the long sides of the rectangle of the tray body 12 after connection.

[0058] (Example 4) As shown in Fig. 11 , the tray body 12 of the conveying tray 84 has at least one moving member 72 that moves the placed product 30 in the direction of the short side of the rectangle toward the display tray 82. The moving member 72 can have a structure that combines a belt and gears, as shown in Fig. 7 . However, in this example, the gear rotates due to the rotation of a motor (not shown) that is driven by power supplied from the robot 100, thereby moving the belt.

[0059] 12 shows an example of the product moving unit 72 of the robot 100. In the example of FIG. 12, the product moving unit 72 is part of the movable unit (arm 104) of the robot 100 and moves the product 30 to the display tray 82. The product moving unit 72 is a pushing member (plate) that pushes the product 30 placed on the tray body 12 of the transport tray 84 into an empty space on the display tray 82. The product moving unit 72 is grasped by the arm 104 of the robot 100, comes into contact with the product 30b placed on the transport tray 84, and slides the product 30b from the transport tray 84 into an empty space on the display tray 82.

[0060] The pusher member is capable of simultaneously moving a plurality of products 30 onto the display tray 82. In this example, two products 30b are simultaneously moved from the transport tray 84 onto the display tray 82.

[0061] As described above, according to the tray 10 of this embodiment, the product 30 can be moved from the transport tray 84 to the display tray 82 simply by sliding the product 30 without lifting it, thereby improving the efficiency of product replenishment work.

[0062] Second Embodiment <System Overview> A detailed example of a store management system equipped with a tray and a product display device according to the present disclosure will be described. FIG. 13 is a conceptual diagram illustrating the system configuration of a store management system 1 according to the present disclosure. The store management system 1 automates the stocking of display shelves 80 in a store 5 using a product display device (robot) 100. The store 5 is, for example, a retail store such as a supermarket, drugstore, or convenience store. In such retail stores, stocking accounts for approximately 20% of the total business. Stocking work is hard work. Furthermore, delays in stocking can lead to lost sales opportunities. Therefore, because stocking work is the most important task, being preoccupied with stocking work can lead to neglecting customer service work that leads to customer satisfaction and sales.

[0063] The store management system 1 according to the present disclosure automatically performs stocking tasks by patrolling the store 5, checking the remaining number of each product 30, and transporting the product 30 from the back yard 7 and displaying it on the display shelves 80 before it runs out. The store management system 1 reduces lost sales opportunities due to stockouts, and allows employees to focus on customer service rather than being overwhelmed with stocking tasks.

[0064] The store management system 1 includes a server device 200, a product display device 100, and a tray 10. The server device 200 and the product display device 100 are connected via a communication network 3. As the tray 10 has been described in the above embodiment, a detailed description thereof will be omitted in this embodiment.

[0065] The server device 200 includes a storage device 220. The storage device 220 may be provided inside or outside the server device 200. In other words, the storage device 220 may be hardware that is integrated with the server device 200, or may be hardware that is separate from the server device 200.

[0066] The robot 100 performs stocking work in accordance with instructions from the server device 200. The stocking work will be described later.

[0067] The server device 200 instructs the robot 100 to perform stocking work using information about the shortage of products 30 detected by the robot 100 and information about the display on the display shelves 80. In the embodiment described below, the server device 200 also predicts demand for the products 30 and instructs the robot 100 to replace the products according to demand.

[0068] <Hardware Configuration Example> FIG. 14 is a block diagram illustrating an example of the hardware configuration of a computer 1000 that realizes the control device 130 and the server device 200 of the product display device 100 according to the present disclosure.

[0069] The computer 1000 has a bus 1010 , a processor 1020 , a memory 1030 , a storage device 1040 , an input / output interface 1050 , and a network interface 1060 .

[0070] The bus 1010 is a data transmission path for transmitting and receiving data among the processor 1020, memory 1030, storage device 1040, input / output interface 1050, and network interface 1060. However, the method of connecting the processor 1020 and the like to each other is not limited to bus connection.

[0071] The processor 1020 is implemented by a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or the like.

[0072] The memory 1030 is a main storage device realized by a RAM (Random Access Memory) or the like.

[0073] The storage device 1040 is an auxiliary storage device realized by a hard disk drive (HDD), a solid state drive (SSD), a memory card, a read-only memory (ROM), or the like. The storage device 1040 stores program modules that realize the functions of the control device 130 of the product display device 100 (such as a movement control unit 132, a tray position acquisition unit 134, a shortage number acquisition unit 136, a tray control unit 138, and a product replenishment unit 140, which will be described later) and the functions of the server device 200 (such as a robot position information acquisition unit 202, a display shelf information acquisition unit 204, a robot work information acquisition unit 206, a robot instruction unit 208, a history information acquisition unit 210, an event information acquisition unit 212, a demand forecasting unit 214, a display information generation unit 216, and a work information generation unit 218, which will be described later). The processor 1020 loads and executes each of these program modules into the memory 1030, thereby realizing the functions corresponding to the program modules. The storage device 1040 may also store the data of the storage device 220 of the server device 200 .

[0074] The program module may be recorded on a recording medium. The recording medium on which the program module is recorded may include a non-transitory, tangible medium usable by the computer 1000, and the program code readable by the computer 1000 (processor 1020) may be embedded in the medium.

[0075] The input / output interface 1050 is an interface for connecting the computer 1000 with various input / output devices. The input / output interface 1050 also functions as a communication interface for performing short-range wireless communication such as Bluetooth (registered trademark) and NFC (Near Field Communication).

[0076] The network interface 1060 is an interface for connecting the computer 1000 to the communication network 3. This communication network 3 is, for example, a local area network (LAN) or a wide area network (WAN). The network interface 1060 may be connected to the communication network 3 wirelessly or by wire.

[0077] The computer 1000 is then connected to necessary equipment (e.g., the camera 102, arm 104, robot support 106, tray holder 112, moving mechanism 120, speaker, microphone, etc. of the product display device 100, and the display, touch panel, operation buttons, touchpad, keyboard, mouse, speaker, microphone, camera, printer, etc. of the server device 200) via the input / output interface 1050 or the network interface 1060.

[0078] Each component of the control device 130 and server device 200 of the commodity display device 100 according to the present disclosure in each figure is realized by any combination of hardware and software of the computer 1000 in Figure 14. Those skilled in the art will understand that there are various variations in the realization method and device. The functional block diagrams showing the control device 130 and server device 200 of the commodity display device 100 according to the present disclosure in each figure show blocks of logical functional units, rather than a configuration of hardware units.

[0079] Furthermore, the control device 130 of the product display device 100 according to the present disclosure may be realized as a single chip or device, or may be realized in a form that is attached to the product display device 100 .

[0080] The camera 102 of the robot 100 includes an imaging element such as a lens and a charge coupled device (CCD) image sensor. The camera 102 may be a network camera such as an Internet Protocol (IP) camera. The network camera may have a wireless local area network (LAN) communication function and may be connected to the server device 200 via a relay device (not shown) such as a router of the communication network 3.

[0081] <Functional Configuration Example> First, the control device 130 of the robot 100 according to the present disclosure will be described with reference to Fig. 15. The control device 130 includes a movement control unit 132, a tray position acquisition unit 134, a shortage number acquisition unit 136 (shortage number identification means), a tray control unit 138 (control means), and a product replenishment unit 140 (control means).

[0082] The movement control unit 132 controls the movement mechanism 120 of the robot 100 in FIG. 2 to move the robot 100 within the store 5 and the backyard 7. The movement of the movement mechanism 120 is controlled by the movement control unit 132, allowing the robot 100 to perform the following tasks. (Task 1) According to a schedule, at a predetermined timing in the backyard 7, open the packaging 32 of the product 30, remove the product 30, and place it on a transport tray 84 to prepare for stocking. However, in the case of a convenience store or the like, the backyard 7 may not be large enough, so this preparation work may be performed in a warehouse for the product 30 and then transport it to the store 5. (Task 2) According to a schedule, at a predetermined timing, the robot 100 patrols the store 5, moves in front of the display shelf 80, captures an image of the display shelf 80 with the camera 102, and detects any shortages of product 30. (Task 3) In response to the detection of a shortage of products 30, in the back yard 7, the robot 100 stores multiple transport trays 110 (Fig. 2) on which the missing products 30 are placed in the tray holder 112 of the robot 100 (Fig. 2). (Task 4) The robot moves into the store 5 and moves in front of the display shelf 80 that displays the products 30. (Task 5) The robot returns to the back yard 7 after displaying (replenishing) the products 30 on the display shelf 80.

[0083] The tray position acquisition unit 134 processes an image of the display shelf 80 captured using the camera 102 to acquire position information of the display tray 82. Methods for acquiring the position information of the display tray 82 include, but are not limited to, the following examples. (Acquisition Method 1) A two-dimensional code 86 indicating identification information for identifying the display tray 82 is provided on a label 88 provided on the front side surface 18 of the display tray 82. The two-dimensional code 86 is read by processing the image 90, and the identification information of the display tray 82 is acquired. Furthermore, a two-dimensional code or marker indicating information for identifying the position of the shelf 81 of the display shelf 80 on which the display tray 82 is stored is provided in front of the shelf 81. The image 90 is processed to read the two-dimensional code or marker, and the position of the shelf 81 of the display shelf 80 on which the display tray 82 is stored is identified. Information indicating the identified position is acquired in association with the identification information of the display tray 82. (Acquisition method 2) Using an image 90 captured of the entire display shelf 80 or a predetermined area, a predetermined position (for example, the upper left corner) of the label 88 of the display tray 82 within the image 90 is detected. The position within the image 90 is identified by two-dimensional coordinates (x, y) as a relative position within the entire display shelf 80 or a predetermined area included in the image 90. Information capable of identifying the entire display shelf 80 or a predetermined area is associated with the position information of each of the multiple display trays 82 included in that area.

[0084] The label 88 also describes the name of the product 30 placed on the tray body 12. Furthermore, the label 88 may also describe identification information that can identify the product 30. The tray position acquisition unit 134 may read and acquire at least one of the name and identification information of the product 30 placed on the tray body 12 from the label 88.

[0085] The shortage quantity acquisition unit 136 processes images of the display shelf 80 to identify the number of missing products 30. There are various possible methods for the shortage quantity acquisition unit 136 to identify the number of missing products 30, including, but not limited to, the following examples. (Identification Method 1) The area of ​​the products 30 on the tray body 12 and the overall area of ​​the tray body 12 are identified through image processing. The number of products 30 that can be placed on the tray body 12 and the number of products 30 placed on the tray body 12 are calculated from the area occupied by each product 30 placed on the tray body 12. The number of missing products 30 is calculated by subtracting the number of products 30 placed on the tray body 12 from the number of products 30 that can be placed on the tray body 12. The products 30 placed on the tray body 12 may be identified by image processing of the labels 88, as described above. Alternatively, the product 30 may be identified by comparing the features of each product 30 pre-stored in the memory 1030 or storage device 1040 of the computer 1000 (hereinafter referred to as the memory unit of the control device 130) with the features extracted from the product 30 in the image 90 by image processing.

[0086] (Identification method 2) Image processing is used to identify areas of the tray body 12 where no products 30 are placed. From the area occupied by each product 30 placed on the tray body 12, the number of products 30 that can be placed in that area is calculated and used as the number of products 30 that are in short supply.

[0087] (Determination method 3) The number of products 30 placed on the tray main body 12 is determined by image processing. The number of products 30 that can be placed on the tray main body 12 is obtained from the memory of the control device 130. Alternatively, the number of products 30 that can be placed on the tray main body 12 calculated by the above-mentioned determination method 1 may be used.

[0088] However, if there are multiple shapes and sizes of tray bodies 12, the number of products 30 that can be placed on the tray body 12 for each type of tray body 12 is stored in the memory of the control device 130. Furthermore, information that can identify the type of tray body 12 is recorded on the label 88 of the tray body 12. The type of tray body 12 is identified by image processing. The number of products 30 that are currently placed on the tray body 12 is subtracted from the number of products 30 that can be placed on the tray body 12 to calculate the number of products 30 that are missing.

[0089] (Identification Method 4) Predetermined markers are provided on the bottom surface of the tray main body 12. The markers are detected by image processing, and areas where no products 30 are placed are calculated based on the detection rate of the markers. In other words, markers in areas of the bottom surface of the tray main body 12 where products 30 are placed are hidden by the products 30 and are therefore not included in the image 90. On the other hand, markers in areas of the bottom surface of the tray main body 12 where no products 30 are placed are included in the image 90. Therefore, the detection rate (e.g., area ratio or number ratio) of the detected markers relative to markers previously provided on the tray main body 12 is calculated to calculate areas where no products 30 are placed.

[0090] The shortage number acquisition unit 136 associates the position information of the tray body 12 acquired by the tray position acquisition unit 134 with the shortage number of the products 30, and stores this as shortage information of the products 30 in the memory unit of the control device 130. The shortage number acquisition unit 136 may transmit the shortage information to the server device 200.

[0091] The tray control unit 138 controls the arm 104 to control the movement of the display tray 82 and the transport tray 84. The product replenishment unit 140 replenishes the display tray 82 with any missing products 30 by moving the products 30 from the transport tray 84 to the display tray 82. The operation of the tray control unit 138 and the product replenishment unit 140 will be described in detail below.

[0092] <Operation Example> The operation of the control device 130 of the robot 100 will be described using Figure 16. First, the movement control unit 132 controls the movement mechanism 120 of the robot 100 to move the robot 100 in front of the display shelf 80 (step S101). Then, the tray position acquisition unit 134 captures an image of the display shelf 80 using the camera 102 and generates an image 90. Then, the tray position acquisition unit 134 processes the image 90 to acquire position information of the tray main body 12 (step S103).

[0093] The shortage quantity acquisition unit 136 then processes the image 90 to identify the number of missing products 30 on each tray body 12 (step S105). The shortage information, which associates the number of missing products 30 on each tray body 12 acquired by the shortage quantity acquisition unit 136 with the position information of the tray body 12, is transmitted to the server device 200.

[0094] The movement control unit 132 controls the movement mechanism 120 to move the robot 100 to the backyard 7. In accordance with the instruction received from the server device 200, the tray control unit 138 stores the transport tray 84 on which the products 30 requiring replenishment are placed in the tray holding unit 112 (step S107). The instruction transmitted from the server device 200 includes work content that associates the transport tray 84 to be stored in the tray holding unit 112 with information that can identify the display tray 82 to which the products 30 in the transport tray 84 should be replenished.

[0095] The tray control unit 138 and the product replenishment unit 140 perform a process of replenishing the products 30 by moving the display tray 82 and the transport tray 84 and moving the products 30 from the transport tray 84 to the display tray 82 (step S109).

[0096] 17 is a flowchart showing the detailed processing operation of step S109. First, the control device 130 of the robot 100 detects its own current position (step S121). There are various possible methods for acquiring the position information of the robot 100, and examples thereof are shown below, but are not limited to these.

[0097] (Acquisition method 1) Location information is acquired from a GPS (Global Positioning System) receiver that the robot 100 has. (Acquisition method 2) The location within the store 5 or the display shelf 80 is identified by processing an image captured by the camera 102 of the robot 100. The store 5 or the display shelf 80 is provided with a two-dimensional code that records information that can identify the location within the store 5 and the display shelf 80. At least one of the location within the store 5 and the display shelf 80 is identified from the two-dimensional code by processing an image captured by the camera 102 of the two-dimensional code.

[0098] The movement control unit 132 controls the movement mechanism 120 to move the robot 100 in front of the display shelf 80 instructed to replenish the product 30, using the location information indicating the current location of the robot 100 obtained in step S121 and information that can identify the location of the display shelf 80 instructed by the server device 200 to replenish the product 30 (step S123).

[0099] The tray control unit 138 then captures an image of the display shelf 80 with the camera 102 to generate an image 90. The tray control unit 138 then processes the image 90 to identify and locate the display tray 82 instructed to be replenished (step S125).

[0100] The tray control unit 138 controls the arm 104 to grip the protrusion 24 of the display tray 82 identified in step S125, and pulls the display tray 82 forward (step S127). As described above, when the display tray 82 is pulled out, the moving mechanism 20 moves the products 30 placed on the display tray 82 forward, creating an empty space behind the display tray 82.

[0101] The tray control unit 138 controls the arm 104 to remove the transport tray 84 from the tray holding unit 112 and place the transport tray 84 next to the display tray 82 pulled out in step S127 (step S129). At this time, the bottom surfaces of the display tray 82 and the transport tray 84 are flush with each other.

[0102] The product replenishment unit 140 controls the arm 104 to slide and replenish the products 30 from the transport tray 84 into an empty space on the display tray 82 (step S131). Then, the tray control unit 138 controls the arm 104 to remove and recover the transport tray 84 from next to the display tray 82, and store it in the tray holding unit 112 (step S133). The robot 100 repeats this process until the replenishment of the products 30 on the transport trays 84 stored in the tray holding unit 112 is complete. When the replenishment of the products 30 on the transport trays 84 stored in the tray holding unit 112 is complete, the movement control unit 132 controls the movement mechanism 120 to return the robot 100 to the backyard 7.

[0103] <Server device 200> <Functional configuration example> The management device (server device) 200 according to the present disclosure will be described below with reference to Fig. 18. The server device 200 has a robot position information acquisition unit 202, a display shelf information acquisition unit 204, a robot work information acquisition unit 206, and a robot instruction unit 208.

[0104] The robot position information acquisition unit 202 acquires current position information from the robot 100. The robot work information acquisition unit 206 acquires information indicating the work state of the robot 100. The work state of the robot 100 is, for example, one of standby, moving, display, and replenishment. Furthermore, the work state of the robot 100 may include stop (such as power off) indicating the operating state of the robot 100.

[0105] When the server device 200 acquires the position information of the robot 100 and the information indicating the working status from each robot 100, the server device 200 stores the information as robot information 230 in the storage device 220, or the memory 1030 or storage device 1040 of the computer 1000. Note that various information described below may also be stored in the storage device 220, or the memory 1030 or storage device 1040 of the computer 1000 in a similar manner. In the following description, the phrase "stored in the storage device 220" is used, but this phrase is intended to mean "stored in the storage device 220, or the memory 1030 or storage device 1040 of the computer 1000."

[0106] 19 is a diagram showing an example of the data structure of the robot information 230. The robot information 230 stores, for each robot 100, information indicating the date and time when information was acquired or recorded, in association with identification information (robot ID in the figure) by which the robot 100 can be identified, position information acquired by the robot position information acquisition unit 202, and information indicating the work status acquired by the robot work information acquisition unit 206. In addition to the example of FIG. 19 , the robot information 230 may store, for each robot 100, information indicating the date and time when information was acquired or recorded, in association with identification information (robot ID in the figure) by which the robot 100 can be identified, position information acquired by the robot position information acquisition unit 202, and information indicating the work status acquired by the robot work information acquisition unit 206.

[0107] 18 , the display shelf information acquisition unit 204 acquires display status information indicating the display status of products on the display shelves 80 in the store 5. Specifically, the display shelf information acquisition unit 204 acquires shortage information indicating the number of products 30 that are lacking for each display shelf 80, which is acquired by the robot 100 as it patrols the store 5. The display shelf information acquisition unit 204 stores the acquired information in the storage device 220 as display shelf inventory management information 240.

[0108] 20 is a diagram showing an example of the data structure of the display shelf inventory management information 240. The display shelf inventory management information 240 includes, for each shelf 81 of the display shelf 80, identification information (shown as a product rack ID in the figure) that can identify the display shelf 80, identification information (shown as a shelf ID in the figure) that can identify the shelf 81, position information that indicates the position of the shelf 81 within the shelf 81 of the display shelf 80, information (shown as a product code in the figure) that can identify the product 30 placed on the display tray 82 that is stored at the position of that shelf 81, and information that indicates the number of that product 30 that is missing, all of which are associated with each other.

[0109] 20 , the display shelf inventory management information 240 stores the number of products 30 that are in short supply, but in other examples, the display shelf inventory management information 240 may store the number of products 30 that are remaining in the display trays 82 and the number of products 30 that can be accommodated in the display trays 82. The number of products 30 that are in short supply can be calculated from the number of products 30 that are remaining in the display trays 82 and the number of products 30 that can be accommodated in the display trays 82.

[0110] 18 , the robot instruction unit 208 uses the robot information 230 and the display shelf inventory management information 240 to determine which robot 100 is to be assigned the task of replenishing which product 30, and generates instruction information indicating the task content for each robot 100. The robot instruction unit 208 transmits the generated instruction information to each robot 100 via the communication network 3.

[0111] <Operation Example> The processing operation of the control device 130 of the robot 100 will be described below with reference to Fig. 21. First, the robot position information acquisition unit 202 acquires the position information of the robot 100 from each robot 100 (step S201). Next, the display shelf information acquisition unit 204 acquires from each robot 100 shortage information indicating the shortage number of products 30 for each display shelf 80, which the robot 100 acquires as it patrols the store 5. The display shelf information acquisition unit 204 stores the acquired information in the storage device 220 as display shelf inventory management information 240 (step S203).

[0112] Then, the robot work information acquisition unit 206 acquires information indicating the work status of the robot 100 from each robot 100 (step S205). The robot work information acquisition unit 206 associates the position information acquired in step S201 with the information indicating the work status acquired in step S205, and stores the information as robot information 230 in the storage device 220.

[0113] The robot instruction unit 208 uses the robot information 230 and the display shelf inventory management information 240 to determine which robot 100 should be assigned the replenishment work for which product 30, and generates instruction information indicating the work content for each robot 100 (step S207).

[0114] The robot instruction unit 208 transmits the generated instruction information to each robot 100 via the communication network 3 (step S209). When the robot 100 receives the instruction information from the server device 200, it can perform the work in accordance with the work content indicated by the instruction information.

[0115] As described above, the store management system 1 of this embodiment includes a server device 200, a product display device (robot) 100, and a tray 10. The robot 100 patrols the store 5, acquires the display status of the display shelves 80, and transmits the acquired information to the server device 200. The server device 200 generates instruction information instructing the restocking of the products 30 using the display status of the display shelves 80 (such as the number of missing products 30) received from the robot 100, and transmits the instruction information to the robot 100. The robot 100 performs the restocking of the products 30 in accordance with the received instruction information. When the tray 10 is pulled out by the robot 100, the tray 10 is moved by the movement mechanism 20 to the front of the tray main body 12 within the tray main body 12, forming a product replenishment area. The robot 100 then replenishes the products 30 in the product replenishment area using the product moving unit.

[0116] In this way, the store management system 1 of this embodiment not only achieves the same effects as the above-described embodiment, but also, by using the robot 100, server device 200, and tray 10, it is possible to automate a series of stocking operations in the store 5, from detecting shortages of products 30 to replenishing the products 30, thereby improving the efficiency of product replenishment operations.

[0117] (Third Embodiment) <Functional Configuration Example> Fig. 22 is a block diagram showing the configuration of a server device 200 according to the present disclosure. The server device 200 in Fig. 22 is the same as the server device 200 in Fig. 18 except that, in addition to the configuration of the server device 200 in Fig. 18, it further includes a configuration for predicting product demand and replacing or replenishing products in accordance with the prediction results. Although Fig. 22 does not show the configuration of Fig. 18, the server device 200 in Fig. 22 may also include each of the elements in Fig. 18. Note that each of the elements in Fig. 22 may be combined with each of the elements in one or more embodiments to the extent that no contradiction occurs.

[0118] The server device 200 includes a history information acquisition unit 210, an event information acquisition unit 212, a demand forecasting unit 214, a display information generation unit 216, and a work information generation unit 218. Furthermore, the server device 200 includes at least the robot instruction unit 208 of Fig. 18 (not shown in Fig. 22).

[0119] The history information acquisition unit 210 acquires product sales history information held by the store system of store 5. This sales history information is used by the demand forecasting unit 214 to create a demand forecast for products by daily time period, day of the week, month, season, etc. For example, the demand forecasting unit 214 can use the sales history information to create a demand forecast by weekday commuting time period, lunch break time period, dinner time period, and home-coming time period.

[0120] The event information acquisition unit 212 acquires event information including information regarding various events (e.g., fireworks displays, sports days, etc.) held in the area surrounding the store 5, information indicating calendar events (e.g., Mother's Day, Father's Day, Christmas, New Year's, etc.), and information regarding promotional events and campaigns.

[0121] There are various possible methods for acquiring event information, including but not limited to the following examples: (Acquisition method 1) Event information is acquired by accepting input from an operator using an input screen including a UI (User Interface) that accepts input of information indicating the type of event and information indicating the date and time the event is held. (Acquisition method 2) Information about various events in the area surrounding store 5 is collected from various websites on the Internet. (Acquisition method 3) Information about calendar events is registered in advance in storage device 220, and the registered information is read and acquired.

[0122] The demand forecasting unit 214 uses the event information acquired by the event information acquisition unit 212 and the sales history information acquired by the history information acquisition unit 210 to generate information indicating a demand forecast for a specific date and time (for example, a specific time on a specific day (e.g., 8:00-10:00) or a specific time period on a weekday (e.g., the time when people return home)).

[0123] The display information generation unit 216 generates product display information using information indicating a demand forecast for a specific date and time. This product display information is display information corresponding to an event or the like on a specific date and time. For example, if a fireworks display is scheduled to be held in the area surrounding the store 5 on the evening of a specific day, the display information generation unit 216 generates display information for displaying products such as beer and snacks in an area of ​​the display shelf 80 where promotional products are displayed, from 3:00 PM to 10:00 PM on that specific day.

[0124] The work information generating unit 218 acquires information indicating the display status of the display shelves 80 at a time before the specific date and time. The information indicating the display status may be information indicating the display status identified from the captured image 90 by the display shelf information acquiring unit 204 described above actually using the robot 100, or may be acquired from display information planned in advance.

[0125] The work information generation unit 218 generates instruction information indicating work content for replacing and replenishing products using the display information at the specific date and time and the display information before the specific date and time. The generated instruction information is transmitted to the robot 100 by the robot instruction unit 208. Upon receiving the instruction information, the robot 100 performs work in accordance with the work content.

[0126] However, the instruction information may include information indicating the date and time when the task is to be performed. The robot 100 may monitor the date and time when the task is to be performed, and start the task when the date and time arrives.

[0127] Furthermore, the instruction information may be created before a specific date and time and may further include information indicating the date and time when the instruction information should be transmitted. The work information generation unit 218 assigns tasks to each robot 100 and creates a work plan using information indicating the work schedule of each robot 100. The robot instruction unit 208 transmits the instruction information to each robot 100 in accordance with the information indicating the date and time when the instruction information should be transmitted. However, as described above, if the instruction information for the robot 100 includes information indicating the date and time when the task will be performed, the instruction information may be transmitted to the robot 100 in advance. The robot 100 may monitor the date and time when the task will be performed and start the task when the date and time arrives.

[0128] <Operation Example> Fig. 23 is a flowchart showing the processing operation of the server device 200 according to the present disclosure. The following description will be made with reference to Fig. 23. The history information acquisition unit 210 acquires product sales history information held by the store system of store 5 (step S221). The event information acquisition unit 212 acquires event information including information about various events being held in the area around store 5, information indicating calendar events, etc. (step S223).

[0129] The demand forecasting unit 214 generates information indicating a demand forecast for a specific date and time using the event information acquired by the event information acquisition unit 212 and the sales history information acquired by the history information acquisition unit 210 (step S227). The display information generation unit 216 generates product display information using the information indicating the demand forecast for the specific date and time (step S227). The work information generation unit 218 acquires information indicating the display status of the display shelves 80 at a time before the specific date and time (step S229). The work information generation unit 218 then generates instruction information indicating the work content for replacing and replenishing products using the display information for the specific date and time and the display information for a time before the specific date and time (step S231).

[0130] The robot instruction unit 208 transmits the generated instruction information to each robot 100 via the communication network 3 (step S209). When the robot 100 receives the instruction information from the server device 200, it can perform the work in accordance with the work content indicated by the instruction information.

[0131] As described above, the server device 200 of this embodiment includes the history information acquisition unit 210, the event information acquisition unit 212, the demand prediction unit 214, the display information generation unit 216, and the work information generation unit 218. Using the sales history information acquired by the history information acquisition unit 210 and the event information acquired by the event information acquisition unit 212, the demand prediction unit 214 generates a demand prediction for products at a specific date and time in the store 5. The display information generation unit 216 generates product display information using information indicating the demand prediction for the specific date and time. The work information generation unit 218 acquires information indicating the display status of the display shelves 80 at a time before the specific date and time. Furthermore, the work information generation unit 218 generates instruction information indicating work details for replacing and replenishing products using the display information at the specific date and time and the display information before the specific date and time. The robot instruction unit 208 then transmits the instruction information to the robot 100, causing it to perform a stocking task.

[0132] As described above, this embodiment not only produces the same effects as the above-described embodiment, but also makes it possible to predict demand using the store's past sales history information and event information for the area surrounding the store 5, and to generate stocking work instructions using display information created according to the prediction, and to have the robot 100 perform stocking work, thereby enabling the replacement and replenishment of products on the display shelves 80 in accordance with customer demand. This makes it possible to avoid missing sales opportunities for products and increase the average purchase price per customer.

[0133] Although the embodiments of the present invention have been described above with reference to the drawings, these are merely examples of the present invention, and various other configurations can also be adopted.

[0134] Other Embodiments Hereinafter, with reference to Figs. 24 and 25, a product replenishing operation in the case of a two-face display in which the same products 30 are displayed in two rows will be described.

[0135] First, the robot 100 pulls out one display tray 82a forward, thereby moving the products 30 to the front of the display tray 82a and creating a space for replenishing products behind the display tray 82a. The robot 100 also pushes out the other display tray 82b backward, thereby moving the products 30 to the rear of the display tray 82b.

[0136] Next, the robot 100 returns the display tray 82a and the display tray 82b to their original positions. Then, the robot 100 slides the products 30b on the display tray 82b into the space for replenishing products in the display tray 82b. The robot 100 removes the emptied display tray 82b from the display shelf 80. The removed display tray 82b is stored in the tray holder 112 of the robot 100. Then, the robot 100 places the transport tray 84, on which the replenishing products 30b are placed, next to the display tray 82a. This transport tray 84 is used as the display tray 82 as is.

[0137] 25, the products 30 on the display tray 82 and the transport tray 84 are then rotated a half turn. This movement can be achieved, for example, by the transport belt 70 of FIG. 9 (combined with the gear 64 of FIG. 7). The transport belt 70 moves when the gear 64 rotates due to the rotation of a motor (not shown) driven by power supplied from the robot 100. This allows the products 30 that remained on the display trays 82a and 82b before replenishment to be placed in front of the two trays, and the products 30 on the newly replenished transport tray 84 to be placed behind the two trays.

[0138] This configuration allows for efficient product replenishment even in the case of two-face display.

[0139] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-described embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.

[0140] In addition, although the flowcharts used in the above description show a sequence of steps (processes), the order of steps executed in each embodiment is not limited to the sequence shown in the flowcharts. In each embodiment, the order of steps shown in the diagrams can be changed as long as it does not cause any problems in terms of the content.

[0141] Some or all of the above embodiments may be described as in the following supplementary notes, but are not limited to them. 1. A display tray comprising: a tray main body that is movable at least one way forward and backward relative to a reference position; and a moving means that moves products placed on the tray main body forward. 2. A display tray as set forth in 1., comprising a movable member that moves as the tray main body moves, and the moving means moves the products forward using kinetic energy generated in the movable member. 3. A display tray as set forth in 2., wherein the movable member is a rotating member, and the moving means comprises a pushing member that pushes the products forward as the rotating member rotates. 4. A display tray as set forth in any one of 1. to 3., wherein the planar shape of the tray main body is a rectangle with short sides on the front and rear sides, and the tray main body has a side surface on at least one of the long sides of the rectangle. 5. 4. 6. The display tray described in any one of 1. to 5., further comprising a belt that comes into contact with the product and moves the product toward the front of the tray body, the belt being inclined with respect to the long sides so as to approach one of the long sides as it approaches the front. 6. The display tray described in any one of 1. to 5., further comprising a display tray that the planar shape of the tray body is a rectangle with short sides on the front and rear sides, and multiple tray bodies can be connected in the direction of the short sides.

[0142] 7. A product display device used with a display shelf having a display tray that can be pulled out forward, comprising: holding means for holding a transport tray on which products to be filled are placed; at least one movable unit capable of moving the products; and control means for controlling the movable unit, wherein when the products are to be refilled into the display tray, the control means controls the movable unit to move the display tray forward, bring the transport tray adjacent to the display tray, and move the products in the transport tray to the display tray. 8. A product display device described in 7., wherein the transport tray comprises a product moving unit that is part of the movable unit and moves the products to the display tray. 9. A product display device described in 8., wherein the product moving unit has a pushing member that pushes the products toward the display tray. 10. A product display device described in 9., wherein the pushing member is capable of moving a plurality of the products to the display tray simultaneously.11. A product display device according to any one of 7. to 10., comprising: current position acquisition means for acquiring current position information indicating the current position of the product display device; movement control means for controlling movement means for moving the product display device to move the product display device; and tray position acquisition means for capturing an image of the display shelf using an imaging means and processing the image of the display shelf generated by the imaging means to identify the position of the display tray and acquire position information of the display tray, wherein the movement control means, upon receiving an instruction indicating an operation content in which the transport tray to be stored in the holding means and information capable of identifying the display tray to be replenished with the products in the transport tray are associated, controls the movement means to move the product display device from the current position of the product display device to a position where the transport tray is located, and the control means, by controlling the movable part, causes the holding means to store the transport tray to be stored in the holding means indicated by the operation content, and the movement control means, by controlling the movement means, a product display device that moves the product display device in front of a display shelf including a display tray to be replenished with the products in the transport tray indicated by the work content, and the control means controls the movable part to perform the work of replenishing the display tray with the products in the transport tray in accordance with the work content. 12. A product display device as described in 11., which is moved in front of the display shelf by the movement control means and comprises a shortage quantity specifying means that specifies the shortage quantity of the products for each display tray specified by the tray position acquisition means by processing an image of the display shelf generated by the imaging means, and the work content is generated using the shortage quantity of the products for each display tray.

[0143] 13. A store management system comprising: a display tray; and a product display device that replenishes products onto the display tray, wherein the display tray comprises: a tray body that is movable at least one way forward and backward relative to a reference position; and moving means that moves products placed on the bottom surface of the tray body forward, wherein the product display device is used with a display shelf having the display tray that can be pulled out forward, and comprises: holding means that holds a transport tray on which the products to be filled are placed; at least one movable unit that can move the products; and control means that controls the movable unit, wherein when replenishing the products onto the display tray, the control means controls the movable unit to move the display tray forward, bring the transport tray adjacent to the display tray, and move the products in the transport tray to the display tray. The store management system described in the above further comprises a management device, wherein the management device comprises: display information acquisition means for acquiring display status information indicating the display status of the products on the display shelves in the store; work information generation means for generating work information for the product display device based on the display status information; and control means for instructing the product display device to perform display work based on the work information.15. In the store management system described in 14., the product display device comprises: a movement control means for controlling a movement means for moving the product display device to move the product display device; and a tray position acquisition means for capturing an image of the display shelf using an imaging means and processing the image of the display shelf generated by the imaging means to identify the position of the display tray and acquire position information of the display tray; in the product display device, the movement control means, upon receiving from the management device an instruction for the display work including work content that associates the transport tray to be stored in the holding means with information that can identify the display tray to be replenished with the products in the transport tray, controls the movement means to move the product display device to a position where the transport tray is located; and the control means, by controlling the movable part, causes the holding means to store the transport tray to be stored in the holding means indicated by the work content; and the movement control means, by controlling the movement means, A store management system that moves the product display device in front of a display shelf including a display tray to be replenished with the products in the transport tray indicated by the work content, and the control means controls the movable part to perform the display work of replenishing the display tray with the products in the transport tray in accordance with the work content. 16. A store management system in accordance with 15., wherein the product display device is moved in front of the display shelf by the movement control means, and includes a shortage number identification means that identifies the number of products that are missing for each display tray identified by the tray position acquisition means by processing an image of the display shelf generated by the imaging means, and the management device generates the work content using the shortage number of products for each display tray identified by the product display device. 17. A store management system in accordance with 14. to 16. In the store management system described in any one of the above, the display information acquisition means of the management device acquires the display status information indicating the display status of the products on the identified display shelf by processing an image of the display shelf generated by the imaging means of the product display device.18. A store management system according to any one of 14. to 17., comprising a plurality of the merchandise display devices, wherein the management device comprises: a current position acquisition means that acquires, from the plurality of merchandise display devices, current position information indicating the current positions of the merchandise display devices; and a work status acquisition means that acquires, from the plurality of merchandise display devices, information indicating the work status of the merchandise display devices, respectively; and in the management device, the work information generation means generates work information for the plurality of merchandise display devices for each of the merchandise display devices using the current position information indicating the current position of each of the merchandise display devices, the information indicating the work status of each of the merchandise display devices, and the display status information, each acquired from the plurality of merchandise display devices. 19. A store management system according to any one of 14. to 18., comprising: a current position acquisition means that acquires, from the plurality of merchandise display devices, current position information indicating the current position of each of the merchandise display devices, the information indicating the work status of each of the merchandise display devices, and the display status information, respectively acquired from the plurality of merchandise display devices. wherein the management device comprises: a sales history acquisition means for acquiring sales history information of the store; an event information acquisition means for acquiring event information related to events in the surrounding area of ​​the store; and a demand forecasting means for performing a demand forecast process using the sales history information and the event information to generate information indicating a demand forecast for each of the products; and wherein in the management device, the work information generation means generates work information for the product display devices using display information generated using the display status information and the information indicating the demand forecast for each of the products generated by the demand forecasting means.

[0144] 20. A control method for a product display device that replenishes products in a display tray having a tray main body that can move at least one of forward and backward relative to a reference position, and moving means that moves products placed on the bottom surface of the tray main body forward, wherein the product display device is used with a display shelf that has the display tray that can be pulled out forward, and has holding means that holds a transport tray on which the products to be filled are placed, and at least one movable unit that can move the products, and wherein one or more computers that realize the product display device, when replenishing the display tray with the products, control the movable unit to move the display tray forward, bring the transport tray adjacent to the display tray, and move the products in the transport tray to the display tray. 21. A control method for a product display device described in 20., wherein the transport tray includes a product moving unit that is part of the movable unit and moves the products to the display tray. 22. 21. 23. A control method for a product display device described in 22., wherein the product moving unit has a push-out member that pushes out the products toward the display tray. 22. A control method for a product display device described in 23., wherein the push-out member is capable of moving multiple products to the display tray simultaneously.24. From 20. to 23. a control method according to any one of the preceding claims, wherein the one or more computers: acquire current position information indicating a current position of the product display device; move the product display device by controlling a moving means for moving the product display device; capture an image of the display shelf using an imaging means and process the image of the display shelf generated by the imaging means to identify the position of the display tray and acquire position information of the display tray; when moving the product display device, upon receiving an instruction indicating an operation detail in which the transport tray to be stored in the holding means and information capable of identifying the display tray to be replenished with the products in the transport tray are associated, control the moving means to move the product display device from the current position of the product display device to a position where the transport tray is located; control the movable part to cause the holding means to store the transport tray to be stored in the holding means indicated by the operation detail; and control the moving means to move the product display device in front of the display shelf including the display tray to be replenished with the products in the transport tray indicated by the operation detail, A control method for a product display device, which controls the movable part to replenish the products in the transport tray to the display tray in accordance with the work content. 25. A control method for a product display device described in 24., wherein the one or more computers move the product display device in front of the display shelf and process images of the display shelf generated by the imaging means to identify the number of products that are missing for each identified display tray, and the work content is generated using the number of products that are missing for each display tray.

[0145] 26. A program for causing a computer controlling a movable part of a product display device used with a display shelf having a display tray that can be pulled out forward, the product display device comprising: holding means for holding a transport tray on which products to be filled are placed; and at least one movable part capable of moving the products, to execute, when replenishing the products in the display tray, a process of moving the display tray forward, a process of bringing the transport tray adjacent to the display tray, and a process of moving the products in the transport tray to the display tray. 27. A program in accordance with 26., wherein the transport tray comprises a product moving part that is part of the movable part and moves the products to the display tray. 28. A program in accordance with 27., wherein the product moving part has a pushing member that pushes the products toward the display tray. 29. A program in accordance with 28., wherein the pushing member is capable of moving a plurality of the products to the display tray simultaneously.30. 26. to 29. a program for causing the computer to execute a current position acquisition process for acquiring current position information indicating the current position of the product display device; a movement control process for moving the product display device by controlling a movement means for moving the product display device; and a tray position acquisition process for capturing an image of the display shelf using an imaging means and processing the image of the display shelf generated by the imaging means to identify the position of the display tray and acquire position information of the display tray, wherein in the movement control process, upon receiving an instruction indicating an operation content in which the transport tray to be stored in the holding means and information capable of identifying the display tray to be replenished with the products in the transport tray are associated, the computer controls the movement means to move the product display device from the current position of the product display device to a position where the transport tray is located, and controls the movable part to cause the holding means to store the transport tray to be stored in the holding means indicated by the operation content, wherein in the movement control process, the computer controls the movement means to 31. A program that causes a computer to execute a process of moving a product display device in front of a display shelf including a display tray to be replenished with the products in the transport tray indicated by the work content, and controlling the movable unit to replenish the display tray with the products in the transport tray in accordance with the work content. 32. A program according to 30., wherein the movement control process causes the computer to execute a shortage quantity identification process that identifies the number of products that are missing for each display tray identified in the tray position acquisition process by moving the product display device in front of the display shelf and processing an image of the display shelf generated by the imaging means, and the work content is generated using the shortage quantity of the products for each display tray.

[0146] 32. A computer-readable recording medium storing a program to cause a computer controlling a movable part of a product display device used with a display shelf having a display tray that can be pulled out forward, the product display device comprising: holding means for holding a transport tray on which products to be filled are placed; and at least one movable part capable of moving the products, to execute, when replenishing the display tray with products, a process of moving the display tray forward, a process of bringing the transport tray adjacent to the display tray, and a process of moving the products in the transport tray to the display tray. 33. A computer-readable recording medium storing a program in the recording medium described in 32., wherein the transport tray is part of the movable part and includes a product moving part that moves the products to the display tray. 34. A computer-readable recording medium storing a program in the recording medium described in 33., wherein the product moving part has a pushing member that pushes the products toward the display tray. 35. 34. 2. The computer-readable recording medium storing a program, wherein the pushing member is capable of simultaneously moving a plurality of the products onto the display tray.36. 32. to 35. a current position acquisition process for acquiring current position information indicating the current position of the product display device; a movement control process for moving the product display device by controlling a movement means for moving the product display device; and a tray position acquisition process for capturing an image of the display shelf using an imaging means and processing the image of the display shelf generated by the imaging means to identify the position of the display tray and acquire position information of the display tray, wherein in the movement control process, upon receiving an instruction indicating an operation content in which the transport tray to be stored in the holding means and information capable of identifying the display tray to be replenished with the products in the transport tray are associated, the movement means is controlled to move the product display device from the current position of the product display device to a position where the transport tray is located, and the movable part is controlled to cause the holding means to store the transport tray to be stored in the holding means indicated by the operation content, wherein in the movement control process, by controlling the movement means, A computer-readable recording medium storing a program that causes a computer to execute a process of moving the product display device in front of a display shelf including the display tray to be replenished with the products in the transport tray indicated by the work content, and controlling the movable unit to replenish the display tray with the products in the transport tray in accordance with the work content. 37. A recording medium described in 36., wherein the movement control process causes the computer to execute a shortage quantity identification process that identifies the number of products that are lacking for each display tray identified in the tray position acquisition process by moving the product display device in front of the display shelf and processing an image of the display shelf generated by the imaging means, and the work content is generated using the shortage number of products for each display tray.

[0147] This application claims priority based on Japanese Patent Application No. 2023-105957, filed on June 28, 2023, the disclosure of which is incorporated herein by reference in its entirety.

[0148] 1 store management system 3 communication network 5 store 7 backyard 10 tray 12 tray body 14 bottom surface 16 side surface 18 side surface 20 moving mechanism 22 push plate 24 convex portion 30, 30a, 30b, 30c product 32 packaging 42 rotating shaft 44 first rack 45 second rack 46 pinion 48 gear 52 guide 54 belt 60 tire 62 rotating shaft 64 gear 66 belt 70 moving belt 72 moving member (product moving part) 80 display shelf 81 shelf board 82, 82a, 82b, 82c display tray 84 transport tray 86 two-dimensional code 88 label 90 image 100 product display device (robot) 102 camera 104 arm 106 Robot support 110 Transport tray 112 Tray holder 120 Movement mechanism 130 Control device 132 Movement control unit 134 Tray position acquisition unit 136 Deficiency number acquisition unit 138 Tray control unit 140 Product replenishment unit 200 Server device 202 Robot position information acquisition unit 204 Display shelf information acquisition unit 206 Robot work information acquisition unit 208 Robot instruction unit 210 History information acquisition unit 212 Event information acquisition unit 214 Demand forecasting unit 216 Display information generation unit 218 Work information generation unit 220 Storage device 230 Robot information 240 Display shelf inventory management information 1000 Computer 1010 Bus 1020 Processor 1030 Memory 1040 Storage device 1050 Input / output interface 1060 Network interface

Claims

1. A tray body that is movable to at least one of the forward and backward positions relative to a reference position, A means for moving the product placed on the tray body forward, A display tray equipped with [a specific feature / feature].

2. In the display tray according to claim 1, The tray body is equipped with a movable member that moves as the tray body moves, The aforementioned moving means is a display tray that moves the product forward using the kinetic energy generated in the movable member.

3. In the display tray according to claim 1 or 2, The planar shape of the tray body is a rectangle with the front and rear sides being the shorter sides. Multiple tray bodies can be connected in the direction of the shorter side. The tray is equipped with a belt that contacts the product and moves the product toward the front of the tray body, A display tray in which the belt is inclined with respect to its long side such that it approaches one of the long sides as it approaches the front.

4. In the display tray according to claim 2, The aforementioned movable member is a rotating member, The moving means is a display tray comprising an extrusion member that pushes the product forward as the rotating member rotates.

5. Used with display shelves that have a display tray that can be pulled out from the front, A holding means for holding a transport tray on which products for filling are loaded, The product is capable of being moved by at least one movable part, Control means for controlling the movable part, Equipped with, The control means controls the movable part when replenishing the product in the display tray, Move the aforementioned display tray forward, The transport tray is placed adjacent to the display tray. A product display device that moves the products in the transport tray to the display tray.

6. In the product display device according to claim 5, A product display device in which the transport tray is part of the movable part and includes a product moving part that moves the products to the display tray.

7. In the product display device according to claim 5 or 6, A current location acquisition means that acquires current location information indicating the current location of the product display device, A movement control means for moving the product display device is provided, The system includes a tray position acquisition means that uses an imaging means to image the display shelf, processes the image of the display shelf generated by the imaging means to identify the position of the display tray, and acquires position information of the display tray, The aforementioned movement control means is When an instruction is received indicating a work procedure that associates the transport tray to be housed in the holding means with information that identifies the display tray to be replenished with the products in the transport tray, the moving means is controlled to move the product display device from its current position to the position where the transport tray is located. The control means controls the movable part, The holding means is used to house the transport tray that is to be housed in the holding means as indicated by the work content. The movement control means controls the movement means, The product display device is moved in front of the display shelf containing the display tray to which the products in the transport tray indicated in the above work procedure should be replenished. The control means controls the movable part, A product display device that performs the operation of replenishing the products in the transport tray into the display tray in accordance with the above-mentioned work procedures.

8. Display trays and The device includes a product display device for replenishing products in the aforementioned display trays, The aforementioned display tray is A tray body that is movable to at least one of the forward and backward positions relative to a reference position, A means for moving the product placed on the bottom surface of the tray body forward, Equipped with, The aforementioned product display device is Used in conjunction with a display shelf having the display tray that can be pulled out forward, A holding means for holding a transport tray on which the product for filling is placed, The product is capable of being moved by at least one movable part, Control means for controlling the movable part, Equipped with, The control means controls the movable part when replenishing the product in the display tray, Move the aforementioned display tray forward, The transport tray is placed adjacent to the display tray. A store management system that moves the products in the transport tray to the display tray.

9. A tray body that is movable to at least one of the forward and backward positions relative to a reference position, A means for moving the product placed on the bottom surface of the tray body forward, A method for controlling a product display device that replenishes products in a display tray having the following: The aforementioned product display device is Used in conjunction with a display shelf having the display tray that can be pulled out forward, A holding means for holding a transport tray on which the product for filling is placed, It has at least one movable part that makes it possible to move the aforementioned product, One or more computers that realize the aforementioned product display device, When replenishing the aforementioned products into the display tray, the movable part is controlled as follows: Move the aforementioned display tray forward, The transport tray is placed adjacent to the display tray. A control method for moving the products in the transport tray to the display tray.

10. Used with display shelves that have a display tray that can be pulled out from the front, A holding means for holding a transport tray on which products for filling are loaded, A computer controlling the movable part of a product display device, which includes at least one movable part capable of moving the aforementioned product, When replenishing the aforementioned products into the display tray, A process of moving the aforementioned display tray forward, The process of placing the transport tray adjacent to the display tray, A program for causing the process of moving the products in the transport tray to the display tray.