Information processing device, information processing system, information processing method, and program

Abstract

An information processing device according to the present disclosure includes: a display information acquisition means for acquiring display information indicating a display state of commodities on a commodity shelf; a shortage commodity identification means for identifying a shortage commodity on the basis of the display information; a needs information acquisition means for acquiring, from a customer terminal used by a customer, needs information indicating a desired commodity desired by the customer; a priority determination means for determining a priority of replenishment of the shortage commodity on the basis of the needs information; and a list creation means for creating list information indicating a replenishment order of the shortage commodity according to the priority.

Description

Information processing device, information processing system, information processing method and program

[0001] The present disclosure relates to an information processing device, an information processing system, an information processing method, and a program.

[0002] Patent Document 1 discloses a system that allows store employees to easily grasp shortages of products on display in a store. The display status notification system described in Patent Document 1 acquires information indicating the display status of the fixtures on which products are displayed from a terminal used by a customer, identifies products that are in short supply based on the information indicating the display status, and notifies a terminal used by an employee that the identified products are in short supply on the fixtures.

[0003] JP 2023-115988 A

[0004] In stores such as supermarkets, there are cases where shortages of products are replenished on shelves at set times. As a result, situations can arise where multiple products are missing from the shelves. When there are shortages (out-of-stock) of products on display in the sales area, customers' purchasing motivation decreases, sales opportunities for the products are lost, and there is a risk of a decrease in sales. It is desirable for employees to recognize which of the multiple products that are missing should be replenished first, thereby improving the efficiency of stocking work.

[0005] In view of the above-mentioned problems, the object of the present disclosure is to provide an information processing device, an information processing system, an information processing method, and a program that can improve the efficiency of the work performed by employees when replenishing shelves with missing products.

[0006] The information processing device according to the present disclosure includes a display information acquisition means for acquiring display information indicating the display status of products on product shelves, a missing product identification means for identifying missing products based on the display information, a needs information acquisition means for acquiring needs information indicating desired products desired by a customer from a customer terminal used by the customer, a priority determination means for determining the priority for replenishing the missing products based on the needs information, and a list creation means for creating list information indicating the order in which the missing products are to be replenished in accordance with the priority.

[0007] The information processing system according to the present disclosure includes a display information acquisition means for acquiring display information indicating the display status of products on product shelves, a missing product identification means for identifying missing products based on the display information, a needs information acquisition means for acquiring needs information indicating products desired by a customer from a customer terminal used by the customer, a priority determination means for determining the priority for replenishing the missing products based on the needs information, and a list creation means for creating list information indicating the order in which the missing products are to be replenished in accordance with the priority.

[0008] The information processing method disclosed herein executes the following processes: a process in which a computer acquires display information indicating the display status of products on a product shelf; a process in which a missing product is identified based on the display information; a process in which needs information indicating the products desired by the customer is acquired from a customer terminal used by the customer; a process in which a priority for replenishing the missing products is determined based on the needs information; and a process in which list information indicating the order in which the missing products will be replenished according to the priority.

[0009] The program disclosed herein causes a computer to perform the following processes: acquiring display information indicating the display status of products on product shelves; identifying missing products based on the display information; acquiring needs information indicating products desired by a customer from a customer terminal used by the customer; determining a priority for replenishing the missing products based on the needs information; and creating list information indicating the order in which the missing products will be replenished in accordance with the priority.

[0010] The present disclosure can improve the efficiency of the work performed by employees when replenishing shelves with products that are in short supply.

[0011] 4 is a diagram showing a configuration of an information processing device according to the present disclosure. FIG. 5 is a flowchart of an information processing method according to the present disclosure. FIG. 6 is a block diagram showing a configuration of an information processing system according to the present disclosure. FIG. 7 is a block diagram showing the overall configuration of an information processing system according to the present disclosure. FIG. 8 is a diagram showing an example of a store to which the information processing system of the present disclosure is applied. FIG. 9 is a block diagram showing the configuration of an employee terminal of FIG. 4. FIG. 10 is a block diagram showing the configuration of a customer terminal of FIG. 4. FIG. 11 is a block diagram showing the configuration of a server of FIG. 12. FIG. 13 is a diagram showing an example of a picking list. FIG. 14 is a diagram explaining the priority of product shelves. FIG. 15 is a diagram explaining an example of creating list information including a replenishment order of missing products taking priority into consideration from a picking list. FIG. 16 is a diagram showing the flow of an information processing method according to the present disclosure.

[0012] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In each drawing, the same or corresponding elements are designated by the same reference numerals, and for clarity of explanation, duplicate explanations will be omitted as necessary.

[0013] Stores such as supermarkets and convenience stores have multiple shelves installed inside. Each shelf has multiple shelves arranged vertically for arranging products. However, a shelf is not limited to one with multiple shelves. A shelf can be any place where products are displayed. For example, when products are stacked flat on a cart, the cart can be treated as a shelf.

[0014] The allocation of products to shelves (planogram) when displaying products on shelves is an important factor that stimulates customer purchasing desire and influences product sales. Planograms predetermine how products should be displayed on shelves (display position, number of displays, number of faces, etc.). The number of faces indicates how many rows of products are lined up on a shelf. Planograms may be changed depending on sales and the season. Products are displayed on each shelf according to the predetermining planogram.

[0015] When there are insufficient products on display (out-of-stock), customers' purchasing motivation decreases, sales opportunities are lost, and sales may decrease. For this reason, employees must monitor the shelves to check the product display status and, if there are shortages, quickly replenish the products. Related technology includes a DX (digital transformation) platform that provides a "fixed-point shelf observation service" that detects the product occupancy rate on shelves from images taken by a camera and notifies employees when the occupancy rate falls below a pre-set threshold.

[0016] The "Fixed Shelf Monitoring Service" has a function to create a "picking list" that displays a list of products that are running low compared to the number of products allocated to a shelf, allowing employees to easily check at a glance which products they should stock. The picking list also shows the filling rate of products that are in short supply on the shelf. Here, "filling rate" refers to the ratio of the actual number of products remaining on the shelf to the standard number of products allocated to the shelf.

[0017] Employees can perform stocking work to replenish missing items based on a picking list. However, when multiple items are missing, it is difficult for employees to determine which items should be replenished first. In order to reduce the loss of product sales opportunities, it is necessary to understand customer needs and determine the order in which missing items should be replenished. Therefore, the embodiments relate to a technology that can understand customer needs and determine the priority for replenishment of missing items listed on a picking list.

[0018] Embodiment 1. An example configuration of an information processing device 1 will be described with reference to FIG. 1. FIG. 1 is a diagram illustrating the configuration of the information processing device 1 according to the present disclosure. As shown in FIG. 1, the information processing device 1 includes a display information acquisition unit 2, a shortage product identification unit 3, a needs information acquisition unit 4, a priority determination unit 5, and a list creation unit 6. The information processing device 1 can perform various communications with external devices via a network. Specifically, the information processing device 1 can be connected to an employee terminal carried by an employee via a communication line such as the Internet. However, the communication line is not limited to the Internet, and may be a combination of the Internet and another communication line, or may be a communication line other than the Internet. Examples of communication methods that can be used include wireless communication or wired communication, such as 4G (Generation 1), 5G, local 5G, Wi-Fi (registered trademark), and LTE (Long Term Evolution). Note that the communication method is not limited to these examples.

[0019] The display information acquisition unit 2 acquires display information indicating the display status of products on product shelves. The display information may be, for example, an image of the product shelf (hereinafter referred to as a "shelf image") transmitted from an imaging device installed in a position where it can capture an image of the product shelf on which the products are displayed. The missing product identification unit 3 identifies missing products based on the display information.

[0020] For example, the missing product identifying unit 3 can identify missing products by comparing actual display information obtained by image analysis of shelf images with reference display information that indicates the display standards for products on the shelf. The reference display information indicates information regarding the position and number of products on the shelf, etc., as determined by the above-mentioned shelf allocation. The missing product identifying unit 3 can, for example, detect the filling rate of products on the shelf and identify products whose filling rate is below a preset threshold as missing products.

[0021] The missing product identifying unit 3 may identify missing products not only based on shelf images, but also by any other method. For example, the missing product identifying unit 3 may identify missing products based on the detection results of a pressure sensor or weight sensor attached to the product shelf. The missing product identifying unit 3 may also identify missing products by using transmission signals from wireless tags attached to the products to identify products that have been physically moved.

[0022] The needs information acquisition unit 4 acquires needs information indicating the desired products desired by the customer from the customer terminal used by the customer. For example, when the desired product is in short supply on the shelves, the customer operates the customer terminal to send the needs information. A shortage of products includes when the desired product is out of stock on the shelves and when the number of desired products on display is less than the number the customer wants to purchase. Popular products tend to run out of stock, and customers may not be able to purchase them when they want. Even when the desired product is sufficiently displayed on the shelves, the customer may send needs information to prevent the desired product from running out of stock.

[0023] The needs information may be, for example, a product image of a product desired by a customer or a shelf image of a product shelf on which the product is placed. The needs information may also be identification information for identifying the product desired by a customer. The product identification information may be obtained from an identifier such as a barcode attached to the product or the product shelf on which the product is displayed. The needs information may also be information about the product, such as the product name of the desired product, transmitted from the customer terminal.

[0024] The priority determination unit 5 determines the priority for replenishing missing items based on the needs information. Then, the list creation unit 6 creates list information indicating the order in which missing items will be replenished according to the priority. The created list is output to, for example, an employee terminal used by an employee. The employee can then replenish the missing items in the order shown in the created list. This makes it possible to prioritize stocking missing items that customers want to purchase.

[0025] Next, the processing performed by the information processing device 1 will be described with reference to Fig. 2. Fig. 2 is a flowchart of an information processing method according to the present disclosure. First, the information processing device 1 acquires display information indicating the display status of products on product shelves (S11). Then, the information processing device 1 identifies missing products based on the display information (S12).

[0026] Next, the information processing device 1 acquires needs information indicating the products desired by the customer from the customer terminal used by the customer (S13). The information processing device 1 then determines the priority for replenishing the missing products based on the needs information (S14). The information processing device 1 then creates list information indicating the order in which the missing products will be replenished according to the priority. In this way, the information processing device 1 allows employees to prioritize stocking the missing products desired by customers according to the replenishment order indicated by the list information, thereby improving employee work efficiency. It also makes it possible to reduce loss of product sales opportunities and increase sales.

[0027] The information processing device 1 includes a processor, a memory, and a storage device (not shown). The storage device stores a program that causes a computer to execute each process of the management method according to the first embodiment. The processor loads the program from the storage device into the memory and executes the program. As a result, the processor realizes the functions of a display information acquisition unit 2, a shortage product identification unit 3, a needs information acquisition unit 4, a priority order determination unit 5, and a list creation unit 6.

[0028] Each component of the information processing device 1 may be realized by dedicated hardware. Furthermore, some or all of the components of each device may be realized by general-purpose or wired circuits, processors, etc., or a combination of these. These may be configured by a single chip, or by multiple chips connected via a bus. Some or all of the components of each device may be realized by a combination of the above-mentioned circuits, etc., and programs. Furthermore, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an FPGA (Field-Programmable Gate Array), a quantum processor (quantum computer control chip), etc. may be used as the processor.

[0029] Furthermore, when some or all of the components of the information processing device 1 are realized by multiple devices, circuits, etc., the multiple devices, circuits, etc. may be centrally or decentralized. FIG. 3 is a block diagram showing the configuration of an information processing system 101 according to the present disclosure. As shown in FIG. 3, the information processing system 101 includes a display information acquisition unit 102, a shortage product identification unit 103, a needs information acquisition unit 104, a priority determination unit 105, and a list creation unit 106. As described above, the detailed operation of each component of the information processing system 101 corresponds to the operation of each component of the information processing device 1. The devices, circuits, etc. realizing the components of FIG. 3 may be realized as a client-server system, a cloud computing system, or the like, connected via a communication network. Furthermore, the functions of the information processing device 1 may be provided in a SaaS (Software as a Service) format.

[0030] Embodiment 2. Fig. 4 is a block diagram showing the overall configuration of an information processing system 100 according to the present disclosure. The information processing system 100 includes a server 10, an employee terminal 20, a camera 30, and a customer terminal 40. The server 10, the employee terminal 20, the camera 30, and the customer terminal 40 are each connected via a network N. Here, the network N is a wired or wireless communication line, for example, the Internet.

[0031] 5 is a diagram showing an example of a store to which the information processing system 100 is applied. Here, an example will be described in which missing products are identified based on shelf images captured by a camera 30 installed in a store 50. The technology for identifying missing products based on shelf images can employ existing image analysis technology.

[0032] As shown in Figure 5, a store 50 is roughly divided into a sales floor and a back yard. A plurality of product shelves 51 are installed in the sales floor. Each of the plurality of product shelves 51 has a plurality of shelf boards 52 arranged vertically for arranging products. A camera 30 is installed so as to be able to photograph all of the products displayed on the product shelves 51. The camera 30 is an imaging device that can take photographs and generate shelf images.

[0033] Note that multiple cameras 30 may be placed in different positions within the store 50 so as to capture images of multiple product shelves 51, respectively. Also, the shooting direction of one camera may be changed at predetermined time intervals to capture images of multiple product shelves, respectively. Also, the camera 30 may capture images of one product shelf 51 by dividing it into multiple areas. In other words, the entire product shelf 51 may be captured using multiple shelf images. The camera 30 may be a surveillance camera, or may be a camera installed in a smartphone, tablet terminal, or the like.

[0034] The employee manages the product shelves while carrying the employee terminal 20. For example, the employee displays products on the product shelves 51 according to a predetermined shelf allocation. As an example, if there is a shortage or out-of-stock of products displayed on the product shelves 51, the employee performs stocking work by bringing new products from the back room where the product inventory is kept and replenishing the products on the product shelves 51.

[0035] The information processing system 100 acquires needs information indicating products that customers like or want and uses it to understand customer needs. The information processing system 100 can improve the efficiency of employee work by linking customer needs to the stocking work performed by employees. Employees can recognize the order in which missing products should be replenished on the shelves 51 via employee terminals 20.

[0036] <Employee terminal 20> The employee terminal 20 is an information terminal used by an employee and transmits and receives data to the server 10 via the network N by wireless communication. The employee terminal 20 is, for example, a smartphone or tablet, and outputs information about missing items to the employee. Figure 6 is a block diagram showing the configuration of the employee terminal 20 in Figure 4.

[0037] The employee terminal 20 includes a storage unit 42, a memory 43, a communication unit 44, an input / output unit 45, and a processing unit 46. The storage unit 42 is an example of a storage device that includes a non-volatile memory such as a flash memory or an SSD (Solid State Drive). The storage unit 42 stores a program that implements processes including a process for displaying list information output from the server 10 that indicates the order in which missing products will be replenished.

[0038] The memory 43 is a volatile storage device such as a RAM (Random Access Memory), and is a storage area for temporarily storing information when the processing unit 46 is operating. The communication unit 44 is a communication interface with the network N. The communication unit 44 may establish a short-range wireless communication connection and perform communication. Various standards such as Bluetooth (registered trademark), BLE (Bluetooth Low Energy), and UWB (Ultra-Wide Band) can be applied to the short-range wireless communication.

[0039] The input / output unit 45 may include a display device such as a screen, and an input device such as a keyboard. The input / output unit 45 may also be a touch panel in which the display device and input device are integrated. The display device can display information regarding the replenishment order of missing items in the store 50, for example, based on list information received from the server 10. Employees can recognize the replenishment order of missing items by visually checking the image displayed on the display device.

[0040] The method of presenting the list information to the employee is not limited to a visual method such as displaying it on a display device, but may also be presented by, for example, vibration, voice, warning sound, etc. Therefore, the input / output unit 45 may include a speaker, a vibrator, etc.

[0041] Furthermore, the employee can use the input device to input information about the work they have performed on the target product shelf, as needed. For example, when the employee has completed replenishing a missing product, the employee can input replenishing completion information indicating that the work has been completed. For example, a check box for inputting whether the work has been completed may be displayed on the touch panel screen of the employee terminal 20.

[0042] It is also possible to determine whether the replenishment work is complete based on whether the products have been displayed on the shelf in accordance with the shelf allocation, for example, using images taken by a camera that photographs the product shelf or detection results from a pressure sensor or the like attached to the shelf board 52. This makes it possible to reduce redundant stocking work by employees other than the employee who performed the work.

[0043] The processing unit 46 is a processor that controls the hardware of the employee terminal 20. The processing unit 46 loads a program from the storage unit 42 into the memory 43 and executes it. As a result, the processing unit 46 realizes the functions of a transmission / reception processing unit 461 and a notification processing unit 462. The transmission / reception processing unit 461 receives list information from the server 10.

[0044] The notification processing unit 462 notifies the employee of information indicating the replenishment order of the missing items using a predetermined notification method based on the list information. For example, the notification processing unit 462 can display a screen generated by executing a program on the input / output unit 45. For example, the notification processing unit 462 can display the replenishment order of the missing items and the positions of the shelves on which the missing items are displayed.

[0045] <Customer Terminal 40> The customer terminal 40 is an information terminal used by a customer and transmits and receives data to and from the server 10 via the network N by wireless communication. The customer terminal 40 is, for example, a smartphone or a tablet, and outputs needs information indicating products desired by the customer. Figure 7 is a block diagram showing the configuration of the customer terminal 40 in Figure 4.

[0046] The customer terminal 40 includes a needs information generation unit 41, a storage unit 42, a memory 43, a communication unit 44, an input / output unit 45, and a processing unit 46. The needs information generation unit 41 generates needs information indicating desired products desired by a customer. The needs information generation unit 41 is, for example, a photographing device. The needs information generation unit 41 can generate, as needs information, product images of the products desired by the customer or shelf images of the product shelves on which the products are placed. Customers can upload their own needs information to the server 10.

[0047] The needs information generation unit 41 may be, for example, a known code reader. The needs information generation unit 41 can obtain identification information for identifying a product by reading an identifier attached to the product or a product shelf. It is also possible to take an image of the identifier using a photographing device and read the identifier through image recognition. It is also possible for a customer to input needs information using an input device, which will be described later. For example, the customer can input the product name of the desired product.

[0048] Customers can upload needs information about their favorite products and products they want to the server 10, regardless of whether there is a shortage of products on the product shelves 51. When uploading needs information to the server 10, customers may also add reason information. "Reason information" is information that indicates the reason why the customer has sent needs information. Reason information may include, for example, the following: (1) I want the product now (2) It is often out of stock, so I hope this will be improved (3) I hope there will be more product varieties (4) I want to know about sales information

[0049] The "product type" in (3) above may include products not available in the store or other types of the same series. The server 10, which will be described later, can also sort the uploaded needs information based on the reason information. This makes it easier for customer requests to be directly conveyed to the store.

[0050] The storage unit 42 is an example of a storage device that includes a non-volatile memory such as a flash memory or an SSD (Solid State Drive). The storage unit 42 stores a program that implements processes including a process for acquiring needs information and transmitting it to the server 10. The memory 43 is a storage area such as a RAM for temporarily storing information when the processing unit 46 is operating. The communication unit 44 is a communication interface with the network N.

[0051] The input / output unit 45 is, for example, a touch panel that combines a display device and an input device. The display device can display, for example, replenishment information received from the server 10, indicating that a missing item has been replenished. By visually checking the notification displayed on the display device, the customer can recognize that the missing item is now available for purchase. Note that the method of presenting the replenishment information to the customer is not limited to visual methods, and may also be presented by, for example, vibration or sound.

[0052] The processing unit 46 is a processor that controls the hardware of the customer terminal 40. The processing unit 46 loads a program from the storage unit 42 into the memory 43 and executes it. As a result, the processing unit 46 realizes the functions of a transmission / reception processing unit 461 and a notification processing unit 462. The transmission / reception processing unit 461 receives replenishment information from the server 10.

[0053] The notification processing unit 462 notifies the customer that the replenishment of the missing item has been completed using a predetermined notification method based on the received request for notification of the replenishment completion. For example, the notification processing unit 462 can display a screen generated by executing a program on the input / output unit 45.

[0054] The transmission / reception processing unit 461 may receive not only information indicating the completion of replenishment of a missing product, but also other information such as sale information and campaign information related to the product for which the needs information has been uploaded. The notification processing unit 462 can notify the customer of this sale information, campaign information, etc. by any method. The notification processing unit 462 may change the notification method depending on the type of information, such as replenishment information or sale information.

[0055] <Server 10> The server 10 is an information processing device that realizes a function of identifying missing items and a function of determining the order in which missing items are replenished. The server 10 may be composed of multiple servers, and each functional block may be realized by multiple computers. Fig. 8 is a block diagram showing the configuration of the server 10 in Fig. 4. As shown in Fig. 8, the server 10 includes a storage unit 11, a memory 12, a communication unit 13, and a processing unit 14.

[0056] The memory unit 11 is an example of a storage device such as a hard disk or flash memory. The memory unit 11 stores a program 111 and an information DB 112. The program 111 is a computer program that implements a function for identifying missing items and a function for determining the order in which missing items will be replenished. The information DB 112 is a database that manages various information related to items. The information DB 112 stores, for example, reference display information for comparison with actual display information acquired from shelf images. The reference display information may be, for example, identification information such as the product name and JAN (Japanese Article Number) code of each item displayed on the product shelf 51, position information of each item on the product shelf 51, the number of faces, the number of items displayed, etc.

[0057] The memory 12 is a volatile storage device such as RAM, and is a storage area for temporarily storing information when the processing unit 14 is operating. The communication unit 13 is a communication interface with the network N. The processing unit 14 is a processor that controls each component of the server 10. The processing unit 14 loads a program 111 from the storage unit 11 into the memory 12 and executes the program 111. As a result, the processing unit 14 realizes the functions of a display information acquisition unit 141, a filling rate calculation unit 142, a missing product identification unit 143, a needs information acquisition unit 144, a priority order determination unit 145, a list creation unit 146, a transmission processing unit 147, an inventory management unit 148, and a notification processing unit 149.

[0058] The display information acquisition unit 141 acquires shelf images captured by the camera 30 of shelves on which products are displayed. The filling rate calculation unit 142 extracts image areas representing each product from the shelf image, for example by performing known image analysis, and generates actual display information. The filling rate calculation unit 142 then compares the actual display information with reference display information based on the shelf allocation, and can calculate the filling rate of products on the product shelves. The filling rate calculation unit 142 can calculate the ratio of the number of products displayed in the actual display information to the number of products displayed in the reference display information as the filling rate.

[0059] The missing product identifying unit 143 identifies missing products based on the filling rate. An arbitrary threshold value is set in advance in the missing product identifying unit 143. When a product has a filling rate below the threshold, new products must be brought from the back room where inventory is kept and replenished on the product shelves 51. The missing product identifying unit 143 can set a product whose filling rate is below the threshold as a missing product. The threshold value may be the same for multiple products, or may be different for each product.

[0060] The needs information acquisition unit 144 acquires needs information from the customer terminal 40 to identify products desired by the customer. As described above, the needs information may include reason information. The priority determination unit 145 determines the priority of products to be replenished from among the products in short supply identified by monitoring the product shelves 51, based on the needs information.

[0061] The priority determination unit 145 can calculate a needs score for each missing product based on the needs information and determine the priority based on the needs score. A "needs score" is an index that indicates the degree to which a customer desires a product. For example, the number of pieces of needs information uploaded to the server 10 can be used as the needs score. Note that the needs score may be calculated taking into account not only the number of pieces of needs information but also the above-mentioned reason information. For example, if reason information such as "(1) I want the product now" is added to the needs information, the need score can be higher than other reason information.

[0062] The list creation unit 146 creates list information indicating the order in which missing items will be replenished according to priority. The replenishment order can be, for example, from highest to lowest needs score. The transmission processing unit 147 transmits a list (picking list) regarding the replenishment of missing items to the employee terminal 20. Figures 9 and 10 are diagrams showing examples of picking lists displayed on the employee terminal 20. The display screen T0 includes a threshold selection button T1, a filter selection button T2, a time selection button T3, and a picking list L1.

[0063] An employee can select and set any threshold value using the threshold value selection button T1. In the example shown in FIG. 9, the threshold value T1 is set to 40%. A picking list L1 is generated, listing products whose fill rate is 40% or less as missing products. The picking list L1 shows, for example, the product names of the missing products.

[0064] The filter selection button T2 is a button for selecting a filter for sorting the picking list L1. Filters may include, for example, "fill rate," "category," "shelf location," and "product needs." An employee can select at least one of these filters. FIG. 9 shows the "fill rate" filter selected.

[0065] The employee can change the filter by operating the filter selection button T2. ​​"Category" refers to a broad range of product classifications, such as food, beverages, hygiene products, and medicines. Note that "subcategories" may be provided that further classify the food category into "bread," "dairy products," and the like. "Shelf location" refers to the location of the product shelf 51 on which the product is displayed. When the "Category" or "Shelf location" filter is selected, only the missing products in the selected category or product shelf 51 are extracted from the missing products identified by the missing product identification unit 143.

[0066] When the "product needs" filter is selected, as shown in FIG. 10, a list showing the order in which missing products will be replenished is displayed in accordance with the priority of the products to be replenished by combining customer needs information with the detection of missing products. In other words, from all the missing products identified by the missing product identification unit 143, products that are requested by customers can be displayed preferentially. In FIG. 10, the missing products are displayed in descending order of need score. Employees can replenish the missing products in this order.

[0067] Any combination of multiple filters may be selected. For example, an employee may select a combination of "needs" and "fill rate" as a filter. In this case, the priority determination unit 145 may determine the priority for replenishing the missing items by taking into account the fill rate of the missing items in addition to the needs information. For example, when the needs information for items P1 and P2 is equal, the priority determination unit 145 may assign a higher priority for replenishing the missing item with a lower fill rate than the missing item with a higher fill rate.

[0068] The time selection button T3 is a button that allows the user to specify any time. The current time is selected in the initial state, and the picking list L1 for the current time is displayed on the display screen T0. For example, if a system is in place to replenish shelves with products that are in short supply at a specific time, an employee can operate the time selection button T3 to select the time at which the replenishment work will be performed, thereby displaying the order in which the missing products will be replenished when the employee performs the replenishment work.

[0069] The list creation unit 146 can also create an optimal stocking work plan that takes into account the number of employees to be assigned to stocking work during that time period, the locations of the product shelves 51 within the store, the location of the back room, etc. Based on the stocking work plan, the server 10 can also send list information indicating the order in which the missing products for which each employee is responsible will be replenished to the employee terminals 20 carried by each employee.

[0070] When a plurality of product shelves 51 are installed in a store, the priority determination unit 145 may tally up the needs scores of the products in short supply for each product shelf 51 and determine the priority of the product shelf 51 based on the needs score tally. In this case, the list creation unit 146 can create list information including the replenishment order taking the priority into consideration.

[0071] FIG. 11 is a diagram illustrating the priority of product shelves 51. In FIG. 11, the product shelf 51 on the left side is called product shelf S1, and the product shelf 51 on the right side is called product shelf S2. It is assumed that both product shelves S1 and S2 have three shelves 52. Each of the three shelves 52 on product shelves S1 and S2 serves as a product placement area. The product placement areas on product shelf S1 are area 1-1, area 1-2, and area 1-3 from the bottom. The product placement areas on product shelf S2 are area 2-1, area 2-2, and area 2-3 from the bottom. It is assumed that all products on both product shelves S1 and S2 are out of stock.

[0072] The needs scores of the products displayed in areas 1-1, 1-2, and 1-3 are assumed to be 2 pt, 0, and 3 pt, respectively. Furthermore, the needs scores of the products displayed in areas 2-1, 2-2, and 2-3 are assumed to be 5 pt, 4 pt, and 1 pt, respectively. The needs score aggregate value obtained by aggregating the needs scores of the products in short supply is 5 pt for product shelf S1 and 10 pt for product shelf S2. In this case, product shelf S2 has a higher priority than product shelf S1.

[0073] 12 is a diagram illustrating an example of creating list information including a replenishment order for missing items based on priority from a picking list. When the priority of the product shelf 51 is not taken into consideration, the picking list is displayed in the order of areas 1-1 to 1-3 below the product shelf S1, and then areas 2-1 to 2-3 below the product shelf S2, as shown on the left side of FIG.

[0074] Considering the priority of the product shelves 51, product shelf S2 has a higher priority than product shelf S1, and therefore, as shown on the right side of FIG. 12, product shelf S2 is to be replenished with products before product shelf S1. Furthermore, the priority determination unit 145 can determine the priority of the products in short supply on product shelves 51 with the same priority based on the needs score of each product in short supply. In the list on the right side of FIG. 12, the replenishment order is determined to be area 2-3, area 2-2, and area 2-1, which have the highest needs scores, on product shelf S2. Then, after product shelf S2, the replenishment order is determined to be area 1-3, area 1-1, and area 1-2, which have the highest needs scores, on product shelf S1.

[0075] In this way, by determining the replenishment order of missing products for each shelf 51 while taking into consideration the priority of the shelf 51, employees can carry out stocking work collectively for each shelf 51. This allows employees to carry out stocking work without having to go back and forth between multiple shelves 51, thereby improving work efficiency.

[0076] The inventory management unit 148 manages inventory information for products located in areas (e.g., the back yard) different from the product shelves 51. When creating list information indicating the replenishment order for missing products, the list creation unit 146 can delete a missing product that is out of stock from the list if the missing product is out of stock. This allows employees to smoothly stock missing products that are in stock.

[0077] The notification processing unit 149 issues various notification requests to the employee terminal 20 and the customer terminal 40. For example, the notification processing unit 149 can acquire inventory information from the inventory management unit 148 and, based on the inventory information, send a notification request to the employee terminal 20 regarding an out-of-stock item. The employee terminal 20 displays information regarding the out-of-stock item in accordance with the received notification request. This allows the employee to recognize the out-of-stock item. Furthermore, when the notification processing unit 149 receives information from the employee terminal 20 that replenishment of a missing item has been completed, it can send a notification request to the customer terminal 40 indicating that replenishment of the missing item has been completed.

[0078] 13 is a diagram showing the flow of the information processing method according to the present disclosure. First, the server 10 acquires shelf images of the product shelves 51 captured by the camera 30 (S101). The server 10 identifies missing products based on the shelf images (S102).

[0079] Meanwhile, the customer terminal 40 generates customer needs information and transmits it to the server 10 (S103). The server 10 determines the priority of replenishing the missing items based on the acquired needs information (S104). The server 10 then creates list information indicating the order in which the missing items will be replenished according to the priority, and transmits this to the employee terminal 20 (S105). The employee terminal 20 displays the list information in a manner that can be recognized by the employee (S106). This allows the employee to quickly replenish the missing items according to the list displayed on the employee terminal 20.

[0080] When the replenishment work is completed, the employee transmits replenishment completion information for the missing items from employee terminal 20 to server 10 (S107). In response to receiving the replenishment completion information, server 10 transmits a notification request to customer terminal 40 to notify that replenishment of the missing items has been completed (S108). Then, customer terminal 40 notifies the customer that replenishment of the missing items has been completed (S109).

[0081] As described above, according to the embodiment, by linking the needs information obtained from customers with the picking list presented in the fixed-point shelf observation service, it becomes possible to prioritize stocking in line with needs.More specific and optimal work instructions can be generated in accordance with the statistics of customer needs, which makes it possible to improve the work efficiency of employees.

[0082] Furthermore, by utilizing information on customer needs, it is possible to improve business operations and processes such as stocking frequency, ordering plans, production plans, and shelf allocation reviews. In addition, since data on products that customers want "now" can be obtained in real time, lost sales opportunities can be reduced and sales can be increased.

[0083] Furthermore, customers will be able to shop more conveniently in the long term as fewer out-of-stock items will be experienced as a result of improved store operations. Customer feedback, such as requests for more products, can be directly conveyed to the store, increasing the variety of products available and allowing customers to try other items in their favorite series, improving the value of their shopping experience. Furthermore, customers will be able to receive information they want, such as sales information, which will increase their purchasing motivation and increase sales opportunities.

[0084] In the above examples, the program includes instructions (or software code) that, when loaded into a computer, cause the computer to perform one or more functions described in the embodiments. The program may be stored on a non-transitory computer-readable medium or a tangible storage medium. By way of example and not limitation, computer-readable media or tangible storage media include RAM, read-only memory (ROM), flash memory, SSD or other memory technology, CD-ROM, digital versatile disc (DVD), Blu-ray® disc or other optical disk storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage device. The program may also be transmitted on a transitory computer-readable medium or communication medium. By way of example and not limitation, transitory computer-readable media or communication media include electrical, optical, acoustic, or other forms of propagated signals.

[0085] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-described embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.

[0086] Each drawing is merely an example for describing one or more embodiments. Each drawing may not relate to only one particular embodiment, but may also relate to one or more other embodiments. As will be understood by those skilled in the art, various features or steps described with reference to any one drawing can be combined with features or steps shown in one or more other drawings to create, for example, an embodiment not explicitly shown or described. Not all features or steps shown in any one drawing are necessary to describe an exemplary embodiment, and some features or steps may be omitted. The order of steps described in any drawing may be changed as appropriate.

[0087] Some or all of the above embodiments can be described as, but are not limited to, the following supplementary notes. (Supplementary Note A1) An information processing device comprising: a display information acquisition means for acquiring display information indicating the display status of products on product shelves; a missing product identification means for identifying missing products based on the display information; a needs information acquisition means for acquiring, from a customer terminal used by the customer, needs information indicating products desired by the customer; a priority determination means for determining a priority for replenishing the missing products based on the needs information; and a list creation means for creating list information indicating an order of replenishment of the missing products in accordance with the priority. (Supplementary Note A2) The information processing device described in Supplementary Note A1, wherein the priority determination means calculates a needs score for each missing product based on the needs information, and determines the priority based on the needs score. (Appendix A3) The information processing device according to Appendix A2, wherein a plurality of product shelves are installed in a store, the priority determination means tally the needs scores of missing products for each product shelf and determine the priority of the product shelf based on the needs score tally, and the list creation means creates list information including a replenishment order taking the priority into consideration. (Appendix A4) The information processing device according to Appendix A3, wherein the priority determination means determines the priority of missing products for product shelves with the same priority based on the needs score for each missing product. (Appendix A5) The information processing device according to any one of Appendix A1 to A4, further comprising transmission means for transmitting list information regarding replenishment of the missing products to an employee terminal used by an employee. (Appendix A6) The information processing device according to any one of Appendix A1 to A5, wherein the display information is an image of the product shelf, and further comprising filling rate calculation means for calculating a filling rate of each product on the product shelf based on the image, and the missing product identification means identifies products whose filling rate is equal to or below a predetermined threshold as missing products. (Supplementary Note A7) The information processing device according to Supplementary Note A6, wherein the priority determination means determines the priority for replenishing the deficient products in consideration of a filling rate of the deficient products in addition to the needs information.(Appendix A8) The information processing device of any one of Appendices A1 to A7, further comprising inventory management means for managing inventory of the missing item, and wherein the list creation means deletes the missing item from the list information when the missing item is out of stock. (Appendix A9) The information processing device of any one of Appendices A1 to A8, further comprising notification means for notifying the customer terminal of the fact when the missing item is replenished. (Appendix B1) An information processing system comprising: display information acquisition means for acquiring display information indicating a display status of items on product shelves; missing item identification means for identifying missing items based on the display information; needs information acquisition means for acquiring, from the customer terminal used by the customer, needs information indicating products desired by the customer; priority determination means for determining a priority for replenishment of the missing items based on the needs information; and list creation means for creating list information indicating an order in which the missing items will be replenished in accordance with the priority. (Appendix C1) An information processing method in which a computer performs the following processes: acquire display information indicating the display status of products on product shelves, identify missing products based on the display information, acquire needs information indicating desired products desired by a customer from a customer terminal used by the customer, determine a priority for replenishing the missing products based on the needs information, and create list information indicating the order in which the missing products will be replenished in accordance with the priority. (Appendix D1) A program that causes a computer to perform the following processes: acquire display information indicating the display status of products on product shelves, identify missing products based on the display information, acquire needs information indicating desired products desired by a customer from a customer terminal used by the customer, determine a priority for replenishing the missing products based on the needs information, and create list information indicating the order in which the missing products will be replenished in accordance with the priority.

[0088] Some or all of the elements (e.g., configurations and functions) described in Appendix A2 to Appendix A9 that are dependent on Appendix A1 (information processing device) may also be dependent on Appendix B1 (information processing system), Appendix C1 (information processing method), and Appendix D1 (program) in the same dependency relationship as Appendix A2 to Appendix A9. Some or all of the elements described in any appendix may be applied to various hardware, software, recording means for recording software, systems, and methods.

[0089] REFERENCE SIGNS LIST 1 Information processing device 2 Display information acquisition unit 3 Shortage product identification unit 4 Needs information acquisition unit 5 Priority determination unit 6 List creation unit 10 Server 11 Storage unit 111 Program 112 Information DB 12 Memory 13 Communication unit 14 Processing unit 141 Display information acquisition unit 142 Filling rate calculation unit 143 Shortage product identification unit 144 Needs information acquisition unit 145 Priority determination unit 146 List creation unit 147 Transmission processing unit 148 Inventory management unit 149 Notification processing unit 20 Employee terminal 21 Storage unit 22 Memory 23 Communication unit 24 Input / output unit 25 Processing unit 251 Transmission / reception processing unit 252 Notification processing unit 30 Camera 40 Customer terminal 41 Needs information generation unit 42 Storage unit 43 Memory 44 Communication unit 45 Input / output unit 46 Processing unit 461 Transmission / reception processing unit 462 Notification processing unit 50 Store 51 Product shelf 52 Shelf board 100 Information processing system 101 Information processing system 102 Display information acquisition unit 103 Shortage product identification unit 104 Needs information acquisition unit 105 Priority determination unit 106 List creation unit N Network T0 Display screen T1 Threshold selection button T2 Filter selection button T3 Time selection button L1 Picking list

Claims

1. An information processing device comprising: a display information acquisition means for acquiring display information indicating the display status of products on product shelves; a missing product identification means for identifying missing products based on the display information; a needs information acquisition means for acquiring needs information indicating products desired by a customer from a customer terminal used by the customer; a priority determination means for determining the priority for replenishing the missing products based on the needs information; and a list creation means for creating list information indicating the order in which the missing products will be replenished in accordance with the priority.

2. The information processing device according to claim 1, wherein the priority determination means calculates a needs score for each shortage product based on the needs information, and determines the priority based on the needs score.

3. The information processing device according to claim 2, wherein a plurality of product shelves are installed in the store, the priority determination means tally the needs scores of products in short supply for each product shelf and determine the priority of the product shelf based on the needs score tally, and the list creation means creates list information including a replenishment order taking into account the priorities.

4. The information processing device according to claim 3, wherein the priority determination means determines the priority of the shortage products on shelves with the same priority level based on the needs score of each shortage product.

5. The information processing device according to claim 1, further comprising a transmitting means for transmitting list information relating to the replenishment of the shortage of products to an employee terminal used by an employee.

6. The information processing device according to claim 1, wherein the display information is an image of the product shelf, and further comprising a filling rate calculation means for calculating the filling rate of each product on the product shelf based on the image, and wherein the missing product identification means identifies products whose filling rate is below a predetermined threshold as missing products.

7. The information processing device according to claim 6, wherein the priority determination means determines the priority for replenishing the deficient products by taking into consideration the filling rate of the deficient products in addition to the needs information.

8. The information processing device according to claim 1, further comprising an inventory management means for managing the inventory of the shortage item, wherein the list creation means deletes the shortage item from the list information when the shortage item is out of stock.

9. The information processing device according to claim 1, further comprising a notification means for notifying said customer terminal when said missing product has been replenished.

10. An information processing system comprising: a display information acquisition means for acquiring display information indicating the display status of products on product shelves; a missing product identification means for identifying missing products based on the display information; a needs information acquisition means for acquiring needs information indicating products desired by a customer from a customer terminal used by the customer; a priority determination means for determining the priority for replenishing the missing products based on the needs information; and a list creation means for creating list information indicating the order in which the missing products will be replenished in accordance with the priority.

11. An information processing method in which a computer performs the following processes: acquiring display information indicating the display status of products on product shelves; identifying missing products based on the display information; acquiring needs information indicating products desired by a customer from a customer terminal used by the customer; determining the priority for replenishing the missing products based on the needs information; and creating list information indicating the order in which the missing products will be replenished in accordance with the priority.

12. A program that causes a computer to perform the following processes: acquiring display information indicating the display status of products on product shelves; identifying products that are in short supply based on the display information; acquiring needs information indicating products desired by a customer from a customer terminal used by the customer; determining the priority for replenishing the short products based on the needs information; and creating list information indicating the order in which the short products will be replenished in accordance with the priority.

13. The program according to claim 12, further comprising a process of calculating a needs score for each shortage product based on the needs information, and determining the priority order based on the needs score.

14. The program described in claim 13, wherein a plurality of product shelves are installed in a store, and further comprising a process of aggregating the need scores of products in short supply for each product shelf and determining the priority of the product shelf based on the aggregated need score values; and a process of creating list information including a replenishment order taking into account the priority.

15. The program according to claim 14, further comprising a process for determining the priority of the shortage products on shelves with the same priority level based on the needs score of each shortage product.

16. The program according to claim 12, further comprising a process for transmitting list information regarding the replenishment of the shortage items to an employee terminal used by an employee.

17. The program described in claim 12, wherein the display information is an image of the product shelf, and further includes a process of calculating the filling rate of each product on the product shelf based on the image, and a process of identifying products whose filling rate is below a predetermined threshold as products that are in short supply.

18. The program according to claim 17, further comprising a process for determining the priority of replenishment of the deficient product by taking into consideration the filling rate of the deficient product in addition to the needs information.

19. The program according to claim 12, further comprising a process for deleting the shortage item from the list information when the shortage item is out of stock.

20. The program according to claim 12, further comprising a process for notifying the customer terminal when the missing product has been replenished.

Images