Processing device, processing method, and recording medium

Abstract

A processing device according to the present disclosure comprises an acquisition unit, an identification unit, a calculation unit, and an output unit. The acquisition unit acquires an image obtained by imaging a commodity display shelf. The identification unit identifies a current commodity layout which is a current commodity layout on the display shelf on the basis of the image. The calculation unit calculates the score of the current commodity layout. The output unit outputs the score of the current commodity layout and a current commodity layout image in which the respective images of commodities are arranged in accordance with the current commodity layout.

Description

Processing device, processing method, and recording medium

[0001] The present disclosure relates to a processing device, a processing method, and a recording medium.

[0002] A technology related to the present disclosure is disclosed in Patent Document 1. The technology disclosed in Patent Document 1 analyzes an image of a display shelf to identify a product layout, and then calculates and outputs a score related to the product layout on the display shelf.

[0003] International Publication No. 2021 / 095539

[0004] As with the technology disclosed in Patent Document 1, by calculating and outputting a score related to the product layout on a display shelf, users can obtain objective evaluation results of the product layout. However, there is a demand for a technology that outputs the score in a distinctive manner, rather than simply outputting the score.

[0005] In view of the above-mentioned problems, an example of an object of the present disclosure is to provide a processing device, a processing method, and a recording medium that output scores for product layouts on display shelves in a distinctive manner.

[0006] The processing device of the present disclosure has an acquisition means for acquiring an image of a product display shelf, an identification means for identifying a current product layout, which is the current product layout on the display shelf, based on the image, a calculation means for calculating a score of the current product layout, and an output means for outputting the score of the current product layout and a current product layout image in which images of each product are arranged according to the current product layout.

[0007] In addition, the processing method disclosed herein involves one or more computers acquiring images of a product display shelf, identifying a current product layout, which is the current product layout on the display shelf, based on the images, calculating a score for the current product layout, and outputting the score for the current product layout and a current product layout image in which images of each product are arranged according to the current product layout.

[0008] In addition, the recording medium of the present disclosure stores a program that causes a computer to function as: an acquisition means for acquiring an image of a product display shelf; an identification means for identifying a current product layout, which is the current product layout on the display shelf, based on the image; a calculation means for calculating a score for the current product layout; and an output means for outputting the score for the current product layout and a current product layout image in which images of each product are arranged according to the current product layout.

[0009] According to one aspect of the present disclosure, a processing device, a processing method, and a recording medium are provided that output scores for product layouts on display shelves in a distinctive manner.

[0010] FIG. 1 is a diagram showing an example of a functional block diagram of a processing device according to the present disclosure. FIG. 2 is a flowchart showing an example of a processing flow of a processing device according to the present disclosure. FIG. 3 is a diagram showing an example of a hardware configuration of a processing device according to the present disclosure. FIG. 4 is a diagram for explaining an example of a score calculation method of a processing device according to the present disclosure. FIG. 5 is a diagram showing an example of a screen output by a processing device according to the present disclosure. FIG. 6 is a diagram showing another example of a functional block diagram of a processing device according to the present disclosure. FIG. 7 is a diagram showing another example of a screen output by a processing device according to the present disclosure. FIG. 8 is a diagram showing another example of a screen output by a processing device according to the present disclosure. FIG. 9 is a diagram showing another example of a functional block diagram of a processing device according to the present disclosure. FIG. 10 is a diagram showing another example of a screen output by a processing device according to the present disclosure.

[0011] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. In this disclosure, the drawings relate to one or more embodiments. In all drawings, similar components are designated by similar reference numerals, and descriptions thereof will be omitted as appropriate.

[0012] First Embodiment Fig. 1 is a functional block diagram showing an overview of a processing device 10. As shown in Fig. 1, the processing device 10 includes an acquisition unit 11, an identification unit 12, a calculation unit 13, and an output unit 14. These functional units execute the processing of the flowchart in Fig. 2.

[0013] In S10, the acquisition unit 11 acquires an image of a product display shelf. In S11, the identification unit 12 identifies a current product layout, which is the current product layout on the display shelf, based on the acquired image. In S12, the calculation unit 13 calculates a score for the current product layout. In S13, the output unit 14 outputs the score for the current product layout and a current product layout image in which images of each product are arranged according to the current product layout.

[0014] In this way, the processing device 10 outputs the scores of the product layout on the display shelf in a characteristic manner.

[0015] Specifically, the processing device 10 does not simply output a score for the current product layout, but also outputs a current product layout image in which images of each product are arranged according to the current product layout in addition to the score. With this processing device 10, the user can understand the current product layout based on the output current product layout image. The user can then understand the current product layout and its score as a set. As a result, the user can easily understand what kind of product layout has what kind of score.

[0016] Furthermore, the processing device 10 outputs a current product layout image in which images of each product are arranged according to the current product layout, rather than an image of a display shelf. Images of a display shelf may contain unnecessary information, such as equipment around the display shelf. For this reason, images of a display shelf may make it difficult for users to understand the current product layout. In contrast, a current product layout image generated by arranging images of each product according to the current product layout can reduce such inconveniences. As a result, it becomes easier for users to understand the current product layout.

[0017] Second Embodiment Overview A processing apparatus 10 according to a second embodiment is a specific embodiment of the configuration of the processing apparatus 10 according to the first embodiment. The processing apparatus 10 will be described in detail below.

[0018] "Hardware Configuration" First, an example of the hardware configuration of the processing device 10 will be described. Each functional unit of the processing device 10 is realized by any combination of hardware and software. Those skilled in the art will understand that there are various variations in the realization method and device. Software includes programs that are pre-loaded in the device before shipping, and programs downloaded from recording media such as CDs (Compact Discs) or servers on the Internet.

[0019] FIG. 3 is a block diagram illustrating an example of the hardware configuration of a processing device 10. As shown in FIG. 3, the processing device 10 has a processor 1A, a memory 2A, an input / output interface 3A, a peripheral circuit 4A, and a bus 5A. The peripheral circuit 4A includes various modules. The processing device 10 does not necessarily have to have the peripheral circuit 4A. Note that the processing device 10 may be composed of multiple devices that are physically and / or logically separated. In this case, each of the multiple devices may have the above hardware configuration.

[0020] The bus 5A is a data transmission path for the processor 1A, memory 2A, peripheral circuit 4A, and input / output interface 3A to mutually transmit and receive data. The processor 1A is, for example, a processing unit such as a CPU or a graphics processing unit (GPU). The memory 2A is, for example, a random access memory (RAM) or a read-only memory (ROM). The input / output interface 3A includes interfaces for acquiring information from input devices, external devices, external servers, external sensors, cameras, etc., and interfaces for outputting information to output devices, external devices, external servers, etc. The input / output interface 3A also includes an interface for connecting to a communication network such as the Internet. Examples of input devices include a keyboard, mouse, microphone, physical buttons, touch panel, etc. Examples of output devices include a display, speaker, printer, mailer, etc. The processor 1A can issue commands to each module and perform calculations based on the results of those calculations.

[0021] "Functional Configuration" Next, the functional configuration of the processing device 10 will be described in detail. Fig. 1 shows an example of a functional block diagram of the processing device 10. As shown in the figure, the processing device 10 has an acquisition unit 11, an identification unit 12, a calculation unit 13, and an output unit 14.

[0022] The acquisition unit 11 acquires an image of a product display shelf.

[0023] A "display shelf" is a shelf used to display products. Display shelves are installed in retail stores such as convenience stores, supermarkets, and drug stores.

[0024] The "image" is generated by a camera taking a picture of the display shelf.

[0025] The cameras may be installed in the store in a position and orientation that allows them to capture images of the display shelves. For example, the cameras may be attached to the ceiling, walls, display shelves facing each other, or other components. Note that the camera installation positions exemplified here are merely examples and are not limited to these. In this example, the cameras may continuously capture moving images. Alternatively, the cameras may capture still images or moving images for a predetermined period of time at a predetermined timing. The predetermined timing may be at predetermined intervals (every hour, every day, every week, every month, etc.).

[0026] Alternatively, a user may carry a camera and take pictures of the display shelves. Alternatively, a mobile object (e.g., a mobile object with an autonomous movement function) equipped with a camera and moving around the store may take pictures of the display shelves while moving around the store. The mobile object may be configured to move along the floor, wall, ceiling, etc., or may be configured to move through the air. Such a mobile object can be realized using any well-known technology. In this example, at least one of the user and the mobile object can take still or moving images of the display shelves at a predetermined timing. The predetermined timing may be at predetermined time intervals (every hour, every day, every week, every month, etc.).

[0027] There are various means for acquiring images generated by the camera. For example, the camera and the processing device 10 may be connected so as to be able to communicate with each other. The camera may then transmit the images it generates to the processing device 10. The camera may transmit images in real time processing or in batch processing. The acquisition unit 11 can acquire the images transmitted from the camera in this manner.

[0028] Alternatively, the images generated by the camera may be stored in a predetermined storage device. This storage device may be provided within the camera or in an external device capable of communicating with the camera. The acquisition unit 11 may acquire the images stored in this storage device at any timing and by any means.

[0029] Note that "acquisition" includes at least one of the following: a device going to retrieve data or information stored in another device or storage medium (active acquisition), and a device inputting data or information output from another device (passive acquisition). Examples of active acquisition include making a request to another device and receiving a response, and accessing and reading information from another device or storage medium. An example of passive acquisition is receiving information that is distributed (or transmitted, push notification, etc.). Furthermore, "acquisition" may also mean selecting and acquiring data or information from received data or information, or selecting and receiving distributed data or information.

[0030] The identification unit 12 identifies a current product layout, which is the current product layout on the display shelf, based on the image acquired by the acquisition unit 11.

[0031] The "current product layout" indicates, for example, which products are displayed in what order on each shelf of a display shelf. The display shelf has multiple display sections. Each display section extends from the front of the display shelf (the side from which customers remove products) toward the back. Each display section basically displays one type of product. The multiple display sections are identified, for example, as the leftmost display section on the first shelf, the second display section from the left on the first shelf, etc. If these multiple display sections are identified from each other by identification information, etc., the current product layout may indicate the products displayed in each display section.

[0032] The identification unit 12 detects multiple products from the image acquired by the acquisition unit 11 through a matching process using appearance information of each product (at least one of the image and features extracted from the image) stored in advance in a storage device. The identification unit 12 can then identify the current product layout based on the arrangement order of the detected multiple products in the image. The storage device may be provided in the processing device 10 or in an external device capable of communicating with the processing device 10. Examples of the matching process include, but are not limited to, feature point matching and feature value matching.

[0033] The calculation unit 13 calculates a score for the current product layout. The selection of the display position for each product, i.e., where on the display shelf each product is displayed, can affect the sales of each product. Furthermore, the selection of products to display on the display shelf, i.e., which products are displayed on the display shelf, can affect the sales of the entire store. The score indicates the merits or demerits of the current product layout from the perspective of, for example, sales. In this embodiment, the higher the score, the better the current product layout is.

[0034] There are various methods for calculating the score. The calculation unit 13 can calculate the score using any technique. An example of the score calculation method will be described below, but the method is not limited to this.

[0035] Calculation Example 1 The calculation unit 13 can calculate a score using a score calculation model generated by machine learning. The score calculation model is generated by learning learning data that links product layouts (explanatory variables) with their scores (target variables). The explanatory variables may include other items. Information such as the types of products included in the product layout, the number of display sections allocated to each product, and the display positions of each product is extracted from the product layout. This information may be used as explanatory variables. The score of the learning data may be set arbitrarily by the user. When the product layout of a certain store is used as the learning data, the user can determine the score based on the sales of the store, etc. Furthermore, once a score calculation model is generated, the score of the product layout used as the learning data can be calculated using the score calculation model.

[0036] Note that a score calculation model may be generated for each location environment of a store. Then, the calculation unit 13 may calculate the score using a score calculation model corresponding to the location environment of the store for which the score is to be calculated. The location environment is defined by, for example, customer demographics, nearby facilities, availability of parking, distance from the station, etc. Note that the items that define the location environment are not limited to these.

[0037] Alternatively, a score calculation model may be generated for each store environment on the day defined by items such as weather, temperature, humidity, etc. Then, the calculation unit 13 may calculate the score using a score calculation model corresponding to the environment on the day of the store that is the target of score calculation. Note that the items that define the environment on the day are not limited to these.

[0038] A specific example of calculation example 1 is described below. (Step 1) Group multiple stores based on criteria such as climatic conditions, location, customer volume, and sales volume. (Step 2) Extract good stores from each group. For example, good stores can be extracted based on sales volume. (Step 3) For each group, the product layout, climatic conditions, customer volume, product sales, and shelf allocation information of the extracted store are used as explanatory variables, and a score is used as the objective variable for learning to create a score calculation model. (Step 4) Identify the group to which the store belongs based on the climatic conditions, location, customer volume, and sales volume of the store for which the score is to be calculated, and calculate the score using the score calculation model for the identified group. (Step 5) Re-train and update the score calculation model at a predetermined time. The update timing can be set to a predetermined time, such as once a month, or the store clerk can change the update timing on their terminal.

[0039] Calculation Example 2 The calculation unit 13 can calculate a score using a score calculation model generated by machine learning. The score calculation model in this example is generated by learning based on sales trend data for each product (what products are selling well), attribute data of people who buy the products, sales data for each product, etc.

[0040] A specific example is described below. (Step 1) Sales trend data for each product is collected from the Internet or other sources. The sales trend data indicates sales data from online shopping and online supermarkets, as well as the attributes of customers who made purchases (gender, age group, etc.). (Step 2) The collected sales trend data for each product (what products are selling), attribute data of the people who buy each product, sales data for each product at each store over a certain period, and the product layout at each store are used as explanatory variables, and the score is used as the objective variable for learning, to create a score calculation model for each store. The sales data for each product at each store over a certain period may be data registered in a point-of-sales (POS) system or data identified by analyzing cameras installed in the store. (Step 3) Using the score calculation model for the store being the target of score calculation, a product layout score is calculated based on the sales trend data at that time, attribute data of the store's customers, and sales data for each product at that store over a certain period.

[0041] Calculation Example 3 The calculation unit 13 can calculate the score using the technology disclosed in Patent Document 1. Here, the technology disclosed in Patent Document 1 will be briefly described.

[0042] 4 is stored in advance in a storage device for each product. The storage device may be provided in the processing device 10 or in an external device that can communicate with the processing device 10.

[0043] Fig. 4 shows information about product AB. The information shown in Fig. 4 indicates the evaluation value when product AB is displayed in each display section of a display shelf. The example of Fig. 4 shows that the evaluation value when product AB is displayed in the leftmost display section on the top shelf of the display shelf is 90. The example of Fig. 4 also shows that the evaluation value when product AB is displayed in the leftmost display section on the bottom shelf of the display shelf is 30.

[0044] The calculation unit 13 identifies the products displayed in each display section of the display shelf based on the current product layout identified by the identification unit 12. Then, the calculation unit 13 identifies the evaluation value of the products identified for each display section when they are displayed in each display section based on the information for each product as shown in Fig. 4. For example, if the current product layout indicates that product AB is displayed in the leftmost display section on the top shelf, the evaluation value of that display section will be 90.

[0045] The calculation unit 13 then calculates the score of the display shelf based on the evaluation values ​​of each of the multiple display sections included in the display shelf. For example, the calculation unit 13 can calculate the average value or total value of the evaluation values ​​of each of the multiple display sections included in the display shelf as the score of the display shelf.

[0046] Calculation Example 4 The calculation unit 13 can calculate a score for the current product layout based on the similarity between the reference product layout and the current product layout. The calculation unit 13 calculates a higher score as the similarity increases.

[0047] In this example, information indicating the reference product layout is stored in advance in a storage device. The calculation unit 13 calculates the score using the information. The storage device may be provided in the processing device 10 or in an external device that can communicate with the processing device 10.

[0048] A "reference product layout" is an excellent product layout, a model product layout. For example, the user may determine the reference product layout. Alternatively, the product layout of a store with good sales may be used as the reference product layout. The user may identify the product layout of a store with good sales and register it as a reference product layout in the storage device. Alternatively, the processing device 10 may identify a store whose sales meet a predetermined condition based on the sales data of each of multiple stores. The processing device 10 may then register the product layout of the identified store as a reference product layout in the storage device. The predetermined condition may be "sales above a threshold" or "sales that are the best among multiple stores," etc.

[0049] Additionally, the processing device 10 may register a product layout having a score equal to or greater than a threshold value as a reference product layout in the storage device.

[0050] The reference product layout may be determined for each location environment of the store. Then, the calculation unit 13 may calculate the score using the reference product layout corresponding to the location environment of the store for which the score is to be calculated. The location environment is defined by, for example, customer demographics, nearby facilities, availability of parking, distance from the station, etc. Note that the items defining the location environment are not limited to these.

[0051] The calculation unit 13 can calculate the similarity between the reference product layout and the current product layout based on at least one of the following: - The type of products included in the product layout - The number of each product included in the product layout (the number of display sections allocated to each product) - The position of each product in the product layout (display position)

[0052] For example, the calculation unit 13 can calculate a higher similarity as the degree of match between the type of product included in the reference product layout and the type of product included in the current product layout increases.

[0053] Furthermore, when there is a product included in both the reference product layout and the current product layout, the calculation unit 13 can calculate a higher similarity as the degree of agreement between the product's display positions increases. The degree of agreement is highest when the display position of a product in the reference product layout matches the display position of that product in the current product layout. The degree of agreement decreases as the distance between the display position of that product in the reference product layout and the display position of that product in the current product layout increases.

[0054] Furthermore, when there is a product included in both the reference product layout and the current product layout, the calculation unit 13 can calculate a higher similarity as the degree of agreement between the numbers of display sections allocated to the product increases.

[0055] 1 , the output unit 14 outputs the score of the current product layout and a current product layout image in which images of the products are arranged according to the current product layout. The output unit 14 can simultaneously display the score and the current product layout image on the screen. That is, the output unit 14 can simultaneously display a screen showing both the score and the current product layout image.

[0056] 5 shows an example of a screen output by the output unit 14. A current product layout image is displayed on the left side of the screen, and a score is displayed on the right side of the screen.

[0057] The "current product layout image" is an image in which images of each product are arranged according to the current product layout. The current product layout image is an image generated by arranging images of each product in a predetermined order. This current product layout image is different from an image generated by photographing a display shelf with a camera.

[0058] "Images of each product" are images in which one product appears in one image. The images may be images generated by photographing each product individually in advance. In this case, it is preferable to photograph each product in an environment where the product label faces the camera and no unnecessary information is included in the background. This makes it easier for the user to recognize the product included in the image. Images of each product are stored in advance in a storage device. The storage device may be provided in the processing device 10 or in an external device capable of communicating with the processing device 10.

[0059] The image of each product may be "an image of each product stored in advance in a storage device" that is used in the above-described matching by the identification unit 12. In this case, it is preferable that the image of each product stored in advance in the storage device can be used for both the matching by the identification unit 12 and the generation of the current product layout image.

[0060] Alternatively, the image of each product may be generated by cutting out a portion of the image of the display shelf acquired by the acquisition unit 11, in which the product appears. The product included in the image is detected by the above-described matching by the identification unit 12. Based on the detection result, the processing device 10 can cut out a portion of the image of the display shelf acquired by the acquisition unit 11, in which the product appears.

[0061] Next, an example of the processing flow of the processing device 10 will be described with reference to the flowchart of FIG.

[0062] The processing device 10 acquires an image of a product display shelf (S10), and then identifies a current product layout, which is the current product layout on the display shelf, based on the acquired image (S11). The processing device 10 then calculates a score for the identified current product layout (S12). The processing device 10 then outputs the score for the current product layout and a current product layout image in which images of each product are arranged according to the current product layout (S13).

[0063] "Operational Effects" The processing apparatus 10 of this embodiment can achieve the same operational effects as the processing apparatus 10 of the first embodiment.

[0064] Third Embodiment The processing device 10 of this embodiment changes the arrangement of product images in a current product layout image based on user input. The processing device 10 then outputs a score for the product layout after the rearrangement. This will be described in detail below.

[0065] 6 shows an example of a functional block diagram of the processing device 10. As shown in the figure, the processing device 10 includes an acquisition unit 11, an identification unit 12, a calculation unit 13, an output unit 14, and a change unit 16.

[0066] The change unit 16 changes the arrangement of the images of each product in the current product layout image output by the output unit 14 based on user input.

[0067] "Changing the arrangement" includes at least one of the following: - Changing the order of images of existing products that are currently in the product layout image - Changing the images of products to be included in the current product layout image - Changing the number of images of each product to be included in the current product layout image

[0068] "Changing the order of images of existing products currently present in the product layout image" means, for example, changing the positions of the image of a product located in the leftmost display section on the top row and the image of a product located in the third display section from the left on the top row.

[0069] "Changing the images of products to be included in the current product layout image" refers to, for example, deleting the image of the product located in the leftmost display section on the top shelf from the current product layout image and positioning the image of another product in that display section. The image of the other product may be an image of another product that is included in the current product layout image. Alternatively, the image of the other product may be an image of another product that is not included in the current product layout image. In the latter case, the modification unit 16 may display a list of other products that are not included in the current product layout image on the screen. Then, the modification unit 16 may accept input to select a product to add to the current product layout image from that list.

[0070] "Changing the number of images of each product included in the current product layout image" refers to changing the display section allocated to each product. For example, this involves deleting the image of the product located in the leftmost display section on the top row from the current product layout image, and relocating the image of the product located in the second display section from the left on the top row to the leftmost display section on the top row as well.

[0071] The change unit 16 can accept user input indicating the above-described changes via an input device such as a touch panel, a mouse, a keyboard, physical buttons, a microphone, etc. The configuration of the user interface screen for accepting such user input can vary and is not particularly limited.

[0072] The calculation unit 13 calculates the score of the product layout shown in the rearranged current product layout image. The method of calculating the score is as described in the second embodiment.

[0073] The output unit 14 outputs the score of the rearranged product layout. Note that the arrangement of the product images in the current product layout image output by the output unit 14 has been changed by the change unit 16. The output unit 14 then outputs the score of the rearranged product layout displayed on the screen. As a result, the rearranged current product layout image and the score of the rearranged product layout are simultaneously displayed on the screen as shown in FIG. 5.

[0074] Other configurations of the processing apparatus 10 of this embodiment are similar to those of the processing apparatus 10 of the first and second embodiments.

[0075] According to the processing apparatus 10 of this embodiment, it is possible to achieve the same effects as those of the processing apparatus 10 of the first and second embodiments.

[0076] Furthermore, the processing device 10 of this embodiment changes the arrangement of product images in the current product layout image based on user input. The processing device 10 then outputs a score for the rearranged product layout. The user can rearrange the product images in the current product layout image and check the score for the rearranged product layout to find the optimal product layout.

[0077] Fourth Embodiment The processing device 10 of this embodiment distinguishably displays images of products that are recommended to be replaced with other products in the current product layout image. This will be described in detail below.

[0078] An example of a functional block diagram of the processing device 10 of this embodiment is shown in FIG. 1 or FIG.

[0079] The calculation unit 13 can determine products that are recommended to be replaced with other products based on the absolute evaluation of each product in the current product layout image, or the relative evaluation of each product in the current product layout image with other products in the current product layout image.

[0080] The calculation unit 13 can determine one or more products from among the products in the current product layout image as products recommended to be replaced with other products.

[0081] The calculation unit 13 can perform the absolute evaluation or relative evaluation based on at least one of the following information: The calculation unit 13 can obtain this data using any well-known technique.

[0082] ・Sales data for each product at the store where the current product layout has been identified ・Sales data for each product at other stores that are different from the store where the current product layout has been identified ・Sales data for each product at the store where the current product layout has been identified and at similar stores that meet the comparison conditions ・Sales data for each product on the website ・Word-of-mouth information for each product

[0083] An example of the process executed by the calculation unit 13 will be described below.

[0084] Determination Example 1: The calculation unit 13 can determine, as a product that is recommended to be replaced with another product, a product whose sales amount or sales volume in a store where the current product layout is specified is equal to or less than a threshold. The threshold is a predetermined value.

[0085] The calculation unit 13 compares the sales amount or sales quantity of each product in the store for which the current product layout has been identified with a predetermined threshold, and can determine that a product for which the sales amount or sales quantity is equal to or less than the threshold is a product for which replacement with another product is recommended.

[0086] The sales amount or number of units sold here refers to, for example, the sales amount or number of units sold within a recent fixed period (e.g., the most recent month), but is not limited to this (the same applies below).

[0087] Determination Example 2 The calculation unit 13 can determine, among multiple products in the current product layout image, products whose "sales amount or sales volume at the store where the current product layout is identified is within a predetermined number" as products that are recommended to be replaced with other products.

[0088] The calculation unit 13 ranks the multiple products in the current product layout image in order of sales or sales volume of each product in the store where the current product layout is specified. Then, the calculation unit 13 can determine that the products whose ranks are equal to or lower than a reference rank are products recommended to be replaced with other products.

[0089] Determination Example 3 The calculation unit 13 can determine, as a product recommended for replacement with another product, a product whose sales amount or sales volume at stores other than the store for which the current product layout has been identified is below a threshold.

[0090] In this example, the other store whose sales amount or sales quantity is referenced is determined in advance and registered in the processing device 10. For example, a store with high overall sales or a store directly managed by the headquarters is determined as the other store. The user may determine the other store and register it in the processing device 10, or the processing device 10 may determine the other store by comparing the sales of multiple stores.

[0091] The calculation unit 13 compares the sales amount or sales quantity of each product at other stores with a predetermined threshold, and can determine that a product whose sales amount or sales quantity is equal to or less than the threshold is a product that is recommended to be replaced with another product.

[0092] Determination Example 4: The calculation unit 13 can determine, among the multiple products in the current product layout image, products whose "sales amount or sales volume at other stores is within a predetermined number" as products recommended for replacement with other products. The concept of other stores is the same as that of Determination Example 3.

[0093] The calculation unit 13 ranks the multiple products in the current product layout image in order of sales or sales volume of each product in other stores. Then, the calculation unit 13 can determine that the products whose ranks are equal to or lower than a reference rank are products that are recommended to be replaced with other products.

[0094] Determination Example 5: The calculation unit 13 can determine that a product whose sales amount or sales volume is below a threshold value at the store whose current product layout has been identified and at a similar store that meets the comparison conditions is a product that is recommended to be replaced with another product.

[0095] The comparison condition is that the similarity of the location environment is equal to or greater than a threshold value. As described above, the location environment is defined by, for example, the customer demographic, nearby facilities, the presence or absence of parking, the distance from the station, etc. Note that the items that define the location environment are not limited to these. There are various methods for calculating the similarity of the contents of these items, and any technology can be adopted.

[0096] In this example, the location environment of each of the multiple stores is stored in advance in a storage device. The storage device may be provided in the processing device 10 or in an external device that can communicate with the processing device 10.

[0097] Then, the calculation unit 13 identifies similar stores that satisfy the comparison conditions with the store whose current product layout has been identified, based on the pre-stored location environment of each store. Note that if there are multiple stores that satisfy the comparison conditions with the store whose current product layout has been identified, the calculation unit 13 can, for example, select one of them as the similar store. The calculation unit 13 may select one at random, may select the store whose location environment is most similar, or may select one using some other method.

[0098] Next, the calculation unit 13 compares the sales amount or sales volume of each product in similar stores with a predetermined threshold value, and can determine that a product whose sales amount or sales volume is equal to or less than the threshold value is a product that is recommended to be replaced with another product.

[0099] Determination Example 6: The calculation unit 13 can determine, among multiple products in the current product layout image, products whose "sales amount or sales volume at similar stores is within a predetermined number" as products recommended for replacement with other products. Similar stores are based on the same concept as in Determination Example 5.

[0100] The calculation unit 13 ranks the multiple products in the current product layout image in order of the sales amount or the number of units sold of each product in similar stores. Then, the calculation unit 13 can determine that the products whose ranks are equal to or lower than a reference rank are products that are recommended to be replaced with other products.

[0101] Determination Example 7 The calculation unit 13 can determine that a product whose sales amount or sales volume on the website is equal to or less than a threshold is a product that is recommended to be replaced with another product.

[0102] Sales on websites are a concept that includes at least one of sales on EC (Electronic Commerce) sites and sales through online supermarkets. Online supermarkets are a service that accepts orders via websites and delivers products to customers from existing nearby stores.

[0103] The calculation unit 13 compares the sales amount or the number of units sold of each product on the website with a predetermined threshold, and can determine that a product whose sales amount or number of units sold is equal to or less than the threshold is a product that is recommended to be replaced with another product.

[0104] Determination Example 8: The calculation unit 13 can determine, among the multiple products in the current product layout image, a product whose "website sales amount or sales volume is within a predetermined number" as a product that is recommended to be replaced with another product. Sales on a website are based on the same concept as Determination Example 7.

[0105] The calculation unit 13 ranks the multiple products in the current product layout image in order of the sales amount or the number of units sold of each product on the website. Then, the calculation unit 13 can determine that the products whose rankings are equal to or lower than a reference ranking are products that are recommended to be replaced with other products.

[0106] Determination Example 9 Word-of-mouth information includes search trends, which are rankings of words searched on search sites, messages uploaded to SNS (Social Networking Service), etc. The calculation unit 13 acquires this word-of-mouth information from an external server. Then, based on the acquired word-of-mouth information, the calculation unit 13 can determine a product that is recommended to be replaced with another product.

[0107] For example, the calculation unit 13 can determine a product that is not included within a predetermined number of top rankings of a word searched on a search site and is recommended to be replaced with another product. A product that is not included within a predetermined number of top rankings is a product whose product name, common name, or nickname is not included within a predetermined number of top rankings.

[0108] Additionally, for example, the calculation unit 13 may determine that a product whose ranking for a word searched on a search site has dropped by a predetermined level or more from its most recent rank is a product that is recommended to be replaced with another product.

[0109] Alternatively, for example, the calculation unit 13 may rank multiple products in the current product layout image in order of ranking of words searched on a search site. Then, the calculation unit 13 may determine that a product whose ranking is equal to or lower than a reference ranking is a product that is recommended to be replaced with another product.

[0110] Alternatively, for example, the calculation unit 13 may extract messages related to each product from SNS messages posted within a certain period. The messages related to each product may include, for example, the product name, popular name, nickname, etc. of each product. Then, the calculation unit 13 may determine, as a product recommended for replacement, a product for which the number of extracted messages is equal to or less than a threshold.

[0111] Alternatively, for example, the calculation unit 13 may rank the products in the current product layout image in descending order of the number of extracted messages. Then, the calculation unit 13 may determine that the products ranked equal to or lower than a reference rank are products recommended to be replaced with other products.

[0112] The output unit 14 displays, in the current product layout image, images of products that are recommended to be replaced with other products in an identifiable manner, as shown in Fig. 7. In the example of Fig. 7, a blinking display is used as the identifiable display method, but the identifiable display method is not limited to this means and any method can be used.

[0113] The output unit 14 may output the reason why replacement with another product is recommended. The output unit 14 may output the reason for each product. For example, when one product recommended for replacement with another product is selected on the screen shown in FIG. 7 , the output unit 14 may display the reason why the product is recommended to be replaced with another product on the screen. If the above reason is the same for all of one or more products currently displayed in an identifiable manner in the product layout image, the output unit 14 may constantly display the reason on the screen shown in FIG. 7 .

[0114] The reason may be, for example, any of the following: These reasons are identified based on the result of the process performed by the calculation unit 13 described above to determine a product recommended for replacement with another product.

[0115] - Because the sales amount or number of units sold of the product at the store where the current product layout is specified is below a threshold. - Because, among multiple products in the current product layout image, the sales amount or number of units sold at the store where the current product layout is specified is within a specified lower number. - Because the sales amount or number of units sold of the product at the other store mentioned above is below a threshold. - Because, among multiple products in the current product layout image, the sales amount or number of units sold at the other store mentioned above is within a specified lower number. - Because the sales amount or number of units sold of the product at the similar store mentioned above is below a threshold. - Because, among multiple products in the current product layout image, the sales amount or number of units sold at the similar store mentioned above is within a specified lower number. - Because the sales amount or number of units sold of the product at the website mentioned above is below a threshold. - Because, among multiple products in the current product layout image, the sales amount or number of units sold at the website mentioned above is within a specified lower number. - Because it is not included within a specified upper number in the ranking of words searched on the search site. - Because the ranking of words searched on the search site has dropped by a specified level or more from the most recent rank. - Among multiple products in the current product layout image, the ranking of words searched on a search site is within a specified number of bottom rankings. - Because the number of messages posted on SNS within a specified period of time is below a threshold. - Among multiple products in the current product layout image, the ranking of the number of messages posted on SNS within a specified period of time is within a specified number of bottom rankings.

[0116] Other configurations of the processing apparatus 10 of this embodiment are similar to those of the processing apparatus 10 of the first to third embodiments.

[0117] According to the processing apparatus 10 of this embodiment, it is possible to achieve the same effects as those of the processing apparatus 10 of the first to third embodiments.

[0118] Furthermore, the processing device 10 of this embodiment can distinguishably display images of products that are recommended to be replaced with other products in the current product layout image, as shown in Fig. 7. Based on this display, the user can confirm and consider the products to be replaced with other products.

[0119] Furthermore, when the processing device 10 has the configuration of the third embodiment, the user can determine how to change the arrangement of the images of each product in the current product layout image based on the display. For example, the user can delete the image of a product that is recommended to be replaced with another product from the current product layout image and position the image of the other product in that display section.

[0120] In this way, the processing device 10 can provide useful information to a user who is considering product layout.

[0121] Fifth Embodiment The processing device 10 of this embodiment further outputs additional product information indicating images of recommended additional products that are products recommended for addition to the current product layout. This will be described in detail below.

[0122] An example of a functional block diagram of the processing device 10 of this embodiment is shown in FIG. 1 or FIG.

[0123] The calculation unit 13 can determine recommended additional products, which are products that are recommended to be added to the current product layout, based on at least one of the following information: The calculation unit 13 can obtain this data using any well-known technology:

[0124] ・Sales data for each product at other stores that have a different product layout from the store where the current product layout is specified. ・Sales data for each product at similar stores that meet the comparison criteria with the store where the current product layout is specified. ・Sales data for each product on the website. ・Review information for each product.

[0125] For example, the calculation unit 13 can determine, as a recommended additional product, a product that is not included in the current product layout and whose sales amount or sales volume at another store meets the recommendation conditions. Additionally, the calculation unit 13 can determine, as a recommended additional product, a product that is not included in the current product layout and whose sales amount or sales volume at a similar store meets the recommendation conditions. Additionally, the calculation unit 13 can determine, as a recommended additional product, a product that is not included in the current product layout and whose sales amount or sales volume at a website meets the recommendation conditions. Other stores, similar stores, and websites are as described in the fourth embodiment.

[0126] The recommendation condition may be, for example, that the sales amount or the number of units sold is equal to or greater than a threshold. Alternatively, the recommendation condition may be, for example, that the product has a sales amount or number of units sold that is ranked higher than a predetermined rank in other stores, similar stores, or websites.

[0127] As another example, the calculation unit 13 can determine, as an additional recommended product, a product that is not currently included in the product layout and whose ranking of words searched on the search site satisfies the recommendation conditions.

[0128] The recommendation condition may be, for example, that the ranking of a word searched on a search site is within a predetermined number of the top rankings. Alternatively, the recommendation condition may be that the ranking of a word searched on a search site has risen by a predetermined level or more from the most recent ranking.

[0129] Alternatively, for example, the calculation unit 13 may rank products not currently included in the product layout in order of the ranking of words searched on the search site. Then, the calculation unit 13 may determine products whose ranking is equal to or higher than a reference rank (recommended condition) as additional recommended products.

[0130] Alternatively, for example, the calculation unit 13 may extract messages related to each product from messages posted on SNS within a certain period of time. The messages related to each product may include, for example, the product name, popular name, or nickname of each product. The calculation unit 13 may then determine, as a recommended additional product, a product that is not currently included in the product layout and for which the number of extracted messages is equal to or exceeds a threshold.

[0131] Alternatively, for example, the calculation unit 13 may rank products not currently included in the product layout in descending order of the number of extracted messages. Then, the calculation unit 13 may determine products whose ranks are equal to or higher than a reference rank as recommended products to be added.

[0132] The output unit 14 further outputs additional product information showing images of recommended additional products that are products recommended to be added to the current product layout, as shown in Fig. 8. The recommended additional product list in Fig. 8 is the additional product information.

[0133] The output unit 14 may output the reason for recommending the addition of the additional recommended product to the current product layout. The output unit 14 may output the reason for each product. For example, when one additional recommended product is selected on the screen shown in FIG. 8, the output unit 14 may display the reason for recommending the addition of that product on the screen. If the above reason is the same for all of one or more products displayed in the additional product information, the output unit 14 may always display the reason on the screen shown in FIG. 8.

[0134] The reason may be, for example, any one of the following: These reasons are identified based on the result of the process performed by the calculation unit 13 to determine the additional recommended product.

[0135] ・Because the sales amount or number of units sold at other stores meets the recommended conditions. ・Because the sales amount or number of units sold at similar stores meets the recommended conditions. ・Because the sales amount or number of units sold on a website meets the recommended conditions. ・Because the ranking of words searched on a search site meets the recommended conditions. ・Because the number of messages posted on SNS within a specified period of time is above the threshold. ・Because, among products not currently included in the product layout, the ranking of the number of messages posted on SNS within a specified period of time is within the top specified number.

[0136] Other configurations of the processing apparatus 10 of this embodiment are similar to those of the processing apparatus 10 of the first to fourth embodiments.

[0137] According to the processing apparatus 10 of this embodiment, it is possible to achieve the same effects as those of the processing apparatus 10 of the first to fourth embodiments.

[0138] Furthermore, the processing device 10 of this embodiment can further output additional product information showing images of recommended additional products that are products recommended for addition to the current product layout, as shown in Fig. 8. Based on this display, the user can consider products to add to the current product layout.

[0139] Furthermore, when the processing device 10 has the configuration of the third embodiment, the user can determine changes to the arrangement of product images in the current product layout image based on the display. For example, the user can make changes such as adding images of recommended additional products to the current product layout image. The calculation unit 13 can reflect, in the score, the purchase rankings, word-of-mouth reviews, purchaser attributes (how closely the product purchaser attributes match the attributes of people visiting the store), weather trends (e.g., changing from cold tomato soup to tomato hotpot as the cold season approaches can lead to an increase in score), etc., of the products added to the current product layout.

[0140] In this way, the processing device 10 can provide useful information to a user who is considering product layout.

[0141] Sixth Embodiment The processing device 10 of this embodiment further outputs an image showing a recommended product layout, which will be described in detail below.

[0142] An example of a functional block diagram of the processing device 10 according to this embodiment is shown in Fig. 9. As shown in Fig. 9, the processing device 10 includes an acquisition unit 11, an identification unit 12, a calculation unit 13, an output unit 14, and a generation unit 15. Although not shown, the processing device 10 may also include a change unit 16.

[0143] The generation unit 15 generates a recommended product layout. The recommended product layout is a recommended product layout. The score of the recommended product layout is higher than the score of the current product layout. The score is calculated by the calculation unit 13.

[0144] The generation unit 15 may use, for example, the reference product layout described in the second embodiment as the recommended product layout.

[0145] As described in the second embodiment, the reference product layout may be determined for each store location environment and stored in a storage device. In this case, the generation unit 15 can use, as the recommended product layout, the reference product layout corresponding to the store location environment for which the recommended product layout is to be determined.

[0146] As another example, the generation unit 15 may generate a recommended product layout by modifying the current product layout based on the reference product layout. For example, the generation unit 15 may identify modifications that increase the similarity with the reference product layout and apply the identified modifications to the current product layout to generate a recommended product layout.

[0147] The generation unit 15 can calculate the similarity between the reference product layout and the current product layout based on at least one of the types of products included in the product layout, the number of each product included in the product layout (the number of display sections allocated to each product), and the position of each product within the product layout (display position).

[0148] However, if unlimited revisions are allowed, the number of revisions may increase. Furthermore, when the product layout is actually changed on-site, that is, when the display of the actual products on the display shelves is changed according to the revisions, the workload on-site increases if there are many revisions. A recommended product layout with such problems may not be adopted. Thus, if unlimited revisions are allowed, an unrealistic recommended product layout will be generated and output.

[0149] Therefore, certain restrictions may be imposed on the modifications. The generation unit 15 may then identify modifications that maximize the similarity between the current product layout and the reference product layout under the restrictions, and apply the identified modifications to the current product layout to generate a recommended product layout. The contents of the modification restrictions are stored in advance in a storage device. The storage device may be provided in the processing device 10 or in an external device that can communicate with the processing device 10. The generation unit 15 can generate a recommended product layout under such pre-stored modification restrictions.

[0150] The content of the modification restriction varies, but may include, for example, at least one of the following: The number of products whose positions are to be changed in the current product layout is P １ ・The number of products to be deleted from the current product layout is P ２ ・The number of new products to be added to the current product layout is P ３・The number of display sections to change the allocated products is P ４ less than pcs

[0151] P １ ~P ４ is a predetermined integer of 1 or greater.

[0152] Next, a specific example of a process for modifying the current product layout will be described. Note that the example given here is merely an example and is not intended to be limiting.

[0153] First, the generation unit 15 identifies a display section to be modified within the current product layout. This modification involves changing the assigned product to another product. Next, the generation unit 15 determines the modification content for the display section identified as the target of modification. In other words, the generation unit 15 determines the new product to be assigned to the display section identified as the target of modification. An example of each process will be described below.

[0154] ○Process of identifying display sections to be modified within the current product layout For example, if information indicating the evaluation value when each product as shown in Figure 4 is displayed in each display section of a display shelf is available, the generation unit 15 may identify a predetermined number of display sections in order of lowest evaluation value as display sections to be modified.

[0155] Additionally, the generation unit 15 may specify at least one of the following as the display section to be corrected: A display section to which a product not included in the reference product layout is assigned A display section to which a product that is included in the reference product layout but is assigned a display position different from that in the reference product layout A display section to which a product that is included in the reference product layout but is assigned a display position different from that in the reference product layout, and the distance between its position in the reference product layout and its position in the current product layout is equal to or greater than a threshold A display section to which a product that is included in the reference product layout but is assigned a different number of display sections from that in the reference product layout A display section to which a product that is included in the reference product layout but is assigned a different number of display sections from that in the reference product layout, and the difference in number is equal to or greater than a threshold

[0156] For example, the generation unit 15 performs a simulation of multiple patterns of modifications to the display section identified as the target of modification, and calculates the score for each pattern. The generation unit 15 then determines the modification pattern with the highest score as the modification to be performed on that display section. Note that if multiple display sections are identified as the target of modification, each modification pattern can be defined as a combination of modifications to multiple display sections.

[0157] In each pattern of modification, the product to be newly allocated to the display section identified as the target of modification is shown.

[0158] The product to be newly allocated to the display section identified as the target of correction may be another product included in the current product layout, or may be a product not included in the current product layout. The product not included in the current product layout may be, for example, the additional recommended product described in the fifth embodiment or other products.

[0159] The determination of each pattern, i.e., the determination of the new product to be allocated to the display section identified as the target of modification, can be determined in accordance with predetermined selection rules. The generation unit 15 can determine at least one new product to be allocated to each display section in accordance with the selection rules. The generation unit 15 determines multiple patterns for performing the above simulation based on the determined content.

[0160] The selection rule may stipulate that a product that satisfies at least one of the following conditions be selected as a product to be newly allocated to each display section: - Included in the reference product layout - A product that is recommended for addition - If information indicating the evaluation value of each product when displayed in each display section of the display shelf as shown in Figure 4 is available, the product has an evaluation value equal to or greater than a threshold value in the display section to be processed (the display section for which a product is being considered to be newly allocated).

[0161] The generation unit 15 may generate the recommended product layout using a learning model that has been generated in advance by machine learning, or may generate the recommended product layout using other methods.

[0162] The calculation unit 13 calculates the score of the recommended product layout generated by the generation unit 15. The calculation unit 13 can calculate the score of the recommended product layout in the same manner as the calculation of the current product layout.

[0163] The output unit 14 further outputs the score of the recommended product layout and a recommended product layout image in which images of the products are arranged according to the recommended product layout.

[0164] A "recommended product layout image" is an image in which images of each product are arranged according to the recommended product layout. As described in the second embodiment, an "image of each product" is an image in which one product is shown per image. The images of each product arranged in the current product layout image and the images of each product arranged in the recommended product layout image may be the same images. In other words, the output unit 14 may generate the current product layout image and the recommended product layout image by using the same images of each product together.

[0165] 10 shows an example of a screen output by the output unit 14. In the example shown, the output unit 14 simultaneously displays the score of the current product layout, an image of the current product layout, the score of the recommended product layout, and an image of the recommended product layout on the screen.

[0166] Here, a modified example of the screen output by the output unit 14 will be described.

[0167] The output unit 14 may distinguishably display differences between the current product layout and the recommended product layout in at least one of the current product layout image and the recommended product layout image, as shown in FIG.

[0168] In the example of FIG. 11, the differences between the current product layout and the recommended product layout are clearly displayed in the recommended product layout image.

[0169] In the example of Fig. 11, a flashing display is used as the method of distinguishing display, but the method of distinguishing display is not limited to this means, and any method can be used. Also, in the example of Fig. 11, the above-mentioned differences are distinguishably displayed in the recommended product layout image, but the above-mentioned differences may also be distinguishably displayed in the current product layout image. Also, the above-mentioned differences may also be distinguishably displayed in both the recommended product layout image and the current product layout image.

[0170] As another modification, the output unit 14 may further output reference information indicating the reason for the change in score that each of the differences brings about when the current product layout is changed to the recommended product layout. For example, when the user selects a display section that is a difference on the screen as shown in Fig. 10 or 11, the output unit 14 may display reference information regarding the difference in a pop-up display, a separate window, or the like.

[0171] The reason for the change in score may be, for example, "the new product is more suitable for the display section than the original product." For example, in the information shown in Figure 4, if the evaluation value of the new product in the display section is higher than that of the original product, this reason may be adopted.

[0172] Other reasons for the change in score include "the new product is included in the reference product layout" and "the new product is a recommended product for addition." In the latter case, the output unit 14 may output the reason why the new product is a recommended product for addition. That is, the output unit 14 may output information indicating which of the various items described in the fifth embodiment is satisfied to make the new product a recommended product for addition.

[0173] As another variation, if there is a modification that is not implemented in the recommended product layout due to the above-mentioned modification restrictions but would further increase the score if implemented, the output unit 14 may further output information indicating the content of the modification. For example, the information may be, "If the number of display sections allocated to product QQ is increased to two, the score will increase."

[0174] As another modification, the output unit 14 may further display additional product information showing an image of the additional recommended product described in the fifth embodiment. That is, the output unit 14 may further display the additional product information on the screen of FIG. 10 or FIG. 11 .

[0175] As another modification, as described in the third embodiment, the change unit 16 may change the arrangement of the product images in the current product layout image output by the output unit 14 based on a user input. Then, the calculation unit 13 may calculate a score based on the changed current product layout. Then, the output unit 14 may update the score of the current product layout being output to a score based on the changed current product layout.

[0176] Furthermore, the change unit 16 may change the arrangement of the images of each product in the recommended product layout image output by the output unit 14 based on user input. Then, the calculation unit 13 may calculate a score based on the changed recommended product layout. Then, the output unit 14 may update the score of the recommended product layout being output to a score based on the changed recommended product layout.

[0177] Other configurations of the processing apparatus 10 of this embodiment are similar to those of the processing apparatus 10 of the first to fifth embodiments.

[0178] According to the processing apparatus 10 of this embodiment, it is possible to achieve the same effects as those of the processing apparatus 10 of the first to fifth embodiments.

[0179] Furthermore, the processing device 10 of this embodiment can simultaneously display the score of the current product layout, an image of the current product layout, the score of the recommended product layout, and an image of the recommended product layout on a screen, as shown in Fig. 10. Based on such a screen, the user can consider and decide on modifications to be made to the current product layout.

[0180] Furthermore, the processing device 10 can distinguishably display the differences between the current product layout image and the recommended product layout image, as shown in Fig. 11. Based on such a screen, the user can easily grasp the differences between the current product layout image and the recommended product layout image.

[0181] The processing device 10 can also output reference information indicating the reason for the change in score that each difference brings about when the current product layout is changed to the recommended product layout. Based on the reason, the user can consider and decide on the modification content to be made to the current product layout.

[0182] Furthermore, if there are any modifications that have not been implemented in the recommended product layout but would further increase the score if implemented, the processing device 10 can further output information indicating the details of those modifications. Based on that information, the user can consider and decide on the details of modifications to be made to the current product layout or the recommended product layout.

[0183] The processing device 10 can also change the arrangement of product images in the recommended product layout image based on user input and output a score for the rearranged recommended product layout. The user can rearrange the product images in the recommended product layout image and check the score for the rearranged product layout to find the optimal product layout.

[0184] Seventh Embodiment The processing device 10 of this embodiment has a function of calculating the order quantity of each product based on the product layout shown in the current product layout image and the product layout shown in the recommended product layout image. This will be described in detail below.

[0185] An example of a functional block diagram of the processing device 10 of this embodiment is shown in Fig. 12. As shown in Fig. 12, the processing device 10 has an acquisition unit 11, an identification unit 12, a calculation unit 13, an output unit 14, and an ordering unit 17. Although not shown, the processing device 10 may also include at least one of a generation unit 15 and a change unit 16.

[0186] The ordering unit 17 calculates the order quantity for each product based on the current product layout shown in the current product layout image.

[0187] Specifically, the ordering unit 17 identifies the products included in the current product layout and the number of display sections allocated to each product. Next, the ordering unit 17 calculates the required quantity for each product included in the current product layout based on the number of display sections allocated to each product.

[0188] The required quantity is the number of items required by the next order timing (estimated sales quantity). There are various ways to calculate the required quantity, but for example, the ordering unit 17 may calculate the required quantity by multiplying the number of display sections by a predetermined coefficient.

[0189] The ordering unit 17 also identifies the current inventory quantity for each product. Management of inventory quantities for each product can be achieved using any well-known technology. For example, the inventory quantity for each product is identified based on sales data, order data, and inventory data recorded in the POS system. Sales data indicates the number of units sold for each product. Order data indicates the order quantity for each product. Inventory data indicates the inventory quantity for each product at the time of inventory.

[0190] Then, the ordering unit 17 calculates the order quantity for each product included in the current product layout by subtracting the stock quantity from the required quantity.

[0191] The ordering unit 17 may calculate the order quantity for each product based on the recommended product layout shown in the recommended product layout image.

[0192] Alternatively, the ordering unit 17 may calculate the order quantity of each product based on the current product layout shown in the current product layout image after rearranging the images of each product based on user input.

[0193] Alternatively, the ordering unit 17 may calculate the order quantity for each product based on the recommended product layout shown in the recommended product layout image after rearranging the images of each product based on user input.

[0194] In either variant, the ordering unit 17 can calculate the order quantity of each product using a process similar to the process of calculating the order quantity of each product based on the current product layout shown in the current product layout image described above.

[0195] For example, an order button may be displayed on the screen displaying the score of the current product layout and the current product layout image, as shown in Fig. 13. Then, in response to an operation of the order button, the ordering unit 17 may calculate the order quantity of each product included in the current product layout image at that time.

[0196] The output unit 14 may then display the calculated order quantity on the screen. For example, the output unit 14 may display the order quantity of each product by superimposing it on the image of each product currently arranged in the product layout image.

[0197] Alternatively, the ordering unit 17 may calculate the order quantity in response to the operation of the order button and then actually perform the ordering process based on the calculated content. In this example, the processing device 10 is configured to be able to execute the ordering process in cooperation with the ordering system.

[0198] The contents of the ordering process vary and depend on the ordering system. For example, the ordering unit 17 may send ordering information linking the identification information of the product to be ordered with the order quantity to the ordering system. The ordering information may also include other information such as store identification information and desired delivery date. The store identification information is registered in advance as a default in the processing device 10. The desired delivery date may be automatically set, for example, to M days after the current date, where M is a predetermined integer of 1 or greater.

[0199] 14, an order button may be displayed on the screen displaying the score of the current product layout, the current product layout image, the score of the recommended product layout, and the recommended product layout image. In the example shown in the figure, the order button is displayed in association with each of the current product layout image and the recommended product layout image.

[0200] The ordering unit 17 may then calculate the order quantity of each product included in the current product layout image at that time in response to an operation of the order button linked to the current product layout image. The ordering unit 17 may also calculate the order quantity of each product included in the recommended product layout image at that time in response to an operation of the order button linked to the recommended product layout image. The processing after calculating the order quantity is the same as the example described above using FIG. 13 .

[0201] Other configurations of the processing apparatus 10 of this embodiment are similar to those of the processing apparatus 10 of the first to sixth embodiments.

[0202] According to the processing apparatus 10 of this embodiment, it is possible to achieve the same effects as those of the processing apparatus 10 of the first to sixth embodiments.

[0203] Furthermore, the processing device 10 of this embodiment can calculate the order quantity for each product based on the current product layout image and the recommended product layout image. In one example, the processing device 10 can actually process an order based on the calculated order quantity. Using such a processing device 10 improves the user's work efficiency.

[0204] Eighth Embodiment The processing device 10 of this embodiment repeatedly calculates the score of the current product layout at predetermined timing, and executes a warning process when the calculated score satisfies a warning condition.

[0205] The acquisition unit 11 repeatedly acquires images at predetermined timings.

[0206] For example, a camera installed in a store at a position and orientation that allows it to capture images of display shelves may repeatedly capture images at predetermined times. Then, the acquisition unit 11 may acquire the images.

[0207] Alternatively, a camera installed in a store at a position and orientation that allows it to capture images of the display shelves may continuously capture moving images, and the acquisition unit 11 may repeatedly acquire frame images from the moving images at predetermined timings.

[0208] Alternatively, a user may carry a camera and repeatedly photograph the display shelves at predetermined times. Alternatively, a mobile object equipped with a camera and moving around the store may repeatedly photograph the display shelves at predetermined times. The acquisition unit 11 may then acquire the images.

[0209] The predetermined timing may be, for example, every predetermined time (every hour, every day, every week, every month, etc.). Alternatively, the predetermined timing may be the timing when the user inputs an instruction to execute a process. The user may input the instruction via an input device included in the processing device 10. Alternatively, the user may input the instruction via an external device communicatively connected to the processing device 10. Examples of input devices include, but are not limited to, a touch panel, a mouse, a keyboard, physical buttons, a microphone, etc. Examples of external devices include, but are not limited to, a smartphone, a smart watch, a mobile phone, a tablet terminal, a personal computer, a POS register, a wearable terminal, etc.

[0210] The identification unit 12 identifies the current product layout based on the image acquired by the acquisition unit 11 .

[0211] The calculation unit 13 calculates a score of the current product layout in response to the identification of the current product layout by the identification unit 12.

[0212] The output unit 14 executes a warning process when the score of the current product layout satisfies the warning condition.

[0213] The warning conditions include at least one of the following: - The score is below a threshold value - The current score has fallen by a predetermined level or more from the most recent score (a fall of a predetermined value or more / a fall of a predetermined percentage or more) - The current score has fallen by a predetermined level or more from the highest previous score for the current product layout (a fall of a predetermined value or more, a fall of a predetermined percentage or more, etc.)

[0214] The processing device 10 may store past scores in a storage device to determine the warning condition. The storage device may be provided in the processing device 10 or in an external device that can communicate with the processing device 10.

[0215] The warning process is, for example, output of warning information via an output device included in the processing device 10. The output device may be, but is not limited to, a display, a projection device, a speaker, etc. Alternatively, the warning process may be a process of transmitting warning information to an external device communicatively connected to the processing device 10 and outputting the warning information via the output device included in the external device.

[0216] The warning information indicates at least one of the following: the existence of a display shelf that satisfies the warning condition; information identifying the display shelf that satisfies the warning condition; and information indicating the location of the display shelf that satisfies the warning condition.

[0217] The user who receives the notification can use the functions of the processing device 10 described in the first to seventh embodiments to check or change the current product layout.

[0218] Other configurations of the processing apparatus 10 of this embodiment are similar to those of the processing apparatus 10 of the first to seventh embodiments.

[0219] According to the processing apparatus 10 of this embodiment, it is possible to achieve the same effects as those of the processing apparatuses 10 of the first to seventh embodiments.

[0220] Furthermore, the processing device 10 of this embodiment repeatedly calculates the score of the current product layout at predetermined times and executes a warning process when the calculated score satisfies the warning condition. With this processing device 10, the user can check or change the current product layout at any time. As a result, the user can avoid the inconvenience of performing such processes at unnecessary times.

[0221] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-described embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.

[0222] In addition, in the flowcharts used in the above explanation, multiple steps (processes) are described in order. However, the order of execution of the steps performed in each embodiment is not limited to the order described. In each embodiment, the order of the steps shown in the figures can be changed to the extent that the content is not affected. Furthermore, each of the above-mentioned embodiments can be combined to the extent that the content is not contradictory.

[0223] Some or all of the above embodiments may be described as, but are not limited to, the following supplementary notes. 1. A processing device having: an acquisition means for acquiring an image of a product display shelf; an identification means for identifying a current product layout that is the current product layout on the display shelf based on the image; a calculation means for calculating a score of the current product layout; and an output means for outputting the score of the current product layout and a current product layout image in which images of each product are arranged in accordance with the current product layout. 2. The processing device described in 1, wherein the output means further outputs the score of a recommended product layout that is a recommended product layout, and a recommended product layout image in which images of each product are arranged in accordance with the recommended product layout. 3. The processing device described in 2, wherein the output means distinguishably displays differences between the current product layout and the recommended product layout in at least one of the current product layout image and the recommended product layout image. 4. The processing device described in 3, wherein the output means distinguishably displays product sections in which different products are assigned to each other in the current product layout image and the recommended product layout image. 5. 6. The processing device according to 3 or 4, wherein the output means outputs reference information indicating reasons for changes in the score caused by each of the differences when the current product layout is changed to the recommended product layout. 6. The processing device according to any of 1 to 5, wherein the output means distinguishably displays images of products recommended to be replaced with other products in the current product layout image. 7. The processing device according to any of 1 to 6, wherein the output means further outputs additional product information indicating images of recommended additional products that are products recommended to be added to the current product layout. 8. The processing device according to any of 1 to 7, further comprising change means for changing the arrangement of images of each product in the current product layout image based on user input, wherein the calculation means calculates the score of the product layout after the rearrangement, and wherein the output means outputs the score of the product layout after the rearrangement.9. The processing device according to any one of 1 to 8, wherein the acquisition means repeatedly acquires the image at a predetermined timing, the identification means identifies the current product layout based on the image in response to the acquisition of the image, the calculation means calculates a score of the current product layout in response to the identification of the current product layout, and the output means executes a warning process if the score of the current product layout satisfies a warning condition. 10. The processing device according to 2, further comprising a generation means for generating the recommended product layout by modifying the current product layout based on a reference product layout. 11. The processing device according to 10, wherein the generation means identifies modifications that will increase the similarity with the reference product layout, and applies the identified modifications to the current product layout to generate the recommended product layout. 12. The processing device according to 11, wherein the generation means calculates the similarity based on at least one of the type of products included in the product layout, the number of each product included in the product layout, and the position of each product in the product layout. 13. 14. The processing device described in 13, wherein the calculation means determines the products recommended for replacement with other products based on an absolute rating of each product in the current product layout image or a relative rating of each product in the current product layout image to other products in the current product layout image. 15. The processing device described in 7, wherein the calculation means determines the recommended additional products based on at least one of sales data of each product in a store different from the store where the current product layout was specified, sales data of each product in other stores different from the store where the current product layout was specified, sales data of each product in similar stores that satisfy a comparison condition with the store where the current product layout was specified, sales data of each product on a website, and word-of-mouth information of each product.16. The processing device described in any one of 1 to 15, having an ordering means for calculating an order quantity for each product based on the current product layout shown in the current product layout image. 17. The processing device described in any one of 2 to 5 and 10 to 12, having an ordering means for calculating an order quantity for each product based on the recommended product layout shown in the recommended product layout image. 18. The processing device described in 8, having an ordering means for calculating an order quantity for each product based on the rearranged product layout. 19. A processing method in which one or more computers acquire images of a product display shelf, identify a current product layout that is the current product layout on the display shelf based on the images, calculate a score for the current product layout, and output the score for the current product layout and a current product layout image in which images of each product are arranged according to the current product layout. 20. A recording medium storing a program that causes a computer to function as: an acquisition means for acquiring an image of a product display shelf; an identification means for identifying a current product layout, which is the current product layout on the display shelf, based on the image; a calculation means for calculating a score for the current product layout; and an output means for outputting the score for the current product layout and a current product layout image in which images of each product are arranged according to the current product layout.

[0224] Some or all of Supplements 2 to 18 that are dependent on the processing device of Supplement 1 described above may also be dependent on the processing method of Supplement 19 and the recording medium of Supplement 20 in the same dependent relationship as Supplement 1 and Supplements 2 to 18. Furthermore, within the scope of each of the above-described embodiments, some or all of the configurations described as Supplements can be realized in various hardware, software, various recording means for recording software, or systems.

[0225] REFERENCE SIGNS LIST 10 Processing device 11 Acquisition unit 12 Identification unit 13 Calculation unit 14 Output unit 15 Generation unit 16 Change unit 17 Ordering unit 1A Processor 2A Memory 3A Input / output I / F 4A Peripheral circuit 5A Bus

Claims

1. A processing device having: an acquisition means for acquiring an image of a product display shelf; an identification means for identifying a current product layout, which is the current product layout on the display shelf, based on the image; a calculation means for calculating a score of the current product layout; and an output means for outputting the score of the current product layout and a current product layout image in which images of each product are arranged according to the current product layout.

2. The processing device according to claim 1, wherein the output means further outputs the score of a recommended product layout, which is a recommended product layout, and a recommended product layout image in which images of each product are arranged according to the recommended product layout.

3. The processing device according to claim 2, wherein the output means distinguishably displays differences between the current product layout and the recommended product layout in at least one of the current product layout image and the recommended product layout image.

4. The processing device according to claim 3, wherein said output means distinguishes and displays product sections to which different products are assigned in said current product layout image and said recommended product layout image.

5. A processing device as described in claim 3 or 4, wherein the output means outputs reference information indicating the reason for the change in score caused by each of the differences when the current product layout is changed to the recommended product layout.

6. A processing device according to any one of claims 1 to 5, wherein the output means identifies and displays images of products that are recommended to be replaced with other products in the current product layout image.

7. A processing device according to any one of claims 1 to 6, wherein the output means further outputs additional product information indicating an image of a recommended additional product which is a product recommended for addition to the current product layout.

8. A processing device as described in any one of claims 1 to 7, further comprising a change means for changing the arrangement of the images of each product in the current product layout image based on user input, wherein the calculation means calculates the score of the product layout after the rearrangement, and the output means outputs the score of the product layout after the rearrangement.

9. A processing device as described in any one of claims 1 to 8, wherein the acquisition means repeatedly acquires the image at a predetermined timing, the identification means identifies the current product layout based on the image in response to acquisition of the image, the calculation means calculates a score of the current product layout in response to identification of the current product layout, and the output means executes a warning process if the score of the current product layout satisfies a warning condition.

10. The processing device of claim 2, further comprising generating means for generating the recommended product layout by modifying the current product layout based on a reference product layout.

11. The processing device according to claim 10, wherein the generating means identifies modifications that increase similarity with the reference product layout, and applies the identified modifications to the current product layout to generate the recommended product layout.

12. The processing device according to claim 11, wherein the generating means calculates the similarity based on at least one of the types of products included in the product layout, the number of each product included in the product layout, and the position of each product in the product layout.

13. The processing device of claim 6, wherein the calculation means determines products recommended for replacement with other products based on an absolute evaluation of each product in the current product layout image or a relative evaluation of each product in the current product layout image with other products in the current product layout image.

14. The processing device according to claim 13, wherein the calculation means performs the absolute evaluation or the relative evaluation based on at least one of sales data for each product in the store in which the current product layout has been identified, sales data for each product in other stores different from the store in which the current product layout has been identified, sales data for each product in similar stores that satisfy comparison conditions with the store in which the current product layout has been identified, sales data for each product on a website, and word-of-mouth information for each product.

15. The processing device according to claim 7, wherein the calculation means determines the additional recommended products based on at least one of sales data for each product in other stores different from the store in which the current product layout is identified, sales data for each product in similar stores that satisfy comparison conditions with the store in which the current product layout is identified, sales data for each product on a website, and word-of-mouth information for each product.

16. The processing device according to any one of claims 1 to 15, further comprising an ordering means for calculating an order quantity for each product based on the current product layout shown in the current product layout image.

17. The processing device according to any one of claims 2 to 5 and 10 to 12, further comprising an ordering means for calculating an order quantity for each product based on the recommended product layout shown in the recommended product layout image.

18. The processing device according to claim 8, further comprising an ordering means for calculating an order quantity for each product based on the rearranged product layout.

19. A processing method in which one or more computers acquire images of a product display shelf, identify a current product layout, which is the current layout of products on the display shelf, based on the images, calculate a score for the current product layout, and output the score for the current product layout and a current product layout image in which images of each product are arranged according to the current product layout.

20. A recording medium storing a program that causes a computer to function as: an acquisition means for acquiring an image of a product display shelf; an identification means for identifying a current product layout, which is the current layout of products on the display shelf, based on the image; a calculation means for calculating a score of the current product layout; and an output means for outputting the score of the current product layout and a current product layout image in which images of each product are arranged according to the current product layout.

Images