Product display analysis device, product display analysis method, and program

Abstract

In order to identify a high-selling product and the location where the product is displayed, this product display analysis device (SB) comprises: a reception unit that receives, from a terminal (TM) of a store, a first photograph (SY (DT)) in which a product shelf (TA) in the store and products displayed on the product shelf (TA) are image-captured; and an inference unit (SR) that learns in advance a second photograph (SY (DT)) in which the product shelf (TA) and the products displayed on the product shelf (TA) are image-captured, and the correspondence relationship between the names of the products, the number of layers of the products displayed on the product shelf, and the number of display surfaces of the products, receives the first photograph (SY (DT)) as input, and infers a product display status composed of the product names of the products, the number of layers of the products displayed on the product shelf, and the number of display surfaces of the products in the store.

Description

Product Display Analysis Device, Product Display Analysis Method, and Program

[0001] The present disclosure relates to a product display analysis device, a product display analysis method, and a program.

[0002] The calculation method etc. for calculating an index for product advertising or product evaluation described in Patent Document 1 aims to calculate an index for accurately grasping the effect of advertising on a product. The above-described calculation method etc. calculates the ratio of the number of product purchasers to the number of product interest holders in a certain store in order to achieve the above-described purpose.

[0003] Japanese Patent No. 4750573

[0004] However, with the above-described calculation method etc., for example, in the above-described store, it was not possible to grasp which products are selling well and where they are located.

[0005] An object of the present disclosure is to identify products with good sales and the positions where those products are displayed.

[0006] To solve the above-described problems, a product display analysis device according to the present disclosure includes a receiving unit that receives a first photograph taken of product shelves in the store and products displayed on the product shelves from a terminal of the store, and a second photograph taken of product shelves and products displayed on the product shelves, and a correspondence relationship between the names of the products, the tiers on which the products are displayed on the product shelves, and the number of display surfaces of the products is learned in advance, and upon receiving the input of the first photograph, an inference unit that infers a product display situation in the store consisting of the product names of the products, the tiers on which the products are displayed on the product shelves, and the number of display surfaces of the products.

[0007] According to the product display analysis device according to the present disclosure, it is possible to identify products with good sales and the positions where those products are displayed.

[0008] This shows the configuration of the product display analysis system SBS of Embodiment 1. This shows the configuration of the product display analysis device SB of Embodiment 1. This shows the configuration of the terminal TM of Embodiment 1. This shows the configuration of the drug store DO1 of Embodiment 1. This shows the configuration of the product shelf TA of Embodiment 1. This shows the environment of the drug store DO1 of Embodiment 1. This shows the relationship between the input and output of the inference unit SR of Embodiment 1. This shows the configuration of the product display analysis device SB of Embodiment 2. This shows the relationship between the input and output of the inference unit SR and the generator SS of Embodiment 2. This shows the relationship between the input and output of the inference unit SR and the generator SS of Embodiment 2. This shows the product sales data SU (DT) of Embodiment 2. This is a flowchart showing the operation of the product display analysis system SBS of Embodiment 2. This is a flowchart showing the operation of the product display analysis system SBS of Modification 1. This is a flowchart showing the operation of the product display analysis system SBS of Modification 2. This is a flowchart showing the operation of the product display analysis system SBS of Modification 3. This shows the hardware configuration of the product display analysis system SBS of Embodiments 1 and 2. The hardware configuration based on the software implementation of the product display analysis system SBS of Embodiments 1 and 2 is shown.

[0009] Embodiment 1 of the product display analysis system related to this disclosure will be described below.

[0010] <Embodiment 1> The product display analysis system SBS of Embodiment 1 will be described.

[0011] <Configuration of Embodiment 1> Figure 1 shows the configuration of the product display analysis system SBS of Embodiment 1.

[0012] The product display analysis system SBS of Embodiment 1 includes a product display analysis device SB and a plurality of terminals TM, as shown in Figure 1.

[0013] As shown in Figure 1, the product display analysis device SB and the multiple terminals TM are interconnected via a network NW (for example, the Internet).

[0014] Multiple terminals TM are used by the drug group DG, the convenience store group KG, the supermarket group SG, food manufacturer ME(A), food manufacturer ME(B), food manufacturer ME(C), cosmetics manufacturer ME(D), and consumer goods manufacturer ME(E), as shown in Figure 1.

[0015] As shown in Figure 1, the drug group DG consists of, for example, multiple drug stores DO1, DO2, etc., a headquarters HO, and a convenience store CO. Headquarters HO provides advice, support, and instructions to the multiple drug stores DO1, DO2, etc., regarding, for example, the display of products (for example, food products SY(A)) on product shelves TA (for example, shown in Figures 4 and 5). The convenience store CO operates, for example, to complement the operations of the multiple drug stores DO1, DO2, etc.

[0016] The convenience store group KG consists of multiple convenience stores, such as KO1, KO2, and so on.

[0017] The Super Group SG consists of multiple supermarket stores, such as SU1, SU2, and so on.

[0018] Food manufacturer ME(A) manufactures and sells food product SY(A), food manufacturer ME(B) manufactures and sells food product SY(B), and food manufacturer ME(C) manufactures and sells food product SY(C). Food products SY(A), SY(B), and SY(C) are in a competitive relationship.

[0019] Cosmetics manufacturer ME(D) manufactures and sells cosmetics, and consumer goods manufacturer ME(E) manufactures and sells consumer goods (for example, laundry detergent, toilet paper).

[0020] <Configuration of the product display analysis device SB> Figure 2 shows the configuration of the product display analysis device SB of Embodiment 1.

[0021] The product display analysis device SB of Embodiment 1, as shown in Figure 2, includes an input / output unit NY (SB), a processing unit SY (SB), a storage unit KI (SB), and a communication unit TU (SB).

[0022] The input / output unit NY(SB) is used, for example, by the administrator (not shown) of the product display analysis device SB to perform input / output for monitoring and controlling the operation of the product display analysis device SB. The input / output unit NY(SB) is, for example, a keyboard, mouse, LCD monitor, or printer.

[0023] The processing unit SY(SB) has an inference unit SR, as shown in Figure 2. The inference unit SR receives photographic data SY(DT) (shown in Figure 7) as input and infers product display data SC(DT) (shown in Figure 7). Details of the inference unit SR will be described later.

[0024] The memory unit KI(SB) stores, for example, the data necessary for processing by the processing unit SY(SB).

[0025] The communications unit (TU / SB) performs communications via the network (NW).

[0026] The communications unit TU(SB) receives, for example, photo data SY(DT) (shown in Figure 7) from terminals TM of drug group DG, convenience store group KG, and supermarket group SG, and receives, for example, photo data SY(DT) of the product shelf TA (shown in Figure 5) of drug store DO1, and the food products SY(A) displayed on the product shelf TA.

[0027] Meanwhile, the communications unit TU(SB) transmits product display data SC(DT) (shown in Figure 7) to terminals TM of the drug group DG, convenience store group KG, supermarket group SG, and food manufacturers ME(A) to consumer goods manufacturers ME(E). For example, it transmits product display data SC(DT) for food product SY(A) on shelf TA of drug store DO1 to food manufacturer ME(B) of food product SY(B), which competes with food product SY(A).

[0028] <Configuration of Terminal™> Figure 3 shows the configuration of the terminal™ of Embodiment 1.

[0029] As shown in Figure 3, the terminal TM of Embodiment 1 includes an input / output unit NY(TM), a processing unit SY(TM), a storage unit KI(TM), and a communication unit TU(TM).

[0030] The input / output unit NY(TM) is used, for example, for employees JU of a drug store DO1 to use the terminal TM. The input / output unit NY(TM) is, for example, a keyboard, mouse, LCD monitor, and printer.

[0031] The processing unit SY(TM) performs processing related to, for example, the transmission of photographic data SY(DT) (shown in Figure 7) and the reception of product display data SC(DT) (shown in Figure 7).

[0032] The memory unit KI(TM) stores, for example, data necessary for processing by the processing unit SY(TM).

[0033] The communications unit (TU™) performs communications via the network (NW).

[0034] The communication unit TU(TM), for example, the communication unit TU(TM) of terminal TM in drug store DO1, transmits photographic data SY(DT) (shown in Figure 7) of the product shelf TA of drug store DO1 and the food product SY(A) displayed on the product shelf TA to the product display analysis device SB.

[0035] On the other hand, the communication unit TU(TM), for example, the communication unit TU(TM) of terminal TM of food manufacturer ME(B), receives product display data SC(DT) (shown in Figure 7) (shown in Figure 7) from product display analysis device SB regarding food product SY(A) displayed on product shelf TA of drug store DO1.

[0036] <Configuration of Drugstore DO1> Figure 4 shows the configuration of Drugstore DO1 in Embodiment 1.

[0037] Drugstore DO1 has multiple product shelves TA for displaying goods, such as food SY(A) (shown in Figure 1), as shown in Figure 4. The multiple product shelves TA are classified, as shown in Figure 4, for example, into regular shelves TA (TE), paid shelves TA (YU), and end shelves TA (EN).

[0038] The standard shelf TA (TE) is a shelf in drug store DO1 where products that are always stocked are displayed. Headquarters HO (illustrated in Figure 1) provides advice, support, and instructions regarding which products to display on the standard shelf TA (TE), which shelf on the standard shelf TA (TE) to display those products on (illustrated in Figure 5), and how many display surfaces CM (so-called face) of those products to use (illustrated in Figure 5).

[0039] A paid shelf TA(YU) is a shelf for a single manufacturer, for example, food manufacturer ME(A) (shown in Figure 1), to exclusively display its products, such as food SY(A). It can also be a shelf for multiple manufacturers, for example, food manufacturer ME(A), cosmetics manufacturer ME(D), and consumer goods manufacturer ME(E), to display their products in an oligopolistic manner.

[0040] The end shelf TA (EN) is a shelf where employees JU (especially the store manager) of drug store DO1 select and display products based on their own judgment, taking into account the location conditions of drug store DO1, i.e., the environment (illustrated in Figure 6).

[0041] As shown in Figure 4, the drug store DO1 has an entrance DE for shoppers (not shown) to enter and exit, and a cash register RE for shoppers to pay for their goods.

[0042] In drug store DO1, as shown in Figure 4A, for example, employee JU of drug store DO1 takes photographs of multiple product shelves TA on which multiple products (for example, food products SY(A)) are displayed using camera CA, and prepares photographic data SY(DT) (shown in Figure 7) of the product shelves TA and the multiple food products displayed on the product shelves TA.

[0043] In drug store DO1, instead of the employee JU mentioned above, multiple cameras CA installed at the four corners of drug store DO1 may be used to take photographs of multiple product shelves TA and multiple products (for example, food products SY(A)), as shown in Figure 4B.

[0044] In the drugstore DO1, instead of the above-mentioned employee JU and multiple cameras CA, a camera robot CR (a mobile robot equipped with a camera CA) may move within the drugstore DO1 and take pictures of multiple product shelves TA and multiple products (e.g., food SY(A)).

[0045] Other drugstores DO2, DO3, etc., convenience stores CO, multiple convenience stores KO1, KO2, etc., and multiple supermarkets SU1, SU2, etc. also have the same configuration as the drugstore DO1 (shown in FIG. 4).

[0046] 〈Configuration of the product shelf TA〉 FIG. 5 shows the configuration of the product shelf TA of Embodiment 1.

[0047] The product shelf TA (also shown in FIG. 4) is provided inside stores such as the drugstore DO1 as described above, and as shown in FIG. 5, it includes multiple shelf boards TI. As shown in FIG. 5, the position of the lowermost shelf board TI is the first, the position of the shelf board TI above it is the second, and in the product shelf TA of FIG. 5, the position of the uppermost shelf board TI is the sixth.

[0048] For example, on the third shelf board TI, food SY(A) (for two people) of food manufacturer ME(A) (shown in FIG. 1) is displayed, on the fourth shelf board TI, food SY(A) (for one person) of food manufacturer ME(A) is displayed, and on the sixth shelf board TI, food SY(B) (for two people) of food manufacturer ME(B) (shown in FIG. 1) is displayed.

[0049] Here, for example, for the products displayed on the fifth shelf board TI, there are two display surfaces CM (so-called faces, the front of the product package facing the aisle side). Generally, the more the number of product display surfaces CM, the better the sales of that product indicates.

[0050] As shown in FIG. 5, the product shelf TA has a shelf tag TG at its upper part. The shelf tag TG indicates the position of the product shelf TA inside stores such as the drugstore DO1 in the form of, for example, a one-dimensional barcode or a two-dimensional barcode.

[0051] FIG. 6 shows the environment of the drugstore DO1 of Embodiment 1.

[0052] As shown in Figure 6, the area surrounding drug store DO1 includes, for example, a high school, a bus stop, a hospital, an apartment building, and a train station. Store data TE(DT) (shown in Figure 10) indicating the environment of drug store DO1, including the presence of a high school, bus stop, hospital, apartment building, and train station in the surrounding area, is pre-stored, for example, in the memory unit KI(TM) of drug store DO's terminal TM.

[0053] Figure 7 shows the relationship between the input and output of the inference unit SR in Embodiment 1.

[0054] In the processing unit SY(SB) within the product display analysis device SB, the inference unit SR (shown in Figure 2) has pre-learned the correspondence between, for example, (1) product shelves TA (shown in Figure 5), and (2) photographic data SY(DT) of multiple products displayed on product shelves TA (for example, food products SY(A), shown in Figure 5), and (1) product names (product names, sizes), (2) the location of product shelves TA, (3) the number of shelves on product shelves TA (total number of shelves), (4) the position of the products (the number of shelves on product shelves TA (1st shelf, 2nd shelf, etc.)), and (5) the number of product display faces (faces) CM.

[0055] Here, the position of product shelf TA is obtained by a conventionally known method based on the shelf tag TG (shown in Figure 5) provided on product shelf TA.

[0056] As shown in Figure 7, the inference unit SR receives photographic data SY(DT) from a terminal TM such as a drug store DO1 and outputs product display data SC(DT). Here, the product display data SC(DT) includes, as shown in Figure 7, (1) product name, (2) position of product shelf TA, (3) number of shelves on product shelf TA, (4) position of product, and (5) number of product display faces CM.

[0057] <Correspondence> The inference unit SR of the product display analysis device SB corresponds to the "inference unit," and the communication unit TU(SB) of the product display analysis device SB corresponds to the "receiving unit" and the "transmitting unit."

[0058] The photo data SY(DT) corresponds to the "first photo," and the product display data SC(DT) corresponds to the "product display situation."

[0059] <Operation of Embodiment 1> Figure 8 is a flowchart showing the operation of the product display analysis system SBS of Embodiment 1.

[0060] The operation of the product display analysis system SBS of Embodiment 1 will be explained with reference to the flowchart in Figure 8.

[0061] In the following, for the sake of clarity and ease of understanding, the following assumptions are made: (1) Photographic data SY(DT) (shown in Figure 7) of the product shelf TA (shown in Figures 4 and 5) on which food product SY(A) is displayed is transmitted from the terminal TM of drug store DO1 to the product display analysis device SB. (2) The administrator of the product display analysis device SB (not shown) has a prior agreement with food manufacturer ME(B) (shown in Figure 1) to provide product display data SC(DT) (shown in Figure 7) indicating the display status of food product SY(A) to food manufacturer ME(B) (shown in Figure 1), which is a competitor to food product SY(A).

[0062] Step ST10: At drug store DO1, employee JU of drug store DO1 uses terminal TM to transmit photographic data SY(DT) of product shelves TA (e.g., regular shelf TA(TE), paid shelf TA(YU), end shelf TA(EN) (shown in Figure 4)) and multiple products (including food SY(A)) displayed on product shelves TA to product display analysis device SB. At product display analysis device SB, the communication unit TU(SB) receives, i.e., acquires, the photographic data SY(DT).

[0063] Step ST11: In the product display analysis device SB, the inference unit SR of the processing unit SY(SB) infers product display data SC(DT) from the photographic data SY(DT), as shown in Figure 7. More specifically, the inference unit SR infers product display data SC(DT) in drug store DO1, including (1) the product shelf TA (shown in Figures 4 and 5), and (2) the photographic data SY(DT) of food products SY(A) displayed on the product shelf TA, (1) the product name of food product SY(A), (2) the location of the product shelf TA, (3) the number of shelves on the product shelf TA, (4) the location of the food product SY(A), and (5) the number of display faces CM of the food product SY(A).

[0064] Step ST12: In the product display analysis device SB, the communication unit TU (SB) transmits product display data SC (DT) regarding food product SY (A) displayed on product shelf TA at drug store DO1 to the terminal TM of food manufacturer ME (B) of food product SY (B), which is competing with food product SY (A).

[0065] <Effects of Embodiment 1> As described above, in the product display analysis system SBS of Embodiment 1, the inference unit SR of the product display analysis device SB infers product display data SC(DT) from the photographic data SY(DT). This makes it possible to identify products that are selling well in drug store DO1 and the location where those products are displayed. More specifically, it becomes possible to determine which products are selling well, i.e., which products have a large number of display surface CMs (for example, which of food SY(A), food SY(B), or food SY(C)), and where on the product shelf TA those products are located (for example, the 3rd or 4th shelf).

[0066] In particular, in the product display analysis system SBS of Embodiment 1, the communication unit TU(SB) of the product display analysis device SB transmits product display data SC(DT) regarding food product SY(A) on the product shelf TA of drug store DO1 to the terminal TM of food manufacturer ME(B) of food product SY(B), which is competing with food product SY(A). As a result, food manufacturer ME(B) can understand and analyze the display status of food product SY(A) on the product shelf TA of drug store DO1, and consider measures to increase sales of food product SY(B).

[0067] <Embodiment 2> The product display analysis system SBS of Embodiment 2 will be described.

[0068] The product display analysis system SBS of Embodiment 2 generates product sales data SU(DT) in addition to inferring product display data SC(DT) in the product display analysis system SBS of Embodiment 1. The product sales data SU(DT) indicates whether or not the sales of the product are strong based on the number of display faces CM and the number of shelves (which shelf) on which the product is displayed on the product shelf TA.

[0069] <Configuration of Embodiment 2> The product display analysis system SBS of Embodiment 2 is basically the same as the configuration of the product display analysis system SBS of Embodiment 1 (for example, shown in Figure 1).

[0070] Figure 9 shows the configuration of the product display analysis device SB of Embodiment 2.

[0071] Figure 10 shows the relationship between the inputs and outputs of the inference unit SR and the generator SS in Embodiment 2.

[0072] The product display analysis device SB of Embodiment 2 differs from the product display analysis device SB of Embodiment 1 (shown in Figure 2) in that, as shown in Figure 9, the product display analysis device SB further includes a generator SS.

[0073] As shown in Figure 10, the generator SS receives product display data SC(DT) output from the inference unit SR, and also receives store data TE(DT) from drug store DO1, etc., and uses the product display data SC(DT) and store data TE(DT) to generate product sales data SU(DT).

[0074] Store data TE(DT), for example, store data TE(DT) received from drug store DO1, includes the store name of drug store DO1 (e.g., Shinjuku Station store, Yurakucho Station store), the environment of drug store DO1 (shown in Figure 6), and the specifications of drug store DO1 (e.g., the area and shape of the sales floor, the location of the entrance DE and cash register RE (shown in Figure 4)).

[0075] Figure 11 shows the product sales data SU(DT) for Embodiment 2.

[0076] As shown in Figure 11, the generator SS generates product sales data SU(DT) (shown in Figure 10) for, for example, the sales status of food product SY(A) (single serving) (shown in Figure 5) from food manufacturer ME(A) at drug store DO1.

[0077] More specifically, the generator SS, as shown in Figure 11A, creates a graph showing, for example, that food product SY(A) was displayed on the third shelf of the standard shelf TA(TE) (shown in Figure 4) at drug store DO1 during the most recent three months (August, September, and October), and that the number of display surfaces CM was gradually increasing.

[0078] The generator SS also creates a graph, as shown in Figure 11B, that for example, in the most recent three months (August, September, and October), food product SY(A) is displayed on the fourth shelf of the paid shelf TA(YU) (shown in Figure 4) at drug store DO1, and that the number of display surfaces CM increased in October.

[0079] The generator SS further generates a graph, as shown in Figure 11C, that for example, in the most recent three months (August, September, and October), food product SY(A) is displayed on the second shelf of the end shelf TA(EN) (shown in Figure 4) at drug store DO1, and that the number of display surfaces CM has not increased or decreased.

[0080] <Correspondence> The generator SS of the processing unit SY(SB) of the product display analysis device SB corresponds to the "generation unit", the store data TE(DT) corresponds to the "store status", and the product sales data SU(DT) corresponds to the "product sales status".

[0081] <Operation of Embodiment 2> Figure 12 is a flowchart showing the operation of the product display analysis system SBS of Embodiment 2.

[0082] The operation of the product display analysis system SBS of Embodiment 2 will be explained with reference to the flowchart in Figure 12.

[0083] In the following, for the sake of clarity and ease of explanation, the following will be assumed, as in Embodiment 1: (1) Photographic data SY(DT) (shown in Figure 10) of the product shelf TA (shown in Figures 4 and 5) on which food product SY(A) is displayed is transmitted from the terminal TM of drug store DO1 to the product display analysis device SB. (2) The administrator of the product display analysis device SB (not shown) has a prior agreement with food manufacturer ME(B) (shown in Figure 1) to provide product sales data SU(DT) (shown in Figures 10 and 11) indicating the sales status of food product SY(A) to food manufacturer ME(B) (shown in Figure 1), which is a competitor to food product SY(A).

[0084] Step ST20: Similar to step ST10 of Embodiment 1, in drug store DO1, employee JU of drug store DO1 uses terminal TM to transmit photographic data SY(DT) of product shelves TA in drug store DO1 and multiple products (including food SY(A)) displayed on product shelves TA to product display analysis device SB. In product display analysis device SB, the communication unit TU(SB) receives, i.e., acquires, the photographic data SY(DT).

[0085] Unlike step ST10 of Embodiment 1, in drug store DO1, employee JU of drug store DO1 transmits store data TE(DT) (shown in Figure 10) of drug store DO1 to product display analysis device SB using terminal TM. The product display analysis device SB, specifically the communication unit TU(SB), receives, i.e., acquires, the store data TE(DT).

[0086] To summarize the above, the product display analysis device SB acquires photo data SY (DT) and store data TE (DT) from the terminal TM of drug store DO1.

[0087] Step ST21: Similar to step ST11 of Embodiment 1, in the product display analysis device SB, as shown in Figure 10, the inference unit SR of the processing unit SY(SB) infers product display data SC(DT) from the photographic data SY(DT).

[0088] Step ST22: In the product display analysis device SB, as shown in Figure 10, the generator SS of the processing unit SY(SB) generates product sales data SU(DT) using product display data SC(DT) and store data TE(DT).

[0089] More specifically, the generator SS generates product sales data SU (DT) (shown in Figure 11) based on product display data SC (DT) including (1) the product name of food SY (A), (2) the location of product shelf TA, (3) the number of shelves on product shelf TA, (4) the location of food SY (A), and (5) the number of display faces CM of food SY (A) at drug store DO1, as well as store data TE (DT) including (a) the store name, (b) the environment (shown in Figure 6), and (c) the specifications for drug store DO1.

[0090] Step ST23: In the product display analysis device SB, the communication unit TU (SB) transmits product sales data SU (DT) to the terminal TM of food manufacturer ME (B) of food product SY (B), which is a competitor of food product SY (A).

[0091] <Effects of Embodiment 2> As described above, in the product display analysis system SBS of Embodiment 2, for drug store DO1, the inference unit SR of the product display analysis device SB infers product display data SC(DT) from photographic data SY(DT), and the generator SS generates product sales data SU(DT) (shown in Figure 10) using the product display data SC(DT) and store data TE(DT).

[0092] This allows for the identification of best-selling products and their display locations in drug store DO1, similar to Embodiment 1. In addition, unlike Embodiment 1, it becomes possible to identify which product shelf TA the best-selling products are displayed on (for example, whether they are on the standard shelf TA (TE), the paid shelf TA (YU), or the end shelf TA (EN)), and their exact position on the product shelf TA (for example, the second, third, or fourth shelf).

[0093] In particular, in the product display analysis system SBS of Embodiment 1, the communication unit TU(SB) of the product display analysis device SB transmits product sales data SU(DT) related to food product SY(A), which competes with food product SY(B), to the terminal TM of food manufacturer ME(B) of food product SY(B). As a result, food manufacturer ME(B) can grasp and analyze the sales status of food product SY(A) on the product shelf TA at drug store DO1, and by doing so, can more easily consider measures to increase sales of food product SY(B) compared to Embodiment 1.

[0094] <Modification 1> Figure 13 is a flowchart showing the operation of the product display analysis system SBS in Modification 1.

[0095] In the modified example 1 of the product display analysis system SBS, in step ST30 (following step ST11 in Embodiment 1 and step ST22 in Embodiment 2), the communication unit TU(SB) (shown in Figure 2) of the product display analysis device SB transmits the product display data SC(DT) (shown in Figure 7) and product sales data SU(DT) (shown in Figure 10) to the headquarters HO of the drug group DG, instead of transmitting them to the food manufacturer ME(B) (shown in Figure 1) (step ST12 in Embodiment 1 and ST23 in Embodiment 2).

[0096] In particular, it is desirable to transmit product display data SC(DT) and product sales data SU(DT) for products (e.g., food products SY(A), etc.) on standard shelves TA(TE) (shown in Figure 4) where headquarters HO provides advice, support, and instructions, and product display data SC(DT) and product sales data SU(DT) for products on end shelves TA(EN) where employees JU (especially the store manager) of drug store DO1 can select and display products at their discretion.

[0097] Through the above transmission, in other words, feedback from Headquarters HO to Drugstore DO1 regarding product selection and display allows Headquarters HO to determine whether the advice, support, and instructions from Headquarters HO to Drugstore DO1 are appropriate, and whether the product selection and display by the store manager of Drugstore DO1 are appropriate. If so, Headquarters HO can then determine whether the product selection and display at Drugstore DO1 should be horizontally deployed to other Drugstores DO2, etc.

[0098] <Modification 2> Figure 14 is a flowchart showing the operation of the product display analysis system SBS in Modification 2.

[0099] In the modified example 2 of the product display analysis system SBS, in step ST40 (following step ST11 in Embodiment 1 and step ST22 in Embodiment 2), the communication unit TU(SB) (shown in Figure 2) of the product display analysis device SB transmits product display data SC(DT) (shown in Figure 7) and product sales data SU(DT) (shown in Figure 10) to other drug stores such as DO2 within the drug group DG to which drug store DO1 belongs, instead of transmitting them to food manufacturer ME(B) (shown in Figure 1) (step ST12 in Embodiment 1 and ST23 in Embodiment 2).

[0100] In particular, it is desirable to transmit product display data SC (DT) and product sales data SU (DT) for products on end shelves TA (EN) where employees JU (especially the store manager) of drug store DO1 can select and display products at their discretion.

[0101] By sending the above information, employees JU of drug store DO2, etc., can refer to the unique product selection and display methods of the store manager of drug store DO1.

[0102] <Modification 3> Figure 15 is a flowchart showing the operation of the product display analysis system SBS in Modification 3.

[0103] In the modified example 3, the product display analysis system SBS, in step ST50 (following step ST11 in Embodiment 1 and step ST22 in Embodiment 2), the communication unit TU(SB) (shown in Figure 2) of the product display analysis device SB transmits the product display data SC(DT) (shown in Figure 7) and product sales data SU(DT) (shown in Figure 10) to the convenience store CO within the drug group DG to which the drug store DO1 belongs, instead of transmitting them to the food manufacturer ME(B) (shown in Figure 1) (step ST12 in Embodiment 1 and ST23 in Embodiment 2).

[0104] It is desirable to transmit any of the following: (a) product display data SC(DT) and product sales data SU(DT) for products (e.g., food products SY(A), etc.) on standard shelves TA(TE) (shown in Figure 4) where the headquarters HO of the drug group DG provides advice, support, and instructions; (b) product display data SC(DT) and product sales data SU(DT) for products on paid shelves TA(YU) where food manufacturers ME(A), etc., display food products SY(A), etc., at their own discretion; and (c) product display data SC(DT) and product sales data SU(DT) for products on end shelves TA(EN) where employees JU (especially the store manager) of drug stores DO1 can select and display products at their discretion.

[0105] Through the above transmission, employees JU (especially store managers) of convenience store COs within the drug group DG can judge whether the advice, support, and instructions regarding product selection and display from the headquarters HO of the drug group DG to drug store DO1 are appropriate, and can also refer to the selection and display of food products SY(A) etc. by food manufacturers ME(A), etc., and the independent product selection and display by the store manager of drug store DO1.

[0106] <Hardware Configuration of Embodiments 1 and 2> Figure 16 shows the hardware configuration of the product display analysis system SBS according to Embodiments 1 and 2.

[0107] The product display analysis system SBS of Embodiments 1 and 2 includes a processing circuit SYO as shown in Figure 16 in order to perform the functions described above, and further includes an input circuit NYU and an output circuit SYU as necessary.

[0108] The processing circuit SYO is dedicated hardware. The processing circuit SYO implements the functions of the product display analysis device SB, the processing unit SY(SB), and the processing unit SY(TM) of the terminal TM (shown in Figures 2 and 3).

[0109] The processing circuit SYO may be, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or a combination thereof.

[0110] The input circuit NYU and the output circuit SYU exchange inputs and outputs related to the operation of the processing circuit SYO with, for example, the product display analysis device SB and the outside of the terminal TM.

[0111] <Hardware configuration based on software implementation of Embodiments 1 and 2> Figure 17 shows the hardware configuration based on the software implementation of the product display analysis system SBS of Embodiments 1 and 2.

[0112] The product display analysis system SBS of Embodiments 1 and 2 includes a processor PRO and a memory circuit KIO, as shown in Figure 17, and optionally further includes an input circuit NYU and an output circuit SYU.

[0113] The processor PRO is a CPU (also known as a Central Processing Unit, processing unit, arithmetic unit, microprocessor, microcomputer, or DSP (Digital Signal Processing)) that executes programs. The processor PRO implements the functions of the product display analysis device SB, the processing unit SY(SB), and the processing unit SY(TM) of the terminal TM (as shown in Figures 2 and 3).

[0114] The processor PRO implements the above-described functions through software, firmware, or a combination of software and firmware. The software and firmware are written as a program PRG and stored in the memory circuit KIO.

[0115] The processor PRO realizes the above-described functions by reading and executing the above-described program PRG from the memory circuit KIO. The above-described program PRG can also be said to cause the computer to execute the procedures and methods of the product display analysis device SB and the processing unit SY(SB) and processing unit SY(TM) of the terminal TM.

[0116] Here, the memory circuit KIO includes, for example, non-volatile or volatile semiconductor memories such as RAM (Random Access Memory), ROM (Read Only Memory), flash memory, EPROM (Erasable Programmable Read Only Memory), and EEPROM (Electrically Erasable Programmable Read-Only Memory), as well as magnetic disks, flexible disks, optical disks, compact disks, minidiscs, DVDs (Digital Versatile Discs), etc.

[0117] Some of the functions of the processing units SY(SB) and SY(TM) of the product display analysis device SB and terminal TM may be implemented by the processing circuit SYO (shown in Figure 16), while other functions may be implemented by the processor PRO (shown in Figure 17).

[0118] As described above, the functions of the product display analysis device SB, the processing unit SY(SB), and the processing unit SY(TM) of the terminal TM can be realized by hardware, software, firmware, or a combination thereof.

[0119] The input circuit NYU and output circuit SYU exchange inputs and outputs related to the operation of the processor PRO with, for example, the product display analysis device SB and the terminal TM.

[0120] <Example of Configuration> The product display analysis device, product display analysis method, and program relating to this disclosure have, for example, the following configuration.

[0121] [Item 1] A product display analysis device comprising: a receiving unit that receives a first photograph taken of product shelves and products displayed on the product shelves in a store from a terminal in the store; and an inference unit that has previously learned the correspondence between a second photograph taken of product shelves and products displayed on the product shelves, the name of the product, the number of shelves on which the product is displayed, and the number of display surfaces of the product, and receives input of the first photograph to infer the product display situation in the store, consisting of the product name, the number of shelves on which the product is displayed, and the number of display surfaces of the product.

[0122] [Item 2] The product display analysis apparatus according to Item 1, further comprising a generating unit that receives store information from the store's terminal indicating the store name, environment, and specifications of the store, and generates product sales information that suggests the sales of the product at the store using the product display information and the store information.

[0123] [Item 3] The product display analysis device according to Item 1 or 2, further comprising a transmitting unit that transmits at least one of the product display status and the product sales status to at least one of the following: a terminal of a company that manufactures other products that compete with the product; a terminal of headquarters that instructs the display of the product on the shelves in the store; and a terminal of another store that belongs to the same group as the store.

[0124] [Item 4] The product display status and product sales status transmitted to the company's terminal are provided by the product display analysis device described in Item 3, relating to at least one of the regular shelves, paid shelves, and endcap shelves within the store.

[0125] [Item 5] The product display status and product sales status transmitted to the headquarters terminal are those of at least one of the regular shelves and end-cap shelves within the store, as described in item 3 of the product display analysis device.

[0126] [Item 6] The product display status and product sales status transmitted to the terminal of the other store are provided by the product display analysis device described in Item 3, relating to the end shelves within the store.

[0127] [Item 7] A product display analysis method comprising: a receiving step in which a computer receives a first photograph taken of product shelves and products displayed on the product shelves from a terminal in the store; and an inference step in which the computer has previously learned the correspondence between a second photograph taken of product shelves and products displayed on the product shelves, the name of the product, the number of shelves on which the product is displayed, and the number of display surfaces of the product, and receives input of the first photograph to infer the product display situation in the store, consisting of the product name, the number of shelves on which the product is displayed, and the number of display surfaces of the product.

[0128] [Item 8] A program for a computer to perform the following steps: a receiving step of receiving a first photograph taken from a store terminal of the store, which shows the shelves and the products displayed on them in the store; an inference step of receiving the first photograph as input and inferring the product display situation in the store, which consists of the product name, the number of shelves on which the product is displayed, and the number of display surfaces of the product, which the computer has previously learned as correspondences between the second photograph taken of the shelves and the products displayed on them, and the names of the products.

[0129] The product display analysis system described herein can be used to identify products that are selling well and the locations where those products are displayed.

[0130] SBS Product display analysis system, SB Product display analysis device, TM Terminal, DG Drug group, KG Convenience store group, SG Supermarket group, HO Headquarters, DO Drug store, CO Convenience store, KO Convenience store, SU Supermarket, ME Manufacturer, SY Food.

Claims

1. A product display analysis device comprising: a receiving unit that receives a first photograph taken of product shelves and products displayed on the product shelves from a terminal in the store; and an inference unit that has previously learned the correspondence between a second photograph taken of product shelves and products displayed on the product shelves, the name of the product, the number of shelves on which the product is displayed, and the number of display surfaces of the product, and receives input of the first photograph to infer the product display situation in the store, consisting of the product name, the number of shelves on which the product is displayed, and the number of display surfaces of the product.

2. The product display analysis apparatus according to claim 1, wherein the receiving unit further receives store information from the store's terminal indicating the store name, environment, and specifications of the store, and further includes a generating unit that generates product sales information indicating the sales of the product at the store using the product display information and the store information.

3. The product display analysis device according to claim 1 or 2, further comprising a transmitting unit that transmits at least one of the product display status and the product sales status to at least one of the following: a terminal of a company that manufactures other products that compete with the product; a terminal of headquarters that instructs the display of the product on the shelves in the store; and a terminal of another store that belongs to the same group as the store.

4. The product display analysis device according to claim 3, wherein the product display status and product sales status transmitted to the company's terminal relate to at least one of the regular shelves, paid shelves, and endcap shelves within the store.

5. The product display analysis device according to claim 3, wherein the product display status and product sales status transmitted to the terminal of the headquarters relate to at least one of the regular shelves and end shelves within the store.

6. The product display status and product sales status transmitted to the terminal of the other store relating to end shelves within the store, as described in claim 3 of the product display analysis device.

7. A product display analysis method comprising: a receiving step in which a computer receives a first photograph taken of product shelves and products displayed on the product shelves from a terminal in the store; and an inference step in which the computer has previously learned the correspondence between a second photograph taken of product shelves and products displayed on the product shelves, the name of the product, the number of shelves on which the product is displayed, and the number of display surfaces of the product, and receives input of the first photograph to infer the product display situation in the store, consisting of the product name, the number of shelves on which the product is displayed, and the number of display surfaces of the product.

8. A program for a computer to perform the following steps: a receiving step of receiving a first photograph taken from a store terminal of the store, which shows the shelves and the products displayed on them; an inference step of receiving the first photograph as input and inferring the product display situation in the store, which consists of the product name, the number of shelves on which the product is displayed, and the number of display surfaces of the product, which has been previously learned as a correspondence between the second photograph taken of the shelves and the products displayed on them; and the first photograph as input.

Images