Information processing device, information processing method, and program

Abstract

To save labor in confirmation work on whether or not an advertisement is arranged on a rack, etc. as specified.SOLUTION: An information processing device comprises an image processing unit, a determination unit, and an output unit. The image processing unit acquires a position of a commodity, the position of an advertisement, information on the commodity targeted by the advertisement, the position of a rack label, and the information on the commodity targeted by the rack label, by analyzing an image in which a rack is captured. The determination unit determines whether or not the information on the commodity targeted by the advertisement coincides with the information on the commodity targeted by the rack label closet to the advertisement. The output unit outputs the information showing a determination result by the determination unit.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a technique for analyzing advertisements used in stores and the like. [Background technology]

[0002] One of the factors that affect sales at retail stores such as supermarkets, convenience stores, and drug stores is the advertising placed on display shelves (Point of purchase advertising: POP advertising).

[0003] Examples of techniques for checking whether product display work is performed correctly are disclosed in the following Patent Documents 1 to 3. Patent Document 1 discloses a technique for preparing related information indicating the correspondence between product information and electronic shelf labels in advance, and determining whether the correspondence between products and electronic shelf labels determined based on the positions of the products and the positions of the electronic shelf labels in an image matches the correspondence in the related information. Patent Document 2 discloses a technique for generating related information that associates the nearest product with an electronic shelf label based on the positions of the products and the electronic shelf labels in an image, and transmitting product information to the electronic shelf label based on the related information. Patent Document 3 discloses a technique for determining whether there is an error in the relationship between the number of types of products recognized from an image and the number of shelf labels, or in the relationship between the positions of products for each type recognized from the image and the positions of the shelf labels recognized from the image. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] International Publication No. 2016 / 052379 [Patent Document 2] International Publication No. 2016 / 052382 [Patent Document 3] International Publication No. 2016 / 052383 Summary of the Invention [Problem to be solved by the invention]

[0005] To maximize the effectiveness of advertising, it is necessary to place the advertisements according to regulations, but the task of checking whether the advertisements are placed on shelves according to regulations was done manually.

[0006] The present invention has been made in view of the above problems. One of the objects of the present invention is to reduce the labor required for checking whether advertisements are arranged on shelves or the like in a prescribed manner. [Means for solving the problem]

[0007] The information processing device according to the present disclosure includes: an image processing means for acquiring product positions, advertisement positions, information on products covered by the advertisements, shelf label positions, and information on products covered by the shelf labels by analyzing an image of the shelves; a determination means for determining whether or not information on a product targeted by the advertisement matches information on a product targeted by a shelf label closest to the advertisement; an output means for outputting information indicating a result of the determination by the determination means; Equipped with.

[0008] The information processing method according to the present disclosure includes: At least one computer By analyzing the captured image of the shelf, the positions of the products, the positions of the advertisements, information on the products covered by the advertisements, the positions of the shelf tags, and information on the products covered by the shelf tags are obtained; determining whether or not information on a product targeted by the advertisement matches information on a product targeted by a shelf label closest to the advertisement; outputting information indicating the result of the determination; This includes:

[0009] The program in this disclosure is At least one computer an image processing means for acquiring product positions, advertisement positions, information on products covered by the advertisements, shelf tag positions, and information on products covered by the shelf tags by analyzing captured images of the shelves; a determination means for determining whether or not information on a product targeted by the advertisement matches information on a product targeted by a shelf label closest to the advertisement; an output means for outputting information indicating a result of the determination by the determination means; Function as. Effect of the Invention

[0010] According to the present invention, it is possible to reduce the labor required to check whether advertisements are arranged on shelves or the like in a prescribed manner. [Brief description of the drawings]

[0011] The above objects, as well as other objects, features and advantages, will become more apparent from the following preferred embodiments and the accompanying drawings.

[0012] [Figure 1] 1 is a block diagram conceptually showing a functional configuration of an information processing device in a first embodiment. [Diagram 2] FIG. 1 is a diagram illustrating a configuration of a computer that realizes an information processing device. [Diagram 3] FIG. 11 is a block diagram conceptually showing the functional configuration of an information processing device according to a second embodiment. [Figure 4] 10 is a flowchart illustrating a flow of a process executed by an information processing apparatus according to a second embodiment. [Diagram 5] 4 is a diagram for explaining a first example of a criterion used by a determination unit. FIG. [Figure 6] 13 is a diagram for explaining a second example of a criterion used by the determination unit. FIG. [Figure 7] FIG. 11 is a diagram for explaining a third example of the criterion used by the determination unit. [Figure 8] FIG. 11 is a diagram for explaining a process performed by an information processing device according to a third embodiment. [Figure 9] FIG. 13 is a block diagram conceptually showing the functional configuration of an information processing device according to a fourth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] [First embodiment] [Functional configuration] FIG. 1 is a block diagram conceptually illustrating a functional configuration of an information processing device 10 in the first embodiment. As illustrated in FIG. 1, the information processing device 10 in this embodiment has an image processing unit 110, a determination unit 120, and an output unit 130. The information processing device 10 is, for example, a portable information processing device such as a smartphone or a tablet, but is not limited thereto. For example, the information processing device 10 may be, for example, a server device. In this case, the information processing device 10 acquires "images of products and advertisements arranged on a shelf" (described later) from a portable terminal such as a smartphone or a tablet, and transmits results of processing (described later) performed using the images to the portable terminal.

[0014] The image processing unit 110 acquires the positions of advertisements and products by analyzing images of products and advertisements arranged on shelves. The determination unit 120 determines whether the relationship between the positions of the products and the positions of the advertisements satisfies a criterion. The output unit 130 outputs information indicating the determination result by the determination unit 120.

[0015] [Hardware configuration] Each functional component of the information processing device 10 may be realized by hardware that realizes each functional component (e.g., a hardwired electronic circuit, etc.), or may be realized by a combination of hardware and software (e.g., a combination of an electronic circuit and a program that controls it, etc.). Below, a further description will be given of the case where each functional component of the information processing device 10 is realized by a combination of hardware and software.

[0016] The computer 1000 may be any of various computers. For example, the computer 1000 may be a PC (Personal Computer), a server machine, a tablet terminal, a smartphone, etc. The computer 1000 may be a dedicated computer designed to realize the information processing device 10, or may be a general-purpose computer.

[0017] FIG. 2 is a diagram illustrating a configuration of a computer 1000 that realizes the information processing device 10. The computer 1000 has a bus 1020, a processor 1040, a memory 1060, a storage device 1080, an input / output interface 1100, and a network interface 1120. The bus 1020 is a data transmission path for the processor 1040, the memory 1060, the storage device 1080, the input / output interface 1100, and the network interface 1120 to transmit and receive data to and from each other. However, the method of connecting the processor 1040 and the like to each other is not limited to bus connection. The processor 1040 is a processor realized by a central processing unit (CPU) or a graphics processing unit (GPU), etc. The memory 1060 is a main storage device realized by a random access memory (RAM), etc. The storage device 1080 is an auxiliary storage device realized by a hard disk drive (HDD), a solid state drive (SSD), a memory card, or a read only memory (ROM), etc.

[0018] The input / output interface 1100 is an interface for connecting the computer 1000 to an input / output device. For example, the input / output interface 1100 is connected to an input device such as a keyboard and an output device such as a display device.

[0019] The network interface 1120 is an interface for connecting the computer 1000 to a network. This network is, for example, a local area network (LAN) or a wide area network (WAN). The method for connecting the network interface 1120 to the network may be a wireless connection or a wired connection.

[0020] The storage device 1080 stores program modules that realize each function (image processing unit 110, determination unit 120, output unit 130) of the information processing device 10. The processor 1040 executes each of these program modules to realize each function corresponding to the program module.

[0021] According to this embodiment, the determination unit 120 determines whether the position of the advertisement satisfies a standard when the position of the product is used as a standard. Therefore, it is possible to reduce the work of checking whether the advertisement is placed on a shelf or the like as specified.

[0022] [Second embodiment] [Functional configuration] Fig. 3 is a block diagram conceptually showing a functional configuration of an information processing device 10 according to the second embodiment. As shown in Fig. 3, the information processing device 10 according to the present embodiment has a similar configuration to the information processing device 10 according to the first embodiment, except that the information processing device 10 communicates with a storage unit 20. In the example shown in Fig. 3, the storage unit 20 is a memory or storage, and is provided outside the information processing device 10. However, the storage unit 20 may be built into the information processing device 10.

[0023] The storage unit 20 stores the criteria used by the determination unit 120 when making a determination, by product type, product type, advertisement type, or advertisement type. There are multiple types of POP advertisements. As an example, there are types of POP advertisements that are arranged horizontally in front of a display shelf, types that are arranged vertically on the pillars of a display shelf, and types that are arranged above a display shelf. The storage unit 20 stores, for example, information indicating this type (advertisement type information) as well as the criteria used by the determination unit 120 when making a determination. The storage unit 20 may also store the above-mentioned criteria by POP advertisement (by advertisement identification information). Also, POP advertisements may be prepared in units that include multiple types of products, such as "food" and "lifestyle products". Also, POP advertisements dedicated to a specific product may be prepared. The storage unit 20 may store the criteria used by the determination unit 120 when making a determination, along with information indicating the type of the product (product type information). The storage unit 20 may store the above criteria by product (by product identification information). The criteria used here vary depending on the type of advertisement or the type of product, and specific examples will be described later with reference to Figs. 5, 6, and 7.

[0024] The storage unit 20 also stores various information used in image processing. For example, the storage unit 20 stores information (e.g., feature amounts) required to identify a product by image processing in association with product identification information that identifies the product. The storage unit 20 also stores information (e.g., feature amounts) required to identify an advertisement by image processing in association with advertisement identification information that identifies the advertisement. The storage unit 20 may store feature amounts for identifying the type of advertisement by type of advertisement (by advertisement type information). The storage unit 20 further stores advertisement type information corresponding to the advertisement identification information and identification information (product identification information) of the product targeted by the advertisement in association with the advertisement identification information. Note that the advertisement identification information may include information for identifying the type of advertisement.

[0025] [Example of operation] 4 is a flowchart illustrating the flow of processing executed by the information processing device 10 of the second embodiment. First, the image processing unit 110 of the information processing device 10 acquires an image to be processed (S10). This image is an image generated by capturing an image of a display shelf. If the information processing device 10 has an imaging unit, this image may be generated by this imaging unit. Also, this image may be generated by an imaging device external to the information processing device 10. In the latter case, this image may be transmitted from the imaging device to the information processing device 10, or may be transmitted to the information processing device 10 via storage.

[0026] Next, the image processing unit 110 analyzes the acquired image to identify the position of the product (S20). An example of the analysis process performed here is a feature matching process. The position identified by this analysis includes both the height position and the horizontal position. In this identification, the image processing unit 110 may further use information stored in the storage unit 20 to identify the type of product. Alternatively, the image processing unit 110 may further use information stored in the storage unit 20 to identify information related to the product. Here, the information related to the product may include at least any of information such as the product name, identifier (e.g., JAN (Japanese Article Number) code), the name of the group to which the product belongs (e.g., brand name), the product category to which the product belongs, the product content (e.g., 350 ml), the product size, the list price of each product, and the manufacturer (manufacturing manufacturer or sales manufacturer).

[0027] Next, the image processing unit 110 identifies the position of the advertisement by analyzing the acquired image (S30). One example of the analysis process performed here is a feature matching process. The position identified by this analysis includes both the vertical position and the horizontal position. During this identification, the image processing unit 110 further uses information stored in the memory unit 20 to identify the type of advertisement (advertisement identification information) and the product that the advertisement targets (product identification information). The image processing unit 110 may also use information stored in the memory unit 20 to identify the type of advertisement.

[0028] Next, the determination unit 120 uses the analysis result of the image processing unit 110 and the information stored in the storage unit 20 to determine whether the position of the advertisement based on the position of the product satisfies a criterion (S40). Specifically, the determination unit 120 reads out the criterion associated with the advertisement identification information specified by the image processing unit 110, or the criterion associated with the advertisement type information specified by the image processing unit 110. Then, the determination unit 120 determines whether the relationship between the position of the product and the position of the advertisement specified by the image processing unit 110 satisfies the read out criterion.

[0029] Next, the output unit 130 outputs the determination result by the determination unit 120 (S50). The output here means, for example, outputting the determination result to a display device included in the information processing device 10. In this output, the output unit 130 may output an image in which information (for example, a frame or an arrow) for recognizing an advertisement that does not satisfy the criteria is superimposed on the image acquired by the image processing unit 110. The output unit 130 may transmit the determination result to a server or the storage unit 20 for storage. The output unit 130 may perform output only when the criteria are not satisfied, or may perform output even when the criteria are satisfied.

[0030] It is preferable that the determination unit 120 specifies the product identification information corresponding to the advertisement identification information determined by the image processing unit 110 using the information stored in the storage unit 20. In this case, it is preferable that the determination unit 120 uses the position of the product corresponding to the specified product identification information among the positions of the products determined by the image processing unit 110 for the above-mentioned determination. In other words, it is preferable that the determination unit 120 uses the position of the advertisement and the position of the product targeted by the advertisement for the determination. It is preferable that the determination unit 120 determines whether or not the product identification information of the product targeted for the determination and the product identification information corresponding to the advertisement identification information determined by the image processing unit 110 match each other, instead of these processes.

[0031] 5 is a diagram for explaining a first example of a criterion used by the determination unit 120. In the example shown in this figure, the product 210 is placed on the display shelf 200, and the advertisement 220 is attached to the front of the display shelf 200. The criterion used by the determination unit 120 is the distance between the product 210 and the advertisement 220 (for example, the distance between the center of the product 210 and the center of the advertisement 220). If this distance is equal to or less than a reference value, the determination unit 120 determines that the advertisement is placed in a correct position, and if the distance exceeds the reference value, the determination unit 120 determines that the advertisement is placed in an incorrect position.

[0032] FIG. 6 is a diagram for explaining a second example of the criterion used by the determination unit 120. In the example shown in this figure, the positions of the product 210 and advertisement 220 are the same as in the first example. Therefore, the advertisement 220 extends in the width direction. The criterion used by the determination unit 120 is, for example, whether or not the one-dimensional position of the product 210 in the width direction of the image acquired by the image processing unit overlaps with the one-dimensional position of the advertisement 220 in the width direction of the same image. Specifically, the determination unit 120 determines whether or not the one-dimensional position of the product 210 in the width direction of the image acquired by the image processing unit overlaps with the one-dimensional position of the advertisement 220 in the width direction of the same image. M (the one-dimensional position of the product 210 in the width direction of the image) and the w A (one-dimensional position of advertisement 220 in the width direction of the image) overlaps with the area indicated by (a). If these areas overlap at least partially, determination unit 120 determines that the advertisement is placed in the correct position. If these areas do not overlap, determination unit 120 determines that the advertisement is placed in the wrong position.

[0033] 7 is a diagram for explaining a third example of the criterion used by the determination unit 120. In the example shown in this figure, the advertisement 220 extends vertically (in the height direction) along the support of the display shelf 200. The criterion used by the determination unit 120 is, for example, whether or not the one-dimensional position of the product 210 in the height direction of the image acquired by the image processing unit overlaps with the one-dimensional position of the advertisement 220 in the height direction of the same image. Specifically, the determination unit 120 determines whether or not the one-dimensional position of the product 210 in the height direction of the image acquired by the image processing unit overlaps with the one-dimensional position of the advertisement 220 in the height direction of the same image. M (the one-dimensional position of the product 210 in the height direction of the image) and the area indicated by h in FIG. A(one-dimensional position of advertisement 220 in the height direction of the image) overlaps with the area indicated by (a). If these areas overlap at least partially, determination unit 120 determines that the advertisement is placed in the correct position. If these areas do not overlap, determination unit 120 determines that the advertisement is placed in the wrong position.

[0034] However, the criteria used by the determination unit 120 are not limited to the examples shown in Figs. 5 to 7. For example, when the number of advertisements required for one row of shelves is specified, the image processing unit 110 may identify the number of advertisements per row of shelves, and the determination unit 120 may determine whether this number meets the specified number. The image processing unit 110 may also determine the inclination of the advertisements. In this case, the determination unit 120 may determine whether the inclination exceeds a certain value.

[0035] 5 to 7, the product 210 is placed on the display shelf 200, but the product 210 may also be placed on a cart. In this case, the criteria shown in FIG. 5, for example, may be used.

[0036] If the memory unit 20 stores information indicating the position where the advertisement should be placed (a position based on a second criterion, for example a specific location on a product shelf), the determination unit 120 may determine whether the advertisement is placed in the correct position. If the memory unit 20 stores an image of a display shelf to which an advertisement corresponding to the advertisement identification information is attached in association with the advertisement identification information, the determination unit 120 may calculate a degree of match (score) between this image and the image acquired by the image processing unit 110, and determine whether the degree of match is equal to or greater than a reference value. In either case, the output unit 130 outputs the determination result.

[0037] The determination unit 120 may also determine whether the advertisement is posted during the correct period. In this case, the output unit 130 outputs the determination result. For example, the storage unit 20 stores the period during which the advertisement should be posted in association with the advertisement identification information. The image processing unit 110 also acquires information indicating the date and time when the image to be processed was captured together with the image. The determination unit 120 determines whether the date and time acquired by the image processing unit 110 is included in the period stored in the storage unit 20. The output unit 130 may perform output only if it is outside the period.

[0038] As described above, in this embodiment, the determination unit 120 also determines whether the position of the advertisement satisfies the criteria when the position of the product is used as the reference. Therefore, it is possible to reduce the work of checking whether the advertisement is placed on the shelf or the like as specified.

[0039] [Third embodiment] 8 is a diagram for explaining the processing performed by the information processing device 10 according to the third embodiment. In this embodiment, the information processing device 10 performs the following processing in addition to the processing shown in the second embodiment.

[0040] First, shelf labels 230 are attached to the display shelves 200. The image processing unit 110 identifies the position of the shelf label 230. At this time, the image processing unit 110 also identifies the product targeted by the shelf label 230 in image processing. The image processing used here is, for example, character recognition processing, but may also be processing for reading a code (for example, a barcode or a two-dimensional code) possessed by the shelf label 230. The image processing unit 110 then identifies product identification information for that product. The product identification information is not particularly limited, but may be, for example, the name of the product acquired by character recognition processing, product identification information (such as a JAN code) read from the code, or image features that can be extracted from an image area recognized as a product in image processing.

[0041] Then, the determination unit 120 determines whether or not the product identification information of the product targeted by the advertisement 220 matches the product identification information of the shelf label 230 closest to the advertisement 220. The output unit 130 also outputs the result of this determination. Note that the output unit 130 may only output if there is no match.

[0042] As described above, in this embodiment as well, the determination unit 120 determines whether the position of the advertisement satisfies the criteria when the position of the product is used as a reference. Therefore, it is possible to reduce the labor required for checking whether the advertisement is placed on a shelf or the like as specified. Furthermore, the determination unit 120 further determines whether the product targeted by the shelf tag matches the product targeted by the advertisement. Therefore, it is possible to further reduce the labor required for checking whether the advertisement is placed on a shelf or the like as specified.

[0043] [Fourth embodiment] 9 is a block diagram conceptually showing the functional configuration of the information processing device 10 in the fourth embodiment. In this embodiment, the information processing device 10 has the same configuration as the information processing device 10 according to the second or third embodiment, except that the information processing device 10 can read out the information stored in the sales storage unit 22 and includes an analysis unit 140.

[0044] The sales storage unit 22 stores sales data for the store where the advertisement 220 is presented. This data can be compiled as sales data by product identification information and by period.

[0045] The storage unit 20 also stores, for each advertisement, information indicating the period during which the advertisement was posted in association with the product identification information targeted by the advertisement. The storage unit 20 also stores, for each advertisement, information indicating whether the position of the advertisement satisfied a criterion, in other words, information indicating the determination result by the determination unit 120.

[0046] Then, the analysis unit 140 generates information indicating the relationship between the determination result by the determination unit 120 for a certain advertisement and the sales of the product at the date and time when the advertisement was posted. For example, the analysis unit 140 reads out the period during which a certain advertisement was presented and the product specification information of the product targeted by the advertisement, using the information stored in the storage unit 20. Then, the analysis unit 140 calculates a total value of the sales corresponding to the read product specification information during the read period, and associates the calculation result with information indicating the determination result by the determination unit 120. The output unit 130 outputs the total value and the information indicating the determination result by the determination unit 120.

[0047] As described above, in this embodiment as well, the determination unit 120 determines whether the position of the advertisement satisfies a criterion when the position of the product is used as a reference. This makes it possible to reduce the work of checking whether the advertisement is placed on a shelf or the like as specified. Furthermore, the output unit 130 outputs the sales amount during the period in which the advertisement was displayed and information indicating whether the advertisement was displayed correctly (the determination result by the determination unit 120). This makes it possible to accurately verify the promotional effect of the advertisement.

[0048] Although the embodiments of the present invention have been described above with reference to the drawings, these are merely examples of the present invention, and various configurations other than those described above can also be adopted.

[0049] A part or all of the above-described embodiments can be described as, but is not limited to, the following supplementary notes. 1. an image processing means for acquiring positions of the advertisements and the products arranged on the shelves by analyzing images of the advertisements and the products; A determination means for determining whether or not a relationship between the position of the product and the position of the advertisement satisfies a criterion; an output means for outputting information indicating a result of the determination by the determination means; An information processing device comprising: 2. The determination means reads out the criteria from a storage means that stores the criteria by the type of the product, by the product, by the type of the advertisement, or by the advertisement. 1. An information processing device according to the present invention. 3. The criteria indicate a distance between the product and the advertisement. 1. An information processing device according to 1. or 2. 4. The shelf has a plurality of stages, the determination means determines whether or not a one-dimensional position of the product in a height direction of the image overlaps with a one-dimensional position of the advertisement in the height direction of the image, or whether or not a one-dimensional position of the product in a width direction of the image overlaps with a one-dimensional position of the advertisement in the width direction of the image; 1. An information processing device according to 1. or 2. 5. The image processing means analyzes the image to identify the type of the product and the type of product targeted by the advertisement; The determination means, in addition to determining the criteria, determines whether or not the type of the product identified by the image processing means matches the type of the product targeted by the advertisement. 5. An information processing device according to any one of 1 to 4. 6. The image processing means further identifies the position of the shelf label provided on the shelf and the type of product that the shelf label covers, the determination means determines whether or not a type of product targeted by the advertisement matches a type of product targeted by the shelf label closest to the advertisement. 6. An information processing device according to any one of 1 to 5. 7. The determination means determines whether or not the position of the advertisement satisfies a second criterion different from the first criterion. 7. An information processing device according to any one of 1 to 6. 8. the determination means reads out a period during which the advertisement should be displayed from a storage means that stores the period for each type of advertisement, and determines whether or not the date and time when the image was captured is included in the period; 8. An information processing device according to any one of 1. to 7. 9. an analysis means for generating information indicating a relationship between a result of the determination by the determination means and sales of the product during a period in which the advertisement was displayed; The output means outputs the information generated by the analysis means. 9. An information processing device according to any one of 1. to 8.

[0050] 10. The computer By analyzing an image of a product and an advertisement placed on a shelf, a position of an advertisement associated with the product and a position of the product are obtained; determining whether a relationship between the position of the product and the position of the advertisement satisfies a criterion; outputting information indicating the determination result; An information processing method comprising the steps of: 11. There are multiple types of said advertisements, The computer, reading out the criteria from a storage means that stores the criteria by the type of the product, by the product, by the type of the advertisement, or by the advertisement; The information processing method according to claim 10, further comprising: 12. The criteria indicate a distance between the product and the advertisement. 10. or 11. The information processing method according to claim 10. 13. The shelf has a plurality of stages, The computer, determining whether a one-dimensional position of the product in a height direction of the image overlaps with a one-dimensional position of the advertisement in the height direction of the image, or whether a one-dimensional position of the product in a width direction of the image overlaps with a one-dimensional position of the advertisement in the width direction of the image; 10. The information processing method according to 11. or 12. 14. The computer, analyzing the image to identify the type of product and the type of product targeted by the advertisement; In addition to determining the criteria, determining whether the identified product type matches the product type targeted by the advertisement. 14. The information processing method according to any one of 10. to 13., 15. The computer, Furthermore, the position of the shelf tag provided on the shelf and the type of product that the shelf tag covers are identified, determining whether or not the type of product targeted by the advertisement matches the type of product targeted by the shelf label closest to the advertisement; 15. The information processing method according to any one of 10. to 14., 16. The computer, determining whether the location of the advertisement satisfies a second criterion different from the first criterion; 16. The information processing method according to any one of 10. to 15., 17. The computer, reading out a period during which the advertisement should be displayed from a storage means that stores the period for each type of advertisement, and determining whether or not the date and time when the image was captured is included in the period; 17. The information processing method according to any one of 10. to 16., 18. The computer, generating information indicating a relationship between the determination result and the sales amount of the product during the period in which the advertisement was displayed, and outputting the generated information; 18. The information processing method according to any one of 10. to 17.,

[0051] 19. A program for causing a computer to execute the information processing method according to any one of 10. to 18.

[0052] This application claims priority based on Japanese Patent Application No. 2017-191792, filed on September 29, 2017, the disclosure of which is incorporated herein in its entirety.

Claims

1. an image processing means for acquiring product positions, advertisement positions, information on products covered by the advertisements, shelf label positions, and information on products covered by the shelf labels by analyzing an image of the shelves; a determination means for determining whether or not information on a product targeted by the advertisement matches information on a product targeted by a shelf label closest to the advertisement; an output means for outputting information indicating a result of the determination by the determination means; An information processing device comprising:

2. the determination means determines whether or not a type of product targeted by the advertisement matches a type of product targeted by the shelf label closest to the advertisement. The information processing device according to claim 1 .

3. the determination means reads out a period during which the advertisement should be displayed from a storage means that stores the period for each type of advertisement, and further determines whether or not the date and time when the image was captured is included in the period.

3. The information processing device according to claim 1 or 2.

4. an analysis means for generating information indicating a relationship between a result of the determination by the determination means and sales of the product during a period in which the advertisement was displayed; The output means outputs the information generated by the analysis means. The information processing device according to claim 1 .

5. At least one computer By analyzing the captured image of the shelf, the positions of the products, the positions of the advertisements, information on the products covered by the advertisements, the positions of the shelf tags, and information on the products covered by the shelf tags are obtained; determining whether or not information on a product targeted by the advertisement matches information on a product targeted by a shelf label closest to the advertisement; outputting information indicating the result of the determination; An information processing method comprising the steps of:

6. At least one computer, an image processing means for acquiring product positions, advertisement positions, information on products covered by the advertisements, shelf tag positions, and information on products covered by the shelf tags by analyzing images of the shelves; a determination means for determining whether or not information on a product covered by the advertisement matches information on a product covered by a shelf label closest to the advertisement; an output means for outputting information indicating a result of the determination by the determination means; A program to function as a

Images