Information output device, information output method, and program

Abstract

To provide information useful for consideration to facilitate purchase of products.SOLUTION: An information output device 1 includes: a viewer data acquisition unit 141 that acquires viewing position data indicating the viewing position of a viewer U who is looking at a product shelf displaying multiple products or an image of the product shelf displaying multiple products; a sales performance data acquisition unit 142 that acquires sales performance data indicating the sales performance of at least some of the multiple products; a specification unit 145 that specifies the sales performance of a viewing object product corresponding to the viewing position by referring to the viewing position data and the sales performance data; and an output unit 146 that outputs presentation information associated with the viewing position and the sales performance.SELECTED DRAWING: Figure 4

Description

Technical Field

[0001] The present invention relates to an information output device, an information output method, and a program.

Background Art

[0002] Conventionally, a system that outputs information including the purchasing behavior of customers in a retail store and the number of purchased items has been known (see, for example, Patent Document 1). The conventional system outputs information indicating which items placed on which shelves are likely to be purchased, based on the relationship between the result of identifying in which front of which product shelf a customer is located and the number of purchased items.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] A large number of items are placed on a product shelf, and there are differences in the likelihood of being purchased even among a plurality of items placed on the same product shelf. However, the conventional system has not been able to provide information regarding which items are likely to be purchased.

[0005] Therefore, the present invention has been made in view of these points, and an object thereof is to be able to provide information useful for consideration for making items placed on a product shelf likely to be purchased.

Means for Solving the Problems

[0006] The information output device according to the first aspect of the present invention includes a viewer data acquisition unit that acquires viewer position data indicating the viewing position of a viewer who is looking at a product shelf on which a plurality of products are displayed or an image of the product shelf on which the plurality of products are displayed, a sales performance data acquisition unit that acquires sales performance data indicating the sales performance of at least some of the plurality of products, a specifying unit that specifies the sales performance of the viewed product corresponding to the viewing position by referring to the viewing position data and the sales performance data, and an output unit that outputs presentation information in which the viewing position and the sales performance are associated with each other.

[0007] The specifying unit may further specify the duration during which the viewing position is being viewed, and the output unit may output the presentation information indicating the relationship between the length of the duration at the viewing position and the magnitude of the sales performance of the viewed product.

[0008] The output unit may output the presentation information indicating a combination of a plurality of time length ranges in which the lengths of the durations are different from each other and a plurality of performance ranges in which the magnitudes of the sales performances are different from each other.

[0009] The viewer data acquisition unit acquires first viewer position data indicating the viewing position while the viewer is walking toward the product shelf and second viewer position data indicating the viewing position while the viewer is within a predetermined range from the product shelf, and the output unit may output first presentation information in which the viewing position corresponding to the first viewer position data and the sales performance are associated with each other and second presentation information in which the viewing position corresponding to the second viewer position data and the sales performance are associated with each other.

[0010] The information output device further includes a storage unit that stores product position data in which the product type and the position of the product on the product shelf are associated with each other, the specifying unit specifies the sales performance corresponding to the viewing position for each type by referring to the product position data, and the output unit may output the presentation information for each type.

[0011] The information output device further includes a reception unit that receives a designation of a partial area in the product shelf, and the specifying unit specifies the sales record of the product to be visually recognized corresponding to the area based on the visual recognition positions included in the area designated by the reception unit, and the output unit may output the presentation information corresponding to the designated partial area.

[0012] The visual recognition person data acquisition unit further acquires biometric state data indicating the biometric state of the visual recognition person in association with the visual recognition position, and the output unit may output the presentation information indicating the biometric state of the visual recognition person in association with the visual recognition position based on the biometric state data.

[0013] The information output device further includes an image data acquisition unit that acquires product shelf image data that is an image of the product shelf and product image data that is an image of a product to be considered for placement on the product shelf, and a reception unit that receives a designation of a placement area that is an area for placing the product to be considered in the product shelf image data, and the output unit inputs the image data obtained by placing the product image data in the placement area in the product shelf image data into a machine learning model that machine-learns at least either the product shelf image data with a relatively large sales record of the product placed in the placement area or the product shelf image data with a relatively small sales record of the product placed in the area as teacher data and outputs an estimated level of sales record when product shelf image data is input, and may output estimated information indicating the estimated level of sales record of the product to be considered.

[0014] The image data acquisition unit acquires a plurality of different product image data, and the output unit may output the estimated information in association with the plurality of product image data.

[0015] The information output method according to the second aspect of the present invention includes steps of: a computer obtaining visual position data indicating a visual position of a viewer looking at a product shelf on which a plurality of products are displayed, or an image of a product shelf on which a plurality of products are displayed; obtaining sales performance data indicating the sales performance of at least some of the plurality of products; specifying the sales performance of the viewed product corresponding to the visual position by referring to the visual position data and the sales performance data; and outputting presentation information in which the visual position and the sales performance are associated with each other.

[0016] The program according to the third aspect of the present invention is a program for causing a computer to execute steps of: obtaining visual position data indicating a visual position of a viewer looking at a product shelf on which a plurality of products are displayed, or an image of a product shelf on which a plurality of products are displayed; obtaining sales performance data indicating the sales performance of at least some of the plurality of products; specifying the sales performance of the viewed product corresponding to the visual position by referring to the visual position data and the sales performance data; and outputting presentation information in which the visual position and the sales performance are associated with each other.

Effect of the Invention

[0017] According to the present invention, there is an effect that information useful for considering how to make the products placed on the product shelf easier to purchase can be provided.

Brief Description of the Drawings

[0018]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Embodiments for Carrying Out the Invention

[0019] [Overview of Information Processing System S] FIG. 1 is a diagram for explaining the overview of the information processing system S. The information processing system S is a system for developers of products, designers of product packages, store managers, etc. (hereinafter referred to as "developers, etc.") to easily consider how to make the products placed on the product shelves easier to purchase by grasping the relationship between the positions on the product shelves seen by customers who visit the store and the sales of the products. The store in this specification may be a store where a building actually exists, or may be a store such as an Internet mall where images can be viewed on a website.

[0020] The information processing system S includes an information output device 1, a visual recognition position specifying device 2, a POS (Point Of Sales) system 3, and an information terminal 4. The information output device 1 is a computer having a function of outputting presentation information indicating the relationship between the position on the product shelf seen by a customer who visits the store and the sales performance of the product. The information output device 1 may be installed in the store or may be a cloud server. The sales performance may be, for example, the number of products sold, or may be the sales amount of the product.

[0021] The visual recognition position specifying device 2 is a device for specifying the position that the viewer U who views the product shelves from the position of a customer who has visited the store is viewing. The viewer U may be an actual customer who has visited the store. The visual recognition position specifying device 2 has a function of detecting the position of the line of sight of the viewer U in a state where the viewer U is looking at the product shelf or an image of the product shelf. In the present embodiment, an example will be mainly described in which the visual recognition position specifying device 2 is a head-mounted display having a function of displaying an image of the product shelf, but the form of the visual recognition position specifying device 2 is arbitrary.

[0022] The visual recognition position specifying device 2 has an acceleration sensor and can detect the orientation of the face of the viewer U. By changing the orientation of the face of the viewer U, the position of the product shelf for which the visual recognition position specifying device 2 displays an image changes. That is, when the viewer U turns the face to the right, the visual recognition position specifying device 2 displays an image of the right area on the product shelf, and when the viewer U turns the face to the left, the visual recognition position specifying device 2 displays an image of the left area on the product shelf.

[0023] The visual recognition position specifying device 2 detects the position that the viewer U is viewing and transmits visual recognition position data indicating the detected visual recognition position to the information output device 1. The visual recognition position is the position of the line of sight of the viewer U when viewed on a preset two-dimensional plane or within a three-dimensional space, and is represented by coordinates with a predetermined position in the store as the origin, for example.

[0024] The visual recognition position may be the position of the area that the viewer U is viewing among a plurality of areas (for example, a plurality of shelves) on the product shelf, may be the position of the product that the viewer U is viewing among a plurality of products placed on the product shelf, or may be the position of a specific area (for example, the product name) among the products. Further, the visual recognition position may be the position of a POP (Point of Purchase advertising) advertising plate or a price tag on which an explanation about the product placed on the product shelf is written. When the visual recognition position specifying device 2 has a function of detecting the position in the depth direction that the viewer U is viewing based on, for example, the line-of-sight directions of both eyes of the viewer U, the visual recognition position may be the position that the viewer U has viewed in a three-dimensional space including the area where a plurality of products are placed on the product shelf.

[0025] In the visual recognition position data, the time and the position being visually recognized by the viewer U are associated. The visual recognition position specifying device 2 may transmit the visual recognition position data to the information output device 1 in real time, or may transmit the visual recognition position data to the information output device 1 after temporarily storing the visual recognition position data acquired over a predetermined period. The visual recognition position specifying device 2 transmits the visual recognition position data to the information output device 1 via, for example, a wireless channel W (e.g., Wi-Fi (registered trademark)).

[0026] The POS system 3 is a system that manages sales performance data in a store. The POS system 3 records the date and time of sale for each product and creates sales performance data in which the product and the number of sales are associated. The POS system 3 transmits the sales performance data to the information output device 1 in response to a request from the information output device 1.

[0027] The information terminal 4 is a computer used by developers or the like. The information terminal 4 displays the information provided by the information output device 1. Further, the information terminal 4 accepts the input of various data set in the information output device 1, stores image data (e.g., product shelf image data or product image data) used for creating the presentation information presented by the information output device 1, and transmits the stored image data to the information output device 1. The information terminal 4 may be installed in the store or may be installed outside the store. When the information terminal 4 is installed outside the store, the information terminal 4 displays the presentation information received from the information output device 1 via the Internet. The information displayed by the information terminal 4 is, for example, presentation information in which the visual recognition position and the sales performance are associated.

[0028] FIG. 2 is a diagram for explaining presentation information. In FIG. 2, three shelves T1, T2, and T3 are shown, and a plurality of products shown as rectangles are placed on each shelf. FIG. 2(a) is a diagram showing products with relatively high sales volume and products with relatively low sales volume created based on sales performance data. The products indicated by hatching in FIG. 2(a) are products whose sales volume in a predetermined period (for example, one week) is equal to or higher than the average value of the sales volume of each product, and the products not indicated by hatching are products whose sales volume is less than the average value.

[0029] FIG. 2(b) is a diagram showing positions where the viewing time or the number of viewings is relatively high, created based on viewing position data. The area indicated by dots in FIG. 2(b) is an area where the viewing time in the predetermined period during which the sales volume in FIG. 2(a) was counted is equal to or higher than the average value of the viewing time of each area.

[0030] FIG. 2(c) is an example of presentation information in which the viewing position and the sales performance are associated. In FIG. 2(c), the products included in the area where the sales volume in FIG. 2(a) is equal to or higher than the average value and the viewing frequency in FIG. 2(b) is equal to or higher than the average value are displayed in black. By displaying such presentation information on the information terminal 4, developers or the like who view the presentation information can recognize that there is a correlation between the viewing position and the sales performance. In addition, since the products displayed in black are easy for the viewer U to view and easy to sell, developers or the like can refer to the package design (that is, the shape, color, and arrangement of characters and images) of the products displayed in black to develop products that are easy to purchase.

[0031] In FIG. 2, presentation information is created based on the results of classifying the sales volume and the viewing time into two levels, but presentation information may also be created based on the results classified into more levels. Specifically, the information output device 1 classifies the sales results into a plurality of result ranges, classifies the viewing time into a plurality of time length ranges, and creates presentation information that can identify which combination among the plurality of combinations of the plurality of result ranges and the plurality of time length ranges each of the plurality of products belongs to. By the information output device 1 creating such presentation information, it becomes easier for developers and the like to further consider which products with what package designs should be developed.

[0032] Also, in FIG. 2, the viewing position was determined for the entire package of one product, but presentation information may also be created based on more classified results. Specifically, the information output device 1 classifies the package of the product into characters, images, etc., and for each of the plurality of products, creates presentation information that can identify whether the time when characters are viewed is longer or the time when images are viewed is longer. By the information output device 1 creating such presentation information, it becomes easier for developers and the like to further consider which products with what package designs should be developed.

[0033] In the presentation information, the aspect of the area of the POP advertisement or price tag of the product may be in an aspect corresponding to the sales results of the product corresponding to the POP advertisement or price tag. By the information output device 1 creating such presentation information, it becomes easier for developers and the like to consider which POP advertisements or price tags should be created.

[0034] FIG. 3 is a diagram showing another example of the presentation information. Instead of creating presentation information showing the relationship between the viewing position and the sales results by an image as shown in FIG. 2, the information output device 1 may create presentation information showing the relationship between the viewing position and the sales results by text as shown in FIG. 3. The upper numbers displayed overlapping the rectangles indicating each product in FIG. 3 indicate the sales volume of the product during a predetermined period, and the lower numbers indicate the values obtained by normalizing the time viewed during the predetermined period.

[0035] The normalized value is determined as follows based on the visual recognition time. Normalized value 1: The visual recognition time is 0 to 20% of the maximum visual recognition time Normalized value 2: The visual recognition time is 20 to 40% of the maximum visual recognition time Normalized value 3: The visual recognition time is 40 to 60% of the maximum visual recognition time Normalized value 4: The visual recognition time is 60 to 80% of the maximum visual recognition time Normalized value 5: The visual recognition time is 80 to 100% of the maximum visual recognition time

[0036] Also in FIG. 3, it shows a tendency that the larger the visual recognition time, the larger the number of sales. Developers and the like can also recognize that there is a correlation between the visual recognition position and the sales results by looking at the information as shown in FIG. 3, and can lead to the development of products that are easy to visually recognize and easy to purchase. In addition, when there are parts where the visual recognition time is small but the number of sales tends to increase, which can be confirmed here and there in FIG. 3, developers and the like can understand that the shelf position and the package design are special positions and products that do not correlate with the visual recognition position.

[0037] [Configuration and Operation of Information Output Device 1] FIG. 4 is a diagram showing the configuration of the information output device 1. The information output device 1 includes a first communication unit 11, a second communication unit 12, a storage unit 13, and a control unit 14. The control unit 14 includes a viewer data acquisition unit 141, a sales result data acquisition unit 142, an image data acquisition unit 143, a reception unit 144, a specification unit 145, and an output unit 146.

[0038] The first communication unit 11 has a communication interface for receiving visual recognition position data from the visual recognition position specifying device 2. The first communication unit 11 inputs the received visual recognition position data to the viewer data acquisition unit 141.

[0039] The second communication unit 12 has a communication interface for transmitting and receiving various data to and from the POS system 3 and the information terminal 4. The second communication unit 12 inputs the sales performance data received from the POS system 3 to the sales performance data acquisition unit 142. The second communication unit 12 inputs the image data received from the information terminal 4 to the image data acquisition unit 143. The second communication unit 12 inputs the setting data received from the information terminal 4 to the reception unit 144. The second communication unit 12 transmits the presentation information input from the output unit 146 to the information terminal 4.

[0040] The storage unit 13 has storage media such as a ROM (Read Only Memory), a RAM (Random Access Memory), and an SSD (Solid State Drive). The storage unit 13 stores the programs executed by the control unit 14. Further, the storage unit 13 stores various data used by the output unit 146 to create presentation information. The storage unit 13 stores, for example, the visual position data received by the first communication unit 11, the sales performance data received by the second communication unit 12, and the merchandise shelf image data. The storage unit 13 may also store merchandise position data in which the type of merchandise is associated with the position of the merchandise on the merchandise shelf. The type of merchandise may be represented, for example, as beverages, foods, confectioneries, or by the manufacturer name of the merchandise, or by the name of the merchandise.

[0041] FIG. 5 is a diagram showing an example of sales performance data including merchandise positions. In the sales performance data shown in FIG. 5, a merchandise ID, the type of merchandise, the manufacturer name of the merchandise, and the position on the merchandise shelf where the merchandise is placed are associated with each other. The position where the POP advertisement of the merchandise is placed may be further associated with the merchandise ID.

[0042] Returning to FIG. 4, the operations of each part of the control unit 14 will be described. The viewer data acquisition unit 141 acquires viewer position data indicating the viewing position of the viewer U who is looking at an image of a product shelf on which a plurality of products are displayed or a product shelf on which a plurality of products are displayed, via the first communication unit 11. When the viewing position specifying device 2 has a function of detecting the biological state of the viewer U, the viewer data acquisition unit 141 may further acquire biological state data indicating the biological state of the viewer U in association with the viewing position. The biological state is, for example, the pupil diameter of the viewer U, the timing of blinking, brain waves (e.g., beta waves or theta waves), or heartbeat fluctuations. The viewer data acquisition unit 141 stores the acquired viewer position data and biological state data in the storage unit 13.

[0043] The viewer data acquisition unit 141 may acquire the viewer position data in association with the state of the viewer U from when the viewer U enters the store until the viewer U selects the product to be purchased. The state of the viewer U is classified into, for example, a state of selecting a product shelf where there is a product the viewer U wants to buy, a state of advancing toward the selected product shelf (advancing state), a state of comparing a plurality of products on the product shelf (comparing state), and a state of purchasing the product the viewer U has decided to buy.

[0044] Among these multiple states, the viewer U looks at the packages of multiple products in the advancing state and the comparing state. Therefore, the relationship between the viewing position and the sales performance in these states is considered useful for developers and the like. Thus, the viewer data acquisition unit 141 may acquire first viewer position data indicating the viewing position while the viewer U is walking toward the product shelf (i.e., during the advancing state), and second viewer position data indicating the viewing position while the viewer U is within a predetermined range from the product shelf (i.e., during the comparing state).

[0045] The sales performance data acquisition unit 142 acquires sales performance data indicating the sales performance of at least some of the plurality of products via the second communication unit 12. The viewer data acquisition unit 141 stores the acquired sales performance data in the storage unit 13.

[0046] The image data acquisition unit 143 acquires, via the second communication unit 12, the merchandise shelf image data that is an image of the merchandise shelf and the product image data that is an image of the product under consideration to be placed on the merchandise shelf. The image data acquisition unit 143 stores the acquired merchandise shelf image data and product image data in the storage unit 13.

[0047] The reception unit 144 receives, via the second communication unit 12, various specifications input by developers or the like on the information terminal 4. The reception unit 144 receives, for example, a specification of the type of product that is the target for which the output unit 146 outputs the presentation information.

[0048] The reception unit 144 may receive a specification of a partial area of the merchandise shelf that is the target for which the presentation information is to be output. In this case, the reception unit 144 receives, via the second communication unit 12, a specification of a partial area on the merchandise shelf. As information specifying a partial area on the merchandise shelf, the reception unit 144 may acquire, for example, data indicating addresses assigned to each of a plurality of areas on the merchandise shelf, or may acquire data indicating the coordinates of the four corners of the area. The reception unit 144 notifies the specifying unit 145 of the specified content.

[0049] The specifying unit 145 specifies the sales performance of the product to be visually recognized corresponding to the visual recognition position by referring to the visual recognition position data and the sales performance data. The specifying unit 145 specifies, for example, the position indicated as being visually recognized by the viewer U in the visual recognition position data, and specifies the sales performance of the product associated with the specified position in the sales performance data indicating the product position shown in FIG. 5. Thereby, the specifying unit 145 can specify the sales performance of the product placed at the position visually recognized by the viewer U.

[0050] When the time for viewer U to visually recognize the position where a certain product A is placed is short, viewer U may not recognize product A and may simply have product A placed on the path where the line of sight was moved to look at another product B. Therefore, the specifying unit 145 may further specify the duration for which the visual recognition position has been visually recognized. The specifying unit 145 may specify which time duration range among a plurality of time duration ranges the duration for which the visual recognition position has been visually recognized is included in. In this case, the specifying unit 145 specifies the sales record of the product to be visually recognized corresponding to the visual recognition position where the duration is equal to or greater than the threshold value.

[0051] Incidentally, depending on the type of product, it is assumed that the magnitude of the influence exerted by the product package on viewer U while viewer U compares products differs. For example, viewer U is considered to have difficulty distinguishing differences in images and characters drawn on the packages of small products. Therefore, the specifying unit 145 may specify the sales record corresponding to the visual recognition position for each type of product by referring to product position data in which the type of product and the position of the product on the product shelf are associated.

[0052] Also, there may be cases where developers or the like want to analyze the differences in the relationship between the visual recognition position and the sales record according to the position on the product shelf. Therefore, the specifying unit 145 may specify the sales record of the product to be visually recognized corresponding to the designated area based on the visual recognition positions included in a part of the area on the product shelf that the reception unit 144 has received the designation for.

[0053] The output unit 146 outputs presentation information in which the visual recognition position and the sales record of the product (i.e., the product to be visually recognized) visually recognized at the visual recognition position are associated. The output unit 146 transmits the presentation information shown in, for example, Fig. 2(c) to the information terminal 4 via the second communication unit 12. By the output unit 146 outputting such presentation information, developers or the like who view the presentation information can grasp that there is a correlation between the visual recognition position and the sales record of the product.

[0054] When the reception unit 144 receives the designation of a partial area in the product shelf, the output unit 146 may output presentation information corresponding to the designated partial area. The output unit 146 outputs, for example, presentation information indicating the relationship between the viewing time of the product group placed in the designated area and the sales performance, presentation information indicating the relationship between the viewing time of the products placed in the designated area and the sales performance, or presentation information indicating the relationship between the viewing time of the characters corresponding to the designated area and the sales performance.

[0055] The output unit 146 may output presentation information for each product type based on the result of the identification unit 145 identifying the sales performance corresponding to the viewing position for each product type. For example, when the reception unit 144 receives the designation of a product type from a developer or the like, the output unit 146 outputs presentation information in which a time length range corresponding to one or more products corresponding to the designated type is associated with the sales performance (for example, the performance range) of the product. By the output unit 146 outputting presentation information for each product type, even when the tendency of the relationship between the viewing position and the sales performance differs for each product type, it becomes possible for the developer or the like to obtain information suitable for the products of the type being developed by the developer or the like.

[0056] The output unit 146 may output presentation information indicating the relationship between the length of the duration at the viewing position and the magnitude of the sales performance of the product being viewed. For example, like the presentation information shown in FIG. 3, the output unit 146 outputs presentation information indicating a combination of a plurality of time length ranges with different lengths of the duration and a plurality of performance ranges with different magnitudes of the sales performance. The output unit 146 may output presentation information in which an image of a mode corresponding to a combination of a plurality of time length ranges with different lengths of the duration and a plurality of performance ranges with different magnitudes of the sales performance is superimposed on the image of the product shelf.

[0057] For example, when there are five time length ranges and five performance ranges, the output unit 146 outputs presentation information indicating 5×5 = 25 types of combinations. By the output unit 146 outputting such presentation information, developers or the like who view the presentation information can grasp that there is a correlation between the time when the product is viewed and the sales performance of the product.

[0058] When the viewer data acquisition unit 141 acquires first viewer position data corresponding to the progress state in which the viewer U is advancing toward the product shelf and second viewer position data corresponding to the comparison state in which the viewer U is comparing a plurality of products, the output unit 146 may output first presentation information corresponding to the progress state and second presentation information corresponding to the comparison state. The first presentation information is information in which the viewer position corresponding to the first viewer position data acquired in the progress state is associated with the sales record, and the second presentation information is information in which the viewer position corresponding to the second viewer position data acquired in the comparison state is associated with the sales record.

[0059] The output unit 146 outputs, for example, the first presentation information in a form such as that shown in Fig. 2(c) or Fig. 3 together with information indicating that it is the progress state, and outputs the second presentation information in a form such as that shown in Fig. 2(c) or Fig. 3 together with information indicating that it is the comparison state. By outputting a plurality of pieces of presentation information corresponding to the state of the viewer U in this way, developers and the like can grasp the relationship between the viewer position and the sales record while the viewer U is heading toward the product shelf, and the relationship between the viewer position and the sales record while the viewer U is comparing a plurality of products in front of the product shelf.

[0060] When the viewer data acquisition unit 141 acquires biometric state data in association with the viewer position, the output unit 146 may output presentation information indicating the biometric state of the viewer in association with the viewer position based on the biometric state data. Specifically, the output unit 146 analyzes the pupil diameter, blink timing, brain waves, or heartbeat variation while the viewer U is viewing a certain position on the product shelf, and creates data indicating those characteristics. The output unit 146 creates presentation information in which the characteristics of the biometric state are shown, in association with each viewer position. The output unit 146 may include data indicating the characteristics of the biometric state of a single viewer U in the presentation information, or may include a statistical value (for example, an average value or a median value) of data indicating the characteristics of the biometric states of a plurality of viewers U in the presentation information.

[0061] The output unit 146 may calculate the concentration or relaxation degree of the viewer U based on the biological state data, and output presentation information indicating the concentration or relaxation degree in association with each viewing position. By the output unit 146 outputting such presentation information, developers and the like can grasp the state of the viewer U while a product with good sales performance is being viewed, so that it becomes possible to consider a package design taking into account the state of the viewer U.

[0062] [Flow of processing in the information output device 1] FIG. 6 is a flowchart showing the flow of processing in which the information output device 1 outputs presentation information. The flowchart shown in FIG. 6 starts from the point in time when the viewer U looks at the product shelf or the product shelf image and the viewing position identification device 2 generates viewing position data.

[0063] The viewer data acquisition unit 141 acquires viewing position data from the viewing position identification device 2 (S11). The specifying unit 145 specifies the viewing time for each viewing position by calculating the time during which the same position is continuously viewed in the viewing position data (S12). The specifying unit 145 specifies, for each viewing position, which time length range among a plurality of time length ranges the specified viewing time is included in (S13).

[0064] The sales performance data acquisition unit 142 acquires sales performance data from the POS system 3 (S14). The specifying unit 145 determines whether the reception unit 144 has received a designation of a product type (S15). When it is determined that the designation of the product type has been received (YES in S15), the specifying unit 145 extracts the product corresponding to the designated type by referring to the sales performance data (S16). When it is determined that the designation of the product type has not been received (NO in S15), the process proceeds to S17.

[0065] The specifying unit 145 specifies the sales results of the products extracted in S16 or all products by referring to the sales result data (S17). The specifying unit 145 specifies in which result range the specified sales results are included (S18). The output unit 146 creates presentation information in which information indicating the time length range of each viewing position is associated with information indicating the result range of the product corresponding to each viewing position (S19), and outputs the presentation information via the second communication unit 12 (S20).

[0066] [Estimation of Sales Results] Incidentally, even if developers or the like can grasp that products that are easy to view are likely to be purchased by looking at the presentation information showing the relationship between the viewing positions and the sales results, it is not easy to find out what kind of package design will make the product more likely to be purchased. Therefore, the information output device 1 may have a function of making it easier for developers or the like to find a package design that is easy to purchase.

[0067] Specifically, first, the reception unit 144 receives a designation of an arrangement area, which is an area for arranging the product under consideration, in the product shelf image data. The product under consideration is a product for which developers or the like are considering a package design or the like, or a product scheduled for sale in the store.

[0068] FIG. 7 is a diagram for explaining an example of a method for designating an arrangement area. The reception unit 144 causes the information terminal 4 to display an image of the product shelf for designating the arrangement area as shown in FIG. 7(a). When developers or the like select the arrangement area in FIG. 7(a), as shown in FIG. 7(b), the selected arrangement area switches to a mode different from other areas. Note that the arrangement area may be an area corresponding to a plurality of products.

[0069] In addition, the reception unit 144 receives image data of a product (package) for which the information output device 1 estimates sales results. The reception unit 144 receives the product image data via, for example, the second communication unit 12. FIG. 8 is a diagram showing an example of the product image data. The reception unit 144 may receive a plurality of product image data as shown in FIGS. 8(a) to 8(d), or may receive one product image data.

[0070] The output unit 146 outputs, to the designated arrangement area, the result of estimating the sales results when the product corresponding to the received product image data is placed, by means of a machine learning model. The machine learning model is a model created by performing machine learning using, as teacher data, at least either the image data of a product shelf where the sales results of the products arranged in the arrangement area are relatively large or the image data of a product shelf where the sales results of the products arranged in the area are relatively small. When the image data of the product shelf is input, the machine learning model outputs an estimated level of sales results. The estimated level of sales results may be, for example, an estimated value of the number of sales, or may be represented by a performance range including the number of sales.

[0071] The output unit 146 inputs, to the machine learning model, the image data in which the product image data is arranged in the designated arrangement area in the product shelf image data, and outputs estimation information indicating the estimated level of the sales results of the product under consideration, which is output from the machine learning model.

[0072] As an example, when the reception unit 144 receives a plurality of product image data from the first product image data to the fourth product image data shown in FIGS. 8(a) to 8(d), the output unit 146 inputs each of these product image data to the machine learning model. Then, the output unit 146 outputs the estimated levels corresponding to each of the plurality of product image data output from the machine learning model. The output unit 146 outputs, for example, the estimated level A in association with the first product image data and the estimated level B in association with the second product image data. By outputting such information by the output unit 146, it becomes easier for developers and the like to determine which product package is good.

[0073] The reception unit 144 may receive the designation of a plurality of arrangement areas, and the output unit 146 may output estimation information indicating an estimated level corresponding to each of the plurality of arrangement areas. The output unit 146 may output estimation information indicating an estimated level for each combination of the plurality of arrangement areas and the plurality of product image data. By the output unit 146 outputting such information, developers and the like can grasp a package design suitable for each arrangement area in the product shelf.

[0074] Note that the machine learning model may be created for each attribute of the product shelf (for example, size, type of product to be placed). When the reception unit 144 receives the designation of the attribute of the product shelf, the output unit 146 can input the image data into the machine learning model corresponding to the designated attribute of the product shelf, and output estimation information indicating the estimated level of the sales performance when the product under consideration is placed in the arrangement area of the product shelf with the designated attribute. Further, when estimating the sales performance using the machine learning model, the information output device 1 may not have the viewer data acquisition unit 141, the sales performance data acquisition unit 142, and the specification unit 145.

[0075] [Effect by Information Output Device 1] The information output device 1 includes a specification unit 145 that specifies the sales performance of the product to be viewed corresponding to the viewing position by referring to the viewing position data and the sales performance data, and an output unit 146 that outputs presentation information in which the viewing position and the sales performance are associated. By the information output device 1 having such a configuration, the information output device 1 can provide information useful for consideration to make the products placed on the product shelf more likely to be purchased.

[0076] As described above, the present invention has been explained using embodiments. However, the technical scope of the present invention is not limited to the scope described in the above embodiments, and various modifications and changes are possible within the scope of the gist. For example, all or part of the device can be configured by functionally or physically dispersing and integrating it in any unit. Also, new embodiments resulting from any combination of a plurality of embodiments are included in the embodiments of the present invention. The effects of the new embodiments resulting from the combination have the effects of the original embodiments combined.

Explanation of Signs

[0077] 1 Information output device 2 Visual recognition position specifying device 3 POS system 4 Information terminal 11 First communication unit 12 Second communication unit 13 Storage unit 14 Control unit 141 Viewer data acquisition unit 142 Sales performance data acquisition unit 143 Image data acquisition unit 144 Reception unit 145 Specifying unit 146 Output unit

Claims

1. A viewer data acquisition unit that acquires viewer position data indicating the viewing position of a viewer who is looking at a merchandise shelf on which a plurality of products are displayed or an image of a merchandise shelf on which a plurality of products are displayed; A sales performance data acquisition unit that acquires sales performance data indicating the sales performance of at least some of the plurality of products; An identification unit that identifies the sales performance of the viewed product corresponding to the viewing position by referring to the viewing position data and the sales performance data; An output unit that outputs presentation information in which the viewing position and the sales performance are associated; An information output device having the above.

2. The identification unit further identifies the duration during which the viewing position is being viewed, The output unit outputs the presentation information indicating the relationship between the length of the duration at the viewing position and the magnitude of the sales performance of the viewed product. The information output device according to claim 1.

3. The output unit outputs the presentation information indicating a combination of a plurality of time length ranges having different lengths of the duration and a plurality of performance ranges having different magnitudes of the sales performance. The information output device according to claim 2.

4. The viewer data acquisition unit acquires first viewing position data indicating the viewing position while the viewer is walking towards the merchandise shelf and second viewing position data indicating the viewing position while the viewer is within a predetermined range from the merchandise shelf, The output unit outputs first presentation information in which the viewing position corresponding to the first viewing position data and the sales performance are associated and second presentation information in which the viewing position corresponding to the second viewing position data and the sales performance are associated. The information output device according to claim 1.

5. It further has a storage unit that stores product position data in which the product type and the position of the product on the merchandise shelf are associated, The identification unit identifies the sales performance corresponding to the viewing position for each type by referring to the product position data, The output unit outputs the presentation information for each type. The information output device according to claim 1.

6. It further has a reception unit that receives the designation of a part of the area on the merchandise shelf, The identification unit identifies the sales performance of the viewed product corresponding to the area based on the viewing position included in the area designated by the reception unit, The output unit outputs the presentation information corresponding to the designated part of the area. The information output device according to claim 1.

7. The viewer data acquisition unit further acquires biometric state data indicating the biometric state of the viewer in association with the viewing position, The output unit outputs the presentation information indicating the biometric state of the viewer in association with the viewing position based on the biometric state data. The information output device according to claim 1.

8. An image data acquisition unit that acquires product shelf image data that is an image of the product shelf and product image data that is an image of a product under consideration to be placed on the product shelf, A reception unit that receives designation of an arrangement area that is an area for arranging the product under consideration in the product shelf image data, further comprising The output unit inputs image data in which the product image data is arranged in the arrangement area in the product shelf image data to a machine learning model that machine-learns at least any one of the product shelf image data with a relatively large sales record of the products arranged in the arrangement area and the product shelf image data with a relatively small sales record of the products arranged in the area as teacher data, and outputs estimation information indicating an estimated level of the sales record of the product under consideration when the product shelf image data is input. The information output device according to claim 1.

9. The image data acquisition unit acquires a plurality of different product image data, The output unit outputs the estimation information in association with the plurality of product image data. The information output device according to claim 8.

10. Executed by a computer, a step of acquiring viewing position data indicating the viewing position of a viewer looking at a product shelf on which a plurality of products are displayed or an image of a product shelf on which a plurality of products are displayed, a step of acquiring sales record data indicating the sales records of at least some of the plurality of products, a step of specifying the sales record of the product being viewed corresponding to the viewing position by referring to the viewing position data and the sales record data, a step of outputting presentation information in which the viewing position and the sales record are associated, An information output method comprising.

11. To a computer, a step of acquiring viewing position data indicating the viewing position of a viewer looking at a product shelf on which a plurality of products are displayed or an image of a product shelf on which a plurality of products are displayed, a step of acquiring sales record data indicating the sales records of at least some of the plurality of products, A step of identifying the sales performance of the visible product corresponding to the visible position by referring to the visible position data and the sales performance data; A step of outputting presentation information in which the visible position and the sales performance are associated; A program for causing the above to be executed.

Images