Display system, control device, and control program

Abstract

To provide a display system configured to improve the technology for analyzing position information, a control apparatus, and a control program.SOLUTION: In an analysis system, an analysis device 50 in a retail store 10 acquires positions of a commodity 11 and a purchaser 13 detected by a plurality of positioning devices, and integrates the positions to analyze behavior of the purchaser 13 with respect to the commodity 11. A display control apparatus 100 integrates information on the positions of the commodity 11 and the purchaser 13 detected by the positioning devices and displays the information on a display device 19.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to a display system for displaying position information, a control device, and a control program. [Background technology]

[0002] Various positioning technologies for detecting a position have been developed. For example, a positioning method using the Global Positioning System (GPS) or wireless communication with a communication tag such as RFID is available (see, for example, Patent Document 1). An appropriate positioning technology is adopted depending on the purpose and manner of use of the location information. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2006-267057 A Summary of the Invention [Problem to be solved by the invention]

[0004] If the purpose is simply to determine the location of a person or object, it is sufficient to adopt only a specific positioning technology that suits the purpose. However, the inventors recognized that when analyzing the location of a person or object for the purpose of obtaining some kind of information, if only location information detected by a specific positioning technology is used, the content and accuracy of the analysis will depend on the characteristics of that positioning technology.

[0005] One exemplary objective of certain aspects of the present invention is to improve techniques for analyzing location information. [Means for solving the problem]

[0006] A display system according to an embodiment of the present invention includes a first device that detects the position of a person in a space in which an object exists, a second device different from the first device that detects the position of the object, and a control device that displays information on a display device. The control device integrates information related to changes in the position of the person acquired from the first device between a predetermined time and a time other than the predetermined time, and information related to changes in the position of the object acquired from the second device between the predetermined time and a time other than the predetermined time, and displays the integrated information on the display device. Effect of the Invention

[0007] According to an aspect of the present invention, the technology for analyzing location information can be improved. [Brief description of the drawings]

[0008] [Figure 1] FIG. 2 is a diagram showing an example of a retail store that is an analysis target of the analysis system according to the embodiment. [Diagram 2] 1 is a block diagram illustrating an outline of a functional configuration of an analysis device according to an embodiment. [Diagram 3] 3(a), (b), and (c) are diagrams showing examples of the relationship between the location of a purchaser and the location of a product. [Figure 4] 1 is a block diagram illustrating a schematic functional configuration of a display control device according to an embodiment. [Diagram 5] FIG. 2 is a diagram illustrating an example of a display screen displayed on a display device by a display control device. [Figure 6] 6(a) and (b) are diagrams showing examples of display screens displayed on a display device by a display control device. [Figure 7] 7(a) and (b) are diagrams showing examples of display screens displayed on a display device by a display control device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. In the description, the same elements are given the same reference numerals, and duplicated description will be omitted as appropriate.

[0010] An overview of this embodiment will be described. In order to analyze human behavior with respect to objects present in a space to be analyzed, the analysis system of this embodiment acquires information indicating the positions of people and objects detected by a plurality of different positioning methods. By integrating and analyzing position information detected by a plurality of positioning methods, rather than a single positioning method, information that cannot be detected by a certain positioning method or that has low detection accuracy can be complemented by another positioning method, thereby improving the scope and accuracy of the analysis.

[0011] For example, when detecting the position of a person or object by capturing an image of the person or object with an imaging device, the state and movement of the person or object can be recognized, but if the person or object is in a blind spot, it becomes impossible to detect it.Even in such a case, the position of the person or object can be detected by detecting the position of a communication tag carried by the person or attached to the object using wireless communication technology such as Bluetooth (registered trademark).

[0012] Furthermore, in the analysis system of this embodiment, since information detected by one positioning method can be analyzed by adding different information detected by another positioning method, it is possible to obtain knowledge that cannot be obtained from information detected by a single positioning method. For example, when it is detected that an object to which a communication tag is attached has been picked up by a person due to a change in the position of the communication tag, the person's actions and facial expressions at that time can be recognized from captured images, and when it is detected that an object to which a communication tag is attached has been returned from a person's hand to the shelf due to a change in the position of the communication tag, the person's actions and facial expressions before and after that can be recognized from captured images, so that it is possible to analyze a purchaser's willingness to purchase a product, the reason why a purchaser did not purchase a product, etc.

[0013] Here, "things" include not only products but also equipment, machinery, and devices (collectively referred to as "equipment"). Equipment includes "non-moving objects" such as ceilings and pillars in buildings and rooms, and "movable objects" such as fixtures, shelves, and desks placed in rooms. The analysis system of this embodiment can also analyze the situations and relationships between "equipment," such as whether or not a "person" is near the equipment, or whether or not a "product" is near the equipment.

[0014] In this way, the analysis system of this embodiment not only can analyze human behavior toward objects with greater accuracy than conventional analysis techniques, but also provides groundbreaking analysis technology that makes it possible to obtain insights that could not be obtained with conventional analysis techniques.

[0015] The present embodiment will be described in detail below, taking as an example a case where the behavior of purchasers with respect to products is analyzed in a retail store where products are displayed and sold.

[0016] 1 shows an example of a retail store that is an analysis target of the analysis system according to the embodiment. The retail store 10 is equipped with a plurality of display shelves 12 for displaying products 11, a register 14 for checking out the products 11 purchased by a customer 13, a plurality of positioning devices for detecting the positions of the products 11 or the customer 13, an imaging device 15 for imaging the customer 13 entering the retail store 10, an identification device 16 for identifying the customer 13, and a display control device 100 for integrating information on the position of the customer 13 detected by the plurality of positioning devices and information on the position of the products 11 and displaying the integrated information on the display device 19. The positioning devices are, for example, an imaging device 20, a communication tag 21, an access point 22, a locator 23, a GPS device 24, a mobile terminal 25, etc.

[0017] The imaging device 20 is provided on the ceiling, wall, floor, display shelf 12, etc. of the retail store 10. The analysis device 50 acquires the positions of the product 11 and the purchaser 13 from the image captured by the imaging device 20. The analysis device 50 may identify the purchaser 13, recognize the actions and facial expressions of the purchaser 13, and recognize the state of the product 11, by analyzing the image captured by the imaging device 20. The imaging device 20 may have a distance measurement function. The imaging device 20 may be installed so as to be able to capture an image of at least the upper body of the purchaser 13. The imaging device 20 may be installed at a position and orientation so as to be able to capture an image of the purchasing behavior of the purchaser 13 looking at, touching, and picking up the product 11.

[0018] The communication tag 21 is attached to the product 11. The communication tag 21 may be an RFID or a beacon. The communication tag 21 may be provided with sensors capable of detecting various types of information, such as an acceleration sensor, a pressure sensor, a temperature sensor, etc. In this case, the analysis device 50 can acquire the position of the communication tag 21 as well as information detected by these sensors. The communication tag 21 may be carried by the purchaser 13.

[0019] The access point 22 is a wireless base station for wireless communication according to standards such as Wi-Fi (registered trademark). The access point 22 is provided on the ceiling, wall, floor, display shelf 12, etc. of the retail store 10. The access point 22 detects the position of the communication tag 21 using a positioning technique based on a Wi-Fi signal. For example, the distance between the communication tag 21 and the access point 22 can be measured by measuring the radio wave strength of the Wi-Fi signal or measuring the propagation time of the Wi-Fi signal using a Time of Flight (TOF) method. Furthermore, the position of the communication tag 21 can be identified based on the principle of triangulation by measuring the distance between the communication tag 21 and multiple access points 22 present around the communication tag 21.

[0020] Locator 23 is a device for identifying the position of communication tag 21 using a beacon signal transmitted and received in accordance with a standard such as Bluetooth or Bluetooth low energy (BLE). Locator 23 is provided on the ceiling, wall, floor, display shelf 12, etc. of retail store 10. Locator 23 measures, for example, the angle of arrival (AOA) of a beacon signal transmitted from communication tag 21, and identifies the position of communication tag 21 based on the obtained angle of arrival. Locator 23 may transmit a beacon signal, and communication tag 21 may receive the beacon signal to identify its own position. Communication tag 21 may identify its own position based on beacon signals transmitted from multiple locators 23.

[0021] The GPS device 24 receives positioning signals from a satellite positioning system such as a Global Positioning System (GPS) or a Global Navigation Satellite System (GNSS) to identify its own position. The communication tag 21 acquires position information from the GPS device 24 present around the communication tag 21, and regards the position of the GPS device 24 as the position of the communication tag 21 itself. The GPS device 24 may transmit the position information of the communication tag 21 to the analysis device 50. The GPS device 24 may be built into the communication tag 21.

[0022] The mobile terminal 25 is a smartphone, a tablet, or the like, carried by the purchaser 13. The mobile terminal 25 acquires its own location information using any method. The mobile terminal 25 may specify its location using a Wi-Fi signal transmitted and received between the access point 22, may specify its location using a beacon signal transmitted and received between the locator 23, or may specify its location using a GPS function. The mobile terminal 25 may measure the angle of arrival (AOA) of a beacon signal transmitted from the communication tag 21, specify the location of the communication tag 21 based on the obtained angle of arrival, and transmit the location to the analysis device 50. The mobile terminal 25 may acquire biometric information detected by a sensor for detecting biometric information of the purchaser 13, and transmit the information to the analysis device 50.

[0023] The method of identifying the positions of the product 11 and the purchaser 13 is not limited to the above, and any other method may be used. Any positioning device not shown may be used. The positions of the product 11 and the purchaser 13 may be identified by combining a plurality of methods, and the positions of the product 11 and the purchaser 13 may be identified with high accuracy by comprehensively using position information identified by the above-mentioned method and other methods.

[0024] The imaging device 15 is installed at the entrance 17 of the retail store 10, captures an image of the purchaser 13 entering the retail store 10 through the entrance 17, and transmits the captured image to the analysis device 50. The analysis device 50 uses the image of the purchaser 13 received from the imaging device 15 to track the purchaser 13 in the images captured by the imaging device 20.

[0025] The identification device 16 is installed at the entrance 17 of the retail store 10, identifies the purchaser 13 who enters the retail store 10 through the entrance 17, and transmits the identification information of the purchaser 13 to the analysis device 50. The identification device 16 may identify the purchaser 13 using authentication technology such as face authentication or biometric authentication, may identify the purchaser 13 by communicating with a mobile terminal 25 held by the purchaser 13 and identifying the mobile terminal 25, may identify the purchaser 13 by acquiring information for identifying the purchaser 13 from an IC card, a point card, a membership card, or the like held by the purchaser 13, or may identify the purchaser 13 by any other technology. The identification device 16 may acquire information about the purchaser 13 from a mobile terminal, an IC card, or the like, and transmit the information to the analysis device 50. The analysis device 50 uses the information of the purchaser 13 received from the identification device 16 for analysis.

[0026] The analysis device 50 acquires the positions of the products 11 and the purchasers 13 detected by the multiple positioning devices, and integrates them to analyze the behavior of the purchasers 13 with respect to the products 11. The analysis device 50 may be provided for each retail store 10. Alternatively, the analysis device 50 may comprehensively analyze the purchasing behavior of the purchasers 13 in multiple retail stores 10.

[0027] The display control device 100 integrates information related to the positions of the product 11 and the purchaser 13 detected by the multiple positioning devices and displays it on the display device 19. The display control device 100 may superimpose the information detected by the multiple positioning devices and display it on the display device 19. In this case, the display control device 100 may directly acquire the information to be displayed on the display device 19 from the multiple positioning devices. The display control device 100 may superimpose the analysis results by the analysis device 50 and the information detected by the multiple positioning devices and display them on the display device 19. In this case, the display control device 100 may acquire the information to be displayed on the display device 19 from the analysis device 50.

[0028] The analysis device 50 and the display control device 100 may be implemented integrally by one device, or may be implemented separately by multiple devices, or some functions may be shared. One or both of the analysis device 50 and the display control device 100 may be implemented by a web server or the like, or may be implemented using cloud computing technology or the like.

[0029] 2 is a block diagram showing a schematic functional configuration of an analysis device 50 according to an embodiment. The analysis device 50 includes a communication device 51, a display device 19, an input device 53, a control device 60, and a storage device 80. The analysis device 50 may be a server device, a device such as a personal computer, or a mobile terminal such as a mobile phone terminal, a smartphone, or a tablet terminal.

[0030] The communication device 51 communicates with devices installed in the retail store 10, positioning devices, etc. The communication device 51 may transmit and receive data using any wired or wireless communication technology.

[0031] The display device 19 displays a screen generated by the control device 60. The display device 19 may be a liquid crystal display device, an organic EL display device, or the like. The input device 53 transmits instructions input by a user of the analysis device 50 to the control device 60. The input device 53 may be a mouse, a keyboard, a touch pad, or the like. The display device 19 and the input device 53 may be implemented as a touch panel.

[0032] The storage device 80 stores programs, data, etc. used by the control device 60. The storage device 80 may be a semiconductor memory, a hard disk, etc. The storage device 80 includes a purchaser database 81, a spatial information storage unit 82, and a position information storage unit 83.

[0033] The purchaser database 81 stores information about the purchaser 13. The purchaser database 81 stores attribute information such as the name, age, sex, and address of the purchaser 13, preference information, and a purchase history of the product 11 at the retail store 10.

[0034] The spatial information storage unit 82 stores information about the space within the retail store 10. The spatial information storage unit 82 stores a map of the display shelves 12 and the like within the retail store 10, the types of positioning devices, installation positions, and the like.

[0035] The position information storage unit 83 stores the position information of the purchaser 13 and the product 11 acquired from the positioning device. The position information storage unit 83 stores the history of the position information of the purchaser 13 and the product 11, and additional information such as acceleration, temperature, and pressure detected by the positioning device.

[0036] The control device 60 includes a first position acquisition unit 61, a second position acquisition unit 62, an image analysis unit 63, a buyer information acquisition unit 64, a behavioral analysis unit 65, a purchasing willingness calculation unit 66, a best-selling product analysis unit 67, a reason analysis unit 68, an inventory management unit 69, and an analysis result presentation unit 70.

[0037] Each functional block shown in this embodiment can be realized in hardware terms by elements and mechanical devices such as a computer CPU and memory, and in software terms by a computer program, etc., but is depicted here as a functional block realized by the cooperation of these. Therefore, it will be understood by those skilled in the art that these functional blocks can be realized in various forms by combining hardware and software.

[0038] The first position acquisition unit 61 acquires the position of the purchaser 13 in the retail store 10. The first position acquisition unit 61 may directly receive information indicating the position of the purchaser 13 from a positioning device installed in the retail store 10. Alternatively, the first position acquisition unit 61 may acquire information indicating the position of the purchaser 13 from a retail store server (not shown) that is installed in the retail store 10 and aggregates information detected by the positioning device.

[0039] The second position acquisition unit 62 acquires the position of the product 11 in the retail store 10. The second position acquisition unit 62 may directly receive information indicating the position of the product 11 from a positioning device installed in the retail store 10. Alternatively, the second position acquisition unit 62 may acquire information indicating the position of the purchaser 13 from a retail store server (not shown).

[0040] The first position acquisition unit 61 or the second position acquisition unit 62 may acquire information such as acceleration, temperature, and pressure detected by a positioning device in addition to the position information of the purchaser 13 or the product 11.

[0041] The captured image analysis unit 63 analyzes the captured image acquired from the imaging device 20 to acquire the position of the product 11 or the purchaser 13. The captured image analysis unit 63 may detect the purchaser 13 from the captured image using the image of the purchaser 13 acquired from the imaging device 15. The captured image analysis unit 63 may detect the product 11 from the captured image using an image of the product 11 previously stored in the storage device 80. The captured image analysis unit 63 may identify the position of the purchaser 13 or the product 11 included in the captured image using an image of the display shelf 12 in the retail store 10 previously stored in the storage device 80.

[0042] The captured image analysis unit 63 may monitor the movements of the purchaser 13 excluding people other than the purchaser 13. People other than the purchaser 13 include, for example, employees of the retail store 10 and vendors entering and leaving the retail store 10. The captured image analysis unit 63 may use images of the employees and vendors of the retail store 10 stored in advance in the storage device 80 to detect the employees and vendors from the captured images and exclude them from the analysis. This can improve the accuracy of the analysis.

[0043] The purchaser information acquisition unit 64 acquires information about the purchaser 13. The purchaser information acquisition unit 64 acquires the identification information of the purchaser 13 from the identification device 16, and acquires information such as the attributes and purchase history of the purchaser 13 by referring to the purchaser database 81. The purchaser information acquisition unit 64 may acquire information about the purchaser 13 from the identification device 16 or the mobile terminal 25.

[0044] The behavior analysis unit 65 analyzes the behavior of the purchaser 13 with respect to the product 11, based on the relationship between the position of the purchaser 13 acquired by the first position acquisition unit 61 and the position of the product 11 acquired by the second position acquisition unit 62. The behavior of the purchaser 13 includes, for example, becoming interested in the product 11, looking at the product 11, touching the product 11, picking up the product 11, considering purchasing the product 11, returning the product 11 to the display shelf 12, taking the product 11 to the register 14, purchasing the product 11, etc.

[0045] The purchasing willingness calculation unit 66 calculates an evaluation value that quantifies the purchasing willingness of the purchaser 13 for the product 11 based on the purchasing behavior of the purchaser 13 analyzed by the behavior analysis unit 65 in association with the location of the product 11 and the location of the purchaser 13. The purchasing willingness calculation unit 66 increases the evaluation value of the product 11 when the purchaser 13 is interested in the product 11, considers purchasing the product 11, looks at the product 11, picks it up, or purchases it. The purchasing willingness calculation unit 66 may increase the evaluation value of the product 11 the more times or the longer the purchaser 13 looks at or picks up the product 11. The purchasing willingness calculation unit 66 may decrease the evaluation value of the product 11 the longer the time the purchaser 13 is not interested in, looked at, or picked up the product 11. The purchasing willingness calculation unit 66 may calculate the evaluation value of the purchaser 13's purchasing willingness for the product 11 based on the biological information of the purchaser 13 when the purchaser 13 looks at, picks up, or purchases the product 11. For example, if the pulse rate, body temperature, blood pressure, etc. of the purchaser 13 increases when the purchaser 13 sees, picks up, or purchases the product 11, the evaluation value of the product 11 may be increased.

[0046] The best-selling product analysis unit 67 analyzes best-selling products 11 among the products 11 displayed in the retail store 10 based on the purchasing behavior of the purchaser 13 analyzed by the behavior analysis unit 65 and the evaluation value of the purchasing willingness of the product 11 calculated by the purchasing willingness calculation unit 66. The best-selling product analysis unit 67 may determine as best-selling products products that are purchased as they are without being returned to the display shelf 12 after being picked up by the purchaser 13. The best-selling product analysis unit 67 may determine as best-selling products products that are moved to the register 14 after being picked up by the purchaser 13 in a time shorter than a predetermined value. The best-selling product analysis unit 67 may determine as niche products products that are picked up by the purchaser 13 less frequently. The best-selling product analysis unit 67 may determine as candidates for best-selling products products products that are picked up by the purchaser 13 more frequently and returned to the display shelf 12. By analyzing best-selling products, it is possible to improve the procurement and display position of the products 11. In addition, by feeding back the analyzed information on best-selling products to the manufacturer of product 11, the information can be utilized in the development and sales strategy of product 11.

[0047] The reason analysis unit 68 analyzes the reason why the purchaser 13 did not purchase the product 11 based on the purchasing behavior of the purchaser 13 analyzed by the behavior analysis unit 65. The reason analysis unit 68 may analyze the reason why the purchaser 13 did not purchase the product 11 by analyzing the behavior of the purchaser 13 before and after the purchaser 13 saw or picked up the product 11. For example, if the purchaser 13 returned the product 11 to the display shelf 12 after seeing a tag such as a price tag attached to the product 11, the reason analysis unit 68 may infer that the reason is that the price, material, brand, etc. of the product 11 did not match the preferences of the purchaser 13. If the purchaser 13 returned the product 11 to the display shelf 12 after touching the product 11, the reason analysis unit 68 may infer that the reason is that the feel of the fabric of the product 11 did not match the preferences of the purchaser 13. If the purchaser 13 returns the product 11 to the display shelf 12 after unfolding the folded product 11, the reason analysis unit 68 may infer that the reason is that the design, size, etc. of the product 11 did not match the preferences of the purchaser 13. By analyzing the reason why the purchaser 13 did not purchase the product 11, it is possible to improve the procurement and display position of the product 11. In addition, by feeding back the analyzed reason to the manufacturer of the product 11, it is possible to utilize it in the development and sales strategy of the product 11.

[0048] The analysis by the behavior analysis unit 65, the purchase intention calculation unit 66, the hot selling product analysis unit 67, or the reason analysis unit 68 may be performed in units of attributes of the purchaser 13. For example, the analysis may be performed in units of the gender, age, place of residence, etc. of the purchaser 13. This makes it possible to analyze what kind of purchaser demographic is interested in what kind of products, what kind of products they have picked up, etc.

[0049] The inventory management unit 69 manages the inventory of the retail store 10. The inventory management unit 69 manages the number of products 11 in stock and the display positions based on the location information of the products 11 acquired by the second location acquisition unit 62, the purchasing behavior of the purchaser 13 analyzed by the behavior analysis unit 65, and the like. The inventory management unit 69 may automatically order the products 11 whose stock has decreased after being purchased by the purchaser 13. The inventory management unit 69 may increase or decrease the number of products 11 ordered or change the display positions of the products 11 based on the analysis results of the best-selling product analysis unit 67 or the reason analysis unit 68.

[0050] The analysis result presentation unit 70 displays the analysis results obtained by the behavior analysis unit 65 , the purchase intention calculation unit 66 , the hot selling item analysis unit 67 , or the reason analysis unit 68 on the display device 19 .

[0051] A specific example of the analysis of the purchasing behavior of the purchaser 13 by the behavior analysis unit 65 will be described.

[0052] The behavior analysis unit 65 analyzes the behavior of the purchaser 13 with respect to the product 11 based on the relationship between the location of the purchaser 13 and the location of the product 11. FIGS. 3(a), (b), and (c) show examples of the relationship between the location of the purchaser 13 and the location of the product 11. The behavior analysis unit 65 may determine that the purchaser 13 is interested in the product 11 when the purchaser 13 and the product 11 are in a predetermined positional relationship. For example, as shown in FIG. 3(a), when the purchaser 13 is within a predetermined range from the product 11 in an aisle facing the display shelf 12 in which the product 11 is displayed, it may be determined that the purchaser 13 is interested in the product 11. Even if the purchaser 13 is within a predetermined range from the product 11, as shown in FIG. 3(b), when the purchaser 13 is in a position that is not in an aisle facing the display shelf 12, the product 11 is not visible to the purchaser 13, so the behavior analysis unit 65 does not need to determine that the purchaser 13 is interested in the product 11. In the case where the line of sight of the purchaser 13 can be obtained from the captured image of the purchaser 13, as shown in Fig. 3(c), if the product 11 is within the field of view of the purchaser 13, it may be determined that the purchaser 13 is interested in the product 11. The behavior analysis unit 65 may analyze the purchasing behavior of the purchaser 13 by referring to a map of the retail store 10 stored in the spatial information storage unit 72.

[0053] The behavior analysis unit 65 may analyze the purchasing behavior of the purchaser 13 based on the change in the position of the purchaser 13 or the product 11 over time. The change in the position over time is, for example, the position of the purchaser 13 or the product 11 at a given time, the amount of movement, the number of movements, or the movement route of the purchaser 13 or the product 11, the stay position, the stay time, or the number of stays of the purchaser 13, or the time the product 11 is displayed on the display shelf 12. The behavior analysis unit 65 may determine that the more the product 11 is moved or moved, the more the purchaser 13 picks up the product 11. The behavior analysis unit 65 may determine that the longer the product 11 is displayed on the display shelf 12, the less the purchaser 13 is interested in the product 11. The behavior analysis unit 65 may determine that the more the purchaser 13 stays in the vicinity of the product 11 for a longer period of time or the more times the purchaser 13 stays in the vicinity of the product 11, the more the purchaser 13 is strongly interested in the product 11.

[0054] The behavior analysis unit 65 may analyze the purchasing behavior of the purchaser 13 based on the relative distance between the position of the purchaser 13 and the position of the product 11. The behavior analysis unit 65 may calculate the distance between the position of the purchaser 13 and the position of the product 11, and determine that the purchaser 13 is interested in a product 11 that is within a predetermined range from the position of the purchaser 13 that the purchaser 13 can reach.

[0055] The behavior analysis unit 65 may analyze the purchasing behavior of the purchaser 13 based on a change in the relative distance between the position of the purchaser 13 and the position of the product 11 at a predetermined time and another time different from the predetermined time. The behavior analysis unit 65 may determine that the purchaser 13 has picked up the product 11 when the distance between the purchaser 13 and the product 11 has decreased. The behavior analysis unit 65 may determine that the purchaser 13 has returned the product 11 to the display shelf 12 when the distance between the purchaser 13 and the product 11 has increased. The behavior analysis unit 65 may analyze the purchasing behavior of the purchaser 13 based on the speed of change in the relative distance between the position of the purchaser 13 and the position of the product 11. If the speed at which the purchaser 13 picked up the product 11 was fast, the behavior analysis unit 65 may determine that the purchaser 13 had a stronger interest in the product 11. If the speed at which the purchaser 13 returned the product 11 to the display shelf 12 was fast, the behavior analysis unit 65 may determine that the degree of interest the purchaser 13 had in the product 11 was lower.

[0056] The behavior analysis unit 65 may analyze the purchasing behavior of the purchaser 13 based on a change in the height of the product 11 detected within a certain range around the purchaser 13. When the height of the product 11 within the reach of the purchaser 13 changes, the behavior analysis unit 65 may determine that the product 11 has been picked up by the purchaser 13.

[0057] The behavior analysis unit 65 may analyze the purchasing behavior of the purchaser 13 based on information indicating that the purchaser 13 has touched or held the product 11. The fact that the purchaser 13 has touched or held the product 11 can be detected, for example, by analyzing an image captured by the imaging device 20. In addition, by providing an acceleration sensor, a contact sensor, a pressure sensor, or the like to the communication tag 21 attached to the product 11, it can be detected that the purchaser 13 has touched or held the product 11.

[0058] 4 is a block diagram showing a schematic functional configuration of a display control device 100 according to an embodiment. The display control device 100 includes a communication device 151, a display device 19, an input device 153, a control device 160, and a storage device 180. The display control device 100 may be a server device, a device such as a personal computer, or a mobile terminal such as a mobile phone terminal, a smartphone, or a tablet terminal.

[0059] The communication device 151 communicates with devices such as a positioning device installed in the retail store 10 and the analysis device 50. The communication device 151 may transmit and receive data using any wired or wireless communication technology.

[0060] The input device 153 transmits an instruction input by a user of the display control device 100 to the control device 160. The input device 153 may be a mouse, a keyboard, a touch pad, etc. The display device 19 and the input device 153 may be implemented as a touch panel.

[0061] The storage device 180 stores programs, data, etc. used by the control device 160. The storage device 180 may be a semiconductor memory, a hard disk, etc. The storage device 180 includes a purchaser database 181, a space information storage unit 182, and a display information storage unit 183.

[0062] The purchaser database 181 stores information about the purchaser 13. The purchaser database 181 stores attribute information such as the name, age, sex, and address of the purchaser 13, preference information, and a purchase history of the product 11 at the retail store 10.

[0063] The spatial information storage unit 182 stores information about the space within the retail store 10. The spatial information storage unit 182 stores a map of the display shelves 12 within the retail store 10, the type, installation location, layout, and the like of positioning devices.

[0064] The display information storage unit 183 stores information to be displayed on the display device 19, such as the location information of the purchaser 13 and the product 11 acquired from the positioning device, and the analysis results by the analysis device 50. The display information storage unit 183 stores the history of the location information of the purchaser 13 and the product 11, additional information such as acceleration, temperature, and pressure detected by the positioning device, and the analysis results acquired from the analysis device 50.

[0065] The control device 160 includes a first position acquisition unit 161, a second position acquisition unit 162, an analysis result acquisition unit 163, a spatial information acquisition unit 164, a display position adjustment unit 165, a display range adjustment unit 166, a superimposed display control unit 167, and a display switching unit 168. These functional blocks can also be realized in various ways by combining hardware and software.

[0066] The first position acquisition unit 161 acquires the position of the purchaser 13 in the retail store 10. The first position acquisition unit 161 may directly receive information indicating the position of the purchaser 13 from a positioning device installed in the retail store 10. Alternatively, the first position acquisition unit 161 may acquire information indicating the position of the purchaser 13 from a retail store server (not shown) that is installed in the retail store 10 and aggregates information detected by the positioning device, an analysis device 50, or the like.

[0067] The second position acquisition unit 162 acquires the position of the product 11 in the retail store 10. The second position acquisition unit 62 may directly receive information indicating the position of the product 11 from a positioning device installed in the retail store 10. Alternatively, the second position acquisition unit 62 may acquire information indicating the position of the purchaser 13 from a retail store server or an analysis device 50 (not shown).

[0068] The first position acquisition unit 161 or the second position acquisition unit 162 may acquire information such as acceleration, temperature, and pressure detected by a positioning device in addition to the position information of the purchaser 13 or the product 11.

[0069] The analysis result acquisition unit 163 acquires the analysis results by the analysis device 50 from the analysis device 50 .

[0070] The display information displayed on the display device 19 by the display control device 100 is an integration of information regarding the change in the position of the purchaser 13 between a predetermined time and a time other than the predetermined time, and information regarding the change in the position of the product 11 between a predetermined time and a time other than the predetermined time. The display information may be an integration of information regarding the change in the relative distance between the position of the purchaser 13 and the position of the product 11 between a predetermined time and a time other than the predetermined time. More specifically, the display information may be the movement amount, number of movements, movement speed, stay time, or number of stays of the purchaser 13, or the movement amount, number of movements, movement speed, or time of existence of the product 11. The stay time or number of stays may be the time or number of stays of the purchaser 13 in the vicinity of the product 11, the time or number of stays of the purchaser 13 in the retail store 10, or the stay time or number of stays of the purchaser 13 in each area of ​​the retail store 10.

[0071] The display information may further include the state, attributes, or behavior of the purchaser 13. The display information may include, for example, the physical state, mental state, facial expression, and gestures of the purchaser 13, the purchasing behavior of the purchaser 13 analyzed by the analysis device 50, and the like. The display information may be an integration of the coordinates, map, or layout of the retail store 10, information regarding changes in the position of the purchaser 13, and information regarding changes in the position of the product 11. The display information may further include information regarding the space of the retail store 10. The information regarding the space may be, for example, information regarding air conditioning equipment, lighting equipment, audio equipment, entrances and exits, and the like installed in the retail store 10, and information regarding the temperature, humidity, brightness, and the like within the retail store 10.

[0072] The spatial information acquisition unit 164 acquires information about the space within the retail store 10. The spatial information acquisition unit 164 may acquire the spatial information from a retail store server or the analysis device 50 (not shown), or may acquire the spatial information via the input device 153.

[0073] The display position adjustment unit 165 adjusts the display position of each piece of display information, such as information detected by a plurality of positioning devices, in order to superimpose and display the pieces of display information. The display range adjustment unit 166 adjusts the display range, scale, and the like of each piece of display information, such as information detected by a plurality of positioning devices, in order to superimpose and display the pieces of display information. The superimposed display control unit 167 superimposes and displays the display information adjusted by the display position adjustment unit 165 and the display range adjustment unit 166 on the display device 19.

[0074] The display switching unit 168 can switch between ON, which displays at least one of the multiple pieces of information superimposed on the display device 19, and OFF, which does not display the information. The display switching unit 168 may simultaneously superimpose changes in all of the obtained information and display them on the display device 19. The display switching unit 168 may display some of the obtained pieces of information and not display the rest. The display switching unit 168 may switch the contents and display layout of the display information displayed on the display device 19.

[0075] 5 is a schematic diagram showing an example of a display screen displayed on the display device 19 by the display control device 100. The superimposed display control unit 167 displays, for example, display information such as information detected by a first positioning device and an analysis result obtained by analyzing the information detected by the first positioning device on a layer 1, displays display information such as information detected by a second positioning device and an analysis result obtained by analyzing the information detected by the second positioning device on a layer 2, and displays display information such as information detected by a third positioning device and an analysis result obtained by analyzing the information detected by the third positioning device on a layer 3. The display switching unit 168 receives an instruction to turn on and off each layer via the input device 153, and switches on and off each layer in response to the instruction.

[0076] 6(a) and (b) show examples of display screens displayed on the display device 19 by the display control device 100. In the example shown in FIG. 6(a), a graph 190 in which the movement amounts of the purchasers 13 and the products 11 are tabulated for each area is superimposed on a map in the retail store 10. In addition, a graph 191 in which the movement amounts of the purchasers 13 and the products 11 are tabulated for each month, a graph 192 showing the composition ratio of the purchasers 13 by gender and age, and a graph 193 in which the ratio of the movement amounts of multiple products 11 included in each category of the products 11 are tabulated are displayed. The analyst can refer to the display screen shown in FIG. 6(a) to analyze best-selling products for each attribute of the purchasers 13, consider the layout in the retail store 10, and consider the inventory and purchasing situation.

[0077] In the example shown in Fig. 6(b), a graph 191 which shows the movement amounts of the purchasers 13 and the products 11 by month is displayed in an enlarged manner, and a graph 190 which shows the movement amounts of the purchasers 13 and the products 11 by area is displayed in a reduced manner. The display switching unit 168 switches the contents and display layout of the display information displayed on the display screen in response to instructions from the analyst. This makes it possible to appropriately support the analysis by the analyst.

[0078] 7(a) and (b) show examples of display screens displayed on the display device 19 by the display control device 100. In the example shown in Fig. 7(a), a movement trajectory 194 of the purchaser 13 is superimposed on a map of the retail store 10. In addition, a user interface 195 for switching on and off the display of information detected by multiple positioning devices and analysis results is displayed. The analyst can switch on and off the display for each positioning device via the user interface 195.

[0079] In the example shown in Fig. 7(b), an analysis result 196 in which the movement amount of the purchaser 13 and the product 11 is collected by area, and a captured image 197 at a position specified by the analyst are further superimposed on the display screen shown in Fig. 7(a). The analyst can arbitrarily switch between information detected by multiple positioning devices and analysis results and superimpose them, so that the analyst can analyze this information from multiple angles and obtain new knowledge.

[0080] As an example of the display contents to be displayed on the display screen, value-added information such as event information for tastings, discount sales, etc. may be superimposed on the display screen, which allows the analyst to perform various analyses related to purchasers and products.

[0081] In the above example, the information on the change in the position of a person and the information on the change in the position of an object are superimposed on each other. However, by superimposing the information on the change in the position of a person and other information on the change in the position of a person, or by superimposing the information on the change in the position of an object and other information on the change in the position of another object, it is possible to provide unprecedented analytical value. For example, by superimposing the position information and the amount of movement of the same product A and product B, it is possible to analyze the correlation between the placement of the product and the activation of the product. More specifically, it is possible to analyze whether an expensive product is more likely to be selected when placed next to an inexpensive product, whether the amount of movement increases by placing products in the same price range adjacent to each other due to a synergistic effect, and so on. In addition, by superimposing the position information and the amount of movement of not only the product but also the equipment and the product, it is possible to apply it to the optimization of the store layout. More specifically, it is possible to analyze whether the amount of movement of the product near the full-length mirror is more activated, the difference in the amount of movement of the product A hanging on the hanger rack and the product B on the shelf, and so on.

[0082] The present invention has been described above based on examples. The present invention is not limited to the above-mentioned embodiment, and it is understood by those skilled in the art that various design changes and modifications are possible, and that such modifications are also within the scope of the present invention.

[0083] In the above embodiment, an example of analyzing the purchasing behavior of the purchaser 13 at the retail store 10 has been shown, but the technology of this embodiment can also be used to analyze the packing work of workers in a warehouse or the work of employees in a factory. For example, in the packing and shipping process of a production line in a product manufacturing factory, information such as the movement amount of workers and the production amount of products obtained from an image captured by an imaging device and information such as the position of products and equipment and the contents of packages obtained from communication tags attached to products and equipment can be superimposed and displayed to manage the production amount and production quality of products and analyze the cause of a decrease in production amount and production quality. When the production amount and production quality are decreasing, if the movement amount of workers in the packing and shipping process is increased, it is presumed that the cause is a malfunction of the equipment or equipment, and when the movement amount of workers is decreased, it is presumed that the cause is poor physical condition of the workers. It is also possible to analyze the cause in more detail by further analyzing information obtained from a sensor for detecting the body temperature, blood pressure, heart rate, etc. of the workers and information such as the work motion of the workers captured by an imaging device.

[0084] In the above embodiment, various functions provided by the analysis device 50 and the relationships between the various functions are described while showing exemplary functional blocks. The boundaries of the above-mentioned functional blocks are arbitrarily determined for convenience of explanation, and boundaries other than the above-mentioned functional blocks may be determined as long as the various functions and the relationships between the various functions are appropriately realized. In addition, the various functions provided by the analysis device 50 may be realized by a single server device, or may be realized by cooperation between multiple server devices. Therefore, the fact that a specific server provides a specific function includes a case where a specific function is realized by a single server device and a case where a specific function is realized by multiple server devices, and does not necessarily mean that a specific function must be realized only by a specific server device. [Explanation of symbols]

[0085] 10... retail store, 11... product, 12... display shelf, 13... purchaser, 14... register, 15... imaging device, 16... identification device, 17... entrance, 19... display device, 20... imaging device, 21... communication tag, 22... access point, 23... locator, 24... GPS device, 25... mobile terminal, 50... analysis device, 51... communication device, 52... display device, 53... input device, 60... control device, 61... first position acquisition unit, 62... second position acquisition unit, 63... captured image analysis unit, 64... purchaser information acquisition unit, 65... behavior analysis unit, 66... ​​purchasing intention calculation unit, 67... best-selling product analysis unit, 68... reason analysis unit, 69... presence Inventory management unit, 70...analysis result presentation unit, 72...spatial information retention unit, 80...storage device, 81...purchaser database, 82...spatial information retention unit, 83...position information retention unit, 100...display control device, 151...communication device, 153...input device, 160...control device, 161...first position acquisition unit, 162...second position acquisition unit, 163...analysis result acquisition unit, 164...spatial information acquisition unit, 165...display position adjustment unit, 166...display range adjustment unit, 167...overlap display control unit, 168...display switching unit, 180...storage device, 181...purchaser database, 182...spatial information retention unit, 183...display information retention unit.

Claims

1. A first device that detects a position of a person in a space in which an object is present; a second device distinct from the first device for detecting a position of the object; and a control device for displaying information on a display device; Equipped with the first device includes an imaging device that captures an image of a person; the second device includes a communication device that communicates with a plurality of communication tags attached to the plurality of objects, The control device includes: Information regarding a change in the position of a person acquired from the first device between a predetermined time and a time other than the predetermined time, information regarding a change in the position of an object acquired from the second device between a predetermined time and a time other than the predetermined time, and information regarding a change in a relative distance between the position of the person and the position of the object between the predetermined time and a time other than the predetermined time are integrated and displayed on the display device. Display system.

2. The display system according to claim 1 , wherein the control device displays on the display device the amount of movement, number of movements, movement speed, stay time, or number of stays of a person, or the amount of movement, number of movements, movement speed, or presence time of an object.

3. The display system according to claim 1 or 2, wherein the control device identifies a state, attribute, or behavior of a person by analyzing an image of the person obtained from the first device, and further displays the information on the display device.

4. The display system according to claim 1 , wherein the control device displays on the display device the coordinates or layout of the space, information relating to changes in the position of people, and information relating to changes in the position of objects in a superimposed manner.

5. The display system according to claim 4 , wherein the control device further superimposes information about the space and displays it on the display device.

6. The display system according to claim 4 or 5, wherein the control device is capable of switching between ON, which displays at least one of the plurality of pieces of information displayed in a superimposed manner on the display device, and OFF, which does not display the at least one piece of information.

7. 7. The display system according to claim 1, wherein the control device displays all the obtained changes in information on the display device in a superimposed manner at the same time.

8. 8. The display system according to claim 1, wherein the control device displays information on the change in the position of the purchaser on the display device, excluding people other than the purchaser.

9. a first position acquisition unit that acquires a position of the person from a first device including an imaging device that captures an image of the person in order to detect the position of the person in a space in which an object exists; A second position acquisition unit that acquires the position of the object from a second device that is different from the first device and includes a communication device that communicates with a plurality of communication tags attached to each of the plurality of objects in order to detect the position of the object; a display unit that integrates and displays on a display device information regarding a change in a position of a person obtained from the first device between a predetermined time and a time other than the predetermined time, information regarding a change in a position of an object obtained from the second device between a predetermined time and a time other than the predetermined time, and information regarding a change in a relative distance between a position of the person and a position of the object between a predetermined time and a time other than the predetermined time; A control device comprising:

10. Computer, a first position acquisition unit that acquires a position of the person from a first device including an imaging device that captures an image of the person in order to detect the position of the person in a space in which an object exists; A second position acquisition unit that acquires the position of the object from a second device that is different from the first device and includes a communication device that communicates with a plurality of communication tags attached to each of the plurality of objects in order to detect the position of the object; a display unit that integrates and displays on a display device information regarding a change in a position of a person obtained from the first device between a predetermined time and a time other than the predetermined time, information regarding a change in a position of an object obtained from the second device between a predetermined time and a time other than the predetermined time, and information regarding a change in a relative distance between a position of the person and a position of the object between a predetermined time and a time other than the predetermined time; A control program that functions as a

Images