Movement line determination device, movement line determination system, movement line determination method, and program

Abstract

To provide a movement line determination device that can analyze a customer's movement line in an area with high accuracy without requiring the customer to take any special action.SOLUTION: A movement line determination device includes: a movement line information acquisition part which acquires movement line information on a moving object; a movement line information classification part which classifies the movement line information on the movement object in which at least a part of the movement line information does not include a predetermined prescribed area in the store as customer's movement line information; and a service information output part which determines whether the customer's movement line information matches predetermined movement line information, and outputs service information related to a product on a locus of the customer's movement line information if the customer's movement line information matches the predetermined movement.SELECTED DRAWING: Figure 17

Description

[Technical field]

[0001] The present invention relates to a movement line determination device, a movement line determination system, a movement line determination method, and a program. [Background technology]

[0002] Customer movement patterns may be analyzed for the purpose of sales promotion, improving customer satisfaction, etc. Patent Document 1 describes, as a related technique, a technique for extracting a trajectory of a customer's movement and adding attribute information of the customer, such as gender and age, extracted from a video, to the trajectory information. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 08-242987 Summary of the Invention [Problem to be solved by the invention]

[0004] Incidentally, when analyzing the movement of customers who do not have an authentication device such as a terminal at a supermarket or convenience store, the accuracy of the analysis of the customer movement may be reduced because customers may be mixed with store clerks who are working. Therefore, there was a demand for technology that could analyze customer movements in an area with high accuracy without forcing customers to take any special action.

[0005] Therefore, an object of the present invention is to provide a flow line determination device, a flow line determination system, a flow line determination method, and a program that can solve the above problems. [Means for solving the problem]

[0006] In order to achieve the above object, the present invention provides a flow line information classifying unit that classifies, from the flow line information of the moving object, flow line information excluding flow line information in which at least a part of the flow line information includes a predetermined area in a store, into customer flow line information; a flow line information output unit that determines, from the customer flow line information, customer flow line information that is determined to match predetermined flow line information within a range of determination error, as corresponding to the predetermined flow line, and outputs the customer flow line information determined to correspond to the predetermined flow line; and a service information output unit that outputs service information of a discount coupon related to a product on a trajectory of the customer flow line information output by the flow line information output unit. It is.

[0007] The present invention also provides a method for producing a semiconductor device comprising the steps of: A flow line determination method executed by a computer, the flow line determination method including: acquiring flow line information of a moving object; classifying, from the flow line information of the moving object, flow line information excluding flow line information in which at least a part of the flow line information includes a predetermined area in a store, into customer flow line information; determining, from the customer flow line information, customer flow line information determined to match the predetermined flow line information within a range of determination error, as corresponding to the predetermined flow line; outputting the customer flow line information determined to correspond to the predetermined flow line; and outputting service information of a discount coupon related to a product on a trajectory of the output customer flow line information. It is.

[0008] The present invention also provides a method for producing a semiconductor device comprising the steps of: A program causing a computer to execute the following: acquiring movement line information of a moving object; classifying, from the movement line information of the moving object, movement line information excluding movement line information in which at least a part of the movement line information includes a predetermined area in a store, into customer movement line information; determining, from the customer movement line information, customer movement line information determined to match the predetermined movement line information within a range of determination error, as corresponding to the predetermined movement line; outputting the customer movement line information determined to correspond to the predetermined movement line; and outputting service information of a discount coupon related to products on a trajectory of the output customer movement line information. It is.

[0009] The present invention also provides a flow line determination system including the above flow line determination device and an imaging unit that captures an image including the moving object. Effect of the Invention

[0010] According to the present invention, it is possible to perform highly accurate analysis of customer movement lines in an area without forcing the customers to take any special action. [Brief description of the drawings]

[0011] [Figure 1] 1 is a diagram illustrating a configuration of a movement line determination system according to a first embodiment of the present invention. [Diagram 2] 1 is a diagram showing a configuration of an image acquisition system according to a first embodiment of the present invention. [Diagram 3] 1 is a diagram illustrating a configuration of a movement line information generating device according to a first embodiment of the present invention. [Figure 4] 1 is a diagram illustrating a configuration of a traffic line determination device according to a first embodiment of the present invention. [Diagram 5] FIG. 2 is a diagram showing a processing flow of the movement line determination system according to the first embodiment of the present invention. [Figure 6] FIG. 11 is a diagram illustrating a configuration of a movement line determination system according to a second embodiment of the present invention. [Figure 7] FIG. 11 is a diagram showing a configuration of a movement line information generating device according to a second embodiment of the present invention. [Figure 8] FIG. 11 is a diagram showing a processing flow of a movement line determination system according to a second embodiment of the present invention. [Figure 9] FIG. 13 is a diagram illustrating a configuration of a movement line determination system according to a third embodiment of the present invention. [Figure 10] FIG. 13 is a diagram illustrating a configuration of a movement line information generating device according to a third embodiment of the present invention. [Figure 11]FIG. 11 is a diagram showing a processing flow of a movement line determination system according to a third embodiment of the present invention. [Figure 12] FIG. 13 is a diagram illustrating a configuration of a flow line determination system according to a fourth embodiment of the present invention. [Figure 13] FIG. 13 is a diagram showing a configuration of an image acquisition system according to a fourth embodiment of the present invention. [Figure 14] FIG. 13 is a diagram showing a processing flow of a flow line determination system according to a fourth embodiment of the present invention. [Figure 15] FIG. 13 is a diagram illustrating a configuration of a traffic line determination device according to a fifth embodiment of the present invention. [Figure 16] FIG. 13 is a diagram showing a processing flow of a traffic line determination system according to a fifth embodiment of the present invention. [Figure 17] FIG. 2 is a diagram showing a minimum configuration of the movement line determination device of the present invention. [Figure 18] FIG. 1 is a diagram showing a minimum configuration of a movement line determination system according to the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] First Embodiment Hereinafter, the embodiments will be described in detail with reference to the drawings. The configuration of a traffic line determination system according to a first embodiment of the present invention will be described. A movement line determination system 1 according to a first embodiment of the present invention includes an image capturing system 10, a movement line information generating device 20, and a movement line determination device 30, as shown in FIG.

[0013] As shown in FIG. 2, the image acquisition system 10 includes image acquisition units 101a, 101b, 101c, 101d, 101e, 101f, 101g, 101h, and 101i (imaging units). The image acquisition units 101a, 101b, 101c, 101d, 101e, 101f, 101g, 101h, and 101i are collectively referred to as image acquisition unit 101.

[0014] Each of the image acquisition units 101 is provided on a side wall, a ceiling, or the like in a space R (area) (region) such as a supermarket or a convenience store. Each of the image acquisition units 101 captures an image within the space R.

[0015] As shown in FIG. 3, the movement line information generating device 20 includes a movement line information generating unit 201 (movement line generating unit) and a storage unit 202. The flow line information generating unit 201 acquires from each of the video acquiring units 101 the video images captured by each of the video acquiring units 101. The flow line information generating unit 201 generates flow line information for each moving object by applying, for example, the technology described in the above Patent Document 1 to the acquired video. The storage unit 202 stores various information necessary for the processing performed by the movement line information generating device 20.

[0016] As shown in FIG. 4, the movement line determining device 30 includes a movement line information acquiring unit 301, a first moving target detecting unit 302 (determining unit), and a movement line information classifying unit 303.

[0017] The flow line information acquisition unit 301 acquires the flow line information of each moving object moving within the space R. Specifically, the movement line information acquisition unit 301 acquires the movement line information generated by the movement line information generation unit 201 from the movement line information generation device 20.

[0018] The first moving object detection unit 302 detects the movement line information of employees (first moving objects) belonging to the first category. Specifically, the first moving target detection unit 302 identifies, from among the multiple pieces of movement line information acquired by the movement line information acquisition unit 301, movement line information that passes through one or more predetermined positions within the range of error of the determination. The predetermined positions here are positions such as registers and back yard that only employees pass through. The first moving target detection unit 302 determines that the identified movement line information is movement line information of an employee belonging to the first category.

[0019] The movement line information classification unit 303 determines that movement line information that does not include movement line information about employees, among movement objects (first movement objects) belonging to the first category, and customers (second movement objects) not belonging to the first category, is customer movement line information. For example, the movement line information classification unit 303 determines that the movement line information acquired by the movement line information acquisition unit 301 is customer movement line information, excluding the movement line information determined by the first moving target detection unit 302 to be employee movement line information.

[0020] Next, the processing of the movement line determination system 1 according to the first embodiment of the present invention will be described. Here, a process flow of the traffic line determination system 1 according to the first embodiment of the present invention shown in FIG. 5 will be described. It is assumed that the movement line determination system 1 has the configuration shown in Fig. 1. The video acquisition system 10 has the configuration shown in Fig. 2. The movement line information generation device 20 has the configuration shown in Fig. 3. The movement line determination device 30 has the configuration shown in Fig. 4.

[0021] Each of the image acquisition units 101 captures an image within a space R such as a supermarket or a convenience store (step S1).

[0022] The flow line information generating unit 201 acquires the images captured by each of the image acquiring units 101 (step S2). The flow line information generating unit 201 writes the captured images into the storage unit 202 (step S3).

[0023] The flow line information generating unit 201 generates flow line information for each moving object by applying, for example, the technology described in the above Patent Document 1 to the acquired video (step S4).

[0024] The flow line information acquisition unit 301 acquires the flow line information of each moving object moving within the space R (step S5). Specifically, the movement line information acquisition unit 301 acquires the movement line information generated by the movement line information generation unit 201 from the movement line information generation device 20.

[0025] The movement line information acquiring unit 301 transmits the movement line information of each acquired moving object to the first moving object detecting unit 302 and the movement line information classifying unit 303 .

[0026] A first moving object detection unit 302 and a movement line information classification unit 303 receive the movement line information of each moving object from the movement line information acquisition unit 301 .

[0027] The first moving object detection unit 302 detects the movement line information of the employees (first moving objects) belonging to the first category (step S6). Specifically, the first moving target detection unit 302 identifies movement line information that passes through one or more predetermined positions within the range of determination error from among the multiple pieces of movement line information received from the movement line information acquisition unit 301. The first moving target detection unit 302 determines that the identified movement line information is movement line information of an employee belonging to the first category. The first moving object detection unit 302 transmits the determined employee movement line information to the movement line information classification unit 303.

[0028] The movement line information classification unit 303 receives the employee movement line information from the first moving target detection unit 302 . The movement line information classification unit 303 determines that the movement line information that does not include movement line information about employees, among the movement objects (first movement objects) belonging to the first category and the movement objects (second movement objects) belonging to the first category, is customer movement line information (step S7). For example, the movement line information classification unit 303 determines that the movement line information acquired by the movement line information acquisition unit 301 is customer movement line information, excluding the movement line information determined by the first moving target detection unit 302 to be employee movement line information.

[0029] The processing flow of the movement line determination system 1 according to the first embodiment of the present invention has been described above. The movement line determination system 1 according to the first embodiment of the present invention includes the video acquisition system 10, the movement line information generation device 20, and the movement line determination device 30. The video acquisition system 10 includes video acquisition units 101a, 101b, 101c, 101d, 101e, 101f, 101g, 101h, and 101i. Each of the video acquisition units 101 is provided on a side wall or a ceiling in a space R such as a supermarket or a convenience store. Each of the video acquisition units 101 captures a video within the space R. The movement line information generation device 20 includes a movement line information generation unit 201 and a storage unit 202. The movement line information generation unit 201 acquires the video captured by each of the video acquisition units 101 from each of the video acquisition units 101. The storage unit 202 stores various information necessary for the processing performed by the movement line information generation device 20. The movement line determination device 30 includes a movement line information acquisition unit 301, a first moving object detection unit 302, and a movement line information classification unit 303. The movement line information acquisition unit 301 acquires movement line information of each moving object moving within the space R. The first moving object detection unit 302 detects movement line information of an employee (first moving object) belonging to a first classification. The movement line information classification unit 303 determines, among moving objects belonging to employees (first moving objects) belonging to the first classification and customers (second moving objects) not belonging to the first classification, movement line information that does not include movement line information about employees as movement line information about customers. In this way, the flow line determination system 1 can distinguish between customer flow line information and employee flow line information in an area, and can identify only customer flow line information. As a result, the flow line determination system 1 can analyze customer flow lines in an area with high accuracy without forcing customers to take special actions.

[0030] Second Embodiment The configuration of a traffic line determination system according to the second embodiment of the present invention will be described. A movement line determination system 1 according to the second embodiment of the present invention includes an image capturing system 10, a movement line information generating device 20, a movement line determining device 30, and an internal attribute acquiring system 40, as shown in FIG.

[0031] The internal attribute acquisition system 40 manages attribute information. The attribute information is information stored in association with each customer, and is, for example, information indicating age and gender estimated from a video including a face using an age and gender estimation program, personal information including a personal name obtained from registration information at the time of registration of a face video or a point card, hobbies and interests estimated from a purchase history, and affiliation information obtained from object recognition of uniforms, belongings, etc. The internal attribute acquisition system 40 is a system that is provided by the company itself.

[0032] As shown in FIG. 7, the movement line information generating device 20 includes a movement line information generating unit 201, a storage unit 202, an attribute extracting unit 203, and an associating unit 204.

[0033] The attribute extraction unit 203 acquires a video corresponding to the customer flow line information determined by the flow line information classification unit 303 .

[0034] The attribute extraction unit 203 extracts attribute information that is closest to the customer from the attribute information managed by the internal attribute acquisition system 40, based on the video corresponding to the acquired customer movement line information. For example, if a customer has previously registered a facial image, the attribute extraction unit 203 uses the face in the image corresponding to the customer's movement line information to identify the customer's face from among the attribute information managed by the internal attribute acquisition system 40. The attribute extraction unit 203 extracts attribute information associated with the identified customer's face. Also, for example, if a customer has not registered a facial image, the attribute extraction unit 203 identifies the age and gender using an age / gender estimation program. The attribute extraction unit 203 also identifies information indicating personal information including the individual's name obtained from registration information at the time of registration of the facial image or a point card, hobbies and interests estimated from a purchase history, and affiliation information obtained from object recognition of uniforms, belongings, etc. Then, the attribute extraction unit 203 may extract attribute information that is closest to the identified age, gender, personal information including the individual's name, hobbies and interests estimated from a purchase history, and affiliation information from among the attribute information managed by the internal attribute acquisition system 40.

[0035] The association unit 204 associates the customer flow line information with the corresponding attribute information extracted by the attribute extraction unit 203 .

[0036] Next, the processing of the movement line determination system 1 according to the second embodiment of the present invention will be described. Here, a process flow of the traffic line determination system 1 according to the second embodiment of the present invention shown in FIG. 8 will be described.

[0037] The flow line determination system 1 performs the processes of steps S1 to S7. The attribute extraction unit 203 reads out from the storage unit 202 a video corresponding to the customer's flow line information determined by the flow line information classification unit 303 (step S8).

[0038] The attribute extraction unit 203 extracts attribute information that is closest to the customer from the attribute information managed by the internal attribute acquisition system 40, based on the video corresponding to the acquired customer movement line information (step S9). For example, if a customer has previously registered a facial image, the attribute extraction unit 203 uses the face in the image corresponding to the customer's movement line information to identify the customer's face from among the attribute information managed by the internal attribute acquisition system 40. The attribute extraction unit 203 extracts attribute information associated with the identified customer's face. Also, for example, if a customer has not registered a facial image, the attribute extraction unit 203 identifies the age and gender using an age / gender estimation program. The attribute extraction unit 203 also identifies information indicating personal information including the individual's name obtained from registration information at the time of registration of the facial image or a point card, hobbies and interests estimated from a purchase history, and affiliation information obtained from object recognition of uniforms, belongings, etc. Then, the attribute extraction unit 203 may extract attribute information that is closest to the identified age, gender, personal information including the individual's name, hobbies and interests estimated from a purchase history, and affiliation information from among the attribute information managed by the internal attribute acquisition system 40.

[0039] The association unit 204 associates the customer flow line information with the corresponding attribute information extracted by the attribute extraction unit 203 (step S10).

[0040] The processing flow of the movement line determination system 1 according to the second embodiment of the present invention has been described above. The movement line determination system 1 according to the second embodiment of the present invention includes a video acquisition system 10, a movement line information generation device 20, a movement line determination device 30, and an internal attribute acquisition system 40. The internal attribute acquisition system 40 manages attribute information. The internal attribute acquisition system 40 is a system provided by the company itself. The movement line information generation device 20 includes a movement line information generation unit 201, a storage unit 202, an attribute extraction unit 203, and a correspondence unit 204. The attribute extraction unit 203 acquires a video corresponding to the movement line information of a customer determined by the movement line information classification unit 303. The attribute extraction unit 203 extracts attribute information that is closest to the customer from the attribute information managed by the internal attribute acquisition system 40 based on the video corresponding to the acquired movement line information of the customer. The correspondence unit 204 associates the movement line information of the customer with the corresponding attribute information extracted by the attribute extraction unit 203. In this way, the flow line determination system 1 can associate attribute information with information on the flow lines of customers in an area. As a result, the flow line determination system 1 can analyze the flow lines of customers in an area with high accuracy without forcing the customers to take special actions, and can provide services more suited to the customers.

[0041] <Third embodiment> The configuration of a traffic line determination system according to the third embodiment of the present invention will be described. A movement line determination system 1 according to the third embodiment of the present invention includes an image capturing system 10, a movement line information generating device 20, a movement line determination device 30, and an external attribute acquiring system 50, as shown in FIG.

[0042] The external attribute acquisition system 50 manages attribute information. The attribute information is information stored in association with each customer, and is, for example, information indicating age and gender estimated from a video including a face using an age and gender estimation program, personal information including a personal name obtained from registration information at the time of registration of a face video or a point card, hobbies and interests estimated from a purchase history, and affiliation information obtained from object recognition of uniforms, belongings, etc. The external attribute acquisition system 50 is a system provided by an external company.

[0043] As shown in FIG. 10, the movement line information generating device 20 includes a movement line information generating unit 201, a storage unit 202, an association unit 204, and an attribute acquiring unit 205.

[0044] The attribute acquisition unit 205 acquires a video corresponding to the customer flow line information determined by the flow line information classification unit 303 .

[0045] The attribute acquisition unit 205 extracts attribute information that is closest to the customer from the attribute information managed by the external attribute acquisition system 50, based on the video corresponding to the acquired customer movement line information. For example, if a customer has previously registered a facial image, the attribute acquisition unit 205 uses the face in the image corresponding to the customer's movement line information to identify the face of the customer from the attribute information managed by the external attribute acquisition system 50. The attribute acquisition unit 205 extracts attribute information associated with the identified customer's face. Also, for example, if a customer has not registered a facial image, the attribute acquisition unit 205 uses an age and gender estimation program to identify the age and gender. The attribute acquisition unit 205 also identifies information indicating personal information including the individual's name obtained from registration information at the time of registration of the facial image or a point card, hobbies and interests estimated from a purchase history, and affiliation information obtained from object recognition of uniforms, belongings, etc. Then, the attribute acquisition unit 205 may extract attribute information that is closest to the identified age, gender, personal information including the individual's name, hobbies and interests estimated from a purchase history, and affiliation information from among the attribute information managed by the external attribute acquisition system 50.

[0046] The association unit 204 associates the customer flow line information with the corresponding attribute information extracted by the attribute acquisition unit 205 .

[0047] Next, the processing of the movement line determination system 1 according to the third embodiment of the present invention will be described. Here, a process flow of the movement line determination system 1 according to the third embodiment of the present invention shown in FIG. 11 will be described.

[0048] The flow line determination system 1 performs the processes of steps S1 to S7. The attribute acquiring unit 205 reads out from the storage unit 202 a video corresponding to the customer's flow line information determined by the flow line information classifying unit 303 (step S11).

[0049] The attribute acquisition unit 205 extracts attribute information that is closest to the customer from the attribute information managed by the external attribute acquisition system 50, based on the video corresponding to the acquired customer movement line information (step S12). For example, if a customer has previously registered a facial image, the attribute acquisition unit 205 uses the face in the image corresponding to the customer's movement line information to identify the face of the customer from the attribute information managed by the external attribute acquisition system 50. The attribute acquisition unit 205 extracts attribute information associated with the identified customer's face. Also, for example, if a customer has not registered a facial image, the attribute acquisition unit 205 uses an age and gender estimation program to identify the age and gender. The attribute acquisition unit 205 also identifies information indicating personal information including the individual's name obtained from registration information at the time of registration of the facial image or a point card, hobbies and interests estimated from a purchase history, and affiliation information obtained from object recognition of uniforms, belongings, etc. Then, the attribute acquisition unit 205 may extract attribute information that is closest to the identified age, gender, personal information including the individual's name, hobbies and interests estimated from a purchase history, and affiliation information from among the attribute information managed by the external attribute acquisition system 50.

[0050] The association unit 204 associates the customer flow line information with the corresponding attribute information extracted by the attribute acquisition unit 205 (step S13).

[0051] The processing flow of the movement line determination system 1 according to the third embodiment of the present invention has been described above. The movement line determination system 1 according to the third embodiment of the present invention includes a video acquisition system 10, a movement line information generation device 20, a movement line determination device 30, and an external attribute acquisition system 50. The external attribute acquisition system 50 manages attribute information. The external attribute acquisition system 50 is a system provided by an external company. The movement line information generation device 20 includes a movement line information generation unit 201, a storage unit 202, a matching unit 204, and an attribute acquisition unit 205. The attribute acquisition unit 205 acquires a video corresponding to the movement line information of a customer determined by the movement line information classification unit 303. The attribute acquisition unit 205 extracts attribute information that is closest to the customer from the attribute information managed by the external attribute acquisition system 50 based on the video corresponding to the acquired movement line information of the customer. The matching unit 204 associates the movement line information of the customer with the corresponding attribute information extracted by the attribute acquisition unit 205. In this way, the flow line determination system 1 can associate attribute information with information on the flow lines of customers in an area. As a result, the flow line determination system 1 can analyze the flow lines of customers in an area with high accuracy without forcing the customers to take special actions, and can provide services more suited to the customers.

[0052] <Fourth embodiment> The configuration of a traffic line determination system according to a fourth embodiment of the present invention will be described. A movement line determination system 1 according to the fourth embodiment of the present invention includes an image capturing system 10, a movement line information generating device 20, a movement line determination device 30, and a terminal device 60, as shown in FIG.

[0053] As shown in FIG. 13, the image acquisition system 10 includes short-range communication units 102a, 102b, 102c, 102d, 102e, 102f, 102g, 102h, 102i, and 102j. The short-range communication units 102a, 102b, 102c, 102d, 102e, 102f, 102g, 102h, 102i, and 102j are collectively referred to as short-range communication unit 102. Each of the short-range communication units 102 is provided in a space R of a supermarket, convenience store, etc., such as the checkout area, back yard, or product shelves, where only employees pass through or where employees are likely to stay for a longer period of time than customers. Each of the short-range communication units 102 performs short-range communication with the terminal device 60 described below. The short-range communication is communication performed using, for example, WiFi (registered trademark), BLE (Bluetooth Low Energy) (Bluetooth is a registered trademark), etc. Each of the short-range communication units 102 records the time when the short-range communication with the terminal device 60 is performed. The terminal device 60 communicates with the short-range communication unit 102 provided in each employee. The terminal device 60 is, for example, a smartphone.

[0054] Next, the processing of the movement line determination system 1 according to the fourth embodiment of the present invention will be described. Here, a process flow of the traffic line determination system 1 according to the fourth embodiment of the present invention shown in FIG. 14 will be described. It is assumed that the movement line determination system 1 has the configuration shown in Fig. 12. The video acquisition system 10 has the configuration shown in Fig. 13. The movement line information generation device 20 has the configuration shown in Fig. 3. The movement line determination device 30 has the configuration shown in Fig. 4.

[0055] The flow line determination system 1 performs the process of step S1. In parallel with the process of step S1 of the movement line determination system 1, each of the short-range communication units 102 performs short-range communication with the terminal device 60 (step S14).

[0056] Each of the short-range communication units 102 records the time when it performed short-range communication with the terminal device 60 (step S15). The flow line determination system 1 performs the processes of steps S2 to S5.

[0057] The movement line information acquiring unit 301 transmits the movement line information of each acquired moving object to the first moving object detecting unit 302 and the movement line information classifying unit 303 .

[0058] A first moving object detection unit 302 and a movement line information classification unit 303 receive the movement line information of each moving object from the movement line information acquisition unit 301 .

[0059] The first moving object detection unit 302 acquires, from the video acquisition system 10, the time when the short-range communication unit 102 performed short-range communication with the terminal device 60 and the position information of the short-range communication unit 102 (step S16).

[0060] The first moving object detection unit 302 detects the movement line information of the employees (first moving objects) belonging to the first category (step S17). Specifically, the first moving target detection unit 302 identifies the correspondence between the employee's position and time from the time when the short-range communication unit 102 performed short-range communication with the terminal device 60 and the position information of the short-range communication unit 102. The correspondence between the position and time here includes the time when the employee passed through a predetermined position and the time spent staying at the predetermined position. The first moving target detection unit 302 also identifies the correspondence between the position and time for each of the multiple pieces of movement line information received from the movement line information acquisition unit 301. The first moving target detection unit 302 compares the correspondence between the position and time for each of the multiple pieces of movement line information received from the movement line information acquisition unit 301 with the correspondence between the employee's position and time. The first moving target detection unit 302 identifies the movement line information received from the movement line information acquisition unit 301 including the correspondence that matches the correspondence between the employee's position and time within the range of the determination error as the movement line information of the employee. For example, the first moving target detection unit 302 identifies movement line information indicating a person staying at the same product shelf for a predetermined time or more as employee movement line information. This is based on the judgment that a person staying at the same product shelf for a predetermined time or more is highly likely to be working on displaying products.

[0061] The first moving object detection unit 302 transmits the determined employee movement line information to the movement line information classification unit 303.

[0062] The movement line information classification unit 303 receives the employee movement line information from the first moving target detection unit 302 . The flow line determination system 1 performs the process of step S7.

[0063] As a means for identifying the correspondence between an employee's location and time, a device that identifies location and time using GPS (Global Positioning System), UWB (Ultra WideBand), sound waves, IMES (Indoor MEssaging System), PDR (Pedestrian Dead Reckoning), etc. may be used instead of the short-range communication unit 102.

[0064] The processing flow of the movement line determination system 1 according to the fourth embodiment of the present invention has been described above. The movement line determination system 1 according to the fourth embodiment of the present invention includes the video acquisition system 10, the movement line information generation device 20, the movement line determination device 30, and the terminal device 60. The video acquisition system 10 includes the short-distance communication units 102a, 102b, 102c, 102d, 102e, 102f, 102g, 102h, 102i, and 102j. Each of the short-distance communication units 102 is provided in a checkout area, a backyard, a product shelf, or the like in a space R of a supermarket or a convenience store, where only employees pass through, or where employees are more likely to stay for a long time than customers. Each of the short-distance communication units 102 performs short-distance communication with the terminal device 60. Each of the short-distance communication units 102 records the time when the short-distance communication with the terminal device 60 is performed. The first moving target detection unit 302 acquires the time when the short-range communication unit 102 performed short-range communication with the terminal device 60 and the position information of the short-range communication unit 102 from the video acquisition system 10. The first moving target detection unit 302 detects the movement line information of the employee (first moving target) belonging to the first category. Specifically, the first moving target detection unit 302 identifies the correspondence between the position and time of the employee from the time when the short-range communication unit 102 performed short-range communication with the terminal device 60 and the position information of the short-range communication unit 102. In addition, the first moving target detection unit 302 identifies the correspondence between the position and time for each of the multiple pieces of movement line information received from the movement line information acquisition unit 301. The first moving target detection unit 302 compares the correspondence between the position and time for each of the multiple pieces of movement line information received from the movement line information acquisition unit 301 with the correspondence between the position and time of the employee. The first moving target detection unit 302 identifies, as employee flow line information, the flow line information received from the flow line information acquisition unit 301 that includes a correspondence relationship that matches the correspondence relationship between the employee's position and time within the range of determination error. In this way, the flow line determination system 1 can better distinguish between customer flow line information and employee flow line information in an area based on the correspondence between the employee's position and time, and can identify only customer flow line information. As a result, the flow line determination system 1 can analyze customer flow lines in an area with higher accuracy without forcing customers to take special actions.

[0065] <Fifth embodiment> The configuration of a traffic line determination system according to a fifth embodiment of the present invention will be described. The movement line determination system 1 according to the fifth embodiment of the present invention includes an image capturing system 10, a movement line information generating device 20, and a movement line determination device 30, similar to the movement line determination system 1 according to the first embodiment of the present invention.

[0066] As shown in FIG. 15, the movement line determining device 30 includes a movement line information acquiring unit 301, a first moving target detecting unit 302, a movement line information classifying unit 303, a movement line information output unit 304, and a service information output unit 305.

[0067] The flow line information output unit 304 outputs flow line information determined to correspond to a predetermined flow line from among the customer flow line information.

[0068] The special offer information output unit 305 outputs special offer information to customers who move along the trajectory of the trajectory information output by the trajectory information output unit 304. The special offer information is, for example, information on sale days and discount coupons related to products on the trajectory.

[0069] Next, the processing of the movement line determination system 1 according to the fifth embodiment of the present invention will be described. Here, a process flow of the traffic line determination system 1 according to the fifth embodiment of the present invention shown in FIG. 16 will be described. It is assumed that the movement line determination system 1 has the configuration shown in Fig. 1. The video acquisition system 10 has the configuration shown in Fig. 12. The movement line information generation device 20 has the configuration shown in Fig. 3. The movement line determination device 30 has the configuration shown in Fig. 15.

[0070] The flow line determination system 1 performs the processes of steps S1 to S7. The flow line information output unit 304 outputs the flow line information determined to correspond to a predetermined flow line from among the customer flow line information (step S18). For example, the movement line information output unit 304 reads out predetermined movement line information indicating a predetermined movement line determined in advance from the storage unit. The movement line information output unit 304 compares the read out predetermined movement line information with each of the customer movement line information. When the movement line information output unit 304 determines that the read out predetermined movement line information matches within the range of a determination error among the customer movement line information, it determines that the customer movement line information corresponds to the predetermined movement line. Then, the movement line information output unit 304 outputs the movement line information to a monitor or the like. At this time, the movement line information output unit 304 may simultaneously display an image of the customer on the monitor together with the movement line information.

[0071] The special offer information output unit 305 outputs special offer information to customers who move along the trajectory of the trajectory information output by the trajectory information output unit 304. The special offer information is, for example, information on sale days and discount coupons related to products on the trajectory. The service information may be provided by an employee to the customer by hand or by mail after viewing the information displayed on a monitor or the like.

[0072] The processing flow of the movement line determination system 1 according to the fifth embodiment of the present invention has been described above. The movement line determination system 1 according to the fifth embodiment of the present invention includes a video acquisition system 10, a movement line information generation device 20, and a movement line determination device 30. The movement line determination device 30 includes a movement line information acquisition unit 301, a first moving target detection unit 302, a movement line information classification unit 303, a movement line information output unit 304, and a service information output unit 305. The movement line information output unit 304 outputs movement line information determined to correspond to a predetermined movement line among the customer movement line information. The service information output unit 305 outputs service information for a customer who moves on the trajectory of the movement line information output by the movement line information output unit 304. In this way, the flow line determination system 1 can provide service information according to the hobbies and tastes of the customer.

[0073] A flow line determining device having a minimum configuration according to the present invention will be described. A flow line determining device 30 having a minimum configuration according to the present invention includes a flow line information acquiring unit 301 and a determining unit 302, as shown in FIG.

[0074] The flow line information acquisition unit 301 acquires the flow line of a target. The determining unit 302 determines, among the target flow lines, a flow line at least a part of which is included in a predetermined area, as a flow line of a person belonging to the first category.

[0075] In this way, the flow line determination device 30 can determine the flow line information of people (e.g., employees) belonging to the first category and distinguish it from customer flow line information. As a result, the flow line determination device 30 can analyze the customer flow line in the area with high accuracy without forcing the customer to take a special action.

[0076] A minimum configuration of the traffic line determination system of the present invention will be described. A flow line determination system 1 having a minimum configuration according to the present invention includes an image capture unit 101, a flow line generation unit 201, and a determination unit 302, as shown in FIG.

[0077] The imaging unit 101 captures an image. The movement line generation unit 201 generates a movement line of a target included in an image captured by the imaging unit 101. The determination unit 302 determines, among the movement lines of the target acquired from the movement line generation unit 201, a movement line at least part of which is included in a predetermined area, as a movement line of a person belonging to a first classification.

[0078] In this way, the movement line determination system 1 can determine the movement line information of people (e.g., employees) belonging to the first category and distinguish it from customer movement line information. As a result, the movement line determination device 30 can analyze the customer movement line in the area with high accuracy without forcing the customer to take a special action.

[0079] The movement line determination device 30 according to the embodiment of the present invention may include some or all of the functional units of the movement line information generation device 20.

[0080] In addition, in the process flow according to the embodiment of the present invention, the order of processes may be changed as long as appropriate processes are performed.

[0081] The storage unit 202 and other storage units in the embodiment of the present invention may be provided anywhere within the range where appropriate information is transmitted and received. Also, the storage unit 202 and other storage units may be present in multiple locations within the range where appropriate information is transmitted and received, and data may be stored in a distributed manner.

[0082] Although the embodiment of the present invention has been described, each of the above-mentioned video acquisition system 10, the movement line information generating device 20, the movement line determining device 30, the internal attribute acquisition system 40, the external attribute acquisition system 50, and the terminal device 60 may have a computer system therein. The above-mentioned process steps are stored in a computer-readable recording medium in the form of a program, and the above-mentioned process is performed by the computer reading and executing the program. Here, the computer-readable recording medium refers to a magnetic disk, a magneto-optical disk, a CD-ROM, a DVD-ROM, a semiconductor memory, etc. Also, the computer program may be distributed to a computer via a communication line, and the computer that receives the distribution may execute the program.

[0083] The program may also realize some of the functions described above. Furthermore, the program may be a file that can realize the functions described above in combination with a program already recorded in the computer system, that is, a so-called differential file (differential program).

[0084] Although several embodiments of the present invention have been described, these embodiments are merely examples and do not limit the scope of the invention. These embodiments may be added, variously omitted, substituted, or modified without departing from the spirit of the invention. [Explanation of symbols]

[0085] 1. Traffic flow determination system 10. Image Acquisition System 20...Flow line information generation device 30...Flow line determination device 40. Internal attribute acquisition system 50. External attribute acquisition system 60 Terminal device 101, 101a, 101b, 101c, 101d, 101e, 101f, 101g, 101h, 101i...Image acquisition unit 102, 102a, 102b, 102c, 102d, 102e, 102f, 102g, 102h, 102i, 102j...Near field communication section 201...Flow line information generation section 202...Storage section 203...Attribute extraction section 204... Correspondence section 205...Attribute acquisition section 301...Flow line information acquisition unit 302: First moving object detection unit, determination unit 303...Flow line information classification section 304 Flow line information output unit 305 Service information output unit

Claims

1. A flow line information acquisition unit that acquires flow line information of a moving object; a flow line information classification unit that classifies, from the flow line information of the moving object, flow line information excluding flow line information in which at least a part of the flow line information includes a predetermined area in the store, into customer flow line information; a flow line information output unit that determines that among the customer flow line information, customer flow line information that is determined to match predetermined flow line information within a range of determination error corresponds to the predetermined flow line, and outputs the customer flow line information that is determined to correspond to the predetermined flow line; a service information output unit that outputs service information of a discount coupon related to a product on the trajectory of the customer's flow line information output by the flow line information output unit; A traffic flow determination device comprising:

2. The service information is Information on sale dates or discount coupons for products on the trajectory of the customer's movement line information. The traffic line determination device according to claim 1 .

3. The movement line information classification unit, Among the movement line information of the moving object, movement line information other than that classified as store clerk movement line information is classified as customer movement line information. The traffic line determination device according to claim 1 or 2.

4. a moving object detection unit which identifies a correspondence relationship between a store clerk's position and time, identifies a correspondence relationship between a position and time for each of the moving object's movement line information, and identifies the identified correspondence relationship for each of the moving object's movement line information including a correspondence relationship that matches the correspondence relationship between the store clerk's position and time within a range of judgment error as the movement line information of the store clerk; Equipped with The movement line information classification unit, classifying, as customer flow information, flow information of the moving objects that existed in the predetermined area at a predetermined time, excluding the flow information of the store clerk identified by the moving object detection unit; The traffic line determination device according to any one of claims 1 to 3.

5. The movement line information classification unit, Classifying the flow line information, at least a part of which is included in the predetermined area, into a flow line of a store clerk. The traffic line determination device according to any one of claims 1 to 4.

6. The correspondence relationship between the position and the time includes a relationship between a time when the object passes through a predetermined position and a residence time when the object stays at the predetermined position. The traffic line determination device according to claim 4 .

7. The traffic line determination device according to claim 1 , An imaging unit that captures an image including the moving object; A traffic flow determination system comprising:

8. A flow line determination method executed by a computer, comprising: Acquiring movement line information of a moving object; classifying, from the movement line information of the moving object, movement line information excluding movement line information in which at least a part of the movement line information includes a predetermined area in the store, into customer movement line information; Among the customer flow line information, customer flow line information determined to match predetermined flow line information within a range of determination error is determined to correspond to the predetermined flow line, and the customer flow line information determined to correspond to the predetermined flow line is output; outputting discount coupon service information related to products on the trajectory of the outputted customer movement line information; A movement line determination method comprising:

9. On the computer, Acquiring movement line information of a moving object; classifying, from the movement line information of the moving object, movement line information excluding movement line information in which at least a part of the movement line information includes a predetermined area in the store, into customer movement line information; Among the customer flow line information, customer flow line information determined to match predetermined flow line information within a range of determination error is determined to correspond to the predetermined flow line, and the customer flow line information determined to correspond to the predetermined flow line is output; outputting discount coupon service information related to products on the trajectory of the outputted customer movement line information; A program that executes the following.

Images