Communication controller and communication control system and guidance system

Abstract

To enable the identification of a person without compromising detection accuracy in an object with a communication terminal.SOLUTION: A communication controller for identifying an object having a communication terminal comprises a storage device that stores terminal movement locus information containing multiple position information of the communication terminal and object movement locus information containing multiple position information of the object, and a control unit that associates the communication terminal with the object, where the control unit calculates a first similarity from the terminal movement locus information and the object movement locus information of the first object, calculates a second similarity between the terminal movement locus information and the object movement locus information of a second object, and based on the first similarity and the second similarity, associates the communication terminal with the object having a higher similarity, and displays an image in which the object having the higher similarity is associated with the communication terminal on a display device.SELECTED DRAWING: Figure 4

Description

Technical Field

[0001] The present invention relates to a communication control device, a communication control system, and a guidance system for identifying an object having a predetermined terminal from video and position information.

Background Art

[0002] A technique for tracking the movement of a specific object by combining continuous video such as a camera and object detection technology is known. For example, Patent Document 1 discloses a technique for detecting a movement pattern of a target person from past images, estimating the position of the target person in a current image, and continuously tracking the target person by matching the image of the target person.

[0003] In recent years, attention has been paid to the fact that there are many people carrying communication terminals such as smartphones or objects equipped with them, and a technique for tracking by utilizing sensor information obtained from smartphones has been developed. For example, Patent Document 2 discloses a technique for collecting an acceleration vector observed by a terminal possessed by a target moving body and identifying the target moving body by evaluating the similarity with the acceleration vector obtained from video.

[0004] Further, Patent Document 3 discloses a technique for observing a moving body in an area using a camera installed in a base station of a mobile phone, obtaining the position of a terminal possessed by the target moving body and communication characteristics (such as broadband communication and low-latency communication) from communication contents with the base station, and identifying the target moving body using the communication characteristics.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Patent Document 2

Patent Document 3

Summary of the Invention

Problems to be Solved by the Invention

[0006] However, when a person makes irregular movements such as stopping or changing the moving direction, the detection accuracy may decrease. Furthermore, for example, in a theme park or a station where the density of people is high and people having communication terminals with the same type of sensor values and communication types are in close proximity, the detection accuracy may decrease.

[0007] When the detection accuracy decreases, it becomes difficult to associate the communication terminal with the person. In such a case, as a specific case, the following problems occur. For example, the operation staff of a theme park is watching a video in which a communication terminal and a person are associated on a display device (such as a monitor). When the operation staff discovers a person having a communication terminal capable of receiving a predetermined preferential service, the operation staff guides the person and provides the predetermined preferential service. However, when the detection accuracy decreases, it becomes difficult to provide an appropriate service to the person.

[0008] The present invention solves the above problems, and an object thereof is to be able to identify a person without decreasing the detection accuracy in an object having a communication terminal.

Means for Solving the Problems

[0009] To achieve the above object, one aspect of the communication control device of the present invention is a communication control device that identifies an object having a communication terminal, including a storage device having terminal movement trajectory information including a plurality of position information of the communication terminal and object movement trajectory information including a plurality of position information of the object, and a control unit that associates the communication terminal with the object. The control unit calculates a first similarity from the terminal movement trajectory information and the object movement trajectory information of the first object, calculates a second similarity from the terminal movement trajectory information and the object movement trajectory information of the second object, associates the object with a high similarity with the communication terminal from the first similarity and the second similarity, and displays a video in which the object with a high similarity and the communication terminal are associated on a display device.

Effects of the Invention

[0010] According to the present invention, it is possible to identify a person in an object having a communication terminal without reducing detection accuracy. [Brief explanation of the drawings]

[0011] [Figure 1] 1 is a configuration diagram of a communication control system according to an embodiment of the present invention. [Figure 2] FIG. 2 is a functional block diagram of a communication control device according to an embodiment of the present invention. [Figure 3] FIG. 2 is a hardware block diagram of a communication control device according to an embodiment of the present invention. [Figure 4] 3 is an operation flowchart of the communication control system according to the first embodiment of the present invention. [Figure 5] 4 is a location history of a service target terminal in an embodiment of the present invention. [Figure 6] 3 is a history of object positions in a video in an embodiment of the present invention; [Figure 7] 10 is an example of an operation for associating a terminal with an object in an embodiment of the present invention. [Figure 8] 10 is an example of calculation of the similarity between the trajectory of a terminal and the trajectory of an object in an embodiment of the present invention. [Figure 9] 10 is a diagram illustrating an example of a display of a result of associating a terminal with an object in an embodiment of the present invention. [Figure 10] 10 is an operation flowchart of a communication control system according to a second embodiment of the present invention. [Figure 11] 10 is an operation flowchart of a communication control system according to a third embodiment of the present invention. [Figure 12] FIG. 10 is a configuration diagram of a communication control system according to a fourth embodiment of the present invention. [Figure 13] 10 is an operation flowchart of a communication control system according to a fourth embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0012] Hereinafter, embodiments will be described with reference to the drawings.

Example

[0013] FIG. 1 is a configuration example of a communication control system according to an embodiment of the present invention. In the drawings of this embodiment, the same parts are denoted by the same reference numerals, but the present invention is not limited to this embodiment, and all application examples consistent with the idea of the present invention are included in the technical scope of the present invention. Also, unless otherwise specified, each component may be plural or singular.

[0014] The communication control system 100 includes an object 101 which is a person having a communication terminal 102, an object 110 which is a person having a communication terminal 109, a position detection device 103, a wireless communication device 104, a camera device 105, and a communication control device 106. The communication base station 107 has a position detection device 103, a wireless communication device 104, etc. The position detection device 103 and the wireless communication device 104 may each be in an independent base station. Also, the objects 101 and 110 may be, in addition to persons, luggage, vehicles etc., as long as they have a communication terminal and can move.

[0015] The communication terminals 102 and 109 detect that they have entered the communication area of the wireless communication device 104 based on information such as the SSID (Service Set Identifier) notified by the wireless communication device 104. Then, the communication terminals 102 and 109 perform authentication etc. on the communication control device 106 via the wireless communication device 104 using communication means such as a wireless LAN, and make the communication control device 106 recognize that the communication terminals 102 and 109 are the targets of the services provided by the communication control device 106.

[0016] The communication control device 106 that has recognized the communication terminals 102 and 109 that are service targets instructs the position detection device 103 to start detecting the positions of the communication terminals 102 and 109, and instructs the camera device 105 to provide camera video information.

[0017] The position detection device 103 calculates the distance from, for example, the reception intensity of radio waves and performs trilateration from the information of three or more position detection devices 103. Then, it calculates the arrival direction of the radio waves and integrates the information of the plurality of position detection devices 103. Further, it performs collation between the reception radio wave intensities of the communication terminal 102 and the communication terminal 109 and a pre-created radio wave intensity map. In this way, the position detection device 103 detects the current positions of the communication terminal 102 and the communication terminal 109 and notifies the communication control device 106 of the positions. The position detection device 103 may also acquire position information using information such as an acceleration sensor and a pedometer included in the communication terminal 102.

[0018] Note that although the object 101 having the communication terminal 102 and the object 110 having the communication terminal 109 are described as examples, three or more communication terminal 102 objects can notify the communication control device 106 of their respective positions.

[0019] FIG. 2 is a functional block diagram of the communication control device 106 in an embodiment of the present invention. The communication control device 106 includes a control unit 1201, an application interface unit 1202, a position detection interface unit 1203, a communication interface unit 1204, a camera interface unit 1205, a terminal information database (DB) 1206, and an object information database (DB) 1207.

[0020] The position detection interface unit 1203 transmits and receives data to and from the position detection device 103 and acquires the position information of the communication terminal 102 for the detected service target.

[0021] The communication interface unit 1204 transmits and receives data to and from the wireless communication device 104 and acquires information such as the ID of the communication terminal 102 of the service target within the target area and an authentication request for the service target terminal. It also acquires information such as the relative distance information between the communication terminal 102 and other terminals measured by the communication terminal 102.

[0022] The camera interface unit 1205 transmits and receives data to and from the camera device 105 and acquires the video (video of the object 101) within the service area captured as video information.

[0023] The control unit 1201 controls the operation of the communication control device 106. It extracts the trajectory of the movement of the object 101 in the video (object movement trajectory information), extracts the trajectory of the movement of the communication terminal 102 targeted for the service (terminal movement trajectory information), and identifies and associates the correspondence between the communication terminal 102 and the object 101 based on their similarity. It corrects and obtains the position information of the communication terminal 102 based on the acquired information on the relative distance between the terminals. When the object 101 or the object 110 is a person, the object movement trajectory information, which is the trajectory of the movement, is the person movement trajectory information.

[0024] The application interface unit 1202 displays the correspondence between the communication terminal 102 and the object 101 on the display device 108 for the user of the system.

[0025] The terminal information database 1206 stores the ID of the communication terminal targeted for the service obtained by the communication interface unit 1204, the position information (history information) at each time, the information of the associated object, and the like.

[0026] The object information database 1207 stores the ID of the object detected from the video obtained by the camera interface unit 1205, the information of the position information (history information) at each time, and the like.

[0027] FIG. 3 is a hardware configuration diagram of the communication control device 106 in an embodiment of the present invention. The communication control device 106 includes an application interface unit 1202, a position detection interface unit 1203, a communication interface unit 1204, a camera interface unit 1205, etc. as interfaces to external nodes.

[0028] Further, the communication control device 106 includes a processor 1301, a data buffer 1302, a memory 1303, etc., which are respectively connected by an internal bus 1304.

[0029] The processor 1301 is a CPU or the like that executes various programs and the like. The memory 1303 holds the necessary data for expanding the programs processed by the processor 1301. The data buffer 1302 temporarily stores various data. The processor 1301, the data buffer 1302, the data buffer 1302, etc. constitute a control unit and execute the processing control of various programs and the like.

[0030] In addition, the communication control device 106 has a storage device 1305 that stores programs and tables, and stores an object detection program 1306, a terminal management program 1307, a terminal position correction program 1308, a terminal object identification program 1309, a parameter management table 1310, and the like.

[0031] The parameter management table 1310 includes a terminal information database 1206, an object information database 1207, and the like. Here, various information may be described in terms of "table" or the like, but it may be expressed in a data structure other than a table.

[0032] The object detection program 1306 has a function of detecting an object and its respective positions for each frame image from the video received from the camera interface unit 1205 in conjunction with the control unit.

[0033] The terminal management program 1307 has a function of determining whether to use a service target terminal based on an authentication request from a target terminal received from the communication interface unit 1204 in conjunction with the control unit.

[0034] The terminal position correction program 1308 has a function of correcting the position information of the terminal based on the position information of the terminal received from the position detection interface unit 1203 and the information on the relative distance between the communication terminal 102 and other terminals measured by the communication interface unit 1204 in conjunction with the control unit.

[0035] The terminal object identification program 1309 operates in conjunction with the control unit. Based on the table of the IDs of communication terminals to be serviced and multiple pieces of location information (history information) for each time stored in the terminal information database 1206 of the storage device 1305, it extracts the movement trajectory (terminal movement trajectory information) of the service target terminal. Also, based on the table of the IDs of objects and multiple pieces of location information (history information) for each time stored in the object information database 1207 of the storage device 1305, it extracts the movement trajectory (object movement trajectory information) of the object. And it has a function of calculating the similarity from each of the extracted trajectories and performing an identification process of identifying the object corresponding to the terminal based on the degree of similarity.

[0036] These programs may be installed from a program source. The program source may be provided, for example, by a program distribution server or a storage medium.

[0037] The parameter management table 1310 includes the terminal information database 1206, the object information database 1207, etc.

[0038] Note that the function and hardware division of the communication control device 106 shown above are just examples, and other configurations may be used as long as they can communicate with the communication terminal 102, communication terminal 109, position detection device 103, wireless communication device 104, and camera device 105 and realize the same function as the entire communication control device 106.

[0039] The operation of the first embodiment will be described. In this embodiment, the communication control device 106 identifies the correspondence between the communication terminal 102, etc. and the object 101, etc. based on the movement trajectory of the communication terminal to be serviced and the movement trajectory of the object 101. FIG. 4 is an operation flowchart of the communication control system in the first embodiment of the present invention.

[0040] The communication control device 106 obtains the ID of the communication terminal at a predetermined time via the wireless communication device 104 and determines whether a communication terminal to be serviced with a table structure as shown in FIG. 5 exists within the area (process 201).

[0041] When there are communication terminals 102, etc. that are service targets, the communication control device 106 acquires the IDs and current positions of the communication terminals 102, etc. from the position detection device 103. Then, it updates the history of the terminal positions regarding the service target terminals (process 202).

[0042] The history of the terminal positions is, for example, in a data format with a table structure as shown in FIG. 5. This is stored in the terminal information database 1206 of the parameter management table 1310 in the storage device 1305 such as the non-volatile memory or hard disk drive of the communication control device 106. In this table structure, the position is updated incrementally with the passage of time at predetermined intervals.

[0043] This time is set to every predetermined time converted into a stride or every second so that the detection accuracy does not decrease when there is irregular movement. The time may be changed based on information such as the acceleration sensor or pedometer of a predetermined communication terminal, or may be changed based on the information and accuracy of a plurality of acquired communication terminals. Also, as the position information, if geomagnetic measurement of the area is being performed, it may be acquired using the magnetometer, etc. of the communication terminal.

[0044] In FIG. 5, the history of the position of the communication terminal 102 indicates that the ID information "Terminal 1" of the communication terminal 102 starts recognition at the position where the X-axis is "3" and the Y-axis is "0" at time "5". Also, the history of the position of the communication terminal 109 indicates that "Terminal 2" starts recognition at the position where the X-axis is "0" and the Y-axis is "0" at time "8". Note that "Terminal 2" indicates that it did not obtain position information and was not within the communication area from time "5" to "7". Then, at the current time "10", "Terminal 1" as the first communication terminal and "Terminal 2" as the second communication terminal exist, and their terminal positions are added to the table structure.

[0045] Next, obtain the video of the area from the camera device 105 at the predetermined time when the ID of the communication terminal is obtained, or at the predetermined time obtained by adding a certain short period of time to the predetermined time when the ID of the communication terminal is obtained. Further, detect an object in the video and obtain the current position of the object. Then, update the history of the terminal position (Process 203). To obtain the position of the object, for example, obtain the relative position from the known coordinates of a marker such as an address display in the obtained video. Coordinate conversion may be performed and obtained based on the information on the absolute position where the camera is installed and the information on the position in the video. Then, calculate the absolute position from the video and obtain the position of each object. Here, the determination as to whether it is the same object is made using feature amounts such as the color, size, and shape of the object in the current frame image and the previous frame image of the video.

[0046] The history of the position of the object in the video is in a data format with a table structure as shown in FIG. 6, for example. This is stored in the object information database 1207 in the storage device 1305 such as the non-volatile memory or hard disk drive of the communication control device 106. Note that in this table structure, the position is additionally updated as time passes.

[0047] As shown in FIG. 6, the history of the position of the object 101 indicates that the ID information "Object A" of the object 101 starts recognition at the position where the X-axis is "0" and the Y-axis is "0" at time "5". Also, "Object B" starts recognition at the position where the X-axis is "3" and the Y-axis is "0" at time "5". Note that "Object B" indicates that it did not obtain position information and was not within the video area from time "5" to "4". Here, at the current time "10", objects "Object A" to "Object E" exist, and the positions of those objects are added to the table structure.

[0048] Next, in Process 204, calculate and compare the similarity of the trajectories from the trajectory of the history of the terminal position as shown in FIG. 5 obtained from Process 202 and the trajectory of the history of the object position as shown in FIG. 6 obtained from Process 203.

[0049] The similarity of the trajectories is, for example, the sum of the distances calculated between the trajectory of "Terminal 1" extracted from a table structure such as that in FIG. 5 and the respective trajectories of "Object A" to "Object E" extracted from a table structure such as that in FIG. 6. The combination with the smallest such sum is determined to have the highest similarity. In this way, the object and the terminal having the trajectory with the highest similarity are associated (Process 204).

[0050] Here, the similarity is calculated, for example, by the sum of Euclidean distances using the straight-line distance between two points for each time. This distance may be the distance between two points by other methods, such as the Manhattan distance or the like.

[0051] Also, it is specified that the ID information (e.g., "Terminal 1") of the communication terminal 102 or the like in the data format of the table structure of the terminal information database 1206 as shown in FIG. 5 corresponds to the ID information (e.g., "Object B") of the object 101. Then, an association is made to add the ID information (e.g., "Object B") of the object 101 to the table structure in FIG. 5.

[0052] Here, although the sum is assumed to be the smallest, a condition may be added that it is further smaller than a predetermined value to further improve the accuracy. And when it is equal to or greater than the predetermined value, no determination is made, and the calculation and determination are performed again at the next time.

[0053] Also, the wider the range of times for which the similarity is obtained, the less the overlap of the trajectories and the higher the accuracy of identifying the target. On the other hand, the processing load in the similarity calculation increases, and there is a trade-off. Therefore, for example, narrowing down the time using the number of objects or the moving speed of the terminal as an index may be performed. Also, the number of objects and the time range may be changed according to the probability that there are similar moving trajectories.

[0054] When the association between the object 101 and the communication terminal 102 is performed in process 204, the process proceeds to process 205. In process 205, highlighting is performed on the object in the video acquired by the camera device 105. That is, among the objects detected in the video, for the object that has been associated and is determined to possess the communication terminal targeted for the service, highlighting processing is performed by attaching a label such as the ID information of the communication terminal, and the highlighted video is displayed on the display device 108 such as a monitor or AR glasses.

[0055] Also, when the communication control device 106 determines that a new communication terminal 102 targeted for the service exists within the area via the wireless communication device 104 (process 206), the ID of the new communication terminal targeted for the service is added as a new column to the table in FIG. 5 (process 207). Then, process 201 is performed again at the next time.

[0056] In this way, when it is determined that a new communication terminal exists within the area, the association between the object in the video and the communication terminal is not immediately performed. As a result, even when the density of objects is high and a person having communication terminals with the same type of sensor values and communication types is in the vicinity, a communication terminal that does not have the position information of multiple communication terminals, that is, a communication terminal with a low possibility, can be excluded.

[0057] Here, specifically, for process 204 of the flow in FIG. 4, the operation of identifying the object with the highest degree of trajectory similarity will be described. Assume that the tables in FIG. 5 and FIG. 6 are given at time "10", and the object to be associated with "Terminal 1" in FIG. 5 is identified.

[0058] The communication control device 106 extracts, as data as shown in FIG. 7, based on the data in the table of FIG. 6, the history of the position information of "Terminal 1" as shown in FIG. 5, which exists from time "5" to time "10". That is, in FIG. 7, the position information from time "0" to time "4" is made invalid, and the calculation of similarity thereafter is omitted to reduce the processing load. Also, even when the density of objects is high and a person having communication terminals with the same type of sensor values and communication types is in the vicinity, it is possible to exclude an object with a low possibility of having the position information from time "0" to time "4".

[0059] Next, the similarity is calculated from the history of the position information for each object from time "5" to time "10" extracted in FIG. 7 and the history of the position information of "Terminal 1" in FIG. 5. FIG. 8 is an example of calculating the similarity between the trajectory of the terminal and the trajectory of the object. The Euclidean distance is obtained from the positions of "Terminal 1" and the object at each time, and the sum thereof is shown. Then, the one with the smallest sum is specified as having the highest similarity.

[0060] Here, for example, when there are not a predetermined number (for example, less than two) of pieces of position information of an object at the time when the position information of "Terminal 1" exists, such as for "Object D" or "Object E", that time is treated as invalid "N / A", and the calculation of the similarity of "Object D" or "Object E" is omitted to reduce the processing load. Also, even if the density of the objects is high and a person having a communication terminal with the same type of sensor value or communication type is in the vicinity, objects with low possibility can be excluded.

[0061] When there is only one piece of position information, such as for "Object C", there is also a possibility of detection failure. The value at that time may be (0, 0) to fill the trajectory of the object, and the similarity may be calculated. Also, the value at that time may be the position data of the previous or later time, more preferably the later time, as the trajectory of the object. Or, other variables on the video may be used as the trajectory of the object.

[0062] In FIG. 8, for the similarity (first similarity) of "Object B (first object or first person)" and the similarity (second similarity) of "Object A (second object or second person)", the similarity of "Object B" is higher. Also, the similarity with "Object B" (first similarity) is the highest. It can be specified that "Object B" corresponds to "Terminal 1".

[0063] Also, when the same operation is performed on "Terminal 2", it can be specified that "Object D" corresponds to "Terminal 2". At this time, the calculation of the similarity with "Object B" for which the association has already been made may be omitted to reduce the processing load.

[0064] As described above, the correspondence between the terminal and the object is obtained in process 204. After that, as described above, in process 205, the communication control device 106 highlights the association result on the display device 108 for the user of the system, for example, as shown in FIG. 9. FIG. 9 is an example of a display in which the association result between the terminal and the object is superimposed on the video.

[0065] The ID of the communication terminal (for example, "Terminal 1") associated with the ID of the object (for example, "Object B") is superimposed in the vicinity of the object (a place closer than other objects) that is a person extracted from the video in the video area to visualize the association. Here, the association between the ID of the object and the ID of the communication terminal is displayed with "=". The display of the association may be other displays as long as the association can be understood. Also, information regarding the communication terminal, such as the name of the owner of the communication terminal, may be superimposed in the vicinity of the video of the object extracted from the entire video area.

[0066] Furthermore, the video of the associated object may be surrounded by a frame and displayed. Also, the frame for the associated object may be displayed in a different color or a different frame width that can be distinguished from the frame for the unassociated object.

[0067] In this way, in an object having a communication terminal, it becomes possible to identify the object (person) without degrading the detection accuracy.

[0068] By causing the display device 108 to display the association between the communication terminal and the object (person), for example, the operation staff of a theme park such as a tourist facility that produces the whole according to a specific theme can surely provide the service to the person having the communication terminal that can receive the service.

[0069] Such a communication control system 100 can be used for guiding a predetermined person at the entrance of a theme park, guiding a predetermined person at the boarding gate of an airplane, guiding a predetermined person at a station ticket gate or inside the premises, receiving customers for a predetermined person at a hotel, restaurant, or retail store, calling a predetermined person at a construction site, etc., and a guidance system when contacting a specific person in a communication area. [Example]

[0070] The operation of the second embodiment of the present invention will now be described. In this embodiment, the communication control device 106 transmits a notification to the terminal, narrows down the objects to those that have responded with a motion, such as looking at the terminal screen, and associates the objects with the terminal.

[0071] 10 is an operation flowchart of the communication control system. In process 203, the communication control device 106 detects an object in the video and acquires the object's location history. Then, in process 801, the communication control device 106 transmits a notification (alarm information) to the service target terminal, which the object will notice when it receives the notification.

[0072] The notification (alarm information) may be a sound, a short message, or the like sent to the communication terminal, or may be a notification in which the infrastructure side of the communication control system 100 issues a sound such as voice guidance.

[0073] After sending the notification, in process 802, objects that have a motion response to the notification with a difference in movement of the object exceeding a predetermined range are identified from the image of the camera device 105, and the objects that have a motion response are narrowed down and acquired from the table structure of the acquired objects as shown in Figure 6.

[0074] The behavioral response to the notification is determined by the object looking in a specific direction, for example, the object's line of sight looking at the screen of the communication terminal, the object stopping its movement, the object bringing the communication terminal closer, etc. Then, similar to Fig. 4, the processing from step 204 onwards is performed. [Example]

[0075] The operation of the third embodiment of the present invention will now be described. In this embodiment, the communication control device 106 performs association by excluding pairs of objects and terminals that have already been associated in the past.

[0076] FIG. 11 is an operation flowchart of the communication control system. In process 203, the communication control device 106 detects an object in the video and acquires the history of the position of the object. Then, in process 901, the communication control device 106 acquires the correspondence relationship between the known terminal and the object.

[0077] The correspondence relationship between the known terminal and the object has already added a row to the table structure of FIG. 5 showing the history of the terminal and associated the ID information of the object 101. By referring to the table of FIG. 5, the correspondence relationship between the known terminal and the object can be acquired.

[0078] Next, in process 902, the communication control device 106 excludes those with a correspondence relationship, that is, combinations of known terminals and objects, from the table structure of FIG. 5. Then, similar to FIG. 4, processes after process 204 are performed.

Embodiment

[0079] The operation of the fourth embodiment of the present invention will be described. In this embodiment, the communication control device 106 acquires the relative distance between terminals in addition to the absolute position of the terminal by the position detection device 103, and determines the position of the terminal with low detection accuracy based on the terminal with high detection accuracy of the absolute position.

[0080] FIG. 12 is a configuration diagram of the communication control system. FIG. 13 is an operation flowchart of the communication control system. In the configuration diagram of the communication control system of FIG. 12, the wireless communication 1001 performs information transmission and reception between the communication terminal 102 and the communication terminal 109 via a wireless LAN, Bluetooth, etc. The communication terminal 102 and the communication terminal 109 can observe the received radio wave intensity with a beacon terminal and can also measure the relative distance between the terminals. The measured relative distance is transmitted to the communication control device 106 via communication with the wireless communication device 104.

[0081] In process 201 of FIG. 13, it is determined whether there are a plurality of communication terminals (the first communication terminal and the second communication terminal) to be served. If there are target communication terminals, the process proceeds to process 1101.

[0082] In process 1101, the communication control device 106 acquires information on the current position of the communication terminal from the position detection device 103. It also acquires information on the relative distance between communication terminals from the wireless communication device 104.

[0083] Next, in process 1102, the communication control device 106 designates a communication terminal whose reliability of the current position information is equal to or higher than a threshold value and for which the association has been finalized as a reference communication terminal, and determines its position. The reliability is, for example, such that the received radio wave intensity of the position detection signal is equal to or higher than a predetermined threshold value. Also, the displacement relative to the previous position may be equal to or higher than a predetermined threshold value.

[0084] On the other hand, for the other communication terminal whose reliability is less than the threshold value, the position is determined using the relative position information with respect to the reference communication terminal. The determination of this position is performed, for example, by using the intersection of the line segment between the position detected at the time when the communication terminal with a reliability less than the threshold value is the latest and the detected position, and the distance from the reference communication terminal. Also, the determination of the position may be performed by weighted synthesis of the position information of each communication terminal according to the reliability.

[0085] In this way, the position of each communication terminal is determined, and the history of the position of the communication terminal is updated. Then, similar to FIG. 4, the processes after process 203 are performed.

Explanation of Signs

[0086] 101, 110 Object having communication terminals 102, 109 Communication terminals 103 Position detection device 104 Wireless communication device 105 Camera device 106 Communication control device 107 Communication base station 108 Display device 1001 Wireless communication 1201 Control unit 1202 Application interface unit 1203 Position detection interface unit 1204 Communication interface unit 1205 Camera interface unit 1206 Terminal Information Database 1207 Object Information Database 1301 Processor 1302 Data Buffer 1303 Memory 1304 Internal Bus 1305 Storage Device

Claims

1. A communication control device for identifying an object having a communication terminal, comprising: a storage device having terminal movement trajectory information including a plurality of position information of the communication terminal and object movement trajectory information including a plurality of position information of the object; a control unit for associating the communication terminal with the object, wherein the control unit calculates a first similarity from the terminal movement trajectory information and the object movement trajectory information of the first object, calculates a second similarity from the terminal movement trajectory information and the object movement trajectory information of the second object, associates the object with the higher similarity with the communication terminal from the first similarity and the second similarity, and a communication control device that displays on a display device an image in which the object with the higher similarity is associated with the communication terminal.

2. The communication control device according to claim 1, wherein the terminal movement trajectory information is information obtained from a position detection device that detects the position of the communication terminal at each time.

3. The communication control device according to claim 1, wherein the terminal movement trajectory information is information obtained from information of an acceleration sensor or a pedometer included in the communication terminal.

4. The communication control device according to claim 1, wherein the object movement trajectory information is information for obtaining the position at each time using video information from a camera device that acquires an image of the object.

5. The communication control device according to claim 4, wherein the control unit acquires the object movement trajectory information using a movement difference of the object in the video information after transmitting warning information to the communication terminal via a wireless communication device that transmits information to the communication terminal.

6. The communication control device according to claim 1, wherein the similarity is calculated from the sum of the distances between the position information of the terminal movement trajectory information and the position information of the object movement trajectory information.

7. The communication control device according to claim 1, wherein the control unit excludes from the object movement trajectory information the object for which the association between the object and the communication terminal has been made in the past, excludes from the terminal movement trajectory information the communication terminal for which the association between the object and the communication terminal has been made in the past, and associates the object with the higher similarity with the communication terminal.

8. The communication control device according to claim 1, wherein when a first communication terminal and a second communication terminal exist in the terminal movement trajectory information, the control unit A communication control device that obtains the position information of one of the first communication terminal and the second communication terminal based on the communication terminal with high reliability among the first communication terminal and the second communication terminal, using the relative position information between the first communication terminal and the second communication terminal.

9. A communication control system for identifying an object having a communication terminal, comprising: A communication control device that performs communication control, and a display device that displays an image. The communication control device A storage device having terminal movement trajectory information including a plurality of position information of the communication terminal and object movement trajectory information including a plurality of position information of the object. A control unit that associates the communication terminal with the object. The control unit Calculates a first similarity from the terminal movement trajectory information and the object movement trajectory information of the first object. Calculates a second similarity from the terminal movement trajectory information and the object movement trajectory information of the second object. Associates the object with the higher similarity with the communication terminal from the first similarity and the second similarity. A communication control system that displays, on a display device, an image in which the object with the higher similarity is associated with the communication terminal.

10. The communication control system according to claim 9, The terminal movement trajectory information is information obtained from a position detection device that detects the position of the communication terminal at each time.

11. The communication control system according to claim 9, The terminal movement trajectory information is information obtained from information of an acceleration sensor or a pedometer included in the communication terminal.

12. The communication control system according to claim 9, The object movement trajectory information is information obtained by obtaining the position at each time using video information from a camera device that obtains an image of the object.

13. The communication control system according to claim 12, After the control unit transmits warning information to the communication terminal via a wireless communication device that transmits information to the communication terminal, the control unit obtains the object movement trajectory information using the movement difference of the object in the video information.

14. The communication control system according to claim 9, The similarity is calculated from the sum of the distances between the position information of the terminal movement trajectory information and the position information of the object movement trajectory information.

15. The communication control system according to claim 9, The control unit excludes the object for which the association between the object and the communication terminal has been made in the past from the object movement trajectory information, excludes the communication terminal for which the association between the object and the communication terminal has been made in the past from the terminal movement trajectory information, and performs association between the object with a high degree of similarity and the communication terminal. Communication control system.

16. The communication control system according to claim 9, when the control unit determines that a first communication terminal and a second communication terminal exist in the terminal movement trajectory information, A communication control system that obtains the position information of the other communication terminal using the relative position information between the first communication terminal and the second communication terminal based on the communication terminal with a higher reliability between the first communication terminal and the second communication terminal.

17. An induction system for a theme park that identifies and guides a person having a communication terminal, comprising a communication control device that performs communication control and a display device that displays images, The communication control device, a storage device having terminal movement trajectory information including a plurality of position information of the communication terminal and person movement trajectory information including a plurality of position information of the person, a control unit that associates the communication terminal with the person, The control unit, calculates a first similarity from the terminal movement trajectory information and the person movement trajectory information of the first person, calculates a second similarity from the terminal movement trajectory information and the object movement trajectory information of the second person, associates the person with a high degree of similarity and the communication terminal from the first similarity and the second similarity, An induction system that displays an image in which the person with a high degree of similarity and the communication terminal are associated on a display device.

Images