Communication control device, communication control system, and guidance system

Abstract

This communication control device identifies an object having a communication terminal, and comprises: a storage device that includes terminal movement trajectory information including a plurality of pieces of position information for the communication terminal and object movement trajectory information including a plurality of pieces of position information for the object; and a control unit that associates the communication terminal with the object. The control unit: calculates a first similarity from the terminal movement trajectory information and the object movement trajectory information for a first object; calculates a second similarity from the terminal movement trajectory information and the object movement trajectory information for a second object; associates the communication terminal with the object having the higher degree of similarity, according to the first similarity and the second similarity; and displays, on a display device, a video in which the object having the higher degree of similarity and the communication terminal are associated with each other.

Description

Communication control device and communication control system, guidance system

[0001] The present invention relates to a communication control device, a communication control system, and a guidance system that identify an object having a predetermined terminal from video and position information.

[0002] There is known a technology that combines continuous video from a camera or the like with object detection technology to track the movement of a specific object. For example, Patent Literature 1 discloses a technology that detects the movement pattern of a target person from past images, estimates the position of the target person in a current image, and matches it with the image of the target person to continuously track the target person.

[0003] In recent years, focusing on the fact that many people and objects carry communication terminals such as smartphones, technologies have been developed to track them using sensor information obtained from smartphones. For example, Patent Literature 2 discloses a technology for identifying a target moving object by collecting acceleration vectors observed by a terminal carried by the target moving object and evaluating the similarity with acceleration vectors determined from video.

[0004] Furthermore, Patent Document 3 discloses a technology in which a camera attached to a mobile phone base station is used to observe mobile objects within an area, and the location of the terminal and communication characteristics (such as broadband communication or low-latency communication) of the target mobile object are obtained from the content of communication with the base station, and the communication characteristics are used to identify the target mobile object.

[0005] Japanese Patent Application Laid-Open No. 2015-072578 International Publication No. 2021 / 124456 Japanese Patent Application Laid-Open No. 2021-090088

[0006] However, detection accuracy may decrease if a person makes irregular movements such as stopping, changing direction, etc. Furthermore, in places with high population density, such as theme parks or train stations, where people with communication devices with the same sensor values ​​or communication types are in close proximity, detection accuracy may also decrease.

[0007] When detection accuracy decreases, it becomes difficult to associate a communication device with a person. In such a case, the following specific problem occurs. For example, a theme park staff member watches a video on a display device (such as a monitor) in which communication devices are associated with people. When the staff member finds a person with a communication device that can receive a specific preferential service, the staff member guides the person to the preferential service and provides the person with the preferential service. However, when detection accuracy decreases, it becomes difficult to provide the appropriate service to the person.

[0008] The present invention is intended to solve the above problem, and has an object to make it possible to identify a person in an object having a communication terminal without reducing detection accuracy.

[0009] In order to achieve the above-mentioned object, one aspect of the communication control device of the present invention is a communication control device that identifies an object having a communication terminal, and includes a memory device having terminal movement trajectory information including multiple position information of the communication terminal and object movement trajectory information including multiple position information of the object, and a control unit that associates the communication terminal with the object, wherein the control unit calculates a first similarity from the terminal movement trajectory information and the object movement trajectory information of a first object, calculates a second similarity from the terminal movement trajectory information and the object movement trajectory information of a second object, associates objects with a high similarity with the communication terminal based on the first similarity and the second similarity, and displays an image on a display device that associates the objects with a high similarity with the communication terminal.

[0010] According to the present invention, it is possible to identify a person in an object having a communication terminal without reducing detection accuracy.

[0011] FIG. 1 is a configuration diagram of a communication control system in an embodiment of the present invention. FIG. 2 is a functional block diagram of a communication control device in an embodiment of the present invention. FIG. 3 is a hardware block diagram of a communication control device in an embodiment of the present invention. FIG. 4 is an operation flowchart of a communication control system in a first embodiment of the present invention. FIG. 5 is a position history of a service target terminal in an embodiment of the present invention. FIG. 6 is a position history of an object in a video in an embodiment of the present invention. FIG. 7 is an example of an operation for associating a terminal and an object in an embodiment of the present invention. FIG. 8 is an example of a similarity calculation example between a terminal trajectory and an object trajectory in an embodiment of the present invention. FIG. 9 is an example of a display of the results of associating a terminal and an object in an embodiment of the present invention. FIG. 10 is an operation flowchart of a communication control system in a second embodiment of the present invention. FIG. 11 is an operation flowchart of a communication control system in a third embodiment of the present invention. FIG. 11 is a configuration diagram of a communication control system in a fourth embodiment of the present invention. FIG. 12 is an operation flowchart of a communication control system in a fourth embodiment of the present invention.

[0012] Hereinafter, an embodiment will be described with reference to the drawings.

[0013] 1 shows an example of the configuration of a communication control system according to an embodiment of the present invention. In the drawings of this embodiment, the same components are given the same reference numerals, but the present invention is not limited to this embodiment, and any application that conforms to the concept of the present invention is included in the technical scope of the present invention. Furthermore, unless otherwise specified, each component may be plural or singular.

[0014] The communication control system 100 includes an object 101 which is a person having a communication terminal 102, an object 110 which is a person having a communication terminal 109, a position detection device 103, a wireless communication device 104, a camera device 105, and a communication control device 106. A communication base station 107 has the position detection device 103, the wireless communication device 104, etc. The position detection device 103 and the wireless communication device 104 may each be located in an independent base station. Furthermore, the object 101 and the object 110 may be a person, luggage, a vehicle, or any other object that has a communication terminal and can move.

[0015] The communication terminals 102 and 109 detect that they have entered the communication area of ​​the wireless communication device 104 based on information such as an SSID (Service Set Identifier) ​​broadcast by the wireless communication device 104. Then, the communication terminals 102 and 109 perform authentication or the like with the communication control device 106 via the wireless communication device 104 using a communication means such as a wireless LAN, and make the communication control device 106 recognize that the communication terminals 102 and 109 are targets of the service provided by the communication control device 106.

[0016] The communication control device 106, which has recognized the communication terminals 102 and 109 to be serviced, instructs the position detection device 103 to start detecting the positions of the communication terminals 102 and 109, and also instructs the camera device 105 to provide camera image information.

[0017] The position detection device 103 calculates distance from the received radio wave strength, for example, and performs trilateration using information from three or more position detection devices 103. Then, it calculates the direction of arrival of the radio waves and integrates the information from the multiple position detection devices 103. Furthermore, it compares the received radio wave strength of the communication terminal 102 and the communication terminal 109 with a pre-created radio wave strength map. In this way, the position detection device 103 detects the current locations of the communication terminal 102 and the communication terminal 109 and notifies the communication control device 106 of the locations. The position detection device 103 may also obtain location information using information from an acceleration sensor, pedometer, or the like included in the communication terminal 102.

[0018] Although the object 101 having the communication terminal 102 and the object 110 having the communication terminal 109 have been described as examples, the communication terminal 102 and three or more objects can be notified of their respective positions to the communication control device 106 .

[0019] 2 is a functional block diagram of the communication control device 106 according to an embodiment of the present invention. The communication control device 106 includes a control unit 1201, an application interface unit 1202, a position detection interface unit 1203, a communication interface unit 1204, a camera interface unit 1205, a terminal information database (DB) 1206, and an object information database (DB) 1207.

[0020] The position detection interface unit 1203 transmits and receives information to and from the position detection device 103 and acquires the position information of the communication terminal 102 as the service target detected.

[0021] The communication interface unit 1204 transmits and receives information to and from the wireless communication device 104 to acquire information such as the ID of the communication terminal 102 to be served within the target area, an authentication request for the communication terminal to be served, etc. It also acquires information such as the relative distance measured by the communication terminal 102 to other terminals.

[0022] The camera interface unit 1205 transmits and receives images (images of the object 101) within the service area captured by the camera device 105 as image information.

[0023] The control unit 1201 controls the operation of the communication control device 106. It extracts the movement trajectory of the object 101 in the video (object movement trajectory information), extracts the movement trajectory of the communication terminal 102 to be serviced (terminal movement trajectory information), and identifies and associates the correspondence between the communication terminal 102 and the object 101 based on the similarity between them. It corrects and obtains the position information of the communication terminal 102 based on the acquired information on the relative distance between the terminals. Note that when the object 101 or object 110 is a person, the object movement trajectory information, which is the movement trajectory, is person movement trajectory information.

[0024] The application interface unit 1202 displays the correspondence between the communication terminal 102 and the object 101 on the display device 108 for the user of the system.

[0025] The terminal information database 1206 stores the ID of the communication terminal to be serviced, position information (history information) at each time, and information on the associated object, which are obtained by the communication interface unit 1204 .

[0026] The object information database 1207 stores information such as the ID of an object detected from the video acquired by the camera interface unit 1205 and its position information (history information) for each time.

[0027] 3 is a diagram showing the hardware configuration of the communication control device 106 in this embodiment of the present invention. The communication control device 106 has an application interface unit 1202, a position detection interface unit 1203, a communication interface unit 1204, a camera interface unit 1205, etc. as interfaces with external nodes.

[0028] The communication control device 106 also includes a processor 1301 , a data buffer 1302 , a memory 1303 , and the like, all of which are connected to each other via an internal bus 1304 .

[0029] The processor 1301 is a CPU or the like that executes various programs, etc. The memory 1303 holds data necessary for the processor 1301 to expand the programs it processes. The data buffer 1302 temporarily stores various data. The processor 1301, data buffer 1302, etc. constitute a control unit that controls the processing of various programs, etc.

[0030] The communication control device 106 also has a storage device 1305 that stores programs and tables, and stores an object detection program 1306, a terminal management program 1307, a terminal position correction program 1308, a terminal object identification program 1309, a parameter management table 1310, and the like.

[0031] The parameter management table 1310 includes a terminal information database 1206, an object information database 1207, etc. Here, various information may be described using expressions such as "table," but may be expressed using a data structure other than a table.

[0032] The object detection program 1306 has a function of detecting objects and their respective positions for each frame image from the video received from the camera interface unit 1205 in conjunction with the control unit.

[0033] The terminal management program 1307 has a function of determining whether or not a terminal is to be made a service target terminal based on an authentication request from the target terminal received from the communication interface unit 1204 in cooperation with the control unit.

[0034] The terminal position correction program 1308 has the function of correcting the terminal position information in cooperation with the control unit based on the terminal position information received from the position detection interface unit 1203 and the information on the relative distance to other terminals measured by the communication terminal 102 obtained from the communication interface unit 1204.

[0035] The terminal object identification program 1309 works in conjunction with the control unit. It extracts the movement trajectory of the service target terminal (terminal movement trajectory information) based on the ID of the service target communication terminal and a table of multiple pieces of position information (history information) for each time stored in the terminal information database 1206 of the storage device 1305. It also extracts the movement trajectory of the object (object movement trajectory information) based on the ID of the object and a table of multiple pieces of position information (history information) for each time stored in the object information database 1207 of the storage device 1305. It then has a function of calculating a similarity from each extracted trajectory and performing an identification process to identify the object corresponding to the terminal based on the level of similarity.

[0036] These programs may be installed from a program source, which may be provided, for example, from a program distribution server or a storage medium.

[0037] The parameter management table 1310 includes a terminal information database 1206, an object information database 1207, and the like.

[0038] Note that the above-described division of functions and hardware of the communication control device 106 is merely an example, and other configurations may be used as long as they can transmit and receive with the communication terminal 102, the communication terminal 109, the position detection device 103, the wireless communication device 104, and the camera device 105 and achieve equivalent functions as the entire communication control device 106.

[0039] The operation of the first embodiment will now be described. In this embodiment, the communication control device 106 identifies the correspondence between the communication terminals 102 and the object 101 based on the movement trajectory of the communication terminal to be serviced and the movement trajectory of the object 101. Fig. 4 is a flowchart showing the operation of the communication control system in the first embodiment of the present invention.

[0040] The communication control device 106 acquires the ID of a communication terminal at a predetermined time via the wireless communication device 104, and determines whether a communication terminal that is a service target of the table structure shown in FIG. 5 exists within the area (process 201).

[0041] If there is a communication terminal 102 or the like to be serviced, the communication control device 106 acquires the ID and current location of the communication terminal 102 or the like from the location detection device 103. Then, the communication control device 106 updates the terminal location history for the communication terminal to be serviced (process 202).

[0042] The terminal location history is in the form of data in a table structure, for example, as shown in Fig. 5. This is stored in the terminal information database 1206 of the parameter management table 1310 in the storage device 1305, such as a non-volatile memory or hard disk drive, of the communication control device 106. This table structure is updated with new locations added at predetermined intervals as time passes.

[0043] This time is set to a predetermined time converted into stride length or every second so that detection accuracy does not decrease when the user moves irregularly. The time may be changed based on information from an acceleration sensor or pedometer of a specific communication terminal, or based on information and the accuracy of the information acquired from multiple communication terminals. Furthermore, if geomagnetic measurements are performed in the area, location information may be acquired using a magnetometer or the like of the communication terminal.

[0044] 5, the location history of communication terminal 102 indicates that ID information "terminal 1" of communication terminal 102 started recognition at time "5" at a position of "3" on the X axis and "0" on the Y axis. Also, the location history of communication terminal 109 indicates that "terminal 2" started recognition at time "8" at a position of "0" on the X axis and "0" on the Y axis. Note that "terminal 2" did not obtain location information from time "5" to "7" and is not within the communication area. Then, at the current time "10", "terminal 1" exists as the first communication terminal and "terminal 2" exists as the second communication terminal, and their terminal locations are added to the table structure.

[0045] Next, an image of the area is acquired from the camera device 105 at a predetermined time when the ID of the communication terminal is acquired, or at a predetermined time that is a certain short time after the ID of the communication terminal is acquired. Furthermore, an object is detected in the image, and the current position of the object is acquired. The terminal location history is then updated (process 203). The object position can be acquired, for example, by determining the relative position from the known coordinates of a marker, such as an address display, in the acquired image. The object position can also be acquired by performing coordinate conversion based on information on the absolute position where the camera is installed and information on the position in the image. The absolute position is then calculated from the image, and the position of each object is acquired. Here, whether the objects are the same is determined using, for example, feature quantities such as the color, size, and shape of the object in the current frame image and the previous frame image of the image.

[0046] The history of the positions of objects in the video is in the form of data with a table structure, as shown in Fig. 6. This is stored in the object information database 1207 in the storage device 1305, such as a non-volatile memory or hard disk drive, of the communication control device 106. Note that positions are added and updated in this table structure over time.

[0047] As shown in Figure 6, the position history of object 101 indicates that ID information "object A" of object 101 began recognition at time "5" at a position of "0" on the X axis and "0" on the Y axis. Also, "object B" began recognition at time "5" at a position of "3" on the X axis and "0" on the Y axis. Note that "object B" did not obtain position information between times "5" and "4" and is not within the image area. In this example, at the current time "10", "objects A" to "object E" are present, and the positions of these objects are added to the table structure.

[0048] Next, in process 204, the similarity between the terminal position history trajectory obtained in process 202 as shown in FIG. 5 and the object position history trajectory obtained in process 203 as shown in FIG. 6 is calculated and compared.

[0049] The similarity of the trajectories is, for example, the sum of the distances calculated between the trajectory of "terminal 1" extracted from the table structure shown in Fig. 5 and the trajectories of "object A" to "object E" extracted from the table structure shown in Fig. 6. The combination with the smallest sum is determined to have the highest similarity. In this way, the object and terminal having the trajectory with the highest similarity are associated (process 204).

[0050] Here, the similarity is calculated by, for example, the sum of Euclidean distances using the straight-line distances between two points at each time point, but this distance may also be calculated by other methods, such as the Manhattan distance, or other distances between two points.

[0051] Furthermore, it is determined that the ID information of the communication terminal 102 or the like (e.g., "terminal 1") corresponds to the ID information of the object 101 (e.g., "object B") in the data format of the table structure of the terminal information database 1206 as shown in Fig. 5. Then, a correspondence is established by adding a row for the ID information of the object 101 (e.g., "object B") to the table structure of Fig. 5.

[0052] Here, the sum is set to be the smallest, but the accuracy can be further improved by adding the condition that it be smaller than a predetermined value. If the sum is equal to or greater than the predetermined value, no judgment is made, and the calculation is performed again at the next time.

[0053] Furthermore, the wider the time range for calculating similarity, the less overlapping of trajectories will occur, resulting in more accurate target identification. However, the processing load for similarity calculations increases, so there is a trade-off. Therefore, for example, the number of objects or the movement speed of the terminal may be used as an index to narrow down the time range. Furthermore, the number of objects and the time range may be changed depending on the probability that similar movement trajectories exist.

[0054] Once the object 101 and the communication terminal 102 are associated in process 204, the process proceeds to process 205. In process 205, the object in the image acquired by the camera device 105 is highlighted. That is, of the objects detected in the image, those that have been associated and determined to be carrying a communication terminal that is the target of the service are subjected to highlighting processing in which a label containing ID information or the like of the communication terminal is attached, and the highlighted image is displayed on a display device 108 such as a monitor or AR glasses.

[0055] Furthermore, when the communication control device 106 determines via the wireless communication device 104 that a new communication terminal 102 to be serviced is present within the area (process 206), it adds a column for the ID of the new communication terminal to be serviced to the table in Fig. 5 (process 207).Then, process 201 is performed again at the next time.

[0056] In this way, when it is determined that a new communication device is present in the area, the system does not immediately associate the object in the image with the communication device. This makes it possible to exclude communication devices that do not have location information of multiple communication devices, i.e., communication devices with low probability, even if the density of objects is high and people with communication devices with the same type of sensor value or communication type are nearby.

[0057] Here, a specific description will be given of the operation of identifying an object with the highest trajectory similarity in process 204 of the flow in Fig. 4. Assume that the tables in Fig. 5 and Fig. 6 are given at time "10" to identify an object associated with "Terminal 1" in Fig. 5.

[0058] As shown in FIG. 5, the communication control device 106 extracts the data shown in FIG. 7 based on the data in the table of FIG. 6, which shows that the location information history for "terminal 1" spans from time "5" to time "10." That is, in FIG. 7, location information from time "0" to time "4" is invalidated, and subsequent calculations of similarity are omitted, reducing the processing load. Furthermore, even if the density of objects is high and people with communication terminals with similar sensor values ​​and communication types are nearby, it is possible to exclude objects that are unlikely to have location information from time "0" to time "4."

[0059] Next, similarity is calculated from the history of position information for each object from time "5" to time "10" extracted in Figure 7 and the history of position information for "Terminal 1" in Figure 5. Figure 8 shows an example of calculating the similarity between the trajectory of a terminal and the trajectory of an object. The Euclidean distance is calculated from the positions of "Terminal 1" and the object for each time, and the sum of these distances is shown. The smallest sum is then identified as the one with the highest similarity.

[0060] Here, if there is no predetermined number of object location information for, for example, "object D" or "object E" at a time when there is location information for "terminal 1" (for example, when there are two or more), that time is treated as invalid "N / A" and calculation of the similarity of "object D" or "object E" is omitted, thereby reducing the processing load. Furthermore, even if the density of objects is high and people with communication terminals with similar sensor values ​​and communication types are nearby, it is possible to exclude objects with low probability.

[0061] When there is only one piece of position information, such as "Object C," there is a possibility of detection failure, and the value at that time may be set to (0, 0) to fill in the object's trajectory and calculate the similarity. Alternatively, position data from a time before or after that time value, more preferably a later time, may be used as the object's trajectory. Alternatively, other variables in the video may be used as the object's trajectory.

[0062] In FIG. 8, the similarity (first similarity) of "object B (first object or first person)" is higher than the similarity (second similarity) of "object A (second object or second person)." Also, the similarity (first similarity) between "object B" and "object A" is the highest. It can be determined that "object B" corresponds to "terminal 1."

[0063] Furthermore, when a similar operation is performed on "terminal 2," it is possible to identify that "object D" corresponds to "terminal 2." At this time, it is possible to reduce the processing load by omitting the calculation of the similarity with "object B," which has already been associated.

[0064] As described above, correspondence between the terminal and the object is obtained in process 204. Thereafter, as described above, in process 205, the communication control device 106 uses the correspondence result to highlight the result on the display device 108 for the system user, for example, as shown in Fig. 9. Fig. 9 is an example of a display in which the correspondence result between the terminal and the object is superimposed on a video image.

[0065] The ID of the communication terminal (e.g., "Terminal 1") associated with the ID of the object (e.g., "Object B") is superimposed near the object, which is a person extracted from the video within the video area (closer than other objects), to visualize the association. Note that here, the association between the ID of the object and the ID of the communication terminal is displayed using "=". The association may be displayed in any other way as long as the association is clear. Furthermore, information about the communication terminal, such as the name of the owner of the communication terminal, may be displayed by superimposing it near the video of the object extracted from the entire video area.

[0066] Furthermore, the image of the associated object may be displayed surrounded by a frame. The frame for the associated object may be displayed in a different color or with a different frame width so as to be distinguishable from the frame for the non-associated object.

[0067] In this way, it becomes possible to identify an object (person) having a communication terminal without reducing detection accuracy.

[0068] By displaying the correspondence between the communication terminal and the object (person) on the display device 108, the management staff of a theme park, such as a tourist facility that creates an overall presentation based on a specific theme, can reliably provide the service to people who have a communication terminal that is capable of receiving the service.

[0069] Such a communication control system 100 can be used as a guidance system for contacting a specific person in a communication area, such as guiding a specific person at the entrance of a theme park, guiding a specific person at an airplane boarding gate, guiding a specific person through a station ticket gate or within the station premises, serving a specific person at a hotel, restaurant, or even a retail facility, or calling a specific person at a construction site.

[0070] The operation of the second embodiment of the present invention will now be described. In this embodiment, the communication control device 106 transmits a notification to the terminal, narrows down the objects to those that have responded with a motion, such as looking at the terminal screen, and associates the objects with the terminal.

[0071] 10 is a flowchart showing the operation of the communication control system. In process 203, the communication control device 106 detects an object in the video and acquires the object's location history. Then, in process 801, the communication control device 106 transmits a notification (alarm information) to the service target terminal, which the object will notice when it receives the notification.

[0072] The notification (alarm information) may be a sound, a short message, or the like sent to the communication terminal, or may be a notification in the form of a sound such as voice guidance from the infrastructure side of the communication control system 100 .

[0073] After sending the notification, in process 802, objects that have a motion response to the notification with a difference in movement of the object exceeding a predetermined range are identified from the image of the camera device 105, and the objects that have a motion response are narrowed down and acquired from the table structure of the acquired objects as shown in Figure 6.

[0074] The behavioral response to the notification is determined by the object looking in a specific direction, for example, the object's line of sight looking at the screen of the communication terminal, the object stopping its movement, the object bringing the communication terminal closer, etc. Then, similar to FIG. 4, processing from step 204 onwards is performed.

[0075] The operation of the third embodiment of the present invention will now be described. In this embodiment, the communication control device 106 performs association by excluding pairs of objects and terminals that have already been associated in the past.

[0076] 11 is a flowchart showing the operation of the communication control system. In process 203, the communication control device 106 detects an object in the video and acquires the object's position history. Then, in process 901, the communication control device 106 acquires the correspondence between known terminals and the object.

[0077] The correspondence between known terminals and objects has already been determined by adding a row to the table structure of Figure 5, which shows the terminal history, and associating the ID information of the object 101. By referring to the table of Figure 5, the correspondence between known terminals and objects can be obtained.

[0078] Next, in process 902, the communication control device 106 removes the correspondence, i.e., the known terminal and object, from the table structure in Fig. 5 where the combination exists. Then, similar to Fig. 4, process 204 and subsequent processes are performed.

[0079] The operation of the fourth embodiment of the present invention will now be described. In this embodiment, the communication control device 106 acquires the relative distance between terminals in addition to the absolute positions of the terminals detected by the position detection device 103, and determines the position of a terminal with low detection accuracy based on a terminal with high absolute position detection accuracy.

[0080] Fig. 12 is a configuration diagram of the communication control system. Fig. 13 is an operation flowchart of the communication control system. In the configuration diagram of the communication control system in Fig. 12, wireless communication 1001 transmits and receives information between communication terminal 102 and communication terminal 109 using a wireless LAN, Bluetooth, or the like. Communication terminal 102 and communication terminal 109 can observe the received radio wave intensity with a beacon terminal and can also measure the relative distance between the terminals. The measured relative distance is transmitted to communication control device 106 via communication with wireless communication device 104.

[0081] 13, it is determined whether there are a plurality of communication terminals (first and second communication terminals) to be serviced. If there are any communication terminals to be serviced, the process proceeds to step 1101.

[0082] In process 1101, the communication control device 106 acquires information on the current positions of the communication terminals from the position detection device 103. It also acquires information on the relative distances between the communication terminals from the wireless communication device 104.

[0083] Next, in process 1102, the processing and communication control device 106 determines the reference communication terminal whose current location information has a reliability equal to or greater than a threshold and whose correspondence has been confirmed, and determines its location. The reliability may be, for example, determined by the received radio wave strength of the location detection signal being equal to or greater than a predetermined threshold. Alternatively, the displacement from the previous location may be equal to or greater than a predetermined threshold.

[0084] On the other hand, for the other communication terminal whose reliability is less than the threshold, the position is determined using relative position information based on the reference communication terminal. This position determination is performed, for example, by using the intersection of the line segment connecting the most recent position of the communication terminal whose reliability is less than the threshold and the detected position, and the distance from the reference communication terminal. The position determination may also be performed by weighting and combining the position information of each communication terminal according to its reliability.

[0085] In this way, the position of each communication terminal is determined and the position history of the communication terminal is updated. Then, the process from step 203 onward is carried out in the same manner as in FIG.

[0086] 101, 110 Object having communication terminal 102, 109 Communication terminal 103 Position detection device 104 Wireless communication device 105 Camera device 106 Communication control device 107 Communication base station 108 Display device 1001 Wireless communication 1201 Control unit 1202 Application interface unit 1203 Position detection interface unit 1204 Communication interface unit 1205 Camera interface unit 1206 Terminal information database 1207 Object information database 1301 Processor 1302 Data buffer 1303 Memory 1304 Internal bus 1305 Storage device

Claims

1. A communication control device for identifying an object having a communication terminal, comprising: a storage device having terminal movement trajectory information including a plurality of position information of the communication terminal and object movement trajectory information including a plurality of position information of the object; and a control unit for associating the communication terminal with the object, wherein the control unit calculates a first similarity from the terminal movement trajectory information and the object movement trajectory information of a first object, calculates a second similarity from the terminal movement trajectory information and the object movement trajectory information of a second object, associates the object with the higher similarity with the communication terminal from the first similarity and the second similarity, and displays on a display device an image in which the object with the higher similarity is associated with the communication terminal.

2. The communication control device according to claim 1, wherein the terminal movement trajectory information is information obtained from a position detection device that detects the position of the communication terminal at each time.

3. The communication control device according to claim 1, wherein the terminal movement trajectory information is information obtained from information of an acceleration sensor or a pedometer included in the communication terminal.

4. The communication control device according to claim 1, wherein the object movement trajectory information is information for obtaining the position at each time using video information from a camera device that acquires the video of the object.

5. The communication control device according to claim 4, wherein the control unit transmits warning information to the communication terminal via a wireless communication device that transmits information to the communication terminal, and then obtains the object movement trajectory information using the movement difference of the object in the video information.

6. The communication control device according to claim 1, wherein the similarity is calculated from the total distance between the position information of the terminal movement trajectory information and the position information of the object movement trajectory information.

7. The communication control device according to claim 1, wherein the control unit excludes from the object movement trajectory information the object for which the association between the object and the communication terminal has been made in the past, excludes from the terminal movement trajectory information the communication terminal for which the association between the object and the communication terminal has been made in the past, and associates the object with the higher similarity with the communication terminal.

8. The communication control device according to claim 1, wherein when the control unit determines that the first communication terminal and the second communication terminal exist in the terminal movement trajectory information, the control unit obtains the position information of the other communication terminal by using the relative position information between the first communication terminal and the second communication terminal, based on the communication terminal with a higher reliability among the first communication terminal and the second communication terminal.

9. A communication control system for identifying an object having a communication terminal, comprising a communication control device for performing communication control and a display device for displaying a video, wherein the communication control device includes a storage device having terminal movement trajectory information including a plurality of position information of the communication terminal and object movement trajectory information including a plurality of position information of the object, and a control unit for associating the communication terminal with the object, and the control unit calculates a first similarity from the terminal movement trajectory information and the object movement trajectory information of the first object, calculates a second similarity from the terminal movement trajectory information and the object movement trajectory information of the second object, associates the object with a higher similarity with the communication terminal from the first similarity and the second similarity, and displays, on the display device, a video in which the object with a higher similarity and the communication terminal are associated.

10. The communication control system according to claim 9, wherein the terminal movement trajectory information is information obtained from a position detection device that detects the position of the communication terminal at each time.

11. The communication control system according to claim 9, wherein the terminal movement trajectory information is information obtained from information of an acceleration sensor or a pedometer included in the communication terminal.

12. The communication control system according to claim 9, wherein the object movement trajectory information is information for obtaining the position at each time by using video information from a camera device that acquires a video of the object.

13. The communication control system according to claim 12, wherein the control unit transmits warning information to the communication terminal via a wireless communication device that transmits information to the communication terminal, and then obtains the object movement trajectory information by using the movement difference of the object in the video information.

14. The communication control system according to claim 9, wherein the similarity is calculated from the sum of the distances between the position information of the terminal movement trajectory information and the position information of the object movement trajectory information.

15. The communication control system according to claim 9, wherein the control unit excludes the object for which the association between the object and the communication terminal has been made in the past from the object movement trajectory information, excludes the communication terminal for which the association between the object and the communication terminal has been made in the past from the terminal movement trajectory information, and associates the object with the high similarity with the communication terminal.

16. The communication control system according to claim 9, wherein when the first communication terminal and the second communication terminal exist in the terminal movement trajectory information, the control unit uses the relative position information between the first communication terminal and the second communication terminal based on the communication terminal with high reliability of either the first communication terminal or the second communication terminal to obtain the position information of the other communication terminal.

17. An induction system for a theme park that identifies and guides a person having a communication terminal, comprising a communication control device that performs communication control and a display device that displays images, wherein the communication control device includes a storage device having terminal movement trajectory information including a plurality of position information of the communication terminal and person movement trajectory information including a plurality of position information of the person, and a control unit that associates the communication terminal with the person, and the control unit calculates a first similarity from the terminal movement trajectory information and the person movement trajectory information of the first person, calculates a second similarity from the terminal movement trajectory information and the object movement trajectory information of the second person, associates the person with the high similarity with the communication terminal from the first similarity and the second similarity, and displays an image in which the person with the high similarity is associated with the communication terminal on the display device.

Images