Tracking support device, terminal, tracking support system, tracking support method and program

Abstract

To support a person in charge of tracking such as a patrol guard to enable tracking in a manner hard to be noticed by a tracking target such as a suspicious person.SOLUTION: A tracking support system includes: a position calculation unit connected to a plurality of cameras, which are arranged in a predetermined monitoring area, to transmit a video captured by each camera, to calculate the position of the tracking target based on each video received from the plurality of cameras; a person-in-charge selection unit which selects a person in charge of tracking who instructs to trace the tracking target, based on the terminal position information received from the terminal and the calculated position of the tracking target; and an information transmitter unit which transmits distance information between the terminal and the tracking target during the tracking of the tracking target, to the terminal of the selected person in charge of tracking.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] (Description of Related Applications) This invention claims priority from U.S. Provisional Application No. 62 / 437,742 (filed December 22, 2016), the entire contents of which are incorporated herein by reference. The present invention relates to a tracing support device, a terminal, a tracing support system, a tracing support method, and a program, and in particular to a tracing support device, a terminal, a tracing support system, a tracing support method, and a program for providing support to a person in charge of tracing a target. [Background technology]

[0002] Patent Document 1 discloses a patrol security support system that allows a security guard heading to a scene where an abnormality has occurred to easily identify a suspicious person during patrol security work. Specifically, the patrol security support system is described as including: a person monitoring means 100 that detects a person included in video from video data captured by a capturing means arranged in a specified security area and monitors the detected person; a suspicious person detection means 101 that detects a person who satisfies a predetermined detection condition as a suspicious person among the people monitored by the person monitoring means 100; a position information calculation means 102 that calculates relative position information between the suspicious person detected by the suspicious person detection means 101 and the patrol security guard; and a suspicious person information transmission means 103 that transmits predetermined information to a mobile terminal held by the patrol security guard based on the relative position information calculated by the position information calculation means 102.

[0003] Patent Document 2 discloses a monitoring system that can promptly and appropriately issue a response instruction for an object such as a suspicious person or a suspicious object when the object is detected. Specifically, Patent Document 3 discloses that the monitoring server 2 of the monitoring system stores a mobile terminal location management table for managing the location of the mobile terminal 3 for each mobile terminal 3. The monitoring server 2 also stores an abnormal state classification table in which conditions are registered for determining the mobile terminal 3 to which a response instruction for the object is to be notified for each item that classifies the type of abnormal state of the object. When the monitoring server 2 receives a report of the detection of an object in an abnormal state from the monitoring camera terminal 1, the monitoring server 2 uses the mobile terminal location management table and the abnormal state classification table to determine the mobile terminal 3 to which a response instruction for the object is to be instructed. It is described that the monitoring server 2 transmits a response instruction for the object that has been reported to be in an abnormal state to the determined mobile terminal 3.

[0004] Patent Document 3 discloses a configuration in which a central monitoring device (20) acquires monitoring information including at least location information output from a monitoring terminal device (10), sets a monitoring point where a tracking target tracked by a monitor is predicted to exist, selects a monitoring terminal device (10) of a moving object approaching and / or moving away from a specified monitoring area based on the set monitoring point, and outputs an image transmission command to the selected monitoring terminal device (10) to transmit the monitoring information including image information.

[0005] Patent Document 4 discloses a detection device and a detection method that can detect the position information of a specific target and can request a third party in the vicinity of the specific target to secure the specific target.

[0006] Patent Document 5 discloses a tracking support device that can reduce the burden on monitors in a central control room or a security room.

[0007] In Patent Document 6, a security guard G1 uses a wearable camera to capture images of his or her field of vision and requests a management device 10 to verify a person included in the captured image data. If the person included in the image data is person H1, the management device 10 notifies the person of the corresponding security information. [Prior art documents] [Patent documents]

[0008] [Patent Document 1] JP 2011-18094 A [Patent Document 2] JP 2012-104022 A [Patent Document 3] International Publication No. 2013 / 125301 [Patent Document 4] JP 2009-3852 A [Patent Document 5] JP 2015-19248 A [Patent Document 6] JP 2016-194759 A Summary of the Invention [Problem to be solved by the invention]

[0009] According to the configurations of Patent Documents 1 to 3, a patrol guard or the like can rush to the scene and immediately respond to suspicious people or abnormalities, but the suspicious person often notices the patrol guard and escapes. In this respect, Patent Document 4 is intended to search for a lost child, and does not anticipate a situation in which the child will escape. Also, the tracking in Patent Documents 5 and 6 is a matter of following people or the like captured on a fixed camera's image with one's eyes, and is not actually tracked by a patrol guard.

[0010] The present invention aims to provide a tracking support device, terminal, tracking support system, tracking support method, and program that can contribute to enriching the means of supporting tracking personnel such as patrol security guards so that tracking can be carried out in a manner that is less likely to be noticed by the target of tracking, such as a suspicious person. [Means for solving the problem]

[0011] According to a first aspect, there is provided a tracking support device that is arranged in a predetermined monitoring area, is connected to a plurality of cameras each transmitting an image captured by the camera, and includes a position calculation unit that calculates the position of a tracking target based on the images received from the plurality of cameras. The tracking support device further includes a person selecting unit that selects a tracking person who will instruct tracking of the tracking target based on the position information of the terminal received from the terminal and the calculated position of the tracking target. The tracking support device further includes an information transmitting unit that transmits, to the terminal of the selected tracking person, information regarding the distance between the terminal and the tracking target while tracking the tracking target.

[0012] According to a second aspect, there is provided a terminal comprising: an instruction receiving unit that receives instructions of a tracked target from a tracking assistance device that transmits instructions to a tracking person carrying the terminal based on information received from a plurality of cameras that are arranged within a specified surveillance area and each transmits images that it captures; and an output unit that outputs information regarding the distance between the terminal and the tracked target based on the position of the tracked target received from the tracking assistance device and the terminal's own position.

[0013] According to a third aspect, there is provided a tracking support method for a tracking support system including a plurality of cameras arranged in a specified monitoring area and each transmitting the captured image, a terminal carried by each of a plurality of trackers, and a tracking support device that transmits instructions to the trackers carrying the terminals based on information received from the cameras, the tracking support device calculates the position of the tracked object based on the images received from the plurality of cameras, selects a tracker to instruct tracking of the tracked object based on the position information of the terminal received from the terminal and the calculated position of the tracked object, and transmits information on the distance between the terminal and the tracked object while tracking the tracked object to the terminal of the selected tracker. This method is linked to a specific machine, that is, a computer that instructs the terminal carried by the tracker to track the tracked object.

[0014] According to a fourth aspect, there is provided a tracking support system including a plurality of cameras arranged within a specified surveillance area and each transmitting the images it captures, a terminal carried by each of a plurality of trackers, and a tracking support device that transmits instructions to the trackers carrying the terminals based on information received from the cameras. The tracking support system includes a computer mounted on the tracking support device, and the computer executes the following processes: calculating a position of the tracked target based on the images received from the plurality of cameras; selecting a tracker to instruct tracking of the tracked target based on position information of the terminal received from the terminal and the calculated position of the tracked target; and transmitting information regarding the distance between the terminal and the tracked target while the tracked target is being tracked to the terminal of the selected tracker.

[0015] According to a fifth aspect, a program is provided that causes a computer mounted on a terminal that receives an instruction of a tracking target from a tracking support device that transmits instructions to a tracking person carrying the terminal based on information received from a plurality of cameras that are arranged in a specified monitoring area and transmit images captured by each of the cameras to execute a process of calculating a distance between the tracking target and the tracking target based on the position of the tracking target received from the tracking support device and the position of the tracking target itself, and a process of outputting information on the calculated distance. The above program can be recorded in a computer-readable (non-transient) storage medium. That is, the present invention can also be embodied as a computer program product.

[0016] According to a sixth aspect, there is provided a tracking assistance system including a plurality of cameras that are placed within a predetermined monitoring area and transmit images captured by each of the cameras, and the tracking assistance device described above. Effect of the Invention

[0017] According to the present invention, it is possible to support a tracking person, such as a patrol security guard, so that tracking can be performed in a manner that is unlikely to be noticed by a tracking target, such as a suspicious person. [Brief description of the drawings]

[0018] [Figure 1] FIG. 1 is a diagram showing a configuration of an embodiment of the present invention. [Diagram 2] FIG. 2 is a diagram for explaining the operation of one embodiment of the present invention. [Diagram 3] 1 is a diagram illustrating a configuration of a tracking support system according to a first embodiment of the present invention. [Figure 4] FIG. 2 is a diagram showing a configuration of a tracking support terminal according to the first embodiment of the present invention. [Diagram 5] FIG. 2 is a diagram illustrating a configuration of a support server according to the first embodiment of the present invention. [Figure 6] FIG. 4 is a diagram illustrating an example of tracer information held in the support server according to the first embodiment of the present invention. [Figure 7] FIG. 2 is a diagram illustrating an example of monitoring target information held in a support server according to the first embodiment of the present invention. [Figure 8] 4 is a flowchart showing the operation (processing of transmitting a captured image to a support server) of the camera according to the first embodiment of the present invention. [Figure 9] 4 is a flowchart showing the operation (position notification process to the support server) of the tracking support terminal according to the first embodiment of the present invention. [Figure 10] 4 is a flowchart showing an operation (processing of changing a tracer) of the support server according to the first embodiment of the present invention. [Figure 11] 4 is a flowchart showing the operation (processing of receiving an instruction from the support server) of the tracking support terminal according to the first embodiment of the present invention. [Figure 12] 4 is a flowchart showing an operation (processing for determining a distance to a tracking target) of the support server according to the first embodiment of the present invention. [Figure 13] FIG. 4 is a sequence diagram showing a handover operation to a tracer in the first embodiment of the present invention. [Figure 14] FIG. 4 is a diagram showing an example of a proximity warning displayed on the tracking support terminal according to the first embodiment of the present invention. [Figure 15] FIG. 11 is a diagram showing another example of a proximity alarm displayed on the tracking support terminal according to the first embodiment of the present invention. [Figure 16]FIG. 11 is a diagram showing a configuration of a tracking support terminal according to a second embodiment of the present invention. [Figure 17] 13 is a flowchart showing an operation (processing for determining a distance to a tracking target) of the tracking support terminal of the second embodiment of the present invention. [Figure 18] FIG. 13 is a diagram showing an example of a button provided on a tracking support terminal according to a third embodiment of the present invention. [Figure 19] FIG. 13 is a sequence diagram showing a handover operation to a tracer in the third embodiment of the present invention. [Figure 20] FIG. 13 is a sequence diagram showing a handover operation to a tracer in the fourth embodiment of the present invention. [Figure 21] FIG. 11 is a sequence diagram showing the operation of a fixed camera and a support server according to an embodiment. [Figure 22] FIG. 11 is a sequence diagram showing the operation of the tracking support terminal and the support server according to an embodiment. [Figure 23] 11 is an operational flowchart of a support server according to an embodiment. [Figure 24] FIG. 2 is a functional block diagram of a support server according to an embodiment. [Diagram 25] FIG. 2 is a functional block diagram of a tracking assistance terminal according to an embodiment. [Figure 26] 13 is another operation flowchart of the tracking assistance terminal according to an embodiment. [Figure 27] 13 is another operation flowchart of the tracking assistance terminal according to an embodiment. [Figure 28] FIG. 11 is a sequence diagram showing the operation of a fixed camera and a support server according to an embodiment. [Figure 29] 13 is another operation flowchart of the tracking assistance terminal according to an embodiment. [Diagram 30] FIG. 11 is a sequence diagram showing the operation of a fixed camera and a support server according to an embodiment. [Diagram 31] FIG. 1 is a block diagram illustrating a configuration of an information processing device according to an embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0019] First, an overview of one embodiment of the present invention will be described with reference to the drawings. Note that the reference numerals in the drawings attached to this overview are attached to each element for convenience as an example to aid in understanding, and are not intended to limit the present invention to the illustrated form. Furthermore, the connection lines between blocks in the drawings and the like referred to in the following description include both bidirectional and unidirectional lines. The unidirectional arrows are intended to diagrammatically indicate the flow of the main signal (data), and do not exclude bidirectionality.

[0020] In one embodiment, the present invention can be realized in a tracking support system including a plurality of cameras 10A arranged within a specified monitoring area, each of which transmits the images it captures, as shown in FIG. 1, a terminal (hereinafter also referred to as a tracking support terminal) carried by each of a plurality of tracking personnel, and a tracking support device 20A that transmits instructions to the tracking personnel carrying the terminal based on information received from the terminal and the cameras 10A.

[0021] More specifically, the tracking support device 20A of the tracking support system includes a position calculation unit 21A that calculates the position of the tracking target based on the images received from the multiple cameras, a tracking person selection unit 22A that selects a tracking person who will instruct the tracking of the tracking target based on the position information of the terminal received from the terminal and the calculated position of the tracking target, and an information transmission unit 23A that transmits information about the distance between the terminal and the tracking target while tracking the tracking target to the terminal of the selected tracking person. As the information about the distance between the terminal and the tracking target, a simple numerical value representing the distance may be displayed, or a level display indicating the distance may be performed using the number of elements with one unit being 3 m, for example. As the information about the distance between the terminal and the tracking target, a form of outputting an approach warning that warns with an image or vibration when the terminal approaches the tracking target too closely, as described later, may be adopted.

[0022] By adopting the above-mentioned configuration, the tracking support device 20A of this tracking support system transmits the distance to the tracking target to the terminal of the selected tracker, as shown in Fig. 2. The tracker refers to the information on the distance displayed on the terminal he / she carries, and carries out tracking while maintaining an appropriate distance.

[0023] As described above, according to the present invention, it is possible to check the distance (interval) between the tracking target and the tracking target without staring at the tracking target, so that it is possible to track the tracking target in a manner that is unlikely to be noticed by the tracking target.

[0024] In addition, when the person selecting unit 22A selects a tracker, it can also adopt a method of predicting the movement of the tracking target and the movement of the tracker and selecting the nearest tracker at each time point. Of course, at that time, it is also possible to make a comprehensive judgment by taking into consideration the appearance (clothing, physique, hair and skin color, sex, etc.) of each tracker, skills (foot speed, language, special skills, etc.), equipment owned, experience, fatigue level, length of tracking time so far, etc.

[0025] [First embodiment] Next, a first embodiment of the present invention will be described in detail with reference to the drawings. Fig. 3 is a diagram showing the configuration of a tracking support system according to the first embodiment of the present invention. Referring to Fig. 3, a configuration is shown in which a support server 100 that receives images captured from a plurality of cameras 200 and a tracking support terminal 500 carried by a plurality of trackers are connected via a communication network. In this embodiment, with the above configuration, a plurality of trackers take turns tracking the tracking target based on instructions from the support server 100.

[0026] Fig. 4 is a diagram showing the configuration of a tracking support terminal 500 according to the first embodiment of the present invention. Referring to Fig. 4, the configuration includes a time management unit 501, a terminal position information acquisition unit 503, a display unit 504, a data transmission / reception unit 505, a wireless interface (hereinafter, "wireless IF") 506, and an operation unit 507.

[0027] The time management unit 501 has a timing device (timer) and manages the time. This time information is transmitted together with the location information to the support server 100.

[0028] The own terminal position information acquisition unit 503 acquires position information indicating the own terminal's position by performing positioning using a satellite positioning system such as a GPS (Global Positioning System).

[0029] The display unit 504 displays the tracking support information received from the support server 100 and warnings such as a proximity warning. The proximity warning is not limited to being displayed as characters or images. For example, the proximity warning can be transmitted by sound or vibration. In that case, the proximity warning is output by a speaker or a vibrator instead of the display unit 504. Also, the characters or images may be used in combination with sound or vibration.

[0030] The data transmission / reception unit 505 communicates with the support server 100 via the wireless IF 506. Specifically, the data transmission / reception unit 505 transmits to the support server 100 position information of the device itself and messages informing the support server 100 that tracking has started or ended. Furthermore, when the data transmission / reception unit 505 receives an instruction or a proximity warning from the support server 100, it transmits the instruction content or the proximity warning to the display unit 504. The wireless IF 506 and the data transmission / reception unit 505 correspond to the instruction receiving unit described above, and the data transmission / reception unit 505 and the display unit 504 correspond to the output unit described above.

[0031] The operation unit 507 is composed of a touch panel and buttons that receive various instructions from an operator.

[0032] As the tracking support terminal 500 as described above, a smartphone equipped with a position measurement function or various wearable terminals can be preferably used (see Figs. 14 and 15).

[0033] Next, the configuration of the support server 100, which corresponds to the above-mentioned tracking support device that grasps the position of the above-mentioned tracking support terminal 500 and supports tracking by outputting a tracking instruction and an approach warning, will be described. Fig. 5 is a diagram showing the configuration of the support server 100 of the first embodiment of the present invention. Referring to Fig. 5, the configuration includes a tracking person information management unit 101, a tracking target information management unit 102, a time management unit 103, a handover destination determination unit 104, a tracking target position estimation unit 105, a network interface (hereinafter, "NW IF") 106, a data transmission / reception unit 107, and a distance determination unit 108.

[0034] The tracker information management unit 101 manages information on the tracker who tracks the target to be tracked. FIG. 6 is a diagram showing an example of the tracker information held by the tracker information management unit 101. In the example of FIG. 6, the tracker information is shown in which the current location of each tracker specified by the tracker ID, appearance information, skill information, address of the tracking support terminal owned, and the like are associated with each other. The current location data field and the current time data field store information indicating the current location of the tracker (for example, latitude and longitude information) and the time when the tracker was at the location. In addition, as the appearance information, information such as the tracker's clothing, physique, hair and skin color, and gender are stored. In addition, as the skill information, walking speed, language, special skills, and the like are stored. As the address of the tracking support terminal, a terminal address used when sending a message or information to the tracking support terminal, and the like are stored. In addition, although omitted in the example of FIG. 6, the equipment owned by the tracker, experience, fatigue level, length of tracking time so far, and the like may be recorded as status information. These pieces of information are referred to when the handover destination determination unit 104 selects a tracker who will be in charge of tracking. The contents of the tracer information management unit 101 may be set by an administrator who supervises the tracers. Of course, items that are preferably changed in real time may be updated by each tracer individually.

[0035] The tracking target information management unit 102 stores information on a person or the like who is a tracking target. FIG. 7 is a diagram showing an example of tracking target information held by the tracking target information management unit 102. In the example of FIG. 7, the location information (current location) of each tracking target specified by the tracking target ID, the time when the person was at that location, and at least one or more pieces of characteristic information of the tracking target are set. For example, characteristics such as clothing, hair or skin color, height, and sex of the person or the like who is a tracking target are preferably adopted as the characteristic information. In addition, information that can be used as the characteristic information is not limited to the external characteristics of the tracking target as described above. For example, if the terminal ID wirelessly transmitted by the terminal held by the tracking target, the voice (voice characteristics), the language used, and the like are known, these can also be used as supplementary information.

[0036] The time management unit 103 also has a timing device (timer) and records and manages the tracking start time, tracking duration, and the like of each tracking target.

[0037] The takeover determination unit 104 determines a new tracker who will start tracking in place of the tracker who is currently tracking the target at a predetermined opportunity. More specifically, the takeover determination unit 104 selects a new tracker who will start tracking based on the information of the target held in the tracker information management unit 102 and the information of the tracker held in the tracker information management unit 101. In addition, as a selection criterion for the tracker, in addition to the current location being a location where tracking of the target can be started, the tracker's appearance, skill and status information are used. For example, a person with different clothes and gender from the tracker currently tracking can be selected, or if the moving speed of the target is fast, a tracker who is fast and less tired can be selected. Also, for example, if it is known that the target is highly cautious, a tracker with attributes that do not stand out in the area where tracking is performed can be selected. Also, the attributes of the tracker may be determined in advance based on the attributes of the target.

[0038] The tracking target position estimation unit 105 acquires the position of the tracking target based on the captured image received from the camera 200, and outputs the position to the distance determination unit 108. For example, the position of the tracking target can be calculated from, for example, the position of the camera 200 and the position and size of the tracking target captured in the captured image. Even if the tracking target has disappeared from the captured image, for example, if it is known from a past captured image that the tracking target is moving in a certain direction at a constant speed, the tracking target position estimation unit 105 may estimate and output the position of the tracking target. As a method for detecting the tracking target and estimating the position, various other methods can be used, but for example, the methods listed in the above-mentioned patent documents (for example, Patent Document 6) can also be used.

[0039] The data transmission / reception unit 107 transmits a tracing instruction to the tracing support terminal 500 of a tracing person who is to newly start tracing, and instructs the tracing support terminal 500 of a tracing person who is to end tracing to end tracing, via the network IF (NW I / F) 106. In addition, the data transmission / reception unit 107 receives, via the wireless IF 106, a tracing start report, a tracing end report, location information of the tracing support terminal, a tracing start time, and the like, transmitted from the tracing support terminal 500 of the tracing person.

[0040] The distance determination unit 108 transmits an approach warning to the tracking support terminal 500 via the data transmission / reception unit 107 when the distance between the position of the tracking target estimated by the tracking target position estimation unit 105 and the position of the tracking person is less than a predetermined threshold.

[0041] In addition, each part (processing means) of the tracking support terminal 500 and the support server 100 shown in Figures 4 and 5 can also be realized by a computer program that causes a processor installed in these devices to execute each of the above-mentioned processes using its hardware.

[0042] Next, the operation of this embodiment will be described in detail with reference to the drawings. First, a mechanism by which the support server 500 specifies the position of a tracking target will be described. Fig. 8 is a sequence diagram showing the operation of the camera of the first embodiment of the present invention (processing of transmitting captured images to the support server). Referring to Fig. 8, the camera 200 transmits captured images to the support server 100 at a predetermined time interval (step S001).

[0043] The support server 100 acquires position information from the captured image received from the camera 200 (step S002). As described above, the position of the tracking target can be calculated from the position of the camera 200 and the position and size of the tracking target captured in the captured image. In addition, if the tracking target has disappeared from the captured image of the camera, the position of the tracking target may be estimated from the past movement of the tracking target.

[0044] Next, a description will be given of a process of transmitting location information from the tracking support terminal 500 to the support server 100. Fig. 9 is a flow chart showing the operation of the tracking support terminal 500 of the first embodiment of the present invention. Referring to Fig. 9, the tracking support terminal 500 transmits location information of its own device (own terminal) to the support server 100 (step S201).

[0045] Next, the tracking support terminal 500 checks whether a specified time has passed since the last transmission to the support server 100 (step S202). If the specified time has not passed, the tracking support terminal 500 waits (NO in step S202). On the other hand, if the specified time has passed, the tracking support terminal 500 returns to step S201 to transmit new information to the support server 100.

[0046] As described above, the tracking support terminal 500 transmits its own position information to the support server 100 at predetermined time intervals.

[0047] Next, an operation of the support server 100 to transmit a tracking instruction to the tracking support terminal 500 using the above-mentioned position of the tracking target and the position of the tracking support terminal will be described. Fig. 10 is a flow chart showing the operation of the support server of the first embodiment of the present invention. Referring to Fig. 10, first, the support server 100 specifies the position of the tracking target from the image captured by the camera 200 as described in Fig. 8 above. The support server 100 receives the position information of each tracking support terminal 500 from the tracking support terminal 500 as described in Fig. 9 above (step S101).

[0048] Next, the support server 100 checks whether or not a specified time has elapsed since the last handover, that is, whether or not the tracing by the tracing person currently performing tracing has elapsed a specified time (step S102).

[0049] If the result of the above check is that the tracking by the current tracker has exceeded the specified time (YES in step S102), the support server 100 determines a tracker to take over and transmits a handover start instruction and location information and characteristic information of the tracked target to the tracking support terminal 500 held by the tracker (step S103).

[0050] When the support server 100 receives a monitoring start notification (described later) from the tracking support terminal 500 of the takeover destination, the support server 100 transmits a takeover end instruction to the tracking support terminal 500 of the takeover source (step S104).

[0051] In step S102, if the tracking by a certain tracker has not elapsed the specified time (NO in step S102), the support server 100 returns to step S101 and continues to receive new information from the camera 200 and the tracking support terminal 500.

[0052] As described above, the support server 100 switches the tracking person who tracks the tracking target at every certain specified time. The "specified time" in step S102 described above does not have to be a fixed time. For example, a time determined by a random number may be added to a certain time, and the value may be used as the specified time. That is, the tracking person who monitors the target can be switched using a time determined randomly each time. This makes it possible to reduce the possibility that the tracking target will notice the monitoring. Also, instead of changing randomly, the tracking person may be determined in consideration of whether the tracking target is in a situation where it is likely to be noticed by the tracking target, such as the attributes of the tracking target (typically, whether the tracking target is a terrorist or a criminal (careful), etc.), the time of day, the weather conditions of the tracking target area, and the degree of congestion in the surrounding area.

[0053] Next, the operation of the tracking support terminal when receiving an instruction from the support server 100 will be described. FIG. 11 is a flow chart showing the operation of the tracking support terminal 500 of the first embodiment of the present invention (instruction receiving process from the support server 100). Referring to FIG. 11, when the tracking support terminal 500 is on standby for tracking, that is, not monitoring the tracking target (YES in step S301), and receives a tracking handover instruction for the tracking target from the support server 100 (YES in step S302), the tracking support terminal 500 displays a tracking start instruction on the display unit 504 (step S303). The person in charge of tracking sees this display and starts tracking the tracking target. Then, the tracking support terminal 500 notifies the support server 100 that monitoring has started (step S304).

[0054] On the other hand, when the tracking support terminal 500 is tracking, i.e., monitoring the tracking target (NO in step S301), if it receives an instruction to end tracking of the tracking target from the support server 100 (YES in step S305), the tracking support terminal 500 displays the instruction on the display unit 504 (step S306). The person in charge of tracking sees this display and ends tracking of the tracking target, and performs a predetermined operation on the operation unit 507 of the tracking support terminal. Then, the tracking support terminal 500 notifies the support server 100 that tracking has been ended (step S307).

[0055] As described above, the tracer starts or ends monitoring of the monitoring target according to instructions from the support server 100, and notifies the support server 100 to that effect.

[0056] Next, a warning process to the tracker by the support server 100, which is performed independently of the handover of the tracked object, will be described. Fig. 12 is a flow chart showing the operation of the support server of the first embodiment of the present invention (processing for determining the distance from the tracked object). Referring to Fig. 12, first, the support server 100 calculates the position information of the tracked object, and acquires the position information of the tracking support terminal 500 that is tracking the tracked object from the tracker information management unit 101 (step S401).

[0057] Next, the support server 100 calculates the distance between the tracking target and the tracking support terminal 500 that is tracking the tracking target (step S402).

[0058] Next, the support server 100 checks whether the calculated distance is less than a predetermined threshold (step S403).

[0059] If the calculated distance is less than a predetermined threshold (YES in step S403), the support server 100 transmits an approach warning to the tracking support terminal 500 that is tracking the tracking target, notifying the tracking target that the distance is too close (too short) (step S404). If the calculated distance in step S403 is equal to or greater than the predetermined threshold (NO in step S403), the support server 100 returns to step S401 and waits until the next calculation timing.

[0060] Next, the tracking handover operation of the tracking target by the tracking support terminal 500 and the support server 100 operating as described above will be described. Fig. 13 is a sequence diagram showing the handover operation to the tracking person in the first embodiment of the present invention. In Fig. 13, it is assumed that, as an initial state, an instruction is given to the tracking support terminal #1 and the tracking target is being monitored (step S501).

[0061] The tracking support terminal #1 held by the tracker who is tracking the target transmits position information to the support server 100 at predetermined time intervals (step S502), as described in step S201 of FIG.

[0062] As described in step S201 of FIG. 9, the tracking support terminal #2 on standby for tracking transmits its own position information to the support server 100 at predetermined time intervals (step S502).

[0063] As described in steps S101 to S102 in Fig. 10, when the tracking duration of a certain tracer exceeds a specified time, the support server 100 determines a tracer who will take over tracking of the trace target (step S503). Here, it is assumed that the support server 100 selects the tracking support terminal #2 of another tracer as the takeover destination.

[0064] Then, the support server 100 transmits the following handover information to the tracking support terminal #2, and instructs it to start supporting the support target (step S504). - Tracking start instruction - Location information of the monitored subject -Characteristic information of the monitored object

[0065] The tracking support terminal #2 that has received the instruction displays the location information and feature information of the tracking target received from the support server 100 on the display unit to prompt the tracking person to start tracking. When the tracking person performs a predetermined tracking start operation on the operation unit 507 of the tracking support terminal #2, the tracking support terminal #2 notifies the support server 100 that tracking of the tracking target has been started (step S506).

[0066] The support server 100, which has received the notification of the start of monitoring from the tracking support terminal #2, instructs the tracking support terminal #1 to end tracking of the tracking target (transition to a tracking standby state) (step S507). The tracking manager terminal #1, which has received the instruction, ends monitoring of the tracking target based on the instruction received from the support server 100, and notifies the support server 100 that monitoring of the monitoring target has been ended (step S508).

[0067] As described above, according to the first embodiment of the present invention, it is possible to track the target by taking turns in a manner that is difficult for the target to notice. Note that, in the above embodiment, the number of trackers who simultaneously track the target is one, but it is also possible to instruct trackers of multiple tracking support terminals to track the target, and to have multiple trackers take over the tracking in principle.

[0068] In addition, an unmanned aerial vehicle (also called a "drone") may be used to play a part of the above-mentioned tracking personnel or to complement the duties of the tracking personnel. In this case, the support server 100 transmits tracking instructions, including location information and characteristic information of the monitored target, to the unmanned aerial vehicle instead of the tracking support terminal. In this way, tracking can be continued even if the tracking personnel is placed in a situation where tracking is difficult.

[0069] In addition, in this embodiment, as described with reference to Fig. 12, a proximity warning is issued to the person in charge of tracking the tracking target, notifying the person in charge of tracking that the person in charge of tracking the tracking target has become close to the tracking target. This proximity warning is implemented in a more suitable form when the tracking assistance terminal 500 is a wearable terminal.

[0070] For example, as shown in Fig. 14, when the tracking assistance terminal 500 is a glasses-type wearable terminal, an approach warning 901 can be displayed in an information display area on the lens surface. In the example of Fig. 14, when the tracking target is captured within the field of vision of the tracker, a marker 902 indicating the tracking target is superimposed. Therefore, the tracker can move without moving his / her line of sight and track the tracking target. Furthermore, when the approach warning 901 is displayed, the tracker can increase the distance from the tracking target by slowing down his / her walking speed or changing the direction of travel.

[0071] 15, when the tracking assistance terminal 500 is a wristwatch-type wearable terminal, an approach warning 911 can be displayed in an information display area of ​​the main body 910. In the case of a wristwatch-type wearable terminal, instead of displaying the approach warning 911 in the information display area, a form of providing an approach warning by vibration of a vibrator can be adopted. The form of the tracking assistance terminal 500 is not limited to these wearable terminals, and a ring-type or wristband-type terminal can be used. Of course, a smartphone or the like can also be used as the tracking assistance terminal 500.

[0072] [Second embodiment] Next, a second embodiment will be described in which the output determination function of the approach warning, which was arranged on the support server 100 side in the first embodiment, is arranged on the tracking support terminal side. Since the basic configuration and operation of the second embodiment are the same as those of the first embodiment, the following description will focus on the differences. The support server 100 of this embodiment has a function of transmitting the position information of the tracking target estimated by the tracking target position estimation unit 105 to the tracking support terminal 500. Other than that, it is the same as the first embodiment, so the description will be omitted.

[0073] Fig. 16 is a diagram showing the configuration of a tracking support terminal 500a according to the second embodiment of the present invention. The difference from the tracking support terminal 500 according to the first embodiment shown in Fig. 4 is that a tracking target position information storage unit 502 and a distance determination unit 508 are added to the tracking support terminal 500a.

[0074] The tracking target position information storage unit 502 stores the position information of the tracking target received from the support server 100 for a predetermined period of time.

[0075] The distance determination unit 508 calculates the distance between the target and its own terminal based on the position information of the target and its own terminal received from the support server 100. If the distance between the target and its own terminal is less than a predetermined threshold as a result of the calculation, the distance determination unit 508 outputs a proximity warning to the display unit 504.

[0076] Next, the output process of the approach warning in the tracking support terminal 500a of this embodiment will be described. Fig. 17 is a flow chart showing the operation (processing of determining the distance from the tracking target) of the tracking support terminal 500a of the second embodiment of the present invention. First, the tracking support terminal 500a reads out the position information of the tracking target from the tracking target position information storage unit 502. Next, the tracking support terminal 500a acquires the position information of the tracking support terminal 500a that is tracking the tracking target from the tracking staff information management unit 101 (step S601).

[0077] Next, the tracking support terminal 500a calculates the distance between the tracking target and the tracking support terminal 500a that is tracking the tracking target (step S602).

[0078] Next, the tracking support terminal 500a checks whether the calculated distance is less than a predetermined threshold value (step S603).

[0079] If the calculated distance is less than the predetermined threshold (YES in step S603), the tracking support terminal 500a displays an approach warning on the display unit 504 to the effect that the distance to the tracking target is too close (too short) (step S604). If the calculated distance in step S603 is equal to or greater than the predetermined threshold (NO in step S603), the tracking support terminal 500a returns to step S601 and waits until the next calculation timing.

[0080] As described above, the present invention can be modified to a configuration in which the tracking support terminal 500a calculates the distance between the tracker and the target, and outputs an approach warning as necessary.

[0081] [Third embodiment] Next, a third embodiment will be described, which adds a search function for when the tracker loses sight of the tracked target (hereinafter, the term "lost sighting" includes the case where the tracker is shaken off by the tracked target and the case where the tracker realizes that he / she has been tracking the wrong tracked target). The basic configuration and operation of the third embodiment are the same as those of the first and second embodiments, so the following description will focus on the differences.

[0082] The tracking support terminal of this embodiment has a function of notifying the support server 100 that the tracker has lost track of the tracking target. FIG. 18 is a diagram showing an example of an operation unit 507 provided in a wristwatch-type tracking support terminal of the third embodiment of the present invention. In the example of FIG. 18, a "target lost" button 912 indicating that the target has been lost and a "need to take over" button 913 requesting handover to another tracker for some reason are provided independently. For example, when the tracker clicks the "target lost" button 912, a message indicating that the tracker has lost the target is transmitted to the support server. Similarly, when the tracker clicks the "need to take over" button 913, a message indicating that the tracker is requesting handover of the task to another tracker is transmitted to the support server. In the example of FIG. 18, an example was given in which the "target lost" button 912 and the "need to take over" button 913 were displayed separately (independently) on the touch panel of the wristwatch-type tracking support terminal, but the two may be integrated to provide a button for requesting support from the support server. Furthermore, functions corresponding to these buttons may be assigned to mechanical buttons provided on the wearable terminal.

[0083] Fig. 19 is a sequence diagram for explaining a function added to the third embodiment of the present invention. The sequence of Fig. 19 shows a search operation for a tracking target that is started when the support server 100, which has received a lost-tracking report from a tracking person, cannot find the tracking target from the video data of the camera 200. Referring to Fig. 19, first, when the tracking person realizes that the tracking target has been lost, he / she clicks, for example, the "target lost" button 912 in Fig. 18 (step S701) to report the loss to the support server 100 (step S702). This report (lost-tracking report) may include the location information (lost-tracking location) and time (lost-tracking time) at which the tracking target was last confirmed, or characteristic information.

[0084] The support server 100 that has received the lost track report selects a tracker based on the location information where the tracker last confirmed the tracked target, and transmits a search request for the tracked target to the tracking support terminal #2 of the tracker (step S703). This search request for the tracked target may include the location information where the tracked target was last confirmed and past feature information indicating disguise history, etc., of the tracked target, in addition to the feature information of the tracked target. If the support server 100 can find the tracked target from the video data of the camera 200 when receiving the lost track report of step S702, steps S703 to S705 can be omitted. In this case, the support server 100 transmits the tracked target location information, etc., identified by the camera 200 to the tracking support terminal #1, and requests re-monitoring of the tracked target (step S706).

[0085] The tracking person who receives the search request for the tracking target searches for the tracking target based on the characteristic information of the tracking target included in the search request for the tracking target (step S704). Note that in the example of FIG. 19, it is assumed that the tracking person who holds the tracking person terminal #2 has found the tracking target as a result of the search for the tracking target.

[0086] The person in charge of tracking who has found the tracking target operates the tracking support terminal #2 to notify the support server 100 that the tracking target has been found (step S705). This notification includes location information indicating the location of the found tracking target and, if necessary, characteristic information.

[0087] The support server 100 that has received the location information of the tracking target transmits the location information of the tracking target to the tracking support terminal #1 and requests the tracking target to be monitored again (step S706). When the tracking person rediscovers the tracking target (step S707), the tracking person operates the tracking support terminal #1 to notify the support server 100 that the tracking target has been found and tracking has been resumed (step S708).

[0088] As described above, according to this embodiment, it becomes possible to respond to the case where the tracking person loses sight of the tracking target because the tracking target changes clothes, disguises itself, intentionally disappears from the field of view of the unmanned aerial vehicle, etc. In particular, by independently providing a "target lost" button 912 as shown in Fig. 18, it becomes possible to report the fact that the tracking target has been lost to the support server 100 immediately after it has been lost.

[0089] In the above embodiment, the support server 100 selects a nearby tracking support terminal based on the location information where the tracking person of the tracking support terminal #1 last confirmed the tracking target. However, the support server 100 can be changed to a form in which the search request for the tracking target is broadcast to all subordinate tracking support terminals. Even in this case, the search request for the tracking target may include location information where the tracking person #1 last confirmed the tracking target. In this way, each tracking person can perform a re-search by referring to the location and characteristics where the tracking person #1 last confirmed the tracking target.

[0090] In the above embodiment, the support server 100 instructs the tracker holding the tracking support terminal #1 to resume tracking. However, if the positional relationship between the tracker #1 and the tracked object is not appropriate, such as when the tracked object has moved significantly, the process may proceed to step S103 in the flowchart of FIG. 10, and a tracker to take over may be selected.

[0091] [Fourth embodiment] Next, a fourth embodiment will be described in which a function for requesting the tracking support terminal to stop tracking is added. The basic configuration and operation of the fourth embodiment are the same as those of the first and second embodiments, so the following description will focus on the differences.

[0092] Fig. 20 is a sequence diagram for explaining a function added to the fourth embodiment of the present invention. Referring to Fig. 20, first, when a reason occurs for stopping tracking of a tracking target that has been tracked (step S1001), a tracking person who holds a tracking support terminal #1 transmits a tracking stop request (tracking end request) to the support server 100 (step S1002). This tracking stop request (tracking end request) may include location information of the last confirmed tracking target and a reason for stopping tracking of the tracking target.

[0093] The following are some of the reasons why tracking of a tracked object may be discontinued: If the person being tracked notices that they are being tracked If the target enters an area where tracking is difficult for the tracker Receipt of another order - Ensuring safety of trackers, including preventing fatigue and injury

[0094] The support server 100 that has received the tracing stop request (tracing end request) determines a tracing person who will take over tracing of the tracing target (step S1003). Here, it is assumed that the support server 100 selects the tracing person who holds the tracing support terminal #2 as the tracing person.

[0095] Then, the support server 100 transmits the following information to the tracking support terminal #2, and instructs it to start tracking the tracking target (step S1004). -Instruction to start handover - Location information of tracked objects -Characteristic information of the tracked object

[0096] The tracking person who holds the tracking support terminal #2 who has received the instruction starts tracking the tracking target based on the position information and feature information of the tracking target received from the support server 100 (step S1005). Then, the tracking support terminal #2 notifies the support server 100 that monitoring of the tracking target has started (step S1006). The notification that monitoring of the tracking target has started may be sent by an explicit operation from the tracking person who holds the tracking support terminal #2, or may be automatically sent based on the tracking support terminal #2 starting a movement to track the tracking target.

[0097] The support server 100, which has received the notification of the start of monitoring from the tracking support terminal #2, instructs the tracking support terminal #1 to end tracking of the tracking target (transition to a tracking standby state) (step S1007). The tracking staff who holds the tracking support terminal #1 that has received the instruction ends tracking of the tracking target based on the instruction received from the support server 100, and notifies the support server 100 that tracking of the tracking target has been ended (step S1008).

[0098] As described above, according to this embodiment, when a situation arises on the part of one tracer that requires tracing to be discontinued, monitoring can be quickly handed over to another tracer.

[0099] Although each embodiment of the present invention has been described above, the present invention is not limited to the above-mentioned embodiments, and further modifications, substitutions, and adjustments can be made without departing from the basic technical idea of ​​the present invention. For example, the network configurations, element configurations, and information element expression forms shown in the drawings are examples to help understand the present invention, and the present invention is not limited to the configurations shown in these drawings.

[0100] Finally, preferred embodiments of the present invention will be summarized. [First form] (See the tracking assistance device from the first perspective above.) [Second Form] In the tracking assistance device, The information regarding the distance between the terminal and the tracked target is preferably a proximity alarm that is transmitted when the distance between the terminal and the tracked target becomes shorter than a predetermined threshold. [Third Form] In the tracking assistance device, the person in charge selection unit, when a tracking time of the trace target by one tracer exceeds a predetermined time, selects another tracer from among the plurality of tracers; A configuration may be adopted in which an instruction is given to the terminal of the other selected tracer to trace the trace target, and an instruction is given to the one tracer to end tracing the trace target. [Fourth Form] In the tracking assistance device, The predetermined time may be a time that is randomly determined each time. [Fifth Form] When the person selecting unit of the tracing support device receives a tracing end request from the one person, the person selecting unit selects another person from among the plurality of tracing persons, The information transmission unit may be configured to instruct the terminals of the other tracers to trace the trace target, and to instruct the terminal of the one tracer to end tracing of the trace target. [Sixth Form] In the above-mentioned tracking support device, when the tracking end request from the one person in charge is due to loss of the target, it is preferable that information on the target be transmitted to the plurality of tracking persons in charge to instruct them to search for the target. [7th form] (See the second perspective terminal above) [8th form] It is preferable that the terminal has a button for transmitting the tracking end request to the tracking assistance device. [9th form] In the above terminal, It is preferable that the buttons include at least a button for notifying the tracking assistance device that the target has been lost, and a button for notifying the tracking assistance device that the target has been noticed by the tracking target, which are provided independently. [10th form] (See the third perspective tracking support method above.) [11th form] A plurality of cameras are arranged within a predetermined surveillance area, each of which transmits the images it captures; A tracking support system including a tracking support device that transmits instructions to the tracking personnel carrying the terminals based on information received from the camera and a terminal carried by each of the tracking personnel, the tracking support device being provided with a computer mounted on the tracking support device; calculating a position of a tracked object based on images received from the plurality of cameras; A process of selecting a tracking person who will instruct tracking of the tracking target based on the location information of the terminal received from the terminal and the calculated location of the tracking target; A process of transmitting information regarding a distance between the selected tracking person's terminal and the tracking target while tracking the tracking target; A program that executes the following. [12th form] A computer mounted on a terminal receives instructions for a tracking target from a support device that transmits instructions to a tracking person carrying the terminal based on information received from a plurality of cameras that are arranged within a specified monitoring area and each transmits an image captured by the camera. A process of calculating a distance between the vehicle and the tracking target based on a position of the tracking target received from the support device and a position of the vehicle; outputting information about the calculated distance; A program that executes the following. The seventh and tenth to twelfth embodiments can be expanded into the second to sixth embodiments in the same manner as the first embodiment.

[0101] In the present disclosure, the following forms are also possible.

[0102] solution In a tracking support system that supports multiple trackers in tracking a monitored person in shifts, A tracking system including a plurality of cameras for capturing images within a monitoring area, a tracking support terminal carried by a tracking person, and a support server connected to the plurality of cameras and the plurality of tracking support terminals via a communication network; The camera transmits images of the monitored area to a support server via a communication network; The tracking support terminal transmits the location information of the terminal to the support server via a communication network, Based on the location information of the tracking support terminal and the location information of the monitored person identified based on the camera footage or the location information of the monitored person estimated from the history, the support server selects the next tracking person to carry out tracking, and notifies the tracking support terminal.

[0103] effect Since the tracking personnel are less likely to lose sight of the monitored subject when switching tracking personnel, can easily recover when they lose sight of the monitored subject, and can track the subject at an appropriate distance, the monitored subject is less likely to notice that he or she is being monitored and is less likely to take action to evade monitoring. In FIG. 22, examples of the method for determining the person in charge of tracking who will take over monitoring include the following. - Randomly select from among support devices moving within a specified radius of the monitored person's current location Based on the behavioral history of the monitored person, a support device is randomly selected from among those moving within a specified radius of the location where the monitored person is likely to move within a specified time period. *When making your selection, you may want to take into consideration the appearance and clothing of the tracker (gender, physique, clothing, accessories, etc.), their walking speed, and the surrounding conditions (degree of congestion). → If you change from an office worker to an old man, you will be less likely to be noticed being followed. If it is crowded, your movement speed will decrease. Furthermore, in the judgment block of Fig. 26, the predetermined distance may be changed depending on the surrounding conditions, etc. For example, when the degree of congestion is high, it is considered that the possibility of being noticed even if the monitoring target is approached decreases. In FIG. 30, examples of the monitoring target information include a photograph of the monitoring target, the physique of the monitoring target, and clothing (clothing worn by the person).

[0104] 31 is a block diagram illustrating a configuration of an information processing device. The analysis server according to the embodiment may include the information processing device shown in the above diagram. The information processing device has a central processing unit (CPU: Central Processing Unit) and a memory. The information processing device may realize some or all of the functions of each part of the analysis server by the CPU executing a program stored in the memory.

[0105] Form 1 In a tracking support system that supports multiple trackers in tracking a monitored person by rotating between them, The system comprises a plurality of cameras for photographing a surveillance area, a plurality of tracking support terminals carried by a plurality of tracking personnel, and a support server connected to the plurality of cameras and the plurality of tracking support terminals via a communication network, The camera transmits images of the monitored area to a support server via a communication network; The tracking support terminals transmit location information of the terminals to a support server via a communication network; The support server selects a tracking person who will next carry out tracking based on the location information of the plurality of tracking support terminals and the location information of the monitored person identified based on the image of the camera or the location information of the monitored person estimated from the history, and notifies the selected tracking support terminal. A tracking support system comprising: Form 2 The support server includes a network interface, a data transmission / reception unit, a monitoring target position estimation unit, a tracking target information storage unit, a tracking person information management unit, a time management unit, and a handover destination determination unit. 2. A tracking support system according to claim 1, Form 3 The plurality of tracking support terminals each include a wireless IF, a display unit, a terminal location information acquisition unit, a monitoring target person location information storage unit, a time management unit, a location relationship determination unit, a data transmission / reception unit, and an operation unit. 3. A tracking support system according to claim 1 or 2, Form 4 When the tracking support terminals receive an input to an operation unit indicating that the monitoring target has been lost, the tracking support terminals report a request for providing monitoring target position information to the support server; The support server notifies the tracking support terminal that is the requester of the location information of the person to be monitored; The tracking support terminal that made the request displays the notified location information of the person to be monitored on a display unit. 4. A tracking support system according to any one of claims 1 to 3, Form 5 The plurality of tracking support terminals calculate the positional relationship between the tracking person and the person being monitored based on the positional information of the terminal itself and the positional information of the person being monitored, and if a predetermined distance (upper and lower limits) is exceeded, a warning to that effect is displayed on the display unit of the tracking support terminal. 5. A tracking support system according to any one of claims 1 to 4.

[0106] Within the scope of the entire disclosure of the present invention (including the scope of claims), modifications and adjustments of the embodiments and examples are possible based on the basic technical ideas. Furthermore, within the scope of the disclosure of the present invention, various combinations and selections of the various disclosed elements (including each element of each claim, each element of each embodiment or example, each element of each drawing, etc.) are possible. In other words, the present invention naturally includes various modifications and corrections that a person skilled in the art would be able to make based on the entire disclosure including the scope of claims and the technical ideas. In particular, with regard to the numerical ranges described in this specification, any numerical value or subrange included in the range should be interpreted as being specifically described even if not otherwise specified. [Explanation of symbols]

[0107] 10A, 200 Camera 20A Tracking aid 21A Position calculation section 22A Personnel Selection Section 23A Information transmission section 100 Support Server 101 Tracking Officer Information Management Department 102 Tracking Information Management Department 103 Time Management Department 104 Successor Determination Department 105 Tracking target position estimation unit 106 Wireless Interface (Wireless IF) 107 Data transmission and reception unit 108 Distance determination unit 500, 500a Tracking Support Terminal 501 Time Management Department 502 Tracking target location information storage unit 503 Terminal location information acquisition unit 504 Display section 505 Data transmission and reception unit 506 Wireless Interface (Wireless IF) 507 Operation section 508 Distance determination unit 900, 910 (wearable device) main unit 902 Marker 901, 911 Proximity warning 912, 913 Buttons

Claims

1. An information processing device capable of communicating with a drone, A process of identifying a position of the tracking target based on an image captured by a camera of the tracking target and a position of the camera; A transmission process for instructing the drone to track the location of the tracked object; A drone selection process for selecting a drone to be instructed to track the tracking target based on position information of a plurality of drones and the position of the tracking target; Run The drone selection process, when receiving from one drone a request for assistance for losing sight of the target or needing to take over, or a request to end tracking, selects another drone from among the multiple drones, and further The drone selection process includes, when a tracking time of the tracking target by one drone exceeds a predetermined time, selecting another drone from the plurality of drones; The transmission process instructs the other selected drones to track the tracking target and instructs the one drone to end tracking the tracking target, an information processing device.

2. a process of tracking the tracking target by the drone when the tracking instruction is received; The information processing apparatus according to claim 1 , further comprising:

3. The transmission process transmits feature information regarding the appearance of the tracked object.

3. The information processing device according to claim 1 or 2.

4. The identification process calculates a position of the tracking target in real space based on a position and a size of the tracking target on the image. The information processing device according to claim 1 .

5. An information processing method by a computer capable of communicating with a drone, comprising: Identifying a position of the tracking target based on an image captured by a camera of the tracking target and a position of the camera; Sending a tracking instruction to the drone to the location of the tracked target; A drone selection process is executed to select a drone to be instructed to track the tracking target based on position information of a plurality of drones and the position of the tracking target; The drone selection process, when receiving from one drone a request for assistance for losing sight of the target or needing to take over, or a request to end tracking, selects another drone from among the multiple drones, and further In the drone selection process, when a tracking time of the tracking target by one drone exceeds a predetermined time, another drone is selected from the plurality of drones; An information processing method that instructs the other selected drones to track the tracking target and instructs the one drone to end tracking the tracking target.

6. a process of tracking the tracking target by the drone when the tracking instruction is received; The information processing method according to claim 5 , further comprising the steps of:

7. and transmitting feature information regarding the appearance of the tracked object.

7. The information processing method according to claim 5 or 6.

8. and calculating a position of the tracked object in real space based on a position and a size of the tracked object in the image. The information processing method according to any one of claims 5 to 7.

9. A computer that can communicate with drones A process of identifying a position of the tracking target based on an image captured by a camera of the tracking target and a position of the camera; A transmission process for instructing the drone to track the location of the tracked object; A drone selection process for selecting a drone to instruct tracking of the tracking target based on position information of multiple drones and the position of the tracking target, and when a request for assistance for target loss or handover, or a request to end tracking is received from one drone, the drone selection process selects another drone from the multiple drones; A program for executing The drone selection process includes, when a tracking time of the tracking target by one drone exceeds a predetermined time, selecting another drone from the plurality of drones; The transmission process is a program that instructs the other selected drones to track the tracking target and instructs the one drone to end tracking the tracking target.

10. When the drone receives the tracking instruction, the drone tracks the tracking target. The program according to claim 9.

11. The transmission process transmits feature information regarding the appearance of the tracked object. The program according to claim 9 or 10.

12. The identification process calculates a position of the tracking target in real space based on a position and a size of the tracking target on the image. The program according to any one of claims 9 to 11.

Images