Information processing device, information processing method, and program

Abstract

Obtaining information that is likely to identify the subject. [Solution] The information processing device 1 has a detection unit 132 that detects a person based on monitoring data used to monitor the monitored area, an identification unit 133 that, when the detection unit 132 detects a person, identifies the movement path taken by the monitored person based on the behavior of the monitored person detected by the detection unit 132 and identified based on the monitoring data, and a selection unit 136 that selects one candidate parking area from one or more candidate parking areas that are predetermined as candidates for parking areas in which to park a vehicle, based on the movement path identified by the identification unit 133.

Description

[Technical field]

[0001] The present invention relates to an information processing device, an information processing method, and a program. [Background technology]

[0002] In recent years, unmanned flying objects, so-called drones, have become widespread and are used for various purposes. Patent Document 1 discloses a technology for making an flying object equipped with a camera track a person. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-061082 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, even if an aircraft tracks a target, there is a risk that the target may escape, and therefore it is desirable to obtain information for identifying the target. Although it may seem that information for identifying the target can be obtained by capturing an image of the target with a camera of the aircraft, if the target cannot be captured from the front, or if the target's face is hidden by the subject's clothing even if the target can be captured from the front, there are cases in which it is difficult to obtain information with a high probability of identifying the target.

[0005] Therefore, the present invention has been made in consideration of these points, and aims to obtain information with a high probability of identifying a subject. [Means for solving the problem]

[0006] An information processing device according to a first aspect of the present invention has a detection unit that detects a person based on surveillance data used to monitor a monitored area, an identification unit that, when the detection unit detects a person, identifies a movement path taken by the monitored person detected by the detection unit based on the behavior of the monitored person identified based on the surveillance data, and a selection unit that selects one candidate parking area from one or more candidate parking areas that are predetermined as candidates for parking areas in which to park a vehicle, based on the movement path identified by the identification unit.

[0007] The identification unit may identify as the movement path the path taken by the monitored person in a direction away from a reference point that is a reference point in the monitored area, and the selection unit may select from the one or more candidate parking areas the candidate parking area that is located in the movement direction of the monitored person on the movement path identified by the identification unit.

[0008] The detection unit may further detect an object held by the person, and the identification unit may identify as the movement path the path taken by the monitored person in a direction away from a reference point in the monitored area after the detection unit detects an object held by the monitored person.

[0009] The identification unit may identify as the movement path the path taken by the monitored person in a direction approaching a reference point that is a reference point in the monitored area, and the selection unit may select from the one or more candidate parking areas a candidate parking area that is located in the opposite direction to the movement direction of the monitored person on the movement path identified by the identification unit.

[0010] The information processing device may further have a setting unit that sets a reference point of the monitored area based on the behavior of the monitored person identified based on the monitoring data, and the identification unit may identify the movement route based on the reference point of the monitored area set by the setting unit.

[0011] The information processing device may further have an acquisition unit that acquires information indicating that a sensor installed in the monitored area has detected a person, and the identification unit may identify the movement path based on the position where the sensor is located, the time when the sensor detected the person, the position of the monitored person identified by the monitoring data, and the time when the monitored person is present at the monitored person's position.

[0012] The information processing device may have one or more candidate routes predefined for each combination of the monitored area and the candidate parking area, which are candidates for the route between the monitored area and the candidate parking area, and the selection unit may select one of the one or more candidate routes based on the travel route identified by the identification unit, and select one of the candidate parking areas from the one or more candidate parking areas based on a selected route, which is the selected candidate route.

[0013] The detection unit may detect a vehicle based on parking data captured by the flying object in a selected parking area, which is the candidate parking area selected by the selection unit, and the information processing device may further have a vehicle determination unit that, when the detection unit detects a vehicle, determines whether or not to make the vehicle a target for association with the flying object based on the state of the vehicle identified based on the parking data.

[0014] The vehicle determination unit may determine, as the state of the vehicle identified based on the parking data, whether or not the vehicle is to be associated with the flying object based on the contents of the cargo of the vehicle.

[0015] The detection unit may further detect a vehicle based on the surveillance data, and the information processing device may further have a vehicle determination unit that, when the detection unit detects a vehicle based on the surveillance data including the monitored person, determines whether or not to make the vehicle a target for correspondence with an air vehicle based on the state of the vehicle identified based on the surveillance data.

[0016] An information processing method according to a second aspect of the present invention includes the steps of: detecting a person based on surveillance data used to monitor a monitored area, executed by a computer; when a person is detected, identifying a route traveled by the detected person, that is, the monitored person, based on the behavior of the monitored person identified based on the surveillance data; and selecting one candidate parking area from one or more candidate parking areas that are pre-defined as candidates for parking areas in which to park a vehicle, based on the identified route traveled.

[0017] A program according to a third aspect of the present invention causes a computer to function as a detection unit that detects a person based on surveillance data used to monitor a monitored area, an identification unit that, when the detection unit detects a person, identifies the route of travel taken by the monitored person detected by the detection unit based on the behavior of the monitored person identified based on the surveillance data, and a selection unit that selects one candidate parking area from one or more candidate parking areas that are pre-defined as candidates for parking areas in which to park a vehicle, based on the route of travel identified by the identification unit.

[0018] Effect of the Invention

[0019] The present invention has an effect of obtaining information with a high probability of identifying a subject. [Brief description of the drawings]

[0020] [Figure 1] FIG. 1 is a diagram for explaining an overview of an information processing device. [Diagram 2] FIG. 2 is a diagram illustrating a functional configuration of an information processing device. [Diagram 3] FIG. 10 is a diagram illustrating a process of identifying a movement route of a monitoring target person. [Figure 4]FIG. 10 is a diagram illustrating a process of identifying a movement route of a monitoring target person. [Diagram 5] FIG. 13 is a diagram showing a schematic diagram of a process for selecting a candidate parking area. [Figure 6] FIG. 2 is a diagram showing a schematic diagram of a process for selecting a candidate parking area. [Figure 7] 10 is a flowchart showing a flow of processing in the information processing device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0021] [Overview of information processing device 1] 1 is a diagram for explaining an overview of an information processing device 1. The information processing device 1 is a device used to provide an information processing service to a user, for example, a server. The information processing service is a service for monitoring a predetermined area using an aircraft D. The predetermined area is an outdoor area managed by a user, for example, an outdoor facility where various equipment including solar panels are installed, a farm field for cultivating agricultural crops, etc.

[0022] The flying object D is an unmanned mobile object, a so-called drone. The flying object D is equipped with various devices such as a camera that captures images using a light source, infrared rays, a heat source, etc., a GPS (Global Positioning System) receiver, a magnetic sensor, etc. The flying object D flies according to, for example, preset contents or according to instructions from the information processing device 1.

[0023] The flying object D has various modes defined, such as a surveillance mode and a search mode. The surveillance mode is a mode for monitoring a specified area. The flying object D set in the surveillance mode flies over a specified area and monitors the presence or absence of people, and when a person is detected, flies while capturing the person with a camera. The search mode is a mode for searching for a specific object. The flying object D set in the search mode moves to a specified location and searches for the specific object.

[0024] When an intruder who invades a specified area steals an object such as equipment parts or agricultural products, a vehicle may be used to transport the object or to escape faster and farther. In this case, it is considered that the probability of identifying the intruder is higher when an image of the intruder's vehicle is used as information for identifying the intruder than when an image of the intruder is used. Therefore, the information processing device 1 causes the flying object D to search for the intruder's vehicle that has invaded the specified area. The process executed by the information processing device 1 will be described below.

[0025] The monitored area W shown in FIG. 1 is a predetermined area defined as a range monitored by the flying object D. One or more candidate parking areas P (candidate parking areas P1, P2, P3 in FIG. 1) are defined in the monitored area W. The candidate parking area P shown in FIG. 1 is an area existing around the monitored area W, such as a parking lot, a road, an open space, etc., but may be any area having a space in which a vehicle can be parked. The candidate parking area P is, for example, an area existing outside the monitored area W, but is not limited thereto, and may be an area existing inside the monitored area W.

[0026] In Fig. 1, an example will be described in which an intruder H parks a vehicle in a candidate parking area P1 and moves along a route R. In this case, first, when the information processing device 1 sets the mode of the flying object D to a monitoring mode, the flying object D starts flying in the monitoring target area W and transmits sensing data to the information processing device 1 ((1) in Fig. 1). The sensing data is, for example, data sensed by a device equipped in the flying object D, and is, for example, data including an image (moving image) captured by a camera of the flying object D, the position of the flying object D when the image was captured, and the orientation of the flying object D just when the image was captured.

[0027] When an intruder H intrudes into the monitored area W and is captured by the camera of the flying object D, the information processing device 1 detects the intruder H using the sensing data and identifies the movement path of the intruder H based on the detected behavior of the intruder H ((2) in FIG. 1). The movement path is, for example, information for identifying the direction in which the intruder H moves. The information processing device 1 identifies, for example, at least a portion of the path R as the movement path of the intruder H.

[0028] The information processing device 1 selects one candidate parking area P from among the candidate parking areas P1, P2, and P3 based on the movement route of the identified intruder H ((3) in FIG. 1). For example, when the movement route of the identified intruder H is a route approaching the center point of the monitored area W, the information processing device 1 selects the candidate parking area P1 as the candidate parking area P existing in the opposite direction to the movement direction of the intruder H identified by the movement route of the identified intruder H. Also, for example, when the movement route of the identified intruder H is a route away from the center point of the monitored area W, the information processing device 1 selects the candidate parking area P1 as the candidate parking area P existing in the movement direction of the intruder H identified by the movement route of the identified intruder H.

[0029] Then, the information processing device 1 instructs the aircraft D to move to the selected candidate parking area P1 and search for a vehicle in the candidate parking area P1 ((4) in FIG. 1). After that, the aircraft D switches the mode from the monitoring mode to the search mode and searches for a vehicle in the candidate parking area P1.

[0030] In this way, the information processing device 1 can increase the probability of discovering the vehicle of the intruder H. This allows the information processing device 1 to obtain information on the vehicle discovered by the search of the flying object D. As a result, the information processing device 1 can obtain information with a high probability of identifying the intruder H. The configuration of the information processing device 1 will be described below.

[0031] [Functional configuration of information processing device 1] FIG. 2 is a diagram showing a schematic functional configuration of the information processing device 1. The information processing device 1 includes a communication unit 11, a storage unit 12, and a control unit 13. In FIG. 2, arrows indicate main data flows, and there may be data flows not shown in FIG. 2. In FIG. 2, each functional block indicates a functional unit configuration, not a hardware (device) unit configuration. Therefore, the functional blocks shown in FIG. 2 may be implemented in a single device, or may be implemented separately in multiple devices. Data may be exchanged between the functional blocks via any means, such as a data bus, a network, or a portable storage medium.

[0032] The communication unit 11 is a communication interface for connecting to a network, and includes a communication controller for receiving data from an external device.

[0033] The memory unit 12 is a large-capacity storage device such as a ROM (Read Only Memory) that stores the BIOS (Basic Input Output System) of the computer that realizes the information processing device 1, a RAM (Random Access Memory) that serves as the working area of ​​the information processing device 1, an HDD (Hard Disk Drive) or an SSD (Solid State Drive) that stores the OS (Operating System), application programs, and various information referenced when the application programs are executed.

[0034] The storage unit 12 stores information about a monitoring target area W, which is a predetermined area to be monitored in the information processing service. The information about the monitoring target area W is, for example, information in which coordinates indicating the range of the monitoring target area W are associated with coordinates indicating the range of each candidate parking area P. The storage unit 12 also stores map information.

[0035] The control unit 13 is a processor such as a CPU (Central Processing Unit) or GPU (Graphics Processing Unit) of the information processing device 1, and functions as an acquisition unit 131, a detection unit 132, an identification unit 133, a setting unit 134, a person determination unit 135, a selection unit 136, an aircraft control unit 137, and a vehicle determination unit 138 by executing programs stored in the memory unit 12.

[0036] The acquisition unit 131 acquires sensing data. The acquisition unit 131 acquires monitoring data as sensing data from, for example, the flying object D. The monitoring data is data used to monitor the monitoring target area W, and is, for example, data including captured images captured with the monitoring target area W as the imaging range. The acquisition unit 131 acquires the monitoring data at a predetermined interval (for example, every second, every 10 seconds, every minute, etc.) from when the flying object D is set to the monitoring mode until it is switched to another mode.

[0037] The acquisition unit 131 may acquire surveillance data from a device other than the flying object D. For example, one or more fixed cameras (not shown) are installed in the monitored area W, and the acquisition unit 131 acquires surveillance data from the fixed cameras.

[0038] The detection unit 132 detects a subject included in the surveillance data acquired by the acquisition unit 131 based on the surveillance data. The detection unit 132 can detect the subject using, for example, a known technique. The detection unit 132 detects a person as the subject based on, for example, the surveillance data acquired by the acquisition unit 131.

[0039] When the detection unit 132 detects a person, the identification unit 133 identifies the movement route of the monitored person based on the behavior of the monitored person (the person detected by the detection unit 132) identified based on the surveillance data. For example, when the detection unit 132 detects a person, the identification unit 133 first identifies the movement state of the monitored person as the behavior of the monitored person based on the surveillance data. Then, when the identification unit 133 identifies a movement state indicating that the monitored person is moving, it identifies multiple positions of the monitored person that change with the movement of the monitored person, thereby identifying the movement route of the monitored person.

[0040] The identification unit 133, for example, refers to map information and identifies a first position of the monitored person and a second position of the monitored person based on the monitoring data. The first position may be the position of the monitored person at the time of detection by the detection unit 132, or may be the position of the monitored person at a predetermined time other than the time of detection by the detection unit 132. The second position is a position different from the first position, and is, for example, the position of the monitored person at the time a predetermined period (e.g., 1 second, 10 seconds, 1 minute, etc.) has elapsed from the time the detection unit 132 detected the monitored person, or the position of the monitored person at a predetermined distance from the first position. Note that the identification unit 133 may identify the position of the monitored person at a predetermined interval (e.g., every 1 second, every 10 seconds, every 1 minute, etc.).

[0041] The identifying unit 133 may identify the movement direction (e.g., east-west, north-south, azimuth, etc.) in which the monitored person moved as the movement route of the monitored person. For example, the identifying unit 133 refers to map information and identifies the direction of the second position when the first position is used as the starting point as the movement direction of the monitored person.

[0042] The identification unit 133 may identify the movement path of the person being monitored based on a reference point that is determined as a reference point in the monitored area W. The reference point of the monitored area W is, for example, the center point of the monitored area W, or a point in the monitored area W where an object that can be stolen is placed. The identification unit 133, for example, identifies the path of the person being monitored that moves away from the reference point of the monitored area W as the movement path of the person being monitored. The identification unit 133 may identify the path of the person being monitored that moves toward the reference point of the monitored area W as the movement path of the person being monitored.

[0043] In this case, the identification unit 133 may identify multiple positions of the monitored person based on the monitoring data, and identify attributes of the movement route of the monitored person based on the relationship between the identified multiple positions of the monitored person and the reference point. The attribute of the movement route of the monitored person is, for example, information for identifying whether the movement of the monitored person is toward or away from the reference point. The identification unit 133, for example, compares a first distance from the first position to the reference point with a second distance from the second position to the reference point, and identifies the attribute of the movement route of the monitored person depending on whether the first distance is longer or shorter than the second distance.

[0044] Fig. 3 is a diagram that illustrates a process for identifying a movement route of a monitored person. Fig. 3(a) shows an example of a state in which the monitored person is approaching point C, which is a reference point. In Fig. 3(a), position L1 is a first position, and position L2 is a second position. In this case, since the second distance from position L2 to point C is shorter than the first distance from position L1 to point C, the identification unit 133 identifies, as an attribute of the movement route of the monitored person, an attribute that indicates that the movement of the monitored person is a movement approaching the reference point.

[0045] Fig. 3(b) shows an example of a state in which the monitored person is moving away from point C, which is a reference point. In Fig. 3(b), position L3 is a first position, and position L4 is a second position. In this case, the second distance from position L4 to point C is longer than the first distance from position L3 to point C, so the identification unit 133 identifies, as an attribute of the movement route of the monitored person, an attribute indicating that the movement of the monitored person is moving away from the reference point.

[0046] If the person being monitored is a thief, it is considered that the person being monitored will return to his / her vehicle after obtaining the object to be stolen in the monitored area W. Therefore, the information processing device 1 may identify the route traveled by the person being monitored after he / she has acquired the object as the travel route of the person being monitored. Specifically, the information processing device 1 identifies the travel route of the person being monitored after he / she has acquired the object by executing the following two steps.

[0047] As a first step, the detection unit 132 further detects an object held by the person to be monitored as a subject. For example, information indicating objects that may be stolen in the monitored area W is predefined in the information processing device 1, and the detection unit 132 detects the object held by the person to be monitored when the object held by the person to be monitored is the predefined object.

[0048] As a second step, the identification unit 133 identifies a path along which the monitored person moves away from a reference point in the monitored area W after the detection unit 132 detects an object held by the monitored person as the moving path of the monitored person. For example, first, when the detection unit 132 detects an object held by the monitored person, the identification unit 133 identifies a first position and a second position at a predetermined interval (for example, every second, every 10 seconds, every minute, etc.). Each time the identification unit 133 identifies the first position and the second position, the identification unit 133 compares a first distance corresponding to the first point with a second distance corresponding to the second position, and determines whether the second distance is longer than the first distance. Then, when the identification unit 133 determines that the second distance is longer than the first distance, the identification unit 133 identifies the first position corresponding to the first distance and the second position corresponding to the second distance as the moving path of the monitored person, and identifies an attribute indicating that the movement of the monitored person is moving away from the reference point as an attribute of the moving path of the monitored person.

[0049] In the above, an example has been described in which the information processing device 1 identifies the movement route of the monitoring target person based on a predetermined reference point, but the present invention is not limited to this. For example, the information processing device 1 may identify the movement route of the monitoring target person based on a reference point set according to the behavior of the monitoring target person. Specifically, the information processing device 1 identifies the movement route of the monitoring target person based on the reference point set according to the behavior of the monitoring target person by executing the following two steps.

[0050] As a first step, the setting unit 134 sets a reference point of the monitoring target area W based on the behavior of the monitoring target person identified based on the monitoring data. For example, first, the setting unit 134 identifies the movement state of the monitoring target person based on the monitoring data. Note that the identification unit 133 may identify the movement state of the monitoring target person. Then, when the setting unit 134 identifies a movement state indicating that the monitoring target person has not moved (stayed) for a predetermined period (e.g., 1 minute, 5 minutes, 10 minutes, etc.), it sets the position of the monitoring target person who stayed as the reference point of the monitoring target area W.

[0051] The setting unit 134 may take the behavior of the monitored person holding an object as the behavior of the monitored person, and set the position of the monitored person at the time when the detection unit 132 detects the object held by the monitored person as the reference point of the monitored area W. When the setting unit 134 is unable to set the reference point of the monitored area W based on the behavior of the monitored person until a predetermined period (e.g., 5 minutes, 30 minutes, 60 minutes, etc.) has elapsed from the time when the detection unit 132 detected the monitored person (e.g., when the monitored person does not stay for the predetermined period, when the monitored person does not hold the object, etc.), the setting unit 134 may set the center point of the monitored area W as the reference point.

[0052] As a second step, the identification unit 133 identifies the movement route of the person to be monitored based on the reference points of the area W to be monitored set by the setting unit 134. In this manner, the information processing device 1 can identify the movement route of the person to be monitored based on the reference points of the area W to be monitored set according to the behavior of the person to be monitored.

[0053] The information processing device 1 may further specify the movement route of the person to be monitored by using information other than the monitoring data. For example, one or more detection sensors that detect people, such as a human presence sensor, are installed in the area W to be monitored.

[0054] In this case, first, the acquisition unit 131 acquires information indicating that the detection sensor has detected a person. Then, the identification unit 133 identifies the movement route of the person to be monitored based on the position where the detection sensor is installed, the time when the detection sensor detected the person, the position of the person to be monitored identified by the monitoring data, and the time when the person to be monitored is present at the position of the person to be monitored.

[0055] Fig. 4 is a diagram showing a schematic diagram of a process for identifying a moving route of a person to be monitored. In the example shown in Fig. 4, the sensor E (sensors E1, E2, E3) is a detection sensor, and the position L5 is the position of the person to be monitored at the time when the detection unit 132 detects the person to be monitored. In the example shown in Fig. 4, it is assumed that the person to be monitored is detected at the position L5 after the sensor E1 detects the person.

[0056] In this case, first, the identification unit 133 identifies the movement route of the monitored person by determining the position where the sensor E1 that detected the person at a time earlier than the time when the detection unit 132 detected the person is installed as the first position, and the position L5 as the second position. Then, the identification unit 133 identifies an attribute indicating that the movement of the monitored person is a movement approaching a reference point as an attribute of the movement route of the monitored person based on the first distance corresponding to the first position and the second distance corresponding to the second position. In this way, the information processing device 1 can improve the accuracy of identifying the movement route of the monitored person.

[0057] In the above, an example has been described in which the identification unit 133 identifies the movement route of a detected person as a monitoring target person, but this is not limiting. For example, when there is a passageway through which people pass in the monitoring target area W, it is desirable to exclude passersby from the monitoring target. In this regard, the information processing device 1 may identify the movement route of a person determined to be a monitoring target person as a monitoring target. Specifically, the information processing device 1 identifies the movement route of a person determined to be a monitoring target person as a monitoring target person by executing the following two steps.

[0058] As a first step, the person determination unit 135 determines whether or not to monitor the person detected by the detection unit 132. Specifically, the person determination unit 135 determines whether or not to monitor the person based on the behavior of the person identified based on the monitoring data.

[0059] For example, first, the person determination unit 135 identifies the movement state of the detected person as human behavior. Then, when the person determination unit 135 identifies a movement state indicating that the person is moving along a passage, it determines that the person is not a target of monitoring. In other words, when the person determination unit 135 identifies a movement state indicating that the person is moving along a passage, it determines that the person is a passerby passing through the area W to be monitored. On the other hand, when the person determination unit 135 identifies a movement state indicating that the person is not moving along a passage (for example, a state in which the person is wandering around the passage, a state in which the person is stopped in the passage for a predetermined period of time, etc.), it determines that the person is a target of monitoring. In other words, when the person determination unit 135 identifies a movement state indicating that the person is not moving along a passage, it determines that the person is not a passerby passing through the area W to be monitored.

[0060] The person determination unit 135 determines whether or not to make a person identified based on the surveillance data a target of surveillance based on whether or not the person is a related person of the surveillance target area W. A related person of the surveillance target area W is, for example, a user (a manager of the surveillance target area W) etc. For example, the storage unit 12 stores information for identifying the face of a person related to the surveillance target area W in advance.

[0061] In this case, the person determination unit 135 compares the face of the detected person with the face of a person registered in advance, and if it determines that the detected person is a person registered in advance, it determines that the person is not a target of monitoring. On the other hand, if the person determination unit 135 determines that the detected person is not a person registered in advance, or if it cannot determine whether the detected person is a person registered in advance, it determines that the person is a target of monitoring.

[0062] Then, the identification unit 133 identifies the movement route of the person detected by the detection unit 132 and determined by the person determination unit 135 to be a target of monitoring as a monitoring target. In this manner, the information processing device 1 can reduce the occurrence of a situation in which a passerby or a related person in the monitoring target area W is targeted for monitoring.

[0063] The selection unit 136 selects one candidate parking area P from one or more candidate parking areas P that are predefined as candidates for parking areas in which to park a vehicle, based on the movement path of the monitoring target person identified by the identification unit 133. Specifically, the selection unit 136 refers to the information and map information related to the monitoring target area W stored in the storage unit 12, and selects one candidate parking area P that exists ahead of the movement path of the monitoring target person identified by the identification unit 133, from one or more candidate parking areas P. More specifically, the selection unit 136 refers to the information and map information related to the monitoring target area W stored in the storage unit 12, and selects one candidate parking area P that exists on the movement direction of the monitoring target person from the first position, from one or more candidate parking areas P.

[0064] For example, when there is no candidate parking area P in the movement direction of the monitoring subject identified by the identification unit 133, the selection unit 136 selects a candidate parking area P that exists in a direction close to the movement direction of the monitoring subject. For example, when the direction identified by the identification unit 133 is "north-south, east-west," the "direction close to the movement direction" is another direction adjacent to the movement direction of the monitoring subject (for example, when the movement direction is "northwest," "north-northwest" and "west-northwest," etc.). Also, for example, when the direction identified by the identification unit 133 is an azimuth angle, the "direction close to the movement direction" is within a predetermined threshold angle (for example, 5 degrees, 10 degrees, etc.) from the azimuth angle identified by the identification unit 133.

[0065] For example, if the attributes of the movement route of the monitored subject identified by the identification unit 133 indicate that the movement of the monitored subject is moving away from a reference point, the selection unit 136 selects, from one or more candidate parking areas P, a candidate parking area P that is located in the movement direction (movement direction) of the monitored subject on the movement route of the monitored subject identified by the identification unit 133.

[0066] FIG. 5 is a diagram showing a process of selecting a candidate parking area P. In FIG. 5, the position L6 is a first position, and the position L7 is a second position. In this case, the identification unit 133 first identifies the direction A1 indicating the direction of the position L7 when the position L6 is the starting point as the movement direction of the monitored person. In addition, since the second distance from the position L7 to the point C is longer than the first distance from the position L6 to the point C, the identification unit 133 identifies an attribute indicating that the movement of the monitored person is a movement away from the reference point as an attribute of the movement path of the monitored person. Then, since the attribute of the movement path of the monitored person indicates that the movement of the monitored person is a movement away from the reference point, the selection unit 136 selects the candidate parking area P1 existing in the direction A1 from the candidate parking areas P1, P2, and P3. In this way, the information processing device 1 can estimate the candidate parking area P where the probability that the monitored person's vehicle is present is high.

[0067] Also, for example, when an attribute of the movement route of the monitored person identified by the identification unit 133 indicates that the movement of the monitored person is moving toward a reference point, the selection unit 136 selects, from one or more candidate parking areas P, a candidate parking area P that is located in the opposite direction to the movement direction of the monitored person on the movement route of the monitored person identified by the identification unit 133.

[0068] FIG. 6 is a diagram showing a process of selecting a candidate parking area P. In FIG. 6, the position L8 is the first position, and the position L9 is the second position. In this case, the identification unit 133 first identifies the direction A2 indicating the direction of the position L9 when the position L8 is the starting point as the movement direction of the monitored person. In addition, since the second distance from the position L9 to the point C is shorter than the first distance from the position L8 to the point C, the identification unit 133 identifies an attribute indicating that the movement of the monitored person is a movement approaching a reference point as an attribute of the movement path of the monitored person. Then, since the attribute of the movement path of the monitored person indicates that the movement of the monitored person is a movement approaching a reference point, the selection unit 136 selects the candidate parking area P1 that exists in the opposite direction to the direction A2 from among the candidate parking areas P1, P2, and P3. In this way, the information processing device 1 can estimate the candidate parking area P that is highly likely to have the vehicle of the monitored person.

[0069] In the above, an example has been described in which the selection unit 136 selects a candidate parking area P that exists in the movement direction of the identified monitored person or in the direction opposite to the movement direction of the identified monitored person from one or more candidate parking areas P, but this is not limited to the above. For example, if the monitored area W is a complicated environment where linear movement is not possible due to obstacles such as trees and walls, the monitored person may turn in various directions, and the accuracy of estimating the area where the monitored person's vehicle is parked may decrease. Therefore, the information processing device 1 selects the candidate parking area P by selecting one candidate route from one or more candidate routes that are predetermined as routes to travel between the monitored area W and the candidate parking area P.

[0070] For example, the information processing device 1 predetermines, for each combination of a monitoring target area W and a candidate parking area P, one or more candidate routes that are candidates for a route between the monitoring target area W and the candidate parking area P. Note that the candidate route is not necessarily a well-maintained road connecting the monitoring target area W and the candidate parking area P. A line segment connecting an accessible area (e.g., a grassland or a forest) between the monitoring target area W and the candidate parking area P that cannot be said to be a well-maintained road may also be determined as a candidate route.

[0071] In this case, first, the selection unit 136 selects one candidate route from one or more candidate routes based on the movement route of the monitoring target person identified by the identification unit 133. For example, the selection unit 136 selects one candidate route that exists in the movement direction of the monitoring target person identified by the identification unit 133 or in the opposite direction to the movement direction of the monitoring target person identified by the identification unit 133 from the one or more candidate routes.

[0072] Then, the selection unit 136 selects one candidate parking area P from among one or more candidate parking areas P based on the selected route, which is the selected candidate route. Specifically, the selection unit 136 selects a candidate parking area P that exists on the selected route from among one or more candidate parking areas P. In this way, the information processing device 1 can improve the accuracy of estimating the area where the vehicle of the monitored person is parked.

[0073] The flying object control unit 137 moves the flying object D to the selected parking area, which is the candidate parking area selected by the selection unit 136, and causes the flying object D to search for a vehicle in the selected parking area. Specifically, first, the flying object control unit 137 transmits a search request to the flying object D. The search request is a request to search for a vehicle, and includes, for example, information indicating the selected parking area. Then, when the flying object D acquires the search request, it moves to the selected parking area specified by the information included in the search request, switches the mode from the monitoring mode to the search mode, and searches for a vehicle in the selected parking area.

[0074] When a vehicle is found in the selected parking area, the flying object control unit 137 causes the flying object D to execute a predetermined process. Specifically, the flying object control unit 137 executes the following four steps to cause the flying object D to execute a predetermined process for the found vehicle.

[0075] As a first step, the acquisition unit 131 acquires parking data as sensing data from the flying object D that has moved to the selected parking area. The parking data is data used to search for a vehicle in the selected parking area, and includes, for example, an image captured with the selected parking area as the imaging range.

[0076] As a second step, the detection unit 132 detects a subject included in the parking data based on the parking data acquired by the acquisition unit 131. The detection unit 132 detects a vehicle as a subject based on the parking data acquired by the acquisition unit 131, for example.

[0077] As a third step, when the detection unit 132 detects a vehicle, the vehicle determination unit 138 determines whether or not the detected vehicle is a vehicle of a person to be monitored based on the parking data. Specifically, first, the identification unit 133 identifies the state of the vehicle detected by the detection unit 132 based on the parking data acquired by the acquisition unit 131. Then, based on the state of the vehicle identified by the identification unit 133, the vehicle determination unit 138 determines whether or not the vehicle is a vehicle of a person to be monitored and is to be associated with the flying object D.

[0078] For example, if the engine of a vehicle is running, it is considered that the monitored person entered the monitored area W with the engine running so that he or she could quickly escape, so there is a high probability that such a vehicle is the monitored person's vehicle. Therefore, when the state of the identified vehicle indicates that the engine is running (for example, a state in which smoke such as exhaust gas is coming out of the muffler, a state in which the lights in front and behind the vehicle are turned on, etc.), the vehicle determination unit 138 determines that the vehicle is to be a target for association with the flying object D.

[0079] Also, for example, even if the engine of the vehicle is not running, the temperature of the vehicle is high for a while after the engine is turned off, so there is a high probability that such a vehicle is a vehicle of a monitored person. Therefore, when the identified vehicle state indicates that the temperature of the vehicle is high (for example, the engine part of the vehicle is hot, or the engine part of the vehicle is hotter than other parts of the vehicle, etc.), the vehicle determination unit 138 determines that the vehicle is to be a target for association with the flying object D.

[0080] Also, for example, in the case of theft, multiple people may share roles, such as the perpetrator and the driver, so a vehicle with a person on board is highly likely to be the vehicle of a person to be monitored. Therefore, when the state of the identified vehicle indicates that a person is on board, the vehicle determination unit 138 determines that the vehicle is to be a target for association with the flying object D.

[0081] Also, for example, if an object has already been stolen in the monitored area W, the object may be loaded on the bed of a vehicle such as a truck, so a vehicle with the object loaded on the bed is highly likely to be the vehicle of a person to be monitored. Therefore, the vehicle determination unit 138 may determine whether or not to make the vehicle a target for association with the flying object D based on the contents of the cargo of the vehicle, which is the state of the vehicle identified based on the parking data.

[0082] Specifically, first, the identification unit 133 identifies the presence or absence of an object in the loading platform of the vehicle based on the parking data acquired by the acquisition unit 131. For example, the information on the monitored area W further includes information indicating an object that may be a target of theft, and the identification unit 133 identifies whether or not an object exists in the loading platform of the vehicle by referring to the information indicating the object. Then, the vehicle determination unit 138 determines that the vehicle is to be a target to be associated with the flying object D when the identification unit 133 identifies the presence of the object.

[0083] As a fourth step, when the vehicle determination unit 138 determines that the vehicle is to be made a target for association with the flying object D, the flying object control unit 137 causes the flying object D to execute a predetermined process on the target vehicle that is determined by the vehicle determination unit 138 to be made a target for association with the flying object D. The predetermined process is a process that is determined in advance for the purpose of acquiring information for identifying a person to be monitored, reducing damage from theft, etc. Specifically, first, the flying object control unit 137 transmits a processing request to the flying object D to execute the predetermined process. Then, when the flying object D acquires the processing request from the information processing device 1, it executes the predetermined process based on the processing request.

[0084] The flying object control unit 137, for example, captures an image of the license plate of the target vehicle as a predetermined process. For example, when the flying object D acquires a processing request indicating to capture an image of the license plate of the target vehicle, the flying object D moves in front of or behind the target vehicle, captures an image of the target vehicle with a camera, and transmits the captured image to the information processing device 1. In this way, the information processing device 1 can obtain information for identifying the person to be monitored.

[0085] The flying object control unit 137 may execute a process for warning a target vehicle as the predetermined process. For example, when the flying object D acquires a process request indicating that a warning should be given to a target vehicle, the flying object D irradiates light toward the target vehicle or outputs a warning sound. In this way, the information processing device 1 can easily prevent the spread of theft damage.

[0086] The flying object control unit 137 may drop a transmitter from above the target vehicle as a predetermined process. For example, a transmitter is mounted on the flying object D, and when the flying object D acquires a processing request indicating dropping a transmitter, the flying object D moves to the air above the loading platform of the target vehicle and drops the transmitter. In this way, the information processing device 1 can track the target vehicle.

[0087] Here, when the monitored area W includes a candidate parking area P or when the monitored person enters the monitored area W by vehicle, the monitored person and the vehicle will be in the same place. Therefore, the information processing device 1 may control the flying object D in response to the detection of the person and the vehicle. Specifically, the information processing device 1 controls the flying object D in response to the detection of the person and the vehicle by executing the following three processes.

[0088] As a first step, the detection unit 132 further detects a vehicle as a subject based on the surveillance data. Specifically, the detection unit 132 detects both a person and a vehicle based on the surveillance data.

[0089] As a second step, when the detection unit 132 detects a vehicle based on the surveillance data including the monitored person, the vehicle determination unit 138 determines whether or not to make the vehicle a target to be associated with the flying object D based on the state of the vehicle identified based on the surveillance data.

[0090] As a third step, the flying object control unit 137 controls the flying object D according to the determination result of the vehicle determination unit 138. Specifically, when the vehicle determination unit 138 determines that the vehicle is to be a target for matching with the flying object D, the flying object control unit 137 does not cause the flying object D to search for the vehicle in the selected parking area, but causes the flying object D to execute a predetermined process on the target vehicle that is the vehicle determined by the vehicle determination unit 138 to be a target for matching with the flying object D. Note that when the vehicle determination unit 138 determines that the vehicle is to be a target for matching with the flying object D, the flying object control unit 137 may cause the flying object D to execute a predetermined process on the vehicle, regardless of whether the vehicle determination unit 138 has determined that the vehicle is to be a target for matching with the flying object D.

[0091] On the other hand, when the vehicle determination unit 138 determines that the vehicle is not to be associated with an air vehicle, the air vehicle control unit 137 causes the air vehicle D to search for the vehicle in the selected parking area. In this manner, the information processing device 1 can associate the vehicle with the air vehicle D depending on the state of the vehicle parked near the person to be monitored.

[0092] [Processing flow of information processing device 1] Next, a description will be given of the process flow of the information processing device 1. Fig. 7 is a flowchart showing the process flow of the information processing device 1. This process starts when the detection unit 132 executes a process of detecting a person based on the monitoring data acquired by the acquisition unit 131 (S1).

[0093] When the detection unit 132 does not detect a person based on the monitoring data acquired by the acquisition unit 131 (NO in S1), the process returns to S1. On the other hand, when the detection unit 132 detects a person based on the monitoring data acquired by the acquisition unit 131 (YES in S1), the person determination unit 135 determines whether or not to monitor the person based on the behavior of the person identified based on the monitoring data (S2).

[0094] When the person determination unit 135 determines that the detected person is not to be monitored (NO in S2), the process returns to S1. On the other hand, when the person determination unit 135 determines that the detected person is to be monitored (YES in S2), the identification unit 133 identifies the movement route of the monitored person based on the behavior of the monitored person identified based on the monitoring data (S3).

[0095] The selection unit 136 selects one candidate parking area P from among one or more candidate parking areas P based on the movement route of the monitored person identified by the identification unit 133 (S4). Then, the aircraft control unit 137 moves the aircraft D to the selected parking area, which is the candidate parking area selected by the selection unit 136, and causes the aircraft D to search for a vehicle in the selected parking area (S5).

[0096] [Effects of this embodiment] As described above, the information processing device 1 identifies the movement route of the monitored person based on the behavior of the monitored person detected in the monitored area, moves the aircraft to a selected parking area, which is a candidate parking area selected from one or more candidate parking areas based on the identified movement route of the monitored person, and has the aircraft search for the vehicle in the selected parking area.

[0097] In this way, the information processing device 1 can increase the probability of discovering the vehicle of the person to be monitored. This allows the information processing device 1 to obtain information on the vehicle discovered by the search of the flying object D. As a result, the information processing device 1 can obtain information with a high probability of identifying the person to be monitored.

[0098] Furthermore, this invention will make it possible to contribute to Goal 9 of the United Nations' Sustainable Development Goals (SDGs), which is to "build resilient infrastructure, promote industry, innovation and infrastructure."

[0099] Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments, and various modifications and changes are possible within the scope of the gist of the present invention. For example, all or part of the device can be configured by distributing or integrating functionally or physically in any unit. In addition, new embodiments resulting from any combination of multiple embodiments are also included in the embodiments of the present invention. The effect of the new embodiment resulting from the combination combines the effect of the original embodiment. [Explanation of symbols]

[0100] 1. Information processing device 11 Communications Department 12 Storage section 13 Control section 131 Acquisition Department 132 Detection unit 133 Specific section 134 Setting section 135 person judgment department 136 Selection Section 137 Aircraft Control Unit 138 Vehicle Judging Department A direction Point C D. Flying object E-Sensor H Intruder L position P Proposed parking area R pathway W Surveillance Area

Claims

1. a detection unit that detects a person based on monitoring data used to monitor a monitored area; an identification unit that, when the detection unit detects a person, identifies a movement route of the person to be monitored based on a behavior of the person to be monitored that is detected by the detection unit and identified based on the monitoring data; and A selection unit that selects one of one or more candidate parking areas that are previously determined as candidates for a parking area in which the vehicle is to be parked, based on the movement path identified by the identification unit; and An information processing device having the above configuration.

2. The identification unit identifies, as the movement path, a path along which the monitoring target person moves in a direction away from a reference point that is a reference point in the monitoring target area; The selection unit selects, from the one or more candidate parking areas, the candidate parking area that is present in the movement direction of the monitoring target person on the movement route identified by the identification unit. The information processing device according to claim 1 .

3. The detection unit further detects an object held by a person, the identification unit identifies, as the movement path, a path along which the monitoring subject moves in a direction away from a reference point in the monitoring area after the detection unit detects an object held by the monitoring subject; The information processing device according to claim 2 .

4. The identification unit identifies, as the movement path, a path along which the monitoring target person moves in a direction approaching a reference point that is a reference point in the monitoring target area; The selection unit selects, from the one or more candidate parking areas, the candidate parking area that is located in a direction opposite to the movement direction of the monitoring target person on the movement route identified by the identification unit. The information processing device according to claim 1 .

5. The information processing device further includes a setting unit that sets a reference point of the monitoring target area based on a behavior of the monitoring target person identified based on the monitoring data, The identification unit identifies the travel route based on a reference point of the monitoring target area set by the setting unit. The information processing device according to claim 2 .

6. The information processing device further includes an acquisition unit that acquires information indicating that a sensor installed in the monitoring area has detected a person, the identification unit identifies the movement route based on a position where the sensor is disposed, a time when the sensor detects a person, a position of the person to be monitored identified by the monitoring data, and a time when the person to be monitored is present at the position of the person to be monitored; The information processing device according to claim 1 .

7. In the information processing device, for each combination of the monitoring target area and the candidate parking area, one or more candidate routes that are candidates for a route between the monitoring target area and the candidate parking area are previously determined, the selection unit selects one of the one or more candidate routes based on the travel route identified by the identification unit, and selects one of the one or more candidate parking areas based on a selected route that is the selected candidate route; The information processing device according to claim 1 .

8. The detection unit detects a vehicle based on parking data captured by the aircraft in a selected parking area, which is the candidate parking area selected by the selection unit, The information processing device further includes a vehicle determination unit that, when the detection unit detects a vehicle, determines whether or not to make the vehicle a target for association with the flying object based on a state of the vehicle identified based on the parking data. The information processing device according to claim 1 .

9. The vehicle determination unit determines whether or not the vehicle is to be associated with the flying object based on the cargo content of the vehicle, as a state of the vehicle identified based on the parking data. The information processing device according to claim 8.

10. The detection unit further detects a vehicle based on the monitoring data, The information processing device further includes a vehicle determination unit that, when the detection unit detects a vehicle based on the monitoring data including the monitored person, determines whether or not to make the vehicle a target for association with an air vehicle based on a state of the vehicle identified based on the monitoring data. The information processing device according to claim 1 .

11. The computer executes detecting a person based on the surveillance data used to monitor the monitored area; When a person is detected, a step of identifying a movement route of the monitored person based on a behavior of the monitored person identified based on the monitoring data; selecting one candidate parking area from among one or more candidate parking areas that are predefined as candidates for parking the vehicle based on the identified travel route; An information processing method comprising the steps of:

12. Computer, a detection unit that detects a person based on monitoring data used to monitor a monitored area; an identification unit that, when the detection unit detects a person, identifies a movement route of the person to be monitored based on a behavior of the person to be monitored that is detected by the detection unit and identified based on the monitoring data; and a selection unit that selects one of one or more candidate parking areas that are predetermined as candidates for a parking area in which the vehicle is to be parked, based on the movement route identified by the identification unit; A program to function as a

Images