Information processing device, information processing system, information processing method, and program

Abstract

To realize new surveillance technology. [Solution] The information processing device disclosed here comprises an acquisition unit, a detection unit, and a monitoring control unit. The acquisition unit acquires surveillance camera images taken within a monitoring area. The detection unit detects a person who meets the monitoring start conditions as a monitoring target within the surveillance camera image. When a monitoring target is detected, the monitoring control unit selects a mobile body from among a plurality of mobile bodies that are autonomously mobile and have a shooting function to monitor the monitoring target, and causes the selected mobile body to perform the monitoring of the monitoring target.

Description

Technical Field

[0001] This disclosure relates to an information processing apparatus, an information processing system, an information processing method, and a program.

Background Art

[0002] The technology related to this disclosure is disclosed in Patent Document 1. When the technology disclosed in Patent Document 1 detects that an intruder has entered the monitoring area using an infrared sensor or the like, it selects an enlargement camera from among a plurality of monitoring cameras installed at a position for photographing the monitoring area. Then, the technology zooms in on the selected enlargement camera toward the face of the intruder and records an enlarged image of the intruder's face.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] According to the technology disclosed in Patent Document 1, an intruder detected in the monitoring area can be photographed and recorded. However, this technology cannot photograph an intruder who has moved outside the monitoring area. Since the technology disclosed in such Patent Document 1 cannot continue to monitor an intruder who has moved outside the monitoring area, the detected intruder can escape.

[0005] An example of the object of this disclosure is to provide a new monitoring technology.

Means for Solving the Problems

[0006] According to one aspect of this disclosure, an acquisition means for acquiring a monitoring camera image photographed within a monitoring area, A detection means for detecting a person who meets the monitoring start conditions as a target within the aforementioned surveillance camera image, When the target to be monitored is detected, the monitoring control means selects a mobile body from among a plurality of mobile bodies that are autonomously mobile and have a shooting function to monitor the target to be monitored, and causes the selected mobile body to perform the monitoring of the target to be monitored. An information processing device having the following is provided.

[0007] Furthermore, according to one aspect of this disclosure, An information processing system is provided, comprising the aforementioned information processing device and a mobile body that is autonomously mobile and has a shooting function.

[0008] Furthermore, according to one aspect of this disclosure, One or more computers, We acquire surveillance camera images taken within the surveillance area. Within the aforementioned surveillance camera image, a person who meets the surveillance start conditions is detected as a target for surveillance. When the target to be monitored is detected, an information processing method is provided which selects a mobile body from among a plurality of mobile bodies that are autonomously mobile and have a shooting function to monitor the target to be monitored, and causes the selected mobile body to perform the monitoring of the target to be monitored.

[0009] Furthermore, according to one aspect of this disclosure, Computers, A means for acquiring surveillance camera images taken within a surveillance area. A detection means for detecting a person who meets the monitoring start conditions as a target within the aforementioned surveillance camera image, When the target to be monitored is detected, a monitoring control means selects a mobile body from among a plurality of mobile bodies that are autonomously mobile and have a shooting function to monitor the target to be monitored, and causes the selected mobile body to perform the monitoring of the target to be monitored. A program is provided to enable it to function as such. [Effects of the Invention]

[0010] According to this example of disclosure, new surveillance technologies will be realized.

Brief Description of the Drawings

[0011] [Figure 1] FIG. 1 is a diagram showing an example of a functional block diagram of an information processing apparatus. [Figure 2] FIG. 2 is a flowchart showing an example of the processing flow of an information processing apparatus. [Figure 3] FIG. 3 is a diagram for explaining an example of the overall view of an information processing system. [Figure 4] FIG. 4 is a diagram showing an example of the hardware configuration of an information processing apparatus. [Figure 5] FIG. 5 is a diagram schematically showing an example of the information processed by an information processing apparatus. [Figure 6] FIG. 6 is a diagram for explaining an example of the processing executed by an information processing apparatus. [Figure 7] FIG. 7 is a flowchart showing another example of the processing flow of an information processing apparatus. [Figure 8] FIG. 8 is a flowchart showing another example of the processing flow of an information processing apparatus. [Figure 9] FIG. 9 is a diagram for explaining another example of the processing executed by an information processing apparatus. [Figure 10] FIG. 10 is a diagram for explaining another example of the processing executed by an information processing apparatus. [Figure 11] FIG. 11 is a diagram for explaining another example of the processing executed by an information processing apparatus. [Figure 12] FIG. 12 is a diagram for explaining another example of the processing executed by an information processing apparatus. [Figure 13] FIG. 13 is a diagram for explaining another example of the processing executed by an information processing apparatus. [Figure 14] FIG. 14 is a diagram for explaining another example of the processing executed by an information processing apparatus. [Figure 15] FIG. 15 is a diagram for explaining another example of the processing executed by an information processing apparatus. [Figure 16]Figure 16 shows an example of information output by an information processing device. [Figure 17] Figure 17 shows another example of information output by an information processing device. [Figure 18] Figure 18 shows an example of information output by an information processing device. [Figure 19] Figure 19 shows another example of information output by an information processing device. [Figure 20] Figure 20 shows another example of information output by an information processing device. [Modes for carrying out the invention]

[0012] The embodiments of this disclosure will be described below with reference to the drawings. In this disclosure, the drawings are associated with one or more embodiments. In all drawings, similar components are denoted by the same reference numerals, and their descriptions are omitted where appropriate.

[0013] <<First Embodiment>> Figure 1 is a functional block diagram showing an overview of the information processing device 10. Figure 2 is a flowchart showing an example of the processing flow executed by the information processing device 10.

[0014] As shown in Figure 1, the information processing device 10 includes an acquisition unit 11, a detection unit 12, and a monitoring and control unit 13. These functional units execute the processes shown in the flowchart of Figure 2.

[0015] In S10, the acquisition unit 11 acquires surveillance camera images taken within the monitoring area. In S11, the detection unit 12 detects a person who meets the monitoring start conditions within the surveillance camera image as a target for monitoring. In S12, when the monitoring control unit 13 detects a target to be monitored in S11, it selects a mobile body from among a plurality of mobile bodies that are autonomously mobile and have a shooting function to monitor the target, and instructs the selected mobile body to perform the monitoring of the target.

[0016] In this way, when the information processing device 10 detects a person (target of surveillance) that meets the conditions for starting surveillance, it causes a "mobile body that is autonomously mobile and has a shooting function" to perform surveillance on that target. The mobile body that monitors the target of surveillance is autonomously mobile. Therefore, the mobile body can track a moving target of surveillance and continue to photograph the target of surveillance. Furthermore, the mobile body can track a target of surveillance that has moved outside the surveillance area and continue to photograph the target of surveillance. With such an information processing device 10, it is possible to suppress the inconvenience of interruptions in surveillance of a target due to the target's movement or the target moving outside the surveillance area.

[0017] <<Second Embodiment>> <Overview> The information processing device 10 of the second embodiment is a concrete implementation of the configuration of the information processing device 10 of the first embodiment.

[0018] There are many individuals who need protection, such as people who could become targets of crime (stalking, bullying, etc.), politicians, and celebrities. However, the number of people available to provide protection (police officers, security guards, bodyguards, etc.) is limited. Therefore, it is difficult to constantly station people around all individuals who need protection and maintain continuous security. The information processing device 10 can be used, for example, to assist in such protection efforts.

[0019] An example of the overall structure and overview of the processing performed by the information processing device 10 will be explained using Figure 3. As shown in the figure, the information processing device 10 can perform predetermined processing in cooperation with the camera C and the mobile device 20. The information processing system may be configured by the information processing device 10 and the mobile device 20. This information processing system may further include the camera C.

[0020] The information processing device 10 determines the surveillance area 3 based on the current location of the person to be protected 1 and acquires surveillance camera images taken in the surveillance area 3. For example, the information processing device 10 acquires surveillance camera images taken by camera C installed in the surveillance area 3. The information processing device 10 and camera C may be connected to each other via a communication network 4 such as the Internet.

[0021] Next, the information processing device 10 detects a person who meets the monitoring start conditions in the surveillance camera image as the monitoring target 2. Upon detecting the monitoring target 2, the information processing device 10 selects a mobile device 20 to monitor the monitoring target 2 and instructs the selected mobile device 20 to perform the monitoring of the monitoring target 2. The mobile device 20, having started monitoring the monitoring target 2, tracks the monitoring target 2 and photographs it. The mobile device 20 can continue to track and photograph the monitoring target 2 not only while the monitoring target 2 is inside the monitoring area 3, but also after the monitoring target 2 has left the monitoring area 3.

[0022] In Figure 3, one mobile device 20 monitors one monitored target 2, but multiple mobile devices 20 may monitor one monitored target 2. The information processing device 10 and the mobile devices 20 may be connected to each other via a communication network 4 such as the Internet.

[0023] The configuration of the information processing device 10 will be described in detail below.

[0024] <Hardware Configuration> First, an example of the hardware configuration of the information processing device 10 will be described. Each functional unit of the information processing device 10 is realized by any combination of hardware and software. Those skilled in the art will understand that there are various variations in the implementation method and the device. The software includes programs that are pre-installed at the time of shipment of the device, as well as programs downloaded from recording media such as CDs (Compact Discs) or from servers on the Internet.

[0025] Figure 4 is a block diagram illustrating the hardware configuration of the information processing device 10. As shown in Figure 4, the information processing device 10 includes a processor 1A, memory 2A, input / output interface 3A, peripheral circuitry 4A, and bus 5A. Peripheral circuitry 4A includes various modules. The information processing device 10 does not necessarily have peripheral circuitry 4A. The information processing device 10 may also be composed of multiple physically and / or logically separated devices. In this case, each of the multiple devices may have the above hardware configuration.

[0026] Bus 5A is a data transmission path for the processor 1A, memory 2A, peripheral circuits 4A, and input / output interface 3A to send and receive data to and from each other. Processor 1A is a processing unit such as a CPU (Central Processing Unit) or GPU (Graphics Processing Unit). Memory 2A is a memory such as RAM (Random Access Memory) or ROM (Read Only Memory). Input / output interface 3A includes interfaces for acquiring information from input devices, external devices, external servers, external sensors, cameras, etc., and interfaces for outputting information to output devices, external devices, external servers, etc. Input / output interface 3A also includes interfaces for connecting to communication networks such as the Internet. Input devices include, for example, keyboards, mice, microphones, physical buttons, touch panels, etc. Output devices include, for example, displays, projectors, speakers, printers, mailers, etc. Processor 1A can issue commands to each module and perform calculations based on their calculation results.

[0027] <Functional Configuration> Next, the functional configuration of the information processing device 10 will be described in detail. Figure 1 is an example of a functional block diagram of the information processing device 10. As shown in the figure, the information processing device 10 has an acquisition unit 11, a detection unit 12, and a monitoring and control unit 13.

[0028] The acquisition unit 11 identifies the current location of the person to be protected 1 and determines the surveillance area 3 based on the current location of the person to be protected 1. The acquisition unit 11 then acquires surveillance camera images taken within the determined surveillance area 3.

[0029] "Person under Protection 1" is the object of protection. Person under Protection 1 can be a person, an animal, or an object (including natural and artificial objects). Person under Protection 1 is registered in advance on the list of persons under Protection. For example, a person who could be a target of crime (such as stalking or bullying), a politician, a celebrity, or a valuable object may be registered on the list as Person under Protection 1.

[0030] The "Security Target List" is a list of Security Target 1. Various information about Security Target 1 is registered in the Security Target List.

[0031] Figure 5 schematically shows an example of a list of persons to be protected. The list of persons to be protected shown includes identification information of the person to be protected, a photograph of their appearance, location-related information, and information on persons of interest. The list of persons to be protected may also include other information. For example, the list of persons to be protected may include the name, age, gender, etc. of person to be protected 1. Other information that the list of persons to be protected may include will be explained below as appropriate.

[0032] "Security target identification information" is information that allows multiple security targets to identify each other.

[0033] "Exterior photographs" are photographs of the exterior of the person to be protected (Person 1). For example, photographs of a person's face or photographs of the main parts of an object may also be used.

[0034] "Location-related information" is information used to determine the current location of the person to be protected 1. For example, location-related information may be identification information of a terminal carried by person to be protected 1 (or a terminal attached to person to be protected 1). Examples of terminals include, but are not limited to, tags or devices equipped with positioning and communication functions to measure current location. Examples of devices equipped with positioning and communication functions include, but are not limited to, smartphones, tablet terminals, mobile phones, personal computers, wearable devices, portable game consoles, etc. Examples of positioning functions include, but are not limited to, satellite-based positioning (GPS (global positioning system) function, GNSS (global navigation satellite system) function, etc.), and various positioning functions can be used.

[0035] Location-related information may also include information that describes features appearing in the appearance of the person to be protected 1. Examples of such information include, but are not limited to, facial information, gender, age group, nationality, build, gait, clothing, possessions, and feature point information extracted from photographs of the person to be protected 1. Furthermore, if the person to be protected 1 is an object other than a person, examples of such information include, but are not limited to, the type of object, color, pattern, and feature point information extracted from photographs of the person to be protected 1. For example, by using such information to detect the person to be protected 1 from images taken at various locations, the location of the person to be protected 1 can be determined.

[0036] "Information on persons of interest" refers to information about individuals who require special attention in the protection of each protected person (person of interest). For example, if a stalking victim is protected person (person of interest), the stalker or suspect will be considered a person of interest. Also, if a politician or celebrity is protected person (person of interest), individuals who are found to have a special relationship with each protected person (person of interest) through prior investigation and who are judged to be capable of dangerous actions against each protected person (person of interest) will be considered a person of interest. For example, members of groups that engage in extremist activities such as demonstrations, members of designated organized crime groups, and members of designated religious corporations may be registered as persons of interest.

[0037] Information on persons of interest may include the person's appearance (e.g., facial photograph), name, age, gender, and location-related information. Location-related information is used to identify the person of interest's current location and is the same information as the location-related information for Person 1 under Protection described above.

[0038] Here, we will explain the process by which the acquisition unit 11 identifies the current location of the person to be protected 1.

[0039] The acquisition unit 11 can determine the current location of each security target 1 by using the location-related information of each security target 1 registered in the security target list described above. The current location of each security target 1 may change over time. Therefore, the acquisition unit 11 can repeatedly perform the process of determining the current location of each security target 1 to determine the latest current location. The current location is indicated by, for example, latitude and longitude information, but is not limited to this.

[0040] For example, the acquisition unit 11 may acquire information indicating the current location of each protected target 1 from a terminal possessed by each protected target 1 (or a terminal attached to each protected target 1). When a terminal possessed by a protected target 1 (or a terminal attached to each protected target 1) determines its current location using its positioning function, it transmits positioning information, including information indicating the determined current location and identification information of its terminal, to the information processing device 10. A terminal possessed by a protected target 1 (or a terminal attached to each protected target 1) can transmit information to the information processing device 10 via a communication network 4, such as the Internet. The acquisition unit 11 identifies the current location of the terminal indicated by the positioning information received from the terminal possessed by each protected target 1 (or a terminal attached to each protected target 1) as the current location of each protected target 1.

[0041] As another example, the acquisition unit 11 can acquire images taken at various locations in real time. For example, the acquisition unit 11 may acquire images generated by surveillance cameras installed at various locations (on the street, inside a facility, etc.). In addition, it may acquire images generated by cameras installed on mobile objects (cars, motorcycles, aircraft, etc.). The information processing device 10 can acquire images generated by these cameras via a communication network 4 such as the Internet.

[0042] The image is associated with information indicating the shooting location. For example, the image tag information may contain information indicating the shooting location. Alternatively, information indicating the installation location of each surveillance camera may be generated in advance and stored in a predetermined storage device. The predetermined storage device may be located within the information processing device 10, or it may be located in an external device that is communicatively connected to the information processing device 10. The same premise regarding the predetermined storage device applies below. The acquisition unit 11 can then identify the current location of each security target 1 by detecting the security target 1 from the image through a matching process (such as facial recognition) using information indicating the characteristics that appear in the appearance of each security target 1 registered in the security target list. In this example, the acquisition unit 11 identifies the shooting location of the image in which the security target 1 was detected as the current location of the security target 1.

[0043] Next, we will explain the process by which the acquisition unit 11 determines the monitoring area 3 based on the current location of the person to be protected 1.

[0044] A rule for determining the surveillance area 3 based on the current location of the protected object 1 (hereinafter sometimes referred to as the "surveillance area determination rule") is defined in advance and stored in a predetermined memory device. The surveillance area determination rule defines the size of the surveillance area 3, the shape of the surveillance area 3, and the relative positional relationship between the current location of the protected object 1 and the surveillance area 3. For example, the surveillance area determination rule may stipulate that the surveillance area 3 is the area within a circle of a predetermined radius centered on the current location of the protected object 1. The acquisition unit 11 determines the surveillance area 3 based on this surveillance area determination rule and the current location of the protected object 1.

[0045] Furthermore, the surveillance area determination rules may define rules that specify multiple areas as surveillance area 3. The acquisition unit 11 may then determine multiple surveillance areas 3 for one person (or one object) to be protected 1 based on the surveillance area determination rules. The distances from the protected object 1 to the multiple surveillance areas 3 may differ. In this case, the importance of surveillance in each surveillance area 3 will differ from one another.

[0046] For example, a surveillance area determination rule may be defined that identifies multiple surveillance areas 3-1 to 3-3, as shown in Figure 6. In this surveillance area determination rule, the area within a circle with radius R1 centered on the current position of the person under protection 1 is determined as surveillance area 3-1. In addition, the area within a circle with radius R2 centered on the current position of the person under protection 1, excluding surveillance area 3-1, is determined as surveillance area 3-2. In addition, the area within a circle with radius R3 centered on the current position of the person under protection 1, excluding surveillance areas 3-1 and 3-2, is determined as surveillance area 3-3. Note that the example in Figure 6 is just one example and is not limited thereto. The number of surveillance areas 3 may be 3 as shown in the figure, or it may be any other number.

[0047] Furthermore, the surveillance area determination rule may be defined for each protected object 1. In this case, at least one of the following can be customized for each protected object 1: the size of the surveillance area 3, the shape of the surveillance area 3, the relative positional relationship between the current position of the protected object 1 and the surveillance area 3, and the number of surveillance areas 3. If the surveillance area determination rule defines the surveillance area 3 as a circle with a predetermined radius centered on the current position of the protected object 1, the size of the radius may differ for each protected object 1. Also, if the surveillance area determination rule specifies multiple surveillance areas 3, the number of surveillance areas 3 may differ for each protected object 1. Furthermore, if the surveillance area determination rule specifies multiple surveillance areas 3, the size (e.g., radius) and shape of each of the multiple surveillance areas 3 may differ for each protected object 1. The operator of the information processing device 10 can, in advance, determine the content of the surveillance area determination rule suitable for each protected object 1, taking into consideration the importance and content of the protection of each protected object 1, and store it in a predetermined storage device.

[0048] Furthermore, multiple surveillance area determination rules may be defined for each protected target 1. In this case, the usage conditions for each surveillance area determination rule are defined in advance. The usage conditions are defined by the date and time, day of the week, time of day, area where protected target 1 is located, etc. An example of a condition might be "September 1, 2024 to September 8, 2024", "Protected target 1 is located within the area of ​​facility XX", "Friday and Saturday from 8pm to 8am". For example, if the importance of protecting protected target 1 changes depending on the situation, surveillance area determination rules can be determined according to each situation, and the usage conditions (for each situation) for using each surveillance area determination rule can be defined. For example, under conditions where the importance of protection is relatively higher, each surveillance area determination rule can be defined with a relatively larger surveillance area 3.

[0049] For example, if there is an event (such as a lecture or speech) during a specified period in which a particular person under protection 1 will appear in public, the importance of protecting that person under protection 1 during that period will be higher than usual. Also, the importance of protecting a particular person under protection 1 will be higher on certain days of the week or at certain times of the day compared to other days of the week or at certain times. Furthermore, the importance of protecting a particular person under protection 1 will be higher in certain areas compared to other areas. Considering the importance of protecting each person under protection 1 in each situation, it is possible to define multiple surveillance area determination rules and the conditions for using each surveillance area determination rule.

[0050] Next, we will explain the process by which the acquisition unit 11 acquires surveillance camera images taken within the determined surveillance area 3.

[0051] "Surveillance camera images" are images taken within surveillance area 3. Surveillance camera images include people and other objects present within surveillance area 3.

[0052] In one example, the acquisition unit 11 can acquire images taken at various locations in real time. Then, the acquisition unit 11 can obtain surveillance camera images by extracting images taken within the surveillance area 3 from the acquired images.

[0053] For example, the acquisition unit 11 may acquire images generated by surveillance cameras installed in various locations (on the street, inside a facility, etc.). In addition, it may acquire images generated by cameras installed on mobile objects (cars, motorcycles, aircraft, etc.). The information processing device 10 can acquire images generated by these cameras via a communication network 4 such as the Internet.

[0054] The images are associated with information indicating the shooting location. For example, the image tag information may contain information indicating the shooting location. Alternatively, information indicating the installation location of each surveillance camera may be generated in advance and stored in a predetermined storage device. The acquisition unit 11 can acquire surveillance camera images by extracting images whose shooting location is within the surveillance area 3 from images taken at various locations.

[0055] In other examples, there may be a mobile security unit that tracks and continuously photographs security target 1. The acquisition unit 11 may then acquire the images taken by the mobile security unit as surveillance camera images. The images taken by the mobile security unit that tracks and photographs security target 1 will be images taken within the surveillance area 3.

[0056] The mobile unit for protecting targets is autonomously mobile and has a camera function. The mobile unit tracks "target 1" and photographs target 1 or its surroundings. In contrast, the mobile unit 20, whose outline is explained using Figure 3, tracks "target 2" and photographs target 2. In this respect, the mobile unit for protecting targets and mobile unit 20 differ.

[0057] The mobile device used for security purposes may be, for example, an aerial vehicle (such as a drone or flying car), or a mobile device that moves on land, in water, or on water. The mobile device used for security purposes may also have the capability to be remotely controlled by a remote controller.

[0058] The mobile device for protecting the target has a camera that performs a shooting function. The camera may generate still images or moving images. The camera may detect visible light and create images, or it may detect other electromagnetic waves such as infrared light and create images. The camera may be a monocular camera or a stereo camera.

[0059] "Acquisition" includes at least one of the following: the device retrieving data or information stored in another device or storage medium (active acquisition), and the device inputting data or information output from another device into its own device (passive acquisition). Examples of active acquisition include making a request to another device and receiving a reply, and accessing and reading data from another device or storage medium. Examples of passive acquisition include receiving information that is delivered (or transmitted, push notification, etc.). Furthermore, acquisition may also involve selecting and acquiring data or information from among the received data or information, or selecting and receiving data or information that has been delivered.

[0060] Returning to Figure 1, the detection unit 12 detects individuals who meet the monitoring start conditions within the surveillance camera image acquired by the acquisition unit 11 as subjects for monitoring.

[0061] The "surveillance initiation conditions" are that the individual is registered on the blacklist and is located within surveillance area 3. Other examples of surveillance initiation conditions are described in the following embodiment. A blacklist is created for each protected individual. The "person of interest information" explained using Figure 5 is the blacklist.

[0062] For example, the detection unit 12 can perform a process to detect individuals registered on the blacklist of each protected target 1 from surveillance camera images taken within the surveillance area 3 of each protected target 1. The surveillance camera images are images taken within the surveillance area 3. Individuals detected in such surveillance camera images can be determined to be present within the surveillance area 3. The detection unit 12 can detect individuals of concern from the surveillance camera images by performing a matching process (such as facial recognition) using information (location-related information) that indicates the characteristics of individuals of concern that are registered in advance.

[0063] As a variation, the detection unit 12 may determine whether a person of interest is within the monitoring area 3 based on the current location of the terminal possessed by the person of interest. In this case, the terminal possessed by the person of interest uses its positioning function to determine its current location and transmits positioning information, including information indicating the determined current location and identification information of the terminal, to the information processing device 10. The terminal possessed by the person of interest can transmit information to the information processing device 10 via a communication network 4, such as the internet. The detection unit 12 identifies the current location of the terminal indicated by the positioning information received from the terminal possessed by the person of interest as the current location of the person of interest.

[0064] In this modified case, the detection unit 12 may extract images taken at or near the current location of a person of interest identified based on the positioning information from surveillance camera images taken within the surveillance area 3 of each protected object 1. The detection unit 12 may then perform a process to detect the person of interest from the extracted images. The detection unit 12 can detect the person of interest from the surveillance camera images by matching them using pre-registered information indicating the characteristics of the person of interest's appearance (location-related information) (such as facial recognition).

[0065] As mentioned above, multiple surveillance areas 3 (e.g., surveillance areas 3-1 to 3-3 in Figure 6) may be determined for a single person (or one object) to be protected. In this case, being registered on a blacklist and being present in a predetermined portion of the multiple surveillance areas 3 may be conditions for starting surveillance. For example, in the example in Figure 6, being registered on a blacklist and being present in surveillance area 3-1 of the three surveillance areas 3-1 to 3-3 may be conditions for starting surveillance.

[0066] In addition, being on the blacklist and existing in one of the multiple monitoring areas 3 may also be conditions for starting monitoring. For example, in the example in Figure 6, being on the blacklist and existing in one of the three monitoring areas 3-1 to 3-3 may be conditions for starting monitoring.

[0067] Returning to Figure 1, when the monitoring control unit 13 detects the target to be monitored 2, it selects a mobile body 20 from among a plurality of mobile bodies 20 that are autonomously mobile and have a shooting function to monitor the target to be monitored 2. The monitoring control unit 13 then instructs the selected mobile body 20 to perform the monitoring of the target to be monitored 2.

[0068] The "mobile unit 20" is capable of autonomous movement and has a shooting function. The mobile unit 20 also has a communication function that allows it to communicate with the information processing device 10 via a communication network 4 such as the Internet. The mobile unit 20 also has a positioning function that measures its current location. The positioning function is exemplified by satellite-based positioning (GPS function, GNSS function, etc.), but is not limited to this, and various positioning functions can be employed. The mobile unit 20 may also have a function to measure the remaining battery level.

[0069] The mobile unit 20 may be, for example, an aerial vehicle (such as a drone or a flying car), or a mobile unit that moves on land, in water, or on water. The mobile unit 20 may also have the function of being remotely controlled by a remote controller.

[0070] The mobile device 20 has a camera that performs a shooting function. The camera may generate still images or moving images. The camera may detect visible light and create images, or it may detect other electromagnetic waves such as infrared rays and create images. The camera may be a monocular camera or a stereo camera.

[0071] Information on multiple mobile bodies 20 controlled by the information processing device 10 is stored in a predetermined storage device in advance. The monitoring control unit 13 selects from among the multiple mobile bodies 20 to monitor the monitoring target 2 detected by the detection unit 12.

[0072] Multiple mobile units 20 may all have the same performance, or they may have different performance characteristics. For example, among the multiple mobile units 20, there may be mobile units 20 with different camera functions (angle of view, number of pixels, etc.). Also, among the multiple mobile units 20, there may be mobile units 20 with different movement functions. For example, among the multiple mobile units 20, there may be mobile units 20 that fly in the air and mobile units 20 that move on land. Also, among the multiple mobile units 20, there may be mobile units 20 with different maximum movement speeds.

[0073] Furthermore, among the multiple mobile bodies 20, there may be mobile bodies 20 having special functions and mobile bodies 20 that do not have such special functions. The special function may be, for example, a function to capture the target being monitored 2. Specifically, the mobile body 20 may be equipped with an arm and have the function of capturing the target being monitored 2 with the arm. In addition, the mobile body 20 may have the function of launching a capture device (such as a net) towards the target being monitored 2. In addition, the mobile body 20 may have the function of launching a color ball towards the target being monitored 2. Note that the capture function exemplified here is merely an example and is not limited to these.

[0074] A predetermined storage device stores information about each of the multiple mobile units 20. For example, the predetermined storage device may store the above-mentioned functions of each of the multiple mobile units 20. An operator can store the above-mentioned functions of each of the multiple mobile units 20 in the predetermined storage device.

[0075] In addition, the predetermined storage device may store the current location and battery level of each of the multiple mobile units 20. The monitoring control unit 13 can repeatedly acquire information indicating the current location and battery level from each of the multiple mobile units 20. The monitoring control unit 13 can then store the information indicating the current location and battery level received from each of the multiple mobile units 20 in the predetermined storage device and update it to the latest values.

[0076] In addition, a predetermined storage device may store information indicating whether each of the multiple mobile units 20 is currently monitoring one of the monitoring targets 2. The monitoring control unit 13 can update this information based on the selection of the mobile units 20 to monitor the monitoring target 2. Furthermore, when the monitoring control unit 13 detects that monitoring by the mobile units 20 has ended, it can update this information accordingly. Details regarding the termination of monitoring by the mobile units 20 will be explained below.

[0077] The monitoring control unit 13 can select which mobile unit 20 to monitor the target 2 based on the information of each of the multiple mobile units 20 described above. The monitoring control unit 13 can select which mobile unit 20 to monitor the target 2 based on, for example, at least one of the following items. • Distance to monitored target 2 (prioritize selecting targets with relatively smaller distances) • Battery level (prioritizes selecting batteries with relatively high battery levels) • Whether or not any of the monitored targets 2 are currently being monitored (prioritize selecting those that are not currently being monitored 2). • Functions (Prioritize selecting functions that are appropriate for the situation)

[0078] Here, we will explain an example of the process of selecting a mobile unit 20 to monitor the target 2 based on the functions of the mobile unit 20. In this example, as described above, multiple monitoring areas 3 (e.g., monitoring areas 3-1 to 3-3 in Figure 6) are determined corresponding to one person (or one object) to be protected 1. In this case, the functions of the mobile units 20 to be selected for each of the multiple monitoring areas 3 may be determined in advance and stored in a predetermined storage device. Also, the functions of the mobile units 20 to be selected when the target 2 is not in a monitoring area 3 may be determined in advance and stored in a predetermined storage device. The monitoring control unit 13 then identifies the area where the target 2 is located (one of the multiple monitoring areas 3, or outside of monitoring area 3), and then determines the "function of the mobile unit 20 to be selected" corresponding to the identified area. The monitoring control unit 13 then selects a mobile unit 20 having the determined function. For example, in areas close to the target 1, such as monitoring area 3-1 (see Figure 6), the alert level is high. Therefore, if the target of monitoring 2 is located in the monitoring area 3-1, a mobile device 20 with a capture function, a mobile device 20 with a higher-performance camera function (e.g., high pixel count), or a mobile device 20 with a higher maximum movement speed may be selected. Below, other examples of the process of selecting a mobile device 20 to monitor the target of monitoring 2 based on the functions of the mobile device 20 will be explained.

[0079] The monitoring control unit 13 may select one mobile body 20 for each monitored person 2, or it may select multiple mobile bodies 20. The process by which the monitoring control unit 13 determines the number of mobile bodies 20 to select will be described below.

[0080] For example, the operator may pre-determine the alert level for each of several persons of interest and store it in a predetermined memory device. Alternatively, the operator may pre-determine the relationship between the alert level and the number of mobile units 20 to be selected and store information indicating this relationship in a predetermined memory device. Based on this information, the monitoring control unit 13 may identify the alert level of the detected monitoring target 2 and determine the number of mobile units 20 to monitor the detected monitoring target 2. The monitoring control unit 13 selects more mobile units 20 for persons of interest (monitoring targets 2) with higher alert levels.

[0081] In addition, the monitoring control unit 13 may determine the number of mobile bodies 20 to select based on the functions of the mobile bodies 20. For example, the monitoring control unit 13 may determine the number of mobile bodies 20 to select such that the sum of the field of view angles of the selected mobile bodies 20 is equal to or greater than a threshold (360°).

[0082] In addition, the monitoring control unit 13 may determine the number of mobile units 20 to select depending on which of the multiple monitoring areas 3 (e.g., monitoring areas 3-1 to 3-3 in Figure 6) the monitored object 2 is located in. In this case, the operator may pre-determine the number of mobile units 20 to select for each of the multiple monitoring areas 3 and store information indicating this determination in a predetermined storage device. The operator may also pre-determine the number of mobile units 20 to select when the monitored object 2 is not located in a monitoring area 3 and store this information in a predetermined storage device. Then, after identifying the area where the monitored object 2 is located (either one of the multiple monitoring areas 3 or outside of monitoring area 3), the monitoring control unit 13 determines the "number of mobile units 20 to select" corresponding to the identified area. In this case, the monitoring control unit 13 can dynamically change the number of mobile units 20 to monitor the monitored object 2 depending on which area the monitored object 2 is located in.

[0083] For example, in areas close to the protected object 1, such as surveillance area 3-1 (see Figure 6), the alert level will be higher. Therefore, the surveillance control unit 13 may select more mobile units 20 if the protected object 2 is located in surveillance area 3-1. Furthermore, the surveillance control unit 13 may determine a smaller number of mobile units 20 as the distance between the protected object 1 and the protected object 2 increases.

[0084] The monitoring control unit 13 transmits information about the monitored object 2 to the selected mobile device 20. For example, the monitoring control unit 13 transmits to the mobile device 20 an image of the monitored object 2, information indicating the features that appear on the surface of the monitored object 2, and information indicating the current location of the monitored object 2.

[0085] The mobile device 20 detects the target of surveillance 2 based on the received information and begins monitoring the target of surveillance 2. For example, the mobile device 20 moves toward the current location of the target of surveillance 2. The mobile device 20 then detects the target of surveillance 2 from images captured by its own camera function, using images of the target of surveillance 2's appearance or information indicating features that appear on the target of surveillance 2's appearance. The mobile device 20 then tracks the detected target of surveillance 2 and continues to photograph it. Tracking of the target of surveillance 2 by the mobile device 20 can be achieved using widely known technologies.

[0086] Furthermore, when multiple mobile units 20 monitor one person (or one object) to be protected 1, the multiple mobile units 20 may form a predetermined formation to track the object to be protected 1. For example, the multiple mobile units 20 may form a circle or any other formation. In addition, the multiple mobile units 20 may include those forming a predetermined formation such as a circle and those approaching the object to be protected 1. For example, a mobile unit 20 with a tracking function may be the mobile unit 20 that approaches the object to be protected 1.

[0087] Next, an example of the processing flow of the information processing device 10 will be explained using the flowcharts in Figures 7 and 8. The purpose here is simply to explain the processing flow. Details of each process have been described above, so explanations will be omitted here as appropriate. Also, while there may be multiple protected targets 1, here we will explain the processing flow for a single protected target 1.

[0088] As shown in Figure 7, first, the information processing device 10 identifies the current location of the person to be protected 1 (S20). Then, based on the current location of the person to be protected 1 identified in S20, the information processing device 10 determines the surveillance area 3 (S21). Next, the information processing device 10 acquires surveillance camera images taken within the surveillance area 3 determined in S21 (S22).

[0089] Subsequently, the information processing device 10 detects a person (surveillance target 2) who meets the monitoring start conditions (surveillance target 2) in the surveillance camera image acquired in S22 (S23). If surveillance target 2 is detected (Yes in S23), the information processing device 10 starts the monitoring process for the detected surveillance target 2 (S24). That is, the information processing device 10 starts the flow shown in Figure 8. The flow in Figure 8 will be described later. After the information processing device 10 starts the monitoring process for the detected surveillance target 2 (flow shown in Figure 8), if there is no instruction to terminate the process (No in S25), it returns to S20 and repeats the process.

[0090] If the monitored target 2 is not detected (No. in S23), or if there is no instruction to terminate the process (No. in S25), the information processing device 10 returns to S20 and repeats the process.

[0091] Note that the current location of the monitored object 2 may change over time. Therefore, if the information processing device 10 returns to S20 and repeats the process, it re-determines the current location of the protected object 1 (S20) and re-determines the monitoring area 3 (S21). Then, the information processing device 10 acquires surveillance camera images taken within the newly determined monitoring area 3 (S22) and detects the monitored object within those surveillance camera images (S23).

[0092] Next, using the flowchart in Figure 8, we will explain an example of the "monitoring process for detected monitoring target 2" that starts at S24 in Figure 7.

[0093] The information processing device 10 selects a mobile body 20 from among a plurality of pre-registered mobile bodies 20 that will monitor the monitored target 2 detected in S22 of Figure 7 (S30). Next, the information processing device 10 instructs the mobile body 20 selected in S30 to perform monitoring of the monitored target 2 detected in S22 of Figure 7 (S31). Subsequently, if the monitoring termination condition is met (Yes in S32), the information processing device 10 terminates the monitoring of the monitored target 2 by the mobile body 20 (S33). For example, the information processing device 10 sends a monitoring termination instruction to the mobile body 20 in response to the fulfillment of the monitoring termination condition. The monitoring termination condition will be described in detail in the following embodiment.

[0094] <Effects and Effects> According to the information processing device 10 of the second embodiment, the same effects and advantages as those of the information processing device 10 of the first embodiment can be achieved.

[0095] Furthermore, the information processing device 10 can determine a monitoring area 3 for each protected target 1 and detect the monitored target 2 within the monitoring area 3 determined for each protected target 1. With such an information processing device 10, instead of detecting the monitored target 2 in the entire area designated as monitoring area 3, it is possible to detect the monitored target 2 in the area surrounding where the protected target 1 is located, designated as monitoring area 3. With such an information processing device 10, the processing load on the computer can be reduced by narrowing the detection process to the appropriate and necessary areas.

[0096] Furthermore, the current location of the person to be protected 1 may change over time. Therefore, the area to be monitored may also change over time. Instead of pre-determining a predetermined area as the monitoring area 3, the information processing device 10 dynamically determines the monitoring area 3 based on the current location of the person to be protected 1. This allows for the appropriate determination of the area to be monitored as the monitoring area 3 even if the person to be protected 1 moves.

[0097] Furthermore, the information processing device 10 can change the size and shape of the monitoring area 3 for each protected target. The importance and content of security may differ for each protected target. By customizing the size and shape of the monitoring area 3 for each protected target, appropriate monitoring can be achieved according to the situation.

[0098] Furthermore, the information processing device 10 can detect individuals who are registered on the blacklist and are located within the monitoring area 3 as monitoring targets 2. For example, stalkers, suspects, and individuals judged to be capable of dangerous actions against each protected target 1 can be registered on the blacklist. As a result, it is possible to detect when stalkers or suspects are approaching stalking victims. It is also possible to detect when individuals judged to be capable of dangerous actions against each protected target 1 are approaching each protected target 1. Then, in response to the detection of a monitoring target 2, the information processing device 10 can cause the mobile unit 20 to perform monitoring of that monitoring target 2.

[0099] Furthermore, the information processing device 10 can determine / change the number of mobile bodies 20 that monitor the target 2, depending on the situation. For example, the information processing device 10 can determine / change the number of mobile bodies 20 that monitor the target 2, depending on the performance (angle of view) of the mobile bodies 20. Specifically, the information processing device 10 can determine the number of mobile bodies 20 to select so that the sum of the angles of view of the selected mobile bodies 20 is equal to or greater than a threshold (360°). With such an information processing device 10, it is possible to photograph an appropriate range and suppress the inconvenience of the target 2 being outside the shooting range.

[0100] Furthermore, the information processing device 10 can determine / change the number of mobile units 20 that monitor the monitored target 2 according to the alert level of the monitored target 2. Specifically, the information processing device 10 can determine a relatively large number of mobile units 20 to monitor the monitored target 2 when the alert level is relatively high. Also, the information processing device 10 can determine / change the number of mobile units 20 to monitor the monitored target 2 according to the current location of the monitored target 2. Specifically, the information processing device 10 can determine a relatively large number of mobile units 20 to monitor the monitored target 2 when the distance between the monitored target 2 and the protected target 1 is relatively small. With such an information processing device 10, by selecting an appropriate number of mobile units 20 according to the situation, limited resources (mobile units 20) can be used effectively.

[0101] Furthermore, the information processing device 10 can select a mobile body 20 having predetermined performance characteristics depending on the situation. For example, when the surveillance target 2 is located near the security target 1 and the alert level is high, the information processing device 10 can select a mobile body 20 with a capture function, a mobile body 20 with a more advanced camera function, or a mobile body 20 with a higher maximum movement speed. With such an information processing device 10, multiple mobile bodies 20 with different performance characteristics can be effectively utilized by selecting the appropriate mobile body 20 for the situation.

[0102] <<Third Embodiment>> The information processing device 10 of the third embodiment differs from the information processing device 10 of the second embodiment in the content of the monitoring initiation conditions. The information processing device 10 of the third embodiment detects individuals who are registered on a blacklist and who meet the criteria for determining that their tendency to approach the security target 1 is deteriorating, as the security target 2. This will be explained in detail below.

[0103] Figure 1 is an example of a functional block diagram of the information processing device 10. As shown in the figure, the information processing device 10 has an acquisition unit 11, a detection unit 12, and a monitoring and control unit 13.

[0104] The detection unit 12 detects a person who meets the monitoring start conditions in the surveillance camera image as the monitoring target 2.

[0105] The "conditions for initiating surveillance" are that the individual is registered on the blacklist and meets the criteria for determining that their tendency to approach Person 1 has worsened. A blacklist is created for each Person 1 under Protection. The "person of interest information" explained using Figure 5 is the blacklist.

[0106] Here, we will explain an example of a process that determines that the tendency to approach is worsening.

[0107] The detection unit 12 can perform at least one of the following: a process to determine whether the criteria for determining a worsening approach trend are met based on the current location history for the day, and a process to determine whether the criteria for determining a worsening approach trend are met based on the current location history for the past few days. Each of these will be explained below.

[0108] ○ A process to determine whether the criteria for a worsening approach trend are met, based on the history of the current location on that day. First, the detection unit 12 repeatedly acquires information indicating the current location of each person of interest registered on the blacklist and stores it in a predetermined storage device as a history of current locations. In the history of the current locations of persons of interest, information indicating the location of the person of interest (e.g., latitude and longitude information) is linked to the time when they were at that location. Based on the location-related information of the person of interest, the detection unit 12 can identify the current location of the person of interest. For example, the detection unit 12 may acquire information indicating the current location from a terminal carried by the person of interest. Alternatively, the detection unit 12 may identify the current location of a person of interest by detecting them in images taken in various locations. These processes are as described in the second embodiment.

[0109] Furthermore, the detection unit 12 can repeatedly identify the current location of the protected object 1 using the means described in the second embodiment, and store the identification result as a history of the protected object 1's current location in a predetermined storage device. In the history of the protected object 1's current location, information indicating the location of the protected object 1 (e.g., latitude and longitude information) is linked to the time when the object was at that location.

[0110] The detection unit 12 can then determine whether the criteria for determining that the tendency to approach has worsened are met, based on the history of the current location of the person of interest on that day and the history of the current location of the person to be protected 1 on that day.

[0111] For example, the detection unit 12 can calculate the distance between the current location history of the person under protection 1 and the current location history of the person of interest (hereinafter sometimes referred to as the "proximity distance"). The calculated proximity distance may be a straight-line distance or the distance of the shortest route along the road. The detection unit 12 can calculate the proximity distance history by calculating the proximity distance for each of multiple time points. Based on this proximity distance history, the detection unit 12 can then determine whether the criteria for determining that the tendency of the person of interest to approach the person under protection 1 is worsening are met.

[0112] For example, the detection unit 12 may determine that the criteria for determining that the approach tendency has worsened are met if at least one of the following criteria 1 to 5 is met. (Criterion 1) The proximity distance has decreased over time during the most recent specified period. (Criterion 2) The proximity distance has remained below the threshold for the most recent specified period of time. (Criterion 3) The proximity distance has remained below the threshold for the most recent specified period of time, and the proximity distance has decreased over time. (Criterion 4) Over the most recent specified period, the average approach speed per unit time is increasing with the passage of time. (Criterion 5) The average approach speed in the most recent unit time is faster than the average speed in the immediately preceding unit time, and the difference is greater than the threshold.

[0113] The "predetermined time," "unit time," "approach distance threshold," and "difference threshold" are predetermined. The difference threshold may be defined by speed or by the rate of change. The "average approach speed" can be calculated, for example, by dividing the difference between the approach distance at the start of the unit time and the approach distance at the end of the unit time by the unit time.

[0114] ○ A process to determine whether the criteria for a worsening approach trend are met, based on the current location history over the past few days. The detection unit 12 calculates the history of the distance (proximity distance) between the current location of the person to be protected 1 and the current location of the person of interest, in the same manner as described above, and stores not only the history for the day but also past history in a predetermined storage device.

[0115] Furthermore, the detection unit 12 may determine that the criteria for determining a worsening approach tendency have been met if at least one of the following criteria 6 to 12 is met.

[0116] (Criterion 6) The time taken for the approach distance to decrease from the first value to the second value tends to decrease day by day for a predetermined number of consecutive days (this may include a period during which the current value remains unchanged) (see Figures 9(A) to (D)). (Criterion 7) The maximum approach distance each day (the minimum approach distance each day) tends to decrease day by day for a predetermined number of consecutive days (this may include a period in which the current distance remains unchanged) (see Figures 10(A) to (D)). (Criterion 8) The number of days (time interval) between the day on which the proximity distance reaches the second value and the day on which it next reaches the second value tends to decrease with each passing day for a predetermined number of consecutive days (this may include a period during which the distance remains unchanged) (see Figures 11(A) to (D)). (Criterion 9) The length of time during which the proximity distance remains below the third value (e.g., the length of time spent within monitoring area 3) tends to increase day by day for a predetermined number of consecutive days (this may include periods during which the status quo is maintained) (see Figures 12(A) to (D)). (Criterion 10) The duration for which the proximity distance remains below the fourth value (a value sufficiently smaller than the third value) tends to increase day by day for a predetermined number of consecutive days (this may include periods where the distance remains unchanged) (see Figures 13(A) to (D)). (Criterion 11) The number of times the proximity distance is less than or equal to the 5th value tends to increase day by day for a predetermined number of consecutive days (this may include periods where the status remains unchanged) (see Figures 14(A) to (D)). (Criterion 12) The number of persons of concern whose proximity distance is 6th or less tends to increase day by day for a specified number of consecutive days (this may include a period during which the situation remains unchanged) (see Figures 15(A) to (D)).

[0117] The "specified number of days" and the "first to sixth values" are predetermined. The first to sixth values ​​may include the same value amongst themselves.

[0118] The detection unit 12 can detect a person who meets the above-described monitoring start conditions within the surveillance camera image as the monitoring target 2.

[0119] Other components of the information processing device 10 can be the same as those in the first and second embodiments. Furthermore, the configuration of other components such as the mobile body 20 that cooperates with the information processing device 10 can be the same as those in the first and second embodiments.

[0120] The information processing device 10 of the third embodiment can achieve the same effects as the information processing device 10 of the first and second embodiments. Furthermore, the information processing device 10 can detect a surveillance target 2 that is registered on a blacklist and meets the criteria for determining that its tendency to approach the security target 1 is deteriorating, and can start monitoring that surveillance target 2. With such an information processing device 10, it is possible to appropriately detect a surveillance target 2 that is being monitored by a mobile device 20. As a result, it is possible to suppress the inconvenience of unnecessarily deploying the mobile device 20 to monitor the surveillance target 2, and the inconvenience of not deploying the mobile device 20 when necessary.

[0121] <<Fourth Embodiment>> The information processing device 10 of the fourth embodiment differs from the information processing device 10 of the second and third embodiments in the content of the monitoring start conditions. The information processing device 10 of the fourth embodiment detects a person who has performed a predefined dangerous behavior within the monitoring area 3 as the monitoring target 2. This will be explained in detail below.

[0122] Figure 1 is an example of a functional block diagram of the information processing device 10. As shown in the figure, the information processing device 10 has an acquisition unit 11, a detection unit 12, and a monitoring and control unit 13.

[0123] The detection unit 12 detects a person who meets the monitoring start conditions in the surveillance camera image as the monitoring target 2.

[0124] The "monitoring initiation condition" is the occurrence of a predefined risky behavior within monitoring area 3.

[0125] "Dangerous behavior" is any behavior that could endanger or potentially endanger the person under protection 1, and may include at least one of the following: • The act of holding a predefined dangerous object (such as a knife, bat, stun gun, or other weapon). Extortion - Assault (e.g., pulling on the body of person under protection, leaning over person under protection, punching person under protection, kicking person under protection, removing person under protection's clothes) • Theft (e.g., stealing the belongings of person under protection and running away) • Taking someone into a car (e.g., taking person 1 into a car) • Predefined dangerous facial expressions (e.g., expressions indicating intent to attack, suppressed anger, angry while thinking, expressions indicating loss of reason)

[0126] The detection unit 12 can use image analysis technology to detect individuals who have engaged in the aforementioned dangerous behaviors within the surveillance camera images as surveillance targets 2. It should be noted that the targets detected here are not limited to individuals registered on the blacklist; all individuals present in the surveillance camera images are subject to detection. In other words, the detection unit 12 processes all individuals detected within the surveillance camera images to determine whether they have engaged in the aforementioned dangerous behaviors.

[0127] A variety of technologies can be used to determine whether a detected person is engaging in dangerous behavior. For example, the detection unit 12 may use an estimation model (classifier, etc.) that has been previously trained on images of people engaging in dangerous behavior as training images to determine whether a person detected in the surveillance camera image is engaging in the aforementioned dangerous behavior.

[0128] Other components of the information processing device 10 can be the same as those in the first to third embodiments. Furthermore, the configuration of other components such as the mobile body 20 that cooperates with the information processing device 10 can be the same as those in the first and third embodiments.

[0129] The information processing device 10 of the fourth embodiment can achieve the same effects as the information processing device 10 of the first to third embodiments. Furthermore, the information processing device 10 can detect individuals who have performed predefined risky behavior within the monitoring area 3 as monitoring targets 2 and start monitoring those monitoring targets 2. With such an information processing device 10, individuals who are not pre-registered on the blacklist can also be appropriately detected as monitoring targets 2 and monitoring can be started. As a result, more comprehensive monitoring is achieved.

[0130] <<Fifth Embodiment>> The information processing device 10 of the fifth embodiment differs from the information processing device 10 of the second to fourth embodiments in the content of the monitoring start conditions. The information processing device 10 of the fifth embodiment detects the monitoring target 2 by adopting a plurality of the monitoring start conditions described in the second to fourth embodiments. This will be explained in detail below.

[0131] Figure 1 is an example of a functional block diagram of the information processing device 10. As shown in the figure, the information processing device 10 has an acquisition unit 11, a detection unit 12, and a monitoring and control unit 13.

[0132] The detection unit 12 detects a person who meets the monitoring start conditions in the surveillance camera image as the monitoring target 2.

[0133] The "monitoring start condition" is at least one, or more, of the following. Note that each monitoring start condition has been explained in the second to fourth embodiments, so its explanation is omitted here. • Registered on the blacklist and located within monitoring area 3, • The individual is on the blacklist and meets the criteria for a worsening tendency to approach the person being protected. • Performed a predefined risky behavior within monitoring area 3.

[0134] In the fifth embodiment, a plurality of monitoring start conditions as described above are defined in advance. The detection unit 12 then detects a monitoring target 2 that satisfies any of the monitoring start conditions.

[0135] When the monitoring control unit 13 detects a monitored object 2 that satisfies any of the monitoring start conditions, it selects a mobile body 20 from among several mobile bodies 20 having different performance characteristics to monitor that monitored object 2. The monitoring control unit 13 decides which mobile body 20 to select based on the content of the monitoring start conditions that the monitored object 2 satisfies.

[0136] For example, if a monitored subject 2 that has performed a predefined dangerous behavior within the monitoring area 3 is detected, the alert level will be higher than in other cases. Therefore, when such a monitored subject 2 is detected, the monitoring control unit 13 may select a mobile body 20 with a capture function, a mobile body 20 with a higher-performance camera function, a mobile body 20 with a higher maximum movement speed, etc. When selecting multiple mobile bodies 20, the monitoring control unit 13 may select at least one mobile body 20 with a capture function, a mobile body 20 with a higher-performance camera function, a mobile body 20 with a higher maximum movement speed, etc.

[0137] Other components of the information processing device 10 can be the same as those in the first to fourth embodiments. Furthermore, the configuration of other components such as the mobile body 20 that cooperates with the information processing device 10 can be the same as those in the first and fourth embodiments.

[0138] The information processing device 10 of the fifth embodiment can achieve the same effects as the information processing device 10 of the first to fourth embodiments. Furthermore, the information processing device 10 can detect the monitored target 2 by defining multiple monitoring start conditions. By using monitoring start conditions with various contents, it is possible to detect the monitored target 2 to be monitored without omission and with high accuracy.

[0139] Furthermore, the information processing device 10 can select a mobile body 20 having predetermined performance characteristics according to the content of the monitoring start conditions that the detected monitoring target 2 satisfies. For example, if the information processing device 10 detects a monitoring target 2 that has performed a predefined dangerous action within the monitoring area 3, it can select a mobile body 20 with a capture function, a mobile body 20 with a higher-performance camera function, or a mobile body 20 with a higher maximum movement speed. With such an information processing device 10, multiple mobile bodies 20 with different performance characteristics can be effectively utilized by selecting the appropriate mobile body 20 for the appropriate situation.

[0140] <<Sixth Embodiment>> The information processing device 10 of the sixth embodiment has a function to notify a predetermined notification target when the mobile device 20 starts monitoring the monitored target 2. This will be described in detail below.

[0141] Figure 1 is an example of a functional block diagram of the information processing device 10. As shown in the figure, the information processing device 10 has an acquisition unit 11, a detection unit 12, and a monitoring and control unit 13.

[0142] When the monitoring control unit 13 instructs the mobile unit 20 to perform monitoring of the monitored object 2, it notifies a designated notification recipient of that fact. The monitoring control unit 13 may also notify the notification recipient of other information. For example, the notification may include the current locations of the protected object 1 and the monitored object 2, photographs of the protected object 1 and the monitored object 2, and the names, ages, and genders of the protected object 1 and the monitored object 2. The notification may also indicate the monitoring start conditions that the monitored object 2 has met. The notification may also indicate the current location of the mobile unit 20. The notification may also indicate images (e.g., live images) taken by the mobile unit 20.

[0143] The "notification targets" may be registered in advance. For each protected object 1, notification targets may be registered in advance. For example, the contact information of notification targets may be stored in advance in a predetermined storage device. The monitoring control unit 13 can identify notification targets and their contact information based on this information. The monitoring control unit 13 can then use the identified contact information to send notifications to the notification targets. Examples of notification targets include, but are not limited to, the teams, organizations, groups, or individuals that provide security for each protected object 1.

[0144] In addition, the monitoring control unit 13 may identify notification targets based on the current location of the detected monitoring target 2. For example, the monitoring control unit 13 may extract notification target candidates that are within a predetermined distance from the current location of monitoring target 2 from among a plurality of pre-registered notification target candidates. Monitoring target 2 may then identify the extracted notification target candidates as notification targets. Notification target candidates are teams, organizations, groups, individuals, etc. that guard each security target 1. The monitoring control unit 13 can extract notification target candidates that are within a predetermined distance from the current location of the detected monitoring target 2 based on the location of the teams, organizations, or groups that guard each security target 1, the current location of the individuals guarding each security target 1, etc. The above locations may be stored in a predetermined storage device in advance. Furthermore, the above current location may be determined using the same method as for determining the current location of security target 1 and monitoring target 2.

[0145] Note that the current location of monitored object 2 may change. Therefore, the monitoring control unit 13 may repeatedly extract notification target candidates that are within a predetermined distance from the current location of monitored object 2, and select the notification target candidates extracted each time as notification targets.

[0146] The notification may be delivered via a dedicated application or software installed on the device operated by the recipient. That is, the notification may be delivered on the application or software's webpage. Alternatively, the notification may be delivered via push notification from the application or software. Furthermore, the notification may also be delivered by other means, such as email or text message.

[0147] Here is an example of a screen displayed on the notification target terminal. The monitoring control unit 13 can generate this screen and send it to the notification target terminal for display.

[0148] Figures 16(A) to (C) show the detection results for persons of interest A and B, who are registered on the blacklist. The screens in Figures 16(A) to (C) are the screens before persons of interest A and B are detected as surveillance targets 2, that is, before the mobile device 20 starts monitoring persons of interest A and B. Incidentally, the conditions for starting monitoring in this example are "being registered on the blacklist and being located within the surveillance area 3-1".

[0149] The screen in Figure 16(A) shows the relative positions of the protected person 1 and the persons of interest A and B detected within the surveillance area 3-3 by mapping these marks onto a map. The screen in Figure 16(A) also shows the distance between protected person 1 and persons of interest A and B. Although not shown, in the screen in Figure 16(A), information (marks) of persons of interest whose distance from protected person 1 is within a threshold may be highlighted. Examples of highlighting include, but are not limited to, displaying in a predetermined color, flashing, or in bold.

[0150] When a predetermined operation is performed while the screen shown in Figure 16(A) is displayed, the screen shown in Figure 16(D) is displayed. The screen in Figure 16(D) shows the date and time when the state shown in Figure 16(A) was detected, and a list of detected persons of interest. The list of detected persons of interest shows the distance between the protected person 1 and each of the detected persons of interest A and B. The list is arranged in descending order of the distance between persons of interest A and B. In this list, information on persons of interest whose distance from the protected person 1 is within a threshold may be highlighted. Examples of highlighting include displaying in a predetermined color, flashing, or in bold, but are not limited to these.

[0151] The screen in Figure 16(B) is displayed after the screen in Figure 16(A). The screen in Figure 16(B) shows the positional relationship and distance between the protected person 1 and the persons of interest A and B, respectively, using the same method as the screen in Figure 16(A). When a predetermined operation is performed while the screen in Figure 16(B) is displayed, the screen in Figure 16(E) is displayed. The screen in Figure 16(E) shows the same content using the same method as the screen in Figure 16(D).

[0152] The screen in Figure 16(C) is displayed after the screen in Figure 16(B). The screen in Figure 16(C) shows the positional relationship and distance between the protected person 1 and the persons of interest A and B, respectively, using the same method as the screens in Figures 16(A) and (B). When a predetermined operation is performed while the screen in Figure 16(C) is displayed, the screen in Figure 16(F) is displayed. The screen in Figure 16(F) shows the same content as the screen in Figure 16(D), using the same method.

[0153] Let's assume that immediately after the screen shown in Figure 16(C), it is detected that person of interest A is present within the monitoring area 3-1. In this case, the warning screen shown in Figure 17(A) is displayed in response to the detection. The warning screen in Figure 17(A) shows the positional relationship and distance between the protected object 1 and persons of interest A and B, respectively, using the same method as the screens in Figures 16(A) to (C). The warning screen in Figure 17(A) indicates that person of interest A has been detected as the monitored object 2. For example, the warning screen in Figure 17(A) may emit a warning sound, or the screen light may flash or illuminate in a predetermined color. Although not shown, the warning screen in Figure 17(A) may also display warning text information such as "Warning".

[0154] The warning screen in Figure 17(A) displays an appearance photograph of person A, who has been detected as surveillance target 2, in the upper left corner of the screen. The warning screen in Figure 17(A) also shows the movement trajectory of person A, who has been detected as surveillance target 2. If a predetermined operation is performed while the warning screen in Figure 17(A) is displayed, the screen in Figure 17(B) will be displayed. The screen in Figure 17(B) displays the same content as the screen in Figure 16(D) using the same method.

[0155] Figures 16 and 17 show an example of the screen content when a person of concern is detected as surveillance target 2, meeting the surveillance initiation condition of "being on the blacklist and located within surveillance area 3-1". Next, Figures 18 and 19 show an example of the screen content for another example. The surveillance initiation conditions for this example are "being on the blacklist and located within surveillance area 3-1" and "having performed a predefined dangerous behavior within surveillance area 3-1".

[0156] Figure 18(A) shows the relative positions of Person 1 under Protection 1 and Person B, who was detected within Surveillance Area 3-3, by mapping these marks onto a map. Person B is a person of interest who was previously registered on a blacklist.

[0157] Furthermore, the screen in Figure 18(A) shows the distance between the person to be protected 1 and the person of interest B. When a predetermined operation is performed while the screen in Figure 18(A) is displayed, the screen in Figure 18(B) is displayed. The screen in Figure 18(B) shows the date and time when the condition shown in Figure 18(A) was detected, and a list of the detected persons of interest. The list of detected persons of interest shows the distance between the person to be protected 1 and the detected person of interest A. This list can be displayed in descending order of the distance between the persons of interest.

[0158] Let's assume that immediately after the screen shown in Figure 18(A), it is detected that person of interest B is present in monitoring area 3-1. Also, at the same time, let's assume that person C, who was not registered on the blacklist as a person of interest, is detected as monitored subject 2 for performing a predefined dangerous behavior in monitoring area 3. In this case, the warning screen shown in Figure 19(A) is displayed in response to this detection. The warning screen in Figure 19(A) shows the positional relationship and distance between protected subject 1 and persons of interest B and C, respectively, using the same method as the screen in Figure 18(A). The warning screen in Figure 19(A) indicates that persons of interest B and C have been detected as monitored subject 2. For example, the warning screen in Figure 19(A) may emit a warning sound, or the screen light may flash or light up in a predetermined color. Although not shown, the warning screen in Figure 19(A) may also display warning text information such as "Warning".

[0159] The warning screen in Figure 19(A) displays photographs of the appearances of persons of interest B and C, who were detected as surveillance target 2, in the upper left corner of the screen. The warning screen in Figure 19(A) also shows the movement trajectory of person of interest B, who was detected as surveillance target 2. If a predetermined operation is performed while the warning screen in Figure 19(A) is displayed, the screen in Figure 19(B) will be displayed. The screen in Figure 19(B) displays the same content as the screen in Figure 18(B) using the same method.

[0160] Next, Figure 20 shows an example of a screen that appears after the warning screens in Figures 17 and 19. Figure 20(A) shows the warning screen in Figure 19(A). The notified person who has seen this warning screen can bring up the screen in Figure 20(B) by performing a predetermined operation on their terminal. The predetermined operation is, for example, touching the photo of monitored person 2 displayed in the upper left of Figure 20(A), but is not limited to this.

[0161] The screen in Figure 20(B) displays information about the selected monitoring target 2. For example, it shows an external photograph of the selected monitoring target 2 and the monitoring start conditions that the selected monitoring target 2 has met.

[0162] The recipient of the notification can input the action to be taken for monitored target 2 on the screen shown in Figure 20(B). For example, if the recipient is about to rush to the location of monitored target 2, they can touch the "Start rush" button. If the recipient needs to interrupt the rush after it has started, they can bring up the screen shown in Figure 20(C) and touch the "Interrupt rush" button.

[0163] Furthermore, if the person being notified arrests the target of surveillance after the response has begun, they can access the screen shown in Figure 20(D) and touch the "Arrest" button. Also, if the person being notified arrives at the location of the target of surveillance after the response has begun, they can access the screen shown in Figure 20(D) and touch the "Response Complete" button. For example, the person being notified can access the screen shown in Figure 20(D) by touching the "Register Action" button in Figures 20(B) and (C). Note that, according to the screen in Figure 20(B), it is possible to access the screen shown in Figure 20(D) by touching the "Register Action" button without touching the "Start Response" button, and then touch the "Arrest" button or the "Response Complete" button. With this configuration, a person being notified who forgets to touch the "Start Response" button at the start of the response can touch the "Arrest" button or the "Response Complete" button without touching the "Start Response" button. Furthermore, if a person who has been notified hears about the arrival or arrest of another notified person via radio or other means, they can touch the "Arrest" button or the "Arrest Complete" button on their behalf without having to touch the "Start Arrival" button themselves.

[0164] Furthermore, the content of the operations performed by the notified device via the screens shown in Figures 20(B) to (D) is transmitted from the notified device's terminal to the information processing device 10.

[0165] In the sixth embodiment, the notified person who receives the notification described above can rush to the location of the mobile body 20 that is tracking the monitored object 2. In this case, the mobile body 20 can terminate tracking the monitored object 2 in response to the notified person's arrival. For example, after notifying the notified person, the monitoring control unit 13 may terminate the monitoring of the monitored object 2 by the mobile body 20 in response to the distance between the notified person (a predetermined person) and the mobile body 20 falling within a threshold.

[0166] In this case, the monitoring control unit 13 identifies the current location of the notification target. The monitoring control unit 13 can identify the current location of the notification target using the same method as for identifying the current locations of the protected target 1 and the monitored target 2. The monitoring control unit 13 then calculates the distance between the identified current location of the notification target and the current location of the mobile object 20, and when the calculated distance falls within a threshold, it can send a tracking termination instruction to the mobile object 20. The distance calculated here may be the straight-line distance or the distance of the shortest route along the road.

[0167] In addition, if the person to be notified touches the "Arrest" button or the "Arrest Complete" button on a screen like the one shown in Figure 20(D), information indicating this may be sent to the information processing device 10. The monitoring control unit 13 may then send a tracking termination instruction to the mobile body 20 upon receiving this information.

[0168] In addition, if the mobile unit 20 detects more than a predetermined number of notification targets in the images captured by the mobile unit 20's shooting function, or if it detects more than a predetermined number of notification targets for a predetermined period of time or longer, the monitoring control unit 13 may send a tracking termination instruction to the mobile unit 20. In this example, information indicating the characteristics that appear in the appearance of the notification targets may be stored in a predetermined storage device beforehand. The monitoring control unit 13 can then detect the notification targets from the images by matching them using this information (such as facial recognition).

[0169] Upon receiving a tracking termination instruction, the mobile unit 20 may automatically return to a designated stop, for example.

[0170] Other components of the information processing device 10 can be the same as those in the first to fifth embodiments. Furthermore, the configuration of other components such as the mobile body 20 that cooperates with the information processing device 10 can be the same as those in the first and fifth embodiments.

[0171] The information processing device 10 of the sixth embodiment can achieve the same effects as the information processing device 10 of the first to fifth embodiments. Furthermore, the information processing device 10 can notify a predetermined notification target of the detection of the monitored object 2 and various information about the monitored object 2 (image, current location, etc.). The notification target can then begin to rush to the monitored object 2 in response to the notification. The mobile device 20 can then continue monitoring the monitored object 2 until the notification target arrives, and can terminate monitoring of the monitored object 2 when the notification target arrives.

[0172] With this information processing device 10, it is possible to monitor the target of monitoring 2 by making efficient and efficient use of resources.

[0173] <<Variation>> Here, we will describe some modifications applicable to the first to sixth embodiments. These modifications can also achieve the same effects and advantages as the first to sixth embodiments.

[0174] <Example 1> The mobile unit 20 may have an audio output function. The mobile unit 20 may also output a warning sound while tracking the monitored object 2. The warning sound may be a siren, a buzzer, or a warning message. In addition, the mobile unit 20 may acquire and output in real time the content spoken by an operator in a designated control room.

[0175] Furthermore, the warning sound output may differ depending on the content of the monitoring start conditions that the monitored object 2 has met. The monitoring control unit 13 determines the warning sound according to the content of the monitoring start conditions that the monitored object 2 has met and notifies the mobile unit 20. The mobile unit 20 can then output the notified warning sound.

[0176] <Modification 2> The monitoring control unit 13 may notify the protected object 1 of the detection of the monitored object 2. Notification to the protected object 1 can be achieved by the same means as the notification to the notified object described in the sixth embodiment. In this example, the protected object 1 can recognize that its own safety is in danger based on the notification.

[0177] <Variation 3> Images captured by the mobile device 20 while tracking the target 2 can be stored in a predetermined storage device.

[0178] <Modification 4> After the mobile unit 20 begins monitoring the first target 2, a second target 2 may be detected at a relatively close location, potentially resulting in a situation where there are insufficient mobile units 20 to be allocated to monitoring the second target 2.

[0179] In this case, the monitoring control unit 13 can adjust the number of mobile units 20 assigned to monitoring the first monitoring target 2 and the second monitoring target 2, respectively, based on the urgency of monitoring the first monitoring target 2 and the second monitoring target 2.

[0180] For example, if the urgency of monitoring the second monitoring target 2 is higher than the urgency of monitoring the first monitoring target 2, the monitoring control unit 13 can change some of the mobile units 20 that were assigned to monitoring the first monitoring target 2 to monitoring the second monitoring target 2. If the number of mobile units 20 assigned to monitoring the second monitoring target 2 is M units short, the monitoring control unit 13 can change M units of the mobile units 20 that were assigned to monitoring the first monitoring target 2 to monitoring the second monitoring target 2.

[0181] In this case, the monitoring control unit 13 transmits to the mobile unit 20 that the assignment has been changed, along with an image of the second monitoring target 2, information indicating the features appearing on the appearance of the second monitoring target 2, and information indicating the current location of the second monitoring target 2. Upon receiving this information, the mobile unit 20 terminates monitoring of the first monitoring target 2 and begins monitoring of the second monitoring target 2 based on the received information. For example, the mobile unit 20 moves toward the current location of the second monitoring target 2. The mobile unit 20 then uses the image of the second monitoring target 2 and the information indicating the features appearing on the appearance of the monitoring target 2 to detect the second monitoring target 2 from the images captured by the camera function of its own device. The mobile unit 20 then tracks the detected second monitoring target 2 and continues to photograph it.

[0182] The monitoring control unit 13 can determine the "urgency" based on the monitoring start conditions that the monitored object 2 satisfies. For example, the monitoring control unit 13 can determine the monitoring urgency of a monitored object 2 that satisfies the condition "performed a predefined dangerous action within the monitoring area 3" to be higher than the monitoring urgency of monitored objects 2 that satisfy other monitoring start conditions.

[0183] Furthermore, if both the first monitored target 2 and the second monitored target 2 satisfy the condition "a predefined dangerous action was performed within the monitoring area 3", the monitoring control unit 13 can perform the following processing. For example, the monitoring control unit 13 can change at least one of the mobile units 20 that were assigned to monitoring the first monitored target 2 to monitoring the second monitored target 2. In this case, some of the multiple mobile units 20 that were assigned to monitoring the first monitored target 2 form a predetermined formation such as a circle, and the other parts function as mobile units 20 for approaching. In this case, the monitoring control unit 13 can change at least one of the mobile units 20 that are forming the predetermined formation such as a circle to monitoring the second monitored target. The monitoring control unit 13 can then ensure that at least one mobile unit 20 for approaching is available for monitoring both the first monitored target and the second monitored target.

[0184] Furthermore, regardless of the content of the monitoring start conditions that the first monitored target 2 satisfies, the monitoring control unit 13 can change at least one of the mobile units 20, which are arranged in a predetermined formation such as a circle, to monitor the second monitored target when a predetermined number or more of notified targets arrive at the location of the first monitored target 2.

[0185] Although this disclosure has been described above with reference to embodiments, this disclosure is not limited to the embodiments described above. Various modifications to the structure and details of this disclosure are possible, which can be understood by those skilled in the art within the scope of this disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.

[0186] Furthermore, the flowcharts used in the above description show multiple steps (processes) in sequence. However, the execution order of the steps performed in each embodiment is not limited to the order in which they are described. In each embodiment, the order of the illustrated steps can be changed to the extent that it does not impede the content.

[0187] Some or all of the above embodiments may also be described as follows, but are not limited to the following. 1. An acquisition means for acquiring surveillance camera images taken within the surveillance area, A detection means for detecting a person who meets the monitoring start conditions as a target within the aforementioned surveillance camera image, When the target to be monitored is detected, the monitoring control means selects a mobile body from among a plurality of mobile bodies that are autonomously mobile and have a shooting function to monitor the target to be monitored, and causes the selected mobile body to perform the monitoring of the target to be monitored. An information processing device having 2. The acquisition means is, Identify the current location of the person to be protected. The information processing device according to claim 1, which determines the surveillance area based on the current location of the person to be protected. 3. Rules are defined in advance for each of the protected targets, specifying the surveillance area based on the current location of the protected target. The aforementioned rules define the size of the surveillance area, the shape of the surveillance area, and the relative positional relationship between the current location of the person being protected and the surveillance area. The acquisition means is an information processing device according to 2 that determines the surveillance area for each of the protected targets based on the current location of the protected target and the rules. 4. The monitoring start conditions are: Registered on the blacklist and located within the aforementioned monitoring area, The person is on the blacklist and meets the criteria for determining that their tendency to approach the person being protected has worsened, and, If a person performs a predefined dangerous behavior within the aforementioned monitoring area, An information processing device according to any one of 1 to 3, which includes at least one of the following. 5. The monitoring and control means is: An information processing device according to any one of 1 to 4, wherein the mobile body terminates monitoring of the target being monitored when the distance between a designated person and the mobile body falls within a threshold. 6. The monitoring and control means is: Select one or more of the mobile bodies to monitor the target being monitored. An information processing device according to any one of 1 to 5, wherein the number of mobile bodies to be selected is determined based on the performance of the mobile bodies to be selected. 7. Multiple monitoring start conditions are defined in advance, The monitoring and control means is When a target being monitored that satisfies any of the above monitoring start conditions is detected, a mobile body is selected from among a plurality of mobile bodies having different performance characteristics to monitor the detected target being monitored. An information processing device according to any one of 1 to 6, which determines which performance of the mobile body to select according to the content of the monitoring start conditions that the monitored object satisfies. 8. An information processing system comprising an information processing device as described in any one of 1 to 7, and a mobile body that is autonomously mobile and has a shooting function. 9. One or more computers, We acquire surveillance camera images taken within the surveillance area. Within the aforementioned surveillance camera image, a person who meets the surveillance start conditions is detected as a target for surveillance. An information processing method in which, upon detection of the target to be monitored, a mobile body is selected from among a plurality of mobile bodies that are autonomously mobile and have a shooting function to monitor the target to be monitored, and the selected mobile body is instructed to perform the monitoring of the target to be monitored. 10. Computers, A means for acquiring surveillance camera images taken within a surveillance area. A detection means for detecting a person who meets the monitoring start conditions as a target within the aforementioned surveillance camera image, When the target to be monitored is detected, a monitoring control means selects a mobile body from among a plurality of mobile bodies that are autonomously mobile and have a shooting function to monitor the target to be monitored, and causes the selected mobile body to perform the monitoring of the target to be monitored. A program that makes it function as such.

[0188] Some or all of the components of components 2 through 7, which are dependent on the information processing device described in component 1 above, may also be dependent on the information processing method described in component 9 and the program described in component 10, in the same dependent relationship as between component 1 and components 2 through 7. Furthermore, within the scope of not departing from the embodiments described above, some or all of the configurations described as components can be realized in various hardware, software, various recording means for recording software, or systems. [Explanation of symbols]

[0189] 10 Information Processing Devices 11 Acquisition Department 12 Detection unit 13 Monitoring and Control Unit 20 Mobile Units 1. Person to be protected 2. Target of monitoring 3. Surveillance Area 3-1 Surveillance Area 3-2 Surveillance Area 3-3 Surveillance Area 4. Communication Network 1A Processor 2A Memory 3A input / output I / F 4A Peripheral Circuits 5A bus

Claims

1. A means for acquiring surveillance camera images taken within a surveillance area, A detection means for detecting a person who meets the monitoring start conditions as a target within the aforementioned surveillance camera image, When the target to be monitored is detected, the monitoring control means selects a mobile body from among a plurality of mobile bodies that are autonomously mobile and have a shooting function to monitor the target to be monitored, and causes the selected mobile body to perform the monitoring of the target to be monitored. An information processing device having

2. The acquisition means is, Identify the current location of the person to be protected. The information processing device according to claim 1, which determines the surveillance area based on the current location of the person to be protected.

3. A rule has been defined in advance for each of the protected targets, which identifies the surveillance area based on the current location of the protected target. The aforementioned rules define the size of the surveillance area, the shape of the surveillance area, and the relative positional relationship between the current location of the person being protected and the surveillance area. The information processing device according to claim 2, wherein the acquisition means determines the surveillance area for each of the protected targets based on the current location of the protected target and the rules.

4. The aforementioned monitoring start conditions are: Registered on the blacklist and located within the aforementioned monitoring area, The person is on the blacklist and meets the criteria for determining that their tendency to approach the person being protected has worsened, and, If a person performs a predefined dangerous behavior within the aforementioned monitoring area, The information processing apparatus according to claim 1, comprising at least one of the following.

5. The monitoring and control means is The information processing device according to claim 1, wherein the mobile body terminates monitoring of the target being monitored when the distance between a predetermined person and the mobile body falls within a threshold.

6. The monitoring and control means is Select one or more of the mobile bodies to monitor the target being monitored. The information processing apparatus according to claim 1, wherein the number of mobile bodies to be selected is determined based on the performance of the mobile bodies to be selected.

7. Multiple monitoring start conditions are defined in advance, The monitoring and control means is When a target being monitored that satisfies any of the above monitoring start conditions is detected, a mobile body is selected from among a plurality of mobile bodies having different performance characteristics to monitor the detected target being monitored. The information processing apparatus according to claim 1, which determines which performance of the mobile body to select according to the content of the monitoring start conditions that the monitored object satisfies.

8. An information processing system comprising an information processing device according to any one of claims 1 to 7, and a mobile body that is autonomously mobile and has a shooting function.

9. One or more computers, We acquire surveillance camera images taken within the surveillance area. Within the aforementioned surveillance camera image, a person who meets the surveillance start conditions is detected as a target for surveillance. An information processing method in which, upon detection of the target to be monitored, a mobile body is selected from among a plurality of mobile bodies that are autonomously mobile and have a shooting function to monitor the target to be monitored, and the selected mobile body is instructed to perform the monitoring of the target to be monitored.

10. Computers, A means for acquiring surveillance camera images taken within a surveillance area. A detection means for detecting a person who meets the monitoring start conditions as a target within the aforementioned surveillance camera image, When the target to be monitored is detected, a monitoring control means selects a mobile body from among a plurality of mobile bodies that are autonomously mobile and have a shooting function to monitor the target to be monitored, and causes the selected mobile body to perform the monitoring of the target to be monitored. A program that makes it function as such.

Images