Monitoring device, monitoring system, monitoring method, and program

The monitoring system identifies permitted or unauthorized drones using pattern recognition of video data, addressing the limitations of remote ID devices and enhancing drone surveillance efficiency.

JP2024168100APending Publication Date: 2024-12-05NEC CORP
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
JP2023084514
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-23
Publication Date
2024-12-05

AI Technical Summary

Technical Problem

Existing drone monitoring systems face challenges in determining whether drones entering a surveillance area are permitted, as they rely on remote ID devices that can be tampered with or require complex data access procedures, and methods to detect unauthorized drones without remote ID information are inadequate.

Method used

A monitoring system that uses detection devices to acquire video data, determines drone patterns, and identifies permitted or unauthorized drones based on predetermined rules, including light emission, operation, and route patterns, without relying on remote ID information.

Benefits of technology

Enables effective monitoring of drones entering and exiting a surveillance area by identifying permitted or unauthorized drones through pattern recognition, reducing the need for remote ID data and simplifying the monitoring process.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024168100000001_ABST
    Figure 2024168100000001_ABST
Patent Text Reader

Abstract

To provide a monitoring device capable of monitoring a drone entering or leaving a monitoring area without using information originated from a remote ID apparatus.SOLUTION: A monitoring device includes an acquisition unit that acquires a detection signal containing video data showing a monitoring area, a determination unit that determines based on a pattern manifested by a drone detected in the video data whether the drone observes a predetermined rule, a discrimination unit that discriminates based on a result of the determination whether the drone detected in the monitoring area is a permitted drone or unpermitted drone, and an output unit that outputs information concerning the discriminated drone.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to a monitoring device, a monitoring system, a monitoring method, and a program. [Background technology]

[0002] In Japan, drones weighing 100g or more must be registered when flying outdoors. Registered drones must also be equipped with a device called a remote ID (identifier) ​​device. The remote ID device transmits information including the registration number, serial number, location information, time, and authentication information. By using the information transmitted from the remote ID device to identify the drone, it is possible to determine whether a drone entering the monitored area has been issued permission to enter. When monitored facilities manage drones independently, the number of drones to be monitored is limited. In such cases, using the information transmitted from the remote ID device makes it easier to manage drones and provides sufficient security.

[0003] The information transmitted from the remote ID device is open information given to many drones. Therefore, the information transmitted from the remote ID device may be tampered with or copied. In addition, if it is necessary to check the registration details and applicant information for all drones entering the monitoring area, application procedures to the Civil Aviation Bureau and procedures to access and check large amounts of data will be required. Thus, drone monitoring using information transmitted from ID devices has issues in terms of security and complicated procedures. In addition, some drones are exempt from being equipped with remote ID devices. Therefore, technology is required to monitor drones entering and leaving the monitoring area without using information transmitted from remote ID devices.

[0004] Patent Document 1 discloses a flight restriction system that restricts the flight of an autonomous flying mobile body in a monitoring area. The system of Patent Document 1 includes a plurality of relay devices. The relay devices wirelessly communicate with monitoring targets including an autonomous flying mobile body and a mobile terminal. The relay devices determine whether or not the monitoring targets have entered the monitoring area based on the radio wave intensity of the wireless communication and a threshold value that is predetermined for each monitoring area. When the relay devices determine that the monitoring targets have entered the monitoring area, the relay devices transmit communication information including the identification information of the relay device itself, the identification information of the monitoring targets, and a time to a monitoring server. The server accumulates the communication information received from each relay device in a storage unit for each monitoring target. The server generates superimposed mapping data indicating the movement history of the monitoring targets based on the mapping data in which the relay devices are mapped and the communication information accumulated in the storage unit. The server displays the generated superimposed mapping data on a display unit.

[0005] Patent Document 2 discloses a drone monitoring system that detects drones in a surveillance area. The system of Patent Document 2 flies an approved drone that has been approved in advance to fly in the surveillance area. The system of Patent Document 2 uses a suspicious object detection device mounted on the approved drone to detect suspicious drones that are not permitted to fly in the surveillance area. The system of Patent Document 2 detects suspicious drones by a reflected signal of a pulse burst signal emitted from the suspicious object detection device. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] JP 2019-104307 A [Patent Document 2] JP 2019-040321 A Summary of the Invention [Problem to be solved by the invention]

[0007] By using the method of Patent Document 1, it is possible to display on the display unit superimposed mapping data showing the movement history of a monitoring target that has entered a monitoring area without using information transmitted from a remote ID device. However, with the method of Patent Document 1, it is not possible to determine whether a monitoring target that has entered a monitoring area is permitted to fly in the monitoring area.

[0008] By using the method of Patent Document 2, it is possible to detect a suspicious drone flying in a surveillance area without using information transmitted from a remote ID device. However, the method of Patent Document 2 cannot detect a suspicious drone unless a reflected signal of a pulse burst signal transmitted from a suspicious object detection device is received. Also, the method of Patent Document 2 cannot detect a suspicious drone unless a human monitors image data from an approved drone.

[0009] An object of the present disclosure is to provide a monitoring device, a monitoring system, a monitoring method, and a program that can monitor drones entering and leaving a monitored area without using information transmitted from a remote ID device. [Means for solving the problem]

[0010] A surveillance device of one embodiment of the present disclosure includes an acquisition unit that acquires a detection signal including video data of a monitored area, a determination unit that determines whether the drone is complying with predetermined rules based on a pattern exhibited by the drone detected in the video data, an identification unit that identifies whether the drone detected in the monitored area is an authorized drone or an unauthorized drone based on the determination result, and an output unit that outputs information regarding the identified drone.

[0011] In one aspect of the monitoring method of the present disclosure, a detection signal including video data of a monitored area is obtained, and based on a pattern exhibited by the drone detected in the video data, it is determined whether the drone is following predetermined rules, and depending on the determination result, it is identified as whether the drone detected in the monitored area is an authorized drone or an unauthorized drone, and information regarding the identified drone is output.

[0012] A program of one embodiment of the present disclosure causes a computer to perform the following processes: acquiring a detection signal including video data of a monitored area; determining whether the drone detected in the video data is complying with predetermined rules based on a pattern revealed by the drone; identifying whether the drone detected in the monitored area is an authorized drone or an unauthorized drone based on the determination result; and outputting information regarding the identified drone. Effect of the Invention

[0013] According to the present disclosure, it is possible to provide a monitoring device, a monitoring system, a monitoring method, and a program that can monitor drones entering and leaving a monitored area without using information transmitted from a remote ID device. [Brief description of the drawings]

[0014] [Figure 1] 1 is a block diagram showing an example of the configuration of a monitoring system according to a first embodiment. [Diagram 2] FIG. 2 is a conceptual diagram showing an example of drone monitoring by the monitoring system according to the first embodiment. [Diagram 3] 1 is a conceptual diagram illustrating an example of the configuration of a detection device included in a monitoring system according to a first embodiment. [Figure 4] 1 is a block diagram showing an example of a configuration of a monitoring device included in a monitoring system according to a first embodiment. [Diagram 5] 13 is an example of a permission ticket given to a drone that is permitted to enter a monitoring area monitored by the monitoring system according to the first embodiment. [Figure 6] FIG. 2 is a conceptual diagram showing an example of a drone used in the monitoring system according to the first embodiment. [Figure 7] FIG. 2 is a conceptual diagram showing an example of a drone used in the monitoring system according to the first embodiment. [Figure 8] 1 is a block diagram showing an example of the configuration of a drone in a surveillance system according to a first embodiment. FIG. [Figure 9]3A to 3C are conceptual diagrams for explaining an example of a light emission pattern according to a predetermined rule that is a subject of determination by the monitoring system according to the first embodiment. [Figure 10] 2 is a conceptual diagram for explaining an example of a signal pattern according to a predetermined rule that is a target of determination by the monitoring system according to the first embodiment. FIG. [Figure 11] 2 is a conceptual diagram for explaining an example of an operation pattern according to a predetermined rule that is a determination target of the monitoring system according to the first embodiment. FIG. [Figure 12] 2 is a conceptual diagram for explaining an example of an operation pattern according to a predetermined rule that is a determination target of the monitoring system according to the first embodiment. FIG. [Figure 13] 2 is a conceptual diagram for explaining an example of a route according to a predetermined rule that is a target of determination by the monitoring system according to the first embodiment. FIG. [Figure 14] 2 is a conceptual diagram for explaining an example of a route according to a predetermined rule that is a target of determination by the monitoring system according to the first embodiment. FIG. [Figure 15] 1 is a conceptual diagram for explaining an example of setting an entrance / exit grid according to a predetermined rule that is a determination target of the surveillance system according to the first embodiment. FIG. [Figure 16] 1 is a conceptual diagram for explaining an example of setting an entrance / exit grid according to a predetermined rule that is a determination target of the surveillance system according to the first embodiment. FIG. [Figure 17] 5 is a flowchart for explaining an example of an operation of a monitoring device included in the monitoring system according to the first embodiment. [Figure 18] FIG. 11 is a block diagram showing an example of the configuration of a monitoring system according to a second embodiment. [Figure 19] FIG. 11 is a block diagram showing an example of the configuration of a monitoring device included in a monitoring system according to a second embodiment. [Figure 20] 13 is a conceptual diagram showing an example of a monitoring area map generated by a map update unit of a monitoring device included in a monitoring system according to a second embodiment. FIG. [Figure 21]13 is a conceptual diagram showing an example of a monitoring area map generated by a map update unit of a monitoring device included in a monitoring system according to a second embodiment. FIG. [Figure 22] 10 is a flowchart illustrating an example of an operation of a monitoring device included in a monitoring system according to a second embodiment. [Diagram 23] FIG. 13 is a block diagram showing an example of the configuration of a monitoring device according to a third embodiment. [Figure 24] 13 is a flowchart illustrating an example of an operation of a monitoring device included in a monitoring system according to a third embodiment. [Diagram 25] FIG. 2 is a block diagram showing an example of a configuration of hardware for executing control and processing according to each embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0015] Hereinafter, the embodiments for carrying out the present invention will be described with reference to the drawings. However, the embodiments described below are limited in a manner that is technically preferable for carrying out the present invention, but the scope of the invention is not limited to the following. In addition, in all the drawings used to explain the following embodiments, the same reference numerals are used for similar parts unless otherwise specified. In addition, in the following embodiments, repeated explanations of similar configurations and operations may be omitted.

[0016] (First embodiment) First, a monitoring system according to a first embodiment will be described with reference to the drawings. The monitoring system of this embodiment monitors a moving object that has entered a monitoring area around a facility that is a monitoring target. In this embodiment, an airborne drone is taken as an example of the moving object. The moving object is not limited to an airborne drone. For example, the moving object may be a terrestrial drone, an underwater drone, or a surface drone. In the following, the moving object will be referred to as a drone.

[0017] (composition) 1 is a block diagram showing an example of the configuration of a monitoring system 10 according to this embodiment. The monitoring system 10 includes a plurality of detection devices 11 and a monitoring device 13. The detection devices 11 and the monitoring devices 13 are communicatively connected to each other via wireless communication. The detection devices 11 and the monitoring devices 13 may also be communicatively connected to each other via wired communication. There are no particular limitations on the communication method or communication standard for connecting the detection devices 11 and the monitoring devices 13.

[0018] FIG. 2 is a conceptual diagram showing an example of monitoring of a drone 15 by the monitoring system 10. A monitoring area SA is set around the monitored facility MF. Only the monitoring area SA may be set without the monitored facility MF. The multiple detection devices 11 may be placed inside the monitoring area SA or outside the monitoring area SA. In the example of FIG. 2, the monitoring device 13 is placed on the roof of the monitored facility MF. The monitoring device 13 may be constructed on a server or in the cloud. Furthermore, the monitoring device 13 may be realized by an application that can be used on a terminal device (not shown) or a mobile terminal (not shown) used by the administrator.

[0019] The drone 15 to be monitored is classified as an authorized drone or an unauthorized drone. An authorized drone is a drone 15 that is authorized to enter the monitored area SA and the monitored facility MF. An unauthorized drone is a drone 15 that is not authorized to enter the monitored area SA and the monitored facility MF. A predetermined rule is given to the authorized drone. In the monitored area SA and the monitored facility MF, the authorized drone can activate a pattern that follows the predetermined rule. Details of the predetermined rule and the pattern that follows the predetermined rule will be described later. A predetermined rule is not given to the unauthorized drone. In the monitored area SA and the monitored facility MF, the unauthorized drone cannot perform an operation that follows the predetermined rule. A drone before being classified as an authorized drone or an unauthorized drone is an unconfirmed drone. Depending on the judgment of the monitoring device 13, the unconfirmed drone is classified as an authorized drone or an unauthorized drone.

[0020] When a pattern conforming to a predetermined rule is detected by the drone 15 in the monitored area SA and the monitored facility MF, the monitoring device 13 determines that the drone 15 is an authorized drone. On the other hand, when a pattern conforming to a predetermined rule is not detected by the drone 15 in the monitored area SA and the monitored facility MF, the monitoring device 13 determines that the drone 15 is an unauthorized drone. The monitoring device 13 outputs information about the drone 15 that has been determined to be an unauthorized drone.

[0021] [Detection device] 3 is a block diagram showing an example of the configuration of the detection device 11. The detection device 11 includes a detector 111, a control unit 113, and a communication unit 115.

[0022] The detector 111 detects the drone 15 moving inside the monitoring area SA. The detector 111 transmits information about the detected drone 15 to the monitoring device 13. For example, the detector 111 is a camera that captures the inside of the monitoring area SA. For example, the detector 111 is realized by a camera that can capture visible and infrared light. When the detector 111 is a camera, the detector 111 transmits captured video data to the monitoring device 13. For example, the video data may be captured by a monitoring camera or a security camera that captures the inside of the monitoring area SA.

[0023] The detector 111 is not limited to a camera as long as it can detect the drone 15 and pattern moving inside the monitoring area SA. For example, the detector 111 may be realized by a sensor that transmits electromagnetic waves toward the inside of the monitoring area SA and detects the reflected waves of the electromagnetic waves. For example, the detector 111 may be realized by a sensor that transmits sound waves toward the inside of the monitoring area SA and detects the reflected waves of the sound waves. When the detector 111 is realized by these sensors, any one of the multiple detection devices 11 may be realized by a camera.

[0024] The control unit 113 acquires a signal detected by the detector 111. When the detector 111 detects video data, the control unit 113 processes the video data into a detection signal in a transmittable data format and outputs the signal to the communication unit 115. For example, the control unit 113 compresses the video data. The detection signal includes information about the detected drone 15. The information about the permitted drone includes a pattern that follows a predetermined rule. For example, the pattern includes a blinking pattern of a light, a frequency pattern of a signal, an operation pattern of the drone 15, and the like.

[0025] The communication unit 115 acquires a detection signal from the control unit 113. The communication unit 115 transmits the detection signal to the monitoring device 13. For example, the communication unit 115 transmits the detection signal to the monitoring device 13 by wireless communication. The communication unit 115 may be configured to transmit the detection signal to the monitoring device 13 by wired communication. There are no particular limitations on the communication method or communication standard of the communication unit 115.

[0026] [Monitoring device] 4 is a block diagram showing an example of the configuration of the monitoring device 13. The monitoring device 13 includes an acquisition unit 131, a determination unit 133, a storage unit 134, an identification unit 135, and an output unit 137.

[0027] The acquisition unit 131 acquires a detection signal transmitted from the detection device 11. For example, the acquisition unit 131 receives the detection signal by wireless communication. The acquisition unit 131 may be configured to receive the detection signal by wired communication. There are no particular limitations on the communication method or communication standard of the acquisition unit 131. The acquisition unit 131 outputs the acquired detection signal to the determination unit 133.

[0028] The determination unit 133 acquires the detection signal acquired by the acquisition unit 131. The determination unit 133 restores video data from the acquired detection signal. The determination unit 133 extracts the drone 15 from the restored video data. The determination unit 133 detects a pattern performed by the extracted drone 15. The determination unit 133 determines whether the drone 15 is an authorized drone or an unauthorized drone according to the detected pattern. For example, the pattern according to the predetermined rule is a blinking pattern of light, a frequency pattern of a signal, an operation pattern of the drone 15, etc. For example, the pattern according to the predetermined rule is set according to a time period. For example, the pattern according to the predetermined rule is set according to a position in the monitoring area SA. For example, the pattern according to the predetermined rule is set for each individual drone 15.

[0029] The storage unit 134 stores information including a pattern according to a predetermined rule. The pattern according to the predetermined rule is given to the drone 15 permitted to enter the monitoring area SA. The storage unit 134 stores information about a permission ticket issued to the drone 15 permitted to enter the monitoring area SA. The permission ticket includes a pattern according to the predetermined rule given to each drone 15.

[0030] FIG. 5 is an example of a permission ticket 140 including a pattern according to a predetermined rule. The permission ticket 140 includes a permission number, a user identifier, an aircraft identifier, a permission area, a permission time period, and a pattern. The permission number is the number of the permission ticket 140. The permission number is given to each permission ticket 140 issued. The user identifier is an identifier indicating the owner (user) of the drone 15 to which the permission ticket 140 is issued. The user identifier is an identifier for uniquely identifying a user, such as a name or an identification symbol. As long as the user can be uniquely identified, there is no limitation on the format of the user identifier. The aircraft identifier is an identifier indicating the drone 15 to which the permission ticket 140 is issued. The aircraft identifier is an identifier for uniquely identifying the drone 15. For example, the aircraft identifier is a registration number or a manufacturing number included in a remote ID (Identifier) ​​device mounted on the drone 15. As long as the drone 15 can be uniquely identified, there is no limitation on the format of the aircraft identifier. The permitted area indicates an area in which the drone 15 that has been issued the permission ticket 140 can enter. The permitted time period indicates a time period in which the drone 15 that has been issued the permission ticket 140 can enter the permitted area. The pattern is a pattern that the drone 15 that has entered the permitted area is required to activate during the permitted time period.

[0031] For example, a user applies in advance for permission for the drone 15 to enter the monitored area SA. For example, the advance application for the drone 15 to enter the monitored area SA is accepted on a website operated by an administrator who manages the monitored area SA. For example, the advance application for the drone 15 to enter the monitored area SA may be made on paper to the administrator who manages the monitored area SA. When permission for the drone 15 to enter the monitored area SA is received, a permission ticket 140 is issued to the drone 15 owned by the user. The permission ticket 140 is granted to the drone 15 as electronic data. For example, the permission ticket 140 is granted to the drone 15 via a terminal device (not shown) owned by the user who made the advance application. The permission ticket 140 is recorded in the drone 15 as electronic data.

[0032] For example, the permission ticket 140 may be provided in the form of a sticker on which an identification symbol indicating permission to enter the monitoring area SA is displayed. In such a case, it is sufficient to clearly indicate that the permission ticket 140 has been granted by attaching a sticker on which an identification symbol indicating that the permission ticket 140 has been granted to the housing of the drone 15.

[0033] The memory unit 134 may store a pattern indicating an unauthorized drone. For example, the memory unit 134 stores a pattern indicating an operation, speed, route, etc. that is determined as an unauthorized drone. In this case, the determination unit 133 determines whether the drone 15 is an unauthorized drone based on the pattern indicating an unauthorized drone. When detecting only unauthorized drones, it is not necessary to detect permitted drones, so the burden of the determination process is reduced.

[0034] The identification unit 135 identifies whether the drone 15 is an unauthorized drone or an authorized drone, depending on the determination result of the determination unit 133. For example, the identification unit 135 identifies the unauthorized drone based on image data of the drone 15 identified as an unauthorized drone. For example, the identification unit 135 identifies information about the unauthorized drone based on the model, shape, etc. of the identified unauthorized drone. For example, the identification unit 135 may identify information about the unauthorized drone based on information transmitted from a remote ID device of the drone 15 identified as an unauthorized drone.

[0035] The output unit 137 outputs information about the identified drone 15. For example, the output unit 137 may output only information about unauthorized drones. For example, the output unit 137 outputs information about the drone 15 to a management terminal (not shown) of an administrator who uses the monitoring system 10. For example, the information about the drone 15 is displayed on the screen of the administrator's management terminal. The information about the drone 15 may be accumulated in a database (not shown) that records entry and exit management of the drone 15 in the monitoring area SA. There are no limitations on the use of the information about the drone 15.

[0036] There are no limitations on the timing at which the output unit 137 outputs the information about the drone 15. For example, the output unit 137 outputs updated information in accordance with the timing at which the information about the drone 15 is updated. For example, the output unit 137 outputs information about the drone 15 at a preset timing. For example, the output unit 137 outputs information about the drone 15 in response to an external request.

[0037] [Drone] 6 to 7 are conceptual diagrams showing an example of the configuration of the drone 15 that is the monitoring target of the monitoring system 10 according to the present embodiment. FIG. 6 to FIG. 7 show the external appearance of the drone 15. FIG. 6 is a plan view of the drone 15 seen from above. FIG. 7 is a side view showing one side of the drone 15. A bottom view, a back view, an oblique view, and the like of the drone 15 are omitted. FIG. 6 to FIG. 7 show the main body 160, the propeller 150 (the blades 151, the motor 152), the frame 154, the light emitter 156, and the camera 157 of the drone 15. FIG. 6 to FIG. 7 show a part of the light emitter 156 and the camera 157 outside the main body. A protective member such as a protective film or a protective glass may be provided on the outside of the lens of the camera 157 and the light emitter 156.

[0038] The drone 15 has at least one propeller 150 for flying the main body 160. The propeller 150 is also called a rotor or a rotating wing. Each of the multiple propellers 150 is composed of a blade 151 that lifts the main body 160 by rotating, and a motor 152 that rotates the blade 151. Each of the multiple propellers 150 is fixed to the main body 160 by a frame 154.

[0039] 6 and 7 show a quadcopter in which four blades 151 are installed on the main body 160 of the drone 15. The rotation speeds of the four blades 151 are controlled independently of each other. The drone 15 may be equipped with a single blade 151. However, in consideration of attitude stability and flight performance in the air, it is preferable that the drone 15 is a multicopter having multiple blades 151.

[0040] In the example of FIG. 6, an identification mark IM indicating that the permission ticket 140 has been granted is affixed to the top surface of the drone 15. If the identification mark IM is affixed, it is possible to determine whether or not the permission ticket 140 has been granted by the identification mark IM. If it is determined that the drone 15 is an authorized drone by the identification mark IM, the drone 15 to which the identification mark IM is affixed is an authorized drone. If it is not determined that the drone 15 is an authorized drone by the identification mark IM, the drone 15 to which the identification mark IM is affixed is an unauthorized drone. For example, there may be cases where the identification mark IM indicating that the permission ticket 140 has been granted is affixed to an unauthorized drone. In such a case, the unauthorized drone is erroneously determined to be an authorized drone. Therefore, it is desirable to determine whether or not the drone 15 is an authorized drone not only by the identification mark IM but also by a pattern according to a predetermined rule.

[0041] The light emitter 156 emits light that can be seen from the outside. For example, the light emitter 156 has an LED (Light Emitting Diode) or the like. For example, the light emitter 156 may have a projector function that can form a desired image. There is no limitation on the mounting position of the light emitter 156 as long as it can emit light that can be seen from the outside. FIGS. 6 to 7 show an example in which the light emitting surface of the light emitter 156 protrudes from one of the sides of the drone 15. The light emitter 156 may be disposed on the upper or lower surface of the drone 15. In addition, multiple light emitters 156 may be mounted on the drone 15. In that case, the multiple light emitters 156 may all be of the same type, or different types may be combined. For example, the light emitter 156 may have a laser light source that emits a highly directional laser light. The laser light irradiated toward the detection device 11 in front of the drone 15 cannot be seen from the side, so it is highly concealable.

[0042] The drone 15 also has a camera 157. At least one lens for imaging is incorporated in the camera 157. FIGS. 6 to 7 show an example in which a part of the lens of the camera 157 protrudes from one of the sides of the drone 15. The lens is installed at a position where the surroundings of the drone 15 can be photographed. The lens incorporated in the camera 157 is a zoom lens that can change the focal length. The lens is equipped with an autofocus function that automatically adjusts the focus. The camera 157 is also equipped with functions that are applied to general digital cameras, such as a function to prevent camera shake. The camera 157 may be disposed at a position where the drone 15 can be photographed above or below. The drone 15 may also be equipped with multiple cameras 157. In this case, the multiple cameras 157 may all be of the same type, or multiple different cameras 157 may be combined. The lens of the camera 157 and the light emitter 156 may be disposed on different surfaces. The camera 157 photographs the surroundings of the drone 15.

[0043] The camera 157 has an imaging element (not shown) for acquiring image data. The imaging element is a photoelectric conversion element in which semiconductor components are integrated. The imaging element can be realized by, for example, a solid-state imaging element such as a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS). For example, the imaging element is configured by an element that captures light in the visible range. For example, the camera 157 is realized by a digital camera capable of capturing video. The imaging element may be configured by an element that can capture and detect electromagnetic waves such as infrared rays, ultraviolet rays, X-rays, gamma rays, radio waves, and microwaves.

[0044] Fig. 8 is a block diagram showing an example of the configuration of the drone 15. Fig. 8 shows a control device 16 which is an internal configuration of the drone 15. The control device 16 has an antenna 161, a communication unit 162, a control unit 163, a propeller driving unit 165, a position identification unit 166, a memory unit 167, and a power source 169.

[0045] The antenna 161 is used for transmitting and receiving radio signals. The specifications of the antenna 161 are selected in accordance with the wavelength band and standard of the radio signals transmitted and received. There are no particular limitations on the type, shape, etc. of the antenna 161.

[0046] The communication unit 162 has a communication control function that controls the transmission and reception of radio waves by the drone 15. The communication unit 162 receives a wireless signal received by the antenna 161. The communication unit 162 decodes a signal included in the received wireless signal. The communication unit 162 outputs the decoded signal to the control unit 163. The communication unit 162 also encodes a signal generated by the control unit 163 for external transmission. The communication unit 162 outputs the encoded signal to the antenna 161.

[0047] The control unit 163 has a control function for controlling the drone 15. For example, the control unit 163 is realized by a microcomputer having a processor and a memory. The control unit 163 acquires flight conditions for the drone 15. For example, the control unit 163 acquires a pattern according to a predetermined rule as the flight condition. For example, the control unit 163 acquires a flight route, such as how and at what position in the monitoring area SA the drone will fly, as the flight condition. The control unit 163 sets flight conditions in the propeller drive unit 165 according to the flight conditions.

[0048] The control unit 163 acquires flight conditions from the communication unit 162 or the storage unit 167. The control unit 163 sets drive conditions for the propellers 150 based on the acquired flight conditions. The control unit 163 sets the set drive conditions for the propellers 150 in the propeller drive unit 165. The drone 15 moves by the rotation of the multiple propellers 150 according to the drive conditions set in the propeller drive unit 165.

[0049] The control unit 163 operates the drone 15 according to a pattern that follows a predetermined rule. For example, the control unit 163 causes the light emitter 156 to emit light in a light emission pattern that follows a predetermined rule. For example, the control unit 163 causes the antenna 161 to transmit a signal pattern modulated in accordance with the predetermined rule. For example, the control unit 163 controls the propeller 150 so that the drone 15 flies in a flight pattern that follows the predetermined rule. For example, the control unit 163 controls the propeller 150 so that the drone 15 flies in an operation pattern that follows the predetermined rule. The control unit 163 controls the propeller 150 so that the drone 15 flies along a route that follows the predetermined rule.

[0050] The control unit 163 acquires image data captured by the camera 157. The control unit 163 performs various image processing on the image data captured by the camera 157. For example, the control unit 163 executes image processing such as dark current correction, interpolation, color space conversion, gamma correction, aberration correction, noise reduction, and image compression. In addition, in order to reduce the processing by the control unit 163, an integrated circuit (image processing processor) that performs various image processing on the image data may be added to the drone 15.

[0051] The propeller driving unit 165 drives the propeller 150 in response to the control of the control unit 163. In FIG. 8, one propeller driving unit 165 is provided for the multiple propellers 150. An individual propeller driving unit 165 may be provided for each of the multiple propellers 150. The propeller driving unit 165 drives the rotation speed of the multiple propellers 150, thereby controlling the flight attitude and direction of the drone 15. When the flight speed of the drone 15 is to be increased, the propeller driving unit 165 increases the rotation speed of the propeller 150. When the flight speed of the drone 15 is to be decreased, the propeller driving unit 165 decreases the rotation speed of the propeller 150.

[0052] The position identification unit 166 is a means for identifying the position of the drone 15. For example, the position identification unit 166 includes a positioning system such as a global positioning system (GPS), and sensors such as a geomagnetic sensor, an acceleration sensor, a speed sensor, an altitude sensor, and a distance measurement sensor. The position identification unit 166 includes at least one of these sensors. The position identification unit 166 may be configured by combining several of these sensors. The position identification unit 166 generates position information of the drone 15. The position identification unit 166 supplies the generated position information to the control unit 163.

[0053] The storage unit 167 stores flight conditions and drive conditions of the drone 15. For example, the storage unit 167 stores flight conditions and drive conditions of the propeller 150 according to the movement plan of the drone. For example, the storage unit 167 may store drive conditions of the propeller 150 according to the distance and position of the target object. For example, the storage unit 167 records drive conditions according to the operation performed by the drone 15 in a table format. In addition, the storage unit 167 stores a pattern assigned to each permitted drone. For example, the storage unit 167 stores electronic data of the permission ticket 140 (FIG. 5) including the permission pattern. In addition to the storage unit 167, image data that could not be completely processed when performing image processing and processed image data may be temporarily stored. There is no particular limitation on the data stored in the storage unit 167.

[0054] The power source 169 is a source of power used by the drone 15. For example, the power source 169 includes a battery capable of supplying power. For example, the power source 169 includes a battery such as a lithium ion battery, a nickel-cadmium battery, or a nickel-metal hydride battery. For example, the power source 169 includes a battery capable of wirelessly supplying power. The power source 169 may also include an engine that runs on fuel such as gasoline. There are no particular limitations on the type or capacity of the power source 169.

[0055] [Prescribed rules] FIG. 9 is a conceptual diagram for explaining an example of a light emission pattern according to a predetermined rule. The horizontal axis indicates time. A white circle indicates light emission, and a black circle indicates extinction. For example, the light emission pattern is set in binary, such as a white circle being 1 and a black circle being 0. In the example of FIG. 9, one set of blinks surrounded by a dashed frame corresponds to a light emission pattern according to a predetermined rule. For example, the light emission pattern may be set with different colors or light emission intensities. There is no particular limitation on the number of blinks or repetitions of the light emission pattern.

[0056] FIG. 10 is a conceptual diagram for explaining an example of a signal pattern modulated according to a predetermined rule. The horizontal axis indicates time. The vertical axis indicates signal strength. In the example of FIG. 10, the signal pattern is expressed by the strength of the signal. For example, the signal pattern is set in binary notation, such as 1 for strong signal strength and 0 for weak signal strength. The length of the time period during which the signal strength is strong or weak is also an element of the signal pattern. In the example of FIG. 10, a set of signals enclosed in a dashed frame corresponds to a signal pattern modulated according to a predetermined rule. For example, the signal pattern may be set with two or more types of signal strength or frequency.

[0057] FIG. 11 is a conceptual diagram for explaining an example of a motion pattern according to a predetermined rule. FIG. 11 is a view of the drone 15 from a side perspective. The horizontal axis indicates time. The vertical axis indicates altitude. In the example of FIG. 11, the motion pattern is expressed by the height of the drone 15. For example, the motion pattern is set in ternary notation, such as 1 for a high altitude, 0 for an altitude at the reference height, and -1 for a low altitude. In addition, the length of the time period at each altitude is also an element of the motion pattern. In the example of FIG. 11, one set of motions surrounded by a dashed frame corresponds to a motion pattern according to a predetermined rule. For example, the motion pattern may be set at two types of altitude. For example, the motion pattern may be set at four or more types of altitude.

[0058] FIG. 12 is a conceptual diagram for explaining another example of a motion pattern according to a predetermined rule. FIG. 12 is a diagram of the drone 15 as seen from a side perspective. The horizontal axis indicates time. In the example of FIG. 12, the motion pattern is expressed by the inclination of the drone 15. For example, the motion pattern is set at a preset inclination of the drone. The time of the inclination is also one element of the motion pattern. In the example of FIG. 12, one set of motions enclosed in a dashed frame corresponds to a motion pattern according to a predetermined rule. For example, the motion pattern may be set at two to three types of inclination.

[0059] 13 to 14 are conceptual diagrams for explaining an example of a route according to a predetermined rule. FIG. 13 to FIG. 14 are diagrams of the drone 15 viewed from above. FIG. 13 to FIG. 14 show an example in which an area expressed by 81 grids of 9 rows (0 to 9) by 9 columns (A to I) is set as a verification area VA of a route. A route according to a predetermined rule is expressed using a spatial code expressed by a combination of row numbers and column symbols. For example, the verification area VA is set as an area toward an entrance to a monitoring area SA or an entrance to a monitored facility MF inside the monitoring area SA. In the example of FIG. 13 to FIG. 14, the route according to the predetermined rule is in the order of "0A, 2A, 2C, 2E, 4E, 4G, 4I, 6I, 6G, 8G, 8I". FIG. 13 shows an example in which the drone 15 moves along a correct route in the verification area VA. In this case, the drone 15 is determined to be an authorized drone (OK). 14 shows an example in which the drone 15 moves along an incorrect route in the verification area VA. In this case, the drone 15 is determined to be an unauthorized drone (NG).

[0060] 15 to 16 are conceptual diagrams for explaining an example of setting an entrance / exit grid according to a predetermined rule. FIG. 15 to FIG. 16 are diagrams of the drone 15 as viewed from above. FIG. 15 to FIG. 16 show an example in which a monitoring area SA is divided into 81 grids of 9 rows (0 to 9) by 9 columns (A to I). An entrance grid and an exit grid are set in the monitoring area SA. The entrance grid and the exit grid are changed according to the time period. The grids set within the monitoring area SA are expressed using a spatial code expressed by a combination of row numbers and column symbols. The entrance grid and the exit grid may be set individually for each drone 15.

[0061] FIG. 15 is an example of the setting of the entry / exit grid. FIG. 15 is an example of the setting of the entry / exit grid for the time period from 12:00 to 13:00. In the example of FIG. 15, the entry grid is set to "0B" and the exit grid is set to "7I". A drone 15 that enters the monitoring area SA from grid "0B" is determined to be an authorized drone (OK). On the other hand, a drone 15 that enters the monitoring area SA from grid "0F" is determined to be an unauthorized drone (NG). Also, a drone 15 that exits the monitoring area SA from grid "7I" is determined to be an authorized drone (OK). On the other hand, a drone 15 that enters the monitoring area SA from grid "3I" is determined to be an unauthorized drone (NG).

[0062] FIG. 16 is another example of the setting of the entry / exit grid. FIG. 16 is an example of the setting of the entry / exit grid for the time period from 13:00 to 14:00. In the example of FIG. 16, the entry grid is set to "0F" and the exit grid is set to "3I". A drone 15 that enters the monitoring area SA from grid "0F" is determined to be an authorized drone (OK). On the other hand, a drone 15 that enters the monitoring area SA from grid "0B" is determined to be an unauthorized drone (NG). Also, a drone 15 that enters the monitoring area SA from grid "3I" is determined to be an authorized drone (OK). On the other hand, a drone 15 that exits the monitoring area SA from grid "7I" is determined to be an unauthorized drone (NG).

[0063] At the time of exiting the monitoring area SA, the unauthorized drone may take away information about the inside of the monitoring area SA. In the example of FIG. 15, the unauthorized drone is tracked by a tracking drone T. For example, the unauthorized drone may be shot down using an artillery device (not shown). For example, the unauthorized drone may be fired with a radio transmitter capable of identifying its location. For example, the unauthorized drone may be captured using a net or the like. For example, the unauthorized drone may be sprayed with paint or other paint as a marker. The method of dealing with unauthorized drones is not limited to the examples given here.

[0064] (operation) Next, an example of the operation of the monitoring system 10 according to the present embodiment will be described with reference to the drawings. In the following, an example of the operation of the monitoring device 13 included in the monitoring system 10 will be described with reference to a flowchart.

[0065] Fig. 17 is a flowchart for explaining an example of the operation of the monitoring device 13. In explaining the process according to the flowchart of Fig. 17, the components of the monitoring device 13 will be described as the subject of the operation. The subject of the operation of the process according to the flowchart of Fig. 17 may be the monitoring device 13.

[0066] 17, first, when a detection signal is acquired (Yes in step S11), the acquisition unit 131 acquires information about the detected drone 15 from the detection signal (step S12). When a detection signal is not acquired (No in step S11), the acquisition unit 131 waits until a detection signal is acquired.

[0067] Next, the determination unit 133 determines whether the information about the detected drone 15 includes a pattern that follows a predetermined rule (step S13). The determination unit 133 determines whether the information about the detected drone 15 includes a pattern that follows a predetermined rule based on the information about the drone 15 stored in the storage unit 134.

[0068] If a pattern conforming to the predetermined rule is included (Yes in step S13), the identification unit 135 identifies the drone 15 as an authorized drone (step S14). On the other hand, if a pattern conforming to the predetermined rule is not included (No in step S13), the identification unit 135 identifies the drone 15 as an unauthorized drone (step S15).

[0069] After steps S14 and S15, the output unit 137 outputs information about the identified drone 15 (step S16). If monitoring is to be continued (Yes in step S17), the process returns to step S11. If monitoring is to be stopped (No in step S17), the process according to the flowchart in Fig. 17 ends. The criteria for continuing or stopping monitoring may be set in advance.

[0070] As described above, the monitoring system of the present embodiment includes at least one detection device and a monitoring device. The detection device detects a drone that has entered a monitoring area. The detection device captures an area including the detected drone. The detection device transmits the captured video data to the monitoring device. The monitoring device includes an acquisition unit, a determination unit, an identification unit, a storage unit, and an output unit. The acquisition unit acquires a detection signal including video data of the monitoring area. The storage unit stores a pattern according to a predetermined rule for each drone. Based on the pattern expressed by the drone detected in the video data, the determination unit determines whether the drone complies with the predetermined rule. The identification unit identifies whether the drone detected in the monitoring area is an authorized drone or an unauthorized drone according to the determination result. The output unit outputs information about the identified drone.

[0071] The monitoring device of this embodiment identifies whether a drone detected in a monitoring area is an authorized drone or an unauthorized drone based on a pattern generated by the drone. Therefore, according to this embodiment, it is possible to monitor drones entering and leaving a monitoring area without using information transmitted from a remote ID device.

[0072] In one aspect of this embodiment, the determination unit determines whether the drone is following a predetermined rule according to the light emission pattern of the light emitter mounted on the drone. The identification unit identifies a drone that is following the predetermined rule as an authorized drone. The identification unit identifies a drone that is not following the predetermined rule as an authorized drone. In this aspect, whether the drone is following a predetermined rule is determined according to the light emission pattern of the light emitter. Therefore, according to this aspect, it is possible to monitor drones entering and leaving a monitoring area according to the light emission pattern of the light emitter.

[0073] In one aspect of the present embodiment, the determination unit determines whether the drone complies with a predetermined rule according to the drone's operation pattern. The identification unit identifies a drone that complies with the predetermined rule as an authorized drone. The identification unit identifies a drone that does not comply with the predetermined rule as an authorized drone. In this aspect, whether the drone complies with a predetermined rule is determined according to the drone's operation pattern. Therefore, according to this aspect, it is possible to monitor drones entering and leaving a monitoring area according to the drone's operation pattern.

[0074] In one aspect of this embodiment, the determination unit determines whether the drone complies with a predetermined rule according to the drone's route. The identification unit identifies a drone that complies with the predetermined rule as an permitted drone. The identification unit identifies a drone that does not comply with the predetermined rule as an permitted drone. In this aspect, it is determined whether the drone complies with the predetermined rule according to the drone's route. Therefore, according to this aspect, it is possible to monitor drones entering and leaving a monitoring area according to the drone's route.

[0075] The monitoring device according to one aspect of the present embodiment includes a storage unit. The storage unit stores information about a permission ticket issued for each drone. The determination unit determines whether the drone is complying with the predetermined rule based on a pattern conforming to the predetermined rule included in the permission ticket. The identification unit identifies a drone that conforms to the predetermined rule as an authorized drone. The identification unit identifies a drone that does not conform to the predetermined rule as an authorized drone. In this aspect, it is determined whether the drone is complying with the predetermined rule based on a pattern conforming to the predetermined rule included in the permission ticket issued for each drone. Therefore, according to this aspect, drones entering and leaving a monitoring area can be monitored based on the permission ticket.

[0076] In one aspect of this embodiment, the determination unit determines whether the drone is an unauthorized drone based on a pattern indicating an unauthorized drone. In response to a determination result that the drone is an unauthorized drone, the identification unit identifies the drone detected in the monitoring area as an unauthorized drone. The output unit outputs information about the drone identified as an unauthorized drone. In this aspect, only unauthorized drones are targeted for identification. Therefore, according to this aspect, the processing load in drone monitoring can be reduced.

[0077] Second embodiment Next, a monitoring system according to a second embodiment will be described with reference to the drawings. The monitoring system of this embodiment displays the position of a moving object that has entered a monitoring area on a map of the monitoring area. In this embodiment, as in the first embodiment, an airborne drone is used as an example of the moving object.

[0078] (composition) FIG. 18 is a block diagram showing an example of the configuration of a monitoring system 20 according to this embodiment. The monitoring system 20 includes a plurality of detection devices 21 and a monitoring device 23. The detection devices 21 and the monitoring devices 23 are communicatively connected by wireless communication. The detection devices 21 and the monitoring devices 23 may be communicatively connected by wired communication. There are no particular limitations on the communication method or communication standard for connecting the detection devices 21 and the monitoring devices 23. The detection device 21 has the same configuration as the detection device 11 of the first embodiment. Therefore, in the following, detailed description of the detection device 21 will be omitted.

[0079] [Monitoring device] 19 is a block diagram showing an example of the configuration of the monitoring device 23. The monitoring device 23 includes an acquisition unit 231, a determination unit 233, a storage unit 234, an identification unit 235, a map update unit 236, and an output unit 237.

[0080] The acquiring unit 231 has the same configuration as the acquiring unit 131 in the first embodiment. The acquiring unit 231 acquires a detection signal transmitted from the detection device 21. The acquiring unit 231 outputs the acquired detection signal to the determining unit 233.

[0081] The determination unit 233 has the same configuration as the determination unit 133 of the first embodiment. The determination unit 233 acquires the detection signal acquired by the acquisition unit 231. The determination unit 233 restores video data from the acquired detection signal. The determination unit 233 extracts a drone from the restored video data. The determination unit 233 detects a pattern according to a predetermined rule for the extracted drone. For example, the pattern according to the predetermined rule is a blinking pattern of a light, a frequency pattern of a signal, an operation pattern of a drone, or the like. For example, the pattern according to the predetermined rule is set according to a time period. For example, the pattern according to the predetermined rule is set according to a position in the monitoring area SA. For example, the pattern according to the predetermined rule is set for each individual drone.

[0082] The storage unit 234 has the same configuration as the storage unit 134 of the first embodiment. The storage unit 234 stores information including a pattern according to a predetermined rule. The pattern according to the predetermined rule is set for a drone permitted to enter the monitored area. The storage unit 234 also stores a map of the monitored area (also called a monitored area map). Drones detected in the monitored area are mapped on the monitored area map.

[0083] The identification unit 235 identifies whether the drone is an unauthorized drone or an authorized drone, depending on the determination result of the determination unit 233. For example, the identification unit 235 identifies the unauthorized drone based on image data of the drone identified as an unauthorized drone. For example, the identification unit 235 may identify the unauthorized drone based on information transmitted from a remote ID device of the drone identified as an unauthorized drone. For example, the identification unit 235 identifies information about the unauthorized drone, such as the model or shape of the identified unauthorized drone.

[0084] The identification unit 235 identifies the position of the drone in the monitoring area. The identification unit 235 identifies the positions of the permitted drone and the unauthorized drone in the monitoring area. The identification unit 235 also identifies the position of the unconfirmed drone in the monitoring area. The unconfirmed drone is a drone that has not been identified as either an authorized drone or an unauthorized drone. For example, the identification unit 235 calculates the position of the drone based on the position of the detection device 21 that captured the image data from which the drone is extracted. The identification unit 235 outputs the position of the drone in the monitoring area to the map update unit 236. The identification unit 235 outputs information indicating whether the drone is an authorized drone or an unauthorized drone and the drone's aircraft identifier in association with the position of the drone.

[0085] The map update unit 236 acquires the position of the drone detected in the monitored area from the identification unit 235. In response to the acquisition of the drone's position, the map update unit 236 updates the monitored area map stored in the storage unit 234. The map update unit 236 adds a marker indicating whether the drone is an permitted drone or a non-permitted drone to the monitored area map in association with the drone's position.

[0086] Fig. 20 is a conceptual diagram showing an example of a monitoring area map generated by the map update unit 236. In Fig. 20, an authorized drone A, an unauthorized drone D, and an unconfirmed drone U are mapped in a monitoring area SA set around a monitored facility MF. According to the monitoring area map in Fig. 20, the positions and permission status of the drones located in the monitoring area SA can be visually grasped.

[0087] Fig. 21 is a conceptual diagram showing another example of a monitoring area map generated by the map update unit 236. In Fig. 21, an unauthorized drone D and an unconfirmed drone U are mapped in a monitoring area SA set around a monitored facility MF. Since permitted drones are not displayed in the monitoring area map in Fig. 21, the data capacity and update addition of the monitoring area map can be reduced. According to the monitoring area map in Fig. 21, the position and permission status of the drones located in the monitoring area SA can be visually grasped.

[0088] The output unit 237 outputs the monitoring area map. For example, the output unit 237 outputs the monitoring area map to a management terminal (not shown) of an administrator who uses the monitoring system 20. For example, the monitoring area map is displayed on a screen of the management terminal of the administrator. The monitoring area map may be accumulated in a database (not shown) in which the entry and exit management of drones in the monitoring area SA is recorded. No limitations are placed on the use of the monitoring area map.

[0089] There is no limitation on the timing at which the output unit 237 outputs the monitoring area map. For example, the output unit 237 outputs the updated monitoring area map in accordance with the timing at which the monitoring area map is updated. For example, the output unit 237 outputs the monitoring area map at a preset timing. For example, the output unit 237 outputs the monitoring area map in response to an external request.

[0090] (operation) Next, an example of the operation of the monitoring system 20 according to this embodiment will be described with reference to the drawings. In the following, an example of the operation of the monitoring device 23 included in the monitoring system 20 will be described with reference to a flowchart.

[0091] Fig. 22 is a flowchart for explaining an example of the operation of the monitoring device 23. In explaining the process according to the flowchart of Fig. 22, the components of the monitoring device 23 will be described as the subject of the operation. The subject of the operation of the process according to the flowchart of Fig. 22 may be the monitoring device 23.

[0092] 22, first, when a detection signal is acquired (Yes in step S21), the acquisition unit 231 acquires information about the detected drone from the detection signal (step S22). If a detection signal is not acquired (No in step S21), the acquisition unit 231 waits until a detection signal is acquired.

[0093] Next, the determination unit 233 determines whether the information about the detected drone includes a pattern that follows a predetermined rule (step S23). The determination unit 233 determines whether the information about the detected drone includes a pattern that follows a predetermined rule based on the information about each drone stored in the storage unit 234.

[0094] If a pattern conforming to the predetermined rule is included (Yes in step S23), the identification unit 235 identifies the drone as an authorized drone (step S24). On the other hand, if a pattern conforming to the predetermined rule is not included (No in step S23), the identification unit 235 identifies the drone as an unauthorized drone (step S25).

[0095] After steps S24 and S25, the map update unit 236 updates the monitoring area map (step S26).

[0096] The output unit 237 outputs the updated monitoring area map (step S27). If monitoring is to be continued (Yes in step S28), the process returns to step S21. If monitoring is to be stopped (No in step S28), the process according to the flowchart in Fig. 22 ends. The criteria for continuing or stopping monitoring may be set in advance.

[0097] As described above, the monitoring system of the present embodiment includes at least one detection device and a monitoring device. The detection device detects a drone that has entered a monitoring area. The detection device captures an area including the detected drone. The detection device transmits the captured video data to the monitoring device. The monitoring device includes an acquisition unit, a determination unit, a specification unit, a storage unit, a map update unit, and an output unit. The acquisition unit acquires a detection signal including video data of the monitoring area. The storage unit stores a pattern according to a predetermined rule for each drone. Based on a pattern expressed by the drone detected in the video data, the determination unit determines whether the drone complies with the predetermined rule. The specification unit specifies whether the drone detected in the monitoring area is an authorized drone or an unauthorized drone according to the determination result. The map update unit updates a monitoring area map in which the position of the drone detected in the monitoring area is mapped. The map update unit adds a marker indicating whether the drone detected in the monitoring area is an authorized drone or an unauthorized drone to the monitoring area map in association with the position of the drone. The output unit outputs information regarding the specified drone. The output unit outputs the monitoring area map.

[0098] The monitoring device of this embodiment identifies whether a drone detected in a monitoring area is an authorized drone or an unauthorized drone based on a pattern generated by the drone. The monitoring device of this embodiment adds a marker indicating whether the drone detected in the monitoring area is an authorized drone or an unauthorized drone to the monitoring area map in association with the drone's position. Therefore, according to this embodiment, it is possible to visually grasp whether a drone located in the monitoring area is an authorized drone or an unauthorized drone.

[0099] Third embodiment Next, a monitoring device according to a third embodiment will be described with reference to the drawings. The monitoring device of this embodiment has a simplified configuration of the monitoring device included in the monitoring system according to the first and second embodiments.

[0100] (composition) 23 is a block diagram showing an example of the configuration of a monitoring device 33 according to this embodiment. The monitoring device 33 includes an acquisition unit 331, a determination unit 333, an identification unit 335, and an output unit 337.

[0101] The acquisition unit 331 acquires a detection signal including video data of a monitored area. The determination unit 333 determines whether the drone complies with a predetermined rule based on a pattern of the drone detected in the video data. The identification unit 335 identifies whether the drone detected in the monitored area is an authorized drone or an unauthorized drone according to the determination result. The output unit 337 outputs information about the identified drone.

[0102] (operation) Fig. 24 is a flowchart for explaining an example of the operation of the monitoring device 33 according to this embodiment. In explaining the process according to the flowchart of Fig. 24, the components of the monitoring device 33 will be described as the subject of the operation. The subject of the operation of the process according to the flowchart of Fig. 24 may be the monitoring device 33.

[0103] In FIG. 24, first, the acquisition unit 331 acquires a detection signal including video data in which a monitoring area is captured (step S31).

[0104] Next, the determination unit 333 determines whether the drone is following a predetermined rule based on a pattern by the drone detected in the video data (step S32).

[0105] Next, the identification unit 335 identifies whether the drone detected in the monitoring area is an authorized drone or an unauthorized drone, depending on the determination result (step S33).

[0106] Next, the output unit 337 outputs information about the identified drone (step S34).

[0107] The monitoring device of this embodiment identifies whether a drone detected in a monitoring area is an authorized drone or an unauthorized drone based on a pattern generated by the drone in the video data of the monitoring area. Therefore, according to this embodiment, it is possible to monitor drones entering and leaving a monitoring area without using information transmitted from a remote ID device.

[0108] (Hardware) Next, a hardware configuration for executing control and processing according to each embodiment of the present disclosure will be described with reference to the drawings. Here, an information processing device 90 (computer) in FIG. 25 is given as an example of such a hardware configuration. The information processing device 90 in FIG. 25 is an example of a configuration for executing control and processing according to each embodiment, and does not limit the scope of the present disclosure.

[0109] As shown in Fig. 25, an information processing device 90 includes a processor 91, a main storage device 92, an auxiliary storage device 93, an input / output interface 95, and a communication interface 96. In Fig. 25, the interface is abbreviated as I / F (Interface). The processor 91, the main storage device 92, the auxiliary storage device 93, the input / output interface 95, and the communication interface 96 are connected to each other via a bus 98 so as to be able to communicate data with each other. In addition, the processor 91, the main storage device 92, the auxiliary storage device 93, and the input / output interface 95 are connected to a network such as the Internet or an intranet via the communication interface 96.

[0110] The processor 91 loads a program (instructions) stored in the auxiliary storage device 93 or the like into the main storage device 92. For example, the program is a software program for executing the control and processing of each embodiment. The processor 91 executes the program loaded into the main storage device 92. The processor 91 executes the program to execute the control and processing of each embodiment.

[0111] The main memory device 92 has an area in which a program is loaded. The processor 91 loads a program stored in the auxiliary memory device 93 or the like in the main memory device 92. The main memory device 92 is realized by a volatile memory such as a dynamic random access memory (DRAM). Furthermore, a non-volatile memory such as a magneto resistive random access memory (MRAM) may be configured / added to the main memory device 92.

[0112] The auxiliary storage device 93 stores various data such as programs. The auxiliary storage device 93 is realized by a local disk such as a hard disk or a flash memory. Note that it is also possible to configure the main storage device 92 to store various data and omit the auxiliary storage device 93.

[0113] The input / output interface 95 is an interface for connecting the information processing device 90 to peripheral devices based on standards and specifications. The communication interface 96 is an interface for connecting to an external system or device through a network such as the Internet or an intranet based on standards and specifications. The input / output interface 95 and the communication interface 96 may be a common interface for connecting to an external device.

[0114] Input devices such as a keyboard, a mouse, and a touch panel may be connected to the information processing device 90 as necessary. These input devices are used to input information and settings. When a touch panel is used as the input device, a screen having the function of the touch panel becomes the interface. The processor 91 and the input devices are connected via an input / output interface 95.

[0115] The information processing device 90 may be equipped with a display device for displaying information. When the display device is equipped, the information processing device 90 is equipped with a display control device (not shown) for controlling the display of the display device. The information processing device 90 and the display device are connected via an input / output interface 95.

[0116] The information processing device 90 may be provided with a drive device. The drive device mediates between the processor 91 and a recording medium (program recording medium) in reading data and programs stored in the recording medium and writing the processing results of the information processing device 90 to the recording medium. The information processing device 90 and the drive device are connected via an input / output interface 95.

[0117] The above is an example of a hardware configuration for enabling the control and processing according to each embodiment of the present disclosure. The hardware configuration in FIG. 25 is an example of a hardware configuration for executing the control and processing according to each embodiment, and does not limit the scope of the present disclosure. A program for causing a computer to execute the control and processing according to each embodiment is also included in the scope of the present disclosure.

[0118] A program recording medium on which the program according to each embodiment is recorded is also included in the scope of the present disclosure. The recording medium can be realized by an optical recording medium such as a CD (Compact Disc) or a DVD (Digital Versatile Disc). The recording medium may be realized by a semiconductor recording medium such as a USB (Universal Serial Bus) memory or an SD (Secure Digital) card. The recording medium may also be realized by a magnetic recording medium such as a flexible disk or other recording medium. When the program executed by the processor is recorded on a recording medium, the recording medium corresponds to a program recording medium.

[0119] The components of each embodiment may be combined in any manner. The components of each embodiment may be realized by software. The components of each embodiment may be realized by a circuit.

[0120] Although the present invention has been described above with reference to the embodiments, the present invention is not limited to the above-mentioned embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention. [Explanation of symbols]

[0121] 10, 20 Surveillance System 11, 21 Detection device 13, 23 Monitoring equipment 16 Control device 111 Detector 113 Control Unit 115 Communications Department 131, 231, 331 Acquisition Department 133, 233, 333 Judgment section 134, 234 Storage section 135, 235, 335 Specific part 137, 237, 337 Output section 150 Propeller 151 Blade 152 Motor 154 frames 156 Light emitter 157 Camera 160 Body 161 Antenna 162 Communications Department 163 Control Unit 165 Propeller drive unit 166 Location identification part 167 Memory section 169 Power source 236 Map Update Department

Claims

1. an acquisition unit that acquires a detection signal including video data of a monitored area; A determination unit that determines whether the drone complies with a predetermined rule based on a pattern exhibited by the drone detected in the video data; An identification unit that identifies whether the drone detected in the monitoring area is an authorized drone or an unauthorized drone according to a determination result; A monitoring device equipped with an output unit that outputs information regarding the identified drone.

2. The determination unit is determining whether the drone is complying with the predetermined rule according to a light emission pattern of a light emitter mounted on the drone; The identification unit is Identifying the drone that complies with the predetermined rule as the permitted drone; The monitoring device according to claim 1 , wherein the drone that does not comply with the specified rules is identified as an authorized drone.

3. The determination unit is Determining whether the drone is complying with the predetermined rule according to an operation pattern of the drone; The identification unit is Identifying the drone that complies with the predetermined rule as the permitted drone; The monitoring device according to claim 1 , wherein the drone that does not comply with the specified rules is identified as an authorized drone.

4. The determination unit is Determine whether the drone is the authorized drone or the unauthorized drone according to the route of the drone; The identification unit is Identifying the drone that complies with the predetermined rule as the permitted drone; The monitoring device according to claim 1 , wherein the drone that does not comply with the specified rules is identified as an authorized drone.

5. A storage unit that stores information regarding a permission ticket issued for each drone, The determination unit is Determine whether the drone is complying with the predetermined rule based on a pattern conforming to the predetermined rule included in the permission ticket; The identification unit is Identifying the drone that complies with the predetermined rule as the permitted drone; The monitoring device according to claim 1 , wherein the drone that does not comply with the specified rules is identified as an authorized drone.

6. The determination unit is determining whether the drone is a unauthorized drone based on a pattern indicative of the unauthorized drone; The identification unit is In response to a determination result that the drone is the unauthorized drone, the drone detected in the monitoring area is identified as the unauthorized drone; The output unit is The monitoring device described in claim 5 , which outputs information regarding the drone identified as the unauthorized drone.

7. A map update unit updates a monitoring area map in which the position of the drone detected in the monitoring area is mapped, The map update unit is Adding a mark indicating whether the drone detected in the monitoring area is the permitted drone or the unauthorized drone to the monitoring area map in association with the position of the drone; The output unit is The monitoring device according to claim 1 , further comprising: a monitor that outputs the monitoring area map.

8. A monitoring device according to any one of claims 1 to 7; A surveillance system comprising at least one detection device that detects a drone entering a surveillance area, photographs the area including the detected drone, and transmits the photographed video data to the surveillance device.

9. The computer A detection signal including image data of a monitored area is obtained; determining whether the drone complies with a predetermined rule based on a pattern exhibited by the drone detected in the video data; Depending on the determination result, identify whether the drone detected in the monitoring area is an authorized drone or an unauthorized drone; A surveillance method that outputs information regarding the identified drone.

10. A process of acquiring a detection signal including image data of a monitored area; determining whether the drone complies with a predetermined rule based on a pattern exhibited by the drone detected in the video data; A process of identifying whether the drone detected in the monitoring area is an authorized drone or an unauthorized drone depending on the determination result; A program that causes a computer to execute a process of outputting information about the identified drone.

Citation Information

Patent Citations

  • Drone monitoring system and drone monitoring method

    JP2019040321A

  • Flight limitation system and flight limitation method

    JP2019104307A