Foreign matter removal system, foreign matter collection device, and foreign matter removal method

Abstract

To reduce the time and manpower required for collecting foreign objects detected by a radar device.SOLUTION: When an object detected by a radar device 100 is determined to be a foreign object, a foreign object collection device 300 moves to the position where the object exists based on position information of the object and recovers the object. After that, the foreign object collection device 300 transmits to a radar monitoring device 200 a foreign object collection notification indicating that the object has been recovered. After receiving the foreign object collection notification, the radar monitoring device 200 transmits a collection confirmation notification indicating that the object collection is confirmed to the foreign object collection device 300 when it is confirmed that the radar device 100 can no longer detect the object within the detection range R. After receiving the collection confirmation notification, the foreign object collection device 300 withdraws from the spot.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to a foreign object removal system that removes foreign objects detected by a radar device. [Background technology]

[0002] An example of a radar device using microwaves or millimeter waves is an FMCW (Frequency Modulated Continuous-Wave) radar device with a structure as shown in FIG. 1. The radar device 100 in Fig. 1 amplifies a frequency-modulated radar signal from an FMCW transmission source 101 by a transmission power amplifier 103 and emits it from a transmission antenna 104. If an object T (reflecting object) is present within the detection range of the radar device 100, the radar transmission wave is reflected by the object T. The reflected wave from the object T is received by a receiving antenna 105 of the radar device 100, amplified by a receiving power amplifier 106, and then mixed with a transmitted radar signal component from a power distributor 102 by a mixer 107 and converted into an IF signal. The IF signal output from the mixer 107 is A / D converted and signal processed by a signal processing unit 108. As a result, radar detection results such as the reflected reception power (reflected wave power) by the object T, the distance to the object T, the direction of the object T, and the speed of the object T when it is moving (relative speed with respect to the radar device 100) can be obtained.

[0003] The following are examples of conventional technologies in the technical field of the present invention. For example, Patent Document 1 discloses an invention in which a detection device detects position information of a fallen object and transmits it to an object search device, and the object search device displays the position information of the fallen object in an augmented reality space as a specific display (such as an arrow or a wavy shape) based on the position information of the fallen object and its own position information. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] International Publication No. 2019 / 065045 Summary of the Invention [Problem to be solved by the invention]

[0005] Radar devices are used to detect objects on the surface of roads, runways, etc. For example, a system to detect foreign objects on airport runways uses a linear cell radar system in which multiple radar devices are arranged in a line along the runway.

[0006] Conventionally, the detection and removal of foreign objects on airport runways is carried out according to the procedure shown in Figure 2. That is, (1) a radar device scans the runway surface to detect objects on the runway. As a result, (2) when an object is detected by the radar device, (3) the object detection information is displayed on a monitor in the control tower. (4) A monitor who sees the display on the monitor determines whether the object is a foreign object (an object that should be removed), and then issues instructions to a worker to remove the foreign object. (5) The worker who received the instructions goes to the site and removes the foreign object, and (6) records the details of the work.

[0007] In this way, the personnel required to detect and collect foreign objects consisted of monitors in the control tower who would determine whether or not something was a foreign object and give instructions to collect it, and workers who would actually collect the object according to those instructions. In this case, the monitors in the control tower would check the object once and then give instructions to the workers to collect it, so it took time to collect it. In addition, a large number of personnel were required to deploy both monitors and workers.

[0008] The present invention has been made in consideration of the above-mentioned conventional circumstances, and has an object to reduce the time and manpower required to collect foreign objects detected by a radar device. [Means for solving the problem]

[0009] In order to achieve the above object, a foreign object removal system according to one aspect of the present invention is configured as follows: That is, the foreign object removal system according to the present invention includes a radar device that detects an object present within a predetermined detection range, a radar monitoring device that controls the radar device, and a foreign object collection device that, when an object detected by the radar device is determined to be a foreign object, moves to a location where the object is present based on position information of the object and collects the object, the foreign object collection device transmits a foreign object collection notification indicating that collection of the object has been completed to the radar monitoring device after collecting the object, the radar monitoring device transmits a collection confirmation notification indicating that collection of the object has been confirmed to the foreign object collection device when it is confirmed that the radar device can no longer detect the object from within the detection range after receiving the foreign object collection notification, and the foreign object collection device withdraws from the location after receiving the collection confirmation notification.

[0010] Here, the foreign object removal system of the present invention may further include a camera device that photographs the object based on the position information of the object detected by the radar device, and the foreign object collection device may be configured to receive the image photographed by the camera device and determine whether the object depicted in the image is a foreign object or not.

[0011] In addition, in the foreign object removal system of the present invention, the foreign object collection device can be configured to photograph the object on site before collecting the object, and to transmit the image of the object photographed on site to the radar monitoring device after collecting the object.

[0012] In addition, in the foreign object removal system of the present invention, the radar monitoring device can be configured to periodically acquire object location information and transmit it to the foreign object collection device, and the foreign object collection device can be configured to move to the location where the object is located based on the object location information received periodically from the radar monitoring device.

[0013] Furthermore, a foreign object collection device according to another aspect of the present invention is configured as follows: That is, the foreign object collection device according to the present invention is a foreign object collection device that communicates with a radar monitoring device that controls a radar device that detects objects present within a predetermined detection range, and when an object detected by the radar device is determined to be a foreign object, moves to a location where the object is present based on position information of the object, and after collecting the object, transmits a foreign object collection notification to the radar monitoring device indicating that collection of the object has been completed, and withdraws from the location after receiving a collection confirmation notification from the radar monitoring device indicating that collection of the object has been confirmed.

[0014] Furthermore, a foreign object removal method according to yet another aspect of the present invention is configured as follows: That is, the foreign object removal method according to the present invention is characterized in that a radar device detects an object present within a predetermined detection range under the control of a radar monitoring device, and when the object detected by the radar device is determined to be a foreign object, the foreign object collection device moves to a location where the object is present based on position information of the object, and after collecting the object, transmits a foreign object collection notification to the radar monitoring device indicating that collection of the object has been completed, and when the radar monitoring device confirms after receiving the foreign object collection notification that the radar device can no longer detect the object from within the detection range, the radar monitoring device transmits a collection confirmation notification to the foreign object collection device indicating that collection of the object has been confirmed, and the foreign object collection device withdraws from the location after receiving the collection confirmation notification. Effect of the Invention

[0015] According to the present invention, it is possible to reduce the time and manpower required to collect a foreign object detected by a radar device. [Brief description of the drawings]

[0016] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of a radar device. [Diagram 2] FIG. 1 is a diagram showing a conventional procedure for detecting and collecting foreign objects. [Diagram 3] 1 is a diagram showing an overview of a foreign matter removal system according to an embodiment of the present invention. [Figure 4] FIG. 4 is a diagram showing the procedure for detecting and collecting foreign objects by the foreign object removal system of FIG. 3. [Diagram 5] 4 is a diagram showing an example of the configuration of a foreign matter recovery device in the foreign matter removal system of FIG. 3. [Figure 6] 4 is a diagram showing an example of a process flow for collecting foreign matter by the foreign matter removal system of FIG. 3. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0017] An embodiment of the present invention will be described with reference to the drawings. Fig. 3 shows an outline of a foreign object removal system according to an embodiment of the present invention. The foreign object removal system of this example includes a radar device 100 and a camera device 120 installed facing a predetermined detection range R such as a runway, a radar monitoring device 200 and a display device 220 installed in a control room or a monitoring room in a control tower, and a foreign object recovery device 300 which is an autonomously traveling robot. Fig. 3 shows only one radar device 100 and one camera device 120, but multiple radar devices 100 and camera devices 120 may be installed.

[0018] The radar device 100 receives reflected waves of the radar transmission waves transmitted within the detection range R, and outputs the results of signal processing to the radar monitoring device 200. Based on the data output from the radar device 100, the radar monitoring device 200 displays position information of an object (foreign object X such as a fallen object or an abandoned object) present within the detection range R on the display device 220. The radar monitoring device 200 further controls the camera device 120 based on the position information so as to capture an image of the object detected by the radar device 100, and displays the captured image on the display device 220. This allows a monitor looking at the display on the display device 220 to confirm the position and appearance of the object detected by the radar device 100.

[0019] Position information of an object detected by the radar device 100 can be calculated based on the coordinates (e.g., latitude and longitude information) of the installation position of the radar device 100 and the distance and angle (azimuth) of the object relative to the radar device 100. The distance from the radar device 100 to the object can be calculated based on the reception intensity of the wave reflected from the object, for example. Furthermore, the angle of the object relative to the radar device 100 can be identified based on the rotation angle information of the antenna at the time the object is detected if the antenna of the radar device 100 is mechanically rotated, or can be identified based on the scanning angle information of the beam at the time the object is detected if the angle of the radar transmission wave beam emitted from the antenna of the radar device 100 is electronically scanned.

[0020] Conventionally, a monitor who sees the display on the display device 220 confirms the presence of an object within the detection range R, and when the monitor determines that the object is a foreign object that should be collected, issues a collection instruction to a worker. In contrast, in the foreign object removal system of this embodiment, a single robot (foreign object collection device 300) is configured to perform a series of steps from determining whether or not an object is a foreign object to collecting the object. That is, as shown in FIG. 4, (1) the radar device 100 scans the runway surface to detect objects on the runway. As a result, (2) when any object is detected by the radar device 100, an image is taken by the camera device 120, and the image is transmitted to the foreign object collection device 300 via the radar monitoring device 200. (3) The foreign object collection device 300 determines whether the detected object is a foreign object based on the received image, and then (4) automatically moves to the location of the foreign object and collects the foreign object.

[0021] 5 shows an example of the configuration of a foreign object collection device 300 that automatically determines whether an object is a foreign object and collects it. The foreign object collection device 300 in this example is assumed to be a vehicle-type robot that travels automatically, but an unmanned aerial vehicle such as a drone may also be used. As shown in FIG. 5, the foreign object collection device 300 includes a wireless transceiver 301, a GPS (Global Positioning System) receiver 302, a travel control unit 303, a foreign object discrimination unit 304, a foreign object collection machine 305, a camera 306, and a control unit 307.

[0022] The wireless transceiver 301 wirelessly transmits and receives data to and from the radar monitoring device 200. The wireless transceiver 301 receives data from the radar monitoring device 200, such as position information of an object detected by the radar device 100 and images captured by the camera device 120. The wireless transceiver 301 also transmits various notifications, which will be described later, to the radar monitoring device 200.

[0023] The GPS receiver 302 receives radio waves from GPS satellites and acquires current position information (e.g., latitude and longitude information) of the foreign object collection device 300. The travel control unit 303 autonomously controls the travel of the foreign object collection device 300. More specifically, the travel control unit 303 periodically calculates the direction and distance to the location where the target object is located based on the position information of the object to be collected (foreign object) and the current position information of the foreign object collection device 300, and moves the foreign object collection device 300 toward that location.

[0024] The foreign object discriminator 304 discriminates whether or not an object detected by the radar device 100 is a foreign object based on an image captured by the camera device 120. The foreign object discriminator 304 may be realized using, for example, AI (Artificial Intelligence) technology. That is, the foreign object discriminator 304 can determine whether or not an object captured in an image is a foreign object by AI analysis using data (learning model) that has been modeled in advance by machine learning.

[0025] The foreign object collector 305 operates after the foreign object collector 300 has moved to the location where the foreign object is present, and collects the foreign object from the runway surface. The camera 306 photographs the foreign object on the spot before the foreign object collector 305 collects the foreign object. The image of the foreign object captured by the camera 306 is transmitted to the radar monitoring device 200 together with a foreign object collection notice after collection of the foreign object is completed. The foreign object collector 305 and the camera 306 are attached, for example, to the underside of the foreign object collector 300. The control unit 307 comprehensively controls the operations of each unit (301 to 306) of the foreign object collector 300.

[0026] The flow of foreign matter collection by the foreign matter removal system of this embodiment will be described with reference to the example of the process flow of FIG. The radar monitoring device 200 controls the radar device 100 to periodically repeat scanning of the runway (step S11), and when an object on the runway is detected, controls the camera device 120 based on the position information of the object to capture an image of the detected object (step S12). The image captured by the camera device 120 is transmitted to the foreign object collection device 300 via the radar monitoring device 200 (step S13). At this timing, the position information of the object may also be transmitted to the foreign object collection device 300.

[0027] When the foreign object collection device 300 receives the image captured by the camera device 120, the foreign object discrimination unit 304 determines whether the object captured in the image is a foreign object (step S14). As a result, if it is determined that the object is not a foreign object (step S14; No), the foreign object collection device 300 transmits a non-foreign object notification indicating that the object was not a foreign object to the radar monitoring device 200. When the radar monitoring device 200 receives the non-foreign object notification from the foreign object collection device 300, it causes the display device 220 to display information that the detected object is not a foreign object.

[0028] On the other hand, if it is determined that the object shown in the image captured by the camera device 120 is a foreign object (step S14; Yes), the foreign object collection device 300 starts the following collection action. First, the foreign object collection device 300 receives object position information from the radar monitoring device 200, and based on the object position information, moves toward the location (site) where the object is located under the control of the travel control unit 303 (step S15). If a possible route within the runway has been determined in advance, the foreign object collection device moves without deviating from that route. Note that since the detected object may move due to wind or the like, the object position information may be periodically reacquired and the movement direction of the foreign object collection device 300 may be appropriately corrected.

[0029] Thereafter, when the foreign object collection device 300 arrives at the scene, it determines whether or not a foreign object actually exists at the scene (step S16). Whether or not a foreign object actually exists at the scene can be determined, for example, by capturing an image of the scene with the on-board camera 306 and analyzing the image.

[0030] As a result, when it is determined that no foreign object is present at the site (step S16; No), the foreign object collection device 300 transmits a foreign object absence notification indicating that no foreign object was present at the site to the radar monitoring device 200, and returns to its original position. When the foreign object absence notification is received from the foreign object collection device 300, information indicating that no foreign object was present at the site is displayed on the display device 220. Note that an example of a situation in which a foreign object is detected but is not present at the site is when the foreign object is naturally removed from the runway by the wind while the foreign object collection device 300 is moving.

[0031] On the other hand, if it is determined that a foreign object exists at the site (step S16; Yes), the foreign object collecting device 300 photographs the foreign object with the on-board camera 306, and then operates the foreign object collecting machine 305 to collect the foreign object (step S17). After that, the foreign object collecting device 300 transmits a foreign object collection notification indicating that collection of the foreign object has been completed to the radar monitoring device 200 together with a collected object image photographed at the site. When the radar monitoring device 200 receives the foreign object collection notification from the foreign object collecting device 300, it checks whether the radar device 100 can no longer detect the foreign object that existed on the runway. As a result, when it is confirmed that the foreign object that existed on the runway can no longer be detected (i.e., the foreign object has been collected), the radar monitoring device 200 transmits a collection confirmation notification indicating that collection of the foreign object has been confirmed to the foreign object collecting device 300. After receiving the collection confirmation notification from the radar monitoring device 200, the foreign object collecting device 300 returns to the original location (step S18).

[0032] As described above, the foreign object removal system of this example includes the radar device 100 that detects an object present within a predetermined detection range R, the radar monitoring device 200 that controls the radar device 100, and the foreign object collection device 300 that, when an object detected by the radar device 100 is determined to be a foreign object, moves to a location where the object is present based on the object's position information and collects the object. After collecting the object, the foreign object collection device 300 transmits a foreign object collection notification indicating that collection of the object has been completed to the radar monitoring device 200. When the radar monitoring device 200 confirms, after receiving the foreign object collection notification, that the radar device 100 can no longer detect the object from within the detection range R, the radar monitoring device 200 transmits a collection confirmation notification indicating that collection of the object has been confirmed to the foreign object collection device 300. After receiving the collection confirmation notification, the foreign object collection device 300 retreats from the scene.

[0033] According to this configuration, the foreign object detected by the radar device can be automatically removed without manual intervention, which makes it possible to significantly reduce the time and manpower required to collect the foreign object.

[0034] Furthermore, in the foreign object removal system of this embodiment, the foreign object collection device 300 photographs the object on the spot before collecting the object, and transmits the image of the object photographed on the spot to the radar monitoring device 200 after collecting the object. Therefore, the image of the object actually collected by the foreign object collection device 300 can be kept as a record. Also, for example, it is possible to have a monitor confirm the object that was actually collected by displaying the image of the object photographed by the foreign object collection device 300 on the display device 220.

[0035] Furthermore, in the foreign object removal system of this example, the radar monitoring device 200 periodically acquires object position information and transmits it to the foreign object collection device 300, and the foreign object collection device 300 moves to the location of the object based on the object position information periodically received from the radar monitoring device 200. Therefore, even if the object moves due to wind or the like, the movement direction of the foreign object collection device 300 can be appropriately corrected, so that the foreign object collection device can reliably move to the location of the object.

[0036] In the foreign object removal system of this example, the foreign object collection device 300 determines whether an object detected by the radar device 100 is a foreign object or not based on an image captured by the camera device 120, but such a determination may also be performed by another device (e.g., the radar monitoring device 200).

[0037] Also, the result of the determination by the foreign object collection device 300 may be displayed on the display device 220 for the monitor to confirm. In this case, if the monitor determines that the determination by the foreign object collection device 300 is incorrect, the operation of the foreign object collection device 300 may be corrected. That is, an operation unit may be provided that receives an instruction from the monitor to cause the foreign object collection device 300 to start a collection action or an instruction to cancel the collection action of the foreign object collection device 300, and a control signal may be sent to the foreign object collection device 300 via the radar monitoring device 200 in response to receiving such an instruction.

[0038] In the above description, whether or not an object detected by the radar device 100 is a foreign object is determined based on one image captured from a specific direction by one camera device 120, but multiple images captured from different directions by multiple camera devices 120 may be used for the determination. This allows for more accurate determination of whether or not an object detected by the radar device 100 is a foreign object.

[0039] Although the embodiments of the present invention have been described above, these embodiments are merely illustrative and do not limit the technical scope of the present invention. The present invention can take various other embodiments, and various modifications such as omissions and substitutions can be made without departing from the gist of the present invention. These embodiments and modifications are included in the scope and gist of the invention described in this specification, etc., and are included in the scope of the invention described in the claims and their equivalents.

[0040] Furthermore, the present invention can be provided not only as devices such as those described above or as a system composed of these devices, but also as methods executed by these devices, programs for causing a processor to realize the functions of these devices, and storage media for storing such programs in a computer-readable format. [Industrial Applicability]

[0041] The present invention can be used in a foreign object removal system that removes foreign objects detected by a radar device. [Explanation of symbols]

[0042] 100: radar device, 101: FMCW transmission source, 102: power splitter, 103: transmission power amplifier, 104: transmission antenna, 105: reception antenna, 106: reception power amplifier, 107: mixer, 108: signal processing unit, 120: camera device, 200: radar monitoring device, 220: display device, 300: foreign object collection device, 301: wireless transceiver, 302: GPS receiver, 303: travel control unit, 304: foreign object discrimination unit, 305: foreign object collection machine, 306: camera, 307: control unit

Claims

1. A radar device that detects an object present within a predetermined detection range; A radar monitoring device for controlling the radar device; a foreign object recovery device that, when the object detected by the radar device is determined to be a foreign object, moves to a location where the object is present based on position information of the object and recovers the object, After collecting the object, the foreign object collection device transmits a foreign object collection notification indicating that collection of the object has been completed to the radar monitoring device; when it is confirmed that the radar device is no longer able to detect the object within the detection range after receiving the foreign object collection notification, the radar monitoring device transmits a collection confirmation notification indicating that collection of the object has been confirmed to the foreign object collection device; The foreign object removal system is characterized in that the foreign object recovery device withdraws from the site after receiving the recovery confirmation notice.

2. 2. The foreign matter removal system according to claim 1, The vehicle further includes a camera device that photographs the object based on position information of the object detected by the radar device, The foreign body removal system is characterized in that the foreign body collection device receives an image captured by the camera device and determines whether the object captured in the image is a foreign body or not.

3. 3. The foreign matter removal system according to claim 1, A foreign object removal system characterized in that the foreign object collection device photographs the object on site before collecting the object, and transmits the image of the object taken on site to the radar monitoring device after collecting the object.

4. The foreign matter removal system according to any one of claims 1 to 3, the radar monitoring device periodically acquires position information of the object and transmits it to the foreign object recovery device; A foreign object removal system characterized in that the foreign object collection device moves to a location where the object is located based on position information of the object periodically received from the radar monitoring device.

5. A foreign object collection device that communicates with a radar monitoring device that controls a radar device that detects objects present within a predetermined detection range, When the object detected by the radar device is determined to be a foreign object, the foreign object collection device moves to the location where the object is located based on the object's position information, and after collecting the object, transmits a foreign object collection notification to the radar monitoring device indicating that the collection of the object has been completed, and withdraws from the scene after receiving a collection confirmation notification from the radar monitoring device indicating that the collection of the object has been confirmed.

6. The radar device detects an object present within a predetermined detection range under the control of the radar monitoring device, a foreign object collection device, when the object detected by the radar device is determined to be a foreign object, moves to a location where the object is present based on position information of the object, collects the object, and then transmits a foreign object collection notification to the radar monitoring device indicating that collection of the object has been completed; when the radar monitoring device confirms that the object can no longer be detected within the detection range by the radar device after receiving the foreign object collection notification, the radar monitoring device transmits a collection confirmation notification indicating that the collection of the object has been confirmed to the foreign object collection device; The foreign object removal method, characterized in that the foreign object recovery device withdraws from the site after receiving the recovery confirmation notice.

Images