Defense Systems

The defense system uses multiple unmanned aerial vehicles and a forklift to detect, photograph, and mask the presence of intruders in work areas, ensuring covert imaging and deterrence.

JP7786863B2Active Publication Date: 2025-12-16MITSUBISHI LOGISNEXT CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2023155817
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2023-09-21
Publication Date
2025-12-16
Estimated Expiration
2043-09-21

AI Technical Summary

Technical Problem

Existing unmanned aerial vehicle systems lack effective means to detect and deter unauthorized intruders in work areas such as factories or warehouses, posing a risk to stored items.

Method used

A defense system comprising multiple unmanned aerial vehicles and a forklift, controlled by a management device, where one vehicle detects intruders, another photographs, and the forklift outputs noise to mask the presence of the photographer, ensuring covert imaging.

Benefits of technology

Effectively photographs intruders while minimizing their awareness of being photographed, thereby deterring and identifying unauthorized access.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007786863000001
    Figure 0007786863000001
  • Figure 0007786863000002
    Figure 0007786863000002
  • Figure 0007786863000003
    Figure 0007786863000003
Patent Text Reader

Abstract

To provide a defense system capable of photographing an intruder who enters a working area in a factory, a warehouse or the like.SOLUTION: A defense system 1 comprises a first unmanned flying body 100-1, a second unmanned flying body 100-2, a moving body 200, and a management device 300, with the first unmanned flying body 100-1 comprising a detection part for detecting an intruder X who enters a working area 10, the second unmanned flying body 100-2 comprising a photographing part for photographing the intruder X, and the moving body 200 comprising a sound source part for outputting a noise sound for reducing a flying sound of the second unmanned flying body 100-2. When the first unmanned flying body 100-1 detects the intruder X, the management device 300 makes the moving body 200 output the noise sound until the second unmanned flying body 100-2 photographs the intruder X.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to a defense system using an unmanned aerial vehicle. [Background technology]

[0002] Conventionally, unmanned aerial vehicles known as drones have been used in work areas such as factories or warehouses. For example, Patent Document 1 describes a guidance system that includes a manned guided vehicle operated by an operator, one unmanned aerial vehicle capable of hovering in the air, and a management device that controls the unmanned aerial vehicle.

[0003] In the guidance system described in Patent Document 1, the unmanned aerial vehicle is equipped with a projector that projects a guidance image onto a road surface. The guidance image, for example, displays an arrow pointing in a specific direction and is projected onto the road surface in front of the manned guided vehicle. As a result, an operator operating the manned guided vehicle can be guided to the loading position by checking the guidance image.

[0004] In recent years, automated guided vehicles (AGVs) have been used instead of manned vehicles to reduce work loads. However, when an automated system is used in a work area such as a factory or warehouse, there is a risk that an unauthorized person (hereinafter referred to as an intruder) may enter the work area and steal or destroy items stored on shelves in the work area. In this regard, if an intruder can be photographed, the intruder can be identified, which can be expected to have a deterrent effect and protect the items. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Publication No. 2020-52629 Summary of the Invention [Problem to be solved by the invention]

[0006] The present invention has been made in consideration of the above circumstances, and its object is to provide a defense system that is capable of photographing an intruder who has entered a work area such as a factory or warehouse. [Means for solving the problem]

[0007] In order to solve the above problem, a defense system according to one embodiment of the present invention comprises: a first unmanned aerial vehicle and a second unmanned aerial vehicle capable of hovering in a predetermined work area; a moving body that moves in the working area; A management device that controls the first unmanned aerial vehicle, the second unmanned aerial vehicle, and the mobile vehicle; A defense system comprising: The first unmanned aerial vehicle is a detection unit for detecting an intruder who has entered the work area; The second unmanned aerial vehicle is a photographing unit for photographing the intruder, The moving body is a sound source unit that outputs noise to reduce the flight noise of the second unmanned aerial vehicle; The management device When the detection unit of the first unmanned aerial vehicle detects the intruder, the noise sound is output from the sound source unit of the moving body until the photographing unit of the second unmanned aerial vehicle photographs the intruder.

[0008] In this configuration, the sound source unit of the moving body outputs noise until the imaging unit of the second unmanned aerial vehicle captures an image of the intruder, making it difficult for the intruder to notice the presence of the second unmanned aerial vehicle, thereby enabling the second unmanned aerial vehicle to capture an image of the intruder.

[0009] In the defense system, The management device When the detection unit of the first unmanned aerial vehicle detects the intruder, determining a first movement path for the second unmanned aerial vehicle to approach the intruder and a second movement path for the moving vehicle to approach the intruder; It is preferable that an obstacle larger than the second unmanned aerial vehicle exists between the end point of the first movement path and the intruder.

[0010] In the defense system, The management device When the work area is viewed in a plane, the first movement path and the second movement path can be determined so as to satisfy the condition that the intruder is present in a triangular area whose vertices are the first unmanned aerial vehicle, the end point of the first movement path, and the end point of the second movement path.

[0011] In the defense system, The management device The second unmanned aerial vehicle can be configured to have the sound source unit of the moving body continue to output the noise sound even after the imaging unit of the second unmanned aerial vehicle has captured an image of the intruder.

[0012] In the defense system, the moving body is a forklift equipped with forks, The management device The forklift may be configured to cause the sound source unit to output the noise and to raise and lower the forks at a predetermined timing.

[0013] In the defense system, The moving body may be a third unmanned aerial vehicle capable of hovering in the air.

[0014] A defense system according to another embodiment of the present invention includes: an unmanned aerial vehicle capable of hovering in the air in a predetermined work area; a moving body that moves in the working area; a management device that controls the unmanned aerial vehicle and the mobile vehicle; A defense system comprising: The unmanned aerial vehicle is a photographing unit for photographing an intruder who has invaded the work area; The moving body is a sound source unit that outputs noise to reduce the flight noise of the unmanned aerial vehicle; The management device The noise sound is output from the sound source unit of the moving body while the unmanned aerial vehicle is flying towards the intruder and while the imaging unit of the unmanned aerial vehicle is imaging the intruder. [Effects of the Invention]

[0015] According to the present invention, it is possible to provide a defense system capable of photographing an intruder who has invaded a work area such as a factory or warehouse. [Brief explanation of the drawings]

[0016] [Figure 1] FIG. 1 is a diagram illustrating an example of a defense system of the present invention. [Figure 2] 1A is a diagram showing a first unmanned aerial vehicle of the present invention, and FIG. 1B is a block diagram of a control unit of the first unmanned aerial vehicle. [Figure 3] 1A is a diagram showing a forklift according to the present invention, and FIG. 1B is a block diagram showing a control unit of the forklift. [Figure 4] FIG. 2 is a block diagram of a management device according to the present invention. [Figure 5] FIG. 10 is a flow chart of a defense process performed by the management device of the present invention. [Figure 6] A diagram showing an example of the movement path of the second unmanned aerial vehicle and the forklift of the present invention. [Figure 7] 10A is a diagram showing a third unmanned aerial vehicle according to a modified example, and FIG. 10B is a block diagram of a control unit of the third unmanned aerial vehicle. DETAILED DESCRIPTION OF THE INVENTION

[0017] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an embodiment of a defense system according to the present invention will be described with reference to the accompanying drawings.

[0018] 1 shows a defense system 1 according to one embodiment of the present invention. The defense system 1 is a system that can photograph an intruder X who has invaded a predetermined work area 10 without permission.

[0019] The defense system 1 of this embodiment is composed of multiple unmanned aerial vehicles 100, at least one forklift 200 (corresponding to the ``mobile body'' of the present invention), and a management device 300 that controls the multiple unmanned aerial vehicles 100 and at least one forklift 200.

[0020] The work area 10 is an area where the unmanned aerial vehicle 100 and / or the forklift 200 perform work. In this embodiment, the work area 10 is an area within any facility, including a factory or warehouse. The work area 10 is provided with a plurality of shelves 11, and cargo is stored on the shelves 11. The shelves 11 may be fixed shelves, or may be movable shelves configured to be movable under the control of the management device 300, or may include both. In addition, the work area 10 (for example, on the wall of the facility) is provided with a plurality of reflectors 12 for laser guidance of the forklift 200. Note that if the forklift 200 is not laser guided, the plurality of reflectors 12 can be omitted.

[0021] The multiple unmanned aerial vehicles 100 include at least one first unmanned aerial vehicle 100-1 and at least one second unmanned aerial vehicle 100-2. In this embodiment, the first unmanned aerial vehicle 100-1 and the second unmanned aerial vehicle 100-2 have different roles but the same configuration. The following description of the configuration will only focus on the first unmanned aerial vehicle 100-1.

[0022] 2(A), the first unmanned aerial vehicle 100-1 includes a main body 110, rotors 120, legs 130, a camera 140, a speaker 150, and a control unit 160. In this embodiment, the first unmanned aerial vehicle 100-1 is a drone.

[0023] The main body 110 includes a body provided with a speaker 150 and a control unit 160, and a plurality of arms (four in this embodiment) extending radially from the body. A rotor 120 is provided at the upper tip of each arm, and a pair of legs 130 and a camera 140 are provided at the lower part of the body.

[0024] Under the control of the control unit 160, the camera 140 takes video and / or still images during flight and transmits image data of the taken images to the management device 300. The camera 140 may further include an infrared sensor and a light that emits light when taking pictures. The camera 140 of the first unmanned aerial vehicle 100-1 corresponds to the "detection unit" of the present invention, and the camera 140 of the second unmanned aerial vehicle 100-2 corresponds to the "photography unit" of the present invention.

[0025] The speaker 150 outputs a warning sound under the control of the control unit 160. The warning sound may be a message sound urging the intruder X to leave the work area 10, or may be a simple sound effect, or may be both.

[0026] 2(B), the control unit 160 includes a position information acquisition unit 161, a flight control unit 162, a camera control unit 163, and an alarm unit 164. The control unit 160 may be configured, for example, by a digital circuit using a microcontroller or a DSP, or may be configured by a circuit that combines a digital circuit and an analog circuit.

[0027] The position information acquisition unit 161 is configured to acquire the position information of the first unmanned aerial vehicle 100-1, for example, using a satellite positioning system such as GPS. The position information includes, for example, latitude information, longitude information, and altitude information. The position information acquisition unit 161 outputs the acquired position information to the flight control unit 162 and transmits the position information to the management device 300. Note that the position information acquisition unit 161 is not limited to a satellite positioning system such as GPS, and any known configuration can be adopted, for example, the configuration described in Patent Document 1. However, if the configuration described in Patent Document 1 is adopted, a ceiling marker must be installed on the ceiling of the work area 10. Furthermore, the position information acquisition unit 161 may identify the direction in which its own camera 140 is facing and transmit information regarding the direction to the management device 300. Alternatively, the management device 300 may analyze image data from the camera 140 to identify the direction in which the camera 140 is facing.

[0028] The flight control unit 162 performs flight control of the main body unit 110 based on the position information from the position information acquisition unit 161 and the movement command (flight command) from the management device 300. Specifically, the flight control unit 162 controls the rotation of the rotor 120 as part of the flight control of the main body unit 110. The flight control unit 162 includes a processing unit that determines the rotation speeds of the four electric motors and four electric motors for rotating the rotor 120 at the determined rotation speeds. For example, if the rotation speeds of the four electric motors are set to the same value, the first unmanned aerial vehicle 100-1 will hover (stop in mid-air). If the rotation speeds of the four electric motors are increased simultaneously by the same amount from that state, the first unmanned aerial vehicle 100-1 will ascend. If the rotation speeds of the four electric motors are changed at different rates, the direction of travel of the first unmanned aerial vehicle 100-1 can be changed. This allows the first unmanned aerial vehicle 100-1 to fly to its destination along the movement path (flight path) determined by the management device 300.

[0029] The camera control unit 163 causes the camera 140 to take videos and / or still images during flight and transmit the image data to the management device 300. If the camera 140 is equipped with an infrared sensor and / or lighting, the camera control unit 163 also controls the infrared sensor and / or lighting. The camera control unit 163 also includes a storage unit that saves the taken videos and / or still images. This allows the taken videos and / or still images to be saved even if communication with the management device 300 is unstable.

[0030] If an intruder X is included in the image captured by camera 140, alarm unit 164 outputs an alarm sound from speaker 150 based on an alarm command from management device 300. Management device 300, for example, compares the image of a person captured by camera 140 with an image of a person registered in advance (e.g., an employee permitted to enter work area 10), and if the two do not match, determines that the person captured by camera 140 is intruder X and transmits an alarm command to first unmanned aerial vehicle 100-1 to cause speaker 150 to output an alarm sound.

[0031] As shown in Fig. 3(A), the forklift 200 includes a vehicle body 210, a cargo handling device 220, a laser scanner 230 provided on the upper part of the vehicle body 210, an illumination unit 240, a sound source unit 250, and a control unit 260. In this embodiment, the forklift 200 is an unmanned forklift of a laser guidance system. However, the forklift 200 may be an unmanned forklift other than a laser guidance system as long as it is capable of unmanned traveling, or may be an unmanned forklift that can switch between manned and unmanned traveling modes.

[0032] The cargo handling device 220 includes a mast and forks. The forks move up and down along the mast under the control of the control unit 260.

[0033] The laser scanner 230 includes a laser light source and a calculation unit. The laser scanner 230 rotates the laser light source to project a laser beam onto the surrounding area and detects the light reflected from a plurality of reflectors 12 provided in the work area 10. The calculation unit of the laser scanner 230 stores the positions of the reflectors 12 on a predetermined map and calculates the current location (self-position) of the vehicle body 210 based on the principle of triangulation. In this way, the forklift 200 travels along the travel route determined by the management device 300 while acquiring current location information regarding the current location of the vehicle body 210.

[0034] The illumination unit 240 is configured, for example, with at least one LED light, and emits an alert light toward the road surface in the forward direction of the vehicle body 210 under the control of the control unit 260. The illumination unit 240 may also include an illumination angle adjustment mechanism that varies the illumination angle of the alert light, or may be configured to change the output state of the alert light under the control of the control unit 260. The output state of the alert light is obtained by changing the blinking speed of the alert light, and includes, for example, five patterns: constant lighting, slow blinking, medium blinking, fast blinking, and off.

[0035] The sound source unit 250 is composed of, for example, at least one speaker, and outputs noise sound under the control of the control unit 260. The noise sound is sound for reducing the flight sound of the second unmanned aerial vehicle 100-2 (for example, the rotation sound of the rotor 120). The noise sound may be, for example, a sound that is in the opposite phase to the flight sound of the second unmanned aerial vehicle 100-2. The sound source unit 250 can vary the volume, frequency, and phase of the noise sound under the control of the control unit 260.

[0036] The noise may be a sound containing white noise, an alarm sound output when an obstacle (for example, luggage placed on the road surface) is detected by an obstacle sensor installed on the vehicle body 210, or a melody output while driving (to alert workers in the work area 10).

[0037] 3(B), the control unit 260 includes a position estimation unit 261, a travel control unit 262, a cargo handling control unit 263, a lighting control unit 264, and a sound source control unit 265. The control unit 260 may be configured, for example, by a digital circuit using a microcontroller, a DSP, or the like, or may be configured by a circuit that combines a digital circuit and an analog circuit.

[0038] The position estimation unit 261 recognizes the current location (self-position) of the vehicle body 210 and acquires position information related to the current location of the vehicle body 210. In this embodiment, the position estimation unit 261 corresponds to the calculation unit of the laser scanner 230. The position estimation unit 261 outputs the acquired position information to the travel control unit 262 and transmits the position information to the management device 300. Note that the position estimation unit 261 may acquire its own position using a satellite positioning system such as GPS, or may acquire its own position using a system such as an electromagnetic induction sensor. When acquiring its own position using these methods, the laser scanner 230 is not required.

[0039] The travel control unit 262 controls the travel of the vehicle body 210 based on the position information from the position estimation unit 261 and the movement command (travel command) from the management device 300. This allows the forklift 200 to travel to the destination according to the travel route determined by the management device 300.

[0040] The cargo handling control unit 263 controls the cargo handling of the cargo handling device 220 based on the cargo handling command from the management device 300. The cargo handling command in this embodiment includes not only a normal cargo handling command related to the movement of cargo, but also a command to raise and lower the forks to attract the attention of the intruder X.

[0041] The illumination control unit 264 controls the on / off of the illumination unit 240. If the illumination unit 240 has an illumination angle adjustment mechanism, the illumination control unit 264 controls the illumination angle adjustment mechanism to vary the illumination angle of the alert light. Furthermore, if the illumination unit 240 is configured to be able to change the output state of the alert light, the illumination control unit 264 changes the output state of the alert light.

[0042] The sound source control unit 265 controls the sound source unit 250. In this embodiment, the sound source control unit 265 controls the sound source unit 250 based on a sound output command from the management device 300, and causes the sound source unit 250 to output noise sound.

[0043] 4, the management device 300 includes a communication unit 301, a display unit 302, a general control unit 303, a mode setting unit 304, and a defense processing unit 305. The management device 300 is preferably provided outside the work area 10 as shown in FIG. 1, but may also be provided inside the work area 10.

[0044] The communication unit 301 communicates wirelessly with the first unmanned aerial vehicle 100-1, the second unmanned aerial vehicle 100-2, and the forklift 200. For example, the communication unit 301 receives image data from the camera 140 from the first unmanned aerial vehicle 100-1 and the second unmanned aerial vehicle 100-2, and transmits various commands to the first unmanned aerial vehicle 100-1, the second unmanned aerial vehicle 100-2, and the forklift 200.

[0045] Display unit 302 is configured, for example, with a liquid crystal display. Images captured by cameras 140 of first unmanned aerial vehicle 100-1 and second unmanned aerial vehicle 100-2 are displayed on display unit 302. Display unit 302 may also display travel information and loading / unloading work information for forklift 200, or may display a model diagram of work area 10 along with the movement paths of first unmanned aerial vehicle 100-1, second unmanned aerial vehicle 100-2, and forklift 200.

[0046] The overall control unit 303 manages the travel and loading / unloading operations of the forklift 200. For example, the overall control unit 303 creates a schedule for loading / unloading operations of the forklift 200 and determines a travel route for smoothly performing the loading / unloading operations. The overall control unit 303 notifies the forklift 200 of the travel route via the communication unit 301.

[0047] When the first unmanned aerial vehicle 100-1 and the second unmanned aerial vehicle 100-2 are to perform support work for a manned forklift (not shown) (for example, guiding the manned forklift), the overall control unit 303 manages the flight of the first unmanned aerial vehicle 100-1 and the second unmanned aerial vehicle 100-2. The overall control unit 303, for example, creates a flight schedule for the first unmanned aerial vehicle 100-1 and the second unmanned aerial vehicle 100-2 and determines a movement route for smoothly carrying out the support work. The overall control unit 303 notifies the first unmanned aerial vehicle 100-1 and the second unmanned aerial vehicle 100-2 of the movement route via the communication unit 301.

[0048] The mode setting unit 304 sets the mode of the defense system 1 to either a first mode (defense mode) or a second mode (normal mode). The first mode (defense mode) is a mode for photographing an intruder X who has invaded the work area 10. The second mode (normal mode) is a mode in which it is not necessary to photograph the intruder X, for example, a mode used when there are multiple workers in the work area 10 and the possibility of the intruder X invading is low.

[0049] When the first mode (defense mode) is set in the mode setting unit 304, the defense processing unit 305 performs the defense processing shown in Figure 5. For ease of explanation, it is assumed that at the start of the defense processing, the first unmanned aerial vehicle 100-1 is flying in a predetermined area of ​​the work area 10, and the second unmanned aerial vehicle 100-2 and the forklift 200 are waiting at a predetermined waiting location in the work area 10.

[0050] At the start of the defense processing shown in Figure 5, the first unmanned aerial vehicle 100-1 is capturing video of itself while flying with the camera 140. The defense processing unit 305 receives image data from the camera 140 from the first unmanned aerial vehicle 100-1 in real time and determines whether the first unmanned aerial vehicle 100-1 has detected an intruder X (S1). If the image data shows the intruder X, the defense processing unit 305 determines that the first unmanned aerial vehicle 100-1 has detected the intruder X (YES in S1). If the image data does not show the intruder X, the defense processing unit 305 determines that the first unmanned aerial vehicle 100-1 has not detected the intruder X (NO in S1).

[0051] If the defense processing unit 305 determines YES in step S1, it sends an alarm command to the first unmanned aerial vehicle 100-1 (S2). Upon receiving the alarm command, the first unmanned aerial vehicle 100-1 outputs a warning sound from the speaker 150 to the intruder X. It is preferable that the first unmanned aerial vehicle 100-1 continue to output the warning sound until the intruder X leaves the working area 10.

[0052] Next, defense processing unit 305 determines the movement routes of second unmanned aerial vehicle 100-2 and forklift 200, and transmits a movement command to second unmanned aerial vehicle 100-2 and forklift 200 (S3).

[0053] As shown in FIG. 6, the defense processing unit 305 determines a first movement path R1 along which the second unmanned aerial vehicle 100-2 approaches the intruder X, and a second movement path R2 along which the forklift 200 approaches the intruder X. Here, the defense processing unit 305 can acquire position information (position coordinates) of the intruder X by analyzing image data captured by the first unmanned aerial vehicle 100-1 using a known method. Furthermore, if the first unmanned aerial vehicle 100-1 is equipped with a distance sensor (e.g., LiDAR, millimeter-wave radar, or stereo camera) for measuring the distance to the target object (intruder X), the defense processing unit 305 may calculate the position coordinates of the intruder X based on the position information of the first unmanned aerial vehicle 100-1 (acquired from the position information acquisition unit 161), information related to the measurement results measured by the distance sensor, and the direction in which the first unmanned aerial vehicle 100-1 (camera 140) is facing.

[0054] The first movement route R1 and the second movement route R2 are determined so as to satisfy at least the following first, second, third and fourth conditions.

[0055] The first condition is that an obstacle (in this embodiment, a shelf 11) larger than the second unmanned aerial vehicle 100-2 exists between the end point A1 of the first movement path R1 of the second unmanned aerial vehicle 100-2 and the intruder X. By satisfying this condition, the second unmanned aerial vehicle 100-2 will be hidden by the shelf 11, which is expected to make the second unmanned aerial vehicle 100-2 less likely to be discovered by the intruder X. It is preferable that the end point A1 be set in a location where the second unmanned aerial vehicle 100-2 can photograph the intruder X while hiding (for example, a location where the front of the second unmanned aerial vehicle 100-2 is between the luggage stored on the shelf 11).

[0056] The second condition is that the above-mentioned obstacle (shelf 11 in this embodiment) does not exist between the end point A2 of the second movement path R2 of the forklift 200 and the intruder X. By satisfying this condition, the forklift 200 can attract the attention of the intruder X more than the second unmanned aerial vehicle 100-2, and therefore, similar to the above, it can be expected that the second unmanned aerial vehicle 100-2 will be less likely to be discovered by the intruder X.

[0057] The third condition is that the timing at which second unmanned aerial vehicle 100-2 arrives at destination point A1 is later than the timing at which forklift 200 arrives at destination point A2. By satisfying this condition, it is expected that the second unmanned aerial vehicle 100-2 will arrive at destination point A1 first, which will prevent intruder X from noticing the presence of second unmanned aerial vehicle 100-2. In order to satisfy the third condition, defense processing unit 305 may include commands regarding the flight speed of second unmanned aerial vehicle 100-2 and the travel speed of forklift 200 in the movement command.

[0058] The fourth condition is that in a plan view, intruder X is present in a triangular area T whose vertices are first unmanned aerial vehicle 100-1, second unmanned aerial vehicle 100-2 (end point A1), and forklift 200 (end point A2). By satisfying this condition, intruder X can be surrounded by first unmanned aerial vehicle 100-1, second unmanned aerial vehicle 100-2 (shelf 11 where second unmanned aerial vehicle 100-2 is hidden), and forklift 200. This is expected to have the effect of ensuring that intruder X can be photographed reliably.

[0059] After performing the process of step S3, the defense processing unit 305 transmits a sound output command to the forklift 200 (S4). The forklift 200, which has received the sound output command, travels along the second movement route R2 to the end point A2 while outputting a noise. Here, it is preferable that the forklift 200 output a louder noise as it approaches the end point A2. It is also preferable that the forklift 200 continue to output the noise even after arriving at the end point A2. Furthermore, after arriving at the end point A2, the forklift 200 may perform a lifting operation to raise and lower the forks to attract the attention of the intruder X.

[0060] Next, the defense processing unit 305 determines whether the second unmanned aerial vehicle 100-2 is able to photograph the intruder X (S5). While checking the position information of the second unmanned aerial vehicle 100-2, if the second unmanned aerial vehicle 100-2 arrives at the destination point A1, the defense processing unit 305 determines that the second unmanned aerial vehicle 100-2 is able to photograph the intruder X (YES in S5).

[0061] On the other hand, if the second unmanned aerial vehicle 100-2 has not arrived at the destination A1, the defense processing unit 305 determines that the second unmanned aerial vehicle 100-2 cannot photograph the intruder X (NO in S5), and proceeds to processing in step S3. If the intruder X moves, the defense processing unit 305 determines new first movement route R1 and second movement route R2 according to the position of the intruder X, and sends a movement command (S3).

[0062] When the second unmanned aerial vehicle 100-2 arrives at the destination A1, the defense processing unit 305, which has determined YES in step S5, sends a photographing command to the second unmanned aerial vehicle 100-2 (S6). Here, even if the second unmanned aerial vehicle 100-2 arrives at the destination A1, it may not be possible to photograph the intruder X at the destination A1 due to the influence of luggage stacked on the shelf 11 between the second unmanned aerial vehicle 100-2 and the intruder X (for example, luggage being placed in a position shifted from the designated location).

[0063] In this case, the defense processing unit 305 transmits a movement command to move the second unmanned aerial vehicle 100-2 to a location where it can photograph the intruder X, and transmits a photographing command after the second unmanned aerial vehicle 100-2 has moved. For example, the defense processing unit 305 transmits a movement command to raise or lower the second unmanned aerial vehicle 100-2 to move it in front of an area of ​​the shelf 11 where there is no cargo, to move it to a position higher than the shelf 11, or to land it on the shelf 11, and transmits a photographing command after the second unmanned aerial vehicle 100-2 has moved. Note that the second unmanned aerial vehicle 100-2 can fly to the destination point A1 while photographing video, so the defense processing unit 305 can determine whether it is possible to photograph the intruder X at the location of the destination point A1 based on the image data of the video.

[0064] Furthermore, in this case, since there is a risk that the intruder X will become aware of the presence of the second unmanned aerial vehicle 100-2, it is preferable that the defense processing unit 305 transmits a command to the forklift 200 at the destination point A2 to perform a loading and unloading operation, thereby attracting the intruder X's attention to the forklift 200. The loading and unloading operation may be a lifting and lowering operation that simply raises and lowers the forks, regardless of the load. In other words, the forklift 200 raises and lowers the forks while outputting a noise.

[0065] Upon receiving the photography command, the second unmanned aerial vehicle 100-2 takes still images of the intruder X. The photography command sets the photography time and / or number of images to be taken, and the second unmanned aerial vehicle 100-2 takes still images for the set photography time and / or number of images and transmits the image data to the defense processing unit 305.

[0066] In this embodiment, the second unmanned aerial vehicle 100-2 takes still images of the intruder X, but it may also take video of the intruder X, or may take both still images and video. The video may be a continuation of the video taken while flying along the first movement route R1.

[0067] Upon receiving the image data of intruder X, defense processing unit 305 sends a standby command to first unmanned aerial vehicle 100-1 and forklift 200 to remain in place, while sending a movement command to second unmanned aerial vehicle 100-2 to return to the standby location (starting point of first movement route R1) (S7). First unmanned aerial vehicle 100-1 continues to output a warning sound to intruder X, and forklift 200 continues to output a noise sound and / or raise and lower its forks. This allows second unmanned aerial vehicle 100-2 to return to the standby location without being noticed by intruder X.

[0068] As described above, in the defense system 1, the first unmanned aerial vehicle 100-1, the second unmanned aerial vehicle 100-2, and the forklift 200 form a group to deal with the intruder X. For this reason, in the defense system 1, it is preferable to increase the number of groups of the first unmanned aerial vehicle 100-1, the second unmanned aerial vehicle 100-2, and the forklift 200 according to the number of intruders X. For example, it is preferable to have three groups of the first unmanned aerial vehicle 100-1, the second unmanned aerial vehicle 100-2, and the forklift 200 deal with three intruders X in different locations in the work area 10.

[0069] Furthermore, in the defense system 1, the first unmanned aerial vehicle 100-1 issues a warning to intruder X, the second unmanned aerial vehicle 100-2 photographs intruder X, and the forklift 200 outputs a noise sound, so that three parties share the roles. Therefore, even if the first unmanned aerial vehicle 100-1 is destroyed by intruder X and is no longer able to output a warning sound, the forklift 200 can continue to output a noise sound, making it difficult for intruder X to notice the presence of the second unmanned aerial vehicle 100-2. Therefore, according to the defense system 1 of this embodiment, the second unmanned aerial vehicle 100-2 can photograph intruder X.

[0070] Although the embodiments of the defense system according to the present invention have been described above, the present invention is not limited to the above embodiments.

[0071] [Variations] For example, in the defense system 1, the third unmanned aerial vehicle 100-3 shown in Figure 7(A) can be used instead of the forklift 200. The third unmanned aerial vehicle 100-3 has the same configuration as the first unmanned aerial vehicle 100-1 and the second unmanned aerial vehicle 100-2 of the above embodiment, except for the control unit 160'.

[0072] As shown in Figure 7(B), the control unit 160' of the third unmanned aerial vehicle 100-3 has the same configuration as the control unit 160 of the first unmanned aerial vehicle 100-1 and the second unmanned aerial vehicle 100-2 in the above embodiment, except that it is equipped with a sound source control unit 165.

[0073] The sound source control unit 165 has the same function as the sound source control unit 265 of the forklift 200 in the above embodiment. That is, the sound source control unit 165 controls the speaker 150 based on a sound output command from the management device 300, and causes noise to be output from the speaker 150. As in the above embodiment, the noise is a sound intended to reduce the flight noise of the second unmanned aerial vehicle 100-2 (for example, the rotation noise of the rotor 120).

[0074] In the defense system according to the modified example, first unmanned aerial vehicle 100-1, second unmanned aerial vehicle 100-2, and third unmanned aerial vehicle 100-3 work together as a group to respond to intruder X. Roles are divided among the three, with first unmanned aerial vehicle 100-1 issuing a warning to intruder X, second unmanned aerial vehicle 100-2 photographing intruder X, and third unmanned aerial vehicle 100-3 outputting a noise sound. Therefore, even if first unmanned aerial vehicle 100-1 is destroyed by intruder X and is no longer able to output a warning sound, third unmanned aerial vehicle 100-3 can continue to output a noise sound, making it difficult for intruder X to notice the presence of second unmanned aerial vehicle 100-2.

[0075] Furthermore, since the third unmanned aerial vehicle 100-3 is smaller in size than the forklift 200, from the perspective of attracting the attention of the intruder X, the defense system 1 using the forklift 200 makes it more reliable for the second unmanned aerial vehicle 100-2 to photograph the intruder X.

[0076] [Other variations] The defense system of the present invention is a defense system comprising an unmanned aerial vehicle capable of hovering in the air in a designated work area, a mobile vehicle that moves in the work area, and a management device that controls the unmanned aerial vehicle and the mobile vehicle, wherein the unmanned aerial vehicle is equipped with a camera unit for photographing an intruder who has invaded the work area, the mobile vehicle is equipped with a sound source unit that outputs noise to reduce the flight noise of the unmanned aerial vehicle, and the management device can be configured as appropriate so long as it causes the sound source unit of the mobile vehicle to output the noise while the unmanned aerial vehicle is flying towards the intruder and while the camera unit of the unmanned aerial vehicle is photographing the intruder.

[0077] For example, the management device may be configured to be able to communicate data with a surveillance camera (e.g., a pan-tilt-zoom camera) placed in the work area. If the management device 300 of the above embodiment is configured to be able to communicate data with the surveillance camera, the surveillance camera will detect the intruder X, and therefore the first unmanned aerial vehicle 100-1 can be omitted in the defense system 1 of the above embodiment.

[0078] Furthermore, the mobile object of the present invention may be a mobile object other than a forklift, or an aerial object other than a drone. However, from the perspective of attracting the attention of an intruder, a forklift is suitable as a mobile object because it can raise and lower its forks and emit a warning light. In other words, under the control of the management device, the forklift can make it difficult for the intruder to notice the presence of the unmanned aerial object by outputting a noise (and in some cases, further raising and lowering its forks or emitting a warning light) at least until the unmanned aerial object photographs the intruder. [Explanation of symbols]

[0079] 1. Defense Systems 10 work area 11 Shelves 12 Reflector 100 Unmanned Aerial Vehicles 110 Main body 120 rotor blades 130 Legs 140 Camera 150 speakers 160 control section 161 Location information acquisition unit 162 Flight Control Unit 163 Camera control unit 164 Alarm section 165 Sound source control unit 200 forklifts 210 Body 220 Cargo handling equipment 230 Laser Scanner 240 Lighting Department 250 Sound Source Section 260 Control Unit 261 Position estimation part 262 Travel control unit 263 Cargo Handling Control Unit 264 Lighting Control Unit 265 Sound Source Control Unit 300 Management device 301 Communications Department 302 Display section 303 General Control Unit 304 Mode setting section 305 Defense Department

Claims

1. a first unmanned aerial vehicle and a second unmanned aerial vehicle capable of hovering in a predetermined working area; a moving body that moves in the working area; a management device that controls the first unmanned aerial vehicle, the second unmanned aerial vehicle, and the mobile vehicle; A defense system comprising: The first unmanned aerial vehicle is a detection unit for detecting an intruder who has entered the work area; The second unmanned aerial vehicle is a photographing unit for photographing the intruder, The moving body is a sound source unit that outputs noise to reduce the flight noise of the second unmanned aerial vehicle; The management device When the detection unit of the first unmanned air vehicle detects the intruder, the sound source unit of the moving body outputs the noise sound until the image capture unit of the second unmanned air vehicle captures an image of the intruder. A defense system characterized by:

2. The management device When the detection unit of the first unmanned aerial vehicle detects the intruder, determining a first movement path for the second unmanned aerial vehicle to approach the intruder and a second movement path for the moving vehicle to approach the intruder; An obstacle larger than the second unmanned aerial vehicle exists between the end point of the first movement path and the intruder. The defense system according to claim 1 .

3. The management device The first movement path and the second movement path are determined so as to satisfy a condition that, when the work area is viewed from above, the intruder is present in a triangular area having vertices that are the first unmanned aerial vehicle, the end point of the first movement path, and the end point of the second movement path.

3. The defense system according to claim 2.

4. The management device The noise sound is output from the sound source unit of the moving body even after the image capturing unit of the second unmanned aerial vehicle captures an image of the intruder. The defense system according to claim 1 .

5. the moving body is a forklift equipped with forks, The management device The noise source of the forklift is caused to output the noise, and the fork is caused to move up and down at a predetermined timing. The defense system according to claim 1 .

6. The moving body is a third unmanned aerial vehicle capable of hovering in the air. The defense system according to claim 1 .

7. an unmanned aerial vehicle capable of hovering in the air in a predetermined work area; a moving body that moves in the working area; a management device that controls the unmanned aerial vehicle and the mobile vehicle; A defense system comprising: The unmanned aerial vehicle is a photographing unit for photographing an intruder who has invaded the work area; The moving body is a sound source unit that outputs noise to reduce the flight noise of the unmanned aerial vehicle; The management device While the unmanned aerial vehicle is flying toward the intruder and while the imaging unit of the unmanned aerial vehicle is imaging the intruder, the sound source unit of the moving body is made to output the noise sound. A defense system characterized by:

Citation Information

Patent Citations

  • Carrier system

    JP2020052629A

  • Unmanned mobile body and control method

    JP2020087061A

  • Vehicle control device and method

    JP2022086361A

  • Flight type robot, control program for flight type robot and control method for flight type robot

    JP2022104061A

  • Drone-augmented emergency response services

    US20170092109A1