Defense Systems
The defense system uses coordinated UAVs and a forklift to photograph intruders by dazzling them, addressing the challenge of unauthorized access in work areas by ensuring reliable image capture and deterrence.
Patent Information
- Application Number
- JP2023155818
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-09-21
- Publication Date
- 2025-12-16
- Estimated Expiration
- 2043-09-21
AI Technical Summary
Unmanned aerial vehicles (UAVs) are ineffective in preventing unauthorized entry and theft or damage in work areas like factories or warehouses, as they lack the capability to detect and deter intruders effectively.
A defense system comprising multiple UAVs and a forklift equipped with a lighting unit to dazzle intruders, allowing a second UAV to photograph them undetected, with a management device controlling their coordinated movement and operation.
The system effectively photographs intruders by blinding them with flashing lights, ensuring reliable image capture while minimizing detection of the UAVs, thus deterring unauthorized access and protecting assets.
Smart Images

Figure 0007786864000001 
Figure 0007786864000002 
Figure 0007786864000003
Abstract
Description
[Technical Field]
[0001] The present invention relates to a defense system using an unmanned aerial vehicle. [Background technology]
[0002] Conventionally, unmanned aerial vehicles known as drones have been used in work areas such as factories or warehouses. For example, Patent Document 1 describes a guidance system that includes a manned guided vehicle operated by an operator, one unmanned aerial vehicle capable of hovering in the air, and a management device that controls the unmanned aerial vehicle.
[0003] In the guidance system described in Patent Document 1, the unmanned aerial vehicle is equipped with a projector that projects a guidance image onto a road surface. The guidance image, for example, displays an arrow pointing in a specific direction and is projected onto the road surface in front of the manned guided vehicle. As a result, an operator operating the manned guided vehicle can be guided to the loading position by checking the guidance image.
[0004] In recent years, automated guided vehicles (AGVs) have been used instead of manned vehicles to reduce work loads. However, when an automated system is used in a work area such as a factory or warehouse, there is a risk that an unauthorized person (hereinafter referred to as an intruder) may enter the work area and steal or destroy items stored on shelves in the work area. In this regard, if an intruder can be photographed, the intruder can be identified, which can be expected to have a deterrent effect and protect the items. [Prior art documents] [Patent documents]
[0005] [Patent Document 1] Japanese Patent Publication No. 2020-52629 Summary of the Invention [Problem to be solved by the invention]
[0006] The present invention has been made in consideration of the above circumstances, and its object is to provide a defense system that is capable of photographing an intruder who has entered a work area such as a factory or warehouse. [Means for solving the problem]
[0007] In order to solve the above problem, a defense system according to one embodiment of the present invention comprises: a first unmanned aerial vehicle and a second unmanned aerial vehicle capable of hovering in a predetermined work area; a moving body that moves in the working area; A management device that controls the first unmanned aerial vehicle, the second unmanned aerial vehicle, and the mobile vehicle; A defense system comprising: The first unmanned aerial vehicle is a detection unit for detecting an intruder who has entered the work area; The second unmanned aerial vehicle is a photographing unit for photographing the intruder, The moving body is a lighting unit that outputs dazzling light to block the view of the intruder, The management device When the detection unit of the first unmanned aerial vehicle detects the intruder, the lighting unit of the moving body outputs the dazzling light until the photographing unit of the second unmanned aerial vehicle photographs the intruder.
[0008] In this configuration, the lighting unit of the mobile body outputs dazzling light (visible light) to block the intruder's view until the second unmanned aerial vehicle's imaging unit photographs the intruder, making it difficult for the intruder to notice the presence of the second unmanned aerial vehicle, thereby enabling the second unmanned aerial vehicle to photograph the intruder.
[0009] In the defense system, The lighting unit of the moving body includes: As the dazzling light, a flashing light that repeatedly turns on and off at a predetermined cycle is output, The management device The second unmanned aerial vehicle may be configured to have the imaging unit capture an image of the intruder at least at the timing of the lighting on or the lighting off.
[0010] In the defense system, The management device When the detection unit of the first unmanned aerial vehicle detects the intruder, determining a first movement path for the second unmanned aerial vehicle to approach the intruder and a second movement path for the moving vehicle to approach the intruder; It is preferable that an obstacle larger than the second unmanned aerial vehicle exists between the end point of the first movement path and the intruder.
[0011] In the defense system, The management device When the work area is viewed in a plane, the first movement path and the second movement path can be determined so as to satisfy the condition that the intruder is present in a triangular area whose vertices are the first unmanned aerial vehicle, the end point of the first movement path, and the end point of the second movement path.
[0012] In the defense system, The management device The second unmanned aerial vehicle can be configured to have the lighting unit of the moving body continue to output the dazzling light even after the imaging unit of the second unmanned aerial vehicle has captured an image of the intruder.
[0013] In the defense system, the moving body is a forklift equipped with forks, The management device The forklift may be configured to emit the dazzling light from the lighting unit and to raise and lower the forks at a predetermined timing.
[0014] In the defense system, The moving body may be a third unmanned aerial vehicle capable of hovering in the air.
[0015] A defense system according to another embodiment of the present invention includes: an unmanned aerial vehicle capable of hovering in the air in a predetermined work area; a moving body that moves in the working area; a management device that controls the unmanned aerial vehicle and the mobile vehicle; A defense system comprising: The unmanned aerial vehicle is a photographing unit for photographing an intruder who has invaded the work area; The moving body is a lighting unit that outputs dazzling light to block the view of the intruder, The management device The method is characterized in that the lighting unit of the moving body outputs the dazzling light while the unmanned aerial vehicle is flying toward the intruder and while the photographing unit of the unmanned aerial vehicle is photographing the intruder. [Effects of the Invention]
[0016] According to the present invention, it is possible to provide a defense system capable of photographing an intruder who has invaded a work area such as a factory or warehouse. [Brief explanation of the drawings]
[0017] [Figure 1] FIG. 1 is a diagram illustrating an example of a defense system of the present invention. [Figure 2] 1A is a diagram showing a first unmanned aerial vehicle of the present invention, and FIG. 1B is a block diagram of a control unit of the first unmanned aerial vehicle. [Figure 3] 1A is a diagram showing a forklift according to the present invention, and FIG. 1B is a block diagram showing a control unit of the forklift. [Figure 4] FIG. 2 is a block diagram of a management device according to the present invention. [Figure 5] FIG. 10 is a flow chart of a defense process performed by the management device of the present invention. [Figure 6] A diagram showing an example of the movement path of the second unmanned aerial vehicle and the forklift of the present invention. [Figure 7]10A is a diagram showing a third unmanned aerial vehicle according to a modified example, and FIG. 10B is a block diagram of a control unit of the third unmanned aerial vehicle. DETAILED DESCRIPTION OF THE INVENTION
[0018] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an embodiment of a defense system according to the present invention will be described with reference to the accompanying drawings.
[0019] 1 shows a defense system 1 according to one embodiment of the present invention. The defense system 1 is a system that can photograph an intruder X who has invaded a predetermined work area 10 without permission.
[0020] The defense system 1 of this embodiment is composed of multiple unmanned aerial vehicles 100, at least one forklift 200 (corresponding to the ``mobile body'' of the present invention), and a management device 300 that controls the multiple unmanned aerial vehicles 100 and at least one forklift 200.
[0021] The work area 10 is an area where the unmanned aerial vehicle 100 and / or the forklift 200 perform work. In this embodiment, the work area 10 is an area within any facility, including a factory or warehouse. The work area 10 is provided with a plurality of shelves 11, and cargo is stored on the shelves 11. The shelves 11 may be fixed shelves, or may be movable shelves configured to be movable under the control of the management device 300, or may include both. In addition, the work area 10 (for example, on the wall of the facility) is provided with a plurality of reflectors 12 for laser guidance of the forklift 200. Note that if the forklift 200 is not laser guided, the plurality of reflectors 12 can be omitted.
[0022] The multiple unmanned aerial vehicles 100 include at least one first unmanned aerial vehicle 100-1 and at least one second unmanned aerial vehicle 100-2. In this embodiment, the first unmanned aerial vehicle 100-1 and the second unmanned aerial vehicle 100-2 have different roles but the same configuration. The following description of the configuration will only focus on the first unmanned aerial vehicle 100-1.
[0023] 2(A), the first unmanned aerial vehicle 100-1 includes a main body 110, rotors 120, legs 130, a camera 140, a speaker 150, and a control unit 160. In this embodiment, the first unmanned aerial vehicle 100-1 is a drone.
[0024] The main body 110 includes a body provided with a speaker 150 and a control unit 160, and a plurality of arms (four in this embodiment) extending radially from the body. A rotor 120 is provided at the upper tip of each arm, and a pair of legs 130 and a camera 140 are provided at the lower part of the body.
[0025] Under the control of the control unit 160, the camera 140 takes video and / or still images during flight and transmits image data of the taken images to the management device 300. The camera 140 may further include an infrared sensor and a light that emits light when taking pictures. The camera 140 of the first unmanned aerial vehicle 100-1 corresponds to the "detection unit" of the present invention, and the camera 140 of the second unmanned aerial vehicle 100-2 corresponds to the "photography unit" of the present invention.
[0026] The speaker 150 outputs a warning sound under the control of the control unit 160. The warning sound may be a message sound urging the intruder X to leave the work area 10, or may be a simple sound effect, or may be both.
[0027] 2(B), the control unit 160 includes a position information acquisition unit 161, a flight control unit 162, a camera control unit 163, and an alarm unit 164. The control unit 160 may be configured, for example, by a digital circuit using a microcontroller or a DSP, or may be configured by a circuit that combines a digital circuit and an analog circuit.
[0028] The position information acquisition unit 161 is configured to acquire the position information of the first unmanned aerial vehicle 100-1, for example, using a satellite positioning system such as GPS. The position information includes, for example, latitude information, longitude information, and altitude information. The position information acquisition unit 161 outputs the acquired position information to the flight control unit 162 and transmits the position information to the management device 300. Note that the position information acquisition unit 161 is not limited to a satellite positioning system such as GPS, and any known configuration can be adopted, for example, the configuration described in Patent Document 1. However, if the configuration described in Patent Document 1 is adopted, a ceiling marker must be installed on the ceiling of the work area 10. Furthermore, the position information acquisition unit 161 may identify the direction in which its own camera 140 is facing and transmit information regarding the direction to the management device 300. Alternatively, the management device 300 may analyze image data from the camera 140 to identify the direction in which the camera 140 is facing.
[0029] The flight control unit 162 performs flight control of the main body unit 110 based on the position information from the position information acquisition unit 161 and the movement command (flight command) from the management device 300. Specifically, the flight control unit 162 controls the rotation of the rotor 120 as part of the flight control of the main body unit 110. The flight control unit 162 includes a processing unit that determines the rotation speeds of the four electric motors and four electric motors for rotating the rotor 120 at the determined rotation speeds. For example, if the rotation speeds of the four electric motors are set to the same value, the first unmanned aerial vehicle 100-1 will hover (stop in mid-air). If the rotation speeds of the four electric motors are increased simultaneously by the same amount from that state, the first unmanned aerial vehicle 100-1 will ascend. If the rotation speeds of the four electric motors are changed at different rates, the direction of travel of the first unmanned aerial vehicle 100-1 can be changed. This allows the first unmanned aerial vehicle 100-1 to fly to its destination along the movement path (flight path) determined by the management device 300.
[0030] The camera control unit 163 causes the camera 140 to take videos and / or still images during flight and transmit the image data to the management device 300. If the camera 140 is equipped with an infrared sensor and / or lighting, the camera control unit 163 also controls the infrared sensor and / or lighting. The camera control unit 163 also includes a storage unit that saves the taken videos and / or still images. This allows the taken videos and / or still images to be saved even if communication with the management device 300 is unstable.
[0031] If an intruder X is included in the image captured by camera 140, alarm unit 164 outputs an alarm sound from speaker 150 based on an alarm command from management device 300. Management device 300, for example, compares the image of a person captured by camera 140 with an image of a person registered in advance (e.g., an employee permitted to enter work area 10), and if the two do not match, determines that the person captured by camera 140 is intruder X and transmits an alarm command to first unmanned aerial vehicle 100-1 to cause speaker 150 to output an alarm sound.
[0032] As shown in Fig. 3(A), the forklift 200 includes a vehicle body 210, a cargo handling device 220, a laser scanner 230 provided on the upper part of the vehicle body 210, an illumination unit 240, and a control unit 250. In this embodiment, the forklift 200 is an unmanned forklift of a laser guidance system. However, the forklift 200 may be an unmanned forklift other than a laser guidance system as long as it is capable of unmanned traveling, or may be an unmanned forklift that can switch between manned and unmanned traveling modes.
[0033] The cargo handling device 220 includes a mast and forks. The forks move up and down along the mast under the control of the control unit 250.
[0034] The laser scanner 230 includes a laser light source and a calculation unit. The laser scanner 230 rotates the laser light source to project a laser beam onto the surrounding area and detects the light reflected from a plurality of reflectors 12 provided in the work area 10. The calculation unit of the laser scanner 230 stores the positions of the reflectors 12 on a predetermined map and calculates the current location (self-position) of the vehicle body 210 based on the principle of triangulation. In this way, the forklift 200 travels along the travel route determined by the management device 300 while acquiring current location information regarding the current location of the vehicle body 210.
[0035] The lighting unit 240 outputs dazzling light L (visible light) to block the view of the intruder X. The lighting unit 240 is configured, for example, with at least one LED light.
[0036] The illumination unit 240 includes an illumination angle adjustment mechanism, and can vary the illumination angle of the dazzling light L under the control of the control unit 250. For example, as shown in FIG. 3(A), the illumination unit 240 can illuminate the dazzling light L toward the road surface in the forward direction of the vehicle body 210 (L1), or illuminate the dazzling light L toward the front in the forward direction (L2). Note that the dazzling light L in the L1 state also functions as a warning light to notify workers in the work area 10 of the presence of the forklift 200 under normal circumstances.
[0037] The illumination unit 240 changes the output state of the dazzling light L under the control of the control unit 250. The output state of the dazzling light L is obtained by changing the blinking speed of the dazzling light L, and includes, for example, five patterns: constant lighting, slow blinking, medium blinking, fast blinking, and off. When the dazzling light L is a blinking light, the dazzling light L repeatedly turns on and off at a predetermined cycle.
[0038] 3(B), the control unit 250 includes a position estimation unit 251, a travel control unit 252, a cargo handling control unit 253, and a lighting control unit 254. The control unit 250 may be configured, for example, by a digital circuit using a microcontroller or a DSP, or may be configured by a circuit that combines a digital circuit and an analog circuit.
[0039] The position estimation unit 251 recognizes the current location (self-position) of the vehicle body 210 and acquires position information related to the current location of the vehicle body 210. In this embodiment, the position estimation unit 251 corresponds to the calculation unit of the laser scanner 230. The position estimation unit 251 outputs the acquired position information to the traveling control unit 252 and transmits the position information to the management device 300. Note that the position estimation unit 251 may acquire its own position using a satellite positioning system such as GPS, or may acquire its own position using a system such as an electromagnetic induction sensor. When acquiring its own position using these methods, the laser scanner 230 is not required.
[0040] The travel control unit 252 controls the travel of the vehicle body 210 based on the position information from the position estimation unit 251 and the movement command (travel command) from the management device 300. This allows the forklift 200 to travel to the destination according to the travel route determined by the management device 300.
[0041] The cargo handling control unit 253 controls the cargo handling of the cargo handling device 220 based on the cargo handling command from the management device 300. The cargo handling command in this embodiment includes not only a normal cargo handling command related to the movement of cargo, but also a command to raise and lower the forks to attract the attention of the intruder X.
[0042] The illumination control unit 254 controls the illumination unit 240. Specifically, the illumination control unit 254 controls to vary the irradiation angle of the dazzling light L and to vary the output state of the dazzling light L.
[0043] 4, the management device 300 includes a communication unit 301, a display unit 302, a general control unit 303, a mode setting unit 304, and a defense processing unit 305. The management device 300 is preferably provided outside the work area 10 as shown in FIG. 1, but may also be provided inside the work area 10.
[0044] The communication unit 301 communicates wirelessly with the first unmanned aerial vehicle 100-1, the second unmanned aerial vehicle 100-2, and the forklift 200. For example, the communication unit 301 receives image data from the camera 140 from the first unmanned aerial vehicle 100-1 and the second unmanned aerial vehicle 100-2, and transmits various commands to the first unmanned aerial vehicle 100-1, the second unmanned aerial vehicle 100-2, and the forklift 200.
[0045] Display unit 302 is configured, for example, with a liquid crystal display. Images captured by cameras 140 of first unmanned aerial vehicle 100-1 and second unmanned aerial vehicle 100-2 are displayed on display unit 302. Display unit 302 may also display travel information and loading / unloading work information for forklift 200, or may display a model diagram of work area 10 along with the movement paths of first unmanned aerial vehicle 100-1, second unmanned aerial vehicle 100-2, and forklift 200.
[0046] The overall control unit 303 manages the travel and loading / unloading operations of the forklift 200. For example, the overall control unit 303 creates a schedule for loading / unloading operations of the forklift 200 and determines a travel route for smoothly performing the loading / unloading operations. The overall control unit 303 notifies the forklift 200 of the travel route via the communication unit 301.
[0047] When the first unmanned aerial vehicle 100-1 and the second unmanned aerial vehicle 100-2 are to perform support work for a manned forklift (not shown) (for example, guiding the manned forklift), the overall control unit 303 manages the flight of the first unmanned aerial vehicle 100-1 and the second unmanned aerial vehicle 100-2. The overall control unit 303, for example, creates a flight schedule for the first unmanned aerial vehicle 100-1 and the second unmanned aerial vehicle 100-2 and determines a movement route for smoothly carrying out the support work. The overall control unit 303 notifies the first unmanned aerial vehicle 100-1 and the second unmanned aerial vehicle 100-2 of the movement route via the communication unit 301.
[0048] The mode setting unit 304 sets the mode of the defense system 1 to either a first mode (defense mode) or a second mode (normal mode). The first mode (defense mode) is a mode for photographing an intruder X who has invaded the work area 10. The second mode (normal mode) is a mode in which it is not necessary to photograph the intruder X, for example, a mode used when there are multiple workers in the work area 10 and the possibility of the intruder X invading is low.
[0049] When the first mode (defense mode) is set in the mode setting unit 304, the defense processing unit 305 performs the defense processing shown in Figure 5. For ease of explanation, it is assumed that at the start of the defense processing, the first unmanned aerial vehicle 100-1 is flying in a predetermined area of the work area 10, and the second unmanned aerial vehicle 100-2 and the forklift 200 are waiting at a predetermined waiting location in the work area 10.
[0050] At the start of the defense processing shown in Figure 5, the first unmanned aerial vehicle 100-1 is capturing video of itself while flying with the camera 140. The defense processing unit 305 receives image data from the camera 140 from the first unmanned aerial vehicle 100-1 in real time and determines whether the first unmanned aerial vehicle 100-1 has detected an intruder X (S1). If the image data shows the intruder X, the defense processing unit 305 determines that the first unmanned aerial vehicle 100-1 has detected the intruder X (YES in S1). If the image data does not show the intruder X, the defense processing unit 305 determines that the first unmanned aerial vehicle 100-1 has not detected the intruder X (NO in S1).
[0051] If the defense processing unit 305 determines YES in step S1, it sends an alarm command to the first unmanned aerial vehicle 100-1 (S2). Upon receiving the alarm command, the first unmanned aerial vehicle 100-1 outputs a warning sound from the speaker 150 to the intruder X. It is preferable that the first unmanned aerial vehicle 100-1 continue to output the warning sound until the intruder X leaves the working area 10.
[0052] Next, the defense processing unit 305 determines the movement routes of the second unmanned aerial vehicle 100-2 and the forklift 200, and transmits a movement command to the second unmanned aerial vehicle 100-2 and the forklift 200 (S3).
[0053] As shown in FIG. 6, the defense processing unit 305 determines a first movement path R1 along which the second unmanned aerial vehicle 100-2 approaches the intruder X, and a second movement path R2 along which the forklift 200 approaches the intruder X. Here, the defense processing unit 305 can acquire position information (position coordinates) of the intruder X by analyzing image data captured by the first unmanned aerial vehicle 100-1 using a known method. Furthermore, if the first unmanned aerial vehicle 100-1 is equipped with a distance sensor (e.g., LiDAR, millimeter-wave radar, or stereo camera) for measuring the distance to the target object (intruder X), the defense processing unit 305 may calculate the position coordinates of the intruder X based on the position information of the first unmanned aerial vehicle 100-1 (acquired from the position information acquisition unit 161), information related to the measurement results measured by the distance sensor, and the direction in which the first unmanned aerial vehicle 100-1 (camera 140) is facing.
[0054] The first movement route R1 and the second movement route R2 are determined so as to satisfy at least the following first, second, third and fourth conditions.
[0055] The first condition is that an obstacle (in this embodiment, a shelf 11) larger than the second unmanned aerial vehicle 100-2 exists between the end point A1 of the first movement path R1 of the second unmanned aerial vehicle 100-2 and the intruder X. By satisfying this condition, the second unmanned aerial vehicle 100-2 will be hidden by the shelf 11, which is expected to make the second unmanned aerial vehicle 100-2 less likely to be discovered by the intruder X. It is preferable that the end point A1 be set in a location where the second unmanned aerial vehicle 100-2 can photograph the intruder X while hiding (for example, a location where the front of the second unmanned aerial vehicle 100-2 is between the luggage stored on the shelf 11).
[0056] The second condition is that the above-mentioned obstacle (shelf 11 in this embodiment) does not exist between the end point A2 of the second movement path R2 of the forklift 200 and the intruder X. By satisfying this condition, the forklift 200 can attract the attention of the intruder X more than the second unmanned aerial vehicle 100-2, and therefore, similar to the above, it can be expected that the second unmanned aerial vehicle 100-2 will be less likely to be discovered by the intruder X.
[0057] The third condition is that the timing at which second unmanned aerial vehicle 100-2 arrives at destination point A1 is later than the timing at which forklift 200 arrives at destination point A2. By satisfying this condition, it is expected that the second unmanned aerial vehicle 100-2 will arrive at destination point A1 first, which will prevent intruder X from noticing the presence of second unmanned aerial vehicle 100-2. In order to satisfy the third condition, defense processing unit 305 may include commands regarding the flight speed of second unmanned aerial vehicle 100-2 and the travel speed of forklift 200 in the movement command.
[0058] The fourth condition is that in a plan view, intruder X is present in a triangular area T whose vertices are first unmanned aerial vehicle 100-1, second unmanned aerial vehicle 100-2 (end point A1), and forklift 200 (end point A2). By satisfying this condition, intruder X can be surrounded by first unmanned aerial vehicle 100-1, second unmanned aerial vehicle 100-2 (shelf 11 where second unmanned aerial vehicle 100-2 is hidden), and forklift 200. This is expected to have the effect of ensuring that intruder X can be photographed reliably.
[0059] After performing the process of step S3, the defense processing unit 305 transmits a light output command to the forklift 200 (S4). The forklift 200, which has received the light output command, travels along the second movement route R2 to the end point A2 while emitting the dazzling light L.
[0060] The forklift 200 continues to output the dazzling light L even after arriving at the destination A2. In this example, the dazzling light L is a flashing light. The forklift 200 may directly irradiate the dazzling light L at the intruder X, or may indirectly irradiate the dazzling light L at the intruder X by reflecting the dazzling light L on the road surface or on the shelf 11. Whether to irradiate the light directly or indirectly can be set in advance in the management device 300, for example. Furthermore, after arriving at the destination A2, the forklift 200 may output the dazzling light L and perform a lifting operation to raise and lower the forks to attract the intruder X's attention.
[0061] Next, the defense processing unit 305 determines whether the second unmanned aerial vehicle 100-2 is able to photograph the intruder X (S5). While checking the position information of the second unmanned aerial vehicle 100-2, if the second unmanned aerial vehicle 100-2 arrives at the destination point A1, the defense processing unit 305 determines that the second unmanned aerial vehicle 100-2 is able to photograph the intruder X (YES in S5).
[0062] On the other hand, if the second unmanned aerial vehicle 100-2 has not arrived at the destination A1, the defense processing unit 305 determines that the second unmanned aerial vehicle 100-2 cannot photograph the intruder X (NO in S5), and proceeds to processing in step S3. If the intruder X moves, the defense processing unit 305 determines new first movement route R1 and second movement route R2 according to the position of the intruder X, and sends a movement command (S3).
[0063] When the second unmanned aerial vehicle 100-2 arrives at the destination A1, the defense processing unit 305, which has determined YES in step S5, sends a photographing command to the second unmanned aerial vehicle 100-2 (S6). Here, even if the second unmanned aerial vehicle 100-2 arrives at the destination A1, it may not be possible to photograph the intruder X at the destination A1 due to the influence of luggage stacked on the shelf 11 between the second unmanned aerial vehicle 100-2 and the intruder X (for example, luggage being placed in a position shifted from the designated location).
[0064] In this case, the defense processing unit 305 transmits a movement command to move the second unmanned aerial vehicle 100-2 to a location where it can photograph the intruder X, and transmits a photographing command after the second unmanned aerial vehicle 100-2 has moved. For example, the defense processing unit 305 transmits a movement command to raise or lower the second unmanned aerial vehicle 100-2 to move it in front of an area of the shelf 11 where there is no cargo, to move it to a position higher than the shelf 11, or to land it on the shelf 11, and transmits a photographing command after the second unmanned aerial vehicle 100-2 has moved. Note that the second unmanned aerial vehicle 100-2 can fly to the destination point A1 while photographing video, so the defense processing unit 305 can determine whether it is possible to photograph the intruder X at the location of the destination point A1 based on the image data of the video.
[0065] Furthermore, in this case, since there is a risk that the intruder X will become aware of the presence of the second unmanned air vehicle 100-2, it is preferable that the defense processing unit 305 transmits a command to the forklift 200 at the destination point A2 to perform a loading and unloading operation, thereby attracting the intruder X's attention to the forklift 200. The loading and unloading operation may be a simple lifting and lowering operation of the forks, regardless of the load. In other words, the forklift 200 raises and lowers the forks while emitting dazzling light L.
[0066] Upon receiving the photography command, the second unmanned aerial vehicle 100-2 takes still images of the intruder X. The photography command sets the photography time and / or number of images to be taken, and the second unmanned aerial vehicle 100-2 takes still images for the set photography time and / or number of images and transmits the image data to the defense processing unit 305.
[0067] Furthermore, in the photography command, the photography timing is set so that a still image of the intruder X is taken at least when the dazzling light L is turned on or off. In this embodiment, the photography timing is set so that a plurality of still images of the intruder X are taken both when the dazzling light L is turned on and when the dazzling light L is turned off. Therefore, in this embodiment, the intruder X can be photographed reliably.
[0068] In this embodiment, the second unmanned aerial vehicle 100-2 takes still images of the intruder X, but it may also take video of the intruder X, or may take both still images and video. The video may be a continuation of the video taken while flying along the first movement route R1.
[0069] Upon receiving the image data of intruder X, defense processing unit 305 sends a standby command to first unmanned aerial vehicle 100-1 and forklift 200 to stay where they are, while sending a movement command to second unmanned aerial vehicle 100-2 to return to the standby location (starting point of first movement route R1) (S7). First unmanned aerial vehicle 100-1 continues to output a warning sound to intruder X, and forklift 200 continues to output dazzling light L and / or raise and lower its forks. This allows second unmanned aerial vehicle 100-2 to return to the standby location without being noticed by intruder X.
[0070] As described above, in the defense system 1, the first unmanned aerial vehicle 100-1, the second unmanned aerial vehicle 100-2, and the forklift 200 form a group to deal with the intruder X. For this reason, in the defense system 1, it is preferable to increase the number of groups of the first unmanned aerial vehicle 100-1, the second unmanned aerial vehicle 100-2, and the forklift 200 according to the number of intruders X. For example, it is preferable to have three groups of the first unmanned aerial vehicle 100-1, the second unmanned aerial vehicle 100-2, and the forklift 200 deal with three intruders X in different locations in the work area 10.
[0071] Furthermore, in the defense system 1, the first unmanned aerial vehicle 100-1 issues a warning to the intruder X, the second unmanned aerial vehicle 100-2 photographs the intruder X, and the forklift 200 outputs the dazzling light L, so that three parties share the responsibility. Therefore, even if the first unmanned aerial vehicle 100-1 is destroyed by the intruder X and is no longer able to output the warning sound, the forklift 200 can continue to output the dazzling light L, making it difficult for the intruder X to notice the presence of the second unmanned aerial vehicle 100-2. Therefore, according to the defense system 1 of this embodiment, the second unmanned aerial vehicle 100-2 can photograph the intruder X.
[0072] Although the embodiments of the defense system according to the present invention have been described above, the present invention is not limited to the above embodiments.
[0073] [Variations] For example, in the defense system 1, the third unmanned aerial vehicle 100-3 shown in Figure 7(A) can be used instead of the forklift 200. The third unmanned aerial vehicle 100-3 has the same configuration as the first unmanned aerial vehicle 100-1 and the second unmanned aerial vehicle 100-2 of the above embodiment, except for the control unit 160' and the lighting unit 170.
[0074] As shown in Figure 7(B), the control unit 160' of the third unmanned aerial vehicle 100-3 has the same configuration as the control unit 160 of the first unmanned aerial vehicle 100-1 and the second unmanned aerial vehicle 100-2 in the above embodiment, except that it is equipped with a lighting control unit 165.
[0075] The lighting unit 170 has the same function as the lighting unit 240 of the forklift 200 of the above embodiment. That is, the lighting unit 170 outputs dazzling light L (visible light) to block the view of the intruder X. The lighting unit 170 is configured with, for example, at least one LED light (multiple in this modification).
[0076] The illumination unit 170 has an illumination angle adjustment mechanism, and can vary the illumination angle of the dazzling light L under the control of the illumination control unit 165. Furthermore, the illumination unit 170 changes the output state of the dazzling light L under the control of the illumination control unit 165. The output state of the dazzling light L is obtained by changing the blinking speed of the dazzling light L, and includes, for example, five patterns: constant lighting, slow blinking, medium blinking, fast blinking, and off. When the dazzling light L is blinking light, the dazzling light L repeatedly turns on and off at a predetermined cycle.
[0077] The lighting control unit 165 has the same functions as the lighting control unit 254 of the forklift 200 of the above embodiment. That is, the lighting control unit 165 performs control to vary the irradiation angle of the dazzling light L and control to vary the output state of the dazzling light L.
[0078] In the defense system according to the modified example, first unmanned aerial vehicle 100-1, second unmanned aerial vehicle 100-2, and third unmanned aerial vehicle 100-3 work together as a group to respond to intruder X. Roles are divided among the three, with first unmanned aerial vehicle 100-1 issuing a warning to intruder X, second unmanned aerial vehicle 100-2 photographing intruder X, and third unmanned aerial vehicle 100-3 outputting dazzling light L. Therefore, even if first unmanned aerial vehicle 100-1 is destroyed by intruder X and is no longer able to output a warning sound, third unmanned aerial vehicle 100-3 can continue to output dazzling light L, making it difficult for intruder X to notice the presence of second unmanned aerial vehicle 100-2.
[0079] Furthermore, since the third unmanned aerial vehicle 100-3 is smaller in size than the forklift 200, from the perspective of attracting the attention of the intruder X, the defense system 1 using the forklift 200 makes it more reliable for the second unmanned aerial vehicle 100-2 to photograph the intruder X.
[0080] [Other variations] The defense system of the present invention is a defense system comprising an unmanned aerial vehicle capable of hovering in the air in a designated work area, a mobile vehicle that moves in the work area, and a management device that controls the unmanned aerial vehicle and the mobile vehicle, wherein the unmanned aerial vehicle is equipped with a camera unit for photographing an intruder who has entered the work area, the mobile vehicle is equipped with a lighting unit that outputs dazzling light to block the intruder's view, and the management device can be configured as appropriate so long as it causes the lighting unit of the mobile vehicle to output the dazzling light while the unmanned aerial vehicle is flying towards the intruder and while the camera unit of the unmanned aerial vehicle is photographing the intruder.
[0081] For example, the management device may be configured to be able to communicate data with a surveillance camera (e.g., a pan-tilt-zoom camera) placed in the work area. If the management device 300 of the above embodiment is configured to be able to communicate data with the surveillance camera, the surveillance camera will detect the intruder X, and therefore the first unmanned aerial vehicle 100-1 can be omitted in the defense system 1 of the above embodiment.
[0082] Furthermore, the mobile object of the present invention may be a mobile object other than a forklift, or an aerial object other than a drone. However, from the viewpoint of attracting the attention of an intruder, a forklift is suitable as a mobile object because it can raise and lower its forks. In other words, under the control of the management device, the forklift can make it difficult for an intruder to notice the presence of the unmanned aerial object by emitting dazzling light L (and in some cases, further raising and lowering its forks) at least until the unmanned aerial object photographs the intruder. [Explanation of symbols]
[0083] 1. Defense Systems 10 working area 11 Shelves 12 Reflector 100 Unmanned Aerial Vehicles 110 Main body 120 rotor blades 130 Legs 140 Camera 150 speakers 160 control section 161 Location information acquisition unit 162 Flight Control Unit 163 Camera control unit 164 Alarm section 165 Lighting control unit 170 Lighting Department 200 forklifts 210 Body 220 Cargo handling equipment 230 Laser Scanner 240 Lighting Department 250 control section 251 Position estimation part 252 Travel control unit 253 Cargo handling control section 254 Lighting control unit 300 Management device 301 Communications Department 302 Display section 303 General Control Unit 304 Mode setting section 305 Defense Department
Claims
1. a first unmanned aerial vehicle and a second unmanned aerial vehicle capable of hovering in a predetermined working area; a moving body that moves in the working area; a management device that controls the first unmanned aerial vehicle, the second unmanned aerial vehicle, and the mobile vehicle; A defense system comprising: The first unmanned aerial vehicle is a detection unit for detecting an intruder who has entered the work area; The second unmanned aerial vehicle is a photographing unit for photographing the intruder, The moving body is a lighting unit that outputs dazzling light to block the view of the intruder, The management device When the detection unit of the first unmanned aerial vehicle detects the intruder, the illumination unit of the moving body outputs the dazzling light until the photographing unit of the second unmanned aerial vehicle photographs the intruder. A defense system characterized by:
2. The lighting unit of the moving body includes: As the dazzling light, a flashing light that repeatedly turns on and off at a predetermined cycle is output, The management device The second unmanned aerial vehicle is caused to photograph the intruder at the timing of at least one of the turning on and the turning off. The defense system according to claim 1 .
3. The management device When the detection unit of the first unmanned aerial vehicle detects the intruder, determining a first movement path for the second unmanned aerial vehicle to approach the intruder and a second movement path for the moving vehicle to approach the intruder; An obstacle larger than the second unmanned aerial vehicle exists between the end point of the first movement path and the intruder. The defense system according to claim 1 .
4. The management device The first movement path and the second movement path are determined so as to satisfy a condition that, when the work area is viewed from above, the intruder is present in a triangular area having vertices that are the first unmanned aerial vehicle, the end point of the first movement path, and the end point of the second movement path.
4. The defense system according to claim 3.
5. The management device The illumination unit of the moving body outputs the dazzling light even after the image capturing unit of the second unmanned aerial vehicle captures the image of the intruder. The defense system according to claim 1 .
6. the moving body is a forklift equipped with forks, The management device The illumination unit of the forklift emits the dazzling light, and the fork is raised and lowered at a predetermined timing. The defense system according to claim 1 .
7. The moving body is a third unmanned aerial vehicle capable of hovering in the air. The defense system according to claim 1 .
8. an unmanned aerial vehicle capable of hovering in the air in a predetermined work area; a moving body that moves in the working area; a management device that controls the unmanned aerial vehicle and the mobile vehicle; A defense system comprising: The unmanned aerial vehicle is a photographing unit for photographing an intruder who has invaded the work area; The moving body is a lighting unit that outputs dazzling light to block the view of the intruder, The management device While the unmanned aerial vehicle is flying toward the intruder and while the photographing unit of the unmanned aerial vehicle is photographing the intruder, the dazzling light is output to the lighting unit of the moving body. A defense system characterized by:
Citation Information
Patent Citations
Carrier system
JP2020052629A
Unmanned mobile body and control method
JP2020087061A
Vehicle control device and method
JP2022086361A
Flight type robot, control program for flight type robot and control method for flight type robot
JP2022104061A
Drone-augmented emergency response services
US20170092109A1