Method for controlling an aircraft
The flying object-based inspection method automates railway track inspection, reducing time and enhancing safety by imaging and transmitting data for efficient abnormality detection and map updates.
Patent Information
- Application Number
- JP2019109964
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2019-06-12
- Publication Date
- 2024-11-29
- Estimated Expiration
- 2039-06-12
AI Technical Summary
Existing railway track maintenance and inspection methods are time-consuming and risky due to manual work on active tracks, with limited safety during operating hours, and existing systems do not fully automate or enhance efficiency.
A method involving a flying object that acquires position information, moves to a predetermined location, images the area, and transmits captured images for automated inspection, integrating with external devices for further analysis.
This approach automates track inspection, reducing time and enhancing safety by efficiently identifying abnormalities and updating maps with inspection results, thereby improving railway operation safety.
Smart Images

Figure 0007591858000001 
Figure 0007591858000002 
Figure 0007591858000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a method for controlling an aircraft. [Background technology]
[0002] Traditionally, maintenance and inspection of railway tracks has been performed manually by workers walking along the tracks, which is time-consuming and hazardous due to the relationship with the operation of trains running through the maintenance section.
[0003] As a system for supporting such maintenance work, a system has been disclosed in which a server confirms the safety of the closed track section where maintenance work is to be performed and sends approval for the work to a mobile phone carried by the worker (Patent Document 1).A system has also been disclosed that improves safety when route setting is requested during maintenance work by displaying information on other switches that are switched in conjunction with route setting based on preset interlocking diagram information of a signaling system (Patent Document 2). [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2015-168316 A [Patent Document 2] JP 2017-065329 A Summary of the Invention [Problem to be solved by the invention]
[0005] However, even if the systems disclosed in the patent documents ensure the safety of workers and reduce the time required to ensure safety, manual maintenance work during train operation must still be performed within a limited time frame.
[0006] Therefore, an object of the present invention is to provide a track inspection method that can solve the above problems and ensure the safety of railway operations more efficiently. [Means for solving the problem]
[0007] One embodiment of the present invention is a method for controlling an aircraft, comprising the steps of acquiring predetermined position information, controlling the aircraft to move to a predetermined position, capturing an image of a predetermined area at the predetermined position, and transmitting the captured image. Effect of the Invention
[0008] According to the present invention, it is possible to provide a railway line inspection method that is more efficient and ensures safety. [Brief description of the drawings]
[0009] [Figure 1] FIG. 1 is a schematic diagram of an inspection method using an aircraft 10 according to a first embodiment. [Diagram 2] FIG. 2 is a functional block diagram of the aircraft 10 according to the first embodiment. [Diagram 3] FIG. 3 is a functional block diagram showing control related to inspection of an aircraft according to the first embodiment. [Figure 4] FIG. 4 is a flow chart showing the control of the flying object and the management terminal according to the first embodiment. [Diagram 5] FIG. 5 is a flow chart showing control related to inspection of an aircraft according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] The contents of the embodiments of the present invention will be described below. The flying object according to the embodiment of the present invention has the following configuration. [Item 1] A method for controlling an aircraft, comprising: acquiring predetermined location information; A step of controlling the aircraft to move to the predetermined position; capturing an image of a predetermined area at the predetermined position; transmitting the captured image; A method for controlling an aircraft, comprising: [Item 2] A method for controlling an aircraft according to item 1, The method for controlling an aircraft further includes a step of confirming whether an investigation has been performed at the specified location. [Item 3] A method for controlling an aircraft according to item 1, The method for controlling an aircraft further includes a step of checking for any abnormalities based on the captured image. [Item 4] A method for controlling an aircraft according to item 3, A method for controlling an aircraft, comprising: mapping the specified position onto map information when an abnormality is confirmed in the confirmation step. [Item 5] A method for controlling an aircraft according to claim 1, A method for controlling an aircraft, characterized in that the position information is obtained by referring to railway operation information.
[0011] (First embodiment) Hereinafter, an aircraft according to a first embodiment of the present invention will be described with reference to the drawings. Fig. 1 is a schematic view of a method for inspecting a railroad track using an aircraft 10 according to the first embodiment.
[0012] 1, an aircraft 10 can fly above a railway line 1 and use a camera to capture images of the area around the railway line 1. The captured images can be transmitted to an external device such as a management terminal via a network.
[0013] 2 is a functional block diagram of the aircraft 10 according to the first embodiment. First, the flight controller 21 can have one or more processors, such as a programmable processor (e.g., a central processing unit (CPU)). The camera 5 is mounted on the aircraft via a gimbal, and can rotate, for example, in the vertical direction relative to the aircraft by the gimbal. It is preferable that the camera can rotate in three axial directions (pitch angle, roll angle, yaw angle) relative to the aircraft.
[0014] Flight controller 21 also has and has access to memory 22. Memory 22 stores logic, code, and / or program instructions that are executable by the flight controller to perform one or more steps.
[0015] The memory 22 may include, for example, a separable medium such as an SD card or a random access memory (RAM) or an external storage device. Data acquired from the camera or sensors may be directly transmitted to and stored in the memory. For example, still image and video data captured by a camera or the like is recorded in an internal memory or an external memory. The camera is installed on the aircraft via a gimbal.
[0016] The flight controller 21 includes a control module configured to control the state of the air vehicle. For example, the control module may be configured to control six degrees of freedom (translational motion x, y, and z, and rotational motion θ x , θ y and θ z The control module controls the propulsion mechanism (motor, etc.) of the aircraft via the ESC to adjust the spatial arrangement, speed, and / or acceleration of the aircraft having the ESC. The motor rotates the propeller to generate lift for the aircraft. The control module can control one or more of the states of the onboard parts and sensors.
[0017] The flight controller 21 can communicate with a transceiver 24 configured to transmit and / or receive data from one or more external devices (e.g., a transceiver 23, a terminal, a display device, or other remote control). The transceiver 23 can use any suitable communication means, such as wired or wireless communication.
[0018] For example, the transceiver 24 may utilize one or more of a local area network (LAN), a wide area network (WAN), infrared, radio, WiFi, a point-to-point (P2P) network, a telecommunications network, cloud communications, and the like.
[0019] The transceiver unit 24 can transmit and / or receive one or more of the following: data acquired by sensors, processing results generated by a flight controller, predetermined control data, user commands from a terminal or a remote controller, etc.
[0020] The sensors 25 according to this embodiment may include an inertial sensor (acceleration sensor, gyro sensor), a GPS sensor, a proximity sensor (e.g., LIDAR), or a vision / image sensor (e.g., camera).
[0021] Furthermore, the inspection unit 31 stores information required for inspection, such as image data captured by the camera 5, in the memory 32, and executes the track inspection. As another example, all or part of the functions of the inspection unit 31 may be provided in a management terminal or the like outside the aircraft (not shown).
[0022] Next, a method for controlling an aircraft in this embodiment will be described with reference to Fig. 3 and Fig. 4. Fig. 3 is a functional block diagram of aircraft control related to inspection of the track of the aircraft in this embodiment. Fig. 4 is a flow chart of the control of the aircraft and the management terminal in this embodiment.
[0023] In this embodiment, the control method for an aircraft to inspect a track can be realized by executing a control program in the CPU in the flight controller 21 and / or the CPU in the inspection unit 31. As another example, all or part of the functions of the flight controller 10 and / or the inspection unit 31 can be provided in an external device 28 (e.g., a server or a management terminal), and the aircraft 10 and the external device 28 can cooperate to execute the necessary processing.
[0024] First, in FIG. 3, the line information acquisition unit 51 refers to line information related to the line position and / or operation time of the railway stored in the line information storage unit 61 of the memory 22, for example, and confirms the location to be surveyed. With respect to the location information confirmed by referring to the line information, the current location information acquisition unit 52 acquires current location information from the GPS sensor 54, the acceleration sensor 55, etc., and the flight control unit 53 controls the motor 26 to move the aircraft 10 to the inspection position that is the destination (S401). The acquired current location information is stored in the current location information storage unit 62 in the memory 22. Note that this step can be replaced by manually operating the aircraft, and can also be replaced by controlling the aircraft to fly on the track by recognizing the track using image recognition technology without relying on the position information.
[0025] Next, when the flying object 10 is positioned on the track to be inspected, the track inspection unit 71 of the inspection unit 31, for example, refers to the map information 83 and checks whether the target track has already been inspected (S403). In this example, an example is assumed in which the inspected positions are mapped on a map, but other formats are acceptable as long as they can be understood as location information. In addition, the flying object 10 can inquire about this information via the transmission / reception unit 24 and the network to an external device 28 such as a management terminal. In this step, if it is confirmed that the target track has not been inspected, the process proceeds to the next step, and if it is confirmed that the track has been inspected, the process returns to the original process. In another example, the flying object 10 can understand the inspected and uninspected positions in advance, perform routing settings for the uninspected positions in advance, and fly. In yet another example, the flying object 10 can turn off the power of the camera at the inspected positions. This can save battery resources.
[0026] Next, the imaging control unit 74 of the inspection unit 31 controls the camera 5 to capture an image of the area around the target track (S403). When capturing an image, an area camera such as a digital camera can be used to capture an image instead of visual inspection. When capturing an image at night, an infrared camera can be used or LED lighting can be used. The captured image can be stored in the memory 32.
[0027] Next, the notification generating unit 72 of the inspection unit 31 transmits a notification to the external device 28 such as a management terminal via the transmitting / receiving unit 24 (S404). The notification contents may include location information, images, etc. The notification process may be performed periodically by accumulating images, but is preferably performed simultaneously with imaging.
[0028] The external device 28 such as a management terminal receives the image transmitted from the flying object 10 (S405). Next, the external device 28 such as a management terminal inspects the track based on the received image (S406). For the inspection, for example, an image processed by an image processing unit (not shown) of the management terminal using a known method such as image binarization, edge and feature detection, etc. may be used. Alternatively, the presence or absence of an abnormality may be confirmed by comparing the image-processed inspection image of the area around the track with a normal image captured under normal circumstances and image-processed. Here, the items to be inspected are assumed to be damage, deformation, misalignment, etc. of the rail.
[0029] In this way, by using an aircraft to inspect tracks, not only can the conventional visual inspection work be automated, but the time required to ensure safety can be reduced, providing a track inspection method that can more efficiently ensure the safety of railway operations.
[0030] (Second embodiment) 5 shows a flowchart of the control of the aircraft related to the inspection of the track of the aircraft according to the second embodiment. The feature of the aircraft 20 in this embodiment is that the inspection that was performed by the management terminal in the first embodiment is performed by the aircraft 20 itself.
[0031] The structure and functional blocks of the aircraft 20 of this embodiment can be the same as those of the aircraft 10 disclosed in the first embodiment shown in FIG. 2, except where specifically mentioned.
[0032] The step of flying over the tracks in FIG. 5 (S501), the step of checking whether the position of the survey target has been surveyed (S502), and the step of capturing an image of the area around the position of the survey target (S503) are the same as the method in the first embodiment described in FIG. 4, and therefore will not be described here.
[0033] In Fig. 5, the track inspection unit 71 of the inspection unit 31 of the flying object 20 inspects the track based on the captured image (S454). For the inspection, for example, an image processed by the image processing unit 73 using a known method such as image binarization processing, edge and feature detection, etc. may be used. Alternatively, the presence or absence of an abnormality may be confirmed by comparing an image-processed inspection image 81 of the area around the track with a normal image 82 captured under normal circumstances and image-processed. Here, the items to be inspected are assumed to be damage, deformation, misalignment, etc. of the rail.
[0034] Next, the track inspection unit 71 checks whether or not there is an abnormality in the track being inspected as a result of the inspection (S505). Possible abnormalities include, for example, damage to the rail, a rail width that is different from normal, a misalignment of the rail center, and the like.
[0035] If no abnormality is found, the original process is resumed, but if an abnormality is found, the track inspection unit 71 inputs the fact that an abnormality has been found, the details of the abnormality, an image, etc., into the map included in the map information 83 (S506). Furthermore, information about whether an inspection has been carried out or not can also be input into the map. The updated map information is transmitted as a notification by the notification generation unit 72 to the external device 28 such as a management terminal, thereby enabling the operator of the management terminal to check the inspected positions and inspection results on the map at a glance.
[0036] In this manner, in this embodiment, the aircraft 20 can take on the entire investigation, making it possible to further improve work efficiency.
[0037] The aircraft of the present invention is expected to be used as an industrial aircraft for investigations, surveying, observation, etc., mainly in the railway business. The aircraft of the present invention can also be used in the aircraft-related industry, such as multicopters and drones, and further, the present invention can contribute to improving the safety of these aircraft and the flight of aircraft.
[0038] The above-described embodiment is merely an example for facilitating understanding of the present invention, and is not intended to limit the present invention. The present invention can be modified or improved without departing from the spirit of the present invention, and it goes without saying that the present invention includes equivalents thereof. [Explanation of symbols]
[0039] 1 track 5. Camera 10 Flying Objects 21 Flight Controller 22 Memory 23 Sensors 24 Transmitter / receiver 25 Transmitter / Receiver 26 Motor 28 External device 31 Inspection Department 32 Memory 51 Route information acquisition department 52 Current location information acquisition unit 53 Flight Control Unit 54 GPS sensor 55 Acceleration Sensor 61 Route information storage section 62 Current location information storage section 71 Track Inspection Department 72 Notification generator 73 Image Processing Section 74 Imaging control section 81 Inspection images 82 Normal Images 83 Map Information
Claims
1. A method for controlling an aircraft, comprising: obtaining a predetermined position; obtaining map information including a map onto which the surveyed locations are mapped; referring to the map information to determine whether the predetermined location has been surveyed; If the predetermined position has not been surveyed, controlling the aircraft to move to the predetermined position; capturing an image of a predetermined area at the predetermined position; transmitting the captured image; checking whether or not there is an abnormality based on the captured image, and when an abnormality is confirmed, mapping the predetermined position onto map information; A method for controlling an aircraft, comprising:
2. A method for controlling an aircraft, comprising: obtaining a predetermined position; obtaining map information including a map onto which the surveyed locations are mapped; referring to the map information to determine whether the predetermined location has been surveyed; If the predetermined position has not been surveyed, controlling the aircraft to move to the predetermined position; capturing an image of a predetermined area at the predetermined position; transmitting the captured image; Including, The predetermined position is acquired by referring to train operation information. A method for controlling an aircraft.
Citation Information
Patent Citations
Device and method for supporting creation of course plan for maintenance car
JP2004168210A
Method for collecting aerial image information by utilizing unmanned flying object
JP2006027331A
Maintenance operation supporting system
JP2015168316A
Railroad track maintenance work support system
JP2017065329A
Pilotless flight device control system, pilotless flight device controlling method, and image projector
JP2017174159A
