Drone and drone control method therefor

By employing a learned spike neural network to adjust motor control signals based on sensor data, the drone system effectively maintains stability and maneuverability in windy conditions, addressing the limitations of existing drone control technologies.

WO2025127558A1PCT designated stage expired Publication Date: 2025-06-19POSCO HLDG INC
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/KR2024/019419
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-12-12
Filing Date
2024-12-02
Publication Date
2025-06-19

AI Technical Summary

Technical Problem

Existing drone control systems face challenges in maintaining stability and maneuverability, particularly in situations like gusts of wind, due to high power consumption and slow computation speeds, leading to potential crashes or loss of control.

Method used

The implementation of a drone system that utilizes a learned spike neural network to measure attitude based on sensor data, converting motor signals into motor control signals to maintain flight trajectory and stability, even in gusty conditions, while minimizing power consumption and latency.

Benefits of technology

This approach enables stable drone control with low power and low latency in specific situations such as gusts of wind, ensuring safe and efficient flight operations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure KR2024019419_19062025_PF_FP_ABST
    Figure KR2024019419_19062025_PF_FP_ABST
Patent Text Reader

Abstract

The present embodiments provide a drone and a drone control method therefor, the drone being controlled to fly along a specific flight trajectory through the conversion of a motor signal into a motor control signal under normal circumstances, using a trained spike neural network to measure orientation on the basis of sensor data so that specific situations are recognized, and being controlled to fly while maintaining orientation through the adjustment of the motor control signal in the specific situations.
Need to check novelty before this filing date? Find Prior Art

Description

Drone and method of controlling the drone

[0001] The present embodiments relate to a drone for controlling an aircraft in a specific situation and a method for controlling the drone.

[0002] In drone control systems, attitude and speed are important factors that determine the stability and maneuverability of the drone.

[0003] Most drones carry a risk of drifting or tilting under certain conditions, such as gusts of wind, which can lead to a crash or loss of control.

[0004] However, general drones do not have a way to control the drone so that it does not drift or tilt and crash or lose control in certain situations such as gusts, and when controlling the drone in certain situations such as gusts with general control methods, the high power consumption and slow computing speed make it unsuitable for application in gusts that require flight time, stability, and quick response.

[0005] The present embodiments can provide a drone and a method for controlling the drone that can stably control the drone with low power and low latency in specific situations such as gusts of wind.

[0006] The present embodiments provide a drone and a control method for the drone, which controls the drone to fly along a specific flight trajectory by converting a motor signal into a motor control signal in a general situation, recognizes a specific situation by measuring attitude based on sensor data using a learned spike neural network, and controls the drone to fly while maintaining attitude by adjusting the motor control signal in a specific situation.

[0007] In one aspect, the present embodiments may provide a drone including a drone sensor unit that provides sensor data, a drone flight unit that provides a motor signal, and a drone control unit that converts the motor signal into the motor control signal in a general situation to control the drone to fly in a specific flight trajectory, measures attitude based on the sensor data using a learned spike neural network to recognize a specific situation, and controls the drone to fly while maintaining attitude by adjusting the motor control signal in a specific situation.

[0008] In another aspect, the present embodiments can provide a method for controlling a drone, including a first step of controlling the drone to fly along a specific flight trajectory by converting a motor signal into a motor control signal in a general situation, and a second step of controlling the drone to fly while maintaining the attitude by measuring the attitude based on sensor data using a learned spike neural network and adjusting the motor control signal in the specific situation.

[0009] According to the drone and the control method thereof according to the present embodiments, the drone can be stably controlled with low power and low latency in specific situations such as gusts of wind.

[0010] Figure 1 is a front view of a drone according to one embodiment.

[0011] Figure 2 is a configuration diagram of the drone of Figure 1.

[0012] Figure 3 is a schematic diagram of a portion of a spike neural network included in the drone control unit of Figure 2.

[0013] Figure 4 is a configuration diagram of a drone control unit of a drone according to another embodiment.

[0014] Figure 5 is a configuration diagram of a drone control unit of a drone according to another embodiment.

[0015] Figure 6 is a conceptual diagram of the flight control transfer process of the conventional control microprocessor and the gust situation analog computer of Figure 5.

[0016] Figure 7 illustrates input / output signals of the analog computer of Figure 6.

[0017] Figure 8 is a flowchart of a drone control method according to another embodiment.

[0018] Figure 9 illustrates in detail the drone control processes of the second stage of Figure 8.

[0019] Hereinafter, some embodiments of the present disclosure will be described in detail with reference to exemplary drawings. When adding reference numerals to components in each drawing, identical components may have the same numerals as much as possible even if they are shown in different drawings. In addition, when describing the present embodiments, if it is determined that a detailed description of a related known configuration or function may obscure the gist of the technical idea of ​​the present invention, the detailed description may be omitted. When "includes," "has," "consists of," etc. are used in this specification, other parts may be added unless "only" is used. When a component is expressed in the singular, it may include a case in which the plural is included unless specifically stated otherwise.

[0020] Additionally, terms such as first, second, A, B, (a), (b), etc. may be used to describe components of the present disclosure. These terms are only intended to distinguish the components from other components, and the nature, order, sequence, or number of the components are not limited by the terms.

[0021] In a description of the positional relationship of components, when it is described that two or more components are "connected," "combined," or "connected," it should be understood that the two or more components may be directly "connected," "combined," or "connected," but that the two or more components may also be further "interposed" with another component to be "connected," "combined," or "connected." Here, the other component may be included in one or more of the two or more components that are "connected," "combined," or "connected" to each other.

[0022] In the description of the temporal flow relationship related to components, operation methods, or manufacturing methods, for example, when the temporal or flow relationship is described as “after”, “following”, “next to”, “before”, etc., it may also include cases where it is not continuous, unless “immediately” or “directly” is used.

[0023] Meanwhile, when numerical values ​​or corresponding information (e.g., levels, etc.) for components are mentioned, even without separate explicit description, the numerical values ​​or corresponding information may be interpreted as including an error range that may occur due to various factors (e.g., process factors, internal or external impact, noise, etc.).

[0024] The embodiments are described in detail with reference to the drawings below.

[0025] Figure 1 is a front view of a drone according to one embodiment.

[0026] Referring to FIG. 1, a drone (100) according to one embodiment can fly using a propeller (110) and an electric motor (120). The electric motor (120) is used to convert electric power into electrical energy and rotate the propeller (110). This rotational motion pushes air, creating a force that propels the drone (100) upward. The propeller (110) uses this rotational motion to help move the air, and this principle allows the drone to fly.

[0027] Drones (100) are equipped with various sensors, cameras, GPS, communication systems, etc. and are used for flight control and data collection.

[0028] The drone (100) has multiple (e.g., four in FIG. 1) propellers (110), and each propeller (110) can be controlled to perform ascending, descending, forward, backward, left and right movement, rotation, etc. To this end, the direction and height of the drone (100) are controlled by controlling the rotation speed of each propeller (110).

[0029] The drone (100) has a built-in flight control system. This system controls the speed of each electric motor (120) and adjusts the attitude to move in the desired direction according to commands entered by the user.

[0030] According to one embodiment, a drone (100) stably controls its attitude and speed without drifting, tilting, falling, or losing control in a specific situation such as a gust of wind with low power and low latency.

[0031] Figure 2 is a configuration diagram of the drone of Figure 1.

[0032] Referring to FIG. 2, a drone (100) according to one embodiment includes a drone sensor unit (130) that provides sensor data, a drone flight unit (140) that provides a motor signal, and a drone control unit (150) that controls the drone to fly along a specific flight trajectory by converting the motor signal into a motor control signal in a general situation, recognizes a specific situation by measuring an attitude based on the sensor data using a learned spike neural network (SNN), and controls the drone to fly while maintaining the attitude by adjusting the motor control signal in a specific situation.

[0033] Hereinafter, specific situations are described as examples of gusts of wind as described above, but are not limited thereto, and generally include all cases other than general situations in which the drone (100) may drift or tilt, causing it to crash or lose control. That is, this specification defines two situations in which the drone (100) may perform general control operations in a first situation such as a general situation, and perform special control operations in a second situation such as a specific situation. As described below, the drone (100) may perform software control operations or hardware control operations in both general and special situations.

[0034] The drone sensor unit (130) includes a gyro sensor (132) and an acceleration sensor (134), and the sensor data may be, but is not limited to, angular velocity sensed by the gyro sensor (132) and acceleration sensed by the acceleration sensor (134).

[0035] The gyro sensor (132) can measure angular velocity. An example of the gyro sensor (132) may be a gyroscope that measures angular velocity. The acceleration sensor (134) is a sensor that measures acceleration. The acceleration sensor (132) can measure acceleration in the x-axis, y-axis, and z-axis directions, for example.

[0036] The drone flight unit (140) can convert the adjusted motor control signal using a learned spike neural network (SNN) into a specific PWM signal that adjusts the motor speed and direction.

[0037] The drone flight unit (140) converts motor control signals generated from a spike neural network (SNN) into corresponding PWM signals that adjust motor speed and direction. The control logic of the drone flight unit (140) uses aerodynamic and flight dynamics models to compensate for wind disturbances and maintain the desired flight trajectory.

[0038] The drone flight unit (140) provides the converted PWM signal to the electric motor (120) and controls the electric motor (120), thereby inducing the flight of the drone (200).

[0039] The drone control unit (150) includes a microprocessor (152), and the drone (100) may additionally include memory (not shown). The memory stores various sensor data and various programs. The memory may be volatile memory (e.g., SRAM, DRAM) or non-volatile memory (e.g., NAND Flash).

[0040] For example, the microprocessor (152) can control the aircraft to fly along a specific flight trajectory by converting a motor signal into a motor control signal in a general situation. Furthermore, the microprocessor (152) can measure attitude based on sensor data using a trained spike neural network (SNN) to recognize specific situations, and control the aircraft to fly while maintaining attitude by adjusting the motor control signal in specific situations.

[0041] As another example, a microprocessor (152) included in a drone control unit (150) may control the drone to fly along a specific flight trajectory by converting a motor signal into a motor control signal in a general situation, store a learned spike neural network (SNN) in a memory, and execute it in the microprocessor (152) to measure the attitude based on sensor data using the spike neural network (SNN), recognize a specific situation, and control the drone to fly while maintaining the attitude by adjusting the motor control signal in a specific situation.

[0042] As another example, the drone control unit (150) may include separate hardware that uses a trained spike neural network (SNN) to measure attitude based on sensor data, recognizes specific situations, and controls flight while maintaining attitude by adjusting motor control signals in specific situations. The separate hardware may be implemented as an analog circuit or a semiconductor chip, and may be either a digital circuit or an analog circuit. This will be described later with reference to FIGS. 4 and 5.

[0043] Neural networks (NNs) are an artificial intelligence technique that mimics the neural network of the human brain and is applied in various industries, such as data mining, language recognition, image processing, and signal processing. Previously, convolutional neural networks (CNNs) were widely used. However, these require large amounts of memory and high power consumption, making them difficult to apply to small systems. This led to the emergence of spiking neural networks (SNNs), which resemble the learning and information processing methods of the human brain while utilizing small amounts of data.

[0044] Figure 3 is a schematic diagram of a portion of a spike neural network included in the drone control unit of Figure 2.

[0045] Referring to FIG. 3, the spike neural network (SNN) included in the drone control unit (150) includes multiple layers (Layers, 210), and each layer (210) contains multiple neurons. The layer (210) represents a group of multiple neurons having the same directionality.

[0046] Based on an arbitrary layer, it includes a pre-synaptic neuron (220) and a post-synaptic neuron (250), and a synapse (230) connecting the pre-synaptic neuron (120) and the post-synaptic neuron (250).

[0047] Neurons existing in different layers (210) are connected and signals are transmitted through synapses (230). In a neural network, the neuron before a synapse (230) is a presynaptic neuron (220), and the neuron after the synapse (230) that is connected to the presynaptic neuron (220) through the synapse (230) is a post-synaptic neuron (250). A signal generated in a presynaptic neuron (220) and transmitted to a post-synaptic neuron (250) through the synapse (230) is called an input spike (240). An output spike (260) is a signal generated in a post-synaptic neuron (250).

[0048] SNN (Spiking Neural Network) is a neural network method in which an output spike (260) occurs only when the sum of input spikes (240) exceeds the firing threshold of the output neuron.

[0049] That is, the post-synaptic neuron (250) multiplies each spike input from the pre-synaptic neuron (220) by a synaptic weight, and when the sum of all these values ​​exceeds a certain threshold, it fires to the next layer (210).

[0050] Therefore, we need to find the optimal weights so that they can exceed a certain threshold, and then we control the output by repeating the above calculations after adjusting the amount of change in the weights to obtain new synaptic weights.

[0051] SNNs typically use an unsupervised learning method called Spiking Timing Dependent Plasticity (STDP). STDP learning optimizes synaptic weights to control output.

[0052] In SNN, when an input spike (240) is transmitted to an output neuron (250) through a synapse (230), each synapse (230) has a synaptic weight. The synaptic weight is an arbitrary value that is multiplied by the input spike (240) to amplify or attenuate the input spike (240). All input spikes (240) multiplied by the synaptic weight are added and compared with the neuron threshold of the output to control the output. Therefore, an optimized synaptic weight design for controlling the output is required. STDP (Spiking Timing Dependent Plasticity) is a function that calculates the amount of change in the synaptic weight by using the difference between the time when the input spike (240) occurs and the time when the output spike (260) occurs.

[0053] That is, the weight of the synapse is adjusted by the difference between the time of occurrence of an input spike (240) in a post-synaptic neuron (250) and the time of occurrence of an output spike (260) in a pre-synaptic neuron (220).

[0054] The drone control unit (150) applies an algorithm for learning and classifying a spike neural network (SNN). During the process of learning and classifying given data, the artificial neuron analyzes the drone's (100) attitude information by generating a small number of spikes simultaneously at multiple points. Through this, the spike neural network (SNN) analyzes the drone's (100) attitude information and generates a motor control signal.

[0055] A control signal can be generated based on the attitude information of the drone (100) analyzed by the spike neural network (SNN). Through this, the spike neural network (SNN) can quickly control the attitude of the drone (100).

[0056] As mentioned above, general drones do not have a way to control the drone in certain situations such as gusts to prevent it from drifting or tilting, crashing, or losing control. In addition, when controlling the drone in certain situations such as gusts with general control methods, the high power consumption and slow computation speed make it unsuitable for use in gusts that require flight time, stability, and quick response.

[0057] A drone (100) according to one embodiment solves this problem by using a spike neural network (SNN) to adjust motor control signals based on sensor data, compensate for gust effects, and maintain a desired flight trajectory.

[0058] Spike neural networks (SNNs) offer low-power and low-latency advantages over traditional networks like deep learning and recurrent neural networks in terms of spatiotemporal information processing. These advantages include low power consumption, high parallel processing, and real-time operation. This is crucial for drone control systems, where low latency and low power consumption are essential for long-term, safe operation.

[0059] A drone (100) according to one embodiment provides a spike neural network-based drone optimized for low-power and low-latency operation in specific situations, such as gusty wind conditions. The drone (100) according to one embodiment can provide efficient and robust control while minimizing power consumption by integrating sensor data, a spike neural network, and a motor control system as subsystems. Furthermore, the drone (100) according to one embodiment can optimize performance under various weather conditions through the adaptability and learning mechanisms of the spike neural network.

[0060] Hereinafter, examples of implementing separate hardware to measure attitude based on sensor data using a learned spike neural network (SNN) to recognize a specific situation and control flight while maintaining attitude by adjusting motor control signals in a specific situation are described with reference to FIGS. 4 and 5.

[0061] Figure 4 is a configuration diagram of a drone control unit of a drone according to another embodiment.

[0062] Referring to FIG. 4, in a drone (100A) according to another embodiment, a drone control unit (150) may include a first microprocessor (154) that converts a motor signal into a motor control signal in a general situation and controls the drone to fly in a specific flight trajectory, and a second microprocessor (156) that measures attitude based on sensor data using a learned spike neural network (SNN) to recognize a specific situation, and controls the drone to maintain the flight trajectory by adjusting the motor control signal in the specific situation.

[0063] The first microprocessor (154) may be a general microprocessor, and the second microprocessor (156) may be a dedicated microprocessor implementing a spike neural network (SNN). The second microprocessor (156) may be a gust situation control analog computer (158) that processes analog signals as described with reference to FIG. 5, but may also be a digital microprocessor that processes digital signals in the same manner as the first microprocessor (154).

[0064] Figure 5 is a configuration diagram of a drone control unit of a drone according to another embodiment.

[0065] Referring to FIG. 6, in a drone (100B) according to another embodiment, a drone control unit (150) may include a general control microprocessor (157) that converts a motor signal into a motor control signal in a general situation and controls the drone to fly in a specific flight trajectory, and a gust situation control analog computer (158) that measures attitude based on sensor data using a learned spike neural network (SNN) to recognize a specific situation, and controls the drone to fly while maintaining attitude by adjusting the motor control signal in a specific situation.

[0066] The conventional control microprocessor (157) can be implemented as a von Neumann computer-based microprocessor system capable of performing the flight and desired tasks of the drone (100) in general or normal situations rather than in specific situations such as gusts of wind.

[0067] The drone control unit (150) recognizes a specific situation, such as a gust of wind, and transfers the drone's flight control to the SNN-based gust of wind situation control analog computer (158) based on the recognition.

[0068] As described above, the aforementioned spike neural network (SNN) utilized in the gust situation control analog computer (158) is an artificial neural network that imitates the operating principles of biological neurons, and the spike neural network (SNN) is used to detect and analyze the attitude of the drone (100) and generate a control signal. The gust situation control analog computer (158) can implement a drone attitude control system with low power and low latency by applying a spike neural network (SNN) capable of processing analog signals.

[0069] The analog computer (158) for controlling gust situations applies an algorithm for learning and classifying a spike neural network (SNN). In the process of learning and classifying given data, the artificial neuron analyzes the attitude information of the drone (100) through the simultaneous occurrence of a small number of spikes at multiple points. Through this, the spike neural network (SNN) analyzes the attitude information of the drone (100) and generates a motor control signal.

[0070] A device is required that generates a control signal based on the attitude information of a drone (100) analyzed by a spike neural network (SNN). Through this, the spike neural network (SNN) can quickly control the attitude of the drone (100).

[0071] A drone (100B) according to another embodiment described above utilizes a spike neural network (SNN) to quickly control and maintain the attitude of the aircraft in a gust of wind, and is designed using an analog computer-based integrated circuit for this purpose.

[0072] To this end, the drone's attitude is quickly detected and analyzed using a spike neural network (SNN) to immediately generate a control signal. For this purpose, a low-power, low-latency spike neural network (SNN) structure is utilized. Accordingly, the drone (100B) according to another embodiment described above can quickly and stably control the attitude of the drone (100B) in a gust of wind, thereby enabling safe flight.

[0073] Figure 6 is a conceptual diagram of the flight control transfer process of the conventional control microprocessor and the gust situation analog computer of Figure 5.

[0074] Referring to FIGS. 5 and 6, in a drone (100B) according to another embodiment, when a gust of wind situation is recognized, the drone control unit (150) can transfer control of the aircraft to a gust of wind situation control analog computer (158), and when the gust of wind situation is over, the control of the aircraft can be transferred to a normal control microprocessor (157).

[0075] Specifically, when the control of the aircraft is in the gust situation control analog computer (158), the determination of the degree of stabilization of the aircraft of the drone (100) is made through a spike neural network (SNN), and when the spike neural network (SNN) recognizes the end of the gust situation, the control is transferred to the existing conventional control microprocessor (157).

[0076] According to another embodiment, a drone (100B) can more efficiently implement a spike neural network (SNN) using an analog computer-based integrated circuit. This is also called a neural processing unit (NPU) or neuromorphic chip, and can more efficiently implement a drone attitude control system.

[0077] Figure 7 illustrates the input / output signals of the gust situation control analog computer of Figure 6.

[0078] Referring to FIG. 7, the gust situation control analog computer (158) can receive a motor signal and sensor data, and output a gust situation judgment signal and a motor control signal that judge a gust situation using a learned spike neural network (SNN).

[0079] The gust situation control analog computer (158) receives motor signals and sensor data, measures attitude based on the sensor data using a learned spike neural network (SNN), recognizes a specific situation, and outputs a gust situation judgment signal and a motor control signal in a specific situation to control flight while maintaining attitude.

[0080] The drones (100, 100A, 100B) according to the above-described embodiments can be recognized as superior to conventional drone attitude control systems. This is because they utilize a spike neural network (SNN) to rapidly detect and analyze the surrounding environment and conditions, such as the drone's attitude, the degree of wind influence, and predictions of future wind intensity, and immediately generate control signals while possessing low power and low latency, thereby demonstrating more efficient performance than conventional systems.

[0081] The drones (100, 100A, 100B) according to the aforementioned embodiments have the advantage of being able to quickly and stably control their attitude in gusty winds, thereby enabling safe flight. Therefore, the drones (100, 100A, 100B) according to the aforementioned embodiments offer a high level of safety, stability, and performance in the drone industry.

[0082] Figure 8 is a flowchart of a drone control method according to another embodiment.

[0083] Referring to FIG. 8, a drone control method (300) according to another embodiment includes a first step (S310) of controlling the drone to fly along a specific flight trajectory by converting a motor signal into a motor control signal in a general situation, and a second step (S320) of controlling the drone to fly while maintaining the attitude by measuring the attitude based on sensor data using a learned spike neural network and adjusting the motor control signal in the specific situation.

[0084] In the second step (S320), the learned spike neural network can be used to convert the adjusted motor control signal into a specific PWM signal that adjusts the motor speed and direction.

[0085] As mentioned above, the sensor data may be, but is not limited to, angular velocity sensed by a gyro sensor and acceleration sensed by an acceleration sensor.

[0086] As described above with reference to FIG. 3, the spike neural network (SNN) includes a plurality of layers (210), and each layer (210) includes a plurality of neurons, and based on an arbitrary layer (210), includes a pre-synaptic neuron (220) and a post-synaptic neuron (250), and a synapse (230) connecting the pre-synaptic neuron (220) and the post-synaptic neuron (250), and the weight of the synapse can be adjusted based on the difference in the time of occurrence of an output spike (260) in the post-synaptic neuron (250) and the time of occurrence of an input spike (240) in the pre-synaptic neuron (220).

[0087] For example, in the first step (S310), the first microprocessor (154) illustrated in FIG. 4 controls the flight to a specific flight trajectory by converting the motor signal into a motor control signal in a general situation, and in the second step (320), the second microprocessor (156) illustrated in FIG. 4 measures the attitude based on sensor data using a learned spike neural network (SNN) to recognize a specific situation, and controls the flight to maintain the attitude by adjusting the motor control signal in the specific situation.

[0088] As another example, in the first step (S310), the normal control microprocessor (157) illustrated in FIG. 5 converts a motor signal into a motor control signal in a general situation to control the flight along a specific flight trajectory, and in the second step (S320), the gust situation control analog computer (158) illustrated in FIG. 5 measures the attitude based on sensor data using a learned spike neural network to recognize a specific situation, and controls the flight while maintaining the attitude by adjusting the motor control signal in a specific situation.

[0089] In the second step (S320), as illustrated in FIG. 6, if a gust situation is recognized, control of the aircraft can be transferred to a gust situation control analog computer (158), and if the gust situation is over, control of the aircraft can be transferred to a normal control microprocessor (157).

[0090] As described above with reference to FIG. 7, the gust situation control analog computer (158) can receive motor signals and sensor data, and output a gust situation judgment signal and a motor control signal that judge a gust situation using a learned spike neural network.

[0091] Figure 9 illustrates in detail the drone control processes of the second stage of Figure 8.

[0092] Referring to FIG. 9, in the second step (S320) described above with reference to FIG. 8, control of the drone is transferred in a gust situation based on a motor signal (PWM) (S321), sensing data on the input motor signal (PWM) and the current state of the aircraft is input (S322), spike embedding and a spike neural network for the sensing data are input (S323), a PWM control signal suitable for each electric motor (220) is generated based on the input information and input to the electric motor (220) (S324), and after controlling the drone through the PWM control signal, control is terminated when the gust situation is resolved (S325).

[0093] As described above with reference to FIG. 6, when a gust situation is recognized, control of the aircraft can be transferred to a gust situation control analog computer (158), and when the gust situation is over, control of the aircraft can be transferred to a normal control microprocessor (157).

[0094] The drone control method (300) according to another embodiment described above can be recognized as superior to conventional drone attitude control systems. It utilizes a spike neural network (SNN) to rapidly detect and analyze the surrounding environment and conditions, such as the drone's attitude, the degree of wind influence, and predictions of future wind intensity, and immediately generates a control signal while possessing low power and low latency, thereby demonstrating more efficient performance than conventional systems.

[0095] The drone control method (300) according to another embodiment described above has the advantage of enabling fast and stable attitude control in gusty wind conditions, thereby enabling safe flight. Therefore, the drone control method (300) according to another embodiment described above provides a high level of safety, stability, and performance in the drone industry.

[0096] The above description is merely an illustrative example of the technical idea of ​​the present disclosure, and those skilled in the art to which the present disclosure pertains will appreciate that various modifications and variations can be made without departing from the essential characteristics of the technical idea of ​​the present disclosure. In addition, the present embodiments are not intended to limit the technical idea of ​​the present disclosure but rather to explain it, and therefore the scope of the technical idea of ​​the present disclosure is not limited by these embodiments. The scope of protection of the present disclosure should be interpreted by the claims below, and all technical ideas within a scope equivalent thereto should be interpreted as being included within the scope of the rights of the present disclosure.

[0097]

[0098] CROSS-REFERENCE TO RELATED APPLICATION

[0099] This patent application claims priority under 35 USC § 119(a) to Korean Patent Application No. 10-2023-0179317, filed December 12, 2023, the entire contents of which are incorporated herein by reference. Furthermore, this patent application claims priority in countries other than the United States for the same reasons, the entire contents of which are incorporated herein by reference.

Claims

1. Drone sensor section providing sensor data; A drone flight section providing motor signals; and A drone including a drone control unit that controls the drone to fly along a specific flight trajectory by converting the motor signal into the motor control signal in a general situation, measures the attitude based on the sensor data using a learned spike neural network to recognize a specific situation, and controls the drone to fly while maintaining the attitude by adjusting the motor control signal in the specific situation.

2. In paragraph 1, The drone flight section is a drone that converts the motor control signal adjusted using the learned spike neural network into a specific PWM signal that adjusts the motor speed and direction.

3. In paragraph 1, The above drone sensor section includes a gyro sensor and an acceleration sensor, and the sensor data is a drone, which is an angular velocity sensed by the gyro sensor and an acceleration sensed by the acceleration sensor.

4. In paragraph 1, The above spike neural network includes a plurality of layers, and each layer includes a plurality of neurons, and based on an arbitrary layer, includes a pre-synaptic neuron, a post-synaptic neuron, and a synapse connecting the pre-synaptic neuron and the post-synaptic neuron, and a drone that learns to adjust the weight of the synapse based on the difference between the spike occurrence time in the post-synaptic neuron and the spike occurrence time in the pre-synaptic neuron.

5. In paragraph 1, The drone control unit comprises a first microprocessor that converts the motor signal into the motor control signal in the general situation and controls the drone to fly in a specific flight trajectory, and a second microprocessor that measures the attitude based on the sensor data using the learned spike neural network to recognize a specific situation, and controls the drone to fly while maintaining the attitude by adjusting the motor control signal in the specific situation.

6. In paragraph 1, The drone control unit includes a general control microprocessor that converts the motor signal into the motor control signal in the general situation and controls the drone to fly in a specific flight trajectory, and a gust situation control analog computer that measures the attitude based on the sensor data using the learned spike neural network to recognize a specific situation, and controls the drone to fly while maintaining the attitude by adjusting the motor control signal in the specific situation.

7. In paragraph 6, A drone in which the above drone control unit, when recognizing the above gust situation, transfers control of the aircraft to the gust situation control analog computer, and when the gust situation ends, transfers control of the aircraft to a normal control microprocessor.

8. In paragraph 6, The above wind gust situation control analog computer receives the motor signal and the sensor data, and outputs a wind gust situation judgment signal and the motor control signal using a learned spike neural network to judge the wind gust situation, the drone.

9. A first step for controlling the flight along a specific flight trajectory by converting a motor signal into a motor control signal in a general situation; and A method for controlling a drone, comprising a second step of measuring a posture based on the sensor data using a learned spike neural network to recognize a specific situation, and controlling the drone to fly while maintaining the posture by adjusting the motor control signal in the specific situation.

10. In paragraph 9, A method for controlling a drone in the second step, wherein the motor control signal adjusted using the learned spike neural network is converted into a specific PWM signal for adjusting the motor speed and direction.

11. In paragraph 9, The above sensor data is a method for controlling a drone, which is an angular velocity sensed by a gyro sensor and an acceleration sensed by an acceleration sensor.

12. In paragraph 9, The above spike neural network includes a plurality of layers, and each layer includes a plurality of neurons, and based on an arbitrary layer, includes a pre-synaptic neuron, a post-synaptic neuron, and a synapse connecting the pre-synaptic neuron and the post-synaptic neuron, and a drone control method that learns to adjust the weight of the synapse based on the difference between the spike occurrence time in the post-synaptic neuron and the spike occurrence time in the pre-synaptic neuron.

13. In paragraph 9, In the above first step, the first microprocessor converts the motor signal into the motor control signal in the above general situation and controls the flight to a specific flight trajectory, A method for controlling a drone, wherein in the second step, the second microprocessor measures the attitude based on the sensor data using the learned spike neural network to recognize a specific situation, and controls the drone to fly while maintaining the attitude by adjusting the motor control signal in the specific situation.

14. In paragraph 9, In the above first step, the normal control microprocessor converts the motor signal into the motor control signal in the above general situation and controls the flight to a specific flight trajectory. A method for controlling a drone, wherein in the second step, a gust situation control analog computer measures the attitude based on the sensor data using the learned spike neural network to recognize a specific situation, and controls the drone to fly while maintaining the attitude by adjusting the motor control signal in the specific situation.

15. In paragraph 14, A method for controlling a drone, wherein in the second step, if the gust situation is recognized, control of the aircraft is transferred to the gust situation control analog computer, and if the gust situation ends, control of the aircraft is transferred to a normal control microprocessor.

16. In paragraph 14, A method for controlling a drone, wherein the above-mentioned wind gust situation control analog computer receives the above-mentioned motor signal and the above-mentioned sensor data, and outputs a wind gust situation judgment signal and the above-mentioned motor control signal using a learned spike neural network.

Citation Information

Patent Citations

  • Flight control device, method and program

    JP2019059314A

  • Spiking Neural Network with STDP apllied to the threshold of neuron

    KR102204107B1

  • Autonomous flying drone using artificial intelligence neural network

    KR102313115B1

  • Devices, systems, methods, and programs that provide a service for matching pet grooming designers using augmented reality

    KR102632584B1

  • Drone Terrain Surveillance with Camera and Radar Sensor Fusion for Collision Avoidance

    US20180253980A1