An acoustic and character dual-mode unmanned aerial vehicle control system
By deploying a command parsing model and integrating identity verification and compliance management on mobile devices, lightweight and multi-mode operation of drones is achieved, solving the problems of single drone operation methods and network dependence, and improving the flexibility, stability and compliance of operation.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- 张方军
- Filing Date
- 2026-04-21
- Publication Date
- 2026-07-10
AI Technical Summary
Existing drone control technology relies on traditional remote controllers or built-in control programs on the drone itself, resulting in limited control methods, high hardware costs, significant computational power consumption, and unstable operation in scenarios without or with weak network coverage. Furthermore, it lacks identity verification and airspace compliance management, making it difficult to adapt to the standardized management of civilian unmanned aerial vehicles.
The intelligent command parsing model is deployed on mobile software to achieve lightweight control of the drone flight control side through wireless communication. It integrates biometric authentication and flight compliance management, supports voice control single mode, text control single mode and dual mode control, and the mobile offline recognition SDK supports parsing in all scenarios.
Reduce drone hardware costs, improve operational flexibility and stability, ensure operational compliance and safety, and adapt to drone operation needs across all scenarios.
Smart Images
Figure FT_1 
Figure FT_2 
Figure FT_3
Abstract
Description
Technical Field
[0001] This invention relates to the field of intelligent control technology for unmanned aerial vehicles (UAVs), specifically to an intelligent control system for single-mode and dual-mode UAVs based on the interface between mobile phone software and UAV hardware, which includes voice control and text control. Background Technology
[0002] Currently, drone control technology largely relies on traditional remote controllers or simple control programs built into the drone itself. This results in issues such as limited control methods, reliance on drone hardware for command parsing computational power, and the need for targeted hardware modifications on the flight control side. Some voice-controlled or text-controlled drone control solutions deploy the parsing model on the drone itself, leading to high drone hardware costs, significant computational power consumption, poor compatibility between mobile devices and drones for command exchange, and inability to achieve stable control in scenarios without or with weak network connectivity.
[0003] Meanwhile, existing drone control systems lack standardized command parsing and issuance mechanisms. Complex spoken voice commands and lengthy text commands cannot be effectively parsed, and most do not integrate identity verification and airspace compliance control functions, posing security risks such as leakage of control authority and illegal flight, making it difficult to adapt to the standardized management requirements of civil unmanned aerial vehicles. Summary of the Invention
[0004] This invention addresses the shortcomings of existing drone control technologies by providing an intelligent drone control system. This system enables lightweight control with mobile software handling command parsing and computing power, requiring no hardware modifications to the drone flight control unit. It also covers voice-controlled single-mode, text-controlled single-mode, and dual-mode control scenarios, while accommodating offline control, identity verification, and airspace compliance management, thereby improving the flexibility, security, and compliance of drone control. Technical solution
[0005] To achieve the above objectives, the present invention adopts the following technical solution: an intelligent control system for unmanned aerial vehicles (UAVs), comprising three core control schemes: voice-controlled single-mode, text-controlled single-mode, and voice-controlled / text-controlled dual-mode. All are based on an architecture of external control terminal software on a mobile phone + wireless connection with UAV hardware. The core feature is that the intelligent model related to instruction parsing is deployed on the mobile phone software, while the UAV flight control side only retains the instruction receiving unit and the flight control execution unit, requiring no hardware modification. Standardized flight control instructions parsed by the mobile phone can be wirelessly transmitted to the UAV flight control side to complete control. It can also be expanded and integrated with additional functions such as biometric authentication, flight compliance management, and offline identification and parsing.
[0006] Voice-controlled single-mode control system: including a voice control core system, which deploys an intelligent model related to voice command parsing in the software of an external control terminal on a mobile phone. The mobile phone software collects the user's voice control commands, converts them into standardized flight control commands after intelligent parsing, and sends them to the UAV flight control side via wireless communication to achieve docking and complete the voice intelligent control of the UAV.
[0007] The text-based single-mode control system includes a text-based core system. The text-based core system deploys an intelligent model related to text command parsing in the software of an external control terminal on a mobile phone. The mobile phone software collects the user's text control commands, which are then intelligently parsed and converted into standardized flight control commands. These commands are then wirelessly transmitted to the UAV flight control side to achieve docking and complete the text-based intelligent control of the UAV.
[0008] The voice-controlled and text-controlled dual-mode control system includes a dual-mode control core system. This core system integrates both voice and text control modes. The intelligent models related to dual-mode command parsing are deployed in the software of an external control terminal on a mobile phone. The mobile phone software collects dual-mode control commands, achieving unified parsing, priority scheduling, and complementary takeover. These commands are then converted into standardized flight control commands and wirelessly transmitted to the UAV flight control side for integration, completing the dual-mode intelligent control of the UAV. The dual-mode control core system further includes a voice control subsystem, a text control subsystem, and a dual-mode fusion scheduling module, enabling the reception, priority determination, scheduling allocation, and complementary takeover triggering of dual-mode commands.
[0009] Furthermore, the control system integrates a biometric authentication system, which is deployed on the mobile software and communicates bidirectionally with each core control system. It grants control permissions by collecting and verifying the user's voiceprint characteristics, and prohibits the issuance of any flight control commands if the verification fails.
[0010] Furthermore, the control system integrates a flight compliance management system, which is deployed on a mobile app and communicates bidirectionally with each core control system to achieve real-time synchronization of airspace compliance data, pre-flight command compliance verification, and flight dynamic compliance management, intercepting non-compliant commands. This system is interconnected with the Civil Unmanned Aerial Vehicle Integrated Management Platform (UOM) to complete the real-name registration verification of UAVs, flight plan reporting, and encrypted reporting of flight dynamics, adapting to official airspace control rules.
[0011] Furthermore, the software of the mobile external control terminal has a built-in offline recognition SDK that supports offline voice / text recognition and parsing of Mandarin and multiple dialects. In scenarios with no network or weak network, it can independently complete command parsing and scheduling, realizing offline intelligent control of the drone.
[0012] Furthermore, the voice control core system / voice control subsystem includes a voice acquisition module, a voice recognition and parsing module, a command conversion module, and a command issuance module connected in sequence, each module being deployed on a mobile phone software; the voice recognition and parsing module adopts AI deep semantic parsing, which can parse complex voice commands with multiple sentences, colloquial language and environmental descriptions, automatically remove redundant information and extract flight control intentions.
[0013] Furthermore, the text control core system / text control subsystem includes a text input module, a text semantic parsing module, a command mapping module, and a command execution module connected in sequence, each module being deployed on a mobile phone software; the text input module supports speech-to-text function, the text semantic parsing module supports shortcut command recognition, and can preset shortcut commands and directly trigger corresponding flight control commands. Beneficial effects
[0014] Compared with the prior art, the present invention has the following advantages: Lightweight control and reduced hardware costs: By deploying the intelligent command parsing model on the mobile software, the drone flight control side only retains the basic command receiving and execution unit, without the need for hardware modification. This significantly reduces the hardware computing power requirements and production costs of the drone, while also simplifying the interface logic between the mobile and drone ends.
[0015] Multi-mode coverage enhances operational flexibility: It supports voice-controlled single-mode, text-controlled single-mode, and dual-mode operation. Dual-mode operation can prioritize and complement each other's commands, adapting to different users' operating habits and usage scenarios. It can also parse complex spoken voice commands and long text commands, improving the accuracy of command parsing.
[0016] Full-scene adaptation and enhanced control stability: The mobile software has a built-in offline recognition SDK, which supports independent parsing and control in scenarios with no network or weak network, breaking the limitations of the network environment and achieving stable drone control in all scenarios.
[0017] Multiple security measures ensure operational compliance: An integrated voiceprint authentication system prevents leakage of control permissions; the integrated flight compliance management system enables airspace data synchronization and command compliance verification, and is interconnected with the official management platform, strictly adapting to the standardized management requirements of civilian drones and preventing illegal flights.
[0018] Modular design facilitates functional expansion: The core control system and additional function systems are independent of each other, and functions such as biometric verification and flight compliance management can be selectively integrated according to actual needs, adapting to the usage requirements of different application scenarios, and have high practicality and scalability. Attached Figure Description
[0019] Figure 1 is a flowchart of voice command processing for the voice-controlled single-mode control system of the present invention; Figure 2 is a flowchart of text command processing for the text-controlled single-mode control system of the present invention; Figure 3 is a flowchart of permission verification for the biometric identity verification system of the present invention; Figure 4 is a flowchart of compliance verification for the flight compliance management system of the present invention.
[0020] In Figure 1, the command processing logic for voice-controlled single-mode operation is as follows: voice acquisition → noise reduction preprocessing → semantic parsing to extract intent → conversion to standard flight control commands → permission verification → compliance verification → execution. The execution result is fed back to the voice acquisition stage in a closed loop, achieving closed-loop control of the entire command process. In Figure 2, the command processing logic for text-controlled single-mode operation is as follows: text input → semantic segmentation and parsing → multi-round matching with the flight control command library → generation of standardized commands → compliance verification → permission verification → execution. This covers the entire processing chain of text commands from input to execution, adapting to the accurate parsing of complex text commands. In Figure 3, the permission verification logic for biometric authentication is as follows: collecting user voiceprint features → retrieving a pre-stored encrypted feature library → real-time feature comparison. If the comparison passes, control permissions are granted; if the comparison fails, all control commands are intercepted and an alarm is triggered, achieving secure identity control for drone operation. In Figure 4, the compliance verification logic for flight compliance control is as follows: synchronizing official airspace / no-fly zone data → real-time verification of flight plans / routes. If compliance rules are met, flight commands are released; if no-fly zones are violated... For violations of airspace, interception orders, risk warnings, and mandatory flight restrictions will be issued to achieve full-dimensional compliance management of drone flights. Detailed Implementation
[0021] The present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments. The scope of protection of the present invention is not limited to the following embodiments.
[0022] Example 1: Voice-Controlled Single-Mode Unmanned Aerial Vehicle Intelligent Control System The voice-controlled single-mode UAV intelligent control system of this embodiment includes a voice control core system. The voice command parsing AI model of the voice control core system is deployed in a mobile APP. The UAV flight control side is only equipped with a wireless communication receiving module and a flight control execution module, without any modification to the original hardware of the UAV.
[0023] Users issue spoken control commands through the voice acquisition portal of the mobile APP. The voice recognition and parsing module of the mobile APP performs deep semantic analysis on the commands, removes redundant information, and extracts the flight control intention of "ascend 50 meters and fly 100 meters due east". This is converted into standardized flight control commands that the drone can recognize. After authorization verification and compliance verification, the commands are sent to the receiving module on the drone's flight control side via Bluetooth wireless communication. The flight control execution module controls the drone to complete the corresponding actions according to the commands. The command execution status is fed back to the mobile APP in real time, completing the closed-loop control of the entire command process as shown in Figure 1.
[0024] Example 2: Intelligent Control System for Single-Mode Unmanned Aerial Vehicles with Word Control The text-controlled single-mode UAV intelligent control system of this embodiment includes a text control core system. The text command parsing AI model of the text control core system is deployed in a mobile app. The hardware architecture of the UAV flight control side is the same as that of Embodiment 1.
[0025] Users can input lengthy control commands such as "hover and take a picture of the scene in front, then return to the takeoff point" in the text input box of the mobile app, or quickly generate text commands through the voice-to-text function. The text semantic parsing module of the mobile app understands the text and performs semantic word segmentation of the command, matches it with the flight control command library and recognizes the preset "return to takeoff point" shortcut command. After being converted into standardized flight control commands, they are verified for compliance and permissions and then sent to the drone via WiFi wireless communication. The drone completes the hovering, shooting and return actions according to the command. The entire flight dynamics are synchronized to the mobile app, realizing the end-to-end processing of text commands as shown in Figure 2.
[0026] Example 3: Voice-controlled and Word-controlled Dual-mode Unmanned Aerial Vehicle Intelligent Control System The voice-controlled and text-controlled dual-mode UAV intelligent control system of this embodiment includes a dual-mode control core system. The dual-mode control core system integrates a voice control subsystem, a text control subsystem, and a dual-mode fusion scheduling module. Each module is deployed in a mobile APP, while the hardware architecture of the UAV flight control side remains unchanged.
[0027] The dual-mode fusion scheduling module is pre-set with a scheduling rule that "voice commands take precedence over text commands". When a user simultaneously issues the voice command "ascend 30 meters immediately" and the text command "fly 50 meters due north", the dual-mode fusion scheduling module prioritizes receiving and scheduling the voice command. The drone completes the ascent first, and the text command is automatically executed after the ascent is completed. If the command parsing of one mode fails, the system automatically triggers the complementary takeover of the other mode to ensure the continuity of drone control. Both modes' commands are converted into flight control commands according to a standardized process and then issued for execution.
[0028] Example 4: Dual-mode UAV intelligent control system with integrated additional functions This embodiment, based on the dual-mode control system of Embodiment 3, integrates a biometric authentication system and a flight compliance management system. All systems are deployed in a mobile app, realizing intelligent control and dual management of safety and compliance for the drone. The specific process is as follows: Identity verification process: As shown in Figure 3, after the user opens the mobile APP, the system automatically collects the user's voiceprint features and compares them in real time with the pre-stored authorized voiceprint encrypted feature library. If the comparison is consistent, the drone control permission is granted. If the comparison fails, the user cannot enter the command collection interface and is prohibited from issuing any control commands. Compliance Management Process: As shown in Figure 4, the flight compliance management system synchronizes official airspace control data in real time. When a user issues a control command to "fly into the airport's no-fly zone," the system performs a preliminary compliance check on the command. If the command is deemed non-compliant, it is immediately intercepted and prohibited from being sent to the drone. A violation notification pops up on the mobile app. At the same time, the system is interconnected with the Civil Unmanned Aerial Vehicle Integrated Management Platform (UOM) to complete the drone's real-name registration verification and flight plan reporting. The drone's real-time flight dynamics are encrypted and reported to the platform, achieving comprehensive flight compliance management. Offline control process: When the user is in a weak network / no network scenario such as a mountainous area, the offline recognition SDK of the mobile APP will be automatically activated. It supports offline voice / text recognition and parsing of local dialects. After the user issues a dialect voice command or enters a text command, the mobile APP will independently complete the command parsing, scheduling and standardization conversion, and send it to the drone through 4G wireless communication to realize normal control in the no-network scenario. The command execution status will be fed back to the mobile APP in real time.
Claims
1. A voice-controlled unmanned aerial vehicle (UAV) intelligent control system, characterized in that, It includes a voice control core system and a UAV flight control unit; the voice control core system deploys a voice command parsing intelligent model on an external control terminal, and the UAV flight control unit is equipped with a command receiving unit and a flight control execution unit, and is communicatively connected to the external control terminal; the voice control core system is used to collect and parse user voice control commands, convert them into flight control commands, and then send them to the UAV flight control unit to realize intelligent voice control of the UAV.
2. A word-controlled unmanned aerial vehicle (UAV) intelligent control system, characterized in that, It includes a text control core system and a UAV flight control unit; the text control core system deploys a text command parsing intelligent model on an external control terminal, and the UAV flight control unit is equipped with a command receiving unit and a flight control execution unit, and is communicatively connected to the external control terminal; the text control core system is used to collect and parse user text control commands, convert them into flight control commands, and then send them to the UAV flight control unit to realize intelligent text control of the UAV.
3. A voice-controlled and text-controlled dual-mode unmanned aerial vehicle (UAV) intelligent control system, characterized in that, It includes a dual-mode control core system and a UAV flight control unit; the dual-mode control core system integrates voice and text control modes, and deploys a dual-mode command parsing intelligent model on an external control terminal; the UAV flight control unit is equipped with a command receiving unit and a flight control execution unit, and is communicatively connected to the external control terminal; the dual-mode control core system collects dual-mode control commands, processes and converts them into flight control commands, and sends them to the UAV flight control unit for execution, thereby realizing dual-mode intelligent control of the UAV.
4. The voice-controlled and text-controlled dual-mode UAV intelligent control system according to claim 3, characterized in that, The dual-mode control core system includes a voice control subsystem, a text control subsystem, and a dual-mode fusion scheduling module. The dual-mode fusion scheduling module is bidirectionally connected to the voice control subsystem and the text control subsystem to realize the reception, priority determination, scheduling allocation, and complementary takeover triggering of dual-mode control commands. The dual-mode fusion scheduling module is deployed on an external control terminal.
5. The intelligent control system for unmanned aerial vehicles according to claim 1, 2, or 3, characterized in that, The UAV flight control unit requires no hardware modification; it only needs to connect with the external control terminal through its own command receiving unit and flight control execution unit to complete command docking and control execution.
6. The intelligent control system for unmanned aerial vehicles according to claim 1, 2, or 3, characterized in that, It also includes a biometric authentication system, which is deployed on an external control terminal and communicates bidirectionally with the corresponding core control system. The biometric authentication system collects and verifies the identity features of the user, and only grants the user control permission after successful verification. If the verification fails, the user is prohibited from issuing flight control commands.
7. The intelligent control system for unmanned aerial vehicles according to claim 1, 2, or 3, characterized in that, It also includes a flight compliance management system, which is deployed on an external control terminal and has bidirectional data communication with the corresponding core control system. The flight compliance management system realizes airspace compliance data synchronization, pre-compliance verification of flight control commands, and dynamic compliance management of UAV flight, and intercepts and prohibits the issuance of non-compliant control commands.
8. The intelligent control system for unmanned aerial vehicles according to claim 1, 2, or 3, characterized in that, The external control terminal has a built-in offline recognition SDK, which supports voice / text recognition and parsing in offline mode. It can independently complete command parsing and scheduling, and send flight control commands to the UAV flight control unit to realize intelligent control of UAV in environments without network or with weak network.
9. The intelligent control system for unmanned aerial vehicles according to claim 1 or 3, characterized in that, The voice control core system or voice control subsystem includes a voice acquisition module, a voice recognition and parsing module, a command conversion module, and a command issuance module that are connected in sequence. All modules are deployed on an external control terminal. The voice recognition and parsing module adopts a deep semantic parsing method, which can parse complex spoken voice commands, extract flight control intentions, and convert them into flight control commands.
10. The intelligent control system for unmanned aerial vehicles according to claim 2 or 3, characterized in that, The text control core system or text control subsystem includes a text input module, a text semantic parsing module, a command mapping module, and a command issuing module that are connected in sequence. All modules are deployed on an external control terminal. The text input module supports speech-to-text conversion, and the text semantic parsing module supports shortcut command recognition. It can preset shortcut commands and call and trigger corresponding flight control commands.