Unmanned aerial vehicle flight simulation method and system based on virtual reality environment

By building a drone simulation model in a virtual reality environment and combining high-precision measurement data of the motion capture system, the drone flight algorithm is optimized, and the problem of ignoring actual flight environment factors in the drone simulation experiment is solved, achieving high accuracy Simulation of flights and missions are completed.

CN119087830APending Publication Date: 2024-12-06GUANGDONG LAB OF ARTIFICIAL INTELLIGENCE & DIGITAL ECONOMY (SZ) +1
View PDF 0 Cites 6 Cited by

Patent Information

Application Number
CN202410982100.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-22
Publication Date
2024-12-06

AI Technical Summary

Technical Problem

In drone simulation experiments, complex factors in actual flight environments are often ignored, such as weather conditions, aerodynamic effects and sensor errors, which leads to inaccurate simulation data and cannot effectively ensure that the drone completes the task smoothly in actual flight environments.

Method used

Using a drone flight simulation method based on virtual reality environment, a virtual simulation environment model is constructed by obtaining real environment images for preprocessing, combining motion capture system to obtain high-precision measurement data, and similarity comparison optimizes the drone flight algorithm to make unmanned The aircraft conducts flight tests in a virtual environment to simulate actual flight conditions.

Benefits of technology

It provides a safe and low-cost simulation environment, ensuring the accuracy of simulation data and the smooth completion of drone tasks, reducing operational risks, and improving the authenticity and accuracy of simulation results.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119087830A_ABST
    Figure CN119087830A_ABST
Patent Text Reader

Abstract

The invention discloses an unmanned aerial vehicle flight simulation method and system based on a virtual reality environment, and the method comprises the steps: obtaining a real environment image, carrying out the preprocessing, obtaining image feature data, and constructing a virtual simulation environment model; when a flight control instruction is received, controlling the unmanned aerial vehicle to carry out a flight test in the virtual simulation environment model to obtain simulation flight data; setting a motion capture system, and obtaining high-precision measurement data obtained by the flight test of the unmanned aerial vehicle in the virtual simulation environment model; and performing similarity comparison on the simulation flight data and the high-precision measurement data to obtain a similarity comparison result, and performing parameter optimization processing on an unmanned aerial vehicle flight algorithm according to the similarity comparison result, so that the unmanned aerial vehicle completes a specified flight task according to the optimized unmanned aerial vehicle flight algorithm. According to the invention, the accuracy of acquiring the simulation experiment data of the unmanned aerial vehicle can be effectively improved, and the unmanned aerial vehicle can be effectively ensured to smoothly complete a target flight task.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of unmanned aerial vehicle simulation, and in particular to a method, system, terminal and computer-readable storage medium for unmanned aerial vehicle flight simulation based on a virtual reality environment. Background Art

[0002] The operation and flight of drones in the real world involve certain risks and costs. Through simulation technology, simulated flights of drones can be performed in a virtual environment to verify flight paths, route planning, and flying robot behavior.

[0003] However, UAV simulation experiments often ignore some complex factors in the actual flight environment, such as real-world weather conditions (such as wind speed, rainfall, etc.), the impact of aerodynamic effects on UAV flight (such as airflow, gas density changes, etc.), sensor errors (such as image processing, laser ranging and other sensor noise and accuracy limitations) and other external interference factors. However, in actual applications, these factors have a significant impact on the flight and performance of UAVs, resulting in inaccurate simulation data and an inability to effectively ensure that the UAV can successfully complete its mission in the actual flight environment.

[0004] Therefore, the prior art still needs to be improved and developed. Summary of the invention

[0005] The main purpose of the present invention is to provide a UAV flight simulation method, system, terminal and computer-readable storage medium based on a virtual reality environment, aiming to solve the problem in the prior art that UAVs often ignore some complex factors in the actual flight environment during simulation experiments, resulting in the obtained simulation data being inaccurate and unable to effectively ensure that the UAV can successfully complete the task in the actual flight environment.

[0006] To achieve the above object, the present invention provides a UAV flight simulation method based on a virtual reality environment, and the UAV flight simulation method based on a virtual reality environment comprises the following steps:

[0007] Acquire a real environment image, preprocess the real environment image to obtain image feature data, and construct a virtual simulation environment model according to the image feature data;

[0008] When a flight control instruction is received, the UAV is controlled according to the flight control instruction to perform a flight test in the virtual simulation environment model to obtain simulated flight data;

[0009] Setting a motion capture system, and obtaining high-precision measurement data obtained by the UAV during a flight test in the virtual simulation environment model through the motion capture system;

[0010] The simulated flight data is compared with the high-precision measurement data for similarity to obtain a similarity comparison result, and the parameters of the UAV flight algorithm are optimized according to the similarity comparison result, so that the UAV can complete the designated flight mission according to the optimized UAV flight algorithm.

[0011] Optionally, the method for simulating unmanned aerial vehicle flight based on a virtual reality environment, wherein the step of acquiring a real environment image and preprocessing the real environment image to obtain image feature data, specifically includes:

[0012] Acquire a real environment image, and perform image optimization processing on the real environment image to obtain an initial optimized image, wherein the image optimization processing includes brightness adjustment, contrast adjustment, color balance adjustment and noise reduction processing;

[0013] The initial optimized image is preprocessed to obtain image feature data, wherein the preprocessing includes grayscale processing, edge detection processing and feature extraction processing.

[0014] Optionally, the UAV flight simulation method based on virtual reality environment, wherein the step of constructing a virtual simulation environment model according to the image feature data specifically includes:

[0015] Acquire a preset virtual environment model, and perform feature matching processing on the image feature data and the preset virtual environment model to obtain a feature matching result;

[0016] Using triangulation method to generate point cloud data according to the feature matching result to obtain feature point cloud data;

[0017] Using a three-dimensional reconstruction algorithm to generate an initial simulation three-dimensional model according to the characteristic point cloud data;

[0018] The initial simulation three-dimensional model is meshed to obtain a virtual simulation environment model.

[0019] Optionally, the UAV flight simulation method based on a virtual reality environment, wherein when a flight control instruction is received, the UAV is controlled according to the flight control instruction to perform a flight test in the virtual simulation environment model to obtain simulated flight data, further comprising:

[0020] Acquire a UAV simulation model and a UAV flight control system, establish a communication connection with the UAV flight control system, and establish a communication connection between the UAV simulation model and the UAV flight control system;

[0021] Generate a test control instruction, and determine whether the communication connection between the UAV simulation model and the UAV flight control system is successful according to the test control instruction;

[0022] If so, the sensor data in the drone simulation model is obtained through the drone flight control system, and a state estimation algorithm is used to obtain the current flight state of the drone based on the sensor data.

[0023] Optionally, the UAV flight simulation method based on a virtual reality environment, wherein when a flight control instruction is received, the UAV is controlled according to the flight control instruction to perform a flight test in the virtual simulation environment model to obtain simulated flight data, specifically includes:

[0024] When receiving a flight control instruction issued by a user, the UAV flight control system generates a UAV control instruction according to the flight control instruction and the current flight state, wherein the UAV control instruction includes a UAV attitude control instruction and a UAV motion control instruction;

[0025] The UAV is controlled according to the UAV attitude control instruction and the UAV motion control instruction to perform a flight test in the virtual simulation environment model to obtain simulated flight data.

[0026] Optionally, the UAV flight simulation method based on a virtual reality environment, wherein the step of setting up a motion capture system and obtaining high-precision measurement data obtained by performing a flight test of the UAV in the virtual simulation environment model through the motion capture system, specifically includes:

[0027] Determine a target flight area for the UAV and set up multiple motion capture cameras in the target flight area;

[0028] Setting a plurality of identification points on the drone, and constructing the motion capture system according to the plurality of motion capture cameras and the plurality of identification points;

[0029] The motion capture system is used to obtain high-precision measurement data of the UAV during flight testing in the virtual simulation environment model in real time.

[0030] Optionally, the UAV flight simulation method based on a virtual reality environment, wherein the simulated flight data is compared with the high-precision measurement data for similarity to obtain a similarity comparison result, and a parameter optimization process is performed on the UAV flight algorithm according to the similarity comparison result, so that the UAV completes a specified flight mission according to the optimized UAV flight algorithm, specifically includes:

[0031] Performing a similarity comparison between the simulated flight data and the high-precision measurement data to obtain a similarity comparison result, wherein the similarity comparison result includes an attitude error comparison result, a hovering offset comparison result, a flight path smoothness comparison result, a damping effect comparison result, and a flight stability index comparison result;

[0032] Determine the designated flight mission corresponding to the flight control instruction, and perform parameter optimization processing on the UAV flight algorithm according to the designated flight mission and the similarity comparison result, so that the UAV completes the designated flight mission according to the optimized UAV flight algorithm, wherein the UAV flight algorithm includes a flight control algorithm, a sensor fusion algorithm and a path planning algorithm.

[0033] In addition, to achieve the above-mentioned purpose, the present invention also provides a UAV flight simulation system based on a virtual reality environment, wherein the UAV flight simulation system based on a virtual reality environment comprises:

[0034] A virtual simulation environment model construction module is used to obtain a real environment image, pre-process the real environment image to obtain image feature data, and construct a virtual simulation environment model according to the image feature data;

[0035] A simulated flight data acquisition module is used to control the UAV to perform a flight test in the virtual simulation environment model according to the flight control instruction when receiving the flight control instruction, so as to obtain simulated flight data;

[0036] A high-precision measurement data acquisition module, used to set up a motion capture system, and obtain high-precision measurement data obtained by the UAV during the flight test in the virtual simulation environment model through the motion capture system;

[0037] The flight algorithm optimization module is used to compare the simulated flight data with the high-precision measurement data to obtain a similarity comparison result, and perform parameter optimization processing on the UAV flight algorithm according to the similarity comparison result, so that the UAV can complete the specified flight mission according to the optimized UAV flight algorithm.

[0038] In addition, to achieve the above-mentioned purpose, the present invention also provides a terminal, wherein the terminal includes: a memory, a processor, and a drone flight simulation program based on a virtual reality environment stored in the memory and executable on the processor, wherein the drone flight simulation program based on the virtual reality environment, when executed by the processor, implements the steps of the drone flight simulation method based on the virtual reality environment as described above.

[0039] In addition, to achieve the above-mentioned purpose, the present invention also provides a computer-readable storage medium, wherein the computer-readable storage medium stores a drone flight simulation program based on a virtual reality environment, and when the drone flight simulation program based on the virtual reality environment is executed by a processor, the steps of the drone flight simulation method based on the virtual reality environment as described above are implemented.

[0040] In the present invention, a real environment image is obtained, the real environment image is preprocessed to obtain image feature data, and a virtual simulation environment model is constructed according to the image feature data; when a flight control instruction is received, a UAV is controlled to perform a flight test in the virtual simulation environment model according to the flight control instruction to obtain simulated flight data; a motion capture system is set, and high-precision measurement data obtained by the UAV performing a flight test in the virtual simulation environment model is obtained through the motion capture system; a similarity comparison is performed between the simulated flight data and the high-precision measurement data to obtain a similarity comparison result, and a parameter optimization processing is performed on the UAV flight algorithm according to the similarity comparison result, so that the UAV completes a designated flight mission according to the optimized UAV flight algorithm. The present invention can provide a safe and controllable UAV actual flight environment, and the environment can be truly restored in the simulator. At the same time, combined with the pre-arranged motion capture system, the captured position and posture information is transmitted to the UAV host computer and the simulator in real time, so that the aircraft body and the simulation body can simultaneously receive the UAV posture information and realize various functions, which not only ensures the accuracy of the UAV simulation experiment data, but also can effectively ensure the smooth completion of the UAV target flight mission; at the same time, through the combination of virtual reality and UAV technology, a safe and low-cost simulation environment is provided for UAV operators and developers, which effectively reduces the operational risks of UAV operators and UAV equipment. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] Figure 1 It is a flow chart of a preferred embodiment of the UAV flight simulation method based on a virtual reality environment of the present invention;

[0042] Figure 2 It is a structural diagram of a preferred embodiment of the UAV flight simulation system based on a virtual reality environment of the present invention;

[0043] Figure 3 It is a structural diagram of a preferred embodiment of the terminal of the present invention. DETAILED DESCRIPTION

[0044] In order to make the purpose, technical solution and advantages of the present invention clearer and more specific, the present invention is further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0045] Simulation technology is a technology that uses computer equipment to simulate and verify the operation and flight of robots or drones (UAVs are used as an example in this invention). It can simulate the flight behavior, sensor data, and flight path planning of drones in a virtual environment, and provide various scenarios and environments for testing and training. Its main purpose is to provide a safe and low-cost method to verify the flight performance, flight control system, path planning algorithm, etc. of drones, while reducing the operational risks and costs in the real environment. It can help drone operators with training, testing, and debugging, and at the same time, it can help developers optimize algorithms and systems.

[0046] In UAV simulation technology, it is usually divided into the following aspects: 1. Dynamics simulation: modeling and simulating the body dynamics of the UAV, including flight attitude, flight stability, and thrust output; 2. Scene environment simulation: providing various virtual environments and scenes, including different weather conditions, terrains, buildings, etc., to simulate the real flight environment; 3. Sensor simulation: simulating the sensor data of the UAV, including cameras, radars, inertial measurement units, etc., to verify the accuracy and performance of the sensors; 4. Flight control system simulation: modeling and simulating the flight control system of the UAV, including flight controllers, flight attitude control and navigation systems, etc.; 5. Path planning simulation: simulating the path planning algorithm of the UAV, including autonomous navigation, obstacle avoidance, etc., to verify the effect and performance of the path planning algorithm. UAV simulation technology can greatly reduce the risk and cost of UAV operation and provide a more flexible and controllable test environment.

[0047] At present, there are many forms of UAV simulation technology, and the commonly used ones include the following: 1. Software simulation: Software simulation, also known as mathematical simulation, mainly uses mathematical models and algorithms to simulate the flight behavior and flight environment of UAVs. By mathematically modeling the dynamics, control system, sensors, etc. of the UAV, and using mathematical analysis and simulation algorithms to simulate the operation and behavior of the UAV. Mathematical simulation can simulate and optimize the path planning, control instructions, sensor data, etc. of the UAV through matrix operations, differential equations, and probability statistics. This simulation technology is usually based on a higher level of abstraction and simplification, and can quickly simulate and optimize in a shorter time. Finally, computer software is used to establish the physical model and flight environment of the UAV, and the operation and flight of the UAV are simulated through calculation and simulation. This form of UAV simulation usually runs on a personal computer, and the operator uses input devices such as a keyboard, mouse or handle to control it. 2. Hardware simulation, also known as physical simulation, uses physical principles and equations to simulate the flight behavior and environmental conditions of the UAV. By establishing a physical model of the UAV, including parameters such as aerodynamics, mechanics, and inertia, a computer algorithm is used to solve the dynamic equations to simulate the flight process and influencing factors of the UAV. Physical simulation can simulate the flight characteristics of drones under different conditions, including flight stability, maneuverability, aerodynamic effects, etc. This simulation technology usually uses numerical calculation methods, such as the Euler method and implicit method, which can provide a relatively accurate flight simulation effect. Finally, the control system and sensors of the drone are connected to the actual hardware equipment, and the operation and flight of the drone are simulated through physical sensors and actuators. This form of drone simulation can provide a more realistic operation experience and a higher accuracy of the control and behavior of the drone. Both physical simulation and mathematical simulation have important applications in drone simulation, and the simulation technology used can be selected according to specific needs and problems. Physical simulation can provide more accurate flight behavior simulation and is suitable for scenarios with higher accuracy requirements for flight dynamics and aerodynamic effects. Mathematical simulation focuses more on the optimization and testing of flight control and algorithms, and is suitable for scenarios where control strategies and system behaviors are simulated and verified. These two technical forms can be combined with each other to achieve a more comprehensive and accurate drone simulation. 3. Semi-physical simulation Semi-mathematical simulation is a method that combines physical simulation and mathematical simulation technology. This simulation method makes comprehensive use of physical models and mathematical modeling to simulate the operation and flight of drones through comprehensive simulation and calculation of physical properties and mathematical characteristics. In semi-physical simulation, physical models can be used to simulate the dynamic behavior, aerodynamic effects, sensors, etc. of drones. Physical models can be obtained through measurement and experiments of physical parameters, and then solved using physical laws and equations to obtain the movement and state changes of drones. In this way, simulation can provide real flight dynamics effects and perception models, making the simulation results more accurate and reliable.In semi-mathematical simulation, mathematical modeling and calculation methods can be used to simulate the control system, path planning, and sensor data of drones. Mathematical models can mathematically model the control algorithm, sensor sampling, data filtering, etc. of drones, and obtain simulation results through numerical calculations and algorithm solutions. This simulation can test and verify drones quickly and efficiently. The advantage of semi-physical simulation and semi-mathematical simulation is that it combines the advantages of the two simulation methods and can simulate the operation and flight behavior of drones more comprehensively. At the same time, this simulation method is also flexible. It can flexibly select the proportion of physical models and mathematical modeling according to specific needs and problems to adapt to different simulation tasks and application scenarios. 4. Virtual reality simulation is to simulate and verify the operation and flight environment of drones by combining virtual reality (VR) and drone simulation. Combined with virtual reality head-mounted displays and interactive devices, users are completely immersed in the virtual drone flight environment, and the operation and flight of drones are simulated through user interaction with the virtual environment. This form of drone simulation has a high sense of immersion and can provide a more realistic flight experience, but the equipment required for simulation is relatively expensive.

[0048] The above technical forms can be selected and applied according to actual needs and environment to simulate and verify the operation and flight of drones. No matter which form of drone simulation technology is used, it can provide a safe and low-cost way to test and optimize the development of drone systems. Although these methods have played an important role in drone research and development, they also have the following shortcomings and disadvantages. 1. Accuracy limitation: In drone simulation methods, simulation based on physical models may face accuracy limitations. This is because physical models can only approximate the system and may not take into account all environmental factors and external interference. Therefore, the simulation results based on physical models may be different from the actual situation. 2. High computational complexity: UAV simulation models often require high computing resources and time when implemented and run. Especially when the model is more complex and there are more environmental factors, the computational complexity of the simulation will increase further. This may limit the scale and efficiency of the simulation. 3. Large data requirements: Data-driven drone simulation methods usually require a large amount of training data to build models and optimize model parameters. This requires a large number of experiments or the collection of real flight data, which is time-consuming and money-consuming, and there may be difficulties in data acquisition. 4. Poor generalization ability: The generalization ability of the UAV simulation model refers to the model's ability to adapt to different scenarios and conditions. For data-driven methods, due to data limitations, the model may not be able to accurately infer the behavior of the UAV in new scenarios. This means that the model may not have good versatility and needs to be retrained and adjusted for new environmental scenarios. In summary, although the commonly used UAV simulation methods can play an important role in UAV research and development, they also have some shortcomings and drawbacks such as limited accuracy, high computational complexity, large data requirements, and poor generalization ability. In order to overcome these problems, researchers need to continuously improve existing methods and combine different simulation strategies to obtain more accurate, efficient and general UAV simulation models.

[0049] UAV simulation is an important technical means to verify and optimize the design and performance of UAV systems. However, traditional simulation methods based on physical and mathematical models have problems of dependence and low computational efficiency, and often cannot provide accurate simulation results in a strict sense. In order to solve these problems, the present invention proposes a UAV flight simulation and training method based on a virtual reality environment. The method first uses computer vision technology to obtain image data from a real environment and construct a virtual environment model. Then, the virtual environment model is connected to the flight control system of the UAV through an algorithm to realize the simulated flight of the UAV in a virtual environment. In order to improve the authenticity and accuracy of the simulation, the present invention also introduces sensor simulation technology to simulate common sensor outputs of UAVs, such as images and lidar data. Finally, by introducing high-precision measurement data from the motion capture system, the data is transmitted to the host computer of the UAV, so that the aircraft body and the simulation body can run stably and complete the flight mission, wherein the UAV entity is underground in the motion capture field and the UAV simulation virtual body is in the display device. Through this virtual-real UAV simulation method, researchers can more flexibly simulate UAV flights in different scenarios, verify and optimize flight control algorithms, sensor fusion algorithms, and path planning algorithms. And by replacing different scene information, even if the drone is flying safely in the motion capture field, it can also simulate the drone's flight mission in extreme environments, and can perform neural network training for some algorithms. Compared with traditional methods, the method proposed in the present invention has higher computational efficiency and flexibility, and can better meet the needs of drone simulation in complex environments, because the actual flight of the aircraft and the simulated flight are carried out in parallel, which can make the simulation results more convincing. In general, the virtual-real combined drone simulation method is a technology with potential and development prospects, which can provide strong support for the design and performance optimization of drone systems. Future research can further explore the effect of this method in practical applications and improve the authenticity and accuracy of simulation.

[0050] At the same time, there are certain risks and costs in the operation and flight of drones in the real world. Through simulation technology, drones can be simulated in a virtual environment to verify flight paths, route planning, flying robot behavior, etc. However, drones often ignore some complex factors in the actual flight environment during simulation experiments. For example, drone simulation usually ignores real weather conditions, such as wind speed and rainfall; simulation generally ignores the impact of aerodynamic effects on drone flight, such as airflow and gas density changes; simulation usually does not consider sensor errors, such as noise and accuracy limitations of sensors such as image processing and laser ranging; simulation ignores external interference factors, such as electromagnetic interference and signal interference, on drone systems; drone simulation generally does not consider dynamic changes in the environment, such as obstacle movement and terrain changes; simulation often ignores the mutual influence or collision between multiple drones; simulation generally does not consider factors such as drone energy consumption and battery life. Although drone simulation ignores the above influences, these factors have an important impact on the flight and performance of drones in actual applications, so they need to be fully considered and verified in actual flight tests.

[0051] The goal of the virtual-reality combined drone simulation proposed in the present invention is to provide a safe and controllable drone real-flight environment, and the environment can be truly restored in the simulator. At the same time, combined with the pre-arranged motion capture system, the captured position and posture information will be transmitted to the host computer and the simulator in real time. The aircraft body and the simulation body will simultaneously receive the drone posture information and realize various functions, including but not limited to path planning, flight control, and three-dimensional perception.

[0052] The preferred embodiment of the present invention is a method for simulating unmanned aerial vehicle flight based on a virtual reality environment, such as Figure 1 As shown, the UAV flight simulation method based on virtual reality environment includes the following steps:

[0053] Step S10: Acquire a real environment image, pre-process the real environment image to obtain image feature data, and construct a virtual simulation environment model according to the image feature data.

[0054] In engineering application scenarios, environmental conditions are often harsh, and it is difficult to conduct repeated experiments, and there is a lack of electricity and signals. In order to complete the purpose of field flight tests in the laboratory, the present invention proposes a virtual-real combination simulation technology. The virtual-real combination drone simulation in the present invention consists of the following components: 1. Drone model: the mathematical and physical expression of the drone, that is, the drone model presented in the virtual environment, which also includes the shape, structure and various sensors of the drone. 2. Real equipment: including the drone body and its integrated host computer, flight controller, sensor and power unit, etc., and also includes motion capture equipment (for obtaining high-precision drone six-degree-of-freedom information), communication equipment such as routers and data transmission, and high-performance simulation host and display equipment. 3. Simulation platform: responsible for the dynamic simulation and environmental simulation of the drone, realizing the simulation of the physical behavior of the drone flight and the real scene. 4. Control system: provides an actual drone control interface and operation method, and interacts with the drone model through virtual reality equipment.

[0055] Specifically, an image of a real environment is acquired, and image optimization processing is performed on the real environment image to obtain an initial optimized image, wherein the image optimization processing includes brightness adjustment, contrast adjustment, color balance adjustment and noise reduction processing; the initial optimized image is preprocessed to obtain image feature data, wherein the preprocessing includes grayscale processing, edge detection processing and feature extraction processing.

[0056] Acquire a preset virtual environment model, and perform feature matching processing on the image feature data and the preset virtual environment model to obtain a feature matching result; use a triangulation method to generate point cloud data according to the feature matching result to obtain feature point cloud data; use a three-dimensional reconstruction algorithm to generate an initial simulation three-dimensional model according to the feature point cloud data; and mesh the initial simulation three-dimensional model to obtain a virtual simulation environment model.

[0057] The most common method is to collect images of the real environment through a camera. In Unreal Engine 4 (UE4), you can obtain image data of the real environment through photos or images, and then use these data to build a similar virtual environment. The construction process of the virtual environment can be as follows: 1. Get photos or images: First, you need to collect or obtain photos or images of the real environment. You can use a camera, mobile phone or other device to take pictures, or get high-quality images from online resources or other channels. 2. Image processing and optimization: After obtaining photos or images, you can use image processing software (such as Photoshop) to adjust and optimize them to ensure image quality and adapt to the requirements of the UE4 platform, including adjusting brightness, contrast, color balance, etc., as well as reducing image noise and distortion. 3. Create a virtual environment: In UE4, you can use blueprints or programming languages ​​(such as C++ or blueprint scripts) to create a virtual environment, and apply images as textures to objects in the scene. You can place objects such as planes, walls, and floors in the scene, and map the textures of these objects to the image to simulate the appearance of the real environment. 4. Lighting and effects: In order to further enhance the realism of the virtual environment, appropriate lighting and special effects can be added to the scene. This includes using UE4's lighting system, setting shadows and lighting effects, and applying post-processing effects (such as color correction, depth of field, etc.) to make the image more realistic. 5. Interaction and navigation: When building a virtual environment, you can also add user interaction and navigation functions. This includes setting clickable objects, adding triggers and collisions, and implementing user navigation controls so that users can move and browse freely in the virtual environment. By obtaining photos or images, performing image processing and optimization, creating a virtual environment, adding lighting and effects, and implementing interaction and navigation functions, UE4 can be used to convert image data of a real environment into a similar virtual environment.

[0058] The technical steps for using the camera to collect images and build a virtual environment model in UE4 are as follows: 1. Camera calibration: First, you need to ensure the accuracy of the camera parameters, including focal length, distortion and other parameters. You can use a camera calibration tool to complete this process, such as the camera calibration module in OpenCV. 2. Image acquisition: Use a calibrated camera to collect images of the real environment. Ensure that the quality and resolution of the image acquisition are high enough and cover the entire environment. 3. Image processing: Preprocess the collected images to extract the required feature information. Common image processing operations include grayscale, edge detection, feature extraction, etc. 4. Feature matching: Feature matching is performed on the collected images with the existing virtual environment model. This step aims to determine the correspondence between the feature points in the image and the feature points in the virtual environment model. 5. Point cloud generation: Using the results of feature matching, triangulation or other point cloud generation algorithms can be used to generate point cloud data. Point cloud is a discrete set of points in three-dimensional space that represents the position and shape of objects in the environment. 6. Model reconstruction: Based on point cloud data, a three-dimensional reconstruction algorithm can be used to restore the three-dimensional model of objects in the environment. Common methods include multi-view geometric reconstruction, voxelization, etc. 7. Mesh generation: By meshing the 3D model, a complete 3D model can be obtained. A mesh is a geometric structure composed of vertices, edges, and faces, which is used to represent the surface of an object. 8. UV mapping: Assign texture coordinates to each face of the mesh model for texture mapping. 9. Material settings: Assign corresponding materials to each face or component of the model as required to achieve appropriate rendering effects. 10. Import into UE4: Import the generated model into UE4 and make necessary adjustments and optimizations. You can use the tools and functions provided in UE4 to further edit and modify the model to suit the project requirements.

[0059] In the virtual environment of UAV simulation, the following models are generally included: 1. UAV model: This is the most important model, which is used to describe the appearance, structure and dynamic characteristics of the UAV. It can help simulate the flight behavior, attitude control and flight performance of the UAV. 2. Ground model: In order to increase the realism of the simulation, the virtual environment usually contains a ground model to simulate the take-off and landing process of the UAV on the ground. The ground model can include runways, buildings, vegetation, etc. 3. Wind model: Wind is one of the important environmental factors in UAV flight. The wind model in the virtual environment can simulate the impact of wind of different strengths and directions on the UAV. This can help study the flight performance and control strategy of the UAV under different wind speed conditions. 4. Weather model: Weather factors also have an impact on the flight of the UAV. The weather model in the virtual environment can simulate different weather conditions, such as rain, snow, fog, etc. This can be used to study the flight strategy and fault handling ability of the UAV under severe weather conditions. 5. Sensor model: UAVs are usually equipped with various sensors, such as cameras, lidar, etc., to perceive the surrounding environment and perform tasks. In the virtual environment, the sensor model can simulate the working principles and performance of these sensors to help study the perception ability and task execution effect of the UAV. 6. Map model: UAVs usually need information about maps and environments when performing tasks. The map model in the virtual environment can simulate the geographic information of the real environment, such as terrain height, building location, etc. This can be used to study the navigation planning and obstacle avoidance algorithms of UAVs.

[0060] Step S20: When a flight control instruction is received, the UAV is controlled according to the flight control instruction to perform a flight test in the virtual simulation environment model to obtain simulated flight data.

[0061] Specifically, a UAV simulation model and a UAV flight control system are obtained, a communication connection with the UAV flight control system is established, and a communication connection between the UAV simulation model and the UAV flight control system is established; a test control instruction is generated, and it is determined according to the test control instruction whether the communication connection between the UAV simulation model and the UAV flight control system is successful; if so, the sensor data in the UAV simulation model is obtained through the UAV flight control system, and a state estimation algorithm is used to obtain the current flight state of the UAV according to the sensor data.

[0062] When a flight control instruction issued by a user is received, the UAV flight control system generates a UAV control instruction according to the flight control instruction and the current flight status, wherein the UAV control instruction includes a UAV attitude control instruction and a UAV motion control instruction; according to the UAV attitude control instruction and the UAV motion control instruction, the UAV is controlled to perform a flight test in the virtual simulation environment model to obtain simulated flight data.

[0063] The drone simulation model and the flight control system are usually connected through software. The connection steps are as follows: 1. Install the drone simulation model software: First, you need to install a drone simulation model software on your computer, such as ROS (Robot Operating System) or PX4 (a multi-rotor control software). These software are usually used to create and simulate the behavior and environment of drones. 2. Install the flight control system software: Next, you need to install the flight control system software that is compatible with the simulation model software. Commonly used flight control system software includes PX4 Autopilot, ArduPilot and DJI SDK, etc. These software can be downloaded and installed from the official website or related open source communities. 3. Connect the drone simulation model and the flight control system: Before connecting the simulation model and the flight control system, you need to ensure that the computer is correctly connected to the flight control system. A common connection method is to connect the computer to the control board of the flight control system via USB. 4. Set up communication between the simulation model and the flight control system: In the simulation model software, you need to configure the communication parameters to communicate with the flight control system. This usually includes specifying the connection port, baud rate and communication protocol. For ROS and PX4, you need to set up ROS nodes and Topics as well as the MQTT (Message Queuing Telemetry Transport) communication protocol to enable data transmission and control command interaction. 5. Test the connection: After completing the configuration, you can do some tests to verify whether the connection between the simulation model and the flight control system is successful. You can send some control instructions, such as flying along a specific path or performing some actions, and then observe the responses of the simulation model and the flight control system to ensure that they can interact and communicate correctly. Control is handled by the drone flight control system, which plays a key role in controlling the various components and navigation methods of the drone when the drone is simulated.

[0064] The basic control process of the flight control (UAV flight control system) is as follows: 1. Sensor data acquisition: The flight control system obtains relevant data such as the attitude, speed, altitude and weather of the UAV through sensors connected to the UAV, such as gyroscopes, accelerometers, magnetometers and barometers. 2. State estimation: By using sensor data, the flight control system performs state estimation, that is, estimates the current attitude (such as pitch, roll, yaw angle), speed and position of the UAV. Common state estimation algorithms include Kalman filtering, extended Kalman filtering, etc. 3. Control command generation: Based on the current state estimation of the UAV and the user's control input, the flight control system generates control commands to control the attitude and motion state of the UAV. Control commands include attitude control commands (such as pitch control, roll control, yaw control) and motion control commands (such as speed control and position control). 4. Controller design and execution: The flight control system uses a controller to execute control commands. Controller design usually adopts the closed-loop feedback control method. Common controllers include proportional-integral-derivative (PID) controller and model predictive controller (MPC). The controller compares the calculated control instructions with the current state of the drone, and outputs appropriate control signals to adjust the attitude and motion state of the drone. 5. Power distribution and execution: After receiving the control signal, the flight control system will convert the signal into appropriate power distribution instructions to control the actions of the various actuators of the drone, such as motor speed and rudder adjustment. This can achieve attitude and motion adjustment of the drone so that it can fly according to a predetermined trajectory or user instructions. 6. Stability adjustment and control loop: During the flight, the flight control system will continuously monitor the attitude and motion state of the drone, and adjust the control instructions and controller parameters based on feedback information to ensure the stability and control accuracy of the drone. This control loop adjustment is an important step in the flight control process.

[0065] Step S30: setting a motion capture system, and obtaining high-precision measurement data obtained by performing a flight test on the UAV in the virtual simulation environment model through the motion capture system.

[0066] Specifically, a target flight area of ​​the UAV is determined, and multiple motion capture cameras are set in the target flight area; multiple identification points are set on the UAV, and the motion capture system is constructed based on the multiple motion capture cameras and the multiple identification points; and high-precision measurement data of the UAV performing a flight test in the virtual simulation environment model is obtained in real time through the motion capture system.

[0067] The process of setting up the motion capture system in the present invention is as follows: 1. First, install multiple motion capture cameras at appropriate locations in the flight area to ensure that the field of view of each camera covers the flight trajectory of the drone, and calibrate and configure the camera according to the characteristics and requirements of the camera. 2. Install markers or identifiers: Paste or install some markers or identifiers on the drone or surrounding objects. These markers or identifiers should be recognizable and trackable by the motion capture system, and reflective stickers or luminous objects can usually be used. 3. Software settings: In the software of the motion capture system, add the drone model and calibrate the position of the markers or identifiers. Ensure that each camera can recognize and track the markers on the drone. 4. Run the drone simulation: Run the simulation program of the drone by connecting the drone model to the motion capture system. During the simulation process, the motion capture camera will collect the posture information of the drone in real time and transmit it to the software of the motion capture system. 5. Data acquisition and processing: In the software of the motion capture system, the posture information of the drone can be obtained in real time. This information can be used to monitor and control the flight of the drone in real time during the simulation process, and can also be saved as a file for subsequent analysis and processing. Among them, using multiple motion capture cameras to collect the posture of the drone may require high computing power and data transmission bandwidth, which uses high-performance simulation hosts, switches, and PoE cables. In addition, during the setup process, it is necessary to ensure the synchronization between cameras and the consistency of the coordinate system to obtain accurate posture information.

[0068] When using a motion capture device to capture drones, the following state variables can be collected: 1. Position information: that is, the coordinate position of the drone in three-dimensional space. This usually includes the x, y, and z coordinates of the drone relative to the ground, which is obtained by tracking the markers on the drone through the camera or sensor of the motion capture device. 2. Attitude information: The attitude of the drone describes its tilt and rotation state relative to the horizontal plane and direction. Common attitude parameters include pitch, roll, and yaw angles. 3. Velocity information: The velocity vector of the drone represents the magnitude and direction of its velocity in three-dimensional space. The velocity vector can be calculated based on the position information collected by the motion capture device. 4. Acceleration information: The acceleration of the drone indicates the degree and direction of its acceleration or deceleration in three-dimensional space. Acceleration information can be derived from the velocity data collected by the motion capture device.

[0069] Step S40: performing a similarity comparison between the simulated flight data and the high-precision measurement data to obtain a similarity comparison result, and performing parameter optimization processing on the UAV flight algorithm according to the similarity comparison result, so that the UAV can complete the designated flight mission according to the optimized UAV flight algorithm.

[0070] In the present invention, it is necessary to connect and control the flight control board of the drone on the ROS (Robot Operating System) host computer, and the following steps can be followed: 1. Make sure that the ROS system has been correctly installed and configured, which includes setting up a workspace on the ROS host computer and installing relevant ROS software packages and dependencies. 2. Make sure that the flight control board supports ROS. Some commonly used flight control boards (such as PX4 and ArduPilot) have corresponding ROS software packages and interfaces, which can be integrated with the ROS system. It is necessary to install the corresponding ROS driver and software package on the flight control board. 3. Connect the flight control board to the ROS host computer in an appropriate manner. It can be connected via a serial port, USB, CAN bus or via a network (such as Wi-Fi or Ethernet). According to the hardware and communication protocol used, select an appropriate connection method. 4. Use the relevant software packages provided by ROS to establish communication with the flight control board. For the PX4 flight control board, the MAVROS (MAVLink / ROS interface) software package can be used, and for the ArduPilot flight control board, the ROSflight software package can be used. These packages provide ROS node and message definitions for communicating with the flight control board. 5. Write the corresponding ROS nodes or scripts on the ROS host computer to interact and control the flight control board. You can also use the tools and functions provided by ROS to subscribe to the status information of the flight control board (such as flight attitude, sensor data, etc.) and issue control instructions. According to different needs, different ROS nodes can be written to control the attitude, altitude, heading, etc. of the drone. 6. Finally, run the ROS node or script to ensure that the correct communication connection is established with the flight control board. You can use command line tools (such as roslaunch) or ROS tools such as RViz to start and monitor the running status of the node. Through debugging and log output, ensure that communication is normal, instructions are sent correctly, and fix any problems.

[0071] Specifically, the simulated flight data and the high-precision measurement data are compared for similarity to obtain similarity comparison results, wherein the similarity comparison results include attitude error comparison results, hovering offset comparison results, flight path smoothness comparison results, damping effect comparison results and flight stability index comparison results; the designated flight mission corresponding to the flight control instruction is determined, and the parameters of the UAV flight algorithm are optimized according to the designated flight mission and the similarity comparison results, so that the UAV completes the designated flight mission according to the optimized UAV flight algorithm, wherein the UAV flight algorithm includes a flight control algorithm, a sensor fusion algorithm and a path planning algorithm.

[0072] The flight data results used to evaluate the stability of the UAV flight control system in the present invention mainly include the following: 1. Attitude error: Attitude error refers to the difference between the actual attitude and the expected attitude. A smaller attitude error indicates that the flight control system can accurately maintain the expected attitude of the UAV, indicating better stability. 2. Hovering offset: Hovering offset refers to the difference in distance between the UAV and the target position in the hovering state. A smaller hovering offset indicates that the flight control system can accurately maintain the UAV hovering near the target position, indicating better stability. 3. Flight path smoothness: Flight path smoothness refers to the degree of drastic attitude changes produced by the UAV during flight. A smaller flight path smoothness indicates that the flight control system can make the flight process smoother, indicating better stability. 4. Damping effect: Damping effect refers to the rapid response and stability of the UAV when encountering external interference. A better damping effect indicates that the flight control system can quickly and smoothly adjust the UAV to offset external interference and maintain stability. 5. Flight stability index: Flight stability index may include the vibration amplitude, yaw, roll and pitch angle stability of the UAV. Smaller fluctuations and stable attitude control indicate that the flight control system has better stability. 6. The flight data results collected by motion capture can be regarded as the actual drone data measured in the real world; the algorithm can be further improved by comparing the consistency and difference with the expected data.

[0073] The optimization of the UAV flight algorithm in the present invention includes the following aspects: 1. Flight control algorithm optimization: Analyze the flight data results to find out the weaknesses or shortcomings of the existing flight control algorithm. According to the requirements of flight data and flight missions, adjust and improve the parameters of the flight control algorithm. It is possible to consider using optimization algorithms (such as genetic algorithms, ant colony algorithms, etc.) for parameter optimization to improve the performance of the flight control algorithm. 2. Sensor fusion algorithm optimization: Check the data quality of each sensor, analyze data errors and noise, and calibrate the sensor. Evaluate the performance of the sensor fusion algorithm and compare and analyze it with the actual flight data. Filtering algorithms (such as Kalman filtering, particle filtering, etc.) can be used to fuse sensor data to improve the accuracy of attitude and position. 3. Path planning algorithm optimization: Analyze the difference between the actual flight path and the target path to determine the shortcomings of the existing path planning algorithm. According to the actual situation, adjust the parameters of the path planning algorithm to better adapt it to the flight environment. Use higher-level path planning algorithms, such as A* algorithm, RRT (Rapidly-exploring Random Trees, Rapid Search Random Trees) algorithm, etc. to obtain a better flight path.

[0074] During the optimization process, the simulation environment can be used for testing and verification. By continuously optimizing algorithms and parameters and running simulations, the performance of flight control algorithms, sensor fusion algorithms, and path planning algorithms can be gradually improved to meet the needs of different flight missions and operating environments.

[0075] The virtual-reality combined drone simulation set in the present invention can be applied to multiple fields, including drone training, flight planning, and test verification. By performing simulated flight in a virtual environment, the risks to drone operators and equipment can be reduced, and a more flexible simulation environment can be provided for developers to conduct experiments on flight algorithms and system optimization.

[0076] In summary, the present invention constructs a simulation and training method based on a virtual reality environment, which combines virtual reality and drone technology to provide drone operators and developers with a safe and low-cost simulation environment that can be used for drone training, testing and verification, and the environment can be truly restored in the simulator. At the same time, combined with a pre-arranged motion capture system, the captured position and posture information is transmitted to the host computer and the simulator in real time. The aircraft body and the simulation body will simultaneously receive the drone posture information and realize various functions, including but not limited to path planning, flight control, and three-dimensional perception.

[0077] Furthermore, if Figure 2 As shown, based on the above-mentioned unmanned aerial vehicle flight simulation method based on a virtual reality environment, the present invention also provides a unmanned aerial vehicle flight simulation system based on a virtual reality environment, wherein the unmanned aerial vehicle flight simulation system based on a virtual reality environment includes:

[0078] A virtual simulation environment model building module 51 is used to obtain a real environment image, pre-process the real environment image to obtain image feature data, and build a virtual simulation environment model according to the image feature data;

[0079] The simulated flight data acquisition module 52 is used to control the UAV to perform a flight test in the virtual simulation environment model according to the flight control instruction when receiving the flight control instruction, so as to obtain simulated flight data;

[0080] A high-precision measurement data acquisition module 53, used to set up a motion capture system, and obtain high-precision measurement data obtained by the UAV during the flight test in the virtual simulation environment model through the motion capture system;

[0081] The flight algorithm optimization module 54 is used to perform similarity comparison between the simulated flight data and the high-precision measurement data to obtain a similarity comparison result, and perform parameter optimization processing on the UAV flight algorithm according to the similarity comparison result, so that the UAV can complete the specified flight mission according to the optimized UAV flight algorithm.

[0082] Furthermore, if Figure 3 As shown, based on the above-mentioned UAV flight simulation method and system based on virtual reality environment, the present invention also provides a terminal accordingly, and the terminal includes a processor 10, a memory 20 and a display 30. Figure 3 Only some components of the terminal are shown, but it should be understood that it is not required to implement all of the components shown, and more or fewer components may be implemented instead.

[0083] In some embodiments, the memory 20 may be an internal storage unit of the terminal, such as a hard disk or memory of the terminal. In other embodiments, the memory 20 may also be an external storage device of the terminal, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (SecureDigital, SD) card, a flash card (Flash Card), etc. equipped on the terminal. Further, the memory 20 may also include both an internal storage unit of the terminal and an external storage device. The memory 20 is used to store application software and various types of data installed in the terminal, such as the program code of the installation terminal. The memory 20 may also be used to temporarily store data that has been output or is to be output. In one embodiment, a drone flight simulation program 40 based on a virtual reality environment is stored on the memory 20, and the drone flight simulation program 40 based on a virtual reality environment can be executed by the processor 10, thereby realizing the drone flight simulation method based on a virtual reality environment in the present application.

[0084] In some embodiments, the processor 10 may be a central processing unit (CPU), a microprocessor or other data processing chip, used to run the program code or process data stored in the memory 20, such as executing the drone flight simulation method based on a virtual reality environment.

[0085] In some embodiments, the display 30 may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, an OLED (Organic Light-Emitting Diode) touch device, etc. The display 30 is used to display information on the terminal and to display a visual user interface. The components 10-30 of the terminal communicate with each other via a system bus.

[0086] In one embodiment, when the processor 10 executes the UAV flight simulation program 40 based on the virtual reality environment in the memory 20, the steps of the UAV flight simulation method based on the virtual reality environment as described above are implemented.

[0087] The present invention also provides a computer-readable storage medium, wherein the computer-readable storage medium stores a UAV flight simulation program based on a virtual reality environment, and when the UAV flight simulation program based on the virtual reality environment is executed by a processor, the steps of the UAV flight simulation method based on the virtual reality environment as described above are implemented.

[0088] In summary, the present invention provides a method and system for simulating unmanned aerial vehicle flight based on a virtual reality environment, the method comprising: acquiring a real environment image, preprocessing the real environment image to obtain image feature data, and constructing a virtual simulation environment model according to the image feature data; when a flight control instruction is received, the unmanned aerial vehicle is controlled to perform a flight test in the virtual simulation environment model according to the flight control instruction to obtain simulated flight data; a motion capture system is set, and high-precision measurement data obtained by the unmanned aerial vehicle performing a flight test in the virtual simulation environment model is obtained through the motion capture system; the simulated flight data is compared with the high-precision measurement data for similarity to obtain a similarity comparison result, and parameter optimization processing is performed on the unmanned aerial vehicle flight algorithm according to the similarity comparison result, so that the unmanned aerial vehicle completes a designated flight mission according to the optimized unmanned aerial vehicle flight algorithm. The present invention can provide a safe and controllable UAV actual flight environment, and the environment can be truly restored in the simulator. At the same time, combined with the pre-arranged motion capture system, the captured position and posture information is transmitted to the UAV host computer and the simulator in real time, so that the aircraft body and the simulation body can simultaneously receive the UAV posture information and realize various functions, which not only ensures the accuracy of the UAV simulation experiment data, but also can effectively ensure the smooth completion of the UAV target flight mission; at the same time, through the combination of virtual reality and UAV technology, a safe and low-cost simulation environment is provided for UAV operators and developers, which effectively reduces the operational risks of UAV operators and UAV equipment.

[0089] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or terminal including the element.

[0090] Of course, those skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing related hardware (such as a processor, a controller, etc.) through a computer program, and the program can be stored in a computer-readable storage medium that can be read by a computer, and the program can include the processes of the above-mentioned method embodiments when executed. The computer-readable storage medium can be a memory, a disk, an optical disk, etc.

[0091] It should be understood that the application of the present invention is not limited to the above examples. For ordinary technicians in this field, improvements or changes can be made based on the above description. All these improvements and changes should fall within the scope of protection of the claims attached to the present invention.

Claims

1. A UAV flight simulation method based on a virtual reality environment, characterized in that: The unmanned aerial vehicle flight simulation method based on virtual reality environment comprises: Acquire a real environment image, preprocess the real environment image to obtain image feature data, and construct a virtual simulation environment model according to the image feature data; When a flight control instruction is received, the UAV is controlled to perform a flight test in the virtual simulation environment model according to the flight control instruction to obtain simulated flight data; Setting a motion capture system, and obtaining high-precision measurement data obtained by the UAV during a flight test in the virtual simulation environment model through the motion capture system; The simulated flight data is compared with the high-precision measurement data for similarity to obtain a similarity comparison result, and the parameters of the UAV flight algorithm are optimized according to the similarity comparison result, so that the UAV can complete the designated flight mission according to the optimized UAV flight algorithm.

2. The method for simulating unmanned aerial vehicle flight based on a virtual reality environment according to claim 1, characterized in that: The acquiring of the real environment image and preprocessing of the real environment image to obtain image feature data specifically includes: Acquire a real environment image, and perform image optimization processing on the real environment image to obtain an initial optimized image, wherein the image optimization processing includes brightness adjustment, contrast adjustment, color balance adjustment and noise reduction processing; The initial optimized image is preprocessed to obtain image feature data, wherein the preprocessing includes grayscale processing, edge detection processing and feature extraction processing.

3. The method for simulating unmanned aerial vehicle flight based on a virtual reality environment according to claim 1, characterized in that: The step of constructing a virtual simulation environment model according to the image feature data specifically includes: Acquire a preset virtual environment model, and perform feature matching processing on the image feature data and the preset virtual environment model to obtain a feature matching result; Using triangulation method to generate point cloud data according to the feature matching result to obtain feature point cloud data; Using a three-dimensional reconstruction algorithm to generate an initial simulation three-dimensional model according to the characteristic point cloud data; The initial simulation three-dimensional model is meshed to obtain a virtual simulation environment model.

4. The method for simulating unmanned aerial vehicle flight based on a virtual reality environment according to claim 1, characterized in that: When the flight control instruction is received, the UAV is controlled according to the flight control instruction to perform a flight test in the virtual simulation environment model to obtain simulated flight data, which also includes: Acquire a UAV simulation model and a UAV flight control system, establish a communication connection with the UAV flight control system, and establish a communication connection between the UAV simulation model and the UAV flight control system; Generate a test control instruction, and determine whether the communication connection between the UAV simulation model and the UAV flight control system is successful according to the test control instruction; If so, the sensor data in the drone simulation model is obtained through the drone flight control system, and a state estimation algorithm is used to obtain the current flight state of the drone based on the sensor data.

5. The method for simulating unmanned aerial vehicle flight based on a virtual reality environment according to claim 4, characterized in that: When the flight control instruction is received, the UAV is controlled according to the flight control instruction to perform a flight test in the virtual simulation environment model to obtain simulated flight data, which specifically includes: When receiving a flight control instruction issued by a user, the UAV flight control system generates a UAV control instruction according to the flight control instruction and the current flight state, wherein the UAV control instruction includes a UAV attitude control instruction and a UAV motion control instruction; The UAV is controlled according to the UAV attitude control instruction and the UAV motion control instruction to perform a flight test in the virtual simulation environment model to obtain simulated flight data.

6. The method for simulating unmanned aerial vehicle flight based on a virtual reality environment according to claim 1, characterized in that: The step of setting up a motion capture system and obtaining high-precision measurement data obtained by performing a flight test of the UAV in the virtual simulation environment model through the motion capture system specifically includes: Determine a target flight area for the UAV and set up multiple motion capture cameras in the target flight area; Setting a plurality of identification points on the drone, and constructing the motion capture system according to the plurality of motion capture cameras and the plurality of identification points; The motion capture system is used to obtain high-precision measurement data of the UAV during flight testing in the virtual simulation environment model in real time.

7. The method for simulating unmanned aerial vehicle flight based on a virtual reality environment according to claim 1, characterized in that: The similarity comparison between the simulated flight data and the high-precision measurement data is performed to obtain a similarity comparison result, and parameter optimization processing is performed on the UAV flight algorithm according to the similarity comparison result, so that the UAV completes the specified flight mission according to the optimized UAV flight algorithm, specifically including: Performing a similarity comparison between the simulated flight data and the high-precision measurement data to obtain a similarity comparison result, wherein the similarity comparison result includes an attitude error comparison result, a hovering offset comparison result, a flight path smoothness comparison result, a damping effect comparison result, and a flight stability index comparison result; Determine the designated flight mission corresponding to the flight control instruction, and perform parameter optimization processing on the UAV flight algorithm according to the designated flight mission and the similarity comparison result, so that the UAV completes the designated flight mission according to the optimized UAV flight algorithm, wherein the UAV flight algorithm includes a flight control algorithm, a sensor fusion algorithm and a path planning algorithm.

8. A UAV flight simulation system based on a virtual reality environment, characterized in that: The unmanned aerial vehicle flight simulation system based on virtual reality environment includes: A virtual simulation environment model construction module is used to obtain a real environment image, pre-process the real environment image to obtain image feature data, and construct a virtual simulation environment model according to the image feature data; A simulated flight data acquisition module is used to control the UAV to perform a flight test in the virtual simulation environment model according to the flight control instruction when receiving the flight control instruction, so as to obtain simulated flight data; A high-precision measurement data acquisition module, used to set up a motion capture system, and obtain high-precision measurement data obtained by the UAV during the flight test in the virtual simulation environment model through the motion capture system; The flight algorithm optimization module is used to compare the simulated flight data with the high-precision measurement data to obtain a similarity comparison result, and perform parameter optimization processing on the UAV flight algorithm according to the similarity comparison result, so that the UAV can complete the specified flight mission according to the optimized UAV flight algorithm.

9. A terminal, characterized in that: The terminal includes: a memory, a processor, and a UAV flight simulation program based on a virtual reality environment stored in the memory and executable on the processor. When the UAV flight simulation program based on the virtual reality environment is executed by the processor, the steps of the UAV flight simulation method based on the virtual reality environment as described in any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a UAV flight simulation program based on a virtual reality environment. When the UAV flight simulation program based on a virtual reality environment is executed by a processor, the steps of the UAV flight simulation method based on a virtual reality environment are implemented as described in any one of claims 1 to 7.

Citation Information

Cited By

  • Configuration generation method and device of unmanned aerial vehicle cleaning system and unmanned aerial vehicle cleaning system

    CN119414732A

  • Full virtual simulation method and device for unmanned aerial vehicle

    CN119689891A

  • Virtual test flight real-time simulation and management and control system oriented to complex scene

    CN120909150A

  • Unmanned aerial vehicle automatic driving virtual simulation method and unmanned aerial vehicle

    CN120993952A

  • Simulation test method and system for unmanned aerial vehicle control algorithm

    CN121115723A