Flight environment virtual simulation restoration method and system based on flight data

Abstract

The invention provides a flight environment virtual simulation restoration method and system based on flight data, relates to the technical field of virtual reality and flight simulation, and solves the problem of how to accurately and smoothly restore real flight data to a virtual simulation environment. The method comprises the following steps: acquiring real flight data, converting the real flight data into a data format which can be identified by a UE rendering engine, analyzing and extracting key flight parameters, and smoothing process data corresponding to the key flight parameters, so that the process data smoothly changes when the flight environment of an aircraft is virtually simulated and updated; according to the smoothed process data, updating the aircraft pose in the UE virtual environment of the UE rendering engine to realize the reduction of the flight path; meanwhile, a world space UI is created, and instrument information corresponding to the flight path is updated and displayed in the world space UI. According to the invention, the flight path and instrument display under the simulation condition are close to the real flight condition, and the authenticity and immersion of flight training are effectively improved.

Description

Technical Field

[0001] The present invention relates to the technical field of virtual reality and flight simulation, and in particular to a method and system for restoring a flight environment virtual simulation based on flight data. Background Art

[0002] With the continuous progress of aviation, the importance of pilot training and flight mission simulation has become increasingly prominent. With the increasing demand for realism and accuracy, flight simulation technology is also evolving. Currently, flight simulation mainly relies on preset models and parameters, using general flight dynamics models and data to reproduce the behavior of aircraft in different stages such as takeoff, cruising, and landing. However, existing simulation methods still face challenges in achieving a highly realistic training environment.

[0003] First, accurately restoring the trajectory and instrument data during the actual flight is a key requirement. Traditional methods tend to use general models for calculations or simply play back pre-recorded data, which is difficult to provide fine-grained reproduction of real flight data. This leads to possible deviations between the simulated flight trajectory and instrument readings and the actual situation, thus affecting the pilot's perception and judgment of flight operations.

[0004] In addition, during actual flight, flight data often fluctuates due to factors such as meteorological conditions, air pressure changes, wind direction changes, and equipment noise. Directly applying unprocessed raw data to simulation will cause jitter and shaking on the screen, which not only reduces the authenticity of the simulation, but may also have a negative impact on the training effect of pilots, because a stable visual experience is essential for effective flight training.

[0005] At the same time, flight data is usually sampled and recorded at a frequency of once per second, while the display and interaction in a virtual reality (VR) environment requires a higher refresh rate, such as more than 60 frames per second. When there is a mismatch between the timing and frequency between the two, if there is no appropriate interpolation, filtering and smoothing technology, problems such as screen freeze and dynamic coherence may occur, seriously affecting the user experience and pilot training results.

[0006] It can be seen that the existing flight simulation technology still has deficiencies in terms of true restoration of flight data, data smoothing, and high-precision timing synchronization. In order to meet the growing demand for pilot training, it is necessary to develop an improved technical solution to solve the above problems and provide pilots with a more realistic, smooth and efficient training environment. This technical solution will be committed to improving the authenticity of flight simulation, ensuring the stability of flight data, and optimizing timing synchronization to enhance the pilot's training experience. Summary of the invention

[0007] The purpose of the present invention is to solve the problem of how to accurately and smoothly restore real flight data to a virtual simulation environment, so that the flight trajectory and instrument display can be highly realistically reproduced dynamically, thereby providing a virtual environment closer to the real flight experience for pilot training; therefore, the present invention provides a flight environment virtual simulation restoration method and system based on flight data. The present invention introduces real flight data into the UE virtual environment through the processes of data import, conversion, processing and smoothing, so that the flight trajectory and instrument display are close to the real flight conditions, effectively improving the authenticity and immersion of flight training.

[0008] The present invention adopts the following technical solutions to achieve the purpose:

[0009] A flight environment virtual simulation restoration method based on flight data comprises the following steps:

[0010] S1. Acquire real flight data from a storage medium and convert it into a data format recognizable by a UE rendering engine to form raw data to be processed;

[0011] S2, parsing the original data and extracting multiple key flight parameters therefrom to form process data corresponding to each key flight parameter in the actual flight process;

[0012] S3, smoothing the process data corresponding to each key flight parameter, so that each process data changes smoothly when the virtual simulation of the aircraft's flight environment is updated;

[0013] S4. Based on the smoothed process data, the aircraft posture in the UE virtual environment corresponding to the UE rendering engine is updated to restore the flight trajectory;

[0014] S5. Create a world space UI in the UE virtual environment, and update and display instrument information corresponding to the flight trajectory in the world space UI based on the smoothed process data.

[0015] Specifically, in step S1, the real flight data generated and recorded by the aircraft after the real flight is obtained from the SD card, and converted into a data format recognizable by the UE rendering engine; the data format types include CSV and JSON.

[0016] Specifically, in step S2, the multiple key flight parameters extracted include: longitude and latitude, altitude, attitude angle, airspeed, vertical speed and engine parameters.

[0017] Furthermore, in step S2, the original data is parsed and key flight parameters including longitude, latitude and altitude are extracted therefrom, and the geographic coordinates are formed by longitude, latitude and altitude; the geographic coordinates are converted into the UE world coordinate system corresponding to the UE rendering engine, and the longitude and latitude are converted using the spherical approximation formula during the conversion. The initial flight point preset by the aircraft in the actual flight is used as the reference origin of the UE world coordinate system to realize the conversion of the remaining longitude, latitude and altitude relative to the reference origin during the flight process; after the conversion is completed, the process data corresponding to the longitude, latitude and altitude during the actual flight process are formed.

[0018] Preferably, in step S3, the process data before smoothing has a first interval value, and after smoothing the process data, the first interval value is converted into a second interval value; the second interval value is smaller than the first interval value, and the process data with the second interval value meets the display requirements of the VR headset and the preset frame rate environment.

[0019] Preferably, the smoothing process includes interpolation; adjacent data values ​​having a first interval value in the process data are interpolated using the FMath::Lerp function in the UE rendering engine, thereby decomposing the data corresponding to the first interval value into multiple frames of data to match the display requirements of the VR headset and the preset frame rate environment.

[0020] Preferably, the smoothing process includes mean filtering; among the multiple key flight parameters extracted, the process data corresponding to the altitude and attitude angle are mean filtered to reduce the noise and irregular mutations in these two types of process data; when the mean filtering method is used for smoothing, the historical data points in the two types of process data are stored in an array in the blueprint of the UE rendering engine, and for each historical data point, the average value within the window size range is calculated respectively, and a new data set array is formed accordingly to achieve smoothing.

[0021] Furthermore, in step S4, in the Tick event of the blueprint of the UE rendering engine, a specific data point in the smoothed process data is selected as a specific input for updating the aircraft posture according to the timestamp selection method; in the blueprint node of the UE rendering engine, the Set Actor Location And Rotation function is used to control the movement and rotation of the aircraft object in the UE virtual environment, wherein the rotation process of the aircraft object is determined according to the process data corresponding to the attitude angle, and the rotation order is performed in the order of heading angle, pitch angle, and roll angle in the attitude angle.

[0022] Furthermore, in step S5, the UMG function of the UE rendering engine is used to create a world space UI, and the key data of the instrument information corresponding to the PFD and MFD of the aircraft are displayed in real time; in the world space UI, the visualization components of the UE rendering engine are used to represent the pointers, numbers and dials of various instruments, and the world space UI and the smoothed process data are bound through the blueprint of the UE rendering engine to update the angle of the instrument pointer in real time, and the instrument information of the aircraft object in the UE virtual environment in the current flight state is displayed through text content.

[0023] The present invention also provides a computer system, including a memory, a processor and a computer program stored in the memory, wherein the processor executes the computer program to implement the steps of the aforementioned flight environment virtual simulation restoration method based on flight data.

[0024] In summary, due to the adoption of this technical solution, the beneficial effects of the present invention are as follows:

[0025] The present invention aims to significantly improve the authenticity and immersion of flight simulation training by introducing real flight data into the UE virtual environment. In this virtual environment, the flight trajectory and instrument display experienced by the pilot will be as close to the actual flight conditions as possible. This not only enables pilots to train in a more realistic environment, but also enhances their understanding and mastery of flight operations, thus laying a solid foundation for actual flight.

[0026] In order to ensure the smoothness and fluency of dynamic display, the present invention uses interpolation and filtering technology to process the aircraft's attitude changes, position movement, and instrument reading updates. These processing methods effectively solve the common jitter and freeze problems in VR display, providing a more stable and smooth visual experience. Pilots can practice various flight operations in a more realistic environment without worrying about the incoherence or instability caused by technical limitations interfering with their training results.

[0027] The application of the present invention can help improve the quality and efficiency of pilot training. Through a highly realistic virtual environment, pilots can repeatedly practice and become familiar with different types of flight operations and instrument interpretation, enhancing their adaptability and decision-making level in actual flight. This method can not only reduce the cost of traditional flight training, but also improve the safety of overall training by providing a safe and controllable training platform. In addition, efficient virtual training can also shorten the pilot's learning curve, speed up their mastery of flight skills, and ultimately achieve a more efficient talent training goal. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1 It is a schematic diagram of the overall process of the flight environment virtual simulation restoration method of the present invention;

[0029] Figure 2 Schematic diagram of three types of attitude angles of the aircraft rotation sequence in the method of the present invention;

[0030] Figure 3 It is a schematic diagram of the interface of the UMG functional system in the method of the present invention;

[0031] Figure 4 It is a schematic diagram of the instrument interface restored by the UMG functional system in the method of the present invention. DETAILED DESCRIPTION

[0032] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Generally, the components of the embodiments of the present invention described and shown in the drawings here can be arranged and designed in various different configurations.

[0033] Therefore, the following detailed description of the embodiments of the present invention provided in the accompanying drawings is not intended to limit the scope of the invention claimed for protection, but merely represents selected embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0034] Example

[0035] A method for restoring a virtual flight environment based on flight data. The overall process of this method can be found in Figure 1 The specific summary of each step is as follows:

[0036] S1. Acquire real flight data from a storage medium and convert it into a data format recognizable by a UE rendering engine to form raw data to be processed;

[0037] S2, parsing the original data and extracting multiple key flight parameters therefrom to form process data corresponding to each key flight parameter in the actual flight process;

[0038] S3, smoothing the process data corresponding to each key flight parameter, so that each process data changes smoothly when the virtual simulation of the aircraft's flight environment is updated;

[0039] S4. Based on the smoothed process data, the aircraft posture in the UE virtual environment corresponding to the UE rendering engine is updated to restore the flight trajectory;

[0040] S5. Create a world space UI in the UE virtual environment, and update and display instrument information corresponding to the flight trajectory in the world space UI based on the smoothed process data.

[0041] This embodiment will explain the steps and contents of the above method in detail.

[0042] Through the above method, this embodiment will achieve two aspects: flight trajectory restoration and instrument data restoration. First of all, flight trajectory restoration refers to the realization of a complete take-off and landing route flight trajectory in a virtual simulation program based on the real SD card flight data provided. Starting from ground taxiing, the pilot taxis the aircraft to the main runway and takes off when it reaches the appropriate position. Subsequently, the pilot performs cruise, approach and landing operations, and finally taxis to the auxiliary road after touchdown. Throughout the process, the virtual simulation system ensures that every action and trajectory of the aircraft is completely consistent with the actual flight data through high-precision data import and algorithm simulation. In this way, pilots can practice and become familiar with the operations of various take-off and landing routes in a realistic environment, improving accuracy and adaptability in actual flight.

[0043] Instrument data restoration refers to the real-time display of key data of PFD (primary flight display) and MFD (multi-purpose flight display) in the virtual simulation program based on the real SD card flight data provided. These key data include but are not limited to airspeed, altitude, heading, attitude, vertical speed, engine parameters, etc. By seamlessly importing data from actual flight into the virtual simulation system, PFD and MFD can display data consistent with actual flight in real time during training, allowing pilots to better monitor and adjust the status of the aircraft. This highly simulated instrument display not only enhances the realism of training, but also helps pilots master the reading and operation of various instruments, improving their decision-making ability and operational accuracy in actual flight.

[0044] Based on the above two aspects, the system development environment to be applied by the method of this embodiment is introduced as follows: In order to restore the real flight driving experience, this embodiment will use UE4 in the UE rendering engine to implement the method and produce related systems. The UE rendering engine also has its corresponding program, namely the UE blueprint development language. Utilizing the highly realistic rendering technology and flexible blueprint programming system provided by UE4, a virtual simulation program for take-off and landing routes with high driving experience restoration, realistic pictures, and strong scalability can be produced. The system corresponding to the virtual simulation of the flight environment in this embodiment will adopt an object-oriented design concept, taking into account its scalability, standardization, and security, and respond to platform events and changes in user needs and presentation formats through event-driven and active push.

[0045] The following is a detailed introduction to the flight trajectory restoration part of the method of this embodiment.

[0046] The restoration of the flight trajectory is achieved by parsing the flight data and converting it into a dynamic model in a virtual environment. This process involves extracting key parameters from the flight record, such as position, speed, attitude angle, acceleration, etc., and then processing these data through an algorithm to generate a three-dimensional dynamic trajectory that conforms to the actual flight characteristics. In a virtual environment, the dynamic visualization of the trajectory not only accurately reproduces the movement path of the aircraft, but also simulates the interaction between the aircraft and the surrounding environment, such as airflow disturbances, terrain effects, etc. Therefore, the process needs to ensure the accuracy and smoothness of the trajectory.

[0047] First, perform data format conversion to convert the flight data in the SD card into a format that can be recognized by the UE rendering engine, such as CSV or JSON. When importing data, use the data reading module in the UE rendering engine to open the flight data file, and use the data reading module to read each line in the file line by line. After reading each line of data, it is necessary to filter it to obtain parameter data related to the aircraft's flight trajectory to form the raw data to be processed.

[0048] This embodiment uses the file I / O system of the UE rendering engine and accesses the file I / O system through the FFileHelper class function. This class function provides static methods such as Load File To Memory and Save Array To File, allowing files to be read and written in binary or text form. Then, the Split function of the FString class is used to split each row of data into multiple fields. For data in CSV format, commas are used as delimiters to extract parameters such as longitude, latitude, and altitude.

[0049] After reading each line of data, a set of predefined rules is used to filter out parameters related to the aircraft's flight trajectory; in addition, data validation logic can be applied to ensure that each record conforms to the expected format and range. At the same time, in order to avoid performing time-consuming file I / O operations in the main thread, the asynchronous loading mechanism of the UE rendering engine can be used; through the AsyncLoad function, data is loaded in the background thread without blocking the main loop.

[0050] After the above operations form the raw data to be processed, data analysis can be performed. According to the read flight data, analysis is performed to obtain multiple key flight parameters related to the flight trajectory of the aircraft; the system is driven by history, and the following data are required to restore the flight trajectory of the aircraft: longitude and latitude, altitude, attitude angle, airspeed, vertical speed and engine parameters. Since the UE world coordinate system corresponding to the UE rendering engine uses the Cartesian three-dimensional space coordinate system to represent the position and direction information of objects, the original data needs to be converted into corresponding units. In this embodiment, the original data units of longitude and latitude are degrees, minutes, and seconds, and the original data units of height are feet. After conversion to the UE world coordinate system, they will jointly form the world coordinate X-axis, Y-axis and Z-axis, and the units are all centimeters.

[0051] In this embodiment, the spherical approximation formula is used to convert the longitude and latitude during the conversion, and the initial flight point preset by the aircraft in the actual flight is used as the reference origin of the UE world coordinate system to realize the conversion of the remaining longitude and latitude and altitude relative to the reference origin during the flight. When the converted geographic coordinates are recorded in a table, if the first row of recorded data is used as the reference origin, the offset of the aircraft position corresponding to the reference origin position can be calculated by subtracting the first row from the remaining rows, and the relative position of the aircraft in the UE world coordinate system (X axis, Y axis and Z axis) can be obtained. After the relative position of the UE world coordinate system is obtained, the flight trajectory of the aircraft can be smoothly generated.

[0052] Since the frequency of real SD card flight data is one second, and the refresh rate of the picture per second (FPS) in the VR headset needs to reach more than 60 to avoid lag, it is necessary to interpolate and smooth the data involved, and interpolate the values ​​between two units of seconds 60 times to ensure smooth and stable images. Then, the interpolated data is restored in turn to the position and posture of the aircraft at that moment, and finally a smooth animation is rendered.

[0053] In this embodiment, the FMath::Lerp function provided by the UE rendering engine is used to perform linear interpolation between two values. This function requires a starting value, an ending value, and an interpolation factor (Alpha, α), where the value of Alpha changes from 0 to 1, indicating a transition from the starting value to the ending value. The formula for linear interpolation is: Lerp(A, B, α) = A + α × (BA) Lerp(A, B, α) = A + α × (BA) In the Unreal Engine, this is used to smoothly transition between two positions or rotation values.

[0054] Continue to perform data smoothing. During the actual flight, the data collected by the aircraft SD card will be affected by the image data of air pressure and wind direction, which will cause fluctuations and errors, and will cause the image rendered to the VR headset to jitter and shake. Therefore, when the data fluctuates abnormally, the drive data needs to be smoothed according to the severity of the fluctuation. In this embodiment, the mean filtering method is used to smooth the signal and reduce the impact of noise by calculating the average value of the data within a certain range around the data point. The specific operations are as follows:

[0055] (1) Create a blueprint that takes historical flight data as input and adds a variable to store the average value.

[0056] (2) Add a timer node to the blueprint and set its time interval to 1 second;

[0057] (3) In the loop event of the timer, add a loop node to retrieve all the position information in the historical flight data and store it in an array;

[0058] (4) Create a variable to store the window size and set its initial value;

[0059] (5) For each historical flight data point, calculate the average value within the window size, use it as the new position of the data point, and store the new position in a new array;

[0060] (6) The new array is used as output to restore the smooth motion trajectory of the aircraft in the UE rendering engine.

[0061] After the above processing, the process data corresponding to each key flight parameter can effectively reduce the jitter and shaking of the picture in the VR headset. Through the mean filtering processing method, the system can smooth the mutation points of the altitude data and reduce the picture offset caused by data fluctuations, thereby providing users with a more stable and comfortable visual experience. This is particularly important for improving the interactivity and immersion in the VR environment, especially when simulating high-dynamic scenes (such as flying and driving), which can significantly reduce the probability of motion sickness.

[0062] Next, you can control the position of the aircraft in the UE virtual environment. First, set the initial position and rotation. This embodiment uses the Set Actor Location And Rotation function to control the movement and rotation of the aircraft object in the UE virtual environment. This blueprint node allows you to specify an FVector as the position in world space and a FRotator as the rotation value.

[0063] The initial position can be obtained by converting the longitude and latitude coordinates to the UE world coordinate system, which is usually set to the origin (0,0,0) in the UE world coordinate system, and there is no initial rotation. Subsequently, the position update of the aircraft object in the UE virtual environment can be updated in real time based on the smoothed process data. In this embodiment, it is completed in the Tick event of the blueprint of the UE rendering engine. The Tick event is called once per frame, allowing the position to be updated based on the time difference (DeltaTime). A specific operation example is: use the Get Actor Location node to obtain the position of the current aircraft object, and update the position of the aircraft object in combination with the interpolated position data. For example, if linear interpolation is used, the new position is calculated by combining the current position and the target position and an interpolation factor (Alpha).

[0064] After the position and movement of the aircraft object are determined and updated in the above way, the attitude of the aircraft object can be controlled. First, we need to understand the rotation order, such as Figure 2 As shown, the aircraft's attitude is defined by three Euler angles ( Figure 2 From left to right in the figure: roll angle, pitch angle and heading angle, which describe the direction of the aircraft relative to the geographic coordinate system.

[0065] In this embodiment, the rotation order must follow the "ZYX" convention in the UE world coordinate system, that is, first rotate the heading angle around the Z axis, then rotate the pitch angle around the Y axis, and finally rotate the roll angle around the X axis. The initial rotation posture is set using the Set Actor Rotation node of the UE rendering engine, usually set to zero, which is done when the aircraft object is generated or reset.

[0066] In the Tick event of the UE rendering engine blueprint, the aircraft's attitude is updated in real time based on the smoothed process data, and the latest heading, pitch, and roll values ​​are obtained from the data source. The UE rendering engine provides the Add Actor WorldRotation node, which allows you to add a rotation offset relative to the world coordinate system to the aircraft object. Therefore, you can use this node three times in a row in the above rotation order, each time using a rotation angle to complete the corresponding rotation, first rotating with the heading angle, then the pitch angle, and finally the roll angle.

[0067] Each rotation is represented by a FRotator object, which contains three floating point values: Pitch, Yaw, and Roll. For example, the yaw rotation is represented by FRotator(0, Yaw, 0), the pitch rotation is FRotator(Pitch, 0, 0), and the roll rotation is FRotator(0, 0, Roll). Each rotation is based on the result of the previous rotation, which means that the final attitude of the aircraft object is the result of the superposition of all rotations.

[0068] The above is the content related to the flight trajectory restoration part. Next, the content of the instrument data restoration part in this embodiment is introduced.

[0069] Similar to flight trajectory restoration, instrument data restoration also requires data import, analysis, calculation, difference, and smoothing. The final application basic data is the process data after smoothing. Specifically, first, the raw data of flight records or sensor outputs is obtained through the data import module; then, key parameters such as timestamp, altitude, speed, acceleration, and position are extracted through the parsing step; then the data is mathematically calculated and interpolated to fill the gaps caused by sensor noise or data loss to ensure the integrity and continuity of the data. Smoothing is a key link in the entire process. It can effectively reduce random noise and short-term fluctuations in the data, providing a more stable foundation for subsequent analysis and use.

[0070] In this embodiment, the UMG function system of the UE rendering engine is used to create a world space UI, thereby simulating various instruments in the cockpit of an aircraft.

[0071] like Figure 3 As shown in the figure, the UMG function system is a powerful UI editor that allows developers to create and edit user interfaces in a visual way. UMG provides a rich component library, including buttons, text, images, sliders, etc., as well as more complex layout containers such as vertical and horizontal boxes, grids, etc. UMG's flexibility and powerful data binding capabilities make it an ideal choice for implementing dynamic and interactive UIs.

[0072] When this embodiment uses the UMG function system to restore the instrument data during the flight, first create a new UMG blueprint class, which will serve as the core of the instrument interface. In this blueprint, all UI elements and their behaviors will be defined. Subsequently, in the UE virtual environment built by the UE rendering engine, add a Widget component to the aircraft model, place the Widget component at the position corresponding to the instrument, and then specify the Widget Class as the UMG blueprint class created as the core of the instrument interface.

[0073] You can then add various components to this UMG blueprint class to restore the appearance of the actual instrument, and promote the components involved in the change to variables so that they can be dynamically modified in the blueprint code. Figure 4 The instrument interface restoration example shown in the figure fully utilizes the visualization components of the UE rendering engine in the world space UI, so that different specific layouts can be used to restore the actual instrument according to its different characteristics.

[0074] In the visualization components of the UE rendering engine, the Image component is used to display images, which can be used to create instrument backgrounds, pointers, and scales; by modifying the render transform property, the translation and rotation effects of the icon pointer on the instrument can be achieved. The Text component is used to display text, which is suitable for displaying numbers and labels; by modifying the text and rendertransform properties, the text content can be changed and jumped.

[0075] Finally, we combine the display form and display position of each instrument information data and use different solutions to restore it according to different display contents. Detailed restoration examples of some instruments are introduced as follows:

[0076] (1) Altitude: Use UMG's Image and Text components to restore. The digital information and appearance of the altimeter can be realized through the pictures of the Text component and Image component. Separating the numbers and the dial allows for more flexible adjustment of the appearance of the altimeter dial to suit different aircraft models and flight scenarios during design.

[0077] (2) Slope: Use UMG's Image and Text components to restore. The numerical information of the slope and the appearance of the tilted dial can be realized through the pictures of the Text component and the Image component. Similarly, the design method of separating the numbers and the dial makes it easy to adjust the appearance of the tilted dial.

[0078] (3) Posture: Use a 3D model to restore it. Use a static mesh to represent the instrument, and control its rotation, tilt, pitch and other parameters through blueprints or code to make the 3D model more realistic.

[0079] (4) Heading: Use UMG's Image and Text components to restore. The heading digital information and the appearance of the compass face can be realized through the pictures of the Text component and the Image component. The design method of separating the numbers and the dial makes it easy to adjust the appearance of the compass face.

[0080] (5) Rise / Fall Rate: Use UMG's Text component to restore the rise / fall rate. The rise / fall rate is usually expressed in feet per minute, so the Text component is used to directly display the number.

[0081] (6) Track: Use UMG's Image and Text components to restore. The digital information of the track and the appearance of the navigation panel are realized through the pictures of the Text component and the Image component. The design method of separating the numbers and the dial makes it easy to adjust the appearance of the navigation panel.

[0082] (7) Engine speed: Use UMG's Text component to restore. The engine speed is presented in the form of RPM (revolutions per minute), so the number is directly displayed through the Text component.

[0083] (8) Indicated airspeed indicator: Use UMG's Text component to restore it. Update the indicated airspeed data in real time and convert it into a suitable Text display.

[0084] The above method of this embodiment can be successfully applied in the current computer system, which includes a memory, a processor and a computer program stored in the memory. When the processor executes the computer program, the various steps and detailed contents of the flight environment virtual simulation restoration method based on flight data in this embodiment can be implemented.

[0085] In summary, the present invention provides pilots with a high-quality, low-cost, safe and reliable training solution by combining high-precision real flight data with an optimized data processing method, thereby promoting the progress and development of the aviation training field.

Claims

1. A flight environment virtual simulation restoration method based on flight data, characterized in that: The method comprises the following steps: S1. Acquire real flight data from a storage medium and convert it into a data format recognizable by a UE rendering engine to form raw data to be processed; S2, parsing the original data and extracting multiple key flight parameters therefrom to form process data corresponding to each key flight parameter in the actual flight process; S3, smoothing the process data corresponding to each key flight parameter, so that each process data changes smoothly when the virtual simulation of the aircraft's flight environment is updated; S4. Based on the smoothed process data, the aircraft posture in the UE virtual environment corresponding to the UE rendering engine is updated to restore the flight trajectory; S5. Create a world space UI in the UE virtual environment, and update and display instrument information corresponding to the flight trajectory in the world space UI based on the smoothed process data.

2. The flight environment virtual simulation restoration method according to claim 1, characterized in that: In step S1, the real flight data generated and recorded by the aircraft after the real flight is obtained from the SD card, and converted into a data format recognizable by the UE rendering engine; the data format types include CSV and JSON.

3. The flight environment virtual simulation restoration method according to claim 1, characterized in that: In step S2, the multiple key flight parameters extracted include: longitude and latitude, altitude, attitude angle, airspeed, vertical speed and engine parameters.

4. The flight environment virtual simulation restoration method according to claim 1, characterized in that: In step S2, the original data is parsed and key flight parameters including longitude, latitude and altitude are extracted from the data, and the geographic coordinates are formed by longitude, latitude and altitude. The geographic coordinates are converted into the UE world coordinate system corresponding to the UE rendering engine. The longitude and latitude are converted using the spherical approximation formula. The initial flight point preset by the aircraft in the actual flight is used as the reference origin of the UE world coordinate system to realize the conversion of the remaining longitude, latitude and altitude relative to the reference origin during the flight. After the conversion is completed, the corresponding process data of the longitude, latitude and altitude during the actual flight are formed.

5. The flight environment virtual simulation restoration method according to claim 1, characterized in that: In step S3, the process data before smoothing has a first interval value, and after smoothing the process data, the first interval value is converted into a second interval value; the second interval value is smaller than the first interval value, and the process data with the second interval value meets the display requirements of the VR headset and the preset frame rate environment.

6. The flight environment virtual simulation restoration method according to claim 5, characterized in that: The smoothing process includes interpolation; the adjacent data values ​​having the first interval value in the process data are interpolated using the FMath::Lerp function in the UE rendering engine, thereby decomposing the data corresponding to the first interval value into multiple frames of data to match the display requirements of the VR headset and the preset frame rate environment.

7. The flight environment virtual simulation restoration method according to claim 5, characterized in that: Smoothing processing includes mean filtering; among the multiple key flight parameters extracted, mean filtering is performed on the process data corresponding to the altitude and attitude angle to reduce the noise and irregular mutations in these two types of process data; when using mean filtering for smoothing, the historical data points in these two types of process data are stored in an array in the blueprint of the UE rendering engine. For each historical data point, the average value within the window size range is calculated respectively, and a new data set array is formed to achieve smoothing processing.

8. The flight environment virtual simulation restoration method according to claim 1, characterized in that: In step S4, in the Tick event of the blueprint of the UE rendering engine, a specific data point in the smoothed process data is selected as the specific input for updating the aircraft posture according to the timestamp selection method; in the blueprint node of the UE rendering engine, the Set ActorLocation And Rotation function is used to control the movement and rotation of the aircraft object in the UE virtual environment, wherein the rotation process of the aircraft object is determined according to the process data corresponding to the attitude angle, and the rotation order is carried out in the order of heading angle, pitch angle, and roll angle in the attitude angle.

9. The flight environment virtual simulation restoration method according to claim 1, characterized in that: In step S5, the UMG function of the UE rendering engine is used to create a world space UI, and the key data of the instrument information corresponding to the PFD and MFD of the aircraft are displayed in real time; in the world space UI, the visualization components of the UE rendering engine are used to represent the pointers, numbers and dials of various instruments. Through the blueprint of the UE rendering engine, the world space UI and the smoothed process data are bound to update the angle of the instrument pointer in real time, and the instrument information of the aircraft object in the UE virtual environment in the current flight state is displayed through text content.

10. A computer system comprising a memory, a processor and a computer program stored in the memory, characterized in that: The processor executes the computer program to implement the steps of the method for virtual simulation and restoration of a flight environment based on flight data as described in any one of claims 1 to 9.

Images