System and method for constructing an aviation virtual-real joint platform based on digital twinning, and platform

Abstract

The application discloses an aviation virtual-real joint platform construction system and method based on digital twinning and the platform, and relates to the field of aviation virtual-real joint platform construction.The aviation virtual-real joint platform construction system comprises a virtual model construction module, a physical property simulation and rule setting module, a platform visualization module, a virtual mapping module, an operation state monitoring model construction module, a performance evaluation module and a state prediction module.The aviation virtual-real joint platform comprises a perception transmission layer, a data layer, a service layer and an application layer.The perception transmission layer collects data through various sensors and transmits the data to the data layer through big data, the Internet of Things and cloud services; the data layer comprises a static database.The aviation virtual-real joint platform built by the application can discover potential faults and performance decline in advance through real-time monitoring and prediction analysis, so that preventive measures can be taken, and the performance and reliability of the aircraft are improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of aviation virtual-real joint platform construction, and particularly relates to an aviation virtual-real joint platform construction system and method based on digital twinning and a platform. BACKGROUND

[0002] Digital twinning technology is a method of simulating, predicting and optimizing real-world systems through real-time data connection between virtual models and the physical world. It uses technologies such as the Internet of Things, big data, artificial intelligence, etc. to map real-world objects, systems or processes to virtual space, enabling information exchange and collaboration between entities and virtual bodies.

[0003] In the field of aviation, the application of digital twinning technology can significantly improve the performance and reliability of aircraft. Since the operating environment of aircraft is variable, its performance is closely related to the design, manufacturing process, etc. With the development of control systems and sensor technology, the amount of monitoring data has grown dramatically, and the data has shown typical characteristics such as high speed, multiple sources, and heterogeneous. Current technology cannot meet the high-precision requirements of real-time evaluation and prediction of the state of the aircraft in a dynamic and variable environment. Digital twinning technology, with its multi-scale, high-fidelity models and full-life-cycle data management capabilities, can reflect the state of the aircraft in virtual space in real time. Through visualization technologies such as three-dimensional models, digital twinning can intuitively and visually display the operating conditions of the aircraft. SUMMARY

[0004] To solve the above problems of the prior art, the present application provides an aviation virtual-real joint platform construction system and method based on digital twinning, and the platform, in order to further improve the performance and reliability of the aircraft, reduce maintenance costs, and extend the service life through virtual-real combination.

[0005] Specifically, in one aspect, the present application provides an aviation virtual-real joint platform construction system based on digital twinning, which includes a virtual model construction module, a physical property simulation and rule setting module, a platform visualization module, a virtual mapping module, an operating state monitoring model construction module, a performance evaluation module, a state prediction module, and a maintenance report generation module.

[0006] The virtual model building module is used for establishing a virtual model of an aviation aircraft in 3ds Max and inputting into Unity3D, and comprises a data collection unit, a model shape construction unit, an initial aircraft model structure construction unit, an aircraft material selection unit, a model input unit and an aviation environment simulation unit. The data collection unit is used for collecting aviation aircraft drawings and parameter data. The model shape construction unit is used for creating a basic shape of a model using a basic geometric body tool in 3ds Max and adjusting the size of the basic geometric body according to the parameter data in the aircraft drawings. The initial aircraft model structure construction unit is used for adjusting the model based on the aircraft drawings using an editing tool in 3ds Max on the basis of the basic geometric body to construct an initial aircraft model structure. The aircraft material selection unit is used for creating materials corresponding to each component of the aircraft using a material editor in 3ds Max and applying the materials. The model input unit is used for exporting the initial aircraft model structure created in 3ds Max into an FBX format and importing into Unity3D. The aviation environment simulation unit is used for setting a scene in Unity3D to simulate a real aviation environment, the scene comprising a sky box, a ground, a background and environmental elements, and a Skybox material of Unity is used to simulate a sky background. A terrain object is created by selecting a Terrain component under 3D Object in a Hierarchy panel to generate a default terrain model, and the terrain model is edited according to requirements through the Terrain component. A directional light is created to simulate sunlight, and the position of the directional light is adjusted to simulate different time lighting effects.

[0007] The physical property simulation and rule setting module is used for simulating physical properties and setting rules of the aviation aircraft itself by using Unity3D to realize the embodiment of physical entities in a virtual environment. Specifically, the physical property simulation and rule setting module comprises gravity setting, physical material setting and camera system setting. The gravity setting specifically comprises modifying the physical setting of a project to adjust the global gravity in a Unity editor. The physical material setting specifically comprises defining a physical material through a Physics Material, and the physical material comprises dynamic friction, static friction and elastic force properties. The parameter range of the dynamic friction is set to be between 0 and 1, the parameter range of the static friction is set to be between 0 and 1, and the parameter range of the elastic force property is set to be between 0.1 and 0.2. The camera system comprises an anthropomorphic prefab for controlling the forward direction and a main camera.

[0008] The platform visualization module is used for building a visualization page of the twin platform.

[0009] The virtual mapping module is used for binding and debugging the interaction and mapping relationship of each aviation aircraft component, designing an interaction function and realizing virtual mapping.

[0010] The operation state monitoring model construction module is configured to collect multi-source data of a component to be predicted, train a model based on an Informer model, and realize prediction of the operation state of the component.

[0011] The performance evaluation module is configured to evaluate the performance of the training result of the prediction model.

[0012] The state prediction module is configured to save the prediction model, compile a dynamic link library, and call the dynamic link library to realize state prediction of the aircraft when a platform fault is predicted.

[0013] The maintenance report generation module is configured to automatically generate a guidance maintenance report after completing state prediction, and the guidance maintenance report can clearly mark the specific area where the fault occurs by combining the 3D components of the aircraft.

[0014] Preferably, the platform visualization module creates UI components in Unity3D to display data and realize user interaction, and the UI components are Text or Button, and the preset visualization interface is obtained by adjusting the position, size and style of the UI elements.

[0015] Preferably, the virtual mapping module controls the behavior and interaction logic of the UI components in Unity3D through C# scripts. First, create and configure the UI components in the Unity editor. Then, create a C# script file and define public methods in it to update the content of the UI components. Then, attach the script to the aircraft component object containing the UI components, and set the public fields of the script in the Inspector panel to ensure that the script can correctly reference the UI components. Finally, run and test to verify the function of the script to ensure that the UI components can respond to interactions as expected.

[0016] Preferably, the operation state monitoring model construction module uses the Informer model to predict the signals of the component to be predicted and diagnose the prediction results. The Informer model includes an encoder and a decoder. The encoder is used to extract features from the input historical time series data, and the decoder is used to map the high-dimensional features generated by the encoder to the target time series to generate future time series predictions.

[0017] Preferably, the performance evaluation module can evaluate the accuracy of the prediction results through prediction evaluation indicators. The performance evaluation module uses mean absolute error (MAE), root mean square error (RMSE), and determination coefficient R 2 to evaluate the accuracy of the prediction results.

[0018] The mean absolute error (MAE) measures the size of the error by calculating the average value of the absolute value of the difference between the predicted value and the actual observed value. The calculation formula of MAE is as follows:

[0019]

[0020] where y i is the i-th observation, is the mean of all observations, f(x i is the model prediction of the i-th observation, and m is the length of the time series.

[0021] The root mean square error (RMSE) is the standard deviation of the difference between the observed and predicted values, and is calculated as follows:

[0022]

[0023] R 2 is the proportion of the actual observations that the model can explain out of the total observations, and R 2 is determined by three parameters: SSR, SST, and SSE. SSR is the sum of the squared differences between the predicted and mean values, SST is the sum of the squared differences between the actual and mean values, and SSE is the sum of the squared differences between the actual and predicted values. SST = SSR + SSE. The formulas for calculating SSR, SST, and SSE are as follows:

[0024]

[0025] The formula for calculating the coefficient of determination R 2 is as follows:

[0026]

[0027] The closer the value of R 2 is to 1, the better the model fits the data.

[0028] Preferably, the specific steps for generating the maintenance report are as follows:

[0029] Create a fault label, add a red box or arrow at the fault location, and when a component is predicted to be faulty, the label starts to flash;

[0030] Define a template for the maintenance report, which includes fault description, maintenance steps, and precautions;

[0031] Use the ScreenCapture.CaptureScreenshot method of Unity to capture Figure 3 the fault label view of the D model;

[0032] Fill the operating state monitoring results, prediction results, and fault label view of the 3D model obtained from the condition monitoring system into the maintenance report template;

[0033] The filled-in maintenance report content and the screenshot are integrated by using iTextSharp to generate a PDF format maintenance report.

[0034] Preferably, in another aspect, the present application provides a method for constructing an aviation virtual-real joint platform based on digital twinning, comprising the following steps:

[0035] S1, a virtual model of an aviation aircraft is established in 3ds Max and input into Unity3D;

[0036] S2, the physical properties and rules of the aviation aircraft itself are simulated and set by using Unity3D, so as to realize the embodiment of physical entities in a virtual environment;

[0037] S3, a visualization page of the twinning platform is built;

[0038] S4, the interaction and mapping relationship of each aviation aircraft component are bound and debugged, and the interactive function is designed and the virtual mapping is realized;

[0039] S5, multi-source data of a component to be predicted is collected, the model is trained relying on the Informer model, and the running state of the component is predicted;

[0040] S6, the performance of the training result of the prediction model is evaluated;

[0041] S7, after saving the prediction model, a dynamic link library is written and the dynamic link library is called to realize the state prediction of the aviation aircraft when the platform fails;

[0042] S8, after completing the state prediction, a guidance maintenance report is automatically generated, and the guidance maintenance report can clearly mark the specific area where the fault occurs by combining the 3D components of the aviation aircraft.

[0043] Preferably, step S1 specifically comprises the following sub-steps:

[0044] S11, collect aviation aircraft related drawings and data;

[0045] S12, in 3ds Max, use basic geometric tools to create and adjust the basic shape of the model, and the basic shape of the model includes a cube, a sphere or a cylinder;

[0046] S13, on the basis of the basic geometric body, use the editing tools in 3ds Max to modify and adjust the model, build the model structure, and the modification and adjustment include stretching, rotating and chamfering;

[0047] S14, create various different materials in 3ds Max using the material editor, and increase the details of the model through mapping and texture;

[0048] S15, export the model created in 3ds Max to FBX format and import it into Unity3D;

[0049] S16, set the scene in Unity3D, simulate the real aviation environment, the scene includes ground, background and environmental elements.

[0050] Preferably, step S2 specifically comprises the following sub-steps:

[0051] S21, gravity setting: in the Unity editor, adjust the global gravity by modifying the physical settings of the project, access through the following path: Edit→Project Settings→Physics find the Gravity setting, modify its value to adjust the global gravity effect, the initial value of gravity is-9.81;

[0052] S22, physical material setting: define physical material through Physics Material, physical material includes dynamic friction, static friction and elastic force properties;

[0053] S23, camera system: the camera system includes a humanoid prefab that controls the forward direction and a main camera, by placing the main camera on the top of the prefab and adjusting the angle accordingly to simulate the human eye view.

[0054] In a third aspect, the present application provides an aviation virtual-real joint platform based on digital twinning, which comprises a perception transmission layer, a data layer, a service layer and an application layer. The perception transmission layer collects data through various sensors and transmits data to the data layer through big data, Internet of Things and cloud services. The data layer comprises a static database, a dynamic database and a knowledge document. The static database comprises configuration information, historical data, business data and expert experience. The dynamic database comprises airborne monitoring data, airborne operation and maintenance data, integrated data and emergency data. The knowledge document comprises a fault dictionary, product technical instructions, diagnostic methods, guidelines, cases, maintenance manuals, regulations and cases. The service layer comprises a data storage unit, a reading unit, a visualization unit, a file download unit, a diagnosis unit, a prediction unit, a report generation unit, a data query unit, an information publishing unit, an update synchronization unit and an information browsing unit. The visualization management of the application layer is divided into PC display, mobile display and large screen display.

[0055] Compared with the prior art, the present application has the following beneficial effects:

[0056] (1) The aviation virtual-real joint platform built by the present application can detect potential faults and performance degradation in advance through real-time monitoring and prediction analysis, so that preventive measures can be taken to improve the performance and reliability of the aircraft.

[0057] (2) The aviation virtual-real combined platform built by the present application utilizes digital twinning technology to make maintenance more accurate, reducing unnecessary inspections and repairs, thereby reducing maintenance costs and operating expenses.

[0058] (3) The data and analysis results provided by the aviation virtual-real combined platform built by the present application can help decision-makers make more scientific and accurate decisions, improving operational efficiency.

[0059] (4) The aviation virtual-real combined platform built by the present application can simulate different environmental conditions to help aircraft better adapt to changing operating environments.

[0060] (5) The construction method of the present application realizes real-time monitoring and predictive maintenance of aircraft performance by integrating sensor technology, big data analysis, and artificial intelligence algorithms, thereby significantly improving the operational efficiency and safety of the aircraft. At the same time, after completing the state prediction, the platform can automatically generate a guidance maintenance report, which can clearly mark the specific area of the fault by combining the 3D components of the aircraft, so that the maintenance personnel can intuitively understand the fault location, and provide detailed precautions and maintenance step guidance for specific fault conditions. BRIEF DESCRIPTION OF DRAWINGS

[0061] Figure 1 is a schematic block diagram of the aviation virtual-real combined platform construction system of the present application;

[0062] Figure 2 is a flowchart of the aviation virtual-real combined platform construction method of the present application;

[0063] Figure 3 is a hierarchical architecture diagram of the aviation aircraft digital twinning platform of the present application;

[0064] Figure 4 is a model structure diagram of the present application;

[0065] Figure 5 is a first perspective reference diagram of the preform of the present application;

[0066] Figure 6 is the structure of the Informer model of the present application;

[0067] Figure 7 is the state prediction process of the present application. DETAILED DESCRIPTION

[0068] The present application will be described in detail below in conjunction with the drawings and specific embodiments.

[0069] On the one hand, the present application provides an aviation virtual-real combined platform construction system based on digital twinning, as shown in Figure 1As shown, it includes a virtual model building module 1, a physical property simulation and rule setting module 2, a platform visualization module 3, a virtual mapping module 4, a running state monitoring model building module 5, a performance evaluation module 6, a state prediction module 7, and a maintenance report generation module 8.

[0070] The virtual model building module 1 is used to establish a virtual model of an aviation aircraft in 3ds Max and input into Unity3D, and the virtual model building module includes a data collection unit, a model shape construction unit, an initial aircraft model structure construction unit, an aircraft material selection unit, a model input unit, and an aviation environment simulation unit. The data collection unit is used to collect aviation aircraft drawings and parameter data. The model shape construction unit is used to create the basic shape of the model using basic geometric tools in 3ds Max, and adjust the size of the basic geometric body according to the parameter data in the aircraft drawings. The initial aircraft model structure construction unit is used to adjust the model based on the aircraft drawings using the editing tools in 3ds Max based on the basic geometric body, and construct the initial aircraft model structure. The aircraft material selection unit is used to create the materials corresponding to each component of the aircraft using the material editor in 3ds Max and apply them. The model input unit is used to export the initial aircraft model structure created in 3ds Max as FBX format and import it into Unity3D. The aviation environment simulation unit is used to set up a scene in Unity3D to simulate the real aviation environment, which includes a skybox, a ground, a background, and environmental elements. The sky background is simulated using the Skybox material of Unity. The terrain object is created by selecting the Terrain component in the 3D Object module in the Hierarchy panel to generate a default terrain model, and edited according to the requirements through the Terrain component. The directional light is created to simulate sunlight, and the position of the directional light is adjusted to simulate different time lighting effects. The sky background is simulated using the Skybox material of Unity, the skybox material is downloaded, and applied on the camera in Scene.

[0071] The physical property simulation and rule setting module 2 is used to simulate the physical properties and rules of the aviation aircraft itself using Unity3D, and realize the embodiment of physical entities in the virtual environment. Specifically, it includes gravity setting, physical material setting, and camera system setting. The gravity setting specifically modifies the physical settings of the project to adjust the global gravity in the Unity editor. The initial value of gravity is -9.81, representing the standard gravity acceleration. The physical material setting specifically defines the physical material through PhysicsMaterial. The physical material includes dynamic friction, static friction, and elastic force properties. The dynamic friction is the friction used when the object is already moving, and the parameter range is set between 0 and 1. The default setting is 0.6, which needs to be adjusted according to the aircraft material and the expected physical behavior.

[0072] Static friction is the friction used when an object is stationary on a surface, parameter range is set between 0 and 1. Default setting is 0.6, which needs to be adjusted according to the aircraft material and the expected physical behavior.

[0073] Bounciness property defines the elasticity of the surface. A value of 0 means the surface has no elasticity, a value of 1 means the surface is very elastic, in this embodiment the parameter range of bounciness property is set between 0.1 and 0.2, preferably set to 0.1, simulating a slight bounce when the aircraft lands.

[0074] The above operations and settings simulate the actual running state and environment of the aircraft, to restore the most close to the real physical entity of the aviation state. It can be realized that the visual effect of roaming in the scene is achieved when the precast body is controlled to move.

[0075] Camera system settings: the first-person camera system is composed of a humanoid precast body that can control the forward direction and a main camera, by placing the main camera on the top of the precast body and adjusting the angle accordingly to simulate the human eye view. It can be realized that the visual effect of roaming in the scene is achieved when the precast body is controlled to move.

[0076] The platform visualization module 3 is used to build the visualization page of the twin platform; specifically: create UI components such as Text, Button, etc. in Unity3D, which are used to display data and realize user interaction. Adjust the position, size and style of UI elements to meet the design requirements.

[0077] In the Unity editor, right-click the Hierarchy panel and select UI→Canvas. Create a Canvas object as a container for all UI elements.

[0078] Right-click the Canvas object and select UI→Text to create a Text object under Canvas. In the Text component, adjust the font (Font), font size (Font Size), color (Color), and alignment (Alignment).

[0079] Right-click the Canvas object and select UI→Button to create a Button object under Canvas.

[0080] Adjust the position, size and style of UI elements to meet the design requirements of the aviation aircraft digital twin visualization panel.

[0081] The virtual mapping module 4 is used for binding and debugging the interaction and mapping relationship of each aircraft component, designing interaction function and realizing virtual mapping; specifically: in Unity3D, the behavior and interaction logic of the UI component are controlled through C# script. First, create and configure UI components such as UI Text in the Unity editor. Next, create a C# script file and define public methods in it to update the content of the UI component. Then, attach the script to the aircraft component object containing the UI component, and set the public fields of the script in the Inspector panel to ensure that the script can correctly reference the UI component. Finally, run and test to verify the function of the script, and ensure that the UI component can respond to interactions as expected.

[0082] The running state monitoring model 5 construction module is used for collecting multi-source data of the component to be predicted, training the model relying on the Informer model, and realizing prediction of the running state of the component; specifically: the Informer model is used to predict the signals of the component to be predicted, and the prediction results are diagnosed to realize the goal of predictive diagnosis of the future state of the component. The structure of the Informer model is shown in Figure 4 The left frame is the encoder for extracting features from the input historical time series data, and the right frame is the decoder for mapping the high-dimensional features generated by the encoder to the target time series to generate future time series prediction.

[0083] The performance evaluation module 6 is used for performance evaluation of the training results of the prediction model.

[0084] The performance evaluation module 6 can evaluate the accuracy of the prediction results through the prediction evaluation index. The performance evaluation module adopts the mean absolute error MAE, the root mean square error RMSE and the determination coefficient R 2 to evaluate the accuracy of the prediction results.

[0085] In specific application, the mean absolute error MAE measures the size of the error by calculating the average value of the absolute value of the difference between the predicted value and the actual observed value. The calculation formula of MAE is as follows:

[0086]

[0087] Where y i is the i-th observed value, is the average value of all observed values, and f(x i ) is the model prediction value of the i-th observed value, and m is the length of the time series.

[0088] The root mean square error RMSE is the standard deviation of the difference between the observed value and the model prediction value. The calculation formula of RMSE is as follows:

[0089]

[0090] R 2 The ratio between the actual observation value that the model can explain and the total observation value, R 2 The value of R is determined by three parameters, SSR, SST and SSE, SSR is the sum of squares of the difference between the predicted data and the mean of the true data, SST is the sum of squares of the difference between the true data and its mean, SSE is the sum of squares of the difference between the true data and the predicted data, SST = SSR + SSE; The calculation formula of the three parameters SSR, SST and SSE is as follows:

[0091]

[0092] The calculation formula of the coefficient of determination R 2 is as follows:

[0093]

[0094] The value of R 2 is closer to 1, the better the model fits the data.

[0095] The state prediction module 7 is used to save the prediction model, write a dynamic link library and call the dynamic link library to realize the state prediction of the aircraft when the platform fails.

[0096] The repair report generation module 8 is used to automatically generate a guiding repair report after completing the state prediction, and the guiding repair report can clearly mark the specific area where the fault occurs by combining the 3D components of the aircraft. The generation steps of the repair report are as follows:

[0097] Write a C# script to create a fault mark, add a red box or arrow at the fault position. When a component is predicted to fail, the mark starts to flash.

[0098] Define a template for the repair report, which contains key information such as fault description, repair steps and precautions.

[0099] Write a C# script to use Unity's ScreenCapture.CaptureScreenshot method to capture Figure 3 the fault mark view of the D model, save the screenshot as an image file for subsequent addition to the report.

[0100] According to the running state monitoring results, prediction results obtained from the state monitoring system, combined with expert experience and the fault mark view of the 3D model, fill in the report template.

[0101] Write a C# script to integrate the filled report content and screenshots to generate a PDF format repair report using iTextSharp.

[0102] Preferably, in another aspect, the present application provides a method for constructing an aviation virtual-real joint platform based on digital twinning, which comprises the following steps: Figure 2 as shown, which comprises the following steps:

[0103] S1, a virtual model of an aviation aircraft is established in 3ds Max and input into Unity3D. S11, aviation aircraft-related drawings and data are collected.

[0104] S12, in 3ds Max, basic shapes of the model are created using basic geometric tools and adjusted, including cubes, spheres or cylinders.

[0105] S13, based on the basic geometric bodies, the model is modified and adjusted using editing tools in 3ds Max to build the model structure, including stretching, rotating and chamfering.

[0106] S14, various different materials are created using the material editor in 3ds Max, and the model details are increased through mapping and texture.

[0107] S15, the model created in 3ds Max is exported in FBX format and imported into Unity3D.

[0108] S16, the scene is set in Unity3D to simulate the real aviation environment, including the ground, background and environmental elements.

[0109] S2, the physical properties and rules of the aviation aircraft itself are simulated and set in Unity3D to realize the embodiment of physical entities in the virtual environment. Step S2 specifically comprises the following sub-steps:

[0110] S21, gravity setting: in the Unity editor, the global gravity is adjusted by modifying the physical settings of the project, which can be accessed by following the path: Edit→Project Settings→Physics to find the Gravity setting and modify its value to adjust the global gravity effect. The initial value of gravity is -9.81.

[0111] S22, physical material setting: physical materials are defined by Physics Material, which includes dynamic friction, static friction and elastic properties.

[0112] S23, camera system: the camera system includes a humanoid prefab that controls the forward direction and a main camera, which is placed on the top of the prefab and adjusted accordingly to simulate the human eye perspective.

[0113] S3, build the visualization page of the twinning platform.

[0114] S4, binding and debugging the interaction and mapping relationship of each aircraft component, designing interaction function and realizing virtual mapping.

[0115] S5, collecting multi-source data of the to-be-predicted component, training the model relying on the Informer model, and realizing prediction of the running state of the component.

[0116] S6, performance evaluation of the training result of the prediction model.

[0117] S7, saving the prediction model, writing a dynamic link library, and calling the dynamic link library to realize state prediction of the aircraft when the platform fails.

[0118] S8, after completing the state prediction, a guiding maintenance report is automatically generated, which can clearly mark the specific area where the fault occurs by combining the 3D components of the aircraft.

[0119] In a third aspect, the present application provides an aviation virtual-real combined platform based on digital twinning, which comprises a perception transmission layer, a data layer, a service layer and an application layer. The perception transmission layer collects data through various sensors and transmits data to the data layer through big data, Internet of Things and cloud services. The data layer comprises a static database, a dynamic database and a knowledge document. The static database comprises configuration information, historical data, business data and expert experience. The dynamic database comprises airborne monitoring data, airborne operation and maintenance data, integrated data and emergency data. The knowledge document comprises a fault dictionary, product technical instructions, diagnostic methods, guidelines, cases, maintenance manuals, regulations and cases. The service layer comprises a data storage unit, a reading unit, a visualization unit, a file download unit, a diagnosis unit, a prediction unit, a report generation unit, a data query unit, an information publishing unit, an update synchronization unit and an information browsing unit. The visualization management of the application layer is divided into PC display, mobile display and large screen display. Specific embodiments

[0121] The present embodiment provides a specific aviation virtual-real platform building method, which comprises the following steps:

[0122] S1, as shown in Figure 3 and Figure 4 , collect the design drawings and related data of the aircraft, use 3ds Max to create basic 3D geometric shapes, and adjust the parameters to meet the design requirements. Refine the model structure using the editing tools of 3ds Max, add materials and textures to enhance the details, and export it as FBX format. Import the model into Unity3D and set the scene environment such as ground and background to simulate the real aviation environment.

[0123] S2, as shown in Figure 3 andFigure 5 As shown, adjust the global gravity settings in Unity to simulate standard gravitational acceleration. Add Rigidbody and Collider components to the object to simulate the elasticity of an aircraft landing. Set physical material properties using Physics Material to simulate friction and elasticity. And add a first-person camera system.

[0124] S3, such as Figure 3 As shown, UI components such as Text and Button are created in Unity3D to display data and implement user interaction, and these elements are adjusted to meet design requirements.

[0125] S4, such as Figure 3 As shown, write a C# script to control the behavior and interaction logic of the UI component, attach the script to the aviation component object, and ensure that the script can correctly reference the UI component.

[0126] S5, such as Figure 6 As shown, the Informer model is used for predictive diagnostics of signals. This model extracts features through an encoder and generates future time series predictions through a decoder.

[0127] S6. The accuracy of prediction results can be evaluated through prediction evaluation indicators. These include the mean absolute error (MAE), root mean square error (RMSE), and coefficient of determination (R²). 2 To assess the accuracy of the prediction results.

[0128] S7, such as Figure 7 As shown, after saving the prediction model, a dynamic link library (DLL) is written and called in the platform's fault prediction function to realize the state prediction of the aircraft.

[0129] S8. To improve maintenance efficiency and shorten maintenance cycles, the platform can automatically generate a guidance maintenance report after completing condition prediction. This report can clearly mark the specific area where the fault occurred by combining 3D components of the aircraft, so that maintenance personnel can intuitively understand the location of the fault and provide detailed precautions and maintenance procedure guidance for specific fault situations.

[0130] The embodiments described above are merely preferred embodiments of the present invention and are not intended to limit the scope of the present invention. Various modifications and improvements made by those skilled in the art to the technical solutions of the present invention without departing from the spirit of the present invention should fall within the protection scope defined by the claims of the present invention.

Claims

1. An aviation virtual-real joint platform construction system based on digital twinning, characterized in that: It comprises a virtual model building module, a physical property simulation and rule setting module, a platform visualization module, a virtual mapping module, a running state monitoring model building module, a performance evaluation module, a state prediction module and a maintenance report generation module; The virtual model building module is used for establishing a virtual model of an aviation aircraft in 3ds Max and inputting the virtual model into Unity3D, and comprises a data collection unit, a model shape construction unit, an initial aircraft model structure construction unit, an aircraft material selection unit, a model input unit and an aviation environment simulation unit, the data collection unit is used for collecting aviation aircraft drawings and parameter data; the model shape construction unit is used for creating a basic shape of a model by using a basic geometric body tool in 3ds Max according to parameter data in an aircraft drawing; the initial aircraft model structure construction unit is used for adjusting the model based on an aircraft drawing by using an editing tool in 3ds Max on the basis of a basic geometric body to construct an initial aircraft model structure; the aircraft material selection unit is used for creating materials corresponding to each component of the aircraft by using a material editor in 3ds Max and applying the materials; the model input unit is used for exporting the initial aircraft model structure created in 3ds Max into an FBX format and importing the initial aircraft model structure into Unity3D; and the aviation environment simulation unit is used for setting a scene in Unity3D to simulate a real aviation environment, the scene comprising a sky box, a ground, a background and environmental elements, a sky background is simulated by using a Skybox material of Unity; a terrain object is created by selecting a Terrain component under 3D Object in a Hierarchy panel to generate a default terrain model, and the terrain model is edited according to requirements by using the Terrain component; a directional light is created to simulate sunlight, and a position of the directional light is adjusted to simulate different time lighting effects; The physical property simulation and rule setting module is used for simulating physical properties and rules of an aviation aircraft by using Unity3D to realize embodiment of a physical entity in a virtual environment; specifically, the physical property simulation and rule setting module comprises gravity setting, physical material setting and camera system setting, the gravity setting specifically comprises modifying physical settings of a project to adjust global gravity in a Unity editor; the physical material setting specifically comprises defining a physical material by using a Physics Material, the physical material comprises dynamic friction, static friction and elastic force properties; a parameter range of the dynamic friction is set to be between 0 and 1, a parameter range of the static friction is set to be between 0 and 1, and a parameter range of the elastic force property is set to be between 0.1 and 0.2; The camera system comprises an anthropomorphic prefab for controlling a forward direction and a main camera; The platform visualization module is used for building a visualization page of a twin platform; The virtual mapping module is used for binding and debugging interaction and mapping relationships of each aviation aircraft component, designing an interaction function and realizing virtual mapping. ​ The operation state monitoring model construction module is configured to collect multi-source data of a component to be predicted, train a model based on an Informer model, and predict the operation state of the component. The performance evaluation module is configured to evaluate the performance of the training result of the prediction model. The state prediction module is configured to save the prediction model, compile a dynamic link library, and call the dynamic link library to predict the state of the aircraft when a fault occurs. The maintenance report generation module is configured to automatically generate a guidance maintenance report after the state prediction is completed, and the guidance maintenance report can clearly mark the specific area where the fault occurs by combining the 3D components of the aircraft.

2. The digital-twin-based aerial cyber-physical joint platform construction system according to claim 1, characterized in that: The platform visualization module creates UI components in Unity3D to display data and implement user interaction. The UI components are Text or Button, and the preset visualization interface is obtained by adjusting the position, size, and style of the UI elements.

3. The digital-twin-based aerial cyber-physical joint platform construction system according to claim 1, characterized in that: The virtual mapping module controls the behavior and interaction logic of the UI components in Unity3D through C# scripts. First, create and configure the UI components in the Unity editor. Then, create a C# script file and define public methods to update the content of the UI components. Next, attach the script to the aircraft component object containing the UI components and set the public fields of the script in the Inspector panel to ensure that the script can correctly reference the UI components. Finally, run and test the script to verify its functionality and ensure that the UI components respond to interactions as expected.

4. The digital-twin-based aerial cyber-physical joint platform construction system according to claim 1, characterized in that: The operation state monitoring model construction module uses the Informer model to predict the signals of the component to be predicted and diagnose the prediction results. The Informer model includes an encoder and a decoder. The encoder is used to extract features from the input historical time series data, and the decoder is used to map the high-dimensional features generated by the encoder to the target time series to generate future time series predictions.

5. The digital-twin-based aerial cyber-physical joint platform construction system according to claim 1, characterized in that: The performance evaluation module can evaluate the accuracy of the prediction result through the prediction evaluation index, and the performance evaluation module adopts mean absolute error MAE, root mean square error RMSE and determination coefficient R 2 to assess the accuracy of the prediction result. The mean absolute error (MAE) measures the size of the error by calculating the average of the absolute values of the differences between the predicted values and the actual observed values. The calculation formula of MAE is as follows: where y i is the i-th observation, is the mean of all observations, f(x i ) is the model prediction for the i-th observation, and m is the time series length. The root mean square error (RMSE) is the standard deviation of the differences between the observed values and the model predicted values. The calculation formula of RMSE is as follows: R 2 The R value is the ratio between the actual observation value that the model can explain and the total observation value. 2 The value of R is determined by three parameters, SSR, SST and SSE, SSR is the sum of squares of the difference between the predicted data and the mean of the true data, SST is the sum of squares of the difference between the true data and its mean, SSE is the sum of squares of the difference between the true data and the predicted data, SST=SSR+SSE; the calculation formula of the three parameters SSR, SST and SSE is as follows: Determination coefficient R 2 The calculation formula is as follows: R 2 The closer the value is to 1, the better the model fits the data.

6. The digital-twin-based aerial cyber-physical joint platform construction system according to claim 5, characterized in that: The specific steps for generating a maintenance report are as follows: Create a fault annotation and add a red box or arrow at the fault location. When a component is predicted to have a fault, the annotation starts to flash. Define a template for the maintenance report, which includes fault description, maintenance steps, and precautions. Use the ScreenCapture.CaptureScreenshot method of Unity to capture the fault annotation view of the 3D model. Fill the operation state monitoring results, prediction results, and fault annotation view of the 3D model obtained from the state monitoring system into the maintenance report template. Use iTextSharp to integrate the filled maintenance report content and screenshots to generate a PDF format maintenance report.

7. An aviation virtual-real joint platform construction method based on the digital-twin-based aviation virtual-real joint platform construction system of claim 1, characterized in that: It includes the following steps: S1, create a virtual model of an aircraft in 3ds Max and input it into Unity3D; S2, the physical properties and laws possessed by the aircraft itself are simulated and set by using Unity3D, so as to realize the embodiment of physical entities in the virtual environment; S3, a visual page of the twin platform is built; S4, the interaction and mapping relationship of each aircraft component are bound and debugged, the interaction function is designed, and the virtual mapping is realized; S5, multi-source data of the component to be predicted is collected, the Informer model is relied on to train the model, and the running state of the component is predicted; S6, the performance of the training result of the prediction model is evaluated; S7, after saving the prediction model, a dynamic link library is written, and the dynamic link library is called to realize the state prediction of the aircraft when the platform fails; S8, after completing the state prediction, a guidance maintenance report is automatically generated, which can clearly mark the specific area where the fault occurs by combining the 3D components of the aircraft.

8. The method of claim 7, wherein: Step S1 specifically includes the following sub-steps: S11, collect the relevant drawings and data of the aircraft; S12, in 3ds Max, use basic geometric tools to create the basic shape of the model and adjust it, the basic shape of the model includes a cube, a sphere or a cylinder; S13, on the basis of the basic geometric body, use the editing tools in 3ds Max to modify and adjust the model, build the model structure, and the modification and adjustment include stretching, rotating and chamfering; S14, use the material editor in 3ds Max to create various different materials, and increase the details of the model through mapping and texture; S15, export the model created in 3ds Max as FBX format, and import it into Unity3D; S16, set the scene in Unity3D, simulate the real aviation environment, the scene includes the ground, the background and the environmental elements. 9.The method of claim 7, wherein: Step S2 specifically includes the following sub-steps: S21, gravity setting: in the Unity editor, adjust the global gravity by modifying the physical settings of the project, access through the following path: Edit→Project Settings→Physics find the Gravity setting, modify its value to adjust the global gravity effect, the initial value of gravity is-9.81; S22, physical material setting: define physical material through Physics Material, physical material includes dynamic friction, static friction and elastic force properties; S23, camera system: the camera system includes a humanoid prefab that controls the forward direction and a main camera, by placing the main camera on the top of the prefab and adjusting the angle accordingly to simulate the human eye view.

10. An aerial cyber-physical joint platform built by the method of claim 7. The aerial virtual-real combined platform comprises a perception transmission layer, a data layer, a service layer and an application layer. The perception transmission layer collects data through various sensors and transmits the data to the data layer through big data, Internet of Things and cloud services. The data layer comprises a static database, a dynamic database and a knowledge document. The static database comprises configuration information, historical data, business data and expert experience. The dynamic database comprises airborne monitoring data, airborne operation and maintenance data, integrated data and emergency data. The knowledge document comprises a fault dictionary, product technical instructions, diagnostic methods, guidelines, cases, maintenance manuals, regulations and cases. The service layer comprises a data storage unit, a reading unit, a visualization unit, a file download unit, a diagnosis unit, a prediction unit, a report generation unit, a data query unit, an information release unit, an update synchronization unit and an information browsing unit. Visualization management of the application layer is divided into PC end display, mobile end display and large screen display.

Images