Civil aircraft-oriented three-dimensional dynamic image creation system and method

Abstract

The invention relates to a civil aircraft-oriented three-dimensional dynamic image creation system and method.The system comprises a civil aircraft model management module, a time sequence data storage module, a dynamic image creation module and a man-machine interaction module, the association module is used for associating the position change time sequence data and the attitude change time sequence data of the civil aircraft and the parts in the civil aircraft in the time sequence data storage module with the position and the attitude of the three-dimensional model of the civil aircraft; and adjusting the coordinate positions and postures of the civil aircraft and each component in the civil aircraft at different moments according to the time sequence data during the operation of the civil aircraft, and generating a civil aircraft dynamic image. According to the civil aircraft-oriented three-dimensional dynamic image creation system and method, the user experience can be effectively guaranteed, the working efficiency of flight data analysis is improved, and the overall simulation effect is vivid.

Description

Technical Field

[0001] The present invention relates to the technical field of image creation, and in particular to a system and method for creating three-dimensional dynamic images for civil aircraft. Background Art

[0002] During the model development phase of civil aircraft (i.e., civil aircraft), flight test verification is a necessary step. In order to better obtain test data and test the performance of the aircraft, engineers often install various sensors on civil aircraft to collect various parameters of the civil aircraft test flight process, including but not limited to pitch angle, pressure altitude, flight speed, etc., for subsequent data analysis.

[0003] In the existing technology, the flight test data can be analyzed through the analysis algorithms of various performance, control and stability of civil aircraft to obtain various indicators and results of civil aircraft during flight. The results of this series of flight test data analysis also provide strong data support for the safety of civil aircraft.

[0004] However, due to the long sampling period of flight test data and the diversity of data frequency, the amount of flight test data is huge and very complex. It is not easy to directly analyze the status and trend of civil aircraft during flight test from the huge amount of data. Therefore, simply using analysis algorithms for data mining and using chart analysis methods to display data cannot intuitively reflect the changes in the flight attitude of civil aircraft, so there is a certain inconvenience. Summary of the invention

[0005] In view of the above-mentioned defects of the prior art, the present invention proposes a system and method for creating three-dimensional dynamic images for civil aircraft, which is easy to use, easy to operate, and can intuitively display the flight status of civil aircraft.

[0006] In order to achieve the above-mentioned purpose, the system and method for creating a 3D dynamic image for civil aircraft of the present invention are as follows:

[0007] In a first aspect, an embodiment of the present invention provides a 3D dynamic image creation system for civil aircraft, the main feature of which is that the system includes:

[0008] A civil aircraft model management module, used to manage a three-dimensional model of a civil aircraft, wherein the three-dimensional model of the civil aircraft includes shape features of various components of the civil aircraft and combination relationships between the various components;

[0009] A time series data storage module, used to store time series data of the civil aircraft during operation, wherein the time series data of the civil aircraft during operation includes time series data of position changes and time series data of attitude changes of the civil aircraft and its components;

[0010] The dynamic image creation module includes a civil aircraft image creation unit, wherein the civil aircraft image creation unit is used to associate the position change time series data and posture change time series data of the civil aircraft and its components in the time series data storage module with the position and posture of the three-dimensional model of the civil aircraft, so as to adjust the coordinate position and posture of the civil aircraft and its components at different times according to the time series data when the civil aircraft is running, and generate a dynamic image of the civil aircraft;

[0011] The human-computer interaction module is used to display a three-dimensional civil aircraft dynamic image, wherein the three-dimensional civil aircraft dynamic image includes the civil aircraft dynamic image.

[0012] In some embodiments, the dynamic image creation module further includes:

[0013] A flame image creation unit, used to create a flame image, and to associate the flame image with the relative position of a corresponding component in the civil aircraft, so that the flame image adjusts the corresponding coordinate position at different times to produce a flame dynamic image;

[0014] A scene image creation unit, used to create a scene image, wherein the environment image includes images of the sky, clouds and sunlight;

[0015] The image generation unit is used to combine the civil aircraft dynamic image, the flame dynamic image and the scene image to generate the three-dimensional civil aircraft dynamic image.

[0016] In some embodiments, the dynamic image creation module includes three.js;

[0017] The three.js combines the civil aircraft dynamic image, the flame dynamic image and the scene image to generate the three-dimensional civil aircraft dynamic image.

[0018] In some embodiments, the system further comprises:

[0019] The dynamic image rendering module is used to respond to user needs, cyclically render the three-dimensional civil aircraft dynamic image, and obtain the rendered three-dimensional civil aircraft dynamic image.

[0020] In some embodiments, the system includes a user-end device and a server-end device, wherein the user-end device is communicatively connected to the server-end device;

[0021] The human-computer interaction module is located in the user terminal device, and the human-computer interaction module is also used to receive the three-dimensional model of the civil aircraft and the time series data of the civil aircraft during operation;

[0022] The civil aircraft model management module, time series data storage module, dynamic image creation module and dynamic image rendering module are located in the server-side device.

[0023] In a second aspect, an embodiment of the present invention further provides a method for creating a three-dimensional dynamic image for a civil aircraft, the method comprising:

[0024] Acquire a three-dimensional model of a civil aircraft, wherein the three-dimensional model of the civil aircraft includes shape characteristics of various components of the civil aircraft and combination relationships between the various components;

[0025] Acquire time series data of the civil aircraft during operation, wherein the time series data of the civil aircraft during operation includes time series data of position changes and time series data of attitude changes of the civil aircraft and each component in the civil aircraft;

[0026] Associating the time series data of the civil aircraft during operation with the position and posture of the three-dimensional model of the civil aircraft, and adjusting the coordinate position and posture of the civil aircraft and each component of the civil aircraft at different times according to the time series data of the civil aircraft during operation to generate a dynamic image of the civil aircraft;

[0027] A three-dimensional civil aircraft dynamic image is displayed, wherein the three-dimensional civil aircraft dynamic image includes the civil aircraft dynamic image.

[0028] In some embodiments, the method further comprises:

[0029] Creating a flame image, and associating the flame image with the relative position of a corresponding component in the civil aircraft, so that the flame image adjusts the corresponding coordinate position at different times to produce a flame dynamic image;

[0030] Creating a scene image, wherein the environment image includes images of the sky, clouds and sunlight;

[0031] The civil aircraft dynamic image, the flame dynamic image and the scene image are combined so that the flame dynamic image and the scene image are displayed on the same display interface as the civil aircraft dynamic image.

[0032] In some embodiments, the method further comprises:

[0033] In response to user needs, the three-dimensional civil aircraft dynamic image is cyclically rendered to obtain a rendered three-dimensional civil aircraft dynamic image.

[0034] In a third aspect, an embodiment of the present invention further provides a three-dimensional dynamic image creation device for civil aircraft, comprising: at least one processor; a memory coupled to the at least one processor, the memory storing executable instructions, wherein the executable instructions, when executed by the at least one processor, implement any method described in the second aspect above.

[0035] In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the method described in any one of the second aspects above is implemented.

[0036] The beneficial effects of the system and method for creating 3D dynamic images for civil aircraft of the present invention are as follows:

[0037] The three-dimensional dynamic image creation system and method for civil aircraft associates each part of the civil aircraft model with the time series data of the civil aircraft during operation, and then generates the corresponding civil aircraft dynamic image, so that users can more intuitively understand the attitude changes of the civil aircraft in flight, which is convenient for technicians to better analyze the flight status of the aircraft. Since the technical solution associates the position change time series data and attitude change time series data of the civil aircraft and each component in the civil aircraft in the time series data storage module with the position and attitude of the three-dimensional model of the civil aircraft, when the user builds the three-dimensional model of the civil aircraft and inputs the corresponding time series data of the civil aircraft during operation into the system, the three-dimensional dynamic image can be produced very conveniently without too many complicated operations, and the operation is very convenient.

[0038] The 3D dynamic image creation system and method for civil aircraft can effectively guarantee user experience, improve the efficiency of flight data analysis, and provide realistic overall simulation effects. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] The concept, specific structure and technical effects of the present invention will be further described below in conjunction with the accompanying drawings to fully understand the purpose, characteristics and effects of the present invention.

[0040] Figure 1 It is a tree structure relationship diagram of a three-dimensional model of a civil aircraft in one embodiment.

[0041] Figure 2 It is a schematic diagram of a three-dimensional model of a civil aircraft in a grid and three-dimensional coordinate axes in one embodiment.

[0042] Figure 3 It is an architectural relationship diagram of a 3D dynamic image creation system for civil aircraft according to an embodiment of the present invention.

[0043] Figure 4 This is a flow chart of a civil aircraft dynamic image creation system for civil aircraft according to an embodiment of the present invention for creating a three-dimensional civil aircraft dynamic image.

[0044] Figure 5 It is a flowchart of flight test data management of a three-dimensional dynamic image creation system for civil aircraft of the present invention in one embodiment.

[0045] Figure 6It is a combination of screenshots of a 3D dynamic image of a civil aircraft at four different moments displayed by a 3D dynamic image creation system for civil aircraft of the present invention in one embodiment.

[0046] Figure 7 is a schematic diagram of an interpolation method in one embodiment. DETAILED DESCRIPTION

[0047] In order to make the technical means, creative features, objectives and effects of the invention easier to understand, the invention is further described below with reference to specific diagrams. However, the invention is not limited to the following implementation cases.

[0048] It should be noted that the structures, proportions, sizes, etc. illustrated in the drawings in this specification are only used to match the contents disclosed in the specification so as to facilitate understanding and reading by persons familiar with this technology. They are not used to limit the conditions under which the present invention can be implemented, and therefore have no substantive technical significance. Any structural modification, change in proportion or adjustment of size, without affecting the effects and purposes that can be achieved by the present invention, should still fall within the scope of the technical contents disclosed by the present invention.

[0049] In order to analyze the flight data of civil aircraft more intuitively, simple chart data can no longer intuitively reflect the flight status of the aircraft. Therefore, it is necessary to demonstrate the attitude information of the aircraft during flight through modeling.

[0050] The 3D dynamic demonstration in the aviation field has the following unique features:

[0051] (1) It is necessary to make a detailed model of the civil aircraft. Since the model structure of the civil aircraft is complex and precise, special attention should be paid to the internal and external details, material texture, etc. during modeling;

[0052] (2) It is necessary to accurately simulate the actual flight behavior, including the influence of aerodynamic effects, fluid effects, gravity and other physical factors;

[0053] (3) The interactive actions of a specific model need to be displayed smoothly;

[0054] (4) A high-performance, interactive real-time rendering environment is required to ensure the accuracy and smoothness of the civil aircraft's flight posture during the 3D dynamic demonstration.

[0055] However, there is no convenient way to generate civil aircraft flight images in the prior art. Therefore, if relevant images are to be obtained, additional analysis and production are required to generate relevant animated images, which is very inconvenient.

[0056] The three-dimensional dynamic image creation system and method for civil aircraft of the present invention provide a more operational technical solution, generate aircraft simulation three-dimensional images, assist in the analysis of test data of civil aircraft during flight, and improve the analysis efficiency.

[0057] In a first aspect, the present invention provides a three-dimensional dynamic image creation system for civil aircraft, the system comprising:

[0058] A civil aircraft model management module, used to manage a three-dimensional model of a civil aircraft, wherein the three-dimensional model of the civil aircraft includes shape features of various components of the civil aircraft and combination relationships between the various components;

[0059] A time series data storage module, used to store time series data of the civil aircraft during operation, wherein the time series data of the civil aircraft during operation includes time series data of position changes and attitude changes of the civil aircraft and its components, and the time series data storage module may be composed of a time series database;

[0060] A dynamic image creation module includes a civil aircraft image creation unit, a flame image creation unit, a scene image creation unit and an image generation unit; the civil aircraft image creation unit is used to associate the position change time series data and posture change time series data of the civil aircraft and each component in the civil aircraft in the time series data storage module with the position and posture of the three-dimensional model of the civil aircraft, so as to adjust the coordinate position and posture of the civil aircraft and each component in the civil aircraft at different times according to the time series data when the civil aircraft is running, and generate a civil aircraft dynamic image; the flame image creation unit is used to create a flame image, and is used to associate the flame image with the relative position of the corresponding component in the civil aircraft, so that the flame image adjusts the corresponding coordinate position at different times to produce a flame dynamic image; the scene image creation unit is used to create a scene image, and the environmental image includes images of the sky, clouds and sunlight; the image generation unit is used to combine the civil aircraft dynamic image, the flame dynamic image and the scene image to generate the three-dimensional civil aircraft dynamic image;

[0061] A dynamic image rendering module is used to respond to user needs, cyclically render a three-dimensional civil aircraft dynamic image, and obtain a rendered three-dimensional civil aircraft dynamic image;

[0062] The human-computer interaction module is used to display a three-dimensional civil aircraft dynamic image, which includes the civil aircraft dynamic image. Users can also input control instructions and related data information through the human-computer interaction module.

[0063] In this embodiment, the dynamic image creation module includes three.js, which is composed of a civil aircraft image creation unit, a flame image creation unit, a scene image creation unit and an image generation unit;

[0064] The three.js combines the civil aircraft dynamic image, the flame dynamic image and the scene image to generate the three-dimensional civil aircraft dynamic image.

[0065] In this embodiment, the system includes a user-end device and a server-end device, and the user-end device is communicatively connected with the server-end device;

[0066] The human-computer interaction module is located in the user terminal device, and the human-computer interaction module is also used to receive the three-dimensional model of the civil aircraft and the time series data of the civil aircraft during operation;

[0067] The civil aircraft model management module, time series data storage module, dynamic image creation module and dynamic image rendering module are located in the server-side device.

[0068] It should be noted that the modules and units mentioned in the present invention do not refer to physical hardware structures, and the related modules may be composed of one or more hardware structures, or may be composed of the same hardware structure.

[0069] Among them, the 3D model of a civil aircraft (i.e. a civil airplane) can be drawn and generated by CAD software (CAD software is software that uses computers and their graphic equipment to help designers perform design work). Due to the complex structure of a civil aircraft, the relative positions of various parts will change according to demand during the flight. Therefore, the 3D model of a civil aircraft must include the shape characteristics of each component in the civil aircraft and the combination relationship between the components. Generally speaking, from the outside, the components of a civil aircraft mainly include five major parts: fuselage, wings, tail, engine, and landing gear. Therefore, the generated 3D model of a civil aircraft can be used as follows: Figure 1 The tree structure shown (note that Figure 1 The generated 3D model of the civil aircraft can be found in Figure 2 As shown, it should be noted that the specific shape and combination relationship of the three-dimensional model can be drawn according to actual needs. In the actual image generation process, the position and attitude changes of the fuselage, wings, tail, engine, landing gear and other components can be adjusted through time series data.

[0070] In this embodiment, the position change time series data and attitude change time series data of the civil aircraft and each component in the civil aircraft in the time series data storage module are associated with the position and attitude of the three-dimensional model of the civil aircraft, so as to adjust the coordinate position and attitude of the civil aircraft and each component in the civil aircraft at different times according to the time series data when the civil aircraft is running, and generate a dynamic image of the civil aircraft. This form of association can conveniently use the time series data to adjust the dynamic changes of each frame of the civil aircraft, and the user can no longer perform complex operations. The dynamic changes of the three-dimensional model of the civil aircraft can be adjusted by obtaining the test data at different time points in the time series database, and a three-dimensional civil aircraft dynamic image can be generated, which effectively guarantees the user experience and improves the work efficiency of the analysis of flight data. At the same time, in this embodiment, by setting the flame image creation unit and the scene image creation unit, the picture can be made more realistic, and the dynamic image rendering module is used to render the three-dimensional civil aircraft dynamic image, which can effectively improve the smoothness of the picture and make the overall simulation effect more realistic.

[0071] The following further describes the civil aircraft-oriented 3D dynamic image creation system in this embodiment in conjunction with a specific application example:

[0072] The three-dimensional dynamic demonstration method in this embodiment uses Three.js. Three.js is a powerful library for Web three-dimensional development (wherein, web (World Wide Web) is the global wide area network, also known as the World Wide Web, which is a global, dynamically interactive, cross-platform distributed graphics information system based on hypertext and HTTP (i.e. Hypertext Transfer Protocol, Hypertext Transfer Protocol, HTTP is a simple request-response protocol).), its bottom layer is based on WebGL (WebGL is written as Web Graphics Library, which is a 3D drawing protocol), WebGL can render high-performance interactive three-dimensional graphics in a Web browser. Three.js encapsulates WebGL, allowing users to easily create objects, textures, three-dimensional calculations and other operations, so it has better ease of use. Compared with the above-mentioned three existing solutions, the three-dimensional dynamic demonstration solution based on Three.js on the Web side has unique advantages such as lightweight hardware requirements, highly flexible architecture, and support for cross-platform and cross-device use.

[0073] like Figure 3 As shown, Figure 3The overall design architecture of the 3D dynamic image creation system for civil aircraft is shown. First, to realize the dynamic simulation of the flight attitude of civil aircraft, it is necessary to prepare the 3D model of civil aircraft and the test flight sampling data of civil aircraft. The test flight sampling data includes parameters such as flight speed, altitude, coordinates, pitch angle, yaw angle, roll angle, etc. The 3D model of civil aircraft can be made by CAD software such as Catia and Solidworks. Then, the driver engine provided by Three.js is used to realize the scene update, flight attitude control, special effect adjustment and other functions in the 3D dynamic demonstration.

[0074] Three-dimensional applications developed based on Three.js must include three major components, namely, scenes, cameras, and renderers. Among them, the scene is a container that carries all objects, and there is only one and only one. The camera defines the projection method from three-dimensional space to two-dimensional space, including orthogonal projection and perspective projection. The role of the renderer is to render the picture taken by the camera in the browser. Specifically, in the three-dimensional dynamic demonstration method of civil aircraft flight attitude, first, a scene must be created, and objects such as the sky and civil aircraft must be added to the scene. Then, by obtaining parameters such as pitch angle, yaw angle, and roll angle in the test flight data, the attitude of the civil aircraft is adjusted (that is, the coordinate position and attitude of the civil aircraft and each component in the civil aircraft at different times are adjusted according to the timing data of the civil aircraft during operation). In order to have a more realistic effect, it is also necessary to dynamically update the scene and add some features according to the flight speed of the civil aircraft, such as the tail flame special effect of the civil aircraft (i.e., flame image), etc. The flame can be associated with the position of a certain component (such as the engine) in the civil aircraft, so that when the position of the civil aircraft changes, the flame can change together.

[0075] Figure 4 This is a flow chart of a civil aircraft dynamic image creation system of the present invention in one embodiment for creating a 3D civil aircraft dynamic image. Figure 4 How the 3D dynamic image creation system for civil aircraft creates dynamic images of civil aircraft is further explained:

[0076] The dynamic demonstration method refers to dynamically adjusting the attitude according to the time series data sampled during the test flight, which requires a certain degree of automation. When the civil aircraft test flight files are too large, they can be stored and accessed through the time series database, which can provide a better user experience.

[0077] The test flight data is the time series data during the test flight, which consists of the pitch angle, yaw angle, roll angle, speed, altitude, and coordinates, which are the time series data of the position change and attitude change of the civil aircraft and its components. The renderer, scene, and camera are all components in three3.js. The user can adjust the angle of the aircraft observed on the screen by adjusting the position of the camera.

[0078] The three-dimensional dynamic demonstration process of the civil aircraft flight attitude in the present invention is as follows:

[0079] S1: Use CAD software to draw a three-dimensional model of a civil aircraft, including five major parts such as fuselage, wings, tail, engine, and landing gear, and export the model file in GLTF format (in other embodiments, files in other formats may also be used for subsequent processing, but this is not limited to this, and is only used as an example for illustration).

[0080] S2: Introduce Three.js, use Three.js to create the three major components of scene, renderer, and camera, and initialize them.

[0081] S3: Use GLTFLoader to import the civil aircraft model, and create reference elements such as grids and 3D coordinate axes. Use the center point as the origin of the 3D coordinate axes and adjust the center point of the civil aircraft model to the origin of the 3D coordinate axes. GLTFLoader is a tool for loading and parsing 3D model files in GLTF format. The main function of the grid and 3D coordinate axes in this step is to confirm the position and size of the civil aircraft. For related status, please refer to Figure 2 shown.

[0082] S4: Add elements such as the sky, white clouds, ambient light, spotlights, and tail flames from the engines of civil aircraft to the scene.

[0083] S5: Create a control panel for the demonstration and perform initialization operations. In this step, the functions of the control panel include perspective switching, flight parameter selection, and start and stop demonstration function buttons. Perspective switching includes switching between perspective projection and orthographic projection, flight parameters include pitch angle, yaw angle, roll angle, etc., and active parts include ailerons, elevators, rudders, flaps, slats, spoilers, etc. Among them, the control panel can be constructed using Three.js.

[0084] S6: According to the test flight information, connect to the time series database server to obtain the test flight data of the specified time period, extract the pitch angle, yaw angle, roll angle and other parameters to adjust the flight attitude of the civil aircraft, extract the tail angle, flap angle, landing gear status and other parameters to adjust the movement of the civil aircraft, extract the flight speed, altitude, GPS coordinate information, etc. to update the scene view.

[0085] In this step, the corresponding test flight data needs to be obtained based on parameters such as time. The test flight data transmission process can be found in Figure 5As shown, first, various test flight data files are uploaded to IoTDB (i.e., time series database) and MINIO (MinIO is an object storage service based on the Apache License v2.0 open source protocol) is used to store offline data. MySQL (MySQL is a relational database management system) is used at the data management level and encapsulated into an API (i.e., Application Programming Interface) for data reading. In this step, the civil aircraft should have different postures at different stages of the test flight, which are mainly controlled by the pitch angle, yaw angle, and roll angle. Specifically, the roll angle a, yaw angle b, and pitch angle c of the civil aircraft at this moment are obtained, and then the civil aircraft model is rotated as a whole, that is, the civil aircraft model object E is specified, and its rotation attribute rotate is set to (a, b, c). The specific flight posture effect in the three-dimensional dynamic demonstration is as follows. Figure 6 At the same time, the civil aircraft 3D model also has movable parts, including ailerons, elevators, rudders, flaps, slats, spoilers, etc. The civil aircraft parts are adjusted accordingly based on the data in the test flight data package. Specifically, the civil aircraft model contains multiple parts, and the model objects can generally be represented by a tree structure. The relationship between them can be found in Figure 1 shown.

[0086] There are generally two types of control over the movable parts of civil aircraft. The first is by changing the position of the parts, and the second is by rotating the part model.

[0087] For the first type, take the landing gear control as an example. The general process is that after the civil aircraft model is loaded, the civil aircraft model tree is traversed to access the landing gear object E1. Then the landing gear descent height h at that moment is obtained from the database. Finally, according to the overall posture of the civil aircraft, the local position of the landing gear is calculated, and the global position is obtained through the MatrixWorld.multiplyVector3 method and updated.

[0088] For the second type, take the flap as the state is updated as an example. The general process is that after the civil aircraft model is loaded, the civil aircraft model tree is traversed to access the flap object E2. Then the local rotation angle f of the flap at that moment is obtained from the database. Finally, according to the overall posture of the civil aircraft, the global rotation angle F of the flap is calculated through getWorldDirection, and the E attribute rotation is assigned to, where the getWorldDirection method is used to obtain the viewing direction vector of the camera in the world coordinate system in three.js.

[0089] In addition, when animating the flight of a civil aircraft, environmental effects such as sunlight, clouds, and air will be updated according to factors such as flight speed, altitude, and time to make the animation more realistic. Specifically, it includes three steps. The first step is to load environmental elements such as skyboxes and clouds. The creation of the skybox sets multiple stickers in the front, back, left, right, top, and bottom. The creation of the cloud layer uses THREE.SphereGeometry to create the cloud layer geometry, and uses THREE.MeshStandardMaterial to create a transparent cloud layer material, and randomly generates multiple ones to add to the scene. The second step is to set the flight path according to the flight altitude, speed, and time, and to set it according to the data in the test flight data package. The third step is to update the sunlight intensity, cloud position, air transparency, etc. according to the position and status of the civil aircraft.

[0090] THREE.SphereGeometry is a geometry class in Three.js, which is used to create the cloud layer in this embodiment.

[0091] S7: Set the rendering interval to 10ms, loop the rendering of the aircraft's flight posture and scene changes within this time period, and update the lighting, special effects and other element effects.

[0092] In specific implementation, the rendering interval can be set to 10ms by default, or you can customize the rendering interval through the control panel, generally 20ms, 30ms, 50ms, etc. Due to the different sampling frequencies of the test flight data, the original data and the 3D rendered animation are out of sync. In this technical solution, data interpolation and synchronization strategies are used to ensure visual fluency. For example, a spline interpolation algorithm is used between two consecutive test flight data points to obtain additional data points, and then the interpolated data is synchronized to the Three.js animation for rendering. The interpolation method can be found in Figure 7 shown.

[0093] In this embodiment, a complete production pipeline is provided for automatically generating a three-dimensional dynamic demonstration animation of the flight attitude of a civil aircraft. First, the civil aircraft is modeled in detail using CAD software, and then the test flight data of the civil aircraft is uploaded to a time series database with low latency and high throughput reading and writing support. According to the test flight time selected by the user, a physical three-dimensional rendering engine based on Three.js is used to generate a three-dimensional dynamic demonstration animation that supports the display of the civil aircraft attitude, the movement of the mechanical parts of the civil aircraft, the switching of environmental special effects such as the sky, and the physical characteristics such as aerodynamics, fluid, and gravity.

[0094] The technical solution in this embodiment has the advantages of being lightweight and highly adaptable. Compared with other three-dimensional dynamic demonstration solutions, this technical solution uses the lightweight three-dimensional rendering engine Three.js, which not only ensures the effect of high-quality three-dimensional rendering, but also does not require high computing performance and storage performance of local devices. In addition, the three-dimensional dynamic demonstration method based on Three.js of the present invention is cross-platform, supporting both mobile devices and desktop devices. This clearly reflects the versatility of this method, which greatly reduces the adaptation cost of developers.

[0095] The technical solution of this embodiment has the characteristics of high automation and good consistency of demonstration effect. By acquiring various parameter time series data in the test flight file in segments, after a series of data processing, the flight attitude of the civil aircraft model will be automatically adjusted, and corresponding actions will be made for the movable parts. The above process is completely automated, and the effects of the civil aircraft's flight attitude, the adjustment of the movements of various parts of the civil aircraft, and environmental changes remain consistent, which not only improves the user experience, but also improves the work efficiency of analysis engineers.

[0096] The technical solution in this embodiment can be applied in the field of civil aviation, where it is crucial to model a fine three-dimensional model of a civil aircraft. In order to achieve a better simulation effect, it is necessary to model parts including ailerons, elevators, rudders, flaps, slats, spoilers, etc. in a targeted manner. At the same time, when making a three-dimensional dynamic demonstration, the three-dimensional rendering engine is effectively used to display the real state changes of the civil aircraft, and the flame image and scene image are set to achieve a more realistic simulation effect.

[0097] In this technical solution, in order to ensure the smoothness and continuity of the three-dimensional dynamic presentation, a spline interpolation algorithm is also used to fill in the missing data.

[0098] In a second aspect, the embodiment provides a method for creating a three-dimensional dynamic image for a civil aircraft, the method comprising:

[0099] Acquire a three-dimensional model of a civil aircraft, wherein the three-dimensional model of the civil aircraft includes shape characteristics of various components of the civil aircraft and combination relationships between the various components;

[0100] Acquire time series data of the civil aircraft during operation, wherein the time series data of the civil aircraft during operation includes time series data of position changes and time series data of attitude changes of the civil aircraft and each component in the civil aircraft;

[0101] Associating the time series data of the civil aircraft during operation with the position and posture of the three-dimensional model of the civil aircraft, and adjusting the coordinate position and posture of the civil aircraft and each component of the civil aircraft at different times according to the time series data of the civil aircraft during operation to generate a dynamic image of the civil aircraft;

[0102] Creating a flame image, and associating the flame image with the relative position of a corresponding component in the civil aircraft, so that the flame image adjusts the corresponding coordinate position at different times to produce a flame dynamic image;

[0103] Creating a scene image, wherein the environment image includes images of the sky, clouds and sunlight;

[0104] The civil aircraft dynamic image, the flame dynamic image and the scene image are combined so that the flame dynamic image and the scene image are displayed on the same display interface as the civil aircraft dynamic image;

[0105] In response to user needs, the three-dimensional civil aircraft dynamic image is cyclically rendered to obtain a rendered three-dimensional civil aircraft dynamic image. This rendering can be achieved through an interpolation algorithm.

[0106] Displays the rendered 3D dynamic image of a civil aircraft.

[0107] The three-dimensional dynamic image creation method for civil aircraft can also be implemented using the physical three-dimensional rendering engine of Three.js. Based on the physical three-dimensional rendering engine of Three.js, and by finely modeling the test flight process of civil aircraft, a three-dimensional dynamic demonstration animation that supports the display of civil aircraft posture, the movement of mechanical parts of civil aircraft, the switching of environmental special effects such as the sky, and supports physical properties such as aerodynamics, fluid, and gravity is generated. The three-dimensional dynamic demonstration method of the present invention can be easily integrated into existing Web applications, and has the characteristics of portability and cross-end use. This clearly reflects the versatility of this method, which greatly reduces the adaptation cost of developers. Through network access, the civil aircraft test flight data parameters are obtained in segments, which reduces the storage pressure of local devices and has lightweight characteristics. The method can automatically generate an interactive three-dimensional dynamic demonstration of the flight posture of civil aircraft based on the time period and specific parameters contained in the test flight data specified by the user. This method uses a spline interpolation algorithm to ensure the fluency and coherence of the three-dimensional demonstration.

[0108] In a third aspect, the present invention further provides a three-dimensional dynamic image creation device for civil aircraft, comprising:

[0109] At least one processor; a memory coupled to the at least one processor, the memory storing executable instructions, wherein the executable instructions, when executed by the at least one processor, implement the method of the second aspect of the present invention.

[0110] This embodiment provides a video processing device, including: at least one processor; and a memory coupled to the at least one processor. The processor and the memory may be provided separately or integrated together.

[0111] For example, the memory may include a random access memory, a flash memory, a read-only memory, a programmable read-only memory, a non-volatile memory or a register, etc. The processor may be a central processing unit (CPU), etc. or a graphic processing unit (GPU). The memory may store executable instructions. The processor may execute the executable instructions stored in the memory to implement the various processes described herein.

[0112] It can be understood that the memory in this embodiment can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories. Among them, the non-volatile memory can be a ROM (Read-Only Memory), a PROM (Programmable ROM), an EPROM (Erasable PROM), an EEPROM (Electrically EPROM), or a flash memory. The volatile memory can be a RAM (Random Access Memory), which is used as an external cache. By way of example but not limitation, many forms of RAM are available, such as SRAM (Static RAM), DRAM (Dynamic RAM), SDRAM (Synchronous DRAM), DDR SDRAM (Double Data Rate SDRAM), ESDRAM (Enhanced SDRAM), SLDRAM (Synchlink DRAM), and DRRAM (Direct Rambus RAM). The memories described herein are intended to include, but are not limited to, these and any other suitable types of memories.

[0113] In some embodiments, the memory stores the following elements, upgrade packages, executable units or data structures, or a subset thereof, or an extended set thereof: an operating system and an application program.

[0114] The operating system includes various system programs, such as a framework layer, a core library layer, a driver layer, etc., which are used to implement various basic services and process hardware-based tasks. The application program includes various application programs, which are used to implement various application services. The program for implementing the method of the embodiment of the present invention can be included in the application program.

[0115] In the embodiment of the present invention, the processor calls a program or instruction stored in the memory, specifically, a program or instruction stored in an application program, and the processor is used to execute the method steps provided in the second aspect.

[0116] In a fourth aspect, an embodiment of the present invention further provides a chip for executing the method in the second aspect. Specifically, the chip includes: a processor for calling and running a computer program from a memory, so that a device equipped with the chip is used to execute the method in the second aspect.

[0117] In addition, in a fifth aspect, the present invention further provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the method of the second aspect of the present invention are implemented.

[0118] For example, machine-readable storage media may include, but are not limited to, various known and unknown types of non-volatile memory.

[0119] In a sixth aspect, an embodiment of the present invention further provides a computer program product, comprising computer program instructions, which enable a computer to execute the method in the second aspect.

[0120] It will be appreciated by those skilled in the art that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0121] In the embodiments of the present application, the disclosed systems, devices and methods can be implemented in other ways. For example, the division of units is only a logical function division, and there can be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system. In addition, the coupling between the various units can be direct coupling or indirect coupling. In addition, the various functional units in the embodiments of the present application can be integrated into a processing unit, or can be separate physical existences, etc.

[0122] It should be understood that in the various embodiments of the present application, the size of the serial number of each process does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0123] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a machine-readable storage medium. Therefore, the technical solution of the present application can be embodied in the form of a software product, which can be stored in a machine-readable storage medium, which can include several instructions to enable an electronic device to perform all or part of the technical solution described in the embodiments of the present application. The above-mentioned storage medium may include various media that can store program codes, such as ROM, RAM, removable disk, hard disk, magnetic disk or optical disk.

[0124] The beneficial effects of the system and method for creating 3D dynamic images for civil aircraft of the present invention are as follows:

[0125] The three-dimensional dynamic image creation system and method for civil aircraft associates each part of the civil aircraft model with the time series data of the civil aircraft during operation, and then generates the corresponding civil aircraft dynamic image, so that users can more intuitively understand the attitude changes of the civil aircraft in flight, which is convenient for technicians to better analyze the flight status of the aircraft. Since the technical solution associates the position change time series data and attitude change time series data of the civil aircraft and each component in the civil aircraft in the time series data storage module with the position and attitude of the three-dimensional model of the civil aircraft, when the user builds the three-dimensional model of the civil aircraft and inputs the corresponding time series data of the civil aircraft during operation into the system, the three-dimensional dynamic image can be produced very conveniently without too many complicated operations, and the operation is very convenient.

[0126] The 3D dynamic image creation system and method for civil aircraft can effectively guarantee user experience, improve the efficiency of flight data analysis, and provide realistic overall simulation effects.

[0127] The preferred specific embodiments of the present invention are described in detail above. It should be understood that ordinary technicians in the field can make many modifications and changes based on the concept of the present invention without creative work. Therefore, all technical solutions that can be obtained by technicians in the technical field based on the concept of the present invention through logical analysis, reasoning or limited experiments on the basis of the prior art should be within the scope of protection determined by the claims.

Claims

1. A three-dimensional dynamic image creation system for civil aircraft, characterized in that: The system comprises: A civil aircraft model management module, used to manage a three-dimensional model of a civil aircraft, wherein the three-dimensional model of the civil aircraft includes shape features of various components of the civil aircraft and combination relationships between the various components; A time series data storage module, used to store time series data of the civil aircraft during operation, wherein the time series data of the civil aircraft during operation includes time series data of position changes and time series data of attitude changes of the civil aircraft and its components; The dynamic image creation module includes a civil aircraft image creation unit, wherein the civil aircraft image creation unit is used to associate the position change time series data and posture change time series data of the civil aircraft and its components in the time series data storage module with the position and posture of the three-dimensional model of the civil aircraft, so as to adjust the coordinate position and posture of the civil aircraft and its components at different times according to the time series data when the civil aircraft is running, and generate a dynamic image of the civil aircraft; The human-computer interaction module is used to display a three-dimensional civil aircraft dynamic image, wherein the three-dimensional civil aircraft dynamic image includes the civil aircraft dynamic image.

2. The three-dimensional dynamic image creation system for civil aircraft according to claim 1, characterized in that: The dynamic image creation module also includes: A flame image creation unit, used to create a flame image, and to associate the flame image with the relative position of a corresponding component in the civil aircraft, so that the flame image adjusts the corresponding coordinate position at different times to produce a flame dynamic image; A scene image creation unit, used to create a scene image, wherein the environment image includes images of the sky, clouds and sunlight; The image generation unit is used to combine the civil aircraft dynamic image, the flame dynamic image and the scene image to generate the three-dimensional civil aircraft dynamic image.

3. The three-dimensional dynamic image creation system for civil aircraft according to claim 2, characterized in that: The dynamic image creation module includes three.js; The three.js combines the civil aircraft dynamic image, the flame dynamic image and the scene image to generate the three-dimensional civil aircraft dynamic image.

4. The three-dimensional dynamic image creation system for civil aircraft according to claim 1, characterized in that: The system further comprises: The dynamic image rendering module is used to respond to user needs, cyclically render the three-dimensional civil aircraft dynamic image, and obtain the rendered three-dimensional civil aircraft dynamic image.

5. The three-dimensional dynamic image creation system for civil aircraft according to claim 4, characterized in that: The system includes a user-end device and a server-end device, wherein the user-end device is communicatively connected with the server-end device; The human-computer interaction module is located in the user terminal device, and the human-computer interaction module is also used to receive the three-dimensional model of the civil aircraft and the time series data of the civil aircraft during operation; The civil aircraft model management module, time series data storage module, dynamic image creation module and dynamic image rendering module are located in the server-side device.

6. A method for creating a three-dimensional dynamic image for a civil aircraft, characterized in that: The method comprises: Acquire a three-dimensional model of a civil aircraft, wherein the three-dimensional model of the civil aircraft includes shape characteristics of various components of the civil aircraft and combination relationships between the various components; Acquire time series data of the civil aircraft during operation, wherein the time series data of the civil aircraft during operation includes time series data of position changes and time series data of attitude changes of the civil aircraft and each component in the civil aircraft; Associating the time series data of the civil aircraft during operation with the position and posture of the three-dimensional model of the civil aircraft, and adjusting the coordinate position and posture of the civil aircraft and each component of the civil aircraft at different times according to the time series data of the civil aircraft during operation to generate a dynamic image of the civil aircraft; A three-dimensional civil aircraft dynamic image is displayed, wherein the three-dimensional civil aircraft dynamic image includes the civil aircraft dynamic image.

7. The method for creating a 3D dynamic image for civil aircraft according to claim 6, characterized in that: The method further comprises: Creating a flame image, and associating the flame image with the relative position of a corresponding component in the civil aircraft, so that the flame image adjusts the corresponding coordinate position at different times to produce a flame dynamic image; Creating a scene image, wherein the environment image includes images of the sky, clouds and sunlight; The civil aircraft dynamic image, the flame dynamic image and the scene image are combined so that the flame dynamic image and the scene image are displayed on the same display interface as the civil aircraft dynamic image.

8. The method for creating a 3D dynamic image for civil aircraft according to claim 6, characterized in that: The method further comprises: In response to user needs, the three-dimensional civil aircraft dynamic image is cyclically rendered to obtain a rendered three-dimensional civil aircraft dynamic image.

9. A three-dimensional dynamic image creation device for civil aircraft, comprising: at least one processor; A memory coupled to the at least one processor, the memory storing executable instructions, wherein the executable instructions, when executed by the at least one processor, enable the method according to any one of claims 6 to 8 to be implemented.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the method as described in any one of claims 6 to 8 are implemented.

Images