A portable integrated flight simulation training system and equipment

Abstract

The present application relates to the field of aircraft simulation training, and in particular to a portable integrated flight simulation training system and equipment. The system includes: a control module, configured to obtain first operation data; a main display module, configured to: intercept a first layer sequence in a visual layer sequence, and intercept a second layer sequence in a head-up display layer sequence; input the first operation data, the first layer sequence, and the second layer sequence into an AI prediction model, so that the AI ​​prediction model modifies and expands the first layer sequence layer by layer based on the first operation data to obtain a third layer sequence, and modifies and expands the second layer sequence layer by layer based on the first operation data to obtain a fourth layer sequence; superimposes the third layer sequence and the fourth layer sequence layer by layer to obtain a new main display frame sequence; and displays the new main display frame sequence after displaying the first key frame. In this way, a simulation training system with high integration, high real-time performance, and high fluency can be achieved.

Description

Technical Field

[0001] The present application relates to the field of aircraft simulation training, and in particular to a portable integrated flight simulation training system and equipment. Background Art

[0002] Aircraft, also known as aircraft, are vehicles or equipment capable of flying, typically used for various purposes, including transportation, scientific research, and military operations. With the demands of modern military training and technological advancements, modern military operations are gradually shifting towards air and information-based warfare, and aircraft are playing an increasingly important role in warfare. To enhance pilots' combat capabilities and reduce training costs and risks, air combat simulation training has become crucial for improving the combat capabilities of pilots and related personnel, making simulation training systems particularly important.

[0003] Virtual cockpit human-machine interface simulation systems are currently a common simulation training system. However, their bulky hardware and low integration make them unsuitable for use in mobile scenarios or in confined environments (e.g., onboard ships, at test sites, or in other field environments).

[0004] It can be seen that under the conditions of an informationized battlefield, air confrontation simulation training faces the problem of lacking a highly integrated, effective and portable simulation system. Summary of the Invention

[0005] The embodiments of the present application provide a portable integrated flight simulation training system and equipment to solve the problem faced by air confrontation simulation training in terms of the lack of a highly integrated, effective and portable simulation system.

[0006] In a first aspect, a portable integrated flight simulation training system is applied to a first electronic device, the system comprising: a main display module, configured to: display a main display frame sequence; wherein the main display frame sequence is obtained by superimposing a visual layer sequence and a head-up display layer sequence layer by layer, the visual layer sequence comprises a plurality of continuous visual layers, the visual layers are used to represent the external visual scenes during the simulated flight process, the head-up display layer sequence comprises a plurality of continuous head-up display layers, the head-up display layers include at least the first flight parameters and / or navigation information during the simulated flight process; a control module, configured to: obtain first operation data in response to a first user operation, the first operation data including flight attitude operation data and / or flight power operation data; the main display module is further configured to: determine a first key frame in response to the first user operation, the first key frame being the currently displayed key frame in the currently displayed main display frame sequence The Mth frame after the frame, M is a preset value; and, a preset length of the visual layer is intercepted in the visual layer sequence to obtain a first layer sequence, and a preset length of the head-up display layer is intercepted in the head-up display layer sequence to obtain a second layer sequence; wherein the starting layer of the first layer sequence and the second layer sequence is a layer for generating a first key frame; and, the first operation data, the first layer sequence and the second layer sequence are input into the AI ​​prediction model, so that the AI ​​prediction model modifies and expands the first layer sequence layer by layer based on the first operation data to obtain a third layer sequence, and, based on the first operation data, modifies and expands the second layer sequence layer by layer to obtain a fourth layer sequence; and, superimposes the third layer sequence and the fourth layer sequence layer by layer to obtain a new main display frame sequence; and, displays the new main display frame sequence after displaying the first key frame.

[0007] In one possible implementation, the system further includes: a visual display module configured to: generate a visual layer sequence based on display configuration information in response to a second user operation; wherein the second user operation is initiated by the user before the first user operation, and the second user operation is used to indicate display configuration information, and the display configuration information includes flight simulation scene information, initial flight attitude information, visual rendering parameters and / or meteorological environment information; a head-up display module configured to: generate a head-up display layer sequence based on the display configuration information in response to the second user operation; and the main display module is further configured to: based on layer priority, superimpose the visual layer sequence and the head-up display layer sequence layer by layer to obtain a main display frame sequence, wherein the layer priority of the head-up display layer is higher than the layer priority of the visual layer.

[0008] In one possible implementation, the system also includes: a lower display module, configured to: determine second flight parameters and radar information during the simulated flight process based on the first operating data; and generate a lower display layer sequence based on the second flight parameters and the radar information, wherein the lower display layer sequence includes at least one lower display layer; a secondary display module, configured to: generate a lower display frame based on the lower display layer sequence to obtain a lower display frame sequence; and display the lower display frame sequence.

[0009] In one possible implementation, the system includes: an AI interaction module, configured to: determine a second key frame, where the second key frame is a random frame after the first key frame in the currently displayed main display frame sequence; and input the target view layer corresponding to the second key frame in the third layer sequence into the AI ​​prediction model, so that the AI ​​prediction model adds a target element to the target view layer, and performs layer expansion on the added target view layer to obtain a fifth layer sequence; wherein the number of layers in the fifth layer sequence is equal to the number of layers after the target head-up display layer corresponding to the second key frame in the fourth layer sequence; the main display module is further configured to: superimpose the fifth layer sequence with the layers after the target head-up display layer in the fourth layer sequence layer by layer to obtain a new main display frame sequence; and display the new main display frame sequence after displaying the second key frame.

[0010] In one possible implementation, the AI ​​interaction module is further configured to: determine a third key frame and a target lower display layer; wherein the third key frame is a lower display frame in a lower display frame sequence, and the third key frame corresponds to the second key frame in time sequence, and the target lower display layer is the lower display layer corresponding to the third key frame in the lower display layer sequence; and, input the fifth layer sequence and the target lower display layer into the AI ​​prediction model, so that the AI ​​prediction model modifies and expands the target lower display layer based on the fifth layer sequence to obtain a sixth layer sequence, and the number of layers in the sixth layer sequence is equal to that in the fifth layer sequence; the secondary display module is further configured to: superimpose the sixth layer sequence with the lower display layer after the target lower display layer in the lower display layer sequence layer by layer to obtain a new lower display frame sequence; and, display the new lower display frame sequence after displaying the third key frame.

[0011] In one possible implementation, the control module is further configured to: obtain second operation data in response to a third user operation; the second operation data includes flight attitude operation data, flight power operation data and / or confrontation data for target elements; the AI ​​interaction module is further configured to: determine a first key frame sequence and a second key frame sequence; wherein the first key frame sequence includes N frames after the fifth key frame in the currently displayed main display frame sequence, and the fifth key frame is the Pth frame after the currently displayed frame; the second key frame sequence includes N frames after the sixth key frame in the currently displayed lower display frame sequence, and the sixth key frame is the Pth frame after the currently displayed frame; N and P are preset values; and, the first key frame sequence, the second key frame sequence and the second operation data are input into the AI ​​prediction model, so that the AI ​​prediction model modifies and expands the first key frame sequence based on the second operation data to obtain a new first key frame sequence, and modifies and expands the second key frame sequence based on the second operation data to obtain a new second key frame sequence.

[0012] In one possible implementation, the main display module is further configured to: determine the fifth key frame, and display a new first key frame sequence after displaying the fifth key frame; the auxiliary display module is further configured to: determine the sixth key frame, and display a new second key frame sequence after displaying the sixth key frame.

[0013] In one possible implementation, the system also includes: a first communication module, configured to: send first terminal interaction data to a second communication module of at least one second electronic device at a preset frequency through a data distribution service DDS, and receive second terminal interaction data sent by the second communication module through DDS; the AI ​​interaction module is also configured to: input the second terminal interaction data into the AI ​​prediction model, so that the AI ​​prediction model generates a new main display frame sequence and a new lower display frame sequence based on the second terminal interaction data; the main display module is also configured to: display the new main display frame sequence; the auxiliary display module is also configured to: display the new lower display frame sequence.

[0014] In a second aspect, an embodiment of the present application also provides a portable integrated flight simulation training device, which includes: a main display, a joystick and at least one processor, and the at least one processor is communicatively connected to the main display and the joystick; the at least one processor is used to run the portable integrated flight simulation training system in the aforementioned first aspect and its various implementation methods.

[0015] In a third aspect, an embodiment of the present application further provides a flight simulation training method, the method comprising: displaying a main display frame sequence; wherein the main display frame sequence is obtained by superimposing a visual layer sequence and a head-up display layer sequence layer by layer, the visual layer sequence comprises a plurality of continuous visual layers, the visual layers are used to represent the external visual scenes during the simulated flight process, the head-up display layer sequence comprises a plurality of continuous head-up display layers, the head-up display layers include at least the first flight parameters and navigation information during the simulated flight process; in response to a first user operation, obtaining first operation data, the first operation data including flight attitude operation data and / or flight power operation data; in response to the first user operation, determining a first key frame, the first key frame being the Mth frame after the currently displayed frame in the currently displayed main display frame sequence, where M is a preset value; in A visual layer of a preset length is intercepted from the visual layer sequence to obtain a first layer sequence, and a head-up display layer of a preset length is intercepted from the head-up display layer sequence to obtain a second layer sequence; wherein the starting layer of the first layer sequence and the second layer sequence is a layer used to generate a first key frame; the first operation data, the first layer sequence, and the second layer sequence are input into the AI ​​prediction model, so that the AI ​​prediction model modifies and expands the first layer sequence layer by layer based on the first operation data to obtain a third layer sequence, and modifies and expands the second layer sequence layer by layer based on the first operation data to obtain a fourth layer sequence; the third layer sequence and the fourth layer sequence are superimposed layer by layer to obtain a new main display frame sequence; and the new main display frame sequence is displayed after the first key frame is displayed.

[0016] As can be seen from the above, an embodiment of the present application provides a portable integrated flight simulation training system and equipment, which includes: a control module configured to obtain first operation data; a main display module configured to: intercept a first layer sequence from a visual layer sequence and intercept a second layer sequence from a head-up display layer sequence; input the first operation data, the first layer sequence, and the second layer sequence into an AI prediction model, so that the AI ​​prediction model modifies and expands the first layer sequence layer by layer based on the first operation data to obtain a third layer sequence, and modifies and expands the second layer sequence layer by layer based on the first operation data to obtain a fourth layer sequence; superimposes the third layer sequence and the fourth layer sequence layer by layer to obtain a new main display frame sequence; and displays the new main display frame sequence after displaying the first key frame. In this way, a highly integrated, real-time, and smooth simulation training system can be achieved. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 A schematic diagram of the hardware structure of a portable integrated flight simulation training device provided in an embodiment of the present application;

[0018] Figure 2A first system architecture diagram of a portable integrated flight simulation training system provided in an embodiment of the present application;

[0019] Figure 3 A schematic diagram of the software structure of the portable integrated flight simulation training system provided in an embodiment of the present application;

[0020] Figure 4 This is a first operating sequence diagram of the portable integrated flight simulation training system provided in an embodiment of the present application;

[0021] Figure 5 A second operating sequence diagram of the portable integrated flight simulation training system provided in an embodiment of the present application;

[0022] Figure 6 This is a third operating sequence diagram of the portable integrated flight simulation training system provided in an embodiment of the present application;

[0023] Figure 7 This is the fourth operating sequence diagram of the portable integrated flight simulation training system provided in an embodiment of the present application;

[0024] Figure 8 A second system architecture diagram of the portable integrated flight simulation training system provided in an embodiment of the present application;

[0025] Figure 9 This is the fifth operating sequence diagram of the portable integrated flight simulation training system provided in an embodiment of the present application;

[0026] Figure 10 This is the sixth operating sequence diagram of the portable integrated flight simulation training system provided in an embodiment of the present application;

[0027] Figure 11 The seventh operating sequence diagram of the portable integrated flight simulation training system provided in an embodiment of the present application;

[0028] Figure 12 A flowchart of the portable integrated flight simulation training method provided in an embodiment of the present application. DETAILED DESCRIPTION

[0029] In order to enable those skilled in the art to better understand the technical solutions in this application, the technical solutions in the embodiments of this application will be clearly and completely described below in conjunction with the drawings in the embodiments of this application. Obviously, the described embodiments are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of this application.

[0030] In order to solve the problem of lack of a highly integrated, effective and portable simulation environment faced by air confrontation simulation training, the embodiment of the present application provides a portable integrated flight simulation training system and equipment, which has the characteristics of high integration and strong portability.

[0031] The portable integrated flight simulation training system and equipment provided in the embodiments of the present application are described in detail below with reference to the accompanying drawings.

[0032] Figure 1 Schematic diagram of the hardware structure of the portable integrated flight simulation training device provided in an embodiment of the present application.

[0033] like Figure 1 As shown, an embodiment of the present application provides a portable integrated flight simulation training device that can be used to operate a portable integrated flight simulation training system. The device includes a dual-screen notebook 101 and a joystick 102. The dual-screen notebook 101 integrates a main display 1011, a secondary display 1012, a keyboard 1013, and a touchpad 1014. The joystick 102 may include a first joystick 1021 and a second joystick 1022. The first joystick 1021, also known as the throttle lever, can be used to control the aircraft's throttle and radar during simulated flight. The second joystick 1022, also known as the flight joystick, can be used to control flight attitude and weapon operation during simulated flight. The first and second joysticks 1021, 1022 can be connected to the dual-screen notebook 101 via a Universal Serial Bus (USB), making them easily pluggable and easy to use.

[0034] In addition, the portable integrated flight simulation training equipment provided in the embodiment of the present application may also include at least one processor, which can be integrated in the dual-screen notebook 101. The processor is used to communicate with devices such as the main display 1011 and the joystick 102 to run the portable integrated flight simulation training system.

[0035] Figure 2 This is a first system architecture diagram of the portable integrated flight simulation training system provided in an embodiment of the present application.

[0036] like Figure 2 As shown, the portable integrated flight simulation training system provided by the embodiment of the present application can be divided into five layers from the bottom layer to the application layer.

[0037] ① Operation layer: includes throttle stick and flight control stick, providing user input interface.

[0038] ② Application layer: including master control, HUD, down display and terminal modules, responsible for core control and display functions.

[0039] ③Communication layer: supports Data Distribution Service (DDS) and USB communication to ensure efficient and stable data transmission.

[0040] ④Data layer: composed of simulation engine, used to generate and manage the data required for flight simulation.

[0041] ⑤ Bottom layer: Based on digital models, it provides the necessary data support and logical basis for the system.

[0042] The architecture is designed to create a highly integrated and portable flight simulation training environment suitable for the needs of modern flight simulation training.

[0043] Figure 3 A schematic diagram of the software structure of the portable integrated flight simulation training system provided in an embodiment of the present application.

[0044] Figure 4 This is the first operating sequence diagram of the portable integrated flight simulation training system provided in an embodiment of the present application.

[0045] like Figure 3 and Figure 4 As shown, the portable integrated flight simulation training system provided in embodiments of the present application can be applied to a first electronic device, such as the aforementioned portable integrated flight simulation training device. The system may include a main display module 201, a control module 202, a visual display module 203, a head-up display module 204, a lower display module 205, a secondary display module 206, an AI interaction module 207, and a first communication module 208.

[0046] The visual display module 203 is configured to generate a visual layer sequence based on the display configuration information in response to the second user operation. The visual layer sequence includes multiple continuous visual layers, and the visual layers are used to simulate the external visual scene during flight.

[0047] The second user operation may refer to a user inputting a command via keyboard 1013, or the second user operation may refer to a user performing touch interaction via touchpad 1014. The second user operation is used to indicate display configuration information, which includes flight simulation scene information, initial flight attitude information, visual rendering parameters, and / or weather environment information. Configuring flight simulation scene information may include flight scenes for different geographical environments, such as plain airspace, mountainous airspace, or maritime airspace. Configuring initial flight attitude information may include, for example, setting the aircraft's initial state to level flight, climb, or dive, as well as initial heading, altitude, and other parameters. Configuring visual rendering parameters may include configuring parameters such as frame rate and resolution. For example, the frame rate may be 30 frames per second, 60 frames per second, or 120 frames per second, though this embodiment of the present application does not specifically limit this. Configuring weather environment information may include, for example, setting different weather conditions, such as sunny, cloudy, rainstorm, lightning, fog, and haze. By accurately receiving and acting upon this information, the visual display module 203 can generate a continuous sequence of visual layers. It is understandable that the specific information included in the display configuration information is specified by the user.

[0048] In some implementations, the visual layer sequence may include 300 or 600 visual layers, which is not specifically limited in the embodiments of the present application.

[0049] It can be seen that the visual display module 203 provides external visual rendering, and by simulating the visual experience during flight, the trainee can obtain a flight experience close to the real one in the virtual environment.

[0050] The HUD module 204 is configured to generate a HUD layer sequence based on the display configuration information in response to the second user operation. The HUD layer sequence includes a plurality of consecutive HUD layers, each of which includes at least the first flight parameter and / or navigation information during the simulated flight.

[0051] The first flight parameters may include key parameters such as the aircraft's current speed, altitude, heading, pitch angle, and roll angle. The navigation information may include information such as the aircraft's current position, preset routes, waypoints, and the locations and distances of surrounding navigational facilities. The HUD module 204 displays these parameters in an intuitive manner within the pilot's forward field of view via a graphical interface.

[0052] In some implementations, the heads-up display layer sequence can include 300 or 600 heads-up display layers.

[0053] The main display module 201 is configured to: based on layer priority, superimpose the visual layer sequence and the head-up display layer sequence layer by layer to obtain a main display frame sequence, wherein the layer priority of the head-up display layer is higher than the layer priority of the visual layer.

[0054] In actual applications, the main display module 201 can output the main display frame sequence to the main display 1011 for display, so that the pilot can quickly and conveniently obtain flight status and navigation guidance while maintaining visual flight.

[0055] This ensures that the flight parameters and navigation information in the HUD layer are displayed over the visual layer, ensuring that pilots can clearly and unobstructedly obtain critical flight data while observing the external flight environment simulation. This display method not only improves the pilot's perception of flight status but is also crucial for making timely and accurate flight decisions.

[0056] The main display module 201 is configured to display a main display frame sequence, wherein the main display frame sequence is obtained by superimposing a visual layer sequence and a head-up display layer sequence layer by layer.

[0057] For further information, see Figure 4 The control module 202 is configured to: obtain first operation data in response to a first user operation, where the first operation data includes flight attitude operation data and / or flight power operation data.

[0058] The control module 202 may be a software module corresponding to the first operating lever 1021 and the second operating lever 1022. The first user operation occurs after the second user operation. The first user operation may be triggered by the user controlling the first operating lever 1021 and / or the second operating lever 1022 to control the simulated aircraft in real time. Examples of the first user operation include pushing or pulling the operating levers, pressing buttons, and the like. For example, if the user pushes the operating levers in level flight, the control module 202 may convert the pitch angle change into flight attitude operation data, and simultaneously convert the throttle change into flight power operation data.

[0059] The main display module 201 is further configured to: determine a first key frame in response to a first user operation, where the first key frame is the Mth frame after the currently displayed frame in the currently displayed main display frame sequence, where M is a preset value.

[0060] In some implementations, M may be equal to 5 frames, 10 frames, 20 frames, or 30 frames, which is not specifically limited in the embodiments of the present application.

[0061] In addition, the main display module 201 is further configured to: intercept a preset length of the visual layer in the visual layer sequence to obtain a first layer sequence, and intercept a preset length of the head-up display layer in the head-up display layer sequence to obtain a second layer sequence; wherein the starting layer of the first layer sequence and the second layer sequence is a layer used to generate a first key frame.

[0062] In some implementations, the preset length is, for example, 10 layers, 20 layers, or 50 layers, which is not specifically limited in the embodiments of the present application.

[0063] In addition, the main display module 201 is also configured to: input the first operation data, the first layer sequence and the second layer sequence into the AI ​​prediction model, so that the AI ​​prediction model modifies the first layer sequence layer by layer and expands the layer based on the first operation data to obtain a third layer sequence, and modifies the second layer sequence layer by layer and expands the layer based on the first operation data to obtain a fourth layer sequence.

[0064] Layer-by-layer modification refers to the AI ​​prediction model adjusting and optimizing each layer in the first and second layer sequences based on the first operation data. For example, if the first operation data indicates that the pilot has adjusted the flight attitude, the AI ​​prediction model can modify the aircraft's attitude parameters in the layer accordingly to better reflect the actual flight state. This modification is performed layer by layer to ensure that each layer accurately reflects the changes after the operation.

[0065] Layer extension refers to the AI ​​prediction model generating new layers based on the existing layer sequence (the first and second layers) to extend the layer sequence. Layer extension generates new layers based on analysis and prediction of the existing layer sequence to reflect possible future flight conditions. For example, the AI ​​prediction model can predict the subsequent flight path based on current flight trends and generate corresponding visual and flight parameter layers to provide visual and information support to the pilot.

[0066] In an embodiment of the present application, the AI ​​prediction model can be generated through multimodal data training. Specifically, the embodiment of the present application can collect spatiotemporally aligned data of pilot operating instructions and visual / instrument layer sequences to construct a dual-branch neural network architecture, comprising a visual branch (3D-CNN to analyze terrain / target dynamics) and an operational branch (LSTM to learn timing control). During the model training phase, the training objective can be to predict layer changes in future frames and inject adversarial samples to enhance battlefield emergency response capabilities. Ultimately, through knowledge distillation, compression, and deployment, millisecond-level situational analysis can be achieved on portable devices (e.g., generating missile avoidance scenarios 0.5 seconds in advance), solving the challenge of real-time simulation in dynamic environments.

[0067] Furthermore, the main display module 201 is further configured to: superimpose the third layer sequence and the fourth layer sequence layer by layer to obtain a new main display frame sequence; and display the new main display frame sequence after displaying the first key frame.

[0068] It can be understood that the layer priority of the fourth layer sequence is higher than the layer priority of the third layer sequence.

[0069] In this way, the portable integrated flight simulation training system provided by the present embodiment can dynamically generate and display frame sequences that meet the pilot's visual requirements based on user operations. Furthermore, the system provided by the present embodiment can miniaturize and reduce power consumption of core components such as the main display module 201, control module 202, and AI interaction module 207, and incorporate them into an all-in-one portable integrated flight simulation training device. This training device can feature a foldable high-definition display (dual-screen notebook 101) and pluggable joysticks (first joystick 1021 and second joystick 1022), enabling quick assembly and disassembly. The first communication module 208 can integrate Bluetooth, Wi-Fi, and DDS, enabling collaborative training without the need for complex external cables. Furthermore, the system utilizes a unified data bus architecture to enable efficient data exchange between modules. While ensuring performance, the system's overall size is kept within the dimensions of a portable backpack and weighs no more than 10 kilograms, making it easy for individual personnel to carry and quickly deploy. It is suitable for a variety of scenarios, including field training and mobile teaching.

[0070] Figure 5 This is the second operating sequence diagram of the portable integrated flight simulation training system provided in an embodiment of the present application.

[0071] like Figure 5 As shown, the lower display module 205 is configured to: determine the second flight parameter and radar information during the simulated flight based on the first operation data; and generate a lower display layer sequence based on the second flight parameter and radar information, wherein the lower display layer sequence includes at least one lower display layer, and the lower display layer includes the second flight parameter and radar information, etc.

[0072] Among them, the second flight parameters include, for example, engine parameters, fuel quantity, etc., and the radar information may include radar mapping data of the detected distance, direction, speed and terrain of surrounding targets, etc. The surrounding targets may be, for example, aircraft, flocks of birds, weather obstacles (such as thunderstorms, clouds, etc.) or ground facilities (such as buildings, airports, etc.).

[0073] The auxiliary display module 206 is configured to: generate a lower display frame based on the lower display layer sequence to obtain a lower display frame sequence; and display the lower display frame sequence.

[0074] In actual applications, the secondary display module 206 may output the lower display frame sequence to the secondary display 1012 for display.

[0075] In the embodiment of the present application, confrontation elements can be randomly added to make the simulation training more realistic and challenging.

[0076] Figure 6 This is the third operating sequence diagram of the portable integrated flight simulation training system provided in an embodiment of the present application.

[0077] Specifically, such as Figure 6 As shown, the AI ​​interaction module 207 is configured to: determine a second key frame, where the second key frame is a random frame after the first key frame in the currently displayed main display frame sequence.

[0078] Furthermore, the AI ​​interaction module 207 is configured to input the target visual layer corresponding to the second key frame in the third layer sequence into the AI ​​prediction model. It is understood that the target visual layer is one of the layers in the third layer sequence, and the target visual layer is the visual layer used for overlay generation of the second key frame.

[0079] Furthermore, after the target visual layer is input into the AI ​​prediction model, the AI ​​prediction model can add a target element to the target visual layer, and perform layer expansion on the added target visual layer to obtain a fifth layer sequence.

[0080] Specifically, the target element, also known as the counter-element, can be an enemy aircraft. The number of target elements is not limited to one and can be two or more. Layer expansion of the added target visual layer means that the AI ​​prediction model predicts the possible subsequent enemy aircraft movement path or counter-action process, and generates a series of new visual layers based on these predictions.

[0081] It is worth noting that the number of layers in the fifth layer sequence is equal to the number of layers following the target HUD layer corresponding to the second keyframe in the fourth layer sequence. This ensures the accuracy of layer-by-layer overlay.

[0082] Furthermore, the main display module 201 is also configured to: superimpose the fifth layer sequence and the layer after the target HUD layer in the fourth layer sequence layer by layer to obtain a new main display frame sequence; and display the new main display frame sequence after displaying the second key frame.

[0083] It is understood that when the new main display frame sequence is displayed on the main display 1011, the pilot can visually see the enemy aircraft and other confrontation elements appear in the window. In this way, after the user takes over the flight through the first user operation, the confrontation mode can be randomly activated to enhance the simulation realism.

[0084] Furthermore, the AI ​​interaction module 207 is also configured to: determine a third key frame and a target lower display layer; wherein the third key frame is a lower display frame in the lower display frame sequence, and the third key frame corresponds to the second key frame in time sequence, and the target lower display layer is the lower display layer corresponding to the third key frame in the lower display layer sequence.

[0085] In the embodiment of the present application, the AI ​​interaction module 207 can determine the third key frame corresponding to the second key frame through a timestamp alignment operation.

[0086] In addition, the AI ​​interaction module 207 is further configured to: input the fifth layer sequence and the target lower visible layer into the AI ​​prediction model, so that the AI ​​prediction model modifies and expands the target lower visible layer based on the fifth layer sequence to obtain a sixth layer sequence, and the number of layers in the sixth layer sequence is equal to that of the fifth layer sequence.

[0087] In practical applications, the AI ​​prediction model can convert the spatial coordinates (e.g., the longitude and latitude of the enemy aircraft) in the fifth layer sequence (including the newly added visual layer data for the enemy aircraft) into the parameter space of the underlying display layer (e.g., radar azimuth and range). For example, if the enemy aircraft is located 10 km northeast in the visual layer, this embodiment of the application can automatically map these coordinates to the 10 km scale point at a 30° azimuth in the underlying radar layer.

[0088] Furthermore, layer expansion refers to the process of extending the layer sequence over time. Based on the existing underlying layers, the AI ​​prediction model can predict changes in adversarial elements over a period of time and generate new layers to extend the layer sequence, resulting in a sixth layer sequence.

[0089] It is worth noting that the sixth layer sequence corresponds to the fifth layer sequence in time. The fifth layer sequence is used to display the radar information of the aircraft, etc., and the sixth layer sequence is used to display the radar information of the enemy aircraft, etc.

[0090] In some implementations, the fifth layer sequence and the sixth layer sequence may include 300 or 600 layers.

[0091] The auxiliary display module 206 is further configured to: superimpose the sixth layer sequence with the lower display layer following the target lower display layer in the lower display layer sequence layer by layer to obtain a new lower display frame sequence; and display the new lower display frame sequence after displaying the third key frame.

[0092] In this way, the new lower display frame sequence can include radar information, flight data, etc. of both the pilot's own aircraft and the enemy aircraft. When the new lower display frame sequence is displayed on the secondary display 1012, the pilot visually sees the enemy aircraft's radar information appear on the radar page (or combat situation page), thereby enhancing the simulation realism.

[0093] Furthermore, when an enemy aircraft or other element appears, the user can perform a third user operation to initiate an attack via the first operating stick 1021 and / or the second operating stick 1022. The first operating stick 1021 and / or the second operating stick 1022 may include interactive buttons such as a weapon launch button, a weapon switching button, and a chaff launch button. Furthermore, the first operating stick 1021 and / or the second operating stick 1022 may be equipped with high-precision position sensors and pressure sensors.

[0094] Continue to see Figure 6In this process, the control module 202 can be configured to: obtain second operation data in response to a third user operation; the second operation data includes flight attitude operation data, flight power operation data and / or confrontation data for target elements.

[0095] It's worth noting that the control module 202 monitors the displacement and rotation angle of the first and second operating levers 1021, 1022, as well as the magnitude and direction of the user's applied force, in real time. Whenever a user performs a third user operation, such as gently pushing the operating lever to change flight attitude or pressing the weapon launch button to initiate an attack, the sensor immediately captures the corresponding signal and converts it into precise digital information. The control module 202 then integrates this information into second operation data, which includes not only flight attitude and power adjustments but also specific commands for engaging targets, such as locking onto, tracking, and simulating attacks on enemy aircraft. This ensures a high degree of synchronization and precise matching between user operations and system responses during simulation training.

[0096] The AI ​​interaction module 207 is further configured to: determine a first key frame sequence and a second key frame sequence; wherein the first key frame sequence includes N frames after the fifth key frame in the currently displayed main display frame sequence, and the fifth key frame is the Pth frame after the currently displayed frame; the second key frame sequence includes N frames after the sixth key frame in the currently displayed lower display frame sequence, and the sixth key frame is the Pth frame after the currently displayed frame; N and P are preset values;

[0097] It is understood that the first key frame sequence includes the main display frames from the P+1th frame after the current display frame in the currently displayed main display frame sequence to the P+Nth frame. Correspondingly, the second key frame sequence includes the lower display frames from the P+1th frame after the current display frame in the currently displayed lower display frame sequence to the P+Nth frame.

[0098] In some implementations, N may be equal to 5, and P may be equal to 3, which is not specifically limited in the embodiments of the present application.

[0099] In addition, the AI ​​interaction module 207 is also configured to: input the first key frame sequence, the second key frame sequence and the second operation data into the AI ​​prediction model, so that the AI ​​prediction model modifies the first key frame sequence and expands the layers based on the second operation data to obtain a new first key frame sequence, and modifies the second key frame sequence and expands the layers based on the second operation data to obtain a new second key frame sequence.

[0100] It can be understood that the first keyframe sequence is generated by superimposing the following two layer sequences: the first layer sequence is the visual layer sequence generated by the AI ​​interaction module 207 for the confrontation mode, i.e., the fifth layer sequence; the second layer sequence is the head-up display layer sequence generated by the AI ​​interaction module 207 based on the first user operation, i.e., the fourth layer sequence. The second keyframe sequence is generated by superimposing the following two layer sequences: the first layer sequence is the lower display layer sequence generated by the AI ​​interaction module 207 for adding confrontation elements in the confrontation mode, and the second layer sequence is the lower display layer sequence generated by the AI ​​interaction module 207 based on the first user operation. Therefore, when the user initiates confrontation through the third user operation, the first and second keyframe sequences can be modified and the layers expanded.

[0101] The modification step involves updating the corresponding layers in the first and second keyframe sequences based on the combat instructions (e.g., initiating a weapon attack) in the second operation data. Specifically, the updating step may include adjusting the positions of combat elements in the first and second keyframe sequences, changing flight attitudes, and updating navigation information.

[0102] The layer expansion step involves using the AI ​​prediction model to generate new layers based on the original keyframe sequence and overlay them to extend the keyframe sequence. For example, based on the analysis of current flight trends and confrontational situations, possible changes in confrontational elements can be predicted.

[0103] Throughout the entire processing process, the AI ​​prediction model employs a reinforcement learning strategy, optimizing prediction parameters through historical training data and real-time user feedback. For example, if a user frequently performs evasive maneuvers, the model dynamically adjusts the enemy aircraft's attack strategy, adding tactics such as multi-directional flanking and feints. If the user's weapon fire accuracy is low, the model reduces the difficulty of target avoidance, helping the user gradually master attack techniques.

[0104] Finally, the new key frame sequence processed by the AI ​​prediction model will be transmitted to the main display module 201 and the auxiliary display module 206, realizing the intelligent evolution and real-time response of the simulated training scene, enabling the training environment to dynamically adapt to user operations, and significantly improving the authenticity and challenge of the training.

[0105] Furthermore, the main display module 201 is further configured to: determine a fifth key frame, and display a new first key frame sequence after displaying the fifth key frame;

[0106] The secondary display module 206 is further configured to: determine a sixth key frame, and display a new second key frame sequence after displaying the sixth key frame.

[0107] The main display module 201 can display the first key frame sequence on the main display 1011, and the auxiliary display module 206 can display the second key frame sequence on the auxiliary display 1012. In this way, smooth display can be achieved and user experience can be improved.

[0108] Furthermore, the system provided in the embodiment of the present application can also provide a red-blue system confrontation mode to achieve 1V1, 1V2 or 1V multi-training. Specifically, in the red-blue system confrontation mode, each module can be configured according to the following steps.

[0109] Figure 7 This is the fourth operating sequence diagram of the portable integrated flight simulation training system provided in an embodiment of the present application.

[0110] like Figure 7 As shown, the first communication module 208 is configured to send first terminal interaction data to the second communication module via the data distribution service DDS at a preset frequency, and receive second terminal interaction data sent by the second communication module via the DDS. The first terminal interaction data can be obtained by the control module 202 of the first electronic device, and the second terminal interaction data can be obtained by the control module of the second electronic device.

[0111] It is understood that the first communication module 208 is a communication module for the first electronic device running the portable integrated flight simulation training system provided in the embodiments of the present application, and the second communication module is a communication module for the second electronic device running the portable integrated flight simulation training system provided in the embodiments of the present application. Both the first and second electronic devices can be operated by real people, enabling multiple terminal devices to work together to simulate complex combat scenarios.

[0112] Exemplarily, the first terminal interaction data includes:

[0113] User operation instructions: such as flight attitude adjustment, flight speed change, weapon launch, etc.

[0114] Display configuration parameter update information: such as update parameters of the visual layer sequence and the flat display layer sequence.

[0115] Real-time feedback data of the simulated flight environment: such as current flight status, changes in weather conditions, etc.

[0116] Exemplarily, the second terminal interaction data includes:

[0117] The opponent's operating instructions: such as the enemy aircraft's attack and defense actions, etc.

[0118] The opponent's status information: such as the position, speed, attitude, etc. of the enemy aircraft.

[0119] Environmental change feedback data: such as dynamic changes in the battlefield environment, the emergence of new threat targets, and other information.

[0120] The AI ​​interaction module 207 is further configured to input the second terminal interaction data into the AI ​​prediction model, so that the AI ​​prediction model generates a new main display frame sequence and a new lower display frame sequence based on the second terminal interaction data.

[0121] It can be understood that the new main display frame sequence and the new subsidiary display frame sequence are both generated through real confrontation operations between the first electronic device user and the second electronic device user.

[0122] The main display module 201 is further configured to: display a new main display frame sequence;

[0123] The auxiliary display module 206 is further configured to display a new lower display frame sequence.

[0124] This enables efficient collaboration and real-time interaction between multiple terminal devices, ensuring smooth and efficient red-blue confrontation training through data distribution services. It can simulate real-world air combat environments and support multiple confrontation modes, such as 1v1, 1v2, or 1v-multi, providing pilots with a wealth of training scenarios and practical experience.

[0125] In some implementations, whether to enable the red-blue system confrontation mode can be configured by the user by operating the keyboard 1013 and the touchpad 1014. At this time, the control module 202 can sense the user operation and enable the confrontation mode.

[0126] In summary, in the embodiment of the present application, during the simulated flight confrontation process, the pilot can observe the flight status and situation information of the aircraft through the head-up display and the lower display. The pilot's main operations include flight attitude operation, weapon-related operations, radar-related operations, and throttle-related operations. The embodiment of the present application can meet the above-mentioned flight requirements with as few devices as possible. In addition, the embodiment of the present application can simulate the pilot's first-person flight perspective by combining the main display 1011 of the dual-screen notebook 101 with the main display module 201, the visual display module 203, and the head-up display module 204. The instrumentation in the aircraft cockpit is simulated by combining the secondary display 1012 with the lower display module 205. The main display 1011 and the secondary display 1012 are an upper and lower structure, similar to the structure of a real machine. In this way, the pilot's visual requirements can be met by a dual-screen notebook 101.

[0127] Furthermore, based on the system and device provided by the embodiments of the present application, the user can control the aircraft's attitude by operating the flight control stick; can control weapon-related operations such as weapon launch, weapon switching, and chaff launch by using the buttons on the flight control stick; can control aircraft thrust by pushing the throttle stick; and can operate radar and other sensors by using the buttons on the throttle stick. In this way, the system and device based on the embodiments of the present application can enable the pilot to meet flight requirements without removing their hands from the stick, thus achieving the purpose of the device and system.

[0128] Figure 8 This is a second system architecture diagram of the portable integrated flight simulation training system provided in an embodiment of the present application.

[0129] like Figure 8 As shown, the portable integrated flight simulation training system architecture provided by the present embodiment consists of a general combat control system, simulator terminal services, five interactive modules, a data management module, and an execution layer. The general combat control system coordinates command transmission and reception and status monitoring; the simulator terminal services standardize connection processes; five modules, including the AI ​​algorithm, perform tasks in a division of labor, relying on asynchronous interaction and decoupled data in the data management module; and the execution layer's services and hardware implementation functions enable a closed "operation-combat-feedback" training loop. This layered decoupling ensures system flexibility and stability.

[0130] In this architecture, the user controls the input data and sends it to the simulation platform through the network. The solution data output by the simulation platform is received and forwarded to various external service programs according to the protocol, including joystick reading, AI algorithm control interface, lower display, head-up display and visual data transmission interface.

[0131] Figure 9 This is the fifth operating sequence diagram of the portable integrated flight simulation training system provided in an embodiment of the present application.

[0132] like Figure 9 As shown, during the startup phase of the portable integrated flight simulation training system, the user configures the battlefield information and clicks the start button to initialize the simulation engine. The simulator terminal receives the startup information and initializes each module. The terminal sends a start signal and the simulation begins.

[0133] Specifically, the combat control is designed and operated based on the MTA architecture to ensure compatibility and interoperability with other modules.

[0134] In addition, the combat control can perform monitoring and other operations as a TCP Server, responsible for monitoring network connection requests and waiting for connections from portable dual-screen notebooks.

[0135] In addition, the combat control system can be used to process the received command information: after receiving the command from the portable dual-screen notebook, the combat control system parses and processes it to realize the corresponding control function.

[0136] The initialization process is as follows:

[0137] Main(): The main function starts the initialization process of the combat control.

[0138] void Init(const_ST_MTA_CONFIG& config): Initializes the system according to the provided MTA configuration parameters.

[0139] void addThread(): Add a thread to prepare for subsequent concurrent operations.

[0140] void addSubThread(): Add subthreads to further refine and decompose tasks.

[0141] Multiple Init() calls: Initialization operations may be performed on different modules or components. Multiple calls are made to ensure that all relevant parts are in a ready state.

[0142] void startThread(): Starts the thread that was previously added and initialized.

[0143] void start(): Starts the system's main business logic or service, which may include multiple calls to start different functional modules or services.

[0144] The simulation engine, simulator terminal, HUD, DUD, viewport, and joystick can be used to call the following functions.

[0145] void Run(): Starts the simulation engine, simulator terminal, HUD, lower display, viewport and joystick, and puts them into working state.

[0146] void Main(): These components may also have their own main program or control logic, which is started through the Main() function.

[0147] Loop: A loop structure used to continuously run and update the status of each component.

[0148] bool Recv(void *p_buffer, int length): Receives data from the combat control or other modules, and receives data of the specified length through the buffer.

[0149] Continue to see Figure 9The portable dual-screen notebook is the user interface of the system, through which users interact with the entire system. The combat control system exchanges data with the portable dual-screen notebook through network communication and other means. The portable dual-screen notebook displays system status and information and receives user input commands.

[0150] Figure 9 It is used to demonstrate how the combat master control initializes itself and its various subsystems, and how it communicates and interacts with a portable dual-screen notebook, thereby enabling the startup and operation of the entire flight simulation training system.

[0151] Figure 10 This is the sixth operating sequence diagram of the portable integrated flight simulation training system provided in an embodiment of the present application.

[0152] like Figure 10 As shown, the simulation process can be described using a red and blue system, divided into maneuvering and fire control operations. Maneuvering operations send data to the simulator terminal via the joystick control. The processed data is displayed on the combat situation page for real-time viewing by the user. Fire control data sends weapon data to the simulation engine via the joystick. The processed data is distributed to the head-up display for viewing of weapon return data.

[0153] Specifically, in the interaction process between components such as the combat control, portable dual-screen notebook, and simulation engine, the operation process of each component is as follows.

[0154] (1) Overall Operational Control:

[0155] ①Instruction analysis:

[0156] bool parseCommand(const void *p_buff, ST_COMAND_INFO & info): After receiving the command data, the combat control system calls this function to parse the command content and convert the data into the command information structure ST_COMAND_INFO for subsequent processing.

[0157] ② Request trigger:

[0158] bool fireRequest(const ST_COMAND_INFO & info): triggers the corresponding request processing flow and executes specific business logic based on the parsed command information.

[0159] ③Message creation:

[0160] bool ReqCreat(CMtaMsgAgent *p_ma): Create a message agent object CMtaMsgAgent, which is used to communicate with other modules (such as simulation engine, etc.) and establish a message transmission bridge.

[0161] ④Status feedback:

[0162] void ActiveCommand(ACTIVE_COMAND *p_act): Returns the status information of the command control to the main control so that the main control can understand the execution status of the command in a timely manner and realize closed-loop control.

[0163] (2) Simulation engine, simulator terminal, head-up display, lower display, viewport and joystick:

[0164] ①Data processing:

[0165] bool MskeData(const void *p_data): performs mask processing or other conversion operations on the data to ensure that the data format meets system requirements and prepares for subsequent simulation and display.

[0166] ②Message creation:

[0167] bool ReqCreat(CMtaMsgAgent *p_ma): It is also necessary to create a message agent object in order to communicate with the combat control or other modules to realize the interaction of data and instructions.

[0168] ③Information acquisition and response:

[0169] Obtain information: Obtain necessary information from relevant data sources to provide data support for subsequent operations.

[0170] void fireNetReply(int code_no): Sends a network reply message to feed back the processing result or status information to the requester. code_no is used to identify the type or status of the reply.

[0171] ④Data sending and storage:

[0172] bool Send(const void *p_buffer, int length): Sends data to the combat control center or other designated recipients through the network or other communication methods.

[0173] void saveGroupinfo(int id, const void *p_info): Saves group information, which may be used to manage different data sets or object groups to facilitate subsequent queries and operations.

[0174] (3) Portable dual-screen notebook:

[0175] The portable dual-screen notebook serves as the user interface, displaying system status and information and receiving user commands. It exchanges data with the operational control system via a network or other communication method, sending user commands to the control system and displaying the status and information returned by the control system to the user.

[0176] Overall, Figure 10 This demonstrates how the combat control system parses and processes commands, communicates and exchanges data with other modules, and provides status feedback to the user. It also illustrates the role of components like the simulation engine in data processing, message passing, and status feedback, illustrating the collaborative workflow of the entire system when executing commands.

[0177] Figure 11 This is the seventh operating sequence diagram of the portable integrated flight simulation training system provided in an embodiment of the present application.

[0178] like Figure 11 As shown in the figure, when stopping the simulation, a stop signal is sent by the master control to the simulation engine and simulator terminal, and then to the HUD, LUD, visual field, and joystick. After the stop operation is completed, the threads and sub-threads are closed one by one.

[0179] Specifically, Figure 11 The communication process between the combat control system and the portable dual-screen notebook is demonstrated, as well as the stop operation process within the combat control system. The specific workflow of each component is as follows.

[0180] (1) Overall Operational Control:

[0181] ①TCP Server operation: The combat control center acts as the TCP server, responsible for monitoring network connection requests and processing received command information.

[0182] ②Stop operation:

[0183] void Stop(const_ST_MTA_CONFIG& config): Executes the stop operation according to the provided MTA configuration parameters and begins to shut down system resources and threads.

[0184] void stopThread(): Stops the previously started thread to ensure that the system stops running.

[0185] Multiple stop() calls: used to stop different functional modules or services to ensure that the system is completely stopped.

[0186] (2) Simulation engine, simulator terminal, head-up display, lower display, viewport and joystick:

[0187] bool Recv(void *p_buffer, int length): Receives data from the combat control or other modules to ensure the final processing of the data during the stop process.

[0188] (3) Portable dual-screen notebook:

[0189] void closeThread(): Closes the thread on the portable dual-screen notebook and prepares to end the application.

[0190] void closeSubThread(): Closes the subthread on the portable dual-screen notebook and ensures that all related operations have stopped.

[0191] The process is described as follows:

[0192] ① Stop monitoring and processing instructions: The combat control stops monitoring network requests and processes the last instruction information.

[0193] ② Stop the thread: The combat control stops the main thread and sub-thread in turn to ensure that system resources are released correctly.

[0194] ③ Close the portable dual-screen notebook thread: The portable dual-screen notebook closes its main thread and sub-threads to ensure that the application on the device side is completely stopped.

[0195] Figure 11 This demonstrates how the combat control system and a portable dual-screen laptop work together to execute a shutdown operation, ensuring that system resources are properly released and all modules are safely shut down. This process is crucial for preventing resource leaks and ensuring the system can boot normally the next time.

[0196] Figure 12 A flowchart of the portable integrated flight simulation training method provided in an embodiment of the present application.

[0197] like Figure 12 As shown, an embodiment of the present application provides a portable integrated flight simulation training method, the method comprising:

[0198] S100: Displaying a main display frame sequence; wherein the main display frame sequence is obtained by layer-by-layer superposition of a visual layer sequence and a head-up display layer sequence, wherein the visual layer sequence includes a plurality of continuous visual layers, each of which is used to represent an external visual scene during a simulated flight, and the head-up display layer sequence includes a plurality of continuous head-up display layers, each of which includes at least a first flight parameter and navigation information during a simulated flight;

[0199] S200: In response to a first user operation, obtaining first operation data, where the first operation data includes flight attitude operation data and / or flight power operation data;

[0200] S300: In response to a first user operation, determining a first key frame, where the first key frame is the Mth frame after the currently displayed frame in the currently displayed main display frame sequence, where M is a preset value;

[0201] S400: intercepting a visual layer of a preset length from the visual layer sequence to obtain a first layer sequence, and intercepting a head-up display layer of a preset length from the head-up display layer sequence to obtain a second layer sequence; wherein the starting layer of the first layer sequence and the second layer sequence is a layer used to generate a first key frame;

[0202] S500: Inputting first operation data, a first layer sequence, and a second layer sequence into an AI prediction model, so that the AI ​​prediction model modifies and expands the first layer sequence layer by layer based on the first operation data to obtain a third layer sequence, and modifies and expands the second layer sequence layer by layer based on the first operation data to obtain a fourth layer sequence.

[0203] S600: Superimposing the third layer sequence and the fourth layer sequence layer by layer to obtain a new main display frame sequence;

[0204] S700: Displaying a new main display frame sequence after displaying the first key frame.

[0205] In some implementations, the following steps S801-S803 may be included before step S100.

[0206] S801: In response to a second user operation, generating a visual layer sequence based on display configuration information; wherein the second user operation is initiated by the user before the first user operation, and the second user operation is used to indicate display configuration information, the display configuration information including flight simulation scene information, initial flight attitude information, visual rendering parameters, and / or weather environment information;

[0207] S802: In response to a second user operation, generating a head-up display layer sequence based on display configuration information;

[0208] S803: Based on the layer priorities, the visual layer sequence and the head-up display layer sequence are superimposed layer by layer to obtain a main display frame sequence, wherein the layer priority of the head-up display layer is higher than the layer priority of the visual layer.

[0209] In some implementations, the method further includes the following steps S901 - S904 .

[0210] S901: Determining second flight parameters and radar information during the simulated flight based on the first operation data;

[0211] S902: Generate a lower display layer sequence based on the second flight parameter and radar information, where the lower display layer sequence includes at least one lower display layer;

[0212] S903: Generate a lower display frame based on the lower display layer sequence to obtain a lower display frame sequence;

[0213] S904: Display the lower display frame sequence.

[0214] In some implementations, step S300 may be followed by the following steps S905-S908.

[0215] S905: Determine a second key frame, where the second key frame is a random frame after the first key frame in the currently displayed main display frame sequence;

[0216] S906: Inputting the target visual layer corresponding to the second key frame in the third layer sequence into the AI ​​prediction model, so that the AI ​​prediction model adds a target element to the target visual layer, and performs layer expansion on the added target visual layer to obtain a fifth layer sequence; wherein the number of layers in the fifth layer sequence is equal to the number of layers following the target head-up display layer corresponding to the second key frame in the fourth layer sequence;

[0217] S907: Overlay the fifth layer sequence with the layer following the target HUD layer in the fourth layer sequence layer by layer to obtain a new HUD frame sequence;

[0218] S908: Displaying a new main display frame sequence after displaying the second key frame.

[0219] Step S906 may be followed by steps S909 to S912.

[0220] S909: Determine a third key frame and a target lower display layer; wherein the third key frame is a lower display frame in the lower display frame sequence, and the third key frame corresponds to the second key frame in time sequence; and the target lower display layer is the lower display layer corresponding to the third key frame in the lower display layer sequence;

[0221] S910: Inputting the fifth layer sequence and the target underlying layer into the AI ​​prediction model, so that the AI ​​prediction model modifies and expands the target underlying layer based on the fifth layer sequence to obtain a sixth layer sequence, where the number of layers in the sixth layer sequence is equal to that in the fifth layer sequence.

[0222] S911: Superimposing the sixth layer sequence with the lower display layer following the target lower display layer in the lower display layer sequence layer by layer to obtain a new lower display frame sequence;

[0223] S912: Displaying a new bottom display frame sequence after displaying the third key frame.

[0224] In some implementations, the following steps S913-S917 may be further included after step S908 and step S912.

[0225] S913: In response to the third user operation, obtaining second operation data; the second operation data includes flight attitude operation data, flight power operation data and / or confrontation data for the target element;

[0226] S914: Determine a first key frame sequence and a second key frame sequence; wherein the first key frame sequence includes N frames after the fifth key frame in the currently displayed main display frame sequence, where the fifth key frame is the Pth frame after the currently displayed frame; and the second key frame sequence includes N frames after the sixth key frame in the currently displayed lower display frame sequence, where the sixth key frame is the Pth frame after the currently displayed frame; N and P are preset values;

[0227] S915: Input the first key frame sequence, the second key frame sequence and the second operation data into the AI ​​prediction model, so that the AI ​​prediction model modifies the first key frame sequence and expands the layers based on the second operation data to obtain a new first key frame sequence, and modifies the second key frame sequence and expands the layers based on the second operation data to obtain a new second key frame sequence.

[0228] S916: Determine the fifth key frame, and display a new first key frame sequence after displaying the fifth key frame;

[0229] S917: Determine the sixth key frame, and display a new second key frame sequence after displaying the sixth key frame.

[0230] In some implementations, the method may further include the following steps S918-S921.

[0231] S918: Sending first terminal interaction data to a second communication module of at least one second electronic device at a preset frequency via a data distribution service DDS, and receiving second terminal interaction data sent by the second communication module via the DDS;

[0232] S919: Inputting the second terminal interaction data into the AI ​​prediction model, so that the AI ​​prediction model generates a new main display frame sequence and a new lower display frame sequence based on the second terminal interaction data;

[0233] S920: Displaying a new main display frame sequence;

[0234] S921: Display a new bottom display frame sequence.

[0235] In summary, the embodiments of the present application provide a portable integrated flight simulation training system and equipment to solve the problem of lack of an effective simulation environment for air confrontation simulation training under informationized battlefield conditions. The system focuses on current aviation combat missions, uses portable equipment and advanced technology, and can build a complex battlefield confrontation training simulation environment in any location. It can effectively support the daily operation training and new tactics and tactics simulation exercises of military aviation units, while making up for the shortcomings of traditional simulation systems in their non-portable structure, so as to achieve an overall improvement in the combat performance of aviation weapons and equipment. It is specifically reflected in the following aspects:

[0236] ① It has low requirements on the objective environment, improves training efficiency, and can carry out simulation exercises at any time and space;

[0237] ② It can be carried out and applied in various complex environments, and can be used for simulation and deduction at any time;

[0238] ③Retain the advantages of high simulation, including the head-up display, lower display, and throttle stick;

[0239] ④It has low requirements on the surrounding environment and can be used without the Internet connection. It can be installed on a laptop and can be used without power for a short period of time.

[0240] Furthermore, the portable integrated flight simulation training system and equipment provided in the embodiments of the present application have the following characteristics.

[0241] ① Strong portability: Light weight and small size, the minimum configuration only requires a dual-screen laptop, a throttle stick and a joystick. Only one person is needed to transfer the entire system, making it easy to carry around.

[0242] ② Convenient Configuration: No complex environment is required. Basic configuration can be completed at any time and in any location simply by connecting laptops via a network cable. Thanks to the laptops' long battery life, the system can be used even during short power outages. The system also supports configuration for various task types. By increasing or decreasing the number of computers in the red and blue systems, you can achieve 1v1, 2v2, and other competitive modes.

[0243] ③Operational Experience: Dual-screen laptops can simulate the aircraft's HUD and visual field. Combined with the throttle and joystick, they provide a realistic flight experience.

[0244] In other words, portable integrated flight simulation training systems and equipment have the advantages of simple deployment, high reliability, rich functions, lightweight design, portability, and high scalability.

[0245] Simple deployment specifically means: the portable integrated flight simulation training equipment adopts a box-based, fully wireless design, is easy to deploy, can be quickly deployed and withdrawn, and is suitable for various training and testing scenarios.

[0246] High reliability specifically means that the equipment is usually highly reliable, can continue to be used even when power is off, can operate independently without relying on the Internet, and is suitable for indoor and outdoor training venues.

[0247] Rich functions specifically mean that it is composed of multiple subsystems including master control, screen display, bottom display, three-dimensional situation, etc., which is close to the real aerial view.

[0248] Lightweight design specifically means that portable equipment is usually designed to be lightweight, has a sturdy and reliable structure, is small and easy to carry, and is suitable for field use.

[0249] Portability specifically means: the hardware of the portable integrated flight simulation training equipment consists of a joystick, a throttle lever, and a notebook. It can be connected to a USB interface and can work anytime and anywhere, making it convenient for individual users and team collaboration.

[0250] High scalability specifically means that the portable integrated flight simulation training device has integrated a large number of models for testing, supports rapid configuration of the environment using configuration files, supports multiple interfaces and operating systems, and can be expanded in standard or customized ways as needed.

[0251] In a specific implementation, the present invention further provides a computer storage medium, wherein the computer storage medium may store a program that, when executed, may include some or all of the steps of each embodiment of the portable integrated flight simulation training system and flight simulation training method provided by the present invention. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

[0252] It is easy to understand that those skilled in the art can combine, split, reorganize, etc. the embodiments of the present application based on the several embodiments provided in the present application to obtain other embodiments, and these embodiments do not exceed the scope of protection of the present application.

[0253] The above specific implementation methods further explain in detail the purpose, technical solutions and beneficial effects of the embodiments of the present application. It should be understood that the above are only specific implementation methods of the embodiments of the present application and are not intended to limit the scope of protection of the embodiments of the present application. Any modifications, equivalent replacements, improvements, etc. made on the basis of the technical solutions of the embodiments of the present application should be included in the scope of protection of the embodiments of the present application.

Claims

1. A portable integrated flight simulation training system, characterized in that: Applied to a first electronic device, the system includes: The main display module is configured to display a main display frame sequence; wherein the main display frame sequence is obtained by layer-by-layer superposition of a visual layer sequence and a head-up display layer sequence, wherein the visual layer sequence includes a plurality of continuous visual layers, each of which is used to represent an external visual scene during a simulated flight; and the head-up display layer sequence includes a plurality of continuous head-up display layers, each of which includes at least a first flight parameter and / or navigation information during the simulated flight. The control module is configured to: acquire first operation data in response to a first user operation, wherein the first operation data includes flight attitude operation data and / or flight power operation data; The main display module is further configured to: determine a first key frame in response to the first user operation, where the first key frame is the Mth frame after the currently displayed frame in the currently displayed main display frame sequence, where M is a preset value; and, intercepting a preset length of the visual layer from the visual layer sequence to obtain a first layer sequence, and intercepting the preset length of the head-up display layer from the head-up display layer sequence to obtain a second layer sequence; wherein the starting layers of the first layer sequence and the second layer sequence are layers used to generate the first key frame; Furthermore, the first operation data, the first layer sequence, and the second layer sequence are input into an AI prediction model, so that the AI ​​prediction model modifies and expands the first layer sequence layer by layer based on the first operation data to obtain a third layer sequence, and modifies and expands the second layer sequence layer by layer based on the first operation data to obtain a fourth layer sequence. and, superimposing the third layer sequence and the fourth layer sequence layer by layer to obtain a new main display frame sequence; And, after displaying the first key frame, a new main display frame sequence is displayed.

2. The portable integrated flight simulation training system according to claim 1, characterized in that: The system further comprises: A visual display module is configured to: generate the visual layer sequence based on display configuration information in response to a second user operation; wherein the second user operation is initiated by a user before the first user operation, and the second user operation is used to indicate the display configuration information, wherein the display configuration information includes flight simulation scene information, initial flight attitude information, visual rendering parameters, and / or meteorological environment information; a head-up display module, configured to: generate the head-up display layer sequence based on the display configuration information in response to the second user operation; The main display module is further configured to: based on layer priority, superimpose the visual layer sequence and the head-up display layer sequence layer by layer to obtain the main display frame sequence, wherein the layer priority of the head-up display layer is higher than the layer priority of the visual layer.

3. The portable integrated flight simulation training system according to claim 1, characterized in that: The system further comprises: a lower display module configured to: determine a second flight parameter and radar information during a simulated flight based on the first operation data; and generating a lower display layer sequence based on the second flight parameter and the radar information, wherein the lower display layer sequence includes at least one lower display layer; The auxiliary display module is configured to: generate a lower display frame based on the lower display layer sequence to obtain a lower display frame sequence; And, displaying the lower display frame sequence.

4. The portable integrated flight simulation training system according to claim 3, characterized in that: The system comprises: The AI ​​interaction module is configured to: determine a second key frame, where the second key frame is a random frame after the first key frame in the main display frame sequence currently displayed; Furthermore, the target visual layer corresponding to the second key frame in the third layer sequence is input into the AI ​​prediction model, so that the AI ​​prediction model adds a target element to the target visual layer, and performs layer expansion on the added target visual layer to obtain a fifth layer sequence; wherein the number of layers in the fifth layer sequence is equal to the number of layers following the target head-up display layer corresponding to the second key frame in the fourth layer sequence; The main display module is further configured to: superimpose the fifth layer sequence with the layer following the target HUD layer in the fourth layer sequence layer by layer to obtain a new main display frame sequence; And, after displaying the second key frame, a new main display frame sequence is displayed.

5. The portable integrated flight simulation training system according to claim 4, characterized in that: The AI ​​interaction module is further configured to: determine a third key frame and a target lower display layer; wherein the third key frame is the lower display frame in the lower display frame sequence, and the third key frame corresponds to the second key frame in time sequence; and the target lower display layer is the lower display layer corresponding to the third key frame in the lower display layer sequence; and inputting the fifth layer sequence and the target lower visible layer into the AI ​​prediction model, so that the AI ​​prediction model modifies and expands the target lower visible layer based on the fifth layer sequence to obtain a sixth layer sequence, wherein the sixth layer sequence has the same number of layers as the fifth layer sequence. The secondary display module is further configured to: superimpose the sixth layer sequence with the lower display layer following the target lower display layer in the lower display layer sequence layer by layer to obtain a new lower display frame sequence; And, after displaying the third key frame, a new sequence of lower display frames is displayed.

6. The portable integrated flight simulation training system according to claim 4 or 5, characterized in that: The control module is further configured to: acquire second operation data in response to a third user operation; the second operation data includes the flight attitude operation data, the flight power operation data and / or confrontation data for the target element; The AI ​​interaction module is further configured to: determine a first key frame sequence and a second key frame sequence; wherein the first key frame sequence includes N frames after the fifth key frame in the currently displayed main display frame sequence, and the fifth key frame is the Pth frame after the currently displayed frame; the second key frame sequence includes N frames after the sixth key frame in the currently displayed lower display frame sequence, and the sixth key frame is the Pth frame after the currently displayed frame; N and P are preset values; Furthermore, the first key frame sequence, the second key frame sequence and the second operation data are input into the AI ​​prediction model, so that the AI ​​prediction model modifies the first key frame sequence and expands the layers based on the second operation data to obtain a new first key frame sequence, and modifies the second key frame sequence and expands the layers based on the second operation data to obtain a new second key frame sequence.

7. The portable integrated flight simulation training system according to claim 6, characterized in that: The main display module is further configured to: determine the fifth key frame, and display a new first key frame sequence after displaying the fifth key frame; The secondary display module is further configured to: determine the sixth key frame, and display a new second key frame sequence after displaying the sixth key frame.

8. The portable integrated flight simulation training system according to claim 4, characterized in that: The system further comprises: The first communication module is configured to: send first terminal interaction data to a second communication module of at least one second electronic device at a preset frequency via a data distribution service DDS, and receive second terminal interaction data sent by the second communication module via the DDS; The AI ​​interaction module is further configured to: input the second terminal interaction data into the AI ​​prediction model, so that the AI ​​prediction model generates a new main display frame sequence and a new lower display frame sequence based on the second terminal interaction data; The main display module is further configured to: display a new main display frame sequence; The auxiliary display module is further configured to display a new lower display frame sequence.

9. A portable integrated flight simulation training device, characterized in that: The device includes: a main display, an operating stick, and at least one processor, wherein the at least one processor is communicatively connected to the main display and the operating stick; At least one of the processors is used to run the portable integrated flight simulation training system according to any one of claims 1 to 8.

10. A flight simulation training method, characterized in that: The method comprises: Displaying a main display frame sequence; wherein the main display frame sequence is obtained by layer-by-layer superposition of a visual layer sequence and a head-up display layer sequence, the visual layer sequence includes a plurality of continuous visual layers, the visual layers are used to represent the external visual scene during the simulated flight, and the head-up display layer sequence includes a plurality of continuous head-up display layers, the head-up display layers include at least the first flight parameter and navigation information during the simulated flight; In response to a first user operation, acquiring first operation data, where the first operation data includes flight attitude operation data and / or flight power operation data; In response to the first user operation, determining a first key frame, where the first key frame is the Mth frame after the currently displayed frame in the currently displayed main display frame sequence, where M is a preset value; Cutting off a preset length of the visual layer from the visual layer sequence to obtain a first layer sequence, and cutting off a preset length of the head-up display layer from the head-up display layer sequence to obtain a second layer sequence; wherein the starting layers of the first layer sequence and the second layer sequence are layers used to generate the first key frame; Inputting the first operation data, the first layer sequence, and the second layer sequence into an AI prediction model, so that the AI ​​prediction model modifies and expands the first layer sequence layer by layer based on the first operation data to obtain a third layer sequence, and modifies and expands the second layer sequence layer by layer based on the first operation data to obtain a fourth layer sequence; Overlaying the third layer sequence and the fourth layer sequence layer by layer to obtain a new main display frame sequence; After displaying the first key frame, a new main display frame sequence is displayed.

Images