Pilot training visualization method and system based on digital operation, equipment and medium

Abstract

The invention relates to the field of digital aviation equipment control, in particular to a pilot training visualization method and system based on digital operation, equipment and a medium, and the method mainly comprises the steps: judging the display level of a current visual image, judging whether the current visual image can be displayed or not according to a first size, a second size and a third size, and displaying the current visual image according to the first size, the second size and the third size. If the first size and the second size can be displayed, the first size and the second size are transmitted to the wearable display device to be displayed, and if not, the first size and the second size are corrected. According to the method, on the basis of the displayed content, when the original visual image cannot be displayed, the sizes of the visual image and the displayed content are corrected so as to meet the condition that the visual image and the displayed content cannot be displayed in an overlapped mode, and the content level of the visual image needing to be displayed is combined through the scheme, so that the display efficiency is improved. The effect of more reasonable display is achieved, and the corrected current visual image and the current conventional display picture are transmitted to the wearable display device to be displayed.

Description

Technical Field

[0001] The present invention relates to the field of digital aviation equipment control, and in particular to a pilot training visualization method and system, equipment and medium based on digital operation. Background Art

[0002] The pilot aviation simulation system is a high-tech tool for training and evaluating pilot skills. Traditional flight training often relies on actual flights, which is costly and risky, while the simulation system provides a safe and economical alternative. The system reproduces various flight environments and emergency situations through high-fidelity flight simulators, allowing pilots to train without risk. The simulation system can not only simulate different types of aircraft, but also various weather conditions and flight missions, helping pilots familiarize themselves with operating procedures and respond to emergencies. In addition, the addition of a visual simulation system, including the integration of virtual reality (VR) and augmented reality (AR) technology, enhances the immersion and realism of training.

[0003] However, in the current visualization training system, due to the limited display area in front of the eyes, there are inevitably some conflicts among the various images that need to be displayed in front of the pilots. The lack of a reasonable visualization method may cause overlapping of multiple images and confusion. Summary of the invention

[0004] The embodiments of the present invention solve the above-mentioned problems in the prior art by providing a pilot training visualization method and system, device, and medium based on digital operation.

[0005] In the first aspect, a pilot training visualization method based on digital operation includes: Acquire the visualization image signal transmitted by the current training simulation system, obtain the visualization image that needs to be displayed currently, and determine the display level of the current visualization image; Obtaining a first size required for displaying the current visualization image, a second size of the current conventional display screen, and a third size that can be used for displaying the screen, and determining whether the current visualization image can be displayed according to the first size, the second size, and the third size; If it can be displayed, it is transmitted to the wearable display device for display. If it cannot be displayed, the first size and the second size are corrected according to the display level of the content of the current visual image signal, and the corrected current visual image and the current regular display screen are transmitted to the wearable display device for display.

[0006] Preferably, determining the display level of the current visualized image includes: The display levels include a first level, a second level and a third level, and the urgency of the display from the first level to the third level increases in sequence; Obtain the content to be displayed by the visualization image and the basic information of the current aircraft, establish an urgency evaluation model, output the evaluation score of the current content to be displayed through the urgency evaluation model, and output the display level of the current visualization image through the evaluation score.

[0007] Preferably, the establishing of the urgency evaluation model comprises: , In the formula, For evaluation scores, is the flight altitude of the currently simulated aircraft, is the maximum allowed flight altitude of the currently simulated aircraft, is the load mass of the currently simulated aircraft, is the maximum load mass of the currently simulated aircraft, is the evaluation weight.

[0008] Preferably, the evaluation weights include: Determine whether the content to be displayed is relevant to the aircraft's continued flight. If so, , if not, determine whether the content to be displayed currently requires manual operation; If the content requires manual operation, ; If it does not require manual operation, .

[0009] Preferably, the outputting of the display level of the current visual image through the evaluation score includes: when When it is greater than or equal to 50%, the display level of the current visualization image is output as the third level; when When it is less than 50% and greater than or equal to 30%, the display level of the output current visualization image is the second level; when When it is less than 30%, the display level of the current visualization image is output as the first level.

[0010] Preferably, the modifying of the first size and the second size comprises: Obtaining current first size data and second size data, establishing a size correction model according to the first size data, the second size data and the display level of the current visualization image, and outputting the corrected first size data and second size data through the correction model; The current visualization image and the conventional display picture are outputted through the first size data and the second size data.

[0011] Preferably, the size correction model includes: , , , In the formula, The current visualization image and the regular display screen exceed the size available for the display screen. is the first size, For the second size, For the third size, is the first size after correction, is the corrected second size, To calculate the weight, when the display level of the current visualization image is the first level, , when the display level of the current visualization image is the second level and the third level, .

[0012] In the second aspect, a pilot training visualization system based on digital operation includes: The information acquisition module is configured to acquire the visualization image signal transmitted by the current training simulation system, obtain the visualization image that needs to be displayed currently, and determine the display level of the current visualization image; A size correction module is configured to obtain a first size required for display of the current visual image, a second size of the current conventional display screen, and a third size that can be used for the display screen, and determine whether the current visual image can be displayed according to the first size, the second size, and the third size; The screen display module is configured to transmit the image to the wearable display device for display if the image can be displayed, and if the image cannot be displayed, to correct the first size and the second size according to the display level of the content of the current visual image signal, and transmit the corrected current visual image and the current regular display image to the wearable display device for display; A main control device, which is connected to the information acquisition module, the size correction module and the picture display module, is used to execute the above-mentioned pilot training visualization method based on digital operation.

[0013] In a third aspect, an electronic device includes a wearable display device and a processor, wherein the processor is electrically connected to the wearable display device, and the processor is used to store a memory of executable instructions of the processor to execute the above-mentioned pilot training visualization method based on digital operation.

[0014] In a fourth aspect, a non-temporary computer-readable storage medium, when the instructions in the storage medium are executed by a processor of an electronic device, enables the electronic device to execute and implement the above-mentioned pilot training visualization method based on digital operation.

[0015] One or more technical solutions provided in the embodiments of the present invention have at least the following technical effects or advantages: The method provided by the present invention mainly includes determining the display level of the current visual image, determining whether the current visual image can be displayed according to the first size, the second size and the third size, and if it can be displayed, transmitting it to the wearable display device for display, and if it cannot be displayed, correcting the first size and the second size. Through the above method, when the original visual image can no longer be displayed based on the displayed content, the size of the visual image and the displayed content is corrected to meet the situation where there is no overlapping display, and this solution is combined with the content level of the visual image that needs to be displayed to achieve a more reasonable display effect, and the corrected current visual image and the current conventional display screen are transmitted to the wearable display device for display. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0017] Figure 1 It is a schematic diagram of the process of the present invention. DETAILED DESCRIPTION

[0018] The embodiments of the present invention solve the technical problems in the prior art by providing a pilot training visualization method and system, medium, and equipment based on digital operation.

[0019] The technical solution of the embodiment of the present invention is to solve the above technical problems, and the overall idea is as follows: In order to better understand the above technical solution, the above technical solution will be described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0020] First of all, the term "and / or" in this article is only a description of the association relationship of the associated objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.

[0021] like Figure 1 As shown, in the first aspect, a pilot training visualization method based on digital operation includes: S101: Acquire a visualization image signal transmitted by the current training simulation system, obtain a visualization image that needs to be displayed, and determine a display level of the current visualization image; In this embodiment, the visual image is the reminder content issued by the aircraft or the training content that the trainees must know, which needs to be displayed visually, and can be eliminated or not after the display, so that the trainees can obtain the current information. The reminder content generally has different levels of urgency, so in the present invention, the display level is divided into the first level, the second level and the third level, and the urgency of the display from the first level to the third level increases in sequence. Of course, it can also be divided into more levels, and the present invention only makes an exemplary display.

[0022] S102: Obtain a first size required for displaying the current visualized image, a second size of the current regular display screen, and a third size that can be used for displaying the screen, and determine whether the current visualized image can be displayed according to the first size, the second size, and the third size; In the present invention, training is generally carried out using head-mounted VR or AR equipment, and the displayed image is only the direct view image in front of the eyes. If the sum of the first size and the second size is greater than the third size, the current visualized image cannot be displayed. If the sum of the first size and the second size is less than or equal to the third size, the current visualized image can be displayed. Among them, conventional display images are generally time, flight altitude, temperature, humidity, etc., which require regular long-term display content.

[0023] S103: If it can be displayed, it is transmitted to the wearable display device for display; if it cannot be displayed, the first size and the second size are corrected according to the display level of the content of the current visual image signal, and the corrected current visual image and the current regular display screen are transmitted to the wearable display device for display.

[0024] The method provided by the present invention mainly includes determining the display level of the current visual image, determining whether the current visual image can be displayed based on the first size, the second size and the third size, and if it can be displayed, transmitting it to the wearable display device for display; if it cannot be displayed, correcting the first size and the second size. Through the above method, when the original visual image can no longer be displayed based on the displayed content, the size of the visual image and the displayed content is corrected to ensure that there is no overlapping display, and this solution is combined with the content level of the visual image that needs to be displayed to achieve a more reasonable display effect, and the corrected current visual image and the current conventional display screen are transmitted to the wearable display device for display. In an exemplary embodiment of the present invention, determining the display level of the current visual image includes: The display levels include the first level, the second level and the third level, and the urgency of the display from the first level to the third level increases in sequence; Obtain the content to be displayed in the visualization image and the basic information of the current aircraft, establish an urgency evaluation model, output the evaluation score of the current content to be displayed through the urgency evaluation model, and output the display level of the current visualization image through the evaluation score.

[0025] Specifically, the establishment of the urgency evaluation model includes: , In the formula, For evaluation scores, is the flight altitude of the currently simulated aircraft, is the maximum allowed flight altitude of the currently simulated aircraft, is the load mass of the currently simulated aircraft, is the maximum load mass of the currently simulated aircraft, is the evaluation weight.

[0026] In this example, not only the flight altitude factor is taken into consideration, but also the current cargo load factor. During the flight of the aircraft, the weight of the cargo load is also crucial to the aircraft factor. It is necessary for the pilot to make reasonable judgments and give feedback on the cargo load based on the content to be displayed in the visualization image. Therefore, the urgency evaluation model of the present invention can more reasonably evaluate the urgency of the content to be displayed in the current visualization image.

[0027] The evaluation weights include: Determine whether the content to be displayed is relevant to the aircraft's continued flight. If so, If not, it is determined whether the content to be displayed currently requires manual operation; the content requiring manual operation is the content that requires the pilot to make corresponding actions; In this embodiment, the content that affects the aircraft's continued flight is generally a serious situation where the aircraft will be unable to continue flying, such as engine failure, fuel exhaustion, etc.

[0028] If the content requires manual operation, ; If manual operation is required, it can generally be for adjusting the aircraft functions, etc.

[0029] If it does not require manual operation, The content that does not require manual operation is generally the signal reminders obtained by various sensors, time, etc., which the pilot only needs to know.

[0030] Outputting the display level of the current visualization image through the evaluation score includes: when When it is greater than or equal to 50%, the display level of the current visualization image is output as the third level; when When it is less than 50% and greater than or equal to 30%, the display level of the output current visualization image is the second level; when When it is less than 30%, the display level of the current visualization image is output as the first level.

[0031] The present invention provides a specific example to explain the above scheme.

[0032] For example, if the content to be displayed in the current visualization image is "Please manually operate the joystick", it can be judged that it is content that requires manual operation and does not affect the continued flight of the aircraft. ; rice, rice, ton, Tons, available , If it is less than 30, the display level of the current visualization image can be output as the first level.

[0033] In an exemplary embodiment of the present invention, modifying the first size and the second size includes: Obtaining current first size data and second size data, establishing a size correction model according to the first size data, the second size data and the display level of the current visualization image, and outputting the corrected first size data and second size data through the correction model; The current visualization image and the conventional display picture are outputted through the first size data and the second size data.

[0034] Specifically, the size correction model includes: , , , In the formula, The current visualization image and the regular display screen exceed the size available for the display screen. is the first size, is the second size, For the third size, is the first size after correction, is the corrected second size, To calculate the weight, when the display level of the current visualization image is the first level, , when the display level of the current visualization image is the second level and the third level, .

[0035] The size correction model of this example is combined with the results of the urgency evaluation model, making the size adjustment more reasonable and the displayed content enabling the pilot to obtain better results.

[0036] The second invention is a pilot training visualization system based on digital operation, comprising: The information acquisition module is configured to acquire the visualization image signal transmitted by the current training simulation system, obtain the visualization image that needs to be displayed currently, and determine the display level of the current visualization image; A size correction module is configured to obtain a first size required for display of the current visual image, a second size of the current conventional display screen, and a third size that can be used for the display screen, and determine whether the current visual image can be displayed according to the first size, the second size, and the third size; The screen display module is configured to transmit the image to the wearable display device for display if the image can be displayed, and if the image cannot be displayed, to correct the first size and the second size according to the display level of the content of the current visual image signal, and transmit the corrected current visual image and the current regular display image to the wearable display device for display; A main control device, which is connected to the information acquisition module, the size correction module and the picture display module, is used to execute the above-mentioned pilot training visualization method based on digital operation.

[0037] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0038] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0039] Although the preferred embodiments of the present invention have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present invention.

[0040] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. A pilot training visualization method based on digital operation, characterized in that: include: Acquire the visualization image signal transmitted by the current training simulation system, obtain the visualization image that needs to be displayed currently, and determine the display level of the current visualization image; Obtaining a first size required for displaying the current visualization image, a second size of the current conventional display screen, and a third size that can be used for displaying the screen, and determining whether the current visualization image can be displayed according to the first size, the second size, and the third size; If it can be displayed, it is transmitted to the wearable display device for display. If it cannot be displayed, the first size and the second size are corrected according to the display level of the content of the current visual image signal, and the corrected current visual image and the current regular display screen are transmitted to the wearable display device for display.

2. A pilot training visualization method based on digital operation according to claim 1, characterized in that: The determining of the display level of the current visual image includes: The display levels include a first level, a second level and a third level, and the display urgency of the first level to the third level increases in sequence; Obtain the content to be displayed in the visualization image and the basic information of the current aircraft, establish an urgency evaluation model, output the evaluation score of the current content to be displayed through the urgency evaluation model, and output the display level of the current visualization image through the evaluation score.

3. The pilot training visualization method based on digital operation according to claim 2, characterized in that: The establishing of the urgency evaluation model comprises: ， In the formula, For evaluation scores, is the flight altitude of the currently simulated aircraft, is the maximum allowed flight altitude of the currently simulated aircraft, is the load mass of the currently simulated aircraft, is the maximum load mass of the currently simulated aircraft, is the evaluation weight.

4. The pilot training visualization method based on digital operation according to claim 3, characterized in that: The evaluation weights include: Determine whether the content to be displayed is relevant to the aircraft's continued flight. If so, If not, determine whether the content to be displayed currently requires manual operation; if it is content that requires manual operation, then ; If it does not require manual operation, .

5. The pilot training visualization method based on digital operation according to claim 4, characterized in that: The step of outputting the display level of the current visual image through the evaluation score includes: when When it is greater than or equal to 50%, the display level of the current visualization image is output as the third level; when When it is less than 50% and greater than or equal to 30%, the display level of the output current visualization image is the second level; when When it is less than 30%, the display level of the current visualization image is output as the first level.

6. The pilot training visualization method based on digital operation according to claim 5, characterized in that: The correcting of the first size and the second size comprises: Acquire current first size data and second size data, establish a size correction model according to the first size data, the second size data and the display level of the current visualization image, and output the corrected first size data and second size data through the correction model; The current visualization image and the conventional display picture are outputted through the first size data and the second size data.

7. The pilot training visualization method based on digital operation according to claim 6, characterized in that: The size correction model comprises: ， ， ， In the formula, The current visualization image and the regular display screen exceed the size available for the display screen. is the first size, For the second size, For the third size, is the first size after correction, is the corrected second size, To calculate the weight, when the display level of the current visualization image is the first level, , when the display level of the current visualization image is the second level and the third level, .

8. A pilot training visualization system based on digital operation, characterized in that: include: The information acquisition module is configured to acquire the visualization image signal transmitted by the current training simulation system, obtain the visualization image that needs to be displayed currently, and determine the display level of the current visualization image; A size correction module is configured to obtain a first size required for display of the current visual image, a second size of the current conventional display screen, and a third size that can be used for the display screen, and determine whether the current visual image can be displayed according to the first size, the second size, and the third size; The screen display module is configured to transmit the image to the wearable display device for display if the image can be displayed, and if the image cannot be displayed, to correct the first size and the second size according to the display level of the content of the current visual image signal, and transmit the corrected current visual image and the current regular display image to the wearable display device for display; A main control device, the main control device is connected to the information acquisition module, the size correction module and the screen display module, and is used to execute a pilot training visualization method based on digital operation as described in any one of claims 1 to 7.

9. An electronic device, characterized in that: It comprises a wearable display device and a processor, wherein the processor is electrically connected to the wearable display device, and the processor is used to store a memory of executable instructions of the processor to execute a pilot training visualization method based on digital operation as described in any one of claims 1-7.

10. A non-transitory computer-readable storage medium, characterized in that: When the instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to implement a pilot training visualization method based on digital operation as described in any one of claims 1 to 7.

Images