Display picture layout and symbol design method of airborne windshield head-up display

Abstract

The embodiment of the invention relates to the technical field of man-machine interaction interface design, in particular to a display picture layout and symbol design method for an airborne windshield head-up display, which comprises the following steps of: presenting attitude information and space guidance information of an airplane by adopting a first person view angle based on the characteristics of the windshield head-up display, 2D situation information and navigation information are presented by adopting the upper emperor view angle, and the characteristic of windshield head-up display means that display information is collimated and imaged on windshield glass in front of a pilot; acquiring a current task stage, and automatically switching to a corresponding picture and displaying according to the current task stage; determining whether to display terrain enhancement information according to the current terrain condition; determining whether to display image enhancement information according to the current meteorological condition; and obtaining a customization instruction of a pilot, and adjusting the position and size of the symbol according to the customization instruction of the pilot. According to the method, the pilot can obtain necessary information through the windshield head-up display in different task scenes, so that the optimal situation awareness is obtained.

Description

Technical Field

[0001] The embodiments of the present application relate to the technical field of human-computer interaction interface design, and in particular to a display screen layout and symbol design method for an airborne windshield head-up display. Background Art

[0002] Human-machine interaction information is a key input for pilots' decision-making. The information elements obtained by pilots from various instruments, displays and communication channels form the basis of pilots' situational awareness. As the environment inside and outside the cockpit becomes more complex, it is a daunting challenge to cultivate pilots' ability to maintain good situational awareness. The windshield HUD (windshield head-up display) is a new type of display device among airborne display devices. It uses the aircraft windshield as a display terminal, and the pilot can see the external view, flight information, and aiming information through the windshield at the same time.

[0003] However, the inventors of this application have discovered that current aircraft are not yet equipped with a windshield HUD, and naturally do not have a reasonable, information-rich display screen layout. How to combine the display characteristics of the windshield HUD and comprehensively consider the mission phase, terrain, weather and customized needs of the pilot to display is an urgent problem that needs to be solved. Among these, it is very necessary to study the display screen layout and symbol design of the windshield HUD. Summary of the invention

[0004] In view of this, an embodiment of the present application proposes a display screen layout and symbol design method for an airborne windshield HUD, which enables pilots to obtain necessary information through the windshield HUD in different mission scenarios without being disturbed by secondary information, thereby obtaining optimal situational awareness.

[0005] In order to achieve the above-mentioned purpose, an embodiment of the present application proposes a display screen layout and symbol design method for an airborne windshield head-up display, comprising the following steps: based on the characteristics of the windshield head-up display, the aircraft's attitude information and spatial guidance information are presented in a first-person perspective, and 2D situation information and navigation information are presented in a God's perspective; wherein the characteristics of the windshield head-up display refer to the display information being collimated and imaged on the windshield directly in front of the pilot; obtaining the current mission phase, automatically switching to the corresponding screen and displaying it according to the current mission phase; determining whether to display terrain enhancement information according to the current terrain conditions; determining whether to display image enhancement information according to the current meteorological conditions; obtaining the pilot's customized instructions, and adjusting the position and size of the symbol according to the pilot's customized instructions.

[0006] In order to achieve the above-mentioned purpose, an embodiment of the present application also proposes an electronic device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute a display screen layout and symbol design method for an airborne windshield head-up display as described above.

[0007] In order to achieve the above objectives, an embodiment of the present application further proposes a computer-readable storage medium storing a computer program. When the computer program is executed by a processor, it can implement a display screen layout and symbol design method for an airborne windshield head-up display as described above.

[0008] The embodiment of the present application proposes a display screen layout and symbol design method for an airborne windshield HUD. Based on the characteristics of the windshield HUD, the method comprehensively considers the mission phase of the carrier aircraft, terrain, weather and customized needs of the pilot, adopts a first-person perspective to present the aircraft's attitude information and spatial guidance information, and adopts a God's perspective to present 2D situation information and navigation information. It also supports flexible adjustment of the position and size of symbols according to the pilot's customized instructions to meet the usage needs of different scenarios, different environments and different personnel, so that the pilot can obtain necessary information through the windshield HUD in different mission scenarios, terrains and weather environments without being disturbed by secondary information, thereby enabling the pilot to obtain optimal situational awareness.

[0009] In some optional embodiments, the first-person perspective refers to the perspective at a fixed eye position of the windshield HUD, along the longitudinal axis of the aircraft shaft, facing directly in front of the aircraft, the aircraft's attitude information includes aircraft heading, aircraft pitch, aircraft roll and aircraft velocity vector, and the spatial guidance information includes flight velocity vector guidance, flight pipeline, target indication information and terrain information.

[0010] In some optional embodiments, the God's perspective refers to a perspective along a straight line determined by the center of gravity of the aircraft and the center of the earth toward the center of the earth at a certain point on the straight line, the 2D situation information includes distribution information of enemy targets, obstacles or friendly targets within a certain range centered on the aircraft, and terrain information, and the navigation information includes flight paths and real-time navigation routes.

[0011] In some optional embodiments, the mission stages include preparation for takeoff, takeoff and climb, level flight and cruising, coordinated reconnaissance, target attack, return and evacuation, emergency landing and ground maintenance; automatically switching to the corresponding screen and displaying it according to the current mission stage includes: determining the display control logic of the symbol according to the information requirements corresponding to the current mission stage, and automatically switching to the corresponding screen and displaying it.

[0012] In some optional embodiments, the information requirements corresponding to the take-off phase, the take-off climb phase, and the ground maintenance phase include: aircraft reference symbol, aircraft heading / pitch / roll / sideslip, aircraft speed, aircraft altitude / climb target altitude, warning, flight path, and threat positions within the flight path; the information requirements corresponding to the level flight cruise phase include: aircraft reference symbol, aircraft heading / pitch / roll / sideslip, aircraft speed, aircraft altitude, warning, flight path, and threat positions within the flight path, and real-time navigation route; the information requirements corresponding to the collaborative reconnaissance phase, the target attack phase, and the emergency landing phase include: aircraft reference symbol, aircraft heading / pitch / roll / sideslip, aircraft speed, aircraft altitude, warning, flight path, and threat positions within the flight path, flight pipeline, obstacle / own target / enemy target position and attribute information, weapon information; the information requirements corresponding to the return and evacuation phase include: aircraft reference symbol, aircraft heading / pitch / roll / sideslip, aircraft speed, aircraft altitude, warning, flight path, and threat positions within the flight path, real-time navigation route, and landing field guidance information.

[0013] In some optional embodiments, terrain conditions are divided into complex mountains and non-complex mountains, and whether to display terrain enhancement information is determined based on the current terrain conditions, including: if the current terrain conditions are complex mountains, then the terrain enhancement information is displayed; if the current terrain conditions are non-complex mountains, then the terrain enhancement information is not displayed; wherein, the basis for determining complex mountains is the existence of terrain higher than the current flight altitude within a preset time at the current flight speed, and the symbol of the terrain enhancement information is a terrain grid image, which is obtained from the aircraft's onboard computer.

[0014] In some optional embodiments, meteorological conditions are divided into poor visual conditions and good visual conditions, and whether to display image enhancement information is determined based on the current meteorological conditions, including: if the current terrain conditions are poor visual conditions, then the image enhancement information is displayed; if the current terrain conditions are good visual conditions, then the image enhancement information is not displayed; wherein the image enhancement information is obtained from the aircraft's onboard optoelectronic sensors.

[0015] In some optional embodiments, the obtained customized instructions of the pilot include translation instructions, scaling instructions, and the number of the symbol to be adjusted; adjusting the position and size of the symbol according to the customized instructions of the pilot includes: finding the symbol to be adjusted based on the number of the symbol to be adjusted, translating and scaling the symbol to be adjusted based on the translation instructions and scaling instructions, thereby adjusting the symbol to be adjusted to the specified position and presenting it in the specified size. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the related technologies, the drawings required for use in the embodiments of the present application or the related technical descriptions will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0017] Figure 1 is a flow chart of a display screen layout and symbol design method of an airborne windshield HUD provided in one embodiment of the present application;

[0018] Figure 2 is a schematic diagram of the working principle of a display screen layout and symbol design method of an airborne windshield head-up display provided in one embodiment of the present application;

[0019] Figure 3 is a schematic diagram of a symbol from a first-person perspective provided in one embodiment of the present application;

[0020] Figure 4 It is a schematic diagram of a symbol from a bird's eye view provided in one embodiment of the present application;

[0021] Figure 5 It is a structural schematic diagram of an electronic device provided in another embodiment of the present application. DETAILED DESCRIPTION

[0022] In order to make the purpose, technical scheme and advantages of the embodiments of the present application clearer, the embodiments of the present application will be described in detail below in conjunction with the accompanying drawings. In the various embodiments of the present application, many technical details are proposed in order to make the reader better understand the present application. However, even without these technical details and various changes and modifications based on the following embodiments, the technical scheme claimed in the present application can also be implemented. The division of the following embodiments is only for the convenience of description, and the specific implementation mode of the present application should not constitute any limitation. The various embodiments can be combined with each other and referenced to each other under the premise of no contradiction.

[0023] An embodiment of the present application proposes a display screen layout and symbol design method for an airborne windshield head-up display, which is applied to an electronic device, wherein the electronic device may be a terminal or a server. In this embodiment and the following embodiments, the electronic device is described using a server as an example. The implementation details of the display screen layout and symbol design method for an airborne windshield head-up display proposed in this embodiment are specifically described below. The following content is only the implementation details provided for ease of understanding and is not necessary for implementing this solution.

[0024] The specific process of the display screen layout and symbol design method of the airborne windshield HUD proposed in this embodiment can be as follows: Figure 1 As shown, its working principle can be Figure 2 As shown, the method specifically includes:

[0025] Step 101, based on the characteristics of the windshield HUD, the attitude information and spatial guidance information of the aircraft are presented in a first-person perspective, and the 2D situation information and navigation information are presented in a God's perspective, wherein the characteristics of the windshield HUD refer to that the display information is collimated and imaged on the windshield directly in front of the pilot.

[0026] In a specific implementation, since the windshield HUD has the characteristic of directly imaging the display information on the windshield directly in front of the pilot, the server can present the aircraft's attitude information and spatial guidance information in a first-person perspective based on the characteristics of the windshield HUD, and present 2D situation information and navigation information in a God's perspective.

[0027] In one example, the first symbol design principle is to present the aircraft's attitude information and spatial guidance information using a first-person perspective. The first-person perspective refers to the perspective from the fixed eye position of the windshield HUD, along the longitudinal axis of the aircraft's shaft, toward the front of the aircraft. The aircraft's attitude information includes the aircraft's heading, aircraft pitch, aircraft roll, and aircraft velocity vector, and the spatial guidance information includes flight velocity vector guidance, flight duct, target indication information, and terrain information. The symbols of the first-person perspective can be as follows: Figure 3 shown.

[0028] In one example, using a bird's-eye view to present 2D situation information and navigation information is the second symbol design principle. The bird's-eye view refers to the view from a point on a straight line between the center of gravity of the aircraft and the center of the earth, along the straight line toward the center of the earth. The 2D situation information includes the distribution information of enemy targets, obstacles or friendly targets within a certain range centered on the aircraft, as well as terrain information. The navigation information includes the flight path and real-time navigation route. The bird's-eye view symbol can be as follows: Figure 4 Shown

[0029] Step 102, obtaining the current task stage, automatically switching to the corresponding screen and displaying it according to the current task stage.

[0030] In the specific implementation, the server obtains the current mission phase of the aircraft in real time, and automatically switches to the corresponding screen and displays it according to the current mission phase.

[0031] In one example, the mission phases of an aircraft include the preparation for takeoff, the takeoff and climb phase, the level flight and cruise phase, the coordinated reconnaissance phase, the target attack phase, the return and evacuation phase, the emergency landing phase, and the ground maintenance phase. The server can determine the display control logic of the symbol according to the information requirements corresponding to the current mission phase, automatically switch to the corresponding screen and display it.

[0032] In one example, the information requirements corresponding to the take-off phase, take-off climb phase, and ground maintenance phase include: aircraft reference symbol, aircraft heading / pitch / roll / sideslip, aircraft speed, aircraft altitude / climb target altitude, warning, flight path, and threat positions within the flight path. The information requirements corresponding to the level flight cruise phase include: aircraft reference symbol, aircraft heading / pitch / roll / sideslip, aircraft speed, aircraft altitude, warning, flight path, and threat positions within the flight path, and real-time navigation route. The information requirements corresponding to the coordinated reconnaissance phase, target attack phase, and emergency landing phase include: aircraft reference symbol, aircraft heading / pitch / roll / sideslip, aircraft speed, aircraft altitude, warning, flight path, and threat positions within the flight path, flight pipeline, obstacle / own target / enemy target position and attribute information, and weapon information. The information requirements corresponding to the return evacuation phase include: aircraft reference symbol, aircraft heading / pitch / roll / sideslip, aircraft speed, aircraft altitude, warning, flight path, and threat positions within the flight path, real-time navigation route, and landing field guidance information.

[0033] Step 103: Determine whether to display terrain enhancement information according to the current terrain conditions.

[0034] In a specific implementation, the server can determine the current terrain conditions in real time during the flight of the aircraft, and determine whether to display the terrain enhancement information according to the current terrain conditions.

[0035] In one example, the terrain conditions are divided into complex mountainous areas and non-complex mountainous areas. The basis for determining complex mountainous areas is that there is terrain higher than the current flight altitude within a preset time (generally set to 10 seconds) at the current flight speed. When the server determines whether to display terrain enhancement information based on the current terrain conditions, it needs to determine the current terrain conditions. If the current terrain conditions are complex mountainous areas, the terrain enhancement information is displayed. If the current terrain conditions are non-complex mountainous areas, the terrain enhancement information is not displayed.

[0036] In one example, the symbol of the terrain enhancement information is a terrain grid image, and the terrain grid image can be obtained from an onboard computer of the aircraft.

[0037] Step 104: Determine whether to display image enhancement information according to current meteorological conditions.

[0038] In a specific implementation, the server can determine the current weather conditions in real time during the flight of the aircraft, and determine whether to display the image enhancement information according to the current weather conditions.

[0039] In one example, the meteorological conditions are divided into poor visual conditions and good visual conditions. When the server determines whether to display the image enhancement information according to the current meteorological conditions, it is necessary to determine the current meteorological conditions. If the current terrain conditions are poor visual conditions, the image enhancement information is displayed. If the current terrain conditions are good visual conditions, the image enhancement information is not displayed.

[0040] In one example, image enhancement information is obtained from electro-optical sensors onboard an aircraft.

[0041] Step 105, obtaining the pilot's customized instructions, and adjusting the position and size of the symbol according to the pilot's customized instructions.

[0042] In a specific implementation, the server can obtain the pilot's customized instructions in real time during the entire operation of the aircraft, and adjust the position and size of the symbol according to the pilot's customized instructions.

[0043] In one example, the pilot's customized instructions acquired by the server include a translation instruction, a scaling instruction, and the number of the symbol to be adjusted. The server can find the symbol to be adjusted based on the number of the symbol to be adjusted, and then translate and scale the symbol to be adjusted based on the translation instruction and the scaling instruction, so as to adjust the symbol to be adjusted to a specified position and present it in a specified size.

[0044] This embodiment, based on the characteristics of the windshield HUD, comprehensively considers the carrier aircraft mission phase, terrain, weather and pilot customization needs, adopts a first-person perspective to present the aircraft's attitude information and spatial guidance information, and adopts a God's perspective to present 2D situation information and navigation information, and supports flexible adjustment of the position and size of symbols according to the pilot's customized instructions to meet the usage needs of different scenarios, different environments and different personnel, so that the pilot can obtain necessary information through the windshield HUD in different mission scenarios, terrains, and weather environments without being disturbed by secondary information, thereby enabling the pilot to obtain optimal situation awareness.

[0045] The step division of the above methods is only for clear description. When implemented, they can be combined into one step or some steps can be split and decomposed into multiple steps. As long as they include the same logical relationship, they are all within the scope of protection of this application; adding insignificant modifications to the algorithm or process or introducing insignificant designs without changing the core design of the algorithm and process are all within the scope of protection of this application.

[0046] Another embodiment of the present application provides an electronic device, whose specific structure is as follows: Figure 5As shown, it includes: at least one processor 201; and a memory 202 that is communicatively connected to the at least one processor 201; wherein the memory 202 stores instructions that can be executed by the at least one processor 201, and the instructions are executed by the at least one processor 201 so that the at least one processor 201 can execute a display screen layout and symbol design method for an airborne windshield head-up display as described in the above embodiments.

[0047] Among them, the memory and the processor are connected in a bus manner, and the bus may include any number of interconnected buses and bridges, and the bus connects various circuits of one or more processors and memories together. The bus can also connect various other circuits such as peripheral devices, voltage regulators, and power management circuits, which are well known in the art and will not be further described in this article. The bus interface is responsible for providing an interface between the bus and the transceiver. The transceiver can be one component or multiple components, such as multiple receivers and transmitters, providing a unit for communicating with various other devices on a transmission medium. The data processed by the processor is transmitted on a wireless medium through an antenna, and further, the antenna also receives data and transmits the data to the processor.

[0048] The processor is responsible for managing the bus and general processing, and can also provide various functions, including timing, peripheral interfaces, voltage regulation, power management, and other control functions. Memory can be used to store data used by the processor when performing operations.

[0049] Another embodiment of the present application provides a computer-readable storage medium storing a computer program. When the computer program is executed by a processor, it can implement a display screen layout and symbol design method for an airborne windshield head-up display as described in the above embodiments.

[0050] That is, those skilled in the art can understand that all or part of the steps in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a program, and the program is stored in a storage medium, including a number of instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, ROM (Read-Only Memory), RAM (Random Access Memory), disk or optical disk and other media that can store program codes.

[0051] Those skilled in the art will appreciate that the above embodiments are specific embodiments for implementing the present application, and in actual applications, various changes may be made thereto in form and detail without departing from the spirit and scope of the present application.

Claims

1. A display screen layout and symbol design method for an airborne windshield head-up display, characterized in that: include: Based on the characteristics of the windshield HUD, the aircraft's attitude information and spatial guidance information are presented in a first-person perspective, and 2D situation information and navigation information are presented in a bird's-eye view. The characteristics of the windshield HUD refer to the display information being collimated and imaged on the windshield directly in front of the pilot. Get the current task stage, automatically switch to the corresponding screen and display it according to the current task stage; Determine whether to display terrain enhancement information based on current terrain conditions; Determine whether to display image enhancement information according to current meteorological conditions; Get the pilot's customized instructions and adjust the position and size of the symbol according to the pilot's customized instructions.

2. The method for designing a display screen layout and symbols for an airborne windshield head-up display according to claim 1, characterized in that: The first-person perspective refers to the perspective viewed from the fixed eye position of the windshield HUD, along the longitudinal axis of the aircraft, facing directly in front of the aircraft. The aircraft's attitude information includes the aircraft's heading, aircraft's pitch, aircraft's roll and aircraft's velocity vector. The spatial guidance information includes flight velocity vector guidance, flight pipeline, target indication information and terrain information.

3. The method for designing a display screen layout and symbols for an airborne windshield head-up display according to claim 2, characterized in that: The God's perspective refers to the perspective along the straight line determined by the center of gravity of the aircraft and the center of the earth toward the center of the earth at a certain point on the straight line. The 2D situational information includes the distribution information of enemy targets, obstacles or friendly targets within a certain range centered on the aircraft, as well as terrain information. The navigation information includes the flight path and real-time navigation route.

4. The method for designing a display screen layout and symbols for an airborne windshield head-up display according to claim 1, characterized in that: The mission phases include the take-off preparation phase, take-off climb phase, level flight cruise phase, coordinated reconnaissance phase, target attack phase, return and evacuation phase, emergency landing phase and ground maintenance phase; Automatically switch to the corresponding screen and display it according to the current task stage, including: According to the information requirements corresponding to the current task stage, the display control logic of the symbol is determined, and the corresponding screen is automatically switched and displayed.

5. The method for designing a display screen layout and symbols for an airborne windshield head-up display according to claim 4, characterized in that: The information requirements for the takeoff phase, takeoff climb phase and ground maintenance phase include: aircraft reference symbol, aircraft heading / pitch / roll / sideslip, aircraft speed, aircraft altitude / climb target altitude, warnings, flight path and threat positions within the flight path; The information requirements for the level flight cruise phase include: aircraft reference symbol, aircraft heading / pitch / roll / sideslip, aircraft speed, aircraft altitude, warnings, flight path and threat positions within the flight path, and real-time navigation route; The information requirements corresponding to the coordinated reconnaissance phase, target attack phase and emergency landing phase include: aircraft reference symbol, aircraft heading / pitch / roll / sideslip, aircraft speed, aircraft altitude, warning, flight path and threat position within the flight path, flight pipeline, obstacle / friendly target / enemy target position and attribute information, and weapon information; The information requirements for the return and evacuation phase include: aircraft reference symbol, aircraft heading / pitch / roll / sideslip, aircraft speed, aircraft altitude, warnings, flight path and threat positions within the flight path, real-time navigation route, and landing field guidance information.

6. The method for designing a display screen layout and symbols for an airborne windshield head-up display according to claim 1, characterized in that: The terrain conditions are divided into complex mountainous areas and non-complex mountainous areas. Whether to display terrain enhancement information is determined based on the current terrain conditions, including: If the current terrain condition is complex mountainous, the terrain enhancement information will be displayed; If the current terrain condition is non-complex mountainous, the terrain enhancement information will not be displayed; The basis for determining complex mountains is the existence of terrain higher than the current flight altitude within the preset flight time at the current flight speed. The symbol of terrain enhancement information is a terrain grid image, which is obtained from the aircraft's onboard computer.

7. The method for designing a display screen layout and symbols for an airborne windshield head-up display according to claim 1, characterized in that: Weather conditions are divided into poor visual conditions and good visual conditions. Whether to display image enhancement information is determined based on the current weather conditions, including: If the current terrain conditions are poor visual conditions, the image enhancement information is displayed; If the current terrain conditions are good visual conditions, the image enhancement information will not be displayed; Among them, image enhancement information is obtained from the aircraft's onboard optoelectronic sensors.

8. A display screen layout and symbol design method for an airborne windshield head-up display according to any one of claims 1 to 7, characterized in that: The obtained pilot's customized instructions include translation instructions, zoom instructions, and the number of the symbol that needs to be adjusted; Adjust symbology position and size based on pilot customization, including: The symbol to be adjusted is found based on the number of the symbol to be adjusted, and the symbol to be adjusted is translated and scaled based on the translation instruction and the scaling instruction, so that the symbol to be adjusted is adjusted to the specified position and presented in the specified size.

9. An electronic device, characterized in that: include: at least one processor; and, a memory communicatively coupled to the at least one processor; In which, the memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute a display screen layout and symbol design method for an airborne windshield head-up display as described in any one of claims 1 to 8.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, it is possible to implement a display screen layout and symbol design method for an airborne windshield head-up display as described in any one of claims 1 to 8.

Images