Image fusion display method and device for helmet-mounted display

Abstract

The invention particularly relates to an image fusion display method and device for a helmet-mounted display. The method comprises the following steps: acquiring two-dimensional information to be displayed; loading a two-dimensional character shader, performing two-dimensional character drawing on the to-be-displayed two-dimensional information by using the two-dimensional character shader, generating two-dimensional characters, and displaying the two-dimensional characters in a preset display plane in a virtual environment; obtaining three-dimensional information to be displayed; loading a three-dimensional character shader, performing three-dimensional character drawing on the three-dimensional information to be displayed by using the three-dimensional character shader to generate three-dimensional characters, and displaying the three-dimensional characters in the virtual reality environment; wherein the virtual environment is a three-dimensional virtual environment displayed by a helmet-mounted display. According to the method, the fusion display of the two-dimensional characters and the three-dimensional characters in the visual field of the helmet-mounted display can be realized.

Description

Technical Field

[0001] The present invention relates to the field of radar technology, and in particular to an image fusion display method and device for a helmet display, a storage medium, a computer program product, and an electronic device. Background Art

[0002] In the related technology, the Helmet Mounted Display (HMD) can provide pilots with information such as weapon aiming, aircraft attitude, altitude, etc. It is a high-performance aiming display device with a large field of view and the ability to quickly capture targets. It has become an important part of the cockpit display system of modern aircraft. At present, the content displayed on the helmet display is two-dimensional characters, which only display some basic flight and attack information. There are problems such as single character display, lack of three-dimensional sense, and poor distance perception.

[0003] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present invention, and therefore may include information that does not constitute the prior art known to ordinary technicians in the field. Summary of the invention

[0004] The present invention provides an image fusion display method and device for a helmet display, a storage medium, a computer program product, and an electronic device, which can fuse and display two-dimensional characters and three-dimensional characters in a helmet display, thereby overcoming the defects in the prior art to a certain extent.

[0005] Other features and advantages of the present invention will become apparent from the following detailed description, or may be learned in part by practice of the present invention.

[0006] According to a first aspect of the present invention, there is provided an image fusion display method for a helmet display, the method comprising:

[0007] Obtaining two-dimensional information to be displayed;

[0008] Loading a two-dimensional character shader, using the two-dimensional character shader to perform two-dimensional character drawing on the two-dimensional information to be displayed and generate a two-dimensional character, and displaying the two-dimensional character on a preset display plane in the virtual environment;

[0009] Acquiring three-dimensional information to be displayed;

[0010] Load a three-dimensional character shader, use the three-dimensional character shader to perform three-dimensional character drawing on the three-dimensional information to be displayed to generate three-dimensional characters, and display the three-dimensional characters in the virtual reality environment; wherein the virtual environment is a three-dimensional virtual environment displayed by a helmet display.

[0011] In some exemplary embodiments, the method further comprises:

[0012] The corresponding plane coordinate information of the preset display plane is configured in the three-dimensional coordinate system corresponding to the virtual environment.

[0013] In some exemplary embodiments, displaying the two-dimensional character on a preset display plane in the virtual environment includes:

[0014] Constructing a two-dimensional coordinate system corresponding to the preset display plane; and establishing a coordinate system conversion relationship between the two-dimensional coordinate system and a three-dimensional coordinate system corresponding to the virtual environment;

[0015] Coordinate information corresponding to the two-dimensional character in the two-dimensional coordinate system is determined, and the two-dimensional character is loaded based on the coordinate information.

[0016] In some exemplary embodiments, loading a two-dimensional character shader includes:

[0017] The OpenGL rendering program is called to draw the two-dimensional character.

[0018] In some exemplary embodiments, the method of loading the 3D character shader further includes:

[0019] The two-dimensional character shader is terminated, and the three-dimensional character shader is switched.

[0020] In some exemplary embodiments, the step of performing three-dimensional character drawing on the three-dimensional information to be displayed to generate a three-dimensional character using a three-dimensional character shader includes:

[0021] Load vertex shader and fragment shader;

[0022] Generate vertex data and index data corresponding to the three-dimensional information to be displayed;

[0023] Determining the texture coordinates of the texture map corresponding to the three-dimensional information to be displayed by using a vertex shader;

[0024] The fragment shader is used to obtain the color value of each pixel on the texture map according to the texture coordinates, and the corresponding pixel is shaded according to the color value.

[0025] According to a second aspect of the present invention, there is provided an image fusion display device for a helmet display, comprising:

[0026] A two-dimensional information acquisition module, used to acquire the two-dimensional information to be displayed;

[0027] A two-dimensional character loading module, used for loading a two-dimensional character shader, using the two-dimensional character shader to perform two-dimensional character drawing on the two-dimensional information to be displayed and generate a two-dimensional character, and displaying the two-dimensional character on a preset display plane in a virtual environment;

[0028] A three-dimensional information acquisition module, used to acquire three-dimensional information to be displayed;

[0029] A three-dimensional character loading module is used to load a three-dimensional character shader, use the three-dimensional character shader to perform three-dimensional character drawing on the three-dimensional information to be displayed to generate a three-dimensional character, and display the three-dimensional character in the virtual reality environment; wherein the virtual environment is a three-dimensional virtual environment displayed by a helmet display.

[0030] According to a third aspect of the present invention, there is provided a storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the above-mentioned image fusion display method for a helmet display.

[0031] According to a fourth aspect of the present invention, there is provided an electronic device, comprising:

[0032] Processor; and

[0033] A memory, configured to store executable instructions of the processor;

[0034] Wherein, the processor is configured to implement the above-mentioned image fusion display method for a helmet display by executing the executable instructions.

[0035] According to a fifth aspect of the present invention, there is provided a computer program product having a computer program stored thereon, and when the computer program is executed by a processor, the image fusion display method for a helmet display is implemented.

[0036] The image fusion display method for a helmet display provided by an embodiment of the present invention uses a two-dimensional character shader to draw two-dimensional characters with displayed two-dimensional information, so that the two-dimensional characters can be displayed on a display plane preconfigured in the virtual environment of the helmet display; in addition, a three-dimensional character shader can be switched, and three-dimensional characters can be drawn, so that the three-dimensional characters can be displayed within the field of view of the helmet display, thereby realizing the fusion display of two-dimensional characters and three-dimensional characters in the helmet display, and improving the display effect of the content of the field of view of the helmet display.

[0037] It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] The accompanying drawings herein are incorporated into and constitute a part of the specification, illustrate embodiments consistent with the present invention, and together with the specification are used to explain the principles of the present invention. Obviously, the accompanying drawings described below are only some embodiments of the present invention, and for those of ordinary skill in the art, other accompanying drawings can be obtained based on these accompanying drawings without creative work.

[0039] Figure 1 A schematic diagram schematically illustrates an image fusion display method for a helmet display according to an exemplary embodiment of the present invention;

[0040] Figure 2 A schematic diagram schematically illustrates a user's field of view of a helmet display according to an exemplary embodiment of the present invention;

[0041] Figure 3 A schematic diagram schematically illustrates an image fusion display device for a helmet display according to an exemplary embodiment of the present invention;

[0042] Figure 4 The figure schematically shows the composition of an electronic device in an exemplary embodiment of the present invention. DETAILED DESCRIPTION

[0043] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that the present invention will be more comprehensive and complete and fully convey the concepts of the example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.

[0044] In addition, the accompanying drawings are only schematic illustrations of the present invention and are not necessarily drawn to scale. The same reference numerals in the figures represent the same or similar parts, and their repeated description will be omitted. Some of the block diagrams shown in the accompanying drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities can be implemented in software form, or implemented in one or more hardware modules or integrated circuits, or implemented in different networks and / or processor devices and / or microcontroller devices.

[0045] In related technologies, helmet displays (HMDs) are used to provide pilots with information such as weapon aiming and aircraft attitude. They are high-performance aiming display devices with a large field of view and the ability to quickly capture targets. They have become an important part of the cockpit display system of modern military aircraft. Currently, the content displayed on helmet displays is two-dimensional characters, which only display some basic flight and attack information. There are problems such as single character display, lack of three-dimensional sense, and poor distance perception.

[0046] In view of the shortcomings and deficiencies of the prior art, this example embodiment provides an image fusion display method for a helmet display, which can realize the fusion display of two-dimensional characters and three-dimensional characters in the helmet display.

[0047] Hereinafter, each step of the image fusion display method for a helmet display in this exemplary implementation will be described in more detail with reference to the accompanying drawings and embodiments.

[0048] In this example implementation, the image fusion display method for the helmet display can be executed by an intelligent terminal device connected to the helmet display, and the calculation results of the two-dimensional characters and the three-dimensional characters are sent to the helmet display and displayed in the helmet display. Among them, the intelligent terminal device can be an independent intelligent terminal device for image processing on board; or, it can also be an intelligent terminal device integrated with the helmet display, and the corresponding image display control method is executed by the CPU (Central Processing Processor) or GPU (Graphics Processing Unit). Among them, the helmet display can be used for data content display in application scenarios such as virtual reality (VR), augmented reality (AR) or mixed reality.

[0049] refer to Figure 1 As shown, the image fusion display method for a helmet display may specifically include the following steps:

[0050] In step S11, two-dimensional information to be displayed is obtained.

[0051] Exemplarily, the two-dimensional information to be displayed collected in real time by the data collection device can be received by the smart terminal device. The two-dimensional information to be displayed can include two-dimensional data tag information. The two-dimensional information to be displayed can be data information displayed in a two-dimensional manner at a fixed position within the field of view of the helmet display. For example, referring to Figure 2 As shown, the two-dimensional information to be displayed may be height information and direction information collected in real time, or posture information and speed information calculated in real time.

[0052] In step S12, a two-dimensional character shader is loaded, and two-dimensional character drawing is performed on the two-dimensional information to be displayed using the two-dimensional character shader to generate two-dimensional characters, and the two-dimensional characters are displayed on a preset display plane in the virtual environment.

[0053] Exemplarily, the loading of the two-dimensional character shader includes: calling an OpenGL rendering program to draw the two-dimensional character.

[0054] Specifically, after obtaining the two-dimensional information to be displayed, the OpenGL rendering program can be called first, for example, the OpenGL ES2.0 standard API can be called to load the two-dimensional character shader. The two-dimensional character shader is used to draw the two-dimensional characters to be displayed. In OpenGL ES2.0, it mainly includes: Vertex Shader and Fragment Shader; the vertex shader processes the information of each vertex, such as position, color, etc., while the fragment shader processes the color output of each pixel.

[0055] Exemplarily, the method further includes: configuring corresponding plane coordinate information of the preset display plane in a three-dimensional coordinate system corresponding to the virtual environment.

[0056] Specifically, in the virtual environment displayed by the helmet display, that is, in the user's field of view, a display plane for displaying two-dimensional characters can be predefined, and a mapping relationship between the preset display plane and the virtual environment can be established. For example, information of data types such as speed, altitude, and direction can be displayed in the display plane.

[0057] In the three-dimensional coordinate system corresponding to the virtual environment, the plane coordinates corresponding to the two-dimensional character display plane can be configured based on the specific needs of the user's field of view for viewing the two-dimensional character content. The two-dimensional character display plane can be configured as a rectangle or an ellipse.

[0058] Exemplarily, displaying the two-dimensional characters on a preset display plane in a virtual environment includes: constructing a two-dimensional coordinate system corresponding to the preset display plane; and establishing a coordinate system conversion relationship between the two-dimensional coordinate system and a three-dimensional coordinate system corresponding to the virtual environment; determining coordinate information corresponding to the two-dimensional characters in the two-dimensional coordinate system, and loading the two-dimensional characters based on the coordinate information.

[0059] Specifically, for a two-dimensional character display plane constructed in a virtual environment, a corresponding two-dimensional coordinate system can be defined, and based on the position information of the display plane in the virtual reality environment, a coordinate system conversion relationship between the two-dimensional coordinate system and the three-dimensional coordinate system of the virtual reality environment can be established, so as to calculate the coordinate system conversion relationship between the three-dimensional coordinates of each pixel point in the display plane in the virtual reality environment and the two-dimensional coordinates in the display plane based on the coordinate system conversion relationship.

[0060] After the two-dimensional characters are drawn using the two-dimensional character shader, the corresponding two-dimensional characters can be displayed on a preset display plane in the virtual environment according to the display positions predefined by various data.

[0061] In addition, in some exemplary embodiments, a plurality of small-sized two-dimensional character display planes may be predefined in the virtual reality environment corresponding to the field of view of the helmet display, and different data contents may be displayed on each small-sized display plane.

[0062] In step S13, three-dimensional information to be displayed is obtained.

[0063] Exemplarily, the two-dimensional information to be displayed may include three-dimensional data label information. The three-dimensional information to be displayed may be static data collected in real time, such as terrain feature data, and is used to display the terrain in three dimensions using lines in a virtual reality environment. Alternatively, the three-dimensional information to be displayed may be dynamic data collected in real time by a radar device, such as coordinate data and size data of a tracked target, and is used to dynamically display a corresponding three-dimensional image in a virtual reality environment based on the data.

[0064] In addition, in some exemplary real-time methods, the three-dimensional information to be displayed may be obtained while the two-dimensional information to be displayed is obtained; or, the three-dimensional information to be displayed may be obtained while the two-dimensional characters are drawn.

[0065] In step S13, a three-dimensional character shader is loaded, and the three-dimensional information to be displayed is subjected to three-dimensional character drawing using the three-dimensional character shader to generate three-dimensional characters, and the three-dimensional characters are displayed in the virtual reality environment; wherein the virtual environment is a three-dimensional virtual environment displayed by a helmet display.

[0066] Exemplarily, the method of loading the 3D character shader further includes: ending the 2D character shader and switching the 3D character shader.

[0067] Specifically, after receiving the 3D information to be displayed, the drawing of the current 2D character can be completed first, and after the 2D character drawing is completed, the 2D character drawing task is terminated, the currently called 2D character shader is terminated, and the 3D character shader is reloaded. The 3D character shader is used to draw the 3D character.

[0068] Exemplarily, in the above step S14, the step of performing three-dimensional character drawing on the three-dimensional information to be displayed to generate three-dimensional characters by using a three-dimensional character shader includes:

[0069] Step S21, loading vertex shader and fragment shader;

[0070] Step S22, generating vertex data and index data corresponding to the three-dimensional information to be displayed;

[0071] Step S23, using a vertex shader to determine the texture coordinates of the texture map corresponding to the three-dimensional information to be displayed;

[0072] Step S24, using a fragment shader to obtain the color value of each pixel on the texture map according to the texture coordinates, and performing coloring processing on the corresponding pixel according to the color value.

[0073] Specifically, when drawing three-dimensional characters, you can first load the vertex shader and fragment shader to generate vertex data and index data of the three-dimensional symbol. Based on the vertex coordinate data and index data, use the vertex shader to perform coordinate conversion to determine the texture coordinates corresponding to the texture map. Among them, the vertex shader can be a program loaded in the GPU and act on the vertex. In addition, it can also be a matrix transformation of the vertex position coordinates by obtaining the model matrix, view matrix, and projection matrix in the shader.

[0074] Then, the fragment shader can be used to determine the color value corresponding to each pixel on the texture map according to the texture coordinates, and then each pixel can be colored according to the color value of each pixel. In addition, for three-dimensional characters showing different contents, corresponding color configurations can be pre-configured. For example, for three-dimensional images of terrain, one color configuration can be used; for tracked dynamic targets, different color configurations can be used, so that different three-dimensional objects can be displayed in the user's field of view of the helmet display.

[0075] The method provided in the embodiment of the present invention can provide a more realistic and three-dimensional display effect to the pilot by switching the shader program, drawing the two-dimensional characters first and then drawing the three-dimensional characters, and finally displaying the fused characters on the helmet display, and can significantly enhance the comprehensive situation awareness capability of the helmet display. The method can be applied to helicopter helmet displays, fighter helmet displays, etc.

[0076] It should be noted that the above figures are only schematic illustrations of the processes included in the method according to an exemplary embodiment of the present invention, and are not intended to be limiting. It is easy to understand that the processes shown in the above figures do not indicate or limit the time sequence of these processes. In addition, it is also easy to understand that these processes can be performed synchronously or asynchronously, for example, in multiple modules.

[0077] For further reference, Figure 3 As shown, in the embodiment of this example, an image fusion display device 30 for a helmet display is also provided, comprising:

[0078] A two-dimensional information acquisition module 301 is used to acquire two-dimensional information to be displayed;

[0079] A two-dimensional character loading module 302 is used to load a two-dimensional character shader, use the two-dimensional character shader to perform two-dimensional character drawing on the two-dimensional information to be displayed and generate a two-dimensional character, and display the two-dimensional character on a preset display plane in the virtual environment;

[0080] A three-dimensional information acquisition module 303 is used to acquire three-dimensional information to be displayed;

[0081] The three-dimensional character loading module 304 is used to load a three-dimensional character shader, use the three-dimensional character shader to perform three-dimensional character drawing on the three-dimensional information to be displayed to generate a three-dimensional character, and display the three-dimensional character in the virtual reality environment; wherein the virtual environment is a three-dimensional virtual environment displayed by a helmet display.

[0082] It should be noted that, although several modules or units of the equipment for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to an embodiment of the present invention, the features and functions of two or more modules or units described above can be embodied in one module or unit. On the contrary, the features and functions of one module or unit described above can be further divided into being embodied by multiple modules or units.

[0083] Figure 4 A schematic diagram of an electronic device suitable for implementing an embodiment of the present invention is shown.

[0084] It should be noted that Figure 4 The electronic device 1000 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0085] like Figure 4 As shown, the electronic device 1000 includes a central processing unit (CPU) 1001, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 1002 or the program loaded from the storage part 1008 to the random access memory (RAM) 1003. In the RAM 1003, various programs and data required for system operation are also stored. The CPU 1001, ROM 1002 and RAM 1003 are connected to each other through a bus 1004. An input / output (I / O) interface 1005 is also connected to the bus 1004.

[0086] The following components are connected to the I / O interface 1005: an input section 1006 including a keyboard, a mouse, etc.; an output section 1007 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 1008 including a hard disk, etc.; and a communication section 1009 including a network interface card such as a LAN (Local Area Network) card, a modem, etc. The communication section 1009 performs communication processing via a network such as the Internet. A drive 1010 is also connected to the I / O interface 1005 as needed. A removable medium 1011, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 1010 as needed, so that a computer program read therefrom is installed into the storage section 1008 as needed.

[0087] In particular, according to an embodiment of the present invention, the process described below with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present invention includes a computer program product, which includes a computer program carried on a storage medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication part 1009, and / or installed from a removable medium 1011. When the computer program is executed by a central processing unit (CPU) 1001, various functions defined in the system of the present application are executed.

[0088] Specifically, the electronic device may be an airborne electronic device, or may be a smart wearable device that cooperates with a helmet display.

[0089] It should be noted that the storage medium shown in the embodiment of the present invention may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present invention, a computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, device or device. In the present invention, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any storage medium other than computer-readable storage media, which may send, propagate, or transmit programs for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the storage medium may be transmitted using any appropriate medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0090] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present invention. In this regard, each box in the flow chart or block diagram can represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0091] The units involved in the embodiments of the present invention may be implemented by software or hardware, and the units described may also be arranged in a processor. The names of these units do not, in some cases, limit the units themselves.

[0092] It should be noted that, as another aspect, the present application also provides a storage medium, which can be included in an electronic device; or it can exist independently without being installed in the electronic device. The above storage medium carries one or more programs, and when the above one or more programs are executed by an electronic device, the electronic device implements the method described in the following embodiments. For example, the electronic device can implement the following Figure 1 The individual steps of the method are shown.

[0093] In one embodiment, the present application provides a computer program product, including a computer program, which implements the steps in the above-mentioned method embodiments when executed by a processor.

[0094] In addition, the above-mentioned figures are only schematic illustrations of the processes included in the method according to an exemplary embodiment of the present invention, and are not intended to be limiting. It is easy to understand that the processes shown in the above-mentioned figures do not indicate or limit the time sequence of these processes. In addition, it is also easy to understand that these processes can be performed synchronously or asynchronously, for example, in multiple modules.

[0095] Other embodiments of the invention will readily occur to those skilled in the art after considering the specification and practicing the invention herein. This application is intended to cover any variations, uses, or adaptations of the invention that follow the general principles of the invention and include common knowledge or customary techniques in the art that are not disclosed by the present invention. The specification and examples are to be considered exemplary only, and the true scope and spirit of the invention are indicated by the claims.

[0096] It should be understood that the present invention is not limited to the exact construction that has been described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present invention is limited only by the appended claims.

Claims

1. An image fusion display method for a helmet display, characterized in that: The method comprises: Obtaining two-dimensional information to be displayed; Loading a two-dimensional character shader, using the two-dimensional character shader to perform two-dimensional character drawing on the two-dimensional information to be displayed and generate a two-dimensional character, and displaying the two-dimensional character on a preset display plane in the virtual environment; Acquiring three-dimensional information to be displayed; Load a three-dimensional character shader, use the three-dimensional character shader to perform three-dimensional character drawing on the three-dimensional information to be displayed to generate three-dimensional characters, and display the three-dimensional characters in the virtual environment; wherein the virtual environment is a three-dimensional virtual environment displayed by a helmet display.

2. The method according to claim 1, characterized in that The method further comprises: The corresponding plane coordinate information of the preset display plane is configured in the three-dimensional coordinate system corresponding to the virtual environment.

3. The method according to claim 1 or 2, characterized in that: The step of displaying the two-dimensional characters on a preset display plane in a virtual environment comprises: Constructing a two-dimensional coordinate system corresponding to the preset display plane; and establishing a coordinate system conversion relationship between the two-dimensional coordinate system and a three-dimensional coordinate system corresponding to the virtual environment; Coordinate information corresponding to the two-dimensional character in the two-dimensional coordinate system is determined, and the two-dimensional character is loaded based on the coordinate information.

4. The method according to claim 1, characterized in that: The loading of the two-dimensional character shader comprises: The OpenGL rendering program is called to draw the two-dimensional character.

5. The method according to claim 1, characterized in that The method of loading a three-dimensional character shader further comprises: The two-dimensional character shader is terminated, and the three-dimensional character shader is switched.

6. The method according to claim 1, characterized in that The method of using a three-dimensional character shader to perform three-dimensional character drawing on the three-dimensional information to be displayed to generate three-dimensional characters includes: Load vertex shader and fragment shader; Generate vertex data and index data corresponding to the three-dimensional information to be displayed; Determining the texture coordinates of the texture map corresponding to the three-dimensional information to be displayed by using a vertex shader; The fragment shader is used to obtain the color value of each pixel on the texture map according to the texture coordinates, and the corresponding pixel is shaded according to the color value.

7. An image fusion display device for a helmet display, characterized in that: The device comprises: A two-dimensional information acquisition module, used to acquire the two-dimensional information to be displayed; A two-dimensional character loading module, used for loading a two-dimensional character shader, using the two-dimensional character shader to perform two-dimensional character drawing on the two-dimensional information to be displayed and generate a two-dimensional character, and displaying the two-dimensional character on a preset display plane in a virtual environment; A three-dimensional information acquisition module, used to acquire three-dimensional information to be displayed; A three-dimensional character loading module is used to load a three-dimensional character shader, use the three-dimensional character shader to perform three-dimensional character drawing on the three-dimensional information to be displayed to generate a three-dimensional character, and display the three-dimensional character in the virtual reality environment; wherein the virtual environment is a three-dimensional virtual environment displayed by a helmet display.

8. A storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the image fusion display method for a helmet display according to any one of claims 1 to 6 is implemented.

9. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the image fusion display method for a helmet display according to any one of claims 1 to 6 is implemented.

10. An electronic device, characterized in that: include: processor; as well as A memory, configured to store executable instructions of the processor; The processor is configured to execute the image fusion display method for a helmet display according to any one of claims 1 to 6 by executing the executable instructions.

Images