XR glasses total element fusion simulation verification platform building method, verification platform and verification method

Abstract

The invention provides an XR glasses total factor fusion simulation verification platform building method, and belongs to the technical field of airborne simulation cockpit display, and the method comprises the steps: building a simulation environment sensor system working model, and obtaining sensor system model data; dividing working modes of the XR glasses according to the flight scene; constructing a simulation environment man-machine interaction and control model; based on sensor system model data and a simulation environment man-machine interaction and control model, a simulation verification environment corresponding to all XR glasses working modes is built, and an XR glasses total factor fusion simulation verification platform is built. A verification platform built by the method realizes fusion display function simulation of airborne sensor data in the XR glasses, and a total factor simulation model of the XR glasses is built; the real flight and man-machine interaction process of the fighter can be simulated, and the real degree of the simulation verification process is improved; the simulation cost can be reduced, and the pre-research function can be conveniently verified.

Description

Technical Field

[0001] This invention belongs to the field of airborne simulated cockpit display technology, specifically relating to a method for building a full-element fusion simulation verification platform for XR glasses, a verification platform, and a verification method. Background Technology

[0002] Helmet-mounted displays (HMDs) are crucial airborne equipment for modern fighter jets, enabling flight navigation, tactical attacks, and situational awareness. Currently, HMD display evaluation, functional simulation, and preliminary research and validation are often conducted using flat-panel displays. This traditional simulation verification method fails to fully demonstrate the situational awareness advantages of HMDs and cannot fully utilize the rich information sources of airborne sensors, resulting in incomplete technical verification and hindering functional pre-research and validation. XR technology can achieve seamless integration between real physical space and virtual information space, simulating realistic flight and human-machine interaction scenarios for fighter jets, and has significant application potential in the field of airborne simulated cockpit display technology simulation.

[0003] Therefore, it is essential to explore a fusion simulation method based on a full-element model of XR glasses, taking into account the functional simulation requirements of XR glasses and utilizing XR display and interaction technologies. Summary of the Invention

[0004] The purpose of this invention is to provide a method for building an XR glasses simulation verification platform and a verification platform in order to meet the simulation requirements of fusion display of airborne sensor data in XR glasses.

[0005] To achieve the above objectives, the present invention provides the following technical solution: a method for building a full-element fusion simulation verification platform for XR glasses, comprising: Based on the working principle of airborne sensor systems, a working model of the sensor system in the simulation environment is constructed; In the Unity simulation development environment, based on the constructed simulation environment sensor system working model, the data source of the airborne sensor is simulated to obtain the sensor system model data. XR glasses working modes are divided according to flight scenarios; A simulation environment human-computer interaction and control model is constructed based on the interaction methods and processes of XR glasses; Based on sensor system model data and simulation environment human-computer interaction and control model, a simulation verification environment containing all working modes of XR glasses is built, and a full-element fusion simulation verification platform for XR glasses is constructed.

[0006] The method for building an XR glasses full-element fusion simulation verification platform provided by the present invention also has the following technical features: the airborne sensor system includes a radar system, an optoelectronic aiming system, an optoelectronic distributed aperture system, and a communication, navigation, and identification system.

[0007] The method for building a full-element fusion simulation verification platform for XR glasses provided by this invention also has the following technical features: the working modes of the XR glasses include a conventional display mode, a cockpit-penetrating display mode, a detection and tracking display mode, and a search and reconnaissance display mode.

[0008] The method for building a full-element fusion simulation verification platform for XR glasses provided by this invention also has the following technical features: the XR glasses interaction methods include physical button interaction mode and voice command interaction mode.

[0009] Another objective of this invention is to provide a full-element fusion simulation verification platform for XR glasses, characterized in that the platform is built based on any of the aforementioned construction methods and includes: XR glasses, an interactive control processing module, and a simulation verification module.

[0010] The third objective of this invention is to provide a full-element fusion simulation verification method for XR glasses, which is implemented based on the aforementioned full-element fusion simulation verification platform for XR glasses.

[0011] Beneficial effects: The present invention provides a method for building a full-element fusion simulation verification platform for XR glasses. The verification platform realizes the simulation of the fusion display function of airborne sensor data in XR glasses and constructs a full-element simulation model of XR glasses. It can simulate the real flight of fighter jets and the human-computer interaction process, thereby improving the realism of the simulation verification process. It can also reduce simulation costs and facilitate convenient verification of pre-research functions. Attached Figure Description

[0012] To more clearly illustrate the technical solutions of the embodiments of this disclosure, the drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this disclosure. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0013] Figure 1 This is a schematic diagram illustrating the working principle of the XR glasses full-element fusion simulation verification method provided in this embodiment of the invention. Figure 2 This is a schematic diagram illustrating the classification of multiple application modes of XR glasses mentioned in the embodiments of the present invention. Detailed Implementation

[0014] The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. However, it should be noted that these embodiments are not intended to limit the present invention. Equivalent changes or substitutions in function, method, or structure made by those skilled in the art based on these embodiments are all within the protection scope of the present invention.

[0015] In the description of the embodiments of the present invention, it should be understood that the terms "center", "longitudinal", "lateral", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are only for the convenience of describing the invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limiting the invention.

[0016] Furthermore, the terms "first," "second," "third," etc., are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined with "first," "second," etc., may explicitly or implicitly include one or more of that feature. In the description of this invention, unless otherwise stated, "a plurality of" means two or more.

[0017] The terms "installation," "connection," and "linking" should be interpreted broadly. For example, they can refer to fixed connections, detachable connections, or integral connections; they can refer to mechanical connections or electrical connections; they can refer to direct connections or indirect connections through an intermediate medium; and they can refer to the internal connection between two components. Those skilled in the art will understand the specific meaning of these terms in this invention based on the specific circumstances.

[0018] like Figure 1-2 As shown, this embodiment of the invention provides a method for building a full-element fusion simulation verification platform for XR glasses, including: Based on the working principle of airborne sensor systems, a working model of the sensor system in the simulation environment is constructed; In the Unity simulation development environment, based on the constructed simulation environment sensor system working model, the data source of the airborne sensor is simulated to obtain the sensor system model data. XR glasses working modes are divided according to flight scenarios; A simulation environment human-computer interaction and control model is constructed based on the interaction methods and processes of XR glasses; Based on sensor system model data and simulation environment human-computer interaction and control model, a simulation verification environment containing all working modes of XR glasses is built, and a full-element fusion simulation verification platform for XR glasses is constructed.

[0019] In some embodiments, the airborne sensor system includes a radar system, an electro-optical targeting system, an electro-optical distributed aperture system, and a communication, navigation, and identification system. By analyzing the working principles and processes of different airborne sensor systems, a simplified working model of the sensor is constructed, and the sensor principle model and simulation data are built in the Unity simulation development environment.

[0020] In some embodiments, the XR glasses' operating modes include a conventional display mode, a cockpit-penetrating display mode, a detection and tracking display mode, and a search and reconnaissance display mode. In typical flight scenarios such as safe flight, tactical attack, and situational awareness, the main display functions of XR glasses used by fighter jets can be categorized as follows: conventional characters, video overlay (partial magnification / 360° image / infrared night vision), and 3D enhanced display. Combining different display functions and scenarios, the operating modes of XR glasses can be classified as follows: Figure 2 As shown.

[0021] In some embodiments, the XR glasses interaction methods include physical button interaction and voice command interaction. The pilot interacts with the XR glasses primarily through physical buttons on the control panel, in addition to voice interaction. The pilot inputs control signals to the electronic components via physical buttons or voice commands, and the main control software analyzes and distributes these input signals to adjust the operating mode and display screen. Based on this interactive control process, and combined with the XR display device, a multimodal human-computer interaction and control model is constructed as the human-computer input interface for the simulation verification platform.

[0022] In some embodiments, an XR glasses full-element fusion simulation verification platform is provided, characterized in that the platform is built based on the construction method described in any of the foregoing claims, and includes: XR glasses, an interactive control processing module, and a simulation verification module.

[0023] In some embodiments, a full-element fusion simulation verification method for XR glasses is provided, the method being implemented based on the aforementioned full-element fusion simulation verification platform for XR glasses.

[0024] The above description is merely a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of the present invention should be included within the protection scope of the present invention. The above description is only a preferred embodiment of the present invention. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the technical principles of the present invention, and these improvements and modifications should also be considered within the protection scope of the present invention.

Claims

1. A method for building a full-element fusion simulation verification platform for XR glasses, characterized in that, include: Based on the working principle of airborne sensor systems, a working model of the sensor system in the simulation environment is constructed; In the Unity simulation development environment, based on the constructed simulation environment sensor system working model, the data source of the airborne sensor is simulated to obtain the sensor system model data. XR glasses working modes are divided according to flight scenarios; A simulation environment human-computer interaction and control model is constructed based on the interaction methods and processes of XR glasses; Based on sensor system model data and simulation environment human-computer interaction and control model, a simulation verification environment containing all working modes of XR glasses is built, and a full-element fusion simulation verification platform for XR glasses is constructed.

2. The method for building a full-element fusion simulation verification platform for XR glasses according to claim 1, characterized in that, The airborne sensor system includes a radar system, an electro-optical targeting system, an electro-optical distributed aperture system, and a communication, navigation, and identification system.

3. The method for building a full-element fusion simulation verification platform for XR glasses according to claim 1, characterized in that, The XR glasses have the following working modes: regular display mode, cockpit penetration display mode, detection and tracking display mode, and search and reconnaissance display mode.

4. The method for building a full-element fusion simulation verification platform for XR glasses according to claim 1, characterized in that, The XR glasses interaction methods include physical button interaction mode and voice command interaction mode.

5. A full-element fusion simulation verification platform for XR glasses, characterized in that, The platform is built based on the construction method described in any one of claims 1-4, and includes: XR glasses, an interactive control processing module, and a simulation verification module.

6. A method for full-element fusion simulation verification of XR glasses, characterized in that, The method is implemented based on the XR glasses full-element fusion simulation verification platform as described in claim 5.

Images