Simulation System Visual Scene Real-Time Display Device and Method Based on Qt and Offline 3D Maps

Abstract

The present invention provides a real-time display device and method for the simulation system visual scene based on Qt and an offline 3D map. In the device, a data processing module is used to store the offline map web page and the aircraft model, and respond to the requests for the offline map web page and the aircraft model sent by the interface display module; an interface display module is used to display the offline map web page and the movement of the aircraft model; a shared memory reading module is used to read the aircraft data stored in the shared memory area of the hardware-in-the-loop real-time simulation system and store it; a web page communication module is used to read the aircraft data stored in the shared memory reading module and send the aircraft data to the offline map web page to drive the movement of the aircraft model in the offline map. The present invention realizes the simulation visual scene display in the form of a three-dimensional map by establishing a website and an offline map, and uses Qt to solve the function of information interaction between the hardware-in-the-loop simulation system and the web page, providing a feasible solution for the hardware-in-the-loop simulation visual scene display.

Description

Technical Field

[0001] The present invention belongs to the technical field of visual simulation, and particularly relates to a real-time visual display device and method for a simulation system view based on Qt (an application development framework) and an offline 3D map. Background Art

[0002] With the rapid development of computer technology, the application field of computer simulation technology is becoming more and more extensive. At present, in addition to displaying ballistic information, the current real-time simulation system also requires a three-dimensional view based on a map to more intuitively display the flight state of an aircraft in real time. Google Earth and Google Map can both provide a map development environment, but the map environment needs to be connected to the Internet, which makes it impossible to use in many specific environments where the Internet cannot be connected. Summary of the Invention

[0003] In order to overcome the deficiencies in the prior art, the inventor of the present invention has conducted intensive research and provided a real-time visual display device and method for a simulation system view based on Qt and an offline 3D map. By establishing a website and an offline map, the simulation view display is realized through a three-dimensional map, and Qt is used to solve the function of information interaction between the hardware-in-the-loop real-time simulation system and the web page, thereby solving the problem of real-time visual display of an offline map in hardware-in-the-loop simulation, and can cooperate with the hardware-in-the-loop simulation system to more intuitively display the flight effect of the aircraft.

[0004] The technical solutions provided by the present invention are as follows:

[0005] In a first aspect, a real-time visual display device for a simulation system view based on Qt and an offline 3D map includes a data processing module, an interface display module, a shared memory reading module, and a web communication module:

[0006] The data processing module is used to store an offline map web page and an aircraft model, and respond to requests for the offline map web page and the aircraft model sent by the interface display module;

[0007] The interface display module includes a web page display module and a display control module. The display control module is used to send requests for calling and replacing the offline map web page and the aircraft model to the data processing module; the web page display module is similar to the function of a web browser and is used to display the offline map web page and the movement of the aircraft model;

[0008] The shared memory reading module is used to read and store the aircraft data stored in the shared memory area of the hardware-in-the-loop real-time simulation system. The aircraft data includes position and attitude information and various flag bits, where the various flag bits include a missile plug-off separation flag bit, an engine shutdown flag bit, an engine separation flag bit, a missile hit flag bit, and a missile self-destruction flag bit, and the current aircraft model actions are indicated by the various flag bits;

[0009] A web communication module, which is used to read the aircraft data stored in the shared memory reading module and send the read aircraft data to the offline map web page to drive the aircraft model to move in the offline map.

[0010] In a second aspect, a method for real-time display of a simulation system visual scene based on Qt and an offline 3D map includes:

[0011] Set up a web server, establish an offline map web page, and store the offline map web page and the aircraft model in the web server;

[0012] Set up a shared memory area in the hardware-in-the-loop real-time simulation system, and store the output data into the shared memory area in real time according to the interface determined by the protocol;

[0013] Use the interface display module to retrieve the offline map web page, import the aircraft model on the offline map web page, read the aircraft position and attitude information from the shared memory area through the shared memory reading module, output it to the offline map web page through the web communication module, and drive the aircraft model to move in the offline map.

[0014] In a third aspect, a device for real-time display of a simulation system visual scene based on Qt and an offline 3D map includes:

[0015] One or more processors;

[0016] A storage device for storing one or more programs,

[0017] When the one or more programs are executed by the one or more processors, the one or more processors implement the method for real-time display of a simulation system visual scene based on Qt and an offline 3D map according to any one of claims 6 to 9.

[0018] According to the device and method for real-time display of a simulation system visual scene based on Qt and an offline 3D map provided by the present invention, the following beneficial effects are achieved:

[0019] The device and method for real-time display of a simulation system visual scene based on Qt and an offline 3D map provided by the present invention realize the simulation visual scene display through a three-dimensional map by establishing a website and an offline map, and use Qt to solve the function of information interaction between the hardware-in-the-loop real-time simulation system and the web page, thereby solving the problem of real-time visual scene display of an offline map in hardware-in-the-loop simulation, and can cooperate with the hardware-in-the-loop simulation system to more intuitively display the flight effect of the aircraft, providing a new feasible solution for the visual scene display of hardware-in-the-loop simulation. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 For the implementation manner of the present invention;

[0021] Figure 2 It is the simulation data interaction logic diagram of the present invention;

[0022] Figure 3 It is the main program operation logic diagram of the display device of the present invention;

[0023] Figure 4 It is the operation logic diagram of the offline map web program of the display device of the present invention;

[0024] Figure 5 It is the state of the display device of the present invention when the aircraft is not launched;

[0025] Figure 6 It is the state of the launch rack before launch of the display device of the present invention;

[0026] Figure 7 It is the off-orbital state of the aircraft of the display device of the present invention;

[0027] Figure 8 It is the engine separation state of the aircraft of the display device of the present invention;

[0028] Figure 9 It is the flight state of the aircraft of the display device of the present invention;

[0029] Figure 10 It is the state of the engine wreckage falling of the display device of the present invention;

[0030] Figure 11 It is the landing state of the aircraft of the display device of the present invention;

[0031] Figure 12 It is the self-destruction state of the aircraft explosion of the display device of the present invention. Detailed implementation manners

[0032] The present invention will be described in detail below, and the features and advantages of the present invention will become clearer and more definite with these descriptions.

[0033] The special term "exemplary" here means "serving as an example, embodiment or illustrative". Any embodiment described as "exemplary" here does not have to be construed as superior or better than other embodiments. Although various aspects of the embodiments are shown in the drawings, the drawings do not have to be drawn to scale unless otherwise specified.

[0034] The current real-time display of the three-dimensional view of the flight state of the aircraft based on the map needs to be realized in a networked environment. Therefore, the present invention determines to build an offline map and use the form of a web page to realize the display based on the offline map Figure 3Visual scene simulation is used to ensure the normal operation of the simulation task and meet the requirement of not connecting to the Internet at the same time. The 3D visual display runs in the form of an html web page. Therefore, how to send the position and attitude information output by the hardware-in-the-loop real-time simulation system into the web page and continuously update it to drive the movement of the aircraft model is another problem to be solved. For this reason, the present invention uses Qt to solve the function of information interaction between the hardware-in-the-loop real-time simulation system and the web page. The specific solution is described as follows.

[0035] According to the first aspect of the present invention, there is provided a real-time visual display device for a simulation system based on Qt and an offline 3D map, as Figure 1 shown, which includes a data processing module, an interface display module, a shared memory reading module, and a web page communication module:

[0036] The data processing module includes a Web server, which is built with Apache software and is used to store the offline map web page and the aircraft model, and respond to the requests for the offline map web page and the aircraft model sent by the interface display module; among them, the offline map web page is written in html form. By using this method, multiple models can be loaded and driven to move on the offline map at the same time, so as to ensure the requirements of various hardware-in-the-loop simulation demonstrations;

[0037] The interface display module includes a web page display module and a display control module. The display control module is used to send requests to call and replace the offline map web page and the aircraft model to the data processing module; the web page display module is similar to the function of a web browser and is used to display the offline map web page and the movement of the aircraft model;

[0038] The shared memory reading module is used to read and store the aircraft data output by the hardware-in-the-loop real-time simulation system. The aircraft data includes position and attitude information and various flag bits, so as to complete the information interaction between the hardware-in-the-loop real-time simulation system and the real-time display device; the various flag bits include missile unplugging and separation flag bits, engine shutdown flag bits, engine separation flag bits, missile hit flag bits, missile self-destruction flag bits, and program exit flag bits, and the current actions of the aircraft model are indicated by the various flag bits;

[0039] The web page communication module is used to send the read aircraft data into the offline map web page to drive the movement of the aircraft model in the offline map.

[0040] Figure 2It is a logic diagram for data interaction in hardware-in-the-loop simulation. The shared memory area is an independently allocated memory block, which is created by the hardware-in-the-loop real-time simulation system and stores the output data into the shared memory area in real time according to the interface determined by the protocol. When the shared memory reading module in the visual real-time display device runs, it will open the shared memory space and read the data, store it in its own memory, and then transmit the array to the offline map web page through the web communication module, driving the aircraft model in the offline map to fly according to the determined flight state.

[0041] In the present invention, the interface display module and the shared memory reading module are compiled and generated using Qt. The web communication module uses the QWebChannel function in Qt to realize the data communication between the interface display module, the shared memory module and the offline map web page. The operation of QWebChannel is used to output the aircraft position and attitude information to the html web page file, thereby driving the real-time movement of the aircraft and solving the problem that the html file needs to update the model data.

[0042] In the present invention, the interface display module further includes a parameter display module, and the parameter display module displays the position and attitude parameters of the aircraft model.

[0043] In the present invention, the shared memory reading module includes a data reading module and a first timer module. The data reading module periodically reads the aircraft data in the shared memory area of the hardware-in-the-loop real-time simulation system under the drive of the first timer module. For example, the first timer module drives the data reading module to read the aircraft data in the shared memory area of the hardware-in-the-loop real-time simulation system every 1 ms.

[0044] Figure 3 It is a running logic diagram of the visual real-time display device. After running, the program initializes and starts to call the offline map web page in the web server. Then the first timer module runs, and the data reading module first reads the data in the shared memory area and stores it in the memory space. Then it determines the program exit flag in the shared memory module. If the hardware-in-the-loop real-time simulation system sends an exit program flag, the program exits the operation; if not, the read aircraft data is put into an array and output to the offline map web page by the web communication module.

[0045] In the present invention, the web communication module includes a data transmission module and a second timer module. The data transmission module periodically reads the aircraft data stored in the shared memory reading module under the drive of the second timer module and outputs the aircraft data to the offline map web page. For example, the second timer module drives the data transmission module to output the aircraft data to the offline map web page every 5 ms.

[0046] Figure 4This is the logic diagram of an html web page program. First, an offline map is created, arrays and various values are initialized, and an aircraft model is imported. The second timer module starts running, and the data transmission module continuously updates the status of the aircraft, such as effects like engine detachment and aircraft explosion. At the same time, it also continuously updates the position and attitude of the aircraft to achieve the effect of the aircraft moving in the offline map.

[0047] Figures 5 to 12 This display device is in the three-dimensional visual display state for a certain hardware-in-the-loop simulation experiment. After the device runs, the display control module in the interface display module requests the offline map web page and the aircraft model. The web page display module displays the offline map, and the initial display state is as Figure 5 shown. When the ready-to-launch command and the launch angle are transmitted from the hardware-in-the-loop real-time simulation system, they are transmitted to the offline map web page through the shared memory reading module and the web page communication module, and the launch rack model starts to move as Figure 6 . When the launch command is transmitted, it is transmitted to the offline map web page through the shared memory reading module and the web page communication module, and the aircraft model is launched. According to the current state sent by the hardware-in-the-loop simulation system, the current aircraft model is selected and an example special effect of the engine afterburner is added, as Figure 7 shown. After receiving the engine separation command, it is transmitted to the offline map web page through the shared memory reading module and the web page communication module. The engine model is separated from the aircraft model, and the hardware-in-the-loop simulation data is continuously obtained to drive the engine model and the aircraft model to move in the map simultaneously, as Figure 8 and Figure 9 shown. The engine model crashes as Figure 10 shown, and the landing state of the aircraft model is as Figure 11 shown. If the aircraft model flies out of the predetermined orbit during the simulation, the hardware-in-the-loop real-time simulation system sends a self-destruction command. After the web page communication module reads the self-destruction command status flag in the shared memory module, it displays the self-destruction of the aircraft model, as Figure 12 shown.

[0048] According to the second aspect of the present invention, a method for real-time visual display of a simulation system based on Qt and an offline 3D map is also provided, including:

[0049] Build a Web server, establish an offline map web page, and store the offline map web page and the aircraft model in the Web server;

[0050] Set up a shared memory area in the hardware-in-the-loop real-time simulation system, and store the output data into the shared memory area in real time according to the interface determined by the protocol;

[0051] The interface display module is used to retrieve the offline map web page, and an aircraft model is imported onto the offline map web page. The aircraft position and attitude information is read from the shared memory area by the shared memory reading module, output to the offline map web page through the web communication module, and the aircraft model is driven to move in the offline map.

[0052] According to the third aspect of the present invention, a real-time visual display device for a simulation system based on Qt and an offline 3D map includes:

[0053] One or more processors;

[0054] A storage device for storing one or more programs,

[0055] When the one or more programs are executed by the one or more processors, the one or more processors implement the real-time visual display method of the simulation system based on Qt and the offline 3D map described in the second aspect.

[0056] Those skilled in the art can clearly understand that for the convenience and brevity of description, the specific working process of the above-described device can refer to the corresponding process in the foregoing method embodiment, and will not be repeated here.

[0057] Those skilled in the art should be able to realize that in the above one or more examples, the functions described in the present invention can be implemented by hardware, software, firmware, or any combination thereof. When implemented using software, these functions can be stored in a computer-readable medium or transmitted as one or more instructions or codes on a computer-readable medium. The computer-readable medium includes computer storage media and communication media, where the communication media includes any medium that facilitates the transmission of a computer program from one place to another. The storage media can be any available medium accessible by a general-purpose or special-purpose computer, including: USB flash drives, external hard drives, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disks, or optical discs, etc., which can store program codes.

[0058] The present invention has been described in detail above in combination with specific implementation manners and exemplary examples, but these descriptions should not be construed as limiting the present invention. Those skilled in the art understand that without departing from the spirit and scope of the present invention, various equivalent substitutions, modifications, or improvements can be made to the technical solutions and implementation manners of the present invention, and these all fall within the scope of the present invention. The protection scope of the present invention is subject to the appended claims.

[0059] The content not described in detail in the specification of the present invention belongs to the well-known technology of those skilled in the art.

Claims

1. A real-time visual display device for a simulation system based on Qt and offline 3D maps, characterized in that, It includes a data processing module, an interface display module, a shared memory reading module, and a web communication module: The data processing module is used to store the offline map web page and the aircraft model, and respond to the requests for the offline map web page and the aircraft model sent by the interface display module; The interface display module is used to send requests for calling and replacing the offline map web page and the aircraft model to the data processing module, and display the offline map web page and the movement of the aircraft model; The shared memory reading module is used to read and store the aircraft data stored in the shared memory area of the hardware-in-the-loop real-time simulation system. The aircraft data includes position and attitude information and various flag bits. Among them, the various flag bits include the missile unplugging and separation flag bit, the engine shutdown flag bit, the engine separation flag bit, the missile hit flag bit, and the missile self-destruction flag bit, and the current aircraft model actions are indicated by the various flag bits; Among them, the shared memory reading module includes a data reading module and a first timer module. The data reading module regularly reads the aircraft data in the shared memory area of the hardware-in-the-loop real-time simulation system under the drive of the first timer module; The web communication module is used to read the aircraft data stored in the shared memory reading module and send the read aircraft data to the offline map web page to drive the aircraft model to move in the offline map; Among them, the web communication module includes a data transmission module and a second timer module. The data transmission module regularly reads the aircraft data stored in the shared memory reading module under the drive of the second timer module and outputs the aircraft data to the offline map web page; The interface display module and the shared memory reading module are compiled and generated by Qt; the web communication module uses the QWebChannel function in Qt to realize the data communication between the interface display module, the shared memory module and the offline map web page; the operation of QWebChannel is used to output the aircraft position and attitude information to the html web page file, so as to drive the real-time movement of the aircraft.

2. The real-time visual display device for a simulation system based on Qt and offline 3D maps according to claim 1, characterized in that, The interface display module is also used to display the real-time position and attitude parameters of the aircraft model.

3. A real-time visual display method for a simulation system based on Qt and offline 3D maps applied to the real-time visual display device for a simulation system based on Qt and offline 3D maps according to claim 1, characterized in that, It includes the following steps: Build a web server, establish an offline map web page, and store the offline map web page and the aircraft model in the web server; Set up a shared memory area in the hardware-in-the-loop real-time simulation system, and store the output data into the shared memory area in real time according to the interface determined by the protocol; Use the interface display module to call the offline map web page, import the aircraft model on the offline map web page, read the aircraft position and attitude information from the shared memory area through the shared memory reading module, and output it to the offline map web page through the web communication module to drive the aircraft model to move in the offline map.

4. The real-time visual display method for a simulation system based on Qt and offline 3D maps according to claim 3, characterized in that, The web communication module uses the QWebChannel function in Qt to implement the data communication between the interface display module, the shared memory module and the offline map web page.

5. The real-time visual display method for a simulation system based on Qt and offline 3D maps according to claim 3, characterized in that, The shared memory reading module regularly reads the aircraft data in the shared memory area of the hardware-in-the-loop real-time simulation system.

6. The real-time visual display method for a simulation system based on Qt and offline 3D maps according to claim 3, characterized in that, The web communication module regularly reads the aircraft data stored in the shared memory reading module and outputs the aircraft data to the offline map web page.

7. A real-time visual display device for a simulation system based on Qt and offline 3D maps, characterized in that, It includes: One or more processors; A storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the method for real-time display of the simulation system view based on Qt and offline 3D maps according to one of claims 3 to 6.

Images