Hierarchical situation management system and method

Abstract

The invention discloses a situation hierarchical management system and method. The system comprises a display control terminal module, an online module, a playback module and a display module. The display control terminal module is in data connection with the online module and the playback module and is used for receiving and processing simulation data output by a simulation engine or playback data of the playback module; the online module is in data connection with the display control terminal module and the display module and is used for controlling the display module; the playback module is in data connection with the display control terminal module and the display module and is used for playing back, displaying and controlling the simulation test result; and the display module is in data connection with the playback module and the online module and is used for displaying the data. According to the method, situation drawing and control management are separated by adopting a layered framework, so that calling of double-engine drawing can be met only by realizing a set of control management modules.

Description

Technical Field

[0001] The present invention relates to the technical field of situation display, and in particular to a situation hierarchical management system and method. Background Art

[0002] In an information-based environment, clearly and accurately grasping situational information and providing timely feedback are key factors for success. Situational simulation systems are important platforms for conducting drills. The development of artificial intelligence and big data technologies provides new technical means for solving intelligent situation estimation problems. Due to the scarcity of real-world cases and the difficulty in obtaining battlefield situation data, situation estimation research can be carried out by relying on experimental data generated by simulation systems. With the development of geographic information systems and graphics engine technologies, the technical implementation of situational simulation systems has made certain progress. However, a reasonable design system for the presentation of situational information and interactive design has not yet been established. Therefore, research on simulated situation display from the perspective of human-computer interaction is of great significance. Summary of the Invention

[0003] The technical problem to be solved by the present invention is to provide a hierarchical situation management system and method, which includes a display and control terminal module, an online module, a playback module and a display module; it can receive situation data and various control instructions and other information pushed by the simulation engine subsystem and the resource management subsystem, support three situation display modes including full-scene situation display, local display and single situation display, can play back simulation data, and provide the display and control terminal with a variety of visual styles to display information and modify status and parameters.

[0004] In order to solve the above technical problems, the first aspect of the embodiment of the present invention discloses a situation hierarchical management system, which includes a display and control terminal module, an online module, a playback module and a display module;

[0005] The display and control terminal module is data-connected to the online module and the playback module, and is used to receive and process the simulation data output by the simulation engine or the playback data of the playback module;

[0006] The online module is data-connected with the display and control terminal module and the display module, and is used to control the display module;

[0007] The playback module is data-connected to the display and control terminal module and the display module, and is used to playback, display and control the simulation test results;

[0008] The display module is connected to the playback module and the online module for displaying data.

[0009] As an optional implementation manner, in the first aspect of the embodiment of the present invention, the display and control terminal module includes a data processing submodule, a terminal display and control submodule, a universal display submodule and a playback control submodule;

[0010] The data processing submodule is used to receive and process real-time data and offline playback data;

[0011] The terminal display and control submodule is used to display data;

[0012] The generalized display submodule is used to display the processed data on the terminal interface in a generalized manner;

[0013] The playback control submodule is used to control and operate the data playback process.

[0014] As an optional implementation manner, in the first aspect of the embodiment of the present invention, the online module includes a data connection submodule, a real-time online control submodule, an online display submodule and a window setting submodule;

[0015] The data induction submodule is a thread that runs in the background without user interaction and is used to monitor whether external data arrives at a designated port;

[0016] The real-time online control submodule is used for real-time data interaction and communication between the user and the system;

[0017] The online display submodule is used for situation display;

[0018] The window setting submodule is used to define the window layout and view angle adjustment.

[0019] As an optional implementation manner, in the first aspect of the embodiment of the present invention, the playback module includes a playback data processing submodule, a playback control submodule, a playback display submodule and a playback display configuration submodule;

[0020] The playback data processing submodule is used to process historical data;

[0021] The playback control submodule is used to provide a control function for the playback process;

[0022] The playback and display submodule is used to playback and display the processed historical data;

[0023] The playback display configuration submodule is used to configure the parameters and settings of the playback display.

[0024] As an optional implementation manner, in the first aspect of the embodiment of the present invention, the display module includes a situation processing submodule, a two-dimensional and three-dimensional situation display submodule, a layered and domain management submodule, and a picture image display submodule;

[0025] The situation processing submodule is used to receive and process situation data;

[0026] The two-dimensional and three-dimensional situation display submodule is used to display the processed situation data;

[0027] The hierarchical and domain management submodule is used to distinguish and manage situations;

[0028] The picture image display submodule is used to display picture image data.

[0029] A second aspect of an embodiment of the present invention discloses a situation hierarchical management method, the method comprising:

[0030] S1, using the online module to receive the situation information of the simulation engine and simulation model;

[0031] S2, processing the situation information using an online module to obtain a situation estimation result;

[0032] S3, sending the situation information and the situation estimation result to a display module for display;

[0033] S4, using the playback module, loading the playback file, and playing back, displaying, and controlling the simulation test results;

[0034] S5, using the display and control terminal module, processes the simulation data output by the simulation engine and the display and control playback data to obtain the situation simulation results.

[0035] As an optional implementation manner, in the second aspect of the embodiment of the present invention, the processing of the situation information by an online module to obtain a situation estimation result includes:

[0036] S21, acquiring situation estimation sample data information; the situation estimation sample data information includes environmental data information, combat unit data information and historical data information; the combat unit data information includes enemy combat unit data information and our combat unit data information;

[0037] S22, performing situation analysis on the situation estimation sample data information to obtain situation feature information;

[0038] S23, processing the situation feature information to obtain situation graph structure information; the situation graph structure information includes a static information layer, an experience information layer, and a dynamic information layer;

[0039] S24, processing the situation graph structure information to obtain situation feature parameters;

[0040] S25, processing the situation characteristic parameters to obtain a situation estimation result.

[0041] As an optional implementation manner, in the second aspect of the embodiment of the present invention, performing situation analysis on the situation estimation sample data information to obtain situation feature information includes:

[0042] S221, performing situation analysis on the combat terrain map in the environmental data information to obtain N grid structures;

[0043] S222, setting a plurality of layers representing data attribute information in the grid structure, and representing the environmental data information as an image pixel matrix;

[0044] S223 , representing the combat unit data information using different grid layers according to the image pixel matrix to obtain situation feature information.

[0045] As an optional implementation, in the second aspect of the embodiment of the present invention, the use of the playback module to load the playback file and playback, display, and control the simulation test results includes:

[0046] S41, using the playback data processing submodule to receive external playback information; the external playback information includes playback data, playback control instructions and display configuration data;

[0047] S42, processing the external playback information to obtain a playback processing result;

[0048] S43, classifying the playback processing result to obtain category information; the category information includes first category information and second category information;

[0049] S44, controlling the first category of information using a playback control submodule;

[0050] S45: Utilize the playback display submodule and the playback display configuration submodule to playback and display the second category information.

[0051] As an optional implementation, in the second aspect of the embodiment of the present invention, the use of the display and control terminal module to process the simulation data output by the simulation engine and the display and control playback data to obtain the situation simulation results includes:

[0052] S51, using the data processing submodule to receive simulation data and display and control playback data output by the simulation engine;

[0053] S52, parsing the simulation data output by the simulation engine to obtain parsed data information;

[0054] S53, verifying the validity of the parsed data information, and sending the data information that passes the validity verification to the terminal display and control submodule for display;

[0055] S54: Process the display and playback data using the universal display submodule and the playback control submodule to obtain a situation simulation result.

[0056] Compared with the prior art, the embodiments of the present invention have the following beneficial effects:

[0057] The present invention discloses a hierarchical situation management system and method, which includes a display and control terminal module, an online module, a playback module and a display module; it can receive situation data and various control instructions pushed by a simulation engine subsystem and a resource management subsystem, support three situation display modes including full-scene situation display, local display and single situation display, can play back simulation data, and provide a display and control terminal with a variety of visual styles to display information and modify status and parameters. BRIEF DESCRIPTION OF THE DRAWINGS

[0058] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0059] Figure 1 This is a schematic diagram of the structure of a situation hierarchical management system disclosed in an embodiment of the present invention;

[0060] Figure 2 It is the online module structure disclosed in the embodiment of the present invention;

[0061] Figure 3 This is the online module processing flow disclosed in the embodiment of the present invention;

[0062] Figure 4 This is the execution process of the data connection submodule disclosed in the embodiment of the present invention;

[0063] Figure 5 It is a display element type supported by the online display submodule disclosed in the embodiment of the present invention;

[0064] Figure 6 This is the execution process of the online display submodule disclosed in the embodiment of the present invention;

[0065] Figure 7 This is the playback module structure disclosed in the embodiment of the present invention;

[0066] Figure 8 This is the playback module process disclosed in the embodiment of the present invention;

[0067] Figure 9 This is the display and control terminal module structure disclosed in the embodiment of the present invention;

[0068] Figure 10 This is the display and control terminal module process disclosed in the embodiment of the present invention;

[0069] Figure 11 It is the display module structure disclosed in the embodiment of the present invention;

[0070] Figure 12 This is the display module processing flow disclosed in the embodiment of the present invention;

[0071] Figure 13 It is the external interface structure disclosed in the embodiment of the present invention;

[0072] Figure 14 This is a flowchart of a situation hierarchical management method disclosed in an embodiment of the present invention;

[0073] Figure 15 This is a flowchart of another situation hierarchical management method disclosed in an embodiment of the present invention. DETAILED DESCRIPTION

[0074] In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making any creative efforts shall fall within the scope of protection of the present invention.

[0075] The terms "first," "second," and so on, in the description and claims of the present invention and the accompanying drawings are used to distinguish between different objects, not to describe a specific order. Furthermore, the terms "including," "having," and any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, apparatus, product, or device comprising a series of steps or elements is not limited to the listed steps or elements but may optionally include steps or elements not listed, or may optionally include other steps or elements inherent to the process, method, product, or device.

[0076] References herein to "embodiments" mean that a particular feature, structure, or characteristic described in connection with the embodiments may be included in at least one embodiment of the present invention. The appearance of this phrase in various places in the specification does not necessarily refer to the same embodiment, nor does it constitute a separate or alternative embodiment that is mutually exclusive of other embodiments. It is understood, both explicitly and implicitly, by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0077] The present invention discloses a simulation situation display system and method, which includes a display and control terminal module, an online module, a playback module and a display module; the display and control terminal module is data-connected with the online module and the playback module, and is used to receive and process simulation data output by the simulation engine or playback data of the playback module; the online module is data-connected with the display and control terminal module and the display module, and is used to control the display module; the playback module is data-connected with the display and control terminal module and the display module, and is used to playback, display and control simulation test results; the display module is data-connected with the playback module and the online module, and is used to display data. The present invention adopts a layered architecture to separate the situation drawing from the control management, so that only one set of control management modules needs to be implemented to meet the call of dual-engine drawing. The following are detailed descriptions.

[0078] Example 1

[0079] See also Figure 1 , Figure 1 This is a schematic diagram of the structure of a situation hierarchical management system disclosed in an embodiment of the present invention. Figure 1 The described situation hierarchical management system is applied to the field of situation display technology, which is not limited in the embodiment of the present invention. Figure 1 As shown, the situation hierarchical management system includes a display and control terminal module, an online module, a playback module and a display module;

[0080] The display and control terminal module is data-connected to the online module and the playback module, and is used to receive and process the simulation data output by the simulation engine or the playback data of the playback module;

[0081] The online module is data-connected with the display and control terminal module and the display module, and is used to control the display module;

[0082] The playback module is data-connected to the display and control terminal module and the display module, and is used to playback, display and control the simulation test results;

[0083] The display module is connected to the playback module and the online module for displaying data.

[0084] Optionally, the display and control terminal module includes a data processing submodule, a terminal display and control submodule, a universal display submodule and a playback control submodule;

[0085] The data processing submodule is used to receive and process real-time data and offline playback data;

[0086] The terminal display and control submodule is used to display data;

[0087] The generalized display submodule is used to display the processed data on the terminal interface in a generalized manner;

[0088] The playback control submodule is used to control and operate the data playback process.

[0089] Optionally, the online module includes a data connection submodule, a real-time online control submodule, an online display submodule and a window setting submodule;

[0090] The data induction submodule is a thread that runs in the background without user interaction and is used to monitor whether external data arrives at a designated port;

[0091] The real-time online control submodule is used for real-time data interaction and communication between the user and the system;

[0092] The online display submodule is used for situation display;

[0093] The window setting submodule is used to define the window layout and view angle adjustment.

[0094] The online module structure is as follows Figure 2 As shown, the online module processing flow is as follows Figure 3 As shown in the figure, the online module adopts a layered architecture. Each submodule interacts and collaborates through defined interfaces and communication mechanisms to ensure system stability and efficiency. The online module receives external real-time simulation data, online control instructions, control data, and window control instructions through the data interface submodule. After parsing, the data is passed to the internal submodules, such as the online display submodule, the real-time online configuration submodule, and the window setting submodule, for processing, or sent to external modules or systems, depending on the data type.

[0095] The data interface module is a thread that runs in the background without user interaction. It monitors the arrival of external data at the specified port. The execution process is as follows: Figure 4 The data connection submodule reads the port to be monitored from the configuration file and checks whether the communication port is occupied by other processes. If so, it prompts the user that the configured port is occupied and exits the submodule. If not, it starts a data monitoring thread at the read port to monitor external data. After the data arrives and is processed, it is handed over to a specific submodule for processing. If the execution is completed and the module does not exit, it continues to monitor whether data arrives.

[0096] The online display submodule can display a variety of elements on a 2D / 3D display. The supported display element types include Figure 5 The online display submodule receives data from the data interface submodule and calls the visual engine to perform different visual renderings according to the type of data. The execution process is as follows: Figure 6 The core functional design of the online display submodule is as follows:

[0097] Real-time dynamic display of the entire test situation: the displayed content includes all entity names, entity enemy and friend attributes, entity locations, communication relationships between entities, confrontational relationships between entities, entity movement trajectories, communication effect diagrams, interference effects and other information.

[0098] Display function: It can display the selected situation information by selecting a frame with the mouse.

[0099] Single situation display: Displays detailed information of the selected equipment in a table in the display list, including basic information (such as name, attributes, type), posture information, working status and working parameters; the selected situation information can be observed by following the perspective.

[0100] Display of key events for both red and blue parties: Key events for both red and blue parties are displayed in a scrollable list, with events arranged in reverse chronological order;

[0101] Configure online display content: Configurable content includes the elements that need to be displayed and the display effects of the elements. Display elements include name, range, height, etc., and the display effects include color, width, and highlight. After configuration is completed, the configuration content can be saved to the configuration file for next call;

[0102] Load online display configuration file: display elements and element display effects according to the content of the loaded configuration file;

[0103] Sample files for display configuration: Two sample configuration files are provided, namely, a parabola display configuration file and a power range display configuration file;

[0104] Display content filtering: You can filter the two-dimensional / three-dimensional situation display content by red, blue, or white, or you can display only the selected elements as needed.

[0105] The real-time online control submodule supports real-time data interaction and communication between users and the system, helping users to control the real-time situation. The core functions of the real-time online control submodule are designed as follows:

[0106] Real-time online observation process control: controllable functions include start, pause and stop functions;

[0107] 2D and 3D situation control: including zooming in, zooming out, dragging and roaming, measurement (angle measurement, distance measurement, area measurement), etc.

[0108] Control of the display window: including scaling, dragging, docking and hiding operations;

[0109] It has the extended function of displaying content in the situation data display window and message window;

[0110] Display elements and display effects can be displayed or hidden as needed.

[0111] The Window Settings submodule allows users to customize the window layout and adjust the viewing angle. The core functions of the Window Settings submodule are designed as follows:

[0112] Provides the function of setting multiple windows in red, blue and white for one simulation task;

[0113] A simulation task supports a maximum of 50 seats of windows accessing at the same time;

[0114] The content displayed in the windows of different seats can be different.

[0115] Table 1 Online module input and output table

[0116] Serial number Interface Name Interface Type Sender / Receiver 1 Real-time simulation data External interface Simulation engine subsystem / online module 3 Real-time online control data External interface User / Online Module 4 Window Control Data External interface User / Online Module 5 Control instructions and data External interface Display and control terminal module / online module 6 Control instructions and data External interface Online module / simulation engine subsystem 10 Simulating real-time data External interface Simulation engine subsystem / online module 12 Image data External interface Resource management subsystem / online module

[0117] Optionally, the playback module includes a playback data processing submodule, a playback control submodule, a playback display submodule, and a playback display configuration submodule;

[0118] The playback data processing submodule is used to process historical data;

[0119] The playback control submodule is used to provide a control function for the playback process;

[0120] The playback and display submodule is used to playback and display the processed historical data;

[0121] The playback display configuration submodule is used to configure the parameters and settings of the playback display.

[0122] Playback module such as Figure 7 The playback module receives external playback data, playback control instructions, and display configuration data through the playback data processing submodule. After parsing, it is handed over to the playback display submodule, playback control submodule, or display configuration submodule for processing based on different data types to complete the loading of playback data, playback control, and playback display content control. The playback module processing flow is shown in the figure below. Figure 8 shown.

[0123] The playback data processing submodule parses historical data, extracts key information and events, preprocesses the parsed data, and calls the playback control submodule for processing. The core functional design of the playback data processing submodule is as follows:

[0124] Load and parse playback files and perform validity verification. The playback data that passes the validity verification will be cached locally. For playback data that fails the validity verification, a pop-up window will be displayed to notify the user of the format error.

[0125] Read, load, and parse playback display configuration data, and call the playback display submodule for processing after the data is completed;

[0126] Unpack and parse the playback control instruction data, and call the playback control submodule for processing after the processed playback control instruction.

[0127] The playback display submodule plays back and displays the processed historical data. The core functions of the playback display submodule are designed as follows:

[0128] It has the function of configuring the 2D / 3D situation display content according to the playback display configuration data, and can configure the display elements and display effects of the 2D / 3D situation according to the playback display configuration data;

[0129] Provides 3 situation display mode buttons / menu items. During playback, you can click the display mode button / menu to switch between different display modes. It supports three display modes: panoramic situation display, local situation display and single situation display.

[0130] The playback control submodule provides users with control over the playback process. The core functions of the playback control submodule are designed as follows:

[0131] The offline observation process can be controlled, providing operations such as start, pause, and end. The playback progress can be dragged to the desired position, and 5 playback speed controls are provided: 1x speed, 2x speed, 4x speed, 1 / 2x speed, and 1 / 4x speed.

[0132] During playback, time jump playback is supported. You can enter the playback time to jump to. If the validity verification passes, the playback will be adjusted to the playback time. If it fails, the user will be prompted to enter an invalid playback position and the playback position will remain unchanged.

[0133] Provides two display modes for the play button control window and content window: one is a combined display mode of the play control button and content window, and the other is an independent display mode of the play control button and content window;

[0134] It has the function of controlling the display elements and display effects, and can display or hide them as needed.

[0135] The playback display configuration submodule allows users to configure the playback display parameters and settings. The core functions of the playback display configuration submodule are designed as follows:

[0136] It has the function of configuring playback display content. The configurable content includes the elements that need to be displayed and the display effects of the elements. The display elements include name, range, height, etc. The display effects include color, width, and highlight. After the configuration is completed, the configuration content can be saved to the configuration file for next call;

[0137] It has the function of loading playback display configuration files, and displays elements and element display effects according to the contents of the loaded configuration files;

[0138] Two sample playback configuration files are provided: a parabola display and a power range playback configuration file. The input and output of the playback module are shown in Table 2.

[0139] Table 2 Input and output table of playback module

[0140] Serial number Interface Name Interface Type Sender / Receiver 1 Replay data External interface Resource management subsystem / playback module 2 Playback control instructions External interface User / Playback Module 3 Playback display configuration data External interface Resource management subsystem / playback module

[0141] The display and control terminal module receives the simulation data output by the simulation engine in real-time online mode or receives the display and control playback data in offline mode afterwards; it displays the performance parameters and working status information, display and control work interface, relevant key events and other data in a visual form. The display and control terminal module includes a data processing submodule, a terminal display and control submodule, a general display submodule and a playback control submodule. The structure is as follows: Figure 9 The processing flow of the display and control terminal module is as follows: Figure 10 shown.

[0142] The display and control terminal module receives external real-time data, playback data, control instructions and data, and playback process control data through the data processing sub-module. After parsing, it is handed over to the playback control sub-module, terminal display and control sub-module or universal display sub-module for processing according to different data types to complete the loading of data, playback control and display content control; the user's modification data on status and performance is sent to the online module through the terminal display and control sub-module in the form of encapsulated control instruction data and encapsulated control data, which are then sent to the simulation engine subsystem by the online module to complete the modification of the corresponding model.

[0143] The data processing submodule is responsible for receiving real-time data from the data interface submodule of the online module and offline playback data from the resource management subsystem, parsing the received data, extracting key information, and converting the parsed data into a format that can be used within the system for subsequent processing and display. The core functional design of the data processing submodule is as follows:

[0144] Load, parse and validate playback data. Replay data that passes validation can be cached locally. For playback data that fails validation, a pop-up window will be displayed to notify the user of format errors.

[0145] Unpack and parse the playback control instruction data, and call the playback control submodule for processing after the playback control instruction is processed;

[0146] The user's operations on the terminal display and control interface are parsed and interpreted as corresponding working mode and working parameter control instructions, which are sent to the simulation engine subsystem for processing to control the model's working mode and working parameters.

[0147] The terminal display and control submodule is designed with an intuitive and friendly terminal interface, which displays data in real time in the form of charts or images and supports real-time operation and control by users. The core functions of the terminal display and control submodule are designed as follows:

[0148] Develop the display and control terminal interface component based on WebGL, and drive the display of the display and control terminal interface according to the received simulation data;

[0149] Based on eChart charts and other controls, it displays basic information and working status of the simulation scenario. The display styles include curves, status lights, property boxes and other visual forms.

[0150] Develop interface components such as oscilloscopes and spectrum analyzers based on WebGL to display battlefield electromagnetic signals based on received simulation data;

[0151] Based on eChart charts, text boxes, property boxes and other controls, the key events of the red and blue sides during the simulation process or playback can be viewed and displayed in the form of graphics, text, tables, etc.

[0152] The above display modes all provide editing functions. Users can modify the state working parameters or performance parameters by clicking on the interface, modifying the attribute values, etc. The modified data can be sent to the simulation engine through the data processing submodule to realize the function of modifying the state and working performance through the display and control interface;

[0153] The universal display submodule displays the processed data in a universal manner on the terminal interface. The core functions of the universal display submodule are designed as follows:

[0154] Develop general display controls such as LDA display and P display based on WebGL. LDA display is used to display CFAR detection result data; LDP display is used to display target distance, direction, track and other information;

[0155] Develop dedicated data display controls based on eChart charts and other controls to support the display of reconnaissance data, jamming guidance data, and other data;

[0156] Develop a time-frequency graph display control based on the eChart chart control to display the received signal time-frequency data to support the signal time-frequency effect analysis function;

[0157] The above display controls are managed using the Vue / React layout manager, which supports horizontal, vertical, table and other layout styles, and can support the function of adjusting the layout of display elements;

[0158] Each type of display control defines a standard data input interface and associates it with the corresponding display control by index. Each control only receives and processes data with the specified ID to implement the binding function between the universal display element and the data source. The data from the data source can be used to drive the refresh of the universal display element.

[0159] The playback control submodule supports the control and operation of the data playback process. The core functions of the playback control submodule are designed as follows:

[0160] Playback control command input controls such as slide controls and text boxes support control of playback speed and display frame rate. The playback speed can reach up to 5.0 times the speed, and the display frame rate can be controlled to a refresh rate of 25 frames.

[0161] It can support a single playback of 2GB of data. The input and output of the terminal display and control module are shown in Table 3.

[0162] Table 3 Input and output table of terminal display and control module

[0163] Serial number Interface Name Interface Type Sender / Receiver 1 Control instructions and data External interface Online module / display and control terminal module 2 Simulating real-time data External interface Online module / display and control terminal module 3 Replay data External interface Playback module / display and control terminal module 4 Playback process control instructions External interface Playback module / display and control terminal module

[0164] Optionally, the display module includes a situation processing submodule, a two-dimensional and three-dimensional situation display submodule, a layered and domain management submodule, and a picture and image display submodule;

[0165] The situation processing submodule is used to receive and process situation data;

[0166] The two-dimensional and three-dimensional situation display submodule is used to display the processed situation data;

[0167] The hierarchical and domain management submodule is used to distinguish and manage situations;

[0168] The picture image display submodule is used to display picture image data.

[0169] The display module receives simulation data output by the simulation engine in the real-time online module or receives playback data in the playback mode, and displays data such as the system confrontation large scene in a two-dimensional or three-dimensional visual form.

[0170] Display module structure as Figure 11 As shown, the processing flow is as follows Figure 12 shown.

[0171] After the display module is started, it first reads the configuration file and loads the required resources to complete the module initialization, and then enters the data processing sub-module. This module is a background thread that runs all the time and monitors whether there is external data or control instructions arriving. After the external data or control instructions arrive, they are parsed and the corresponding sub-module is called for processing based on the data type. If it is a control instruction, after executing the control instruction, the rendering engine is driven to refresh the interface display. If it does not exit, it continues to monitor whether there is external data arriving. If it exits, the thread is closed and the sub-module exits.

[0172] The display module receives the real-time simulation data, playback data, control instructions, image data and control data of the online module through the data processing submodule. After parsing, it is handed over to the two-dimensional / three-dimensional situation display submodule, the layered and domain management submodule or the image display submodule for processing according to different data types to complete the two-dimensional / three-dimensional display of static and dynamic effects, automatic roaming of three-dimensional scenes, scene switching and data export and other functions.

[0173] The situation processing submodule receives the data stream and parses and processes it in real time, and calls the corresponding submodule for processing according to the type of the processed simulation situation data.

[0174] The 2D / 3D situation display submodule renders and displays the processed data in graphics. Users can freely adjust the viewing angle, zoom, and other parameters of the display interface, and can add annotations and descriptions to the displayed data to provide more detailed information and guidance. The core functional design of the 2D / 3D situation display submodule is as follows:

[0175] A switch button between global perspective and focus perspective is provided for switching between the two perspectives; the panoramic situation of multiple missiles can be viewed through the global perspective;

[0176] Provides automatic positioning of the 3D viewport and automatic roaming of the 3D scene, and can complete automatic roaming of the 3D scene according to the set route;

[0177] Through data integration and operational integration, it supports the display of system confrontation (including basic information, current status and strength of force and weapon entities, as well as large-scale natural environment, fixed facilities, electromagnetic environment, etc.), communication, mobility, firepower confrontation, electromagnetic confrontation and other processes and effects in the form of two-dimensional / three-dimensional linkage;

[0178] It can display different combat elements in a variety of display styles, including military symbols, names, detection ranges, killing ranges, path points, command and control relationships, network relationships, areas, trajectory lines, tracking lines, navigation lines, detection lines, trajectory points, engagement lines, interference information, communication information, area information, and network information.

[0179] The hierarchical and domain management submodule realizes situation differentiation and management by dividing the battlefield into different aspects such as friendly and enemy; realizes hierarchical display and management of situation by dividing the battlefield into different levels such as high level, middle level and low level; realizes domain-based display and management of situation by dividing the battlefield into different areas such as sea, land and air. The core functional design of the hierarchical and domain management submodule is as follows:

[0180] Use INI or XML data formats as configuration files to record visibility control rules. By reading the visibility control rule file, you can configure the visibility of various situation information. Support visibility operations on single elements such as scene elements and special effect elements. The visibility control rule file can be exported and imported.

[0181] Provides situation display control function, which can perform operations such as zooming and dragging on the situation;

[0182] Provides customized detail display functions such as small scenes and viewpoint tracking, supports switching between large and small scenes, and can view, display and print key events in graphics, text, tables, etc.

[0183] Provides three display modes, including the combination of 2D and 3D, the combination of static and dynamic data, and the combination of graphics and data;

[0184] Through LOD technology, terrain elevation and texture data are divided into LODs. The corresponding level of terrain data can be loaded according to the viewpoint distance to improve the terrain data loading speed and realize the function of switching the display of scene terrain elevation and texture data with different levels of detail according to distance; when clicking on a model in the scene, the ID, enemy, and other basic information of the relevant entity, as well as motion status information such as position and posture can be displayed through the property box or label; the table display control provides the display and hiding control function of rows and columns, as well as the function of exporting data of specified rows or columns to CSV files or key events; the use of controls such as tables supports the display of key events, and the displayed content includes information such as event classification, event priority, and event content. The predefined event types include maneuver events, equipment work events, and task events.

[0185] The core functions of the image display submodule are as follows: it can load and display global elevation data with a resolution of 120 meters; it provides elevation data expansion, allowing for the addition of high-resolution elevation data as needed; it loads and displays global multi-resolution image data with a fine texture of 200 meters; it provides image data expansion, allowing for the addition of high-resolution image data as needed; it can display maps at an average of 25 frames per second in 3D map display mode; it can display 2000 batches of moving targets at a data rate of 1 Hz in 2D map display mode; it provides 2013 standard designations, domestic and international 2D vector military symbols, and images, and can draw 100 types of 2D vector military symbols and images; and it provides 80 3D models, including those for satellites and electronic countermeasures. The inputs and outputs of the display module are shown in Table 4.

[0186] Table 4 shows the module input and output table

[0187] Serial number Interface Name Interface Type Sender / Receiver 1 Real-time simulation data External interface Online module / display module 2 Control instructions External interface Online module / display module 3 Image data External interface Online module / display module 4 Control Data External interface Online module / display module 5 Replay data External interface Playback module / display module 6 Elevation data External interface Resource management subsystem / display module

[0188] The interface function between the situation hierarchical management system of the present invention and the outside is as follows Figure 13 shown.

[0189] Table 5 Description of external interfaces of simulation situation display system

[0190]

[0191]

[0192] It can be seen that the present invention discloses a simulation situation display system and method, which includes a display and control terminal module, an online module, a playback module and a display module; it can receive situation data and various control instructions and other information pushed by the simulation engine subsystem and the resource management subsystem, support three situation display methods including full-scene situation display, local display and single situation display, can play back simulation data, and provide the display and control terminal with a variety of visual styles to display information and modify status and parameters.

[0193] Example 2

[0194] See also Figure 14 , Figure 14 This is a flow chart of a situation hierarchical management method disclosed in an embodiment of the present invention. Figure 14 The described situation hierarchical management method is applied to the field of situation display technology, and the embodiment of the present invention does not limit it. Figure 14 As shown, the situation hierarchical management method includes:

[0195] S1, using the online module to receive the situation information of the simulation engine and simulation model;

[0196] S2, processing the situation information using an online module to obtain a situation estimation result;

[0197] S3, sending the situation information and the situation estimation result to a display module for display;

[0198] S4, using the playback module, loading the playback file, and playing back, displaying, and controlling the simulation test results;

[0199] S5, using the display and control terminal module, processes the simulation data output by the simulation engine and the display and control playback data to obtain the situation simulation results.

[0200] Optionally, the using an online module to process the situation information to obtain a situation estimation result includes:

[0201] S21, acquiring situation estimation sample data information; the situation estimation sample data information includes environmental data information, combat unit data information and historical data information; the combat unit data information includes enemy combat unit data information and our combat unit data information;

[0202] S22, performing situation analysis on the situation estimation sample data information to obtain situation feature information;

[0203] S23, processing the situation feature information to obtain situation graph structure information; the situation graph structure information includes a static information layer, an experience information layer, and a dynamic information layer;

[0204] The static information layer includes static map information, force deployment information, and visible entity information in the situation feature information;

[0205] The experience information layer includes historical combat information in the situation feature information;

[0206] The dynamic information layer includes enemy position information, observation field information, and fire coverage information in the situational feature information;

[0207] S24, processing the situation graph structure information to obtain situation feature parameters, including:

[0208] S241, using the first position estimation model to process the situation map structure information to obtain the first position estimation information μ(e,grid i );

[0209] The first position estimation model is:

[0210]

[0211] Among them, grid iis the i-th grid in the situation graph structure information, i=1,2,…,N, N is the number of grids; V e_hpos is the empirical position probability, is the impact value of the enemy’s field of view on the i-th grid, is the impact value of the enemy combat unit's mobility on the i-th grid; W1, W2, W3 are the impact weights, and e is the enemy combat unit;

[0212] S242, using the second firepower coverage range calculation model, the situation map structure information is processed to obtain the second firepower coverage range information l (grid i );

[0213] The second firepower coverage range calculation model is:

[0214]

[0215] Among them, u k is our kth combat unit, k=1,2,…,M; M is the number of our combat units, firelevel(u k ,grid i ) is used to calculate the fire threat of our k-th combat unit;

[0216] S243, using the first fire coverage estimation model, processing the situation map structure information to obtain the first fire coverage estimation information l (grid j ,u);

[0217] The first fire coverage estimation model is:

[0218]

[0219] in, For the grid j The kth enemy combat unit in the grid; e k is the kth enemy combat unit, M is the number of enemy combat units; μ(e k ,grid j ) is the enemy combat unit e k Grid on the situation map structure information j The position of the grid is estimated, and u is our combat unit.

[0220] The situation characteristic parameters include the first position estimation information μ(e,grid i ), second firepower coverage information l(grid i ), second firepower coverage information l(grid i ), first fire coverage estimation information l(grid j ,u).

[0221] S25, processing the situation characteristic parameters to obtain a situation estimation result.

[0222] Enemy field of view estimation: Based on the estimated probability of the enemy's position, the field of view of each combat unit is superimposed to comprehensively calculate the enemy's field of view on the map, and infer the combat units that may be observed by our side.

[0223] Our field of view: superimpose the field of view of each combat unit and calculate the enemy combat units within the field of view.

[0224] The situation estimation model is trained using situation feature parameters to obtain an optimized situation estimation model;

[0225] The optimized situation estimation model is used to process the situation characteristic parameters to be processed and obtain the situation estimation results.

[0226] The situation estimation model is the CTPN model; the CTPN model includes a VGG16 convolutional model, a bidirectional LSTM model, and a fully connected layer;

[0227] Inputting the situation feature parameters into the VGG16 convolutional model; the VGG16 network includes 13 convolutional layers, 5 maximum pooling layers and 3 fully connected layers;

[0228] In the convolution layer, a two-dimensional convolution kernel w∈R is used 3×3 Extract the feature parameters of the situation and obtain the feature matrix C n ;

[0229]

[0230] Among them, n represents the number of convolution operations, m represents the number of convolution kernels, and p i represents the acquired i-th feature matrix, f represents the nonlinear activation function, · represents the corresponding operation of the shared weight of the convolution kernel and the feature matrix, w represents the weight of the convolution kernel, b represents the bias value, R 3×3 Represents a 3×3 real matrix;

[0231] The maximum pooling method is used in the pooling layer, and the feature extraction formula is expressed as follows:

[0232] p u =Max 2×2 [C n ]

[0233] Among them, u represents the number of pooling, Max 2×2 Represents the maximum pooling operation method of a 2×2 matrix, p uis the extracted feature; after multiple convolution and pooling operations, the reshaped data stream is input into the bidirectional LSTM model to obtain a feature vector with time series properties, which is expressed as follows:

[0234] o t =g(V st +V′ sT′ ),

[0235] Among them, s t Represents the output of the forward sequence at time t, s′ t Represents the output of the reverse sequence at time t, U Xt Represents the initial input of the forward sequence, U′ Xt Represents the initial input of the reverse sequence, Represents the input at the previous moment of the forward sequence, The input of the next moment in reverse time sequence, o t Represents the output at time t. After feature extraction by the time series model, the spatial + sequence feature vector is input into the RPN network and passes through two feature extraction networks. One of them obtains positive and negative feedback classification through the softmax classification feature vector set, and the other is used to calculate the boundary value regression offset for the feature vector set to obtain accurate measurement results.

[0236] Optionally, performing situation analysis on the situation estimation sample data information to obtain situation feature information includes:

[0237] S221, performing situation analysis on the combat terrain map in the environmental data information to obtain N grid structures;

[0238] S222, setting a plurality of layers representing data attribute information in the grid structure, and representing the environmental data information as an image pixel matrix;

[0239] S223 , representing the combat unit data information using different grid layers according to the image pixel matrix to obtain situation feature information.

[0240] Optionally, the use of a playback module to load a playback file and playback, display, and control the simulation test results includes:

[0241] S41, using the playback data processing submodule to receive external playback information; the external playback information includes playback data, playback control instructions and display configuration data;

[0242] S42, processing the external playback information to obtain a playback processing result;

[0243] S43, classifying the playback processing result to obtain category information; the category information includes first category information and second category information;

[0244] The first category of information is information that requires a panoramic situation display;

[0245] The second category of information is information that requires local situation display;

[0246] S44, controlling the first category of information using a playback control submodule;

[0247] S45: Utilize the playback display submodule and the playback display configuration submodule to playback and display the second category information.

[0248] Optionally, the display and control terminal module is used to process the simulation data output by the simulation engine and the display and control playback data to obtain the situation simulation results, including:

[0249] S51, using the data processing submodule to receive simulation data and display and control playback data output by the simulation engine;

[0250] S52, parsing the simulation data output by the simulation engine to obtain parsed data information;

[0251] S53, verifying the validity of the parsed data information, and sending the parsed data information that passes the validity verification to the terminal display and control submodule for display;

[0252] S531, performing thread operation analysis on the parsed data information to obtain thread operation information;

[0253] Analyze the event running time executed by each thread running in parallel to obtain event running time information;

[0254] Analyze the entities executed by each thread running in parallel to obtain entity-related information;

[0255] Entity-related information includes entity name, unique identifier, event execution time, and thread identifier;

[0256] Analyze the operating efficiency of each thread running in parallel to obtain operating efficiency information;

[0257] Count all entities running in a single thread to obtain entity list information;

[0258] The event running time information, the entity related information, the running efficiency information and the entity list information are integrated to obtain thread running information.

[0259] S532, performing entity operation analysis on the parsed data information to obtain entity operation information;

[0260] Merge the event running time of the same entity executed by the same thread in each sampling period to obtain the first event running time;

[0261] The running time of the first event is compared with a preset first threshold, and entities exceeding the preset first threshold are sorted to obtain entity running information.

[0262] S533, performing type operation analysis on the parsed data information to obtain type operation information;

[0263] The running time of the same type of entity executed by the same thread in each sampling period is merged to obtain the second event running time;

[0264] The second event running time is compared with a preset second threshold, and the entity types exceeding the preset second threshold are sorted to obtain type running information.

[0265] S534, performing event operation analysis on the parsed data information to obtain event operation information;

[0266] In each sampling period, the execution time of the same event type in the same thread is merged to obtain the third event running time; the third event running time is compared with a preset third threshold, and the event interfaces that exceed the preset third threshold are sorted to obtain event running information.

[0267] S535 , comprehensively analyzing the thread running information, the entity running information, the type running information, and the event running information to obtain a validity verification result.

[0268] W=a1p1+a2p2+a3p3+a4p4

[0269] Where p1 is thread execution information, p2 is entity execution information, p3 is type execution information, and p4 is event execution information. a1 is thread execution information, a2 is the entity execution information weight, a3 is the type execution information weight, and a4 is the event execution information weight. W is the validity verification result. W is compared with a preset threshold. If it exceeds the threshold, the validity verification is considered passed.

[0270] S54: Process the display and playback data using the universal display submodule and the playback control submodule to obtain a situation simulation result.

[0271] It can be seen that the present invention discloses a hierarchical situation management system and method, which includes a display and control terminal module, an online module, a playback module and a display module; it can receive situation data and various control instructions and other information pushed by the simulation engine subsystem and the resource management subsystem, support three situation display modes including full-scene situation display, local display and single situation display, can play back simulation data, and provide the display and control terminal with a variety of visual styles to display information and modify status and parameters.

[0272] Example 3

[0273] See also Figure 15 , Figure 15 This is a flow chart of another situation hierarchical management method disclosed in an embodiment of the present invention. Figure 15 The described situation hierarchical management method is applied to the field of situation display technology, and the embodiment of the present invention does not limit it. Figure 15 As shown, the situation hierarchical management method includes:

[0274] The system includes an online module, a playback module, a display and control terminal module, and a presentation module. These modules provide test personnel with a display and control terminal. Using geographic information as a display background, the system displays the trajectory, information interaction, status parameters, and key events of each simulated entity, as well as data such as performance parameters of the display and control interface. The situation display subsystem offers two observation modes: real-time online observation (with "man in the loop") and post-event playback (with "man out of the loop"), supporting both display and display and control terminal presentation.

[0275] The online module is mainly used to receive information from subsystems and simulation models such as the simulation engine, and to perform real-time online control of the situation display module, including data connection, online control, and online display configuration. The playback module plays back and controls the simulation test results by loading playback files, including playback file management, playback control, and playback display configuration. The display and control terminal module receives simulation data output by the simulation engine in real-time online mode or displays and controls playback data in post-offline mode; it displays information such as performance parameters and working status, the display and control work interface, and related key events in a visual manner. The display module receives simulation data output by the simulation engine in real-time online mode or playback data in playback mode, and displays data such as key events in large-scale system confrontations or fine-grained small-scale confrontations in key areas in two-dimensional or three-dimensional visualizations.

[0276] The device embodiments described above are merely illustrative. Modules described as separate components may or may not be physically separate, and components shown as modules may or may not be physical modules, i.e., they may be located in one place or distributed across multiple network modules. Some or all of the modules may be selected based on actual needs to achieve the objectives of the present embodiment. Persons of ordinary skill in the art will be able to understand and implement the present invention without inventive effort.

[0277] Finally, it should be noted that the situation hierarchical management system and method disclosed in the embodiments of the present invention are only preferred embodiments of the present invention, and are only used to illustrate the technical solutions of the present invention, rather than to limit them. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that the technical solutions described in the aforementioned embodiments can still be modified, or some of the technical features therein can be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present invention.

Claims

1. A situation hierarchical management system, characterized in that: The system includes a display and control terminal module, an online module, a playback module and a display module; The display and control terminal module is data-connected to the online module and the playback module, and is used to receive and process the simulation data output by the simulation engine or the playback data of the playback module; The online module is data-connected with the display and control terminal module and the display module, and is used to control the display module; The playback module is data-connected to the display and control terminal module and the display module, and is used to playback, display and control the simulation test results; The display module is connected to the playback module and the online module for displaying data.

2. The situation hierarchical management system according to claim 1, characterized in that: The display and control terminal module includes a data processing submodule, a terminal display and control submodule, a universal display submodule and a playback control submodule; The data processing submodule is used to receive and process real-time data and offline playback data; The terminal display and control submodule is used to display data; The generalized display submodule is used to display the processed data on the terminal interface in a generalized manner; The playback control submodule is used to control and operate the data playback process.

3. The situation hierarchical management system according to claim 1, characterized in that: The online module includes a data connection submodule, a real-time online control submodule, an online display submodule and a window setting submodule; The data induction submodule is a thread that runs in the background without user interaction and is used to monitor whether external data arrives at a designated port; The real-time online control submodule is used for real-time data interaction and communication between the user and the system; The online display submodule is used for situation display; The window setting submodule is used to define the window layout and view angle adjustment.

4. The situation hierarchical management system according to claim 1, characterized in that: The playback module includes a playback data processing submodule, a playback control submodule, a playback display submodule and a playback display configuration submodule; The playback data processing submodule is used to process historical data; The playback control submodule is used to provide a control function for the playback process; The playback and display submodule is used to playback and display the processed historical data; The playback display configuration submodule is used to configure the parameters and settings of the playback display.

5. The situation hierarchical management system according to claim 1, characterized in that: The display module includes a situation processing submodule, a two-dimensional and three-dimensional situation display submodule, a layered and domain management submodule, and a picture image display submodule; The situation processing submodule is used to receive and process situation data; The two-dimensional and three-dimensional situation display submodule is used to display the processed situation data; The hierarchical and domain management submodule is used to distinguish and manage situations; The picture image display submodule is used to display picture image data.

6. A situation hierarchical management method, characterized in that: Applicable to any one of claims 1 to 5 of the situation hierarchical management system, the method comprising: S1, using the online module to receive the situation information of the simulation engine and simulation model; S2, processing the situation information using an online module to obtain a situation estimation result; S3, sending the situation information and the situation estimation result to a display module for display; S4, using the playback module, loading the playback file, and playing back, displaying, and controlling the simulation test results; S5, using the display and control terminal module, processes the simulation data output by the simulation engine and the display and control playback data to obtain the situation simulation results.

7. The situation hierarchical management method according to claim 6, characterized in that: The process of processing the situation information using an online module to obtain a situation estimation result includes: S21, acquiring situation estimation sample data information; the situation estimation sample data information includes environmental data information, combat unit data information and historical data information; the combat unit data information includes enemy combat unit data information and our combat unit data information; S22, performing situation analysis on the situation estimation sample data information to obtain situation feature information; S23, processing the situation feature information to obtain situation graph structure information; the situation graph structure information includes a static information layer, an experience information layer, and a dynamic information layer; S24, processing the situation graph structure information to obtain situation feature parameters; S25, processing the situation characteristic parameters to obtain a situation estimation result.

8. The situation hierarchical management method according to claim 7, characterized in that: The performing situation analysis on the situation estimation sample data information to obtain situation feature information includes: S221, performing situation analysis on the combat terrain map in the environmental data information to obtain N grid structures; S222, setting a plurality of layers representing data attribute information in the grid structure, and representing the environmental data information as an image pixel matrix; S223 , representing the combat unit data information using different grid layers according to the image pixel matrix to obtain situation feature information.

9. The situation hierarchical management method according to claim 6, characterized in that: The playback module is used to load the playback file and playback, display and control the simulation test results, including: S41, using the playback data processing submodule to receive external playback information; the external playback information includes playback data, playback control instructions and display configuration data; S42, processing the external playback information to obtain a playback processing result; S43, classifying the playback processing result to obtain category information; the category information includes first category information and second category information; S44, controlling the first category of information using a playback control submodule; S45: Utilize the playback display submodule and the playback display configuration submodule to playback and display the second category information.

10. The situation hierarchical management method according to claim 6, characterized in that: The display and control terminal module is used to process the simulation data output by the simulation engine and the display and control playback data to obtain the situation simulation results, including: S51, using the data processing submodule to receive simulation data and display and control playback data output by the simulation engine; S52, parsing the simulation data output by the simulation engine to obtain parsed data information; S53, verifying the validity of the parsed data information, and sending the data information that passes the validity verification to the terminal display and control submodule for display; S54: Process the display and playback data using the universal display submodule and the playback control submodule to obtain a situation simulation result.

Images