A multi-target situation priority layered display method and system

Abstract

The application discloses a multi-target situation priority layered display method and system, and the method comprises the following steps: acquiring characteristic data of a plurality of target objects in a situation display window; performing priority sorting on the target objects according to a multi-parameter evaluation rule or model; according to the priority sorting result, the target objects are divided into different display levels, and situation information is output to a display interface in a visual manner; according to different priority levels to which the targets belong, different display styles and information contents are set in layers, a visual enhancement element is superimposed on a high-priority target, and a low-priority target is visually weakened and simplified; receiving a multi-modal man-machine interaction instruction input by an operator, and adjusting the layered display result of the related target objects in real time according to the instruction; and the application improves situation awareness accuracy and man-machine collaborative decision-making efficiency.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of human-computer interaction and situation awareness, and particularly relates to a priority layered display method and system for multi-target situation. BACKGROUND

[0002] With the increasing scale of smart city, digital security, intelligent transportation and air traffic control systems, the challenge of coexistence of target quantity increase, target type diversity, state real-time change and strong interaction demand is widely faced. The traditional situation information display interface adopts the methods of list auxiliary display, icon dense stacking or heat map covering, which is difficult to effectively highlight important targets, resulting in information "overload", interface confusion and rendering performance decline.

[0003] Some existing solutions introduce aggregation, thinning, icon partitioning and other means to alleviate target occlusion and congestion, but lack dynamic identification and significant expression of target priority, risk level and importance of associated tasks, which cannot accurately monitor the occurrence of abnormal targets or dangerous events, and is easy to cause misjudgment, missed judgment and delay disposal. At the same time, the existing methods generally rely on static grouping or local rules, ignore human judgment and decision-making, and lack effective fusion of multi-modal interaction input methods (such as eye movement, gesture, voice, etc.), which is difficult to realize efficient human-computer cooperation. SUMMARY

[0004] The purpose of the present application is to provide a priority layered display method and system for multi-target situation, which solves the problems of information overload and unhighlighted important targets in multi-target situation presentation.

[0005] Technical scheme: The priority layered display method for multi-target situation according to the present application comprises the following steps:

[0006] S1, acquiring feature data of multi-target objects in a situation display window;

[0007] S2, performing priority sorting on the target objects according to multi-parameter evaluation rules or models; according to the priority sorting result, the target objects are divided into different display levels, and the situation information is output to the display interface in a visual manner;

[0008] S3, according to different priority levels of the targets, different display styles and information contents are set in layers, visual enhancement elements are superimposed on high-priority targets, and low-priority targets are visually simplified;

[0009] S4, receiving multi-modal human-computer interaction instructions input by the operator, and adjusting the layered display result of the related target objects in real time according to the instructions;

[0010] When a new target appears, target feature data changes, or a new interaction instruction is input, the priority level is readjusted and the hierarchical display result is updated.

[0011] Further, step S1 is specifically as follows: attribute, state, and behavior feature data of the multiple target objects in the situation display window are collected at a predetermined frame rate, the data is preprocessed, and a standardized target object data set is formed.

[0012] Further, step S2 includes the following steps:

[0013] S21, according to a multi-parameter evaluation rule or model, priority of the target objects is sorted, the parameters including target attribute, state, task progress, alarm, and field-related element parameters, wherein the field-related element parameters include target type, country information, task type, and region, and weights of the elements can be adjusted according to specific application scenarios, terminal devices, or related historical data;

[0014] S22, according to the priority sorting result, the target objects are divided into different display levels, at least including a high-priority target set and a low-priority target set;

[0015] S23, the situation information is output to the display interface in a visual manner, a multi-level interface display structure is constructed, and the high-priority targets are displayed on the upper layer of the interface.

[0016] Further, step S3 includes the following steps:

[0017] S31, a visual enhancement element is superimposed on the high-priority target, including a state bar, a threat bar, and an information label, the state bar is expressed in the form of a progress bar or a ring bar to express task progress, remaining energy, and remaining ability, the threat bar is expressed in the form of color, length, or flicker to express target risk level and alarm information level, and the enhancement element supports parameterized configuration and user customization;

[0018] S32, the low-priority target is visually weakened and simplified, and is presented in the form of semi-transparency, a thumbnail icon, or a digital indication.

[0019] Further, step S31 further includes: a visual enhancement element is superimposed on the high-priority target, the enhancement element can be further combined or nested for display, and the display mode can be adjusted according to task type, risk level, and task progress difference.

[0020] Further, step S4 includes the following steps:

[0021] S41, multi-modal human-computer interaction instructions input by an operator are received, a focus area or a target of interest is identified, and input modes include but are not limited to a mouse, touch, voice, and eye tracking.

[0022] S42, adjusting the hierarchical display result in real time according to the received operator instruction, including adjusting the priority level of the corresponding target, switching the expansion or folding state of the information label, filtering the selected category of target, and adjusting the display parameter of the visual enhancement element;

[0023] S43, recording the interactive behavior data of the operator as a reference for priority hierarchical sorting calculation.

[0024] Further, step S41 further includes: fusing eye tracking interactive input mode, converting eye tracking input data into human-computer interaction instructions by real-time collection of eye tracking input data, and adjusting the hierarchical display result.

[0025] Further, step S42 further includes: adjusting the hierarchical display result according to the received operator instruction, if the number of high-priority targets exceeds the load threshold set according to the terminal device performance, display area size or user configuration, adopting paging and dynamic summary to avoid interface information overflow, or continuously highlighting the most critical target and prompting that the current high-priority target display has reached the upper limit; if the operator's target priority instruction conflicts with the evaluation calculation result, the operator's instruction is used as the reference; all interactive input operations support undo, and confirmation and prompt steps of key interactive operations are set to ensure operation safety and user experience.

[0026] The multi-target situation priority hierarchical display system provided by the application comprises:

[0027] The data acquisition module is used for collecting multi-source target feature data at a predetermined frame rate and pre-processing to form a standardized target object data set;

[0028] The priority evaluation module is used for priority sorting of target objects according to multi-parameter rules and models;

[0029] The hierarchical control module is used for dividing target objects into different display levels according to the priority sorting result;

[0030] The visual enhancement module is used for setting different display styles and information contents according to different priority levels of the target, superimposing visual enhancement elements on high-priority targets, and visually weakening and simplifying low-priority targets;

[0031] The interactive processing module is used for fusing multiple interactive inputs, receiving multi-modal human-computer interaction instructions input by the operator, and feeding back to the hierarchical control module or the display control module for execution;

[0032] The display control module is used for adapting to multiple terminal devices, controlling the display and refresh frequency of target objects, and outputting the situation information to the display interface in a visual manner.

[0033] Beneficial effects: Compared with the prior art, the present invention has the following significant advantages: The present invention can reduce information clutter and highlight key targets in multi-target situations by prioritizing evaluation and hierarchical display; with the help of information visualization enhancement, risk levels and alarm information can be intuitively perceived, improving situational awareness efficiency; by integrating multiple human-computer interaction methods, it responds to the operator's judgment and decision-making, and realizes decision-making collaboration through human-computer interaction; the priority ranking model and information enhancement display parameters can be configured according to the scenario, and it is not sensitive to specific target types, so it can be extended to situational monitoring and command systems in more fields. Attached Figure Description

[0034] Figure 1 This is a flowchart of the method of the present invention;

[0035] Figure 2 This is a visually enhanced schematic diagram of the present invention;

[0036] Figure 3 This is a schematic diagram of the system structure of the present invention. Detailed Implementation

[0037] The technical solution of the present invention will be further described below with reference to the accompanying drawings.

[0038] like Figure 1 As shown, this embodiment of the invention provides a priority hierarchical display method for multi-target situations, including the following steps:

[0039] S1. Obtain feature data of multiple target objects in the situation display window;

[0040] Information on all aerial targets in the situation display window is collected from multiple sensor sources, along with aggregated data from other business systems and flight schedules. Attribute data such as flight type, aircraft type, maximum range, and planned route are recorded; status data such as longitude / latitude, altitude, ground speed, remaining fuel, and transponder code are recorded; and behavioral data such as flight phase, yaw angle, radar signal, and warning status are recorded. The data is preprocessed to form a standardized target object dataset. Preferably, the data update interval can be configured to 100-500ms.

[0041] S2. Prioritize target objects according to multi-parameter evaluation rules or models; based on the priority ranking results, divide target objects into different display levels and output the situation information to the display interface in a visual manner, specifically including the following steps:

[0042] S201, according to the multi-parameter evaluation rule or model, the target object is prioritized, and the parameters include but are not limited to target attributes, state, task progress, alarm and field related element parameters, wherein the field related element parameters include but are not limited to target type, country information, task type, region, and each element weight can be adjusted according to specific application scene, terminal device or related historical data;

[0043] Preferably, a weighted model is used to comprehensively calculate the attributes, state, task progress, alarm and field related element parameters of the target, and a priority score is generated, wherein the priority score P can be calculated by the following formula:

[0044] ;

[0045] Wherein, the risk weight α, the task weight β, the operator attention weight γ and the historical data weight δ can be adjusted according to specific scene, terminal device or related historical data, and preferably, in the embodiment, α=0.3, β=0.3, γ=0.3 and δ=0.1 are set. , , , ;

[0046] S202, according to the priority sorting result, the target object is divided into different display levels, preferably including a high priority target set and a low priority target set;

[0047] S203, the situation information is output to the display interface in a visual way, and a multi-level interface display structure is constructed, preferably, the high priority target is displayed on the upper layer of the interface (Z-index=100), and the low priority target is displayed on the lower layer of the interface (Z-index=10).

[0048] S3, please refer to Figure 2 , Figure 2 is a visual enhancement diagram of a multi-target situation priority layered display method disclosed by the embodiment of the application. According to different priority levels of the target, different display styles and information contents are set in layers, visual enhancement elements are superimposed on high priority targets, and low priority targets are visually weakened and simplified. The specific steps include the following steps:

[0049] S301, visual enhancement elements are superimposed on high priority targets, including but not limited to status bar, threat bar and information label, the status bar adopts progress bar, ring bar and other forms to express task progress, remaining energy and remaining capacity, the threat bar expresses target risk level and alarm information level through color, length or flashing mode, and the enhancement element supports parameterized configuration and user customization, preferably, the related parameter configuration is shown in table 1.

[0050] Table 1 related parameter configuration

[0051] ;

[0052] The visual enhancement elements superimposed on the high-priority targets can be further combined or nested and can be displayed differently according to parameters such as task type, risk level, task progress, etc.

[0053] S302, visually weakening and simplifying the low-priority targets, and presenting them in the form of semi-transparency, thumbnail icons, or numerical indications, preferably, setting the semi-transparency of the low-priority targets to 50%.

[0054] S4, receiving the multi-modal human-computer interaction instructions input by the operator, and adjusting the hierarchical display results of the relevant target objects in real time according to the instructions, specifically including the following steps:

[0055] S401, receiving the multi-modal human-computer interaction instructions input by the operator, and identifying the focus area or the target of interest, the input methods including but not limited to mouse, touch, voice, and eye tracking.

[0056] Preferably, the eye tracking interaction input method is fused, the gaze area, gaze duration, and interaction intensity are determined by real-time collection of eye tracking input data, when the operator continuously gazes at a target for more than 2 seconds, visual enhancement content is automatically superimposed and displayed, and information such as the task status and remaining fuel of the target is displayed. Further, a voice command such as "highlight the emergency flight" can promote the on-map flight target with the status "emergency" to a high-priority target.

[0057] S402, adjusting the hierarchical display results in real time according to the received operator instructions, including but not limited to adjusting the priority level of the corresponding target, switching the expansion or folding state of the information label, filtering the selected category of targets, and adjusting the display parameters of the visual enhancement elements.

[0058] According to the received operator instructions, the hierarchical display results are adjusted, if the number of high-priority targets exceeds the load threshold set according to the terminal device performance, display area size, or user configuration, the interface information overflow is avoided by using methods such as paging and dynamic summary, or the most critical target is continuously highlighted, and a pop-up window is prompted that the display of the current high-priority target has reached the upper limit; if the operator's instruction to promote the priority of the target conflicts with the evaluation and calculation results, the operator's instruction is used as the reference; all interaction input operations support undo, and confirmation and prompt steps are set for critical interaction operations to ensure operation safety and user experience.

[0059] S403, recording the interaction behavior data of the operator as a reference for historical data calculation in the priority hierarchical sorting.

[0060] As Figure 3As shown, the structure schematic diagram of the multi-target situation priority layered display system disclosed by the embodiment of the present application can realize the priority layered display of the multi-target situation, and specifically comprises:

[0061] The data acquisition module is configured to acquire multi-source target feature data and pre-process the multi-source target feature data according to a predetermined frame rate, thereby forming a standardized target object data set.

[0062] The priority evaluation module is configured to perform priority sorting on the target object according to a multi-parameter rule and model.

[0063] The layered control module is configured to divide the target object into different display levels according to the priority sorting result.

[0064] The visual enhancement module is configured to set different display styles and information contents according to different priority levels of the target, superimpose visual enhancement elements on high-priority targets, and perform visual weakening and simplification processing on low-priority targets.

[0065] The interactive processing module is configured to fuse multiple interactive inputs, receive multi-modal human-computer interaction instructions input by an operator, and feed back the multi-modal human-computer interaction instructions to the layered control module or the display control module for execution.

[0066] The display control module is configured to adapt to multiple terminal devices, control the display and refresh frequency of the target object, and output the situation information to a display interface in a visual manner.

Claims

1. A method for priority layered display of multi-target situation, characterized in that, Comprise the following steps: S1, acquire the characteristic data of multiple target objects in the situation display window; Specifically as follows: collect the attribute, state and behavior characteristic data of multiple target objects in the situation display window at a predetermined frame rate, preprocess the data to form a standardized target object data set; S2, prioritize the target objects according to a multi-parameter evaluation rule or model; According to the priority ranking result, the target objects are divided into different display levels, and the situation information is output to the display interface in a visual manner; Comprise the following steps: S21, prioritize the target objects according to a multi-parameter evaluation rule or model, the parameters include target attribute, state, task progress, alarm and field related element parameters, wherein the field related element parameters include: target type, country information, task type, region, the weight of each element is adjusted according to specific application scene, terminal equipment or related historical data; The priority score P is calculated by the following formula: ； Wherein, the risk weight α, the task weight β, the operator attention weight γ and the historical data weight δ can be adjusted according to the specific scene, terminal equipment or related historical data; S22, according to the priority ranking result, the target objects are divided into different display levels, including high priority target set and low priority target set; S23, the situation information is output to the display interface in a visual manner, a multi-level interface display structure is constructed, and the high priority target is displayed on the upper layer of the interface; S3, according to the different priority levels of the target, the display style and information content are set layer by layer, the high priority target is superimposed with visual enhancement elements, and the low priority target is visually simplified; Comprise the following steps: S31, superimpose visual enhancement elements on the high priority target, including status bar, threat bar and information label, the status bar adopts progress bar and ring bar, which expresses task progress, remaining energy and remaining capacity, the threat bar differentiates target risk level and alarm information level through color, length or flashing mode, and the enhancement elements support parameterization configuration and user customization; The visual enhancement elements are further combined or nested on the high priority target, and the display mode is adjusted according to the task type, risk level and task progress difference; S32, the low priority target is visually simplified and presented in a semi-transparent, thumbnail or digital indication visual form; S4, receive the multi-modal human-computer interaction instruction input by the operator, and adjust the hierarchical display result of the related target object in real time according to the instruction; When a new target appears, the target characteristic data changes or a new interaction instruction is input, the priority level is adjusted again and the hierarchical display result is updated; Comprise the following steps: S41, receive the multi-modal human-computer interaction instruction input by the operator, identify the focus area or focus target, and the input mode includes mouse, touch, voice and eye tracking; S42, adjust the hierarchical display result in real time according to the received operator instruction, including adjusting the priority level of the corresponding target, switching the expansion or folding state of the information label, filtering the selected category of target, and adjusting the display parameters of the visual enhancement elements; S43, record the interactive behavior data of the operator as a reference for the priority layering calculation.

2. The method for priority layering display of multi-target situation according to claim 1, characterized in that, Step S41 further includes: fusing eye tracking interactive input methods, determining the gaze area, gaze duration and interaction intensity by real-time collection of eye movement input data, converting into human-computer interaction instructions and adjusting the layering display results.

3. The method of claim 1, wherein, Step S42 further includes: adjusting the layering display results according to the received operator instructions, if the number of high-priority targets exceeds the load threshold set according to the terminal device performance, display area size or user configuration, using paging, dynamic summary to avoid interface information overflow, or continuously highlighting the most critical targets and pop-up window prompting that the current high-priority target display has reached the upper limit; if the operator's target priority promotion instruction conflicts with the evaluation calculation result, the operator's instruction is used as the reference; all interactive input operations support undo, and confirmation and prompt steps for critical interactive operations are set to ensure operation safety and user experience.

4. A multi-target situation priority layering display system, characterized by, The method of any one of claims 1-3, comprising: a data acquisition module for acquiring multi-source target feature data at a predetermined frame rate and preprocessing to form a standardized target object data set; a priority evaluation module for prioritizing target objects according to multi-parameter rules and models; a layering control module for dividing target objects into different display levels according to the priority sorting results; a visual enhancement module for setting different display styles and information content according to different priority levels of the target, superimposing visual enhancement elements on high-priority targets, and visually weakening and simplifying low-priority targets; an interactive processing module for fusing multiple interactive inputs, receiving multi-modal human-computer interaction instructions input by the operator, and feeding back to the layering control module or the display control module for execution; a display control module for adapting to multiple terminal devices, controlling the display and refresh frequency of target objects, and outputting the situation information to the display interface in a visual manner.

Images