Multi-target situation priority hierarchical display method and system

Abstract

The invention discloses a priority hierarchical display method and system for a multi-target situation. The method comprises the following steps: obtaining feature data of a multi-target object in a situation display window; performing priority ranking on the target objects according to a multi-parameter evaluation rule or model; according to a priority ranking result, dividing the target objects to different display levels, and outputting the situation information to a display interface in a visual mode; according to different priority levels to which the targets belong, different display styles and information contents are set in a layered manner, visual enhancement elements are superposed on the high-priority targets, and visual weakening and simplification processing is performed on the low-priority targets; a multi-mode man-machine interaction instruction input by an operator is received, and the layered display result of the related target object is adjusted in real time according to the instruction; the situation awareness accuracy and the man-machine collaborative decision-making efficiency are improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of human-computer interaction and situation awareness, and particularly relates to a priority layered display method and system for multi-target situation. BACKGROUND

[0002] With the increasing scale of smart city, digital security, intelligent transportation and air traffic control systems, there are widespread challenges of dramatic increase in target quantity, variety of target types, real-time changes in state and strong interaction requirements. Traditional situation information display interfaces mostly use list-assisted display, icon-intensive stacking or heat map covering methods to handle, which cannot effectively highlight important targets, leading to information overload, interface confusion and rendering performance degradation.

[0003] Some existing solutions introduce aggregation, thinning, icon partitioning and other means to alleviate target occlusion and congestion, but lack dynamic identification and significant expression of target priority, risk level and importance of associated tasks, and cannot accurately monitor the occurrence of abnormal targets or dangerous events, which may cause misjudgment, missed judgment and delay in disposal. At the same time, existing methods generally rely on static grouping or local rules, ignore human judgment and decision-making, and lack effective fusion of multi-modal interaction input methods (such as eye movement, gesture, voice, etc.), making it difficult to achieve efficient human-computer collaboration. SUMMARY

[0004] The purpose of the present application is to provide a priority layered display method and system for multi-target situation, which solves the problems of information overload and unhighlighted important targets in multi-target situation presentation.

[0005] Technical solution: The priority layered display method for multi-target situation according to the present application comprises the following steps: S1, obtaining feature data of multiple target objects in a situation display window; S2, performing priority sorting on the target objects according to a multi-parameter evaluation rule or model; according to the priority sorting result, the target objects are divided into different display levels, and the situation information is output to the display interface in a visual manner; S3, according to different priority levels of the targets, different display styles and information contents are set in layers, visual enhancement elements are superimposed on high-priority targets, and low-priority targets are visually simplified; S4, receiving multi-modal human-computer interaction instructions input by the operator, and adjusting the layered display result of the related target objects in real time according to the instructions; Wherein, when a new target appears, the target feature data changes or a new interaction instruction is input, the priority level is adjusted again and the layered display result is updated.

[0006] Further, step S1 is specifically as follows: acquiring attribute, state and behavior characteristic data of the multiple target objects in the situation display window at a predetermined frame rate, pre-processing the data to form a standardized target object data set.

[0007] Further, step S2 includes the following steps: S21, prioritizing the target objects according to a multi-parameter evaluation rule or model, the parameters including target attributes, states, task progress, alarms and domain-related element parameters, wherein the domain-related element parameters include target type, country information, task type, and region, and the weights of the elements can be adjusted according to specific application scenarios, terminal devices or related historical data; S22, dividing the target objects into different display levels according to the prioritization results, including at least a high-priority target set and a low-priority target set; S23, outputting the situation information to the display interface in a visual manner to construct a multi-level interface display structure, and placing high-priority targets on the upper layer of the interface.

[0008] Further, step S3 includes the following steps: S31, superimposing visual enhancement elements on the high-priority targets, including status bars, threat bars and information labels, the status bars being in the form of progress bars, ring bars, etc. to express task progress, remaining energy and remaining capacity, the threat bars being in the form of color, length or flashing to express target risk level and alarm information level, and the enhancement elements supporting parameterized configuration and user customization; S32, visually weakening and simplifying the low-priority targets and presenting them in the form of semi-transparent, thumbnail or digital indication visualization.

[0009] Further, step S31 further includes superimposing visual enhancement elements on the high-priority targets, the enhancement elements being further combined or nested for display, and the display mode being adjusted according to task type, risk level and task progress difference.

[0010] Further, step S4 includes the following steps: S41, receiving multi-modal human-computer interaction instructions input by the operator, identifying the focus area or the target of interest, and the input modes including but not limited to mouse, touch, voice and eye tracking; S42, adjusting the layered display results in real time according to the received operator instructions, including adjusting the priority level of the corresponding target, switching the expansion or folding state of the information label, filtering the selected category of target, and adjusting the display parameters of the visual enhancement elements; S43, recording the interaction behavior data of the operator as a reference for the prioritization and layered sorting calculation.

[0011] Further, step S41 further includes: fusing eye tracking interaction input mode, determining the gaze area, gaze duration and interaction intensity by real-time collection of eye movement input data, converting into human-computer interaction instructions and adjusting the hierarchical display result.

[0012] Further, step S42 further includes: adjusting the hierarchical display result according to the received operator instruction, if the number of high-priority targets exceeds the load threshold set according to the terminal device performance, display area size or user configuration, then using paging, dynamic summary to avoid interface information overflow, or continuously highlighting the most critical target and pop-up prompting that the current high-priority target display has reached the upper limit; if the operator's target priority instruction conflicts with the evaluation calculation result, then the operator's instruction is used as the criterion; all interaction input operations support undoing, and confirmation and prompting steps of critical interaction operations are set to ensure operation safety and user experience.

[0013] The multi-target situation priority hierarchical display system provided by the application comprises: A data acquisition module is configured to acquire multi-source target feature data and pre-process the data according to a predetermined frame rate, thereby forming a standardized target object data set. A priority evaluation module is configured to sort the target objects according to a multi-parameter rule and model. A hierarchical control module is configured to divide the target objects into different display levels according to the priority sorting result. A visual enhancement module is configured to set different display styles and information contents according to different priority levels of the target objects, superimpose visual enhancement elements on high-priority target objects, and visually weaken and simplify low-priority target objects. An interaction processing module is configured to fuse multiple interaction inputs, receive multi-modal human-computer interaction instructions input by an operator, and feed back the instructions to the hierarchical control module or the display control module for execution. A display control module is configured to adapt to multiple terminal devices, control the display and refresh frequency of the target objects, and output the situation information to a display interface in a visual manner.

[0014] Advantages: Compared with the prior art, the application has the following advantages: the application can reduce the degree of information clutter and highlight important targets in a multi-target situation through priority evaluation and hierarchical display; the application can intuitively perceive the risk level and alarm information through information visual enhancement, thereby improving the situation awareness efficiency; the application can realize decision-making collaboration through a man-in-the-loop by fusing multiple human-computer interaction modes to respond to the judgment and decision-making of the operator; the application is not sensitive to specific target types and can be applied to more fields of situation monitoring and command systems. BRIEF DESCRIPTION OF DRAWINGS

[0015] Figure 1 A method flowchart of the present application; Figure 2 A visualization enhancement schematic of the present application; Figure 3 A system structure schematic of the present application. DETAILED DESCRIPTION

[0016] The technical solutions of the present application are further described below in conjunction with the accompanying drawings.

[0017] As Figure 1 shown, the embodiment of the present application provides a multi-target situation priority layer display method, including the following steps: S1, obtaining characteristic data of multi-target objects in a situation display window; All air target information in the situation display window is collected through multi-source sensors, and data summary information from other business systems, flight plans, etc. is collected, recording attribute data such as flight type, aircraft model, maximum range, planned route, etc., state data such as longitude / latitude, altitude, ground speed, remaining fuel, transponder code, etc., behavior data such as flight phase, yaw angle, radar signal, warning state, etc. Through data preprocessing, standardized target object data sets are converted. Preferably, the interval of data update can be configured to 100-500ms.

[0018] S2, priority sorting of target objects according to multi-parameter evaluation rules or models; according to the priority sorting result, the target objects are divided into different display levels, and the situation information is output to the display interface in a visual manner, specifically including the following steps: S201, priority sorting of target objects according to multi-parameter evaluation rules or models, the parameters including but not limited to target attributes, states, task progress, alarms, and field-related element parameters, wherein the field-related element parameters include but are not limited to target type, country information, task type, and region, and the weights of each element can be adjusted according to specific application scenarios, terminal devices, or related historical data; Preferably, a weighted model is used to comprehensively calculate the attributes, states, task progress, alarms, and field-related element parameters of the target, to generate a priority score, wherein the priority score P can be calculated by the following formula: ; Wherein, the risk weight α, the task weight β, the operator attention weight γ, and the historical data weight δ can be adjusted according to specific scenarios, terminal devices, or related historical data, and preferably, in the present embodiment, , , , ; S202, according to the priority sorting result, the target object is divided into different display levels, preferably, including a high priority target set and a low priority target set; S203, the situation information is output to the display interface in a visual manner, and a multi-level interface display structure is constructed, preferably, the high priority target is displayed on the upper layer (Z-index=100) of the interface, and the low priority target is displayed on the lower layer (Z-index=10) of the interface.

[0019] S3, please refer to Figure 2 , Figure 2 is a visual enhancement diagram of a multi-target situation priority layered display method disclosed by the embodiment of the application. According to different priority levels of the target, different display styles and information contents are set in layers, visual enhancement elements are superimposed on the high priority target, and the low priority target is visually simplified, which specifically includes the following steps: S301, superimposing visual enhancement elements on the high priority target, including but not limited to status bar, threat bar and information label, the status bar adopts a progress bar, a ring bar and the like to express task progress, remaining energy and remaining ability, the threat bar differentiates target risk level and alarm information level through color, length or flashing mode and the like, the enhancement element supports parameterized configuration and user customization, and preferably, the related parameter configuration is shown in Table 1.

[0020] Table 1 related parameter configuration ;

[0021] The visual enhancement elements superimposed on the high priority target can be further combined or nested for display, and the display mode can be adjusted according to parameters such as task type, risk level and task progress; S302, the low priority target is visually simplified and simplified, and is presented in a visual form such as semi-transparency, a thumbnail icon or a digital indication, preferably, the semi-transparency of the low priority target is set to 50%.

[0022] S4, receiving multi-modal human-computer interaction instructions input by an operator, and adjusting the layered display result of the related target object in real time according to the instructions, which specifically includes the following steps: S401, receiving multi-modal human-computer interaction instructions input by an operator, identifying a focus area or a focus target, and the input mode includes but is not limited to a mouse, a touch, a voice, and eye tracking; Preferably, the fusion eye movement tracking interaction input mode is used to collect eye movement input data in real time, determine a gaze area, a gaze duration and an interaction intensity, automatically superimpose and display visual enhancement content when an operator continuously gazes at a target for more than 2 seconds, and display information such as a task state and a remaining oil amount of the target. Further, a voice command such as "highlight the emergency flight" can promote a target of an in-map flight in a state of "emergency" to a high-priority target. S402, according to the received operator instruction, real-time adjustment of the hierarchical display result, including but not limited to: adjusting the priority level of the corresponding target, switching the expansion or folding state of the information label, filtering the selected category of target, adjusting the display parameters of the visual enhancement element; According to the received operator instruction, adjust the hierarchical display result, if the number of high-priority targets exceeds the load threshold set according to the terminal device performance, display area size or user configuration, use paging, dynamic summary and other methods to avoid interface information overflow, or continuously highlight the most critical target and pop up a window to prompt that the current high-priority target display has reached the upper limit; if the operator's target priority promotion instruction conflicts with the evaluation calculation result, the operator's instruction is used as the reference; all interactive input operations support undo, and confirmation and prompt steps for key interactive operations are set to ensure operation safety and user experience; S403, record the interactive behavior data of the operator as a reference for historical data calculation in the priority hierarchical sorting.

[0023] As shown in Figure 3 The structure diagram of the priority hierarchical display system for multi-target situation disclosed by the embodiment of the application, which can realize the priority hierarchical display of the multi-target situation, specifically includes: A data acquisition module is configured to acquire multi-source target feature data at a predetermined frame rate and pre-process the multi-source target feature data to form a standardized target object data set; A priority evaluation module is configured to sort the target objects according to a multi-parameter rule and model; A hierarchical control module is configured to divide the target objects into different display levels according to the priority sorting result; A visual enhancement module is configured to set different display styles and information contents according to different priority levels of the target objects, superimpose visual enhancement elements on high-priority target objects, and visually weaken and simplify low-priority target objects; An interactive processing module is configured to fuse multiple interactive inputs, receive multi-modal human-computer interaction instructions input by an operator, and feed back the multi-modal human-computer interaction instructions to the hierarchical control module or the display control module for execution; A display control module is configured to adapt to multiple terminal devices, control the display and refresh frequency of the target objects, and output the situation information to a display interface in a visual manner.

Claims

1. A method for priority layered display of multi-target situation, characterized in that, The method comprises the following steps: S1, acquiring feature data of multiple target objects in a situation display window; S2, performing priority ranking on the target objects according to a multi-parameter evaluation rule or model; according to the priority ranking result, the target objects are divided into different display levels, and situation information is output to a display interface in a visual manner; S3, different display styles and information contents are set in different priority levels according to the different priority levels of the targets, a visual enhancement element is superimposed on a high-priority target, and a low-priority target is visually simplified; S4, receiving a multi-modal human-computer interaction instruction input by an operator, and adjusting the hierarchical display result of the related target objects in real time according to the instruction; wherein when a new target appears, the target feature data changes or a new interaction instruction is input, the priority level is readjusted and the hierarchical display result is updated.

2. The method of claim 1, wherein, Step S1 is specifically as follows: attribute, state and behavior feature data of multiple target objects in a situation display window are collected at a predetermined frame rate, the data is preprocessed, and a standardized target object data set is formed.

3. The method of claim 1, wherein, Step S2 comprises the following steps: S21, performing priority ranking on the target objects according to a multi-parameter evaluation rule or model, the parameters including target attribute, state, task progress, alarm and field-related element parameters, wherein the field-related element parameters include target type, country information, task type, region, and the weights of the elements are adjusted according to specific application scenarios, terminal devices or related historical data; S22, according to the priority ranking result, the target objects are divided into different display levels, including a high-priority target set and a low-priority target set; S23, the situation information is output to the display interface in a visual manner, a multi-level interface display structure is constructed, and the high-priority targets are displayed on the upper layer of the interface.

4. The method of claim 1, wherein, Step S3 comprises the following steps: S31, a visual enhancement element is superimposed on the high-priority target, including a status bar, a threat bar and an information label, the status bar adopts a progress bar or a ring bar to express task progress, remaining energy and remaining capacity, the threat bar differentiates target risk level and alarm information level through color, length or flashing mode, and the enhancement element supports parameterized configuration and user customization; S32, the low-priority target is visually simplified and presented in a semi-transparent, thumbnail or digital indication visual form.

5. The multi-target situation priority layering display method according to claim 4, characterized in that, Step S31 further comprises: superimposing a visual enhancement element on the high-priority target, the enhancement element is further combined or nested for display, and the display mode is adjusted according to the task type, risk level and task progress difference.

6. The method of claim 1, wherein, Step S4 comprises the following steps: S41, receiving a multi-modal human-computer interaction instruction input by an operator, identifying a focus area or a target of interest, and the input mode includes mouse, touch, voice and eye tracking; S42, adjusting the hierarchical display result in real time according to the received operator instruction, including adjusting the priority level of the corresponding target, switching the expansion or folding state of the information label, filtering the selected category of target, and adjusting the display parameters of the visual enhancement element; S43, recording the interaction behavior data of the operator as a reference for priority hierarchical ranking calculation.

7. The method of claim 6, wherein, The step S41 further comprises: fusing eye movement tracking interaction input mode, determining the gaze area, gaze duration and interaction intensity by real-time collection of eye movement input data, converting into human-computer interaction instructions and adjusting the hierarchical display result.

8. The method for displaying multi-target situation in a priority layered manner according to claim 6, wherein: The step S42 further comprises: adjusting the hierarchical display result according to the received operator instruction, if the number of high-priority targets exceeds the load threshold set according to the terminal device performance, display area size or user configuration, adopting paging and dynamic summary to avoid interface information overflow, or continuously highlighting the most critical target and prompting that the current high-priority target display has reached the upper limit; if the operator's target priority instruction conflicts with the evaluation calculation result, the operator instruction is used as the criterion; all interaction input operations support revocation, and confirmation and prompt steps of key interaction operations are set to ensure operation safety and user experience.

9. A multi-target situation priority layering display system, characterized by, Comprise: a data acquisition module for acquiring multi-source target feature data at a predetermined frame rate and preprocessing to form a standardized target object data set; a priority evaluation module for prioritizing target objects according to multi-parameter rules and models; a hierarchical control module for dividing target objects into different display levels according to the priority sorting result; a visual enhancement module for setting different display styles and information content according to different priority levels of the target, superimposing visual enhancement elements on high-priority targets, and visually weakening and simplifying low-priority targets; an interaction processing module for fusing multiple interaction inputs, receiving multi-modal human-computer interaction instructions input by the operator, and feeding back to the hierarchical control module or the display control module for execution; a display control module for adapting to multiple terminal devices, controlling the display and refresh frequency of target objects, and outputting the situation information to the display interface in a visual manner.

Images