Command console human-computer interaction adaptive control method for multi-task scenarios

Abstract

The application discloses a command console human-computer interaction adaptive control method for a multi-task scene, relates to the technical field of human-computer interaction control, and comprises the following steps: acquiring running state data, risk change data and inter-task association data of each task in a multi-task command control scene, taking a task as a node, taking a risk influence relationship caused by a task state change leading to a safety state change of an associated task as an associated edge, and establishing a task risk association object; determining an associated task set affected by a risk according to the task risk association object, generating a safety display constraint object, and constraining a display layout output by an operator habit model based on a risk association display relationship; generating an interface intervention identifier when a task display adjustment is performed, and obtaining task-driven interaction data. The application can reduce the interference of interface adjustment on interaction data, avoid self-strengthening of task attention, and improve the accuracy of human-computer interaction adaptive control in a multi-task command control scene.

Description

Technical Field

[0001] This invention relates to the field of human-computer interaction control technology, and in particular to an adaptive human-computer interaction control method for command and control consoles in multi-task scenarios. Background Technology

[0002] With the development of drone swarms, intelligent equipment, and complex mission collaborative systems, command and control consoles need to manage multiple mission objects simultaneously and provide timely and accurate information support to operators based on changes in mission status. In order to reduce the information filtering burden on operators and improve response efficiency in complex mission environments, command and control consoles are gradually developing towards human-computer interaction and adaptive design, dynamically adjusting the interface by analyzing the operator's behavior.

[0003] Currently, the command and control console assesses task attention based on interactive data such as operator gaze, clicks, dwell time, and response frequency. It then adaptively adjusts the task display position, size, and alarm intensity based on the assessment results. However, it does not consider the impact of the display adjustment itself on subsequent interactive data. When a task is highlighted in advance, it gains more exposure and induces operators to engage in more interactive behaviors. This incremental interaction caused by interface adjustments is incorrectly identified as the operator's active attention needs, leading to a positive feedback bias in the task attention assessment model. This results in some tasks continuously occupying display resources, while tasks with increased potential risks fail to receive timely attention due to prolonged low exposure.

[0004] Existing adaptive human-computer interaction technologies for command consoles in multi-task scenarios cannot establish effective constraints between task risk correlations and operator interaction habits, nor can they eliminate the interference caused by interface adjustments to subsequent interactive behaviors. This leads to distortion of task display control basis and makes it difficult to achieve dynamic display adjustments based on actual operational needs. Therefore, this invention proposes an adaptive human-computer interaction control method for command consoles in multi-task scenarios. Summary of the Invention

[0005] The purpose of this invention is to provide an adaptive human-computer interaction control method for command consoles in multi-task scenarios. This method addresses the problem that existing adaptive human-computer interaction technologies for command consoles in multi-task scenarios cannot establish effective constraints between task risk correlation and operator interaction habits, and cannot eliminate the interference of interface adjustments on subsequent interaction behaviors, resulting in distorted task display control and difficulty in achieving dynamic display adjustments based on actual operational needs.

[0006] To solve the above-mentioned technical problems, the present invention is achieved through the following technical solution:

[0007] This invention relates to an adaptive human-computer interaction control method for a command console in multi-task scenarios, comprising the following steps:

[0008] S1. Obtain the operational status data, risk change data, and inter-task correlation data of each task in the multi-task command and control scenario. Using tasks as nodes and the risk impact relationship of changes in task status leading to changes in the safety status of related tasks as the correlation edge, establish task risk correlation objects to represent the task safety status, risk change trend, and risk impact relationship of related tasks.

[0009] S2. Determine the set of associated tasks affected by the risk based on the associated task risk objects, and generate safety display constraint objects that limit the minimum display conditions of associated tasks, so that the operator's habit model can only adjust the task display method within the range of meeting the task safety display requirements.

[0010] S3. Determine the risk association display relationship between related tasks based on the task risk association objects, and constrain the candidate display layout output by the operator's habit model to keep the risk association tasks in the preset display association state. Adjust the task information presentation method and interaction entry configuration according to the constrained display layout.

[0011] S4. When performing task display adjustments, generate interface intervention identifiers, record the corresponding task object, adjustment time, adjustment source, and task exposure parameters before and after the adjustment, and establish a time correspondence between interface adjustment behavior and subsequent operation and handling behavior based on task object and adjustment time.

[0012] S5. Based on the operation and handling behavior data after the interface adjustment, and the time relationship between the task risk change time, the interface adjustment time and the operation and handling behavior occurrence time, combined with the task exposure parameters before and after the adjustment, determine the interface-induced interaction component, and use the interface-induced interaction component to correct the operation and handling behavior data to obtain task-driven interaction data.

[0013] S6. Update the operator's habit model based on task-driven interactive data, and generate the next round of task display scheme under the condition of satisfying the risk association display relationship and safety display constraint object.

[0014] Furthermore, the task risk-related objects include the time of task status change, the time of risk change, the direction of risk change, and the path of risk impact. The risk impact relationships include the direct impact relationships between task nodes and the indirect impact relationships formed through at least one intermediate task node.

[0015] Furthermore, when determining the scope of risk impact, starting from the task node whose state has changed, the risk impact path is traversed according to the direction of risk impact. The affected task nodes are then selected based on the degree of risk impact and the risk response time corresponding to each associated edge, forming a set of associated tasks.

[0016] Furthermore, the safety display constraints include at least one of the following: the minimum window occupancy ratio of the associated task, the minimum display level, the type of information that must be displayed, the allowable occlusion ratio, and the retention status of the interaction entry.

[0017] Furthermore, when determining the risk association display relationship, an association display group is established based on the risk impact path between tasks, and at least one of synchronous display, association expansion, or status linkage is configured for tasks within the same association display group; status linkage includes updating the display identifier of the associated task according to the risk status change of the source task.

[0018] Furthermore, the interface intervention indicator also includes task exposure parameters before and after the interface adjustment. The task exposure parameters include at least one of the following: window area change, screen position change, display level change, and alarm stimulus change, which are used to determine the degree of impact of the interface adjustment on the operation and handling behavior.

[0019] Furthermore, when determining the interface-induced interactive behavior, the degree of influence of interface adjustment and the degree of influence of task status change are determined based on the changes in task exposure parameters in the interface intervention identifier and the temporal correlation between interface adjustment time, task risk change time and operation and handling behavior occurrence time; based on the correlation between the degree of influence of interface adjustment and the degree of influence of task status change, the induced interactive component generated by interface adjustment in the operation and handling behavior is determined.

[0020] Furthermore, the operation and handling behavior data includes at least one of gaze duration, number of clicks, window dwell time, operation response time, and number of control command executions; the interface-induced interaction component is subtracted from the operation and handling behavior data to obtain task-driven interaction data, and the task-driven interaction data is written into the historical interaction sample set according to task type, task stage, and operation path;

[0021] The operator habit model is used to adjust the presentation format of task information, allowed display areas, information display granularity, and arrangement of interaction entry points. It is not used to reduce the safety display priority, alarm level, mandatory information items, or retention status of interaction entry points for tasks.

[0022] Furthermore, based on the data on changes in task operation status, risk changes, and changes in task handling stages, the risk impact relationships among the task risk-related objects are dynamically updated; based on the updated risk impact relationships, the addition, enhancement, weakening, and removal status of risk impact relationships between tasks are determined, and the safety display constraint objects and risk association display relationships are adjusted synchronously according to the changes in the risk impact relationships.

[0023] Furthermore, when dynamically updating the risk impact relationships among the task risk-related objects, the risk propagation path of the corresponding stage is determined based on the change information of the task handling stage. The current risk propagation path is matched with the historical risk propagation path, and the addition, transfer, weakening, and removal status of the risk impact relationship between tasks are identified based on the changes in the starting task node, intermediate related nodes, and risk impact direction in the risk propagation path. The task risk-related objects are updated based on the identification results, and the safety display constraint objects and risk association display relationships of the corresponding tasks are adjusted.

[0024] The present invention has the following beneficial effects:

[0025] 1. This invention establishes task risk association objects and describes the risk propagation relationship between tasks by describing the risk impact relationship that causes changes in the safety status of associated tasks due to changes in task status. This enables the command and control console to no longer adjust the display based solely on the current level of attention of a single task, but to identify associated tasks with risk impact relationships. This provides a basis for subsequent safety display constraints and associated display control, and improves the rationality of task information display in complex multi-task scenarios.

[0026] 2. This invention generates safety display constraint objects and uses risk-related display relationships to constrain the candidate display layout output by the operator's habit model. This makes the operator accustomed to using information presentation methods that are only used to optimize and meet safety requirements. It avoids the long-term weakening of the display of key related tasks due to historical operation preferences, and improves the visibility of risk tasks while ensuring operational convenience.

[0027] 3. This invention generates interface intervention identifiers and combines the time relationship between task risk change time, interface adjustment time, and operation and handling behavior occurrence time to identify and correct the induced interaction components caused by interface adjustment. This enables the operator's habit model to be updated based on task-driven interaction data, reduces the interaction data offset caused by interface enhancement behavior, and avoids the formation of an erroneous feedback loop between task display enhancement and increased interaction.

[0028] 4. The present invention further updates the task risk association objects dynamically based on the task operation status change data, risk change data, and task handling stage change information, so that the risk impact relationship can be adjusted with the node change, path change, and impact relationship change during the task execution process, and the safety display constraint object and risk association display relationship are updated synchronously, thereby improving the dynamic adaptability of the command console in the human-computer interaction adaptive process. Attached Figure Description

[0029] To more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0030] Figure 1 This is the overall flowchart of the human-computer interaction adaptive control method for command and control consoles in multi-task scenarios according to the present invention.

[0031] Figure 2 This is a flowchart of the task risk association object construction and risk association display control process in this invention.

[0032] Figure 3 This is a flowchart of the interface-induced interaction recognition and habit model update process in this invention. Detailed Implementation

[0033] To make the technical means, creative features, objectives and effects of this invention easier to understand, the invention will be further described below in conjunction with specific embodiments.

[0034] Example 1

[0035] See Figure 1 This invention provides an adaptive human-computer interaction control method for a command console in multi-task scenarios, comprising the following steps:

[0036] S1. Obtain the operational status data, risk change data, and inter-task correlation data of each task in the multi-task command and control scenario. Using tasks as nodes and the risk impact relationship of changes in task status leading to changes in the safety status of related tasks as the correlation edge, establish task risk correlation objects to represent the task safety status, risk change trend, and risk impact relationship of related tasks.

[0037] The associated objects of task risk include the time of task status change, the time of risk change, the direction of risk change, and the path of risk impact. The risk impact relationship includes the direct impact relationship between task nodes and the indirect impact relationship formed through at least one intermediate task node.

[0038] Specifically, in a multi-task command and control scenario, the tasks do not run independently. The change in the running status of one task may affect the security status of other tasks through communication links, resource dependencies, control permissions, task collaboration relationships, etc. Therefore, this embodiment first obtains the status change information of each task during operation, and establishes task risk association objects based on the risk transmission relationship between tasks.

[0039] Among them, the operation status data is used to characterize the current execution status of the task, including at least one of the following: task execution stage, resource occupancy status, equipment operation status, and task completion progress; the risk change data is used to characterize the change of the task risk status over time, including the amount of risk level change, the direction of risk change, and the speed of risk change; the inter-task correlation data is used to characterize the dependencies between tasks, including at least one of the following: information interaction relationship, control relationship, resource call relationship, and task collaboration relationship.

[0040] When establishing specific task risk association objects, each task is treated as a task node, and the relationship between task state changes and the safety status of other tasks is treated as the association edges between nodes. For any task node... Its risk status is represented as:

[0041]

[0042] in, Indicates task The risk level at time t, Indicates the change in risk level. Indicates the rate at which risk changes.

[0043] When task node State changes cause task nodes When the risk status changes, a risk impact association edge is established between the two task nodes. The risk impact correlation edge should at least include the direction of the risk impact, the degree of the risk impact, and the time of the risk impact:

[0044]

[0045] in, Indicates task For the task The direction of risk impact, Indicates the degree of risk impact. Indicates the impact of risk on the task Transfer to task Required response time.

[0046] In this embodiment, when the communication support task status is abnormal in the UAV collaborative control scenario, it may reduce the communication reliability of the UAV control task, thereby increasing the risk of UAV loss of control. At this time, a risk impact association edge is established between the communication support task node and the UAV control task node. When the risk change of a task needs to be transmitted to the target task through multiple task nodes, a risk impact path is formed through multiple association edges.

[0047] When determining the scope of risk impact, start from the task node whose state has changed, traverse the risk impact path according to the direction of risk impact, and filter the affected task nodes according to the degree of risk impact and risk response time corresponding to each associated edge to form a set of associated tasks.

[0048] Specifically, when a task node is detected When the risk status changes, As the starting point for risk propagation, based on the direction of risk impact stored in the task risk-related objects, it is used to... Traverse the connected edges to obtain a set of task nodes that may be affected.

[0049] To avoid including all weakly related tasks within the scope of explicit constraints, this embodiment further filters based on the degree of risk impact and risk response time; for any related task node... Based on the risk impact of the corresponding associated edges and risk response time Obtain the risk impact assessment value:

[0050]

[0051] in, Represents task node For task nodes The risk impact assessment value is used to determine the task node. When the risk impact assessment value exceeds the preset impact threshold, the task node will be... Add to the affected associated task set.

[0052] See Figure 2 S2. Determine the set of associated tasks affected by the risk based on the associated task risk objects, and generate safety display constraint objects that limit the minimum display conditions of associated tasks, so that the operator's habit model can only adjust the task display method within the range of meeting the task safety display requirements.

[0053] The safety display constraints should include at least one of the following: the minimum window occupancy ratio of the associated task, the minimum display level, the type of information that must be displayed, the allowable occlusion ratio, and the retention status of the interaction entry.

[0054] Specifically, after determining the set of associated tasks affected by the risk, a corresponding safety display constraint object is generated based on the risk status, risk change trend, and position of influence of each associated task in the risk propagation path. The safety display constraint object is used to limit the minimum display conditions of the associated tasks in the command and control console interface, so that the display layout generated subsequently based on the operator's habits will not reduce the necessary display resources of the associated tasks.

[0055] Among them, the security display constraints corresponding to different related tasks can be set differently according to their risk impact. In this embodiment, for task nodes that are at the beginning of the risk propagation path and may cause changes in the risk of multiple tasks, their minimum display level and the number of mandatory information items are increased; for task nodes that are at the end of the risk propagation path and have a low risk impact, only the necessary status information and interaction entry are maintained.

[0056] When generating specific safety display constraint objects, the risk impact assessment value corresponding to each task node in the associated task set is used as a reference. Determine the security display level and configure the corresponding display constraint parameters according to the security display level:

[0057]

[0058] in, For task nodes The corresponding safety display constraint object, Indicates the minimum window occupancy percentage. Indicates the lowest display level. Indicates the type of information that must be displayed. Indicates the allowable occlusion ratio. This indicates that the interaction entry point is retained.

[0059] In this embodiment, when there is a risk-affected relationship between the communication support task and the UAV control task, even if the operator is currently paying less attention to the communication support task, the system still retains necessary information such as communication quality, link status, and communication switching entry based on the safety display constraint object, so as to ensure that the operator can obtain key factors affecting the safety status of UAV control in a timely manner.

[0060] S3. Determine the risk association display relationship between related tasks based on the task risk association objects, and constrain the candidate display layout output by the operator's habit model to keep the risk association tasks in the preset display association state. Adjust the task information presentation method and interaction entry configuration according to the constrained display layout.

[0061] When determining the risk association display relationship, establish an association display group based on the risk impact path between tasks, and configure at least one of synchronous display, association expansion, or status linkage for tasks within the same association display group; status linkage includes updating the display identifier of the associated task according to the risk status change of the source task.

[0062] Specifically, the operator habit model can generate multiple candidate display layouts based on historical interaction data, such as adjusting the window arrangement according to the operator's usage habits of the map, parameter window, or control panel.

[0063] Based on the risk impact path in the task risk association objects, task nodes with risk propagation relationships are grouped to form association display groups. Association display groups are used to describe the set of tasks that need to maintain display association. It does not limit the associated tasks to use a fixed window position, but limits the associated tasks to maintain a preset information association relationship.

[0064] In this embodiment, the following assumptions are made: when task A is a UAV flight control task and task B is a communication support task, and the change in the state of task B may cause a change in the safety state of task A, task A and task B are assigned to the same associated display group. Even if the operator's habit model tends to expand the window of task A and hide the window of task B, the system still needs to retain the display area or associated entry of task B according to the risk-related display relationship.

[0065] Furthermore, when generating the final display layout, the minimum display conditions for associated tasks are first determined based on the safety display constraint object, and then the task information presentation method is selected from the candidate layouts that meet the constraint conditions based on the operator's habit model.

[0066] Meanwhile, for tasks within the same associated display group, different types of associated display methods can be configured based on the direction of risk impact between tasks.

[0067] Synchronous display method: The risk impact source task and the affected task are configured in the same display area, so that operators can obtain the status of related tasks at the same time;

[0068] Related expansion method: When the risk status of a certain task changes, the information of related tasks that have a risk impact relationship with it will be automatically expanded;

[0069] Status linkage method: Update the display identifier of the associated task according to the status change of the risk impact source task.

[0070] See Figure 3 S4. When performing task display adjustments, generate interface intervention identifiers, record the corresponding task object, adjustment time, adjustment source, and task exposure parameters before and after the adjustment, and establish a time correspondence between interface adjustment behavior and subsequent operation and handling behavior based on task object and adjustment time.

[0071] The interface intervention indicator also includes task exposure parameters before and after the interface adjustment. The task exposure parameters include at least one of the following: changes in window area, changes in screen position, changes in display level, and changes in alarm stimuli, which are used to determine the degree of impact of the interface adjustment on the operation and handling behavior.

[0072] Specifically, in the process of multi-task command and control, changes in the task display status are not only generated by the operator's active operation, but may also be automatically adjusted by the system according to the safety display constraint object or the operator's habit model. Since changes in the display status will change the visibility of the task in the interface, this embodiment records the adjustment process each time the task display is adjusted and generates a corresponding interface intervention mark.

[0073] Interface intervention identifiers are used to describe the complete impact process of an interface adjustment event, including the adjusted task object, the time of adjustment, the driving source of adjustment, and the display status changes before and after the adjustment. The adjustment source is used to distinguish whether the display change is triggered by task safety requirements or by operator habit adaptation.

[0074] In this embodiment, when a task is automatically displayed at the top of the screen due to an increased risk level, a corresponding interface intervention flag is generated and the following information is recorded: the display area of ​​the task window before adjustment; the area and display level of the task window after adjustment; whether color enhancement, flashing prompts, or sound alarms are triggered; and the time and duration of the adjustment.

[0075] By recording the above information, it is possible to determine whether subsequent user interactions such as eye contact and clicks occur within the scope of interface adjustments, thus providing a data foundation for identifying interface-induced interactive behaviors.

[0076] S5. Based on the operation and handling behavior data after the interface adjustment, and the time relationship between the task risk change time, the interface adjustment time and the operation and handling behavior occurrence time, combined with the task exposure parameters before and after the adjustment, determine the interface-induced interaction component, and use the interface-induced interaction component to correct the operation and handling behavior data to obtain task-driven interaction data.

[0077] When determining interface-induced interactive behaviors, the degree of influence of interface adjustments and the degree of influence of task status changes are determined based on the changes in task exposure parameters in the interface intervention identifier and the temporal correlation between interface adjustment time, task risk change time and the time of operation and handling behavior. Based on the correlation between the degree of influence of interface adjustments and the degree of influence of task status changes, the induced interactive component generated by interface adjustments in the operation and handling behavior is determined.

[0078] Specifically, existing adaptive display technologies typically use the operator's gaze, clicks, and pauses as the basis for evaluating the degree of task attention. Considering that display adjustment behavior will change the operator's opportunity to obtain information, the operation and handling behavior is divided into autonomous interaction behavior driven by task state changes and induced interaction behavior driven by interface adjustments.

[0079] Among them, the interface-induced interaction component is used to represent the additional interactive behavior generated by the operator due to display changes such as window enlargement, position adjustment, and alarm enhancement, rather than the attention behavior actively generated by the operator based on the actual status of the task.

[0080] When specifically determining the interface-induced interaction components, firstly, based on the interface intervention identifier, obtain the changes in task exposure parameters to determine the impact of interface adjustments on task visibility; for task i, its exposure change can be determined based on the difference in exposure before and after the adjustment.

[0081]

[0082] in, This indicates the change in display exposure for task i. This represents the k-th exposure parameter before adjustment. This represents the k-th exposure parameter after adjustment. This indicates the weight of the corresponding exposure parameter's influence.

[0083] Subsequently, based on the time interval between the occurrence of the operation and the interface adjustment time, and the time interval between the occurrence of the operation and the change in task risk, the degree of influence of the interface adjustment factor and the task status change factor on the operation is determined.

[0084] If an operator observes, clicks, or pauses within a short period after an interface adjustment, and the corresponding task risk status does not change significantly, then the behavior is considered to be significantly affected by the interface adjustment, and the proportion of interface-induced interaction is increased. If an operator takes action in response to a change in task status after a change in task risk occurs, then the proportion of interface-induced interaction is decreased.

[0085] Based on the identified interface-guided interaction components, the original operation and handling behavior data is corrected:

[0086]

[0087] in, This represents the original operation and handling behavior data for task i. This indicates the interactive elements induced by the interface. This represents task-driven interaction data after removing the influence of the interface.

[0088] The above processing can avoid the repeated reinforcement of task interaction data due to the system's proactive enhancement of the display, making the data source for subsequent habit model learning closer to the operator's actual information usage preferences.

[0089] Operational behavior data includes at least one of the following: gaze duration, number of clicks, window dwell time, operation response time, and number of control command executions. The interface-induced interaction component is subtracted from the operational behavior data to obtain task-driven interaction data, and the task-driven interaction data is written into the historical interaction sample set according to task type, task stage, and operation path.

[0090] The operator habit model is used to adjust the presentation format of task information, allowed display areas, information display granularity, and arrangement of interaction entry points. It is not used to reduce the safety display priority, alarm level, mandatory information items, or retention status of interaction entry points for tasks.

[0091] S6. Update the operator's habit model based on task-driven interactive data, and generate the next round of task display scheme under the condition of satisfying the risk association display relationship and safety display constraint object.

[0092] In this embodiment, after the operation and handling behavior correction is completed, the obtained task-driven interaction data is used as an effective input sample for the operator's habit model, which is used to update the operator's usage preferences for information presentation methods and interaction paths.

[0093] It should be noted that the operator habit model in this embodiment is only used to describe the operator's preferences for interface organization, such as the order of task windows, information expansion methods, parameter viewing habits, and control entry usage habits, and is not used to change the security display requirements of the task itself.

[0094] When generating the next round of task display schemes, the risk association display relationship between current tasks is first determined based on the task risk association object, and the minimum display conditions of each associated task are limited based on the safety display constraint object; within the candidate range that meets the above constraints, the updated operator habit model is then called to determine the final display layout.

[0095] It should be added that for two tasks that have a risk-affect relationship, even if the operator's historical habit is to only view the interface of one task, the system still retains the necessary display area or interaction entry of the other related task. For tasks that are not risk-affected, the display order and information presentation format can be adjusted according to the operator's habits.

[0096] By employing the above methods, a coordinated control between mission safety requirements and operator usage habits can be achieved, enabling the command and control console to adaptively adjust its interface according to actual operational needs, while avoiding data offset caused by interface adjustments themselves.

[0097] Example 2

[0098] In the above embodiments, display control based on task risk relationships is achieved by establishing task risk association objects. However, in the process of multi-task command and control, the task status and handling stage will change continuously, so the risk impact relationship between tasks is not fixed. In order to solve the problem of display control lag caused by changes in risk association relationships in a dynamic task environment, this embodiment dynamically updates the risk impact relationship in the task risk association object according to the task running status change data, risk change data, and task handling stage change information; determines the addition, enhancement, weakening, and removal status of the risk impact relationship between tasks according to the updated risk impact relationship, and synchronously adjusts the safety display constraint object and risk association display relationship according to the change status of the risk impact relationship.

[0099] Specifically, in actual command and control processes, the risk-impact relationships between tasks will change as the task execution phase, resource allocation status, and task objectives change.

[0100] In this embodiment, in the initial stage of the mission, the communication assurance task may be the main factor affecting the safety status of the UAV control task. However, after the mission enters the target identification stage, the target identification task may become an important factor affecting the execution of the UAV mission. Therefore, if the risk association object established in the initial stage of the mission is continuously used for display control, it may lead to a mismatch between the allocation of display resources and the current risk status of the mission.

[0101] Based on the above, this embodiment introduces a dynamic update mechanism for risk impact relationships on the basis of the original task risk association objects. The risk impact relationships between task nodes are re-identified based on task operation status change data, risk change data, and task handling stage change information.

[0102] Among them, the task handling stage change information is used to characterize the current execution stage of the task, including at least one of the task initiation stage, execution stage, coordination stage, exception handling stage and task termination stage. The task objectives, resource dependencies and risk propagation paths corresponding to different task stages may differ, so it is necessary to adjust the task risk association objects according to the changes in task stages.

[0103] When dynamically updating the risk impact relationships among task risk-related objects, the risk propagation path of the corresponding stage is determined based on the change information of the task handling stage. The current risk propagation path is matched with the historical risk propagation path. Based on the changes in the starting task node, intermediate related nodes, and risk impact direction in the risk propagation path, the addition, transfer, weakening, and removal status of risk impact relationships between tasks are identified. The task risk-related objects are updated based on the identification results, and the safety display constraint objects and risk association display relationships of the corresponding tasks are adjusted.

[0104] It should be noted that, firstly, the set of risk propagation paths for the corresponding stage is determined based on the current task handling stage. The risk propagation path is used to represent the sequence of task nodes through which the risk is transmitted from one task node to another.

[0105] The risk propagation path during the historical mission phase is as follows:

[0106]

[0107] Indicates task State changes may occur through tasks Impact on tasks .

[0108] After the task phase changes, the currently detected risk propagation path is:

[0109]

[0110] At this point, by comparing the risk propagation paths of the two stages, it can be determined that the intermediate linking node is... Transform into This indicates that the risk impact relationship between tasks has shifted, and the display relationship of related tasks needs to be readjusted.

[0111] When matching risk propagation paths, the task nodes, associated edges, and directions of risk impact in historical and current risk propagation paths are compared.

[0112] Specifically, when a task node or associated edge that did not exist in the historical risk propagation path appears in the current risk propagation path, it is determined that a new risk impact relationship has been added; when a task node or associated edge in the historical risk propagation path no longer appears in the current risk propagation path, it is determined that a corresponding risk impact relationship has been terminated; when the task node remains unchanged, but the degree of risk impact corresponding to the associated edge changes, it is determined whether the risk impact relationship has been strengthened or weakened based on the magnitude of the change; when the starting task node or intermediate associated node in the risk propagation path changes, it is determined that the risk impact relationship has been transferred.

[0113] To illustrate the degree of change in risk impact relationships, this embodiment compares the risk impact relationship parameters before and after the update, and examines the associated edges between any task nodes. Its risk impact status is represented as follows:

[0114]

[0115] in, The direction of risk impact between task nodes at time t. Indicates the degree of risk impact. Indicates the risk response time.

[0116] By comparing the parameters of the associated edges at different times:

[0117]

[0118] This allows us to determine the changing state of the risk impact relationships between tasks.

[0119] In this embodiment, when the degree of risk impact Increased risk response time When shortened, the task is explained. For the task The impact of risk increases, while a decrease in the degree of risk impact or an increase in risk response time indicates a weakening of the risk impact relationship.

[0120] Based on the identified changes in risk impact relationships, update the task risk-related objects and simultaneously adjust the safety display constraint objects and risk-related display relationships.

[0121] Specifically, when a communication assurance task in the original risk propagation path exits the main impact path, its security display constraint level is reduced, and some display resources are released; when a new task node enters the risk propagation path, the display constraint level corresponding to the task is increased, and it is added to the corresponding associated display group, so that operators can obtain new risk-related information in a timely manner.

[0122] By using the above dynamic update method, the task risk association objects can continuously reflect the current risk propagation relationship as the task status changes, avoiding the lag in display control strategy caused by using fixed risk association relationships, and improving the adaptability of human-computer interaction adaptive control in multi-task command and control scenarios.

[0123] The foregoing has shown and described the basic principles, main features, and advantages of the present invention. Those skilled in the art should understand that the present invention is not limited to the above embodiments. The embodiments and descriptions in the specification are merely illustrative of the principles of the invention. Various changes and modifications can be made to the invention without departing from its spirit and scope, and all such changes and modifications fall within the scope of the present invention as claimed. The scope of protection of this invention is defined by the appended claims and their equivalents.

Claims

1. A human-computer interaction adaptive control method for a command console in multi-task scenarios, characterized in that, Includes the following steps: S1. Obtain the operational status data, risk change data, and inter-task correlation data of each task in the multi-task command and control scenario. Using tasks as nodes and the risk impact relationship of changes in task status leading to changes in the safety status of related tasks as the correlation edge, establish task risk correlation objects to represent the task safety status, risk change trend, and risk impact relationship of related tasks. S2. Determine the set of associated tasks affected by the risk based on the associated task risk objects, and generate safety display constraint objects that limit the minimum display conditions of associated tasks, so that the operator's habit model can only adjust the task display method within the range of meeting the task safety display requirements. S3. Determine the risk association display relationship between related tasks based on the task risk association objects, and constrain the candidate display layout output by the operator's habit model to keep the risk association tasks in the preset display association state. Adjust the task information presentation method and interaction entry configuration according to the constrained display layout. S4. When performing task display adjustments, generate interface intervention identifiers, record the corresponding task object, adjustment time, adjustment source, and task exposure parameters before and after the adjustment, and establish a time correspondence between interface adjustment behavior and subsequent operation and handling behavior based on task object and adjustment time. S5. Based on the operation and handling behavior data after the interface adjustment, and the time relationship between the task risk change time, the interface adjustment time and the operation and handling behavior occurrence time, combined with the task exposure parameters before and after the adjustment, determine the interface-induced interaction component, and use the interface-induced interaction component to correct the operation and handling behavior data to obtain task-driven interaction data. S6. Update the operator's habit model based on task-driven interactive data, and generate the next round of task display scheme under the condition of satisfying the risk association display relationship and safety display constraint object.

2. The human-computer interaction adaptive control method for a command console in a multi-task scenario according to claim 1, characterized in that, The task risk association objects include the task status change time, risk change time, risk change direction, and risk impact path. The risk impact relationships include direct impact relationships between task nodes and indirect impact relationships formed through at least one intermediate task node.

3. The human-computer interaction adaptive control method for a command console in a multi-task scenario according to claim 1, characterized in that, When determining the scope of risk impact, start from the task node whose state has changed, traverse the risk impact path according to the direction of risk impact, and filter the affected task nodes according to the degree of risk impact and risk response time corresponding to each associated edge to form a set of associated tasks.

4. The human-computer interaction adaptive control method for a command console in a multi-task scenario according to claim 1, characterized in that, The security display constraints include at least one of the following: minimum window occupancy ratio of the associated task, minimum display level, mandatory information type, allowed occlusion ratio, and interactive entry retention status.

5. The human-computer interaction adaptive control method for a command console in a multi-task scenario according to claim 1, characterized in that, When determining the risk association display relationship, an association display group is established based on the risk impact path between tasks, and at least one of synchronous display, association expansion, or status linkage is configured for tasks within the same association display group; the status linkage includes updating the display identifier of the associated task according to the risk status change of the source task.

6. The human-computer interaction adaptive control method for a command console in a multi-task scenario according to claim 1, characterized in that, The interface intervention identifier also includes task exposure parameters before and after the interface adjustment. The task exposure parameters include at least one of the following: window area change, screen position change, display level change, and alarm stimulus change, which are used to determine the degree of impact of the interface adjustment on the operation and handling behavior.

7. The human-computer interaction adaptive control method for a command console in a multi-task scenario according to claim 1, characterized in that, When determining interface-induced interactive behavior, the degree of influence of interface adjustment and the degree of influence of task status change are determined based on the changes in task exposure parameters in the interface intervention identifier and the temporal correlation between interface adjustment time, task risk change time and operation and disposal behavior occurrence time. Based on the correlation between the degree of influence of interface adjustment and the degree of influence of task status change, the induced interactive component generated by interface adjustment in operation and disposal behavior is determined.

8. The human-computer interaction adaptive control method for a command console in a multi-task scenario according to claim 1, characterized in that, The operation and handling behavior data includes at least one of gaze duration, number of clicks, window dwell time, operation response time, and number of control command executions; the interface-induced interaction component is subtracted from the operation and handling behavior data to obtain task-driven interaction data, and the task-driven interaction data is written into the historical interaction sample set according to task type, task stage, and operation path; The operator habit model is used to adjust the presentation format of task information, allowed display area, information display granularity, and arrangement of interaction entry points. It is not used to reduce the security display priority, alarm level, mandatory information items, or retention status of interaction entry points for tasks.

9. The human-computer interaction adaptive control method for a command console in a multi-task scenario according to claim 1, characterized in that, Based on the data on changes in task operation status, risk changes, and changes in task handling stages, the risk impact relationships in the task risk association objects are dynamically updated; based on the updated risk impact relationships, the addition, enhancement, weakening, and removal status of risk impact relationships between tasks are determined, and the safety display constraint objects and risk association display relationships are adjusted synchronously according to the changes in the risk impact relationships.

10. The human-computer interaction adaptive control method for a command console in a multi-task scenario according to claim 9, characterized in that, When dynamically updating the risk impact relationships in the task risk association objects, the risk propagation path of the corresponding stage is determined based on the change information of the task handling stage. The current risk propagation path is matched with the historical risk propagation path. Based on the changes in the starting task node, intermediate association nodes and risk impact direction in the risk propagation path, the addition, transfer, weakening and removal status of the risk impact relationship between tasks are identified. The task risk association objects are updated based on the identification results, and the safety display constraint objects and risk association display relationships of the corresponding tasks are adjusted.

Images