A visual knowledge system modeling method, system, electronic device and medium

Abstract

The present invention discloses a visual knowledge system modeling method, system, electronic device and medium, wherein the method comprises first obtaining a typical mission scenario of helicopter driving and a mission plan under the scenario, then analyzing the scenario to obtain a basic task set related to the mission plan, constructing a visual task model of the mission plan according to the basic task set, then decomposing the mission plan into a task network, obtaining the pilot's action information in real time, converting the task network into a task list according to the pilot's action information, and finally pushing the task list in real time on a human-computer interaction interface. The method solves the problem that fine-grained task visual knowledge modeling in the field of helicopter driving cannot be realized in the prior art, so the pilot needs to remember manually during the driving process, resulting in a large load, thereby affecting the stability and safety of driving.

Description

Technical Field

[0001] The present invention relates to the technical field of human-computer interaction, and in particular to a visual knowledge system modeling method, system, electronic equipment and medium. Background Art

[0002] In the highly professional and complex field of helicopter driving, the "man-machine-environment" system constitutes the core framework for safe flight. The flight missions involve many scenarios and complex tasks. At the same time, the pilot's action information during the driving process is complex and changeable. How to conduct real-time analysis and display of mission scenarios combined with the complex nodes, associations, conditions, constraints, and time and space information in the mission process is a key issue that needs to be solved.

[0003] Therefore, an advanced visual knowledge system modeling method is urgently needed to solve the problem that pilots need to remember manually during the driving process, which leads to a heavy load and affects the stability and safety of helicopter driving. Summary of the invention

[0004] The purpose of an embodiment of the present invention is to provide a cockpit human-computer interaction system based on a knowledge graph to solve the problem in the prior art that the pilot's load assessment and intention prediction cannot be performed in a timely manner, resulting in low flight stability and safety.

[0005] To achieve the above objectives, in a first aspect, the present invention provides a method for modeling a visual knowledge system, the method comprising:

[0006] Obtaining typical mission scenarios for flying a helicopter and mission plans under the typical mission scenarios;

[0007] Analyze the typical task scenario to obtain a basic task set related to the task plan;

[0008] Constructing a visual task model of the task plan according to the basic task set;

[0009] In combination with the visual task model, decomposing the task plan into a task network;

[0010] Obtain pilot action information in real time;

[0011] converting the mission network into a mission list according to the action information of the pilot;

[0012] The task list is pushed in real time on the human-computer interaction interface.

[0013] On the basis of the above technical solution, the present invention can also be improved as follows:

[0014] Furthermore, in one implementation, the analyzing of typical task scenarios to obtain a basic task set related to the task plan includes:

[0015] Identify mission critical elements related to executing mission plans in the typical mission scenarios;

[0016] Integrate the key elements of the tasks to obtain the basic task set;

[0017] The mission critical elements related to the execution of the mission plan include mission environment elements and mission realization elements;

[0018] The mission environment elements include: topographic information, meteorological conditions information, mission situation information and electromagnetic environment information;

[0019] The task implementation elements include: basic task flow, task type information, and functional design information and performance indicator information corresponding to the task type information.

[0020] Furthermore, in one implementation, constructing a visual task model of the task plan according to the basic task set includes:

[0021] Based on the knowledge graph technology, the task plan is constructed into a visual task model including basic task processes, task environment elements and task implementation elements according to the basic task set;

[0022] In the visual task model, the typical task scenario, the name of the task plan, the basic task process, the task environment elements and the task implementation elements are displayed as nodes;

[0023] Among them, the basic task flow, task environment elements and task realization elements are displayed as attributes of the name of the task plan, that is, the name of the task plan is connected to the basic task flow, task environment elements and task realization elements through edges respectively.

[0024] Furthermore, in one implementation, combining the visualization task model to decompose the task plan into a visualization task network includes:

[0025] Extracting each basic task in the visualization task model;

[0026] Decomposing the basic tasks according to the execution order and logical relationship between the basic tasks to obtain subtasks of the basic tasks;

[0027] Determine the subdivided task scenario corresponding to the subtask according to the task environment elements and task realization elements of the subtask;

[0028] According to the subdivided task scenario, decomposing the subtask into task actions;

[0029] The task action is refined into a set of visualization elements at the operation level, and the set of visualization elements is displayed as key information and control options of a human-computer interaction interface.

[0030] Furthermore, in one implementation, the step of combining the visualized task model to decompose the task plan into a task network includes:

[0031] The visualization element sets of basic tasks, subtasks of basic tasks, subdivided task scenarios of subtasks, task actions of subdivided task scenarios and character actions in the visualization task model are integrated and displayed in a visualization manner.

[0032] Furthermore, in one implementation, converting the task network into a task list according to the action information of the pilot includes:

[0033] Determine the time nodes of each subtask in the task plan according to the basic task flow in the task realization elements;

[0034] According to the relationship between the change of the pilot's action information and the time nodes of each subtask, the task network is converted into a task list containing time nodes, and the task list includes a completed task list, a current task list and an expected task list.

[0035] Furthermore, in one implementation, converting the task network into a task list according to the action information of the pilot further includes:

[0036] After obtaining the action information of the pilot, determining whether the action information includes conditions for task activation and completion in the basic task flow;

[0037] If the action information includes conditions for task activation and completion, the task list is updated.

[0038] In a second aspect, the present invention provides a visual knowledge system modeling system, the system is used to implement a visual knowledge system modeling method as described in any one of the first aspects, the system comprising:

[0039] An acquisition module, used to acquire a typical mission scenario for flying a helicopter and a mission plan under the typical mission scenario;

[0040] A task scenario analysis module, used to analyze the typical task scenario to obtain a basic task set related to the task plan;

[0041] A task model building module, used to build a visual task model of the task plan according to the basic task set;

[0042] A task network decomposition module, used to decompose the task plan into a task network in combination with the visual task model;

[0043] Action information acquisition module, used to obtain the pilot's action information in real time;

[0044] A task list conversion module, used for converting the task network into a task list according to the action information of the pilot;

[0045] The push module is used to push the task list in real time on the human-computer interaction interface.

[0046] In a third aspect, the present invention provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the method as described in any one of the first aspects when executing the computer program.

[0047] In a fourth aspect, the present invention provides a non-transitory computer-readable medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the steps of the method described in any one of the first aspects.

[0048] The present invention provides a visual knowledge system modeling method, system, electronic device and medium, wherein the method comprises: firstly obtaining a typical mission scenario of helicopter driving and a mission plan under the scenario, then analyzing the scenario to obtain a basic task set related to the mission plan, constructing a visual task model of the mission plan based on the basic task set, then decomposing the mission plan into a task network, obtaining the pilot's action information in real time, converting the task network into a task list based on the pilot's action information, and finally pushing the task list in real time on a human-computer interaction interface. The method solves the problem that fine-grained task visual knowledge modeling in the field of helicopter driving cannot be realized in the prior art, so the pilot needs to remember manually during the driving process, resulting in a large load and affecting the stability and safety of driving. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] In order to more clearly illustrate the implementation methods of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for the implementation methods or the description of the prior art. Obviously, the drawings in the following description are only exemplary, and for ordinary technicians in this field, other implementation drawings can be derived from the provided drawings without creative work.

[0050] Figure 1A flow chart of a visual knowledge system modeling method provided by an embodiment of the present invention;

[0051] Figure 2 A schematic diagram of a knowledge graph-based visualization task model provided in an embodiment of the present invention;

[0052] Figure 3 A schematic diagram of the structure of a visual knowledge system modeling system provided by an embodiment of the present invention;

[0053] Among them, 10-acquisition module, 20-task scenario analysis module, 30-task model construction module, 40-task network decomposition module, 50-action information acquisition module, 60-task list conversion module, and 70-push module. DETAILED DESCRIPTION

[0054] The following is a description of the implementation of the present invention by specific embodiments. People familiar with the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0055] Figure 1 A flow chart of a visual knowledge system modeling method provided by the present invention is as follows: Figure 1 As shown, a visual knowledge system modeling method provided by an embodiment of the present invention includes the following steps:

[0056] S101, obtaining a typical mission scenario for flying a helicopter and a mission plan under the typical mission scenario;

[0057] S102, analyzing the typical task scenario to obtain a basic task set related to the task plan;

[0058] S103, constructing a visual task model of the task plan according to the basic task set;

[0059] S104, combining the visual task model, decomposing the task plan into a task network;

[0060] S105, acquiring the pilot's action information in real time; specifically, in this embodiment, the pilot's action information includes the pilot's cockpit operation information and voice command information in real time;

[0061] S106, converting the task network into a task list according to the action information of the pilot;

[0062] S107, pushing the task list in real time on the human-computer interaction interface.

[0063] As can be seen from S101 to S107, a visual knowledge system modeling method provided by an embodiment of the present invention first obtains a typical mission scenario of helicopter driving and a mission plan under the scenario, then analyzes the scenario to obtain a basic task set related to the mission plan, constructs a visual task model of the mission plan based on the basic task set, decomposes the mission plan into a task network, obtains the pilot's action information in real time, converts the task network into a task list based on the pilot's action information, and finally pushes the task list in real time on the human-computer interaction interface. This solves the problem that fine-grained task visual knowledge modeling in the field of helicopter driving cannot be achieved in the prior art, so the pilot needs to remember manually during the driving process, resulting in a large load and affecting the stability and safety of driving.

[0064] In a visual knowledge system modeling method provided by an embodiment of the present invention, the step S102, analyzing a typical task scenario to obtain a basic task set related to the task plan, includes:

[0065] S1021, identifying key mission elements related to executing the mission plan in the typical mission scenario;

[0066] S1022, integrating the key elements of the tasks to obtain the basic task set;

[0067] The mission critical elements related to the execution of the mission plan include mission environment elements and mission realization elements;

[0068] The mission environment elements include: topographic information, meteorological conditions information, mission situation information and electromagnetic environment information;

[0069] The task realization elements include: basic task flow, task type information, and functional design information and performance indicator information corresponding to the task type information; specifically, in this step, the basic task flow is all processes from task activation to task completion; the task type information includes but is not limited to reconnaissance tasks, support tasks, material transportation tasks or special tasks; the functional design information and performance indicator information corresponding to the task type include but are not limited to flight stability requirements, sensor detection range requirements, other module mounting capability requirements and real-time data transmission rate requirements; the basic task set obtained through this step can ensure that in the helicopter driving environment, the helicopter and its onboard systems can meet the stringent requirements of the mission plan.

[0070] In this embodiment, through S1021~S1022, the understanding and task decomposition based on typical task scenarios in the present invention are realized, so as to obtain a basic task set. In the specific implementation process, the basic task set can cover the complete task process from task planning, helicopter takeoff preparation, etc. to return and recovery; specifically, by identifying and integrating all key task elements that may be related to the execution of the mission plan, the basic task set is comprehensive and thus constructs the basic framework of the visual task model, laying a good foundation for the subsequent further construction of the visual task model and the decomposition of the dynamic task network.

[0071] In a visual knowledge system modeling method provided by an embodiment of the present invention, the step S103, constructing a visual task model of the task plan according to a basic task set, includes:

[0072] S1031, based on the knowledge graph technology, construct the task plan into a visual task model including basic task processes, task environment elements and task implementation elements according to the basic task set;

[0073] S1032, in the visual task model, the typical task scenario, the name of the task plan, the basic task process, the task environment elements and the task implementation elements are displayed as nodes;

[0074] Among them, according to the knowledge graph construction method, the basic task process, task environment elements and task implementation elements are displayed as attributes of the name of the task plan, that is, the name of the task plan is connected to the basic task process, task environment elements and task implementation elements through edges respectively.

[0075] Specifically, Figure 2 As shown, a schematic diagram of a visual task model based on a knowledge graph is provided. In the figure, a task model is displayed based on the knowledge graph technology. In this task model, the specific typical task scenario of helicopter driving is the "drone launch phase scenario", and the name of the task plan is "task planning". The basic task process of the task plan includes "target allocation" and "confirmation of mounting", the unrestricted task environment elements of the task plan, and the task realization elements of the task plan include a basic task load of "high load" and a task automation level of "semi-automation". In addition, the task plan needs to display the "suspension management screen" and then display the "increase of drone launch information", and in the "target allocation" process, it is also necessary to display the "situation map formation coordination information".

[0076] In a visual knowledge system modeling method provided by an embodiment of the present invention, the step S104, combining a visual task model, decomposing the task plan into a visual task network, includes:

[0077] S1041, extracting each basic task in the visual task model; specifically, in this embodiment, for example, the helicopter's airborne reconnaissance mission should include a takeoff preparation phase, a takeoff and climb phase, a level flight and cruise phase, a reconnaissance phase, an ultra-low altitude penetration phase, etc.; wherein each phase corresponds to a basic task, that is, each task represents an important link in the task planning process, and each basic task is extracted to facilitate the overall layout and phased objectives of the task from a macro perspective;

[0078] S1042, decomposing the basic tasks according to the execution order and logical relationship between the basic tasks to obtain subtasks of the basic tasks; in this embodiment, through this step, the basic tasks are decomposed to ensure that each subtask is a clear and implementable unit, covering each stage of the basic tasks from initiation, execution to completion;

[0079] S1043, determining the subdivided task scenarios corresponding to the subtasks according to the task environment elements and task realization elements of the subtasks; specifically, in this embodiment, these subdivided task scenarios are determined based on expected environmental conditions, situations and task requirements, such as the reconnaissance phase includes the launch drone phase scenario, the altitude reduction phase (descent) scenario, the reconnaissance phase scenario, etc.; the scenario decomposition achieved in this step helps the pilots to conduct targeted analysis and preset response strategies;

[0080] S1044, decomposing the subtask into task actions according to the subdivided task scenario; specifically, in this embodiment, for example, the reconnaissance phase scenario includes task actions such as situation reconnaissance, impact assessment, and map observation, which are directly related to the execution level of helicopter operations and can clarify the type of operation that the pilot needs to perform;

[0081] S1045, breaking down the task action into a set of visual elements at the operation level, and displaying the set of visual elements as key information and control options of the human-computer interaction interface; specifically, in this embodiment, the set of visual elements of the operation interface includes but is not limited to map marks, target indications, mount equipment selection icons, status display bars, etc.; ensuring that the pilot can intuitively and quickly obtain and operate all necessary information to support efficient decision-making and execution; for example, in reconnaissance actions, the human-computer interaction interface should display radar images, weather images, anti-collision images, and optoelectronic images for the pilot to observe and judge; the radar image should include multi-function millimeter-wave phase resonance radar, laser obstacle avoidance radar information, etc.

[0082] Through S1041~S1045 provided in the embodiment of the present invention, a task network generation function is provided, which can generate a task network in a visual form based on the current task, task progress and other information, and intuitively display the forward and backward dependencies, parallel execution or conditional branches between tasks, so as to facilitate the pilot to intuitively understand and manage the complex task structure, avoid the pilot's need for too much manual memory during the driving process, resulting in a heavy load problem, thereby improving the stability and safety of driving.

[0083] In a visual knowledge system modeling method provided by an embodiment of the present invention, the step S104, combining a visual task model to decompose the task plan into a task network, includes:

[0084] S1046, integrating the visualization element sets of the basic tasks, subtasks of the basic tasks, subdivided task scenarios of the subtasks, task actions of the subdivided task scenarios, and character actions in the visualization task model, and displaying them in a visualization manner.

[0085] Specifically, in this embodiment, the visualization method supports display in different forms, such as flow charts, tables, progress bars, labels, etc. The displayed visualized task network content includes but is not limited to: task type, current task status; task stage, task stage process, task stage completion status; task scene, task scene completion status; task action, task action completion status; action display element set, element set display status; current progress, etc.

[0086] In a visual knowledge system modeling method provided by an embodiment of the present invention, the step S106, converting the task network into a task list according to the action information of the pilot, includes:

[0087] S1061, determining the time nodes of each subtask in the task plan according to the basic task flow in the task realization element;

[0088] S1062, according to the relationship between the change of the pilot's action information and the time nodes of each subtask, convert the task network into a task list including time nodes, wherein the task list includes a completed task list, a current task list and an expected task list; in the present invention, the relationship between the change of the pilot's action information and the time nodes of each subtask includes: the change of the pilot's action information occurs at a certain time node, and the change of the pilot's action information occurs during a time period from a certain time node to another time node, etc.

[0089] In a visual knowledge system modeling method provided by an embodiment of the present invention, the step S106, converting the task network into a task list according to the action information of the pilot, further includes:

[0090] S1063, after obtaining the action information of the pilot, determining whether the action information includes conditions for task activation and completion in the basic task flow;

[0091] S1064: If the action information includes conditions for task activation and completion, update the task list.

[0092] In this embodiment, through S1063~S1064, a monitoring function of the task list and the task network is provided. Specifically, during the mission, the pilot's action information, such as operation information and environmental changes, is continuously monitored, the key conditions for task activation and completion are dynamically identified, and the task network is updated in real time; the completion status of the task list is ensured, and the tasks currently in progress, to be executed and completed can be clearly displayed, providing the pilot and the command system with an instant and synchronized task view, thereby reducing the pilot's load, while enhancing the task response speed and flexibility, thereby improving the stability and safety of driving.

[0093] Based on the method provided in the embodiment of the present invention, the present invention further provides a visual knowledge system modeling system, the system is used to implement a visual knowledge system modeling method as described in any one of the above embodiments, the system comprising:

[0094] An acquisition module 10 is used to acquire a typical mission scenario for flying a helicopter and a mission plan under the typical mission scenario;

[0095] A task scenario analysis module 20 is used to analyze the typical task scenario to obtain a basic task set related to the task plan;

[0096] A task model building module 30, used to build a visual task model of the task plan according to the basic task set;

[0097] A task network decomposition module 40, used to decompose the task plan into a task network in combination with the visual task model;

[0098] The action information acquisition module 50 is used to acquire the action information of the pilot in real time;

[0099] A task list conversion module 60, used for converting the task network into a task list according to the action information of the pilot;

[0100] The push module 70 is used to push the task list in real time on the human-computer interaction interface.

[0101] In addition, based on the method and system provided by the embodiments of the present invention, the embodiments of the present invention also provide an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and when the processor executes the computer program, it implements the steps of the method described in each embodiment.

[0102] In addition, based on the above methods, systems and electronic devices, the embodiments of the present invention also provide a non-transitory computer-readable storage medium, which stores computer instructions, and the computer instructions enable the computer to execute the methods provided by the above method embodiments.

[0103] A person skilled in the art can understand that all or part of the steps of implementing the above method embodiment can be completed by hardware related to program instructions, and the aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps of the above method embodiment; and the aforementioned storage medium includes: ROM, RAM, magnetic disk or optical disk, etc., various storage media that can store program codes.

[0104] In combination with the above embodiments, the present invention discloses a visual knowledge system modeling method, system, electronic device and medium, wherein the method comprises: firstly obtaining a typical mission scenario of helicopter driving and a mission plan under the scenario, then analyzing the scenario to obtain a basic task set related to the mission plan, constructing a visual task model of the mission plan based on the basic task set, then decomposing the mission plan into a task network, obtaining the pilot's action information in real time, converting the task network into a task list based on the pilot's action information, and finally pushing the task list in real time on the human-computer interaction interface. This solves the problem that fine-grained task visual knowledge modeling in the field of helicopter driving cannot be realized in the prior art, so the pilot needs to remember manually during the driving process, resulting in a large load and affecting the stability and safety of driving.

[0105] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, i.e., they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Those of ordinary skill in the art may understand and implement it without creative effort.

[0106] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods of each embodiment or some parts of the embodiment.

[0107] Although the present invention has been described in detail above by general description and specific embodiments, it is obvious to those skilled in the art that some modifications or improvements can be made to the present invention. Therefore, these modifications or improvements made without departing from the spirit of the present invention all belong to the scope of protection claimed by the present invention.

Claims

1. A visual knowledge system modeling method, characterized in that: The method comprises: Obtaining typical mission scenarios for flying a helicopter and mission plans under the typical mission scenarios; Analyze the typical mission scenario, identify the mission key elements related to the execution of the mission plan in the typical mission scenario, integrate the mission key elements, and obtain a basic task set related to the mission plan; the mission key elements related to the execution of the mission plan include mission environment elements and mission implementation elements, and the mission environment elements include topographic information, meteorological condition information, mission situation information and electromagnetic environment information; Based on the knowledge graph technology, a visual task model of the task plan is constructed according to the basic task set, and the visual task model includes task environment elements and task implementation elements; the task implementation elements include: basic task flow, task type information, and functional design information and performance indicator information corresponding to the task type information; In the visual task model, the typical task scenario, the name of the task plan, the task environment element and the task realization element are displayed as nodes; wherein the task environment element and the task realization element are displayed as attributes of the name of the task plan, that is, the name of the task plan is connected to the task environment element and the task realization element respectively through edges; In combination with the visual task model, decomposing the task plan into a task network; Obtain pilot action information in real time; According to the change of the action information of the pilot, combined with the time nodes in the task plan determined according to the task realization elements, the task network is converted into a task list including time nodes; The task list is pushed in real time on the human-computer interaction interface.

2. A visual knowledge system modeling method according to claim 1, characterized in that: The step of combining the visualization task model and decomposing the task plan into a visualization task network includes: Extracting each basic task in the visualization task model; Decomposing the basic tasks according to the execution order and logical relationship between the basic tasks to obtain subtasks of the basic tasks; Determine the subdivided task scenario corresponding to the subtask according to the task environment elements and task realization elements of the subtask; According to the subdivided task scenario, decomposing the subtask into task actions; The task action is refined into a set of visualization elements at the operation level, and the set of visualization elements is displayed as key information and control options of a human-computer interaction interface.

3. A visual knowledge system modeling method according to claim 1, characterized in that: The step of combining the visual task model and decomposing the task plan into a task network includes: The visualization element sets of basic tasks, subtasks of basic tasks, subdivided task scenarios of subtasks, task actions of subdivided task scenarios and character actions in the visualization task model are integrated and displayed in a visualization manner.

4. A visual knowledge system modeling method according to claim 1, characterized in that: The step of converting the task network into a task list according to the action information of the pilot includes: Determine the time nodes of each subtask in the task plan according to the basic task flow in the task realization elements; According to the relationship between the change of the pilot's action information and the time nodes of each subtask, the task network is converted into a task list containing time nodes, and the task list includes a completed task list, a current task list and an expected task list.

5. A visual knowledge system modeling method according to claim 4, characterized in that: The step of converting the task network into a task list according to the pilot's action information further includes: After obtaining the action information of the pilot, determining whether the action information includes conditions for task activation and completion in the basic task flow; If the action information includes conditions for task activation and completion, the task list is updated.

6. A visual knowledge system modeling system, characterized in that: The system is used to implement a visual knowledge system modeling method as claimed in any one of claims 1 to 5, and the system includes: An acquisition module, used to acquire a typical mission scenario for flying a helicopter and a mission plan under the typical mission scenario; A task scenario analysis module is used to analyze the typical task scenario, identify the key task elements related to the execution of the task plan in the typical task scenario, integrate the key task elements, and obtain a basic task set related to the task plan; the key task elements related to the execution of the task plan include task environment elements and task realization elements, and the task environment elements include topographic information, meteorological condition information, task situation information and electromagnetic environment information; A task model construction module is used to construct a visual task model of the task plan based on the knowledge graph technology and the basic task set, wherein the visual task model includes task environment elements and task implementation elements, and the task implementation elements include: basic task flow, task type information, and functional design information and performance indicator information corresponding to the task type information; in the visual task model, the typical task scenario, the name of the task plan, the task environment elements, and the task implementation elements are displayed as nodes; wherein the task environment elements and the task implementation elements are displayed as attributes of the name of the task plan, that is, the name of the task plan is connected to the task environment elements and the task implementation elements through edges respectively; A task network decomposition module, used to decompose the task plan into a task network in combination with the visual task model; Action information acquisition module, used to obtain the pilot's action information in real time; A task list conversion module, used for converting the task network into a task list containing time nodes according to the change of the action information of the pilot and the time nodes in the task plan determined according to the task realization elements; The push module is used to push the task list in real time on the human-computer interaction interface.

7. An electronic device, characterized in that: The electronic device comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the method as claimed in any one of claims 1 to 5 when executing the computer program.

8. A non-transitory computer readable medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 5 are implemented.

Images