A driver assistance operation method applied to a simulator

Abstract

The present invention belongs to the field of helicopter simulation and relates to a driver assistance operation method applied to a simulator. The method includes: displaying a multifunctional display interface and an integrated control unit display interface. The multifunctional display interface includes a central display area for displaying flight information or avionics system information, fixed-position peripheral virtual keys around the central display area, and a task quick command list; the integrated control unit display interface includes a display area for integrated control unit information and fixed-position peripheral virtual keys; receiving a selection operation of the user input task quick command list, in response to the selection operation, generating subsequent execution instructions for the target task, according to the subsequent execution instructions, invoking the execution process of the target task, and completing the target task according to the process.

Description

Technical Field

[0001] The present invention belongs to the field of helicopter simulation and relates to a driver assistance operation method applied to a simulator. Background Art

[0002] In helicopter avionics technology, multifunctional displays and integrated control units are directly involved in interacting with users. For display devices such as multifunctional displays and integrated control units in helicopters, the displayed content should be complete in symbols, clear and concise. This is because the display space of on-board display devices is limited, and with the driver as the main focus, rich display elements are not required to avoid distracting the driver. That is, the on-board screen display elements should follow the principle of "restrained richness".

[0003] In the simulator environment: The simulator mainly aims to enhance the driver's understanding of the helicopter. Here, as much information as possible is displayed, enabling the driver to have a deeper understanding of the functions, performance, parameters, boundary conditions, etc. of the aircraft and making it easier to operate the helicopter.

[0004] During the operation of the helicopter, the user's main focus should be on the operation of the helicopter. For the display screens of the multifunctional display and the integrated control unit, as well as the operation logic of parameter settings, sometimes it is necessary to perform operations on the avionics system through layer-by-layer screen jumps and the cooperation of pressing multiple buttons.

[0005] In addition, the driver operation procedure is an operation manual for guiding the driver to operate the aircraft avionics system. There is a lot of logical information in the driver operation procedure that is not displayed on devices such as the integrated display. The driver needs to be very familiar with the content of the driver operation procedure to proficiently master the operation of devices such as the integrated display. Summary of the Invention

[0006] The object of the present invention: By adding a driver assistance operation program to the simulator, first, use a quick command menu to enable the user to add convenient and fast function operations in actual use, thereby quickly completing the operations of relevant parameters and commands. Second, when training the user, show the logic used in the task to enhance the driver's familiarity with the operation of the avionics system.

[0007] The technical solution of the present invention:

[0008] A driver assistance operation method applied to a simulator, comprising:

[0009] Display the display interfaces of the multifunctional display and the integrated control unit. The display interface of the multifunctional display includes a central display area for displaying flight information or avionics system information, fixed-position peripheral virtual keys surrounding the central display area, and a task quick command list; the display interface of the integrated control unit includes a display area for integrated control unit information and fixed-position peripheral virtual keys.

[0010] Receive the selection operation of the task quick command list input by the user. In response to this selection operation, generate subsequent execution instructions for the target task. According to these subsequent execution instructions, call the execution process of the target task and complete the target task according to this process.

[0011] Before displaying the display interfaces of the multifunctional display and the integrated control unit, the method further includes:

[0012] Number the display screens of the display interfaces of the multifunctional display and the integrated control unit respectively; number the directions of the peripheral virtual keys of the two display interfaces in the display interfaces respectively.

[0013] According to the tasks in the task quick command list, determine the commands corresponding to specific peripheral virtual keys of different display screens required to implement the tasks.

[0014] Generate the execution process of the corresponding task according to the actual execution order and the commands called during execution.

[0015] The method further includes:

[0016] Create a new task quick command in the task quick command list.

[0017] Enter the keyword of the new task in this new task quick command. This keyword is extracted from the key parameters of the multifunctional display software, the operating flight software, and the integrated control unit software, so that when the user executes the new task, the corresponding execution parameters can be filled in the keyword.

[0018] When in the function demonstration guidance stage, after calling the execution process of the target task, the method further includes:

[0019] For a link in the execution process, display the display interface where the display screen corresponding to this link is located.

[0020] Display an indication animation around the specific virtual key for the target task among the peripheral virtual keys of this display interface.

[0021] Receive the click operation of the user; if the click operation is performed on this specific virtual key, enter the next link of the execution process; if the click operation is performed on other virtual keys, prompt the user that the operation is not in accordance with the process and ask to operate again; if the user still does not operate in accordance with the process, exit the function demonstration guidance.

[0022] Number the display screens of the multifunctional display interface and the integrated control unit display interface respectively, including:

[0023] Developed using the Python scripting language, combined with PyQt5 and Opencv technologies, use the image recognition function in Opencv to complete the numbering of the multifunctional display software and the integrated control unit screen, and use PyQt5 to draw tasks lists and red arrow animations and other work related to the screen.

[0024] Receive the user's click operation; if the click operation is performed on this specific virtual key, enter the next link of the execution process; if the click operation is performed on other virtual keys, prompt the user that the operation is not in accordance with the process and ask the user to operate again; if the user still does not operate in accordance with the process, jump out of the function demonstration guide, including:

[0025] When the display screens of the multifunctional display software and the integrated control unit display software change, Opencv detects the screen change and notifies PyQt5 to draw the position indicated by the red arrow in the new screen. If the operator does not operate according to the arrow indication, a warning screen will pop up and prompt to return to the previous screen.

[0026] According to the tasks in the task quick instruction list, determine the commands corresponding to a specific peripheral virtual key required to implement the task for different display screens, including:

[0027] When obtaining the logic of a task, decompose the task logic into several display screens and the peripheral virtual keys that need to be clicked on that display screen; let Opencv complete the work of screen recognition and key position recognition, and let PyQt5 complete the work of each screen jump and the drawing of prompt arrows. See Figure 2 as shown.

[0028] According to the tasks in the task quick instruction list, determining the commands corresponding to a specific peripheral virtual key required to implement the task also includes:

[0029] For peripheral virtual keys with a more complex working mechanism, PyQt draws a prompt information box next to the corresponding peripheral virtual key on the screen. When the screen is displayed, the prompt information is also displayed synchronously. See Figure 3 as shown.

[0030] The beneficial effects of the present invention: Open more operation permissions of the helicopter avionics system to end users. Users can design functions and operation paths that better suit their own usage habits, which has more significance for the customization of avionics usage.

[0031] There are limited elements displayed on in-flight multi-functional displays and other screen display devices. By applying this auxiliary program on the simulator, the execution of avionics tasks can be demonstrated, and at the same time, the hidden task logic in the pilot operation procedures can be shown on the relevant screens, deepening the pilot's understanding of the tasks.

[0032] It can effectively improve the efficiency of pilots using the simulator to carry out training tasks and realize the task visualization in the pilot operation procedures. Integrating the document with the actual operation organically reduces the operation risk.

[0033] 1. From the design of task requirements, software development to the final users, the understanding of task logic is clear and unified.

[0034] 2. It can effectively help pilots understand the task logic and deepen their understanding of the functions and performance of helicopters.

[0035] 3. The more complex the task logic is, the better the effect of using this program for demonstration and training. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] Figure 1 It is a schematic diagram of the task quick command list.

[0037] Figure 2 It is a peripheral key prompt diagram for screen jumping.

[0038] Figure 3 It is a peripheral key prompt diagram for screen jumping.

[0039] Figure 4 It is the display software interface of the multi-functional display for showing prompt information. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0040] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

[0041] A driver auxiliary operation method applied to a simulator is designed. It is itself loaded on a simulator running on the Windows platform and has two display areas. One is the task list display area (as Figure 1 shown), which is alone on a display screen, and the other is loaded on the interfaces of the multi-functional display software and the integrated control unit software and exists in the form of an upper layer.

[0042] 1. Quick function instructions

[0043] Instrumentation is carried out in the multi-functional display software, the operation flight software, and the integrated control unit software to achieve the following functions:

[0044] 1) Instructions based on the operation path: Set the screen and the surrounding key numbers in the simulator software of the integrated control unit software and the multi-functional display software. The screen numbers are in the format of A, B, C, D…AA, AB, AC, AD…, and the surrounding keys of the screen are in the format of U (Up), D (Down), L (Left), R (Right) + number. Users can use a process similar to: L5 key of screen A → U1 key of screen B → D3 key of screen C to achieve the corresponding function settings.

[0045] 2) Instructions based on function keywords: Set keywords, extract the screen setting parameters among them as keywords, support the combination and splicing based on keywords, that is, on the basis of the existing keywords, perform logical combinations and encapsulate them into new combined keywords. Through the combined keywords, form shortcut instructions to complete the parameter setting function of complex paths.

[0046] The two functions are a shortcut instruction for intuitive screen operation and a shortcut instruction for one-key parameter setting, which are applicable to function settings in specified task scenarios. The shortcut instructions generated by the user are displayed in the left function menu of the multi-functional display software.

[0047] 2. Function demonstration guidance

[0048] When the user selects the corresponding task in the task list, a pulsating red arrow icon is displayed at the corresponding positions in the multi-functional display software and the integrated control unit display software. The user presses the relevant buttons in sequence according to the indication of the red arrow to complete the corresponding task.

[0049] Specific implementation principle: Developed using the Python scripting language, combined with PyQt5 and Opencv technologies. Use the image recognition function in Opencv to complete the numbering of the multi-functional display software and the integrated control unit screen, and use PyQt5 to draw the task list and the red arrow animation and other work related to the screen.

[0050] When the screens of the multi-functional display software and the integrated control unit display software change, Opencv detects the screen change and notifies PyQt5 to draw the position indicated by the red arrow in the new screen. If the operator does not operate according to the arrow indication, a warning screen will pop up and prompt to return to the previous screen.

[0051] After obtaining the logic of a task, decompose the task logic into several screens and the key operations to be clicked on these screens. Opencv is used to complete the recognition of the screens and the recognition of the key positions, and PyQt5 is used to complete the work of each screen jump and the drawing of the prompt arrows.

[0052] For keys with a relatively complex working mechanism, PyQt draws a prompt information box near the corresponding keys around the screen. When the screen is displayed, the prompt information is also displayed synchronously.

[0053] Using this program, the display of avionics tasks and the training of pilots can be completed. The more complex the task logic, the better the training effect.

[0054] Set the decision height: The process of setting the decision height is completed in two ways. First, press the "SET" key in the display screen of the integrated control unit, as shown in Figure 4 shown, enter the setting screen, press the "L1" key in the display screen of the integrated control unit again, enter the decision height setting screen, press the "L1" key in the display screen of the integrated control unit again, set the decision height value, and complete the process of setting the decision height. For the quick command, assuming the code name of the display screen of the integrated control unit is CDU, the quick command is "CDU-1-SET" → "CDU-7-L1" → "CDU-8-L1" → "1000", and the process of setting the decision height to 1000 meters is completed.

[0055] Second, the keyword for setting the decision height is "Decision height", and directly set "Decision height = 1000" in the quick command to complete the process of setting the decision height to 1000 meters.

[0056] The above are only specific embodiments of the present invention. The present invention is described in detail, and the unelaborated parts are conventional technologies. However, the protection scope of the present invention is not limited thereto. Any changes or substitutions that can be easily thought of by those skilled in the art within the technical scope disclosed by the present invention should be covered by the protection scope of the present invention. The protection scope of the present invention shall be subject to the protection scope of the claims.

Claims

1. A driver assistance operation method applied to a simulator, characterized in that Including: Displaying the display interface of the multifunctional display and the display interface of the integrated control unit. The display interface of the multifunctional display includes a central display area for displaying flight information or avionics system information, fixed-position peripheral virtual keys around the central display area, and a task quick command list; the display interface of the integrated control unit includes a display area for integrated control unit information and fixed-position peripheral virtual keys. Receiving a selection operation of the task quick command list by the user, in response to the selection operation, generating subsequent execution instructions for the target task, and according to the subsequent execution instructions, invoking the execution process of the target task and completing the target task according to the process. Before displaying the display interface of the multifunctional display and the display interface of the integrated control unit, the method further includes: Numbering the display screens of the display interface of the multifunctional display and the display interface of the integrated control unit respectively. Numbering the peripheral virtual keys of the two display interfaces in the direction of the display interface. Determining the commands corresponding to specific peripheral virtual keys of different display screens required to implement the task according to the tasks in the task quick command list. Generating the execution process of the corresponding task according to the actual execution order and the commands called during execution. The process of setting the decision altitude: Press the "SET" button on the display screen of the integrated control unit to enter the setting screen, press the "L1" key on the display screen of the integrated control unit again to enter the decision altitude setting screen, press the "L1" key on the display screen of the integrated control unit again to set the decision altitude value, and complete the process of setting the decision altitude; for the quick command, assuming the code name of the display screen of the integrated control unit is CDU, the quick command is "CDU-1-SET" → "CDU-7-L1" → "CDU-8-L1" → "1000", and the process of setting the decision altitude to 1000 meters is completed.

2. The method according to claim 1, wherein The method further includes: Creating a new task quick command in the task quick command list. Entering the keyword of the new task in the new task quick command, and the keyword is extracted from the key parameters of the multifunctional display software, the operating flight software, and the integrated control unit software, so that when the user executes the new task, the corresponding execution parameters can be filled in the keyword.

3. The method according to claim 2, characterized in that, When in the function demonstration guidance stage, after invoking the execution process of the target task, the method further includes: For a link in the execution process, displaying the display interface where the display screen corresponding to the link is located. Displaying an indication animation around the specific virtual key for executing the target task among the peripheral virtual keys of the display interface. Receiving the click operation of the user; if the click operation is executed on the specific virtual key, entering the next link of the execution process; if the click operation is executed on other virtual keys, prompting the user that the operation is not in accordance with the process and asking to operate again; if the user still does not operate in accordance with the process, exiting the function demonstration guidance.

4. The method according to claim 2, characterized in that, Numbering the display screens of the display interface of the multifunctional display and the display interface of the integrated control unit respectively, including: Developed using the Python scripting language, combined with PyQt5 and Opencv technologies. Use the image recognition function in Opencv to complete the numbering work of the display software of the multifunctional display and the screen of the integrated control unit, and use PyQt5 to draw the task list and the red arrow animation.

5. The method according to claim 3, characterized in that Receive the user's click operation; if the click operation is performed on this specific virtual key, enter the next link of the execution process; if the click operation is performed on other virtual keys, prompt the user that the operation is not in accordance with the process and ask to operate again; If the user still does not operate according to the process, jump out of the function demonstration guide, including: When the screens of the display software of the multifunctional display and the integrated control unit display software change, Opencv detects the screen change and notifies PyQt5 to draw the position indicated by the red arrow in the new screen; if the operator does not operate according to the arrow indication, a warning screen will pop up and prompt to return to the previous screen.

6. The method according to claim 1, characterized in that According to the tasks in the task quick instruction list, determine the commands corresponding to specific peripheral virtual keys required to implement the tasks for different display screens, including: After obtaining the logic of a task, decompose the task logic into several display screens and the peripheral virtual keys that need to be clicked on these display screens; let Opencv complete the work of screen recognition and key position recognition, and let PyQt5 complete the work of each screen jump and the drawing of the prompt arrow.

7. The method according to claim 6, wherein According to the tasks in the task quick instruction list, determine the commands corresponding to specific peripheral virtual keys required to implement the tasks for different display screens, and also include: For peripheral virtual keys with a more complex working mechanism, PyQt draws a prompt information box next to the corresponding peripheral virtual key on the screen. When this screen is displayed, the prompt information is also displayed synchronously.

Images