Touch interactive display system for light aircraft

Abstract

The invention discloses a light airplane-oriented touch interactive display system, which comprises a virtual key group, a multifunctional window and page configuration information, and is characterized in that the page configuration information describes page information and a hierarchical structure displayed by the multifunctional window and the virtual key group, and assigns one of the pages as a default page; the multifunctional window displays page information in the page configuration information according to the control of the virtual key group, and displays a default page when the system is started and an alarm signal is received; the virtual key group is composed of a plurality of longitudinally arranged button controls and is divided into a locking state, a basic state and a menu state, the virtual key group has the characteristics of adaptive interaction steps, response to external input of the system and further dynamic change, the virtual key group occupies a small screen display space, and other information is prevented from being shielded; and the key can be ensured to have a large enough touch area in each interaction stage, so that the man-machine interaction efficiency and accuracy are improved, and the occurrence of mistaken touch is reduced.

Description

Technical Field

[0001] The present invention belongs to the technical field of display and control of aircraft avionics systems, and in particular to the field of integrated displays or display screens with touch interaction functions suitable for use in cockpits of light sport aircraft. Background Art

[0002] The human-machine interface (HMI) in modern aircraft cockpits integrates a rich array of information displays and control functions, and human-machine interaction systems are becoming increasingly complex. Touchscreen interaction technology, with its intuitive and convenient advantages, effectively improves the efficiency of HMI and has become a key development trend in the next-generation cockpit. In international civil aviation, Collins' Pro Line Fusion avionics system is equipped with multiple touchscreen displays. These allow pilots to use single-touch gestures on the primary flight display to enter autopilot commands in menus; adjust the map display range on the navigation interface using pan and zoom gestures, and edit flight plans by directly clicking on the image; and set performance parameters for takeoff, approach, and landing using input box controls on the flight management page.

[0003] From an ergonomics perspective, the target area for touch gesture recognition should be large enough to allow users to quickly and accurately position their finger within it. For example, the US military standard MIL-STD-1472H recommends a minimum touch target area of ​​15mm x 15mm. Due to the turbulence present in flight, pilots can easily touch non-target areas, placing even higher demands on the size of controls in aircraft cockpit interactive display systems.

[0004] Currently, touch interactions in the cockpit display systems of mainstream aircraft mostly utilize buttons, menus, and other controls similar to the graphical user interfaces of consumer electronics. These controls struggle to strike a balance between a large touch area and a small screen-to-body ratio. A larger touch area allows pilots to quickly and accurately position their fingers, reducing accidental touches. However, this also results in excessive screen real estate usage, leading to information obstruction when controls are superimposed on the interface, thus compromising the efficiency of human-computer interaction.

[0005] Most light sport aircraft cockpits are equipped with only one or two display screens. Due to the limited screen space and the need to support the display of multiple information pages, the above-mentioned problem is particularly significant. To this end, the present invention proposes a touch interactive display system, which is equipped with a virtual button group control that changes dynamically with the interaction steps to provide the pilot with a page switching function. Different from the multi-level menu control of the traditional graphical user interface, the virtual button group ensures that the touch range of each option is large enough to facilitate the pilot to align his finger with the control; it does not take up too much screen space. In order to improve the reliability of the touch system, when there is a threat in the flight environment (such as turbulence ahead), the system limits the page switching function and automatically switches to the warning-related page. Summary of the Invention

[0006] The purpose of the present invention is to provide a touch interactive display system for light aircraft, which uses a virtual button group control with dynamically changing functions in the cockpit touch interactive display system to replace the multi-level menu control of the traditional graphical user interface. It can provide a larger control touch target area within a smaller screen range, thereby improving the efficiency and accuracy of the touch interactive system; and limit the touch function of some buttons in special scenarios to improve touch reliability.

[0007] The object of the present invention is achieved through the following technical solutions:

[0008] A touch interactive display system for light aircraft, including a virtual button group, a multi-function window and page configuration information;

[0009] The page configuration information describes the page information and hierarchical structure for displaying the multi-function window and the virtual key group, and specifies one of the pages as a default page;

[0010] The multifunctional window displays page information in the page configuration information according to the control of the virtual key group, and displays a default page when the system is started and when an alarm signal is received;

[0011] The virtual button group is composed of several button controls arranged vertically, which are divided into a locked state, a basic state and a menu state. The virtual button group in the menu state is further divided into multiple levels, and the number of levels is set according to the hierarchical structure in the page configuration information;

[0012] In the locked state, the virtual button group is used to display three buttons with fixed positions. The label characters of the first button are "Menu", and gesture recognition is suppressed; the label characters of the second button are "Range Increase", and when clicked, a range increase instruction is generated; the label characters of the third button are "Range Decrease", and when clicked, a range decrease instruction is generated; when it is recognized that "Range Increase" is clicked, the multi-function window is caused to expand the display range of the default page; when it is recognized that "Range Decrease" is clicked, the multi-function window is caused to reduce the display range of the default page;

[0013] In the basic state, the virtual button group is used to display three buttons with fixed positions. The label character of the first button is "Menu". When clicked, the virtual button group is switched to the first level of the menu state; the label character of the second button is "Previous Page", which generates an upward page-cutting instruction when clicked; the label character of the third button is "Next Page", which generates a downward page-cutting instruction when clicked; when the multi-function window receives the upward page-cutting instruction, it switches the page to the previous page with the same upper-level page in the page configuration information; when the multi-function window receives the downward page-cutting instruction, it switches the page to the next page with the same upper-level page in the page configuration of the multi-function display window.

[0014] In the menu state, the virtual button group is arranged according to the hierarchical structure in the page configuration information and displays buttons and label characters of a certain level. When any button is clicked, if there is a next-level page in the page configuration information, the virtual button group displays the buttons and label characters of the next level; if there is no next-level page in the page configuration information, a page selection instruction is generated and the virtual button group is switched to the basic state; the multi-function window displays the corresponding page after receiving the generated page selection instruction;

[0015] When the virtual button group receives an external alarm signal, it switches to a locked state; if no alarm signal is received from the integrated monitoring system for a period of time, and the virtual button group state is a locked state, it switches to a basic state; if a single-click gesture is triggered in the multi-function window, and the virtual button group state is a menu state, it switches to a basic state.

[0016] Preferably, in the menu state, when the number of buttons of a certain level page displayed by the virtual button group is no more than N, the corresponding number of buttons are displayed; when the number of pages of the level is more than N, N buttons within the visible range and partial shapes of buttons outside the visible range are displayed; while an upward drag gesture is detected in its area, an animation of scrolling all buttons upward and revealing the buttons outside the visible range in turn is displayed; while a downward drag gesture is detected in its area, an animation of scrolling all buttons downward and revealing the buttons outside the visible range in turn is displayed.

[0017] Preferably, the virtual button group is further used to perform transition animation when switching between the basic state, the lock state, the menu state, and each level of the menu state.

[0018] Preferably, the virtual button group fills the entire screen vertically.

[0019] The beneficial effects of the present invention are:

[0020] The present invention provides a touch interactive display system for light aircraft, wherein the virtual button group control has the characteristics of adapting to the interaction steps, responding to the external input of the system, and then changing dynamically. Based on the virtual button group control, it is applied to a touch interactive display system of a light aircraft, so that the latter can switch pages through gestures such as clicking and dragging, bringing an intuitive and convenient interactive experience to the pilot. Based on the characteristics of the control, the control occupies less screen display space, avoiding the obstruction of other information; and it can ensure that the button has a sufficiently large touch area in each interaction stage to improve the efficiency and accuracy of human-computer interaction and reduce the occurrence of false touches. The system responds to relevant warning signals from the external environment. When there is a threat in the environment, some touch functions are disabled to improve the reliability of touch interaction. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 This is a schematic diagram of the interface layout of a touch interactive display system for light aircraft.

[0022] Figure 2 Configure information diagram for the page.

[0023] Figure 3 This is a diagram showing the first level of the virtual button group lock state, basic state, and menu state.

[0024] Figure 4 This is a diagram of the second level of the virtual button group menu status.

[0025] Figure 5 The diagram is a schematic diagram of the interaction flow of a touch interactive display system for light aircraft under normal circumstances.

[0026] Figure 6 The figure is a schematic diagram of the interaction process of a touch interactive display system for light aircraft in a threat environment. DETAILED DESCRIPTION

[0027] The present invention will be further described in detail below with reference to the accompanying drawings and embodiments.

[0028] The touch interactive display system for light aircraft shown in this embodiment resides on a display processor device and provides information display and human-computer interaction functions through a screen device with touch gesture recognition function. It also connects to the integrated monitoring system through an interface module to receive alarm signals.

[0029] See also Figure 1 As shown, the touch-screen interactive display system for light aircraft includes a virtual button group A01 on the left side of the screen device, a multi-function window A02 on the right side of the screen device, and page configuration information to implement human-computer interaction. It may also include a main flight display window A03 and an engine indication and warning window A04 on the right side of the screen device for displaying fixed information pages. The location and layout of the modules are not within the scope of this invention.

[0030] The page configuration information describes the page information and hierarchical structure displayed by the multi-function window and virtual key group, and specifies one of the pages as the default page. For example, it is configured as multiple first-level pages; one first-level page corresponds to several second-level pages; one second-level page corresponds to several third-level pages. Figure 2As shown, to enhance pilots' awareness and monitoring of the flight route, flight environment, and aircraft status, the page configuration information includes the following primary pages: navigation information, system diagram, checklist, electronic chart, and aircraft parameters. Furthermore, navigation information includes secondary pages: extended mode, compass mode, and planning mode; the system diagram includes secondary pages: starting subpage, flight control system subpage, power system subpage, hydraulic system subpage, air conditioning system subpage, fuel system subpage, and door system subpage; the checklist's secondary page displays a list of checkpoints across multiple pages, with no more than six pages, depending on the number of checkpoints in the current flight phase; the electronic chart has no secondary pages; and the aircraft parameters' secondary page is a list of parameter items, displayed across six pages, with each page displaying up to 10 parameter items.

[0031] In this embodiment, the page configuration information includes at least one first-level page of "navigation information" and one second-level page of "extended mode", and the navigation information-extended mode is used as the default page.

[0032] The multifunctional window is used to display the page information in the page configuration information according to the control of the virtual key group, and to display the default page when the system is started and when an alarm signal is received.

[0033] The virtual button group is a graphical user interface consisting of several button controls arranged vertically. In this embodiment, the virtual button group is 25mm horizontally and fills the entire screen vertically, maximizing the size of each button and providing the driver with a sufficiently large interactive target area.

[0034] like Figure 3 The virtual key group has three states: locked state S10, basic state S20, and menu state S30. The virtual key group in the menu state can be divided into multiple levels. The number of levels is determined by the hierarchical structure in the page configuration information. The present invention does not restrict the number of levels.

[0035] In the locked state S10, the virtual button group is used to display three buttons with fixed positions, and the label character of the first button is "Menu", which is the second display effect of D2, and gesture recognition is suppressed; the label character of the second button is "Range Increase", which is the first display effect of D1, and a range increase instruction is generated when clicked; the label character of the third button is "Range Decrease", which is the first display effect of D1, and a range decrease instruction is generated when clicked.

[0036] In this embodiment, the default Navigation Information - Extended Mode page displays navigation information in a semi-compass format. This information includes aircraft heading and an integrated surveillance graphic overlay (displaying threat symbols or graphics such as weather, traffic, and mountain terrain based on integrated surveillance system alerts). Upon recognizing a single click on "Range Up," the multi-function window expands the display range of the integrated surveillance graphic within the compass; upon recognizing a single click on "Range Down," the multi-function window reduces the display range of the integrated surveillance graphic within the compass. The virtual button group does not process gestures within the button range of the second display effect or drag gestures within the entire range.

[0037] It should be noted that the first display effect and the second display effect should be distinguished in appearance in a manner that is not within the scope of the invention. In this embodiment, the first display effect D1 and the second display effect D2 are distinguished by the color of the button as a whole and its label characters.

[0038] In basic state S20, the virtual button group displays three fixed-position buttons. The first button is labeled "Menu" and, when clicked, switches the virtual button group to the first level of menu state S30. The second button is labeled "Previous Page" and, when clicked, generates an upward page switch instruction. The third button is labeled "Next Page" and, when clicked, generates a downward page switch instruction. Upon receiving an upward page switch instruction, the multi-function window switches to the previous page with the same parent page in the page configuration information. Upon receiving a downward page switch instruction, the multi-function window switches to the next page with the same parent page in the page configuration of the multi-function display window.

[0039] In menu state S30, the virtual button group is arranged according to the hierarchical structure in the page configuration information and displays buttons and label characters of a certain level. When any button is clicked, if there is a next-level page in the page configuration information, the virtual button group displays buttons and label characters of the next level; if there is no next-level page in the page configuration information, a page selection instruction is generated, and the virtual button group is switched to the basic state. The multi-function window displays the corresponding page after receiving the generated page selection instruction. For example, in the first level, the virtual button group displays 5 buttons according to the page configuration information, and their label characters are "Navigation Information, System Diagram, Checklist, Electronic Chart, Aircraft Parameters"; if the "Navigation Information, System Diagram, Checklist, Aircraft Parameters" button is clicked, the virtual button group is switched to the next level; if the "Electronic Chart" button is clicked, the page configuration information does not have a next-level page, a page selection instruction is generated, the multi-function window displays the electronic chart, and the virtual button group is switched to the basic state.

[0040] In menu state S30, if the number of buttons on a certain level of pages displayed by the virtual button group is no more than 6, the corresponding number of buttons will be displayed. If the number of pages at that level is more than 6, the 6 buttons within the visible range and the partial shapes of the buttons outside the visible range will be displayed to help the pilot understand that there are more than 6 buttons. While an upward drag gesture is detected within the area, an animation of scrolling all buttons upward and revealing the buttons outside the visible range in sequence will be displayed. While a downward drag gesture is detected within the area, an animation of scrolling all buttons downward and revealing the buttons outside the visible range in sequence will be displayed.

[0041] like Figure 4 , in the second level of the menu state, the virtual button group arranges and displays buttons according to the page configuration information: if it is under the "navigation information" level, 3 buttons are displayed, and their label characters are "expanded mode, compass mode, and planning mode", see S40; if it is under the "system diagram" level, 7 buttons are arranged, and their label characters are "start subpage, flight control system subpage, power system subpage, hydraulic system subpage, air conditioning system subpage, fuel system subpage, and door system subpage", and 6 of them are displayed, and part of the shape of the button outside the visible range is displayed. , so that the pilot can understand that the number of buttons is more than 6, such as S41 and S42; if it is under the "Checklist" level, no more than 6 buttons are displayed, and the actual number depends on the total number of check items in the current flight phase, and their label characters are "Page 1, Page 2, Page 3, Page 4, Page 5, Page 6", as shown in S43; if it is under the "Electronic Chart" level, there is no second level; if it is under the "Aircraft Parameters" level, 6 buttons are displayed, and their label characters are "Page 1, Page 2, Page 3, Page 4, Page 5, Page 6", as shown in S43.

[0042] See also Figure 4 As shown, when the virtual button group is at the second level of the "system diagram", when an upward drag gesture is detected in its area, an animation of scrolling all buttons upward and revealing the buttons outside the visible range in sequence is displayed until the last button is visible within the range, see S42; when a downward drag gesture is detected in its area, an animation of scrolling all buttons downward and revealing the buttons outside the visible range in sequence is displayed until the first button is visible within the range, see S41.

[0043] Figure 5, a schematic diagram of the interaction flow of this embodiment under normal circumstances, that is, when no integrated surveillance system alarm has occurred, also illustrates the transition relationship between the virtual key group's basic state S20, the first level of the menu state S30, and the second level of the menu state S40. When no integrated surveillance system alarm signal is received, a touch-screen interactive display system for light aircraft allows pilots to switch pages in a multi-function information window.

[0044] Figure 6 , is a schematic diagram of the interaction flow of this embodiment in a threatening environment, namely, during and before and after the occurrence of an integrated surveillance warning. It also illustrates the transition relationship between the virtual key group's locked state in S10 and other states. When the touch-screen interactive display system for light aircraft receives a warning signal (indicating the presence of weather, traffic, mountainous terrain, and other threats in the flight environment) from an integrated surveillance system (weather radar, air collision avoidance system, ground proximity warning system, transponder, etc.), it switches the multi-function window to the Navigation Information - Extended Mode page to display the specific warning information, switches the virtual key group to a locked state, and disables the pilot's ability to switch pages.

[0045] When the touch interactive display system for light aircraft does not receive an alarm signal from the integrated monitoring system for 10 consecutive seconds, if the virtual key group state is in the locked state, it will be switched to the basic state.

[0046] When the touch interactive display system for light aircraft detects a single-click gesture within the multi-function window, if the virtual key group state is a menu state, it switches it to a basic state.

[0047] The virtual button group is also used to execute transition animations when switching between the basic state, the locked state, the menu state, and each level of the menu state, so that the pilot can feel that the touch operation is effective.

[0048] In this embodiment, the transition animation is preset to: loop in the order of "locked state-basic state-first level of menu state-second level of menu state", when switching to the latter one, play the animation of each button sliding from the right to the left into the virtual key group area within 0.3 seconds; when switching to the previous one, play the animation of each button sliding from the left to the right into the virtual key group area within 0.3 seconds.

[0049] In this embodiment, the single-click gesture is preset as follows: a single finger touches the screen for 0.1 to 1 second, and the position offset during this period does not exceed 3mm; the drag gesture is preset as follows: a single finger touches the screen, and dragging starts when the coordinate displacement in the vertical direction exceeds 3mm, and is judged as upward or downward, and dragging ends when the single finger leaves the screen.

[0050] It is understandable that those skilled in the art can make equivalent substitutions or changes based on the technical solution and inventive concept of the present invention, and all these changes or substitutions should fall within the scope of protection of the claims attached to the present invention.

Claims

1. A touch-sensitive interactive display system for light aircraft, comprising a virtual key group, a multi-function window, and page configuration information, characterized in that: The page configuration information describes the page information and hierarchical structure for displaying the multi-function window and the virtual key group, and specifies one of the pages as a default page; The multifunctional window displays page information in the page configuration information according to the control of the virtual key group, and displays a default page when the system is started and when an alarm signal is received; The virtual button group is composed of several button controls arranged vertically, which are divided into a locked state, a basic state and a menu state. The virtual button group in the menu state is further divided into multiple levels, and the number of levels is set according to the hierarchical structure in the page configuration information; In the locked state, the virtual button group is used to display three buttons with fixed positions. The first button is labeled "Menu" and gesture recognition is suppressed; the second button is labeled "Range Up" and generates a range increase instruction when clicked; the third button is labeled "Range Down" and generates a range decrease instruction when clicked; when "Range Up" is recognized as being clicked, the multi-function window is caused to expand the display range of the default page; when "Range Down" is recognized as being clicked, the multi-function window is caused to reduce the display range of the default page; In the basic state, the virtual button group is used to display three buttons with fixed positions. The first button is labeled "Menu". When clicked, the virtual button group switches to the first level of the menu state; the second button is labeled "Previous Page". When clicked, it generates an upward page switching instruction; the third button is labeled "Next Page". When clicked, it generates a downward page switching instruction; When the multi-function window receives an upward page switching instruction, it switches the page to the previous page with the same upper level page in the page configuration information; when the multi-function window receives a downward page switching instruction, it switches the page to the next page with the same upper level page in the page configuration of the multi-function display window; In the menu state, the virtual button group is arranged according to the hierarchical structure in the page configuration information and displays buttons and label characters of a certain level. When any button is clicked, if there is a next-level page in the page configuration information, the virtual button group displays the buttons and label characters of the next level; if there is no next-level page in the page configuration information, a page selection instruction is generated and the virtual button group is switched to the basic state at the same time; The multi-function window displays the corresponding page after receiving the instruction to generate the page selection; When the virtual button group receives an external alarm signal, it switches to a locked state; If no alarm signal is received from the integrated monitoring system for a period of time, if the virtual button group state is in the locked state, it will switch to the basic state; if a single-click gesture is detected within the multi-function window range, if the virtual button group state is in the menu state, it will switch to the basic state.

2. A touch interactive display system for light aircraft according to claim 1, characterized in that In the menu state, when the number of buttons of a certain level page displayed by the virtual button group is not more than N, the corresponding number of buttons are displayed; when the number of pages of the level is more than N, the N buttons within the visible range and the partial shapes of the buttons outside the visible range are displayed; When an upward drag gesture is detected in its area, an animation of scrolling all buttons upward is displayed and the buttons outside the visible range are exposed one by one; when a downward drag gesture is detected in its area, an animation of scrolling all buttons downward is displayed and the buttons outside the visible range are exposed one by one.

3. The touch interactive display system for light aircraft according to claim 1, characterized in that The virtual button group is also used to perform transition animation when switching between the basic state, the lock state, the menu state, and each level of the menu state.

4. The touch interactive display system for light aircraft according to claim 1, characterized in that The virtual button group fills the entire screen vertically.

Images