Cursor control method and cursor control device for aircraft cockpit

By employing an optical engine and an ergonomically designed cursor control device in the aircraft cockpit, the problems of insufficient user comfort, risk of accidental touch, and anti-interference capability of existing cursor control devices have been solved, achieving higher sensitivity and stability, extending service life, reducing maintenance costs, and improving pilot operating efficiency and flight safety.

CN121879632APending Publication Date: 2026-04-17COMMERCIAL AIRCRAFT CORP OF CHINA LTD +1
View PDF 4 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
COMMERCIAL AIRCRAFT CORP OF CHINA LTD
Filing Date
2026-01-07
Publication Date
2026-04-17

AI Technical Summary

Technical Problem

Existing aircraft cockpit cursor control devices suffer from problems such as poor user comfort, high risk of accidental touch, low sensitivity, insufficient anti-interference capability, and short service life.

Method used

It employs an optical engine, including a light source, optical sensor, and image processor. The optical sensor acquires images, which are then analyzed by the image processor to achieve cursor positioning. Combined with dot-matrix LEDs and an ergonomically designed contact surface, it enhances the sensitivity and stability of cursor control.

Benefits of technology

It improves the sensitivity and stability of cursor control, reduces the risk of misoperation, extends service life, reduces maintenance costs, and enhances pilot operational efficiency and flight safety.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN121879632A_ABST
    Figure CN121879632A_ABST
Patent Text Reader

Abstract

A cursor control device (100) for a display screen of an aircraft cockpit comprises a digital interface, a control in communication connection with a flight control system of an aircraft, and an optical engine having: a light source; an optical sensor (111) disposed opposite the light source at a contact surface (143) of the housing of the device and configured to receive reflected light from the contact surface to acquire an image, the contact surface being positioned such that light from the light source can be completely shielded by touching the contact surface when the device is in use; and the image processor is in communication connection with the optical sensor to receive and analyze the image so as to realize cursor positioning and send the image to a flight control system through a digital interface. According to the photoelectric cursor control device, the reliability and the anti-interference capability are improved, and the efficiency of operating the cursor by a pilot can be improved. The invention further provides the cockpit seat (200) provided with the cursor control device and a cursor control method by means of the cockpit seat (200).
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to the field of human-computer interaction in aircraft cockpits. Specifically, this invention relates to a cursor control method and a cursor control device used in aircraft cockpits. Background Technology

[0002] In current aircraft cockpit displays, movable cursors are widely used for operation. Cursor control is primarily achieved through a cursor control device located on the central control panel of the cockpit. This control device is a crucial component of the aircraft control system, affecting not only navigation and flight control but also flight safety and efficiency.

[0003] Most mainstream monitors currently use trackball-type cursor controls. This is a mechanical device, primarily located on the left and right sides of the central control panel. In this type of cursor control, a rotatable trackball controls the cursor's movement. As the trackball rolls, sensors detect the ball's movement and convert it into an electrical signal, thereby controlling the cursor's movement on the display. Additionally, push-button buttons are located on both sides of the trackball for users to confirm selected targets.

[0004] A cursor control system for an aircraft display device is known from CN 106233238 B (publication date: January 10, 2020). In this system, a mechanical trackball, a touch screen, or a joystick is used to move the cursor. By controlling the movement of the cursor in the grid cells, the system can achieve fast cursor movement and positioning while reducing operational redundancy and optimizing the cursor movement path.

[0005] A cursor control device for controlling an aircraft display screen, integrated into the front of the armrest of a cockpit seat, is known from US 20190112030 A1 (publication date: April 18, 2019). The integrated control head includes, for example, a button, scroll wheel, or touch surface. This control device primarily improves pilot comfort by optimizing its size, shape, and configuration to enhance the fit between the control device and the size and posture of the pilot's hand during operation.

[0006] A cursor positioning system incorporating voice recognition, which can be used in an aircraft cockpit, is known from US 8139025 B1 (publication date: March 20, 2012). With this positioning system, through area optimization, the pilot can first quickly move the cursor to a rough target area via voice command, and then precisely click it with a mechanical trackball.

[0007] In addition, the applicant has proposed a cursor movement control system for an airborne interactive interface for an aircraft in CN 111767001 B (publication date: May 30, 2023). In this system, the optimal target movement path is selected by dividing the module area and optimizing the cursor movement path to achieve rapid cursor movement based on the moving target.

[0008] The inventors have discovered the following drawbacks in existing cursor control devices of this type: 1) Poor user comfort In mainstream civil aircraft models, the two cursor control devices are located on either side of the central base and are usually quite large. Due to differences in cabin layout and pilot height and build, for example, when the aircraft encounters an emergency, the restraint of the seat belt often requires the pilot to bend over or turn sideways when using the cursor control devices to move the cursor. Prolonged use can easily lead to fatigue in the pilot's waist and arms.

[0009] 2) High risk of accidental touch and low sensitivity.

[0010] Because the central base housing the cursor control device also integrates multiple other devices and has limited space, pilots may accidentally touch the control stick or other surrounding equipment, especially the main flight stick, when operating the cursor control device. In situations of extreme vibration, this can significantly impact flight safety. To reduce the risk of such misoperation, existing cursor control devices are set to a lower sensitivity. However, this reduces pilot efficiency, particularly failing to meet the demands for high-sensitivity, rapid operation in emergency situations.

[0011] 3) Insufficient anti-interference capability

[0012] Existing mechanical trackball control devices include damping mechanisms, but these mechanisms are often insufficient to completely prevent trackball movement in the face of mechanical vibrations and equipment movement caused by aircraft turbulence or other emergencies. The movement of the trackball creates a trajectory, which in turn introduces the risk of malfunction in the photoelectric control device during such emergencies.

[0013] 4) Service life and maintainability

[0014] Existing cursor control devices employ a mechanical design. Wear and tear from use leads to a gradual decrease in cursor movement accuracy. Therefore, the overall lifespan of such cursor control devices is limited. While these mechanical cursor control devices are equipped with damping mechanisms, such as magnetic damping combined with springs, this increases the complexity and weight of the device, raising the manufacturing and operating costs of the aircraft. Furthermore, using a trackball requires frequent cleaning, and sometimes even disassembly, of the cursor control device to remove dust, debris, and other foreign objects that may accumulate and affect the trackball's scrolling flexibility. Replacement of components may also be necessary, further increasing maintenance costs and complicating the maintenance process.

[0015] Therefore, the art still desires to propose a control device and corresponding control method that can at least improve or even completely avoid the aforementioned defects of existing mechanical cursor control devices. Summary of the Invention

[0016] This invention was made in view of the aforementioned technical problems. According to a first aspect of the invention, a cursor control device for a display screen in an aircraft cockpit is provided. This device can improve the reliability and sensitivity of controlling changes in the cursor trajectory.

[0017] The cursor control device according to the present invention includes: a digital interface, a control unit, and an optical engine having: a light source; an optical sensor disposed opposite to the light source at a contact surface of the housing of the cursor control device and configured to receive reflected light from the contact surface to acquire an image, the contact surface being positioned such that when using the cursor control device, touching the contact surface can completely block the light from the light source; an image processor communicatively connected to the optical sensor to receive and analyze the image from the optical sensor to achieve cursor positioning, and to transmit the cursor positioning signal to the flight control system of the aircraft via the digital interface.

[0018] This invention proposes a cursor control device for a cursor on a display screen in an aircraft cockpit. The cursor device uses an optical engine, combining a light source, an optical sensor, and an image processor. It calculates the relative movement direction and distance of the operator's (e.g., a pilot's) finger with the contact surface to obtain the cursor's trajectory change on the cockpit display screen, thereby achieving cursor positioning.

[0019] The photoelectric cursor control device of the present invention avoids the shortcomings of existing mechanical cursor control devices using trackball structures, such as weak rapid positioning capability, poor movement smoothness, and susceptibility to foreign object interference causing trackball jamming or deviation. By using an optical engine to obtain the cursor positioning signal, the cursor control device of the present invention has higher sensitivity and stability, strong positioning capability, and good movement smoothness, meeting the anti-turbulence requirements during flight. Furthermore, the cursor control device of the present invention is easy to operate, lighter in overall weight than mechanical cursor control devices using trackballs, and has lower maintenance costs. In addition, using an optical engine instead of a trackball extends the service life of the cursor control device. The use of an optical engine also makes the cursor control device of the present invention more reliable and resistant to interference, and improves the efficiency of pilot operation.

[0020] In one aspect of the invention, the light source includes a plurality of light-emitting diodes arranged in a dot matrix on the surface of the housing of the cursor control device opposite to the contact surface.

[0021] For this photoelectric cursor control device, the use of a dot-matrix structure of light-emitting diodes (LEDs) as the light source improves the accuracy of the optical engine. This avoids the risk of a single-point light source being easily blocked by the pilot's finger, causing the image processor to misjudge cursor movement and leading to erroneous cursor movement. The multiple LEDs arranged in a dot-matrix pattern ensure that the contact surface receives light from all directions. Therefore, when a finger fully touches the contact surface, it completely blocks the light from the source, ensuring the accuracy of the trajectory, reducing the response error of the optical sensor, and improving the accuracy of the cursor trajectory changes obtained by the optical engine.

[0022] Preferably, the contact surface located on the surface of the cursor control device is designed as a groove that is recessed inward relative to the surrounding surface.

[0023] Furthermore, by setting the contact surface as a recessed groove extending inward from the surface of the cursor control device's housing, tactile feedback can be provided to the pilot indicating the range of finger movement for moving the cursor. In other words, when an operator, such as a pilot, uses the cursor control device, they can determine whether their finger is within the prescribed range of motion by observing changes in the depth of the recessed contact surface.

[0024] More preferably, an optical coating is also provided on the surface of the contact surface that is configured as a groove.

[0025] By applying an optical coating to the surface of the groove, residual reflected light can be minimized, reflectivity can be controlled, interference from external light on the optical engine can be reduced, and the reliability, accuracy and stability of the cursor control device can be improved.

[0026] In a non-limiting embodiment, the angle α between the first housing surface where the contact surface is located and the second housing surface where the light-emitting diode is located ranges from 30 to 45 degrees.

[0027] It has been found that when the angle between the contact surface of the cursor control device and the surface of the light source is within the above-mentioned angle range, the cursor trajectory change recognized by the optical engine is highly accurate, the cursor engine response efficiency is high, the positioning accuracy achieved by the optical engine is guaranteed, and the interference of stray light is suppressed.

[0028] In another non-limiting embodiment of the invention, the control unit of the cursor control device includes a first-side control member disposed on a first side of the housing and a second-side control member disposed on a second side opposite to the first side. The first-side control member and the second-side control member are communicatively connected to the flight control system via a digital interface. Neither the aforementioned contact surface nor the light source is disposed on the first or second side of the housing. The first-side control member includes a first-side confirmation button. The second-side control member includes a second-side confirmation button.

[0029] By integrating the cursor control components onto opposite sides of the cursor control housing, specifically on the surface side without optical sensors or light sources, an ergonomic cursor control design is achieved. Pilots can input and select operations by moving their fingers to the first and second sides of the housing and slightly bending them to press buttons, eliminating the need to reach out and bend over to operate various buttons typically located next to the trackball or on a central console, such as in the cockpit.

[0030] In a non-limiting embodiment of the invention, the first side control also includes selection buttons, an up button, and a down button, each different in size and shape. The selection buttons are designed as a multi-function keyboard. The second side control also includes menu buttons and page-turning buttons, each different in size and shape.

[0031] Here, by designing the size and shape of the buttons on each of the two sides of the control unit of the cursor control device to be different from each other, the pilot can distinguish the different buttons by touch, which makes it convenient for the pilot to operate the cursor control device quickly, and ensures that the pilot can control the cursor, input and select operations as accurately as possible in an emergency, without having to look at the buttons again.

[0032] In a non-limiting embodiment of the present invention, the buttons of the first-side control member and the second-side control key, as well as the contact surfaces included in the optical engine, are arranged in a position that is easily accessible to the pilot's fingers, so that the pilot can easily operate the cursor control device and the wrist is always in a comfortable resting state during operation.

[0033] The cursor control device according to the present invention improves accuracy, response speed, reliability, anti-interference performance and maintenance cost by using an optical engine to obtain the cursor movement trajectory, thus achieving more intelligent and efficient control of the displayed cursor.

[0034] According to a second aspect, the present invention also proposes a cockpit seat for an aircraft cockpit, the cockpit seat including armrests, the armrests having a cursor control device as described in any of the above technical solutions at their front ends.

[0035] By using the cockpit seat according to the present invention, the cursor control device is located on the armrest of the seat, rather than on the central control panel of the aircraft cockpit. This saves integration space on the compact central control panel of the aircraft cockpit, allowing more space to integrate other equipment. This facilitates the pilot's movement and input of the cursor in any scenario, including emergencies, reducing the probability of accidental touches and improving flight safety. At the same time, it is more convenient and comfortable for the pilot to operate and control the cursor.

[0036] When using this cockpit seat, the pilot can perform basic operations such as moving, selecting, and inputting the cursor while leaning back in the seat. This ensures pilot comfort while also guaranteeing precise control of the cursor, including changes in the cursor's trajectory, even in emergencies such as vibration, turbulence, or stall, reducing the probability of accidentally touching other devices.

[0037] In a preferred embodiment of the invention, the armrests of the cockpit seat are hinged to the cockpit seat body at the rear end opposite the front end, allowing the armrests to rotate upwards to align parallel to and in the same plane as the cockpit seat backrest. This arrangement further facilitates the pilot's entry into and seating in the cockpit seat.

[0038] According to a third aspect, the present invention also proposes a cursor control method for moving and controlling a cursor on a display screen in the cockpit of an aircraft by manipulating a cursor control device as described in any of the above embodiments.

[0039] This cursor control method is easy to operate and enables rapid cursor positioning and movement. It offers higher accuracy and reliability, and avoids interference from ambient light on cursor positioning.

[0040] Additional features and advantages described herein will be set forth in the detailed description below, and will be recognized by those skilled in the art either by the following description or by practice of the embodiments described herein, including the detailed description below, the claims, and the drawings. Attached Figure Description

[0041] With reference to the above objectives, the technical features of the present invention are clearly described in the following claims, and its advantages are apparent from the following detailed description with reference to the accompanying drawings, which illustrate preferred embodiments of the invention by way of example, without limiting the scope of the inventive concept.

[0042] Figure 1 A cockpit seat according to an embodiment of the present invention is shown; Figure 2 Shown in enlarged view Figure 1 The armrest of the cockpit seat shown; Figure 3 The setting is shown in the left view. Figure 2 A cursor control device at the armrest according to an embodiment of the present invention; Figure 4 Shown in right view Figure 3 The cursor control device; Figure 5 Show in 3D Figure 3 The cursor control device; Figure 6 A stereoscopic view shown from another angle Figure 3 The cursor control device; and Figure 7 A stereoscopic view shown from another angle Figure 3 The cursor control device.

[0043] List of reference numerals

[0044] 100 Cursor Control Device

[0045] 101 Part 1

[0046] 102 Part Two

[0047] 111 Optical Sensors

[0048] 112 Light Emitting Diode

[0049] 120 First side control unit

[0050] 121 Selection Button

[0051] 122 Up button

[0052] 123 Down button

[0053] 124 First side confirmation button

[0054] 130 Second side control unit

[0055] 131 Menu button

[0056] 132 Page Turning Buttons

[0057] 133 Second side confirmation button

[0058] 140 housing

[0059] 141 Front end

[0060] 142 Upper surface

[0061] 143 Contact surface

[0062] 144 surface

[0063] 200 cockpit seats

[0064] 210 Seat armrests

[0065] 220 Seat backrest. Detailed Implementation

[0066] Reference will now be made in detail to various embodiments of the invention, examples of which are shown in the accompanying drawings and described below. Although the invention will be described in conjunction with exemplary embodiments, it should be understood that this specification is not intended to limit the invention to those exemplary embodiments. Rather, the invention is intended to cover not only these exemplary embodiments, but also various alternatives, modifications, equivalents, and other embodiments that may be included within the spirit and scope of the invention as defined by the appended claims. For ease of interpretation and precise definition in the appended claims, the terms “upper,” “lower,” “inner,” and “outer” are used to describe features with reference to their location in the exemplary embodiments shown in the figures.

[0067] Figure 1 The diagram shows a cockpit seat 200 used in an aircraft cockpit. A cursor control device 100 is located at the top of an armrest 210 on one side of the cockpit seat 200. The cockpit seat 200 can be either a driver's seat or a co-pilot's seat. The armrest 210 of the cockpit seat 200 is designed to be retractable. The armrest 210 is hinged at its rear end away from the observer, allowing it to rotate upwards in the drawing plane to align parallel to and in the same plane as the backrest 220 of the cockpit seat 200. This makes it easier for the pilot to enter and exit the seat 200 and to use the cursor control device 100 located on the armrest 210.

[0068] Since the cursor control device 100 is located at the armrest 210 of the cockpit seat 200, it no longer occupies the space-constrained central cockpit base. This allows for a significant reduction in the size of the central base and / or frees up usable space there, thereby enabling further improvements in the layout of other avionics integrated at the central base.

[0069] Figure 2 The cursor control device 100 is further shown in a perspective view. The cursor control device 100 includes control components and an optical engine disposed on the housing 140. In terms of communication, the cursor control device 100 is connected to the aircraft's flight control system via an interface to achieve real-time transmission of cursor control signals and function commands, thereby controlling the movement of the cursor on the display screen and enabling operations such as selection via the control components.

[0070] The following text will refer to Figures 3 to 7 Further explanation of the cursor control device 100.

[0071] The housing 140 of the cursor control device 100 includes a straight-extending first portion 101 and a second portion 102 intersecting the first portion 101 and extending at a non-right-angle angle. For example... Figure 4 As shown, in the illustrated embodiment, the angle α between the first part 101 and the second part 102 is 30 to 45 degrees.

[0072] The cursor control device 100 is ergonomically designed. To ensure the pilot's comfort in holding and supporting the arm, and considering the buttons and input keys commonly used in human-computer interaction, these input key sets and buttons are located on the opposite first and second sides of the first part 101 of the housing 140.

[0073] During flight, the pilot places their hands on the armrests 210 of the cockpit seat 200. The pilot's palms naturally rest on the upper surface 142 of the first portion 101 of the housing 140 of the cursor control device 100, with fingers hanging naturally from both sides of the upper surface 142. This allows the pilot to easily operate the first-side controls 120 and second-side controls 130 located on the first and second sides of the first portion 101 of the housing 140 for input operations. A front end face 141 is formed between the first and second sides. In the illustrated embodiment, no buttons or keys are provided on the front end face 141. Figure 5 As shown. This reduces the probability of accidental touches by the pilot when using the cursor control device 100.

[0074] like Figure 3 and Figure 4 As shown, the first side control unit 120 and the second side control unit 130 each include multiple buttons and keys for performing functions such as confirmation, menu invocation, and page switching.

[0075] exist Figure 3In the center, from left to right, the first side control 120 includes a selection button 121, an up button 122, a down button 123, and a first-side confirmation button 124. The selection button 121 is designed as a multi-function keypad (MKB) input button. The pilot can use the knobs and buttons on the selection button 121 to select the input content included in the MKB. The up button 122 and down button 123 are symmetrically distributed, serving as selection buttons for the cursor display on the upper and lower screens. The cursor distribution area can be switched using the up button 122 and down button 123. The first-side confirmation button 124 is configured for confirming the input of the selected content.

[0076] Reference Figure 4 On the second side, opposite the first side, from right to left, the second-side control 130 includes a menu button 131, a page-turning button 132, and a second-side confirmation button 133. The menu button 131 is configured for page selection. The page-turning button 132 is configured for turning pages of alarm information on the CAS page. The second-side confirmation button 133 is configured for confirming the input action.

[0077] The pilot's operation of the buttons in the first side control unit 120 and the second side control unit 130 is transmitted to the flight control system through the signal processing circuit, thereby realizing the corresponding functions and realizing operations such as clicking, selecting, inputting, and confirming on the display screen.

[0078] The arrangement order, shape, and size of the buttons 121, 122, 123, and 124 in the first-side control component 120 are not limited to... Figure 3 The arrangement, shape, and size of the buttons 131, 132, and 133 in the second-side control unit 130 are not limited to the situation shown. Figure 4 The situation is shown.

[0079] In the illustrated embodiment, all buttons or keys in the first and second side controls have different shapes and sizes. This is to facilitate pilots' tactile identification of different buttons, reduce the probability of pilot error, and improve pilot operating efficiency.

[0080] For example, in the illustrated embodiment, the first-side confirmation button 124 and the second-side confirmation button 133 are both relatively large and are respectively located on the first and second sides, closest to the front surface 141 of the cursor control device 100. However, in other embodiments not shown, the first-side confirmation button 124 and the second-side confirmation button 133 may be located at other positions on the first and second sides of the housing 140. They may also not be the largest relative to other buttons and keys on the same side.

[0081] To achieve photoelectric control of the cursor movement trajectory, the cursor control device 100 includes an optical engine. The optical engine consists of an optical sensor 111, a light-emitting diode 112, and an image analysis chip (not shown).

[0082] A contact surface 143 is provided on the lower surface of the first part 101 of the cursor control device 100, opposite to the upper surface 142. Figure 7 As shown. The contact surface 143 is designed as a recessed groove relative to the surrounding surface. The depth of the recess ranges from 0.1 to 0.5 cm. The groove restricts the range of movement of the pilot's fingers. When the pilot moves out of the groove, tactile feedback from the groove wall will alert the pilot to the movement. An optical sensor 111 is provided at the contact surface 143 to sense the light emitted by the light-emitting diode 112 positioned opposite it, as further explained below. If necessary, an optical coating treatment can also be applied to the surface of the contact surface 143 to avoid interference from ambient light. For example, in this embodiment, a silicon dioxide antireflective film with a thickness of 100-150 nm is deposited on the contact surface 143 to control the reflectivity to below 0.5%, thereby reducing interference from external light.

[0083] Light-emitting diodes (LEDs) 112 are arranged in a matrix array on the inclined extending surface 144 of the second portion 102 of the housing 140 of the cursor control device 100, opposite the upper surface 142. The array of LEDs 112 is positioned opposite the contact surface 143, such that light emitted by the LEDs 112 as a light source illuminates the contact surface 143, thereby being sensed by the optical sensor 111. The LEDs 112 are uniformly distributed in a dot matrix pattern. This avoids the following situation that may occur when using a single point light source: the pilot moves the cursor with their finger, but the finger directly blocks the propagation path of the light emitted by that single point light source. This would cause the optical sensor 111 to misidentify the cursor, making it impossible to obtain the cursor movement trajectory intended by the pilot through analysis by the associated image chip.

[0084] In the illustrated embodiment, the cursor control device 100 may employ closed-loop feedback control. The controller of the cursor control device 100 is configured to adjust the driving current of the light-emitting diode 112 in real time based on the output signal of the optical sensor 111, ensuring that the optical sensor 111 receives a stable reflected light intensity from the light-emitting diode 112 under different contact pressures ranging from 0.1 to 5 N. Here, the adjustment range of the driving current is 0-150 mA.

[0085] The cursor control device 100 configured as described above can maintain stable operation within a temperature range of -20℃ to 50℃, giving it good environmental temperature adaptability. Even in emergency situations with extreme temperatures in the cockpit, it can still control the cursor and ensure flight safety.

[0086] The following explains the pilot's operation of controlling the cursor to move on the display screen through the cursor control device 100, and the pilot's operation of inputting data on the display screen through the first side control and the second side control.

[0087] Pilots typically rest their hands on the armrests 210 of the cockpit seat 200. At this time, the pilot's fingers naturally droop, blocking some of the light emitted by the LEDs 112. Because the LEDs 112 located in the second part 102 of the housing 40 below the fingers are arranged in a dot matrix pattern, although the pilot's fingers block the light source coming from the front relative to the optical sensor 111, the light from the LEDs 112 entering from the sides relative to the optical sensor 111 can still be sensed by the optical sensor 111.

[0088] When the pilot moves the cursor on the display screen using the cursor control device 100, his finger must bend inward from its natural vertical position to touch the contact surface 143 located in the first part 101 of the housing 140. At this time, the optical sensor 111 located within the groove of the contact surface 143 may be completely blocked by the pilot's finger, thus completely blocking the light from the light-emitting diode 112. In this situation, the optical sensor 111 cannot receive any light.

[0089] In terms of structural design, the cursor control device 100 suppresses the interference of stray light on cursor movement control by optimizing the ratio of groove depth to tilt angle at the contact surface, for example, to 1:1.2.

[0090] The optical engine is configured such that, in this situation, the optical sensor 111 will collect the movement signal of the pilot's finger. The optical engine then uses image processing technology and digital conversion circuitry to identify and scale the movement path represented by the movement signal, ultimately displaying it as cursor movement on the cockpit control display.

[0091] Specifically, the pilot's finger (contact area 0.5-1.2 cm²) is constructed as a grooved contact surface 143. Light emitted by the LED 112 undergoes diffuse reflection through the contact surface 143. Due to the difference in refractive index between the contact area of ​​the contact surface 143 and air (e.g., skin n≈1.38 while air n=1), approximately 3.5% of the incident light is reflected under the Fresnel effect. When the reflected light passes through the optical filter layer, the visible light component (wavelength range 400-700 nm) from the ambient light is blocked, and only the effective signal in the 800-1000 nm band from the light from the LED 112 is retained and sensed by the optical sensor 111. The optical sensor 111 captures images of the reflected light spot at a rate of 120 frames per second and transmits a series of images to the analysis chip.

[0092] The embedded image analysis chip has a main frequency of, for example, 1.2 GHz, and integrates a convolutional neural network accelerator. The image analysis chip is configured to perform real-time analysis of this series of images, calculate the relative movement direction and distance between the pilot's finger and the contact surface 143, and then calculate the change in cursor position, converting it into digital control signals and sending them to the flight control system, thereby realizing the change in the cursor's movement path on the display screen.

[0093] Image processing algorithms for embedded image analysis chips are known to those skilled in the art; examples are provided here only and are not intended to be limiting. The image processing algorithms for image analysis chips comprise three key steps: First, an adaptive threshold segmentation algorithm is used to separate the finger region from the background noise. In this embodiment, the number of iterations is set to 16. Then, feature points are extracted using the Harris corner detection algorithm, wherein, in this embodiment, 200 key points are extracted per frame; Finally, the Lucas-Kanade optical flow method is used to calculate the displacement vector of the feature points, where, in this embodiment, the precision of 0.1 is configured as pixels.

[0094] In other embodiments not shown, the number of iterations, the number of keypoints extracted per frame, and the extraction accuracy can be set according to specific circumstances.

[0095] Furthermore, to eliminate motion blur, dynamic exposure control technology is employed when the image analysis chip is only processing the image. The exposure time is automatically adjusted based on the speed of the pilot's finger movements, with an adjustment range of 10-100 μs.

[0096] It has been demonstrated that, under ambient light of 300 lux, the positioning accuracy of the cursor control device 100 can reach 0.05 mm RMS, and the response time is less than 15 ms.

[0097] When a pilot needs to modify a flight plan, the pilot can first move the cursor on the display screen to the target input box by operating the contact surface 143 with their finger; then the pilot can operate the first side confirmation button 124 in the first side control 120 of the first part 101 of the cursor control device 100 to perform the confirmation operation.

[0098] When the pilot needs to switch the page displayed on the display screen, the pilot can quickly switch the page displayed on the upper and lower screens by operating the up button 122 and the down button 123 in the first side control 120 with their fingers.

[0099] The aforementioned configuration of the cursor control device 100 improves the sensitivity and accuracy of cursor control and shortens the response time. Simultaneously, the pilot can maintain a normal posture while leaning back in the cockpit seat 200 to perform cursor movement and control operations, enhancing pilot comfort.

[0100] The buttons and photoelectric contact surfaces 143 included in the first side control unit 120 and the second side control unit 130 of the cursor control device 100 are all arranged in positions easily accessible to the pilot's fingers, ensuring that the pilot's wrist is always in a comfortable resting state when operating the cursor control device 100. When controlling the cursor, pilots of different body types can achieve precise cursor movement simply by moving their fingers, without needing to bend over or turn to the side as with a traditional trackball, and without being affected by seatbelts. Operation can also be performed in emergencies, achieving precise cursor control. The arrangement of the cursor control device 100 also reduces the chance of accidental contact with other flight control electronic equipment.

[0101] [Other Embodiments]

[0102] In the above embodiments, the buttons and keys included in the first side control member 120 and the second side control member 130 have been described, but the present invention is not limited thereto. In other embodiments, one or more custom buttons with other commonly used or desired functions may be included in the first side control member 120 and the second side control member 130, depending on the needs of the model.

[0103] In the above embodiments, the wavelength of the light-emitting diode 112, which serves as the light source in the optical engine, and the type of the optical sensor 111 used to receive the light emitted by the light source are not specifically limited, and can be configured according to different lighting environments.

[0104] In the above embodiments, the shape of the groove-shaped contact surface 143 is not specifically limited. Although it is shown as a general rectangle in the illustrated embodiment, it can also be manufactured in other shapes as needed to accommodate the finger operation habits of different pilots.

[0105] The cursor control device 100 of this invention uses a photoelectric optical engine to replace the existing mechanical trackball, enabling cursor movement. This improves the smoothness of cursor movement and positioning accuracy, thereby enhancing the pilot's control experience. It is also less prone to getting dirty, facilitating comfortable and easy operation for the pilot, and is highly sensitive and stable. Even during taxiing or turbulent flight, in emergency situations such as maneuvers or bouncing, or in complex weather conditions, the pilot can maintain stable operation with the help of the cursor control device 100. The cursor control device 100 meets the requirements for turbulence resistance, helping the pilot to control commands more accurately.

[0106] The cursor control device has strong positioning capability, smooth movement, low maintenance cost, long service life, and reduces equipment weight to a certain extent, thereby improving the aircraft's economy, overall performance and safety.

[0107] Within the scope of this invention, various embodiments can be freely combined, or appropriately modified or omitted.

Claims

1. A cursor control device (100) for a display screen in an aircraft cockpit, the cursor control device (100) comprising: Digital interface, The control unit, which is communicatively connected to the aircraft's flight control system, and An optical engine, the optical engine having: light source; An optical sensor (111) is disposed opposite to the light source at the contact surface (143) of the housing (140) of the cursor control device (100) and configured to receive reflected light from the contact surface (143) to acquire an image, wherein the contact surface (143) is positioned such that when the cursor control device (100) is used, light from the light source can be completely blocked by touching the contact surface (143); An image processor is communicatively connected to the optical sensor (111) to receive and analyze the image from the optical sensor (111) to achieve cursor positioning, and sends it to the flight control system through the digital interface.

2. The cursor control device (100) of claim 1, characterized in that The light source includes a plurality of light-emitting diodes (112) arranged in a dot matrix, which are located on the surface of the housing (140) opposite to the contact surface (143).

3. The cursor control device (100) of claim 2, characterized in that The contact surface (143) is designed to be an inwardly oriented groove.

4. The cursor control device (100) of claim 3, characterized in that An optical coating is provided on the surface of the groove.

5. The cursor control device (100) of claim 3, characterized in that The angle α between the housing surface where the contact surface (143) is located and the housing surface where the light-emitting diode (112) is located is in the range of 30 to 45 degrees.

6. The cursor control device (100) as described in claim 3, characterized in that, The control unit of the cursor control device (100) includes a first side control member (120) disposed on a first side of the housing (140) and a second side control member (130) disposed on a second side opposite to the first side. The first side control member (120) and the second side control member (130) are communicatively connected to the flight control system through the digital interface. Wherein, the contact surface (143) and the light source are not located on the first side and the second side, and The first side control (120) includes a first side confirmation button (124), and the second side control (130) includes a second side confirmation button (133).

7. The cursor control device (100) as described in claim 6, characterized in that, The first side control (120) also includes selection buttons (121), up buttons (122), and down buttons (123) that are different in size and shape from each other. The selection buttons (121) are designed as a multi-function keyboard. The second side control (130) also includes menu buttons (131) and page-turning buttons (132) that are different in size and shape from each other.

8. A cockpit seat (200), characterized in that... Includes a handrail (210), wherein the handrail (210) is provided with a cursor control device (100) as described in any one of claims 1 to 7 at its front end.

9. The cockpit seat (200) as described in claim 8, characterized in that, The armrest (210) is hinged to the body of the cockpit seat (200) at the rear end opposite to the front end, such that the armrest can rotate upward to be parallel to and aligned with the backrest of the cockpit seat (200) in the same plane.

10. A cursor control method, characterized in that... The cursor on the cockpit display screen is controlled by manipulating the cursor control device (100) as described in any one of claims 1 to 7.

Citation Information

Patent Citations

  • Cursor control for aircraft display devices

    CN106233238B

  • Cursor movement control method for aircraft in-flight interactive interfaces

    CN111767001B

  • Cockpit seat armrest avionics cursor control device

    US20190112030A1

  • Cursor positioning via voice recognition

    US8139025B1