Training device for monitoring eye movement track of flying trainee in real time

Abstract

The utility model relates to the technical field of simulated flight training, and discloses a training device for monitoring the eye movement track of a flying trainee in real time, comprising a bottom plate, one end of which is fixedly connected with a seat for bearing the flying trainee; the flying trainee wears an eye tracker for monitoring and recording the trainee eye movement track in real time; the other end of the bottom plate faces the seat and is provided with a display module used for displaying the environment outside the flight student simulation cabin and displaying an instrument interface. The manipulation modules are arranged below the display module and provide simulated manipulation input functions for flight trainees; a monitor used for displaying the eye movement track of the flying trainee to a teacher is further arranged beside the seat, and the eye tracker is electrically connected with the monitor. The device is easy to operate, and a teacher can conveniently observe the eye movement of a flight student during training, so that the attention distribution mode of the student can be timely guided and adjusted, and the flight training quality and the teaching efficiency are improved.

Description

Technical Field

[0001] The utility model relates to the technical field of simulated flight training, in particular to a training device for real-time monitoring of eye movement tracks of flight trainees. Background Art

[0002] When performing flight missions, flight trainees need to pay accurate and timely attention to the status of instruments and other equipment in the cockpit and the environment outside the cabin. However, the attention of flight trainees is always limited, which requires trainees to have the ability to reasonably allocate attention to ensure the safety of the flight process and the smooth completion of the flight mission. In order to train and improve the ability of flight trainees to allocate attention resources, eye trackers can be used to observe the eye movements of trainees during simulated flight training. Current eye tracker technology mostly uses large and heavy head-mounted or desktop devices, which will limit the naturalness and convenience of flight trainees' operations when performing tasks.

[0003] The existing Chinese patent with announcement number CN220340816U provides an auxiliary training device for recording the attention distribution of flight trainees. The device includes a bottom plate, a base is fixedly connected to one side of the top of the bottom plate, a slide groove is provided on the base, and a seat is provided on the slide groove for supporting the flight trainees; a visual component is arranged on the other side of the top of the bottom plate through a multi-functional bracket, and is used to provide visual and sound feedback to the flight trainees; a simulation component is arranged on the multi-functional bracket and located between the seat and the visual component, and is used to simulate flight functions for the flight trainees; a detection component is arranged corresponding to the simulation component and is worn on the eyes of the flight trainees, and is used to monitor the eye movement trajectory of the flight trainees.

[0004] The defect of this patented technology is that it cannot observe the eye movement trajectory of flight trainees during training in real time, and does not provide instructors with a device that can monitor the eye movement trajectory of trainees during training. Summary of the invention

[0005] In order to overcome or alleviate one or more of the above technical problems, the utility model aims to provide a training device for real-time monitoring of the eye movement trajectory of flight trainees.

[0006] The utility model provides the following technical solutions:

[0007] A training device for real-time monitoring of a flight trainee's eye movement trajectory comprises a base plate (1), one end of the base plate (1) being fixedly connected to a seat (2) for receiving the flight trainee; the flight trainee wears an eye tracker (23) for real-time monitoring and recording the trainee's eye movement trajectory; the other end of the base plate (1) faces the seat (2) and is provided with a display module for displaying a simulated cabin environment and an instrument interface for the flight trainee; the control module is arranged below the display module and provides a simulated control input function for the flight trainee; a monitor for displaying the flight trainee's eye movement trajectory to an instructor is also arranged next to the seat (2), and the eye tracker (23) is electrically connected to the monitor.

[0008] In the above implementation, in the field of flight training, the instructor is the instructor of the flight trainee. The flight trainee wears an eye tracker during training, and the instructor observes and guides the flight trainee. Therefore, the eye tracker records the eye movement trajectory of the flight trainee, and the monitor also displays the eye movement trajectory of the trainee. The instructor can observe the eye movement trajectory of the trainee by observing the monitor, and the instructor observing the monitor from the side will not affect the eye movement trajectory of the trainee during training.

[0009] According to some embodiments, the first integrated bracket and the second integrated bracket are both arranged on the bottom plate (1), the first integrated bracket includes a first column (6), the top of the first column (6) is provided with a first bracket capable of carrying a plurality of environmental displays (16); a second bracket carrying an instrument display (15) is arranged on the first column (6) and below the first bracket; a carrying platform (3) is arranged on the first column (6) and below the second bracket, and the platform (3) is connected to a rudder (17) of the control module;

[0010] The second integrated bracket comprises a second column (19), the upper ends of which extend inwardly and outwardly respectively, the inner end being connected to the throttle (4) of the operating module, and the outer end being connected to the monitor.

[0011] According to some embodiments, a plurality of the environment displays (16) are symmetrically arranged on both sides of the top of the first column (6).

[0012] According to some embodiments, the plurality of environment displays (16) and the instrument display (15) are connected to the first bracket and the second bracket respectively via a back panel with an adjustable angle.

[0013] According to some embodiments, the number of the ambient displays (16) is three.

[0014] According to some embodiments, a pedal rudder (18) of the operating module for simulating control is provided on the base plate (1) between the first column (6) and the seat (2).

[0015] According to some embodiments, the instrument display (15) is arranged to be tilted toward the eyes of the flight trainee.

[0016] According to some embodiments, the eye tracker (23) is of glasses type.

[0017] According to some embodiments, the monitor is selected from a tablet computer.

[0018] Compared with the prior art, the utility model has the following beneficial effects:

[0019] The utility model provides a training device for real-time monitoring of eye movement trajectories of flight trainees. The display module and the control module are used to provide the flight trainees with a simulated flight driving environment and basic control functions. The environment display of the display module is used to display the environment outside the cabin, which can provide a basis for the flight trainees to judge the flight attitude. The instrument display is used to display flight-related instrument data, including airspeed, altitude, slope, etc., to help the trainees understand the flight status in time. The eye tracker is worn on the eyes of the flight trainees, which will not affect the students' routine operations, ensures the students' naturalness in the process of performing tasks, and thus improves the authenticity of the eye movement data. The monitor, such as a tablet computer, is used to display the eye movement trajectory of the flight trainees during the flight, which is convenient for the instructor to observe the students' attention distribution in real time, so as to guide and adjust the students' attention distribution mode in time, improve the training efficiency, and improve the teaching effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 A front structural schematic diagram of an embodiment of the utility model is provided.

[0021] Figure 2 A schematic diagram of the back structure provided for an embodiment of the utility model.

[0022] Figure 3 This is a thermal diagram of eye movements of a flight student during the ascent phase when the flight attitude indicator provided in the embodiment of the utility model fails.

[0023] Figure 4 This is a thermal diagram of eye movements of a flight trainee during the descent phase when the flight attitude indicator provided in the embodiment of the utility model fails.

[0024] Figure 5 This is a thermal diagram of eye movements of a flight trainee during the turning phase when the flight attitude indicator fails, provided in an embodiment of the utility model.

[0025] In the figure:

[0026] 1. Bottom plate; 2. Seat; 3. Support platform; 4. Throttle; 5. Tablet computer; 6. First column; 7. Third bracket; 8. First extension frame; 9. Second extension frame; 10. First back plate; 11. Second back plate; 12. Third back plate; 13. Third extension frame; 14. Fourth back plate; 15. Instrument display; 16. Environmental display; 17. Rudder; 18. Pedal rudder; 19. Second column; 20. Fifth back plate; 21. Fourth extension frame; 22. Fifth extension frame; 23. Eye tracker. DETAILED DESCRIPTION

[0027] The present invention is described in detail below in conjunction with the embodiments and drawings, but it should be understood that the embodiments and drawings are only used to exemplify the present invention and do not constitute any limitation on the protection scope of the present invention. All reasonable changes and combinations within the scope of the utility model's purpose fall within the protection scope of the present invention.

[0028] In the description of the present utility model, it should be noted that the directions or positional relationships indicated by the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", "front", "rear", etc. are based on the directions or positional relationships shown in the drawings, and are only for the convenience of describing the present utility model and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific direction, be constructed and operated in a specific direction, and therefore cannot be understood as limiting the present utility model; the terms "first", "second", and "third" are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance. In addition, unless otherwise clearly specified and limited, the terms "set", "install", "connect", and "connect" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be an indirect connection through an intermediate medium, or it can be a communication between the two elements. For ordinary technicians in this field, the specific meanings of the above terms in the present utility model can be understood according to specific circumstances.

[0029] The utility model is further described below in conjunction with the accompanying drawings.

[0030] Example 1

[0031] refer to Figure 1-Figure 2 This embodiment provides a training device for real-time monitoring of eye movement trajectories of flight trainees, the training device comprising:

[0032] A seat 2 is fixedly connected to the left end of the bottom plate 1 for accommodating flight trainees;

[0033] The first integrated bracket is arranged at the right end of the bottom plate 1, and the display module and the support platform 3 are fixedly connected to the top of the first integrated bracket;

[0034] The second integrated bracket is arranged between the seat 2 and the first integrated bracket on the right side, and the throttle 4 and the monitor are fixedly connected thereto;

[0035] The display module is fixedly connected to the first integrated bracket and is used to simulate the environment outside the cabin and display the instrument interface to the flight trainees;

[0036] The control module is arranged between the seat 2 and the first integrated bracket, and is used to provide flight trainees with control tools for simulated flight;

[0037] The monitoring module includes an eye tracker 23 and a monitor. The eye tracker 23 is worn on the eyes of the flight trainee and the monitor is connected to the second integrated bracket, and is used to monitor the eye movement trajectory of the flight trainee in real time.

[0038] The display module, the control module and the monitoring module all have the function of real-time data transmission, and can perform online monitoring and feedback on the eye movement trajectory of the flight trainees. This is a prior art and will not be elaborated in detail here.

[0039] The first integrated bracket includes a first column 6, a first bracket, a second bracket and a third bracket 7. The first bracket includes a first extension frame 8, a second extension frame 9, a first back panel 10, a second back panel 11 and a third back panel 12. The third back panel 12 is arranged at the upper end of the first column 6, the first back panel 10 is arranged at the left end of the first extension frame 8, and the second back panel 11 is arranged at the right end of the second extension frame 9 to fix the display module. The second bracket includes a third extension frame 13 and a fourth back panel 14. The fourth back panel 14 is arranged at the upper end of the third extension frame 13 to fix the display module. The third bracket 7 is fixedly connected to the support platform 3.

[0040] The first bracket realizes fixed support for the environment display 16 in the display module. The three screens of the environment display 16 are fixed in position and kept stable by means of the first bracket. The second bracket realizes fixed support for the instrument display 15 in the display module. The instrument display 15 is kept at a certain tilt angle by means of the second bracket. The third bracket 7 realizes fixed support for the support platform 3.

[0041] The display module is fixedly connected to the first bracket and the second bracket, and includes an instrument display 15 and an environment display 16. The instrument display 15 is fixedly connected to the second bracket for displaying the instrument interface. The environment display 16 is fixedly connected to the first bracket and includes three displays for simulating the environment outside the cabin.

[0042] The display module consists of an instrument display 15 and an environment display 16. The instrument display 15 is located below the environment display 16, and provides feedback to the flight trainees in the simulation training on flight parameters such as flight altitude, airspeed, and heading. The environment display 16 is connected to the first column 6 through the first bracket, and the three screens form a semi-enclosed structure, which provides feedback to the flight trainees in the simulation training on the view outside the cockpit, simulates the real flight environment for the trainees, helps the trainees improve the immersion level of the training, and can also serve as a basis for the trainees to judge the aircraft attitude.

[0043] The control module includes a rudder 17, a throttle 4 and a pedal rudder 18. The rudder 17 is fixedly connected to the support platform 3. The throttle 4 is fixedly connected to the second integrated bracket. The second integrated bracket includes a second column 19. The second column 19 extends upward and then forks into a fourth extension frame 21 and a fifth extension frame 22. The upper end of the fourth extension frame 21 is connected to the throttle 4. The fifth extension frame 22 is upwardly connected to the fifth back panel 20 and a monitor. The monitor is selected from a tablet computer 5 or a display. The throttle 4 is arranged at the upper end of the fourth extension frame 21, and the pedal rudder 18 is arranged on the base plate 1 and is located below the support platform 3.

[0044] The control module provides simulated control input functions to the flight trainee. When the trainee sits on the seat 2 for training, he controls the pedal rudder 18 with his feet to simulate the left and right deflection of the aircraft and realize the control of the heading. The rudder 17 and the throttle 4 are controlled by the hands, wherein the rudder 17 is a simulation device for controlling the aircraft attitude, and the throttle 4 is a simulation device for controlling the engine power.

[0045] The monitoring module includes an eye tracker 23 and a tablet computer 5 . The eye tracker 23 is worn on the eyes of the flight trainee, and the tablet computer 5 is fixedly connected to the fifth back plate 20 .

[0046] The preferred model of the eye tracker 23 is a glasses-type eye tracker of Tobii Glasses 3, which collects the eye movement data of the flight trainees. The tablet computer adopts the Harmony system, and the eye movement trajectory of the trainees wearing the eye tracker 23 for training is presented in real time on the tablet computer 5. The instructor can timely understand the attention status of the trainees by observing the tablet computer 5, so as to provide targeted and personalized attention allocation guidance.

[0047] Example 2

[0048] This embodiment provides a scenario description of the use of a training device for real-time monitoring of eye movement trajectories of flight trainees.

[0049] The abnormal procedure of the three-state interchange of ascent, descent and turn under the failure of the attitude indicator is selected as the experimental subject, and the aircraft model is selected as SR-20. The instrument display 15 shows the corresponding instrument interface of SR-20. The flight trainee sits in the seat 2 and wears the eye tracker 23 to complete the flight training task. When the attitude indicator fails, the airspeed is maintained at 96kt and the heading is 127°, and the flight trainee ascends from 4900ft to 5900ft. After leveling off, the flight trainee descends from 5900ft to 4900ft while maintaining a descent rate of 500ft / min and a heading of 127°. Finally, the flight trainee turns from a heading of 127° to a heading of 0° while maintaining an altitude of 4900ft and an airspeed of 120kt, and a bank angle of 15° is maintained during the turn.

[0050] During the experiment, the eye tracker 23 automatically records the student's attention distribution on the instrument display 15. The eye movement data in the SD card of the eye tracker 23 is imported into the Tobii Pro Lab software for analysis and processing. Tobii Pro Lab will generate a color-coded heat map based on the frequency and duration of the fixation point. The heat map is used to represent the hot spots where the student is fixating. The darker the color, the more concentrated the fixation point. Figure 3-5 , which are the eye movement heat maps of flight trainees during the ascent, descent and turning phases when the attitude indicator fails.

[0051] The above embodiments are only preferred implementations of the present invention, and the protection scope of the present invention is not limited to the above embodiments. All technical solutions under the concept of the present invention belong to the protection scope of the present invention. It should be pointed out that for ordinary technicians in this technical field, improvements and modifications without departing from the principle of the present invention should also be regarded as the protection scope of the present invention.

Claims

1. A training device for real-time monitoring of eye movement trajectories of flight trainees, comprising a base plate (1), one end of the base plate (1) being fixedly connected to a seat (2) for receiving the flight trainees; the flight trainees are provided with an eye tracker (23) for real-time monitoring and recording of the eye movement trajectories of the trainees, characterized in that: The other end of the bottom plate (1) faces the seat (2) and is provided with a display module for displaying the simulated external environment of the cabin for the flight trainee and displaying the instrument interface; A control module, disposed below the display module, provides simulated control input functions to flight trainees; A monitor for displaying the eye movement trajectory of the flight trainee to the instructor is also provided next to the seat (2), and the eye tracker (23) is electrically connected to the monitor.

2. The training device for real-time monitoring of eye movement trajectories of flight trainees according to claim 1 is characterized in that: The invention comprises a first integrated bracket and a second integrated bracket both arranged on the bottom plate (1), wherein the first integrated bracket comprises a first column (6), a first bracket capable of carrying a plurality of environment displays (16) is arranged at the top of the first column (6); a second bracket for carrying an instrument display (15) is arranged on the first column (6) and below the first bracket; a carrying support platform (3) is arranged on the first column (6) and below the second bracket, and the support platform (3) is connected to a rudder (17) of the control module; The second integrated bracket comprises a second column (19), the upper ends of which extend inwardly and outwardly respectively, the inner end being connected to the throttle (4) of the operating module, and the outer end being connected to the monitor.

3. The training device for real-time monitoring of eye movement trajectories of flight trainees according to claim 2 is characterized in that: A plurality of environment displays (16) are symmetrically arranged on both sides of the top of the first upright column (6).

4. The training device for real-time monitoring of eye movement trajectories of flight trainees according to claim 3 is characterized in that: The plurality of environment displays (16) and the instrument displays (15) are respectively connected to the first bracket and the second bracket via a back panel with adjustable angles.

5. The training device for real-time monitoring of eye movement trajectories of flight trainees according to claim 4 is characterized in that: The number of the environment displays (16) is three.

6. The training device for real-time monitoring of eye movement trajectories of flight trainees according to claim 2 is characterized in that: A pedal rudder (18) of the control module for simulating control is provided on the bottom plate (1) and between the first upright column (6) and the seat (2).

7. The training device for real-time monitoring of eye movement trajectories of flight trainees according to claim 2 is characterized in that: The instrument display (15) is arranged tilted toward the eyes of the flight trainee.

8. The training device for real-time monitoring of eye movement trajectories of flight trainees according to claim 1 is characterized in that: The eye tracker (23) is of glasses type.

9. The training device for real-time monitoring of eye movement trajectories of flight trainees according to any one of claims 1 to 8, characterized in that: The monitor is selected from a tablet computer.

Images