A flight test apparatus and a flight test method
By collecting user characteristic data and adjusting the difficulty of the flight control handle, combined with changes in the display screen, the problem of personalized testing of flight test devices has been solved, enabling more accurate pilot ability assessment and training.
Patent Information
- Application Number
- CN202511983799.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2025-12-26
- Publication Date
- 2026-02-24
- Estimated Expiration
- 2045-12-26
AI Technical Summary
Existing flight testing equipment is difficult to test for the individual characteristics of different pilots, resulting in poor test results and difficulty in customizing personalized scenarios.
The controller collects user characteristic data through sensors, analyzes the user's status, and adjusts the flight control handle and display screen to increase the control difficulty, generate operation prompts, simulate sudden test scenarios, and record test results.
It enables personalized flight testing, allowing for in-depth exploration of pilots' operational capabilities in different scenarios, thereby improving testing effectiveness and training efficiency.
Smart Images

Figure CN121393263B_ABST
Abstract
Description
Technical Field
[0001] This application belongs to the field of flight test equipment technology, and particularly relates to a flight test equipment and a flight test method. Background Technology
[0002] In the early stages of pilot training, flight testing devices can be used to simulate flight scenarios, and pilots' mindset, reaction, operation, and other abilities can be trained based on the simulated flight scenarios.
[0003] The flight test apparatus may include a display for showing flight animations, a flight control handle for controlling flight direction and altitude, and an altitude-variable cockpit to simulate flight scenarios from multiple angles, thereby stimulating the pilot's instinctive performance in flight test scenarios and enabling targeted training for the pilot's weaknesses.
[0004] During testing, abnormal flight scenarios can be added to normal flight scenarios to test pilots' responsiveness. However, different pilots have different sensitivities to different scenarios. Therefore, if pilots are tested using uniformly customized test scenarios, it is difficult to test them based on their individual characteristics, resulting in poor test results. On the other hand, customizing scenarios for each individual pilot is prone to difficulties due to insufficient sample size. Summary of the Invention
[0005] This application provides a flight testing device and a flight testing method to address the difficulty in balancing the testing effectiveness and the complexity of scenario customization in flight testing.
[0006] In a first aspect, embodiments of this application provide a flight test apparatus, comprising:
[0007] Sensors are configured to collect user characteristic data; the user characteristic data is used to characterize the user's state during flight simulation caused by sudden test samples.
[0008] The flight control handle is configured to generate flight control signals in response to user input; these flight control signals are used to indicate the direction of movement of the virtual aircraft.
[0009] The display is configured to display a flight simulation screen; the flight simulation screen includes a first simulation screen and a second simulation screen, the first simulation screen being the screen corresponding to a normal test sample, and the second simulation screen being the screen corresponding to a sudden test sample;
[0010] The controller is configured as follows:
[0011] In response to the simulation start command, control the display to play the first simulated image;
[0012] If the playback progress is detected to have reached a preset node, the display is controlled to show the second simulated image;
[0013] During the process of displaying the second simulated image on the monitor, the user characteristic data is analyzed;
[0014] If the user status represented by the user feature data is an abnormal state, then the flight control handle is controlled to switch from the first control state to the second control state; the control difficulty of the flight control handle in the second control state is greater than the control difficulty in the first control state.
[0015] Generate operation prompts to prompt the user to operate the flight control handle to perform the first target task based on the operation prompts.
[0016] Upon detecting a flight control signal generated by the flight control handle, the display is controlled to show a subsequent image of the second simulated image based on the second simulated image and the flight control signal;
[0017] Upon detection that the first target task has been completed, a flight test result is generated; the flight test result is used to characterize whether the user has passed the flight test.
[0018] In some feasible embodiments, the controller is further configured to: upon detecting a flight control signal generated by the flight control handle.
[0019] A first flight damping control signal is generated based on the flight control signal, wherein the direction of movement of the virtual aircraft indicated by the first flight damping control signal is on a different side from the direction of movement of the virtual aircraft indicated by the flight control signal;
[0020] A first burst control signal is generated based on the flight control signal and the first flight damping control signal;
[0021] Based on the movement direction of the virtual aircraft indicated by the first burst control signal, the display is controlled to show a subsequent screen of the second simulated screen; the content of the subsequent screen of the second simulated screen is different from that of the second simulated screen.
[0022] In some feasible embodiments, the flight control handle includes a first drive mechanism; the controller, when the user state characterized by the user characteristic data is in an abnormal state, controls the flight control handle to switch from a first control state to a second control state, specifically configured as follows:
[0023] Generate the first motion signal;
[0024] The first motion signal is sent to the first drive mechanism so that the first drive mechanism drives the flight control handle to move in accordance with the motion pattern indicated by the first motion signal.
[0025] In some feasible embodiments, the keypad includes a second drive mechanism; the controller is further configured to: after the user state represented by the user feature data is an abnormal state, the controller is configured to:
[0026] Generate a second motion signal;
[0027] The second motion signal is sent to the second drive mechanism so that the second drive mechanism drives the keypad to move in accordance with the motion mode indicated by the second motion signal.
[0028] In some feasible embodiments, the controller is further configured to, upon detecting that the first target task has been completed:
[0029] Test records are generated based on the user's operation records and the generated user characteristic data during the display of the second simulated screen;
[0030] The user's user ID and the test record are stored in the training record database. The test record also includes an operational capability tag corresponding to the user ID. The operational capability tag is obtained by analyzing the test record and is used to characterize the user's operational capability in burst test samples.
[0031] In some feasible embodiments, the abnormal state includes a first-level abnormal state and a second-level abnormal state, wherein the first-level abnormal state corresponds to a first-level motion signal, and the second-level abnormal state corresponds to a second-level motion signal; the controller is specifically configured to generate the first motion signal as follows:
[0032] The abnormal state is determined to be either a Level 1 or Level 2 abnormal state;
[0033] When the abnormal state is a level one abnormal state, a level one motion signal is generated; the level one motion signal is sent to the first drive mechanism so that the first drive mechanism drives the flight control handle to move in accordance with the motion mode indicated by the level one motion signal;
[0034] When the abnormal state is a level two abnormal state, a level two motion signal is generated; the level two motion signal is sent to the first drive mechanism so that the first drive mechanism drives the flight control handle to move in accordance with the motion mode indicated by the level two motion signal; the motion amplitude of the flight control handle based on the level one motion signal is greater than the motion amplitude based on the level two motion signal.
[0035] In some feasible embodiments, after the controller detects that the playback progress has reached a preset node and controls the display to show the second simulated image, it is further configured to:
[0036] Record the user's operation time when operating the flight control handle;
[0037] If the user completes the first target task within a first preset time range, the display is controlled to play a third simulated scene; the degree of danger of the simulated scene corresponding to the third simulated scene is greater than the degree of danger of the simulated scene corresponding to the second simulated scene.
[0038] A second flight damping control signal is generated; the signal strength of the second flight damping control signal is greater than that of the first flight damping control signal.
[0039] A second burst control signal is generated based on the flight control signal and the second flight damping control signal;
[0040] The movement direction of the virtual aircraft indicated by the second burst control signal controls the display to show a subsequent screen of the third simulated screen; the content of the subsequent screen of the third simulated screen is different from that of the third simulated screen.
[0041] In some feasible embodiments, when the controller detects that the playback progress has reached a preset node, it controls the display to show the second simulated image, specifically configured as follows:
[0042] Get the current user ID;
[0043] Find the operational capability tag based on the user ID;
[0044] The second simulation screen is selected based on the operational capabilities represented by the operational capability label.
[0045] In some feasible embodiments, the controller generates a first flight damping control signal based on the flight control signal, specifically configured as follows:
[0046] Obtain the image information of the second simulated image, the image information including the environment type in the second simulated image and the physical parameters corresponding to the environment type;
[0047] The first flight damping control signal is generated based on the flight control signal, the first flight damping control signal, the environment type, and the physical parameters.
[0048] Secondly, embodiments of this application provide a flight testing method, including:
[0049] In response to the simulation start command, control the display to play the first simulated image;
[0050] If the playback progress is detected to have reached a preset node, the display is controlled to show the second simulated image;
[0051] During the process of displaying the second simulated image on the monitor, the user characteristic data is analyzed;
[0052] If the user status represented by the user feature data is an abnormal state, then the flight control handle is controlled to switch from the first control state to the second control state; the control difficulty of the flight control handle in the second control state is greater than the control difficulty in the first control state.
[0053] Generate operation prompts to prompt the user to operate the flight control handle to perform the first target task based on the operation prompts.
[0054] Upon detecting a flight control signal generated by the flight control handle, the display is controlled to show a subsequent image of the second simulated image based on the second simulated image and the flight control signal;
[0055] Upon detection that the first target task has been completed, a flight test result is generated; the flight test result is used to characterize whether the user has passed the flight test. Attached Figure Description
[0056] To more clearly illustrate the technical solution of this application, the drawings used in the embodiments will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0057] Figure 1 Schematic diagram of a flight test apparatus provided in some embodiments of this application;
[0058] Figure 2 Control flowcharts for flight testing provided in some embodiments of this application;
[0059] Figure 3 Three-dimensional situational awareness diagrams provided for some embodiments of this application;
[0060] Figure 4 This is a schematic diagram illustrating the flight control state switching effect provided in some embodiments of this application. Detailed Implementation
[0061] The embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described below do not represent all embodiments consistent with this application. They are merely examples of systems and methods consistent with some aspects of this application.
[0062] It should be noted that the brief descriptions of terms in this application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise stated, these terms should be understood in their ordinary and common meaning.
[0063] The terms "first," "second," "third," etc., used in this application's specification are used to distinguish similar or related objects or entities, and do not necessarily imply a specific order or sequence, unless otherwise specified. It should be understood that such terms can be used interchangeably where appropriate.
[0064] The terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device that includes a range of components is not necessarily limited to all of the components that are clearly listed, but may include other components that are not clearly listed or that are inherent to such product or device.
[0065] The term "module" refers to any known or subsequently developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.
[0066] In the early stages of pilot training, flight testing devices can be used to simulate flight scenarios, and pilots' mindset, reaction, operation, and other abilities can be trained based on the simulated flight scenarios.
[0067] like Figure 1 As shown, the flight test device may include a display for showing flight animations, a flight control handle for controlling flight direction and altitude, and a cockpit with variable altitude to simulate flight scenarios from multiple angles, so as to stimulate the pilot's instinctive performance in flight test scenarios and thus conduct targeted training for the pilot's weaknesses.
[0068] During testing, abnormal flight scenarios can be added to normal flight scenarios to test pilots' responsiveness. However, different pilots have different sensitivities to different scenarios. Therefore, if pilots are tested using uniformly customized test scenarios, it is difficult to test them based on their individual characteristics, resulting in poor test results. On the other hand, customizing scenarios for each individual pilot is prone to difficulties due to insufficient sample size.
[0069] To solve the above problems, such as Figure 2 As shown, this application provides a flight test apparatus, including:
[0070] Sensors are configured to collect user characteristic data; the user characteristic data is used to characterize the user's state during flight simulation caused by sudden test samples.
[0071] The flight control handle is configured to generate flight control signals in response to user input; these flight control signals are used to indicate the direction of movement of the virtual aircraft.
[0072] The display is configured to display a flight simulation screen; the flight simulation screen includes a first simulation screen and a second simulation screen, the first simulation screen being the screen corresponding to a normal test sample, and the second simulation screen being the screen corresponding to a sudden test sample;
[0073] The controller is configured as follows:
[0074] S100: In response to the simulation start command, control the display to play the first simulated image;
[0075] S200: When the playback progress is detected to have reached a preset node, control the display to show the second simulated image;
[0076] S300: During the process of displaying the second simulated image on the display, analyze the user feature data;
[0077] S400: If the user state represented by the user feature data is an abnormal state, then control the flight control handle to switch from the first control state to the second control state; the control difficulty of the flight control handle in the second control state is greater than the control difficulty in the first control state.
[0078] S500: Generate operation prompt information to prompt the user to operate the flight control handle to perform the first target task based on the operation prompt information;
[0079] S600: Upon detecting a flight control signal generated by the flight control handle, control the display to show a subsequent image of the second simulated image based on the second simulated image and the flight control signal;
[0080] S700: Upon detecting the completion of the first target task, generate flight test results; the flight test results are used to characterize whether the user has passed the flight test.
[0081] like Figure 1As shown, in some embodiments, the sensor: a device for collecting user characteristic data, may include a heart rate sensor, a skin conductance sensor, an eye-tracking sensor, or an electroencephalogram (EEG) sensor for monitoring the user's physiological state such as heart rate, sweat secretion, eye movements, or brain waves.
[0082] Flight control handle: A user-operated input device, such as a joystick or game controller, that generates flight control signals to control the direction of movement of a virtual aircraft. In some examples, the flight control handle can have a dynamic damping structure, such as adding a reversing motor to the handle, increasing resistance by controlling the speed of the reversing motor. Furthermore, based on the speed control of the reversing motor, different levels of resistance can be provided according to different test scenarios. In other examples, the control handle can be built based on a magnetorheological fluid damper. When increased resistance is needed, a magnetic field is applied to the magnetic particles to arrange them into a stable structure such as a chain, greatly increasing resistance. This type of handle has a fast damping adjustment response and a wide range of variation, suitable not only for providing graded resistance but also for simulating specific scenarios such as the handle losing control due to mechanical failure.
[0083] Display: An output device that displays flight simulation images, such as an LCD screen or a virtual reality headset. The first simulation image is a normal scene, such as stable flight, and the second simulation image is an emergency scene, such as engine failure.
[0084] In some embodiments, the data displayed on the display can be scene data built based on 3D situational awareness software. The 3D situational awareness software can load terrain elevation data captured by image acquisition devices, and then build a test scene based on the terrain elevation data to fully simulate the real scene, and also make it easier for the test user to capture the terrain and landform features in the scene from the displayed screen.
[0085] like Figure 3 As shown, in some examples, the display screen may include multiple interactive prompt buttons, such as a weather change button and a viewpoint switching button. It may also include flight parameter data, aircraft model parameter data, and other parameters. Users can modify the test scenario by triggering these buttons during the simulation, such as switching from sunny to rainy weather, or from a dive view to a level flight view. Furthermore, users can control the test progress through subjective interaction, improving the interactivity of the testing process.
[0086] Understandably, the flight test device can receive images from image acquisition devices in different regions through its onboard communication device and in conjunction with the corresponding communication protocol. Then, by calling 3D situational awareness software, it can render images of different scenes for users to choose from, thereby increasing the diversity of testing and making it easier to explore the user's operational characteristics in different scenarios.
[0087] Controller: A computing unit that processes data, such as a microprocessor or computer, and coordinates sensors, handles, and displays.
[0088] User characteristic data: Data that characterizes a user's state, including but not limited to heart rate changes, eye movement frequency, and electroencephalogram (EEG) data, which can be used to determine whether a user is in an abnormal state such as tension, trembling, or inattentiveness.
[0089] First control state and second control state: the operation modes of the flight control handle. The second state is more difficult to control, such as by increasing the handle resistance or reducing the sensitivity to increase the difficulty of operation.
[0090] The primary objective is to perform specific actions, such as stabilizing the aircraft or avoiding obstacles.
[0091] In some examples, the flight test setup includes a heart rate sensor, a force feedback flight joystick, a VR headset, and a controller. At the start of the test, the user wears the VR headset, and the controller responds to the simulated start command, displaying a smooth flight scenario in a clear sky. When the flight time reaches a preset 5-minute mark, the controller triggers a sudden test, switching the scene to one of engine fire and flashing cabin alarms. During this process, the controller receives and analyzes heart rate sensor data in real time; if it detects that the user's heart rate consistently exceeds a threshold, it immediately sends a command to the force feedback flight joystick, switching it from a smooth, light control state to a more resistant, less precise control state. Simultaneously, a prompt message appears on the VR screen: "Please execute the emergency landing procedure," guiding the user to operate the joystick to perform the first objective. After the user overcomes the operational difficulties and pushes the joystick, the generated flight control signal is received by the controller, which then updates the VR screen, displaying subsequent scenes such as the aircraft beginning its descent. If the controller detects that the user has ultimately completed the emergency landing, it generates a "test passed" flight test result.
[0092] like Figure 4 As shown in (a) above, in normal flight conditions, the flight control handle / joystick is in a normal position, such as an upright position. Figure 4 As shown in (b), corresponding to the playback phase of the first simulated scene, the aircraft tends to descend, but only slight adjustments to the joystick are needed to maintain level flight. Figure 4 As shown in (c), corresponding to the switch to the second control state stage, the aircraft's downward trend remains unchanged, but more force is required to operate the joystick to keep the aircraft flying level.
[0093] By introducing a first flight damping control signal, the operational difficulty for users can be increased, thereby fully simulating test scenarios and deeply exploring user operational characteristics. Furthermore, by monitoring user status in real time during emergency tests and proactively increasing control difficulty upon detecting anomalies, this solution can more realistically simulate the decline in pilot operational ability under pressure, thus making the test results more reflective of the subject's true performance under stress. In addition, by generating operational prompts, the system not only serves as a testing tool but also functions as a training tool, helping users learn correct coping strategies in challenging situations.
[0094] It should be noted that the control state switching point is after an abnormal user state is detected. This allows for testing to be conducted in conjunction with the user's actual reactions. On the one hand, it can effectively uncover the user's true abilities and improve the testing results. On the other hand, it can record the corresponding screen content based on this point, forming a correlation between the screen content and the user's abnormality. Based on this correlation, key test markers / key test content can be formed, so that key test content can be trained in subsequent tests on the same user, improving the effectiveness of the test and achieving the effect of dedicated training for specific users.
[0095] When the user's state is abnormal, it indicates that the test user has experienced abnormal emotions such as tension due to a sudden scenario, and therefore the test can begin. In this abnormal state, the user's operational and reaction abilities will decrease to a certain extent compared to normal operation. Furthermore, the controllability of controllable components will also decrease. Therefore, by increasing the difficulty of controlling the flight controller, abnormal scenarios can be simulated, thereby allowing for a deeper exploration of the test user's various abilities under abnormal conditions.
[0096] In some embodiments, the controller is further configured to: upon detecting a flight control signal generated by the flight control handle.
[0097] A first flight damping control signal is generated based on the flight control signal, wherein the direction of movement of the virtual aircraft indicated by the first flight damping control signal is on a different side from the direction of movement of the virtual aircraft indicated by the flight control signal;
[0098] A first burst control signal is generated based on the flight control signal and the first flight damping control signal;
[0099] Based on the movement direction of the virtual aircraft indicated by the first burst control signal, the display is controlled to show a subsequent screen of the second simulated screen; the content of the subsequent screen of the second simulated screen is different from that of the second simulated screen.
[0100] In some embodiments, the first flight damping control signal is a virtual control signal automatically generated by the controller. This signal indicates a flight direction opposite to or at an angle to the flight control signal generated by the user's control handle, used to simulate external interference scenarios such as airflow or handle malfunction. It also corresponds to situations where the user, facing abnormal operational events, finds it difficult to accurately control the handle's operation due to anxiety.
[0101] First burst control signal: The final control command synthesized from the user's flight control signal and the system's first flight damping control signal.
[0102] In some examples, when a user attempts to maintain level flight by pushing the stick during an engine fire scenario, the controller generates a flight control signal pointing upwards. Simultaneously, to simulate the descent effect of insufficient engine power, the controller generates a first flight damping control signal pointing downwards. The controller vector-wise synthesizes these two signals to obtain the final first burst control signal, which may be slightly upwards or horizontally, but never in the user's intended direction. The VR display will then show subsequent footage of the aircraft struggling to maintain altitude rather than rapidly climbing, based on this synthesized signal.
[0103] In other examples, the first flight damping control signal can be applied to the handle to increase the difficulty of control for the user. That is, the user needs to exert more effort to keep the aircraft flying level, thereby fully testing the user's performance in abnormal scenarios.
[0104] Of course, the first flight damping control signal can be applied to the handle and also serve as an adversarial signal for visual display. Depending on the level of the test environment, the flight damping control signal can be applied to multiple test stages to adapt to different test conditions.
[0105] This approach doesn't simply increase handle drag; instead, it introduces an adversarial signal at the flight control logic level, directly creating the visual effect of the aircraft becoming unresponsive. This method simulates aircraft malfunctions such as control surface jamming more effectively than simply increasing the physical drag of the handle, greatly enhancing the realism of the simulated environment and the challenge of sudden testing.
[0106] For example, draggable components such as control handles can simulate the control difficulty under abnormal scenarios by increasing damping, or by combining abnormal scenarios to make the flight control handle vibrate, etc., to further fit the abnormal scenarios, which is conducive to further improving the simulation level and further exploring the state of the test user under abnormal scenarios.
[0107] In some embodiments, the flight control handle includes a first drive mechanism; the controller, when the user state characterized by the user characteristic data is in an abnormal state, controls the flight control handle to switch from a first control state to a second control state, specifically configured as follows:
[0108] Generate the first motion signal;
[0109] The first motion signal is sent to the first drive mechanism so that the first drive mechanism drives the flight control handle to move in accordance with the motion pattern indicated by the first motion signal.
[0110] In some embodiments, the first drive mechanism is a device with drive capability integrated inside the flight control handle, such as a vibration motor, a linear actuator, or an eccentric wheel vibration motor, used to drive the handle to generate movements such as vibration according to electrical signals, in order to simulate the controllability of the handle in sudden scenarios, and to simulate to some extent the scenarios in which the test user's shaking caused by tension leads to increased control difficulty.
[0111] In some examples, when the controller determines that the user's state is abnormal, it generates a specific vibration waveform signal and sends it to the vibration motor embedded in the flight joystick via circuitry. The motor activates, causing the entire joystick to vibrate at a high frequency and with a small amplitude, thereby switching from the first control state to the second control state.
[0112] In this way, the test goes beyond simply adjusting software parameters (such as sensitivity) to specifically implement tactile feedback intervention in hardware. By causing the handle itself to move erratically, it directly disrupts the user's expectation of stability in the control device, simulating the control difficulties caused by turbulence or aircraft vibration in real flight. This physical interference poses a greater challenge to the user than purely visual or parameter adjustments, resulting in a more profound test effect.
[0113] In addition to the flight control handle, the real operating environment also includes multiple control buttons. In abnormal environments, the control buttons may shake or move. Therefore, simulating this part can further simulate flight scenarios / abnormal flight scenarios and further explore the state of the test user in abnormal scenarios.
[0114] like Figure 1 As shown, it also includes a keypad, which includes a second drive mechanism; after the user state represented by the user feature data is an abnormal state, the controller is further configured to:
[0115] Generate a second motion signal;
[0116] The second motion signal is sent to the second drive mechanism so that the second drive mechanism drives the keypad to move in accordance with the motion mode indicated by the second motion signal.
[0117] In some embodiments, the keypad is a simulated panel with multiple buttons and switches used to simulate various system operation modules in a flight cockpit.
[0118] Second drive mechanism: Similar to the first drive mechanism, but mounted on the keypad, it can make it vibrate or shake.
[0119] In some examples, the flight test device includes a separate button panel in addition to the flight joystick, which has switches for "landing gear retraction / extension" and "fuel pump". When the controller detects an abnormal user status, in addition to vibrating the joystick, it also generates another motion signal and sends it to the vibration motor at the bottom of the button panel, causing the entire panel to shake, making it difficult for the user to accurately operate the switches.
[0120] This expands the difficulty intervention from a single flight control axis to the entire interactive environment of the simulated cockpit. It recognizes that in emergency situations, pilots not only need to maintain a stable control stick but also accurately operate various panel switches. By interfering with panel operations, this solution constructs a more comprehensive and realistic multi-task interference test environment, enhancing the comprehensiveness and realism of the test.
[0121] All data generated by users during the testing process can be recorded to analyze user performance in abnormal scenarios.
[0122] In some embodiments, the controller is further configured to, upon detecting that the first target task has been completed:
[0123] Test records are generated based on the user's operation records and the generated user characteristic data during the display of the second simulated screen;
[0124] The user's user ID and the test record are stored in the training record database. The test record also includes an operational capability tag corresponding to the user ID. The operational capability tag is obtained by analyzing the test record and is used to characterize the user's operational capability in burst test samples.
[0125] In some embodiments, operational ability labels are categorized based on the user's historical test records, such as reaction time, operational accuracy, and physiological data stability, through algorithmic analysis. Examples of such labels include "weak stress tolerance" and "precise operation but slow reaction time." In some examples, after a user completes the test, the controller packages all their operational data from the second simulation screen in that round, such as lever input, task completion time, and physiological data like heart rate curves, into a test record. The system automatically analyzes these records and labels the user ID with an operational ability label, such as "prone to nervousness in sudden situations leading to rough operation." This user ID, the complete test record, and the ability label are stored together in the training record database.
[0126] In the process of generating operational capability tags, the tags can be generated in conjunction with the corresponding screen content. This means that the contextual reference information provided by the screen content can have a certain weight, further refining the operational capability tags. This allows analysis of the scenarios in which the test user is most stressed, or even at which flight angle, leading to a deeper understanding of the user's operational characteristics and psychological state, and enabling timely adjustments to the testing strategy.
[0127] The content of a screen can be obtained by acquiring the metadata corresponding to the screen media assets, or by analyzing the captured screen image using an image recognition model to determine the semantic information corresponding to the screen content, i.e., the contextual reference information. This application does not limit how the contextual reference information of the screen content is obtained.
[0128] This adds data-driven and structured artificial intelligence analysis capabilities to the flight testing equipment. It becomes more than just a single-test tool; it serves as a platform for accumulating individual training data. User profiles can be created based on operational capability tags, allowing for the generation of more targeted test scenarios. Alternatively, existing test scenarios can be augmented by adjusting flight damping control signals and vibration amplitude to specifically increase the test load, thereby improving the testing effect for users and achieving personalized training. This also provides precise data support for subsequent personalized training program development and personnel capability assessment.
[0129] Users experience different emotions when facing different test scenarios, and their operational and reaction abilities vary depending on their emotions. Therefore, by monitoring the user's state and classifying abnormal states, the usage status of components such as the flight control handle can be adjusted according to the level of abnormal state, in order to deeply simulate abnormal scenarios and explore the user's various capabilities under abnormal scenarios.
[0130] In some embodiments, the abnormal state includes a primary abnormal state and a secondary abnormal state, wherein the primary abnormal state corresponds to a primary motion signal and the secondary abnormal state corresponds to a secondary motion signal; the controller, when generating the primary motion signal, is specifically configured as follows:
[0131] The abnormal state is determined to be either a Level 1 or Level 2 abnormal state;
[0132] When the abnormal state is a level one abnormal state, a level one motion signal is generated; the level one motion signal is sent to the first drive mechanism so that the first drive mechanism drives the flight control handle to move in accordance with the motion mode indicated by the level one motion signal;
[0133] When the abnormal state is a level two abnormal state, a level two motion signal is generated; the level two motion signal is sent to the first drive mechanism so that the first drive mechanism drives the flight control handle to move in accordance with the motion mode indicated by the level two motion signal; the motion amplitude of the flight control handle based on the level one motion signal is greater than the motion amplitude based on the level two motion signal.
[0134] In some embodiments, Level 1 and Level 2 abnormal states represent a more detailed classification of abnormal states. For example, Level 1 corresponds to a 10-20% increase in heart rate, while Level 2 corresponds to an increase in heart rate of more than 20% or significant fluctuations in skin conductance.
[0135] In some examples, the controller has pre-set logic for judging the level of abnormality. When the user's heart rate increases by 15%, it is judged as a Level 1 abnormal state, and a mild Level 1 motion signal is generated, such as sending a low-frequency, low-amplitude vibration signal to the joystick motor. If the user's heart rate further increases by 30% and is accompanied by a surge in skin conductance, it is judged as a Level 2 abnormal state, and a strong Level 2 motion signal is generated, such as sending a high-frequency, high-amplitude vibration signal to the flight control handle, causing the vibration amplitude of the flight control handle to increase significantly, thus increasing the difficulty of operation.
[0136] This approach, based on physiological states, employs a gradient of difficulty intervention. Instead of abruptly increasing the difficulty, it uses a step-by-step testing method tailored to the user's stress level. This tiered control avoids excessively large jumps in difficulty that could cause users to abandon the test, making the testing process more scientific and humane. It allows for a more precise mapping of user performance curves under different stress levels, thus providing a data foundation for customizing subsequent testing tasks.
[0137] During the testing process, the potential of the tested users can be explored by creating more extreme environments, thereby creating a more comprehensive simulation effect.
[0138] In some embodiments, after the controller detects that the playback progress has reached a preset node and controls the display to show the second simulated image, it is further configured to:
[0139] Record the user's operation time when operating the flight control handle;
[0140] If the user completes the first target task within a first preset time range, the display is controlled to play a third simulated scene; the degree of danger of the simulated scene corresponding to the third simulated scene is greater than the degree of danger of the simulated scene corresponding to the second simulated scene.
[0141] A second flight damping control signal is generated; the signal strength of the second flight damping control signal is greater than that of the first flight damping control signal.
[0142] A second burst control signal is generated based on the flight control signal and the second flight damping control signal;
[0143] The movement direction of the virtual aircraft indicated by the second burst control signal controls the display to show a subsequent screen of the third simulated screen; the content of the subsequent screen of the third simulated screen is different from that of the third simulated screen.
[0144] In some embodiments, the third simulated scenario is a scenario that is more dangerous than the second simulated scenario, such as a thunderstorm or mechanical failure.
[0145] Second flight damping control signal: A damping signal with a higher strength than the first flight damping control signal, such as a larger counterforce.
[0146] In some examples, if the user completes the first objective task within 3 seconds, the controller controls the display to play a third simulated image and generates a second flight damping control signal by increasing the load by 50% on top of the first flight damping control signal. This is then combined with changes to the control screen displayed by the test user's operation of the flight control handle.
[0147] The third simulated screen can be highly unrelated to the first and second simulated screens, increasing the difficulty of the test by introducing sudden changes in the flight scenario, thereby testing the test subject's extreme control capabilities. This helps improve the test results and tap into the user's potential.
[0148] The data generated by users during testing can reflect the scenarios in which they are good at and bad at. Therefore, based on the data recorded during testing, we can analyze the user's strengths and weaknesses, identify the user by user ID, and then enter the corresponding test scenario. This allows us to adapt testing to various user types based on the recorded data.
[0149] In some embodiments, when the controller detects that the playback progress has reached a preset node, it controls the display to show the second simulated image, specifically configured as follows:
[0150] Get the current user ID;
[0151] Find the operational capability tag based on the user ID;
[0152] The second simulation screen is selected based on the operational capabilities represented by the operational capability label.
[0153] In some embodiments, before displaying the second simulated screen, the controller obtains the user ID and queries the database for operation capability tags. Based on the tags, the corresponding second simulated screen is selected. Operation capability tags can be mapped to multiple second simulated screens, thus forming a user ID-operation capability tag-second simulated screen association, creating a personalized testing mode. Even with limited training resources, the most suitable test scenario and timing for testing can be selected through in-depth analysis of user operation characteristics. By recording test screens simultaneously with test data, the test screens provide contextual references for the test data, further enabling in-depth analysis of user operation characteristics and improving testing efficiency and effectiveness.
[0154] Parameters such as weather and environment in simulated scenarios can also affect the operation and reaction capabilities of the tested users. Therefore, the difficulty of controlling components such as flight control handles can be adjusted in conjunction with the content displayed on the screen to fully test the users.
[0155] In some embodiments, the controller generates a first flight damping control signal based on the flight control signal, specifically configured as follows:
[0156] Obtain the image information of the second simulated image, the image information including the environment type in the second simulated image and the physical parameters corresponding to the environment type;
[0157] The first flight damping control signal is generated based on the flight control signal, the first flight damping control signal, the environment type, and the physical parameters.
[0158] In some embodiments, screen information describes metadata of the virtual environment in the simulated screen, including environment types such as "high mountains and canyons" and "over the city" as well as physical parameters such as wind speed, air density, and turbulence model in that environment.
[0159] In some examples, when a first flight damping control signal needs to be generated, the controller reads the image information from the current second simulation screen. If the image information shows the environment type as "high mountain canyon" and the physical parameters include "crosswind 15 m / s", the controller will generate a continuous lateral first flight damping control signal, the magnitude and direction of which are strictly calculated based on the 15 m / s crosswind physical model, rather than a fixed disturbance value.
[0160] In this way, by deeply integrating flight damping interference with the physical rules of the virtual environment, the interference signal is no longer a preset abstract value, but a calculation result based on a specific environmental physical model. This greatly enhances the realism of the simulation, makes changes in flight damping traceable, and thus further improves the accuracy and reliability of the test.
[0161] This application also provides a flight test method, including:
[0162] In response to the simulation start command, control the display to play the first simulated image;
[0163] If the playback progress is detected to have reached a preset node, the display is controlled to show the second simulated image;
[0164] During the process of displaying the second simulated image on the monitor, the user characteristic data is analyzed;
[0165] If the user status represented by the user feature data is an abnormal state, then the flight control handle is controlled to switch from the first control state to the second control state; the control difficulty of the flight control handle in the second control state is greater than the control difficulty in the first control state.
[0166] Generate operation prompts to prompt the user to operate the flight control handle to perform the first target task based on the operation prompts.
[0167] Upon detecting a flight control signal generated by the flight control handle, the display is controlled to show a subsequent image of the second simulated image based on the second simulated image and the flight control signal;
[0168] Upon detection that the first target task has been completed, a flight test result is generated; the flight test result is used to characterize whether the user has passed the flight test.
[0169] Similar parts between the embodiments provided in this application can be referred to mutually. The specific implementation methods provided above are only a few examples under the overall concept of this application and do not constitute a limitation on the scope of protection of this application. For those skilled in the art, any other implementation methods extended from the solution of this application without creative effort shall fall within the scope of protection of this application.
Claims
1. A flight test device, characterized in that, include: Sensors are configured to collect user characteristic data; the user characteristic data is used to characterize the user's state during flight simulation caused by sudden test samples. The flight control handle is configured to generate flight control signals in response to user input; these flight control signals are used to indicate the direction of movement of the virtual aircraft. The display is configured to display a flight simulation screen; the flight simulation screen includes a first simulation screen and a second simulation screen, the first simulation screen being the screen corresponding to a normal test sample, and the second simulation screen being the screen corresponding to a sudden test sample; The controller is configured as follows: In response to the simulation start command, control the display to play the first simulated image; If the playback progress is detected to have reached a preset node, the display is controlled to show the second simulated image; During the process of displaying the second simulated image on the monitor, the user characteristic data is analyzed; If the user status represented by the user feature data is an abnormal state, then the flight control handle is controlled to switch from the first control state to the second control state; the control difficulty of the flight control handle in the second control state is greater than the control difficulty in the first control state. Generate operation prompts to prompt the user to operate the flight control handle to perform the first target task based on the operation prompts. Upon detecting a flight control signal generated by the flight control handle, the display is controlled to show a subsequent image of the second simulated image based on the second simulated image and the flight control signal; Upon detection that the first target task has been completed, a flight test result is generated; the flight test result is used to characterize whether the user has passed the flight test.
2. The flight test apparatus according to claim 1, characterized in that, The controller, upon detecting the flight control signal generated by the flight control handle, is further configured to: A first flight damping control signal is generated based on the flight control signal, wherein the direction of movement of the virtual aircraft indicated by the first flight damping control signal is on a different side from the direction of movement of the virtual aircraft indicated by the flight control signal; A first burst control signal is generated based on the flight control signal and the first flight damping control signal; Based on the movement direction of the virtual aircraft indicated by the first burst control signal, the display is controlled to show a subsequent screen of the second simulated screen; the content of the subsequent screen of the second simulated screen is different from that of the second simulated screen.
3. The flight test apparatus according to claim 1, characterized in that, The flight control handle includes a first drive mechanism; when the user state represented by the user characteristic data is in an abnormal state, the controller controls the flight control handle to switch from the first control state to the second control state, specifically configured as follows: Generate the first motion signal; The first motion signal is sent to the first drive mechanism so that the first drive mechanism drives the flight control handle to move in accordance with the motion pattern indicated by the first motion signal.
4. The flight test apparatus according to claim 1, characterized in that, It also includes a keypad, which includes a second drive mechanism; the controller, after the user state represented by the user feature data is an abnormal state, is further configured to: Generate a second motion signal; The second motion signal is sent to the second drive mechanism so that the second drive mechanism drives the keypad to move in accordance with the motion mode indicated by the second motion signal.
5. The flight test apparatus according to claim 1, characterized in that, The controller is further configured to, upon detecting that the first target task has been completed: Test records are generated based on the user's operation records and the generated user characteristic data during the display of the second simulated screen; The user's user ID and the test record are stored in the training record database. The test record also includes an operational capability tag corresponding to the user ID. The operational capability tag is obtained by analyzing the test record and is used to characterize the user's operational capability in burst test samples.
6. The flight test apparatus according to claim 3, characterized in that, The abnormal state includes a first-level abnormal state and a second-level abnormal state. The first-level abnormal state corresponds to a first-level motion signal, and the second-level abnormal state corresponds to a second-level motion signal. When generating the first motion signal, the controller is specifically configured as follows: The abnormal state is determined to be either a Level 1 or Level 2 abnormal state; When the abnormal state is a level one abnormal state, a level one motion signal is generated; the level one motion signal is sent to the first drive mechanism so that the first drive mechanism drives the flight control handle to move in accordance with the motion mode indicated by the level one motion signal; When the abnormal state is a level two abnormal state, a level two motion signal is generated; the level two motion signal is sent to the first drive mechanism so that the first drive mechanism drives the flight control handle to move in accordance with the motion mode indicated by the level two motion signal; the motion amplitude of the flight control handle based on the level one motion signal is greater than the motion amplitude based on the level two motion signal.
7. The flight test apparatus according to claim 2, characterized in that, After the controller detects that the playback progress has reached a preset node and controls the display to show the second simulated image, it is further configured to: Record the user's operation time when operating the flight control handle; If the user completes the first target task within a first preset time range, the display is controlled to play a third simulated scene; the degree of danger of the simulated scene corresponding to the third simulated scene is greater than the degree of danger of the simulated scene corresponding to the second simulated scene. A second flight damping control signal is generated; the signal strength of the second flight damping control signal is greater than that of the first flight damping control signal. A second burst control signal is generated based on the flight control signal and the second flight damping control signal; The movement direction of the virtual aircraft indicated by the second burst control signal controls the display to show a subsequent screen of the third simulated screen; the content of the subsequent screen of the third simulated screen is different from that of the third simulated screen.
8. The flight test apparatus according to claim 5, characterized in that, When the controller detects that the playback progress has reached a preset node, it controls the display to show the second simulated image, specifically configured as follows: Get the current user ID; Find the operational capability tag based on the user ID; The second simulation screen is selected based on the operational capabilities represented by the operational capability label.
9. The flight test apparatus according to claim 2, characterized in that, The controller generates a first flight damping control signal based on the flight control signal, specifically configured as follows: Obtain the image information of the second simulated image, the image information including the environment type in the second simulated image and the physical parameters corresponding to the environment type; The first flight damping control signal is generated based on the flight control signal, the first flight damping control signal, the environment type, and the physical parameters.
10. A flight test method, characterized in that, The flight test apparatus used in any one of claims 1-9 comprises: In response to the simulation start command, control the display to play the first simulation screen; If the playback progress is detected to have reached a preset node, the display is controlled to show a second simulated image; During the process of displaying the second simulated image on the monitor, user characteristic data is analyzed; If the user status represented by the user feature data is an abnormal state, the flight control handle is switched from the first control state to the second control state; the control difficulty of the flight control handle in the second control state is greater than the control difficulty in the first control state. Generate operation prompts to prompt the user to operate the flight control handle to perform the first target task based on the operation prompts. Upon detecting a flight control signal generated by the flight control handle, the display is controlled to show a subsequent image of the second simulated image based on the second simulated image and the flight control signal; Upon detection that the first target task has been completed, a flight test result is generated; the flight test result is used to characterize whether the user has passed the flight test.
Citation Information
Patent Citations
Airplane simulation cockpit control system
CN110930812A
Mark processing method and device in virtual scene, equipment and storage medium
CN117122919A