A method and system for training and assessing pilots' cognitive abilities

Abstract

This invention provides a method and system for training and evaluating pilots' cognitive abilities, relating to the fields of cognitive science and computer-aided training technology. Based on a training and evaluation system integrating personnel management, evaluation management, and training management, it completes a phased cycle of initial assessment, competency training, periodic assessment, and targeted training. The system collects operational data and adaptively adjusts training difficulty based on difficulty parameters, allowing assessment results to directly drive training program configuration. Furthermore, through the fusion analysis of multiple rounds of assessment and training data, it generates a digital profile of cognitive competence, achieving precise quantification and continuous improvement of pilots' cognitive abilities. The training effects of this invention can be transferred to real-world mission scenarios, making it suitable for large-scale application.

Description

Technical Field

[0001] This invention relates to the fields of cognitive science and computer-aided training technology, and in particular to a method and system for training and assessing the cognitive abilities of pilots. Background Technology

[0002] Currently, cognitive ability training and assessment technologies have received widespread attention in fields such as education, healthcare, and artificial intelligence. However, for pilots, existing technologies mainly include: First, traditional paper-and-pencil assessments and manual training methods, which are highly subjective, inefficient, and monotonous, making it difficult to record micro-behavioral data such as reaction time trajectories, hesitation, and error patterns in a timely and objective manner; Second, computerized cognitive assessment and training systems mostly simply present traditional cognitive tasks on computer or tablet screens, with "training" and "assessment" separated, lacking personalization, and having weak correlation with the real flight mission environment, making it difficult to effectively transfer training effects to cognitive activities during flight missions; Third, while virtual reality or augmented reality-based systems are relatively cutting-edge, they are costly, have low system integration, and may cause discomfort, making them unsuitable for large-scale promotion and use in military units and grassroots units.

[0003] In summary, existing technologies lack an integrated solution that can effectively simulate and train pilots' "dynamic cognitive skills" in complex and dynamic flight environments, achieve high-precision, multi-dimensional assessment and deep integration of adaptive and personalized training, and is portable, low-cost, and suitable for large-scale promotion. Summary of the Invention

[0004] To overcome the shortcomings of existing technologies, the purpose of this invention is to provide a method and system for training and evaluating pilots' cognitive abilities. By constructing a training and evaluation system that integrates assessment, training, and data analysis, the cognitive assessment results of pilots can directly drive the configuration of training programs, and continuously optimize the training effect through adaptive difficulty adjustment and multiple rounds of assessment, thereby achieving a systematic improvement in cognitive abilities.

[0005] To achieve the above objectives, the present invention provides the following solution: A method for training and assessing pilots' cognitive abilities includes: Based on a training and evaluation system that includes personnel management, assessment management, and training management, user information is established for pilots, and flight cognitive ability assessment tasks and training tasks are configured in the assessment management and training management. During the initial assessment phase, the pilot logs into the assessment management system, completes eight capability assessments, and obtains the initial assessment results. Based on the initial assessment results, the training management department selects seven capability training items for the pilot and generates a training plan. During the training process, the training evaluation system collects the pilot's operational data and training results, adaptively adjusts the training difficulty based on the difficulty parameters and the operational data, and records the training data. During the periodic assessment phase, the pilots are reassessed through the assessment management system according to the same eight competency assessments as in the initial assessment phase. The periodic assessment results are compared and analyzed with the initial assessment results and the training data to obtain the changes in each cognitive dimension and the competency shortcomings. Based on the changes and the shortcomings in capabilities, targeted training tasks are determined in the training management, and targeted training is arranged to alternate with the regular assessments. Based on multiple rounds of assessments and training data, a digital profile of the pilot's cognitive competence is generated.

[0006] Preferably, the personnel management in the training and evaluation system is used to create and maintain the pilot's user information, the evaluation management is used to configure and publish the flight cognitive ability evaluation task, and the training management is used to configure and manage the ability training program and the targeted training task.

[0007] Preferably, the ability assessment includes tests of surrounding perception ability, motion prediction ability, sensorimotor coordination, stress tolerance, logical reasoning ability, visual-spatial memory, traffic adaptive perception, and spatial ability.

[0008] Preferably, the assessment management uses embedded standard score formulas for t-scores, z-scores, and percentile rank to convert the initial assessment results and the periodic assessment results, automatically generating raw scores and norm scores for the assessment results, and simultaneously presenting statistical indicator results and detailed parameters in the assessment report.

[0009] Preferably, the capability training items include instrument emergency response training, airspace conflict scheduling training, flight path fuel planning training, air situation target reproduction training, trajectory prediction and strike training, aircraft group collaborative decision-making training, and dynamic visual manipulation training. When selecting training items, the training evaluation system displays the most recent training time, total training time, maximum training level, and current training level for each training item on the interface.

[0010] Preferably, when implementing the capability training program and the targeted training task, the training evaluation system upgrades or downgrades the training difficulty based on the pilot's operation data, and provides corresponding prompts when upgrading or downgrading. Each training includes an operation guide and the training duration can be set as needed. During the training process, it is allowed to exit at any time and save the training progress and the training difficulty when exiting, so that the initial state when re-entering the training is the training difficulty level before exiting.

[0011] Preferably, the training data includes the pilot's operational data collected during training and the key training indicators calculated from the operational data; the training evaluation system analyzes the training data and generates a training report; the training report lists each training record in reverse chronological order, and in each training record, it provides the training time, training duration, training difficulty level, and the value of the key training indicator, and uses charts to visualize the changes of the key training indicator between different training records.

[0012] Preferably, the training plan includes: scheduling at least two training sessions per month and at least twelve training sessions every six months, with each training session to be completed within one week; the periodic assessment phase, after the end of each quarter, completes the same eight competency assessments as the initial assessment phase through the assessment management; and the targeted training tasks are adjusted based on the results of the periodic assessments every six months.

[0013] Preferably, the cognitive competence digital profile provides the pilot's competence level and competence change trend in each cognitive dimension during the initial assessment phase and each of the periodic assessment phases, and marks the cognitive dimensions that need to be focused on training based on the competence gaps, in order to support decisions on pilot selection, job allocation and targeted competence improvement.

[0014] A system for training and assessing pilots' cognitive abilities includes: The user information establishment and task configuration unit is used to establish user information for pilots based on a training and evaluation system that includes personnel management, evaluation management, and training management, and to configure flight cognitive ability assessment tasks and training tasks in the evaluation management and training management. The initial cognitive ability assessment unit is used during the initial assessment phase, whereby the pilot logs into the assessment management system, completes eight ability assessments, and obtains the initial assessment results. The training plan generation and training item selection unit is used to select 7 capability training items for the pilot and generate a training plan based on the initial assessment results; The training process monitoring and difficulty adaptive adjustment unit is used to collect the pilot's operation data and training results during the training implementation process, adaptively adjust the training difficulty based on the difficulty parameter and the operation data, and record the training data. The periodic assessment and cognitive change analysis unit is used to reassess the pilots during the periodic assessment phase by means of the assessment management according to the same eight ability assessments as in the initial assessment phase, and to compare and analyze the periodic assessment results with the initial assessment results and the training data to obtain the changes in each cognitive dimension and the ability shortcomings. The targeted training determination and cognitive competence profile generation unit is used to determine targeted training tasks in the training management based on the changes and the competence deficiencies, and to arrange targeted training to be carried out alternately with the periodic assessments, and to generate a digital profile of the pilot's cognitive competence based on multiple rounds of assessments and training data.

[0015] The present invention discloses the following technical effects: This invention overcomes the shortcomings of existing technologies where assessment and training systems are fragmented and unable to form a unified closed loop for improving cognitive abilities by simultaneously configuring flight cognitive ability assessment and training tasks within a training and assessment system that includes personnel management, assessment management, and training management. This architecture allows assessment results to be directly used for training program selection, achieving truly data-driven training and providing structured support for the continuous improvement of pilots' cognitive abilities.

[0016] This invention acquires pilots' basic competency levels in the initial assessment phase and automatically selects seven competency training items based on the initial assessment results to generate a personalized training plan. This solves the long-standing pain points of traditional training methods, such as "homogenized training" and "inability to address individual weaknesses." By directly mapping individual competency differences to training item configuration, the training content is transformed from subjective experience-based selection to quantitative result-driven approaches, significantly improving the efficiency of training resource utilization and training effectiveness.

[0017] This invention collects pilot operational data during training and dynamically adjusts the training difficulty based on difficulty parameters and the operational data. This effectively overcomes the problem of existing cognitive training systems having fixed difficulty levels and being unable to adjust in real time according to changes in cognitive state. The adaptive difficulty mechanism avoids situations where training is too difficult, leading to frustration, or too easy, resulting in a lack of stimulation. It keeps pilots within their optimal learning range, improves training efficiency, and accelerates the improvement of cognitive abilities.

[0018] This invention conducts a periodic evaluation using the same eight competency assessments as the initial assessment, and compares and analyzes the periodic assessment results with the initial assessment results and training data. This addresses the shortcomings of existing training methods, which struggle to quantify cognitive development trajectories and accurately identify competency gaps. This mechanism not only provides multi-dimensional, dynamic competency change curves but also assists in judging the effectiveness of training plans, ensuring continuous optimization and iteration of training content.

[0019] This invention generates a digital profile of pilots' cognitive competence based on multi-round assessment and training data, effectively overcoming the problem of lacking objective quantitative evidence in traditional flight personnel management. The digital profile can integrate pilots' actual performance, competency gaps, and development potential across multiple cognitive dimensions, providing data-driven support for pilot selection, job allocation, advanced training, and long-term competency management, and realizing a shift from experience-based decision-making to scientific decision-making. Attached Figure Description

[0020] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0021] Figure 1 A flowchart of the method provided in an embodiment of the present invention; Figure 2 This is a schematic diagram of the system structure provided in an embodiment of the present invention; Figure 3 This is a flowchart illustrating the cognitive ability training and assessment method provided in an embodiment of the present invention. Detailed Implementation

[0022] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0023] The purpose of this invention is to provide a method and system for training and evaluating pilots' cognitive abilities, which deeply integrates pilot cognitive ability assessment, personalized training plans, adaptive training adjustments, and long-term ability tracking. By generating a digital profile of cognitive competence through multiple rounds of assessment and training data, the cognitive ability improvement process is made more accurate, efficient, and has sustainable optimization capabilities.

[0024] To make the above-mentioned objects, features and advantages of the present invention more apparent and understandable, the present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments.

[0025] Figure 1 The method flowchart provided in the embodiments of the present invention is as follows: Figure 1 As shown, the present invention provides a method for training and assessing the cognitive abilities of pilots, comprising: Step 100: Based on the training and assessment system that includes personnel management, assessment management and training management, establish user information for pilots, and configure flight cognitive ability assessment tasks and training tasks in assessment management and training management; Step 200: In the initial assessment phase, the pilot logs into the assessment management system, completes 8 capability assessments, and obtains the initial assessment results; Step 300: Based on the initial assessment results, the training management department selects 7 capability training items for the pilots and generates a training plan; Step 400: During the training process, the training evaluation system collects the pilot's operational data and training results, adaptively adjusts the training difficulty based on the difficulty parameters and operational data, and records the training data; Step 500: During the periodic assessment phase, the pilots are reassessed by the assessment management according to the same eight competency assessments as in the initial assessment phase. The periodic assessment results are compared and analyzed with the initial assessment results and training data to obtain the changes in each cognitive dimension and competency shortcomings. Step 600: Based on changes and capability gaps, determine targeted training tasks in training management, and arrange for targeted training to be carried out alternately with regular assessments. Based on multiple rounds of assessments and training data, generate a digital profile of the pilot's cognitive competence.

[0026] Specifically, in step 100 of this embodiment, a training and evaluation system is first constructed, comprising personnel management, evaluation management, and training management, to carry pilot-related data and evaluation and training tasks. Personnel management in this embodiment is used to create and maintain pilot user information, which includes at least fields such as name, number, affiliated unit, years of flight experience, aircraft type, and evaluation status markers, used to differentiate and track different pilots during subsequent evaluation and training. Evaluation management in this embodiment is used to configure and publish flight cognitive ability evaluation tasks, allowing this embodiment to set evaluation batches and evaluation time windows for different pilots. Training management in this embodiment is used to configure and manage capability training projects and targeted training tasks, where "capability training projects" refer to standardized training tasks designed around the flight cognitive dimension, and "targeted training tasks" refer to intensive training tasks selectively arranged based on evaluation results and capability shortcomings. In a specific embodiment, this embodiment sets the number of user information fields for a single pilot to no less than 10, the number of pilots supported by personnel management to no less than 200, the configuration time for each evaluation and training task to no more than 5 minutes, and the number of capability training projects that each pilot can associate within an evaluation-training cycle to 7.

[0027] In this embodiment, when configuring flight cognitive ability assessment tasks, the ability assessment is specifically refined into eight categories of assessment tasks: peripheral perception ability test, motion prediction ability test, sensorimotor coordination test, stress tolerance test, logical reasoning ability test, visual-spatial memory test, traffic adaptive perception test, and spatial ability test. Among them, the "peripheral perception ability test" is used to measure the pilot's speed and accuracy in perceiving targets at the edge of the field of vision; the "motion prediction ability test" is used to measure the pilot's ability to predict the future position of dynamic targets; the "sensory-motor coordination test" is used to reflect the coordination level between visual information and physical operation; the "stress tolerance test" is used to examine the performance stability under time pressure and information overload; the "logical reasoning ability test" is used to evaluate the ability to integrate and reason under rule constraints; the "visual-spatial memory test" is used to examine the ability to retain spatial position and shape information for a short time; the "traffic adaptive perception test" is used to simulate the situational understanding and risk perception ability in complex airspace traffic scenarios; and the "spatial ability test" is used to measure the cognitive processing ability of three-dimensional spatial attitude and orientation relationships. In one specific embodiment, the number of questions for each ability test is set to be between 20 and 60, the duration of a single test is controlled within the range of 5 to 15 minutes, the total assessment time for the eight abilities does not exceed 90 minutes, and the original score for each ability is divided into a score range of 0 to 100.

[0028] After obtaining the initial and periodic evaluation results, this embodiment uses the t-score, z-score, and percentile rank standard score formulas embedded in the evaluation management to standardize and transform the evaluation results, generating the raw score, norm score, and easily interpretable statistical indicators and detailed parameters. The "raw score of the evaluation result" refers to the count or time score directly obtained by the pilot in various ability tests, which is then adjusted for necessary orientation to form a unified score. The "norm score" refers to the raw score converted into a standard score reflecting the relative position using a specific norm sample as a reference. In this embodiment, the z-score z = (X - μ) / σ is calculated first, followed by the t-score t = 50 + 10 × z, and then the percentile rank is calculated using the standard normal distribution function to represent the pilot's relative percentile position in the norm sample. Here, X is the raw score obtained by the pilot in a certain ability test, which is the count or time measurement data collected through the test; μ is the average value of the ability in the norm sample, which is a representative group of pilots. In this embodiment, the norm sample consists of no less than 100 people; σ is the standard deviation of the raw score of the ability in the norm sample, which reflects the degree of dispersion within the norm group. The z-score obtained through the above calculation is used to measure the degree and direction of the pilot's raw score deviating from the norm mean, thereby achieving comparability across ability dimensions and training stages. This embodiment controls the estimation error of the norm mean μ to no more than ±1.0 points and the estimation error of the standard deviation σ to no more than ±0.5 points. "Statistical index results" refer to the average, standard deviation, maximum, and minimum values ​​of various capabilities for an individual pilot or a group of pilots. "Detailed parameters" refer to parameters such as the sub-scores, median reaction time, and error rate for each capability test in different sub-tasks and time periods. This embodiment sets the norm sample size to no less than 100 pilots, sets the theoretical mean of the t-score to 50 and the standard deviation to 10, sets the output precision of the percentage level to 1%, and displays no less than 4 statistical index results and no less than 16 detailed parameter items in each evaluation report.

[0029] Optionally, step 200 of this embodiment is as follows: In the initial assessment phase, the pilot first enters the capability assessment interface through the assessment management system. The system presents eight capability assessment tasks according to a preset assessment process, namely, peripheral perception capability test, motion prediction capability test, sensorimotor coordination test, stress tolerance test, logical reasoning capability test, visual-spatial memory test, traffic adaptive perception test, and spatial capability test. These tests are used to quantitatively collect the pilot's perception speed, prediction capability, information integration capability, spatial processing capability, and task execution stability under pressure conditions across different cognitive dimensions. In this embodiment, the number of questions for each capability test is set to 20-60, the duration of a single test is controlled to 5-15 minutes, and the scores for each test are adjusted in a unified direction to form an additive raw score. After the pilot completes all eight capability assessments sequentially, the assessment management system automatically records measurement data such as reaction time, accuracy rate, error type, and sub-item scores, and generates an initial assessment result containing the raw scores for the eight capabilities, which is used for subsequent training task configuration and capability change tracking.

[0030] Further, in step 300 of this embodiment, when configuring training based on the initial assessment results, the raw scores and standard scores of the eight capability assessments are first compared with preset thresholds to identify the pilot's strengths and weaknesses. Then, the training management team matches and selects seven types of capability training items. This embodiment defines "capability training items" as contextualized task units built around specific cognitive dimensions. Each task unit collects data such as reaction time, accuracy, and task completion quality through multiple rounds of operation to continuously shape the corresponding capability level. This embodiment preferably selects training items according to the principle of "prioritizing weaknesses and covering all dimensions." Under the premise of including at least one peripheral perception-related training and one spatial processing-related training, seven capability training items are configured for a single pilot, forming a training plan that includes a list of training items, suggested training frequency, and recommended training duration. In a specific embodiment, this embodiment sets the recommended duration for each capability training session to 10-20 minutes, the recommended total training duration for a single pilot within a training cycle to be no less than 240 minutes, and the number of times each pilot can participate in the same training item within a single training cycle to be 1-5 times.

[0031] In this embodiment, when generating the training plan, instrument incident response training, airspace conflict scheduling training, trajectory and fuel planning training, air situation and target reproduction training, trajectory prediction and strike training, swarm collaborative decision-making training, and dynamic visual manipulation training are sequentially classified into seven capability training items, each with a clearly defined functional positioning. Specifically, instrument incident response training simulates sudden changes or abnormal scenarios in multi-instrument information to examine information filtering and response capabilities in complex instrument environments; airspace conflict scheduling training measures conflict identification and scheduling decision-making capabilities in the context of multiple target trajectory intersections; trajectory and fuel planning training examines mission planning and resource allocation capabilities under fuel constraints and mission time constraints; air situation and target reproduction training measures the ability to encode, retain, and reproduce air situation elements; trajectory prediction and strike training examines the ability to predict and make decisions about the trajectory of high-speed targets; swarm collaborative decision-making training simulates information sharing and collective decision-making processes in multi-aircraft collaborative missions; and dynamic visual manipulation training measures manipulation accuracy and stability under dynamic visual stimuli. In this embodiment, the training program selection interface displays the most recent training time, total training time, highest training level, and current training level for each training program, allowing pilots to understand their personal training history and progress. In one specific embodiment, the training level of each training program is divided into 1 to 10 levels, the display precision of the total training time is set to 1 minute, and the time resolution of the most recent training time is set to 1 day.

[0032] In this embodiment, when implementing the aforementioned capability training programs and subsequent targeted training tasks, the training difficulty is dynamically adjusted based on the pilot's operational data to ensure that the training process matches the actual capability level. This embodiment defines the "training difficulty level" as a discrete level formed by comprehensively adjusting factors such as task complexity, number of targets, time pressure, and information interference level. The training difficulty level is used to characterize the load intensity of the current task situation. "Operational data" is defined as measurement data collected during training, such as reaction time, accuracy rate, error type, task completion rate, and fluctuations in key indicators. In this embodiment, during training, if the accuracy rate is higher than the preset upper limit and the average reaction time gradually decreases in several consecutive rounds of tasks, it is judged as "good performance." In this case, the training difficulty level is increased by 1 level, and the increase is indicated by a text prompt on the interface. If the accuracy rate is lower than the preset lower limit or the error rate continues to rise in several consecutive rounds of tasks, it is judged as "limited performance," and the training difficulty level is decreased by 1 level, with a corresponding prompt on the interface. This embodiment sets up an operation guide page for each training item to explain the task objectives, operation methods, and scoring rules. The training duration can be set as needed within the range of 5 to 40 minutes. During training, participants can exit at any time, and upon exiting, the current training difficulty level and progress information of unfinished tasks are recorded, ensuring that the pilot's initial state upon re-entry is the same as the training difficulty level and task progress before exiting. In one specific embodiment, this embodiment sets the statistical window used to determine "good performance" or "limited performance" to the most recent 5 rounds of tasks, sets the upper threshold for accuracy to 80%, the lower threshold for accuracy to 60%, and sets the time interval for adjusting the training difficulty level to no less than 60 seconds.

[0033] Furthermore, in step 400 of this embodiment, a training evaluation system is used as a platform during the training process to record the entire task process of the pilots completing various capability training items, thereby forming quantifiable training data. This embodiment defines "operational data" as basic behavioral data collected sequentially over time during a single training session. This data includes at least the trigger time of key presses or control commands, command type, time of task target appearance, task feedback time, task completion marker, and task result status, reflecting the pilot's operational rhythm and behavioral patterns during training tasks. Preferably, this embodiment sets the data collection interval to 0.1–0.5 seconds, sets the maximum number of recordable operational events in a single training session to 1000, and organizes the operational data within the same training task by task round after each training session for subsequent calculation of key training indicators and generation of training reports.

[0034] In this embodiment, after collecting operational data, the training difficulty is adaptively adjusted based on preset "difficulty parameters" and the operational data, and recorded to form training data. "Difficulty parameters" in this embodiment are defined as a set of parameters characterizing the training scenario load level, including various task-setting variables such as the number of targets, target occurrence frequency, allowable reaction time, proportion of interfering targets, and information presentation complexity, used to characterize the cognitive load intensity caused to the pilot by the current training conditions. "Training data" in this embodiment is defined as a combination of operational data collected in a single training session and training key indicators calculated from the operational data. The "training key indicators" include at least average reaction time, reaction time standard deviation, accuracy, error rate, task completion rate, and number of consecutive errors, used to quantitatively evaluate the pilot's performance level in that training session. This embodiment preferably uses the average reaction time and accuracy of the most recent 5 rounds of tasks as the basis for adjusting the training difficulty. When the average reaction time continuously decreases and the accuracy is continuously higher than 80%, the difficulty level is increased; when the accuracy is continuously lower than 60% or the number of consecutive errors is greater than 3, the difficulty level is decreased. The difficulty parameter values ​​and corresponding time markers before and after each difficulty adjustment are recorded in the training data.

[0035] This embodiment, after completing the training data recording, organizes and analyzes the training data and generates a training report for capability tracking. This embodiment defines a "training record" as a data entry stored on a per-training basis. Each training record includes at least the training time, training duration, training difficulty level, and values ​​for each key training indicator. A "training report" is defined as a result file that summarizes and visualizes multiple training records within a given time interval, used to show the pilot's performance trends during the training phase. This embodiment preferably lists training records in reverse chronological order, with the most recent training session at the top of the list. Each training record provides the training time (accurate to the minute), training duration (in minutes), training difficulty level (levels 1-10), and values ​​for at least six key training indicators. Simultaneously, line graphs or bar charts are used to visualize the changes in key training indicators such as average reaction time, accuracy, and task completion rate between the most recent 5-20 training records. In one specific embodiment, the number of historical training records that a single pilot can query is set to no less than 100, and the number of charts displayed in the training report is set to no less than 3, in order to ensure the continuity and readability of the training process analysis.

[0036] Optionally, in step 500 of this embodiment, during the periodic assessment phase, the pilot is presented with the same eight capability assessment tasks as in the initial assessment phase through assessment management. These tasks include: peripheral perception capability test, motion prediction capability test, sensorimotor coordination test, stress tolerance test, logical reasoning capability test, visual-spatial memory test, traffic adaptive perception test, and spatial capability test. This ensures comparability between different assessment phases. This embodiment defines "cognitive dimensions" as capability categories corresponding to the eight capabilities mentioned above, used to decompose and represent the pilot's cognitive ability structure. In specific implementation, this embodiment preferably schedules periodic assessments to be completed within 7 days after the end of each natural quarter, ensuring at least four periodic assessments per year. The time interval between each periodic assessment is controlled within the range of 60-120 days to balance assessment frequency and the integrity of the training cycle. After the periodic assessment is completed, this embodiment organizes the pilot's raw scores, z-scores, t-scores, and percentile rankings for each cognitive dimension to form a periodic assessment result set corresponding to the initial assessment results.

[0037] This embodiment, after obtaining periodic evaluation results, performs multidimensional comparative analysis with the initial evaluation results and training data to reveal changes in each cognitive dimension and identify capability gaps. This embodiment defines "changes" as the standardized score differences and trends of the same cognitive dimension at different evaluation stages, including t-score differences, percentage rank changes, and the trajectory of key training indicators over time. "Capability gaps" are defined as cognitive dimensions that are relatively low in the same batch of pilots and whose changes are insufficient to reach a preset improvement threshold. This embodiment preferably uses a t-score difference less than +3 and a percentage rank improvement less than 10% as the criteria for "insufficient improvement," and a t-score below 40 and ranking in the bottom 30% of the sample group as the criteria for "capability gaps." Combined with changes in key training indicators such as average reaction time, accuracy, and task completion rate in the training data, it confirms whether the gap is related to insufficient training participation or unreasonable training difficulty settings. In one specific embodiment, after each round of periodic evaluation, this embodiment outputs no less than 8 cognitive dimension change indicators and no less than 3 capability shortcomings for each pilot, in order to support the arrangement and adjustment of subsequent targeted training tasks.

[0038] As an optional implementation, in step 600 of this embodiment, after determining the changes in each cognitive dimension and the skill gaps, targeted training tasks are determined in training management based on the changes and skill gaps. This embodiment defines a "targeted training task" as a reinforcement training program formed by selecting or combining existing skill training projects with skill gaps as the core objective. Priority is given to training projects corresponding to cognitive dimensions with low t-scores, insufficient percentage-level improvement, and limited improvement in key training indicators. The training frequency and duration for that cognitive dimension are increased when necessary. In this embodiment, the number of key cognitive dimensions for each pilot's training is preferably limited to 2 to 4, the duration of a single targeted training session is set to 15 to 30 minutes, and the total number of targeted training sessions between two adjacent periodic assessments is set to no less than 6. The assessment-training alternation cycle is constructed in the order of "periodic assessment, targeted training, periodic assessment" so that each round of periodic assessment can reflect the implementation effect of the previous stage of targeted training tasks. In a specific embodiment, the total duration of the complete assessment-training alternation cycle is set to 3 to 6 months to support at least 2 complete cycles of cognitive ability improvement within an year.

[0039] This embodiment, after obtaining multiple rounds of initial and periodic assessment results and corresponding training data, constructs a cognitive competence digital profile for each pilot. This profile presents the ability level and trends of each cognitive dimension within a unified framework, and identifies cognitive dimensions requiring focused training. This embodiment defines the "cognitive competence digital profile" as a multi-dimensional quantitative representation formed by integrating standardized assessment results and key training indicators at different time points, using each cognitive dimension as a basic unit. In implementation, this embodiment preferably uses the t-score as a unified indicator for longitudinal comparison. A cognitive competence index is calculated for each cognitive dimension, and a comprehensive cognitive competence index is further calculated to reflect the overall cognitive ability level. This embodiment calculates the cognitive competence index Ci of the i-th cognitive dimension using the following formula: The Comprehensive Cognitive Competency Index (Ctotal) can be calculated using the following formula: in, Let be the cognitive competence index of the i-th cognitive dimension; The t-score for this cognitive dimension during the initial assessment phase; The t-score for this cognitive dimension is the score in the kth periodic assessment stage; K is the number of periodic assessments involved in the calculation, which is preferably set to 1~6 in this embodiment; It is a comprehensive cognitive competence index used to characterize overall cognitive level; The total number of cognitive dimensions is 8 in this embodiment. This embodiment preferably uses... Dimensions scoring below 40 and ranking in the bottom 30% of all cognitive dimensions are marked as competency weaknesses and prominently displayed in the cognitive competency digital profile to support pilot selection, job allocation, and targeted capability enhancement decisions. In a specific embodiment, this embodiment displays Ci values ​​for no fewer than 8 cognitive dimensions and 1 [missing information - likely a specific feature or characteristic] for each pilot in the digital profile. The value and no less than three key training dimensions marked as weaknesses.

[0040] like Figure 2 As shown, the system in this embodiment includes three modules: personnel management, training management, and evaluation management. Regarding personnel management and evaluation task configuration, this embodiment first manages all personnel using this method through personnel management. In the personnel management interface, basic information such as name, ID number, affiliated unit, contact information, and training status flags are entered to create new users. Existing users can be added, modified, deleted, and queried through the "Personnel" list to ensure accurate association of personnel identities during the evaluation and training phases. In evaluation management, when creating an evaluation task, this embodiment sequentially sets the task name, the interval between evaluation items, whether multiple participations are allowed, the task description, and the selected evaluation items, and submits these settings to form a complete evaluation task. After task creation, this embodiment can also adjust the order of evaluation items in the evaluation list to match the actual evaluation process. Subsequently, this embodiment uses the evaluation personnel allocation function to associate published evaluation tasks with evaluated personnel, supporting batch addition of personnel through searching, selection, and checkmarking, so that the same evaluation task can cover no fewer than 10 evaluated subjects.

[0041] In this embodiment, during the assessment process, eight cognitive ability assessment tasks are presented to the assessed individuals sequentially: peripheral perception ability test, motion prediction ability test, sensorimotor coordination test, stress tolerance test, logical reasoning ability test, visual-spatial memory test, traffic adaptive perception test, and spatial ability test. Basic operating instructions and example questions are provided before the formal assessment to familiarize the assessed individuals with the operating methods. Each assessment item is used to examine the perception and capture of information about the surrounding environment, the prediction of movement trajectories, the coordination between sensory information and motor responses, the ability to cope under stress, the logical reasoning ability under rule constraints, the ability to remember and reproduce visual-spatial information, the ability to understand and adapt to complex traffic scenarios, and the ability to understand and manipulate three-dimensional spatial relationships. In one specific embodiment, the sensorimotor coordination test can be set to a duration of 5 minutes. In the data analysis phase of this embodiment, the embedded t-score, z-score, and percentile rank standard score formulas are used to standardize and convert the raw scores of each ability, automatically generating the raw score and norm score of the evaluation result. In the evaluation report query phase, this embodiment can view the evaluation result reports of all personnel in the task. The report content includes the statistical indicator results and detailed parameters of each individual in the formal evaluation, which are used for subsequent ability deficiency identification and training task configuration.

[0042] In this embodiment, training management revolves around functions such as selecting training programs, implementing training programs, analyzing training data, and querying training reports related to comprehensive or targeted cognitive ability training. On the training program selection interface, this embodiment presents basic information for each training program in an independent display area, including the most recent training time, total training duration, maximum training level, and current training level. It also provides training programs such as instrument situation response training, airspace conflict scheduling training, flight path and fuel planning training, air situation target reproduction training, trajectory prediction and strike training, swarm collaborative decision-making training, and dynamic visual manipulation training. These programs are used to respectively improve an individual's ability to switch and process multi-source information, assess risk and make decisions in uncertain situations, plan tasks and utilize resources, process working memory and dynamically process key information, capture multi-source information and predict evolutionary trends in complex environments, coordinate multi-aircraft actions and make cognitive decisions, and perform visual-spatial perception and fine motor control in dynamic interactive situations. In this embodiment, during the implementation of training projects, the training duration can be customized according to training needs, and an operation guide explaining the training objectives and operation rules is provided before each training session. During training, the training difficulty is adjusted up or down based on the trainee's performance, with prompts given when the difficulty is increased or decreased. Trainees can also exit at any time during training, retaining their training progress and current difficulty level upon exit to support subsequent training and historical record viewing. In the training data analysis and training report query stage, this embodiment analyzes the distribution and trends of various evaluation indicator data during individual training, including comparisons with previous training results and fluctuations in training performance over specific time periods. Training records are arranged in reverse chronological order, allowing users to browse the training ID, training time, training duration, training difficulty level, and key training indicators for each record. The training evaluation indicator results are visualized through charts, thus intuitively displaying the evolution of training effectiveness.

[0043] Figure 3 This is a flowchart illustrating the cognitive ability training and assessment method according to an embodiment of the present invention. It shows a cyclical process starting from personnel registration, consisting of an initial assessment stage, an initial training stage, a periodic assessment stage, and a targeted training stage. In this process, trainees first complete eight ability assessments to obtain an initial cognitive ability level, and then conduct seven ability training sessions according to the training cycle requirements. Subsequently, a periodic review of the eight abilities is conducted quarterly, and the results of the periodic assessments are compared with the results of the previous stage to evaluate the training improvement effect. Based on the ability gaps identified in the periodic assessments, targeted training tasks are formulated and implemented in subsequent cycles, thus forming an assessment-training-reassessment cyclical system, and ultimately generating an individual training assessment report for decision support.

[0044] The cognitive ability training and assessment method in this embodiment first enters the initial assessment stage. Trainees log in to the assessment management module using their ID card number and password to complete eight ability assessments, which measure their basic level in multiple cognitive dimensions, including peripheral perception, motion prediction, sensorimotor coordination, stress tolerance, logical reasoning, visuospatial memory, traffic adaptive perception, and spatial ability. These eight assessments can be completed all at once or in stages, depending on the trainee's actual situation, to ensure flexibility in the assessment process. After completing the initial assessment, this embodiment enters the first training stage. Trainees conduct seven ability training sessions through the training module, completing the training plan with a cycle of two training sessions per month and 12 training sessions every six months. Each training session is scheduled to be completed within one week to ensure the continuity and controllability of the training effect.

[0045] In this cyclical process of alternating training and periodic assessment phases, this embodiment organizes trainees to complete eight competency assessments again at the end of each quarter. The assessment content is completely consistent with the initial assessment, and it also allows for flexible adjustments based on the trainees' actual situation, allowing for completion once or in multiple sessions. The system compares the periodic assessment results with the initial assessment results to evaluate the effectiveness of competency improvement after training and identify competency gaps in the current cognitive dimensions. Based on the identification of competency gaps, this embodiment further enters the targeted training phase, strengthening deficiencies by selecting specific training content corresponding to the competency dimensions from seven training tasks. Targeted training is still conducted twice a month, twelve times every six months, with each training session scheduled to be completed within one week, enabling continuous improvement of cognitive abilities. Through the phased cyclical mechanism, this embodiment ensures that training strategies are dynamically adjusted based on the semi-annual assessment, maintaining cognitive ability levels and maximizing training efficiency; the final individual training assessment report can serve as a basis for selection, job allocation, and competency enhancement decisions.

[0046] Corresponding to the above method, this embodiment also provides a system for training and assessing pilots' cognitive abilities, including: The user information establishment and task configuration unit is used to establish user information for pilots based on a training and evaluation system that includes personnel management, evaluation management, and training management, and to configure flight cognitive ability assessment tasks and training tasks in the evaluation management and training management. The initial cognitive ability assessment unit is used during the initial assessment phase, whereby the pilot logs into the assessment management system, completes eight ability assessments, and obtains the initial assessment results. The training plan generation and training item selection unit is used to select 7 capability training items for the pilot and generate a training plan based on the initial assessment results; The training process monitoring and difficulty adaptive adjustment unit is used to collect the pilot's operation data and training results during the training implementation process, adaptively adjust the training difficulty based on the difficulty parameter and the operation data, and record the training data. The periodic assessment and cognitive change analysis unit is used to reassess the pilots during the periodic assessment phase by means of the assessment management according to the same eight ability assessments as in the initial assessment phase, and to compare and analyze the periodic assessment results with the initial assessment results and the training data to obtain the changes in each cognitive dimension and the ability shortcomings. The targeted training determination and cognitive competence profile generation unit is used to determine targeted training tasks in the training management based on the changes and the competence deficiencies, and to arrange targeted training to be carried out alternately with the periodic assessments, and to generate a digital profile of the pilot's cognitive competence based on multiple rounds of assessments and training data.

[0047] The beneficial effects of this invention are as follows: This invention constructs a highly realistic and rule-unified cognitive task simulation environment, transforming the abstract and fragmented skills training content of traditional cognitive training into quantifiable, repeatable, and standardized task operations. This ensures that the training content remains consistent with the requirements of real flight missions in terms of objectives, rules, and operational logic. Compared to traditional training methods that are disconnected from actual work scenarios and have difficulty transferring training results, the simulated task system formed by this invention allows trainees to directly apply the observation patterns, information processing methods, and decision-making logic developed during training to actual flight missions, thereby significantly improving the conversion efficiency of training effects. Furthermore, the training hardware solution proposed in this invention, centered on a computer system and general peripherals, avoids the high costs of VR devices and professional simulators, enabling the low-cost, mass deployment of this type of cognitive training platform, which is conducive to its widespread promotion from specific units to grassroots units.

[0048] This invention achieves an adaptive training mechanism driven by the trainee's real-time performance through real-time linkage of multi-dimensional difficulty parameters, including complexity upgrades, time pressure adjustments, and resource constraint enhancements. This overcomes the structural limitations of existing cognitive training models, such as "fixed difficulty," "uniform intensity," and "inability to match individual differences." The system dynamically adjusts the task load in each training round based on key training indicators such as reaction time, accuracy, and task completion, ensuring the trainee remains at an appropriate level of cognitive challenge and maximizing training efficiency. Furthermore, this invention establishes a tight feedback loop between the training and evaluation phases, allowing training content to automatically adjust according to changes in cognitive ability, achieving continuous and personalized ability enhancement and significantly improving training accuracy and adaptability.

[0049] This invention utilizes an iterative "assessment-training-assessment" mechanism to continuously collect and analyze trainees' dynamic performance across multiple cognitive dimensions, generating an objectively quantifiable "digital profile of cognitive competence." This digital profile not only comprehensively presents trainees' current ability levels across different cognitive dimensions but also assesses their potential for development and weaknesses based on multi-period data. This data guides the implementation of targeted training programs, enabling scientific and precise planning of competency improvement paths. Furthermore, this profile system provides reliable and interpretable data for key management aspects such as talent selection, job allocation, and training resource distribution, transforming traditional experience-based personnel management into a data-driven decision-making model and significantly enhancing the organization's scientific management capabilities.

[0050] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on its differences from other embodiments. Similar or identical parts between embodiments can be referred to interchangeably. For the systems disclosed in the embodiments, since they correspond to the methods disclosed in the embodiments, the descriptions are relatively simple; relevant parts can be referred to the method section.

[0051] This document uses specific examples to illustrate the principles and implementation methods of the present invention. The descriptions of the above embodiments are only for the purpose of helping to understand the method and core ideas of the present invention. Furthermore, those skilled in the art will recognize that, based on the ideas of the present invention, there will be changes in the specific implementation methods and application scope. Therefore, the content of this specification should not be construed as a limitation of the present invention.

Claims

1. A method for training and assessing the cognitive abilities of pilots, characterized in that, include: Based on a training and evaluation system that includes personnel management, assessment management, and training management, user information is established for pilots, and flight cognitive ability assessment tasks and training tasks are configured in the assessment management and training management. During the initial assessment phase, the pilot logs into the assessment management system, completes eight capability assessments, and obtains the initial assessment results. Based on the initial assessment results, the training management department selects seven capability training items for the pilot and generates a training plan. During the training process, the training evaluation system collects the pilot's operational data and training results, adaptively adjusts the training difficulty based on the difficulty parameters and the operational data, and records the training data. During the periodic assessment phase, the pilots are reassessed through the assessment management system according to the same eight competency assessments as in the initial assessment phase. The periodic assessment results are compared and analyzed with the initial assessment results and the training data to obtain the changes in each cognitive dimension and the competency shortcomings. Based on the changes and the shortcomings in capabilities, targeted training tasks are determined in the training management, and targeted training is arranged to alternate with the regular assessments. Based on multiple rounds of assessments and training data, a digital profile of the pilot's cognitive competence is generated.

2. The method for training and assessing pilots' cognitive abilities according to claim 1, characterized in that, The personnel management in the training and evaluation system is used to create and maintain the pilot's user information; the evaluation management is used to configure and publish the flight cognitive ability evaluation task; and the training management is used to configure and manage the ability training program and the targeted training task.

3. The method for training and assessing pilots' cognitive abilities according to claim 1, characterized in that, The ability assessment includes tests of surrounding perception, motion prediction, sensorimotor coordination, stress tolerance, logical reasoning, visual-spatial memory, traffic adaptive perception, and spatial ability.

4. The method for training and assessing pilots' cognitive abilities according to claim 1, characterized in that, The assessment management system uses embedded standard score formulas for t-scores, z-scores, and percentile rank to convert the initial assessment results and the periodic assessment results, automatically generating the raw score and norm score of the assessment results, and simultaneously presenting statistical indicator results and detailed parameters in the assessment report.

5. The method for training and assessing pilots' cognitive abilities according to claim 1, characterized in that, The capability training programs include instrument emergency response training, airspace conflict scheduling training, flight path and fuel planning training, air situation and target reproduction training, trajectory prediction and strike training, aircraft group collaborative decision-making training, and dynamic visual manipulation training. When selecting training programs, the training evaluation system displays the most recent training time, total training time, maximum training level, and current training level for each training program on the interface.

6. The method for training and assessing pilots' cognitive abilities according to claim 1, characterized in that, When implementing the aforementioned capability training program and the aforementioned targeted training task, the training evaluation system upgrades or downgrades the training difficulty based on the pilot's operational data, and provides corresponding prompts when upgrading or downgrading. Each training session includes an operation guide and the training duration can be set as needed. The system allows for exiting at any time during the training process and saves the training progress and the training difficulty when exiting, so that the initial state when re-entering the training is the training difficulty level before exiting.

7. The method for training and assessing pilots' cognitive abilities according to claim 1, characterized in that, The training data includes the pilot's operational data collected during training and key training indicators calculated from the operational data; the training evaluation system analyzes the training data and generates a training report; The training report lists each training record in reverse chronological order. Each training record provides the training time, training duration, training difficulty level, and the value of the key training indicator. The changes of the key training indicator between different training records are visualized through charts.

8. The method for training and assessing pilots' cognitive abilities according to claim 1, characterized in that, The training plan includes: scheduling at least two training sessions per month and at least twelve training sessions every six months, with each training session to be completed within one week; the periodic assessment phase, after the end of each quarter, completes the same eight competency assessments as the initial assessment phase through the assessment management; and the targeted training tasks are adjusted based on the results of the periodic assessments every six months.

9. The method for training and assessing pilots' cognitive abilities according to claim 1, characterized in that, The cognitive competence digital profile provides the pilot's ability level and ability change trend in each cognitive dimension during the initial assessment phase and each of the periodic assessment phases. Based on the ability gaps, it identifies the cognitive dimensions that need to be focused on training, in order to support decisions on pilot selection, job allocation, and targeted ability enhancement.

10. A system for training and assessing the cognitive abilities of pilots, characterized in that, include: The user information establishment and task configuration unit is used to establish user information for pilots based on a training and evaluation system that includes personnel management, evaluation management, and training management, and to configure flight cognitive ability assessment tasks and training tasks in the evaluation management and training management. The initial cognitive ability assessment unit is used during the initial assessment phase, whereby the pilot logs into the assessment management system, completes eight ability assessments, and obtains the initial assessment results. The training plan generation and training item selection unit is used to select 7 capability training items for the pilot and generate a training plan based on the initial assessment results; The training process monitoring and difficulty adaptive adjustment unit is used to collect the pilot's operation data and training results during the training implementation process, adaptively adjust the training difficulty based on the difficulty parameter and the operation data, and record the training data. The periodic assessment and cognitive change analysis unit is used to reassess the pilots during the periodic assessment phase by means of the assessment management according to the same eight ability assessments as in the initial assessment phase, and to compare and analyze the periodic assessment results with the initial assessment results and the training data to obtain the changes in each cognitive dimension and the ability shortcomings. The targeted training determination and cognitive competence profile generation unit is used to determine targeted training tasks in the training management based on the changes and the competence deficiencies, and to arrange targeted training to be carried out alternately with the periodic assessments, and to generate a digital profile of the pilot's cognitive competence based on multiple rounds of assessments and training data.

Images