A QDT comprehensive driving control operation scoring system and scoring method
By designing a multi-level QDT comprehensive driving control operation scoring system, combining subjective and objective evaluation, and adopting a weighted computer system, the problem of single evaluation methods of the existing simulator is solved, and the comprehensive operation level of the operator is achieved. Scientific and credible quantitative evaluation.
Patent Information
- Application Number
- CN202410700206.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-05-31
- Publication Date
- 2024-11-19
- Estimated Expiration
- 2044-05-31
AI Technical Summary
The existing simulator evaluation method is single, and the lack of hierarchical analysis based on the weight of the factor indicators, resulting in the incomplete and objective evaluation of the operator's operating level.
A QDT comprehensive driving control operation scoring system was designed, and a multi-level evaluation module for training movements, training questions, training subjects, training categories and training stages was combined with subjective and objective evaluation, and a weight computer system was used to form a scientific and reasonable comprehensive scoring. system.
It realizes a comprehensive, scientific and credible quantitative evaluation of the operator's operating level, improves the comprehensiveness and credibility of the evaluation, and can truly reflect the operator's operating capabilities in different environments.
Smart Images

Figure CN118486207B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of air cushion craft operation evaluation, and in particular to a QDT comprehensive driving and control operation scoring system and a scoring method. Background Art
[0002] As a kind of high-speed marine equipment, the air cushion craft (QDT) usually operates in higher sea conditions and more severe sea conditions. Its operation tasks and operation actions are more complex than those of conventional ships. At the same time, it puts forward higher requirements on the driver's emergency handling ability in dangerous situations. The conventional real boat training method is often more dangerous, costly and easy to cause harm to people. Therefore, the use of simulation training can organically combine people and equipment. It is the best way for drivers to master the operation skills of new equipment quickly and better. It can not only reduce the danger of training, shorten the real boat training cycle, but also avoid damage to new equipment and effectively guarantee its service life. Therefore, designing a QDT comprehensive driving and control operation training evaluation system and its evaluation method has very important practical application value.
[0003] The QDT comprehensive driving control operation training evaluation system and its evaluation method are one of the important components of the QDT training simulator. During the simulation training process, in response to the needs and actual situation of real-time evaluation and assessment of on-site training, experts are responsible for manual scoring based on the operator's performance, and for different training actions, training questions, training subjects, training categories, and training stages of any training task, different weights are set according to their importance, and reasonable, accurate, and reliable evaluation results are automatically given to accurately and effectively complete the assessment task of the operator's practical training.
[0004] The existing simulator evaluation methods have the following problems:
[0005] (1) The simulation operation is only for a single training subject, mainly focusing on basic operations such as straight flight and turning. There is no comprehensive and scientific training system. As a result, due to different training environment settings or other influencing factors, the operator's operating level may fluctuate greatly during the training process. The training evaluation data cannot objectively reflect the operator's operating level.
[0006] (2) There is a lack of methods to apply hierarchical analysis to specific training based on the weights of factor indicators. Summary of the invention
[0007] The technical problems to be solved by the present invention are:
[0008] The existing simulator evaluation method has a single training system and lacks a method to apply hierarchical analysis to specific training based on the weights of factor indicators.
[0009] The present invention adopts the following technical solutions to solve the above technical problems:
[0010] The present invention provides a QDT comprehensive driving control operation scoring system, the scoring system comprising:
[0011] The bottom evaluation module of training actions is used to manage operator training topics and calculate the evaluation scores of operator training topics from both subjective and objective aspects according to the weights of topic evaluation factors;
[0012] The second-level evaluation module of the training questions is used to evaluate the scores according to the operator's operation actions and calculate the operator's evaluation scores on the subject according to the weight of the questions in the subject;
[0013] The second-level evaluation module of the training subject is used to calculate the evaluation score of the operator on the training category according to the evaluation score of the operator on the subject and the weight of the subject in the training category;
[0014] The top-level evaluation module of the training category is used to calculate the evaluation score of the operator in the training stage according to the evaluation score of the operator in the category and the weight of the training category in the training stage;
[0015] The overall comprehensive evaluation module of the training stage is used to calculate the comprehensive score obtained by the operator after completing the entire training system according to the evaluation score of the training stage and the weight of the training stage.
[0016] Furthermore, the bottom layer evaluation module of the training action is used to provide evaluation scores on the training action for different training action topics through human-computer interaction evaluation.
[0017] Furthermore, the underlying evaluation module of the training action is based on the calculation method:
[0018]
[0019] where d i represents the score of the i-th manual subjective evaluation factor given by the on-site trainer during the operator's j-th topic special training, w ji represents the weight of the jth question and the ith evaluation factor, f(D Sj ) represents the operator's subjective evaluation score on the jth question;
[0020]
[0021] Where E i represents the error size of the control result of the operator's i-th evaluation factor during the j-th topic special training process, f(D Oj ) represents the student's objective evaluation score on the jth question;
[0022] f(D j )=w Sj f(D Sj )+w Oj f(D Oj ) (3)
[0023] where w Sj represents the subjective score weight of the jth question, w Oj represents the objective score weight of the jth question, f(D j ) represents the operator's subjective and objective combined evaluation score on the jth question.
[0024] Furthermore, the calculation method of the sub-bottom evaluation module of the training question is based on:
[0025]
[0026] in represents the weight of the kth subject and the jth question, f(C k ) represents the operator’s evaluation score on the kth subject.
[0027] Furthermore, the second-level evaluation module of the training subject is based on the calculation method:
[0028]
[0029] where φ jk represents the weight of the jth category and the kth subject, f(B j ) represents the evaluation score of the operator on the jth training category.
[0030] Furthermore, the top-level evaluation module of the training category is based on the calculation method:
[0031]
[0032] where β ij represents the weight of the jth training category in the i-th training stage, f(A i ) represents the evaluation score of the operator in the i-th training stage.
[0033] Furthermore, the overall comprehensive evaluation module in the training phase is based on the calculation method as follows:
[0034]
[0035] in represents the weight of the i-th training stage, and S represents the comprehensive score obtained by the operator after completing the entire training system.
[0036] A QDT comprehensive driving control operation scoring method, the scoring method comprising the following steps:
[0037] Step 1: The operator performs operation training through the training questions in the bottom evaluation module of the training action. After the training task, a set of training actions of different training topics is obtained. According to formulas (1) to (3), the on-site trainer gives the subjective evaluation score of the operator's various training actions through the human-computer interaction interface based on expert experience. At the same time, the system calculates the operator's control operation error and calculates the objective evaluation score of the operator's various training actions. Finally, the evaluation score of the operator's training topic is calculated.
[0038] Step 2: After the operator completes all questions on the training subject, the evaluation score of each operation action of the operator on the subject is calculated by weight according to formula (2);
[0039] Step 3: When the operator completes the training tasks of all subjects in this category, the evaluation score of the operator in the training category is calculated by weight according to formula (3);
[0040] Step 4: When the operator completes all the training tasks of this stage as required, the evaluation score of the operator in the training stage is calculated by weight according to formula (4);
[0041] Step 5: When the operator completes the training tasks of all stages under the top-level evaluation system, the comprehensive score obtained by the operator for completing the entire training system is calculated by weight according to formula (5).
[0042] Compared with the prior art, the present invention has the following beneficial effects:
[0043] The present invention has established a comprehensive QDT driving control operation scoring system for all working conditions, all tasks and all subjects. It has a scientific and reasonable hierarchical task system, which progresses from easy to difficult. The multi-level training system drives the tree structure evaluation mechanism, integrating the online evaluation of on-site experts and the automatic scoring method of system level analysis. It combines the subjective judgment of professionals with the objective data of automatic scoring by the system, comprehensively considering the performance of students at different levels from stages, categories to subjects and topics, and improving the comprehensiveness and credibility of the evaluation.
[0044] The QDT comprehensive driving control operation scoring system of the present invention determines the weighted evaluation model of each indicator in the training system according to the different requirements of the QDT driving control simulation system for the operator's driving control training in different training stages, training categories, training subjects, and training topics, and establishes a scientific and reasonable QDT driving control operation evaluation system to truly evaluate the operator's operation level in different environments and obtain a comprehensive quantitative evaluation result. BRIEF DESCRIPTION OF THE DRAWINGS
[0045] Figure 1 Schematic diagram of the structure of the QDT comprehensive driving control operation scoring system in an embodiment of the present invention. DETAILED DESCRIPTION
[0046] In order to enable those skilled in the art to better understand the scheme of the present invention, exemplary implementations or embodiments of the present invention will be described below in conjunction with the accompanying drawings. Obviously, the described implementations or embodiments are only implementations or embodiments of a part of the present invention, not all of them. Based on the implementations or embodiments of the present invention, all other implementations or embodiments obtained by ordinary technicians in the field without creative work should fall within the scope of protection of the present invention.
[0047] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, specific embodiments of the present invention are described in detail below with reference to the accompanying drawings.
[0048] like Figure 1 As shown, the present invention provides a QDT comprehensive driving control operation scoring system on one hand, and the scoring system includes:
[0049] The bottom evaluation module of training actions is used to manage operator training topics and calculate the evaluation scores of operator training topics from both subjective and objective aspects according to the weights of topic evaluation factors;
[0050] The second-level evaluation module of the training questions is used to evaluate the scores according to the operator's operation actions; and calculate the operator's evaluation score on the subject according to the weight of the question in the subject;
[0051] The second-level evaluation module of the training subject is used to calculate the evaluation score of the operator on the training category according to the evaluation score of the operator on the subject and the weight of the subject in the training category;
[0052] The top-level evaluation module of the training category is used to calculate the evaluation score of the operator in the training stage according to the evaluation score of the operator in the category and the weight of the training category in the training stage;
[0053] The overall comprehensive evaluation module of the training stage is used to calculate the comprehensive score obtained by the operator after completing the entire training system according to the evaluation score of the training stage and the weight of the training stage.
[0054] The scoring system of the present invention is provided with different training stages; multiple training categories are provided in each training stage, multiple training subjects are provided in each training category; different training topics are provided in each subject, and different training topics have different environment modes; and multiple training actions are included in each environment mode. Each training action is scored separately, and the operator's operation level of each item in different environments can be truly evaluated.
[0055] The training subjects involved in the scoring system of the present invention are more comprehensive. When the operator completes all training subjects under each category, the system can automatically give the operator's subject training quantitative evaluation results according to the weight index of each subject in the category; further, when the operator completes the training questions of all categories, the system can automatically give the operator's comprehensive training quantitative evaluation results according to the weight index of each category in the overall training system, which can evaluate the operator's operation level and comprehensive training level in different subjects and stages, and help the operator to improve his targeted operation ability.
[0056] The bottom layer evaluation module of the training action is used to provide evaluation scores on the training action through human-computer interaction evaluation for different training action topics.
[0057] The underlying evaluation module of the training action is based on the calculation method:
[0058]
[0059] where d i represents the score of the i-th manual subjective evaluation factor given by the on-site trainer during the operator's j-th topic special training, w ji represents the weight of the jth question and the ith evaluation factor, f(D Sj ) represents the operator's subjective evaluation score on the jth question;
[0060]
[0061] Where E i represents the error size of the control result of the operator's i-th evaluation factor during the j-th topic special training process, f(D Oj ) represents the student's objective evaluation score on the jth question;
[0062] f(D j )=w Sj f(D Sj )+w Oj f(D Oj ) (3)
[0063] where w Sj represents the subjective score weight of the jth question, w Oj represents the objective score weight of the jth question, f(D j ) represents the operator's subjective and objective combined evaluation score on the jth question.
[0064] The calculation method of the second-level evaluation module of the training question is based on:
[0065]
[0066] in represents the weight of the kth subject and the jth question, f(C k ) represents the operator’s evaluation score on the kth subject.
[0067] The second-level evaluation module of the training subject is based on the calculation method:
[0068]
[0069] where φ jk represents the weight of the jth category and the kth subject, f(B j ) represents the evaluation score of the operator on the jth training category.
[0070] The top-level evaluation module of the training category is based on the calculation method:
[0071]
[0072] where β ij represents the weight of the jth training category in the i-th training stage, f(A i ) represents the evaluation score of the operator in the i-th training stage.
[0073] The calculation method of the overall comprehensive evaluation module in the training phase is based on:
[0074]
[0075] in represents the weight of the i-th training stage, and S represents the comprehensive score obtained by the operator after completing the entire training system.
[0076] Another aspect of the present invention provides a QDT comprehensive driving control operation scoring method, the scoring method comprising the following steps:
[0077] Step 1: The operator performs operation training through the training questions in the bottom evaluation module of the training action. After the training task, the training action set (i) of different training questions is obtained. According to formulas (1) to (3), the on-site trainer gives the subjective evaluation factor score (d) of each training action of the operator through the human-computer interaction interface based on expert experience. i ), calculate the subjective evaluation score according to the weight of the evaluation factor; at the same time, calculate the control result error size E of the evaluation factor during the training process i , and further calculate the objective evaluation score according to the weight of the evaluation factors, and combine the subjective evaluation score and the objective evaluation score to obtain the operation action evaluation score f(D j). For example, in the training topic of low-speed direct flight driving on a sunny day, the action set includes heading control, speed control and track keeping. During the training process, the on-site instructor gives the corresponding subjective score according to the operator's driving situation in the above training actions, and the system automatically calculates the corresponding objective score by calculating the error between the operator's control result and the required control accuracy. Finally, the present invention sets corresponding weight constraints according to the different importance of different training actions, and the system automatically calculates the operator's operation action evaluation score in this topic training.
[0078] Step 2: After the operator completes all questions for a certain training subject, the evaluation score f(C k For example, in the manual direct navigation training subject, there are direct navigation training questions under different weather and sea conditions. The present invention sets corresponding weight constraints according to the different importance of different questions, and automatically calculates the comprehensive scores of all training questions of the operator under this training subject.
[0079] Step 3: When the operator completes the training tasks of all subjects in this category, the operator's evaluation score f(B j ). For example, in the category of still water driving training, there are driving training subjects such as manual, automatic, straight-line and turning. The present invention sets corresponding weight constraints according to the different importance of different training subjects, and automatically calculates the comprehensive scores of all training subjects of the operator under this training category.
[0080] Step 4: When the operator completes all the training tasks of this stage as required, the operator's evaluation score f(A) in the training stage is calculated by weight according to formula (6). i ). For example, in the basic training stage, there are training categories such as equipment operation and driving. The present invention sets corresponding weight constraints according to the different importance of different training categories, and automatically calculates the comprehensive scores of all training categories of the operator in this training stage.
[0081] Step 5: When the operator completes the training tasks of all stages under the top-level evaluation system, the comprehensive score S obtained by the operator after completing the entire training system is weighted and calculated according to formula (7). The present invention sets corresponding weight constraints according to the different importance of different training stages, and automatically calculates the comprehensive score obtained by the operator after completing the training tasks under the training system.
[0082] Although the present invention is disclosed as above, the protection scope of the present invention is not limited thereto. Those skilled in the art may make various changes and modifications without departing from the spirit and scope of the present invention, and these changes and modifications will fall within the protection scope of the present invention.
Claims
1. A QDT comprehensive driving control operation scoring system, characterized in that: The scoring system includes: The bottom evaluation module of training actions is used to manage operator training topics and calculate the evaluation scores of operator training topics from both subjective and objective aspects according to the weights of topic evaluation factors; The second-level evaluation module of the training questions is used to evaluate the scores according to the operator's operation actions and calculate the operator's evaluation scores on the subject according to the weight of the questions in the subject; The second-level evaluation module of the training subject is used to calculate the evaluation score of the operator on the training category according to the evaluation score of the operator on the subject and the weight of the subject in the training category; The top-level evaluation module of the training category is used to calculate the evaluation score of the operator in the training stage according to the evaluation score of the operator in the category and the weight of the training category in the training stage; The overall comprehensive evaluation module of the training stage is used to calculate the comprehensive score obtained by the operator after completing the entire training system according to the evaluation score of the training stage and the weight of the training stage; The underlying evaluation module of the training action is based on the calculation method: where d i represents the score of the i-th manual subjective evaluation factor given by the on-site trainer during the operator's j-th topic special training, w ji represents the weight of the jth question and the ith evaluation factor, f(D Sj ) represents the operator's subjective evaluation score on the jth question; Where E i represents the error size of the control result of the operator's i-th evaluation factor during the j-th topic special training process, f(D Oj ) represents the student's objective evaluation score on the jth question; f(D j )=w Sj f(D Sj )+w Oj f(D Oj ) (3) where w Sj represents the subjective score weight of the jth question, w Oj represents the objective score weight of the jth question, f(D j ) represents the operator's subjective and objective combined evaluation score on the jth question.
2. The QDT comprehensive driving control operation scoring system according to claim 1 is characterized in that: The bottom layer evaluation module of the training action is used to provide evaluation scores on the training action through human-computer interaction evaluation for different training action topics.
3. The QDT comprehensive driving control operation scoring system according to claim 1 is characterized in that: The calculation method of the second-level evaluation module of the training question is based on: in represents the weight of the kth subject and the jth question, f(C k ) represents the operator’s evaluation score on the kth subject.
4. The QDT comprehensive driving control operation scoring system according to claim 3 is characterized in that: The second-level evaluation module of the training subject is based on the calculation method: where φ jk represents the weight of the jth category and the kth subject, f(B j ) represents the evaluation score of the operator on the jth training category.
5. The QDT comprehensive driving control operation scoring system according to claim 4 is characterized in that: The top-level evaluation module of the training category is based on the calculation method: where β ij represents the weight of the jth training category in the i-th training stage, f(A i ) represents the evaluation score of the operator in the i-th training stage.
6. The QDT comprehensive driving control operation scoring system according to claim 5 is characterized in that: The calculation method of the overall comprehensive evaluation module in the training phase is based on: in represents the weight of the i-th training stage, and S represents the comprehensive score obtained by the operator after completing the entire training system.
7. A QDT comprehensive driving control operation scoring method, characterized in that: The scoring method comprises the following steps: Step 1: The operator performs operation training through the training questions in the bottom evaluation module of the training action. After the training task, a set of training actions for different training questions is obtained. According to formulas (1) to (3), the on-site trainer gives the operator's subjective evaluation score for each training action through the human-computer interaction interface based on expert experience; where d i represents the score of the i-th manual subjective evaluation factor given by the on-site trainer during the operator's j-th topic special training, w ji represents the weight of the jth question and the ith evaluation factor, f(D Sj ) represents the operator's subjective evaluation score on the jth question; Where E i represents the error size of the control result of the operator's i-th evaluation factor during the j-th topic special training process, f(D Oj ) represents the student's objective evaluation score on the jth question; f(D j )=w Sj f(D Sj )+w Oj f(D Oj ) (3) where w Sj represents the subjective score weight of the jth question, w Oj represents the objective score weight of the jth question, f(D j ) represents the operator's subjective and objective evaluation score on the jth question; At the same time, the system calculates the operator's control operation error and obtains the objective evaluation score of the operator's various training actions. Finally, the evaluation score of the operator's training questions is calculated. Step 2: After the operator completes all questions on the training subject, the evaluation score of each operation action of the operator on the subject is calculated by weight according to formula (2); Step 3: When the operator completes the training tasks of all subjects under the category, the evaluation score of the operator in the training category is calculated by weight according to formula (3); Step 4: When the operator completes all the training tasks of the stage as required, the evaluation score of the operator in the training stage is calculated by weight according to formula (4); in represents the weight of the kth subject and the jth question, f(C k ) represents the evaluation score of the operator on the kth subject; Step 5: When the operator completes the training tasks of all stages under the top-level evaluation system, the comprehensive score obtained by the operator for completing the entire training system is calculated by weight according to formula (5); where φ jk represents the weight of the jth category and the kth subject, f(B j ) represents the operator's evaluation score on the jth training category.
