Operation behavior evaluation method for communication operation and maintenance skill three-dimensional simulation drill

Abstract

The invention relates to the technical field of communication simulation and drill behavior evaluation, in particular to an operation behavior evaluation method for communication operation and maintenance skill three-dimensional simulation drill, which comprises the following steps: setting behavior evaluation conditions of simulation operation, including a leading dependency behavior, a contradictory behavior, a same-effect behavior, time limit, a correct behavior and a guess behavior; constructing a scoring standard of the simulation drilling operation; collecting to-be-evaluated behaviors in the simulation drilling operation according to a preset behavior data format; and according to the behavior evaluation condition and the scoring standard, scoring the to-be-evaluated behavior to obtain an evaluation result of the simulation drill operation behavior. By introducing parameters such as the dependency behavior list, the contradictory behavior list and the same-effect behavior list, the logic relationship between the operation behaviors can be evaluated, the sequence and dependency relationship of the operation behaviors are ensured to be correctly processed, and repeated and contradictory operations can be avoided, so that the authenticity and effectiveness of drilling are improved.

Description

Technical Field

[0001] The present application relates to the technical field of communication simulation and exercise behavior evaluation, and more specifically, to an operation behavior evaluation method for three-dimensional simulation exercises of communication operation and maintenance skills. Background Art

[0002] In the field of communication network operation and maintenance, with the continuous development of communication technology, the sequential expansion of network scale, and the increasing complexity of the structure and function of communication equipment, the skill requirements for operation and maintenance personnel are becoming higher and higher. Traditional operation and maintenance skill drills often rely on physical equipment for operation, which is not only costly, but also difficult to cover all possible equipment types and operation and maintenance operation scenarios. Therefore, in recent years, three-dimensional simulation technology has been widely used in communication operation and maintenance skill drills. Using a three-dimensional simulation system for communication operation and maintenance operation skill drills, it is possible to simulate a real communication network and operating environment.

[0003] The invention patent with the authorization announcement number CN109754663B discloses a method for implementing simulation training and evaluation of the entire process of substation operation and maintenance. By constructing a simulation training scenario for the substation, simulating the operation and maintenance project operation process logic, receiving operation and maintenance training tasks and operation and maintenance environment, and obtaining evaluation results, the reliability of the training is improved. However, when users use the three-dimensional communication simulation system to conduct operational drills for various operation and maintenance tasks, there are still many problems in the evaluation of the correctness and standardization of the user's operating behavior. It is impossible to comprehensively analyze and evaluate each behavior generated during the operation process. This leads to the user focusing on completing the task during the simulation drill, while ignoring the standardization and safety of the operating behavior.

[0004] The invention patent with publication number CN109523856A discloses a test driver training system and control method based on aircraft engine working condition simulation. In this scheme, the test driver operation program displays the working condition demonstration content and fault working condition demonstration content of the current working condition simulation section. The test driver operates the engine throttle lever angle and each operating switch based on this content, and the operation behavior is converted into operation data through a digital-to-analog converter. The test driver operation program sends the operation data and the display of the corresponding simulation section and its working condition demonstration content to the control machine. The trainer control system obtains the training results. The trainer control system determines the correctness of the test driver's operation, thereby obtaining a score for the operator. It can be seen that although some simulation systems in other professional fields have realized the comparison and automatic scoring of the user's main operating behaviors based on rule templates. However, the existing methods cover fewer behavioral evaluation factors, mainly comparing whether a small number of key correct behaviors exist, and the scoring is not comprehensive and accurate enough.

[0005] Therefore, how to provide a real-time comprehensive evaluation method for user operation behavior suitable for three-dimensional simulation and drill systems to solve the problems of low efficiency, poor comprehensiveness and insufficient accuracy in the current user behavior evaluation during the three-dimensional simulation and drill of operation and maintenance skills has become a technical problem that needs to be solved. Summary of the invention

[0006] In view of this, the present application provides an operational behavior evaluation method for three-dimensional simulation drills of communication operation and maintenance skills, so as to solve the technical problems of low efficiency, poor comprehensiveness and insufficient accuracy in user behavior evaluation during the current three-dimensional simulation drills of operation and maintenance skills.

[0007] The technical solutions provided by this application are as follows:

[0008] An operation behavior evaluation method for three-dimensional simulation drills of communication operation and maintenance skills, the method comprising:

[0009] S1. Set the behavior evaluation conditions of the simulation operation, including the leading dependent behavior, contradictory behavior, equivalent behavior, time limit, correct behavior and guessed behavior; S2. Construct the scoring criteria for the simulation drill operation, and the scoring criteria are determined based on the steps of the simulation drill operation, the correct behavior in each step, the prohibited behavior, the correct / prohibited behavior and the logical relationship between the behavior evaluation conditions; S3. Collect the behaviors to be evaluated in the simulation drill operation according to the preset behavior data format, and determine the leading dependent behavior, contradictory behavior and equivalent behavior corresponding to the operation behavior; S4. Score the behaviors to be evaluated according to the behavior evaluation conditions and scoring criteria, and obtain the evaluation results of the simulation drill operation behaviors.

[0010] In one possible implementation, setting the behavior evaluation condition of the simulation operation in S1 also includes:

[0011] Based on different types of simulation drill tasks and behavior evaluation conditions, a simulation operation behavior evaluation table is constructed;

[0012] The evaluation parameters of each behavior evaluation condition in the simulation operation behavior evaluation table are set, and the evaluation parameters include behavior type, operation object, and behavior nature; the behavior nature includes correct behavior and prohibited behavior.

[0013] In one possible implementation, the step of constructing a simulation operation behavior evaluation table includes:

[0014] Determine the drill steps of the simulation drill task and the correct operation behavior in each drill step based on the scenario and drill content corresponding to the simulation drill task;

[0015] Determine the logical relationship between each correct operation behavior, including the preceding dependent behaviors, contradictory behaviors, and equivalent behaviors that need to be completed before the correct operation behavior occurs, and determine the additional points after the correct behavior is determined and the deduction points after the guessed behavior is discovered.

[0016] In one possible implementation, the simulation operation behavior evaluation table further includes a dependent behavior list, a contradictory behavior list, an equivalent behavior list, a time limit, a correct behavior bonus table, and a guessing behavior deduction table;

[0017] The dependent behavior list includes the leading dependent behavior that must be completed before the behavior to be evaluated occurs, the behavior type and operation object of the leading dependent behavior;

[0018] The list of contradictory behaviors includes the contradictory behaviors that occurred before the behavior to be evaluated and are contradictory to the operation behavior, the behavior type, operation object and deduction value of the contradictory behavior;

[0019] The time limit includes the maximum allowed interval between the behavior to be evaluated and the previous operation;

[0020] The guessed behavior deduction table includes deduction values ​​for invalid behaviors that occurred before the behavior to be evaluated; the invalid behaviors have the same behavior type as the behavior to be evaluated but different operation objects.

[0021] In one possible implementation, in S3, the preset behavior data format is in the form of a tuple, including the collection behavior sequence number, behavior type, operation object, and occurrence time.

[0022] In one possible implementation, S4 scores the behavior to be evaluated according to the behavior evaluation conditions and scoring criteria, including:

[0023] Scan the simulation operation behavior evaluation table corresponding to the simulation drill task to determine whether the behavior to be evaluated belongs to the drill step corresponding to the simulation drill task;

[0024] If yes, then determine whether the behavior to be evaluated is a prohibited behavior;

[0025] If the behavior to be evaluated is a prohibited behavior, terminating the simulation exercise task;

[0026] If the behavior to be evaluated is not a prohibited behavior, the preceding dependent behavior, contradictory behavior, equivalent behavior, behavior time, correct behavior in the operation behavior, and guessed behavior corresponding to the behavior to be evaluated are analyzed in turn, and scored to obtain the evaluation result of the simulation exercise operation behavior.

[0027] In one possible implementation, determining whether the behavior to be evaluated belongs to a drill step corresponding to the simulation drill task includes:

[0028] Determine the behavior type and operation object of the behavior to be evaluated;

[0029] Scan the simulation operation behavior evaluation table to determine whether there is a behavior evaluation condition that is consistent with the behavior type and operation object of the behavior to be evaluated;

[0030] If so, the behavior to be evaluated is a correct behavior or a prohibited behavior related to the simulation exercise task;

[0031] If it does not exist, the simulation exercise task is terminated.

[0032] In one possible implementation, analyzing the contradictory behavior of the behavior to be evaluated includes:

[0033] Scan the collection behavior record list corresponding to the simulation exercise task to determine whether there is an operation behavior that is consistent with the behavior type and operation object of the behavior to be evaluated;

[0034] If there is, it is determined that the contradictory behavior has occurred first, and the deduction value is deducted from the score of the behavior to be evaluated and the total score, and the next contradictory behavior is processed;

[0035] If not, the contradictory behavior has not occurred, and the next contradictory behavior will be processed;

[0036] After all the contradictory behaviors in the contradictory behavior list are processed, it is determined whether at least one contradictory behavior has occurred;

[0037] If yes, then the scoring process for the behavior to be evaluated ends;

[0038] If no conflicting behavior has occurred, proceed to the next step of scoring.

[0039] In one possible implementation, analyzing the guessed behavior of the behavior to be evaluated includes:

[0040] Scan the simulation operation behavior scoring table to determine whether there is a behavior evaluation condition that is consistent with the behavior type corresponding to the behavior to be evaluated and the nature of the behavior is not a prohibited behavior;

[0041] If it exists, read the operation behavior record list corresponding to the simulation exercise task, find out the first operation behavior that is consistent with the behavior to be evaluated, and the behavior type and operation object of the first operation behavior are consistent with those of the behavior to be evaluated;

[0042] Obtaining the operation behaviors between the first operation behavior and the behavior to be evaluated in the simulation exercise task, and determining the number of first behaviors with the same behavior type in the operation behaviors;

[0043] Based on the number of the behaviors, points are deducted for guessed behaviors in the behaviors to be evaluated.

[0044] In one possible implementation, if there is no behavior evaluation condition that has the same behavior type as the behavior to be evaluated and the behavior nature is not a prohibited behavior, then in the operation behavior record list, all operation behavior records before the behavior to be evaluated in the simulation exercise task are read;

[0045] Determine the number of second behaviors of the operation behaviors that are consistent with the behavior type of the behavior to be evaluated in all operation behavior records;

[0046] According to the number of the second behaviors, points are deducted for guessed behaviors in the behaviors to be evaluated.

[0047] Compared with the prior art, the technical solution provided by this application has the following beneficial effects:

[0048] The present application proposes a real-time comprehensive evaluation method for operation behavior, which can automatically collect the user's simulation exercise operation behavior during the three-dimensional simulation exercise, and make a comprehensive comparison with the evaluation condition template, and give the behavior score and the total score of the exercise activity in real time. This method improves the efficiency and accuracy of the evaluation, reduces the need for manual scoring and possible subjective bias. The present application designs a simulation operation behavior evaluation condition template containing multi-dimensional evaluation elements, which not only considers the correctness of the operation behavior, but also introduces evaluation dimensions such as timeliness and logic. Such a multi-dimensional evaluation can more comprehensively evaluate the standardization and safety of the operation behavior, and improve the comprehensiveness and accuracy of the evaluation. By introducing parameters such as dependent behavior lists, contradictory behavior lists, and equivalent behavior lists, the present application can evaluate the logical relationship between the operation behaviors. This can not only ensure that the order and dependency of the operation behavior are correctly handled, but also avoid repeated and contradictory operations, thereby improving the authenticity and effectiveness of the exercise. The present application proposes a simulation operation behavior scoring table structure with a sequential relationship, which can construct corresponding scoring tables for different types of simulation exercise tasks. This structured design makes the evaluation process more flexible and easy to manage and maintain. This application designs a simulation exercise collection behavior data format and proposes an automatic collection and preservation method. This automated data collection method ensures the accuracy and completeness of the data and provides a reliable basis for subsequent evaluation and analysis. The specific steps and methods for real-time comprehensive scoring of collected behaviors are elaborated in detail, including the analysis and processing of dependent behaviors, contradictory behaviors, equivalent behaviors, behavior duration, and guessed behaviors. These methods can ensure that each operation behavior is properly evaluated and improve the fairness and rationality of the scoring.

[0049] In summary, this application proposes a real-time comprehensive evaluation method for operational behavior, which can significantly improve the efficiency, comprehensiveness, accuracy and objectivity of operational behavior evaluation in three-dimensional simulation drills of communication operation and maintenance skills. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying any creative work.

[0051] Figure 1 A flowchart of an operational behavior evaluation method for three-dimensional simulation drills of communication operation and maintenance skills provided in Example 1 of the present application.

[0052] Figure 2 A flow chart of a method for scoring each newly collected behavior to be evaluated provided in Example 1 of the present application. DETAILED DESCRIPTION

[0053] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0054] To solve the above technical problems, the present application provides an operation behavior evaluation method for three-dimensional simulation drills of communication operation and maintenance skills. The method includes six steps: the first step is to design a simulation operation behavior evaluation condition template containing multi-dimensional evaluation elements, define the name, data type and meaning of each parameter, and design the structure of the scoring table based on the simulation operation behavior evaluation condition; the second step is to design the behavior data format used when collecting the user's simulation drill behavior, and the behavior data collected and stored according to the format will be used for subsequent comprehensive evaluation of the behavior; the third step is to construct a simulation operation behavior scoring table for different types of simulation drill tasks, and design its specific parameters for each simulation operation behavior evaluation condition in the table; the fourth step is to carry out a specific task drill through the three-dimensional simulation system of communication operation and maintenance operation skills, and automatically collect and save each operation behavior of the user during the drill; the fifth step is to combine the simulation operation behavior scoring table of the task, comprehensively analyze and evaluate the parameters of each newly collected behavior, and give the behavior score and the total score of the drill activity up to now in real time; finally, when the simulation drill task ends or terminates, the method also automatically completes the evaluation of all the generated operation behaviors and automatically gives the total score.

[0055] Through the above method, the user's simulation exercise operation behavior can be automatically collected during the 3D simulation exercise, and a comprehensive comparison can be made with the evaluation condition template to give the behavior score and the total score of the exercise activity in real time. This method improves the efficiency and accuracy of the evaluation, reduces the need for manual scoring and possible subjective bias.

[0056] Below, the technical solution provided by this application is further explained in conjunction with specific embodiments.

[0057] Embodiment 1

[0058] See also Figure 1 , which is a flow chart of an operation behavior evaluation method for three-dimensional simulation drills of communication operation and maintenance skills provided in Example 1 of the present application.

[0059] S1. Set the behavior evaluation conditions for the simulation operation, including predecessor dependent behavior, contradictory behavior, equivalent behavior, time limit, correct behavior and guessed behavior.

[0060] Specifically, in order to realize automatic real-time analysis and evaluation of the correctness and standardization of the user's operating behavior in the three-dimensional communication simulation system, the present application designs a template for simulation operating behavior evaluation conditions involving multiple factors.

[0061] The template consists of several parameters. The name, data type and meaning of each parameter are shown in Table 1:

[0062] Table 1 Parameters and descriptions included in the behavior evaluation condition template for simulation operation

[0063]

[0064]

[0065] Among them, parameters such as behavior type, operation object, and behavior nature provide support for determining the correctness of the behavior, time limit parameters provide support for determining the timeliness of the behavior, and parameters such as correct behavior bonus points and guessed behavior deduction points provide support for score calculation after the evaluation is completed.

[0066] In particular, the parameters such as the dependent behavior list, the contradictory behavior list, and the valid behavior list introduced in the template in this application provide support for determining the logical correctness of the operation behavior.

[0067] The dependent behavior list stores all the operation behaviors that must be completed before the current behavior occurs. If one of the behaviors has not yet occurred, it means that the condition on which the current behavior depends has not yet been established, and the current behavior occurs too early and no points should be added.

[0068] All operating behaviors that should not occur before the current behavior occurs are saved in the contradictory behavior list. If one of the behaviors has already occurred, it means that the current behavior is inconsistent with it and no points should be added.

[0069] All behaviors with the same operating effect as the current behavior are saved in the list of equivalent behaviors. If one of the behaviors has already occurred, it means that the current behavior is redundant and does not need to be repeated to add points.

[0070] S2. Construct scoring criteria for simulation drill operations.

[0071] Among them, the above-mentioned scoring criteria are determined based on the steps of the simulation exercise operation, the correct behavior in each step, the prohibited behavior, the correct / prohibited behavior and the logical relationship between the behavior evaluation conditions.

[0072] Specifically, the present application designs a simulation operation behavior scoring table, based on which a series of simulation operation behavior scoring standards with a sequential relationship can be set for each type of simulation exercise task, providing support for the comprehensive evaluation of all core key behaviors of a simulation exercise task, and its structure is shown in Table 2:

[0073] Table 2 Structure of the simulation operation behavior scoring table

[0074] Rating item number Evaluation conditions of simulation operation behavior Use Status 1 Condition 1 Not used (or used) 2 Condition 2 Not used (or used) 3 Condition 3 Not used (or used) … … …

[0075] The simulation operation behavior scoring table contains several rows, each of which includes a simulation operation behavior evaluation condition, as well as the corresponding serial number and usage status of the condition. The scoring item serial number indicates the order of the corresponding behavior evaluation condition in the entire scoring table, which is numbered sequentially from 1 and provides support for the timing correctness judgment of each simulation operation behavior. The usage status indicates whether the corresponding behavior evaluation condition has been used, that is, whether the behavior generated by a certain item has been evaluated.

[0076] S3. Collect the behaviors to be evaluated in the simulation exercise operation according to the preset behavior data format, and determine the leading dependent behaviors, contradictory behaviors and equivalent behaviors corresponding to the operation behaviors.

[0077] In order to collect and store the key parameters of the user's operation behavior generated during the simulation exercise. For example, the user selects a simulation exercise task in the communication operation and maintenance operation skills three-dimensional simulation exercise system, and the system automatically loads the exercise scene and scoring table corresponding to the task, and sets the total exercise score to 0. The user performs various operation and maintenance operations on different objects in the three-dimensional simulation scene, including roaming in the communication room, equipment inspection, daily maintenance of equipment boards and components, replacement of equipment boards and components, cable connection, auxiliary facility operation data inspection and component replacement, instrument tool use, etc.

[0078] After an operation occurs, the parameters of the behavior are automatically collected, and a collection behavior record is generated according to the simulation drill collection behavior data format requirements proposed in this application, and automatically saved in the collection behavior record list for automatic evaluation. This application proposes a simulation drill collection behavior data format in tuple form, as shown below:

[0079] (Collect behavior serial number, behavior type, operation object, occurrence time)

[0080] Each collected behavior data contains four parameters. The name, data type and meaning of each parameter are shown in Table 3:

[0081] Table 3 Parameters and descriptions of the behavior data collected during the simulation exercise

[0082]

[0083] This application targets the scenarios, content, objectives and requirements of different types of communication operation and maintenance operation skill simulation drill tasks, analyzes the key steps necessary for the task based on task instructions, operation specifications and other documents, and sorts out the correct operating behaviors in each step. Further analyze the logical relationship between each key correct operating behavior and other operating behaviors, determine the operating behaviors that need to be completed before the behavior occurs, contradictory operating behaviors, and operating behaviors with the same effect, and determine the bonus points after the correct behavior is determined and the deduction points after the guessed behavior is discovered. At the same time, analyze the operating behaviors that are strictly prohibited during the execution of the task based on documents such as safety regulations, and determine the order relationship between prohibited behaviors and other key correct operating behaviors.

[0084] For each key correct behavior and prohibited behavior sorted out, a simulation operation behavior evaluation condition is generated, and added to the simulation operation behavior scoring table in order. The <scoring item sequence number> parameters are numbered in sequence, and the <usage status> parameter value is set to "unused".

[0085] S4. Score the behavior to be evaluated according to the behavior evaluation conditions and scoring standards to obtain the evaluation results of the simulation exercise operation behavior.

[0086] For each newly collected behavior to be evaluated (assuming that the collected behavior serial number is N1), a comprehensive score will be given according to the method proposed in this application, and the score of the behavior and the total score up to now will be given in real time.

[0087] Specifically, see Figure 2 , is a flow chart of a method for scoring each newly collected behavior to be evaluated provided in Example 1 of the present application. Figure 2 As shown in , the specific implementation steps of the above method include:

[0088] S41. Set the score of this behavior to 0. Scan the simulation operation behavior scoring table corresponding to this simulation exercise task in order of scoring item numbers from low to high, and find the first simulation operation behavior evaluation condition that is consistent with the collection behavior to be evaluated (that is, the <behavior type> and <operation object> parameter values ​​are the same) and has not been used (that is, the <usage status> parameter value is "unused"). If no matching evaluation condition is found, it is determined that this behavior is not a key correct behavior or a prohibited behavior, and the processing ends; if it is found (set its scoring item number to N2), continue processing.

[0089] S42: Determine whether this behavior is a prohibited behavior (i.e., determine whether the value of the parameter <behavior nature> is "prohibited behavior"). If it is a prohibited behavior, directly set the total score to 0 and terminate this simulation exercise task. Otherwise, continue processing.

[0090] S43. Analyze whether all the preceding dependent behaviors of this behavior have occurred, and perform corresponding scoring.

[0091] Specifically, the <dependency behavior list> parameter of the simulation operation behavior evaluation condition is read, and the following processing is performed for each dependency behavior in the list:

[0092] Starting from (N1-1), scan the collection behavior record list corresponding to this simulation exercise task in descending order of the collection behavior sequence number, and find the collection behavior that is consistent with the dependent behavior (that is, the <behavior type> and <operation object> parameter values ​​are the same). If not found, it is determined that the dependent behavior has not occurred, and this operation behavior is invalid and not scored, and the real-time comprehensive scoring process for the newly collected behavior ends; if found, it means that the dependent behavior has occurred first, and the next dependent behavior is processed.

[0093] After all dependent behaviors in the dependent behavior list are processed, if they have all occurred, proceed to the next step.

[0094] S44. Analyze whether the behavior that contradicts the current behavior has occurred, and perform corresponding scoring.

[0095] Specifically, read the <contradictory behavior list> parameter of the simulation operation behavior evaluation condition, and perform the following operations for each contradictory behavior in the list:

[0096] Starting from (N1-1), scan the collection behavior record list corresponding to this simulation exercise task in descending order of the collection behavior sequence number, and find the collection behavior that is consistent with the contradictory behavior (that is, the <behavior type> and <operation object> parameter values ​​are the same). If found, it is determined that the contradictory behavior has occurred first, and the <deduction value> parameter value is deducted from the current behavior score and the total score, and the next contradictory behavior is processed; if not found, it is determined that the contradictory behavior has not occurred, and the next contradictory behavior is processed.

[0097] After all the contradictory behaviors in the contradictory behavior list are processed, it is further determined whether at least one contradictory behavior has occurred. If the determination is established, the real-time comprehensive scoring process for the newly collected behaviors is terminated; if the determination is not established, the next step of processing is continued.

[0098] S45. Analyze whether other behaviors with the same effect as the current behavior have already occurred, and perform corresponding scoring.

[0099] Specifically, read the <list of equivalent behaviors> parameter of the simulation operation behavior evaluation condition, and perform the following operations for each equivalent behavior in the list:

[0100] Starting from (N1-1), scan the collection behavior record list corresponding to this simulation exercise task in descending order of the collection behavior sequence number, and find the collection behavior that is consistent with the same effect behavior (that is, the <behavior type> and <operation object> parameter values ​​are the same). If found, it is determined that the same effect behavior has occurred first, that is, this behavior is useless and does not score, and the real-time comprehensive scoring process for the newly collected behavior ends; if not found, it is determined that the same effect behavior has not occurred, and the next same effect behavior is processed.

[0101] After all the same-effect behaviors in the list of same-effect behaviors have been processed, if none of them has occurred, proceed to the next step.

[0102] S46. Analyze whether the behavior has exceeded the time limit and perform corresponding scoring.

[0103] Specifically, the value of the <Occurrence time> parameter of the collected behavior data of this simulation exercise is read (set to T1). The value of the <Behavior type>, <Operation object> parameter and the value of the <Maximum time> parameter in the <Time limit> parameter of the simulation operation behavior evaluation condition are read (set to T).

[0104] Starting from (N1-1), scan the collection behavior record list corresponding to this simulation exercise task in order of the collection behavior serial number from high to low, and find the collection behavior that is consistent with the <behavior type> and <operation object> parameter values ​​in the <time limit> parameter. If found, read the <occurrence time> parameter value (set to T2) from the collection behavior data, and further determine whether (T1-T2) is greater than T. If it is greater, it means that the operation has timed out, and the real-time comprehensive scoring process for the newly collected behavior is terminated, and this behavior will not be scored. Otherwise, continue to the next step.

[0105] S47, adding the value of the parameter <Correct Behavior Bonus> to the current behavior score and the total score.

[0106] S48. Analyze whether there are any suspected behaviors similar to the current behavior, and perform corresponding scoring.

[0107] During the simulation exercise, it is common for users to try to operate multiple similar objects and guess the correct operation because they do not know which operation object is correct. If the above guessing behavior occurs, points should be deducted accordingly. This application proposes the following processing method for analyzing and determining guessing behavior and deducting points.

[0108] S481, starting from (N2-1), scan the simulation operation behavior scoring table in descending order of the scoring item number, and find the simulation operation behavior evaluation condition that is consistent with the evaluation condition type corresponding to the scoring item number N2 (i.e., the value of the <behavior type> parameter is the same, set to B1), is not a prohibited behavior (i.e., the value of the <behavior nature> parameter is not "prohibited behavior"), and has been used (i.e., the value of the <usage status> parameter is "used"). If found, read the value of the <scoring item number> parameter of the first evaluation condition found (set to N3), and jump to S482 for processing; if not found, jump to S484 for processing.

[0109] S482. Starting from (N1-1), scan the collection behavior record list corresponding to this simulation exercise task in order of collection behavior serial numbers from high to low, find the first collection behavior that is consistent with the behavior with scoring item serial number N3 (that is, the <behavior type> and <operation object> parameter values ​​are the same), and read the <collection behavior serial number> parameter value of the collection behavior data (set to N4).

[0110] S483, in the collection behavior record list, scan all the collection behavior records with the collection behavior serial number between (N4+1, N1-1), and count the number of behaviors with the same behavior type (that is, the value of the <behavior type> parameter is B1). The final counted number is recorded as C, and jump to S485 to continue processing.

[0111] S484, in the collection behavior record list, scan all the collection behavior records with the collection behavior serial number between (1, N1-1), and count the number of behaviors with the same behavior type (ie, the value of the <behavior type> parameter is B1). The final counted number is recorded as C, and jump to S485 to continue processing.

[0112] S485, read the parameter value of <Guessing Behavior Deduction> of the simulation operation behavior evaluation condition corresponding to the scoring item number N2 (set to X), and deduct points for all guessing behaviors from the total score, that is, subtract (C*X) from the total score.

[0113] S49. Set the value of the parameter "Usage Status" of the row with the scoring item number N2 in the simulation operation behavior scoring table to "used".

[0114] Compared with the prior art, the technical solution provided by this application has the following beneficial effects:

[0115] The present application proposes a real-time comprehensive evaluation method for three-dimensional simulation drills. The method collects the user's simulation drill operation behavior in real time and makes a comprehensive comparison with a simulation operation behavior scoring table containing multi-dimensional behavior evaluation elements, automatically giving a score for a certain behavior and the total score of the drill activity to date, thereby greatly improving the efficiency and objectivity of the simulation drill behavior evaluation.

[0116] A simulation operation behavior evaluation condition template containing multi-dimensional evaluation elements is designed, which defines the name, data type and meaning of each parameter in the template, and innovatively introduces logical evaluation elements of operation behavior such as dependent behavior list, contradictory behavior list and equivalent behavior list in the template. The introduction of the above logical evaluation elements makes the simulation exercise behavior evaluation more comprehensive and accurate, and can cover more evaluation factors.

[0117] A simulation operation behavior scoring table structure is designed, which contains multiple simulation operation behavior evaluation conditions with a sequential relationship, and a method of constructing corresponding behavior scoring tables for different types of simulation drill tasks is proposed, so that the scoring table structure is more flexible and can adapt to different types of simulation drill tasks.

[0118] The data format of simulation drill collection behavior is designed, the name, data type and meaning of the key parameters of the collection behavior are defined, and the automatic collection and storage method of simulation drill operation behavior is proposed, which provides detailed input data for the evaluation of operation behavior.

[0119] A method is proposed to determine whether all the behaviors that a simulation exercise operation behavior depends on have occurred first and to perform corresponding scoring. This solves the problem of how to determine and score the dependency relationship of operation behaviors and improves the accuracy of exercise evaluation.

[0120] A method is proposed to determine whether there are multiple behaviors that contradict a certain simulation exercise operation behavior and to make corresponding point deductions. This solves the problem of how to determine the contradiction between a certain behavior and certain previous behaviors and make scores, thereby improving the accuracy of exercise evaluation.

[0121] A method is proposed to determine whether there are other drill operation behaviors with the same effect as a certain simulation drill operation behavior and to perform corresponding scoring. This solves the problem of how to determine the duplication of effects between a certain behavior and certain previous behaviors and perform scoring, thereby improving the accuracy of drill evaluation.

[0122] A method is proposed to determine whether the time used between two simulation drill operation behaviors has exceeded the time limit and to make corresponding point deductions. This solves the problem of how to determine and score the timeliness of operation behaviors and improves the accuracy of drill evaluation.

[0123] A method is proposed to determine whether the user has performed similar but incorrect guessing operations before a certain simulation drill operation and to make corresponding point deductions. This solves the problem of how to determine and score guessing behaviors in the simulation drill process and improves the comprehensiveness and accuracy of drill evaluation.

[0124] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.

[0125] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0126] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments shown herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. An operation behavior evaluation method for three-dimensional simulation drills of communication operation and maintenance skills, characterized in that: The method comprises: S1. Set the behavior evaluation conditions of the simulation operation, including the leading dependent behavior, contradictory behavior, equivalent behavior, time limit, correct behavior and guessed behavior; S2. Construct the scoring criteria for the simulation drill operation, and the scoring criteria are determined based on the steps of the simulation drill operation, the correct behavior in each step, the prohibited behavior, the correct / prohibited behavior and the logical relationship between the behavior evaluation conditions; S3. Collect the behaviors to be evaluated in the simulation drill operation according to the preset behavior data format, and determine the leading dependent behavior, contradictory behavior and equivalent behavior corresponding to the operation behavior; S4. Score the behaviors to be evaluated according to the behavior evaluation conditions and scoring criteria, and obtain the evaluation results of the simulation drill operation behaviors.

2. According to claim 1, an operation behavior evaluation method for three-dimensional simulation drills of communication operation and maintenance skills is characterized in that: The behavior evaluation conditions for setting simulation operations in S1 also include: Based on different types of simulation drill tasks and behavior evaluation conditions, a simulation operation behavior evaluation table is constructed; The evaluation parameters of each behavior evaluation condition in the simulation operation behavior evaluation table are set, and the evaluation parameters include behavior type, operation object, and behavior nature; the behavior nature includes correct behavior and prohibited behavior.

3. The method for evaluating operation behavior for three-dimensional simulation drill of communication operation and maintenance skills according to claim 2 is characterized in that: The construction of the simulation operation behavior evaluation table includes: Determine the drill steps of the simulation drill task and the correct operation behavior in each drill step based on the scenario and drill content corresponding to the simulation drill task; Determine the logical relationship between each correct operation behavior, including the preceding dependent behaviors, contradictory behaviors, and equivalent behaviors that need to be completed before the correct operation behavior occurs, and determine the additional points after the correct behavior is determined and the deduction points after the guessed behavior is discovered.

4. The method for evaluating operation behavior for three-dimensional simulation drill of communication operation and maintenance skills according to claim 3 is characterized in that: The simulation operation behavior evaluation table also includes a dependent behavior list, a contradictory behavior list, an equivalent behavior list, a time limit, a correct behavior bonus table, and a guessing behavior deduction table; The dependent behavior list includes the leading dependent behavior that must be completed before the behavior to be evaluated occurs, the behavior type and operation object of the leading dependent behavior; The list of contradictory behaviors includes the contradictory behaviors that occurred before the behavior to be evaluated and are contradictory to the operation behavior, the behavior type, operation object and deduction value of the contradictory behavior; The time limit includes the maximum allowed interval between the behavior to be evaluated and the previous operation; The guessed behavior deduction table includes deduction values ​​for invalid behaviors that occurred before the behavior to be evaluated; the invalid behaviors have the same behavior type as the behavior to be evaluated but different operation objects.

5. The method for evaluating operation behavior for three-dimensional simulation drill of communication operation and maintenance skills according to claim 1 is characterized in that: In S3, the preset behavior data format is in the form of a tuple, including the collection behavior sequence number, behavior type, operation object, and occurrence time.

6. The method for evaluating operation behavior for three-dimensional simulation drill of communication operation and maintenance skills according to claim 2 is characterized in that: In S4, the behavior to be evaluated is scored according to the behavior evaluation conditions and scoring criteria, including: Scan the simulation operation behavior evaluation table corresponding to the simulation drill task to determine whether the behavior to be evaluated belongs to the drill step corresponding to the simulation drill task; If yes, then determine whether the behavior to be evaluated is a prohibited behavior; If the behavior to be evaluated is a prohibited behavior, terminating the simulation exercise task; If the behavior to be evaluated is not a prohibited behavior, the preceding dependent behavior, contradictory behavior, equivalent behavior, behavior time, correct behavior in the operation behavior, and guessed behavior corresponding to the behavior to be evaluated are analyzed in turn, and scored to obtain the evaluation result of the simulation exercise operation behavior.

7. The method for evaluating operation behavior for three-dimensional simulation drill of communication operation and maintenance skills according to claim 6 is characterized in that: Determining whether the behavior to be evaluated belongs to the exercise step corresponding to the simulation exercise task includes: Determine the behavior type and operation object of the behavior to be evaluated; Scan the simulation operation behavior evaluation table to determine whether there is a behavior evaluation condition that is consistent with the behavior type and operation object of the behavior to be evaluated; If so, the behavior to be evaluated is a correct behavior or a prohibited behavior related to the simulation exercise task; If it does not exist, the simulation exercise task is terminated.

8. The method for evaluating operation behavior for three-dimensional simulation drill of communication operation and maintenance skills according to claim 6 is characterized in that: Analyze the contradictory behaviors of the behavior to be evaluated, including: Scan the collection behavior record list corresponding to the simulation exercise task to determine whether there is an operation behavior that is consistent with the behavior type and operation object of the behavior to be evaluated; If there is, it is determined that the contradictory behavior has occurred first, and the deduction value is deducted from the score of the behavior to be evaluated and the total score, and the next contradictory behavior is processed; If not, the contradictory behavior has not occurred, and the next contradictory behavior will be processed; After all the contradictory behaviors in the contradictory behavior list are processed, it is determined whether at least one contradictory behavior has occurred; If yes, then the scoring process for the behavior to be evaluated ends; If no conflicting behavior has occurred, proceed to the next step of scoring.

9. The method for evaluating operation behavior for three-dimensional simulation drill of communication operation and maintenance skills according to claim 6 is characterized in that: Analyze the guessed behavior of the behavior to be evaluated, including Scan the simulation operation behavior scoring table to determine whether there is a behavior evaluation condition that is consistent with the behavior type corresponding to the behavior to be evaluated and the nature of the behavior is not a prohibited behavior; If it exists, read the operation behavior record list corresponding to the simulation exercise task, find out the first operation behavior that is consistent with the behavior to be evaluated, and the behavior type and operation object of the first operation behavior are consistent with those of the behavior to be evaluated; Obtaining the operation behaviors between the first operation behavior and the behavior to be evaluated in the simulation exercise task, and determining the number of first behaviors with the same behavior type in the operation behaviors; Based on the number of the behaviors, points are deducted for guessed behaviors in the behaviors to be evaluated.

10. The method for evaluating operation behavior for three-dimensional simulation drill of communication operation and maintenance skills according to claim 9, characterized in that: If there is no behavior evaluation condition that the behavior type is consistent with the behavior to be evaluated and the behavior nature is not a prohibited behavior, then read all the operation behavior records before the behavior to be evaluated in the simulation exercise task in the operation behavior record list; Determine the number of second behaviors of the operation behaviors that are consistent with the behavior type of the behavior to be evaluated in all operation behavior records; According to the number of the second behaviors, points are deducted for guessed behaviors in the behaviors to be evaluated.

Images