Online virtual psychological training scoring system and scoring method thereof

Abstract

The invention belongs to the technical field of virtual training analysis, and particularly relates to an online virtual psychological training scoring system and a scoring method thereof. Comprising a training simulation module, a simulation evaluation module, a database module, a wide area network module, a management end and a student end. The training simulation module comprises a simulation server and a simulation output unit; the simulation evaluation module comprises an identity management unit, an index management unit and an evaluation unit; the database module is used for providing data support and processing service for each resource of the system and generated data; the wide area network module is used for establishing contact between equipment in the system and the management end and the student end; the management end is used for establishing an interface and a control mechanism related to system configuration management and system monitoring; and the student end is used for establishing a simulation training and student interaction operation mechanism. The virtual psychological training system is used for online virtual psychological training, meets the requirements of vocational skill training of related posts and the like, and enables learners to be familiar with and master basic knowledge, basic processes and practical operation skills of psychological training.

Description

Technical Field

[0001] The present invention belongs to the technical field of virtual training analysis, and in particular relates to an online virtual psychological training scoring system and a scoring method thereof. Background Art

[0002] Online virtual psychological training is a technology that meets various psychological training or training tasks without the need for real-world training scenarios or equipment. It can effectively reduce the difficulty and risk of executing some psychological training content, and is one of the important methods in various stages of pre-employment training for various positions. Currently, common online virtual psychological training systems focus on the simulation and re-enactment of psychological training content, which can well meet the accuracy requirements of the scenarios. However, for some training content, not only is it necessary to simply confirm the results of the training project, but also to effectively collect various indicators and parameters during the training process to effectively observe the entire training process of the trainees, and conduct more scientific and effective evaluation and analysis of the trainees to further improve the effectiveness of virtual training. However, the current online virtual training methods are relatively simple and crude, and cannot meet the requirements of more refined and efficient system evaluation and processing. Summary of the Invention

[0003] The object of the present invention is to provide a system and method for evaluating and analyzing training items that can be used in various types of online virtual psychological training.

[0004] To achieve the above objectives, the present invention adopts the following technical solutions.

[0005] An online virtual psychological training scoring system includes a training simulation module, a simulation evaluation module, a database module, a wide area network module, a management terminal, and a student terminal;

[0006] The training simulation module includes a simulation server and a simulation output unit;

[0007] Simulation server: used to establish simulation models of the equipment and environmental systems required for each training item, ensuring that the static and dynamic simulation accuracy of equipment parameters meet the training item requirements;

[0008] The simulation output unit is used to establish a visual panel for the corresponding display area of ​​the device and output visual simulation information of various parameters of the device; establish dynamic operation attribute information related to multi-person collaborative training items and multi-person collaborative interaction channels;

[0009] The simulation evaluation module includes identity management unit, indicator management unit and evaluation unit;

[0010] The identity management unit is used to establish role-based access control, identity authentication, and authority management procedures, providing interactive functions for four elements: users, authorities, roles, and sessions;

[0011] The indicator management unit is used to establish a multi-level indicator library and rule library from training items to specific training indicators; establish weight factors for each level of indicators, determine the weight of each indicator based on the hierarchical analysis method, determine the importance scale value based on the relative importance of each indicator, and calculate the relative weight of each indicator and the weight of the bottom-level indicator relative to the highest level;

[0012] The evaluation unit is used to establish an evaluation system based on the indicator library and rule library, and determine the final score based on the indicator data of the training items;

[0013] Database module provides data support and processing services for various system resources and generated data;

[0014] WAN module, establishing connections between the devices in the system and the management and student ends;

[0015] The management side is used to establish interfaces and control mechanisms related to system configuration management and system monitoring;

[0016] The student side is used to establish a simulation training and student interaction mechanism.

[0017] A further improvement or preferred implementation of the aforementioned online virtual psychological training scoring system, wherein the training items include: cognitive ability training, emotion regulation ability training, willpower training, interpersonal communication training, team cohesion training, leadership training, and basic psychological training.

[0018] A further improvement or preferred implementation of the aforementioned online virtual psychological training scoring system, wherein the permission management includes at least the start-up, environment setting, and termination permissions of the assessment system controlled by the examiner or assessor; the support and operation of the assessment system controlled by the staff, the scenario editing, test question editing and management, user management, and software update permissions of the assessment system; the permission of the assessment subject to use the assessment system under the supervision of the examiner or assessor; and the permission of the assessment subject to set training tasks or subtasks according to the corresponding training items.

[0019] In a further improvement or preferred embodiment of the aforementioned online virtual psychological training scoring system, the roles include at least examiner, assessor, worker, and assessment subject.

[0020] This application also provides a scoring method for an online virtual psychological training scoring system, comprising the following steps:

[0021] Step 1: Establishing an element representation of a virtual training item. The establishment of an element representation of a virtual training item specifically refers to: establishing a training item element sequence consisting of multiple training item elements. ; Indicates the training elements, Refers to the total number of training item elements, which include at least: training item elements , training item analysis elements , training item condition elements , training item related elements ;

[0022] Step 2. Determine the characteristics of training items and establish an evaluation index system;

[0023] Based on data collection and analysis methods, obtain and collect structured or unstructured original feature data related to the indicator combinations within the aforementioned training elements, and build an indicator system based on the expert evaluation system;

[0024] The specific steps of constructing the indicator system include:

[0025] A1. Determine a basic indicator system for virtual training items based on the requirements of the virtual training evaluation function. The basic indicator system includes at least: training effectiveness, feasibility, and training cost.

[0026] A2. Determine the original evaluation indicators based on the contents of the basic indicator system;

[0027] Based on the aforementioned basic indicator system, original evaluation indicators are given according to the corresponding content of the training process;

[0028] Analyze and compare the meaning of the indicators, eliminate the repeated original evaluation indicators, and score them according to the relative scale between each original evaluation indicator to obtain the original evaluation indicators. Relative to The relative importance of ;

[0029] Establish a judgment matrix between any two original evaluation indicators , calculate the eigenvector of the judgment matrix , multiply each row of the judgment matrix and open To the power, we get the square root vector , where n is the order of the judgment matrix; the square root vector is normalized to further obtain the relative importance weight of the same level indicator relative to a certain indicator of the previous level ; then the maximum eigenvalue can be expressed as ;

[0030] Perform consistency analysis on the judgment matrix. If the consistency , then adjust the judgment matrix until , calculate the consistency ratio ;

[0031] The established judgment matrix is ​​used to obtain the single ranking weight of each layer of indicators, calculate the relative importance of each layer of indicators relative to the overall goal, and use the product method to calculate the combined weight to further obtain the total weight of each upper layer indicator. Several original evaluation indicators with smaller weights are eliminated, and all indicators in the indicator system are combined to obtain the indicator set. , It refers to the evaluation indicators, It refers to the total number of evaluation indicators;

[0032] For the indicator set Analyze the elements in the data to determine the value attributes of each indicator. For quantitative indicators, use expert scoring and data statistics to determine the specific score or range score of each indicator based on historical experience data. For qualitative indicators, use the hierarchical analysis method to determine the attribute factors corresponding to the indicators, assign scores to the attribute factors, and determine the final score value of the qualitative indicators.

[0033] Collect the scoring assignments of all indicators and establish a scoring set based on the evaluation rules of the evaluation system ;in Refers to the first Reviews, Refers to the total number of reviews;

[0034] Step 3. Collect the evaluation indicators obtained by the online virtual psychological training scoring system and determine the final score through the scoring system and scoring method.

[0035] Further improvement or optimal implementation steps for the scoring method of the aforementioned online virtual psychological training scoring system, wherein the training item elements refer to a combination of several indicators used to represent the training objectives to be achieved by the training items; the training item analysis elements refer to a combination of several indicators used to analyze and confirm the training effects of the training items; the training item condition elements refer to a combination of several basic conditions required for executing the training items; and the training item association elements refer to a combination of dependencies between the execution of a certain training item and other training items;

[0036] The indicator combination refers to a combination of one or more value indicators, utility indicators, preference indicators, and technical indicators associated with the training items; the basic condition combination refers to a combination of one or more hardware requirement indicators, software requirement indicators, and system function requirement indicators required for the execution and information collection of the training items; the dependency relationship combination refers to one or more direct or indirect dependencies with a certain training item.

[0037] Further improvement or optimal implementation steps of the scoring method of the aforementioned online virtual psychological training scoring system. The original evaluation indicators used to characterize the effectiveness of training mainly include: training success rate, success rate ratio, and training completion rate within the standard time; the original evaluation indicators used to characterize the executability mainly include: average training time, repeatable execution index, and training pass rate; the original evaluation indicators used to characterize the training cost mainly include: resource occupancy rate, effective resource utilization rate, and training time. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] Figure 1 It is a schematic diagram of the online virtual mental training scoring system;

[0039] Figure 2 It is a flowchart of the online virtual psychological training scoring method. DETAILED DESCRIPTION

[0040] The present invention is described in detail below with reference to specific embodiments.

[0041] The present invention relates to an online virtual psychological training scoring system, which is used for online virtual psychological training to meet the needs of vocational skills training in related positions. By using virtual reality technology, users can perceive and operate various stimuli and moving objects in the virtual world in a virtual scene, and achieve real-time interaction with the virtual space, so as to enable learners to become familiar with and master the basic knowledge, basic processes and practical skills of psychological training, so as to improve their psychological quality and master psychological training skills.

[0042] The online virtual psychological training scoring system of the present invention is composed of the following components: Figure 1 As shown, it includes training simulation module, simulation evaluation module, database module, wide area network module, management terminal and student terminal;

[0043] The training simulation module consists of a simulation server and a simulation output unit;

[0044] The simulation server is used to establish simulation models of the equipment and environmental systems required for each training item, ensuring that the static and dynamic simulation accuracy of the equipment parameters meets the training item requirements;

[0045] The simulation output unit is used to establish a visualization panel for the corresponding display area of ​​the device and visualize the simulation information output of various parameters of the device; establish dynamic operation attribute information related to multi-person collaborative training items and multi-person collaborative interaction channels; the training items include: cognitive ability training, emotion regulation ability training, willpower training, interpersonal communication training, team cohesion training, leadership training, and basic psychological training;

[0046] The simulation evaluation module includes identity management unit, indicator management unit and evaluation unit;

[0047] The identity management unit is used to establish role-based access control, identity authentication, and authority management procedures, providing interactive functions for four elements: users, authorities, roles, and sessions;

[0048] The roles include at least examiner, assessor, worker, assessment subject, etc.;

[0049] To meet the basic requirements of system evaluation, the authority management shall include at least the following aspects:

[0050] The examiner or assessor is responsible for the authority to start, set up the environment, and end the assessment system;

[0051] The staff is responsible for supporting and operating the assessment system, including editing scenarios, editing and managing test questions, user management, and software updates.

[0052] The right to use the assessment system by the assessee under the supervision of the examiner or assessor;

[0053] The assessment subject sets the authority of the training task or subtask according to the corresponding training item;

[0054] The indicator management unit is used to establish a multi-level indicator library and rule library from training items to specific training indicators; establish weight factors for each level of indicators, determine the weight of each indicator based on the hierarchical analysis method, determine the importance scale value based on the relative importance of each indicator, and calculate the relative weight of each indicator and the weight of the bottom-level indicator relative to the highest level;

[0055] The evaluation unit is used to establish an evaluation system based on the indicator library and rule library, and determine the final score based on the indicator data of the training items;

[0056] Database module provides data support and processing services for various system resources and generated data;

[0057] WAN module, establishing connections between the devices in the system and the management and student ends;

[0058] The management side is used to establish interfaces and control mechanisms related to system configuration management and system monitoring;

[0059] The student side is used to establish a simulation training and student interaction mechanism;

[0060] The online virtual psychological training scoring system of this application implements the scoring operation based on the following method, and the specific steps are as follows:

[0061] Step 1: Establishing an element representation of a virtual training item. The establishment of an element representation of a virtual training item specifically refers to: establishing a training item element sequence consisting of multiple training item elements. ; Indicates the training elements, Refers to the total number of training item elements, which include at least: training item elements , training item analysis elements , training item condition elements , training item related elements ; Training item elements refer to a combination of several indicators used to represent the training objectives that need to be achieved by the training items; the training item analysis elements refer to a combination of several indicators used to analyze and confirm the training effects of the training items; the training item condition elements refer to a combination of several basic conditions required for executing the training items; the training item association elements refer to a combination of the dependencies of executing a certain training item on other training items;

[0062] The indicator combination refers to a combination of one or more value indicators, utility indicators, preference indicators, and technical indicators associated with the training item; the basic condition combination refers to a combination of one or more hardware requirement indicators, software requirement indicators, and system function requirement indicators required for the execution and information collection of the training item; the dependency relationship combination refers to one or more direct or indirect dependency relationships with a certain training item;

[0063] Step 2. Determine the characteristics of training items and establish an evaluation index system;

[0064] Based on data collection and analysis methods, obtain and collect structured or unstructured original feature data related to the indicator combinations within the aforementioned training elements, and build an indicator system based on the expert evaluation system;

[0065] The specific steps of constructing the indicator system include:

[0066] A1. Determine a basic indicator system for virtual training items based on the requirements of the virtual training evaluation function. The basic indicator system includes at least: training effectiveness, feasibility, and training cost.

[0067] A2. Determine the original evaluation indicators based on the contents of the basic indicator system;

[0068] Based on the aforementioned basic indicator system, original evaluation indicators are given according to the corresponding content of the training process;

[0069] In actual analysis, commonly used original evaluation indicators for characterizing training effectiveness include: training success rate, success rate percentage, training completion rate within standard time, etc.; original evaluation indicators for characterizing executability include: average training time, repeatable execution index, training pass rate, etc.; original evaluation indicators for characterizing training cost include: resource occupancy rate, effective resource utilization rate, training time, etc.; each original evaluation indicator may contain one or more secondary indicators, as shown in Table 1:

[0070] Table 1 Schematic diagram of the initial evaluation index system for virtual training

[0071]

[0072] Original evaluation indicators often involve a large number of evaluation parameters, including indicators with similar or even identical attributes. It is necessary to optimize the original evaluation indicators obtained, eliminate the original evaluation indicators that are obviously similar or repeated by analyzing and comparing the meaning of the indicators, and score them according to the relative scale between the original evaluation indicators to obtain the original evaluation indicators. Relative to The relative importance of ;

[0073] Establish a judgment matrix between any two original evaluation indicators , calculate the eigenvector of the judgment matrix , multiply each row of the judgment matrix and open To the power, we get the square root vector , where n is the order of the judgment matrix; the square root vector is normalized to further obtain the relative importance weight of the same level indicator relative to a certain indicator of the previous level ; then the maximum eigenvalue can be expressed as ;

[0074] Perform consistency analysis on the judgment matrix. If the consistency , then adjust the judgment matrix until , calculate the consistency ratio ;

[0075] The established judgment matrix is ​​used to obtain the single ranking weight of each layer of indicators, calculate the relative importance of each layer of indicators relative to the overall goal, and use the product method to calculate the combined weight to further obtain the total weight of each upper layer indicator. Several original evaluation indicators with smaller weights are eliminated, and all indicators in the indicator system are combined to obtain the indicator set. , It refers to the evaluation indicators, It refers to the total number of evaluation indicators;

[0076] For the indicator set Analyze the elements in the data to determine the value attributes of each indicator. For quantitative indicators, use expert scoring and data statistics to determine the specific score or range score of each indicator based on historical experience data. For qualitative indicators, use the hierarchical analysis method to determine the attribute factors corresponding to the indicators, assign scores to the attribute factors, and determine the final score value of the qualitative indicators.

[0077] Collect the scoring assignments of all indicators and establish a scoring set based on the evaluation rules of the evaluation system ;in Refers to the first Reviews, Refers to the total number of reviews;

[0078] Step 3. Collect the evaluation indicators obtained by the online virtual psychological training scoring system and determine the final score through the scoring system and scoring method.

[0079] Taking a certain psychological virtual training system as an example, as shown in Table 2, the basic training items and goals of the psychological virtual training system are shown in the table.

[0080] Table 2

[0081]

[0082] Based on the training purpose of the virtual psychological training system and the professional evaluation standards of the corresponding training items, each training item can be decomposed based on training goals, training tasks, training elements, etc., and a psychological training system database can be constructed, including a psychological training rule base, a psychological training knowledge base, and a psychological training condition base. The various knowledge, rules, and conditions contained in the rule base, knowledge base, and condition base need to be generated based on the logical relationship of the training items. For the expert evaluation system, questionnaires and voting are generally used to obtain expert experience data from the corresponding expert database. Then, the expert evaluation system is used to generate the psychological training system database corresponding to the corresponding expert evaluation system, and the corresponding relationship between the corresponding training item status, scoring indicators, and evaluation rules is established. After classification and extraction, a virtual psychological training system expert evaluation system consisting of multiple evaluation rule items is generated. Each evaluation item contains several scoring indicators and evaluation rules.

[0083] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit the scope of protection of the present invention. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solutions of the present invention may be modified or replaced by equivalents without departing from the essence and scope of the technical solutions of the present invention.

Claims

1. An online virtual psychological training scoring system, characterized in that: It includes training simulation module, simulation evaluation module, database module, wide area network module, management terminal and student terminal; The training simulation module includes a simulation server and a simulation output unit; Simulation server: used to establish simulation models of the equipment and environmental systems required for each training item, ensuring that the static and dynamic simulation accuracy of equipment parameters meets the training item requirements; The simulation output unit is used to establish a visual panel for the corresponding display area of ​​the device and output visual simulation information of various parameters of the device; establish dynamic operation attribute information related to multi-person collaborative training items and multi-person collaborative interaction channels; The simulation evaluation module includes identity management unit, indicator management unit and evaluation unit; The identity management unit is used to establish role-based access control, identity authentication, and authority management procedures, providing interactive functions for four elements: users, authorities, roles, and sessions; The indicator management unit is used to establish a multi-level indicator library and rule library from training items to specific training indicators; establish weight factors for indicators at all levels, determine the weight of each indicator based on the hierarchical analysis method, determine the importance scale value based on the relative importance of the indicators, and obtain the relative weight of each indicator and the weight of the bottom indicator relative to the highest level; The evaluation unit is used to establish an evaluation system based on the indicator library and rule library, and determine the final score based on the indicator data of the training items; Database module provides data support and processing services for various system resources and generated data; WAN module, establishing connections between the devices in the system and the management and student ends; The management side is used to establish interfaces and control mechanisms related to system configuration management and system monitoring; The student side is used to establish a simulation training and student interaction mechanism.

2. The online virtual psychological training scoring system according to claim 1, characterized in that: The training items include: cognitive ability training, emotion regulation ability training, willpower training, interpersonal communication training, team cohesion training, leadership training, and basic psychological training.

3. The online virtual psychological training scoring system according to claim 1, characterized in that: The authority management includes at least the start-up, environment setting, and termination permissions of the evaluation system, which are controlled by the examiner or evaluator; the support and operation of the evaluation system, the scenario editing, test question editing and management, user management, and software update permissions of the evaluation system, which are controlled by the staff; the permission of the evaluation subject to use the evaluation system under the supervision of the examiner or evaluator; and the permission of the evaluation subject to set training tasks or subtasks according to the corresponding training items.

4. The online virtual psychological training scoring system according to claim 1, characterized in that: The roles include at least examiner, evaluator, worker, and evaluation object.

5. The scoring method according to the online virtual psychological training scoring system of claim 1, characterized in that: Includes the following steps Step 1: Establishing an element representation of a virtual training item. The establishment of an element representation of a virtual training item specifically refers to: establishing a training item element sequence consisting of multiple training item elements. ; Indicates the training elements, Refers to the total number of training item elements, which include at least: training item elements , training item analysis elements , training item condition elements , training item related elements ; Step 2. Determine the characteristics of training items and establish an evaluation index system; Based on data collection and analysis methods, obtain and collect structured or unstructured original feature data related to the indicator combinations within the aforementioned training elements, and build an indicator system based on the expert evaluation system; The specific steps of constructing the indicator system include: A1. Determine a basic indicator system for virtual training items based on the requirements of the virtual training evaluation function. The basic indicator system includes at least: training effectiveness, feasibility, and training cost. A2. Determine the original evaluation indicators based on the contents of the basic indicator system; Based on the aforementioned basic indicator system, original evaluation indicators are given according to the corresponding content of the training process; Analyze and compare the meaning of the indicators, eliminate the repeated original evaluation indicators, and score them according to the relative scale between each original evaluation indicator to obtain the original evaluation indicators. Relative to The relative importance of ; Establish a judgment matrix between any two original evaluation indicators , calculate the eigenvector of the judgment matrix , multiply each row of the judgment matrix and open To the power, we get the square root vector , where n is the order of the judgment matrix; the square root vector is normalized to further obtain the relative importance weight of the same level indicator relative to a certain indicator of the previous level ; then the maximum eigenvalue can be expressed as ; Perform consistency analysis on the judgment matrix. If the consistency , then adjust the judgment matrix until , calculate the consistency ratio ; The established judgment matrix is ​​used to obtain the single ranking weight of each layer of indicators, calculate the relative importance of each layer of indicators relative to the overall goal, and use the product method to calculate the combined weight to further obtain the total weight of each upper layer indicator. Several original evaluation indicators with smaller weights are eliminated, and all indicators in the indicator system are combined to obtain the indicator set. , It refers to the evaluation indicators, It refers to the total number of evaluation indicators; For the indicator set Analyze the elements in the data to determine the value attributes of each indicator. For quantitative indicators, use expert scoring and data statistics to determine the specific score or range score of each indicator based on historical experience data. For qualitative indicators, use the hierarchical analysis method to determine the attribute factors corresponding to the indicators, assign scores to the attribute factors, and determine the final score value of the qualitative indicators. Collect the scoring assignments of all indicators and establish a scoring set based on the evaluation rules of the evaluation system ;in Refers to the first Reviews, Refers to the total number of reviews; Step 3. Collect the evaluation indicators obtained by the online virtual psychological training scoring system and determine the final score through the scoring system and scoring method.

6. The scoring method of the online virtual psychological training scoring system according to claim 5, characterized in that: The training item elements refer to a combination of several indicators used to represent the training objectives that need to be achieved by the training items; the training item analysis elements refer to a combination of several indicators used to analyze and confirm the training effects of the training items; the training item condition elements refer to a combination of several basic conditions required for executing the training items; and the training item association elements refer to a combination of dependencies between the execution of a certain training item and other training items; The indicator combination refers to a combination of one or more value indicators, utility indicators, preference indicators, and technical indicators associated with the training items; the basic condition combination refers to a combination of one or more hardware requirement indicators, software requirement indicators, and system function requirement indicators required for the execution and information collection of the training items; the dependency relationship combination refers to one or more direct or indirect dependencies with a certain training item.

7. The scoring method of the online virtual psychological training scoring system according to claim 5, characterized in that: The original evaluation indicators used to characterize the effectiveness of training mainly include: training success rate, success rate ratio, and training completion rate within the standard time; the original evaluation indicators used to characterize the executability mainly include: average training time, repeatable execution index, and training pass rate; the original evaluation indicators used to characterize the training cost mainly include: resource occupancy rate, effective resource utilization rate, and training time.

Images