A capability assessment method, apparatus, server, and storage medium under the T&EE model.

Abstract

This invention relates to a competency assessment method, apparatus, server, and storage medium under a T&EE (Test and Answer) model. The method includes: in T&EE mode, responding to configuration commands input by administrators, configuring assessment items and a simulation environment to provide a question-answering environment for participants; the assessment items have three levels: solutions, tasks, and skill points; based on preset assessment standards, real-time scoring and data statistics are performed on the received answer data, and the statistical results are visualized and updated. The technical solution provided by this invention offers a standardized three-layer architecture of solutions-tasks-skill points, supporting customized changes according to assessment needs, accurately adapting to the competency assessment needs of different industries or positions, balancing the universality of the standardized architecture with the relevance of the content, improving scenario adaptation efficiency, and reducing scenario adaptation costs.

Description

Technical Field

[0001] This invention relates to the field of network security, and in particular to a capability assessment method, apparatus, server, and storage medium under the T&EE model. Background Technology

[0002] In the field of cybersecurity, the required skills for different positions are usually different. However, when assessing talent skills, a uniform standard is usually used to assess the skills of talents in different positions. The assessment results are limited, making it difficult to reflect the differences in the skill structure of different positions and failing to meet the skill assessment needs in different scenarios. Summary of the Invention

[0003] In view of the above problems, embodiments of the present invention provide a capability assessment method, apparatus, server and storage medium under the T&EE model to form a flexible assessment simulation environment, thereby solving the problem that the existing technology uses a uniform standard to assess the capabilities of talents in different positions, which makes it difficult to reflect the differences in capability structure between different positions.

[0004] In a first aspect, embodiments of the present invention provide a capability assessment method under a T&EE (Telecommunications and Equipment Exemption) model, the method comprising: In T&EE mode, in response to configuration commands input by administrators, the evaluation items and simulation environment are configured to provide participants with a question-answering environment; the evaluation items have three levels: scheme, task, and skill point; Based on preset evaluation criteria, the received answer data is scored and statistically analyzed in real time, and the statistical results are visualized and updated.

[0005] In one possible implementation, after configuring the evaluation project and simulation environment in response to configuration instructions input by the administrator, the method further includes: In response to configuration change commands input by administrators, customize at least one of the following: change scheme, task, skill point, evaluation criteria, and simulation environment.

[0006] In one possible implementation, the simulation environment type includes Docker containers, AWD scenarios, and target range environments; after configuring the evaluation project and simulation environment in response to configuration commands input by the administrator, the implementation further includes: Based on the received simulation environment acquisition instruction, a simulation environment of the corresponding type is issued; the simulation environment acquisition instruction carries the simulation environment type. If multiple simulation environment acquisition commands are received simultaneously, the corresponding simulation environment type will be sent out synchronously.

[0007] In one possible implementation, the skill points are theoretical skill points or practical skill points; The real-time scoring and data statistics of the answer data based on preset evaluation criteria include: Based on the evaluation criteria, determine whether the answer data is correct; For theoretical skills questions, a fixed score is awarded if the answer is correct; no score is awarded if the answer is incorrect. For practical skills questions, if the answer is correct, a corresponding dynamic score will be awarded; if the answer is incorrect, no score will be awarded. The dynamic score decreases as the duration of the quiz or the number of individuals / teams scoring increases.

[0008] In one possible implementation, the visualization and updating of statistical results includes: A skill tree is established with the plan as the first-level node, the task as the second-level node, and the skill point as the third-level node. By assigning different display effects to nodes, we can represent the different states of the nodes; When the state of a node changes, the node's display should be updated accordingly.

[0009] In one possible implementation, the method further includes: Upon receiving new access information, the source of the access information is verified based on the stored personnel management information; If the access information comes from a participant, then grant them participation privileges. If the access information comes from the evaluator, then grant them evaluation privileges. If the access information comes from someone other than the participants and evaluators, then grant them guest access.

[0010] Secondly, embodiments of the present invention provide a capability assessment device under the T&EE mode, the device comprising: The configuration module, in T&EE mode, responds to configuration commands input by administrators to configure the evaluation items and simulation environment, providing a question-answering environment for participants; the evaluation items have three levels: scheme, task, and skill point; The evaluation module is used to score and statistically analyze the received answer data in real time based on preset evaluation criteria, and to visualize and update the statistical results.

[0011] In one possible implementation, the device further includes: The modification module is used to respond to configuration change commands input by administrators and customize at least one of the following: change scheme, task, skill point, evaluation criteria, and simulation environment.

[0012] Thirdly, embodiments of the present invention provide a server, the server including one or more processors; a memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions that, when executed by the server, cause the server to perform a capability assessment method under the T&EE mode as described in the first aspect or any possible implementation of the first aspect.

[0013] Fourthly, embodiments of the present invention provide a computer-readable storage medium comprising a stored program, wherein, when the program is executed, it controls the device on which the computer-readable storage medium is located to perform a capability assessment method under the T&EE mode as described in the first aspect or any possible implementation thereof.

[0014] In the technical solution provided by the embodiments of the present invention, a three-layer standardized architecture of solution-task-skill point is provided in the resource configuration process of the simulation environment formed on demand. It supports custom changes according to the evaluation requirements, and can form a flexible evaluation simulation environment that accurately adapts to the personnel ability evaluation needs of different industries or positions. It takes into account the universality of the standardized architecture and the relevance of the content, improves the efficiency of scene adaptation, and reduces the cost of scene adaptation. Attached Figure Description

[0015] Figure 1 This is a flowchart illustrating a capability assessment method under the T&EE model provided in an embodiment of the present invention.

[0016] Figure 2 This is a schematic diagram of a data statistics page provided in an embodiment of the present invention.

[0017] Figure 3 This is a schematic diagram of an answer page provided in an embodiment of the present invention.

[0018] Figure 4 This is a schematic diagram of a task details page provided in an embodiment of the present invention.

[0019] Figure 5 This is a schematic diagram of a capability assessment device under the T&EE mode provided in an embodiment of the present invention.

[0020] Figure 6 This is a schematic diagram of a server provided in an embodiment of the present invention. Detailed Implementation

[0021] To further illustrate the technical means and effects of the present invention in achieving its intended purpose, the following detailed description of the specific implementation methods, structures, features and effects of the present invention, in conjunction with the accompanying drawings and preferred embodiments, is provided below.

[0022] Figure 1 This is a flowchart illustrating a capability assessment method under the T&EE model provided in an embodiment of the present invention, as shown below. Figure 1 As shown, the method includes: Step 101: In T&EE mode, in response to the configuration instructions input by the administrator, configure the evaluation project and simulation environment to provide the participants with a question-answering environment. The evaluation project has three levels: solution, task and skill point.

[0023] In this embodiment of the invention, each step is executed by a server, which has a management backend deployed on it.

[0024] The Test & Evaluation & Evolution (T&EE) model employs a three-tiered architecture of solutions, tasks, and skill points to assess participants' practical abilities in real-world business scenarios. The assessment projects consist of three levels: solutions, tasks, and skill points. Each solution includes multiple tasks, and each task includes multiple skill points. By breaking down solutions into multiple tasks and each task into multiple skill points, the composition of abilities is reflected, enhancing the scientific rigor and comprehensiveness of talent assessment.

[0025] In this embodiment of the invention, when configuring a scheme, administrators need to configure the scheme name, scheme description, scheme attributes, and scheme content. The scheme description is an overview of the core content of the scheme; the scheme attributes are theoretical or practical; and the scheme content is a detailed description of the scheme, limited to 500 characters. Rich text editing functions are supported during configuration, such as bolding, italics, font color settings, background color settings, line breaks, and numbering. When configuring a task, the task name, task description, and number of associated skill points need to be configured. When configuring skill points, the skill point name, skill point attributes, score type, and associated topology nodes need to be configured. By default, no topology nodes are associated; when topology node association is required, the node distribution can be viewed to complete the association. Skill point attributes include penetration testing, Attack With Defense (AWD), data algorithms, and regular CTF challenges; the score type is fixed score or dynamic score.

[0026] In this embodiment of the invention, the skill points are either theoretical or practical. Based on the evaluation criteria, the correctness of the answer data is determined. For theoretical skill points, if the answer is correct, a fixed score is obtained; if the answer is incorrect, no score is obtained. For practical skill points, if the answer is correct, a dynamic score is obtained; if the answer is incorrect, no score is obtained. The dynamic score decreases as the answering time or the number of scoring individuals / teams increases.

[0027] For example, the initial score for practical skills is 10 points. When the number of scorers / teams is 5 or less, the dynamic score is 10 points; when the number of scorers / teams is between 6 and 10, the dynamic score is 9 points; when the number of scorers / teams is between 11 and 15, the dynamic score is 8 points; and so on.

[0028] For example, the initial score for practical skills is 10 points. If the answering time is within 5 minutes, the dynamic score is 10 points; if the answering time is within 10 minutes, the dynamic score is 9 points; if the answering time is within 15 minutes, the dynamic score is 8 points; and so on.

[0029] In this embodiment of the invention, in response to configuration change commands input by administrators, at least one of the following can be customized: scheme, task, skill point, evaluation criteria, and simulation environment, to quickly adapt to different application scenarios. Based on a three-layer standardized architecture of scheme-task-skill point, the scheme content, task content, skill point content, and various parameters in the simulation environment can be flexibly adjusted according to evaluation needs. This provides a flexible answering environment to accurately match the personnel competency assessment needs of different industries or positions, balancing the universality of the standardized architecture with the relevance of the content, improving scenario adaptation efficiency, and reducing scenario adaptation costs.

[0030] In this embodiment of the invention, the simulation environment types include Docker containers, AWD scenarios, and target range environments. Docker containers focus on lightweight, standardized simulation; AWD scenarios focus on realistic attack and defense simulation; and target range environments focus on comprehensive scenario simulation. For Docker containers, the system provides functions for creating, deploying, and reclaiming Docker containers, limiting the number of Docker containers deployed by an individual to avoid excessive resource consumption and adapting to the operational needs of different skill levels. For AWD scenarios, the system supports scenario configuration, vulnerability implantation, and real-time status monitoring of attack and defense behaviors to meet the evaluation needs of attack and defense skills. For target range environments, the system configures realistic target range scenarios and associates topology nodes to provide environmental support for practical tasks such as vulnerability scanning and attack simulation.

[0031] In this embodiment of the invention, a simulation environment acquisition button is provided on the participant's answer page. When a participant clicks the simulation environment acquisition button, a simulation environment acquisition command is generated and sent to the management backend. The management backend issues the corresponding type of simulation environment based on the received simulation environment acquisition command; if multiple simulation environment acquisition commands are received simultaneously, the corresponding type of simulation environment is issued synchronously to achieve synchronous issuance and operation of different simulation environments, which has excellent compatibility.

[0032] In this embodiment of the invention, the management backend stores personnel management information to manage participants and evaluators. This includes, for example, adding, removing, and editing personnel. When the management backend receives new access information, it verifies the source of the access information based on the personnel management information. If the access information originates from a participant, participation privileges are granted; if it originates from an evaluator, evaluation privileges are granted; and if it originates from someone other than a participant or evaluator, visitor privileges are granted. Participants, evaluators, and visitors have different access permissions, and their front-end interfaces differ. Visitors cannot participate in answering questions or scoring; they can only view basic information, such as leaderboard information for each participant / team. Furthermore, the management backend also stores competition rules information, including participation methods, individual / team base scores, and individual / team participation restrictions.

[0033] In this embodiment of the invention, the management backend supports announcement publishing and message push functions. Different push methods are selected based on the importance of the announcement. For example, for important announcements, a pop-up is pushed to all participants, who must manually close it. For ordinary announcements, they are displayed in the homepage announcement section, requiring participants to actively view them. Real-time information such as task updates and scoring results is pushed to participants.

[0034] Step 102: Based on the preset evaluation criteria, score and statistically analyze the received answer data in real time, and visualize and update the statistical results.

[0035] In this step, participants can submit their answers in various formats, such as text or attachments. If the same answer is scored multiple times, only one score will be valid.

[0036] For theoretical skills, automatic verification generates automatic scores. For practical skills, assessors generate manual scores based on evaluation criteria; alternatively, automatic verification (such as flag submission verification and document checking) and manual evaluation are combined, and a weighted average of the automatic and manual scores is calculated to obtain a comprehensive score. When scoring, assessors evaluate the answers from multiple dimensions, including technical approach, solution completeness, and practical effectiveness, to improve the scientific rigor and accuracy of the evaluation. After scoring, the score details for each skill point are recorded; a blank value is displayed when no score is received, and the specific score is displayed when a score is received. Furthermore, the scores for multiple skill points in the task are totaled to obtain the task score; the scores for multiple tasks in the solution are totaled to obtain the solution score, thus providing a clear understanding of strengths and weaknesses.

[0037] Figure 2 This is a schematic diagram of a data statistics page provided in an embodiment of the present invention, such as... Figure 2As shown, the upper left corner of the data statistics page displays the number of valid submissions (number of valid score submissions) and the accuracy rate (ratio of valid score submissions to the total number of submissions). The lower left corner displays data related to solutions, tasks, and skills points, categorized by level. Solution-related data includes the solution name and task completion rate. The task completion rate is calculated as: (Number of completed skills points / Total number of skills points in the current solution) * Proportion of skills points, where the proportion of skills points represents the ratio of the total number of skills points in the current solution to the total number of skills points. Task-related data includes the task name, the number of associated skills points, the number of individuals / teams who have submitted answers, and the accuracy rate. Skill point-related data includes the number of individuals / teams who have submitted answers and the number of individuals / teams with valid scores. The bottom of the data statistics page displays the number of submissions, the number of valid submissions, and the success rate for each solution.

[0038] like Figure 2 As shown, the data statistics page displays a global visualization of skill point completion status in the middle via a skill tree. Alternatively, it displays a global visualization of topology nodes via a topology map. A toggle button is provided on the page to switch between the topology map and the skill tree.

[0039] Specifically, a skill tree is established with solutions as first-level nodes, tasks as second-level nodes, and skill points as third-level nodes. Different display effects are assigned to nodes to represent their different states; the display effect is updated accordingly when a node's state changes. For example, a node is grayed out when it is not associated with any skill points in its first or second-level nodes; it lights up when it is associated with a skill point. Yellow is used as the node's background color when a skill point is conquered; orange is used when more than 50% of the participants / teams have conquered a skill point. Furthermore, the node's background color gradually deepens as the percentage of conquered skill points increases.

[0040] Specifically, the state of each topology node is visualized through a topology graph, with different display effects representing different states of the topology nodes. For example, in an attack scenario, when a participant, acting as the attacker, discovers a vulnerability in an adversary and submits a Flag, the first display effect is used; when the Flag is verified and the attack is successful, the second display effect is used. In a defense scenario, when a participant, acting as the defender, successfully uploads a repair file, the third display effect is used; when the repair file successfully fixes the vulnerability and the defense is successful, the fourth display effect is used.

[0041] like Figure 2 As shown, a leaderboard is displayed on the right side of the page. The leaderboard displays the ranking, team name, real-time score, and ranking trend, using up or down arrows to indicate whether the ranking is rising or falling. A "View More" option is located on the right side of the leaderboard; clicking the "View More" button will show the complete ranking.

[0042] like Figure 2 As shown, the bottom right side of the page displays multiple quiz updates in chronological order, from most recent to oldest. These updates include the quiz time, participant / team name, status, and skill point name. The statuses are: Flag submitted, attack successful, repair file uploaded, or defense successful. A "View More" button is located to the right of each quiz update; clicking this button will show the complete quiz update.

[0043] Figure 3 This is a schematic diagram of an answer page provided in an embodiment of the present invention, such as... Figure 3 As shown, the upper left corner of the answer page features a "Call Referee" button and an "Announcement Information" button. Clicking the "Call Referee" button pops up a question description box, allowing participants to submit text descriptions and screenshots. Clicking the "Announcement Information" button displays the announcement information. A navigation tree is displayed on the left side of the page, showing the names of various solutions. The name of the currently selected solution is highlighted with a different background color, allowing participants to quickly identify the solution they are working on.

[0044] like Figure 3 As shown, the central part of the page displays the solution description, test content, and task list. The task list includes multiple task cards, each displaying the task name, task status, task description, and the number of associated skill points. Furthermore, each task card also has a "view" button; clicking the "view" button will take participants to the task details.

[0045] Figure 4 This is a schematic diagram of a task details page provided in an embodiment of the present invention, such as... Figure 4 As shown, the task details page displays the task description, access URL, operation tips, score, and current score. The task details page also includes a file upload box, an upload button, a verification input box, a submit verification button, and a simulation environment acquisition button. The file upload box provides information on file format and size limitations.

[0046] During the actual test, participants review the task description on the task details page, then click the "Simulation Environment Acquisition" button to obtain the simulation environment (Docker container / AWD scene / target range) before answering the questions. Alternatively, they can select the file to be repaired via the file upload box and click the upload button to upload the repaired file; or, they can enter the flag to be verified via the verification content input box and click the "Submit Verification" button to submit the flag.

[0047] In the technical solution provided by the embodiments of the present invention, a three-layer standardized architecture of solution-task-skill point is provided in the resource configuration process of the simulation environment formed on demand. It supports custom changes according to the evaluation requirements, and can form a flexible evaluation simulation environment that accurately adapts to the personnel ability evaluation needs of different industries or positions. It takes into account the universality of the standardized architecture and the relevance of the content, improves the efficiency of scene adaptation, and reduces the cost of scene adaptation.

[0048] Figure 5 This is a schematic diagram of the structure of a capability assessment device under the T&EE mode provided in an embodiment of the present invention, as shown below. Figure 5 As shown, the device includes a configuration module 11 and an evaluation module 12. The configuration module 11, in T&EE mode, responds to configuration commands input by administrators to configure the evaluation items and simulation environment, providing a question-answering environment for participants; the evaluation items have three levels: solutions, tasks, and skill points; the evaluation module 12, based on preset evaluation criteria, performs real-time scoring and data statistics on the received answer data, and visualizes and updates the statistical results.

[0049] In this embodiment of the invention, the device further includes: a modification module, used to respond to configuration change instructions input by an administrator to customize at least one of the following: a modification scheme, a task, a skill point, an evaluation standard, and a simulation environment.

[0050] In this embodiment of the invention, the device further includes a distribution module, which is used to distribute a simulation environment of the corresponding type according to the received simulation environment acquisition instruction; the simulation environment acquisition instruction carries the simulation environment type; if multiple simulation environment acquisition instructions are received at the same time, the simulation environment of the corresponding type is distributed synchronously.

[0051] In this embodiment of the invention, the evaluation module 12 is specifically used to determine whether the answer data is correct based on the evaluation criteria. For theoretical skill points, if the answer is correct, a corresponding fixed score is obtained; if the answer is incorrect, no score is obtained. For practical skill points, if the answer is correct, a corresponding dynamic score is obtained; if the answer is incorrect, no score is obtained. The dynamic score decreases as the answering time or the number of scorers / teams increases.

[0052] In this embodiment of the invention, the evaluation module 12 is specifically used to establish a skill tree with the scheme as the first-level node, the task as the second-level node, and the skill point as the third-level node; by assigning different display effects to the nodes, the different states of the nodes are represented; when the state of a node changes, the display effect of the node is updated accordingly.

[0053] In this embodiment of the invention, the device further includes a verification module, which is used to verify the source of the access information based on the stored personnel management information when new access information is received; if the access information comes from a participant, then granting them participation permission; if the access information comes from an evaluator, then granting them evaluation permission; if the access information comes from someone other than a participant or evaluator, then granting them visitor permission.

[0054] In the technical solution provided by the embodiments of the present invention, a three-layer standardized architecture of solution-task-skill point is provided in the resource configuration process of the simulation environment formed on demand. It supports custom changes according to the evaluation requirements, and can form a flexible evaluation simulation environment that accurately adapts to the personnel ability evaluation needs of different industries or positions. It takes into account the universality of the standardized architecture and the relevance of the content, improves the efficiency of scene adaptation, and reduces the cost of scene adaptation.

[0055] This invention provides a computer-readable storage medium including a stored program, wherein, when the program runs, it controls the device where the computer-readable storage medium is located to execute the steps of the embodiment of the capability assessment method under the T&EE mode described above. For a detailed description, please refer to the embodiment of the capability assessment method under the T&EE mode described above.

[0056] Figure 6 A schematic diagram of a server provided in an embodiment of the present invention, as shown below. Figure 6 As shown, the server 3 in this embodiment includes a processor 301, a memory 302, and a computer program 303 stored in the memory 302 and executable on the processor 301. When the processor 301 executes the computer program 303, it implements the steps in the various method embodiments described above. Alternatively, when the processor 301 executes the computer program 303, it implements the functions of each module / unit in the various device embodiments described above.

[0057] Server 3 can be an electronic device such as a desktop computer, laptop, handheld computer, or cloud server. Server 3 may include, but is not limited to, processor 301 and memory 302. Those skilled in the art will understand that... Figure 6 This is merely an example of server 3 and does not constitute a limitation on server 3. It may include more or fewer components than shown in the illustration, or different components.

[0058] The processor 301 can be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.

[0059] The memory 302 can be an internal storage unit of the server 3, such as a hard drive or memory of the server 3. The memory 302 can also be an external storage device of the server 3, such as a plug-in hard drive, SmartMedia Card (SMC), Secure Digital (SD) card, or FlashCard. The memory 302 can also include both internal and external storage units of the server 3. The memory 302 is used to store computer programs and other programs and data required by electronic devices.

[0060] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is merely an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0061] The above description is merely a preferred embodiment of the present invention and is not intended to limit the present invention in any way. Although the present invention has been disclosed above with reference to preferred embodiments, it is not intended to limit the present invention. Any person skilled in the art can make some modifications or alterations to the above-disclosed technical content to create equivalent embodiments without departing from the scope of the present invention. Any simple modifications, equivalent changes and alterations made to the above embodiments based on the technical essence of the present invention without departing from the scope of the present invention shall still fall within the scope of the present invention.

Claims

1. A method for capability evaluation in T&EE mode, characterized in that, The method comprises: In the T&EE mode, an evaluation project and a simulation environment are configured in response to a configuration instruction input by an administrator to provide a test environment for contestants; the evaluation project has three levels of schemes, tasks and skill points; Based on the preset evaluation standard, the received test data is scored and data is counted in real time, and the statistical results are visually displayed and updated.

2. The method of claim 1, wherein, After the evaluation project and the simulation environment are configured in response to the configuration instruction input by the administrator, the method further comprises: In response to a configuration change instruction input by the administrator, at least one of the schemes, the tasks, the skill points, the evaluation standard and the simulation environment is customized.

3. The method of claim 1, wherein, The simulation environment types include docker containers, AWD scenes and target range environments; after the evaluation project and the simulation environment are configured in response to the configuration instruction input by the administrator, the method further comprises: According to the received simulation environment acquisition instruction, the simulation environment of the corresponding type is issued; the simulation environment acquisition instruction carries the simulation environment type; If multiple simulation environment acquisition instructions are received at the same time, the simulation environment of the corresponding type is issued synchronously.

4. The method of claim 1, wherein, The skill points are theoretical skill points or practical skill points; The real-time scoring and data counting of the test data based on the preset evaluation standard comprises: Based on the evaluation standard, it is judged whether the test data is correct; For theoretical skill points, if the test is correct, the corresponding fixed score is obtained; if the test is incorrect, no score is obtained; For practical skill points, if the test is correct, the corresponding dynamic score is obtained; if the test is incorrect, no score is obtained; The dynamic score decreases with the increase of the test duration or the number of scorers / teams.

5. The method of claim 1, wherein, The visual display and update of the statistical results comprise: A skill tree is established with the schemes as first-level nodes, the tasks as second-level nodes and the skill points as third-level nodes; Different display effects are given to the nodes to represent different states of the nodes; When the state of a node changes, the display effect of the node is updated accordingly.

6. The method of claim 1, wherein, The method further comprises: When new access information is received, the source of the access information is verified based on the stored personnel management information; If the access information comes from a contestant, the contestant is given a participation permission; If the access information comes from an evaluation personnel, the evaluation personnel is given an evaluation permission; If the access information comes from a person other than the contestants and the evaluation personnel, the person is given a visitor permission.

7. A capability evaluation apparatus in a T&EE mode, characterized by comprising: The device comprises: A configuration module configured to, in the T&EE mode, configure an evaluation project and a simulation environment in response to a configuration instruction input by an administrator to provide a test environment for contestants; the evaluation project has three levels of schemes, tasks and skill points; An evaluation module configured to score and count data of received test data in real time based on a preset evaluation standard, and visually display and update the statistical results.

8. The apparatus of claim 7, wherein, The device further comprises: A change module configured to customize at least one of the schemes, the tasks, the skill points, the evaluation standard and the simulation environment in response to a configuration change instruction input by the administrator.

9. A server, characterized by The server includes one or more processors; memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions that, when executed by the server, cause the server to perform the capability assessment method under the T&EE mode as described in any one of claims 1 to 6.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a stored program, wherein, when the program is executed, it controls the device on which the computer-readable storage medium is located to perform the capability assessment method under the T&EE mode as described in any one of claims 1 to 6.

Images