Network security practitioner capability evaluation device, method and equipment based on analytic hierarchy process and medium
Through the network security practitioner capability assessment device based on the hierarchical analysis method, an assessment model is constructed and skill proficiency is determined, which solves the one-sidedness problem of network security practitioner assessment in the existing technology, realizes a more scientific and comprehensive capability assessment, and ensures the practicality and pertinence of the assessment results.
Patent Information
- Application Number
- CN202510962063.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-07-11
- Publication Date
- 2025-10-17
AI Technical Summary
In existing technologies, evaluating whether cybersecurity practitioners are competent for their current positions based on a single piece of knowledge or skill is one-sided and difficult to fully and correctly reflect an individual's specific abilities, especially the evaluation of practical cybersecurity capabilities.
A network security practitioner capability assessment device based on the hierarchical analysis method is used. By dividing the work task types, a network security practitioner capability assessment model is constructed, the correlation between knowledge and skills is established, and the skill proficiency is determined using the weight matrix and knowledge vector for comprehensive evaluation.
It achieves a scientific and comprehensive assessment of the capabilities of network security practitioners, ensures the practicality and pertinence of the assessment results, avoids the one-sidedness of single knowledge or skill assessment, and ensures that the actual capabilities of practitioners meet job requirements.
Smart Images
Figure CN120806728A_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the technical field of network security, and particularly relates to a network security practitioner ability evaluation device and method based on an analytic hierarchy process, equipment and a medium. BACKGROUND
[0002] At present, whether a network security practitioner is competent for the current post is generally determined by relevant certification and examination. However, due to the strong dependence of network security work on practical ability, these methods have certain one-sidedness. On the one hand, it is difficult to fully and correctly reflect a person's specific ability through one or more examinations; on the other hand, the current network security related certification still focuses on the evaluation of network security knowledge, and less on the evaluation of network security practical ability.
[0003] From the above, how to avoid the one-sidedness of using single knowledge or skill to evaluate whether a network security practitioner is competent for the current post is a problem to be solved at present. SUMMARY
[0004] Therefore, the present application aims to provide a network security practitioner ability evaluation device and method based on an analytic hierarchy process, which can avoid the use of single knowledge or skill to evaluate network security practitioners. The specific scheme is as follows:
[0005] In a first aspect, the present application provides a network security practitioner ability evaluation device based on an analytic hierarchy process, comprising:
[0006] An evaluation model construction module is configured to divide network security practitioners based on the task type of a work task to obtain various types of practitioners, analyze the comprehensive ability of various types of practitioners, and construct a network security practitioner ability evaluation model using the analysis results.
[0007] A first matrix construction module is configured to determine the degree of knowledge mastery of a to-be-evaluated practitioner using the network security practitioner ability evaluation model and the examination records of the to-be-evaluated practitioner, establish the association between knowledge and skills based on the degree of knowledge mastery, and obtain a corresponding initial matrix.
[0008] A second matrix construction module is configured to determine a knowledge vector using the degree of knowledge mastery, determine the relative importance between tasks, skills and knowledge in the network security practitioner ability evaluation model based on the initial matrix and using an analytic hierarchy process, and construct a weight matrix using the relative importance.
[0009] An evaluation result determination module is configured to determine an evaluation result of the to-be-evaluated practitioner based on the skill requirement data of each task unit in the task and the skill proficiency, which is determined by using the weight matrix and the knowledge vector.
[0010] Optionally, the evaluation model construction module comprises:
[0011] A practitioner division unit is configured to divide network security practitioners based on the task type of the work task to obtain various types of practitioners, and analyze the professional skills, knowledge reserves, thinking abilities, communication abilities and team collaboration abilities of the various types of practitioners to determine the ability composition elements of the practitioners of different types based on the analysis results.
[0012] An evaluation model construction unit is configured to construct a network security practitioner ability evaluation model by using the hierarchical structure, logical relationship among the task, the skill and the knowledge, and the ability composition elements.
[0013] The various types of practitioners comprise network security management practitioners, network security planning practitioners, network security design practitioners, network security engineering implementation practitioners, network security operation practitioners, emergency response practitioners, penetration testing practitioners, evaluation audit practitioners, evidence tracing practitioners, malicious code analysis practitioners, service consulting practitioners and network security research practitioners.
[0014] Optionally, the first matrix construction module comprises:
[0015] A number determination unit is configured to determine the number of correct answers of the to-be-evaluated practitioner to each security network knowledge and the total number of questions related to each target security network knowledge based on the network security practitioner ability evaluation model and the examination records of the to-be-evaluated practitioner.
[0016] A degree determination unit is configured to determine the mastery degree of the to-be-evaluated practitioner to the security network knowledge by using the proportion of the number of correct answers and the total number of questions.
[0017] Optionally, the first matrix construction module comprises:
[0018] A relationship establishment unit is configured to analyze the dependence degree of the skill on the knowledge based on the mastery degree, and establish the association relationship between the knowledge and the skill by using the dependence degree.
[0019] A first matrix construction unit is configured to construct the initial matrix based on the association relationship and the mastery degree.
[0020] Optionally, the second matrix construction module comprises:
[0021] a dimension determination unit configured to determine a matrix dimension of a weight matrix based on a total number of skills and a total number of knowledge in the network security practitioner capability evaluation model;
[0022] an importance determination unit configured to determine relative importance between tasks, skills and knowledge in the network security practitioner capability evaluation model based on the initial matrix and by using an analytic hierarchy process;
[0023] a second matrix construction unit configured to determine a degree of dependence of each skill on different knowledge based on the relative importance to obtain a dependence weight, and to construct the weight matrix based on the dependence weight and the matrix dimension.
[0024] Optionally, the evaluation result determination module comprises:
[0025] a skill proficiency determination unit configured to decompose a task to obtain a task unit, and to determine a skill proficiency required for each task unit based on the dependence weight in the weight matrix and the knowledge vector;
[0026] a skill matching degree determination unit configured to define skill requirement data of each task unit, and to determine a skill matching degree of each task unit based on the skill requirement data and the skill proficiency and by using a preset scale method, and to determine an evaluation result of the practitioner to be evaluated based on the skill matching degree.
[0027] Optionally, the network security practitioner capability evaluation device based on the analytic hierarchy process further comprises:
[0028] a first gap determination unit configured to, if the evaluation result indicates that the skill matching degree of the practitioner to be evaluated does not meet a target task requirement, determine a degree of knowledge mastery of the practitioner to be evaluated as an actual knowledge mastery degree, and determine a knowledge mastery gap based on the actual knowledge mastery degree and a target knowledge mastery degree;
[0029] a second gap determination unit configured to determine a degree of skill mastery of the practitioner to be evaluated as an actual skill mastery degree, and determine a skill mastery gap based on the actual skill mastery degree and a target skill mastery degree;
[0030] a weight adjustment unit configured to adjust the dependence weight in the weight matrix based on the knowledge mastery gap, the skill mastery gap and by using a gradient descent algorithm, until the skill matching degree meets a target stable change condition or an adjustment frequency reaches a target adjustment frequency threshold, to obtain an optimized weight matrix.
[0031] In a second aspect, the present application provides a network security practitioner capability evaluation method based on an analytic hierarchy process, comprising:
[0032] The network security practitioners are classified based on the task types of work tasks to obtain various types of practitioners, the comprehensive abilities of various types of practitioners are analyzed, and a network security practitioner ability evaluation model is constructed by using the analysis result;
[0033] The network security practitioner ability evaluation model and the examination record of the practitioner to be evaluated are used to determine the mastery degree of knowledge of the practitioner to be evaluated, an association relationship between knowledge and skills is established based on the mastery degree to obtain a corresponding initial matrix;
[0034] The knowledge vector is determined by using the mastery degree, the relative importance between tasks, skills and knowledge in the network security practitioner ability evaluation model is determined based on the initial matrix and by using the analytic hierarchy process, and a weight matrix is constructed by using the relative importance;
[0035] The evaluation result of the practitioner to be evaluated is determined based on the skill requirement data and the skill proficiency of each task unit in the task; the skill proficiency is determined by using the weight matrix and the knowledge vector.
[0036] In a third aspect, the present application provides an electronic device, comprising:
[0037] A memory for saving a computer program;
[0038] A processor for executing the computer program to implement the aforementioned network security practitioner ability evaluation method based on the analytic hierarchy process.
[0039] In a fourth aspect, the present application provides a computer readable storage medium for saving a computer program, wherein the computer program is executed by a processor to implement the aforementioned network security practitioner ability evaluation method based on the analytic hierarchy process.
[0040] The application evaluates a model construction module for classifying network security practitioners based on the task type of a work task to obtain various types of practitioners, analyzing the comprehensive ability of various types of practitioners, and constructing a network security practitioner ability evaluation model using the analysis result; a first matrix construction module for determining the knowledge mastery degree of a to-be-evaluated practitioner using the network security practitioner ability evaluation model and the examination record of the to-be-evaluated practitioner, establishing the association between knowledge and skills based on the knowledge mastery degree to obtain a corresponding initial matrix; a second matrix construction module for determining a knowledge vector using the knowledge mastery degree, determining the relative importance between tasks, skills and knowledge in the network security practitioner ability evaluation model based on the initial matrix and using the analytic hierarchy process, and constructing a weight matrix using the relative importance; and an evaluation result determination module for determining the evaluation result of the to-be-evaluated practitioner based on the skill requirement data and skill proficiency of each task unit in the task, wherein the skill proficiency is determined using the weight matrix and the knowledge vector.
[0041] As can be seen from the above, the application classifies network security practitioners based on the task type of a work task, analyzes the comprehensive ability of various types of practitioners, can comprehensively understand the advantages and disadvantages of different types of practitioners in knowledge, skills, thinking ability and the like, constructs a network security practitioner ability evaluation model using the analysis result, the model integrates the understanding of the comprehensive ability of various types of practitioners, and can more scientifically and comprehensively evaluate network security practitioners; then the knowledge mastery degree is determined using the model and the examination record of the to-be-evaluated practitioner, the association between knowledge and skills is established to construct an initial matrix, the evaluation process is more logical and systematic, the relative importance between tasks, skills and knowledge is determined based on the initial matrix and the analytic hierarchy process, and a weight matrix is constructed, ensuring the scientificity and rationality of weight distribution. In this way, the evaluation result is determined based on the skill requirement data of each task unit in the task and the skill proficiency determined using the weight matrix and the knowledge vector, which can accurately measure whether the to-be-evaluated practitioner has the required ability to complete the task, making the evaluation result more practical and targeted, avoiding the one-sidedness of single knowledge or skill evaluation, and ensuring that the actual ability of the practitioner meets the actual requirements of the post. BRIEF DESCRIPTION OF DRAWINGS
[0042] In order to more clearly illustrate the technical solutions in the embodiments of the application or the prior art, the following will briefly introduce the drawings needed to be used in the embodiments or the prior art description. Obviously, the drawings in the following description are only the embodiments of the application, and for those skilled in the art, other drawings can also be obtained without creative labor based on the provided drawings.
[0043] Figure 1A network security practitioner capability evaluation device structure schematic diagram based on the analytic hierarchy process is disclosed in the present application.
[0044] Figure 2 A network security practitioner classification schematic diagram is disclosed in the present application.
[0045] Figure 3 A network security practitioner capability component schematic diagram is disclosed in the present application.
[0046] Figure 4 A network security practitioner capability evaluation model schematic diagram is disclosed in the present application.
[0047] Figure 5 A main task schematic diagram of various practitioners is disclosed in the present application.
[0048] Figure 6 A network security practitioner capability evaluation framework schematic diagram is disclosed in the present application.
[0049] Figure 7 A main skill schematic diagram of various practitioners is disclosed in the present application.
[0050] Figure 8 A network security practitioner knowledge system framework schematic diagram is disclosed in the present application.
[0051] Figure 9 A main network security knowledge requirement schematic diagram of various practitioners is disclosed in the present application.
[0052] Figure 10 A network security practitioner capability evaluation method flowchart based on the analytic hierarchy process is disclosed in the present application.
[0053] Figure 11 An electronic device structure diagram is disclosed in the present application. DETAILED DESCRIPTION
[0054] The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by a person of ordinary skill in the art without creative labor fall within the scope of protection of the present application.
[0055] At present, due to the strong dependence of network security work on practical ability, it is difficult to comprehensively and correctly reflect the specific ability of a person through one or more examinations; moreover, the current network security related certification certificates still focus on the evaluation of network security knowledge, and the evaluation of network security practical ability is less. Therefore, the application provides a network security practitioner ability evaluation device based on the analytic hierarchy process, which determines the evaluation result based on the skill requirement data of each task unit in the task and the skill proficiency determined by the weight matrix and the knowledge vector, can accurately measure whether the practitioner to be evaluated has the ability required to complete the task, makes the evaluation result more practical and targeted, avoids the one-sidedness of single knowledge or skill evaluation, and ensures that the actual ability of the practitioner meets the actual requirements of the post.
[0056] Referring to Figure 1 The embodiment of the application discloses a network security practitioner ability evaluation device based on the analytic hierarchy process, which comprises:
[0057] The evaluation model construction module 11 is used for dividing network security practitioners based on the task type of work tasks to obtain various types of practitioners, analyzing the comprehensive ability of various types of practitioners, and constructing a network security practitioner ability evaluation model by using the analysis result.
[0058] In the embodiment, network security practitioners are divided into twelve types based on different work tasks to be undertaken, such as Figure 2 As shown in the figure, including network security management practitioners, network security planning practitioners, network security design practitioners, network security engineering implementation practitioners, network security operation practitioners, emergency response practitioners, penetration testing practitioners, evaluation audit practitioners, evidence tracing practitioners, malicious code analysis practitioners, service consulting practitioners, and network security research practitioners; then the comprehensive ability of various types of practitioners is analyzed to determine the ability composition elements of different types of practitioners based on the analysis result, such as Figure 3 As shown in the figure, the ability composition elements include network security ethics and rule of law consciousness, network security knowledge, network security skills, network security tool development and use, and network security practical operation. Then the network security practitioner ability evaluation model is constructed by using the hierarchical structure, logical relationship between tasks, skills and knowledge, and the ability composition elements. The network security practitioner ability evaluation model is as shown in the figure. Figure 4 In the network security practitioner ability evaluation model, knowledge provides support for skills, and knowledge and skills jointly provide support for completing tasks. Knowledge and skills can be respectively evaluated, and the knowledge level and practical operation skills can be continuously improved through evaluation; or the evaluation can be performed in the completion of specific tasks, and the gap analysis of knowledge and skills required to complete specific tasks is performed, so that the specific gap can be improved and improved to continuously meet the various knowledge and skill requirements required by network security tasks.
[0059] Specifically, the evaluation model construction module comprises: a practitioner classification unit configured to classify network security practitioners based on task types of work tasks to obtain various types of practitioners, and analyze professional skills, knowledge reserves, thinking abilities, communication abilities and team collaboration abilities of the various types of practitioners to determine ability composition elements of different types of practitioners based on analysis results; and an evaluation model construction unit configured to construct a network security practitioner ability evaluation model by using a hierarchical structure, a logical relationship among tasks, skills and knowledge, and the ability composition elements; wherein the various types of practitioners comprise network security management practitioners, network security planning practitioners, network security design practitioners, network security engineering implementation practitioners, network security operation practitioners, emergency response practitioners, penetration testing practitioners, evaluation audit practitioners, evidence tracing practitioners, malicious code analysis practitioners, service consulting practitioners and network security research practitioners.
[0060] It can be understood that the main tasks corresponding to the various types of practitioners are as shown in Figure 5 Each type of practitioner corresponds to different work tasks. It should be noted that the evaluation framework corresponding to the network security practitioner ability evaluation model is as shown in Figure 6 The evaluation of the network security practitioner ability needs to set the practitioner ability level, for example, set four levels of primary, intermediate, advanced and expert, then determine the evaluation content, determine the evaluation standards, evaluation methods, evaluation tools and evaluation processes and the calculation method of the evaluation results for different levels, and then determine the network security practitioner ability level according to the evaluation results. The evaluation method usually includes theoretical examination, skill operation examination, interview, paper writing, scheme planning and case examination. The selection of the evaluation method can be selected according to the content and purpose of the examination. Further, the main skills of the various types of practitioners are as shown in Figure 7 Each type of practitioner corresponds to different skills. Since network security knowledge is the basis for generating network security skills and completing network tasks, a network security practitioner knowledge system framework is constructed by analyzing and researching various network security work, as shown in Figure 8 In addition, the main network security knowledge requirements of the various types of practitioners are different, as shown in Figure 9
[0061] The first matrix construction module 12 is configured to determine the mastery degree of knowledge of the to-be-evaluated practitioner by using the network security practitioner ability evaluation model and the examination records of the to-be-evaluated practitioner, establish an association relationship between the knowledge and the skills based on the mastery degree to obtain a corresponding initial matrix.
[0062] In the embodiment, after obtaining the network security practitioner ability evaluation model, based on the network security practitioner ability evaluation model and the examination record of the to-be-evaluated practitioner, the number of correct answers of the to-be-evaluated practitioner to each security network knowledge and the total number of questions respectively related to each target security network knowledge are determined to obtain the mastery degree of the to-be-evaluated practitioner to the security network knowledge. The formula corresponding to the mastery degree is as follows:
[0063] ;
[0064] wherein, is the mastery degree of the knowledge point ; Specifically, the first matrix construction module comprises: a number determination unit configured to determine, based on the network security practitioner ability evaluation model and the examination record of the to-be-evaluated practitioner, the number of correct answers of the to-be-evaluated practitioner to each security network knowledge and the total number of questions respectively related to each target security network knowledge; and a degree determination unit configured to determine the mastery degree of the to-be-evaluated practitioner to the security network knowledge by using the proportion of the number of correct answers and the total number of questions.
[0065] It can be understood that the dependence degree of the skill on the knowledge is analyzed based on the mastery degree, so as to establish the correlation between the knowledge and the skill by using the dependence degree, that is, the quantitative relationship between the knowledge and the skill, and the initial matrix is constructed based on the correlation and the mastery degree. Specifically, the first matrix construction module comprises: a relationship establishment unit configured to establish the correlation between the knowledge and the skill by using the dependence degree of the skill on the knowledge based on the mastery degree; and a first matrix construction unit configured to construct the initial matrix based on the correlation and the mastery degree.
[0066] The second matrix construction module 13 is configured to determine a knowledge vector by using the mastery degree, determine the relative importance between the tasks, the skills and the knowledge in the network security practitioner ability evaluation model based on the initial matrix and by using the analytic hierarchy process, and construct a weight matrix by using the relative importance.
[0067] In this embodiment, after obtaining the mastery level, a knowledge vector is determined based on the mastery level of each knowledge point, and then the matrix dimension of the weight matrix is determined based on the total number of skills and the total number of knowledge in the cybersecurity practitioner capability assessment model. Then, the dependency weight of skills on knowledge is determined using the analytic hierarchy process (AHP), wherein the AHP determines the relative importance of tasks, skills, and knowledge through expert scoring, and constructs a weight matrix based on the relative importance, the dependency weight, and the matrix dimension. Specifically, the second matrix construction module includes: a dimension determination unit for determining the matrix dimension of the weight matrix based on the total number of skills and the total number of knowledge in the cybersecurity practitioner capability assessment model; an importance determination unit for determining the relative importance of tasks, skills, and knowledge in the cybersecurity practitioner capability assessment model based on the initial matrix and using the AHP; a second matrix construction unit for determining the degree of dependency of each skill on different knowledge using the relative importance to obtain dependency weights, and constructing a weight matrix based on the dependency weights and the matrix dimension.
[0068] The evaluation result determination module 14 is used to determine the evaluation result of the practitioner to be evaluated based on the skill requirement data and skill proficiency of each task unit in the task; the skill proficiency is the skill proficiency determined using the weight matrix and the knowledge vector.
[0069] In this embodiment, after obtaining the weight matrix, the task is decomposed into various task units. For example, the "penetration test task" is decomposed into "vulnerability discovery", "vulnerability exploitation" and "report writing". The skill proficiency required for each task unit is then determined using the dependency weights in the weight matrix and the knowledge vector. The formula corresponding to the skill proficiency is as follows:
[0070] ;
[0071] in, is the proficiency of the skill; For skills Knowledge The dependency weight of For the knowledge point in the knowledge vector the degree of mastery; .
[0072] Furthermore, after obtaining the skill proficiency, the skill requirement vector of each task unit is defined, and the expert scores are analyzed using a 1-9 scale or other scale method to obtain the skill requirement degree of the task unit; wherein 1 in the 1-9 scale method represents the lowest requirement degree and 9 represents the highest requirement degree. The skill matching degree of each task unit is determined based on the skill requirement degree and the skill proficiency. The formula corresponding to the skill matching degree is as follows:
[0073] ;
[0074] in, Task Unit Skill matching; is the proficiency of the skill; For the task unit The skill matching degree ranges from 0 to 1. The higher the value of the skill matching degree, the more suitable the practitioner to be evaluated is for the corresponding task unit.
[0075] Specifically, the evaluation result determination module includes: a skill proficiency determination unit, which is used to decompose the task to obtain each task unit, and determine the skill proficiency required for each task unit based on the dependency weights in the weight matrix and the knowledge vector; a skill matching determination unit, which is used to define the skill requirement data of each task unit, and determine the skill matching of each task unit based on the skill requirement data and the skill proficiency and using a preset scaling method, and use the skill matching to determine the evaluation result of the practitioner to be evaluated.
[0076] In this embodiment, the dependency weights can be adjusted using a gradient descent algorithm to make the skill matching more accurate. That is, if the evaluation result indicates that the skill matching of the practitioner to be evaluated does not meet the target task requirements, the knowledge mastery gap between the actual knowledge mastery and the target knowledge mastery is determined. The formula corresponding to the knowledge mastery gap is as follows:
[0077] ;
[0078] in, The knowledge mastery gap; The target knowledge mastery level can be determined based on actual conditions; The actual knowledge mastery is the degree of knowledge mastery by the practitioner to be evaluated.
[0079] It can be understood that after obtaining the skill mastery degree, the skill mastery gap is determined based on the actual skill mastery degree and the target skill mastery degree, and the formula corresponding to the skill mastery gap is as follows:
[0080] ;
[0081] wherein, is the skill mastery gap; is the target skill mastery degree, which can be determined according to actual conditions; is the actual skill mastery degree, i.e., the degree of mastery of the skill by the practitioner to be evaluated.
[0082] Further, after obtaining the skill mastery gap, the dependent weight in the weight matrix is adjusted based on the knowledge mastery gap and the skill mastery gap and by using a gradient descent algorithm to obtain an adjusted weight. The formula corresponding to the adjusted weight is as follows:
[0083] ;
[0084] wherein, is the skill on knowledge The dependent weight at the first adjustment or iteration, i.e., the adjusted weight; is the learning rate, which can adopt an adaptive decay strategy, with an initial value of 0.01 and a decay of 5% every 100 iterations, and when the change amplitude of the task matching degree in 5 consecutive iterations is less than 0.01; is the partial derivative of the loss function with respect to the dependent weight , indicating the change rate of the task matching degree to Until the skill matching degree meets the target stable change condition or the number of adjustments reaches the target adjustment number threshold, to obtain an optimized weight matrix.
[0085] Specifically, the network security practitioner ability evaluation device based on the analytic hierarchy process further includes: a first gap determination unit, configured to determine the knowledge mastery degree of the to-be-evaluated practitioner as an actual knowledge mastery degree if the evaluation result indicates that the skill matching degree of the to-be-evaluated practitioner does not meet the target task requirement, and determine a knowledge mastery degree gap based on the actual knowledge mastery degree and a target knowledge mastery degree; a second gap determination unit, configured to determine the skill mastery degree of the to-be-evaluated practitioner as an actual skill mastery degree, and determine a skill mastery degree gap based on the actual skill mastery degree and a target skill mastery degree; and a weight adjustment unit, configured to adjust the dependent weights in the weight matrix based on the knowledge mastery degree gap and the skill mastery degree gap and by using a gradient descent algorithm until the skill matching degree meets a target stable change condition or the number of adjustments reaches a target adjustment number threshold, to obtain an optimized weight matrix. It should be noted that the target task requirement can be adjusted according to actual conditions, and is not specifically limited here.
[0086] As can be seen from the above, the network security practitioner is divided based on the task type of the work task, the comprehensive ability of each type of practitioner is analyzed, the advantages and disadvantages of different types of practitioners in knowledge, skills, thinking ability and the like are comprehensively understood, the analysis result is used to construct a network security practitioner ability evaluation model, the model combines the understanding of the comprehensive ability of each type of practitioner, and the network security practitioner can be more scientifically and comprehensively evaluated; then the knowledge mastery degree is determined by using the model and the examination record of the to-be-evaluated practitioner, an initial matrix is constructed by establishing the association between knowledge and skills, the evaluation process is more logical and systematic, the relative importance among tasks, skills and knowledge is determined based on the initial matrix and the analytic hierarchy process, and a weight matrix is constructed, so that the scientificity and rationality of weight distribution are ensured. In this way, the evaluation result is determined based on the skill proficiency determined by using the weight matrix and the knowledge vector and the skill requirement data of each task unit in the task, whether the to-be-evaluated practitioner has the required ability to complete the task can be accurately measured, the evaluation result is more practical and targeted, the one-sidedness of single knowledge or skill evaluation is avoided, and it is ensured that the actual ability of the practitioner meets the actual requirements of the post.
[0087] The above embodiments introduce the functions of each module in the present application in detail, the evaluation result of the to-be-evaluated practitioner can be determined based on the skill proficiency determined by using the weight matrix and the knowledge vector and the skill requirement data of each task unit in the task; the following embodiments will introduce a network security practitioner ability evaluation method based on the analytic hierarchy process. Referring to Figure 10 The embodiment of the present application discloses a network security practitioner ability evaluation method based on the analytic hierarchy process, which comprises:
[0088] Step S11, dividing the network security practitioners based on the task types of the work tasks to obtain various types of practitioners, analyzing the comprehensive abilities of the various types of practitioners, and constructing a network security practitioner ability evaluation model by using the analysis results;
[0089] Step S12, determining the mastery degree of knowledge of the to-be-evaluated practitioner by using the network security practitioner ability evaluation model and the examination records of the to-be-evaluated practitioner, establishing the association relationship between the knowledge and the skills based on the mastery degree to obtain a corresponding initial matrix;
[0090] Step S13, determining the knowledge vector by using the mastery degree, determining the relative importance between the tasks, the skills and the knowledge in the network security practitioner ability evaluation model based on the initial matrix and by using the analytic hierarchy process, and constructing a weight matrix by using the relative importance;
[0091] Step S14, determining the evaluation result of the to-be-evaluated practitioner based on the skill requirement data of each task unit in the task and the skill proficiency degree, wherein the skill proficiency degree is determined by using the weight matrix and the knowledge vector.
[0092] As can be seen from the above, the network security practitioners are divided based on the task types of the work tasks, the comprehensive abilities of the various types of practitioners are analyzed, the advantages and disadvantages of the different types of practitioners in the knowledge, the skills, the thinking abilities and the like are comprehensively understood, the network security practitioner ability evaluation model is constructed by using the analysis results, the model combines the understanding of the comprehensive abilities of the various types of practitioners, and the network security practitioners can be more scientifically and comprehensively evaluated; then the knowledge mastery degree is determined by using the model and the examination records of the to-be-evaluated practitioner, the association relationship between the knowledge and the skills is established to construct the initial matrix, the evaluation process is more logical and systematic, the relative importance between the tasks, the skills and the knowledge is determined based on the initial matrix and the analytic hierarchy process, and the weight matrix is constructed, so that the scientificity and the rationality of the weight distribution are ensured. In this way, the evaluation result is determined based on the skill requirement data of each task unit in the task and the skill proficiency degree which is determined by using the weight matrix and the knowledge vector, the to-be-evaluated practitioner can be accurately measured whether the to-be-evaluated practitioner has the required ability to complete the task, the evaluation result is more practical and targeted, the one-sidedness of the single knowledge or skill evaluation is avoided, and the actual ability of the practitioner is ensured to meet the actual requirements of the post.
[0093] Further, the embodiment of the present application also discloses an electronic device, Figure 11is a structural diagram of the electronic device 20 according to an exemplary embodiment, and the content in the figure should not be considered as any limitation on the use range of the present application. The electronic device 20 can specifically include at least one processor 21, at least one memory 22, a power supply 23, a communication interface 24, an input / output interface 25, and a communication bus 26. The memory 22 is configured to store a computer program, and the processor 21 is configured to load and execute the computer program to implement the related steps in the network security practitioner capability evaluation method based on the analytic hierarchy process disclosed in any of the preceding embodiments. In addition, the electronic device 20 in the present embodiment can be an electronic computer.
[0094] In the present embodiment, the power supply 23 is configured to provide operating voltage for each hardware device on the electronic device 20; the communication interface 24 is configured to create a data transmission channel between the electronic device 20 and external devices, and the communication protocol followed by the communication interface 24 can be any communication protocol applicable to the technical solution of the present application, which is not limited specifically herein; the input / output interface 25 is configured to obtain external input data or output data to the outside, and the specific interface type can be selected according to the specific application needs, which is not limited specifically herein.
[0095] In addition, the memory 22 as a carrier for resource storage can be a read-only memory, a random access memory, a magnetic disk, or an optical disk, and the resources stored thereon can include an operating system 221, a computer program 222, etc., and the storage mode can be temporary storage or permanent storage.
[0096] The operating system 221 is configured to manage and control each hardware device on the electronic device 20 and the computer program 222, and can be Windows Server, Netware, Unix, Linux, etc. In addition to the computer program for completing the network security practitioner capability evaluation method based on the analytic hierarchy process executed by the electronic device 20 disclosed in any of the preceding embodiments, the computer program 222 can further include a computer program for completing other specific work.
[0097] Further, the present application further discloses a computer readable storage medium for storing a computer program; wherein the computer program is executed by a processor to implement the network security practitioner capability evaluation method based on the analytic hierarchy process disclosed above. For the specific steps of the method, reference can be made to the corresponding content disclosed in the preceding embodiments, which will not be repeated here.
[0098] The various embodiments described in this specification are presented for the purpose of illustration and description. Each of the embodiments highlights a different aspect of the application. The embodiments are not mutually exclusive, and the various embodiments can be combined with each other. The same or similar elements are denoted by the same or similar reference signs.
[0099] Those skilled in the art will further appreciate that the units and algorithm steps of the various examples described in connection with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or combinations of both. To clearly illustrate this interchangeability of hardware and software, various examples have been described herein in terms of their functionality, which has been described generally and symbolically in flow charts. Having thus described the functionality of the examples in terms of a process, it is appreciated that this functionality can be implemented by one or more types of electrical circuits, computer instructions, or a combination of both. One of ordinary skill in the art having the benefit of this disclosure will appreciate that the functionality can be implemented by either software or hardware, or a combination thereof, as desired.
[0100] The steps of a method or algorithm described in connection with the embodiments disclosed herein can be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module can reside in random access memory (RAM), flash memory, read-only memory (ROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
[0101] Finally, it should be noted that the terms "first", "second", and the like, herein do not denote any order, quantity, combination, or importance, but rather are used to distinguish one element from another, and are more especially used for the purpose of illustration and not of limitation. Also, the terms "comprises", "comprising", or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but can also include other elements not expressly listed or inherent to such process, method, article, or apparatus. The terms "includes", "including", or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that includes a list of elements does not include only those elements but can also include other elements not expressly listed or inherent to such process, method, article, or apparatus.
[0102] The above detailed description of the application has been presented for the purposes of illustration and description. The description is merely intended to facilitate understanding of the methods and concepts of the application. The above examples are illustrative rather than limiting, and the scope of the application is not to be determined by the specific examples presented herein, but only by the claims.
Claims
1. A network security practitioner capability assessment device based on hierarchical analysis method, characterized in that: include: An assessment model building module is used to divide cybersecurity practitioners based on the task types of their work tasks to obtain different types of practitioners, analyze the comprehensive capabilities of each type of practitioners, and use the analysis results to build a cybersecurity practitioner capability assessment model; A first matrix construction module is configured to determine the knowledge mastery level of the practitioner to be assessed by using the cybersecurity practitioner capability assessment model and the assessment records of the practitioner to be assessed, and to establish a correlation between knowledge and skills based on the mastery level to obtain a corresponding initial matrix; a second matrix construction module, configured to determine a knowledge vector using the mastery level, determine the relative importance of tasks, skills, and knowledge in the cybersecurity practitioner capability assessment model based on the initial matrix and using an analytic hierarchy process, and construct a weight matrix using the relative importance; An assessment result determination module, configured to determine an assessment result of the practitioner to be assessed based on the skill requirement data and skill proficiency of each task unit in the task; The skill proficiency is a skill proficiency determined using the weight matrix and the knowledge vector.
2. The network security practitioner capability assessment device based on the analytic hierarchy process according to claim 1, characterized in that: The evaluation model building module includes: A practitioner classification unit is used to classify cybersecurity practitioners based on the task types of their work tasks to obtain different types of practitioners, and to analyze the professional skills, knowledge reserves, thinking ability, communication ability, and teamwork ability of each type of practitioner to determine the ability components of different types of practitioners based on the analysis results; An assessment model building unit, configured to build a cybersecurity practitioner capability assessment model using the hierarchical structure and logical relationships among tasks, skills, and knowledge, and the capability components; Among them, the various types of practitioners include network security management practitioners, network security planning practitioners, network security design practitioners, network security engineering implementation practitioners, network security operations practitioners, emergency response practitioners, penetration testing practitioners, assessment and auditing practitioners, forensics and tracing practitioners, malicious code analysis practitioners, service consulting practitioners, and network security research practitioners.
3. The network security practitioner capability assessment device based on the analytic hierarchy process according to claim 1, characterized in that: The first matrix building module includes: a quantity determination unit, configured to determine, based on the network security practitioner capability assessment model and the assessment records of the practitioners to be assessed, the number of correct answers given by the practitioners to be assessed for each security network knowledge and the total number of questions related to each target security network knowledge; The degree determination unit is used to determine the degree of mastery of the security network knowledge by the practitioner to be evaluated by using the ratio of the number of correct answers to the total number of questions.
4. The network security practitioner capability assessment device based on the analytic hierarchy process according to claim 1, characterized in that: The first matrix building module includes: a relationship establishing unit, configured to analyze the degree of dependence of the skill on the knowledge based on the mastery degree, so as to establish an association relationship between the knowledge and the skill using the dependence degree; The first matrix construction unit is configured to construct the initial matrix based on the association relationship and the mastery degree.
5. The network security practitioner capability assessment device based on the analytic hierarchy process according to claim 1, characterized in that: The second matrix building module includes: a dimension determination unit, configured to determine a matrix dimension of a weight matrix based on the total number of skills and the total number of knowledge in the cybersecurity practitioner capability assessment model; an importance determination unit, configured to determine the relative importance of tasks, skills, and knowledge in the cybersecurity practitioner capability assessment model based on the initial matrix and using a hierarchical analysis method; The second matrix construction unit is used to determine the degree of dependence of each skill on different knowledge using the relative importance to obtain dependence weights, and to construct a weight matrix based on the dependence weights and the matrix dimensions.
6. The network security practitioner capability assessment device based on the analytic hierarchy process according to claim 5, characterized in that: The evaluation result determination module includes: a skill proficiency determination unit, configured to decompose the task to obtain task units, and determine the skill proficiency required for each task unit based on the dependency weights in the weight matrix and the knowledge vector; A skill matching determination unit is used to define the skill requirement data of each task unit, and determine the skill matching of each task unit based on the skill requirement data and the skill proficiency and using a preset scaling method, and use the skill matching to determine the evaluation result of the practitioner to be evaluated.
7. The network security practitioner capability assessment device based on the analytic hierarchy process according to claim 5, characterized in that: Also includes: a first gap determination unit, configured to determine the knowledge mastery level of the practitioner to be evaluated as the actual knowledge mastery level if the evaluation result indicates that the skill matching level of the practitioner to be evaluated does not meet the target task requirements, and determine the knowledge mastery gap based on the actual knowledge mastery level and the target knowledge mastery level; a second gap determining unit, configured to determine the skill mastery level of the practitioner to be assessed as the actual skill mastery level, and determine a skill mastery gap based on the actual skill mastery level and the target skill mastery level; A weight adjustment unit is used to adjust the dependency weights in the weight matrix based on the knowledge mastery gap and the skill mastery gap and using a gradient descent algorithm until the skill matching degree meets the target stable change condition or the number of adjustments reaches the target adjustment number threshold, so as to obtain an optimized weight matrix.
8. A method for evaluating the capabilities of network security practitioners based on the analytic hierarchy process, characterized in that: include: Classify cybersecurity practitioners based on the task types of their work tasks to obtain various types of practitioners, analyze the comprehensive capabilities of each type of practitioners, and use the analysis results to build a cybersecurity practitioner capability assessment model; Determine the knowledge mastery level of the practitioner to be assessed using the cybersecurity practitioner capability assessment model and the assessment records of the practitioner to be assessed, and establish a correlation between knowledge and skills based on the mastery level to obtain a corresponding initial matrix; Determine a knowledge vector using the mastery level, determine the relative importance of tasks, skills, and knowledge in the cybersecurity practitioner capability assessment model based on the initial matrix and using a hierarchical analysis method, and construct a weight matrix using the relative importance; Determining an assessment result of the practitioner to be assessed based on the skill requirement data and skill proficiency of each task unit in the task; The skill proficiency is a skill proficiency determined using the weight matrix and the knowledge vector.
9. An electronic device, characterized in that: include: Memory, used to store computer programs; A processor is configured to execute the computer program to implement the method for evaluating the capabilities of network security practitioners based on the hierarchical analysis method as claimed in claim 8.
10. A computer-readable storage medium, characterized in that Used to store a computer program, wherein when the computer program is executed by a processor, the method for evaluating the capabilities of network security practitioners based on the hierarchical analysis method according to claim 8 is implemented.