Test system management method based on multiple roles
By creating tenants, assigning roles, generating permission models and test scenarios, the problem of unclear role division and permission management in traditional test management is solved, and efficient test system management is achieved.
Patent Information
- Application Number
- CN202511028144.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-07-24
- Publication Date
- 2025-12-19
AI Technical Summary
Traditional test management methods lack effective role division and permission management, resulting in a chaotic testing process, low team collaboration efficiency, and difficulty in meeting the needs of rapid iteration and high-quality delivery in modern software development.
By creating several tenants, assigning roles, generating initial permissions based on a multi-role permission model, constructing test scenarios and virtual test units, generating comprehensive test evaluation values based on test results, determining whether to adjust permissions, and generating permission management strategies.
It enables refined permission management, improves the efficiency of test system management, and meets the needs of rapid iteration and high-quality delivery.
Smart Images

Figure CN121166524A_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the technical field of software testing, in particular to a multi-role-based test system management method. BACKGROUND
[0002] With the continuous expansion of the scale and increase of the complexity of software projects, software testing work becomes increasingly important and complex. The traditional test management method often lacks effective role division and permission management, leading to chaotic test process, low team collaboration efficiency, and difficulty in meeting the needs of rapid iteration and high-quality delivery in modern software development. Therefore, a multi-role-based test system management method is urgently needed to clearly define the permissions of different roles and improve the efficiency of test system management. SUMMARY
[0003] To solve the above technical problems, the present application provides a multi-role-based test system management method, which creates a plurality of tenants, assigns roles to users in each tenant, generates initial permissions for each role based on a multi-role permission model, constructs a plurality of test scenarios and virtual test units for each role and performs testing, generates a comprehensive test evaluation value for each user based on the test results, and determines whether to adjust the initial permissions. If so, generate a permission management strategy to achieve fine-grained permission management and improve the efficiency of test system management.
[0004] In some embodiments of the present application, a multi-role-based test system management method is provided, comprising: creating a plurality of tenants, obtaining the basic information of users inside each tenant, and assigning roles to users based on the basic information; constructing a multi-role permission model and generating initial permissions for each role of different tenants based on the multi-role permission model, wherein the initial permissions include a plurality of preset permission points; constructing a plurality of test scenarios and virtual test units for each role, testing the virtual test units based on the plurality of test scenarios, and generating a comprehensive test evaluation value for each role based on the test results; determining whether to adjust the initial permissions of the role based on the comprehensive test evaluation value, and if so, generating a permission management strategy.
[0005] In some embodiments of the present application, a plurality of tenants are created, the basic information of users inside each tenant is obtained, and roles are assigned to users based on the basic information, comprising: obtaining the current actual organizational structure, matching the corresponding mapping scenario based on the actual organizational structure, and determining a plurality of mapping features of the current mapping scenario; creating a plurality of tenants based on the plurality of mapping features of the current mapping scenario, and setting the isolation strategy of each tenant; Obtaining a plurality of users in each tenant and basic information of each user based on a mapping relationship between a user information library and each tenant; Determining a feature user in the tenant according to the basic information of the user, wherein the feature user customizes a role for the basic information of the remaining users and is assigned to a corresponding user.
[0006] In some embodiments of the present application, an isolation strategy of each tenant is set, including: Determining a value category and a sensitive level of the tenant; Traversing a preset isolation strategy library according to the value category and the sensitive level of each tenant to obtain an isolation strategy level and a corresponding isolation strategy of each tenant; The isolation strategy includes a data layer isolation strategy, an authority layer isolation strategy and a resource layer isolation strategy.
[0007] In some embodiments of the present application, a multi-role authority model is constructed, including: Setting a plurality of role categories based on a historical role creation library to generate a first historical behavior data set and a second historical behavior data set of each role category; Generating an authority evaluation value of the corresponding role category according to the first historical behavior data set; Generating an authority anomaly evaluation value of the corresponding role category according to the second historical behavior data set; Setting a first authority point number of the corresponding role category according to the authority evaluation value, and extracting an authority point based on the first authority point number and historical behavior data in the first historical behavior data set of the corresponding role category to obtain a first authority point set of the corresponding role category; Setting a second authority point number of the corresponding role category according to the authority anomaly evaluation value, and extracting an authority point based on the second authority point number and historical behavior data in the second historical behavior data set of the corresponding role category to obtain a second authority point set of the corresponding role category; Generating the first authority point set and the second authority point set of each role category in turn; Taking each role category as training input data, taking the first authority point set of the corresponding role category as a training output label set, and taking the second authority point set of the corresponding role category as a training output pseudo label set; Performing semi-supervised learning training based on the training input data, the training output label set and the training output pseudo label set to generate a multi-role authority model.
[0008] In some embodiments of the present application, the calculation formula of the authority evaluation value is: ; Wherein, Q1 is the authority evaluation value, n1 is the number of authority evaluation indexes, an i1th permission evaluation index generated for the historical behavior data in the first historical behavior data set, a weight coefficient of the i1th permission evaluation index; The calculation formula of the permission abnormal evaluation value is: wherein Q2 is the permission abnormal evaluation value, n2 is the number of permission abnormal evaluation indexes, an i2th permission abnormal evaluation index generated for the historical behavior data in the second historical behavior data set, a weight coefficient of the i2th permission abnormal evaluation index.
[0009] In some embodiments of the present application, the initial permission of each role of different tenants is generated based on the multi-role permission model, comprising: calculating a similarity evaluation value of each role and a plurality of historical created roles in a historical created role library; if there is a similarity evaluation value greater than a preset similarity evaluation value, inputting the corresponding role into the multi-role permission model to obtain the initial permission of the corresponding role; if there is no similarity evaluation value greater than the preset similarity evaluation value; performing correlation analysis on the corresponding role, other roles and a plurality of historical created roles to obtain a first correlation coefficient of the corresponding role and other roles, a second correlation coefficient between other roles, a third correlation coefficient of the corresponding role and historical created roles, and a fourth correlation coefficient between different historical created roles; obtaining a first associated role group and a second associated role group of the corresponding role according to the first correlation coefficient, the second correlation coefficient, the third correlation coefficient and the fourth correlation coefficient; wherein the first associated role group comprises an upper associated role and a lower associated role, and the first associated role group comprises an upper associated historical created role and a lower associated historical created role; generating a first predicted permission of the corresponding role according to the initial permission of the upper associated role and the initial permission of the lower associated role in the first associated role set, wherein the first predicted permission comprises a plurality of pending permission points; generating a second predicted permission of the corresponding role according to the historical permission of the upper associated historical created role and the historical permission of the lower associated historical created role in the second associated role set, wherein the second predicted permission comprises a plurality of pending permission points; performing comparative analysis on the first predicted permission and the second predicted permission to obtain a plurality of same pending permission points, and setting the same pending permission points as the initial permission of the corresponding role.
[0010] In some embodiments of the present application, a plurality of test scenarios and a virtual test unit of each role are constructed, the virtual test unit is tested based on the plurality of test scenarios, and a comprehensive test evaluation value of each role is generated according to a test result, including: A plurality of independent containers are created based on a containerization technology, and a corresponding independent container is rendered according to the initial permission, behavior data and actual environment of each role, to obtain a virtual test unit of each role; A plurality of test scenarios are constructed in advance, and each test scenario is mapped with corresponding test data and a test level; The virtual test unit is tested according to the plurality of test data mapped by each test scenario, to obtain a test result, and the test result includes a plurality of test corresponding data; The test evaluation value of the virtual test unit for each test scenario is generated according to the test result, and a comprehensive test evaluation value of the corresponding role is generated according to a plurality of test evaluation values.
[0011] In some embodiments of the present application, the comprehensive test evaluation value of the corresponding role is generated according to a plurality of test evaluation values, including: A plurality of test evaluation indexes of each test scenario are preset; The data source of the plurality of test corresponding data in the test result of each test scenario is mapped with the virtual test unit, to obtain a test corresponding data group of each virtual test unit for each test scenario; A test sub-evaluation value of each test evaluation index of the corresponding test scenario is generated based on the test corresponding data group of each virtual test unit for each test scenario, and a test evaluation value of each virtual test unit for the corresponding test scenario is generated in combination with a weight coefficient of the corresponding test evaluation index; A comprehensive test evaluation value of the corresponding virtual test unit is generated according to the test evaluation values of the same virtual test unit for all test scenarios and the test levels of the corresponding test scenarios.
[0012] In some embodiments of the present application, the calculation formula of the comprehensive test evaluation value is: ; Wherein, Z is the comprehensive test evaluation value, w is the number of test scenarios, is the test evaluation value of the virtual test unit of the corresponding role for the s th test scenario, ds is the test level of the s th test scenario, and rs is the weight conversion coefficient of the test level of the s th test scenario.
[0013] In some embodiments of the present application, whether to adjust the initial permission of the role is determined according to the comprehensive test evaluation value, if yes, a permission management strategy is generated, including: A comprehensive test evaluation value threshold is preset; if the comprehensive test evaluation value is less than the comprehensive test evaluation value threshold, it is determined that the initial permission of the corresponding role is adjusted; if the comprehensive test evaluation value is not less than the comprehensive test evaluation value threshold, it is determined that the initial permission of the corresponding role is not adjusted; when the initial permission of the corresponding role is adjusted; determine the to-be-adjusted permission points and the corresponding to-be-adjusted sub-strategies of the corresponding role according to the test evaluation value of each test scene and the test sub-evaluation value of the several test evaluation indexes of each test scene; generate the permission management strategy of the corresponding role according to the several to-be-adjusted permission points and the corresponding to-be-adjusted sub-strategies of the corresponding role.
[0014] Compared with the prior art, the multi-role-based test system management method has the beneficial effects that: By creating several tenants and assigning roles to the users of each tenant, generating the initial permission of each role based on the multi-role permission model, constructing several test scenes and virtual test units of each role and testing, generating the comprehensive test evaluation value of each user according to the test results, and determining whether to adjust the initial permission, if so, generating the permission management strategy, realizing the fine-grained permission management, and improving the test system management efficiency. BRIEF DESCRIPTION OF DRAWINGS
[0015] Figure 1 is a flowchart of the multi-role-based test system management method in the embodiments of the present application. DETAILED DESCRIPTION
[0016] The specific embodiments of the present application will be further described in detail below in conjunction with the drawings and examples. The following examples are used to illustrate the present application, but not to limit the scope of the present application.
[0017] In the description of the present application, it should be understood that the terms "center", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer" and the like indicate the orientation or positional relationship based on the orientation or positional relationship shown in the drawings, and are only for the convenience of describing the present application and simplifying the description, and do not indicate or imply that the device or element referred to must have a particular orientation, be constructed and operated in a particular orientation, and therefore cannot be understood as a limitation on the present application.
[0018] The terms "first", "second", "third", etc. are used only for descriptive purposes and do not connote or imply relative importance or a number of the indicated technical features. Thus, features defined with "first", "second" or "third" can explicitly or implicitly include one or more of the features. In the description of the present application, the meaning of "a plurality of" is two or more, unless otherwise specified.
[0019] In the description of the present application, it should be noted that, unless otherwise explicitly specified and limited, the terms "mounting", "connection", "connecting" should be understood broadly, for example, it can be fixed connection, or detachable connection, or integral connection; it can be mechanical connection, or electrical connection; it can be direct connection, or indirect connection through intermediate medium, or internal communication of two elements. For those skilled in the art, the specific meaning of the above terms in the present application can be understood according to the specific circumstances.
[0020] As shown in Figure 1 The multi-role based test system management method of the embodiments of the present application comprises: Step S101: creating a plurality of tenants, obtaining the basic information of the users inside each tenant, and assigning roles to the users according to the basic information; Step S102: constructing a multi-role permission model, and generating the initial permission of each role of different tenants based on the multi-role permission model, wherein the initial permission comprises a plurality of preset permission points; Step S103: constructing a plurality of test scenarios and a virtual test unit of each role, testing the virtual test unit based on the plurality of test scenarios, and generating a comprehensive test evaluation value of each role according to the test result; Step S104: determining whether to adjust the initial permission of the role according to the comprehensive test evaluation value, and if so, generating a permission management strategy.
[0021] In some embodiments of the present application, creating a plurality of tenants, obtaining the basic information of the users inside each tenant, and assigning roles to the users according to the basic information comprises: Obtaining the actual organization structure, matching the corresponding mapping scenario according to the actual organization structure, and determining a plurality of mapping features of the current mapping scenario; Creating a plurality of tenants based on the plurality of mapping features of the current mapping scenario, and setting the isolation strategy of each tenant; Obtaining a plurality of users inside each tenant and the basic information of each user based on the mapping relationship between the user information base and each tenant; Determining the feature user in the tenant according to the basic information of the user, the feature user customizing the basic information of the remaining users, and assigning the corresponding user.
[0022] In the embodiment, the actual organization structure refers to the management logic of a team, a business unit or an organization, for example, "company→subcompany→department→team", "business line A→project team 1→member", and the like.
[0023] In the embodiment, the mapping scenario includes a business line, a department and a project cycle, and the mapping scenario is selected according to the complexity of the management logic of the actual organization structure, for example, when the actual organization structure is a large team, the complexity of the management logic is large, and the mapping scenario can be mapped according to a business line, when the actual organization structure is a small team, the complexity of the management logic is small, and the mapping scenario can be mapped according to a department or a project, and the mapping feature refers to setting a specific business in a business line, a specific department and a specific project.
[0024] In the embodiment, the basic information includes a post, a post responsibility, a post level and the like, the feature user refers to the highest manager in each tenant, and the custom role refers to that the highest manager can create a new role according to the basic information of each user and assign the new role to the corresponding user.
[0025] In the embodiment, the isolation between different tenants is realized by creating a plurality of tenants, and different levels of isolation strategies are configured, the custom role is set for each tenant, which lays a foundation for setting the responsibility and the permission of each role in the test system in the future, thereby improving the team collaboration efficiency.
[0026] In some embodiments of the present application, the isolation strategy of each tenant is set, including: determining the value category and the sensitive level of the tenant; traversing a preset isolation strategy library according to the value category and the sensitive level of each tenant to obtain the isolation strategy level of each tenant and the corresponding isolation strategy; The isolation strategy includes a data layer isolation strategy, an authority layer isolation strategy and a resource layer isolation strategy.
[0027] In the embodiment, the isolation strategies corresponding to different isolation strategy levels are different, and when the isolation strategy level is higher, the security requirement of the data layer isolation strategy of the corresponding isolation strategy is higher, the permission secrecy level of the authority layer isolation strategy is higher, and the resource allocation degree of the resource layer isolation strategy is higher.
[0028] In some embodiments of the present application, a multi-role permission model is constructed, including: setting a plurality of role categories based on a historical role creation library, generating a first historical behavior data set and a second historical behavior data set of each role category; generating a permission evaluation value of the corresponding role category according to the first historical behavior data set; generate an authority anomaly evaluation value of the corresponding role category according to the second historical behavior data set; set a first authority point number of the corresponding role category according to the authority evaluation value, perform authority point extraction based on the first authority point number and historical behavior data in the first historical behavior data set of the corresponding role category, and obtain a first authority point set of the corresponding role category; set a second authority point number of the corresponding role category according to the authority anomaly evaluation value, perform authority point extraction based on the second authority point number and historical behavior data in the second historical behavior data set of the corresponding role category, and obtain a second authority point set of the corresponding role category; generate the first authority point set and the second authority point set of each role category in turn; use each role category as training input data, use the first authority point set of the corresponding role category as a training output label set, and use the second authority point set of the corresponding role category as a training output pseudo label set; perform semi-supervised learning training based on the training input data, the training output label set, and the training output pseudo label set, and generate a multi-role authority model.
[0029] In this embodiment, the behavior data includes but is not limited to operation range, accessible resources, core function authority, etc. The first historical behavior data set refers to behavior data of the corresponding role category within the normal authority range, the second historical behavior data set refers to behavior data of the corresponding role category outside the normal authority range, and impact data generated by the corresponding behavior data.
[0030] In this embodiment, the authority evaluation value is calculated to accurately evaluate the authority range and authority division level of the corresponding role category. The historical behavior data in the first historical behavior data set is classified to obtain a plurality of behavior categories and is divided into levels in the order of "range from wide to narrow". A plurality of behavior characteristics of each behavior category are determined, and there is a superior-inferior relationship between the behavior characteristics. Each behavior characteristic is regarded as an authority point, a first authority point matrix is constructed, the rows of the matrix represent different behavior categories, the columns represent the authority points of a plurality of behavior characteristics of the same behavior category, and the rows and columns are arranged in order of behavior category range size and behavior characteristic level size.
[0031] In this embodiment, the historical role library is constructed according to a plurality of historical created roles.
[0032] In the embodiment, the frequency and influence degree of the role category are accurately evaluated by calculating the authority anomaly evaluation value, the historical behavior data in the second historical behavior data set is classified, a plurality of behavior categories are obtained, and the behavior categories are classified according to the range from wide to narrow, a plurality of behavior characteristics of each behavior category are determined, the behavior characteristics have a superior-inferior relationship, each behavior characteristic is regarded as an authority point, the second authority point matrix is constructed, the behaviors of the matrix are different behavior categories, the columns are a plurality of authority points of the same behavior category, and the matrix is arranged according to the behavior category anomaly probability and the behavior characteristic level.
[0033] In the embodiment, the first authority point set is obtained by extracting the authority points according to the first authority point number and the arrangement order in the first authority point matrix, and the second authority point set is obtained by extracting the authority points according to the second authority point number and the arrangement order in the second authority point matrix.
[0034] In the embodiment, the semi-supervised learning is a machine learning method combining the learning process of labeled data and unlabeled data. By combining the labeled data and the unlabeled data, the semi-supervised learning can overcome the limitation of limited labeled data, provide more data information, and improve the management efficiency of the authority points of each role category by using the unlabeled data, ensure the authority accuracy of each role category, and maintain the independence of each tenant and the flexibility of the platform.
[0035] In some embodiments of the present application, the calculation formula of the authority evaluation value is: ; Wherein, Q1 is the authority evaluation value, n1 is the number of authority evaluation indexes, is the authority sub-evaluation value of the i1th authority evaluation index generated by the historical behavior data in the first historical behavior data set, is the weight coefficient of the i1th authority evaluation index; The calculation formula of the authority anomaly evaluation value is: ; Wherein, Q2 is the authority anomaly evaluation value, n2 is the number of authority anomaly evaluation indexes, is the authority anomaly sub-evaluation value of the i2th authority anomaly evaluation index generated by the historical behavior data in the second historical behavior data set, is the weight coefficient of the i2th authority anomaly evaluation index.
[0036] In the embodiment, the abnormal evaluation indexes include, but are not limited to, an abnormal frequency of historical behavior data of the role category out of the normal permission range, an abnormal probability, and an influence degree of the behavior data on other role categories and tenants. When the abnormal frequency is more, the abnormal probability is greater, and the influence degree is greater, the corresponding permission abnormal evaluation value is greater, and vice versa.
[0037] In the embodiment, the permission evaluation indexes include, but are not limited to, a behavior category, a behavior level, and different behavior characteristics of the same behavior category of historical behavior data of the role category in the normal permission range. When the behavior category is more, the behavior level is higher, and the behavior characteristics are more, the corresponding permission evaluation value is greater, and vice versa.
[0038] In the embodiment, by setting the permission evaluation value and the permission abnormal evaluation value, the first permission point set and the second permission point set of each role category are determined, a multi-role permission model is constructed, a foundation is laid for subsequent determination of the initial permission of each role, the permission setting accuracy of each role is improved, the security requirements of different tenants are met, and the flexibility and ease of use of the platform are maintained.
[0039] In some embodiments of the present application, the initial permission of each role of different tenants is generated based on the multi-role permission model, including: calculating a similarity evaluation value of each role and a plurality of historical created roles in a historical created role library; if there is a similarity evaluation value greater than a preset similarity evaluation value, inputting the corresponding role into the multi-role permission model to obtain the initial permission of the corresponding role; if there is no similarity evaluation value greater than the preset similarity evaluation value; performing correlation analysis on the corresponding role, other roles, and a plurality of historical created roles to obtain a first correlation coefficient of the corresponding role and other roles, a second correlation coefficient between other roles, a third correlation coefficient of the corresponding role and historical created roles, and a fourth correlation coefficient between different historical created roles; obtaining a first associated role group and a second associated role group of the corresponding role according to the first correlation coefficient, the second correlation coefficient, the third correlation coefficient, and the fourth correlation coefficient; The first associated role group includes an upper associated role and a lower associated role, and the first associated role group includes an upper associated historical created role and a lower associated historical created role. generating a first predicted permission of the corresponding role according to the initial permission of the upper associated role and the initial permission of the lower associated role in the first associated role set, the first predicted permission including a plurality of pending permission points; The second predicted permission of the corresponding role is generated according to the historical permission of the upper associated history and the historical permission of the lower associated history of the role in the second associated role set, and the second predicted permission includes a plurality of pending permission points; The first predicted permission and the second predicted permission are compared and analyzed to obtain a plurality of same pending permission points, and the same pending permission points are set as the initial permission of the corresponding role.
[0040] In the embodiment, other roles with a first association coefficient greater than a preset first association coefficient are screened out, and a second association coefficient between the screened other roles is calculated. The two screened other roles with a second association coefficient greater than a preset second association coefficient are constructed as a first associated role group of the corresponding role, and the upper associated role and the lower associated role in the first associated role group are roles with set initial permissions. If no initial permission is set, a first associated role group is newly constructed.
[0041] In the embodiment, the historical created roles with a third association coefficient greater than a preset third association coefficient are screened out, and a fourth association coefficient between the screened historical created roles is calculated. The historical created roles screened out with a fourth association coefficient greater than a preset fourth association coefficient are constructed as a second associated role group of the corresponding role.
[0042] In the embodiment, the first predicted permission is obtained by performing permission correspondence according to a plurality of permission points in the initial permission of the upper associated role and a plurality of permission points in the initial permission of the lower associated role, and predicting the permission points of the corresponding role. The second predicted permission is obtained by performing permission correspondence according to a plurality of permission points in the historical permission of the upper associated history created role and a plurality of permission points in the historical permission of the lower associated history created role, and predicting the permission points of the corresponding role.
[0043] In the embodiment, the same pending permission points are obtained by comparing and analyzing the first predicted permission and the second predicted permission, and the same pending permission points are set as the initial permission of the corresponding role. The initial permission includes a plurality of permission points, i.e., the same pending permission points.
[0044] In the embodiment, the judgment method of the initial permission of each role is determined through similarity analysis and association analysis, so as to obtain the initial permission of each role, improve the permission management efficiency of the corresponding role, lay a foundation for subsequent execution test, ensure that the test platform can meet the security requirements of enterprises of different scales, and maintain the flexibility and ease of use of the platform.
[0045] In some embodiments of the present application, a plurality of test scenarios and a virtual test unit of each role are constructed, the virtual test unit is tested based on the plurality of test scenarios, and a comprehensive test evaluation value of each role is generated according to the test result, including: A plurality of independent containers are created based on containerization technology, and the corresponding independent container is rendered according to the initial permission, behavior data and actual environment of each role, to obtain a virtual test unit of each role; A plurality of test scenes are constructed in advance, and each test scene is mapped with corresponding test data and a test level; Each test scene is mapped with a plurality of test data, and the virtual test unit is executed for test, to obtain a test result, which includes a plurality of test corresponding data; According to the test result, a test evaluation value of the virtual test unit for each test scene is generated, and a comprehensive test evaluation value of the corresponding role is generated according to a plurality of test evaluation values.
[0046] In the embodiment, the test scene includes, but is not limited to, permission design test, permission compliance test, permission change test, multi-role cooperation test, abnormal extreme situation test, performance stress test, etc. of a single virtual test unit, and the test level is set in advance.
[0047] In the embodiment, the behavior data refers to the behavior trace and operation record of each user in the corresponding tenant, which is predictable. The test corresponding data corresponds to the test data of the test scene one by one, and the test corresponding data refers to the data actually generated after each test data is input into the virtual test unit.
[0048] In the embodiment, a plurality of independent containers are created by containerization technology, and a virtual test unit of each user is rendered. The virtual test unit is tested according to the test scene constructed in advance, to obtain a test result. The permission setting accuracy of each virtual test unit is evaluated according to the test result, and the permission is adjusted in time to improve the management efficiency of the test system.
[0049] In some embodiments of the present application, the comprehensive test evaluation value of the corresponding role is generated according to a plurality of test evaluation values, including: A plurality of test evaluation indexes of each test scene are set in advance; The data source of a plurality of test corresponding data in the test result of each test scene is mapped with the virtual test unit, to obtain a test corresponding data group of each virtual test unit for each test scene; Based on the test corresponding data group of each virtual test unit for each test scene, a test sub-evaluation value of each test evaluation index of the corresponding test scene is generated, and a test evaluation value of each virtual test unit for the corresponding test scene is generated in combination with a weight coefficient of the corresponding test evaluation index; According to the test evaluation value of the same virtual test unit for all test scenes and the test level of the corresponding test scene, a comprehensive test evaluation value of the corresponding virtual test unit is generated.
[0050] In the embodiment, the test evaluation indexes are set according to the test scenarios. If the test scenario is performance stress test, that is, high concurrent permission request in the virtual test unit, the test evaluation indexes include, but are not limited to, response capability of the virtual test unit under concurrent permission request, permission stability, operation compliance, and bearing capacity, etc. The permission processing capability of each virtual test unit is comprehensively evaluated through the test evaluation indexes. The greater the capability is, the greater the test evaluation value is, and vice versa.
[0051] In the embodiment, the standard test corresponding data of each test evaluation index is compared with the test corresponding data group. The greater the data consistency is, the greater the test sub-evaluation value is, and vice versa.
[0052] In the embodiment, the greater the test sub-evaluation value is, the greater the test evaluation value is, and vice versa.
[0053] In the embodiment, the comprehensive test evaluation value of each user is calculated to determine whether the permission of the corresponding user needs to be adjusted, so as to ensure the accuracy of the permission management of each user and improve the team cooperation efficiency.
[0054] In some embodiments of the present application, the calculation formula of the comprehensive test evaluation value is: ; Wherein, Z is the comprehensive test evaluation value, w is the number of test scenarios, is the test evaluation value of the virtual test unit of the corresponding role for the s th test scenario, ds is the test level of the s th test scenario, and rs is the weight conversion coefficient of the test level of the s th test scenario.
[0055] In the embodiment, the higher the test level is, the greater the weight conversion coefficient is.
[0056] In some embodiments of the present application, it is determined whether to adjust the initial permission of the role according to the comprehensive test evaluation value. If yes, a permission management strategy is generated, including: a comprehensive test evaluation value threshold is set in advance; if the comprehensive test evaluation value is less than the comprehensive test evaluation value threshold, it is determined to adjust the initial permission of the corresponding role; if the comprehensive test evaluation value is not less than the comprehensive test evaluation value threshold, it is determined not to adjust the initial permission of the corresponding role; when the initial permission of the corresponding role is adjusted; the to-be-adjusted permission point of the corresponding role and the corresponding to-be-adjusted sub-strategy are determined according to the test evaluation value of each test scenario and the test sub-evaluation value of each test evaluation index of each test scenario; The role is generated according to the role corresponding to a plurality of to be adjusted permission points and the corresponding to be adjusted sub-strategy.
[0057] In the embodiment, the test scene whose test evaluation value is less than the test evaluation value threshold is screened, the test evaluation index whose test sub-evaluation value is less than the test sub-evaluation value threshold is screened, the to-be-adjusted permission point is locked according to the screened test evaluation index and the corresponding test corresponding data, and the to-be-adjusted sub-strategy of the corresponding to-be-adjusted permission point is generated according to the standard test corresponding data of the test evaluation index, and the to-be-adjusted sub-strategy includes permission reduction, addition and deletion, etc.
[0058] In the embodiment, the comprehensive test evaluation value threshold, the test evaluation value threshold and the test sub-evaluation value threshold are all minimum evaluation values meeting the test requirements.
[0059] In the embodiment, the test system management efficiency is improved by calculating the comprehensive test evaluation value, timely discovering and generating the permission management strategy, and clearly defining the permissions of different roles.
[0060] The above only describes the preferred embodiments of the present application, and it should be noted that, for those skilled in the art, without departing from the technical principles of the present application, a plurality of improvements and replacements can be made, and these improvements and replacements should also be considered as the protection scope of the present application.
Claims
1. A multi-role based test system management method, characterized by, The method comprises the following steps: creating a plurality of tenants, obtaining basic information of users inside each tenant, and assigning roles to the users according to the basic information; building a multi-role permission model, and generating initial permissions of each role of different tenants based on the multi-role permission model, wherein the initial permissions comprise a plurality of preset permission points; building a plurality of test scenarios and a virtual test unit of each role, testing the virtual test unit based on the plurality of test scenarios, and generating a comprehensive test evaluation value of each role according to a test result; determining whether to adjust the initial permissions of the role according to the comprehensive test evaluation value, and if so, generating a permission management strategy.
2. The role-based test system management method of claim 1, wherein, The method comprises the following steps: obtaining a current actual organizational structure, matching a corresponding mapping scenario according to the actual organizational structure, and determining a plurality of mapping features of the current mapping scenario; creating a plurality of tenants based on the plurality of mapping features of the current mapping scenario, and setting an isolation strategy of each tenant; obtaining a plurality of users inside each tenant and basic information of each user based on a mapping relationship between a user information library and each tenant; determining a feature user in the tenant according to the basic information of the user, customizing a role of the feature user to basic information of the remaining users, and assigning the feature user to a corresponding user.
3. The role-based test system management method of claim 2, wherein, The method comprises the following steps: determining a value category and a sensitive level of the tenant; traversing a preset isolation strategy library according to the value category and the sensitive level of each tenant to obtain an isolation strategy level and a corresponding isolation strategy of each tenant; the isolation strategy comprises a data layer isolation strategy, a permission layer isolation strategy, and a resource layer isolation strategy.
4. The role-based test system management method of claim 3, wherein, The method comprises the following steps: setting a plurality of role categories based on a historical created role library, generating a first historical behavior data set and a second historical behavior data set of each role category; generating a permission evaluation value of the corresponding role category according to the first historical behavior data set; generating a permission anomaly evaluation value of the corresponding role category according to the second historical behavior data set; setting a first number of permission points of the corresponding role category according to the permission evaluation value, and extracting the permission points based on the first number of permission points and historical behavior data in the first historical behavior data set of the corresponding role category to obtain a first permission point set of the corresponding role category; setting a second number of permission points of the corresponding role category according to the permission anomaly evaluation value, and extracting the permission points based on the second number of permission points and historical behavior data in the second historical behavior data set of the corresponding role category to obtain a second permission point set of the corresponding role category; generating the first permission point set and the second permission point set of each role category in turn; taking each role category as training input data, taking the first permission point set of the corresponding role category as a training output label set, and taking the second permission point set of the corresponding role category as a training output pseudo label set; performing semi-supervised learning training based on the training input data, the training output label set, and the training output pseudo label set to generate a multi-role permission model.
5. The multi-role based test system management method of claim 4, wherein The calculation formula of the permission evaluation value is: ; Wherein, Q1 is the authority evaluation value, n1 is the number of authority evaluation indexes, The authority sub-evaluation value of the i1th authority evaluation index generated for the historical behavior data in the first historical behavior data set, The weight coefficient of the i1th authority evaluation index. The calculation formula of the permission abnormal evaluation value is: ; Wherein, Q2 is the authority anomaly evaluation value, n2 is the number of authority anomaly evaluation indexes, The authority anomaly sub-evaluation value of the i2th authority anomaly evaluation index generated for the historical behavior data in the second historical behavior data set, The weight coefficient of the i2th authority anomaly evaluation index.
6. The role-based test system management method of claim 5, wherein, Generating initial permissions of each role of different tenants based on the multi-role permission model, including: Calculating a similarity evaluation value of each role and a plurality of historical created roles in a historical created role library; If there is a similarity evaluation value greater than a preset similarity evaluation value, input the corresponding role into the multi-role permission model to obtain the initial permissions of the corresponding role; If there is no similarity evaluation value greater than the preset similarity evaluation value; Correlation analysis of the corresponding role, other roles and a plurality of historical created roles is performed to obtain a first correlation coefficient of the corresponding role and other roles, a second correlation coefficient between other roles, a third correlation coefficient of the corresponding role and historical created roles, and a fourth correlation coefficient between different historical created roles; According to the first correlation coefficient, the second correlation coefficient, the third correlation coefficient and the fourth correlation coefficient, a first associated role group and a second associated role group of the corresponding role are obtained; The first associated role group includes an upper associated role and a lower associated role, and the first associated role group includes an upper associated historical created role and a lower associated historical created role; According to the initial permissions of the upper associated role and the initial permissions of the lower associated role in the first associated role set, a first predicted permission of the corresponding role is generated, and the first predicted permission includes a plurality of pending permission points; According to the historical permissions of the upper associated historical created role and the historical permissions of the lower associated historical created role in the second associated role set, a second predicted permission of the corresponding role is generated, and the second predicted permission includes a plurality of pending permission points; Comparative analysis of the first predicted permission and the second predicted permission is performed to obtain a plurality of same pending permission points, and the same pending permission points are set as the initial permissions of the corresponding role.
7. The role-based test system management method of claim 6, wherein, A plurality of test scenarios and virtual test units of each role are constructed, and the virtual test units are tested based on the plurality of test scenarios, and a comprehensive test evaluation value of each role is generated according to the test results, including: A plurality of independent containers are created based on containerization technology, and the corresponding independent containers are rendered according to the initial permissions, behavior data and actual environment of each role to obtain the virtual test units of each role; A plurality of test scenarios are constructed in advance, and each test scenario is mapped with corresponding test data and test levels; Each virtual test unit is executed according to the plurality of test data mapped by each test scenario to obtain test results, and the test results include a plurality of test corresponding data; According to the test results, a test evaluation value of the virtual test unit for each test scenario is generated, and a comprehensive test evaluation value of the corresponding role is generated according to a plurality of test evaluation values.
8. The role-based test system management method of claim 7, wherein, According to a plurality of test evaluation values, a comprehensive test evaluation value of the corresponding role is generated, including: A plurality of test evaluation indexes of each test scenario are preset; The data sources of the plurality of test corresponding data in the test results of each test scenario are mapped with the virtual test units to obtain a test corresponding data group of each virtual test unit for each test scenario; The test sub-evaluation value of each test evaluation index of the corresponding test scene is generated based on the test corresponding data set of each virtual test unit for each test scene, and the test evaluation value of the corresponding test scene of each virtual test unit is generated by combining the weight coefficient of the corresponding test evaluation index; The comprehensive test evaluation value of the corresponding virtual test unit is generated according to the test evaluation values of the same virtual test unit for all test scenes and the test levels of the corresponding test scenes.
9. The multi-role based test system management method of claim 8, wherein, The calculation formula of the comprehensive test evaluation value is: ; Wherein, Z is a comprehensive test evaluation value, w is the number of test scenarios, is the test evaluation value of the corresponding role virtual test unit for the s th test scenario, ds is the test level of the s th test scenario, and rs is the weight conversion coefficient of the test level of the s th test scenario.
10. The role-based test system management method of claim 8, wherein, It is judged whether to adjust the initial permission of the role according to the comprehensive test evaluation value, if yes, a permission management strategy is generated, including: A comprehensive test evaluation value threshold is preset; If the comprehensive test evaluation value is less than the comprehensive test evaluation value threshold, it is judged to adjust the initial permission of the corresponding role; If the comprehensive test evaluation value is not less than the comprehensive test evaluation value threshold, it is judged not to adjust the initial permission of the corresponding role; When the initial permission of the corresponding role is adjusted; The to-be-adjusted permission points and the corresponding to-be-adjusted sub-strategies of the corresponding role are determined according to the test evaluation value of each test scene and the test sub-evaluation value of a plurality of test evaluation indexes of each test scene; The permission management strategy of the corresponding role is generated according to a plurality of to-be-adjusted permission points and the corresponding to-be-adjusted sub-strategies of the corresponding role.
