Grayscale user management method and system

Abstract

The invention relates to a grayscale user management method and system. The method comprises the following steps: creating an initial environment for grayscale release; setting a gray level user screening condition and storing the gray level user screening condition as a gray level configuration strategy; filtering users based on a gray level configuration strategy to obtain a primary gray level user set; setting a test target of a gray scale test, and further setting refined test nodes; setting a specific test task and a test result evaluation threshold for each test node; issuing a test flow to all gray level users, wherein the test flow comprises at least two test nodes which need to be completed in sequence; and collecting use data of the gray level users, and carrying out summarization analysis. According to the method, multi-dimensional, flexible and configurable gray user setting can be supported, and meanwhile, a real-time monitoring and feedback mechanism is realized, so that the high efficiency, stability and controllability of the gray release process are ensured.

Description

Technical Field

[0001] The present invention relates to the technical field of software or service testing, and in particular to a grayscale user management method and system. Background Art

[0002] With the increasing acceleration of software development cycles and the significant increase in iteration frequency, grayscale release, as an efficient and critical software deployment method, has been widely popularized and highly valued in the business community.

[0003] Grayscale release is a release method that uses a gradual advancement and amplification strategy when updating software or launching new features to ensure system stability and user experience. It allows some users to experience the new version or new features first, and evaluates the performance of the new version by collecting feedback from these users, and then decides whether to continue to expand the scope of the new version until the full upgrade or adjust or even roll back to the old version based on the feedback results.

[0004] Grayscale users are a group of users who are selected during the grayscale release process and are given the privilege of experiencing new versions or new features first. The selection of these users is usually based on certain strategies, such as user characteristics, number of users, user-common functions, user range, etc., to ensure the representativeness and effectiveness of feedback.

[0005] The traditional grayscale release model often relies on a set of fixed rules or simple user classification standards. This method may be competent for simple scenarios, but its limitations become particularly prominent when faced with complex and changeable enterprise-level application scenarios. Specifically, the traditional grayscale release model is difficult to effectively respond to highly customized needs, and cannot flexibly adjust the scope and characteristics of grayscale users according to the company's specific business needs, testing strategies, and even market dynamics. This not only limits the accuracy and effectiveness of grayscale testing, but also increases the uncertainty and risk in the software release process.

[0006] The information disclosed in this background technology section is only intended to deepen the understanding of the overall background technology of the present invention, and should not be regarded as acknowledging or suggesting in any form that the information constitutes the prior art already known to those skilled in the art. Summary of the invention

[0007] In view of the defects existing in the prior art, the purpose of the present invention is to provide a grayscale user management method and system, which can support multi-dimensional, flexible and configurable grayscale user settings, and at the same time realize real-time monitoring and feedback mechanism to ensure the efficiency, stability and controllability of the grayscale publishing process.

[0008] In order to achieve the above purpose, the technical solution adopted by the present invention is:

[0009] A grayscale user management method, characterized by comprising:

[0010] Create an initial environment for grayscale release;

[0011] Set grayscale user screening conditions and save them as grayscale configuration policies;

[0012] Filter users based on the grayscale configuration strategy to obtain a primary grayscale user set;

[0013] Set the test objectives of the grayscale test and further set detailed test nodes;

[0014] Set specific test tasks and test result evaluation thresholds for each test node;

[0015] Send a test process to all grayscale users, where the test process includes at least two test nodes that need to be completed in sequence;

[0016] Collect usage data of Grayscale users and conduct summary analysis.

[0017] On the basis of the above technical solution, the grayscale users are divided into at least three groups according to the total number of users in the primary grayscale user set, and the users are labeled based on the user portraits to form several first-level user labels. There is a one-to-many correspondence between users and first-level user labels.

[0018] Based on the above technical solution, at least one test target is activated from the preset test targets, and the preset test targets include: verifying new functions, fixing known bugs, and evaluating performance improvements;

[0019] Determine specific test requirements and test scope based on the activated test objectives, including at least: functional modules to be tested, performance indicators to be tested, and user experience to be fed back;

[0020] Bind the functional modules to be tested and the performance indicators to be tested to form a test node set.

[0021] On the basis of the above technical solution, the test task specifically includes: a test schedule, a test environment, and at least one group of grayscale users;

[0022] The test result evaluation threshold corresponds to the performance indicator to be tested, and at least includes an upper threshold limit or a lower threshold limit.

[0023] On the basis of the above technical solution, after collecting the usage data of a group of grayscale users according to the test process, the users who found potential problems or potential defects are determined through summary analysis, and the users who have not participated in the test process are screened from the users based on the user tags to form a verification user set. The user tags refer to primary user tags and secondary user tags. The primary user tags correspond to grayscale users who have not participated in the test, and the secondary user tags correspond to grayscale users who have participated in the test at least once. The priority of the secondary user tags is higher than that of the primary user tags.

[0024] Verify that the grayscale users in the user set repeat the test process and confirm whether the potential problems or defects can still be reproduced.

[0025] On the basis of the above technical solution, for the grayscale users who have completed the test process, the test nodes participating in the test are updated. After collecting the user behavior, the user portrait is summarized and updated. Based on the updated user portrait, the secondary user label of the grayscale user is formed. There is a one-to-many correspondence between the user and the secondary user label.

[0026] Based on the above method, a grayscale user management system is also provided, which is characterized by comprising:

[0027] Initialization module, used to create the initial environment for grayscale release;

[0028] User screening module, used to set grayscale user screening conditions and store them as grayscale configuration policies;

[0029] A user filtering module is used to filter users based on the grayscale configuration strategy to obtain a primary grayscale user set;

[0030] The test target setting module is used to set the test target of the grayscale test and further set detailed test nodes; it is used to set specific test tasks and test result evaluation thresholds for each test node;

[0031] A test process publishing module is used to issue a test process to all grayscale users, wherein the test process includes at least two test nodes that need to be completed in sequence;

[0032] The data collection module is used to collect usage data of grayscale users and conduct summary analysis.

[0033] On the basis of the above technical solutions, it also includes:

[0034] The user labeling module is used to label users based on user portraits to form several primary user labels; and to form secondary user labels for grayscale users based on updated user portraits.

[0035] Based on the above method, a computer-readable storage medium is also provided, wherein the computer-readable storage medium includes a stored program, wherein when the program is running, the device where the computer-readable storage medium is located is controlled to execute any one of the grayscale user management methods described above.

[0036] The grayscale user management method and system described in the present invention have the following beneficial effects:

[0037] 1. Configurable grayscale user management system;

[0038] The attributes of grayscale users can be flexibly set according to the actual business needs, testing strategies and even market feedback of the enterprise. This not only helps to improve the accuracy and effectiveness of grayscale testing, but also meets the personalized needs of different enterprises for grayscale user management.

[0039] 2. Support dynamic configuration of multi-dimensional grayscale strategies;

[0040] In order to better adapt to the complex and ever-changing enterprise-level application scenarios, a dynamic configuration method that supports multiple grayscale strategies is adopted. The strategies include but are not limited to division by multiple dimensions such as user ID, geographic location, device type, and user behavior. Through multi-dimensional strategy configuration, the scope and characteristics of grayscale users can be more accurately controlled to ensure the comprehensiveness and representativeness of grayscale testing. At the same time, the ability of dynamic configuration also enables the system to flexibly adjust as business needs change, maintaining its adaptability and vitality.

[0041] 3. Real-time monitoring and feedback mechanism;

[0042] The system can automatically collect usage data of grayscale users, including but not limited to function usage, performance, stability evaluation, etc. After the data is aggregated and analyzed, it will form a valuable feedback report to provide decision-making reference for administrators and ensure that problems in the grayscale release process can be discovered and handled in a timely manner;

[0043] The system can also use the preset alarm mechanism to promptly issue an alarm when a potential problem is discovered, ensuring that the problem is responded to and handled in a timely manner;

[0044] The grayscale user management method and system described in the present invention can significantly improve the efficiency and security of software release; on the one hand, the highly configurable grayscale user management system and real-time monitoring and feedback mechanism make the grayscale testing process more accurate and efficient; on the other hand, the dynamic configuration capability of the multi-dimensional grayscale strategy enables enterprises to flexibly adjust the grayscale testing strategy according to different business needs and market feedback, reducing the uncertainty and risk in the release process. The present invention not only improves the accuracy and effectiveness of grayscale testing, but also enhances the flexibility and security of the software release process, providing strong support for the rapid iteration and optimization of enterprise-level software. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] The present invention has the following accompanying drawings:

[0046] The accompanying drawings are used to better understand the present invention and do not constitute an improper limitation of the present invention.

[0047] Figure 1 A flowchart of embodiment 1 of a grayscale user management method and system according to the present invention.

[0048] Figure 2 System architecture diagram of embodiment 1 of a grayscale user management method and system described in the present invention. DETAILED DESCRIPTION

[0049] The present invention is further described in detail below in conjunction with the accompanying drawings. The detailed description is an explanation made in conjunction with the exemplary embodiments of the present invention, including various details of the embodiments of the present invention to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those skilled in the art that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of the present invention. Similarly, for the sake of clarity and conciseness, the description of well-known functions and structures is omitted in the following description.

[0050] like Figure 1 As shown, the grayscale user management method described in the present invention includes:

[0051] Create an initial environment for grayscale release;

[0052] Set grayscale user screening conditions and save them as grayscale configuration policies;

[0053] Filter users based on the grayscale configuration strategy to obtain a primary grayscale user set;

[0054] Set the test objectives of the grayscale test and further set detailed test nodes;

[0055] Set specific test tasks and test result evaluation thresholds for each test node;

[0056] Send a test process to all grayscale users, where the test process includes at least two test nodes that need to be completed in sequence;

[0057] Collect usage data of Grayscale users and conduct summary analysis.

[0058] This embodiment covers the entire process from environment preparation, user screening, test goal setting, test node refinement, task and threshold setting, test process distribution to data collection and analysis. This management method aims to ensure the effectiveness and stability of new products or functions in specific user groups through refined management and evaluation, and provide strong support for the comprehensive promotion of products.

[0059] On the basis of the above technical solution, the grayscale users are divided into at least three groups according to the total number of users in the primary grayscale user set, and the users are labeled based on the user portraits to form several first-level user labels. There is a one-to-many correspondence between users and first-level user labels.

[0060] Exemplarily, the user portrait includes at least the following information: user ID, user device type, user level, and geographic location.

[0061] This embodiment divides grayscale users into multiple groups and labels them based on user portraits. By dividing grayscale users into different groups, more targeted test tasks and goals can be set according to the user characteristics of different groups. For example, one group may include highly active users, another group may include users in a specific geographical location, and the third group may include users in the average activity range and the widest age range. In this way, different test scenarios can be designed based on these characteristics to more comprehensively evaluate the performance of new products or features in different user groups.

[0062] In addition, when resources are limited, group management can be used to allocate testing resources more effectively. For example, for functions with more expected problems or higher risks, more testing resources and attention can be allocated to groups containing high-risk user groups to ensure that these problems are discovered and resolved in a timely manner.

[0063] By labeling users through user portraits, user characteristics can be more carefully described, including user ID, device type, user level, geographic location, etc. These labels not only help to group users more accurately, but also provide more detailed data support for subsequent test task design, result analysis and product optimization. After labeling is completed, based on user portraits and grouping results, in-depth analysis of usage data of different user groups can be conducted to understand their behavior patterns and preferences when using new products or functions. These analysis results can provide strong support for companies to formulate more accurate marketing strategies, optimize product functions and improve user experience.

[0064] To sum up the above, through refined grayscale user management, we can ensure that new products or features have been fully tested and verified before they are launched to market, reducing potential problems and failures, which helps to improve user satisfaction and trust in new products or features, and thus promote the overall promotion and success of the product.

[0065] Based on the above technical solution, at least one test target is activated from the preset test targets, and the preset test targets include: verifying new functions, fixing known bugs, and evaluating performance improvements;

[0066] Determine specific test requirements and test scope based on the activated test objectives, including at least: functional modules to be tested, performance indicators to be tested, and user experience to be fed back;

[0067] Bind the functional modules to be tested and the performance indicators to be tested to form a test node set.

[0068] This embodiment can ensure that the test work focuses directly on the key improvement points and potential problems of the product or function by selecting and activating specific test targets from the preset test targets, which not only reduces unnecessary test work, but also improves the efficiency and quality of the test. Based on the activated test targets, the specific test requirements and test scope are determined, including the functional modules to be tested, the performance indicators to be tested, and the user experience to be fed back, etc., which provide clear guidance and basis for the test work, help the test team to plan the test plan more systematically, and ensure the comprehensiveness and depth of the test work. Binding the functional modules to be tested and the performance indicators to be tested to form a test node set, this practice helps to realize the collaborative testing of functional modules and performance indicators during the test process. In this way, the performance of new functions or repaired functions in actual use can be more comprehensively evaluated, including its stability, efficiency and user experience. In addition, the test work is refined into a specific test node set, and detailed test planning and execution are carried out for each node, which can ensure the reliability and effectiveness of the test results.

[0069] On the basis of the above technical solution, the test task specifically includes: a test schedule, a test environment, and at least one group of grayscale users;

[0070] The test result evaluation threshold corresponds to the performance indicator to be tested, and at least includes an upper threshold limit or a lower threshold limit.

[0071] This embodiment further clarifies the specific content of the test task and the setting of the test result evaluation threshold. By specifying the test task, including setting a test schedule, clarifying the test environment, and selecting at least one group of grayscale users, the test work is made more operational. The test team can proceed with the test work in an orderly manner based on this specific information, reducing confusion and delays caused by unclear information. Clear test environment and grayscale user group selection help ensure the accuracy and consistency of test results. Different test environments and user groups may have different effects on test results. Therefore, by fixing these variables, new functions or repair effects can be better evaluated.

[0072] This embodiment provides a clear evaluation standard for the test results by setting an evaluation threshold (including an upper threshold or a lower threshold) corresponding to the performance indicator to be tested, which enables the tester to objectively judge whether the test results meet expectations and make corresponding decisions. By setting specific evaluation thresholds, the subjectivity and uncertainty in the evaluation process can be reduced. The tester can quantitatively evaluate the test results based on these thresholds, thereby drawing more accurate and fair conclusions.

[0073] On the basis of the above technical solution, after collecting the usage data of a group of grayscale users according to the test process, the users who found potential problems or potential defects are determined through summary analysis, and the users who have not participated in the test process are screened from the users based on the user tags to form a verification user set. The user tags refer to primary user tags and secondary user tags. The primary user tags correspond to grayscale users who have not participated in the test, and the secondary user tags correspond to grayscale users who have participated in the test at least once. The priority of the secondary user tags is higher than that of the primary user tags.

[0074] Verify that the grayscale users in the user set repeat the test process and confirm whether the potential problems or defects can still be reproduced.

[0075] The advantages of this embodiment are: on the one hand, by introducing a new set of verified users, especially those users who have not participated in the test before, the coverage of the test can be further expanded. These users may have different usage habits, device configurations or network environments, which is helpful to discover problems that were not covered by previous tests; on the other hand, multiple tests by different user groups can increase the credibility of the test results. If multiple users can reproduce the same problem in different test environments, then this problem is more likely to be real rather than accidental.

[0076] In order to improve the efficiency and accuracy of the test, this embodiment uses a user tag system (primary user tags and secondary user tags) to more quickly screen out qualified verification users, especially secondary user tags (grayscale users who have participated in the test at least once). Since they have test experience, they may be more likely to understand and perform test tasks, thereby locating problems more quickly. Once the problem is verified to be real, the development team can develop a solution more quickly. When testing in this way, since there is already feedback and test data from multiple users, the solution will be more targeted and effective.

[0077] On the basis of the above technical solution, for the grayscale users who have completed the test process, the test nodes participating in the test are updated. After collecting the user behavior, the user portrait is summarized and updated. Based on the updated user portrait, the secondary user label of the grayscale user is formed. There is a one-to-many correspondence between the user and the secondary user label.

[0078] Based on the above technical solution, Figure 2 As shown, the grayscale user management system described in the present invention includes:

[0079] Initialization module, used to create the initial environment for grayscale release;

[0080] User screening module, used to set grayscale user screening conditions and store them as grayscale configuration policies;

[0081] A user filtering module is used to filter users based on the grayscale configuration strategy to obtain a primary grayscale user set;

[0082] The test target setting module is used to set the test target of the grayscale test and further set detailed test nodes; it is used to set specific test tasks and test result evaluation thresholds for each test node;

[0083] A test process publishing module is used to issue a test process to all grayscale users, wherein the test process includes at least two test nodes that need to be completed in sequence;

[0084] The data collection module is used to collect usage data of grayscale users and conduct summary analysis.

[0085] On the basis of the above technical solutions, it also includes:

[0086] The user labeling module is used to label users based on user portraits to form several primary user labels; and to form secondary user labels for grayscale users based on updated user portraits.

[0087] The contents not described in detail in this specification belong to the prior art known to professional and technical personnel in this field.

[0088] The above description is only a preferred embodiment of the present invention, and the protection scope of the present invention is not limited to the above embodiment. Any equivalent modifications or changes made by those skilled in the art based on the contents disclosed by the present invention should be included in the protection scope recorded in the claims.

Claims

1. A grayscale user management method, characterized in that: include: Create an initial environment for grayscale release; Set grayscale user screening conditions and save them as grayscale configuration policies; Filter users based on the grayscale configuration strategy to obtain a primary grayscale user set; Set the test objectives of the grayscale test and further set detailed test nodes; Set specific test tasks and test result evaluation thresholds for each test node; Send a test process to all grayscale users, where the test process includes at least two test nodes that need to be completed in sequence; Collect usage data of Grayscale users and conduct summary analysis.

2. A grayscale user management method as claimed in claim 1, characterized in that: According to the total number of users in the primary grayscale user set, the grayscale users are divided into at least three groups, and the users are labeled based on the user portraits to form several primary user labels. There is a one-to-many correspondence between users and primary user labels.

3. A grayscale user management method as claimed in claim 1, characterized in that: Activate at least one test target from preset test targets, wherein the preset test targets include: verifying new functions, fixing known bugs, and evaluating performance improvements; Determine specific test requirements and test scope based on the activated test objectives, including at least: functional modules to be tested, performance indicators to be tested, and user experience to be fed back; Bind the functional modules to be tested and the performance indicators to be tested to form a test node set.

4. A grayscale user management method as claimed in claim 1, characterized in that: The test task specifically includes: a test schedule, a test environment, and at least one group of grayscale users; The test result evaluation threshold corresponds to the performance indicator to be tested, and at least includes an upper threshold limit or a lower threshold limit.

5. A grayscale user management method as claimed in claim 1, characterized in that: After collecting the usage data of a group of grayscale users according to the test process, determine the users who discovered potential problems or potential defects through summary analysis, and screen users from users who have not participated in the test process based on user tags to form a verification user set. The user tags refer to primary user tags and secondary user tags. The primary user tags correspond to grayscale users who have not participated in the test, and the secondary user tags correspond to grayscale users who have participated in the test at least once. The priority of the secondary user tags is higher than that of the primary user tags. Verify that the grayscale users in the user set repeat the test process and confirm whether the potential problems or defects can still be reproduced.

6. A grayscale user management method as claimed in claim 1, characterized in that: For grayscale users who have completed the test process, update the test nodes in which they participate in the test. After collecting user behaviors, summarize and update user portraits. Based on the updated user portraits, form secondary user labels for grayscale users. There is a one-to-many correspondence between users and secondary user labels.

7. A grayscale user management system, characterized in that: include: Initialization module, used to create the initial environment for grayscale release; User screening module, used to set grayscale user screening conditions and store them as grayscale configuration policies; A user filtering module is used to filter users based on the grayscale configuration strategy to obtain a primary grayscale user set; The test target setting module is used to set the test target of the grayscale test and further set detailed test nodes; Used to set specific test tasks and test result evaluation thresholds for each test node; A test process publishing module is used to issue a test process to all grayscale users, wherein the test process includes at least two test nodes that need to be completed in sequence; The data collection module is used to collect usage data of grayscale users and conduct summary analysis.

8. A grayscale user management system as claimed in claim 7, characterized in that: Also includes: User labeling module, used to label users based on user portraits to form several primary user labels; Used to form secondary user labels for grayscale users based on updated user profiles.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a stored program, wherein when the program is executed, the device where the computer-readable storage medium is located is controlled to execute the grayscale user management method according to any one of claims 1 to 6.

Images