Method and system for updating ab test configuration of game operation data

Abstract

The application provides an AB test configuration updating method and system for game operation data, which comprises setting a basic configuration and an AB test configuration; the basic configuration comprises the same configuration content in multiple game versions, and the AB test configuration comprises different configuration content in multiple game versions; when an AB test effective instruction comprising a game version is received, the corresponding basic configuration and AB test configuration are read according to the game version, and the configuration of the game version is updated. When the configuration of the game version needs to be updated, the basic configuration, the AB test configuration or the basic configuration and the AB test configuration can be updated separately according to different game versions, so that the problem that the configuration which does not change is also updated when the game version is updated in the prior art is avoided, and the workload is repeated. The method is flexible and universal, and greatly reduces the configuration maintenance difficulty and workload of the AB test.

Description

Technical Field

[0001] This invention belongs to the field of data analysis, specifically relating to a method and system for updating A / B testing configurations for game operation data. Background Technology

[0002] Game data operations primarily involve modifying game configuration data to monitor changes in various key analytical metrics. These metrics include changes in user retention rate, user playtime, and ad viewing frequency. This allows for data-driven configuration updates to capture changes in key analytical metrics without altering the game's logic. Therefore, the quality of in-game data operations and analysis is a crucial factor influencing the game's lifespan and quality after launch.

[0003] Currently, the most commonly used method for game data operation and analysis is A / B testing. A / B testing involves having a certain number of qualified users participate in two groups, A and B, for the same test. Group A uses the standard configuration across a specific version range of the game, while Group B uses a configuration obtained by making very minor changes to Group A's configuration. Therefore, Group A and Group B differ only in a small amount of configuration variation, and the resulting changes in various key analytical indicators are observed. This facilitates testing the impact of specific configurations on key analytical indicator data.

[0004] A / B testing allows users to be divided into different configurations for comparative analysis, making it suitable for refined data-driven operations. However, current A / B testing methods present challenges such as difficult maintenance and high workload for the A / B group configurations. For example, every time the basic configuration is added, deleted, or modified, it must be synchronized to the B group configuration and uploaded to the server together. Summary of the Invention

[0005] To address the shortcomings of existing technologies, this invention provides a method and system for updating A / B testing configurations for game operation data, which greatly reduces the difficulty and workload of A / B testing configuration and maintenance.

[0006] Firstly, a method for updating A / B testing configurations for game operation data includes the following steps:

[0007] Settings; Basic configuration includes the same configuration content in multiple game versions, while A / B test configuration includes different configuration content in multiple game versions;

[0008] When an A / B test activation command is received, including the game version, the corresponding basic configuration and A / B test configuration are read according to the game version, and the game version configuration is updated based on the basic configuration and A / B test configuration.

[0009] Preferably, both the basic configuration and the A / B test configuration include:

[0010] Minimum version: The minimum game version applicable to the game;

[0011] Configuration content: Includes the content set according to the preset configuration format.

[0012] Preferably, the game version includes a major version number, a minor version number, and a revision number: the major version number, minor version number, and revision number are all integers from 0 to 999.

[0013] Preferably, the game version is determined in the following way:

[0014] Calculate the version number of the game:

[0015] Version number = Major version number × 1,000,000 + Minor version number × 1,000 + Revision number;

[0016] In comparing two game versions, the game version with the larger version number is considered higher.

[0017] Preferably, after setting the basic configuration and A / B test configuration, the following is also included:

[0018] When a new basic configuration or A / B test configuration is received, the new basic configuration or A / B test configuration is uploaded to the database for storage.

[0019] Preferably, after receiving a new basic configuration or A / B test configuration, the following is also included:

[0020] When the lowest version of the basic configuration in the database is the same as the lowest version of the new basic configuration, the new basic configuration will override the basic configuration in the database.

[0021] When the lowest version of the AB test configuration in the database is the same as the lowest version of the new AB test configuration, the new AB test configuration will override the AB test configuration in the database.

[0022] Preferably, the process of reading the corresponding basic configuration and A / B test configuration based on the game version, and updating the game version configuration based on the basic configuration and A / B test configuration specifically includes:

[0023] Read the basic configuration and A / B test configuration respectively;

[0024] Calculate the version range of the basic configuration and the version range of the A / B test configuration respectively;

[0025] Calculate the intersection of the version range of the base configuration and the version range of the A / B test configuration;

[0026] When the game version in the AB test activation command falls into the intersection, the basic configuration and the AB test configuration will be merged to form the B group configuration;

[0027] Update the game version configuration using Group B configuration.

[0028] Preferably, the version range of the basic configuration is determined by the following method:

[0029] Get the minimum version of all basic configurations;

[0030] Arrange all minimum versions in ascending order;

[0031] The version range of the base configuration is determined based on all the lowest versions after sorting, where the minimum value of the version range is the lowest version of the base configuration, and the maximum value of the version range is the next lowest version higher than the minimum value.

[0032] Preferably, the version range of the AB test configuration is determined by the following method:

[0033] Obtain the minimum version of all A / B test configurations;

[0034] Arrange all minimum versions in ascending order;

[0035] The version range of the A / B test configuration is determined based on all the lowest versions after sorting, where the minimum value of the version range is the lowest version of the A / B test configuration, and the maximum value of the version range is the next lowest version higher than the minimum value.

[0036] Secondly, an A / B testing configuration and update system for game operation data, including...

[0037] Server: Used to receive basic configuration and A / B test configuration; the server is also used to read the corresponding basic configuration and A / B test configuration according to the game version when it receives the A / B test activation instruction including the game version, and send the basic configuration and A / B test configuration to the client;

[0038] The client is used to update the game version configuration based on the received basic configuration and A / B test configuration.

[0039] As can be seen from the above technical solution, the A / B testing configuration update method and system for game operation data provided by this invention allows for the selection of updating the basic configuration, the A / B testing configuration, or both simultaneously, depending on the game version, when an update is needed. This avoids the problem of redundant workload caused by updating unchanged configurations when the game version is updated, as is common in existing technologies. This method updates the corresponding configurations based on the changes made in the game version, offering flexibility and significantly reducing the difficulty and workload of A / B testing configuration maintenance. Attached Figure Description

[0040] To more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the accompanying drawings used in the description of the specific embodiments or the prior art will be briefly introduced below. In all the drawings, similar elements or parts are generally identified by similar reference numerals. In the drawings, the elements or parts are not necessarily drawn to scale.

[0041] Figure 1 A flowchart of the A / B test configuration update method for game operation data provided in this embodiment.

[0042] Figure 2 A flowchart of the configuration generation method for Group B provided in this embodiment.

[0043] Figure 3 A flowchart of a method for confirming the version range of basic configurations provided in an embodiment.

[0044] Figure 4 A flowchart of the version range confirmation method for AB test configuration provided in the embodiment.

[0045] Figure 5 The block diagram of the A / B test configuration update system for game operation data provided in this embodiment. Detailed Implementation

[0046] The embodiments of the technical solution of the present invention will now be described in detail with reference to the accompanying drawings. The following embodiments are only used to more clearly illustrate the technical solution of the present invention, and are therefore merely examples and should not be used to limit the scope of protection of the present invention. It should be noted that, unless otherwise stated, the technical or scientific terms used in this application should have the ordinary meaning understood by those skilled in the art to which this invention pertains.

[0047] It should be understood that, when used in this specification and the appended claims, the terms "comprising" and "including" indicate the presence of the described features, integrals, steps, operations, elements and / or components, but do not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components and / or collections thereof.

[0048] It should also be understood that the terminology used in this specification is for the purpose of describing particular embodiments only and is not intended to limit the invention. As used in this specification and the appended claims, the singular forms “a,” “an,” and “the” are intended to include the plural forms unless the context clearly indicates otherwise.

[0049] As used in this specification and the appended claims, the term "if" may be interpreted, depending on the context, as "when," "once," "in response to determination," or "in response to detection." Similarly, the phrases "if determined" or "if [described condition or event] is detected" may be interpreted, depending on the context, as "once determined," "in response to determination," "once [described condition or event] is detected," or "in response to detection of [described condition or event]."

[0050] Example:

[0051] A method for updating A / B testing configurations for game operation data, see [link / reference]. Figure 1 This includes the following steps:

[0052] S1: Set up basic configuration and A / B test configuration; the basic configuration includes the same configuration content in multiple game versions, and the A / B test configuration includes the different configuration content in multiple game versions;

[0053] S2: When receiving the A / B test activation command for the game version, read the corresponding basic configuration and A / B test configuration according to the game version, and update the game version configuration according to the basic configuration and A / B test configuration.

[0054] In this embodiment, the game versions applicable to the basic configuration and the game versions applicable to the A / B test configuration can be the same or different. The basic configuration includes the same configurations used in the applicable game versions. For example, the basic configuration can define some basic structural information to adapt to different game versions, so that one basic configuration can be used on multiple game versions. When updating the configuration of a game version, the basic configuration can be used without updating it, and the previous basic configuration can continue to be used. The A / B test configuration includes configurations other than the basic configuration used in the applicable game versions. For example, the A / B test configuration can define the basic structural information of A / B testing to adapt to different game versions, so that one A / B test configuration can be used on multiple game versions. When updating the configuration of a game version, the A / B test configuration can be used without updating it, and the previous A / B test configuration can continue to be used. Therefore, the basic configuration identifies the same configurations across different game versions, while the A / B test configuration identifies different configurations across different game versions.

[0055] This method allows for configuration updates to a game version during development or when fixing bugs in an existing version. The A / B test activation command includes the game version, indicating that a configuration update is required for that version. When updating the game version's configuration, you can update the basic configuration or the A / B test configuration separately, or you can merge the basic and A / B test configurations and then update them together. The configuration update method for different game versions depends on the differences between the new and old versions. For example, if the difference between the new and old game versions lies in the modification of the A / B test configuration, then the A / B test configuration can be updated separately for the new game version.

[0056] This method allows for flexible and adaptable updates to game version configurations. When game version updates are required, the method can choose to update the basic configuration separately, the A / B test configuration separately, or both simultaneously, avoiding the duplication of work caused by updating unchanged configurations during game version updates, as is common in existing technologies. This approach updates configurations based on game version modifications, significantly reducing the difficulty and workload of A / B test configuration maintenance.

[0057] Furthermore, in some embodiments, both the basic configuration and the A / B test configuration include:

[0058] Minimum version: The minimum game version applicable to the game;

[0059] Configuration content: Includes the content set according to the preset configuration format.

[0060] In this embodiment, to be usable across multiple game versions and to reduce configuration maintenance, the basic configuration includes the following:

[0061] Minimum Version: The lowest game version applicable to the system. For example, the minimum version of base configuration A is game version A, meaning that base configuration A can be used with game version A and higher. When only the base configuration of the game version needs to be updated, the game version must be equal to or higher than the minimum version of the base configuration.

[0062] The configuration content includes settings according to a preset configuration format. The configuration format can be standard JSON, which is highly readable and easy for computers to read and use. For example, the configuration content settings (maximum depth 2) are as follows:

[0063]

[0064]

[0065] The configuration can also be set in a flat manner (maximum depth 1), which can maintain breadth-first rather than depth-first approach, making it easier to merge the basic configuration and A / B test configuration:

[0066]

[0067] The A / B test configuration includes the following:

[0068] Minimum Version: The minimum game version applicable to the system. The minimum version for the A / B test configuration can be the same as or different from the minimum version for the base configuration; they do not necessarily correspond one-to-one. For example, the minimum version for the base configuration can be 1.2.3, 1.2.6, 1.2.11, etc., while the minimum version for the A / B test configuration can be 1.2.4, 1.2.8, 1.2.12, etc. When only the game version needs to be updated in the A / B test configuration, the game version must be equal to or higher than the minimum version specified in the A / B test configuration.

[0069] The configuration content includes settings according to a preset configuration format. The A / B test configuration only includes the changed configurations, and the configuration format can be standard JSON.

[0070] Furthermore, in some embodiments, the game version includes a major version number, a minor version number, and a revision number: the major version number, minor version number, and revision number are all integers from 0 to 999.

[0071] In this embodiment, the method defines rules for game version definitions, ensuring a consistent approach to game version usage throughout the method. The major version number represents the game's major version number; generally, major version numbers are not backward compatible. For example, game versions 1.0 and 2.0 are essentially redeveloped and incompatible, requiring a mandatory upgrade. The minor version number represents the game's minor version number, indicating functional changes (including additions, modifications, and deletions) between different minor version numbers; minor version numbers are backward compatible. For example, game version 2.1 is compatible with game version 2.0, and game version 2.0 can log in to the 2.1 server. The revision version number represents a fix within a minor version range, typically released to fix bugs. For example, game version 2.1.3 was released to fix bugs in game version 2.1.2. Therefore, according to the game version defined by the above method, the lowest version can be 0.0.0, and the highest version can be 999.999.999.

[0072] Furthermore, in some embodiments, the game version level is determined in the following way:

[0073] Calculate the version number of the game:

[0074] Version number = Major version number × 1,000,000 + Minor version number × 1,000 + Revision number;

[0075] In comparing two game versions, the game version with the larger version number is considered higher.

[0076] In this embodiment, the way the game version is defined conforms to human habits but not to computer habits. Humans can intuitively see the difference in game version quality; for example, when comparing game version 2.1.3 and game version 2.1.33, it is obvious that the latter is a higher version. However, computers cannot make intuitive comparisons, so this method requires converting the game version into a numerical value before computer comparison.

[0077] The calculation methods for version values ​​in different game versions are as follows:

[0078] Version number = Major version number × 1,000,000 + Minor version number × 1,000 + Revision number;

[0079] If the version number is known, the game version can also be deduced by working backward:

[0080] Major version number = (version value / 1000000); Minor version number = (version value / 1000) % 1000; Revision version number = version value % 1000; Game version = Major version number.Minor version number.Revision version number. For example, the version value of game version 0.0.0 = 0 × 1000000 + 0 × 1000 + 0 = 0; the version value of game version 999.999.999 = 999 × 1000000 + 999 × 1000 + 999 = 999999999; the version value of game version 1.2.3 = 1 × 1000000 + 2 × 1000 + 3 = 1002003. When comparing two game versions, the version values ​​are used for comparison. For example, when comparing game version 1.2.3 and game version 1.2.33, compare 1002003 and 1002033. The latter is larger, so 1.2.33 is the higher version.

[0081] Furthermore, in some embodiments, after setting the basic configuration and A / B test configuration, the following is also included:

[0082] When a new basic configuration or A / B test configuration is received, the new basic configuration or A / B test configuration is uploaded to the database for storage.

[0083] In this embodiment, the basic configuration or A / B test configuration can be uploaded to the server through a preset interface and stored in the server's database. The parameters of the preset interface may include configuration type (indicating which type of configuration it is, including "basic configuration" and "A / B test configuration"), minimum version (the minimum version of the basic configuration or A / B test configuration), and configuration content (the configuration content of the basic configuration or A / B test configuration).

[0084] Furthermore, in some embodiments, after receiving a new basic configuration or A / B test configuration, the following steps are also included:

[0085] When the lowest version of the basic configuration in the database is the same as the lowest version of the new basic configuration, the new basic configuration will override the basic configuration in the database.

[0086] When the lowest version of the AB test configuration in the database is the same as the lowest version of the new AB test configuration, the new AB test configuration will override the AB test configuration in the database.

[0087] In this embodiment, the method also has a configuration overriding function. Configuration overriding is determined based on "configuration type + minimum version" as the sole condition. When the "configuration type + minimum version" in the new configuration file is the same as the "configuration type + minimum version" in the configuration stored in the database, the two are considered to be duplicate configurations, and the newly received configuration overwrites the old configuration in the database.

[0088] Furthermore, in some embodiments, see Figure 2 Based on the game version, read the corresponding basic configuration and A / B test configuration, and update the game version configuration according to the basic configuration and A / B test configuration. Specifically, this includes:

[0089] S11: Read the basic configuration and AB test configuration respectively;

[0090] S12: Calculate the version range of the basic configuration and the version range of the A / B test configuration respectively;

[0091] S13: Calculate the intersection of the version range of the basic configuration and the version range of the A / B test configuration;

[0092] S14: When the game version in the AB test activation command falls into the intersection, the basic configuration and AB test configuration will be merged to form the B group configuration;

[0093] S15: Update the game version configuration using the B group configuration.

[0094] In this embodiment, the version range of the basic configuration includes game versions using that basic configuration, and the version range of the AB test configuration includes game versions using that AB test configuration. When it is necessary to update both the basic configuration and the AB test configuration for the game version simultaneously, this method can use a preset interface to read the basic configuration and the AB test configuration, and calculate the version range of the basic configuration and the AB test configuration accordingly.

[0095] This method, after reading the basic configuration and the A / B test configuration, calculates the intersection of the version ranges of the basic configuration and the A / B test configuration. For example, assuming the version range of basic configuration A is [1.2.4, 1.2.9], the version range of basic configuration B is [1.2.10, 1.2.14], and the version range of the A / B test configuration is [1.2.7, 1.2.12], then the intersections are [1.2.7, 1.2.9] and [1.2.10, 1.2.12], respectively. The intersection represents the range of game versions that can be included in the A / B test. That is, using basic configuration A, only games with versions within [1.2.7, 1.2.9] can be included in the A / B test. Using basic configuration B, only games with versions within [1.2.10, 1.2.12] can be included in the A / B test.

[0096] This method merges the basic configuration and the AB test configuration into a B-group configuration when the game version in the AB test activation command falls into the intersection. The B-group configuration is the complete configuration used in the AB test and is then entered into the AB test. The basic configuration and the AB test configuration can be merged using the following method: First, copy the basic configuration to the B-group configuration, then take each layer element from the AB test configuration and write / overwrite it to the B-group configuration.

[0097] For example: the basic configuration is:

[0098]

[0099]

[0100] After merging, the configuration for Group B is as follows:

[0101]

[0102] Furthermore, in some embodiments, see Figure 3 The version range of the basic configuration can be determined using the following method:

[0103] S21: Get the minimum version of all basic configurations;

[0104] S22: Arrange all minimum versions in ascending order;

[0105] S23: Determine the version range of the basic configuration based on all the lowest versions after sorting, where the minimum value of the version range is the lowest version of the basic configuration, and the maximum value of the version range is the next lowest version higher than the minimum value.

[0106] In this embodiment, the method can determine the version range of basic configurations based on the lowest versions of multiple basic configurations. First, the lowest versions of the basic configurations are arranged in ascending order. For each lowest version, the corresponding highest version is calculated. The version value of the highest version is equal to the version value of the next game version higher than the current game version minus 1. If there is no version higher than the current game version, the maximum game version is 999.999.999. For example, assuming the lowest versions of the four basic configurations are 1.2.18, 1.2.5, 1.2.9, and 1.2.3, the calculated version ranges of these four basic configurations are [1.2.3, 1.2.4], [1.2.5, 1.2.8], [1.2.9, 1.2.17], and [1.2.18, 999.999.999].

[0107] Furthermore, in some embodiments, see Figure 4 The version range of the A / B test configuration can be confirmed using the following methods:

[0108] S31: Obtain the minimum version of all A / B test configurations;

[0109] S32: Arrange all minimum versions in ascending order;

[0110] S33: Determine the version range of the AB test configuration based on all the lowest versions after sorting, where the minimum value of the version range is the lowest version of the AB test configuration, and the maximum value of the version range is the next lowest version higher than the minimum value.

[0111] In this embodiment, the method for confirming the version range of the AB test configuration is the same as the method for confirming the version range of the basic configuration.

[0112] A game operation data A / B test configuration update system, see [link / reference] Figure 5 ,include:

[0113] Server 1: Used to receive basic configuration and A / B test configuration; Server 1 is also used to read the corresponding basic configuration and A / B test configuration according to the game version when it receives the A / B test activation instruction including the game version, and send the basic configuration and A / B test to client 2;

[0114] Client 2 is used to update the game version configuration based on the received basic configuration and A / B test configuration.

[0115] The system provided in this embodiment of the invention is described in a brief manner. For any parts not mentioned in the embodiment section, please refer to the corresponding content in the foregoing embodiment.

[0116] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention, and they should all be covered within the scope of the claims and specification of the present invention.

Claims

1. A method for updating A / B testing configurations for game operation data, characterized in that, Includes the following steps: Set up basic configuration and A / B test configuration; the basic configuration includes the same configuration content in multiple game versions, and the A / B test configuration includes different configuration content in multiple game versions; When an A / B test activation command for a game version is received, the system reads the corresponding basic configuration and A / B test configuration based on the game version, and updates the game version's configuration according to the basic configuration and A / B test configuration. Specifically, this includes: Read the basic configuration and the AB test configuration respectively; Calculate the version range of the basic configuration and the version range of the A / B test configuration respectively; Calculate the intersection of the version range of the basic configuration and the version range of the AB test configuration; When the game version in the AB test activation command falls into the intersection, the basic configuration and the AB test configuration are merged to form the B group configuration; Update the game version's configuration using the configuration from group B.

2. The A / B test configuration update method for game operation data according to claim 1, characterized in that, Both the basic configuration and the AB test configuration include: Minimum version: The minimum game version applicable to the game; The configuration content includes content set according to a preset configuration format.

3. The A / B test configuration update method for game operation data according to claim 2, characterized in that, The game version includes a major version number, a minor version number, and a revision number: the major version number, minor version number, and revision number are all integers from 0 to 999.

4. The A / B test configuration update method for game operation data according to claim 3, characterized in that, The game version is determined in the following ways: Calculate the version number of the game version: Version number = Major version number × 1,000,000 + Minor version number × 1,000 + Revision number; In the comparison of two game versions, the game version with the larger version number is defined as higher.

5. The A / B test configuration update method for game operation data according to claim 1, characterized in that, After setting the basic configuration and A / B test configuration, the following is also included: When a new basic configuration or AB test configuration is received, the new basic configuration or AB test configuration is uploaded to the database for storage.

6. The A / B test configuration update method for game operation data according to claim 5, characterized in that, After receiving the new basic configuration or AB test configuration, the following is also included: When the lowest version of the basic configuration in the database is the same as the lowest version of the new basic configuration, the new basic configuration overrides the basic configuration in the database. When the lowest version of the AB test configuration in the database is the same as the lowest version of the new AB test configuration, the new AB test configuration overrides the AB test configuration in the database.

7. The A / B test configuration update method for game operation data according to claim 4, characterized in that, The version range of the basic configuration is determined by the following method: Obtain the minimum version of all the aforementioned basic configurations; Arrange all the minimum versions in ascending order; The version range of the basic configuration is determined based on all the lowest versions after sorting, wherein the minimum value of the version range is the lowest version of the basic configuration, and the maximum value of the version range is the next lowest version higher than the minimum value.

8. The A / B test configuration update method for game operation data according to claim 4, characterized in that, The version range of the AB test configuration is confirmed by the following method: Obtain the lowest version of all the aforementioned AB test configurations; Arrange all the minimum versions in ascending order; The version range of the AB test configuration is determined based on all the lowest versions after sorting, wherein the minimum value of the version range is the lowest version of the AB test configuration, and the maximum value of the version range is the next lowest version higher than the minimum value.

9. A system for configuring and updating A / B testing of game operation data, characterized in that, include: Server: Used to receive basic configuration and AB test configuration; the server is also used to, when receiving an AB test activation instruction including the game version, read the corresponding basic configuration and AB test configuration according to the game version, and send the basic configuration and AB test configuration to the client; The client is used to update the game version configuration based on the received basic configuration and AB test configuration, specifically including: Read the basic configuration and the AB test configuration respectively; Calculate the version range of the basic configuration and the version range of the A / B test configuration respectively; Calculate the intersection of the version range of the basic configuration and the version range of the AB test configuration; When the game version in the AB test activation command falls into the intersection, the basic configuration and the AB test configuration are merged to form the B group configuration; Update the game version's configuration using the configuration from group B.

Images