Business evaluation method and device, equipment and storage medium

Abstract

The invention provides a business evaluation method, device and equipment and a storage medium, which can be applied to various scenes such as cloud technology, artificial intelligence, map field, smart traffic, auxiliary driving and vehicle-mounted, and the method comprises the following steps: obtaining business type information and first interaction data of a to-be-evaluated business; the first interaction data is interaction data between the preset terminal object and the first business processing result; the first service processing result is obtained by processing a preset number of service requests by the to-be-evaluated service in the preset test layer and the quantity amplification test service in the preset quantity amplification layer under the condition that the to-be-evaluated service is added into the preset test layer; determining an evaluation strategy according to the type strategy mapping information; and performing performance evaluation processing on the first interaction data according to the evaluation strategy. According to the scheme, the test efficiency is improved, the server computing resource consumption of the service system is reduced, meanwhile, the service system can be timely and quickly optimized and updated, and the response efficiency of the service system is improved.

Description

Technical Field

[0001] The present application belongs to the field of computer technology, and specifically relates to a business evaluation method, device, equipment and storage medium. Background Art

[0002] With the rapid development of Internet technology, various business systems are often continuously optimized and updated. When optimizing and updating business systems, it is usually necessary to use some testing methods to test the optimization effects of new versions or new functions, such as using A / B testing to test the optimization effects of new versions or new functions.

[0003] When conducting an A / B experiment, the scheme to be tested is usually used to process a small number of business requests in the business system, and the optimization effect of the updated scheme is preliminarily determined by obtaining the interaction data between the terminal object and the business processing results. If it is preliminarily determined that the optimization effect of the updated scheme is positive or not obviously negative, the number of business requests processed by the scheme to be tested is gradually enlarged for further testing. In the related art, when enlarging the number of business requests processed by the scheme to be tested, the scheme adopted is to suspend other test schemes in the experimental layer where the scheme to be tested is located, and assign the business requests processed by other test schemes to the scheme to be tested for processing. This scheme has the problem of low testing efficiency. On the one hand, it will increase the server computing resource consumption of the business system. On the other hand, due to the inability to optimize and update the business system in a timely and rapid manner, the business system response efficiency will be low. Summary of the invention

[0004] In order to solve the above technical problems, the present application provides a service evaluation method, device, equipment and storage medium.

[0005] On the one hand, an embodiment of the present application provides a service evaluation method, the service evaluation method comprising:

[0006] Obtaining business type information and first interaction data of the business to be evaluated; the first interaction data is interaction data between a preset terminal object and a first business processing result; the first business processing result is obtained by processing a preset number of business requests respectively for the business to be evaluated in the preset test layer and the volume test business in the preset volume release layer when the business to be evaluated is added to the preset test layer; the volume test business in the preset volume release layer is the initial test business in the preset test layer, and is added to the preset volume release layer when preset conditions are met; the initial test business is the business in the preset test layer other than the business to be evaluated;

[0007] Determine the evaluation strategy corresponding to the service type indicated by the service type information according to the type strategy mapping information; the type strategy mapping information represents the mapping relationship between the service type and the evaluation strategy;

[0008] The first interaction data is subjected to performance evaluation processing according to the evaluation strategy to obtain performance evaluation data of the service to be evaluated.

[0009] On the other hand, an embodiment of the present application further provides a service evaluation device, the device comprising:

[0010] An acquisition module is used to obtain business type information and first interaction data of the business to be evaluated; the first interaction data is interaction data between a preset terminal object and a first business processing result; the first business processing result is obtained by processing a preset number of business requests respectively by the business to be evaluated in the preset test layer and the volume test business in the preset volume release layer when the business to be evaluated is added to the preset test layer; the volume test business in the preset volume release layer is the initial test business in the preset test layer, and is added to the preset volume release layer when the preset conditions are met; the initial test business is the business in the preset test layer other than the business to be evaluated;

[0011] An evaluation strategy determination module, used to determine the evaluation strategy corresponding to the service type indicated by the service type information according to the type strategy mapping information; the type strategy mapping information represents the mapping relationship between the service type and the evaluation strategy;

[0012] The performance evaluation module is used to perform performance evaluation processing on the first interaction data according to the evaluation strategy to obtain performance evaluation data of the service to be evaluated.

[0013] On the other hand, an embodiment of the present application also provides an electronic device for business evaluation, which includes a processor and a memory, wherein the memory stores at least one instruction or at least one program, and the at least one instruction or at least one program is loaded and executed by the processor to implement the business evaluation method as described above.

[0014] On the other hand, an embodiment of the present application also provides a computer-readable storage medium, in which at least one instruction or at least one program is stored, and the at least one instruction or the at least one program is loaded and executed by a processor to implement the business evaluation method as described above.

[0015] On the other hand, an embodiment of the present application further provides a computer program product, which implements the business evaluation method as described above when the computer program is executed by a processor.

[0016] The service evaluation method, device, electronic device and storage medium proposed in the embodiment of the present application use the service to be evaluated in the preset test layer and the volume test service in the preset volume layer to process the preset number of service requests respectively to obtain the first service processing result, so as to obtain the first interaction data between the preset terminal object and the first service processing result. Since the service to be evaluated in the volume test service is not in the same layer, there is no need to suspend the service to be evaluated when the proportion of the number of service requests processed by the volume test service is reached, thereby improving the test efficiency and reducing the server computing resource consumption of the service system. When the service to be evaluated is to be evaluated, the service type information and the first interaction data of the service to be evaluated are obtained, and then the evaluation strategy corresponding to the service type indicated by the service type information is determined according to the type strategy mapping information, and the evaluation strategy is used to perform performance evaluation processing on the first interaction data to obtain the performance evaluation data of the service to be evaluated, thereby avoiding the parameter coverage between the preset volume layer and the preset test layer, affecting the performance evaluation of the service to be evaluated, and realizing the accurate evaluation of the optimization effect of the service to be evaluated. This technical solution can improve the test efficiency, thereby reducing the server computing resource consumption of the service system. At the same time, it can realize the timely and rapid optimization and update of the service system, and improve the response efficiency of the service system. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions and advantages in the embodiments of the present application or the prior art, the drawings required for use in the embodiments or the prior art descriptions are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0018] Figure 1 The figure is a schematic diagram of an implementation environment of a service evaluation method according to an exemplary embodiment.

[0019] Figure 2 A process diagram of a service evaluation method according to an exemplary embodiment is shown. Figure 1 .

[0020] Figure 3 It is a structural schematic diagram of a multi-module linkage experiment layer and a single-module experiment layer according to an exemplary embodiment.

[0021] Figure 4 The present invention is a schematic diagram of a process of adding an initial test service to a preset volume-increasing layer according to an exemplary embodiment.

[0022] Figure 5 The diagram is a schematic diagram showing a method of performing volume expansion processing on an initial test service of a functional test type according to an exemplary embodiment.

[0023] Figure 6 The diagram is a schematic diagram showing a method of performing volume expansion processing on an initial test service of a logic compatible type according to an exemplary embodiment.

[0024] Figure 7 The diagram is a schematic diagram showing a method of performing volume expansion processing on an initial test service of a logical mutual exclusion type according to an exemplary embodiment.

[0025] Figure 8 The figure is a block diagram of a service evaluation device according to an exemplary embodiment.

[0026] Fig. 9 The present invention is a hardware structure block diagram of a server of a service evaluation method provided according to an exemplary embodiment. DETAILED DESCRIPTION

[0027] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0028] It should be noted that the terms "first", "second", etc. in the specification and claims of the embodiment of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the embodiment of the present application described here can be implemented in an order other than those illustrated or described here. Thus, the features defined as "first" and "second" can expressly or implicitly include one or more of the features. In the description of the present embodiment, unless otherwise specified, the meaning of "multiple" is two or more. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or server comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0029] In order to make the purpose, technical solution and advantages disclosed in the embodiments of the present application more clearly understood, the embodiments of the present application are further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the embodiments of the present application and are not used to limit the embodiments of the present application.

[0030] In order to facilitate understanding of the above-mentioned technical solutions and the technical effects produced by the embodiments of the present application, the embodiments of the present application first explain the relevant professional terms:

[0031] A / B experiment: A method for testing the effect of an updated solution online. The experimental samples (e.g., the terminal objects displayed by the receiving object) are randomly divided into two mutually exclusive sample groups, the experimental group and the control group. The control group samples keep the original solution unchanged, while the experimental group uses the new solution. Finally, the difference between the two groups of results is compared to obtain the updated effect of the solution.

[0032] Layer domain model: used to manage and allocate business requests for A / B experiments. Business requests for A / B experiments can be divided into several subsets according to "domains", and business requests corresponding to different "domains" are mutually exclusive. In the same "domain", the "layers" corresponding to several modules are divided according to the business system modules, and each "layer" can reuse all business requests in the "domain".

[0033] Experimental domain: The business system divides the business requests within a certain period of time into subsets. The business requests corresponding to different experimental domains are mutually exclusive. Several sub-experimental domains or experimental layers can be nested in the same experimental domain.

[0034] Experimental layer: Different experiments are divided into multiple experimental layers according to information such as solution type or effective module. Each experimental layer stores the configuration information of several experiments and is a collection of experiments of the same type. Each experimental layer corresponds to the full amount of business requests in the experimental domain. Business requests allocated to different solutions in the same experimental layer are mutually exclusive, and business requests in different experimental layers can be orthogonal to each other.

[0035] The scale-up layer is the default experimental domain layer in the layer domain model. The scale-up layer often corresponds to the full amount of business requests of the business system. When the proportion of business requests processed by the scheme to be tested is increased, the scheme to be tested can be added to the scale-up layer for testing.

[0036] Experimental parameters: used to control the configuration of the logic of a module in the business system. By configuring different values ​​of the same parameter for the control group and the experimental group of the A / B experiment, different scheme logics can be effective for different groups. For example, an experimental parameter can be the font color of the display interface. The experimental group and the control group can set different values. For example, the control group can be (0, 255, 0), and the experimental group can be (0, 0, 255).

[0037] Parameter coverage: In the layer domain model, for business requests that are hit across the experimental layer and the mass-production layer at the same time, if the same parameter is configured in both the experimental layer and the mass-production layer but with different values, then there are multiple alternative values ​​for the parameter in the business request. Since only one value can be valid for each parameter in a business request, it will eventually follow a certain rule to select the value and take effect. For the groups in other layers, although they are hit by the business request, the values ​​of their parameters are not effective as expected. This is parameter coverage.

[0038] Parameter coverage will affect the effectiveness of the experiment and the accuracy of the evaluation. In serious cases, it may also cause online accidents in the business system and cause losses. The volume-release layer in the layer domain model is often used for large-scale volume testing of experiments. The original intention is to avoid the volume-release test occupying too many business requests of the experimental layer, which makes the corresponding business requests of other experiments in the same layer scarce. However, the use of the volume-release layer makes it easy for the same parameters to be reused by multiple cross-layer experiments, resulting in parameter coverage, leading to experimental risks and evaluation deviations. However, if the volume-release layer is not used at all, the experimental volume release will result in the business requests of the experimental layer not being able to meet the test needs, thereby reducing the efficiency of the experiment and increasing the server computing resource consumption of the business system. At the same time, the business system response efficiency will be low due to the inability to optimize and update the business system in a timely and rapid manner.

[0039] In view of this, the embodiment of the present application provides a service evaluation method, device, electronic device and storage medium, which uses the service to be evaluated in the preset test layer and the volume test service in the preset volume layer to process the preset number of service requests respectively to obtain the first service processing result, so as to obtain the first interaction data between the preset terminal object and the first service processing result. Since the volume test service and the service to be evaluated are not in the same layer, there is no need to suspend the service to be evaluated when the number of service requests processed by the volume test service is proportional, thereby improving the test efficiency and reducing the server computing resource consumption of the business system. When the performance evaluation of the service to be evaluated is performed, by obtaining the service type information and the first interaction data of the service to be evaluated, and then determining the evaluation strategy corresponding to the service type indicated by the service type information according to the type strategy mapping information, the evaluation strategy is used to perform performance evaluation processing on the first interaction data, and the performance evaluation data of the service to be evaluated is obtained, thereby avoiding the parameter coverage between the preset volume layer and the preset test layer, affecting the performance evaluation of the service to be evaluated, and realizing accurate evaluation of the optimization effect of the service to be evaluated. This technical solution can improve the test efficiency, thereby reducing the server computing resource consumption of the business system. At the same time, it can optimize and update the business system in a timely and rapid manner, thereby improving the response efficiency of the business system.

[0040] Figure 1FIG. 1 is a schematic diagram of an implementation environment of a business evaluation method according to an exemplary embodiment. Figure 1 As shown, the implementation environment may include at least a terminal 01 and a server 02. The terminal 01 and the server 2 may be directly or indirectly connected via wired or wireless communication, and this application does not impose any limitation thereto.

[0041] Specifically, the terminal 01 can be used to send a service request to the server 02. Optionally, the terminal 01 can be a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart speaker, an intelligent voice interaction device, a smart home appliance, a smart watch, a vehicle terminal, an aircraft, etc., but is not limited thereto. The embodiments of the present application can be applied to various scenarios, including but not limited to the sending of service requests involved in various scenarios such as cloud technology, artificial intelligence, smart transportation, and assisted driving.

[0042] Specifically, the server 02 can be used to obtain business type information and first interaction data of the business to be evaluated; the first interaction data is the interaction data between the preset terminal object and the first business processing result; the first business processing result is obtained by processing a preset number of business requests respectively for the business to be evaluated in the preset test layer and the volume-release test business in the preset volume-release layer when the business to be evaluated is added to the preset test layer; the volume-release test business in the preset volume-release layer is the initial test business in the preset test layer, which is added to the preset volume-release layer when preset conditions are met; the initial test business is the business in the preset test layer except the business to be evaluated; it can also be used to determine the evaluation strategy corresponding to the business type indicated by the business type information according to the type strategy mapping information; the type strategy mapping information represents the mapping relationship between the business type and the evaluation strategy; it can also be used to perform performance evaluation processing on the first interaction data according to the evaluation strategy to obtain performance evaluation data of the business to be evaluated. Optionally, the server 02 can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDN), as well as big data and artificial intelligence platforms.

[0043] It should be noted that Figure 1 This is just an example. In other scenarios, other implementation environments may also be included. In addition, the relevant information (including but not limited to feature information) and data (including but not limited to interactive data) of the terminal object involved in the embodiments of the present application are all information and data authorized by the terminal object or fully authorized by all parties.

[0044] Figure 2 A process diagram of a service evaluation method according to an exemplary embodiment is shown. Figure 1 This method can be used for Figure 1 In the implementation environment of the embodiment. This specification provides the method operation steps as described in the embodiment or flowchart, but may include more or fewer operation steps based on routine or non-creative work. The order of steps listed in the embodiment is only one way of executing the steps among many steps, and does not represent the only execution order. When the actual system or server product is executed, it can be executed in sequence or in parallel (for example, in a parallel processor or multi-threaded processing environment) according to the method shown in the embodiment or the drawings. Specifically, Figure 2 As shown, the method may include:

[0045] S101: Acquire service type information and first interaction data of a service to be evaluated.

[0046] In the embodiment of the present application, before the business system is updated, the update scheme can be tested to evaluate the optimization effect of the update scheme, so as to avoid the negative impact of the update scheme on the performance of the business system. The business system can be a platform or application that provides a certain network service, such as a content publishing platform, a live broadcast platform, a social service platform, an e-commerce platform, an instant messaging application, a game application, an audio and video application, etc. The business system can generally include a client and a server, the client can be installed in various terminal devices, and the server is used to provide services to the client. When the server provides services to the client, it can receive the business request sent by the client, and process the business request according to the set business logic to obtain the business processing result, and then the server sends the business processing result to the client. After receiving the business processing result, the client can display the business processing result on the human-computer interaction interface, so that the terminal object can interact with the business processing result. The server can obtain the corresponding interaction data by obtaining the interactive processing result of the terminal object on the business processing result. Optionally, the update scheme corresponding to the business system includes but is not limited to the update of the client human-computer interaction interface, the update of the server business logic, etc.

[0047] In the embodiment of the present application, when the update scheme is tested, the business logic of the scheme to be tested is usually used to process a small number of business requests in the business system, and the optimization effect of the scheme is preliminarily determined by obtaining the interactive data between the terminal object and the business processing result. If it is preliminarily determined that the optimization effect of the scheme is positive or not obviously negative, the number ratio of the business requests processed by the scheme to be tested is gradually enlarged. For example, the business logic of the scheme to be tested is first used to process 10% of the business requests in the business system. If it is preliminarily determined that the optimization effect of the scheme to be tested is positive or not obviously negative, the amount of business requests processed by the business logic of the scheme to be tested is enlarged to 50%. Under this condition, if it is determined that the optimization effect of the scheme to be tested is positive, the amount of business requests processed by the business logic of the scheme to be tested can be enlarged to 100%, that is, the business logic of the scheme to be tested is used to replace the existing business logic in the business system.

[0048] Generally speaking, a business system will include multiple business modules. Taking the advertising recommendation system as an example, the business system can include a recall module, a rough sorting module, a fine sorting module, etc. Therefore, for different business modules and different business functions, there can be multiple update schemes for the business system at the same time. Moreover, there may be multiple update schemes for the same function at the same time. For example, for the update scheme of the background color of the human-computer interaction interface, there can be multiple schemes such as blue, red, and green at the same time. In order to improve the testing efficiency, these schemes can be tested at the same time.

[0049] In the embodiment of the present application, in order to better control the business requests processed by the scheme to be tested and make the evaluation results of the scheme to be tested more accurate, before testing the scheme to be tested, a layer domain model can be designed to distribute the business requests received in the business system, and then the scheme to be tested that needs to be tested is filled into each experimental layer, so that each scheme to be tested can be tested using the business requests corresponding to each experimental layer. The layer domain model may include at least one experimental domain, and each experimental domain may include at least one experimental layer. One to multiple experiments can be carried out simultaneously in each experimental layer, and each experiment can be a scheme to be tested. Each experimental layer is bound to the experimental parameters corresponding to the layer, and there are no shared experimental parameters between different experimental layers, so that parameter coverage can be avoided. That is, each experimental layer can correspond to multiple experiments of the same type, and different experimental layers correspond to different types of experiments. As an example, a certain experimental layer is an experimental layer of a scheme to be tested for testing the background color of the human-computer interaction interface, and the background color of the human-computer interaction interface can be tested simultaneously in the layer. Multiple schemes to be tested such as blue, red, and green. The layer domain model can also include at least one volume release layer. The scaling layer is used to add a certain scheme to be tested to the scaling layer when it is preliminarily determined that the optimization effect of the scheme to be tested is positive or not obviously negative, so that the scheme to be tested can be tested with more business requests to accurately evaluate the optimization effect of the scheme to be tested.

[0050] In an embodiment of the present application, after the layer domain model is constructed, the business logic of all the schemes to be tested in the business system can be added to the layer domain model as the business to be evaluated. Specifically, the business to be evaluated can be divided into two categories according to whether the business module corresponding to the business to be evaluated is associated with other business modules in the business system. One category is that the business module corresponding to the business to be evaluated is not associated with other business modules in the business system. For this type of business to be evaluated, they can be added to the same or different preset test layers according to their corresponding experimental parameters. The preset test layer is an experimental layer for a certain experimental object in the layer domain model. For a certain preset test layer, these businesses to be evaluated added to the preset test layer can also be regarded as initial test businesses in the preset test layer. If there are new businesses to be evaluated that need to be added to the preset test layer later, they can only be added to the preset test layer when the initial test business completes the test or the initial test business is moved to the preset release layer. The preset release layer is a release layer for a certain experimental object in the layer domain model. In order to avoid parameter coverage between release layers, for a certain experimental object, there can only be one preset release layer in the layer domain model. The other type is that the business module corresponding to the business to be evaluated is associated with other business modules in the business system. For this type of business to be evaluated, they can be combined into a linkage evaluation business according to the association order of the business modules, and then the linkage evaluation business can be added to the preset test layer.

[0051] In an embodiment of the present application, for a certain business to be evaluated, by adding it to a preset test layer for testing, the first interaction data corresponding to the business to be evaluated can be obtained. The first interaction data is the interaction data between the preset terminal object and the first business processing result. The first business processing result is obtained by processing a preset number of business requests respectively by the business to be evaluated in the preset test layer and the volume-release test business in the preset volume-release layer when the business to be evaluated is added to the preset test layer. The volume-release test business in the preset volume-release layer is the initial test business in the preset test layer, which is added to the preset volume-release layer when the preset conditions are met. The initial test business is the business in the preset test layer before the business to be evaluated is added to the preset test layer.

[0052] Specifically, the preset test layer may include a first preset test layer and a second preset test layer. The first preset test layer is a single-module experimental layer in the layer domain model, which is used to test the business to be evaluated corresponding to the single module. The business to be evaluated corresponding to the single module means that the to-be-evaluated solution corresponding to the business to be evaluated is a solution for a single business module in the business system, and the business to be evaluated only has the parameters of the corresponding business module, and does not involve the parameters of other business modules. When determining the first interaction data, the business to be evaluated and the business association information corresponding to the business to be evaluated can be obtained first. Among them, the business association information is used to indicate the number of associated business modules in the business system corresponding to the business to be evaluated. When the business association information indicates that the number of associated business modules in the business system corresponding to the business to be evaluated does not meet the preset conditions, the business to be evaluated is added to the first preset test layer. Then, based on the business to be evaluated in the first preset test layer and the volume test business in the preset volume layer, a preset number of business requests are processed respectively to obtain the first business processing result corresponding to each business request. By sending the first business processing result corresponding to each business request to the preset terminal object corresponding to each business request, the interaction processing result between the preset terminal object corresponding to each business request and the first business processing result corresponding to each business request is obtained, and then based on the interaction processing result between the preset terminal object corresponding to each business request and the first business processing result corresponding to each business request, the first interaction data corresponding to each business request is obtained. When determining the first interaction data, if the business to be evaluated is the business to be evaluated corresponding to a single module, the business to be evaluated can be directly added to the preset test layer, thereby improving the test efficiency. By using the business request corresponding to the preset test layer to test the business to be evaluated to obtain the first interaction data, it can be ensured that the obtained first interaction data is true and reliable, thereby improving the reliability of the performance evaluation of the business to be evaluated.

[0053] Specifically, before adding the business to be evaluated to the preset test layer, it can be determined whether the number of associated business modules in the business system corresponding to the business to be evaluated meets the preset conditions according to the business association information corresponding to the business to be evaluated. If not, it can be added to the preset test layer bound with the corresponding experimental parameters according to the experimental parameters corresponding to the business to be evaluated. Meeting the preset conditions means that the number of associated business modules in the business system corresponding to the business to be evaluated does not exceed one. In other words, the business logic of the business to be evaluated only involves a single business module in the business system. As an example, the business to be evaluated is a business to be evaluated with a human-computer interaction interface background color of red. When the number of associated business modules in its corresponding business system does not meet the preset conditions, it can be added to the preset test layer for the background color of the human-computer interaction interface. After adding the business to be evaluated to the preset test layer, a preset number of business requests can be separated from the corresponding business requests in the preset test layer for testing the business to be evaluated. The preset number of business requests can be requests sent to the business system by several preset terminal objects within a preset time period, such as business requests sent to the business system by all preset terminal objects within 3 days. The terminal object may be the object of all clients using the business system, and the preset terminal object may be some of the terminal objects among all the terminal objects. The terminal object may be all objects using the client of the business system. In actual applications, when the business system receives a business request, it can determine whether the business request is a business request corresponding to the business to be evaluated based on the characteristic information of the preset terminal object that sends the business request, such as performing a hash calculation on the identification information of the preset terminal object through a hash algorithm, and partitioning according to the calculation result, so as to determine whether the business request is in the partition corresponding to the business to be evaluated. If so, it indicates that the business request is a business request corresponding to the business to be evaluated. Then the business to be evaluated processes the business request according to its business logic to obtain the corresponding first business processing result. The first business processing result can be the content requested by the business request, or it can be the associated content of the content requested by the business request. For example, search for recalled content, or advertisements recommended based on search for recalled content, etc.

[0054] As an example, for the business request for display objects sent by the terminal object, when the business system receives the business request, the business system determines that the business request is a business request corresponding to the business to be evaluated, and sends the business request to the business to be evaluated for processing. The business to be evaluated parses the business request to obtain the display object information carried in the business request, such as the display object type, display object identifier, etc., and then determines the corresponding display object according to the display object information, and then takes values ​​for the various parameters of the display object according to the various parameter configurations of the display object in the business logic. In the case where there is a volume test business in the preset volume layer, the business system will also send the business request to the volume test business in the preset volume layer for processing. When the volume test business in the preset volume layer processes the business request, it will also take values ​​for the various parameters of the display object according to the various parameter configurations of the display object in the business logic. In this way, there will be multiple values ​​for the various parameter configurations of the display object. In this case, the final values ​​of the various parameter configurations of the display object can be determined according to the parameter effectiveness priority of the business to be evaluated and the volume test business in the preset volume layer, thereby obtaining the first business processing result.

[0055] After obtaining the first business processing result, the first business processing result can be sent to the preset terminal object corresponding to each business request. The preset terminal object that receives the first business processing result is the account that sends the business request. After the preset terminal object receives the first business processing result, the first business processing result can be interactively processed. Depending on the first business processing result, the preset terminal object can interact with the first business processing result in different ways. For example, the first business processing result is a display object, and the preset terminal object can interact with the first business processing result by interactive processing methods such as clicking, browsing, downloading, and purchasing. Of course, the preset terminal object can also directly close or delete the first business processing result. Regardless of how the preset terminal object interacts with the first business processing result, a corresponding interactive processing result will be generated.

[0056] For any business request, after obtaining the interaction processing result between the preset terminal object that sends the business request and the first business processing result, the first interaction data corresponding to the business request can be determined according to the interaction processing result. The first interaction data may be data directly associated with the interaction processing result, such as exposure, click, conversion and other data. As an example, if the interaction processing result is that the preset terminal object clicks on the first business processing result corresponding to the business request, then the first interaction data corresponding to the business request is click. Correspondingly, if the interaction processing result is that the preset terminal object closes the first business processing result corresponding to the business request, then the first interaction data corresponding to the business request is not clicked. The first interaction data may also be data indirectly associated with the interaction processing result, such as consumption, resource transfer quantity and other data.

[0057] In an embodiment of the present application, when determining the first interaction data, if the business association information indicates that the number of associated business modules in the business system corresponding to the business to be evaluated meets the preset conditions, the business to be evaluated can be added to the second preset test layer. Then, based on the business to be evaluated in the second preset test layer and the volume test business in the preset volume layer, the preset number of business requests are processed respectively to obtain the first business processing result corresponding to each business request, and the first business processing result corresponding to each business request is sent to the preset terminal object corresponding to each business request to obtain the preset terminal object corresponding to each business request, and the interaction processing result between the first business processing result corresponding to each business request, and then based on the preset terminal object corresponding to each business request, and the interaction processing result between the first business processing result corresponding to each business request, the first interaction data corresponding to each business request is obtained. When determining the first interaction data, if the number of associated business modules in the business system corresponding to the business to be evaluated meets the preset conditions, the business to be evaluated can be added to the second preset test layer for testing, thereby avoiding the situation where parameters are covered between the experimental layers and the experimental layers, and improving the accuracy of the evaluation results. By testing the service to be evaluated using the service request corresponding to the preset test layer to obtain the first interaction data, it can be ensured that the obtained first interaction data is authentic and reliable, thereby improving the reliability of the performance evaluation of the service to be evaluated.

[0058] Specifically, the second preset test layer is a multi-module linkage experimental layer in the layer domain model, which is used to test the business to be evaluated involving multiple associated business modules. Before adding the business to be evaluated to the preset test layer, if it is determined based on the business association information corresponding to the business to be evaluated that the number of associated business modules in the business system corresponding to the business to be evaluated meets the preset conditions, that is, the business logic of the business to be evaluated involves two or more business modules in the business system, the business to be evaluated can be added to the second preset test layer in the layer domain model.

[0059] As an example, in an advertising recommendation system, it usually includes a recall module, a rough sorting module, a fine sorting module, etc., and the business logics between these modules are related. In the advertising recommendation process, the recall module usually recalls a certain number of advertisements first, and then the rough sorting module performs rough sorting on the recall results of the recall module, and then the fine sorting module performs fine sorting on the rough sorting results of the rough sorting module, and finally sends the fine sorting results to a preset terminal object. If the business logic of the business to be evaluated involves the recall module, the rough sorting module, and the fine sorting module, three business modules that are related in the business system, the business to be evaluated can be added to the second preset test layer for testing.

[0060] In an embodiment of the present application, when the number of associated business modules in the business system corresponding to the business to be evaluated does not meet the preset conditions, the first preset test layer to which the business to be evaluated is added is a single-module experimental layer in the layer domain model. When the number of associated business modules in the business system corresponding to the business to be evaluated meets the preset conditions, the second preset test layer to which the business to be evaluated is added is a multi-module linkage experimental layer in the layer domain model. The multi-module linkage experimental layer is obtained by partially or completely merging multiple single-module experimental layers that meet the preset conditions. Meeting the preset conditions means that the business modules to which each of the multiple single-module experimental layers belongs is an associated business module in the business system. In other words, the business logic corresponding to the business modules to which each of the multiple single-module experimental layers belongs is in the same business link in the business system. For example, the first business module and the second business module are two business modules in the business system, and the business logic of the first business module and the business logic of the second business module are in the same business link in the business system. Then, the first business request corresponding to the experimental layer of the first business module and the second business request corresponding to the experimental layer of the second business module can be fixed as the same business request, and then the business request is used as the business request corresponding to the multi-module linkage experimental layer. Optionally, the first business request may be part of the business request or all of the business request corresponding to the experimental layer of the first business module. Similarly, the second business request may be part of the business request or all of the business request corresponding to the experimental layer of the second business module. By flexibly dividing the multi-module linkage experimental layer that runs through multiple experimental layers between experimental layers, and adding the services to be evaluated that meet the preset conditions for testing, parameter coverage between experimental layers can be avoided. Moreover, since the multi-module linkage experimental layer is obtained by partially or completely integrating multiple single-module experimental layers that meet the preset conditions, compared with directly dividing the multi-module experimental domain in the layer domain model, the multi-module linkage experimental layer can utilize more business requests, and at the same time, it can also avoid occupying the business request volume that can be used by other single-module experimental layers, thereby ensuring that there is no parameter coverage between experimental layers and high evaluation accuracy, while greatly improving the test efficiency.

[0061] Figure 3is a schematic diagram showing a structure of a multi-module linkage experiment layer and a single-module experiment layer according to an exemplary embodiment. Figure 3 As shown, the experimental layer of the first business module and the second business module are partially integrated to obtain a multi-module linkage experimental layer, and the business tested in the multi-module linkage experimental layer is the business to be evaluated of two or more related business modules in the corresponding business system. After receiving the business request, the business system can determine the experimental layer corresponding to the business request according to the overall business request division rule, such as performing hash calculations on the terminal object identifier, request resource information, etc., and determining the division and attribution of the business request according to the calculation results. For the multi-module linkage experimental layer, its corresponding business request will be assigned to the test business or control business in the business to be evaluated according to the set rules for processing, so as to obtain the corresponding business processing results, and then obtain the first interactive data according to the business processing results. For the single-module experimental layer, its corresponding business request will be assigned to each business to be evaluated in the experimental layer according to the set rules for processing, and the business request assigned to each business to be evaluated will also be divided into the test business and control business in each business to be evaluated according to the set rules.

[0062] In the embodiment of the present application, after adding the to-be-evaluated services of two or more associated service modules in the corresponding service system to the second preset test layer, the preset number of service requests corresponding to the multi-module linkage experimental layer can be used to test the to-be-evaluated services of two or more associated service modules in the corresponding service system, thereby obtaining the first interaction data corresponding to each service request. The specific process of processing the service request by the to-be-evaluated service added to the second preset test layer is the same as the process of processing the service request by the to-be-evaluated service added to the first preset test layer, and will not be repeated here.

[0063] In the embodiment of the present application, when the service to be evaluated is added to the preset test layer, the queuing rules need to be followed. That is, only when there are idle service requests in the preset test layer, can the service to be evaluated be added to the preset test layer in the queuing order. Generally, idle service requests will appear in the preset test layer only when the initial test service in the preset test layer ends the test, or the initial test service in the preset test layer is moved to the preset volume-increasing layer. For the initial service in a preset test layer, when it is moved to the preset volume-increasing layer for testing, certain preset conditions need to be met, and it needs to be added to the preset volume-increasing layer according to the corresponding volume-increasing strategy. Specifically, Figure 4 is a schematic diagram of a process of adding an initial test service to a preset volume-increasing layer according to an exemplary embodiment. Figure 4 As shown, adding the initial test service to the preset volume-increasing layer may include:

[0064] S201: Based on the initial test service, a service request corresponding to a preset test layer is processed to obtain a second service processing result.

[0065] S203: Based on the second service processing result, obtain second interaction data between the preset terminal object and the second service processing result.

[0066] S205: When the second interaction data meets a preset condition, determine the volume expansion strategy corresponding to the service type of the initial test service according to the volume expansion strategy mapping information; the volume expansion strategy mapping information represents the mapping relationship between the service type and the volume expansion strategy.

[0067] S207: Based on the volume-increasing strategy corresponding to the initial test service, the initial test service is added to the preset volume-increasing layer to obtain the volume-increasing test service in the preset volume-increasing layer.

[0068] In the above steps S201 to S203, in order to achieve the ratio of the number of business requests processed in the volume test business, there is no need to suspend the business to be evaluated, and the business that needs to be tested in volume can be moved to the preset volume layer for testing to improve the test efficiency. For the initial test business in a preset test layer, before adding it to the preset volume layer for volume processing, it can be preliminarily tested based on the business request corresponding to the preset test layer to obtain the second business processing result, and then obtain the second interactive data. Specifically, when the business system receives the business request, the business system determines that the business request is a business request corresponding to an initial test business in the prediction test layer, and sends the business request to the initial test business for processing. The initial test business parses the business request to obtain the request information carried in the business request to determine the corresponding request object, and then takes the value of each parameter configuration of the request object according to the business logic, so as to obtain the second business processing result. After obtaining the second business processing result, the second business processing result can be sent to the preset terminal object corresponding to the business request. When the preset terminal object receives the second business processing result, the second business processing result can be interactively processed. According to the difference of the second service processing result, the preset terminal object can interact with the second service processing result in different ways to obtain the interaction processing result. Then, after obtaining the interaction processing result between the preset terminal object sending the service request and the second service processing result, it can be determined that the service request corresponds to the second interaction data according to the interaction processing result.

[0069] In the above steps S205 to S207, satisfying the preset condition means that the optimization effect of the initial test service determined according to the second interaction data is positive or has no obvious negative effect. In this case, the business type information of the initial test service is obtained to determine the business type of the initial test service. Then, based on the volume expansion strategy mapping information, the volume expansion strategy corresponding to the business type of the initial test service is determined, and the volume expansion strategy mapping information characterizes the mapping relationship between the business type and the volume expansion strategy. Then, the volume expansion strategy corresponding to the business type of the initial test service is added to the preset volume expansion layer. By setting different volume expansion strategies for initial test services of different business types in advance, the utilization efficiency of the volume expansion layer can be improved, thereby improving the test efficiency.

[0070] In the embodiment of the present application, the service types of the initial test service include functional test type, logical compatibility type and logical mutual exclusion type. Accordingly, the corresponding volume expansion strategy includes functional test volume expansion strategy, logical compatibility volume expansion strategy and logical mutual exclusion volume expansion strategy. After obtaining the volume expansion strategy corresponding to the initial test service, the initial test service can be moved to the preset volume expansion layer for volume expansion processing according to the corresponding volume expansion strategy.

[0071] As an optional implementation, when the service type of the initial test service is a functional test type, its corresponding expansion strategy is a functional test type expansion strategy. The functional test type refers to the initial test service used to test a certain function, such as a certain switch button displayed on the interface. Since the initial test service of the functional test type generally does not produce obvious optimization effects as expected, if the preliminary test determines that its optimization effect is positive or has no obvious negative effect, it can be added to the preset expansion layer for further testing. Optionally, the functional test type expansion strategy is to directly add the initial test service to the preset expansion layer. When adding the initial test service to the preset expansion layer, based on the functional test type expansion strategy, the initial test service is directly added to the preset expansion layer to obtain the expansion test service in the preset expansion layer. Figure 5 FIG. 1 is a schematic diagram showing a method of increasing the volume of an initial test service of a functional test type according to an exemplary embodiment. Figure 5As shown, the strategy of using the preset volume-release layer for the initial test service of the functional test type is to use it according to the first-in-first-out queuing principle. For example, for services 1 and 2 arranged in the queue order, service 1 can be moved to the preset volume-release layer for volume-release testing first. After service 1 completes the volume-release test, service 2 is moved to the preset volume-release layer for volume-release testing. Similarly, for the services to be evaluated whose service type is the functional test type, the strategy of adding them to the preset test layer can also be added according to the first-in-first-out queuing principle. For example, after service 1 is moved to the preset volume-release layer for volume-release testing, idle service requests appear in the preset test layer. At this time, service 3, which is in the front of services 3 and 4 arranged in the queue order, can be added to the preset test layer. By directly adding the initial test service to the preset volume-release layer when the service type of the initial test service is the functional test type, the test efficiency is improved.

[0072] As another optional implementation, when the service type of the initial test service is a logically compatible type, its corresponding volume expansion strategy is a logically compatible volume expansion strategy. The logically compatible type means that the service logic of the initial test service in the preset test layer is compatible. As an example, a preset test layer is used to test the optimization effect of increasing the input features of the click-through rate model. One of the initial test services has the feature ABCDE for the click-through rate model input, and the other initial test service has the feature ABCDF for the click-through rate model input. Then the service types of these two initial test services are logically compatible types. For the initial test service whose service type is a logically compatible type, when performing a volume expansion test, a feasible strategy is to merge all the initial test services in the preset test layer to obtain a fused test service. For example, in the above example, the fused test service obtained after fusion has the feature ABCDEF for the click-through rate model input. Since all the initial test services in the preset test layer are merged together, the service requests corresponding to each initial test service before the fusion can also be superimposed together, so that the fused test service can be tested using all the service requests in the preset test layer. Another feasible strategy is to merge all the initial test services in the preset test layer to obtain a merged test service, and then add the merged test service to the preset volume-increasing layer. Optionally, the logic compatibility volume-increasing strategy includes merging the initial test services to obtain a merged test service, and then adding the merged test service to the preset volume-increasing layer to obtain a volume-increasing test service in the preset volume-increasing layer. When adding the initial test service to the preset volume-increasing layer, the initial test service can be added to the preset volume-increasing layer based on the logic compatibility volume-increasing strategy to obtain a volume-increasing test service in the preset volume-increasing layer. Figure 6 FIG. 1 is a schematic diagram showing a method of performing volume expansion processing on an initial test service of a logic compatible type according to an exemplary embodiment. Figure 6As shown, the strategy of using the preset volume-release layer for the initial test service of the logical compatibility type is to merge the initial test service to obtain the merged test service, and then add the merged test service to the preset volume-release layer to obtain the volume-release test service in the preset volume-release layer. For example, for service 1 and service 2 in the preset test layer, service 1 and service 2 can be merged into a merged test service first, and then the merged test service can be moved to the preset volume-release layer for volume-release testing. When service 1 and service 2 are merged into a merged test service and moved to the preset volume-release layer for volume-release testing, idle service requests appear in the preset test layer. At this time, service 3 and service 4 in the service to be evaluated arranged in queue order can be added to the preset test layer. By merging the initial test service in the preset test layer into a merged test service when the service type of the initial test service is a logical compatibility type, and then adding the merged test service to the preset volume-release layer, the test efficiency is improved.

[0073] As another optional implementation, when the business type of the initial test business includes a logical mutually exclusive type, its corresponding expansion strategy is a logical mutually exclusive expansion strategy. The logical mutually exclusive type means that the business logic of the initial test business in the preset test layer is mutually exclusive. As an example, a preset test layer is used to test the optimization effect of different weight parameters in the click-through rate model. One of the initial test businesses has a weight parameter of 1.0 in the click-through rate model, and the other initial test business has a weight parameter of 1.1 in the click-through rate model. The business types of these two initial test businesses are logically mutually exclusive types. For the initial test business whose business type is a logically mutually exclusive type, when conducting a volume expansion test, the initial test business with the best optimization effect can be selected for volume expansion test. For example, in the above example, the optimization effect of the weight parameter of 1.0 in the click-through rate model is lower than the optimization effect of the initial test business with a weight parameter of 1.01 in the click-through rate model. Then, the initial test business corresponding to the weight parameter of 1.01 in the click-through rate model can be moved to the volume expansion layer for volume expansion test. Optionally, the logical mutual exclusion type of volume expansion strategy includes determining in the initial test business that the second interactive data meets the preset conditions of the target test business, and then adding the target test business to the preset volume expansion layer to obtain the volume expansion test business in the preset volume expansion layer. When the initial test business is added to the preset volume expansion layer based on the volume expansion strategy corresponding to the initial test business, the initial test business can be added to the preset volume expansion layer based on the logical mutual exclusion type of volume expansion strategy to obtain the volume expansion test business in the preset volume expansion layer. Figure 7 FIG. 1 is a schematic diagram showing a method of increasing the volume of an initial test service of a logical mutual exclusion type according to an exemplary embodiment. Figure 7As shown, the strategy of using the preset volume-release layer for the initial test business of the logical mutual exclusion type is to determine the initial test business with the best optimization effect in the preset test layer, and then add it as the target test business to the preset volume-release layer to obtain the volume-release test business in the preset volume-release layer. For example, for business 1 and business 2 in the preset test layer, after preliminary testing in the preset volume-release layer, it is determined that the optimization effect of business 2 is higher than that of business 1. At this time, business 2 can be moved to the preset volume-release layer as the target test business for volume-release testing. After business 2 is moved to the preset volume-release layer for volume-release testing, idle business requests appear in the preset test layer. At this time, business 3, which is in the front of business 3 and business 4 to be evaluated arranged in queue order, can be added to the preset test layer. By directly selecting the initial test business with better optimization effect in the preset test layer and adding it to the preset volume-release layer when the business type of the initial test business is a logical mutual exclusion type, invalid testing can be avoided, greatly improving the test efficiency.

[0074] S103: Determine the evaluation strategy corresponding to the service type indicated by the service type information according to the type strategy mapping information; the type strategy mapping information represents the mapping relationship between the service type and the evaluation strategy.

[0075] In an embodiment of the present application, when testing the business to be evaluated, if there is a situation where the initial test business in the corresponding preset test layer is moved to the preset volume-release layer, the business request processed by the business to be evaluated may be processed by the business to be evaluated in the preset volume-release layer and the volume-release test business in the preset volume-release layer at the same time, resulting in parameter coverage. In this case, the first interaction data obtained will contain interaction data that is affected by parameter coverage. If the performance evaluation of the business to be evaluated is performed directly based on the first interaction data, the evaluation result will be inaccurate. However, since the tolerance of the business to be evaluated of different business types is different for parameter coverage, different evaluation strategies can be set for the evaluated businesses of different business types in advance according to the business type of the business to be evaluated. When performing performance evaluation on the business to be evaluated, the evaluation strategy corresponding to the business to be evaluated can be determined first, and then the business to be evaluated can be evaluated according to the evaluation strategy corresponding to the business to be evaluated.

[0076] In an embodiment of the present application, when determining the evaluation strategy corresponding to the business to be evaluated, it can be determined according to the type strategy mapping information. The type strategy mapping information represents the mapping relationship between the business type and the evaluation strategy. The business type information of the business to be evaluated is used to indicate the business type of the business to be evaluated. After obtaining the business type information of the business to be evaluated, the evaluation strategy corresponding to the business to be evaluated can be determined according to the business type indicated by the business type information, using the mapping relationship between the business type and the evaluation strategy. Then, according to the evaluation strategy corresponding to the business to be evaluated, the first interaction data is subjected to performance evaluation processing to obtain corresponding performance evaluation data.

[0077] S105: Perform performance evaluation processing on the first interaction data according to the evaluation strategy to obtain performance evaluation data of the service to be evaluated.

[0078] In the embodiment of the present application, the business type of the business to be evaluated is different, and the evaluation strategy of the business to be evaluated is also different. Optionally, the business type of the business to be evaluated includes a functional test type, a logical compatibility type, and a logical mutual exclusion type, and accordingly, the corresponding evaluation strategy includes a functional test type evaluation strategy, a logical compatibility type evaluation strategy, and a logical mutual exclusion type evaluation strategy. After obtaining the evaluation strategy corresponding to the business to be evaluated, the performance evaluation process of the business to be evaluated can be performed according to the corresponding evaluation strategy.

[0079] As an optional implementation, when the business type of the business to be evaluated is a functional test type, the corresponding evaluation strategy is a functional test type evaluation strategy. Since the business to be evaluated of the functional test type generally does not produce obvious optimization effects as expected, whether there is parameter coverage during the test of the business to be evaluated of the functional test type has little effect on its performance evaluation results, so the performance evaluation can be performed directly based on the first interaction data. Optionally, the functional test type evaluation strategy includes a strategy for directly performing performance evaluation processing based on the first interaction data. When the first interaction data is subjected to performance evaluation processing according to the evaluation strategy, the first interaction data can be directly subjected to performance evaluation processing to obtain performance evaluation data of the business to be evaluated. Similarly, for the volume test business in the preset volume test layer, the performance evaluation can also be directly performed based on the corresponding number of interactions to obtain the corresponding performance evaluation data. By directly evaluating the business to be evaluated based on the first interaction data when the business type of the business to be evaluated is a functional test type, the efficiency of performance evaluation can be improved.

[0080] As another optional implementation, when the business type of the business to be evaluated is a logical compatibility type, the corresponding evaluation strategy is a logical compatibility evaluation strategy. When the business to be evaluated of the logical compatibility type is subjected to a volume test, it will be integrated into a fusion test business for volume processing. When the business to be evaluated is tested, since the priority of the business logic parameters in the preset test layer is usually higher than the priority of the business logic parameters in the preset volume layer, if the business logic corresponding to the volume test business in the preset volume layer is set as the comparison business logic, then the test business effectiveness logic of the business to be evaluated will not be covered by the volume test business in the preset volume layer, and the performance evaluation process can be directly performed according to the first interaction data. Optionally, the logical compatibility evaluation strategy includes a first logical compatibility evaluation sub-strategy, and the first logical compatibility evaluation sub-strategy includes a case where the business logic corresponding to the volume test business in the preset volume layer is set as the comparison business logic, and the performance evaluation process is performed according to the first interaction data. When the first interaction data is subjected to performance evaluation according to the evaluation strategy, the first interaction data can be subjected to performance evaluation according to the first logical compatibility evaluation sub-strategy to obtain the performance evaluation data of the business to be evaluated. Similarly, for the volume test business in the preset volume layer, the performance evaluation can also be directly performed according to the corresponding number of interactions to obtain the corresponding performance evaluation data. By determining whether the business logic corresponding to the volume test business in the preset volume layer is set as the comparison business logic when the business type of the business to be evaluated is a logically compatible type, if so, the business to be evaluated can be directly evaluated according to the first interaction data, thereby improving the efficiency of performance evaluation.

[0081] As another optional implementation, when the business type of the business to be evaluated is a logically compatible type, if the business logic corresponding to the volume test business in the preset volume layer is not set to the comparison business logic, there will be parameter coverage between the volume test business in the preset volume layer and the business to be evaluated. Therefore, when performing performance evaluation on the business to be evaluated, in order to avoid the influence of parameter coverage, it is necessary to eliminate the interactive data affected by the parameter coverage to improve the accuracy of the performance evaluation. Specifically, the business to be evaluated includes a first test business and a first control business, and the volume test business in the preset volume layer includes a second test business and a second control business. The first interactive data includes interactive test data and interactive control data. The interactive test data includes data corresponding to the first test business and the second test business, and data corresponding to the first test business and the second control business. The interactive control data includes data corresponding to the first control business and the second test business, and data corresponding to the first control business and the second control business. The logic compatibility class evaluation strategy also includes a second logic compatibility class evaluation sub-strategy, and the second logic compatibility class evaluation sub-strategy includes, when the business logic corresponding to the volume test business in the preset volume test layer is not set as the comparison business logic, from the interaction test data, determine the interaction data corresponding to the business request processed by the first test business and the second test business at the same time, and obtain candidate interaction test data, and from the interaction comparison data, determine the interaction data corresponding to the business request processed by the first comparison business and the second test business at the same time, and obtain candidate interaction comparison data, and then filter out the candidate interaction test data in the interaction test data to obtain target interaction test data, and filter out the candidate interaction comparison data in the interaction comparison data to obtain target interaction comparison data, and perform performance evaluation processing on the target interaction test data and the target interaction comparison data. When the first interaction data is subjected to performance evaluation processing according to the evaluation strategy, the first interaction data can be subjected to performance evaluation processing according to the second logic compatibility class evaluation sub-strategy to obtain performance evaluation data of the business to be evaluated. Similarly, for the volume test business in the preset volume test layer, when performing performance evaluation on it, it is also necessary to eliminate the interaction data affected by parameter coverage according to the above scheme, and perform performance evaluation based on the interaction data after elimination, so as to obtain corresponding performance evaluation data. By determining whether the business logic corresponding to the volume test business in the preset volume test layer is set as the comparison business logic when the business type of the business to be evaluated is a logically compatible type, if not, candidate interaction test data and candidate interaction test data can be determined from the interaction data, thereby improving the efficiency of eliminating the interaction data affected by parameter coverage, while improving the accuracy of the test business evaluation.

[0082] As an optional implementation, when the business type of the business to be evaluated is a logically mutually exclusive type, the corresponding evaluation strategy is a logically mutually exclusive evaluation strategy. For the business to be evaluated of the logically mutually exclusive type, there will be parameter coverage between the volume test business in the preset volume release layer and the business to be evaluated. Therefore, when the performance evaluation is performed on the business to be evaluated, in order to avoid the influence of parameter coverage, the interactive data affected by the parameter coverage needs to be eliminated to improve the accuracy of the performance evaluation. Specifically, the business to be evaluated includes a first test business and a first control business. The volume test business in the preset volume release layer includes a second test business and a second control business. The first interactive data includes interactive test data and interactive control data. The interactive test data includes data corresponding to the first test business and the second test business, and data corresponding to the first test business and the second control business. The interactive control data includes data corresponding to the first control business and the second test business, and data corresponding to the first control business and the second control business; the business type includes a logically mutually exclusive type. The evaluation strategy corresponding to the logical mutual exclusion type is a logical mutual exclusion evaluation strategy. The logical mutual exclusion evaluation strategy includes determining the interactive data corresponding to the service requests processed by the first test service and the second test service at the same time from the interactive test data to obtain candidate interactive test data, and determining the interactive data corresponding to the service requests processed by the first comparison service and the second test service at the same time from the interactive comparison data to obtain candidate interactive comparison data, screening out the candidate interactive test data in the interactive test data to obtain target interactive test data, and screening out the candidate interactive comparison data in the interactive comparison data to obtain target interactive comparison data, and performing performance evaluation on the target interactive test data and the target interactive comparison data. When the first interactive data is subjected to performance evaluation according to the evaluation strategy, the first interactive data can be subjected to performance evaluation according to the logical mutual exclusion evaluation strategy to obtain performance evaluation data of the service to be evaluated. Similarly, for the volume test service in the preset volume test layer, when performing performance evaluation on it, it is also necessary to eliminate the interactive data affected by parameter coverage according to the above scheme, and perform performance evaluation based on the eliminated interactive data to obtain corresponding performance evaluation data. By determining candidate interaction test data and candidate interaction test data from the interaction data when the business type of the business to be evaluated is a logically mutually exclusive type, the efficiency of eliminating interaction data affected by parameter coverage can be improved, while the accuracy of evaluating the test business can be improved.

[0083] The present application also provides a service evaluation device. Figure 8 FIG. 1 is a block diagram of a service evaluation device according to an exemplary embodiment. Figure 8 As shown, the device may include at least:

[0084] The acquisition module 301 is used to obtain the business type information and the first interaction data of the business to be evaluated; the first interaction data is the interaction data between the preset terminal object and the first business processing result; the first business processing result is obtained by processing the preset number of business requests of the business to be evaluated in the preset test layer and the volume test business in the preset volume release layer respectively when the business to be evaluated is added to the preset test layer; the volume test business in the preset volume release layer is the initial test business in the preset test layer, which is added to the preset volume release layer when the preset conditions are met; the initial test business is the business in the preset test layer except the business to be evaluated;

[0085] An evaluation strategy determination module 303 is used to determine the evaluation strategy corresponding to the service type indicated by the service type information according to the type strategy mapping information; the type strategy mapping information represents the mapping relationship between the service type and the evaluation strategy;

[0086] The performance evaluation module 305 is used to perform performance evaluation processing on the first interaction data according to the evaluation strategy to obtain performance evaluation data of the service to be evaluated.

[0087] In some optional embodiments, the preset test layer includes a first preset test layer; the device further includes a first interaction data determination module, and the first interaction data determination module includes:

[0088] The acquisition submodule is used to acquire the business to be evaluated and the business association information corresponding to the business to be evaluated; the business association information is used to indicate the number of associated business modules in the business system corresponding to the business to be evaluated;

[0089] A preset test layer adding submodule, used for adding the business to be evaluated to the first preset test layer when the business association information indicates that the number of associated business modules in the business system corresponding to the business to be evaluated does not meet a preset condition;

[0090] A first business processing result determination submodule is used to process a preset number of business requests based on the business to be evaluated in the first preset test layer and the volume test business in the preset volume layer, and obtain a first business processing result corresponding to each business request;

[0091] An interactive processing result determination submodule, used to send the first business processing result corresponding to each business request to the preset terminal object corresponding to each business request, so as to obtain the interactive processing result between the preset terminal object corresponding to each business request and the first business processing result corresponding to each business request;

[0092] The first interaction data determination submodule is used to obtain the first interaction data corresponding to each business request based on the interaction processing result between the preset terminal object corresponding to each business request and the first business processing result corresponding to each business request.

[0093] In some optional embodiments, the service type includes a functional test type; the evaluation strategy corresponding to the functional test type is a functional test type evaluation strategy; the functional test type evaluation strategy includes a strategy for directly performing performance evaluation processing according to the first interaction data; the performance evaluation module includes:

[0094] The performance evaluation submodule is used to perform performance evaluation processing on the first interaction data according to the functional test type evaluation strategy to obtain performance evaluation data of the service to be evaluated.

[0095] In some optional embodiments, the service type includes a logic compatibility type; the evaluation strategy corresponding to the logic compatibility type is a logic compatibility class evaluation strategy; the logic compatibility class evaluation strategy includes a first logic compatibility class evaluation sub-strategy; the first logic compatibility class evaluation sub-strategy includes performing performance evaluation processing according to the first interaction data when the service logic corresponding to the volume test service in the preset volume layer is set to the comparison service logic; the performance evaluation module includes:

[0096] The performance evaluation submodule is used to perform performance evaluation processing on the first interaction data according to the first logical compatibility class evaluation sub-strategy to obtain performance evaluation data of the service to be evaluated.

[0097] In some optional embodiments, the business to be evaluated includes a first test business and a first control business; the volume test business in the preset volume test layer includes a second test business and a second control business; the first interaction data includes interaction test data and interaction control data; the interaction test data includes data corresponding to the first test business and the second test business, and data corresponding to the first test business and the second control business; the interaction control data includes data corresponding to the first control business and the second test business, and data corresponding to the first control business and the second control business; the logical compatibility class evaluation strategy also includes a second logical compatibility class evaluation sub-strategy; the second logical compatibility class evaluation sub-strategy includes the volume test business in the preset volume test layer. When the business logic corresponding to the service is not set as the comparison business logic, the interaction data corresponding to the business request processed by the first test service and the second test service is determined from the interaction test data to obtain candidate interaction test data, and the interaction data corresponding to the business request processed by the first comparison service and the second test service is determined from the interaction comparison data to obtain candidate interaction comparison data, the candidate interaction test data in the interaction test data is screened out to obtain target interaction test data, and the candidate interaction comparison data in the interaction comparison data is screened out to obtain target interaction comparison data, and performance evaluation processing is performed on the target interaction test data and the target interaction comparison data; the performance evaluation module includes:

[0098] The performance evaluation submodule is used to perform performance evaluation processing on the first interaction data according to the second logic compatibility class evaluation sub-strategy to obtain performance evaluation data of the service to be evaluated.

[0099] In some optional embodiments, the business to be evaluated includes a first test business and a first control business; the volume test business in the preset volume test layer includes a second test business and a second control business; the first interaction data includes interaction test data and interaction control data; the interaction test data includes data corresponding to the first test business and the second test business, and data corresponding to the first test business and the second control business; the interaction control data includes data corresponding to the first control business and the second test business, and data corresponding to the first control business and the second control business; the business type includes a logical mutual exclusion type; the evaluation strategy corresponding to the logical mutual exclusion type is a logical mutual exclusion type evaluation strategy; the logical mutual exclusion type evaluation strategy includes determining from the interaction test data, interaction data corresponding to the business request processed by the first test business and the second test business at the same time, obtaining candidate interaction test data, and determining from the interaction control data, interaction data corresponding to the business request processed by the first control business and the second test business at the same time, obtaining candidate interaction control data, screening out the candidate interaction test data in the interaction test data, obtaining target interaction test data, and screening out the candidate interaction control data in the interaction control data, obtaining target interaction control data, and performing performance evaluation processing on the target interaction test data and the target interaction control data; the performance evaluation module includes:

[0100] The performance evaluation submodule is used to perform performance evaluation processing on the first interaction data according to the logic mutual exclusion evaluation strategy to obtain performance evaluation data of the service to be evaluated.

[0101] In some optional embodiments, the device further comprises:

[0102] A second service processing result determination module is used to process the service request corresponding to the preset test layer based on the initial test service to obtain a second service processing result;

[0103] A second interaction data determination module, used to obtain second interaction data between the preset terminal object and the second service processing result based on the second service processing result;

[0104] A volume expansion strategy determination module is used to determine the volume expansion strategy corresponding to the service type of the initial test service according to the volume expansion strategy mapping information when the second interaction data meets the preset condition; the volume expansion strategy mapping information represents the mapping relationship between the service type and the volume expansion strategy;

[0105] The volume-increasing test service determination module is used to add the initial test service to the preset volume-increasing layer based on the volume-increasing strategy corresponding to the initial test service, so as to obtain the volume-increasing test service in the preset volume-increasing layer.

[0106] In some optional embodiments, the service type includes a functional test type; the volume release strategy corresponding to the functional test type is a functional test volume release strategy; the functional test volume release strategy includes directly adding the initial test service to the preset volume release layer; the volume release test service determination module includes:

[0107] The volume-release test business determination submodule is used to add the initial test business to the preset volume-release layer based on the functional test type volume-release strategy to obtain the volume-release test business in the preset volume-release layer.

[0108] In some optional embodiments, the service type includes a logical compatibility type; the volume expansion strategy corresponding to the logical compatibility type is a logical compatibility type volume expansion strategy; the logical compatibility type volume expansion strategy includes fusing the initial test service to obtain a fused test service, and adding the fused test service to a preset volume expansion layer; the volume expansion test service determination module includes:

[0109] The volume-release test service determination submodule is used to add the initial test service to the preset volume-release layer based on the logic compatible volume-release strategy to obtain the volume-release test service in the preset volume-release layer.

[0110] In some optional embodiments, the service type includes a logical mutual exclusion type; the volume expansion strategy corresponding to the logical mutual exclusion type is a logical mutual exclusion type volume expansion strategy; the logical mutual exclusion type volume expansion strategy includes determining a target test service in which the second interaction data satisfies a preset condition in the initial test service, and adding the target test service to a preset volume expansion layer; the volume expansion test service determination module includes:

[0111] The volume-release test business determination submodule is used to add the initial test business to the preset volume-release layer based on the logical mutually exclusive volume-release strategy to obtain the volume-release test business in the preset volume-release layer.

[0112] In some optional embodiments, the preset test layer further includes a second preset test layer; and the device further includes:

[0113] A test business acquisition module, configured to add the business to be evaluated to a second preset test layer when the business association information indicates that the number of associated business modules in the business system corresponding to the business to be evaluated meets a preset condition;

[0114] A first business processing result determination module is used to process a preset number of business requests based on the business to be evaluated in the second preset test layer and the volume test business in the preset volume layer, and obtain a first business processing result corresponding to each business request;

[0115] An interactive processing result determination module, used to send the first business processing result corresponding to each business request to the preset terminal object corresponding to each business request, so as to obtain the interactive processing result between the preset terminal object corresponding to each business request and the first business processing result corresponding to each business request;

[0116] The first interaction data determination module is used to obtain the first interaction data corresponding to each business request based on the interaction processing result between the preset terminal object corresponding to each business request and the first business processing result corresponding to each business request.

[0117] It should be noted that the business evaluation device embodiment provided in the embodiments of the present application and the above-mentioned business evaluation method embodiment are based on the same inventive concept.

[0118] An embodiment of the present application also provides an electronic device for business evaluation, which includes a processor and a memory, wherein the memory stores at least one instruction or at least one program, and the at least one instruction or at least one program is loaded and executed by the processor to implement a business evaluation method provided in any of the above embodiments.

[0119] An embodiment of the present application also provides a computer-readable storage medium, which can be set in a terminal to store at least one instruction or at least one program for implementing a business evaluation method in a method embodiment, and the at least one instruction or at least one program is loaded and executed by a processor to implement the business evaluation method provided in the above method embodiment.

[0120] Optionally, in the embodiment of this specification, the storage medium may be located in at least one of the multiple network servers of the computer network. Optionally, in this embodiment, the above storage medium may include but is not limited to: a USB flash drive, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk or an optical disk, and other media that can store program codes.

[0121] The memory of the embodiment of this specification can be used to store software programs and modules, and the processor executes various functional applications and data processing by running the software programs and modules stored in the memory. The memory may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, applications required for functions, etc.; the data storage area may store data created according to the use of the device, etc. In addition, the memory may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage device. Accordingly, the memory may also include a memory controller to provide the processor with access to the memory.

[0122] The embodiment of the present application also provides a computer program product or a computer program, which includes a computer instruction stored in a computer-readable storage medium. The processor of the computer device reads the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the computer device executes the service evaluation method provided by the above method embodiment.

[0123] The method embodiments provided in the embodiments of the present application can be executed in a terminal, a computer terminal, a server or a similar computing device. Taking running on a server as an example, Fig. 9 FIG. 1 is a hardware structure diagram of a server of a service evaluation method provided according to an exemplary embodiment. Fig. 9 As shown, the server 400 may have relatively large differences due to different configurations or performances, and may include one or more central processing units (CPU) 410 (the central processing unit 410 may include but is not limited to a processing device such as a microprocessor MCU or a programmable logic device FPGA), a memory 430 for storing data, and one or more storage media 420 (such as one or more mass storage devices) for storing application programs 423 or data 422. Among them, the memory 430 and the storage medium 420 can be short-term storage or permanent storage. The program stored in the storage medium 420 may include one or more modules, each of which may include a series of instruction operations on the server. Furthermore, the central processing unit 410 can be configured to communicate with the storage medium 420 and execute a series of instruction operations in the storage medium 420 on the server 400. The server 400 may also include one or more power supplies 460, one or more wired or wireless network interfaces 450, one or more input and output interfaces 440, and / or one or more operating systems 421, such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM, etc.

[0124] The input / output interface 440 may be used to receive or send data via a network. The specific example of the network may include a wireless network provided by a communication provider of the server 400. In one example, the input / output interface 440 includes a network adapter (Network Interface Controller, NIC), which may be connected to other network devices via a base station so as to communicate with the Internet. In one example, the input / output interface 440 may be a radio frequency (RF) module, which is used to communicate with the Internet wirelessly.

[0125] It can be understood by those skilled in the art that Fig. 9 The structure shown is only for illustration and does not limit the structure of the above electronic device. Fig. 9 More or fewer components as shown, or with Fig. 9 Different configurations are shown.

[0126] It should be noted that the above-mentioned sequence of the embodiments of the present application is for description only and does not represent the advantages and disadvantages of the embodiments. The above-mentioned specific embodiments of this specification are described. Other embodiments are within the scope of the attached claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0127] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the device and server embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiments.

[0128] A person skilled in the art will understand that all or part of the steps to implement the above embodiments may be accomplished by hardware, or by a program to instruct the relevant hardware, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a disk or an optical disk, etc.

[0129] The above are only preferred embodiments of the present application and are not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application should be included in the protection scope of the present application.

Claims

1. A business evaluation method, characterized in that: The method comprises: Obtaining business type information and first interaction data of the business to be evaluated; the first interaction data is interaction data between a preset terminal object and a first business processing result; the first business processing result is obtained by processing a preset number of business requests respectively for the business to be evaluated in the preset test layer and the volume-release test business in the preset volume-release layer when the business to be evaluated is added to the preset test layer; the volume-release test business in the preset volume-release layer is the initial test business in the preset test layer, which is added to the preset volume-release layer when preset conditions are met; the initial test business is a business in the preset test layer other than the business to be evaluated; Determine, according to the type strategy mapping information, an evaluation strategy corresponding to the service type indicated by the service type information; the type strategy mapping information represents a mapping relationship between the service type and the evaluation strategy; The first interaction data is subjected to performance evaluation processing according to the evaluation strategy to obtain performance evaluation data of the service to be evaluated.

2. The method according to claim 1, characterized in that The preset test layer includes a first preset test layer; and the method for determining the first interaction data includes: Acquire the business to be evaluated and business association information corresponding to the business to be evaluated; the business association information is used to indicate the number of associated business modules in the business system corresponding to the business to be evaluated; When the business association information indicates that the number of associated business modules in the business system corresponding to the business to be evaluated does not meet a preset condition, adding the business to be evaluated to the first preset test layer; Based on the to-be-evaluated services in the first preset test layer and the volume-test services in the preset volume-release layer, a preset number of service requests are processed respectively to obtain a first service processing result corresponding to each of the service requests; Sending the first business processing result corresponding to each of the business requests to the preset terminal object corresponding to each of the business requests, so as to obtain the interaction processing result between the preset terminal object corresponding to each of the business requests and the first business processing result corresponding to each of the business requests; Based on the interaction processing result between the preset terminal object corresponding to each of the service requests and the first service processing result corresponding to each of the service requests, the first interaction data corresponding to each of the service requests is obtained.

3. The method according to claim 1, characterized in that The service type includes a functional test type; the evaluation strategy corresponding to the functional test type is a functional test type evaluation strategy; the functional test type evaluation strategy includes a strategy for directly performing performance evaluation processing based on the first interaction data; The performing performance evaluation processing on the first interaction data according to the evaluation strategy to obtain performance evaluation data of the service to be evaluated includes: The first interaction data is subjected to performance evaluation processing according to the functional test type evaluation strategy to obtain performance evaluation data of the service to be evaluated.

4. The method according to claim 1, characterized in that: The service type includes a logic compatibility type; the evaluation strategy corresponding to the logic compatibility type is a logic compatibility class evaluation strategy; the logic compatibility class evaluation strategy includes a first logic compatibility class evaluation sub-strategy; the first logic compatibility class evaluation sub-strategy includes, when the service logic corresponding to the volume test service in the preset volume-increasing layer is set to a comparison service logic, performing performance evaluation processing according to the first interaction data; The performing performance evaluation processing on the first interaction data according to the evaluation strategy to obtain performance evaluation data of the service to be evaluated includes: The first interaction data is subjected to performance evaluation processing according to the first logical compatibility class evaluation sub-strategy to obtain performance evaluation data of the service to be evaluated.

5. The method according to claim 4, characterized in that The service to be evaluated includes a first test service and a first control service; the test service in the preset volume-release layer includes a second test service and a second control service; the first interaction data includes interaction test data and interaction control data; the interaction test data includes data corresponding to the first test service and the second test service, and data corresponding to the first test service and the second control service; the interaction control data includes data corresponding to the first control service and the second test service, and data corresponding to the first control service and the second control service; the logic compatibility class evaluation strategy also includes a second logic compatibility class evaluation sub-strategy; the second logic compatibility class evaluation sub-strategy includes the volume-release test service in the preset volume-release layer; In the case where the business logic corresponding to the test business is not set as the comparison business logic, determining from the interaction test data the interaction data corresponding to the business request processed by both the first test business and the second test business to obtain candidate interaction test data, and determining from the interaction comparison data the interaction data corresponding to the business request processed by both the first comparison business and the second test business to obtain candidate interaction comparison data, filtering out the candidate interaction test data from the interaction test data to obtain target interaction test data, and filtering out the candidate interaction comparison data from the interaction comparison data to obtain target interaction comparison data, and performing performance evaluation processing on the target interaction test data and the target interaction comparison data; The performing performance evaluation processing on the first interaction data according to the evaluation strategy to obtain performance evaluation data of the service to be evaluated includes: The first interaction data is subjected to performance evaluation processing according to the second logic compatibility class evaluation sub-strategy to obtain performance evaluation data of the service to be evaluated.

6. The method according to claim 1, characterized in that The business to be evaluated includes a first test business and a first control business; the volume test business in the preset volume-increasing layer includes a second test business and a second control business; the first interaction data includes interaction test data and interaction control data; the interaction test data includes data corresponding to the first test business and the second test business, and data corresponding to the first test business and the second control business; the interaction control data includes data corresponding to the first control business and the second test business, and data corresponding to the first control business and the second control business; the business type includes a logical mutual exclusion type; the evaluation strategy corresponding to the logical mutual exclusion type is a logical mutual exclusion type evaluation strategy; The logical mutual exclusion class evaluation strategy includes determining, from the interaction test data, interaction data corresponding to the service requests processed by both the first test service and the second test service to obtain candidate interaction test data, and determining, from the interaction comparison data, interaction data corresponding to the service requests processed by both the first comparison service and the second test service to obtain candidate interaction comparison data, screening out the candidate interaction test data from the interaction test data to obtain target interaction test data, and screening out the candidate interaction comparison data from the interaction comparison data to obtain target interaction comparison data, and performing performance evaluation processing on the target interaction test data and the target interaction comparison data; The performing performance evaluation processing on the first interaction data according to the evaluation strategy to obtain performance evaluation data of the service to be evaluated includes: The first interaction data is subjected to performance evaluation processing according to the logic mutual exclusion class evaluation strategy to obtain performance evaluation data of the service to be evaluated.

7. The method according to claim 1, characterized in that The method further comprises: Based on the initial test service, processing the service request corresponding to the preset test layer to obtain a second service processing result; Based on the second business processing result, obtaining second interaction data between the preset terminal object and the second business processing result; When the second interaction data meets a preset condition, determining the volume expansion strategy corresponding to the service type of the initial test service according to the volume expansion strategy mapping information; the volume expansion strategy mapping information represents the mapping relationship between the service type and the volume expansion strategy; Based on the volume-increasing strategy corresponding to the initial test service, the initial test service is added to the preset volume-increasing layer to obtain the volume-increasing test service in the preset volume-increasing layer.

8. The method according to claim 7, characterized in that The service type includes a functional test type; the volume release strategy corresponding to the functional test type is a functional test volume release strategy; the functional test volume release strategy includes directly adding the initial test service to the preset volume release layer; the volume release strategy corresponding to the initial test service, adding the initial test service to the preset volume release layer, and obtaining the volume release test service in the preset volume release layer, includes: Based on the functional test type volume-increasing strategy, the initial test service is added to the preset volume-increasing layer to obtain the volume-increasing test service in the preset volume-increasing layer.

9. The method according to claim 7, characterized in that: The service type includes a logical compatibility type; the volume release strategy corresponding to the logical compatibility type is a logical compatibility type volume release strategy; the logical compatibility type volume release strategy includes fusing the initial test service to obtain a fused test service, and adding the fused test service to the preset volume release layer; the volume release strategy corresponding to the initial test service, adding the initial test service to the preset volume release layer, and obtaining the volume release test service in the preset volume release layer, includes: Based on the logic compatible volume-scaling strategy, the initial test service is added to the preset volume-scaling layer to obtain the volume-scaling test service in the preset volume-scaling layer.

10. The method according to claim 7, characterized in that The service type includes a logical mutual exclusion type; the volume expansion strategy corresponding to the logical mutual exclusion type is a logical mutual exclusion type volume expansion strategy; the logical mutual exclusion type volume expansion strategy includes determining a target test service whose second interaction data meets a preset condition in the initial test service, and adding the target test service to the preset volume expansion layer; the volume expansion strategy corresponding to the initial test service, adding the initial test service to the preset volume expansion layer, and obtaining the volume expansion test service in the preset volume expansion layer, includes: Based on the logic mutually exclusive volume-scaling strategy, the initial test service is added to the preset volume-scaling layer to obtain the volume-scaling test service in the preset volume-scaling layer.

11. The method according to claim 2, characterized in that The preset test layer further includes a second preset test layer; and the method further includes: If the business association information indicates that the number of associated business modules in the business system corresponding to the business to be evaluated meets a preset condition, adding the business to be evaluated to the second preset test layer; Based on the to-be-evaluated services in the second preset test layer and the volume-test services in the preset volume-release layer, a preset number of service requests are processed respectively to obtain a first service processing result corresponding to each of the service requests; Sending the first business processing result corresponding to each of the business requests to the preset terminal object corresponding to each of the business requests, so as to obtain the interaction processing result between the preset terminal object corresponding to each of the business requests and the first business processing result corresponding to each of the business requests; Based on the interaction processing result between the preset terminal object corresponding to each of the service requests and the first service processing result corresponding to each of the service requests, the first interaction data corresponding to each of the service requests is obtained.

12. A service evaluation device, characterized in that: The device comprises: An acquisition module, used for acquiring business type information and first interaction data of the business to be evaluated; the first interaction data is interaction data between a preset terminal object and a first business processing result; the first business processing result is obtained by processing a preset number of business requests respectively for the business to be evaluated in the preset test layer and the volume test business in the preset volume release layer when the business to be evaluated is added to the preset test layer; the volume test business in the preset volume release layer is the initial test business in the preset test layer, which is added to the preset volume release layer when preset conditions are met; the initial test business is the business in the preset test layer other than the business to be evaluated; An evaluation strategy determination module, used to determine the evaluation strategy corresponding to the service type indicated by the service type information according to the type strategy mapping information; the type strategy mapping information represents the mapping relationship between the service type and the evaluation strategy; The performance evaluation module is used to perform performance evaluation processing on the first interaction data according to the evaluation strategy to obtain performance evaluation data of the service to be evaluated.

13. An electronic device for business evaluation, characterized in that: The device includes a processor and a memory, wherein the memory stores at least one instruction or at least one program, and the at least one instruction or the at least one program is loaded by the processor and executes the service evaluation method according to any one of claims 1-11.

14. A computer-readable storage medium, characterized in that: The storage medium stores at least one instruction or at least one program, and the at least one instruction or at least one program is loaded and executed by the processor to implement the business evaluation method according to any one of claims 1-11.

15. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the service evaluation method according to any one of claims 1 to 11 is implemented.

Images