Business process verification method and device based on real-time traffic, computer equipment and storage medium

Abstract

The invention relates to a business process verification method and device based on real-time traffic, computer equipment and a storage medium. The method comprises the steps of obtaining a full-process empty running task of a to-be-verified version of an application program; determining a sub-process and / or a decision which needs to execute an empty running operation in the whole-process empty running task, wherein the sub-process is configured with a specified execution action or a specified non-execution action; acquiring real-time traffic of an online version of the application program, wherein the real-time traffic comprises user attribute data and user behavior data; and performing service verification on the sub-process and / or decision needing to execute the idle running operation through the real-time flow. According to the method, the business process is verified through the real-time flow, so that potential process vulnerabilities, abnormal conditions and connection problems among links can be found, and the verification accuracy of the whole business process is improved.

Description

Technical Field

[0001] The present application relates to the technical field of business data processing, and particularly to a method, device, computer device, and storage medium for validating a business process based on real-time traffic. Background Art

[0002] In the scenario of online services of an application program, a business process often involves a large amount of data interaction and multi-step processing. The entire process involves information flow between multiple different systems and databases. Any change in the data at any node will affect the entire result.

[0003] For a new version of an application program, during the process of evolving and optimizing its process strategy, it is expected that the actual impact conforms to the expectation. Therefore, it is necessary to fully validate the business process of the new version of the application program. The currently adopted validation method is offline testing. That is, generally, business process validation is carried out in a simulation environment. However, it is difficult for a simulation environment to fully reproduce various dynamic factors in the real network, such as real-time network load, external interference, etc. Therefore, offline testing cannot truly reflect the complex situation in the actual operating environment. Summary of the Invention

[0004] Based on this, in view of the above technical problems, it is necessary to provide a method, device, computer device, and storage medium for validating a business process based on real-time traffic. The real-time traffic can cover all links and all operations of the business process. Validating the business process through real-time traffic can discover potential process vulnerabilities, abnormal situations, and connection problems between various links, and improve the validation accuracy of the entire business process.

[0005] A method for validating a business process based on real-time traffic includes: obtaining a full-process dry-run task of a version to be validated of an application program; identifying sub-processes and / or decisions that need to perform dry-run operations in the full-process dry-run task, where the sub-processes are configured with specified execution actions or specified non-execution actions; obtaining real-time traffic of an online version of the application program, where the real-time traffic includes user attribute data and user behavior data; and performing business validation on the sub-processes and / or decisions that need to perform dry-run operations through the real-time traffic.

[0006] In one embodiment, business verification is performed on sub - processes and / or decisions that need to execute an idle run operation through real - time traffic, including: obtaining the configuration information of the to - be - verified version of the sub - process, where the configuration information of the to - be - verified version of the sub - process includes the configuration information of the action nodes of the sub - process, the configuration information of the input items of the sub - process, and the configuration information of the model of the sub - process. The configuration information of the action nodes contains the configuration information for specifying an execution action or the configuration information for specifying a non - execution action; obtaining the user attribute data and user behavior data of the sub - process from the real - time traffic; performing business verification on the action nodes, input items, and model of the sub - process according to the user attribute data and user behavior data of the sub - process and the configuration information of the to - be - verified version; and / or, obtaining the configuration information of the to - be - verified version of the decision, where the configuration information of the to - be - verified version of the decision includes the configuration information for calculating and filtering various attributes of the user; obtaining the user attribute data and user behavior data of the decision from the real - time traffic; performing business verification on the decision according to the user attribute data and user behavior data of the decision and the configuration information of the to - be - verified version of the decision.

[0007] In one embodiment, performing business verification on the action nodes, input items, and model of the sub - process according to the user attribute data and user behavior data of the sub - process and the configuration information of the to - be - verified version includes: obtaining the configuration information for specifying an execution action of the sub - process; performing business verification on the action nodes of the sub - process according to the user attribute data and user behavior data of the sub - process and the configuration information for specifying an execution action.

[0008] In one embodiment, performing business verification on the action nodes, input items, and model of the sub - process according to the user attribute data and user behavior data of the sub - process and the configuration information of the to - be - verified version includes: obtaining the configuration information of the input items of the sub - process, where the configuration information of the input items of the sub - process includes the configuration information for reusing the input items of the sub - process or the configuration information for not reusing the input items of the sub - process; performing business verification on the input items of the sub - process according to the user attribute data and user behavior data of the sub - process and the configuration information for reusing the input items of the sub - process or the configuration information for not reusing the input items of the sub - process.

[0009] In one embodiment, if the configuration information of the input item of the subprocess includes the configuration information that the input item of the subprocess is not reused, then based on the user attribute data and user behavior data of the subprocess, and the configuration information of the input item reuse or the configuration information that the input item of the subprocess is not reused of the subprocess, perform business verification on the input item of the subprocess, including: obtaining the value data of the input item from the user attribute data of the subprocess; filling the value data into the input item, and performing business verification on the input item of the subprocess according to the user behavior data of the subprocess; if the configuration information of the input item of the subprocess includes the configuration information of the input item reuse of the subprocess, then based on the user attribute data and user behavior data of the subprocess, and the configuration information of the input item reuse or the configuration information that the input item of the subprocess is not reused of the subprocess, perform business verification on the input item of the subprocess, including: identifying whether there is a null value in the reused input item; if so, obtaining the value data of the input item from the user attribute data of the subprocess, filling the value data into the input item, and performing business verification on the input item of the subprocess according to the user behavior data of the subprocess; if not, performing business verification on the input item of the subprocess through the value in the reused input item and the user behavior data of the subprocess.

[0010] In one embodiment, based on the user attribute data and user behavior data of the subprocess and the configuration information of the version to be verified, perform business verification on the action nodes, input items and models of the subprocess, including: obtaining the configuration information of the model of the subprocess, and the configuration information of the model of the subprocess includes the parameters of the configured model; calculating the model score of the model based on the user attribute data and user behavior data of the subprocess and based on the parameters of the configured model, so as to perform business verification on the model of the subprocess, where the model score is used to reflect the attributes of the user through the model.

[0011] In one embodiment, obtain the real-time traffic of the online version of the application program, including: obtaining the configured traffic ratio, and the traffic ratio is dynamically adjusted based on the load capacity of the system running the application program, and the load capacity of the system includes the free ratio of the CPU, the free ratio of the memory and the free ratio of the disk; obtaining the real-time traffic of the online version from the online traffic of the application program according to the traffic ratio.

[0012] A business process verification device based on real-time traffic includes: a first obtaining module, configured to obtain the full-process empty-running task of the version to be verified of the application program; a determination module, configured to confirm the subprocesses and / or decisions that need to perform empty-running operations in the full-process empty-running task, and a specified execution action or a specified non-execution action is configured in the subprocesses; a second obtaining module, configured to obtain the real-time traffic of the online version of the application program, and the real-time traffic includes user attribute data and user behavior data; a verification module, configured to perform business verification on the subprocesses and / or decisions that need to perform empty-running operations through the real-time traffic.

[0013] A computer device includes a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the computer program, the steps of the method in any of the above embodiments are implemented.

[0014] A computer-readable storage medium stores a computer program. When the computer program is executed by a processor, the steps of the method in any of the above embodiments are implemented.

[0015] For the above-mentioned method, device, computer device, and storage medium for verifying a business process based on real-time traffic, obtain the full-process dry-run task of the version to be verified of the application program; confirm the sub-processes and / or decisions that need to perform dry-run operations in the full-process dry-run task, and a specified execution action or a specified non-execution action is configured in the sub-processes; obtain the real-time traffic of the online version of the application program, where the real-time traffic includes user attribute data and user behavior data; perform business verification on the sub-processes and / or decisions that need to perform dry-run operations through the real-time traffic. Therefore, verify the sub-processes and / or decisions that need to perform dry-run operations of the version to be verified based on the real-time traffic generated by the online version operation. The verification scenario is completely consistent with the online scenario, and potential process loopholes, abnormal situations, and connection problems between various links can be found during the verification process, improving the verification accuracy of the entire business process. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 It is an application environment diagram of a method for verifying a business process based on real-time traffic in an embodiment;

[0017] Figure 2 It is a flowchart of a method for verifying a business process based on real-time traffic in an embodiment;

[0018] Figure 3 It is a schematic diagram of the configuration interface of the dry-run task in an embodiment;

[0019] Figure 4 It is a flowchart of a method for verifying a business process based on real-time traffic in a specific embodiment;

[0020] Figure 5 It is a flowchart of the business verification of input items in a specific embodiment;

[0021] Figure 6 It is a flowchart of the business verification of a model in a specific embodiment;

[0022] Figure 7 It is a structural block diagram of a device for verifying a business process based on real-time traffic in an embodiment;

[0023] Figure 8 It is an internal structure diagram of a computer device in an embodiment. Detailed implementation manners

[0024] In order to make the objectives, technical solutions and advantages of the present application more clear and understandable, the present application will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0025] A business process verification method based on real-time traffic provided by the present application is applied to an application environment as Figure 1 shown. As Figure 1 shown, a business system 100 is used to execute a business process verification method based on real-time traffic of the present application. Specifically, as Figure 1 shown, terminals such as terminal 202, terminal 204, and terminal 206 run application programs, generating user attribute data and user behavior data. The business system collects the real-time traffic of the online version of the application program, that is, the user attribute data and user behavior data generated by the terminals. Furthermore, the business system 100 obtains a full-process dry-run task of the to-be-verified version of the application program, confirms the sub-processes and / or decisions that need to perform dry-run operations in the full-process dry-run task, and there are specified execution actions or specified non-execution actions configured in the sub-processes. The business system 100 obtains the real-time traffic of the online version of the application program, and the real-time traffic includes user attribute data and user behavior data, and performs business verification on the sub-processes and / or decisions that need to perform dry-run operations through the real-time traffic. For example, as Figure 1 shown, the business system 100 respectively executes the real-time business of the application program and the verification dry-run task. The real-time business executes the formal process and outputs the result to the verification dry-run task. The output result includes user attribute data and user behavior data. Furthermore, when the business system 100 executes the verification dry-run task, it uses the user attribute data and user behavior data for dry-run verification.

[0026] In one embodiment, as Figure 2 shown, a business process verification method based on real-time traffic is provided. Taking the method applied to the Figure 1 business system 100 as an example, the method includes the following steps:

[0027] S202, obtaining a full-process dry-run task of the to-be-verified version of the application program.

[0028] In this embodiment, the full process refers to a complete business process in any scenario of the online business of the application program. The dry-run task means that when the business system executes the full-process business of the application program, it will not actually execute its business logic during task scheduling, but directly return the execution status. The full-process dry-run task is usually used to test the coherence of the workflow of any full-process task of the application program.

[0029] The application is divided into the application of the online version in production operation and the application of the improved version to be verified. Generally, the application of the version to be verified can improve the functions of some modules of the application on the basis of the online version to further optimize the performance of the application. At this time, it is necessary to test and verify the modified module functions. Therefore, configure the full-process dry-run task for the version of the application to be verified. The full-process dry-run task is used to instruct the business system to perform a dry-run operation on the specified full-process business of the application of the version to be verified.

[0030] S204. Confirm the sub-processes and / or decisions that need to perform dry-run operations in the full-process dry-run task. The sub-processes are configured with specified execution actions or specified non-execution actions.

[0031] In this embodiment, multiple sub-processes and multiple decisions are configured in the full-process dry-run task. During the configuration process, any sub-process and any decision can be configured whether to run the dry-run version. If any sub-process or decision is configured to run the dry-run version, it is determined that the sub-process or decision needs to perform a dry-run operation. A sub-process can be referenced by other processes. A series of business templates and reusable scenarios are defined inside the sub-process. A decision refers to the calculation, processing, screening, etc. of various attributes of users through a decision engine. In the full process of any business module of the application, the corresponding sub-processes and decisions can be changed. For the changed sub-process / decision, the version of the sub-process / decision that you want to execute can be selected again in the full-process dry-run task, so that the changed sub-process / decision can be verified.

[0032] Information on the execution of actions can be configured in the sub-process, such as Figure 3 shown, which is used to instruct the business system to perform certain actions or not perform certain actions when it executes to this sub-process. If a specified execution action is configured, when the business system executes the business of this sub-process, it performs the specified execution action according to the configuration information. If a specified non-execution action is configured, when the business system executes the business of this sub-process, it controls not to perform the specified execution action according to the configuration information. Therefore, when the business system simultaneously executes the production work of the application of the online version and the verification work of the application of the offline version to be verified, configure the specified execution action and the specified non-execution action in the sub-process of the application of the version to be verified that needs to perform a dry-run operation, so as to set a new execution mode when this sub-process is executed to distinguish it from the execution action of the online official production, isolate the online official operation for customers from the offline business verification, and avoid the interference of the offline business verification operation on the online operation for customers.

[0033] For example, the execution actions included in any sub - process of the online version of the application are: sending a SMS verification code to the user. For this sub - process in the application to be verified, the configured specified non - execution action is: not sending a SMS verification code to the user. Therefore, when performing the verification operation of the application to be verified, it will not interfere with the application that is officially running for customers online.

[0034] S206, obtain the real - time traffic of the online version of the application. The real - time traffic includes user attribute data and user behavior data.

[0035] In this embodiment, the online version of the application runs in the business system at the same time. During the running of the online version of the application, end - users use the application, generating real - time traffic. The real - time traffic includes user attribute data and user behavior data. User attribute data includes the user's gender, age, etc., which are characteristic data reflecting the user's personal attributes. User behavior data is the behavior data generated when the user operates in the application. For example, the user clicks the repayment button on the repayment interface of the application.

[0036] In one embodiment, the step of obtaining the real - time traffic of the online version of the application includes: obtaining the configured traffic ratio, where the traffic ratio is dynamically adjusted based on the load capacity of the system running the application. The load capacity of the system includes the free ratio of the CPU, the free ratio of the memory, and the free ratio of the disk; obtaining the real - time traffic of the online version from the online traffic of the application according to the traffic ratio.

[0037] Specifically, since the business system simultaneously executes the production of the online version of the application and the verification operation of the application to be verified, if all the real - time traffic generated by the production of the online version of the application is used for business verification, it will cause a load burden on the business system, and further affect the normal use of the online version of the application. Therefore, the traffic ratio is dynamically adjusted based on the load capacity of the system running the application, and the amount of real - time traffic data collected is controlled through this traffic ratio, so as to control the running amount of the verification operation of the application to be verified offline, and further avoid the impact of the offline verification operation on the running of the online application.

[0038] Among them, the system running the application is the above - mentioned business system. The load capacity of the system running the application includes the free ratio of the CPU, the free ratio of the memory, and the free ratio of the disk. Therefore, it is ensured that the system can reserve sufficient resources such as CPU, memory, and disk for the running of the online application.

[0039] Specifically, for the configuration of the traffic ratio, refer to Figure 3As shown. Among them, the traffic ratio can be adjusted manually based on the current load of the business system, or the business system can determine the traffic ratio based on the current load of the business system and then automatically configure it to Figure 3 the page shown.

[0040] S208, perform business verification on the sub-processes and / or decisions that need to perform the dry-run operation through real-time traffic.

[0041] In this embodiment, the real-time traffic is the traffic generated by the online version of the application program in the actual business scenario. Using the real-time traffic to perform business verification on the sub-processes and / or decisions that need to perform the dry-run operation makes the verification process consistent with the actual online operation and production process, without data errors, thus ensuring the accuracy of the verification process. During the process of using the real-time traffic to perform business verification on the sub-processes and / or decisions that need to perform the dry-run operation, since the real-time traffic can cover all links and all operations of the business process, potential process loopholes, abnormal situations, and connection problems between various links can be discovered, ensuring the smooth operation of the entire business process verification process.

[0042] For the above-mentioned business process verification method based on real-time traffic, obtain the full-process dry-run task of the version to be verified of the application program; confirm the sub-processes and / or decisions that need to perform the dry-run operation in the full-process dry-run task, and the specified execution actions or specified non-execution actions are configured in the sub-processes; obtain the real-time traffic of the online version of the application program, and the real-time traffic includes user attribute data and user behavior data; perform business verification on the sub-processes and / or decisions that need to perform the dry-run operation through the real-time traffic. Therefore, verify the sub-processes and / or decisions that need to perform the dry-run operation of the version to be verified based on the real-time traffic generated by the online version operation. The verification scenario is completely consistent with the online scenario, and potential process loopholes, abnormal situations, and connection problems between various links can be discovered during the verification process, improving the verification accuracy of the entire business process.

[0043] In one embodiment, the step of performing business verification on subprocesses and / or decisions that need to perform dry-run operations through real-time traffic includes: obtaining the configuration information of the to-be-verified version of the subprocess, where the configuration information of the to-be-verified version of the subprocess includes the configuration information of the action nodes of the subprocess, the configuration information of the input items of the subprocess, and the configuration information of the model of the subprocess. The configuration information of the action nodes includes the configuration information of specifying an execution action or the configuration information of specifying no execution action; obtaining the user attribute data and user behavior data of the subprocess from the real-time traffic; performing business verification on the action nodes, input items, and model of the subprocess according to the user attribute data and user behavior data of the subprocess and the configuration information of the to-be-verified version; and / or, obtaining the configuration information of the to-be-verified version of the decision, where the configuration information of the to-be-verified version of the decision includes the configuration information of performing calculation and screening processing on various attributes of the user; obtaining the user attribute data and user behavior data of the decision from the real-time traffic; performing business verification on the decision according to the user attribute data and user behavior data of the decision and the configuration information of the to-be-verified version of the decision.

[0044] Specifically, as Figure 3 shown, when configuring the full-process dry-run task, each subprocess of the full process is configured. For example, whether to select the dry-run version and the version number of the dry-run version. If it is triggered to select dry-run, the selected dry-run version is read. The subprocess of the dry-run version is respectively configured with the configuration information of action nodes, input items, and models. When executing to this subprocess, business verification is performed on the subprocess based on the configuration information of the action nodes, input items, and models configured therein and combined with the user attribute data and user behavior data in the real-time traffic. Similarly, business verification is performed on the decision combined with the user attribute data and user behavior data in the real-time traffic.

[0045] In an example of this embodiment, the step of performing business verification on the action nodes, input items, and model of the subprocess according to the user attribute data and user behavior data of the subprocess and the configuration information of the to-be-verified version includes: obtaining the configuration information of the specified execution action of the subprocess; performing business verification on the action nodes of the subprocess according to the user attribute data and user behavior data of the subprocess and the configuration information of the specified execution action.

[0046] In another example of this embodiment, the step of performing business verification on the action nodes, input items, and model of the subprocess according to the user attribute data and user behavior data of the subprocess and the configuration information of the version to be verified includes: obtaining the configuration information of the input items of the subprocess, where the configuration information of the input items of the subprocess includes the configuration information for reusing the input items of the subprocess or the configuration information for not reusing the input items of the subprocess; and performing business verification on the input items of the subprocess according to the user attribute data and user behavior data of the subprocess, and the configuration information for reusing the input items of the subprocess or the configuration information for not reusing the input items of the subprocess.

[0047] In yet another example of this embodiment, the step of performing business verification on the action nodes, input items, and model of the subprocess according to the user attribute data and user behavior data of the subprocess and the configuration information of the version to be verified includes: obtaining the configuration information of the model of the subprocess, where the configuration information of the model of the subprocess includes the parameters of the configured model; calculating a model score of the model according to the user attribute data and user behavior data of the subprocess and based on the parameters of the configured model to perform business verification on the model of the subprocess, where the model score is used to reflect the attributes of the user through the model.

[0048] Corresponding to the above three examples, specifically as Figure 4 shown. The configuration of the subprocess includes the configuration of these three parts: action nodes, input items, and models. The configuration information specifying the execution action in the action nodes can be the action that needs to be specified for executing this subprocess. When performing business verification on the action nodes, the user attribute data and user behavior data in the real-time traffic are used to verify the specified execution action, so as to determine the running state of the action nodes. For example, for the execution behavior to be taken, such as sending text messages to users, etc., it can be freely configured whether to execute and which ones to execute for such action nodes.

[0049] The configuration information of the input items includes the configuration information for reusing the input items of the subprocess or the configuration information for not reusing the input items of the subprocess. Input item reuse means reusing the input item information of the original version of the application program. Input item non-reuse means not using the input item information of the original version of the application program but using the newly configured input item information. If input item reuse is configured, verification is performed on the input item based on the reused input item information in combination with the user attribute data and user behavior data, so as to determine the state of the input item. If input item non-reuse is configured, the information of the newly configured input item is obtained, and verification is performed on the input item in combination with the user attribute data and user behavior data, so as to determine the state of the input item. For example, the input items include obtaining user tags from a third-party system, such as the user's age, gender, etc. At this time, custom configuration can be performed, and whether the values of these input items directly use the real-time traffic in production or retrieve values from the system again to meet the corresponding business requirements.

[0050] The configuration information of the model includes the parameters of the model. Based on the reconfigured parameters, combined with user attribute data and user behavior data, the model is verified, so that the model with new parameters can be used to evaluate user attributes. For example, for a property model and an education model, after reconfiguring the parameters of the model, the user attribute data and user behavior data are used to verify the property model or the education model, and a model score is output. The model score reflects the user's attributes. Furthermore, it is possible to identify whether the model after the new configuration parameters meets the business requirements through the model score. For example, the model score calculated by the current model can reflect the user's attributes, and the model score can be freely selected to be calculated using the real-time traffic in production.

[0051] For the example of the input items of the above sub-process, in a specific example, if the configuration information of the input items of the sub-process includes the configuration information that the input items of the sub-process are not reused, then based on the user attribute data and user behavior data of the sub-process, and the configuration information that the input items of the sub-process are reused or the configuration information that the input items of the sub-process are not reused, business verification is performed on the input items of the sub-process, including: obtaining the value data of the input items from the user attribute data of the sub-process; filling the value data into the input items, and performing business verification on the input items of the sub-process according to the user behavior data of the sub-process; if the configuration information of the input items of the sub-process includes the configuration information that the input items of the sub-process are reused, then based on the user attribute data and user behavior data of the sub-process, and the configuration information that the input items of the sub-process are reused or the configuration information that the input items of the sub-process are not reused, business verification is performed on the input items of the sub-process, including: identifying whether there is a null value in the reused input items; if so, obtaining the value data of the input items from the user attribute data of the sub-process, filling the value data into the input items, and performing business verification on the input items of the sub-process according to the user behavior data of the sub-process; if not, performing business verification on the input items of the sub-process through the values in the reused input items and the user behavior data of the sub-process.

[0052] In this example, the configuration of the input items includes the configuration of input item reuse and the configuration of non-reuse of input items. For the scenario of input item reuse, during the process of performing business verification using the reused input item information, if there is a situation of null input items, then values are taken from the user attribute data for verification. For the scenario of non-reuse of input items, the configured input item information needs to be obtained. Since the original input items are not reused, all input items are taken from the user attribute data of the sub-process for verification.

[0053] Specifically, see Figure 5As shown in the figure, for the configuration and verification of input items: First, determine whether the input items need to be reused. If not, it means that the original input item values are not required, and the input items need to be re-obtained from the real-time traffic. If so, directly use the input items of the original sub-process, and determine whether the input items are null values. If they are null values, the input items need to be re-obtained from the real-time traffic.

[0054] See Figure 6 As shown in the figure, for the configuration and verification of the model: First, determine whether the model needs to be executed. If not, skip the verification of the model. If so, further determine whether the model is reused. If not, execute the model with reconfigured parameters for business verification of the model. If so, use the parameters of the model in the original sub-process, and then perform value-taking verification. If no value is taken, it is determined that the model does not need to be verified. If a new value is taken, perform the verification of the model after taking the value.

[0055] A business process verification method based on real-time traffic according to various embodiments of the present application, based on the empty-run strategy of real-time traffic, the traffic scenarios used are exactly the same as those produced by online application programs, without errors. The values obtained during verification can be customarily obtained, and even the execution versions can be freely defined. In addition, a single real-time traffic can verify multiple different business process verifications. Therefore, the following effects can be achieved:

[0056] 1: Real-time traffic can cover all aspects and all operations of the business process, can discover potential process loopholes, abnormal situations, and connection problems between various links, and ensure the smooth operation of the entire business process.

[0057] 2: When a new business process is launched or an existing business process is modified, the strategy of full-process empty running can be used to quickly conduct verification. Without affecting the actual business operation, problems that may exist in the new process can be discovered in a timely manner, the speed of business going live can be accelerated, and the risk of business changes can be reduced.

[0058] 3: By discovering and solving problems in the business process in advance, problems such as business interruptions and customer complaints caused by process failures can be avoided, and the resulting economic losses and reputation impacts can be reduced.

[0059] 4: Testing and verification can be completed in a relatively short time, reducing testing costs and improving testing efficiency.

[0060] 5: Extended in the form of tasks, a single formal traffic can verify multiple different tasks.

[0061] It should be understood that although the steps in the flowchart are shown sequentially in the direction of the arrows, these steps are not necessarily executed sequentially in the order indicated by the arrows. Unless specifically stated herein, there is no strict order restriction for the execution of these steps, and these steps can be executed in other orders. Moreover, at least a part of the steps in the accompanying drawings may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed alternately or in turn with at least a part of other steps or sub-steps or stages of other steps.

[0062] This application also provides a business process verification device based on real-time traffic. As Figure 7 shown, a business process verification device based on real-time traffic includes a first acquisition module 702, a determination module 704, a second acquisition module 706, and a verification module 708. The first acquisition module 702 is configured to acquire a full-process dry-run task of a to-be-verified version of an application program; the determination module 704 is configured to confirm sub-processes and / or decisions that need to perform dry-run operations in the full-process dry-run task, and a specified execution action or a specified non-execution action is configured in the sub-processes; the second acquisition module 706 is configured to acquire real-time traffic of an online version of the application program, and the real-time traffic includes user attribute data and user behavior data; the verification module 708 is configured to perform business verification on the sub-processes and / or decisions that need to perform dry-run operations through the real-time traffic.

[0063] In one embodiment, performing business verification on sub-processes and / or decisions that need to perform dry-run operations through real-time traffic includes: acquiring configuration information of a to-be-verified version of a sub-process, where the configuration information of the to-be-verified version of the sub-process includes configuration information of action nodes of the sub-process, configuration information of input items of the sub-process, and configuration information of a model of the sub-process, and the configuration information of the action nodes includes configuration information of a specified execution action or a specified non-execution action; acquiring user attribute data and user behavior data of the sub-process from the real-time traffic; performing business verification on the action nodes, input items, and model of the sub-process according to the user attribute data and user behavior data of the sub-process and the configuration information of the to-be-verified version; and / or, acquiring configuration information of a to-be-verified version of a decision, where the configuration information of the to-be-verified version of the decision includes configuration information for performing calculation and screening processing on various attributes of users; acquiring user attribute data and user behavior data of the decision from the real-time traffic; performing business verification on the decision according to the user attribute data and user behavior data of the decision and the configuration information of the to-be-verified version of the decision.

[0064] In one embodiment, according to the user attribute data and user behavior data of the subprocess and the configuration information of the version to be verified, business verification is performed on the action nodes, input items, and models of the subprocess, including: obtaining the configuration information of the specified execution action of the subprocess; and performing business verification on the action nodes of the subprocess according to the user attribute data and user behavior data of the subprocess and the configuration information of the specified execution action.

[0065] In one embodiment, according to the user attribute data and user behavior data of the subprocess and the configuration information of the version to be verified, business verification is performed on the action nodes, input items, and models of the subprocess, including: obtaining the configuration information of the input items of the subprocess, where the configuration information of the input items of the subprocess includes the configuration information for reusing the input items of the subprocess or the configuration information for not reusing the input items of the subprocess; and performing business verification on the input items of the subprocess according to the user attribute data and user behavior data of the subprocess and the configuration information for reusing the input items of the subprocess or the configuration information for not reusing the input items of the subprocess.

[0066] In one embodiment, if the configuration information of the input items of the subprocess includes the configuration information for not reusing the input items of the subprocess, then business verification is performed on the input items of the subprocess according to the user attribute data and user behavior data of the subprocess and the configuration information for reusing the input items of the subprocess or the configuration information for not reusing the input items of the subprocess, including: obtaining the value data of the input item from the user attribute data of the subprocess; filling the value data into the input item, and performing business verification on the input items of the subprocess according to the user behavior data of the subprocess; if the configuration information of the input items of the subprocess includes the configuration information for reusing the input items of the subprocess, then business verification is performed on the input items of the subprocess according to the user attribute data and user behavior data of the subprocess and the configuration information for reusing the input items of the subprocess or the configuration information for not reusing the input items of the subprocess, including: identifying whether the reused input item is a null value; if so, obtaining the value data of the input item from the user attribute data of the subprocess, filling the value data into the input item, and performing business verification on the input items of the subprocess according to the user behavior data of the subprocess; if not, performing business verification on the input items of the subprocess through the value in the reused input item and the user behavior data of the subprocess.

[0067] In one embodiment, according to the user attribute data and user behavior data of the subprocess and the configuration information of the version to be verified, business verification is performed on the action nodes, input items, and models of the subprocess, including: obtaining the configuration information of the model of the subprocess, where the configuration information of the model of the subprocess includes the parameters of the configured model; calculating the model score of the model according to the user attribute data and user behavior data of the subprocess and based on the parameters of the configured model to perform business verification on the model of the subprocess, where the model score is used to reflect the attributes of the user through the model.

[0068] In one embodiment, obtaining the real-time traffic of the online version of the application program includes: obtaining the configured traffic ratio, where the traffic ratio is dynamically adjusted based on the load capacity of the system running the application program, and the load capacity of the system includes the free ratio of the CPU, the free ratio of the memory, and the free ratio of the disk; obtaining the real-time traffic of the online version from the online traffic of the application program according to the traffic ratio.

[0069] For the specific limitations of a business process verification device based on real-time traffic, reference can be made to the limitations of a business process verification method based on real-time traffic in the above text, which will not be elaborated here. Each module in the above business process verification device based on real-time traffic can be implemented in whole or in part by software, hardware, and their combination. The above modules can be embedded in the processor of the computer device in hardware form or be independent of it, or be stored in the memory of the computer device in software form, so that the processor can call and execute the operations corresponding to the above modules.

[0070] In one embodiment, a computer device is provided. The computer device can be a server, and its internal structure diagram can be as Figure 8 shown. The computer device includes a processor, a memory, a network interface, and a database connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store real-time traffic or historical traffic data. The network interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, it implements a business process verification method based on real-time traffic.

[0071] Those skilled in the art can understand that Figure 8 the structure shown in

[0072] In one embodiment, a computer device is provided, including a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the computer program, the following steps are implemented: obtaining a full-process dry-run task of a to-be-verified version of an application program; confirming sub-processes and / or decisions that need to perform dry-run operations in the full-process dry-run task, where the sub-processes are configured with specified execution actions or specified non-execution actions; obtaining real-time traffic of an online version of the application program, where the real-time traffic includes user attribute data and user behavior data; and performing business verification on the sub-processes and / or decisions that need to perform dry-run operations through the real-time traffic.

[0073] In one of the embodiments, when the processor executes the computer program to implement the above step of performing business verification on the sub-processes and / or decisions that need to perform dry-run operations through the real-time traffic, the following steps are specifically implemented: obtaining configuration information of a to-be-verified version of a sub-process, where the configuration information of the to-be-verified version of the sub-process includes configuration information of action nodes of the sub-process, configuration information of input items of the sub-process, and configuration information of a model of the sub-process, and the configuration information of the action nodes includes configuration information of a specified execution action or a specified non-execution action; obtaining user attribute data and user behavior data of the sub-process from the real-time traffic; performing business verification on the action nodes, input items, and model of the sub-process according to the user attribute data and user behavior data of the sub-process and the configuration information of the to-be-verified version; and / or, obtaining configuration information of a to-be-verified version of a decision, where the configuration information of the to-be-verified version of the decision includes configuration information for performing calculation and screening processing on various attributes of users; obtaining user attribute data and user behavior data of the decision from the real-time traffic; and performing business verification on the decision according to the user attribute data and user behavior data of the decision and the configuration information of the to-be-verified version of the decision.

[0074] In one of the embodiments, when the processor executes the computer program to implement the above step of performing business verification on the action nodes, input items, and model of the sub-process according to the user attribute data and user behavior data of the sub-process and the configuration information of the to-be-verified version, the following steps are specifically implemented: obtaining configuration information of a specified execution action of the sub-process; and performing business verification on the action nodes of the sub-process according to the user attribute data and user behavior data of the sub-process and the configuration information of the specified execution action.

[0075] In one embodiment, when the processor executes a computer program to implement the above steps of performing business verification on the action nodes, input items, and model of the subprocess according to the user attribute data, user behavior data of the subprocess, and the configuration information of the version to be verified, the following steps are specifically implemented: Obtain the configuration information of the input items of the subprocess, where the configuration information of the input items of the subprocess includes the configuration information for reusing the input items of the subprocess or the configuration information for not reusing the input items of the subprocess; According to the user attribute data and user behavior data of the subprocess, and the configuration information for reusing the input items of the subprocess or the configuration information for not reusing the input items of the subprocess, perform business verification on the input items of the subprocess.

[0076] In one embodiment, if the configuration information of the input items of the subprocess includes the configuration information for not reusing the input items of the subprocess, when the processor executes a computer program to implement the above steps of performing business verification on the input items of the subprocess according to the user attribute data and user behavior data of the subprocess, and the configuration information for reusing the input items of the subprocess or the configuration information for not reusing the input items of the subprocess, the following steps are specifically implemented: Obtain the value data of the input item from the user attribute data of the subprocess; Fill the value data into the input item, and perform business verification on the input items of the subprocess according to the user behavior data of the subprocess; If the configuration information of the input items of the subprocess includes the configuration information for reusing the input items of the subprocess, when the processor executes a computer program to implement the above steps of performing business verification on the input items of the subprocess according to the user attribute data and user behavior data of the subprocess, and the configuration information for reusing the input items of the subprocess or the configuration information for not reusing the input items of the subprocess, the following steps are specifically implemented: Identify whether the reused input item is a null value; If so, obtain the value data of the input item from the user attribute data of the subprocess, fill the value data into the input item, and perform business verification on the input items of the subprocess according to the user behavior data of the subprocess; If not, perform business verification on the input items of the subprocess through the value in the reused input item and the user behavior data of the subprocess.

[0077] In one embodiment, when the processor executes a computer program to implement the above steps of performing business verification on the action nodes, input items, and model of the subprocess according to the user attribute data, user behavior data of the subprocess, and the configuration information of the version to be verified, the following steps are specifically implemented: Obtain the configuration information of the model of the subprocess, where the configuration information of the model of the subprocess includes the parameters of the configured model; Calculate the model score of the model according to the user attribute data and user behavior data of the subprocess and based on the parameters of the configured model, so as to perform business verification on the model of the subprocess, where the model score is used to reflect the attributes of the user through the model.

[0078] In one embodiment, when the processor executes a computer program to implement the above steps of obtaining the real-time traffic of the online version of the application program, the following steps are specifically implemented: obtaining the configured traffic ratio, where the traffic ratio is dynamically adjusted based on the load capacity of the system running the application program, and the load capacity of the system includes the free ratio of the CPU, the free ratio of the memory, and the free ratio of the disk; obtaining the real-time traffic of the online version from the online traffic of the application program according to the traffic ratio.

[0079] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the following steps are implemented: obtaining the configuration information of the to-be-verified version of the sub-process, where the configuration information of the to-be-verified version of the sub-process includes the configuration information of the action nodes of the sub-process, the configuration information of the input items of the sub-process, and the configuration information of the model of the sub-process, and the configuration information of the action nodes includes the configuration information of specifying an execution action or the configuration information of specifying not to execute an action; obtaining the user attribute data and user behavior data of the sub-process from the real-time traffic; performing business verification on the action nodes, input items, and model of the sub-process according to the user attribute data and user behavior data of the sub-process and the configuration information of the to-be-verified version; and / or, obtaining the configuration information of the to-be-verified version of the decision, where the configuration information of the to-be-verified version of the decision includes the configuration information of performing calculation and screening processing on various attributes of the user; obtaining the user attribute data and user behavior data of the decision from the real-time traffic; performing business verification on the decision according to the user attribute data and user behavior data of the decision and the configuration information of the to-be-verified version of the decision.

[0080] In one embodiment, when the computer program is executed by the processor to implement the above steps of performing business verification on the action nodes, input items, and model of the sub-process according to the user attribute data and user behavior data of the sub-process and the configuration information of the to-be-verified version, the following steps are specifically implemented: obtaining the configuration information of the specified execution action of the sub-process; performing business verification on the action nodes of the sub-process according to the user attribute data and user behavior data of the sub-process and the configuration information of the specified execution action.

[0081] In one embodiment, when the computer program is executed by the processor to implement the above steps of performing business verification on the action nodes, input items, and model of the sub-process according to the user attribute data and user behavior data of the sub-process and the configuration information of the to-be-verified version, the following steps are specifically implemented: obtaining the configuration information of the input items of the sub-process, where the configuration information of the input items of the sub-process includes the configuration information of reusing the input items of the sub-process or the configuration information of not reusing the input items of the sub-process; performing business verification on the input items of the sub-process according to the user attribute data and user behavior data of the sub-process, and the configuration information of reusing the input items of the sub-process or the configuration information of not reusing the input items of the sub-process.

[0082] In one embodiment, if the configuration information of the input item of the subprocess includes the configuration information that the input item of the subprocess is not reused, when the computer program is executed by the processor to implement the above step of performing business verification on the input item of the subprocess according to the user attribute data and user behavior data of the subprocess, and the configuration information of the input item reuse or non-reuse of the subprocess, the following steps are specifically implemented: obtaining the value data of the input item from the user attribute data of the subprocess; filling the value data into the input item, and performing business verification on the input item of the subprocess according to the user behavior data of the subprocess; if the configuration information of the input item of the subprocess includes the configuration information that the input item of the subprocess is reused, when the computer program is executed by the processor to implement the above step of performing business verification on the input item of the subprocess according to the user attribute data and user behavior data of the subprocess, and the configuration information of the input item reuse or non-reuse of the subprocess, the following steps are specifically implemented: identifying whether there is a null value in the reused input item; if so, obtaining the value data of the input item from the user attribute data of the subprocess, filling the value data into the input item, and performing business verification on the input item of the subprocess according to the user behavior data of the subprocess; if not, performing business verification on the input item of the subprocess through the value in the reused input item and the user behavior data of the subprocess.

[0083] In one embodiment, when the computer program is executed by the processor to implement the above step of performing business verification on the action node, input item, and model of the subprocess according to the user attribute data and user behavior data of the subprocess and the configuration information of the version to be verified, the following steps are specifically implemented: obtaining the configuration information of the model of the subprocess, where the configuration information of the model of the subprocess includes the parameters of the configured model; calculating the model score of the model based on the user attribute data and user behavior data of the subprocess and based on the parameters of the configured model to perform business verification on the model of the subprocess, where the model score is used to reflect the attributes of the user through the model.

[0084] In one embodiment, when the computer program is executed by the processor to implement the above step of obtaining the real-time traffic of the online version of the application program, the following steps are specifically implemented: obtaining the configured traffic ratio, where the traffic ratio is dynamically adjusted based on the load capacity of the system running the application program, and the load capacity of the system includes the free ratio of the CPU, the free ratio of the memory, and the free ratio of the disk; obtaining the real-time traffic of the online version from the online traffic of the application program according to the traffic ratio.

[0085] Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be completed by instructing relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above methods. Among them, any reference to a memory, storage, database, or other medium used in the embodiments provided in the present application can include non-volatile and / or volatile memories. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), Rambus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and Rambus dynamic RAM (RDRAM), etc.

[0086] The technical features of the above embodiments can be combined arbitrarily. For the sake of brevity of description, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, it should be considered as the scope described in this specification.

[0087] The above-described embodiments merely represent several implementation manners of the present application. The description thereof is relatively specific and detailed, but it should not be construed as a limitation on the scope of the invention patent. It should be noted that for those of ordinary skill in the art, without departing from the concept of the present application, several modifications and improvements can still be made, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the appended claims.

Claims

1. A business process verification method based on real-time traffic, characterized in that: The method comprises: Get the full process of the unverified version of the application. Confirming the sub-process and / or decision that needs to perform the dry run operation in the full-process dry run task, wherein the sub-process is configured with a specified execution action or a specified non-execution action; Obtaining real-time traffic of an online version of an application, wherein the real-time traffic includes user attribute data and user behavior data; The sub-process and / or decision that needs to perform the dry run operation is business verified through the real-time traffic.

2. The method according to claim 1, characterized in that The performing business verification on the sub-process and / or decision requiring the dry run operation by using the real-time traffic includes: Obtaining configuration information of the version to be verified of the sub-process, the configuration information of the version to be verified of the sub-process including configuration information of the action node of the sub-process, configuration information of the input item of the sub-process and configuration information of the model of the sub-process, wherein the configuration information of the action node includes configuration information for specifying execution of an action or configuration information for specifying not to execute an action; Acquire user attribute data and user behavior data of the sub-process from the real-time traffic; Performing business verification on the action nodes, input items and models of the sub-process according to the user attribute data and user behavior data of the sub-process and the configuration information of the version to be verified; and / or, Acquire configuration information of the version to be verified of the decision, wherein the configuration information of the version to be verified of the decision includes configuration information for calculating and screening various attributes of the user; Acquire user attribute data and user behavior data for the decision from the real-time traffic; The decision is business-verified according to the user attribute data and user behavior data of the decision and the configuration information of the version to be verified of the decision.

3. The method according to claim 2, characterized in that The performing business verification on the action nodes, input items and models of the sub-process according to the user attribute data and user behavior data of the sub-process and the configuration information of the version to be verified includes: Obtaining configuration information of a specified execution action of the sub-process; Business verification is performed on the action node of the sub-process according to the user attribute data and user behavior data of the sub-process and the configuration information of the specified execution action.

4. The method according to claim 2, characterized in that The performing business verification on the action nodes, input items and models of the sub-process according to the user attribute data and user behavior data of the sub-process and the configuration information of the version to be verified includes: Acquire configuration information of the input items of the sub-process, wherein the configuration information of the input items of the sub-process includes configuration information of the input items of the sub-process that are reused or configuration information of the input items of the sub-process that are not reused; The input items of the sub-process are business verified according to the user attribute data and user behavior data of the sub-process, and the configuration information of the input items of the sub-process being reused or the configuration information of the input items of the sub-process being non-reused.

5. The method according to claim 4, characterized in that If the configuration information of the input items of the sub-process includes non-reuse configuration information of the input items of the sub-process, then performing business verification on the input items of the sub-process according to the user attribute data and user behavior data of the sub-process, and the reuse configuration information of the input items of the sub-process or the non-reuse configuration information of the input items of the sub-process, includes: Acquire value data of the input item from user attribute data of the sub-process; Fill the value data into the input item, and perform business verification on the input item of the sub-process according to the user behavior data of the sub-process; If the configuration information of the input items of the sub-process includes configuration information of input item reuse of the sub-process, then performing business verification on the input items of the sub-process according to the user attribute data and user behavior data of the sub-process, and the configuration information of input item reuse of the sub-process or the configuration information of input item non-reuse of the sub-process, includes: Identify whether the reused input item is null; If so, obtaining the value data of the input item from the user attribute data of the sub-process, filling the value data into the input item, and performing business verification on the input item of the sub-process according to the user behavior data of the sub-process; If not, business verification is performed on the input items of the sub-process through the values ​​in the reused input items and the user behavior data of the sub-process.

6. The method according to claim 2, characterized in that The performing business verification on the action nodes, input items and models of the sub-process according to the user attribute data and user behavior data of the sub-process and the configuration information of the version to be verified includes: Acquire configuration information of the model of the sub-process, wherein the configuration information of the model of the sub-process includes parameters of the configured model; According to the user attribute data and user behavior data of the sub-process and based on the parameters of the configured model, a model score of the model is calculated to perform business verification on the model of the sub-process, wherein the model score is used to reflect the user's attributes through the model.

7. The method according to claim 1, characterized in that The obtaining of the real-time traffic of the online version of the application includes: Obtaining a configured traffic ratio, where the traffic ratio is dynamically adjusted based on the load capacity of the system running the application, where the load capacity of the system includes the free ratio of the CPU, the free ratio of the memory, and the free ratio of the disk; The real-time traffic of the online version is obtained from the online traffic of the application according to the traffic ratio.

8. A business process verification device based on real-time traffic, characterized in that: The device comprises: The first acquisition module is used to acquire the full-process dry run task of the version to be verified of the application program; A determination module, used to confirm the sub-process and / or decision that needs to perform the empty run operation in the full-process empty run task, wherein the sub-process is configured with a specified execution action or a specified non-execution action; A second acquisition module is used to acquire real-time traffic of the online version of the application, wherein the real-time traffic includes user attribute data and user behavior data; The verification module is used to perform business verification on the sub-process and / or decision that needs to perform the dry run operation through the real-time traffic.

9. A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images