Data processing method and device
By building a logical view and applying it to multiple business processes, the problem of difficulty in evaluating the impact of changes in data processing scope on the overall business in existing technologies is solved, and a comprehensive assessment and stability guarantee of the overall business is achieved.
Patent Information
- Application Number
- CN202510878069.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-06-26
- Publication Date
- 2025-09-26
AI Technical Summary
Existing technologies make it difficult to effectively assess the impact of changes in data processing scope on the overall business, and assessment plans are usually limited to specific scenarios, making it impossible to achieve a comprehensive assessment of the overall business.
By constructing logical views, using the user data of the experimental population to generate logical views, and applying them to multiple businesses for processing, we can determine the changes in global business indicators and thus evaluate the overall impact of changes in data processing caliber.
It realizes a comprehensive assessment of the impact of changes in data processing scope on the overall business, can isolate the interference of other variables, ensure the stability and continuity of the business system, and provide strong data support for business decision-making.
Smart Images

Figure CN120705364A_ABST
Abstract
Description
Technical Field
[0001] This document relates to the field of Internet business processing, and in particular to a data processing method and device. Background Art
[0002] In the internet industry, service providers typically collect large amounts of user data to improve service quality. They then analyze and process this data to optimize their products and services. Because user data is dynamic, after collecting user data, service providers often adjust the processing methods used to update the data and provide users with better services.
[0003] Typically, after changing a user's data processing caliber, the impact (or effectiveness) of the changed data processing caliber on the business can be evaluated to make relevant strategic decisions based on the evaluation results. However, in practice, changes in data processing caliber are closely linked to business processes. A single data processing caliber change often involves multiple changes, such as page upgrades, model improvements, and back-end system optimization. This makes it difficult to quantify the impact of a data processing caliber change on the business. Furthermore, current evaluation solutions typically assess local effects in specific scenarios and fail to provide a comprehensive assessment of the overall business. Summary of the Invention
[0004] The embodiments of this specification provide a data processing method and apparatus for solving the current problem of being unable to effectively evaluate the overall impact of changes in data processing caliber on the business.
[0005] To solve the above technical problems, the embodiments of this specification are implemented as follows: In a first aspect, a data processing method is proposed, comprising: Obtain the first user data of the experimental population that changes when the data processing caliber changes; generating a logical view according to the first user data; Applying the data in the logical view to multiple businesses for business processing, and determining changes in global business indicators corresponding to the multiple businesses based on the business processing results; Based on the changes in the global business indicators, determine the overall impact of the changed data processing caliber on the multiple businesses.
[0006] In a second aspect, a data processing device is provided, comprising: An acquisition module, which acquires the first user data of the experimental population that changes when the data processing caliber is changed; A generating module, generating a logical view according to the first user data; A first determination module applies the data in the logical view to multiple businesses for business processing, and determines changes in global business indicators corresponding to the multiple businesses based on the business processing results; The second determination module determines the overall impact of the changed data processing scope on the multiple businesses based on changes in the global business indicators.
[0007] In a third aspect, an electronic device is proposed, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program, when executed by the processor, implements the steps of the method described in the first aspect.
[0008] In a fourth aspect, a computer-readable storage medium is proposed, on which a computer program is stored. When the computer program is executed by a processor, the steps of the method described in the first aspect are implemented.
[0009] In a fifth aspect, a computer program product is proposed, which includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute part or all of the steps of the method described in the first aspect.
[0010] In the embodiments of this specification, when the data processing caliber is changed, since a logical view can be constructed based on the first user data that has changed in the experimental population, and the data in the logical view can be applied to multiple businesses for business processing, the data and the business can be decoupled so that the change in the data processing caliber affects the data level but not the business level. This allows the data that the business relies on to be adjusted in a non-invasive manner, effectively isolating the interference of other variables. This not only allows the impact of the change in the data processing caliber on the business to be quantified individually, but also ensures the stability and continuity of the business system. Since the changes in the global business indicators corresponding to multiple businesses can be determined based on the business processing results, and the overall impact of the changed data processing caliber on multiple businesses can be determined based on the changes in the global business indicators, a comprehensive assessment of the overall business can be achieved, providing strong data support for business decisions. BRIEF DESCRIPTION OF THE DRAWINGS
[0011] In order to more clearly illustrate the embodiments of this specification or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments recorded in the embodiments of this specification. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.
[0012] Figure 1is a flowchart of a data processing method according to an embodiment of the present specification; Figure 2 is a flowchart of a data processing method according to an embodiment of the present specification; Figure 3 is a schematic diagram of a data processing method according to an embodiment of the present specification; Figure 4 is a schematic structural diagram of an electronic device according to an embodiment of the present specification; Figure 5 It is a structural diagram of a data processing device according to an embodiment of the present specification. DETAILED DESCRIPTION
[0013] In related technologies, when data processing standards change, a common approach to assessing the overall impact of the change on the business is to evaluate the impact of the change within each business area of the service provider. However, this approach is time-consuming. Each change in data processing standards requires corresponding modifications to the engineering pipeline and models within the relevant business areas, a process that is both time-consuming and resource-intensive. Furthermore, in practice, factors such as the business model's design and parameter configuration may also impact the business, in addition to changes in data processing standards. Therefore, it is difficult to exclude the influence of these factors and independently quantify the impact of a change in data processing standards on the business. Furthermore, service providers typically offer multiple services (i.e., across multiple business areas) that are interconnected. This assessment approach often focuses on the impact within a single business area and lacks a broader perspective to measure the impact of changes in data processing standards on the overall operational efficiency or strategic objectives of multiple businesses. This raises questions about its scientific and comprehensive nature.
[0014] The technical solution provided by the embodiments of this specification, when the data processing caliber is changed, can be used to construct a logical view based on the first user data that has changed in the experimental population, and the data in the logical view can be applied to multiple businesses for business processing. Therefore, the data and the business can be decoupled so that the change in the data processing caliber affects the data level but not the business level, so that the data that the business depends on can be adjusted in a non-invasive manner, effectively isolating the interference of other variables. It is not only possible to quantify the impact of the change in the data processing caliber on the business, but also to ensure the stability and continuity of the business system. In addition, when evaluating the impact of the change in the data processing caliber on the business, since the changes in the global business indicators corresponding to multiple businesses can be determined based on the business processing results, and the overall impact of the changed data processing caliber on multiple businesses can be determined based on the changes in the global business indicators, a comprehensive evaluation of the overall business can be achieved, thereby providing strong data support for business decisions.
[0015] In order to help those skilled in the art better understand the technical solutions in the embodiments of this specification, the technical solutions in the embodiments of this specification will be clearly and completely described below in conjunction with the drawings in one or more embodiments of this specification. Obviously, the described embodiments are only part of the embodiments of this specification, not all of the embodiments. Based on the embodiments in this specification, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of this document.
[0016] It should be noted that the technical solutions provided in the embodiments of this specification are applicable to scenarios including but not limited to risk control scenarios, advertising scenarios, and product recommendation scenarios, which are not specifically limited here.
[0017] The technical solutions provided by the embodiments of this specification are described in detail below with reference to the accompanying drawings.
[0018] Figure 1 It is a flowchart of a data processing method according to an embodiment of the present specification. Figure 1 The data processing method shown may include the following steps.
[0019] S102: Acquire first user data of the experimental population that changes when the data processing caliber is changed.
[0020] When evaluating the overall impact of a change in data processing standards on the business, the user data of the experimental population that changes due to the change in data processing standards can be obtained. For ease of distinction, this data can be referred to as first user data.
[0021] The experimental population is the population used to evaluate the overall impact of changes in data processing caliber on the business. Optionally, the experimental population can be a subset of users within a user group. This user group can be the user group corresponding to the user data that the business relies on, i.e., the user data consumed by the service provider when providing the service. For example, a service provider collects user data from multiple users. When providing services, it analyzes user behaviors, interests, and hobbies based on this data and uses this data to optimize and improve service quality. In this case, the user data collected by the service provider is the user data that the business relies on, i.e., the user data consumed when providing the service. The multiple users corresponding to this user data constitute the user group, and the experimental population can be a subset of this user group.
[0022] Changes in data processing caliber may include changing the source of user data (i.e., changing the data source, such as introducing a new data source) or revising the original data, etc., and are not specifically limited here.
[0023] For example, the experimental population includes user A and user B. When changing the data processing caliber, a new data source is introduced. The new data source supplements user A's occupation and corrects user B's age. The first user data obtained includes user A's occupation and the corrected age of user B.
[0024] S104: Generate a logical view according to the first user data.
[0025] In the event that the user data of the experimental population changes, the embodiment of this specification will not update the changed user data of the experimental population (i.e., the first user data) to the physical table of the database (the physical table stores the user data that the business provider relies on when providing business services, and these user data are all user data before the data processing caliber is changed), but will generate a logical view based on the first user data.
[0026] Logical view is a concept in the design and implementation of data warehouses. It is a data structure and organization method defined from the user or business perspective without having to worry about the specific details of the underlying physical storage. Logical view can quickly adjust the way data is displayed according to different business needs without changing the underlying physical database design. In the embodiments of this specification, by constructing a logical view, data can be decoupled from the business, so that changes in the data processing caliber affect the data level but not the business level. Therefore, the data that the business depends on can be adjusted in a non-invasive manner, effectively isolating the interference of other variables, so that data changes can be reflected in the business efficiently at a lower cost.
[0027] When generating a logical view according to the first user data, in some embodiments, the following steps may be included: Obtain the original user data of the experimental population without changing the data processing caliber; Updating (or correcting) the original user data according to the first user data; Generate a logical view based on the updated user data.
[0028] When the data processing scope changes, the user data of the experimental population may not all change. That is, the change in data processing scope may only change part of the user data in the experimental population, such as only some fields in the user data. Therefore, in order to take into account this part of the unchanged user data, when generating the logical view, the logical view can be generated based on the changed user data (that is, the first user data) and the unchanged user data of the experimental population.
[0029] When generating a logical view, specifically, the original user data of the experimental population can be first obtained when the data processing caliber is unchanged. The original user data can then be updated or modified based on the first user data (for example, the content of the field corresponding to the first user data in the original user data is replaced with the first user data). The updated user data obtained at this time includes user data that has not changed after the data processing caliber is changed and user data that has changed. When generating a logical view, a logical view can be generated based on the updated user data. The original user data of the experimental population when the data processing caliber is unchanged can be obtained from the aforementioned physical table, which stores the original user data of the experimental population before the data processing caliber is changed.
[0030] S106: Apply the data in the logical view to multiple businesses for business processing, and determine changes in global business indicators corresponding to the multiple businesses based on the business processing results.
[0031] Multiple services are offered by a service provider. When providing services to users, service providers prioritize the global business metrics corresponding to these multiple services over the metrics of individual services. Specifically, they prioritize the overall service effectiveness of these multiple services over the local effectiveness of individual services. Therefore, when assessing the overall impact of a change in data processing scope on a business, data from the logical view can be applied to multiple services for business processing (i.e., multiple services can consume user data from the logical view during business processing). Based on the processing results of these multiple services, changes in the global business metrics corresponding to these multiple services can be determined. This allows for focusing on the most critical global business metrics while masking the differences in focus across different services. Changes in global business metrics can include changes in the magnitude of the indicator value, such as increases or decreases. These changes can reflect the overall impact of a change in data processing scope on multiple services.
[0032] When determining changes in global business indicators corresponding to multiple businesses based on business processing results, in some implementations, the following steps may be included: Determine a first indicator value of a global business indicator according to the business processing result; Obtain the second indicator value of the global business indicator, where the second indicator value is the indicator value of the global business indicator when the data processing caliber is not changed; A change in the global business indicator is determined based on the first indicator value and the second indicator value.
[0033] The first indicator value is the indicator value of the global business indicator obtained after multiple businesses perform business processing based on the changed user data after the data processing scope is changed. The specific implementation method for determining the first indicator value of the global business indicator based on the business processing results can be found in the specific implementation in the relevant technology and is not specifically limited here. For example, the impact of a single business on the global business indicator can be determined based on the business processing results of the single business. The impact of multiple businesses on the global indicator can then be combined to ultimately obtain the first indicator value of the global business indicator.
[0034] The second indicator value is the indicator value of the global business indicator corresponding to multiple businesses before the data processing caliber is changed. The second indicator value is a reference value used for comparison with the first indicator value to determine the change in the global business indicator after the data processing caliber is changed. In some embodiments, the second indicator value can be a manually set reference value. In other embodiments, the second indicator value can also be an indicator value determined based on actual business processing conditions. No specific limitation is made herein on how to obtain the second indicator value.
[0035] When the second indicator value is determined according to actual business processing conditions, in some implementations, obtaining the second indicator value may include: Obtain the second user data of the control population without changing the data processing caliber; The second user data is applied to multiple services for service processing, and a second indicator value of the global service indicator is determined according to the service processing result.
[0036] The control population is a population used for comparison with the above-mentioned experimental population. Optionally, the control population can be other users in the user group described in S102 above except for the experimental population, that is, when evaluating the overall impact of the change in data processing caliber on the business, the users in the user group that the business depends on can be diverted, with some users serving as the experimental population and the other users serving as the control population. The data of different populations are then applied to multiple businesses for business processing to obtain global business indicators under the influence of different populations. By comparison, the overall impact of the change in data processing caliber on the business can be accurately obtained. Among them, the experimental population is the population whose user data changes when the data processing caliber changes, that is, the population affected by the changed data processing caliber, and the control population is the population whose user data does not change when the data processing caliber changes, that is, the population not affected by the changed data processing caliber. When obtaining the user data of the control population when the data processing caliber is not changed, it can be obtained from the above-mentioned physical table, which stores the user data of the control population when the data processing caliber is not changed.
[0037] After obtaining the first indicator value and the second indicator value of the global business indicator, the change of the global business indicator can be determined based on the first indicator value and the second indicator value. In some embodiments, determining the change of the global business indicator based on the first indicator value and the second indicator value includes: determining whether a change in the first indicator value compared to the second indicator value satisfies a preset condition; When the preset condition is met, determining that the change of the global business indicator is normal; If the preset condition is not met, it is determined that the change of the global business indicator is abnormal.
[0038] The change in the first indicator value compared to the second indicator value can include whether the first indicator value increased or decreased (or the percentage of increase or decrease) compared to the second indicator value, as well as the confidence level of the increase or decrease. The preset condition can be a rollout condition, which requires that the change in data processing scope be rolled out to all users who rely on the business. Optionally, the preset condition can include an increase and a confidence level greater than or equal to a set threshold.
[0039] After determining whether the change in the first indicator value compared to the second indicator value satisfies a preset condition, if the determination result is that the change in the first indicator value compared to the second indicator value satisfies the preset condition, it can be indicated that the change in the data processing caliber can improve the global business indicator, and in this case, the change in the global business indicator can be determined to be normal (or effective). If the determination result is that the change in the first indicator value compared to the second indicator value does not satisfy the preset condition, it can be indicated that the change in the data processing caliber will cause the global business indicator to deteriorate, and in this case, the change in the global business indicator can be determined to be abnormal (or invalid).
[0040] S108: Based on changes in global business indicators, determine the overall impact of the changed data processing scope on multiple businesses.
[0041] Since changes in global business indicators can reflect the overall impact of changes in data processing caliber on multiple businesses, after obtaining the changes in global business indicators, the overall impact of the changed data processing caliber on multiple businesses can be determined based on the changes in global business indicators. For example, it can be determined whether the overall impact on multiple businesses is positive or negative (that is, whether the impact is good or bad).
[0042] As mentioned above, the change of the global business indicator can be normal or abnormal. In this way, in some embodiments, when determining the overall impact of the changed data processing caliber on multiple businesses, the following may be included: If the changes in global business indicators are normal, it is determined that the overall impact of the changed data processing caliber on multiple businesses is positive. In other words, the changed data processing caliber can improve the global business indicators of multiple businesses and enhance the overall effectiveness of multiple businesses. In the case of abnormal changes in global business indicators, it is determined that the overall impact of the changed data processing caliber on multiple businesses is negative, that is, the changed data processing caliber will cause the global business indicators of multiple businesses to deteriorate, thereby reducing the overall effect of multiple businesses.
[0043] In some embodiments, after determining the overall impact of the changed data processing caliber on multiple businesses, if the overall impact is positive, the user data in the physical tables that multiple businesses rely on can be updated according to the changed data processing caliber. In this way, when multiple businesses are performing business processing, the user data in the physical table can be obtained for business processing, thereby improving global business indicators, which not only helps to improve the operational efficiency of the enterprise, but also promotes the continuous improvement of product and service quality, and wins more competitive advantages for the enterprise. If the overall impact is negative, the user data in the physical tables that multiple businesses rely on can be updated without using the changed data processing caliber, that is, no full processing is performed. In addition, if the overall impact is negative, the first user data can also be rolled back, that is, the user data of the experimental population can be restored to the user data before the data processing caliber was changed.
[0044] For example, in the scenario of recommending products to users, a service provider can offer multiple recommendation services, each recommending different types of products. These services consume the user data of the same user group. After changing the data processing scope, for example, by adding occupational information for some users in the user group, this information can be applied to the recommendation algorithms of each service. The algorithm will then modify the products recommended to the user based on their occupational information. The effectiveness of product recommendations from multiple services can then be determined, measured, for example, by the global conversion rate. If the global conversion rate is higher than the conversion rate when recommending products without occupational information, it can be determined that the added occupational information has a positive overall impact on the service. In this case, the change in occupational information can be rolled out to the entire user group. Otherwise, it can be determined that the added occupational information has a negative overall impact on the service. In this case, the user data of some users in the user group can be rolled back to cancel the occupational information change.
[0045] Optionally, in some implementations, a monitoring mechanism can also be established based on the user data of the experimental population that changes when the data processing caliber is changed, to prevent the change in data processing caliber from bringing unexpected effects. On this basis, when performing data push, it can be decided whether to perform data push based on whether the monitoring mechanism finds anomalies. For example, if the monitoring mechanism does not find anomalies, and the overall impact of the changed data processing caliber on multiple businesses is positive, the user data in the physical tables that multiple businesses rely on can be updated according to the changed data processing caliber. If the monitoring mechanism finds anomalies, no matter whether the overall impact of the changed data processing caliber on multiple businesses is positive or negative, data push will not be performed.
[0046] In some possible application scenarios, there may be multiple data processing calibers after the change, such as multiple different new data sources. In this scenario, the technical solution provided in the embodiments of this specification can be used to determine the impact of different data processing calibers on global business indicators (it should be noted that the experimental populations corresponding to different data processing calibers cannot have repeated users to avoid affecting the experimental results), and then determine the data processing caliber that has the best impact on the global business indicators (such as the data processing caliber that improves the global business indicators the most), and update the user data in the physical tables that multiple businesses depend on according to the data processing caliber. In this way, by selecting the best data processing caliber to change user data, the service quality can be better improved and the user experience can be enhanced.
[0047] In the embodiments of this specification, when the data processing caliber is changed, since a logical view can be constructed based on the first user data that has changed in the experimental population, and the data in the logical view can be applied to multiple businesses for business processing, the data and the business can be decoupled so that the change in the data processing caliber affects the data level but not the business level. This allows the data that the business relies on to be adjusted in a non-invasive manner, effectively isolating the interference of other variables. This not only allows the impact of the change in the data processing caliber on the business to be quantified individually, but also ensures the stability and continuity of the business system. Since the changes in the global business indicators corresponding to multiple businesses can be determined based on the business processing results, and the overall impact of the changed data processing caliber on multiple businesses can be determined based on the changes in the global business indicators, a comprehensive assessment of the overall business can be achieved, providing strong data support for business decisions.
[0048] In order to facilitate understanding of the technical solutions provided in the embodiments of this specification, a more specific implementation method will be used as an example for explanation below. Figure 2 and Figure 3 .
[0049] Figure 2It is a flowchart of a data processing method according to an embodiment of the present specification. Figure 2 The data processing method shown includes the following steps.
[0050] S202: Determine global business indicators.
[0051] To minimize the impact on upper-level businesses, we first need to clarify global business metrics. This means disregarding the differences in focus across different businesses and focusing on the most critical global metrics. Generally, global business metrics are known information. For example, in a product recommendation scenario, a global business metric could be the overall conversion rate for multiple product types.
[0052] S204: Change the data processing caliber.
[0053] You can use a new caliber to process user data. For example, you can introduce a new data source or correct a previously incorrect processing caliber, etc. There are no specific restrictions here.
[0054] S206: Divide the user group and determine the experimental group and the control group.
[0055] The user group can be the user group corresponding to the user data that the business relies on. To scientifically determine the impact of data changes, it is necessary to triage the user group. This can be done offline, dividing the user group into a treatment group and a control group. The treatment group can be the group affected by the data and caliber changes, while the control group can be the group not affected by the data and caliber changes.
[0056] S208: Generate an experiment change table based on the user data after the experimental population is changed.
[0057] The experiment change table includes user data of the experimental population that has changed due to the change of data processing caliber. Optionally, in some embodiments, the form of the experiment change table can be as shown in Table 1.
[0058] Table 1
[0059] S210: Generate a logical view based on the experiment change table and the original physical table.
[0060] The original physical table stores user data that remains unchanged after data processing. This user data is received by the service provider and is business-dependent. When consuming data, the service obtains it from the original physical table. After obtaining the experiment change table, a logical view can be generated based on the experiment change table and the original physical table. The logical view includes the user data after the changes to the experimental population.
[0061] Under the influence of the experiment change table, the logical view automatically fills in new data for the experimental population, which saves storage space and does not pollute the original data.
[0062] S212: Establish a monitoring mechanism based on the experimental change table.
[0063] The monitoring mechanism here can prevent changes in data processing caliber from causing unexpected impacts.
[0064] S214: Apply the data in the logical view to multiple businesses for business processing to determine changes in global business indicators.
[0065] Here, you can first apply the data in the logical view to multiple businesses for business processing to determine the first indicator value of the global business indicator after changing the data processing caliber. Then, apply the user data of the control group to multiple businesses for business processing to determine the second indicator value of the global business indicator before changing the data processing caliber. Based on the first and second indicator values, determine the change in the global business indicator. For example, whether the global business indicator has improved, that is, whether the first indicator value is higher than the second indicator value.
[0066] This step actually analyzes the effects of global business indicators on different groups of people, such as cumulative income or per capita income, to determine whether this data experiment is effective.
[0067] S216: Determine whether to improve the global business indicator.
[0068] If the global business indicator is improved, S218 may be executed; otherwise, S220 may be executed.
[0069] S218: Conduct experiments to promote the whole process.
[0070] During the pilot rollout, user data in the original physical table can be modified based on the changed data processing caliber. This allows subsequent business processing to retrieve the modified user data from the original physical table. Since the aforementioned pilot has proven that the changed data processing caliber can improve global business metrics, retrieving the modified user data from the original physical table for business processing can improve global business metrics and service quality.
[0071] S220: Perform experiment rollback.
[0072] When rolling back an experiment, you can modify the experiment change table to restore the original data.
[0073] Figure 3 It is a schematic diagram of a data processing method according to an embodiment of the present specification. Figure 3In this scenario, when the data processing caliber changes, some fields in the user data are modified. The user group is then divided into an experimental population and a control population. The experimental population is affected by the data processing caliber change and has some fields in its user data changed. The control population is not affected by the data processing caliber change and has no changes in its user data. An experiment change table is then generated based on the changed fields in the experimental population. A logical view is then generated based on the experiment change table and the original physical table (including all fields from both the control and experimental populations). The data in the logical view is then applied to multiple businesses for business processing. The results of these business processing operations determine changes in global business indicators, and the experimental results are evaluated based on these changes. Quality monitoring can also be performed on the logical view and the experiment change table. If monitoring is normal and the changes in global business indicators meet expectations, such as improvements, data rollout is performed. This involves modifying the fields in the original physical table based on the changed data processing caliber. If monitoring is abnormal or the changes in global business indicators do not meet expectations, a data rollback is performed.
[0074] It should be noted that Figure 3 The business intermediate table shown in the figure is an optional data table. In actual applications, if the business directly consumes the data in the logical view for processing, the business intermediate table is not required. If the data in the logical view needs to be further processed, a business intermediate table can be generated.
[0075] The embodiments of this specification can achieve the decoupling of data and business by constructing a logical view, which only affects the data level and can effectively isolate the interference of other variables, thereby adjusting the data that the business relies on in a non-invasive way. It can not only reduce the time cost required to transform the existing business process, efficiently reflect the data changes in the business, but also ensure the stability and continuity of the system. By utilizing offline diversion experiments and comprehensive business indicator systems, it is possible not only to comprehensively evaluate the impact of changes in data processing caliber on the overall business and provide strong data support for decision-making, but also to carefully analyze the specific impact of specific user groups on a single business link. In addition, through the design of the experimental change table, data iteration experiments can be performed in a configurable manner, achieving the decoupling between business logic and data management, so that the impact of each data change on the overall business performance can be more accurately evaluated, thereby assisting decision makers to gain a clearer insight into the changing trend of data value and make more wise strategic choices. It not only helps to improve the operational efficiency of the enterprise, but also promotes the continuous improvement of product and service quality, and wins more competitive advantages for the enterprise.
[0076] The foregoing description of this specification describes specific embodiments. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims can be performed in an order different from that described in the embodiments and still achieve the desired results. Furthermore, the processes depicted in the accompanying drawings do not necessarily require the specific order shown or the sequential order to achieve the desired results. In certain embodiments, multitasking and parallel processing are also possible or may be advantageous.
[0077] Figure 4 This is a schematic diagram of the structure of an electronic device according to an embodiment of this specification. Figure 4 At the hardware level, the electronic device includes a processor and, optionally, an internal bus, a network interface, and memory. The memory may include internal memory, such as high-speed random-access memory (RAM), or non-volatile memory, such as at least one disk drive. Of course, the electronic device may also include other hardware required for its services.
[0078] The processor, network interface, and memory can be interconnected via an internal bus, which can be an ISA (Industry Standard Architecture) bus, a PCI (Peripheral Component Interconnect) bus, or an EISA (Extended Industry Standard Architecture) bus. The bus can be divided into an address bus, a data bus, a control bus, and the like. For ease of representation, Figure 4 Only one bidirectional arrow is used in the diagram, but this does not mean that there is only one bus or one type of bus.
[0079] The memory is used to store programs. Specifically, the program may include program code, which includes computer operating instructions. The memory may include internal memory and non-volatile memory, and provides instructions and data to the processor.
[0080] The processor reads the corresponding computer program from the non-volatile memory into the internal memory and then runs it, forming a data processing device at the logical level. The processor executes the program stored in the memory and is specifically used to perform the following operations: Obtain the first user data of the experimental population that changes when the data processing caliber changes; generating a logical view according to the first user data; Applying the data in the logical view to multiple businesses for business processing, and determining changes in global business indicators corresponding to the multiple businesses based on the business processing results; Based on the changes in the global business indicators, determine the overall impact of the changed data processing caliber on the multiple businesses.
[0081] It should be understood that the data processing device of this embodiment can be used as Figure 1 or Figure 2 The execution subject of the method shown can thus realize Figure 1 or Figure 2 The steps and functions of the method shown are not repeated here.
[0082] The above is as in this manual Figure 1 or Figure 2 The methods disclosed in the illustrated embodiments can be applied to or implemented by a processor. The processor may be an integrated circuit chip with signal processing capabilities. During implementation, each step of the above method can be performed by hardware integrated logic circuits within the processor or by software instructions. The above processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. The methods, steps, and logic block diagrams disclosed in the embodiments of this specification can be implemented or executed. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the methods disclosed in conjunction with the embodiments of this specification can be directly implemented and executed by a hardware decoding processor, or by a combination of hardware and software modules within the decoding processor. The software module can be located in a storage medium well-known in the art, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, etc. The storage medium is located in the memory, and the processor reads the information in the memory and, in conjunction with its hardware, completes the steps of the above method.
[0083] Of course, in addition to software implementation, the electronic device of the embodiments of this specification does not exclude other implementation methods, such as logic devices or a combination of software and hardware, etc. That is to say, the execution subject of the following processing flow is not limited to each logic unit, but can also be hardware or logic devices.
[0084] The embodiment of this specification also proposes a computer-readable storage medium, which stores one or more programs, wherein the one or more programs include instructions, which, when executed by a portable electronic device including multiple application programs, can enable the portable electronic device to execute Figure 1 or Figure 2 The method of the embodiment shown is specifically used to perform the following operations: Obtain the first user data of the experimental population that changes when the data processing caliber changes; generating a logical view according to the first user data; Applying the data in the logical view to multiple businesses for business processing, and determining changes in global business indicators corresponding to the multiple businesses based on the business processing results; Based on the changes in the global business indicators, determine the overall impact of the changed data processing caliber on the multiple businesses.
[0085] In addition, an embodiment of the present disclosure further provides a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, wherein the computer program is operable to cause a computer to execute: Obtain the first user data of the experimental population that changes when the data processing caliber changes; generating a logical view according to the first user data; Applying the data in the logical view to multiple businesses for business processing, and determining changes in global business indicators corresponding to the multiple businesses based on the business processing results; Based on the changes in the global business indicators, determine the overall impact of the changed data processing caliber on the multiple businesses.
[0086] Figure 5 This is a structural diagram of a data processing device 50 according to an embodiment of the present specification. Figure 5 In a software implementation, the data processing device 50 may include: an acquisition module 51, a generation module 52, a first determination module 53 and a second determination module 54, wherein: An acquisition module 51 acquires first user data of an experimental population that changes when the data processing caliber is changed; A generating module 52 generates a logical view according to the first user data; A first determination module 53 applies the data in the logical view to multiple businesses for business processing, and determines changes in global business indicators corresponding to the multiple businesses based on the business processing results; The second determination module 54 determines the overall impact of the changed data processing caliber on the multiple businesses based on changes in the global business indicators.
[0087] In some implementations, the generating module 52 generates a logical view based on the first user data, including: Obtaining original user data of the experimental population without changing the data processing caliber; updating the original user data according to the first user data; The logical view is generated according to the updated user data.
[0088] In some implementations, the first determining module 53 determines changes in global business indicators corresponding to the multiple businesses based on the business processing results, including: Determine a first indicator value of the global business indicator according to the business processing result; Obtaining a second indicator value of the global business indicator, where the second indicator value is the indicator value of the global business indicator when the data processing caliber is not changed; A change in the global business indicator is determined based on the first indicator value and the second indicator value.
[0089] In some implementations, the first determining module 53 obtains the second indicator value of the global business indicator, including: Obtain the second user data of the control population without changing the data processing caliber; Apply the second user data to the multiple services for service processing, and determine a second indicator value of the global service indicator according to the service processing result.
[0090] In some implementations, the first determining module 53 determines the change in the global service indicator based on the first indicator value and the second indicator value, including: determining whether a change in the first indicator value compared to the second indicator value satisfies a preset condition; When the preset condition is met, determining that the change of the global business indicator is normal; If the preset condition is not met, it is determined that the change of the global business indicator is abnormal.
[0091] In some embodiments, the second determining module 54 determines the overall impact of the changed data processing caliber on the multiple businesses based on the change in the global business indicator, including: If the changes in the global business indicators are normal, determining that the overall impact of the changed data processing caliber on the multiple businesses is positive; In the case where the change in the global business indicator is abnormal, it is determined that the overall impact of the changed data processing caliber on the multiple businesses is negative.
[0092] In some implementations, the second determining module 54 further includes: If the changed data processing caliber has a positive overall impact on the multiple businesses, updating user data in the physical tables that the multiple businesses rely on according to the changed data processing caliber; When the changed data processing scope has a negative overall impact on the multiple businesses, the first user data is rolled back.
[0093] The aforementioned modules in the apparatuses provided in the embodiments of this specification may also implement the method steps provided in the aforementioned method embodiments. Alternatively, the apparatuses provided in the embodiments of this specification may further include other modules in addition to the aforementioned modules to implement the method steps provided in the aforementioned method embodiments. The apparatuses provided in the embodiments of this specification are capable of achieving the technical effects achieved by the aforementioned method embodiments, and therefore will not be further elaborated upon here.
[0094] In short, the above description is only a preferred embodiment of this specification and is not intended to limit the scope of protection of this document. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of one or more embodiments of this specification shall be included in the scope of protection of this document.
[0095] The systems, devices, modules, or units described in the above embodiments may be implemented by computer chips or entities, or by products having certain functions. A typical implementation device is a computer. Specifically, the computer may be, for example, a personal computer, a laptop computer, a cellular phone, a camera phone, a smartphone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.
[0096] Computer-readable media includes permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. The information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include transitory computer-readable media (transitory media), such as modulated data signals and carrier waves.
[0097] It should also be noted that the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, commodity, or apparatus that includes a series of elements includes not only those elements but also other elements not explicitly listed, or includes elements inherent to such process, method, commodity, or apparatus. In the absence of further limitations, an element defined by the phrase "comprises a ..." does not exclude the presence of other identical elements in the process, method, commodity, or apparatus that includes the element.
[0098] The various embodiments in this specification are described in a progressive manner. Similar parts between the various embodiments can be referred to in conjunction with each other. Each embodiment focuses on the differences between the other embodiments. In particular, the system embodiments are generally similar to the method embodiments, so the description is relatively simple. For relevant parts, refer to the description of the method embodiments.
Claims
1. A data processing method, comprising: Obtain the first user data of the experimental population that changes when the data processing caliber changes; generating a logical view according to the first user data; Applying the data in the logical view to multiple businesses for business processing, and determining changes in global business indicators corresponding to the multiple businesses based on the business processing results; Based on the changes in the global business indicators, determine the overall impact of the changed data processing caliber on the multiple businesses.
2. The method according to claim 1, wherein generating a logical view according to the first user data comprises: Obtaining original user data of the experimental population without changing the data processing caliber; updating the original user data according to the first user data; The logical view is generated according to the updated user data.
3. The method according to claim 1, wherein determining changes in global business indicators corresponding to the multiple businesses based on business processing results comprises: Determine a first indicator value of the global business indicator according to the business processing result; Obtaining a second indicator value of the global business indicator, where the second indicator value is the indicator value of the global business indicator when the data processing caliber is not changed; A change in the global business indicator is determined based on the first indicator value and the second indicator value.
4. The method according to claim 3, wherein obtaining the second indicator value of the global business indicator comprises: Obtain the second user data of the control population without changing the data processing caliber; Apply the second user data to the multiple services for service processing, and determine a second indicator value of the global service indicator according to the service processing result.
5. The method according to claim 3, wherein determining the change of the global business indicator based on the first indicator value and the second indicator value comprises: determining whether a change in the first indicator value compared to the second indicator value satisfies a preset condition; When the preset condition is met, determining that the change of the global business indicator is normal; If the preset condition is not met, it is determined that the change of the global business indicator is abnormal.
6. The method according to claim 1, wherein determining the overall impact of the changed data processing caliber on the multiple businesses based on changes in the global business indicators comprises: If the changes in the global business indicators are normal, determining that the overall impact of the changed data processing caliber on the multiple businesses is positive; In the case where the change in the global business indicator is abnormal, it is determined that the overall impact of the changed data processing caliber on the multiple businesses is negative.
7. The method according to claim 1 or 6, further comprising: If the changed data processing caliber has a positive overall impact on the multiple businesses, updating user data in the physical tables that the multiple businesses rely on according to the changed data processing caliber; When the changed data processing scope has a negative overall impact on the multiple businesses, the first user data is rolled back.
8. A data processing device comprising: An acquisition module, which acquires the first user data of the experimental population that changes when the data processing caliber is changed; A generating module, generating a logical view according to the first user data; A first determination module applies the data in the logical view to multiple businesses for business processing, and determines changes in global business indicators corresponding to the multiple businesses based on the business processing results; The second determination module determines the overall impact of the changed data processing scope on the multiple businesses based on changes in the global business indicators.
9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program implements the steps of the method according to any one of claims 1 to 7 when executed by the processor.
10. A computer-readable storage medium having a computer program stored thereon, wherein the computer program implements the steps of the method according to any one of claims 1 to 7 when executed by a processor.
11. A computer program product, comprising a non-transitory computer-readable storage medium storing a computer program, wherein the computer program is operable to cause a computer to execute part or all of the steps of the method according to any one of claims 1 to 7.