Data processing method, device, electronic device and storage medium
By obtaining and processing data sets and rule sets, deleting inappropriate rules, and repeatedly determining target rules, the perceptual impact and accuracy problems in the formulation of traditional risk control policy rule sets are solved, and high-quality risk control rule sets are achieved and high-quality risk control rule sets are improved. The effect of risk prevention and control.
Patent Information
- Application Number
- CN202210376815.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-04-11
- Publication Date
- 2024-11-15
- Estimated Expiration
- 2042-04-11
AI Technical Summary
The formulation of traditional risk control strategy rule sets is susceptible to personal sentiment, resulting in unobjective and inaccurate results. The rule set generated by machine learning may contain inappropriate rules, affecting the accuracy of decision making.
By obtaining the data set and rule set, determining the indicator values corresponding to the rules, deleting inappropriate rules, and repeating the indicator value determination process until the preset conditions are met to form a high-quality target rule set.
It ensures the quality of the rule set, improves the accuracy of risk control decisions, and provides guarantees for enterprise risk prevention and control.
Smart Images

Figure CN114897595B_ABST
Abstract
Description
Technical Field
[0001] Embodiments of the present invention relate to the field of risk control technology, and in particular, to a data processing method, device, electronic device, and storage medium. Background Art
[0002] The formulation of traditional risk control strategy rule sets usually depends on the business personnel's understanding of user data. The formulation of risk control strategy rule sets requires business personnel to understand the distribution of user data and combine their own business experience to obtain the corresponding rule sets. However, the formulation of the above rule sets is easily affected by personal emotions and cannot objectively and quantitatively obtain results.
[0003] At present, in order to avoid the drawbacks of the traditional method of formulating risk control strategy rule sets, related technologies usually use methods such as machine learning to generate risk control strategy rule sets corresponding to user data based on user data.
[0004] However, due to the characteristics of machine learning methods, the risk control strategy rule set generated by the machine learning method may contain rules that are not applicable to user data. If the above-mentioned inapplicable rules are not deleted from the rule set, when the inapplicable rules are applied to risk control decisions, the decision results may be inaccurate. Summary of the invention
[0005] In view of this, in order to solve the above technical problems or part of the technical problems, an embodiment of the present invention provides a data processing method, device, electronic device and storage medium.
[0006] In a first aspect, an embodiment of the present invention provides a data processing method, including:
[0007] Acquire a first data set and a first rule set corresponding to the first data set;
[0008] For each first rule in the first rule set, determining a first indicator value of a first indicator corresponding to the first rule according to the first data set, to obtain a first indicator value set corresponding to the first rule set;
[0009] Determine a target indicator value and a target rule corresponding to the target indicator value according to the first indicator value set;
[0010] Deleting the target rule from the first rule set to obtain a second rule set, and deleting the first data corresponding to the target rule from the first data set to obtain a second data set;
[0011] The second rule set is used as the first rule set, and the second data set is used as the first data set. The step of determining the target rule using the first indicator value set is repeated to obtain a plurality of the target rules that meet the first preset condition.
[0012] In a possible implementation manner, determining the target indicator value according to the first indicator value set includes:
[0013] Determine a preset indicator value set corresponding to a preset threshold range from the first indicator set, wherein the preset indicator value set includes at least one preset indicator value;
[0014] A target indicator value is determined from the preset indicator value set.
[0015] In a possible implementation, the method further includes:
[0016] For each first rule in the first rule set, determining a second indicator value of a second indicator corresponding to the first rule according to the first data set, to obtain a second indicator value set corresponding to the first rule set;
[0017] For each preset indicator value in the preset indicator value set, determine a second indicator value corresponding to the preset indicator value, and obtain a plurality of second indicator values corresponding to the preset indicator value set;
[0018] Sorting the multiple second indicator values to obtain a sorting result;
[0019] According to the sorting result, a target indicator value is determined.
[0020] In a possible implementation manner, obtaining the plurality of target rules that satisfy the first preset condition includes:
[0021] In the process of repeatedly performing the determination of the target rule using the first indicator value set, when the preset indicator value set is empty, the repeated determination of the target rule is terminated to obtain a plurality of the target rules.
[0022] In a possible implementation manner, determining, according to the first data set, a first indicator value of a first indicator corresponding to the first rule includes:
[0023] Determine a rule hit result of the first rule according to the first data set;
[0024] According to the rule hit result, a first indicator value of the first indicator corresponding to the first rule is determined.
[0025] In a possible implementation, the method further includes:
[0026] Determine a third indicator value corresponding to each of the first rules according to the rule hit result;
[0027] According to the preset business requirement, at least one first rule whose third indicator value is less than a preset threshold is deleted from the first rule set to obtain the first rule set after deletion;
[0028] The first indicator value set is determined according to the deleted first rule set.
[0029] In a possible implementation, the method further includes:
[0030] Performing a deduplication operation on each of the first rules in the first rule set to obtain a deduplicated first rule set;
[0031] At least one of the first rules whose third indicator value is less than a preset threshold is deleted from the first rule set after deduplication to obtain the first rule set after deletion.
[0032] In a second aspect, an embodiment of the present invention provides a data processing device, including:
[0033] An acquisition module, configured to acquire a first data set and a first rule set corresponding to the first data set;
[0034] A first determination module, configured to determine, for each first rule in the first rule set, a first indicator value of a first indicator corresponding to the first rule according to the first data set, to obtain a first indicator value set corresponding to the first rule set;
[0035] A second determination module is further used to determine a target indicator value and a target rule corresponding to the target indicator value according to the first indicator value set;
[0036] a deleting module, configured to delete the target rule from the first rule set to obtain a second rule set, and to delete the first data corresponding to the target rule from the first data set to obtain a second data set;
[0037] The third determination module is further used to use the second rule set as the first rule set and the second data set as the first data set, and repeatedly call the first determination module and the second determination module to obtain multiple target rules that meet the first preset condition.
[0038] In a third aspect, an embodiment of the present invention provides an electronic device, comprising: a processor and a memory, wherein the processor is used to execute a data processing program stored in the memory to implement the data processing method as described above.
[0039] In a fourth aspect, an embodiment of the present invention provides a storage medium, wherein the storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the data processing method as described above.
[0040] The data processing method provided by the embodiment of the present invention includes obtaining a first data set and a first rule set corresponding to the first data set; for each first rule in the first rule set, determining the first indicator value of the first indicator corresponding to the first rule according to the first data set, and obtaining the first indicator value set corresponding to the first rule set; determining the target indicator value according to the first indicator value set, and the target rule corresponding to the target indicator value; deleting the target rule from the first rule set to obtain the second rule set, and deleting the first data corresponding to the target rule from the first data set to obtain the second data set; using the second rule set as the first rule set and the second data set as the first data set, repeatedly executing the step of determining the target rule using the first indicator value set, so as to obtain multiple target rules that meet the first preset condition. In the above manner, the present invention determines the indicator value of the first rule set, and realizes the screening of inapplicable rules in the rule set according to the indicator value, thereby ensuring the quality of the rules in the generated rule set, and can better provide a guarantee for enterprises to carry out risk prevention and control. BRIEF DESCRIPTION OF THE DRAWINGS
[0041] Figure 1 A flowchart of a data processing method provided by an embodiment of the present invention;
[0042] Figure 2 A flowchart of another data processing method provided by an embodiment of the present invention;
[0043] Figure 3 A schematic diagram of the structure of a data processing device provided by an embodiment of the present invention;
[0044] Figure 4 A schematic diagram of the structure of an electronic device provided by an embodiment of the present invention;
[0045] In the above attached figure:
[0046] 10. Acquisition module; 20. First determination module; 30. Second determination module; 40. Deletion module; 50. Third determination module;
[0047] 400, electronic device; 401, processor; 402, memory; 4021, operating system; 4022, application; 403, user interface; 404, network interface; 405, bus system. DETAILED DESCRIPTION
[0048] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0049] To facilitate understanding of the embodiments of the present invention, specific embodiments will be further explained below in conjunction with the accompanying drawings. The embodiments do not constitute a limitation on the embodiments of the present invention.
[0050] refer to Figure 1 , Figure 1 A data processing method provided by an embodiment of the present invention includes the following steps:
[0051] S101: Acquire a first data set and a first rule set corresponding to the first data set.
[0052] In this embodiment, the first data set corresponds to the user group, and the first data set is obtained by processing the original data group corresponding to the user group. Each user corresponds to a first data, and the first data includes a characteristic parameter, a characteristic parameter value, and an identification value. The characteristic parameter can be the user's behavioral characteristics, and the characteristic parameter value corresponds to the characteristic parameter. The characteristic parameter value is the data corresponding to the user's behavioral characteristics. The first data also includes the user's risk performance data, which comes from the statistics of the user's own loan behavior. The identification value corresponds to the user's risk performance data, wherein the identification value can be obtained by marking the user's risk performance data according to a preset marking method. The preset marking method can be set according to the preset business requirements, and this embodiment does not make specific limitations here. For example, when the preset business requirement is to formulate a pass rule set, the preset marking method is to mark good users as 1 and bad users as 0; when the preset business requirement is to formulate a reject rule set, the preset marking method can also be to mark good users as 0 and bad users as 1. Good users and bad users can be distinguished in the following way: a risk performance data set corresponding to the user group is collected by crawling, and each risk performance data in the risk performance data set is judged according to a preset risk indicator threshold. When the risk performance data exceeds the preset risk indicator threshold, the user corresponding to the risk performance data is recorded as a good user, and when the risk performance data does not exceed the preset risk indicator threshold, the user corresponding to the risk performance data is recorded as a bad user. On the basis of determining whether each user is a good user or a bad user, each user can be marked according to preset business needs to lay a foundation for determining the first rule set.
[0053] In this embodiment, the first rule set can be determined according to the first data set and the preset algorithm, wherein the preset algorithm can be a data binning method, or a tree model algorithm, wherein the corresponding preset algorithm can be selected according to actual needs to process the first data set, so as to obtain the first rule set corresponding to the first data set, which is not specifically limited in this embodiment. For example, the data binning method can be selected to process the first data set, so as to obtain the first rule set corresponding to the first data set, and the first rule in the first rule set is a single variable rule; the tree model method can also be selected to process the first data set, so as to obtain the first rule set corresponding to the first data set, and the first rule in the first rule set includes a single variable rule and a multivariate rule; of course, the data binning method and the tree model method can also be selected, and the single variable rule set is obtained by the data binning method, and the multivariate rule set is obtained by the tree model method, and the first rule set corresponding to the first data set can be obtained by fusing the single variable rule set and the multivariate rule set. In this embodiment, it is preferred to process the first data set by the tree model method to obtain the first rule set including single variable rules and multivariate rules.
[0054] Among them, the first data set can be randomly divided to obtain a training set, a test set and a validation set; the first data set can also be divided according to the timeline to obtain a training set, a test set and a validation set. The first data in the first data set also includes a time node, which is a backtracking time node of the user's behavioral feature data, and the timeline is divided according to the backtracking time node; of course, random division and timeline division can be combined while ensuring that the amount of data of the first data is large enough. The specific division method of the training set, the test set and the validation set in the first data set can be selected according to actual needs, and this is not limited in this embodiment. The training set is trained using a tree model to obtain a corresponding rule set, and the obtained rule set is optimized according to the test set and the validation set to obtain the first rule set corresponding to the first data set.
[0055] S102: For each first rule in the first rule set, determine a first indicator value of a first indicator corresponding to the first rule according to the first data set, and obtain a first indicator value set corresponding to the first rule set.
[0056] The first indicator may include the number of users in the hit user group, the number of good users in the hit user group, and the number of bad users in the hit user group. The first indicator value of the first indicator may be determined in the following manner, as follows:
[0057] Determine a rule hit result of the first rule according to the first data set;
[0058] According to the rule hit result, a first indicator value of the first indicator corresponding to the first rule is determined.
[0059] In this embodiment, the rule hit result is the number of first data in the first data set that meets the first rule, and the number of first data is the number of hit user groups; the number of hit user groups can be obtained according to the rule hit result. According to the rule hit result and the corresponding relationship between the first data and the identification value, the number of good users in the hit user group and the number of bad users in the hit user group can be determined.
[0060] Among them, the first indicator set can be a first indicator value set corresponding to one first indicator, or a first indicator value set corresponding to multiple first indicators. The first indicator can be selected according to actual needs and is not specifically limited in this embodiment.
[0061] In one embodiment, before obtaining the first indicator value set corresponding to the first rule set, the method further includes:
[0062] A deduplication operation is performed on each first rule in the first rule set to obtain a deduplicated first rule set.
[0063] After obtaining the first rule set after deduplication, for each first rule in the first rule set after deduplication, determine the first indicator value of the first indicator corresponding to the first rule according to the first data set to obtain the first indicator value set corresponding to the first rule set after deduplication.
[0064] In this embodiment, before determining the indicator value set, a deduplication operation is performed on the first rule set to remove inapplicable first rules in the first rule set, and the amount of calculation of subsequent indicator values can be reduced, thereby improving the efficiency of determining the target rule.
[0065] In one embodiment, before obtaining the first indicator value set corresponding to the first rule set, the method further includes:
[0066] Determine the third indicator value corresponding to each first rule according to the rule hit result;
[0067] According to preset business requirements, at least one first rule whose third indicator value is less than a preset threshold is deleted from the first rule set to obtain a deleted first rule set;
[0068] A first indicator value set is determined according to the deleted first rule set.
[0069] Among them, the preset business requirements are consistent with the above, and this embodiment will not be repeated here. The third index value represents the first ratio of the number of good users in the rule-hit user group to the number of users in the hit user group, or the second ratio of the number of bad users in the hit user group to the number of users in the hit user group. Since the tree model method will produce two branches of classification results, namely, good user branches and bad user branches, after the branch results corresponding to good users are parsed into rules, at least half of the people in the hit user group in these rules will be good users. When the preset business requirement is to formulate a rejection rule set, the rules corresponding to good users are not applicable, so the above rules can be deleted to reduce the calculation amount of subsequent index values. In this embodiment, the preset business requirement is to formulate a rejection rule set, the third index value is the second ratio of the number of bad users in the hit user group to the number of users in the hit user group, and the preset threshold is the preset ratio of the number of bad users in the user group to the number of users in the user group. At least one first rule whose second ratio is less than the preset ratio is deleted from the first rule set, thereby obtaining the deleted first rule set.
[0070] After obtaining the deleted first rule set, for each first rule in the deleted first rule set, determine the first indicator value of the first indicator corresponding to the first rule according to the first data set to obtain the first indicator value set corresponding to the deleted first rule set.
[0071] In one embodiment, after performing a deduplication operation on each first rule in the first rule set to obtain the deduplicated first rule set, at least one first rule whose third indicator value is less than a preset threshold is deleted from the deduplicated first rule set to obtain the deleted first rule set, and for each first rule in the deleted first rule set, the first indicator value of the first indicator corresponding to the first rule is determined based on the first data set to obtain the first indicator value set corresponding to the first rule set.
[0072] S103: Determine a target indicator value and a target rule corresponding to the target indicator value according to the first indicator value set.
[0073] In this embodiment, step S103 specifically includes:
[0074] Determine a preset indicator value set corresponding to a preset threshold range from the first indicator set, wherein the preset indicator value set includes at least one preset indicator value;
[0075] Determine a target indicator value from a set of preset indicator values.
[0076] Among them, one indicator can be selected as the first indicator from the number of hit user groups, the number of good users in the hit user groups, and the number of bad users in the hit user groups according to actual needs, and the preset threshold range corresponds to the first indicator. After obtaining the preset indicator value set, the preset indicator value set can be displayed on the display interface so that the business personnel can select the target indicator value from the preset indicator value set.
[0077] In this embodiment, the target indicator value can also be selected according to the following method, which is as follows:
[0078] For each first rule in the first rule set, determine a second indicator value of a second indicator corresponding to the first rule according to the first data set, and obtain a second indicator value set corresponding to the first rule set;
[0079] For each preset indicator value in the preset indicator value set, determine a second indicator value corresponding to the preset indicator value, and obtain multiple second indicator values corresponding to the preset indicator value set;
[0080] Sorting the multiple second indicator values to obtain a sorting result;
[0081] Determine the target indicator value based on the sorting results.
[0082] Among them, the determination method of the second indicator value is consistent with the determination method of the first indicator value, and this embodiment will not be repeated here. The second indicator includes the risk multiple of the hit user group and the coverage rate of the hit user group. The third ratio is determined according to the number of bad users (or the number of good users) in the user group and the number of user groups, the fourth ratio is determined according to the number of bad users (or the number of good users) in the hit user group and the number of hit user groups, and the hit risk multiple is determined according to the multiple relationship between the third ratio and the fourth ratio. The fifth ratio is determined according to the number of hit user groups and the number of user groups, and the fifth ratio is the coverage rate of the hit user group. According to actual needs, one indicator can be selected from the hit risk multiple and the hit user group coverage rate as the second indicator. After obtaining multiple second indicator values corresponding to the preset indicator value set, the multiple second indicator values can be sorted according to the relationship from large to small, and the second indicator value located in the first place is used as the target indicator value. According to the target indicator value, the target rule corresponding to the target indicator value is determined. Of course, the sorting result can be displayed on the display interface so that the user can select a rule from the sorting result as the target rule according to the sorting result.
[0083] S104: Deleting the target rule from the first rule set to obtain a second rule set, and deleting the first data corresponding to the target rule from the first data set to obtain a second data set.
[0084] Among them, after steps S101 to S103, a round of target rule selection is completed. When a target rule is selected, in order to ensure the accuracy of subsequent target rule selection, the selected target rule needs to be removed from the first rule set, and the first data hit by the target rule is deleted from the first data set to obtain the second data set.
[0085] S105: Using the second rule set as the first rule set and the second data set as the first data set, repeatedly executing the step of determining the target rule using the first indicator value set to obtain a plurality of target rules that meet the first preset condition.
[0086] Among them, the second rule set is used as the first rule set, and the second data set is used as the first data set, and steps S102 and S103 are repeatedly executed to complete multiple rounds of target rule selection. It should be noted that when determining the preset indicator value set from the first indicator set according to the preset threshold range in each round, the preset threshold range of each round can be set according to actual needs, and this embodiment does not make specific limitations here. If the first rule set after deletion is obtained, the second rule set is used as the first rule set after deletion, and the second data set is used as the first data set, so as to repeat the step of determining the target rules using the first indicator value set to obtain multiple target rules that meet the first preset condition.
[0087] In this embodiment, the multiple target rules satisfying the first preset condition are obtained, including:
[0088] In the process of repeatedly executing the determination of the target rule using the first indicator value set, when the preset indicator value set is empty, the repeated determination of the target rule is terminated to obtain multiple target rules.
[0089] A data processing method provided in this embodiment includes obtaining a first data set and a first rule set corresponding to the first data set; for each first rule in the first rule set, determining the first indicator value of the first indicator corresponding to the first rule according to the first data set, and obtaining the first indicator value set corresponding to the first rule set; determining the target indicator value according to the first indicator value set, and the target rule corresponding to the target indicator value; deleting the target rule from the first rule set to obtain the second rule set, and deleting the first data corresponding to the target rule from the first data set to obtain the second data set; using the second rule set as the first rule set and the second data set as the first data set, repeatedly executing the step of determining the target rule using the first indicator value set, so as to obtain multiple target rules that meet the first preset condition. In the above manner, the present invention determines the indicator value of the first rule set, and implements the screening of inapplicable rules in the rule set according to the indicator value, thereby ensuring the quality of the rules in the generated rule set, and providing better protection for enterprises to carry out risk prevention and control.
[0090] The following is an example of a data processing process. Figure 2 , as follows:
[0091] The original data set corresponding to the user group is obtained, and each original data in the original data set includes risk performance data, characteristic parameters, and characteristic parameter values corresponding to the characteristic parameters. When the preset business requirement is to formulate a passing rule set, the users are marked according to the preset business requirement and the preset risk indicator threshold, where good users are marked as 1 and bad users are marked as 0, thereby obtaining the first data of each user, and then obtaining the first data set corresponding to the user group. The first data set is divided according to the timeline to obtain a training set, a test set, and a validation set, and the first rule set corresponding to the first data set is obtained according to the tree model algorithm, the training set, the test set, and the validation set. Perform a deduplication operation on the first rule set to obtain a first rule set after deduplication, and delete the first rule whose third indicator value is less than the preset ratio from the first rule set after deduplication to obtain the deleted first rule set. According to the first rule set after deletion, determine the first indicator value set of the first indicator and the second indicator value set of the second indicator, determine the preset indicator set corresponding to the preset range from the first indicator value set, determine multiple second indicator sets corresponding to the preset indicator set, sort the multiple second indicator sets to obtain the sorting result, determine the target indicator value according to the sorting result, and determine the target rule corresponding to the target indicator value, obtain the second rule set after deleting the target rule from the first rule set after deletion, delete the first data corresponding to the target rule from the first data set to obtain the second data set, use the second rule set as the first rule set after deletion, use the second data set as the first data set, repeat the step of determining the target rule using the first indicator value set, and when the preset indicator value set is empty, terminate the repeated determination of the target rule to obtain multiple target rules.
[0092] refer to Figure 3 , Figure 3A structural diagram of a data processing device provided by an embodiment of the present invention. A data processing device provided by this embodiment includes an acquisition module 10, a first determination module 20, a second determination module 30, a deletion module 40 and a third determination module 50, wherein the acquisition module 10 is used to acquire a first data set and a first rule set corresponding to the first data set; the first determination module 20 is used to determine the first indicator value of the first indicator corresponding to the first rule according to the first data set for each first rule in the first rule set, and obtain the first indicator value set corresponding to the first rule set; the second determination module 30 is used to determine the target indicator value and the target rule corresponding to the target indicator value according to the first indicator value set; the deletion module 40 is used to delete the target rule from the first rule set to obtain the second rule set, and delete the first data corresponding to the target rule from the first data set to obtain the second data set; the third determination module 50 is used to use the second rule set as the first rule set and the second data set as the first data set, and repeatedly call the first determination module 20 and the second determination module 30 to obtain multiple target rules that meet the first preset condition.
[0093] In this embodiment, the second determination module 30 is further used to determine a preset indicator value set corresponding to a preset threshold range from the first indicator set, the preset indicator value set including at least one preset indicator value; and determine a target indicator value from the preset indicator value set.
[0094] In this embodiment, the second determination module 30 is also used to determine, for each first rule in the first rule set, the second indicator value of the second indicator corresponding to the first rule according to the first data set, to obtain a second indicator value set corresponding to the first rule set; for each preset indicator value in the preset indicator value set, determine the second indicator value corresponding to the preset indicator value, to obtain multiple second indicator values corresponding to the preset indicator value set; sort the multiple second indicator values to obtain a sorting result; and determine the target indicator value based on the sorting result.
[0095] In this embodiment, the third determination module 50 is further configured to terminate the repeated determination of the target rule when the preset indicator value set is empty during the process of repeatedly performing the determination of the target rule using the first indicator value set, thereby obtaining multiple target rules.
[0096] In this embodiment, the first determination module 20 is used to determine a rule hit result of the first rule according to the first data set; and determine a first indicator value of the first indicator corresponding to the first rule according to the rule hit result.
[0097] In this embodiment, the first determination module 20 is also used to determine the third indicator value corresponding to each first rule according to the rule hit result; according to the preset business requirements, delete at least one first rule whose third indicator value is less than the preset threshold from the first rule set to obtain the deleted first rule set; determine the first indicator value set based on the deleted first rule set.
[0098] In this embodiment, the deletion module 40 is also used to perform a deduplication operation on each first rule in the first rule set to obtain a deduplicated first rule set; delete at least one first rule whose third indicator value is less than a preset threshold from the deduplicated first rule set to obtain a deleted first rule set.
[0099] A data processing device provided in this embodiment determines the indicator value of the first rule set, and screens out inapplicable rules in the rule set according to the indicator value, thereby ensuring the quality of the rules in the generated rule set and providing better protection for enterprises to carry out risk prevention and control.
[0100] Figure 4 A schematic diagram of the structure of an electronic device provided by an embodiment of the present invention, Figure 4 The electronic device 400 shown includes: at least one processor 401, a memory 402, at least one network interface 404 and other user interfaces 403. The various components in the electronic device 400 are coupled together via a bus system 405. It is understood that the bus system 405 is used to achieve connection and communication between these components. In addition to the data bus, the bus system 405 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, the bus system 405 is not shown in FIG. Figure 4 Various buses are labeled as bus system 405 .
[0101] The user interface 403 may include a display, a keyboard, or a pointing device (eg, a mouse, a trackball, a touch pad, or a touch screen).
[0102] It can be understood that the memory 402 in the embodiment of the present invention can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct RAM bus random access memory (DRRAM). The memory 402 described herein is intended to include, but is not limited to, these and any other suitable types of memory.
[0103] In some implementations, the memory 402 stores the following elements, executable units or data structures, or a subset thereof, or an extended set thereof: an operating system 4021 and application programs 4022 .
[0104] The operating system 4021 includes various system programs, such as a framework layer, a core library layer, a driver layer, etc., which are used to implement various basic services and process hardware-based tasks. The application 4022 includes various application programs, such as a media player (Media Player), a browser (Browser), etc., which are used to implement various application services. The program for implementing the method of the embodiment of the present invention can be included in the application 4022.
[0105] In an embodiment of the present invention, by calling a program or instruction stored in the memory 402, specifically, a program or instruction stored in the application 4022, the processor 401 is used to execute the method steps provided by each method embodiment, for example, including: obtaining a first data set and a first rule set corresponding to the first data set; for each first rule in the first rule set, determining a first indicator value of a first indicator corresponding to the first rule according to the first data set, and obtaining a first indicator value set corresponding to the first rule set; determining a target indicator value according to the first indicator value set, and a target rule corresponding to the target indicator value; deleting the target rule from the first rule set to obtain a second rule set, and deleting the first data corresponding to the target rule from the first data set to obtain a second data set; using the second rule set as the first rule set and the second data set as the first data set, repeatedly executing the step of determining the target rule using the first indicator value set to obtain multiple target rules that meet the first preset condition.
[0106] The method disclosed in the above embodiment of the present invention can be applied to the processor 401, or implemented by the processor 401. The processor 401 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the hardware integrated logic circuit in the processor 401 or the instruction in the form of software. The above processor 401 can be a general processor, a digital signal processor (Digital Signal Processor, DSP), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), a field programmable gate array (Field Programmable Gate Array, FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps and logic block diagrams disclosed in the embodiments of the present invention can be implemented or executed. The general processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in the embodiment of the present invention can be directly embodied as a hardware decoding processor to execute, or the hardware and software units in the decoding processor can be executed. The software unit can be located in a mature storage medium in the field such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory 402, and the processor 401 reads the information in the memory 402 and completes the steps of the above method in combination with its hardware.
[0107] It is understood that the embodiments described herein may be implemented in hardware, software, firmware, middleware, microcode, or a combination thereof. For hardware implementation, the processing unit may be implemented in one or more application specific integrated circuits (ASIC), digital signal processors (DSP), digital signal processing devices (DSPDevice, DSPD), programmable logic devices (PLD), field programmable gate arrays (FPGA), general purpose processors, controllers, microcontrollers, microprocessors, other electronic units for performing the functions described in the present application, or a combination thereof.
[0108] For software implementation, the technology described herein can be implemented by a unit that performs the functions described herein. The software code can be stored in a memory and executed by a processor. The memory can be implemented in the processor or outside the processor.
[0109] The electronic device provided in this embodiment may be Figure 4 The electronic device shown in FIG. 1 may perform the following steps: Figure 1-2 All steps of the data processing method in Figure 1-2 For details on the technical effects of the data processing method shown, please refer to Figure 1-2 For the sake of brevity, the relevant description is not repeated here.
[0110] The embodiment of the present invention also provides a storage medium (computer-readable storage medium). The storage medium here stores one or more programs. The storage medium may include a volatile memory, such as a random access memory; the memory may also include a non-volatile memory, such as a read-only memory, a flash memory, a hard disk or a solid-state drive; the memory may also include a combination of the above-mentioned types of memory.
[0111] When one or more programs in the storage medium can be executed by one or more processors, the data processing method executed on the data processing device side can be implemented.
[0112] The processor is used to execute the data processing program stored in the memory to implement the following steps of the data processing method performed on the data processing device side: obtaining a first data set and a first rule set corresponding to the first data set; for each first rule in the first rule set, determining a first indicator value of a first indicator corresponding to the first rule according to the first data set, and obtaining a first indicator value set corresponding to the first rule set; determining a target indicator value and a target rule corresponding to the target indicator value according to the first indicator value set; deleting the target rule from the first rule set to obtain a second rule set, and deleting the first data corresponding to the target rule from the first data set to obtain a second data set; using the second rule set as the first rule set and the second data set as the first data set, repeatedly executing the step of determining the target rule using the first indicator value set to obtain multiple target rules that meet the first preset condition.
[0113] The professionals should further realize that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in the above description according to the function. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.
[0114] The steps of the method or algorithm described in conjunction with the embodiments disclosed herein may be implemented using hardware, a software module executed by a processor, or a combination of the two. The software module may be placed in a random access memory (RAM), a memory, a read-only memory (ROM), an electrically programmable ROM, an electrically erasable programmable ROM, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
[0115] The specific implementation methods described above further illustrate the objectives, technical solutions and beneficial effects of the present invention in detail. It should be understood that the above description is only a specific implementation method of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.
Claims
1. A data processing method, characterized in that: include: Obtain a first data set and a first rule set corresponding to the first data set, the first rule set being obtained by processing the first data set through a preset algorithm, the first data set corresponding to a user group, the first data set being obtained by processing an original data group corresponding to the user group, each user corresponding to a first data, the first data including a characteristic parameter, a characteristic parameter value, an identification value and the risk performance data of the user, the characteristic parameter being a behavioral characteristic of the user, the characteristic parameter value corresponding to the characteristic parameter, the characteristic parameter value being data corresponding to the behavioral characteristic of the user, the risk performance data being derived from statistics of the user's own loan behavior, the identification value corresponding to the risk performance data of the user, and the identification value being obtained by marking the risk performance data of the user according to a preset marking method; For each first rule in the first rule set, determine a first indicator value of a first indicator corresponding to the first rule according to the first data set, and obtain a first indicator value set corresponding to the first rule set, wherein the first indicator includes the number of hit user groups, the number of good users in the hit user groups, and the number of bad users in the hit user groups; Determining a target indicator value and a target rule corresponding to the target indicator value according to the first indicator value set, wherein determining the target indicator value according to the first indicator value set comprises: determining a preset indicator value set corresponding to a preset threshold range from the first indicator value set, wherein the preset indicator value set comprises at least one preset indicator value; and determining the target indicator value from the preset indicator value set; Deleting the target rule from the first rule set to obtain a second rule set, and deleting the first data corresponding to the target rule from the first data set to obtain a second data set; The second rule set is used as the first rule set, and the second data set is used as the first data set. The step of determining the target rule using the first indicator value set is repeated to obtain a plurality of the target rules that meet the first preset condition.
2. The method according to claim 1, characterized in that: The method further comprises: For each first rule in the first rule set, determine a second indicator value of a second indicator corresponding to the first rule according to the first data set, and obtain a second indicator value set corresponding to the first rule set, wherein the second indicator includes a risk multiple of a hit user group and a coverage rate of a hit user group; For each preset indicator value in the preset indicator value set, determine a second indicator value corresponding to the preset indicator value, and obtain a plurality of second indicator values corresponding to the preset indicator value set; Sorting the multiple second indicator values to obtain a sorting result; According to the sorting result, a target indicator value is determined.
3. The method according to claim 1, characterized in that The obtaining of the plurality of target rules that meet the first preset condition includes: In the process of repeatedly performing the determination of the target rule using the first indicator value set, when the preset indicator value set is empty, the repeated determination of the target rule is terminated to obtain a plurality of the target rules.
4. The method according to claim 1, characterized in that: The determining, according to the first data set, a first indicator value of a first indicator corresponding to the first rule includes: Determine a rule hit result of the first rule according to the first data set; According to the rule hit result, a first indicator value of the first indicator corresponding to the first rule is determined.
5. The method according to claim 4, characterized in that The method further comprises: According to the rule hit result, determine a third index value corresponding to each of the first rules, the third index value including a first ratio of the number of good users in the hit user group to the number of users in the hit user group and a second ratio of the number of bad users in the hit user group to the number of users in the hit user group; According to preset business requirements, at least one first rule whose third indicator value is less than a preset threshold is deleted from the first rule set to obtain the first rule set after deletion; The first indicator value set is determined according to the deleted first rule set.
6. The method according to claim 5, characterized in that The method further comprises: Performing a deduplication operation on each of the first rules in the first rule set to obtain a deduplicated first rule set; At least one of the first rules whose third indicator value is less than a preset threshold is deleted from the first rule set after deduplication to obtain the first rule set after deletion.
7. A data processing device, characterized in that: include: an acquisition module, for acquiring a first data set and a first rule set corresponding to the first data set, wherein the first rule set is acquired by processing the first data set through a preset algorithm, the first data set corresponds to a user group, the first data set is obtained by processing an original data group corresponding to the user group, each user corresponds to a first data, the first data includes a characteristic parameter, a characteristic parameter value, an identification value and the risk performance data of the user, the characteristic parameter is a behavioral characteristic of the user, the characteristic parameter value corresponds to the characteristic parameter, the characteristic parameter value is data corresponding to the behavioral characteristic of the user, the risk performance data comes from statistics of the user's own loan behavior, the identification value corresponds to the risk performance data of the user, and the identification value can be obtained by marking the risk performance data of the user according to a preset marking method; A first determination module is used to determine, for each first rule in the first rule set, a first indicator value of a first indicator corresponding to the first rule according to the first data set, to obtain a first indicator value set corresponding to the first rule set, wherein the first indicator includes the number of hit user groups, the number of good users in the hit user groups, and the number of bad users in the hit user groups; A second determination module, configured to determine a target indicator value and a target rule corresponding to the target indicator value according to the first indicator value set; The second determination module is further configured to determine a preset indicator value set corresponding to a preset threshold range from the first indicator value set, wherein the preset indicator value set includes at least one preset indicator value; and determine a target indicator value from the preset indicator value set; a deleting module, configured to delete the target rule from the first rule set to obtain a second rule set, and to delete the first data corresponding to the target rule from the first data set to obtain a second data set; The third determination module is further used to use the second rule set as the first rule set and the second data set as the first data set, and repeatedly call the first determination module and the second determination module to obtain multiple target rules that meet the first preset condition.
8. An electronic device, characterized in that: include: A processor and a memory, wherein the processor is used to execute a data processing program stored in the memory to implement the data processing method according to any one of claims 1 to 6.
9. A storage medium, characterized in that: The storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the data processing method described in any one of claims 1 to 6.
