Data processing method, device, electronic device and storage medium

By obtaining the correlation between the data samples to be tested and classifying them, forming an independent subset for testing, the problem of inaccurate test results caused by data sample dependencies in the prior art is solved, and the accuracy of the test results is improved.

CN114398268BActive Publication Date: 2024-11-29BEIJING DAJIA INTERNET INFORMATION TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202111620208.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-12-27
Publication Date
2024-11-29
Estimated Expiration
2041-12-27

AI Technical Summary

Technical Problem

When the prior art determines whether the service strategy meets user needs, it is affected by the complex dependencies between the data samples to be tested, resulting in inaccurate test results.

Method used

By obtaining the correlation between the data samples to be tested, classifying, forming independent subsets, and testing each subset to obtain data test results, ensuring that there is no correlation between the subsets, and improving the accuracy of the test results.

Benefits of technology

The accuracy of data test results tested separately for each subset of data samples to be tested is improved, and the problem of inaccurate data test results in the sample set of data to be tested is avoided.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114398268B_ABST
    Figure CN114398268B_ABST
Patent Text Reader

Abstract

The present disclosure is about a data processing method, device, electronic device and storage medium, the method comprising: obtaining a set of data samples to be tested, wherein the set of data samples to be tested includes multiple data samples to be tested; obtaining the correlation between the data samples to be tested; classifying the data samples to be tested according to the correlation between the data samples to be tested to obtain multiple subsets of data samples to be tested, wherein there is no correlation between the data samples to be tested contained in any two subsets of data samples to be tested; testing the subsets of data samples to be tested to obtain data test results; obtaining the data test results of the set of data samples to be tested according to the data test results of each subset of data samples to be tested. The technical solution provided by the present disclosure can be applied in the testing process.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of communications, and in particular to a data processing method, device, electronic device and storage medium. Background Art

[0002] With the development of Internet technology, users can easily and quickly use applications on mobile phones, computers and other terminal devices to obtain services, such as advertising services, instant messaging services, etc. Each type of service will correspond to different service strategies, such as advertising services have different delivery structures, promotion strategies and subsidy strategies. How to judge whether the service strategy meets user needs has become an urgent problem to be solved.

[0003] In order to solve the above problems, the prior art generally uses a testing method to determine whether the service strategy meets the user's needs based on the test results. Specifically, the testing method may include: obtaining a data sample to be tested; extracting a target test data sample of a certain concentration (such as 10%) from the data sample to be tested; testing the target test sample to obtain the test result of the target test sample; and inferring the test result of the data sample to be tested based on the test result of the target test sample.

[0004] The premise of the above test methods is that the data samples to be tested are parallel and independent of each other. However, in actual applications, there are complex dependencies between the data samples to be tested, which leads to inaccurate test results obtained using existing test methods. Summary of the invention

[0005] In order to overcome the problems existing in the related art, the present disclosure provides a data processing method, device, electronic device and storage medium.

[0006] According to a first aspect of an embodiment of the present disclosure, a data processing method is provided, the method comprising:

[0007] Acquire a set of data samples to be tested, wherein the set of data samples to be tested includes a plurality of data samples to be tested;

[0008] Obtaining the correlation between the data samples to be tested;

[0009] Classifying the data samples to be tested according to the correlation between the data samples to be tested to obtain a plurality of subsets of the data samples to be tested, wherein the data samples to be tested included in any two subsets of the data samples to be tested do not have the correlation;

[0010] Testing the subset of data samples to be tested to obtain data test results;

[0011] The data test result of the set of data samples to be tested is obtained according to the data test result of each subset of the data samples to be tested.

[0012] Optionally, after classifying the data samples to be tested according to the correlation between the data samples to be tested to obtain a plurality of subsets of data samples to be tested, and before testing the subsets of data samples to be tested and obtaining data test results, the method further includes:

[0013] Performing convex optimization processing on all the subsets of data samples to be tested to obtain a test concentration of each subset of data samples to be tested, wherein the test concentrations of any two subsets of data samples to be tested are different, and the weighted sum of the test concentrations of all the subsets of data samples to be tested is less than a preset test concentration threshold;

[0014] The testing of the to-be-tested data sample subset to obtain data test results comprises:

[0015] According to the test concentration of the subset of data samples to be tested, acquiring a target data sample to be tested from the data samples to be tested included in the subset of data samples to be tested;

[0016] The target data sample to be tested is tested to obtain a data test result.

[0017] Optionally, the convex optimization process is performed on all the subsets of the data samples to be tested to obtain the test concentration of each subset of the data samples to be tested, which is obtained by the following formula:

[0018]

[0019]

[0020]

[0021] Wherein, p is the number of the subset of data samples to be tested, and p is an integer greater than 1; i∈[1,p]; θ i is the test concentration of the i-th subset of the data samples to be tested; λ1 is The importance weight coefficient of The importance weight coefficient of w i is θ i The weight of , u is the preset test concentration threshold.

[0022] Optionally, the testing the target to-be-tested data sample and obtaining the data test result includes:

[0023] Performing a first test and a second test on the target data sample to be tested respectively, and obtaining a first test result and a second test result; wherein the first test and the second test are different test versions set for the same test object;

[0024] A data test result is obtained according to the first test result and the second test result.

[0025] Optionally, the data samples to be tested included in the subset of data samples to be tested have the correlation relationship.

[0026] According to a second aspect of an embodiment of the present disclosure, there is provided a data processing device, including:

[0027] The first module is used to obtain a set of data samples to be tested, wherein the set of data samples to be tested includes multiple data samples to be tested;

[0028] The second module is used to obtain the correlation between the data samples to be tested;

[0029] A third module is used to classify the data samples to be tested according to the correlation between the data samples to be tested to obtain multiple subsets of data samples to be tested, wherein the correlation does not exist between the data samples to be tested included in any two subsets of data samples to be tested;

[0030] The fourth module is used to test the subset of data samples to be tested and obtain data test results;

[0031] The fifth module is used to obtain the data test results of the data sample set to be tested according to the data test results of each of the data sample subsets to be tested.

[0032] Optionally, the data processing device further includes:

[0033] A sixth module is used to perform convex optimization processing on all the subsets of data samples to be tested to obtain a test concentration of each subset of data samples to be tested, wherein the test concentrations of any two subsets of data samples to be tested are different, and the weighted sum of the test concentrations of all the subsets of data samples to be tested is less than a preset test concentration threshold;

[0034] The fourth module is specifically used to obtain a target data sample to be tested from the data samples to be tested included in the data sample subset to be tested according to the test concentration of the data sample subset to be tested, test the target data sample to be tested, and obtain a data test result.

[0035] Optionally, the sixth module is specifically used to perform convex optimization processing on all the subsets of data samples to be tested by using the following formula to obtain the test concentration of each subset of data samples to be tested;

[0036]

[0037]

[0038]

[0039] Wherein, p is the number of the subsets of data samples to be tested, and p is an integer greater than 1; i∈[1,p]; θi is the test concentration in the i-th subset of the data samples to be tested; λ1 is The importance weight coefficient of is the importance weight coefficient of θi; wi is the weight of θi, and u is the pre-set test concentration threshold.

[0040] Optionally, the fourth module includes:

[0041] The first submodule is used to perform a first test and a second test on the target data sample to be tested, respectively, to obtain a first test result and a second test result; wherein the first test and the second test are different test versions set for the same test object;

[0042] The second submodule is used to obtain a data test result according to the first test result and the second test result.

[0043] Optionally, the data samples to be tested included in the subset of data samples to be tested have the correlation relationship.

[0044] According to a third aspect of an embodiment of the present disclosure, there is provided an electronic device, including:

[0045] processor;

[0046] a memory for storing instructions executable by the processor;

[0047] The processor is configured to execute the instructions to implement the data processing method as described above.

[0048] According to a fourth aspect of an embodiment of the present disclosure, a computer-readable storage medium is provided. When instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the data processing method as described above.

[0049] According to a fifth aspect of an embodiment of the present disclosure, a computer program product is provided, which includes a computer program or computer instructions, and when the computer program or computer instructions are executed by a processor, the data processing method as described above is implemented.

[0050] The technical solution provided by the embodiments of the present disclosure brings at least the following beneficial effects:

[0051] In the present disclosure, the data test results of the data sample set to be tested are obtained based on the data test results of each subset of the data sample to be tested. Since there is no correlation between the data samples to be tested contained in any two subsets of the data sample to be tested, the data samples to be tested between the subsets of the data sample to be tested are independent of each other, thereby improving the accuracy of the data test results obtained by testing each subset of the data sample to be tested separately, thereby avoiding the problem of inaccurate data test results of the data sample set to be tested caused by complex dependencies between the data samples to be tested in the data sample set to be tested.

[0052] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] The drawings herein are incorporated into and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the description are used to explain the principles of the present disclosure, and do not constitute improper limitations on the present disclosure.

[0054] Figure 1 is one of the flow charts of a data processing method according to an exemplary embodiment;

[0055] Figure 2 yes Figure 1 The schematic diagram of the graphical network in step 12 of a data processing method according to an exemplary embodiment is shown;

[0056] Figure 3 yes Figure 2 Schematic diagram of the adjacency matrix corresponding to the graph network shown;

[0057] Figure 4(a) is Figure 2 One of the schematic diagrams of the sub-graph network obtained after clustering the graph network shown;

[0058] Figure 4(b) is Figure 2 The second schematic diagram of the sub-graph network obtained after clustering the graph network shown;

[0059] Figure 4(c) is Figure 2 The third schematic diagram of the sub-graph network obtained after clustering the graph network shown;

[0060] Figure 4(d) is Figure 2 The fourth schematic diagram of the sub-graph network obtained after clustering the graph network shown;

[0061] Figure 5 is a second flowchart of a data processing method according to an exemplary embodiment;

[0062] Figure 6 is one of the block diagrams of a data processing device according to an exemplary embodiment;

[0063] Figure 7 is a second block diagram of a data processing device according to an exemplary embodiment;

[0064] Figure 8 yes Figure 6 The block diagram of a fourth module 64 in a data processing device according to an exemplary embodiment is shown;

[0065] Fig. 9 It is a block diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION

[0066] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Instead, they are merely examples of devices and methods consistent with some aspects of the present invention as detailed in the appended claims.

[0067] Figure 1 is a flow chart of a data processing method according to an exemplary embodiment. Figure 1 As shown, the following steps are included:

[0068] In step S11, a set of data samples to be tested is obtained, wherein the set of data samples to be tested includes a plurality of data samples to be tested.

[0069] It should be noted that the specific content of the data samples to be tested is different in different application scenarios. For example, in the process of commercial testing, the data samples to be tested may specifically be merchants and customers, etc. This exemplary embodiment does not specifically limit the data samples to be tested. In actual use, the data samples to be tested may be determined according to the specific application scenario and test requirements.

[0070] In step S12, the correlation between the data samples to be tested is obtained.

[0071] In this exemplary embodiment, the correlation between the data samples to be tested is different in different application scenarios. For example: in the process of commercial testing, the data samples to be tested include merchants and customers. At this time, the correlation between the data samples to be tested may include: constraint relationships, competitive relationships, or cooperative relationships, etc. Through continuous testing and summary in different application scenarios, the correlation described in this exemplary embodiment can be an interactive relationship, or it can be that the data samples to be tested share the same set of business models or algorithms, or it can be the constraint relationships, competitive relationships, or cooperative relationships mentioned above, etc. Of course, in the actual use process, other situations can also be included, which will not be described one by one here.

[0072] In order to more clearly show the correlation between the data samples to be tested, in this exemplary embodiment, the following can be constructed: Figure 2 The graphical network shown in FIG. 1 shows the correlation between the data samples to be tested in a graphical manner. Specifically, Figure 2 In the graphical network shown, each point is a data sample to be tested, and each line indicates that there is a correlation between the data samples to be tested at two endpoints. It should be noted that Figure 2 In the graphical network shown, there is no specific limitation on the correlation between the test data samples. The correlation may include the above-mentioned interaction relationship, the test data samples sharing the same business model or algorithm, or constraint relationship, competition relationship or cooperation relationship. Figure 2 All are expressed in the form of lines.

[0073] Furthermore, if the number of test data samples is huge, Figure 2 The graphical network shown is very complex. To solve this problem, in this exemplary embodiment, Figure 2 The graph network shown is transformed into Figure 3 The adjacency matrix shown in the figure can achieve the purpose of more concisely and clearly displaying the correlation between the data samples to be tested.

[0074] In step S13, the data samples to be tested are classified according to the correlation between the data samples to be tested to obtain a plurality of subsets of the data samples to be tested, wherein there is no correlation between the data samples to be tested included in any two subsets of the data samples to be tested.

[0075] The data samples to be tested included in each subset of data samples to be tested may have a correlation relationship. In this exemplary embodiment and the following embodiments, the example that there is no correlation relationship between the data samples to be tested included in any two subsets of data samples to be tested, and at the same time, the data samples to be tested included in each subset of data samples to be tested have a correlation relationship is used for description.

[0076] In order to enable those skilled in the art to more clearly understand the specific implementation method of step S13, this exemplary embodiment combines Figure 2 and Figure 3 The contents shown here will be used to explain step S13.

[0077] First, S13 Figure 3 The adjacency matrix is ​​clustered to obtain four independent sub-adjacency matrices.

[0078] Then, S13 restores the four independent sub-adjacency matrices into Figure 4(a)-Figure 4(d) The subgraph network shown.

[0079] Finally, get Figure 4(a)-Figure 4(d) The data samples to be tested corresponding to each point in the sub-graph network in the graph are used to generate the corresponding subset of data samples to be tested. For example, FIG4(b) includes 5 points, each of which corresponds to a data sample to be tested. The data samples to be tested corresponding to the above 5 points form the subset of data samples to be tested in FIG4(b).

[0080] In this exemplary embodiment, the correlation between the data samples to be tested may include multiple situations. In order to obtain more accurate test results, step S13 can determine the correlation required for the actual test from the correlation obtained in step S12 based on conditions such as application scenarios and test requirements, and then classify the data samples to be tested based on the correlation required for the actual test to obtain multiple subsets of data samples to be tested.

[0081] In this exemplary embodiment, step S13 can determine the correlation required for the actual test from the correlation obtained in step S12 by manual screening. Step S13 can also determine the correlation required for the actual test by inputting screening conditions and having the system perform dimensionality reduction processing on the correlation obtained in step S12 according to the screening conditions. Of course, in actual use, step S13 can also determine the correlation required for the actual test from the correlation obtained in step S12 by other methods, and each case will not be described one by one here.

[0082] By determining the step of actually testing the required correlation, the part of the correlation obtained in step S12 that is useless for the test can be removed, thereby achieving the purpose of improving the accuracy of the test result.

[0083] In step S14, the subset of data samples to be tested is tested to obtain data test results.

[0084] This exemplary embodiment does not limit the specific test method. In actual use, step S14 can select a suitable test method according to different application scenarios and test requirements.

[0085] In step S15, the data test results of the set of data samples to be tested are obtained according to the data test results of each subset of the data samples to be tested.

[0086] In this exemplary embodiment, step S15 may use a preset machine learning model to infer the data test results of the entire set of data samples to be tested based on the data test results of each subset of the data samples to be tested.

[0087] In the present disclosure, the data test results of the data sample set to be tested are obtained based on the data test results of each subset of the data sample to be tested. Since there is no correlation between the data samples to be tested contained in any two subsets of the data sample to be tested, the data samples to be tested between the subsets of the data sample to be tested are independent of each other, thereby improving the accuracy of the data test results obtained by testing each subset of the data sample to be tested separately, thereby avoiding the problem of inaccurate data test results of the data sample set to be tested caused by complex dependencies between the data samples to be tested in the data sample set to be tested.

[0088] Figure 5 is a flow chart of a data processing method according to an exemplary embodiment. Figure 5 As shown, the following steps are included:

[0089] In step S51, a set of data samples to be tested is obtained, wherein the set of data samples to be tested includes a plurality of data samples to be tested.

[0090] It should be noted that the specific content of the data samples to be tested is different in different application scenarios. For example, in the process of commercial testing, the data samples to be tested may specifically be merchants and customers, etc. This exemplary embodiment does not specifically limit the data samples to be tested. In actual use, the data samples to be tested may be determined according to the specific application scenario and test requirements.

[0091] In step S52, the correlation between the data samples to be tested is obtained.

[0092] In this exemplary embodiment, the correlation between the data samples to be tested is different in different application scenarios. For example: in the process of commercial testing, the data samples to be tested include merchants and customers. At this time, the correlation between the data samples to be tested may include: constraint relationships, competitive relationships, or cooperative relationships, etc. Through continuous testing and summary in different application scenarios, the correlation described in this exemplary embodiment can be an interactive relationship, or it can be that the data samples to be tested share the same set of business models or algorithms, or it can be the constraint relationships, competitive relationships, or cooperative relationships mentioned above, etc. Of course, in the actual use process, other situations can also be included, which will not be described one by one here.

[0093] In order to more clearly show the correlation between the data samples to be tested, in this exemplary embodiment, the following can be constructed: Figure 2 The graphical network shown in FIG. 1 shows the correlation between the data samples to be tested in a graphical manner. Specifically, Figure 2 In the graphical network shown, each point is a data sample to be tested, and each line indicates that there is a correlation between the data samples to be tested at two endpoints. It should be noted that Figure 2 In the graphical network shown, there is no specific limitation on the correlation between the test data samples. The correlation may include the above-mentioned interaction relationship, the test data samples sharing the same business model or algorithm, or constraint relationship, competition relationship or cooperation relationship. Figure 2 All are expressed in the form of lines.

[0094] Furthermore, if the number of test data samples is huge, Figure 2 The graphical network shown is very complex. To solve this problem, in this exemplary embodiment, Figure 2 The graph network shown is transformed into Figure 3 The adjacency matrix shown in the figure can achieve the purpose of more concisely and clearly displaying the correlation between the data samples to be tested.

[0095] In step S53, the data samples to be tested are classified according to the correlation between the data samples to be tested to obtain a plurality of subsets of the data samples to be tested, wherein there is no correlation between the data samples to be tested included in any two subsets of the data samples to be tested.

[0096] The data samples to be tested included in each subset of data samples to be tested may have a correlation relationship. In this exemplary embodiment and the following embodiments, the example that there is no correlation relationship between the data samples to be tested included in any two subsets of data samples to be tested, and at the same time, the data samples to be tested included in each subset of data samples to be tested have a correlation relationship is used for description.

[0097] In order to enable those skilled in the art to more clearly understand the specific implementation method of step S53, this exemplary embodiment combines Figure 2 and Figure 3 The contents shown here will explain step S53.

[0098] First, S53 Figure 3 The adjacency matrix is ​​clustered to obtain four independent sub-adjacency matrices.

[0099] Then, S53 restores the four independent sub-adjacency matrices into Figure 4(a)-Figure 4(d) The subgraph network shown.

[0100] Finally, get Figure 4(a)-Figure 4(d) The data samples to be tested corresponding to each point in the sub-graph network in the graph are used to generate the corresponding subset of data samples to be tested. For example, FIG4(b) includes 5 points, each of which corresponds to a data sample to be tested. The data samples to be tested corresponding to the above 5 points form the subset of data samples to be tested in FIG4(b).

[0101] In this exemplary embodiment, the correlation between the data samples to be tested may include multiple situations. In order to obtain more accurate test results, step S53 can determine the correlation required for the actual test from the correlation obtained in step S52 based on conditions such as application scenarios and test requirements, and then classify the data samples to be tested based on the correlation required for the actual test to obtain multiple subsets of data samples to be tested.

[0102] In this exemplary embodiment, step S53 can determine the correlation required for the actual test from the correlation obtained in step S52 by manual screening. Step S53 can also determine the correlation required for the actual test by inputting screening conditions and having the system perform dimensionality reduction processing on the correlation obtained in step S52 according to the screening conditions. Of course, in actual use, step S13 can also determine the correlation required for the actual test from the correlation obtained in step S52 by other methods, and each case will not be described one by one here.

[0103] By determining the correlation required for the actual test, the part of the correlation obtained in step S52 that is useless for the test can be removed, thereby achieving the purpose of improving the accuracy of the test result.

[0104] In step S54, convex optimization processing is performed on all subsets of data samples to be tested to obtain the test concentration of each subset of data samples to be tested, wherein the test concentrations of any two subsets of data samples to be tested are different, and the weighted sum of the test concentrations of all subsets of data samples to be tested is less than a preset test concentration threshold.

[0105] In this exemplary embodiment, step S54 performs convex optimization processing on all subsets of data samples to be tested to obtain the test concentration of each subset of data samples to be tested, which can be specifically completed by the following formula (1):

[0106]

[0107]

[0108]

[0109] Wherein, p is the number of the subset of data samples to be tested, and p is an integer greater than 1; i∈[1,p]; θ i is the test concentration of the i-th subset of the data samples to be tested; λ1 is The importance weight coefficient of The importance weight coefficient of w i is θ i The weight of , u is the preset test concentration threshold.

[0110] By determining the test concentration of each subset of the data samples to be tested through convex optimization processing, the complexity of testing the data sample set to be tested can be reduced, the test cost can be reduced, the accuracy of the test results can be improved, and the data processing efficiency can be improved.

[0111] In step S55, according to the test concentration of the subset of data samples to be tested, a target data sample to be tested is obtained from the data samples to be tested included in the subset of data samples to be tested.

[0112] In this exemplary embodiment, step S55 can obtain the target data samples to be tested from the data samples to be tested included in the data sample subset to be tested by any method according to the test concentration of the data sample subset to be tested obtained in step S54. For example, assuming that the test concentration of the data sample subset to be tested is 10%, step S55 can extract the first 10% of the data samples to be tested from the data sample subset to be tested in order as the target data samples to be tested. Each case will not be described one by one here.

[0113] In step S56, the target data sample to be tested is tested to obtain data test results of the subset of the data sample to be tested.

[0114] Specifically, the first test and the second test can be performed on the target data sample to be tested respectively to obtain the first test result and the second test result; wherein the first test and the second test are different test versions set for the same test object; and the data test result is obtained based on the first test result and the second test result.

[0115] In step S57, the data test results of the data sample set to be tested are obtained according to the data test results of each of the data sample subsets to be tested.

[0116] In this exemplary embodiment, step S57 may use a preset machine learning model to infer the data test results of the entire set of data samples to be tested based on the data test results of each subset of the data samples to be tested.

[0117] The technical solution provided by this exemplary embodiment achieves Figure 1 On the basis of the beneficial effects brought by the technical solution provided by the exemplary embodiment shown, a test concentration is set for each subset of data samples to be tested, and the weighted sum of the test concentrations of all subsets of data samples to be tested is less than the preset test concentration threshold, so that the technical solution provided by this exemplary embodiment can balance the commercial risk issues on the basis of accurate testing, so that the test process meets the needs of commercial applications. In addition, since the test concentrations of each subset of data samples to be tested obtained in accordance with the convex optimization processing method are different from each other, the overall test result of the final set of samples to be tested is unbiased and will not be overestimated due to the influence of the spillover effect.

[0118] Figure 6 is a block diagram of a data processing device according to an exemplary embodiment. Figure 6 , the data processing device may include:

[0119] The first module 61 is used to obtain a set of data samples to be tested, wherein the set of data samples to be tested includes a plurality of data samples to be tested;

[0120] The second module 62 is used to obtain the correlation between the data samples to be tested;

[0121] A third module 63 is used to classify the data samples to be tested according to the correlation between the data samples to be tested to obtain multiple subsets of data samples to be tested, wherein the correlation does not exist between the data samples to be tested included in any two subsets of data samples to be tested;

[0122] The fourth module 64 is used to test the subset of data samples to be tested and obtain data test results;

[0123] The fifth module 65 is used to obtain the data test results of the data sample set to be tested according to the data test results of each of the data sample subsets to be tested.

[0124] Optional, such as Figure 7 As shown, the data processing device may further include:

[0125] The sixth module 66 is used to perform convex optimization processing on all the subsets of data samples to be tested to obtain the test concentration of each subset of data samples to be tested, wherein the test concentrations of any two subsets of data samples to be tested are different, and the weighted sum of the test concentrations of all the subsets of data samples to be tested is less than a preset test concentration threshold;

[0126] The fourth module 64 is specifically configured to obtain a target data sample to be tested from the data samples to be tested included in the data sample subset to be tested according to the test concentration of the data sample subset to be tested, test the target data sample to be tested, and obtain a data test result.

[0127] Optionally, the sixth module 66 is specifically used to perform convex optimization processing on all the subsets of data samples to be tested by using the following formula to obtain the test concentration of each subset of data samples to be tested;

[0128]

[0129]

[0130]

[0131] Wherein, p is the number of the subsets of data samples to be tested, and p is an integer greater than 1; i∈[1,p]; θi is the test concentration in the i-th subset of the data samples to be tested; λ1 is The importance weight coefficient of is the importance weight coefficient of θi; wi is the weight of θi, and u is the pre-set test concentration threshold.

[0132] Optional, such as Figure 8 As shown, the fourth module 64 includes:

[0133] The first submodule 641 is used to perform a first test and a second test on the target data sample to be tested, respectively, to obtain a first test result and a second test result; wherein the first test and the second test are different test versions set for the same test object;

[0134] The second submodule 642 is used to obtain a data test result according to the first test result and the second test result.

[0135] Optional, above Figure 6-8 In the provided data processing device, the data samples to be tested included in the subset of data samples to be tested have the correlation relationship.

[0136] In the present disclosure, the data test results of the data sample set to be tested are obtained based on the data test results of each subset of the data sample to be tested. Since there is no correlation between the data samples to be tested contained in any two subsets of the data sample to be tested, the data samples to be tested between the subsets of the data sample to be tested are independent of each other, thereby improving the accuracy of the data test results obtained by testing each subset of the data sample to be tested separately, thereby avoiding the problem of inaccurate data test results of the data sample set to be tested caused by complex dependencies between the data samples to be tested in the data sample set to be tested.

[0137] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0138] Fig. 9 900 is a block diagram of an electronic device according to an exemplary embodiment. For example, the electronic device 900 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0139] Reference Fig. 9 , the electronic device 900 may include one or more of the following components: a processing component 902 , a memory 904 , a power component 906 , a multimedia component 908 , an audio component 910 , an input / output (I / O) interface 912 , a sensor component 914 , and a communication component 916 .

[0140] The processing component 902 generally controls the overall operation of the electronic device 900, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 902 may include one or more processors 920 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 902 may include one or more modules to facilitate the interaction between the processing component 902 and other components. For example, the processing component 902 may include a multimedia module to facilitate the interaction between the multimedia component 908 and the processing component 902.

[0141] The memory 904 is configured to store various types of data to support operations on the electronic device 900. Examples of such data include instructions for any application or method operating on the electronic device 900, contact data, phone book data, messages, pictures, videos, etc. The memory 904 may be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0142] The power supply component 906 provides power to the various components of the electronic device 900. The power supply component 906 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 900.

[0143] The multimedia component 908 includes a screen that provides an output interface between the electronic device 900 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 908 includes a front camera and / or a rear camera. When the electronic device 900 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0144] The audio component 910 is configured to output and / or input audio signals. For example, the audio component 910 includes a microphone (MIC), and when the electronic device 900 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 904 or sent via the communication component 916. In some embodiments, the audio component 910 also includes a speaker for outputting audio signals.

[0145] I / O interface 912 provides an interface between processing component 902 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0146] The sensor assembly 914 includes one or more sensors for providing various aspects of status assessment for the electronic device 900. For example, the sensor assembly 914 can detect the open / closed state of the electronic device 900, the relative positioning of components, such as the display and keypad of the electronic device 900, and the sensor assembly 914 can also detect the position change of the electronic device 900 or a component of the electronic device 900, the presence or absence of user contact with the electronic device 900, the orientation or acceleration / deceleration of the electronic device 900, and the temperature change of the electronic device 900. The sensor assembly 914 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 914 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 914 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0147] The communication component 916 is configured to facilitate wired or wireless communication between the electronic device 900 and other devices. The electronic device 900 can access a wireless network based on a communication standard, such as WiFi, a carrier network (such as 2G, 3G, 4G or 5G), or a combination thereof. In an exemplary embodiment, the communication component 916 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 916 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0148] In an exemplary embodiment, the electronic device 900 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to perform the above-mentioned offline package update method.

[0149] In an exemplary embodiment, a storage medium including instructions is also provided, such as a memory 904 including instructions, and the instructions can be executed by the processor 920 of the electronic device 900 to complete the above-mentioned offline package update method. Optionally, the storage medium can be a non-transitory computer-readable storage medium, for example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0150] In an exemplary embodiment, a computer program product is also provided, the computer program product includes a computer program or a computer instruction, the computer program or the computer instruction can be executed by the processor 920 of the electronic device 900 to complete the above data processing method. Optionally, the program code can be stored in a storage medium of the electronic device 900, the storage medium can be a non-transitory computer-readable storage medium, for example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0151] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0152] It should be understood that the present invention is not limited to the exact construction that has been described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present invention is limited only by the appended claims.

Claims

1. A data processing method, characterized in that: The method comprises: Acquire a set of data samples to be tested, wherein the set of data samples to be tested includes a plurality of data samples to be tested; Obtaining the correlation between the data samples to be tested; Classifying the data samples to be tested according to the correlation between the data samples to be tested to obtain a plurality of subsets of the data samples to be tested, wherein the data samples to be tested included in any two subsets of the data samples to be tested do not have the correlation; Performing convex optimization processing on all the subsets of data samples to be tested to obtain a test concentration of each subset of data samples to be tested, wherein the test concentrations of any two subsets of data samples to be tested are different, and the weighted sum of the test concentrations of all the subsets of data samples to be tested is less than a preset test concentration threshold; The testing of the to-be-tested data sample subset to obtain data test results comprises: Acquire a target data sample to be tested from the data samples to be tested included in the data sample to be tested subset according to the test concentration of the data sample to be tested subset; Testing the subset of data samples to be tested to obtain data test results; The data test result of the set of data samples to be tested is obtained according to the data test result of each of the subsets of data samples to be tested.

2. The method according to claim 1, characterized in that: The convex optimization process is performed on all the subsets of the data samples to be tested to obtain the test concentration of each subset of the data samples to be tested, which is obtained by the following formula: Wherein, p is the number of the subset of data samples to be tested, and p is an integer greater than 1; i∈[1,p]; θ i is the test concentration of the i-th subset of the data samples to be tested; λ1 is The importance weight coefficient of The importance weight coefficient of w i is θ i The weight of , u is the preset test concentration threshold.

3. The method according to claim 1, characterized in that The testing of the target to-be-tested data sample and obtaining the data test result comprises: Performing a first test and a second test on the target data sample to be tested respectively, and obtaining a first test result and a second test result; wherein the first test and the second test are different test versions set for the same test object; A data test result is obtained according to the first test result and the second test result.

4. The method according to any one of claims 1 to 3, characterized in that: The data samples to be tested included in the subset of data samples to be tested have the correlation relationship.

5. A data processing device, characterized in that: include: The first module is used to obtain a set of data samples to be tested, wherein the set of data samples to be tested includes multiple data samples to be tested; The second module is used to obtain the correlation between the data samples to be tested; A third module is used to classify the data samples to be tested according to the correlation between the data samples to be tested to obtain multiple subsets of data samples to be tested, wherein the correlation does not exist between the data samples to be tested included in any two subsets of data samples to be tested; The fourth module is used to test the subset of data samples to be tested and obtain data test results; wherein the fourth module is specifically used to obtain a target data sample to be tested from the data samples to be tested included in the subset of data samples to be tested according to the test concentration of the subset of data samples to be tested, test the target data sample to be tested, and obtain data test results; A fifth module is used to obtain the data test results of the data sample set to be tested according to the data test results of each of the data sample subsets to be tested; The sixth module is used to perform convex optimization processing on all the subsets of data samples to be tested to obtain the test concentration of each subset of data samples to be tested, wherein the test concentrations of any two subsets of data samples to be tested are different, and the weighted sum of the test concentrations of all the subsets of data samples to be tested is less than a preset test concentration threshold.

6. The device according to claim 5, characterized in that The sixth module is specifically used to perform convex optimization processing on all the subsets of data samples to be tested by using the following formula to obtain the test concentration of each subset of data samples to be tested; Wherein, p is the number of the subset of data samples to be tested, and p is an integer greater than 1; i∈[1, p]; θi is the test concentration in the i-th subset of the data samples to be tested; λ1 is The importance weight coefficient of is the importance weight coefficient of θi; wi is the weight of θi, and u is the pre-set test concentration threshold.

7. The device according to claim 5, characterized in that The fourth module comprises: The first submodule is used to perform a first test and a second test on the target data sample to be tested, respectively, to obtain a first test result and a second test result; wherein the first test and the second test are different test versions set for the same test object; The second submodule is used to obtain a data test result according to the first test result and the second test result.

8. The device according to any one of claims 5 to 7, characterized in that: The data samples to be tested included in the subset of data samples to be tested have the correlation relationship.

9. An electronic device, characterized in that: include: processor; a memory for storing instructions executable by the processor; The processor is configured to execute the instructions to implement the data processing method according to any one of claims 1 to 4. 10 . A computer-readable storage medium, when instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the data processing method according to any one of claims 1 to 4.

11. A computer program product comprising a computer program or computer instructions, characterized in that When the computer program or computer instruction is executed by a processor, the data processing method according to any one of claims 1 to 4 is implemented.