Internet data detection method, device, electronic device and computer readable medium

Abstract

The embodiments of the present disclosure provide an Internet data detection method, device, electronic device and computer-readable medium. The method includes: obtaining the Internet data of the current batch to be detected from the first queue and putting it into the pending pool; determining that the Internet data of the same type in the pending pool belongs to the target Internet data set; determining that the corresponding Internet data in the target Internet data set is a sampling sample according to the quality inspection standard and the number of Internet data in the target Internet data set; determining that the sampling sample has a first priority; pushing the sampling sample with the first priority to the second queue to give priority to the sampling sample; obtaining the audit result of the sampling sample; determining the audit result of the target Internet data set in the pending pool according to the audit result of the sampling sample. The technical solution provided by the embodiments of the present disclosure can improve the efficiency of data detection while ensuring the detection quality of the data.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to an Internet data detection method, device, electronic device, and computer-readable medium. Background Art

[0002] Mini Programs are applications that can be used without downloading and installing. Currently, the application of Mini Programs is very extensive. Before a Mini Program goes online, it needs to go through a Mini Program review. Usually, the Mini Program platform will conduct security and usability tests on the content, style, and functions of the version submitted by the Mini Program developer. Only after the review is passed will there be an opportunity to give users an online experience. The existing Mini Program review technology is a method of manually reviewing each Mini Program one by one. This is a high-cost solution. With an average monthly scale of one million orders for WeChat Mini Programs, it requires a large amount of review human resources, and the maintenance cost is very high. In addition, when the review orders are concentrated, it is impossible to guarantee a good experience of review timeliness.

[0003] Therefore, a new Internet data detection method, device, electronic device and computer-readable medium are needed.

[0004] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present disclosure, and therefore may include information that does not constitute the prior art known to ordinary technicians in the field. Summary of the invention

[0005] The embodiments of the present disclosure provide an Internet data detection method, device, electronic device, and computer-readable medium, thereby improving the timeliness of data detection at least to a certain extent while ensuring the quality of data detection.

[0006] Other features and advantages of the present disclosure will become apparent from the following detailed description, or may be learned in part by the practice of the present disclosure.

[0007] The disclosed embodiment proposes an Internet data detection method, including: obtaining Internet data of a current batch to be detected from a first queue and placing it into a pending pool; determining that Internet data of the same type in the pending pool belongs to a target Internet data set; determining that the corresponding Internet data in the target Internet data set is a random inspection sample based on a quality inspection standard and the amount of Internet data in the target Internet data set; determining that the random inspection sample has a first priority; pushing the random inspection sample with the first priority to a second queue to give priority to detecting the random inspection sample; obtaining an audit result of the random inspection sample; and determining the audit result of the target Internet data set in the pending pool based on the audit result of the random inspection sample.

[0008] The disclosed embodiment proposes an Internet data detection device, comprising: a data acquisition module, configured to acquire the Internet data of the current batch to be detected from the first queue and put it into a pending pool; a set generation module, configured to determine that the Internet data of the same type in the pending pool belongs to a target Internet data set; a sample determination module, configured to determine that the corresponding Internet data in the target Internet data set is a random inspection sample based on the quality inspection standard and the number of Internet data in the target Internet data set; a first priority module, configured to determine that the Internet data of the random inspection sample has a first priority; a sample push module, configured to push the random inspection sample with the first priority to the second queue to give priority to the detection of the random inspection sample; a sample review module, configured to obtain the review result of the random inspection sample; and a set review module, configured to determine the review result of the target Internet data set in the pending pool based on the review result of the random inspection sample.

[0009] In an exemplary embodiment of the present disclosure, the Internet data includes applications; the set generation module includes: a template identification unit, configured to obtain a template identification of the application; an identification clustering unit, configured to cluster the applications according to the template identification, and determine that the applications with the same template identification belong to the target Internet data set.

[0010] In an exemplary embodiment of the present disclosure, the sample determination module is configured to determine the random inspection sample based on the quality inspection standard and the amount of Internet data in the target Internet data set if the amount of Internet data in the target Internet data set is greater than a preset threshold.

[0011] In an exemplary embodiment of the present disclosure, the set audit module is configured to determine that the audit result of the target Internet data set in the pending pool is passed if the audit result of the random inspection sample is passed.

[0012] In an exemplary embodiment of the present disclosure, the set audit module includes a second priority unit and a data push unit. The second priority unit is configured to set the Internet data in the sample to have a second priority if the audit result of the sample is not passed, and the first priority is higher than the second priority. The data push unit is configured to push the target Internet data set with the second priority to the second queue.

[0013] In an exemplary embodiment of the present disclosure, the data push unit includes a quality label subunit, a delayed push subunit and a data push subunit. The quality label subunit is configured to set the quality label of the target Internet data set in the pending pool to be a first quality label. The delayed push subunit can be configured to delay the push time of the target Internet data set according to the first quality label. The data push subunit is configured to push the target Internet data set to the second queue according to the push time of the target Internet data set.

[0014] In an exemplary embodiment of the present disclosure, the Internet data detection device further includes a violation degree module and a standard adjustment module, wherein the violation degree module is configured to determine the violation degree according to the audit result of the sample inspection. The standard adjustment unit is configured to adjust the quality inspection standard of the target Internet data set according to the violation degree.

[0015] In an exemplary embodiment of the present disclosure, the sample determination module includes a code determination unit, a sample quantity unit and a sample determination unit. The code determination unit is configured to determine the sample quantity code according to the inspection level in the quality inspection standard and the number of Internet data in the target Internet data set. The sample quantity unit is configured to determine the sample quantity according to the reception quality limit in the quality inspection standard and the sample quantity code. The sample determination unit is configured to determine the random inspection sample in the target Internet data set according to the sample quantity of the target Internet data set and a random algorithm.

[0016] In an exemplary embodiment of the present disclosure, the sample review module includes a receiving number unit and a sample review unit. The receiving number unit is configured to determine the receiving number according to the receiving quality limit in the quality inspection standard and the sample quantity code. The sample review unit is configured to determine that the review result of the sample is passed if the number of the Internet data that failed the review in the sample is less than or equal to the receiving number.

[0017] An embodiment of the present disclosure proposes an electronic device, comprising: at least one processor; a storage device for storing at least one program, when the at least one program is executed by the at least one processor, the at least one processor implements the Internet data detection method as described in the above embodiment.

[0018] The embodiments of the present disclosure provide a computer-readable medium on which a computer program is stored. When the computer program is executed by a processor, the Internet data detection method as described in the above embodiments is implemented.

[0019] According to one aspect of the present application, a computer program product or a computer program is provided, the computer program product or the computer program including computer instructions, the computer instructions being stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the Internet data detection method described in the above embodiment and the methods provided in various optional implementations.

[0020] In the technical solutions provided by some embodiments of the present disclosure, Internet data of the same type in the pending pool are determined to belong to the target Internet data set, and the target Internet data set is sampled according to the quality inspection standard to obtain the random inspection sample. Due to the scientific and reasonable samples of the quality inspection standard and the overall error evaluation system, the audit of the target Internet data set can be completed based on the audit of the random inspection sample. Avoid the large amount of manpower and material resources caused by manual one-by-one audit in related technologies, save detection costs, and improve detection efficiency while ensuring detection quality. At the same time, the Internet data detection method provided by the embodiment of the present disclosure pushes the random inspection samples with the first priority to the second queue to give priority to the detection of the random inspection samples, and can obtain the audit results of the random inspection samples in a shorter time, further improving the timeliness of Internet data detection.

[0021] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] The drawings herein are incorporated into the specification and constitute a part of the specification, showing embodiments consistent with the present disclosure, and together with the specification, are used to explain the principles of the present disclosure. Obviously, the drawings described below are only some embodiments of the present disclosure, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. In the drawings:

[0023] Figure 1 A schematic diagram showing an exemplary system architecture to which the Internet data detection method or device according to an embodiment of the present disclosure can be applied;

[0024] Figure 2 A flowchart of an Internet data detection method according to an embodiment of the present disclosure is schematically shown;

[0025] Figure 3 is based on Figure 2 A flowchart of step S220 in an exemplary embodiment;

[0026] Figure 4 is based on Figure 2A flowchart of step S270 in an exemplary embodiment;

[0027] Figure 5 is based on Figure 4 A flowchart of step S420 in an exemplary embodiment;

[0028] Figure 6 A flowchart of an Internet data detection method according to an embodiment of the present disclosure is schematically shown;

[0029] Figure 7 A flowchart of an Internet data detection method according to an embodiment of the present disclosure is schematically shown;

[0030] Figure 8 is based on Figure 2 A flowchart of step S260 in an exemplary embodiment;

[0031] Fig. 9 A flowchart of an Internet data detection method according to an embodiment of the present disclosure is schematically shown;

[0032] Fig.10 A block diagram of an Internet data detection device according to an embodiment of the present disclosure is schematically shown;

[0033] Fig.11 A schematic diagram of the structure of an electronic device suitable for implementing the embodiments of the present disclosure is shown. DETAILED DESCRIPTION

[0034] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in a variety of forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be more comprehensive and complete and will fully convey the concept of the example embodiments to those skilled in the art.

[0035] In addition, the described features, structures or characteristics may be combined in one or more embodiments in any suitable manner. In the following description, many specific details are provided to provide a full understanding of the embodiments of the present disclosure. However, those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced without one or more of the specific details, or other methods, components, devices, steps, etc. may be adopted. In other cases, known methods, devices, implementations or operations are not shown or described in detail to avoid blurring the various aspects of the present disclosure.

[0036] The block diagrams shown in the accompanying drawings are only functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities can be implemented in software form, or in at least one hardware module or integrated circuit, or in different networks and / or processor devices and / or microcontroller devices.

[0037] The flowcharts shown in the accompanying drawings are only exemplary and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps can be decomposed, and some operations / steps can be combined or partially combined, so the actual execution order may change according to actual conditions.

[0038] In the relevant technologies, the number of mini-programs submitted for review by service providers is huge, reaching an average of 400,000 per month. Since more than 95% of the mini-programs served by service providers are corporate entities, the requirements for the review timeliness of corporate mini-programs in commercial scenarios are very high. The traditional method of reviewing one by one consumes a lot of review manpower and has a slow review timeliness. When the backlog is serious, the platform also tries to automatically approve some so-called low-risk service provider mini-programs, but this method relies too much on the accuracy of the low-risk judgment model. The historical low-risk judgment model has a low accuracy rate, which leads to a more serious problem of online omissions.

[0039] Therefore, a new Internet data detection method, device, electronic device and computer-readable medium are needed.

[0040] Figure 1 A schematic diagram showing an exemplary system architecture to which the Internet data detection method or device according to an embodiment of the present disclosure can be applied.

[0041] like Figure 1 As shown, the system architecture 100 may include one or more of terminal devices 101, 102, 103, a network 104, and a server 105. The network 104 is used to provide a medium for communication links between the terminal devices 101, 102, 103 and the server 105. The network 104 may include various connection types, such as wired, wireless communication links, or optical fiber cables, etc.

[0042] It should be understood that Figure 1 The number of terminal devices, networks and servers in the embodiment is only for illustration. According to the implementation requirements, there may be any number of terminal devices, networks and servers. For example, the server 105 may be a server cluster composed of multiple servers.

[0043] Users can use terminal devices 101, 102, 103 to interact with server 105 through network 104 to receive or send messages, etc. Terminal devices 101, 102, 103 can be various electronic devices with display screens and supporting web browsing, including but not limited to smart phones, tablet computers, portable computers, desktop computers, wearable devices, virtual reality devices, smart homes, etc.

[0044] The server 105 may be a server that provides various services. For example, the terminal device 103 (or the terminal device 101 or 102) uploads Internet data to the server 105 to generate a first queue. The server 105 may obtain the Internet data of the current batch to be detected from the first queue and put it into the pending pool; determine that the Internet data of the same type in the pending pool belongs to the target Internet data set; determine that the corresponding Internet data in the target Internet data set is a sampling sample according to the quality inspection standard and the number of Internet data in the target Internet data set; determine that the sampling sample has a first priority; push the sampling sample with the first priority to the second queue to give priority to the sampling sample; obtain the audit result of the sampling sample; determine the audit result of the target Internet data set in the pending pool according to the audit result of the sampling sample. And feed back the audit result of the target Internet data set to the terminal device 103, so that the terminal device 103 can withdraw and improve the Internet data that has not passed the audit, thereby realizing a fast, safe and efficient detection process for Internet data.

[0045] Figure 2 The flowchart of the Internet data detection method according to an embodiment of the present disclosure is schematically shown. The method provided by the embodiment of the present disclosure can be processed by any electronic device with computing processing capabilities, such as the above Figure 1 The server 105 and / or terminal devices 102 and 103 in the embodiment are described by taking the server 105 as the execution subject in the following embodiment, but the present disclosure is not limited to this.

[0046] like Figure 2 As shown, the Internet data detection method provided by the embodiment of the present disclosure may include the following steps.

[0047] In step S210, the current batch of Internet data to be detected is obtained from the first queue and put into the pending pool.

[0048] In the embodiment of the present disclosure, the first queue may include Internet data uploaded by different device terminals. The Internet data in the first queue may be sorted according to the upload time. The current batch to be detected may be Internet data uploaded by the device terminal within a preset time period. The Internet data may be, for example, but not limited to, application programs, video data, audio data, image data, text data, code data, etc.

[0049] In step S220, Internet data of the same type in the pending pool is determined to belong to the target Internet data set.

[0050] In the disclosed embodiment, the type of Internet data can be set and bound to the Internet data when the device uploads it. When two Internet data are of the same type, the performance of the two Internet data is similar. The similarity of Internet data can be, for example, but not limited to, the security and availability of content, style, function, etc. Taking an application as an example, when a service provider develops a mini-program, the type of each mini-program can be the template number of the mini-program template used by the mini-program. Mini-programs with the same template number belong to the same type.

[0051] In step S230, the corresponding Internet data in the target Internet data set is determined as a random inspection sample based on the quality inspection standard and the amount of Internet data in the target Internet data set.

[0052] In the disclosed embodiments, the quality inspection standard may be, for example, the quality acceptance standard (acceptance quality limit, AQL). The AQL quality acceptance standard refers to: when a continuous series of batches are submitted for acceptance, the worst allowable process average quality level. AQL (Acceptable Quality Level) is the basis of the adjusted sampling system, and is the upper limit of the process average of the continuously submitted inspection batches that can be accepted by the supplier and the demander. The process average is the average quality of a series of continuously submitted inspection batches, expressed as "batch defective rate" or "defect rate per hundred units".

[0053] In step S240, it is determined that the sample to be randomly inspected has the first priority.

[0054] In the disclosed embodiment, the priority may be a label for each Internet data in the random inspection sample.

[0055] In step S250, the sample samples with the first priority are pushed to the second queue to give priority to the detection of the sample samples.

[0056] In the disclosed embodiment, the second queue may be a queue for review. For example, each Internet data will be reviewed according to the arrangement order of the Internet data in the second queue. In the second queue, the priority of the Internet data will be given priority, and the Internet data with the first priority will be ranked before other Internet data. For another example, after the Internet data is sorted according to the priority, it is sorted according to the time when each Internet data is submitted.

[0057] In step S260, the audit results of the random inspection samples are obtained.

[0058] In the disclosed embodiment, the audit result of the sampled sample may be determined according to the quality inspection standard in step S230 and the audit result of each Internet data in the sampled sample.

[0059] In step S270, the audit results of the target Internet data set in the pending pool are determined based on the audit results of the random inspection samples.

[0060] In the disclosed embodiment, if the audit result of the sample randomly inspected is passed, then the audit result of the target Internet data set in the pending pool is determined to be passed.

[0061] The Internet data detection method provided by the embodiment of the present disclosure determines that the Internet data of the same type in the pending pool belongs to the target Internet data set, and takes the target Internet data set as a unit, samples the target Internet data set according to the quality inspection standard to obtain the random inspection sample. Due to the scientific and reasonable samples of the quality inspection standard and the overall error evaluation system, the audit of the target Internet data set can be completed based on the audit of the random inspection sample. Avoid the large amount of manpower and material resources caused by manual one-by-one audit in the related technology, save the detection cost, and improve the detection efficiency while ensuring the detection quality. At the same time, the Internet data detection method provided by the embodiment of the present disclosure pushes the random inspection sample with the first priority to the second queue to give priority to the detection of the random inspection sample, and can obtain the audit results of the random inspection sample in a shorter time, further improving the timeliness of Internet data detection.

[0062] In an exemplary embodiment, in step S230, if the number of Internet data in the target Internet data set is greater than a preset threshold, a random inspection sample is determined based on the quality inspection standard and the number of Internet data in the target Internet data set. Among them, the preset threshold can be determined based on the accuracy of the quality inspection standard. For example, the reliability of the quality inspection standard changes according to the size of the population. For example, the smaller the population, the lower the reliability of the quality inspection standard. The specific value of the preset threshold can be set according to the reliability of the test results required by the actual application scenario. In this embodiment, by comparing the preset threshold and the number of Internet data in the target Internet data set, the target Internet data set is determined to be the target Internet data set when the number of Internet data in the target Internet data set is greater than the preset threshold, which can further improve the reliability and accuracy of the audit results when the Internet data is tested.

[0063] Figure 3 is based on Figure 2 FIG. 1 is a flow chart of step S220 in an exemplary embodiment.

[0064] like Figure 3 As shown, in the embodiment of the present disclosure, Internet data may include application programs, such as but not limited to small programs, etc. Figure 2 Step S220 in the embodiment may further include the following steps.

[0065] In step S310, the template identifier of the application in the pending pool is obtained.

[0066] In the embodiment of the present disclosure, the application may be, for example, a mini-program, and the template identifier of the application may be a template identifier of the mini-program.

[0067] In step S320, the application programs are clustered according to the template identifiers, and the application programs having the same template identifier are determined to belong to the target Internet data set.

[0068] In the disclosed embodiment, applications identified by different templates will belong to different target Internet data sets.

[0069] In an exemplary embodiment, the applications can also be clustered according to the service provider identification or submission time or mini-program framework description of the application, and the applications with the same service provider identification or submission time or mini-program framework description are determined to belong to the target Internet data set. Among them, the service provider identification is the identification of the service provider that outputs and submits the application. The mini-program framework description is the descriptive content of the framework of different mini-programs, such as but not limited to the framework name, etc. When the application does not have a template identification, and the mini-programs submitted by the same service provider in the same batch are likely to be under the same template, then the degree of similarity between the mini-programs can be judged based on the mini-program framework description.

[0070] In this embodiment, applications are clustered according to template identifiers. Since the reliability of applications with the same template is similar, applications with the same template identifier can be clustered into the same target Internet data set. In the subsequent sampling detection process using the target Internet data set as the whole, the accuracy and effectiveness of the sampling detection results can be improved.

[0071] Figure 4 is based on Figure 2 Flowchart of step S270 in an exemplary embodiment.

[0072] like Figure 4 As shown above Figure 2 Step S270 in the embodiment may further include the following steps.

[0073] In step S410, if the audit result of the sample sample is not passed, the Internet data in the sample sample is set to have a second priority, and the first priority is higher than the second priority.

[0074] In step S420, the target Internet data set with the second priority is pushed to the second queue.

[0075] In the disclosed embodiment, since the second priority is lower than the first priority, in the second queue, the Internet data with the second priority will be arranged after the Internet data with the first priority. The arrangement order of the Internet data in the second queue determines the detection order of the Internet data, and the Internet data in the front will be detected first.

[0076] In this embodiment, when the audit result of the random inspection sample is failed, the priority of the Internet data in the random inspection sample is reduced to the second priority, so that when the target Internet data set with the second priority is pushed to the second queue, the audit resources of the remaining Internet data will not be squeezed out.

[0077] Figure 5 is based on Figure 4 FIG. 1 is a flow chart of step S420 in an exemplary embodiment.

[0078] like Figure 5 As shown above Figure 2 Step S420 in the embodiment may further include the following steps.

[0079] In step S510, the quality label of the target Internet data set in the pending pool is set to a first quality label.

[0080] In the disclosed embodiment, when the target Internet data set has the first quality label, on the one hand, it indicates that the target Internet data set has been subjected to a detection step such as step S260, and on the other hand, it indicates that the audit result of the target Internet data set is not passed.

[0081] In step S520, the push time of the target Internet data set is postponed according to the first quality label.

[0082] In the disclosed embodiment, the push time is the time when the target Internet data enters the second queue.

[0083] In step S530, the target Internet data set is pushed to the second queue according to the push time of the target Internet data set.

[0084] In an exemplary embodiment, a withdrawal rectification notice may also be generated according to the push time and sent to the submission device of the target Internet data set; and an updated target Internet data set generated by the submission device in response to the withdrawal rectification notice may be received; and the updated target Internet data set may be pushed to the second queue according to the push time of the target Internet data set.

[0085] In this embodiment, by delaying the push time of the target Internet data set with a failed audit result into the second queue, the normal audit speed of other Internet data can be ensured.

[0086] Figure 6 The flowchart of the Internet data detection method according to an embodiment of the present disclosure is schematically shown.

[0087] like Figure 6 As shown, based on Figure 4 The Internet data detection method of the illustrated embodiment may further include the following steps.

[0088] In step S610, the degree of violation is determined based on the audit results of the random inspection samples.

[0089] In the embodiments of the present disclosure, the audit results of failure may include different reasons for failure. For example, but not limited to: sensitive content, illegal content, unavailable buttons, invalid links, etc. The degree of violation may be determined based on the reasons for failure. For example, sensitive content and illegal content may be serious violations, and unavailable buttons and invalid links may be general violations, but this is only an example, and the embodiments of the present disclosure do not specifically limit this.

[0090] In step S620, the quality inspection standard of the target Internet data set is adjusted according to the degree of violation.

[0091] In the disclosed embodiment, adjustment parameters of quality inspection standards of different violation degrees can be set. Continuing with the above example, when the violation degree is a serious violation, the quality inspection standard can be adjusted to AQL1; when the violation degree is a general violation, the quality inspection standard can be adjusted to AQL10. Among them, AQL1 means that the receiving quality limit is 1, and its corresponding pass rate reaches 99%. AQL10 means that the receiving quality limit is 10, and its corresponding pass rate is 90%.

[0092] In this embodiment, adjusting the quality inspection standards of the target Internet data set whose audit results are failed can further ensure that online risks are controllable and reduce the possibility of high-risk violation vulnerabilities being missed.

[0093] Figure 7 The flowchart of the Internet data detection method according to an embodiment of the present disclosure is schematically shown.

[0094] like Figure 7 As shown, the Internet data detection method based on the above embodiment also includes the following steps.

[0095] In step S710, a sample size code is determined according to the inspection level in the quality inspection standard and the amount of Internet data in the target Internet data set.

[0096] In the disclosed embodiment, the quantity of Internet data may be used as the overall batch, and the sample quantity code may be determined by matching the inspection level and the overall batch in the AQL sampling standard table.

[0097] In step S720, the sample quantity is determined according to the reception quality limit and the sample quantity code in the quality inspection standard.

[0098] In the disclosed embodiment, the sample quantity may be determined by matching the received quality limit (AQL value) and the sample quantity code in the AQL sampling standard table.

[0099] In step S730, a random sampling sample is determined in the target Internet data set according to the sample quantity of the target Internet data set and a random algorithm.

[0100] Figure 8 is based on Figure 2 A flowchart of step S260 in an exemplary embodiment.

[0101] like Figure 8 As shown above Figure 2 Step S260 in the embodiment may further include the following steps.

[0102] In step S810, the reception number is determined according to the reception quality limit and the sample size code in the quality inspection standard.

[0103] In the disclosed embodiment, the acceptance number (Accept value, Ac value) can be determined by matching the acceptance quality limit and the sample size code in the AQL sampling standard table. The acceptance number is the maximum number of Internet data in the sampled sample that has a failed audit result when the audit of the sampled sample is passed.

[0104] In step S820, if the number of Internet data that failed the review in the random inspection sample is less than or equal to the number of received data, the review result of the random inspection sample is determined to be passed.

[0105] Fig. 9 The flowchart of the Internet data detection method according to an embodiment of the present disclosure is schematically shown.

[0106] like Fig. 9 As shown, the Internet data detection method provided in this embodiment includes the following steps.

[0107] In step S905, the current batch of Internet data to be detected is obtained from the first queue and put into the pending pool.

[0108] In step S910, Internet data of the same type in the pending pool is determined to belong to the target Internet data set.

[0109] In step S915, if the amount of Internet data in the target Internet data set is greater than a preset threshold, the corresponding Internet data in the target Internet data set is determined as a random inspection sample based on the quality inspection standard and the amount of Internet data in the target Internet data set.

[0110] In step S920, it is determined that the sample to be sampled has the first priority and is pushed to the second queue to preferentially detect the sample to be sampled.

[0111] In step S925, the audit results of the random inspection samples are obtained.

[0112] In step S930, if the audit result of the sample being randomly inspected is passed, it is determined that the audit result of the target Internet data set in the pending pool is passed.

[0113] In an exemplary embodiment, if the audit result of the random inspection sample is passed, the target Internet data set in the pending pool can also be confirmed as the first priority and added to the queue to give priority to the audit of Internet data with the first priority.

[0114] In step S935, if the audit result of the sample sample is not passed, the Internet data in the sample sample is set to have a second priority, and the first priority is higher than the second priority.

[0115] In step S940, the quality label of the target Internet data set in the pending pool is set to a first quality label.

[0116] In step S945, the push time of the target Internet data set is postponed according to the first quality label.

[0117] In step S950, a withdrawal and rectification notice is generated according to the push time and sent to the submitting device of the target Internet data set, and the updated target Internet data set generated by the submitting device in response to the withdrawal and rectification notice is received, and the execution returns to step S905.

[0118] The following describes an apparatus embodiment of the present disclosure, which can be used to execute the Internet data detection method of the present disclosure. For details not disclosed in the apparatus embodiment of the present disclosure, please refer to the embodiment of the Internet data detection method of the present disclosure.

[0119] Fig.10 A block diagram of an Internet data detection device according to an embodiment of the present disclosure is schematically shown.

[0120] Reference Fig.10 As shown, according to an embodiment of the present disclosure, an Internet data detection device 1000 may include: a data acquisition module 1010, a set generation module 1020, a sample determination module 1030, a first priority module 1040, a sample push module 1050, a sample review module 1060 and a set review module 1070.

[0121] The data acquisition module 1010 can be configured to acquire the current batch of Internet data to be detected from the first queue and put it into the pending pool.

[0122] The set generation module 1020 may be configured to determine that the Internet data of the same type in the pending pool belongs to the target Internet data set.

[0123] The sample determination module 1030 may be configured to determine corresponding Internet data in the target Internet data set as random inspection samples based on a quality inspection standard and the amount of Internet data in the target Internet data set.

[0124] The first priority module 1040 can be configured to determine that the Internet data of the random inspection sample has a first priority.

[0125] The sample pushing module 1050 may be configured to push the sample samples having the first priority level to the second queue so as to preferentially detect the sample samples.

[0126] The sample review module 1060 may be configured to obtain the review result of the sample being randomly inspected.

[0127] The collection audit module 1070 may be configured to determine the audit result of the target Internet data set in the pending pool based on the audit result of the random inspection sample.

[0128] The Internet data detection device provided by the embodiment of the present disclosure determines that the Internet data of the same type in the pending pool belongs to the target Internet data set, and takes the target Internet data set as a unit, samples the target Internet data set according to the quality inspection standard to obtain the random inspection sample. Due to the scientific and reasonable samples of the quality inspection standard and the overall error evaluation system, the audit of the target Internet data set can be completed based on the audit of the random inspection sample. Avoid the large amount of manpower and material resources caused by manual one-by-one audit in the related technology, save the detection cost, and improve the detection efficiency while ensuring the detection quality. At the same time, the Internet data detection method provided by the embodiment of the present disclosure pushes the random inspection samples with the first priority to the second queue to give priority to the detection of the random inspection samples, and can obtain the audit results of the random inspection samples in a shorter time, further improving the timeliness of Internet data detection.

[0129] In an exemplary embodiment, the Internet data may include an application; the set generation module 1020 may include: a template identification unit, configured to obtain a template identification of the application; an identification clustering unit, configured to cluster the application according to the template identification, and determine that the application with the same template identification belongs to the target Internet data set.

[0130] In an exemplary embodiment, the sample determination module 1030 may be configured to determine the random inspection sample based on the quality inspection standard and the amount of Internet data in the target Internet data set if the amount of Internet data in the target Internet data set is greater than a preset threshold.

[0131] In an exemplary embodiment, the collection audit module 1070 may be configured to determine that the audit result of the target Internet data set in the pending pool is passed if the audit result of the random inspection sample is passed.

[0132] In an exemplary embodiment, the collection audit module 1070 may include a second priority unit and a data push unit. The second priority unit may be configured to set the Internet data in the sample to have a second priority if the audit result of the sample is not passed, and the first priority is higher than the second priority. The data push unit may be configured to push the target Internet data collection with the second priority to the second queue.

[0133] In an exemplary embodiment, the data push unit may include a quality label subunit, a delayed push subunit and a data push subunit. The quality label subunit may be configured to set the quality label of the target Internet data set in the pending pool to be a first quality label. The delayed push subunit may be configured to delay the push time of the target Internet data set according to the first quality label. The data push subunit may be configured to push the target Internet data set to the second queue according to the push time of the target Internet data set.

[0134] In an exemplary embodiment, the Internet data detection device 1000 may further include a violation degree module and a standard adjustment module, wherein the violation degree module may be configured to determine the violation degree according to the audit result of the sample inspection. The standard adjustment unit may be configured to adjust the quality inspection standard of the target Internet data set according to the violation degree.

[0135] In an exemplary embodiment, the sample determination module 1030 may include a code determination unit, a sample quantity unit, and a sample determination unit. The code determination unit may be configured to determine the sample quantity code according to the inspection level in the quality inspection standard and the number of Internet data in the target Internet data set. The sample quantity unit may be configured to determine the sample quantity according to the reception quality limit in the quality inspection standard and the sample quantity code. The sample determination unit may be configured to determine the random inspection sample in the target Internet data set according to the sample quantity of the target Internet data set and a random algorithm.

[0136] In an exemplary embodiment, the sample review module 1060 may include a receiving number unit and a sample review unit. The receiving number unit may be configured to determine the receiving number according to the receiving quality limit in the quality inspection standard and the sample quantity code. The sample review unit may be configured to determine that the review result of the sample is passed if the number of the Internet data that failed the review in the sample is less than or equal to the receiving number.

[0137] Fig.11 FIG. 1 shows a schematic diagram of the structure of an electronic device suitable for implementing the embodiment of the present disclosure. It should be noted that: Fig.11 The electronic device 1100 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0138] like Fig.11As shown, the electronic device 1100 includes a central processing unit (CPU) 1101, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1102 or a program loaded from a storage part 1108 into a random access memory (RAM) 1103. In the RAM 1103, various programs and data required for system operation are also stored. The CPU 1101, the ROM 1102, and the RAM 1103 are connected to each other via a bus 1104. An input / output (I / O) interface 1105 is also connected to the bus 1104.

[0139] The following components are connected to the I / O interface 1105: an input section 1106 including a keyboard, a mouse, etc.; an output section 1107 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 1108 including a hard disk, etc.; and a communication section 1109 including a network interface card such as a LAN card, a modem, etc. The communication section 1109 performs communication processing via a network such as the Internet. A drive 1110 is also connected to the I / O interface 1105 as needed. A removable medium 1111, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 1110 as needed, so that a computer program read therefrom is installed into the storage section 1108 as needed.

[0140] In particular, according to an embodiment of the present disclosure, the process described below with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication part 1109, and / or installed from a removable medium 1111. When the computer program is executed by a central processing unit (CPU) 1101, various functions defined in the system of the present application are executed.

[0141] It should be noted that the computer-readable medium shown in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with at least one wire, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the above.

[0142] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a module, a program segment or a part of the code, and the above-mentioned module, program segment or a part of the code contains at least one executable instruction for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0143] The modules and / or units and / or sub-units involved in the embodiments described in the present disclosure may be implemented by software or hardware, and the modules and / or units and / or sub-units described may also be set in a processor. The names of these modules and / or units and / or sub-units do not, in some cases, constitute limitations on the modules and / or units and / or sub-units themselves.

[0144] As another aspect, the present application also provides a computer-readable medium, which may be included in the electronic device described in the above embodiment; or may exist independently without being installed in the electronic device. The above computer-readable medium carries one or more programs, and when the above one or more programs are executed by an electronic device, the electronic device implements the method described in the following embodiment. For example, the electronic device may implement the following method. Figure 2 or Figure 3 or Figure 4 or Figure 5 or Figure 6 or Figure 7 or Figure 8 or Fig. 9 The steps shown.

[0145] It should be noted that, although several modules or units or subunits of the device for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present disclosure, the features and functions of two or more modules or units or subunits described above can be embodied in one module or unit or subunit. On the contrary, the features and functions of one module or unit described above can be further divided into multiple modules or units or subunits to be embodied.

[0146] Through the description of the above implementation, it is easy for those skilled in the art to understand that the example implementation described here can be implemented by software, or by software combined with necessary hardware. Therefore, the technical solution according to the implementation of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, including several instructions to enable a computing device (which can be a personal computer, a server, a touch terminal, or a network device, etc.) to execute the method according to the implementation of the present disclosure.

[0147] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0148] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A method for detecting Internet data, characterized in that: include: Obtaining the current batch of Internet data to be detected from the first queue and putting it into the pending pool, wherein the Internet data includes an application program; Determining that the Internet data of the same type in the pending pool belongs to the target Internet data set includes: obtaining the template identifiers of the applications in the pending pool; clustering the applications according to the template identifiers, and determining that the applications with the same template identifiers belong to the target Internet data set; Determine the sampling sample according to the quality inspection standard and the amount of Internet data in the target Internet data set; Determining that the sample to be inspected has a first priority; Pushing the sample sample with the first priority to the second queue to give priority to detecting the sample sample; Obtaining the audit results of the sample inspection; Determining the audit result of the target Internet data set in the pending pool according to the audit result of the random inspection sample includes: if the audit result of the random inspection sample is passed, determining the audit result of the target Internet data set in the pending pool is passed.

2. The method according to claim 1, characterized in that The samples for random inspection determined according to the quality inspection standards and the amount of Internet data in the target Internet data set include: If the amount of Internet data in the target Internet data set is greater than a preset threshold, the random inspection sample is determined based on the quality inspection standard and the amount of Internet data in the target Internet data set.

3. The method according to claim 1, characterized in that Determining the audit results of the target Internet data set in the pending pool according to the audit results of the random inspection samples includes: If the audit result of the sample being inspected is not passed, setting the Internet data in the sample being inspected to have a second priority, the first priority being higher than the second priority; The target Internet data set having the second priority is pushed to the second queue.

4. The method according to claim 3, characterized in that Pushing the target Internet data set having the second priority to the second queue comprises: Setting the quality label of the target Internet data set in the pending pool to a first quality label; Delaying the push time of the target Internet data set according to the first quality label; The target Internet data set is pushed to the second queue according to the pushing time of the target Internet data set.

5. The method according to claim 3, characterized in that Also includes: Determine the extent of the violation based on the review results of the sample; The quality inspection standard of the target Internet data set is adjusted according to the degree of violation.

6. The method according to claim 1, characterized in that The samples for random inspection determined according to the quality inspection standards and the amount of Internet data in the target Internet data set include: Determine a sample size word according to the inspection level in the quality inspection standard and the amount of Internet data in the target Internet data set; Determine the sample quantity according to the acceptance quality limit in the quality inspection standard and the sample quantity code; The random sampling samples are determined in the target Internet data set according to the sample quantity of the target Internet data set and a random algorithm.

7. The method according to claim 6, characterized in that The audit results of the sample inspection include: Determine the acceptance number according to the acceptance quality limit in the quality inspection standard and the sample size code; If the number of Internet data that failed the review in the random inspection sample is less than or equal to the number of received data, the review result of the random inspection sample is determined to be passed.

8. An Internet data detection device, characterized in that: include: A data acquisition module is configured to acquire the Internet data of the current batch to be detected from the first queue and put it into the pending pool, wherein the Internet data includes application programs; A set generation module, configured to determine that the Internet data of the same type in the pending pool belongs to the target Internet data set, the set generation module includes: a template identification unit, configured to obtain the template identification of the application; an identification clustering unit, configured to cluster the application according to the template identification, and determine that the application with the same template identification belongs to the target Internet data set; A sample determination module, configured to determine a random inspection sample according to a quality inspection standard and the amount of Internet data in the target Internet data set; A first priority module, configured to determine that the Internet data of the sample has a first priority; A sample pushing module, configured to push the sample having the first priority to the second queue, so as to give priority to detecting the sample; A sample review module, configured to obtain the review result of the sample inspection; The set review module is configured to determine the review result of the target Internet data set in the pending pool based on the review result of the random inspection sample. The set review module is configured to: if the review result of the random inspection sample is passed, then determine that the review result of the target Internet data set in the pending pool is passed.

9. The device according to claim 8, characterized in that The sample determination module is configured to determine the random inspection sample based on the quality inspection standard and the number of Internet data in the target Internet data set if the number of Internet data in the target Internet data set is greater than a preset threshold.

10. The device according to claim 8, characterized in that The collection audit module includes: A second priority unit, configured to set the Internet data in the sample to have a second priority if the audit result of the sample is not passed, and the first priority is higher than the second priority; A data pushing unit is configured to push the target Internet data set having the second priority to the second queue.

11. The device according to claim 10, characterized in that The data pushing unit comprises: A quality label subunit, configured to set the quality label of the target Internet data set in the pending pool to be a first quality label; a delayed push subunit, configured to delay the push time of the target Internet data set according to the first quality label; The data push subunit is configured to push the target Internet data set to the second queue according to the push time of the target Internet data set.

12. The device according to claim 10, characterized in that Also includes: a violation degree module configured to determine the violation degree according to the audit result of the sample; The standard adjustment unit is configured to adjust the quality inspection standard of the target Internet data set according to the degree of violation.

13. The device according to claim 8, characterized in that The sample determination module comprises: a code determination unit configured to determine a sample size code according to the inspection level in the quality inspection standard and the amount of Internet data in the target Internet data set; A sample quantity unit, configured to determine the sample quantity according to the acceptance quality limit in the quality inspection standard and the sample quantity code; The sample determination unit is configured to determine the random sample in the target Internet data set according to the sample quantity of the target Internet data set and a random algorithm.

14. The device according to claim 13, characterized in that The sample review module includes: A receiving number unit, configured to determine the receiving number according to the receiving quality limit in the quality inspection standard and the sample size code; The sample review unit is configured to determine that the review result of the sample is passed if the number of the Internet data that failed the review in the sample is less than or equal to the number of received data.

15. An electronic device, characterized in that: include: at least one processor; A storage device for storing at least one program; When the at least one program is executed by the at least one processor, the at least one processor implements the method according to any one of claims 1 to 7.

16. A computer readable medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

17. A computer program product, characterized in that The computer program product comprises computer instructions, and the computer instructions are executed to implement the method according to any one of claims 1-7.

Images