File quality verification method and device, electronic equipment and storage medium

Abstract

The embodiment of the invention discloses a file quality verification method and device, electronic equipment and a storage medium. The method can comprise the steps that file information is obtained for a bypass machine deployed with retrieval service, and the file information is used for describing a bypass index file which is loaded on the bypass machine and corresponds to the retrieval service; acquiring bypass information from a bypass machine and acquiring reference information from a reference machine based on the data identifier under the condition of determining that the bypass index file is to be verified according to the file information; and verifying the file quality of the bypass index file according to the bypass information and the reference information. According to the technical scheme, file quality verification can be achieved, the obtained verification result not only can reflect the quality of the bypass index file, but also can reflect the influence degree of the bypass index file on the retrieval service, and the online application value is good.

Description

Technical Field

[0001] Embodiments of the present invention relate to the field of computer application technology, and in particular to a file quality verification method, device, electronic device and storage medium. Background Art

[0002] The retrieval module and the index module are the core modules of the advertising system. The index module can receive advertising delivery information in real time and build an index file based on the advertising delivery information. On this basis, the retrieval module can retrieve qualified advertising candidate sets based on the index file for application.

[0003] In order to ensure the accuracy of the search results, when the index file is updated, the search module needs to load the latest version of the index file for online application. It should be noted that after the index file with poor file quality is put into online application, it is easy to cause great losses to the downstream system. Therefore, the file quality of the index file needs to be verified before loading, so that the search module can load the index file with better file quality.

[0004] In the process of implementing the present invention, the inventors found that the prior art has the following technical problems: currently, it is impossible to implement file quality verification. Summary of the invention

[0005] The embodiments of the present invention provide a file quality verification method, device, electronic device and storage medium to implement file quality verification.

[0006] According to one aspect of the present invention, a file quality verification method is provided, which may include:

[0007] For a bypass machine where a search service is deployed, file information is obtained, wherein the file information is used to describe a bypass index file corresponding to the search service that has been loaded on the bypass machine;

[0008] When it is determined according to the file information that the bypass index file is to be verified, the bypass information is obtained from the bypass machine based on the data identifier, and the reference information is obtained from the reference machine;

[0009] Verify the file quality of the bypass index file based on the bypass information and the benchmark information;

[0010] The bypass information is used to describe the bypass index data corresponding to the data identifier stored in the bypass index file, the retrieval service is deployed on the reference machine and the reference index file corresponding to the retrieval service has been loaded, and the reference information is used to describe the reference index data corresponding to the data identifier stored in the reference index file;

[0011] Data identifier, used to represent data retrieved through the retrieval service based on the bypass index file or the base index file.

[0012] According to another aspect of the present invention, a file quality verification device is provided, which may include:

[0013] A file information acquisition module, used to acquire file information for a bypass machine on which a search service is deployed, wherein the file information is used to describe a bypass index file corresponding to the search service that has been loaded on the bypass machine;

[0014] A reference information acquisition module, for obtaining bypass information from a bypass machine based on a data identifier and obtaining reference information from a reference machine when a bypass index file to be verified is determined according to file information;

[0015] A file quality verification module, used to verify the file quality of the bypass index file based on the bypass information and the benchmark information;

[0016] The bypass information is used to describe the bypass index data corresponding to the data identifier stored in the bypass index file, the retrieval service is deployed on the reference machine and the reference index file corresponding to the retrieval service has been loaded, and the reference information is used to describe the reference index data corresponding to the data identifier stored in the reference index file;

[0017] Data identifier, used to represent data retrieved through the retrieval service based on the bypass index file or the base index file.

[0018] According to another aspect of the present invention, there is provided an electronic device, which may include:

[0019] at least one processor; and

[0020] a memory communicatively connected to at least one processor; wherein,

[0021] The memory stores a computer program that can be executed by at least one processor. The computer program is executed by at least one processor so that the file quality verification method provided by any embodiment of the present invention is implemented when the at least one processor executes the computer program.

[0022] According to another aspect of the present invention, a computer-readable storage medium is provided, on which computer instructions are stored, and the computer instructions are used to enable a processor to implement the file quality verification method provided by any embodiment of the present invention when executed.

[0023] The technical solution in the embodiment of the present invention is aimed at a bypass machine with a retrieval service deployed, by obtaining file information for describing a bypass index file corresponding to the retrieval service loaded on the bypass machine; when it is determined that the bypass index file is to be verified according to the file information, bypass information is obtained from the bypass machine based on the data identifier, and benchmark information is obtained from a benchmark machine with a retrieval service deployed and loaded with a benchmark index file corresponding to the retrieval service, the bypass information is used to describe the bypass index data corresponding to the data identifier stored in the bypass index file, the benchmark information is used to describe the benchmark index data corresponding to the data identifier stored in the benchmark index file, and the data identifier is used to characterize the data retrieved through the retrieval service based on the bypass index file or the benchmark index file; the file quality of the bypass index file is verified according to the bypass information and the benchmark information. The above technical solution realizes file quality verification, and the verification result obtained thereby can not only reflect the quality of the bypass index file itself, but also reflect the degree of influence of the bypass index file on the retrieval service, and has good online application value.

[0024] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0026] Figure 1 is a flow chart of a file quality verification method provided according to an embodiment of the present invention;

[0027] Figure 2 is a flow chart of another file quality verification method provided according to an embodiment of the present invention;

[0028] Figure 3 is a flow chart of another file quality verification method provided according to an embodiment of the present invention;

[0029] Figure 4 is a flow chart of another file quality verification method provided according to an embodiment of the present invention;

[0030] Figure 5 is a schematic diagram of a difference verification tool in another file quality verification method provided according to an embodiment of the present invention;

[0031] Figure 6 is a schematic diagram of an example of file quality verification in another file quality verification method provided according to an embodiment of the present invention;

[0032] Figure 7 is a structural block diagram of a file quality verification device provided according to an embodiment of the present invention;

[0033] Figure 8 It is a structural schematic diagram of an electronic device for implementing the file quality verification method according to an embodiment of the present invention. DETAILED DESCRIPTION

[0034] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0035] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. The situations of "target", "original", etc. are similar and will not be repeated here. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0036] Figure 1 This is a flowchart of a file quality verification method provided in an embodiment of the present invention. This embodiment is applicable to the case of verifying the file quality of bypass index files, and is particularly applicable to the case of verifying the degree of impact of bypass index files on retrieval services. The method can be executed by a file quality verification device provided in an embodiment of the present invention, which can be implemented in software and / or hardware, and can be integrated in an electronic device, which can be various user terminals or servers.

[0037] See also Figure 1 The method of the embodiment of the present invention specifically includes the following steps:

[0038] S110. For a bypass machine where a search service is deployed, obtain file information, wherein the file information is used to describe a bypass index file corresponding to the search service loaded on the bypass machine.

[0039] Among them, for at least two machines respectively deployed with retrieval services, the bypass machine can be understood as a machine selected from the at least two machines and pre-applied as the test environment. In actual applications, optionally, the at least two machines work in an online environment. The bypass index file can be understood as an index file corresponding to the retrieval service loaded on the bypass machine, and in particular can be understood as a full index file corresponding to the retrieval service. The file information can be understood as information used to describe the bypass index file, for example, it can be at least one of the first file identifier, file size, file type, file version, and file generation time, etc. This can be set according to actual conditions and is not specifically limited here.

[0040] S120, when it is determined according to the file information that the bypass index file is to be verified, based on the data identifier, obtaining bypass information from the bypass machine, and obtaining reference information from the reference machine;

[0041] The bypass information is used to describe the bypass index data corresponding to the data identifier stored in the bypass index file;

[0042] A retrieval service is deployed on the benchmark machine and a benchmark index file corresponding to the retrieval service has been loaded, and the benchmark information is used to describe the benchmark index data corresponding to the data identifier stored in the benchmark index file;

[0043] Data identifier, used to represent data retrieved through the retrieval service based on the bypass index file or the base index file.

[0044] Among them, the reference machine can be understood as a machine selected from the at least two machines and pre-applied as a reference environment, that is, a retrieval service is also deployed on the reference machine. The reference index file can be understood as the index file of the corresponding retrieval service loaded on the reference machine, and in particular can be understood as a full index file that has been successfully verified. In actual applications, optionally, under normal circumstances, the index files loaded on the machines other than the bypass machine among the at least two machines are all reference index files, that is, the file versions of the index files loaded on these machines are the same, and the file version of the bypass index file loaded on the bypass machine may be the same or higher than the file version of the reference index file, which is not specifically limited here. On this basis, combined with the application scenarios that may be involved in the embodiments of the present invention, when the file version of the bypass index file is higher than the file version of the reference index file, the bypass index file is usually an index file with verification requirements that is updated on the basis of the reference index file.

[0045] The retrieval service deployed on the bypass machine can perform retrieval based on the bypass index file loaded on the bypass machine, that is, provide retrieval service; correspondingly, the retrieval service deployed on the reference machine can perform retrieval based on the reference index file loaded on the reference machine. On this basis, the data identifier can be used to characterize the data retrieved by the retrieval service, and such data can also be called result data.

[0046] When it is determined that the bypass index file needs to be verified (i.e., storage verification requirement) based on the file information, the bypass information can be obtained from the bypass machine based on the data identifier, and the reference information can be obtained from the reference machine. The bypass information can be used to describe the bypass index data corresponding to the data identifier (i.e., associated with the data represented by the data identifier) ​​in all the index data stored in the bypass index file, and the reference information can be used to describe the reference index data corresponding to the data identifier in all the index data stored in the reference index file.

[0047] S130: Verify the file quality of the bypass index file according to the bypass information and the benchmark information.

[0048] Among them, according to the above description, the bypass index file corresponding to the bypass information needs to be verified, while the benchmark index file corresponding to the benchmark information has been successfully verified. Therefore, the file quality verification process of the bypass index file can be implemented based on the bypass information and the benchmark information.

[0049] It should be noted that since the bypass information is information determined based on the data actually retrieved by the retrieval service based on the bypass index file, and the benchmark information is information determined based on the data actually retrieved by the retrieval service based on the benchmark index file, the verification results obtained based on the two can not only reflect the quality of the bypass index file itself, but also reflect the degree of impact of the bypass index file on the retrieval service compared to the benchmark index file, and have good online application value.

[0050] In addition, the above technical solution has at least the following advantages:

[0051] 1. Perform file quality verification based on the data actually retrieved by the retrieval service without the need for manual data construction, that is, there is no need for relevant personnel to collect additional test cases, thereby reducing labor costs.

[0052] 2. During the file quality verification process, there is no need to apply request data, which solves the problem of unstable verification results caused by complex and changeable request data.

[0053] 3. There is no need to build an additional test environment (i.e. verification environment). File quality verification can be performed directly based on the benchmark machine and bypass machine in the online environment, with low labor costs.

[0054] 4. It is only necessary to compare the bypass index data corresponding to the data identifier in the bypass index file with the benchmark index data corresponding to the data identifier in the benchmark index file, without directly comparing between GB-level index files, thereby ensuring the controllability of the comparison performance in actual situations.

[0055] 5. Online verification can be realized, which helps to directly release the product online if the verification is successful.

[0056] 6. Automatic verification can be realized, thereby ensuring the verification efficiency and thus ensuring the efficiency of release and online release.

[0057] The technical solution in the embodiment of the present invention is aimed at a bypass machine with a retrieval service deployed, by obtaining file information for describing a bypass index file corresponding to the retrieval service loaded on the bypass machine; when it is determined that the bypass index file is to be verified according to the file information, bypass information is obtained from the bypass machine based on the data identifier, and benchmark information is obtained from a benchmark machine with a retrieval service deployed and loaded with a benchmark index file corresponding to the retrieval service, the bypass information is used to describe the bypass index data corresponding to the data identifier stored in the bypass index file, the benchmark information is used to describe the benchmark index data corresponding to the data identifier stored in the benchmark index file, and the data identifier is used to characterize the data retrieved through the retrieval service based on the bypass index file or the benchmark index file; the file quality of the bypass index file is verified according to the bypass information and the benchmark information. The above technical solution realizes file quality verification, and the verification result obtained thereby can not only reflect the quality of the bypass index file itself, but also reflect the degree of influence of the bypass index file on the retrieval service, and has good online application value.

[0058] An optional technical solution, after verifying the file quality of the bypass index file according to the bypass information and the benchmark information, the file quality method further includes:

[0059] The verification result of the file quality is obtained, and based on the preset distribution method, the verification result is distributed to the target terminal to display the verification result.

[0060] Among them, after verifying the file quality of the bypass index file according to the bypass information and the benchmark information, the verification result of the file quality can be obtained. In practical applications, the verification result can be optionally a verification success or a verification failure. The former can be used to indicate that the bypass index file has little impact on the retrieval service and can be published online, that is, loaded onto the machine for application; correspondingly, the latter can be used to indicate that the bypass index file has a greater impact on the retrieval service and is an unqualified bypass index file that cannot be published online.

[0061] The preset distribution method can be understood as a preset method for distributing the verification results to the target terminal, such as email and / or instant message, etc. Based on the preset distribution method, the verification results are distributed to the target terminal, so that the verification results can be displayed through the target terminal, so that relevant personnel can receive the verification results in time, and then abnormal bypass index files can be checked in time.

[0062] Figure 2 It is a flow chart of another file quality verification method provided in an embodiment of the present invention. This embodiment is optimized based on the above-mentioned technical solutions. In this embodiment, optionally, when it is determined that the bypass index file is to be verified based on the file information, the bypass information is obtained from the bypass machine based on the data identifier, and the benchmark information is obtained from the benchmark machine, including: when it is determined that the bypass index file is the latest index file and is to be verified based on the file information, the bypass information is obtained from the bypass machine based on the data identifier, and the benchmark information is obtained from the benchmark machine, wherein the latest index file is the latest version of the index file corresponding to the retrieval service. Among them, the explanations of the terms that are the same as or corresponding to the above-mentioned embodiments are not repeated here.

[0063] See also Figure 2 The method of this embodiment may specifically include the following steps:

[0064] S210. Obtain file information for a bypass machine on which a search service is deployed, wherein the file information is used to describe a bypass index file corresponding to the search service that has been loaded on the bypass machine.

[0065] S220. When it is determined according to the file information that the bypass index file is the latest index file and is to be verified, the bypass information is obtained from the bypass machine based on the data identifier, and the reference information is obtained from the reference machine.

[0066] The latest index file is the latest version of the index file corresponding to the search service;

[0067] The bypass information is used to describe the bypass index data corresponding to the data identifier stored in the bypass index file;

[0068] A retrieval service is deployed on the benchmark machine and a benchmark index file corresponding to the retrieval service has been loaded, and the benchmark information is used to describe the benchmark index data corresponding to the data identifier stored in the benchmark index file;

[0069] Data identifier, used to represent data retrieved through the retrieval service based on the bypass index file or the base index file.

[0070] Among them, according to the above description, in order to ensure the accuracy of the search results, the search service needs to load the latest index file for online application. Therefore, when the bypass index file is the latest index file and is to be verified, the bypass index file can be verified for file quality, thereby ensuring that the file quality verification process implemented each time has practical application value. It can be understood that the latest index file is the latest version of the index file corresponding to the search service.

[0071] S230: Verify the file quality of the bypass index file according to the bypass information and the benchmark information.

[0072] The technical solution of the embodiment of the present invention can ensure that each file quality verification process implemented has practical application value by performing file quality verification on the bypass index file when the bypass index file is the latest index file and is to be verified.

[0073] An optional technical solution, wherein the file information includes a first file identifier of a bypass index file, and when it is determined according to the file information that the bypass index file is the latest index file and is to be verified, the bypass information is obtained from the bypass machine based on the data identifier, and the reference information is obtained from the reference machine, including:

[0074] Obtain an identification file, wherein the identification file stores a verification identification and a second file identification of the latest index file;

[0075] When the first file identifier is the same as the second file identifier and the verification identifier is used to represent the file to be verified, bypass information is obtained from the bypass machine based on the data identifier, and reference information is obtained from the reference machine.

[0076] The first file identifier may be used to uniquely identify the bypass index file. In practical applications, optionally, the first file identifier may be applied based on the file version of the bypass index file.

[0077] Get an identification file (i.e., the last_dump file), which stores a second file identifier and a verification identifier. The second file identifier can be used to identify the latest index file of the corresponding retrieval service; the verification identifier can be used to reflect the verification status of the latest index file, for example, it can be pending verification, verification failure, or verification success, etc., which is not specifically limited here.

[0078] When the first file identifier is the same as the second file identifier, and the verification identifier is used to represent the file to be verified, since the former indicates that the bypass index file is the latest index file corresponding to the retrieval service, and the latter indicates that there is a verification requirement for the latest index file, the combination of the two indicates that the time for file quality verification for the bypass index file is met. Therefore, the bypass information and the benchmark information can be obtained based on the data identifier, and the file quality verification can be performed based on the two.

[0079] The above technical solution can accurately determine the execution time of file quality verification by setting the identification file.

[0080] On this basis, optionally, the above-mentioned file quality verification method further includes:

[0081] The obtained verification result is sent to the index generation service, so that the verification identifier is updated by the index generation service according to the received verification result.

[0082] Among them, the identification file can be maintained through the index generation service. In actual applications, the index generation service can optionally be used to build the index file; further optionally, the index generation service can be deployed on a machine other than the at least two machines mentioned above. After obtaining the verification result, the verification result can be sent to the index generation service, so that the index generation service can update the verification identifier according to the received verification result, for example, updating the verification identifier from pending verification to verification success or verification failure, thereby ensuring the accuracy of the verification identifier, which can assist the reference machine and other machines that have not loaded the bypass index file to accurately determine whether the bypass index file can be loaded based on the verification identifier, thereby achieving the timely online of qualified bypass index files and the timely interception of unqualified bypass index files.

[0083] Alternatively, the index file loading switch pre-configured on the bypass machine is set to the on state, so that the retrieval service deployed on the bypass machine, when detecting that the first file identifier is different from the second file identifier, loads the index file corresponding to the second file identifier as the bypass index file onto the bypass machine. Wherein, when the first file identifier is different from the second file identifier, this indicates that the bypass index file currently loaded on the bypass machine is not the latest index file. In order to implement the file quality verification process of the latest index file through the bypass machine, the index file loading switch (open_norm_guard_monitor) pre-configured on the bypass machine can be set to the on state, which enables the retrieval service to always load the latest index file onto the bypass machine, and at this time, there is no need to pay attention to the verification status of the latest index file, thereby ensuring the timely verification of the file quality of the latest index file.

[0084] In another optional embodiment, the index file loading switch pre-configured on the reference machine is set to a closed state, so that the retrieval service deployed on the reference machine, when detecting that the third file identifier is different from the second file identifier and the verification identifier is used to indicate that the verification is successful, will load the index file corresponding to the second file identifier as a reference index file to the reference machine, wherein the third file identifier is used to describe the reference index file. In other words, by setting the index file loading switch to a closed state, the retrieval service can only load the latest index file that has successfully been verified to the reference machine, thereby solving the problem of long recovery time and easy to cause large losses to downstream systems caused by loading the unqualified latest index file to the reference machine, and realizing the tight coupling of the verification result and the release of the latest index file. In practical applications, optionally, for the machines other than the reference machine and the bypass machine among the at least two machines mentioned above, these machines can also refer to the reference machine to implement the loading process of the latest index file.

[0085] Figure 3 : is a flow chart of another file quality verification method provided in an embodiment of the present invention. This embodiment is optimized based on the above-mentioned technical solutions. In this embodiment, optionally, verifying the file quality of the bypass index file according to the bypass information and the benchmark information may include: performing a difference verification on the file quality of the bypass index file compared with the file quality of the benchmark index file according to the bypass information and the benchmark information. Among them, the explanations of the terms that are the same or corresponding to the above-mentioned embodiments are not repeated here.

[0086] See also Figure 3 The method of this embodiment may specifically include the following steps:

[0087] S310. Obtain file information for a bypass machine on which a search service is deployed, wherein the file information is used to describe a bypass index file corresponding to the search service loaded on the bypass machine.

[0088] S320, when it is determined according to the file information that the bypass index file is to be verified, based on the data identifier, obtaining bypass information from the bypass machine, and obtaining reference information from the reference machine;

[0089] The bypass information is used to describe the bypass index data corresponding to the data identifier stored in the bypass index file;

[0090] A retrieval service is deployed on the benchmark machine and a benchmark index file corresponding to the retrieval service has been loaded, and the benchmark information is used to describe the benchmark index data corresponding to the data identifier stored in the benchmark index file;

[0091] Data identifier, used to represent data retrieved through the retrieval service based on the bypass index file or the base index file.

[0092] S330: Perform a difference check on the file quality of the bypass index file compared with the file quality of the benchmark index file based on the bypass information and the benchmark information.

[0093] Among them, according to the bypass information and the benchmark information, the file quality of the bypass index file is difference-checked (i.e., DIFF check) compared with the file quality of the benchmark index file. Specifically, the DIFF between the benchmark index data and the bypass index data can be compared to obtain the verification result of the file quality of the bypass index file compared with the file quality of the benchmark index file.

[0094] The technical solution of the embodiment of the present invention, the verification result obtained through DIFF verification can reflect the degree of influence of the bypass index file on the retrieval service compared with the baseline index file, which helps to determine whether to update the baseline index file to the bypass index file for online application. This verification method can minimize the impact of the index file update on the retrieval service.

[0095] An optional technical solution, in the case where the file types of the bypass index file and the reference index file are forward index files, the bypass information includes the bypass forward number of forward keywords in the bypass index data, and / or, bypass forward detailed data, and the reference information includes the reference forward number of forward keywords in the reference index data, and / or, reference forward detailed data;

[0096] Accordingly, based on the bypass information and the benchmark information, the file quality of the bypass index file is checked for differences compared with the file quality of the benchmark index file, including:

[0097] According to the bypass positive ranking quantity and the benchmark positive ranking quantity, the positive ranking keyword change rate is obtained;

[0098] According to the bypass forward row detailed data and the benchmark forward row detailed data, the forward row detailed data change rate is obtained;

[0099] Based on the change rate of the keywords in the forward ranking and / or the change rate of the detailed data in the forward ranking, the file quality of the bypass index file is compared with the file quality of the benchmark index file, and a difference check is performed on the file quality of the bypass index file.

[0100] Among them, the bypass positive row number can be understood as the number of positive row keywords (i.e., positive row keys) in the bypass index data. It can be understood that the above positive row keywords can be understood as the positive row keywords involved in the data represented by the data identifier in the bypass index file, that is, they are not necessarily all the positive row keywords in the bypass index file. The meaning of the benchmark positive row number is similar and will not be repeated here.

[0101] The bypass positive row detailed data can be understood as the detailed data related to the above positive row keywords in the bypass index data. Exemplarily, here, taking the advertising system in the background technology as an example, the positive row keyword at this time can be the advertising unit id, then the bypass positive row detailed data may include the material information of the advertising unit represented by the advertising unit id (for example, it may include the material id, material type and material length and width, etc.), plan information (for example, it may include the plan id and plan type, etc.), delivery information (for example, it may include delivery id and delivery deadline, etc.), keyword id, index_source, part-of-speech tagging text_analysis_term_type, search_trigger_source, buy word type bid_word_match_type, index sorting bid, activity sea investment sku_id, advertiser information (for example, it may include advertiser id and advertiser final bid_price, etc.), crowd id and click-through rate ctr, etc. At least one of the above can be set according to actual conditions and is not specifically limited here. The situation of the benchmark positive row detailed data is similar and will not be repeated here. The above advertising unit can also be called advertising material.

[0102] According to the number of bypass positive rows and the number of benchmark positive rows, the positive row keyword change rate is obtained; and / or, according to the bypass positive row detailed data and the benchmark positive row detailed data, the positive row detailed data change rate is obtained. On this basis, the file quality of the bypass index file can be compared with the file quality of the benchmark index file according to the positive row keyword change rate and / or the positive row detailed data change rate.

[0103] The above technical solution realizes the difference verification of the file quality of the forward index file.

[0104] Another optional technical solution, when the file types of the bypass index file and the base index file are inverted index files, the bypass information includes the bypass inverted number of inverted keywords in the bypass index data, and / or the bypass inverted information of each inverted index chain, and the bypass inverted information includes at least one of the bypass inverted length, the bypass inverted weight, and the bypass inverted detailed data;

[0105] The benchmark information may include a benchmark inverted number of inverted keywords in the benchmark index data, and / or benchmark inverted information of each inverted chain, wherein the benchmark inverted information includes at least one of a benchmark inverted length, a benchmark inverted weight, and benchmark inverted detailed data;

[0106] Accordingly, based on the bypass information and the benchmark information, the file quality of the bypass index file is checked for differences compared with the file quality of the benchmark index file, including:

[0107] According to the bypass inversion quantity and the benchmark inversion quantity, the inversion keyword change rate is obtained;

[0108] According to the bypass inversion length and the reference inversion length, the inversion chain length change rate is obtained;

[0109] According to the bypass inverted weight and the base inverted weight, the weight change rate of the inverted chain is obtained;

[0110] Obtaining a sorting overlap rate of data represented by the data identifier according to the bypass inverted detailed data and the reference inverted detailed data;

[0111] The file quality of the bypass index file is checked for difference compared with the file quality of the reference index file according to at least one of a postings keyword change rate, a postings chain length change rate, a postings chain weight change rate, and a sort overlap rate.

[0112] Among them, the bypass reverse number is similar to the bypass positive number, and the reference reverse number is similar to the reference positive number, which will not be repeated here.

[0113] For each postings chain in the bypass index data, the bypass postings information of the postings chain can be used to describe the postings chain, and specifically can include at least one of the bypass postings length, the bypass postings weight, and the bypass postings detailed data, wherein the bypass postings length can be understood as the length of the postings chain, the bypass postings weight can be understood as the weight of the postings chain, and the bypass postings detailed data can be understood as the detailed data contained in the postings chain. The situation of the reference postings information of each postings chain in the reference index data is similar, and will not be described in detail here.

[0114] According to the bypass inverted number and the benchmark inverted number, the inverted keyword change rate is obtained. Exemplarily, the inverted keyword change rate = fabs((cur_size-last_size) / last_size), wherein cur_size may represent the bypass inverted number, and last_size may represent the benchmark inverted number.

[0115] According to the bypass inverted index length and the benchmark inverted index length, the postings chain length change rate is obtained. For example, the postings chain length change rate of a single inverted index chain (i.e., the inverted index chain corresponding to a single inverted keyword) can be calculated first. The calculation process can be specifically referred to the inverted keyword change rate. It can be understood that when a certain inverted keyword does not exist in either the inverted key chain in the bypass index data or the inverted key chain in the benchmark index data, the postings chain length change rate can be recorded as 1; then, the average of the postings chain length change rates of each inverted chain is taken as the final postings chain length change rate.

[0116] According to the bypass postings weight and the base postings weight, the postings chain weight change rate is obtained. For example, reference may be made to the calculation process of the postings chain length change rate.

[0117] According to the bypass inverted list details and the benchmark inverted list details, the sorting overlap rate of the data represented by the data identifier is obtained. It should be noted that the inverted keyword change rate, the inverted chain length change rate and the inverted chain weight change rate are all unrelated to the "sort position" in the inverted chain, and the "sort position" factor must also be considered when reflecting the change rate of the data represented by the data identifier, so the sorting overlap rate indicator is proposed. In order to better understand the above indicators, the above data is an advertising unit as an example for explanation.

[0118] Exemplarily, the advertising unit overlap rate = the number of common advertising units in two postings chains / the number of advertising units in the two postings chains, and the two postings chains may be corresponding postings chains in the bypass index data and the reference index data. For example, for postings chain A and postings chain B, the advertising units of postings chain A are {a, b, c, d, e}, and the advertising units of postings chain B are {b, a, f, h, e}, then the advertising unit overlap rate = 3 / 5.

[0119] On this basis, i is used here to represent the depth, which can be specifically understood as the first i postings nodes in the postings chain, thus reflecting the importance of position. n represents the number of postings nodes in the postings chain, which is similar to the ad unit overlap rate. For example, for postings chain A and postings chain C, the ad units of postings chain C are {b,a,f,d,g}, then

[0120] On this basis, the file quality of the bypass index file can be checked for difference compared with the file quality of the benchmark index file based on at least one of the inverted keyword change rate, the inverted index chain length change rate, the inverted index chain weight change rate and the sorting overlap rate.

[0121] The above technical solution realizes the difference verification of the file quality of the inverted index file.

[0122] Figure 4 It is a flow chart of another file quality verification method provided in an embodiment of the present invention. This embodiment is optimized based on the above-mentioned technical solutions. In this embodiment, optionally, when the retrieval service deployed on the bypass machine exposes a bypass debugging interface, and the retrieval service deployed on the reference machine exposes a reference debugging interface, based on the data identifier, obtaining bypass information from the bypass machine, and obtaining reference information from the reference machine, may include: generating a debugging request based on the data identifier, and sending the debugging request to the bypass debugging interface and the reference debugging interface respectively; receiving the bypass information returned by the bypass debugging interface for the debugging request, and the reference information returned by the reference debugging interface for the debugging request. Among them, the explanations of the terms that are the same or corresponding to the above-mentioned embodiments are not repeated here.

[0123] See also Figure 4 The method of this embodiment may specifically include the following steps:

[0124] S410, acquiring file information from a bypass machine where a search service is deployed;

[0125] The file information is used to describe the bypass index file corresponding to the retrieval service that has been loaded on the bypass machine. The retrieval service deployed on the bypass machine exposes a bypass debugging interface.

[0126] The bypass debugging interface can be understood as an interface exposed by the search service deployed on the bypass machine. In practical applications, optionally, the bypass debugging interface can be used to view details of the bypass index data stored in the bypass index file loaded on the bypass machine.

[0127] S420: when it is determined according to the file information that the bypass index file is to be verified, a debugging request is generated based on the data identifier, and the debugging request is sent to the bypass debugging interface and the reference debugging interface respectively;

[0128] The benchmark debugging interface includes a debugging interface exposed by a retrieval service deployed on a benchmark machine, and a benchmark index file corresponding to the retrieval service has been loaded on the benchmark machine;

[0129] Data identifier, used to represent data retrieved through the retrieval service based on the bypass index file or the base index file.

[0130] Among them, the benchmark debugging interface can be understood as the interface exposed by the retrieval service deployed on the benchmark machine. In actual applications, optionally, the details of the benchmark index data stored in the benchmark index file loaded on the benchmark machine can be viewed through the benchmark debugging interface. It should be noted that the retrieval service deployed on the bypass machine is essentially the same as the retrieval service deployed on the benchmark machine. Therefore, the bypass debugging interface and the benchmark debugging interface are essentially debugging interfaces (i.e., DEBUG interfaces). The distinction here is only made in naming to distinguish the debugging interfaces on different machines, and it is not a specific limitation on their essential meanings.

[0131] A debugging request (i.e., debug request) is generated based on the data identifier, i.e., the generated debugging request carries the data identifier; then, the debugging request is sent to the bypass debugging interface and the benchmark debugging interface respectively, i.e., the bypass debugging interface is called through the debugging request to obtain the bypass information, and the benchmark debugging interface is called through the debugging request to obtain the benchmark information.

[0132] S430, respectively receiving bypass information returned by the bypass debugging interface for the debugging request, and baseline information returned by the baseline debugging interface for the debugging request;

[0133] The bypass information is used to describe the bypass index data corresponding to the data identifier stored in the bypass index file, and the reference information is used to describe the reference index data corresponding to the data identifier stored in the reference index file.

[0134] S440: Verify the file quality of the bypass index file according to the bypass information and the benchmark information.

[0135] The technical solution of the embodiment of the present invention develops a debugging interface for the retrieval service in advance, so that the bypass information of the bypass index data and the benchmark information of the benchmark index data can be viewed based on the debugging interface, thereby achieving the effect of effectively obtaining the bypass information and the benchmark information.

[0136] Before introducing the following technical solutions, we will take the advertising system as an example to illustrate its application scenarios. For example, in actual applications, the advertising system may involve one or more businesses (i.e., business platforms / business lines), such as search, recommendation, top focus, and off-site. In order to improve the access efficiency of various businesses, various businesses can be accessed in a configurable manner, as shown in Table 1 below.

[0137] Table 1 Service access configuration example

[0138]

[0139]

[0140] On this basis, optionally, each of the multiple types of business has its own corresponding search service. The common point of these search services is that they are based on the index files corresponding to themselves for search, but the specific search logic may be different. Optionally, for each of the multiple types of business, the online environment is deployed with multiple machines corresponding to the type of business, that is, each of the multiple machines is deployed with a search service matching the type of business. In actual applications, two machines can be selected from the multiple machines, one of which is used as a bypass machine and the other as a reference machine for application.

[0141] An optional technical solution is to send the debugging request to the bypass debugging interface and the base debugging interface respectively, including:

[0142] For services corresponding to the bypass machine and the reference machine, obtaining configuration information pre-configured for the services, wherein the configuration information at least includes a bypass Internet Protocol (IP) of the bypass machine and a reference Internet Protocol of the reference machine;

[0143] The debug request is sent to the bypass debug interface according to the bypass Internet protocol, and the debug request is sent to the base debug interface according to the base Internet protocol.

[0144] In other words, by obtaining the bypass IP of the bypass machine and the reference IP of the reference machine to locate the machine, the debugging request can be sent to the bypass debugging interface based on the bypass IP, and the debugging request can be sent to the reference debugging interface based on the reference IP, thereby achieving effective sending of the debugging request. Moreover, the above technical solution is connected to various businesses in a configurable manner, which makes the above file quality verification process quickly applicable to various businesses, with better versatility and scalability.

[0145] In order to better understand the above-mentioned technical solutions as a whole, an advertising system is taken as an example to illustrate it. Before the formal explanation, it should be emphasized that the advertising system is just an example, and the above-mentioned technical solutions can also be applied to other scenarios involving retrieval services, such as e-commerce platforms, logistics systems, and book management systems, etc., which are not specifically limited here.

[0146] For example, in order to ensure the safe and fast launch of the full index files loaded by the retrieval service during the promotion and daily periods of the advertising system, the NormGuard launch mechanism is implemented through basic service transformation and the full business line of the advertising system (such as search, recommendation, top focus and off-site), which ensures the timely verification and release of the forward and reverse index files of the advertising materials after the update, thereby realizing the index file correctness guarantee technology that integrates file quality verification, result data collection, automatic release and abnormal active interception. The main contents and achievements of this technical solution are as follows:

[0147] 1 Basic service transformation and evaluation algorithm setting

[0148] To ensure scalability, we first upgrade the index generation service and retrieval service:

[0149] Index generation service upgrade

[0150] The last_dump file storage logic is added to the full index file update logic to record the file version of each full index file change. The path is at the same level as the outer directory of the existing full index file. When the index generation service stores the last_dump file or updates the file content of the last_dump file, the first column must contain the file version of the full index file under each file version, and the second column must contain the verification flag (for example, empty for pending verification, 0 for verification failure, and 1 for verification success).

[0151] Before verification: entire_1-1628794805356000

[0152] After verification: entire_1-1628794805356000 1

[0153] Retrieve service switch settings

[0154] Turn on the open_norm_guard_monitor configuration switch to ensure that the newly generated full index file is always loaded to become the test environment, and the loading results can be viewed through the DEBUG interface.

[0155] Logic upgrade for loading full index files in search service

[0156] The logic of loading the full index file is divided into two states: open and closed. In the open state, the retrieval service always loads the latest index file; in the closed state, the retrieval service periodically scans the last_dump file. If the check mark in the last_dump file is 1, the check is considered successful, and the retrieval service loads the latest index file; if the check mark is 0, the check is considered failed, and the latest index file is skipped; if the check mark is empty, the latest index file is also skipped.

[0157] Development of debug interface for search service

[0158] The information returned by the DEBUG interface corresponding to the forward index file may include: the forward number of the forward key and the forward detailed data of the advertising unit.

[0159] The information returned by the DEBUG interface corresponding to the inverted index file may include: the inverted number of the inverted key, the inverted length of each inverted chain, the inverted weight, and the inverted detailed data of the ad unit.

[0160] The above information returned by the DEBUG interface can be used to calculate evaluation indicators and determine the DIFF rate.

[0161] Development of positive ranking evaluation algorithm and reverse ranking evaluation algorithm

[0162] Evaluation indicators of the forward index file may include: forward key change rate and forward detailed data change rate.

[0163] The evaluation indicators of inverted index files are more complicated. Since inverted index files are ordered lists, we can start with similarity measurement indicators, which may include: inverted key change rate, inverted index chain length change rate, inverted index chain length change rate and ad unit sorting overlap rate.

[0164] NormGuard validation framework configuration settings

[0165] As the core of this example, the NormGuard verification framework uses the basic capabilities of the service side and the evaluation algorithm side that have been implemented in the previous steps to initiate verification and complete efficient release for each business line in the advertising system. On this basis, in order to improve the access efficiency of each business line, the NormGuard verification framework supports access to each business line in a configured manner. The specific example is shown above.

[0166] DIFF Verification Tool (Difference Verification Tool) Settings

[0167] See also Figure 5 , the DIFF verification tool obtains the ad unit ID from the ad exposure click log (i.e., the ad unit ID retrieved through the search service), and then sends a debug request carrying the ad unit ID to the benchmark machine randomly sampled from the online environment and the selected bypass machine, respectively, so that the above string of information can be obtained by calling the DEBUG interface exposed by the search service. In actual applications, for special businesses, the information returned by the DEBUG interface can be configured in the DIFF verification tool configuration file to ignore fields (for example, dynamic population id and timestamp, etc.) and ignore fields under the hierarchy, supporting strong and weak verification modes (classified as DIFF if any condition is met or classified as DIFF if none of the conditions are met).

[0168] 2 Overall deployment of technical solutions, see Figure 6

[0169] Retrieval service started

[0170] For each of the multiple business lines, a bypass machine is elected when the online environment of the business line is deployed through the zookeeper lock grabbing mechanism. The successfully elected bypass machine can turn on the open_norm_guard_monitor configuration switch in the memory to always load the latest index file. Through this mechanism, it can be ensured that each business platform has a machine responsible for loading the latest index file to provide a test environment, without manual intervention in deployment, and with low labor costs.

[0171] NormGuard verification framework operation

[0172] The NormGuard verification framework can be divided into two parts: NormGuard Checker and NormGuard Worker.

[0173] NormGuard Checker regularly scans the last_dump file in the network disk and obtains the file version of the bypass index file loaded on the bypass machine. When it detects that the file version of the bypass index file is consistent with the file version of the latest index file recorded in the last_dump file on the network disk, and the latest index file has not been verified, the check logic is triggered. It is understandable that the full index file is very large, so it can be processed in pieces in actual applications, for example Figure 6 The shards shown as 0, 1, 2…15 under the network disk.

[0174] NormGuard Worker is responsible for receiving the difference verification tasks issued by NormGuard Checker, thereby executing specific DIFF verification logic.

[0175] Email distribution module deployment

[0176] If the DIFF rate of the forward index file and the DIFF rate of the inverted index file are both lower than the preset threshold, the verification is successful and the success mark is written to the last_dump file. Otherwise, the verification fails and the failure mark is written to the last_dump file. Whether the verification is successful or failed, it can trigger email and instant message push. Click the email link to view the details after the DIFF verification, and back up the historical report to facilitate problem tracing. After receiving the abnormal email, if the relevant personnel confirm that it is a problem with the full index file, they can initiate troubleshooting of the upstream link problem and re-trigger the full index file processing.

[0177] Full index file takes effect online

[0178] After completing the deployment of the above modules, you can provide verification and release of the forward and reverse index files of advertising materials around the clock. The online retrieval service regularly detects the success mark in the last_dump file. When the file version of the full index file changes and the verification is successful, the full index file will be released and loaded online.

[0179] Any full index file that fails verification will not be loaded by the search service and requires R&D intervention to troubleshoot.

[0180] Automated operation and maintenance tools for emergency response

[0181] Supports re-running tasks and forcing task success when verification results are untrustworthy.

[0182] 3 Test Conclusion

[0183] By using the file quality verification method shown in this example, the verification and launch of the GB-level advertising material forward and reverse index files can be completed within 1 minute, and access can be completed on multiple business platforms of the advertising system. The operating availability rate during the promotion and daily periods is as high as 99.9%, and the release and launch of non-compliant full index files have been intercepted many times. After the distributed index architecture on the advertising side is upgraded, it can be quickly adapted at a very low transformation cost. In general, it is a universal and unified full index file correctness assurance technology across business platforms, which realizes the verification and launch of full index files with high reliability and efficiency.

[0184] Figure 7 This is a structural block diagram of a file quality verification device provided in an embodiment of the present invention. The device is used to execute the file quality verification method provided in any of the above embodiments. The device and the file quality verification method of the above embodiments belong to the same inventive concept. For details not described in detail in the embodiment of the file quality verification device, please refer to the embodiment of the above file quality verification method. Figure 7 The device may specifically include: a file information acquisition module 510, a reference information acquisition module 520 and a file quality verification module 530.

[0185] The file information acquisition module 510 is used to acquire file information for a bypass machine where a search service is deployed, wherein the file information is used to describe a bypass index file corresponding to the search service loaded on the bypass machine;

[0186] The reference information acquisition module 520 is used to acquire bypass information from the bypass machine based on the data identifier and acquire reference information from the reference machine when it is determined that the bypass index file is to be verified according to the file information;

[0187] A file quality verification module 530, used to verify the file quality of the bypass index file according to the bypass information and the benchmark information;

[0188] The bypass information is used to describe the bypass index data corresponding to the data identifier stored in the bypass index file, the retrieval service is deployed on the reference machine and the reference index file corresponding to the retrieval service has been loaded, and the reference information is used to describe the reference index data corresponding to the data identifier stored in the reference index file;

[0189] Data identifier, used to represent data retrieved through the retrieval service based on the bypass index file or the base index file.

[0190] Optionally, the reference information acquisition module 520 includes:

[0191] A reference information acquisition unit is used to obtain bypass information from a bypass machine based on a data identifier and to obtain reference information from a reference machine when it is determined that the bypass index file is the latest index file and is to be verified based on file information, wherein the latest index file includes the latest version of the index file corresponding to the retrieval service.

[0192] On this basis, optionally, the file information includes a first file identifier of the bypass index file;

[0193] The benchmark information acquisition unit is specifically used for:

[0194] Obtain an identification file, wherein the identification file stores a verification identification and a second file identification of the latest index file;

[0195] When the first file identifier is the same as the second file identifier and the verification identifier is used to represent the file to be verified, bypass information is obtained from the bypass machine based on the data identifier, and reference information is obtained from the reference machine.

[0196] On this basis, optionally, the above-mentioned document quality verification device further includes:

[0197] The verification result sending module is used to send the obtained verification result to the index generation service, so that the verification identifier is updated according to the received verification result through the index generation service.

[0198] Alternatively, a preconfigured index file loading switch on the bypass machine is set to an on state, so that the retrieval service deployed on the bypass machine, when detecting that the first file identifier is different from the second file identifier, loads the index file corresponding to the second file identifier as a bypass index file onto the bypass machine;

[0199] and / or,

[0200] The index file loading switch pre-configured on the benchmark machine is set to a closed state so that the retrieval service deployed on the benchmark machine, when it detects that the third file identifier is different from the second file identifier and the verification identifier is used to indicate a successful verification, will load the index file corresponding to the second file identifier as a benchmark index file onto the benchmark machine, wherein the third file identifier is used to describe the benchmark index file.

[0201] Optionally, the file quality verification module 530 includes:

[0202] The file quality verification unit is used to perform a difference verification on the file quality of the bypass index file compared with the file quality of the benchmark index file based on the bypass information and the benchmark information.

[0203] On this basis, optionally, in the case where the file types of the bypass index file and the reference index file include a forward index file, the bypass information includes the bypass forward number of the forward keywords in the bypass index data, and / or the bypass forward detailed data, and the reference information includes the reference forward number of the forward keywords in the reference index data, and / or the reference forward detailed data;

[0204] The file quality verification unit is specifically used for:

[0205] According to the bypass positive ranking quantity and the benchmark positive ranking quantity, the positive ranking keyword change rate is obtained;

[0206] According to the bypass forward row detailed data and the benchmark forward row detailed data, the forward row detailed data change rate is obtained;

[0207] Based on the change rate of the keywords in the forward ranking and / or the change rate of the detailed data in the forward ranking, the file quality of the bypass index file is compared with the file quality of the benchmark index file, and a difference check is performed on the file quality of the bypass index file.

[0208] Alternatively, when the file types of the bypass index file and the base index file are inverted index files, the bypass information includes the bypass inverted quantity of the inverted keywords in the bypass index data, and / or the bypass inverted information of each inverted index chain, and the bypass inverted information includes at least one of the bypass inverted length, the bypass inverted weight, and the bypass inverted detailed data;

[0209] The benchmark information includes a benchmark inverted number of inverted keywords in the benchmark index data, and / or benchmark inverted information of each inverted chain, wherein the benchmark inverted information includes at least one of a benchmark inverted length, a benchmark inverted weight, and benchmark inverted detailed data;

[0210] The file quality verification unit is specifically used for:

[0211] According to the bypass inversion quantity and the benchmark inversion quantity, the inversion keyword change rate is obtained;

[0212] According to the bypass inversion length and the reference inversion length, the inversion chain length change rate is obtained;

[0213] According to the bypass inverted weight and the base inverted weight, the weight change rate of the inverted chain is obtained;

[0214] Obtaining a sorting overlap rate of data represented by the data identifier according to the bypass inverted detailed data and the reference inverted detailed data;

[0215] A difference check is performed on the file quality of the bypass index file compared with the file quality of the benchmark index file according to at least one of a postings keyword change rate, a postings chain length change rate, a postings chain weight change rate, and a sort overlap rate.

[0216] Optionally, when the search service deployed on the bypass machine exposes a bypass debugging interface, and the search service deployed on the reference machine exposes a reference debugging interface, the reference information acquisition module 520 includes:

[0217] A debugging request sending unit, used for generating a debugging request based on the data identifier, and sending the debugging request to the bypass debugging interface and the reference debugging interface respectively;

[0218] The reference information receiving unit is used to respectively receive the bypass information returned by the bypass debugging interface for the debugging request and the reference information returned by the reference debugging interface for the debugging request.

[0219] On this basis, optionally, a debugging request sending unit includes:

[0220] A configuration information acquisition subunit, configured to acquire configuration information pre-configured for services corresponding to the bypass machine and the reference machine, wherein the configuration information at least includes a bypass Internet protocol of the bypass machine and a reference Internet protocol of the reference machine;

[0221] The debugging request sending subunit is used to send the debugging request to the bypass debugging interface according to the bypass Internet protocol, and to send the debugging request to the base debugging interface according to the base Internet protocol.

[0222] Optionally, the above-mentioned document quality verification device further includes:

[0223] The verification result distribution module is used to obtain the file quality verification result after verifying the file quality of the bypass index file according to the bypass information and the benchmark information, and distribute the verification result to the target terminal based on a preset distribution method to display the verification result.

[0224] The file quality verification device provided by the embodiment of the present invention obtains file information for describing the bypass index file corresponding to the retrieval service loaded on the bypass machine through a file information acquisition module for a bypass machine with a retrieval service deployed; obtains bypass information from the bypass machine based on a data identifier when it is determined that the bypass index file is to be verified according to the file information, and obtains benchmark information from a benchmark machine with a retrieval service deployed and loaded with a benchmark index file corresponding to the retrieval service, the bypass information is used to describe the bypass index data corresponding to the data identifier stored in the bypass index file, the benchmark information is used to describe the benchmark index data corresponding to the data identifier stored in the benchmark index file, and the data identifier is used to characterize the data retrieved through the retrieval service based on the bypass index file or the benchmark index file; and verifies the file quality of the bypass index file according to the bypass information and the benchmark information through the file quality verification module. The above device realizes file quality verification, and the verification result obtained thereby can not only reflect the quality of the bypass index file itself, but also reflect the degree of influence of the bypass index file on the retrieval service, and has good online application value.

[0225] The file quality verification device provided in the embodiment of the present invention can execute the file quality verification method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0226] It is worth noting that in the embodiment of the above-mentioned file quality verification device, the various units and modules included are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of the present invention.

[0227] Figure 8 A schematic diagram of the structure of an electronic device 10 that can be used to implement an embodiment of the present invention is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or required herein.

[0228] like Figure 8As shown, the electronic device 10 includes at least one processor 11, and a memory connected to the at least one processor 11, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 to the random access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other through a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0229] A number of components in the electronic device 10 are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0230] The processor 11 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 11 executes the various methods and processes described above, such as a file quality verification method.

[0231] In some embodiments, the file quality verification method may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the file quality verification method described above may be performed. Alternatively, in other embodiments, the processor 11 may be configured to execute the file quality verification method in any other appropriate manner (e.g., by means of firmware).

[0232] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0233] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine as a stand-alone software package and partially on a remote machine, or entirely on a remote machine or server.

[0234] In the context of the present invention, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in combination with an instruction execution system, device or equipment. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0235] To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0236] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0237] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.

[0238] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.

[0239] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A file quality verification method, characterized in that: include: For a bypass machine where a search service is deployed, file information is obtained, wherein the file information is used to describe a bypass index file corresponding to the search service that has been loaded on the bypass machine; When it is determined according to the file information that the bypass index file is to be verified, based on the data identifier, obtaining bypass information from the bypass machine, and obtaining reference information from the reference machine; Verifying the file quality of the bypass index file according to the bypass information and the benchmark information; The bypass information is used to describe the bypass index data corresponding to the data identifier stored in the bypass index file, the retrieval service is deployed on the reference machine and the reference index file corresponding to the retrieval service has been loaded, and the reference information is used to describe the reference index data corresponding to the data identifier stored in the reference index file; The data identifier is used to represent the data retrieved through the retrieval service based on the bypass index file or the reference index file.

2. The method according to claim 1, characterized in that When it is determined according to the file information that the bypass index file is to be verified, based on the data identifier, obtaining the bypass information from the bypass machine, and obtaining the reference information from the reference machine, comprises: When it is determined according to the file information that the bypass index file is the latest index file and is to be verified, the bypass information is obtained from the bypass machine based on the data identifier, and the benchmark information is obtained from the benchmark machine, wherein the latest index file is the latest version of the index file corresponding to the retrieval service.

3. The method according to claim 2, characterized in that The file information includes a first file identifier of the bypass index file, and when it is determined according to the file information that the bypass index file is the latest index file and is to be verified, based on the data identifier, obtaining the bypass information from the bypass machine, and obtaining the reference information from the reference machine, comprises: Obtaining an identification file, wherein the identification file stores a verification identification and a second file identification of a latest index file; When the first file identifier is the same as the second file identifier and the verification identifier is used to represent the object to be verified, bypass information is obtained from the bypass machine based on the data identifier, and reference information is obtained from the reference machine.

4. The method according to claim 3, characterized in that Also includes: The obtained verification result is sent to the index generation service, so that the verification identifier is updated according to the received verification result through the index generation service.

5. The method according to claim 3 or 4, characterized in that: The index file loading switch pre-configured on the bypass machine is set to an on state, so that the search service deployed on the bypass machine, when detecting that the first file identifier is different from the second file identifier, loads the index file corresponding to the second file identifier as the bypass index file to the bypass machine; and / or, The index file loading switch pre-configured on the reference machine is set to a closed state so that the retrieval service deployed on the reference machine, when detecting that the third file identifier is different from the second file identifier and the verification identifier is used to indicate a successful verification, will load the index file corresponding to the second file identifier as the reference index file onto the reference machine, wherein the third file identifier is used to describe the reference index file.

6. The method according to claim 1, characterized in that The verifying the file quality of the bypass index file according to the bypass information and the benchmark information includes: According to the bypass information and the reference information, a difference check is performed on the file quality of the bypass index file compared with the file quality of the reference index file.

7. The method according to claim 6, characterized in that In the case where the file types of the bypass index file and the reference index file include a forward index file, the bypass information includes the number of bypass forward keywords in the bypass index data, and / or bypass forward detailed data; The benchmark information includes the benchmark positive ranking quantity of the positive ranking keywords in the benchmark index data, and / or benchmark positive ranking detailed data; The performing a difference check on the file quality of the bypass index file compared with the file quality of the benchmark index file according to the bypass information and the benchmark information includes: According to the bypass positive ranking quantity and the reference positive ranking quantity, a positive ranking keyword change rate is obtained; Obtaining a positive row detailed data change rate according to the bypass positive row detailed data and the reference positive row detailed data; According to the change rate of the forward keywords and / or the change rate of the forward detailed data, a difference check is performed on the file quality of the bypass index file compared with the file quality of the benchmark index file.

8. The method according to claim 6, characterized in that In the case that the file types of the bypass index file and the base index file include inverted index files, the bypass information includes the bypass inverted quantity of the inverted keywords in the bypass index data, and / or the bypass inverted information of each inverted index chain, and the bypass inverted information includes at least one of the bypass inverted length, the bypass inverted weight, and the bypass inverted detailed data; The benchmark information includes a benchmark inverted number of inverted keywords in the benchmark index data, and / or benchmark inverted information of each inverted chain, wherein the benchmark inverted information includes at least one of a benchmark inverted length, a benchmark inverted weight, and benchmark inverted detailed data; The performing a difference check on the file quality of the bypass index file compared with the file quality of the benchmark index file according to the bypass information and the benchmark information includes: Obtaining a reverse keyword change rate according to the bypass reverse number and the benchmark reverse number; Obtaining a change rate of inverted chain length according to the bypass inverted length and the reference inverted length; Obtaining a postings chain weight change rate according to the bypass postings weight and the benchmark postings weight; Obtaining, according to the bypass inverted detailed data and the reference inverted detailed data, a sorting overlap rate of the data represented by the data identifier; A difference check is performed on the file quality of the bypass index file compared with the file quality of the reference index file according to at least one of the postings keyword change rate, the postings chain length change rate, the postings chain weight change rate and the sorting overlap rate.

9. The method according to claim 1, characterized in that: In a case where the retrieval service deployed on the bypass machine exposes a bypass debugging interface, and the retrieval service deployed on the reference machine exposes a reference debugging interface, the acquiring of bypass information from the bypass machine based on the data identifier, and the acquiring of reference information from the reference machine, include: Generate a debugging request based on the data identifier, and send the debugging request to the bypass debugging interface and the reference debugging interface respectively; The bypass information returned by the bypass debugging interface in response to the debugging request and the reference information returned by the reference debugging interface in response to the debugging request are respectively received.

10. The method according to claim 9, characterized in that The sending the debugging request to the bypass debugging interface and the reference debugging interface respectively includes: For the services corresponding to the bypass machine and the reference machine, obtaining configuration information pre-configured for the services, wherein the configuration information at least includes a bypass Internet protocol of the bypass machine and a reference Internet protocol of the reference machine; The debug request is sent to the bypass debug interface according to the bypass Internet protocol, and the debug request is sent to the base debug interface according to the base Internet protocol.

11. The method according to claim 1, characterized in that: After verifying the file quality of the bypass index file according to the bypass information and the benchmark information, the method further includes: The verification result of the file quality is obtained, and based on a preset distribution method, the verification result is distributed to a target terminal to display the verification result.

12. A document quality verification device, characterized in that: include: A file information acquisition module, used to acquire file information for a bypass machine on which a search service is deployed, wherein the file information is used to describe a bypass index file corresponding to the search service that has been loaded on the bypass machine; A reference information acquisition module, configured to acquire bypass information from the bypass machine based on the data identifier and acquire reference information from the reference machine when it is determined that the bypass index file is to be verified according to the file information; A file quality verification module, used to verify the file quality of the bypass index file according to the bypass information and the benchmark information; The bypass information is used to describe the bypass index data corresponding to the data identifier stored in the bypass index file, the retrieval service is deployed on the reference machine and the reference index file corresponding to the retrieval service has been loaded, and the reference information is used to describe the reference index data corresponding to the data identifier stored in the reference index file; The data identifier is used to represent the data retrieved through the retrieval service based on the bypass index file or the reference index file.

13. An electronic device, characterized in that: include: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor executes the file quality verification method according to any one of claims 1 to 11.

14. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the file quality verification method as described in any one of claims 1-11 when executed.

Images