Method, device, electronic device and storage medium for determining contribution of difference rate
By filtering multiple access requests and calculating the difference rate of the distributed search engine system, the problem of inconsistency in search results caused by the difference rate in the system is solved, and the contribution of the specified service difference rate is achieved is achieved, which improves the reliability and user experience of the system.
Patent Information
- Application Number
- CN202311246127.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-09-25
- Publication Date
- 2025-03-25
- Estimated Expiration
- 2043-09-25
AI Technical Summary
The difference rate problem in distributed search engine systems due to massive changes and abnormalities leads to inconsistent search results of the same search request, which affects the reliability and user experience of the system.
By filtering multiple access requests, the first difference rate and the second difference rate of the distributed search engine system are obtained. The second difference rate is the difference rate after data leveling is processed in the intermediate response results of the specified service, and then the difference rate contribution of the specified service is calculated.
Accurately and effectively obtain the contribution of the difference rate of each specified service in a distributed search engine system, help analyze and optimize the system, and improve the consistency of search results and the stability of the system.
Smart Images

Figure CN117473007B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of computer technology, specifically to technical fields such as cloud computing and intelligent search, and in particular to a method, device, electronic device and storage medium for determining a contribution of a difference rate. Background Art
[0002] In a large-scale distributed search engine system, there are a large number of changes and anomalies every day, which leads to differences in search results for the same request, and then the diff rate of the distributed search engine system is greater than 0. The larger the diff rate of the distributed search engine system, the greater the risk of inconsistent search results for the same search request.
[0003] The existing distributed search engine system is very large, including multiple levels of services, and each level of service may cause differences in search results. Summary of the invention
[0004] The present disclosure provides a method, device, electronic device and storage medium for determining a contribution of a difference rate.
[0005] According to one aspect of the present disclosure, a method for determining a contribution of a difference rate is provided, comprising:
[0006] Based on a plurality of access requests screened according to a preset condition, obtaining a first difference rate of the distributed search engine system;
[0007] Based on the multiple access requests, a second difference rate of the distributed search engine system is obtained by performing data flattening processing on an intermediate response result of a designated service of the distributed search engine system as an intervention condition; the designated service is a service at any level of the distributed search engine system;
[0008] Based on the first difference rate and the second difference rate, the contribution of the difference rate of the designated service is obtained to identify the contribution degree of the designated service to the difference rate of the distributed search engine system.
[0009] According to another aspect of the present disclosure, a device for determining a contribution of a difference rate is provided, comprising:
[0010] A first difference rate acquisition module, configured to acquire a first difference rate of the distributed search engine system based on a plurality of access requests screened according to a preset condition;
[0011] A second difference rate acquisition module is used to acquire a second difference rate of the distributed search engine system based on the multiple access requests and taking data flattening processing of intermediate response results of a designated service of the distributed search engine system as an intervention condition; the designated service is a service of any level in the distributed search engine system;
[0012] The first difference rate contribution acquisition module is used to acquire the difference rate contribution of the specified service based on the first difference rate and the second difference rate to identify the contribution degree of the specified service to the difference rate of the distributed search engine system.
[0013] According to another aspect of the present disclosure, there is provided an electronic device, comprising:
[0014] at least one processor; and
[0015] a memory communicatively connected to the at least one processor; wherein,
[0016] The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method of any possible implementation manner and the aspects described above.
[0017] According to yet another aspect of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to cause the computer to execute the method of the above-mentioned aspect and any possible implementation manner.
[0018] According to yet another aspect of the present disclosure, a computer program product is provided, including a computer program, wherein when the computer program is executed by a processor, the computer program implements the above-mentioned aspects and any possible implementation method.
[0019] According to the technology disclosed in the present invention, the contribution of the difference rate of each designated service in the distributed search engine system can be accurately and effectively obtained.
[0020] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS
[0021] The accompanying drawings are used to better understand the present solution and do not constitute a limitation of the present disclosure.
[0022] Figure 1 is a schematic diagram according to a first embodiment of the present disclosure;
[0023] Figure 2 is a schematic diagram according to a second embodiment of the present disclosure;
[0024] Figure 3 It is a schematic diagram of the architecture of a distributed search engine system provided by the present disclosure;
[0025] Figure 4 is an architecture diagram used in a calculation process of a first difference rate provided by the present disclosure;
[0026] Figure 5 is a schematic diagram of a diff rate provided by the present disclosure;
[0027] Figure 6 is an architecture diagram used in a calculation process of a second difference rate provided by the present disclosure;
[0028] Figure 7 is a schematic diagram of another second difference rate calculation process provided by the present disclosure;
[0029] Figure 8 is a schematic diagram of another diff rate provided by the present disclosure;
[0030] Fig. 9 yes Figure 7 An example diagram of data flattening processing corresponding to the architecture shown;
[0031] Fig.10 yes Figure 7 Another example diagram of data flattening corresponding to the architecture shown;
[0032] Fig.11 is a schematic diagram according to a third embodiment of the present disclosure;
[0033] Fig.12 is a schematic diagram according to a fourth embodiment of the present disclosure;
[0034] Fig.13 yes Figure 7 Another example diagram of data flattening processing corresponding to the architecture shown;
[0035] Fig.14 is a schematic diagram according to a fifth embodiment of the present disclosure;
[0036] Fig.15 is a schematic diagram according to a sixth embodiment of the present disclosure;
[0037] Fig.16 The block diagram is a block diagram of an electronic device for implementing the method of the embodiment of the present disclosure. DETAILED DESCRIPTION
[0038] The following is a description of exemplary embodiments of the present disclosure in conjunction with the accompanying drawings, including various details of the embodiments of the present disclosure to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present disclosure. Similarly, for the sake of clarity and conciseness, descriptions of well-known functions and structures are omitted in the following description.
[0039] Obviously, the described embodiments are only part of the embodiments of the present disclosure, but not all of them. Based on the embodiments of the present disclosure, all other embodiments obtained by ordinary technicians in the field without creative work are within the scope of protection of the present disclosure.
[0040] It should be noted that the terminal devices involved in the embodiments of the present disclosure may include but are not limited to mobile phones, personal digital assistants (PDAs), wireless handheld devices, tablet computers and other smart devices; display devices may include but are not limited to personal computers, televisions and other devices with display functions.
[0041] In addition, the term "and / or" in this article is only a description of the association relationship between the associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.
[0042] The consistency of search results in a distributed search engine system is very important for ensuring a company's revenue and reputation. Therefore, in order to improve the consistency of search results and reduce the diff rate of a distributed search engine system, the contribution of each location in the distributed search engine system to the diff rate can be analyzed to purposefully and specifically repair or upgrade the distributed search engine system, thereby improving the consistency of search results in the distributed search engine system. However, the causes of the diff rate in a distributed search engine system have been difficult to fully analyze, and how to fully and meticulously analyze the contribution of the diff rate has also been a difficult problem in the industry. Therefore, there is an urgent need to provide a relevant solution to determine the contribution of the diff rate in a distributed search engine system.
[0043] The diff rate of a distributed search engine system is a very important indicator for measuring the consistency of the search results of a distributed search engine system. For example, for two identical requests in a request pair, if the search results of the two requests are inconsistent, then it is considered that there is a difference in the search results of the two requests. The diff rate of a distributed search engine system can be calculated by dividing the number of request pairs with differences by the total number of request pairs within a period of time.
[0044] Figure 1 is a schematic diagram according to the first embodiment of the present disclosure; Figure 1 As shown, this embodiment provides a method for determining the contribution of the difference rate, which may specifically include the following steps:
[0045] S101, obtaining a first difference rate of a distributed search engine system based on multiple access requests screened according to preset conditions;
[0046] S102, based on multiple access requests, obtaining a second difference rate of the distributed search engine system by performing data flattening processing on an intermediate response result of a designated service of the distributed search engine system as an intervention condition; the designated service is a service at any level in the distributed search engine system;
[0047] S103: Based on the first difference rate and the second difference rate, obtain a contribution degree of the difference rate of the specified service to identify a contribution degree of the specified service to the difference rate of the distributed search engine system.
[0048] The execution subject of the method for determining the contribution of the difference rate of this embodiment may be a device for determining the contribution of the difference rate, which may be an electronic entity or an application integrated with software. When in use, the device can access the distributed search engine system, obtain the response result to any access request, and then calculate the difference rate; it can also intervene in any level of the service of the distributed search engine system, and then determine the contribution of the difference rate.
[0049] In order to accurately calculate the difference rate of the distributed search engine system, multiple access requests need to be analyzed. For example, when implementing the technical solution of this embodiment, multiple access requests in online traffic can be used for implementation, or multiple access requests in copied traffic can be used for implementation during traffic playback.
[0050] Moreover, since all traffic is used to determine the contribution of the difference rate, the amount of calculation is large, and the preset condition can be configured to filter only a small cluster of traffic from all traffic. For example, based on the preset time period, the identifier of the access request and the time when the access request is received, multiple access requests that meet the requirements can be screened and dyed as a small cluster of traffic participating in the determination of the contribution of the difference rate. For example, the traffic whose last digit of the identifier of the access request is a specified value within the preset time period can be dyed; the traffic whose last digit of the identifier of the access request can be divided by the specified value within the preset time period can also be dyed; or a certain number of access requests can be obtained every T time interval based on the time when the access request is received within the preset time period, and dyed, and so on. In short, no matter what method is used, a small cluster of traffic including multiple access requests can be filtered out from the global traffic. The preset time period of this embodiment can be set according to the actual needs of the specific scenario. For example, it can be set to 1 minute, 5 minutes, 1 hour, etc., which is not limited here.
[0051] The flow coloring of this embodiment may be to add a certain coloring mark to the selected flow to identify the contribution of the access request of the flow to the determination of the difference rate. The coloring mark of this embodiment is not limited and may be in any form.
[0052] The first difference rate of the distributed search engine system in this embodiment is calculated based on multiple access requests screened according to preset conditions, and can be called the overall difference rate of the distributed search engine system.
[0053] The second difference rate of the distributed search engine system is also calculated based on the same multiple access requests, but during the calculation process, the intermediate response results of the designated service of the distributed search engine system are intervened by data balancing. Specifically, the intervention of data balancing can refer to the same access request sharing the intermediate response results on the designated service of the distributed search engine system; that is, the same access request has the same intermediate response results on the designated service of the distributed search engine system.
[0054] Since the above-mentioned intervention condition is added, the change of the second difference rate of the distributed search engine system relative to the first difference rate can be considered to be caused by the data leveling processing of the intermediate response results of the designated service in the intervention condition. Therefore, based on the first difference rate and the second difference rate, the contribution degree of the designated service to the difference rate of the distributed search engine system can be obtained as the contribution degree of the difference rate of the designated service. The contribution degree of the difference rate of the designated service can be used as an important indicator to measure the influence of the designated service on the difference rate of the entire search engine system in the distributed search engine system.
[0055] The method for determining the contribution of the difference rate of the present embodiment, by taking data flattening processing on the intermediate response results of the designated service of the distributed search engine system as the intervention condition, obtains the first difference rate before the intervention of the distributed search engine system and the second difference rate after the intervention, and then obtains the contribution of the difference rate of the designated service based on the first difference rate and the second difference rate. The process of determining the contribution of the difference rate of the designated service is very efficient and reasonable, and can accurately and effectively obtain the contribution of the difference rate of each designated service in the distributed search engine system, so as to facilitate a more accurate analysis of each designated service in the distributed search engine system, which can further help to improve the consistency of search results of the distributed search engine system and the stability of search services.
[0056] Figure 2 is a schematic diagram according to the second embodiment of the present disclosure; this embodiment provides a method for determining the contribution of the difference rate, in the above Figure 1 Based on the technical solutions of the embodiments shown in the figure, the technical solutions of the present disclosure are further described in more detail. Figure 2 As shown, the method for determining the contribution of the difference rate in this embodiment may specifically include the following steps:
[0057] S201, marking different access requests among multiple access requests screened according to preset conditions;
[0058] S202, counting a first number of different access requests among the multiple access requests;
[0059] S203, obtaining a first difference rate of the distributed search engine system based on the first number of the difference access requests and the total number of the plurality of access requests;
[0060] Specifically, when step S201 is implemented, it may include the following steps:
[0061] (a1) for each access request in the plurality of access requests, an access request pair including two identical access requests may be generated;
[0062] Or it can be said that each access request is split into two identical access request pairs; or it can be directly considered as copying an identical access request to form an access request pair. In this way, it is possible to construct an access request pair based on each access request. Multiple access requests can construct multiple access request pairs. And each access request pair includes two identical access requests, which can be called the first access request and the second access request, for example.
[0063] (b1) for each access request pair, obtaining two response results corresponding to the two access requests in the access request pair respectively accessed by the distributed search engine system;
[0064] (c1) If the two response results are different, the corresponding access request is marked as a difference access request; otherwise, no mark is made.
[0065] In the above manner, each different access request among the multiple access requests can be identified.
[0066] Steps S201-S203 are as above Figure 1 A specific implementation of step S101 of the illustrated embodiment. By adopting this method, the first difference rate of the distributed search engine system can be obtained efficiently and accurately.
[0067] S204: for an access request pair corresponding to each access request in the multiple access requests, at a location of a designated service in the distributed search engine system, perform data averaging processing on intermediate response results of two access requests of the access request pair;
[0068] The data flattening processing in this embodiment is a flattening processing based on a designated service. The effect of the data flattening processing may be to flatten the intermediate response results of two access requests at the designated service location so that the intermediate response results of the two access requests at the designated service location are the same.
[0069] The method of generating the access request pair corresponding to each access request can refer to the description of the above step (a1), which will not be repeated here.
[0070] S205. Based on the intermediate response result after the data flattening processing is performed on the designated service, obtain a first response result obtained by the distributed search engine system continuing to respond to the first access request in the access request pair, and a second response result obtained by continuing to respond to the second access request in the access request pair;
[0071] The first response result of this embodiment is the intermediate response result after the distributed search engine system performs data flattening based on the designated service, and continues to respond until the first response result is obtained at the top service of the distributed search engine system. The second response result is generated in the same way as the first response result.
[0072] S206, obtaining a second difference rate of the distributed search engine system response based on the first response result and the second response result corresponding to each access request pair;
[0073] Specifically, when this step is implemented, it may include the following steps:
[0074] (a2) for each access request pair, if the corresponding first response result and the second response result are different, marking the corresponding access request as a differential access request;
[0075] (b2) counting a second number of different access requests among the multiple access requests;
[0076] (c2) Obtaining a second difference rate of the distributed search engine system based on the second number of the difference access requests and the total number of the plurality of access requests.
[0077] Steps (a2)-(c2) are implemented in the same way as the above steps S201-S203 and will not be described in detail here. The second difference rate of the distributed search engine system can be obtained efficiently and accurately.
[0078] By adopting the above steps S204-S206, after performing data averaging based on the intermediate response results of the two access requests for the designated service access request pair, the second difference rate of the distributed search engine system response can be accurately and efficiently obtained.
[0079] S207: Obtain a difference between the first difference rate and the second difference rate as a contribution of the difference rate of the designated service.
[0080] Since the difference between the second difference rate and the first difference rate is caused by the operation of flattening the intermediate response results of the two access requests of each access request pair by the designated service of the distributed search engine system, the difference between the first difference rate and the second difference rate can be used as the contribution of the designated service to the difference rate.
[0081] The method for determining the contribution of the difference rate of the designated service in this embodiment is very accurate and reasonable.
[0082] Figure 3 Schematic diagram of the architecture of a distributed search engine system provided by the present disclosure. Figure 3 As shown, the distributed search engine system can include multiple layers of services. Each layer of services receives the request of the previous layer, and parses the request of the previous layer, which can be split into multiple sub-requests, which are sent to the sub-services that can handle the corresponding sub-requests, and so on, until the last layer of sub-services. When responding, each layer of services receives the response results returned by each sub-service of the next layer, and based on the response results of each sub-service of the next layer, according to the response rules of the service, integrates them into a comprehensive response result, and feeds back to the sub-service of the previous layer, and so on, until the top-level service obtains the final response result.
[0083] For example, Figure 4 1 is a schematic diagram of a first difference rate calculation process provided by the present disclosure. Figure 4 As shown, for each access request query, it is split into queryA and queryB, and queryA and queryB are the same as query. Figure 4The boxes below represent the services of each level of the distributed search engine system, and the overall structure of the attached diagrams of each level Figure 3 According to the above steps S201-S203 of this embodiment, the first difference rate of the distributed search engine system, ie, the first diff rate, can be calculated and obtained. The first diff rate can also be called the large-scale diff rate.
[0084] For example, according to the above method of this embodiment, the market diff rate of each preset time period, such as every minute, can be calculated. For multiple consecutive time periods, the following can be obtained: Figure 5 Schematic diagram of the large disk diff rate shown.
[0085] Figure 6 1 is a schematic diagram of a second difference rate calculation process provided by the present disclosure. Figure 6 As shown, Figure 4 In contrast, data can be flattened for services at a certain level of the distributed search engine system. For example, Figure 7 is an architecture diagram used in another second difference rate calculation process provided by the present disclosure, such as Figure 7 As shown, the data flattening processing of the intermediate response result of service S is taken as an example.
[0086] like Figure 7 As shown in the figure, P1 and P2 are two service instances of a service, providing the same service and belonging to service P; S1 and S2 are also two service instances of a service, providing the same service and belonging to service S. P1 is the parent node of S1, and P2 is the parent node of S2. The query is split into two identical queries at the top service: queryA and queryB. QueryA passes through the P1 and S1 service instances, and queryB passes through the P2 and S2 service instances. The data leveling service module, also known as align-server, is responsible for leveling the intermediate response results of service instances S1 and S2. Specifically, if you want to evaluate the contribution of the service S position on the service PS link to the overall diff rate, then when queryA is processed by service instance S1 and the return result reaches service instance P1, service instance P1 publishes it to the data leveling service module align-server. When queryB reaches service instance P2, service instance P2 no longer requests service instance S2, but directly subscribes to the data published by service instance P1 from the data leveling service module align-server. Figure 7The scenario shown is based on the example that service instance S1 returns the intermediate response result to service instance P1, and service instance P1 publishes it to the data flattening service module. In actual applications, service instance S1 itself can also obtain the intermediate response result and publish it to the data flattening service module, with the same effect.
[0087] After the above data flattening process, according to the above steps S204-S207 of this embodiment, the second difference rate of the distributed search engine system can be obtained. Similarly, in a similar manner, the second diff rate of each preset time period can be calculated. For multiple consecutive time periods, the following can be obtained: Figure 8 The schematic diagram of the second diff rate is shown in FIG. Figure 8 As shown, it can be concluded that the second diff rate is effectively reduced by a certain percentage compared with the first diff rate, that is, the market diff rate.
[0088] Finally, for each preset time period, the difference between the first difference rate and the second difference rate may be directly taken as the contribution of the difference rate of the designated service in the preset time period.
[0089] Further optionally, when step S204 of this embodiment is specifically implemented, it may include the following two different implementations. In the first implementation, a data leveling service module may be used to perform data leveling processing, which may specifically include the following steps:
[0090] (a3) for a first access request in the access request pair, obtaining a first intermediate response result in a process of responding to the first access request using a first service instance of a designated service;
[0091] (b3) using a first service instance of a designated service to send a first data flattening request carrying an access request identifier, a designated service identifier, and a first intermediate response result to a data flattening service module;
[0092] (c3) Using the data flattening service module to perform data flattening processing on the first intermediate response result based on the first data flattening request and the configured designated service identifier, the data flattening processing is performed, and the data flattening processing result is returned to the first service instance of the designated service.
[0093] It should be noted that the designated service identifier that needs to be processed for data flattening can be configured in advance in the data flattening service module. In this way, the data flattening service module learns that data flattening needs to be performed based on the first data flattening request, and then based on the configured identifier of the designated service that needs to perform data flattening, it can be learned that data flattening is performed at the designated service granularity, and then data flattening is performed on the first intermediate response result.
[0094] Further optionally, when step (c3) is implemented specifically, it may include the following steps:
[0095] (a4) using the data leveling service module to detect whether the corresponding second intermediate response result has been received in advance based on the access request identifier and the designated service identifier;
[0096] The second intermediate response result is a second service instance of the designated service of the distributed search engine system, obtained in the process of responding to the second access request in the corresponding access request pair, and a second data leveling request carrying the access request identifier, the designated service identifier and the second intermediate response result is sent to the data leveling service module in advance;
[0097] (b4) in response to the data flattening service module having received the corresponding second intermediate response result in advance, the data flattening service module uses the second intermediate response result to perform data flattening processing on the first intermediate response result based on the first data flattening request and the specified service identifier, and returns the data flattening processing result to the first service instance of the specified service;
[0098] Optionally, in the scenario of this embodiment, the entire package of the intermediate response result is flattened. In order to further improve the accuracy and efficiency of the flattening, the following steps may be performed before step (b4):
[0099] If the first sub-request and the second sub-request are in a set form or an array form, based on the information of the first sub-request and the information of the second sub-request, a data balancing service module is used to detect and determine that the first sub-request is the same as the second sub-request.
[0100] For example, the set form can also be called a uniform resource locator (URL) set form, and the array form can also be called a URL array form. The set form or array form of the first sub-request and the second sub-request both include at least two URLs in a sequential relationship.
[0101] The first data flattening request also carries information about a first sub-request, which is a sub-request generated by the distributed search engine system when processing a first access request and processed by a first service instance of a specified service; the first sub-request can also be considered as a sub-request corresponding to a first intermediate response result; the second data flattening request also carries information about a second sub-request, which is a sub-request generated by the distributed search engine system when processing a second access request in a corresponding access request pair and processed by a second service instance of a specified service; the second sub-request can also be considered as a sub-request corresponding to a second intermediate response result.
[0102] The two sub-requests are considered the same only if the information of the first sub-request in the form of a set or array is exactly the same as the information of the second sub-request. Otherwise, if the included elements are the same but in a different order, or the included elements are different, the first sub-request and the second sub-request are considered different.
[0103] If the first sub-request and the second sub-request are different, the data leveling service module is used to issue an alarm message indicating that data leveling cannot be performed. For example, the alarm message may carry the identifier of the corresponding access request, the identifier of the designated service, and the information of the first sub-request and the information of the second sub-request, so that the worker can check the specific reason for the alarm.
[0104] (c4) In response to the data flattening service module not receiving the corresponding second intermediate response result in advance, the data flattening service module is used to return a result without data flattening processing to the first service instance of the designated service.
[0105] For example, Fig. 9 yes Figure 7 An example diagram of data flattening processing corresponding to the architecture shown; Fig. 9 As shown, the first sub-request sent by service instance p1 to service instance S1 is in the form of a url set or array, taking url1, url2 and url3 in a sequential relationship as an example, the corresponding first intermediate corresponding result includes the features 1, 2 and 3 of url1; the features 1, 2 and 3 of url2; and the features 1, 2 and 3 of url3. Similarly, the second sub-request sent by service instance p2 to service instance S2 is also in the form of a url set or array, taking url2, url1 and url3 in a sequential relationship as an example, the corresponding second intermediate corresponding result includes the features 1, 2 and 3 of url2; the features 1, 2 and 3 of url1; and the features 1, 2 and 3 of url3. According to the above embodiment, by comparing the information of the first sub-request with the information of the second sub-request, it can be found that if the two are different, at this time, the data leveling service module issues an alarm message that the data leveling process cannot be performed.
[0106] and Fig.10 yes Figure 7 Another example of data flattening processing corresponding to the architecture shown in the figure; in the same way, after comparison, it can be found that Fig.10 In the example shown, the information of the first sub-request is the same as the information of the second sub-request. Therefore, at this time, the first intermediate response result and the second intermediate response result can be flattened as a whole packet in the manner of the above embodiment. For details, please refer to the relevant records of the above embodiment, which will not be repeated here.
[0107] In the above embodiment, the first instance of the specified service sends a first data flattening request to the data flattening service module as a trigger condition for data flattening processing. In actual applications, the second service instance of the specified service sends a second data flattening request to the data flattening service module as a trigger condition for data flattening processing. The principle is exactly the same and will not be repeated here.
[0108] Based on the above, it can be known that in this implementation, a data leveling service module is used to perform data leveling processing. For each access request pair, the two service instances of the designated service responsible for processing the two access requests of the access request pair send data leveling processing requests to the data leveling service module when obtaining the corresponding intermediate response results. The data leveling processing request received first can be regarded as a data publishing process; and the data leveling processing request received later is used for data leveling processing.
[0109] By adopting this implementation method, the intermediate response results of the two access requests of the access request pair can be accurately and efficiently processed at the location of the specified service, providing effective data support for determining the contribution of the specified service to the difference rate. Moreover, in this implementation method, when data flattening cannot be performed, the results that have not been processed by data flattening can be accurately and timely returned to the service instance of the specified service, ensuring that the distributed search engine system can make subsequent responses in a timely manner. Moreover, in this implementation method, before the data flattening process, it can also be verified whether the first sub-request corresponding to the first intermediate response result and the second sub-request corresponding to the second intermediate response result are the same, and ensure that the data flattening process is performed when the two are the same, and when the two are different, an alarm message that the data flattening process cannot be performed is issued in time, which can effectively ensure the accuracy of the data flattening process.
[0110] In addition, optionally, in the second implementation, the data flattening process of this embodiment can also be performed on the service instance side, such as on the first service instance or the second service instance side of the specified service. For example, the specific implementation may include the following steps:
[0111] (a5) for the first access request in each access request pair, using the first service instance of the designated service to obtain a first intermediate response result obtained in the process of responding to the first access request;
[0112] (b5) Using the first service instance of the designated service to pull a second intermediate response result from the data flattening service module based on the identifier of the access request pair corresponding to the access request and the identifier of the designated service, the second intermediate response result is the second service instance of the designated service of the distributed search engine system, which is obtained in the process of responding to the second access request in the corresponding access request pair and is pre-published in the data flattening service module.
[0113] Specifically, the pulling process of this embodiment can be pulled based on the identifier of the access request and the identifier of the specified service. For example, when the second service instance of the specified service publishes the second intermediate response result to the data flattening service module, it will carry the identifier of the access request and the identifier of the specified service, such as query identifier: identifier S of the specified service. Or optionally, when the second intermediate response result of S is published by the upper-layer service of the specified service, the published second intermediate response result can carry the representation of query: identifier S of the specified service → identifier P of the upper-layer service of the specified service, which can indicate that service P publishes the intermediate response result returned by service S to the data flattening service module. When the first service instance of the specified service pulls the intermediate response result from the data flattening service module, it can also pull based on the identifier of the access request and the identifier of the specified service, which can effectively ensure the accuracy of the pulled intermediate response result.
[0114] (c5) The first service instance of the specified service detects whether the second intermediate response result can be pulled from the data flattening service module. If it can be pulled, step (d5) is executed; if the first service instance of the specified service cannot pull the second intermediate response result from the data flattening service module, step (e5) is executed;
[0115] (d5) Using the first service instance of the specified service to perform data flattening processing on the first intermediate response result based on the second intermediate response result, and ending.
[0116] Specifically, the first intermediate response result is replaced by the second intermediate response result.
[0117] (e5) using the first service instance of the designated service to publish the first intermediate response result and the corresponding access request identifier and the designated service identifier to the data leveling service module; executing step (f5);
[0118] (f5) the second service instance of the designated service of the distributed search engine system obtains the first intermediate response result from the data leveling service module after obtaining the second intermediate response result in the process of responding to the second access request in the corresponding access request pair;
[0119] (g5) Using the second service instance of the designated service to perform data flattening processing on the second intermediate response result based on the first intermediate response result.
[0120] Specifically, the second intermediate response result is replaced by the first intermediate response result.
[0121] Further optionally, similar to the first implementation method described above, before step (d5), it may also include: using the first service instance of the designated service, while pulling the second intermediate response result from the data leveling service module, also pulling the corresponding second sub-request information, if the first sub-request and the second sub-request are in the form of a collection or array, based on the information of the first sub-request and the information of the second sub-request, using the first service instance of the designated service to detect and determine that the first sub-request is the same as the second sub-request. If the first sub-request and the second sub-request are different, using the first service instance of the designated service to issue an alarm message that the data leveling process cannot be performed.
[0122] Similarly, in the above embodiment, the first service instance and the second service instance of the designated service are completely equivalent and can also interchangeably execute the operations of the other end, which is not limited here.
[0123] The first implementation method mentioned above is to implement the data flattening processing operation in the data flattening service module; the second implementation method is to perform the data flattening processing operation on the first service instance or the second service instance side of the specified service; in the first implementation method, it is only necessary to configure the corresponding implementation rules in the data flattening service module and configure the identifier of the specified service to be flattened. Compared with the first implementation method, the second implementation method needs to change the implementation rules of the specified service in the distributed search engine system, and the implementation is more complicated. Therefore, preferably, the first implementation method mentioned above is used to implement data flattening processing, and the data flattening processing efficiency is higher.
[0124] Based on the above, it can be known that, in theory, different service instances of a specified service are responsible for processing the two access requests in the access request pair. The service instance that processes the intermediate response result first publishes the intermediate response result to the data flattening service module. The service instance that processes the intermediate response result then directly obtains the intermediate response result of the same access request identifier and service identifier from the data flattening service module, and performs data flattening on the intermediate response result processed by this service instance so that it is the same as the intermediate response result obtained from the data flattening service module.
[0125] The method for determining the contribution of the difference rate of the present embodiment can determine the contribution of the difference rate of any specified service on the processing link of the access request in the distributed search engine system by means of data flattening, and can accurately and effectively obtain the contribution of the difference rate of each specified service in the distributed search engine system, so as to facilitate a more accurate analysis of each specified service in the distributed search engine system.
[0126] Fig.11 is a schematic diagram according to the third embodiment of the present disclosure; this embodiment provides a method for determining the contribution of the difference rate, in the above Figure 1 or Figure 2 After obtaining the contribution of the difference rate of the specified service in the illustrated embodiment, the following steps may also be included:
[0127] S1101, when determining that a contribution analysis of the difference rate of a secondary drill-down feature is required based on the contribution of the difference rate of a designated service, obtaining a third difference rate of the distributed search engine system by performing data flattening processing on a designated feature in an intermediate response result of a designated service of the distributed search engine system based on multiple access requests as an intervention condition;
[0128] S1102: Based on the first difference rate and the third difference rate, obtain the contribution of the difference rate of the specified feature of the specified service to identify the contribution of the specified feature in the specified service to the difference rate of the distributed search engine system.
[0129] The multiple access requests in this embodiment are similar to the above Figure 1 or Figure 2 The multiple access requests of the illustrated embodiment are identical.
[0130] In this embodiment, when step 1101 is implemented, it can be detected whether the contribution of the difference rate of the specified service is greater than or equal to a preset threshold. If so, it is determined that a contribution analysis of the difference rate of the secondary drill-down feature is required; otherwise, it is determined that a contribution analysis of the difference rate of the secondary drill-down feature is not required.
[0131] The preset threshold in this embodiment can be set based on experience. For example, in actual applications, if the contribution of the difference rate of a specified service is greater than or equal to the preset threshold, it can be considered that the contribution of the difference rate of the specified service is large. At this time, according to the method of this embodiment, it is possible to further analyze and locate which secondary drill-down feature in the specified service has a greater impact on the contribution of the difference rate. If the contribution of the difference rate of a specified service is less than the preset threshold, it is considered that the contribution of the difference rate of the specified service is not large, and further positioning and analysis may not be performed.
[0132] Alternatively, in practical applications, the above Figure 1 and Figure 2 In the embodiment shown, the contribution of the difference rate of each service in the distributed search engine system is determined, and then the contribution of the difference rate of each designated service is sorted in order of size. Then, it is detected whether the contribution of the difference rate of the designated service is in the top N of the sorting. If so, it is determined that the contribution analysis of the difference rate of the secondary drill-down feature needs to be performed to locate which secondary drill-down feature difference rate contribution has a greater impact.
[0133] In this embodiment, when performing secondary drill-down feature analysis within a specified service, data flattening is performed on the specified features in the intermediate response results of the specified service of the distributed search engine system, and this is used as an intervention condition to obtain the third difference rate of the distributed search engine system; and then based on the first difference rate and the third difference rate, the contribution of the difference rate of the specified feature of the specified service is obtained.
[0134] With the above Figure 1 and Figure 2 Compared with the embodiment shown, Figure 1 and Figure 2 The granularity of the data flattening process in the intervention condition in the illustrated embodiment is the granularity of a service in the distributed search engine system, while the granularity of the data flattening process in the intervention condition in this embodiment is the granularity of the feature in the service. The feature here can also be a field, so it can also be called the granularity of the field in the service. Figure 1 and Figure 2 Compared with the embodiment shown, the analysis of the secondary drill-down features is performed, which can more accurately locate and analyze, and obtain the contribution of the difference rate of each specified feature of the specified service. In this way, it can assist R&D personnel in locating each feature in each service in the distributed search engine system, and then make targeted improvements and upgrades, which is very helpful to improve the consistency of search results of the distributed search engine system and the stability of search services.
[0135] The method for determining the contribution of the difference rate of the present embodiment, by taking data flattening processing of the specified features in the intermediate response results of the specified services of the distributed search engine system as an intervention condition, can accurately and reasonably obtain the contribution of the difference rate of the specified features of the specified services, so as to facilitate a more accurate analysis of each feature in each specified service in the distributed search engine system.
[0136] Fig.12 is a schematic diagram according to the fourth embodiment of the present disclosure; this embodiment provides a method for determining the contribution of the difference rate, in the above Fig.11 Based on the technical solutions of the embodiments shown in the figure, the technical solutions of the present disclosure are further described in more detail. Fig.12 As shown, the method for determining the contribution of the difference rate in this embodiment may specifically include the following steps:
[0137] S1201: When it is determined that a contribution analysis of the difference rate of the secondary drill-down feature needs to be performed on the designated service, for an access request pair corresponding to each access request in the multiple access requests, at the location of the designated service of the distributed search engine system, data averaging is performed on the designated features in the intermediate response results of the two access requests of the access request pair;
[0138] S1202, obtaining the intermediate response result after data flattening processing based on the specified feature, and obtaining a third response result obtained by the distributed search engine system continuing to respond to the first access request in each access request pair, and a fourth response result obtained by continuing to respond to the second access request in each access request pair;
[0139] S1203: acquiring a third difference rate of the distributed search engine system response based on the third response result and the fourth response result corresponding to each of the access request pairs;
[0140] For example, in the specific implementation of step S1201 of this embodiment, reference may be made to the above Figure 2 There are two implementation methods of step S204 in the illustrated embodiment. The first implementation method implements data flattening based on the specified feature in the data flattening service module; the second implementation method implements data flattening based on the specified feature on the first service instance side or the second service instance side of the specified service. For example, the first implementation method may specifically include the following steps:
[0141] (a6) for a first access request in the access request pair, obtaining, using a first service instance of a designated service, a first intermediate response result obtained in a process of responding to the first access request;
[0142] (b6) using a first service instance of a designated service to send a first data flattening request carrying an access request identifier, a designated service identifier, and a first intermediate response result to a data flattening service module;
[0143] (c6) Using the data flattening service module, based on the first data flattening request and the identifier of the specified feature corresponding to the pre-configured specified service identifier that needs to be processed for data flattening, data flattening is performed on the specified feature in the first intermediate response result, and the flattening result is returned to the first service instance of the specified service.
[0144] With the above Figure 2 Compared with the implementation method of step S204 of the illustrated embodiment, when flattening the entire package of the intermediate response result of the specified service, only the identifier of the specified service is configured in the data flattening service module; while in the present embodiment, when performing data flattening processing of specified features, it is necessary to configure the information of the specified features under the identifier of the specified service in the data flattening service module, such as the information of the specified features can be the field name of a specified field, so as to identify the value of the specified field in the intermediate response result of the specified service that needs to be subjected to data flattening processing.
[0145] Furthermore, when step (c6) is implemented, it may include the following steps:
[0146] (a7) using the data leveling service module to detect whether the corresponding second intermediate response result has been received in advance based on the access request identifier and the designated service identifier;
[0147] The second intermediate response result is a second service instance of the designated service of the distributed search engine system, which is obtained in the process of responding to the second access request in the corresponding access request pair, and a second data leveling request carrying the access request identifier, the designated service identifier and the second intermediate response result is sent to the distributed search engine system in advance.
[0148] (b7) In response to the fact that the data flattening service module has pre-received the corresponding second intermediate response result, the data flattening service module uses the information of the specified features in the second intermediate response result to perform data flattening processing on the information of the specified features in the first intermediate response result based on the first data flattening request, the specified service identifier and the identifier of the specified features, and returns the data flattening processing result to the first service instance of the specified service.
[0149] At this time, in step (b7), after the data flattening service module performs data flattening processing at the specified feature granularity, the data flattening processing result returned to the first service instance of the specified service is the intermediate response result after the flattening processing, that is, what is returned is the intermediate response result after the information of the specified features in the first intermediate response result is replaced by the information of the specified features in the second intermediate response result, which is a whole data packet rather than the information of the specified features after replacement.
[0150] Optionally, before step (b7), a data leveling service module may be used to detect and determine that both the first intermediate response result and the second intermediate response result include information of the specified feature; otherwise, if the data leveling service module detects that the first intermediate response result or the second intermediate response result does not include information of the specified feature, the data leveling service module may be used to issue an alarm message indicating that data leveling processing of the specified feature cannot be performed. Similarly, the alarm message may carry the identifier of the access request, the first intermediate response result, the second intermediate response result, and information of the specified feature, so that the staff can check the reason why data leveling processing of the specified feature cannot be performed.
[0151] (c7) In response to the data flattening service module not receiving the corresponding second intermediate response result in advance, the data flattening service module is used to return a result without data flattening processing to the first service instance of the designated service.
[0152] In this embodiment, step (b7) and step (c7) cannot be executed at the same time. Based on the judgment result of step (a7), one of them is executed.
[0153] In this embodiment, the first intermediate response result and the second intermediate response result may include multiple features, and the designated feature is any one of the multiple features.
[0154] The second implementation of step S1201 of this embodiment implements data flattening based on the specified feature on the first service instance side or the second service instance side of the specified service. Figure 2 The step S204 of the illustrated embodiment is implemented by the implementation principle of the second implementation method, which will not be elaborated here.
[0155] In this embodiment, no matter which implementation method is adopted, it is possible to accurately and efficiently perform data leveling processing on the specified features in the intermediate response results of the two access requests of the access request pair at the location of the specified service, providing effective data support for determining the contribution of the specified features of the specified service to the difference rate. Moreover, in this implementation method, when it is impossible to perform data leveling processing based on the specified features of the specified service, it is possible to accurately and timely return the results without data leveling processing to the service instance of the specified service, ensuring that the distributed search engine system can make subsequent responses in a timely manner. Moreover, in this implementation method, when data leveling processing is not supported, it is possible to promptly issue an alarm message that data leveling processing cannot be performed, which can effectively ensure the accuracy of data leveling processing.
[0156] The implementation of step S1202 of this embodiment can refer to the above Figure 2 The implementation of step S205 and step S1203 in the embodiment shown in the figure can refer to the above Figure 2 Step S206 of the illustrated embodiment will not be described in detail here.
[0157] In this embodiment, through the above method, after performing data flattening based on the specified features in the intermediate response results of the two access requests for the specified service access request pair, the second difference rate of the distributed search engine system response can be accurately and efficiently obtained.
[0158] S1204: Obtain a difference between the first difference rate and the third difference rate as a contribution of the difference rate of the specified feature of the specified service.
[0159] In this embodiment, the difference between the third difference rate and the first difference rate is caused by the operation of flattening the data of the specified features in the intermediate response results of the two access requests of each access request pair by the designated service of the distributed search engine system. Therefore, the difference between the first difference rate and the third difference rate can be used as the contribution of the specified features of the designated service to the difference rate.
[0160] Fig.13 yes Figure 7Another example diagram of data flattening processing corresponding to the architecture shown in FIG. Fig.13 As shown, the first sub-request sent by service instance p1 to service instance S1 is in the form of a url set or array, taking url1, url2 and url3 having a sequential relationship as an example, the corresponding first intermediate response result includes the features of url1, url2 and url3 in sequence. Similarly, the second sub-request sent by service instance p2 to service instance S2 is also in the form of a url set or array, taking url4, url4 and url5 having a sequential relationship as an example, the corresponding second intermediate response result includes the features of url4, url2 and url5 in sequence. The data flattening service module is configured to flatten the features of url2 in the intermediate response result of the specified service S. According to the above embodiment, after detection, it is determined that both the first intermediate response result and the second intermediate response result include the features of url2. At this time, the features of url2 in the two can be flattened. Specifically, the feature information of url2 in the intermediate response result received first is used to flatten the feature information of url2 in the intermediate response result received later. Otherwise, if the first intermediate response result or the second intermediate response result does not include the feature of url2, at this time, the data flattening service module issues an alarm message that the data flattening process based on the feature of url2 cannot be performed.
[0161] In this embodiment, in the distributed engine search system, the interaction packages of upstream and downstream services exist in multiple formats, including internal IDL format, protobuf format, json format, and so on.
[0162] Although the formats of interaction packages are diverse, their internal data structures are similar, and a set of syntax can be used to access specific fields, that is, a set of syntax can be used to uniquely identify a field. For example, a tag connected by a "." can be used to uniquely identify a field. There are two types of tags here, the first is "field name" and the second is "index[subscript]".
[0163] The following takes a section of JSON as an example to illustrate how to write the grammar:
[0164] urls field: "urls"
[0165] The links field in refs of the first element of the urls array: "urls.index[0].refs.links"
[0166] The second element of the urls array: "urls.index[1]".
[0167] For ease of processing, the data format can be uniformly converted into JSON, and then the data can be flattened at the field or feature granularity based on the JSON format, and finally converted back to the original format.
[0168]
[0169]
[0170] In the distributed search engine system of this embodiment, during the process of processing a query, the sub-requests of any layer of service may have various forms such as query, URL set, URL array, single URL, etc.
[0171] A subrequest in the form of a query can include multiple fields. A subrequest in the form of a url set or url array can include multiple urls in a sequential relationship. A subrequest in the form of a single url can include only one url.
[0172] Regardless of the form of the sub-request, the feature-based data flattening process can be performed in accordance with the above embodiment. As for the flattening process of the whole package data, it should be noted that for the sub-requests in the form of URL sets and URL arrays, it is necessary to analyze whether the corresponding two sub-requests are the same in accordance with the above embodiment. If they are the same, the whole package data flattening process is performed. Otherwise, the data flattening process is meaningless and the whole package data flattening process is not performed.
[0173] The method for determining the contribution of the difference rate in this embodiment can achieve a refined analysis of each feature in the service based on the data flattening processing of the feature granularity within the service, determine the contribution of each feature to the difference rate, and then accurately optimize the features with a large contribution to the difference rate, thereby improving the stability of the search results of the entire distributed search engine system, and thus effectively maintaining the company's revenue and reputation.
[0174] In the technical solution disclosed herein, the acquisition, storage and application of user personal information involved are in compliance with the provisions of relevant laws and regulations and do not violate public order and good morals.
[0175] According to an embodiment of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium and a computer program product.
[0176] Fig.14 is a schematic diagram according to the fifth embodiment of the present disclosure; Fig.14 As shown, this embodiment provides a device 1400 for determining a contribution of a difference rate, including:
[0177] A first difference rate acquisition module 1401, configured to acquire a first difference rate of the distributed search engine system based on a plurality of access requests screened according to a preset condition;
[0178] A second difference rate acquisition module 1402 is used to acquire a second difference rate of the distributed search engine system based on the multiple access requests and taking data flattening processing of intermediate response results of a designated service of the distributed search engine system as an intervention condition; the designated service is a service at any level of the distributed search engine system;
[0179] The first difference rate contribution acquisition module 1403 is used to acquire the difference rate contribution of the specified service based on the first difference rate and the second difference rate to identify the contribution degree of the specified service to the difference rate of the distributed search engine system.
[0180] The device 1400 for determining the contribution of the difference rate in this embodiment, by adopting the above-mentioned modules to realize the implementation principle and technical effect of determining the contribution of the difference rate, is the same as that of the above-mentioned related method embodiments. For details, please refer to the records of the above-mentioned related method embodiments, which will not be repeated here.
[0181] Fig.15 is a schematic diagram according to the sixth embodiment of the present disclosure; Fig.15 As shown, this embodiment provides a device 1500 for determining the contribution of a difference rate, comprising: Fig.14 The modules with the same name and function shown are: a first difference rate acquisition module 1501 , a second difference rate acquisition module 1502 and a first difference rate contribution acquisition module 1503 .
[0182] In the device 1500 for determining the contribution of the difference rate in this embodiment, the first difference rate acquisition module 1501 is used to:
[0183] marking different access requests among the multiple access requests;
[0184] Counting a first number of different access requests among the multiple access requests;
[0185] Based on the first number of the differential access requests and the total number of the plurality of access requests, a first differential rate of the distributed search engine system is obtained.
[0186] Further optionally, if Fig.15 As shown, in the device 1500 for determining the contribution of the difference rate in this embodiment, the second difference rate acquisition module 1502 includes:
[0187] A first balancing processing unit 15021 is configured to perform data balancing processing on intermediate response results of two access requests of an access request pair corresponding to each access request in the multiple access requests at a location of a designated service of the distributed search engine system; the access request pair corresponding to each access request is generated based on the access request, and the access request pair includes two identical access requests;
[0188] A first response result obtaining unit 15022 is configured to obtain, based on the intermediate response result after data flattening processing is performed on the designated service, a first response result obtained by the distributed search engine system continuing to respond to the first access request in the access request pair, and a second response result obtained by continuing to respond to the second access request in the access request pair;
[0189] The first difference rate acquisition unit 15023 is used to acquire a second difference rate of the distributed search engine system response based on the first response result and the second response result corresponding to each access request pair.
[0190] Further optionally, in one embodiment of the present disclosure, the first leveling processing unit 15021 is used to:
[0191] For a first access request in the access request pair, a first intermediate response result obtained in a process of obtaining a response to the first access request using the first service instance of the designated service;
[0192] Using the first service instance of the designated service to send a first data flattening request carrying the access request identifier, the designated service identifier, and the first intermediate response result to a data flattening service module;
[0193] The data flattening service module uses the designated service identifier that needs to perform data flattening processing based on the first data flattening request and the configuration to perform data flattening processing on the first intermediate response result, and returns the data flattening processing result to the first service instance of the designated service.
[0194] Further optionally, in one embodiment of the present disclosure, the first leveling processing unit 15021 is used to:
[0195] The data flattening service module is used to detect whether a corresponding second intermediate response result has been received in advance based on the access request identifier and the designated service identifier, where the second intermediate response result is a second service instance of the designated service of the distributed search engine system, obtained in the process of responding to the second access request in the corresponding access request pair, and a second data flattening request carrying the access request identifier, the designated service identifier and the second intermediate response result is sent to the data flattening service module in advance;
[0196] In response to the fact that the data flattening service module has pre-received the corresponding second intermediate response result, the data flattening service module uses the second intermediate response result to perform data flattening processing on the first intermediate response result based on the first data flattening request and the designated service identifier, and returns the data flattening processing result to the first service instance of the designated service.
[0197] Further optionally, in one embodiment of the present disclosure, the first leveling processing unit 15021 is further configured to:
[0198] In response to the data flattening service module not receiving the corresponding second intermediate response result in advance, the data flattening service module is used to return a result without data flattening processing to the first service instance of the designated service.
[0199] Further optionally, in an embodiment of the present disclosure, the first data flattening request also carries information of a first sub-request, where the first sub-request is a sub-request generated by the distributed search engine system in the process of processing the first access request and processed by the first service instance of the designated service; the second data flattening request also carries information of a second sub-request, where the second sub-request is a sub-request generated by the distributed search engine system in the process of processing the second access request in the corresponding access request pair and processed by the second service instance of the designated service;
[0200] The first leveling processing unit 15021 is further used for:
[0201] If the first sub-request and the second sub-request are in a set form or an array form, based on the information of the first sub-request and the information of the second sub-request, the data flattening service module is used to detect and determine that the first sub-request is the same as the second sub-request.
[0202] Further optionally, in one embodiment of the present disclosure, the first leveling processing unit 15021 is further configured to:
[0203] If the first sub-request and the second sub-request are different, the data leveling service module is used to issue an alarm message indicating that data leveling processing cannot be performed.
[0204] Further optionally, in one embodiment of the present disclosure, the first difference rate acquiring unit 15023 is configured to:
[0205] For each access request pair, if the corresponding first response result and the second response result are different, marking the corresponding access request as a difference access request;
[0206] counting a second number of different access requests among the multiple access requests;
[0207] Based on the second number of the differential access requests and the total number of the plurality of access requests, a second differential rate of the distributed search engine system is obtained.
[0208] Further optionally, in an embodiment of the present disclosure, the first difference rate contribution acquisition module 1503 is used to acquire the difference between the first difference rate and the second difference rate as the contribution of the difference rate of the designated service.
[0209] Further optionally, if Fig.15 As shown, in one embodiment of the present disclosure, the device 1500 for determining the contribution of the difference rate further includes:
[0210] A third difference rate acquisition module 1504 is configured to acquire a third difference rate of the distributed search engine system based on the plurality of access requests and taking data flattening processing of the designated feature in the intermediate response result of the designated service of the distributed search engine system as an intervention condition when determining that a difference rate contribution analysis of the secondary drill-down feature is required based on the contribution of the difference rate of the designated service.
[0211] The second difference rate contribution acquisition module 1505 is used to acquire the contribution of the difference rate of the specified feature of the specified service based on the first difference rate and the third difference rate, so as to identify the contribution degree of the specified feature in the specified service to the difference rate of the distributed search engine system.
[0212] Further optionally, if Fig.15 As shown, in one embodiment of the present disclosure, the third difference rate acquisition module 1504 includes:
[0213] The second balancing processing unit 15041 is used to perform data balancing processing on the specified features in the intermediate response results of the two access requests of the corresponding access request pair at the location of the specified service of the distributed search engine system for the access request pair corresponding to each access request in the multiple access requests;
[0214] The second response result obtaining unit 15042 is used to obtain the intermediate response result after data flattening processing based on the specified feature, and obtain the third response result obtained by the distributed search engine system continuing to respond to the first access request in the access request pair, and the fourth response result obtained by continuing to respond to the second access request in the access request pair;
[0215] The second difference rate acquisition unit 15043 is used to acquire a third difference rate of the distributed search engine system response based on the third response result and the fourth response result corresponding to each access request pair.
[0216] Further optionally, in one embodiment of the present disclosure, the second leveling processing unit 15041 is used to:
[0217] For a first access request in the access request pair, a first intermediate response result obtained in a process of obtaining a response to the first access request using the first service instance of the designated service;
[0218] Using the first service instance of the designated service to send a first data flattening request carrying the access request identifier, the designated service identifier, and the first intermediate response result to a data flattening service module;
[0219] The data flattening service module performs data flattening on the specified features in the first intermediate response result based on the first data flattening request and the identifier of the specified feature corresponding to the pre-configured specified service identifier that needs to be processed for data flattening, and returns the flattening result to the first service instance of the specified service.
[0220] Further optionally, in one embodiment of the present disclosure, the second leveling processing unit 15041 is used to:
[0221] The data flattening service module is used to detect whether a corresponding second intermediate response result has been received in advance based on the access request identifier and the designated service identifier, where the second intermediate response result is a second service instance of the designated service of the distributed search engine system, obtained in the process of responding to the second access request in the corresponding access request pair, and a second data flattening request carrying the access request identifier, the designated service identifier and the second intermediate response result is sent to the data flattening service module in advance;
[0222] In response to the data flattening service module having received the corresponding second intermediate response result in advance, the data flattening service module uses the information of the specified feature in the second intermediate response result to perform data flattening processing on the information of the specified feature in the first intermediate response result based on the first data flattening request, the specified service identifier and the identifier of the specified feature, and returns the data flattening processing result to the first service instance of the specified service;
[0223] The second flattening processing unit 15041 is further used to use the data flattening service module to return a result without data flattening processing to the first service instance of the designated service in response to the data flattening service module not receiving the corresponding second intermediate response result in advance.
[0224] Further optionally, in an embodiment of the present disclosure, the second leveling processing unit 15041 is further configured to use the data leveling service module to detect and determine that both the first intermediate response result and the second intermediate response result include the information of the specified feature;
[0225] The second flattening processing unit is also used to use the data flattening service module to issue an alarm message that the data flattening processing of the specified feature cannot be performed if the data flattening service module detects that the first intermediate response result or the second intermediate response result does not include the information of the specified feature.
[0226] Further optionally, in one embodiment of the present disclosure, the second difference rate contribution acquisition module 1505 is used to:
[0227] A difference between the first difference rate and the third difference rate is obtained as a contribution degree of the difference rate of the specified feature of the specified service.
[0228] The device 1500 for determining the contribution of the difference rate in this embodiment, by adopting the above-mentioned modules to realize the implementation principle and technical effect of determining the contribution of the difference rate, is the same as that of the above-mentioned related method embodiments. For details, please refer to the records of the above-mentioned related method embodiments, which will not be repeated here.
[0229] Fig.16 A schematic block diagram of an example electronic device 1600 that can be used to implement an embodiment of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or required herein.
[0230] like Fig.16 As shown, the device 1600 includes a computing unit 1601, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 1602 or a computer program loaded from a storage unit 1608 into a random access memory (RAM) 1603. In the RAM 1603, various programs and data required for the operation of the device 1600 can also be stored. The computing unit 1601, the ROM 1602, and the RAM 1603 are connected to each other via a bus 1604. An input / output (I / O) interface 1605 is also connected to the bus 1604.
[0231] A number of components in the device 1600 are connected to the I / O interface 1605, including: an input unit 1606, such as a keyboard, a mouse, etc.; an output unit 1607, such as various types of displays, speakers, etc.; a storage unit 1608, such as a disk, an optical disk, etc.; and a communication unit 1609, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 1609 allows the device 1600 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.
[0232] The computing unit 1601 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 1601 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 1601 performs the various methods and processes described above, such as the above-mentioned methods of the present disclosure. For example, in some embodiments, the above-mentioned methods of the present disclosure may be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as a storage unit 1608. In some embodiments, part or all of the computer program may be loaded and / or installed on the device 1600 via the ROM 1602 and / or the communication unit 1609. When the computer program is loaded into the RAM 1603 and executed by the computing unit 1601, one or more steps of the above-mentioned methods of the present disclosure described above may be performed. Alternatively, in other embodiments, the computing unit 1601 may be configured to execute the above method of the present disclosure in any other appropriate manner (for example, by means of firmware).
[0233] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.
[0234] The program code for implementing the method of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, enables the functions / operations specified in the flow chart and / or block diagram to be implemented. The program code may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.
[0235] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
[0236] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).
[0237] The systems and techniques described herein may be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), and the Internet.
[0238] A computer system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The relationship of client and server is generated by computer programs running on respective computers and having a client-server relationship with each other. The server may be a cloud server, a server of a distributed system, or a server combined with a blockchain.
[0239] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this disclosure can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solutions disclosed in this disclosure can be achieved, and this document does not limit this.
[0240] The above specific implementations do not constitute a limitation on the protection scope of the present disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present disclosure shall be included in the protection scope of the present disclosure.
Claims
1. A method for determining a contribution of a difference rate, comprising: Based on the plurality of access requests screened according to the preset conditions, obtaining a first difference rate of the distributed search engine system; Based on the multiple access requests, a second difference rate of the distributed search engine system is obtained by performing data flattening processing on an intermediate response result of a designated service of the distributed search engine system as an intervention condition; the designated service is a service at any level of the distributed search engine system; Performing data flattening on the intermediate response results of the designated service of the distributed search engine system, that is, the same access request shares the intermediate response results on the designated service; Based on the first difference rate and the second difference rate, obtaining a contribution degree of the difference rate of the specified service to identify a contribution degree of the specified service to the difference rate of the distributed search engine system; The method of obtaining a first difference rate of the distributed search engine system based on a plurality of access requests screened according to a preset condition includes: Marking different access requests among the multiple access requests; the different access requests refer to access requests for which the distributed search engine system has different response results to the same two access requests; Counting a first number of different access requests among the multiple access requests; Based on the first number of the differential access requests and the total number of the plurality of access requests, a first differential rate of the distributed search engine system is obtained.
2. The method according to claim 1, wherein: Based on the multiple access requests, taking data leveling processing of the intermediate response results of the designated service of the distributed search engine system as an intervention condition, obtaining a second difference rate of the distributed search engine system includes: For an access request pair corresponding to each access request in the multiple access requests, at a location of a designated service of the distributed search engine system, data balancing is performed on intermediate response results of two access requests of the access request pair; the access request pair corresponding to each access request is generated based on the access request, and the access request pair includes two identical access requests; Based on the intermediate response result after the designated service performs data flattening processing, obtain a first response result obtained by the distributed search engine system continuing to respond to the first access request in the access request pair, and a second response result obtained by continuing to respond to the second access request in the access request pair; Based on the first response result and the second response result corresponding to each access request pair, a second difference rate of the distributed search engine system response is obtained.
3. The method according to claim 2, wherein: At a designated service location of the distributed search engine system, data averaging is performed on intermediate response results of two access requests of the access request pair, including: For a first access request in the access request pair, a first intermediate response result obtained in a process of obtaining a response to the first access request using the first service instance of the designated service; Using the first service instance of the designated service to send a first data flattening request carrying the access request identifier, the designated service identifier, and the first intermediate response result to a data flattening service module; The data flattening service module uses the designated service identifier that needs to perform data flattening processing based on the first data flattening request and the configuration to perform data flattening processing on the first intermediate response result, and returns the data flattening processing result to the first service instance of the designated service.
4. The method according to claim 3, wherein: Using the data flattening service module to perform data flattening processing based on the first data flattening request and the configured designated service identifier, performing data flattening processing on the first intermediate response result, and returning the data flattening processing result to the first service instance of the designated service, including: The data flattening service module is used to detect whether a corresponding second intermediate response result has been received in advance based on the access request identifier and the designated service identifier, where the second intermediate response result is a second service instance of the designated service of the distributed search engine system, obtained in the process of responding to the second access request in the corresponding access request pair, and a second data flattening request carrying the access request identifier, the designated service identifier and the second intermediate response result is sent to the data flattening service module in advance; In response to the fact that the data flattening service module has pre-received the corresponding second intermediate response result, the data flattening service module uses the second intermediate response result to perform data flattening processing on the first intermediate response result based on the first data flattening request and the designated service identifier, and returns the data flattening processing result to the first service instance of the designated service.
5. The method according to claim 4, wherein: The method further comprises: using the data flattening service module to perform data flattening processing based on the first data flattening request and the configured designated service identifier, performing data flattening processing on the first intermediate response result, and returning the data flattening processing result to the first service instance of the designated service, further comprising: In response to the data flattening service module not receiving the corresponding second intermediate response result in advance, the data flattening service module is used to return a result without data flattening processing to the first service instance of the designated service.
6. The method according to claim 4, wherein: The first data flattening request also carries information about a first sub-request, where the first sub-request is a sub-request generated by the distributed search engine system in the process of processing the first access request and processed by the first service instance of the designated service; the second data flattening request also carries information about a second sub-request, where the second sub-request is a sub-request generated by the distributed search engine system in the process of processing the second access request in the corresponding access request pair and processed by the second service instance of the designated service; In response to the data flattening service module having received the corresponding second intermediate response result in advance, before the data flattening service module uses the second intermediate response result to perform data flattening processing on the first intermediate response result based on the first data flattening request and the designated service identifier, the method further includes: If the first sub-request and the second sub-request are in a set form or an array form, based on the information of the first sub-request and the information of the second sub-request, the data flattening service module is used to detect and determine that the first sub-request is the same as the second sub-request.
7. The method according to claim 6, wherein: The method further comprises: If the first sub-request and the second sub-request are different, the data leveling service module is used to issue an alarm message indicating that data leveling processing cannot be performed.
8. The method according to claim 2, wherein: Based on the first response result and the second response result corresponding to each access request pair, obtaining a second difference rate of the distributed search engine system response includes: For each access request pair, if the corresponding first response result and the second response result are different, marking the corresponding access request as a difference access request; counting a second number of different access requests among the multiple access requests; Based on the second number of the differential access requests and the total number of the plurality of access requests, a second differential rate of the distributed search engine system is obtained.
9. The method according to any one of claims 1 to 8, wherein: Acquiring a contribution of the difference rate of the designated service based on the first difference rate and the second difference rate includes: A difference between the first difference rate and the second difference rate is obtained as a contribution of the difference rate of the designated service.
10. The method according to any one of claims 1 to 8, wherein: After obtaining the contribution of the difference rate of the designated service based on the first difference rate and the second difference rate, the method further includes: When determining that a contribution analysis of the difference rate of a secondary drill-down feature is required based on the contribution of the difference rate of the designated service, obtaining a third difference rate of the distributed search engine system based on the multiple access requests and taking data flattening processing of the designated feature in the intermediate response result of the designated service of the distributed search engine system as an intervention condition; Based on the first difference rate and the third difference rate, the contribution of the difference rate of the specified feature of the specified service is obtained to identify the contribution degree of the specified feature in the specified service to the difference rate of the distributed search engine system.
11. The method according to claim 10, wherein: Based on the multiple access requests, taking data flattening processing of a specified feature in an intermediate response result of a specified service of the distributed search engine system as an intervention condition, obtaining a third difference rate of the distributed search engine system includes: For an access request pair corresponding to each access request in the plurality of access requests, at a location of a designated service of the distributed search engine system, performing data flattening processing on designated features in intermediate response results of two access requests of the corresponding access request pair; Obtaining, based on the designated feature, an intermediate response result after data flattening processing, a third response result obtained by the distributed search engine system continuing to respond to the first access request in the access request pair, and a fourth response result obtained by continuing to respond to the second access request in the access request pair; Based on the third response result and the fourth response result corresponding to each access request pair, a third difference rate of the distributed search engine system response is obtained.
12. The method according to claim 11, wherein: At a designated service location of the distributed search engine system, data flattening is performed on designated features in intermediate response results of two access requests of the corresponding access request pair, including: For a first access request in the access request pair, a first intermediate response result obtained in a process of obtaining a response to the first access request using the first service instance of the designated service; Using the first service instance of the designated service to send a first data flattening request carrying the access request identifier, the designated service identifier, and the first intermediate response result to a data flattening service module; The data flattening service module performs data flattening on the specified features in the first intermediate response result based on the first data flattening request and the identifier of the specified feature corresponding to the pre-configured specified service identifier that needs to be processed for data flattening, and returns the flattening result to the first service instance of the specified service.
13. The method according to claim 12, wherein: The data flattening service module performs data flattening on the specified feature in the first intermediate response result based on the first data flattening request and the identifier of the specified feature corresponding to the pre-configured specified service identifier that needs to perform data flattening, and returns the flattening result to the first service instance of the specified service, including: The data flattening service module is used to detect whether a corresponding second intermediate response result has been received in advance based on the access request identifier and the designated service identifier, where the second intermediate response result is a second service instance of the designated service of the distributed search engine system, obtained in the process of responding to the second access request in the corresponding access request pair, and a second data flattening request carrying the access request identifier, the designated service identifier and the second intermediate response result is sent to the data flattening service module in advance; In response to the data flattening service module having received the corresponding second intermediate response result in advance, the data flattening service module uses the information of the specified feature in the second intermediate response result to perform data flattening processing on the information of the specified feature in the first intermediate response result based on the first data flattening request, the specified service identifier and the identifier of the specified feature, and returns the data flattening processing result to the first service instance of the specified service; The method further comprises: In response to the data flattening service module not receiving the corresponding second intermediate response result in advance, the data flattening service module is used to return a result without data flattening processing to the first service instance of the designated service.
14. The method according to claim 13, wherein: In response to the data flattening service module having received the corresponding second intermediate response result in advance, before the data flattening service module uses the information of the specified feature in the second intermediate response result to perform data flattening processing on the information of the specified feature in the first intermediate response result based on the first data flattening request, the specified service identifier and the identifier of the specified feature, the method further includes: Using the data flattening service module to detect and determine whether the first intermediate response result and the second intermediate response result both include information of the specified feature; The method further comprises: If the data flattening service module detects that the first intermediate response result or the second intermediate response result does not include the information of the specified feature, the data flattening service module is used to issue an alarm message that the data flattening process of the specified feature cannot be performed.
15. The method according to claim 10, wherein: Acquiring a contribution of a difference rate of a specified feature of the specified service based on the first difference rate and the third difference rate includes: A difference between the first difference rate and the third difference rate is obtained as a contribution degree of the difference rate of the specified feature of the specified service.
16. A device for determining a contribution of a difference rate, comprising: A first difference rate acquisition module, used to acquire a first difference rate of the distributed search engine system based on multiple access requests screened according to preset conditions; A second difference rate acquisition module is used to acquire a second difference rate of the distributed search engine system based on the multiple access requests and taking data flattening processing of intermediate response results of a designated service of the distributed search engine system as an intervention condition; the designated service is a service of any level in the distributed search engine system; Performing data flattening on the intermediate response results of the designated service of the distributed search engine system, that is, the same access request shares the intermediate response results on the designated service; A first difference rate contribution acquisition module, configured to acquire the difference rate contribution of the specified service based on the first difference rate and the second difference rate, so as to identify the contribution degree of the specified service to the difference rate of the distributed search engine system; Wherein, the first difference rate acquisition module is used to: Marking different access requests among the multiple access requests; the different access requests refer to access requests for which the distributed search engine system has different response results to the same two access requests; Counting a first number of different access requests among the multiple access requests; Based on the first number of the differential access requests and the total number of the plurality of access requests, a first differential rate of the distributed search engine system is obtained.
17. The device according to claim 16, wherein: The second difference rate acquisition module includes: a first balancing processing unit, configured to perform data balancing processing on intermediate response results of two access requests of an access request pair corresponding to each access request in the multiple access requests at a location of a designated service of the distributed search engine system; the access request pair corresponding to each access request is generated based on the access request, and the access request pair includes two identical access requests; A first response result obtaining unit is used to obtain, based on the intermediate response result after data flattening processing is performed on the designated service, a first response result obtained by the distributed search engine system continuing to respond to the first access request in the access request pair, and a second response result obtained by continuing to respond to the second access request in the access request pair; The first difference rate acquisition unit is used to acquire a second difference rate of the distributed search engine system response based on the first response result and the second response result corresponding to each access request pair.
18. The device according to claim 17, wherein: The first flattening processing unit is used for: For a first access request in the access request pair, a first intermediate response result obtained in a process of obtaining a response to the first access request using the first service instance of the designated service; Using the first service instance of the designated service to send a first data flattening request carrying the access request identifier, the designated service identifier, and the first intermediate response result to a data flattening service module; The data flattening service module uses the designated service identifier that needs to perform data flattening processing based on the first data flattening request and the configuration to perform data flattening processing on the first intermediate response result, and returns the data flattening processing result to the first service instance of the designated service.
19. The device according to claim 18, wherein: The first flattening processing unit is used for: The data flattening service module is used to detect whether a corresponding second intermediate response result has been received in advance based on the access request identifier and the designated service identifier, where the second intermediate response result is a second service instance of the designated service of the distributed search engine system, obtained in the process of responding to the second access request in the corresponding access request pair, and a second data flattening request carrying the access request identifier, the designated service identifier and the second intermediate response result is sent to the data flattening service module in advance; In response to the fact that the data flattening service module has pre-received the corresponding second intermediate response result, the data flattening service module uses the second intermediate response result to perform data flattening processing on the first intermediate response result based on the first data flattening request and the designated service identifier, and returns the data flattening processing result to the first service instance of the designated service.
20. The device according to claim 19, wherein The first leveling processing unit is further used for: In response to the data flattening service module not receiving the corresponding second intermediate response result in advance, the data flattening service module is used to return a result without data flattening processing to the first service instance of the designated service.
21. The device according to claim 19, wherein The first data flattening request also carries information about a first sub-request, where the first sub-request is a sub-request generated by the distributed search engine system in the process of processing the first access request and processed by the first service instance of the designated service; the second data flattening request also carries information about a second sub-request, where the second sub-request is a sub-request generated by the distributed search engine system in the process of processing the second access request in the corresponding access request pair and processed by the second service instance of the designated service; The first leveling processing unit is further used for: If the first sub-request and the second sub-request are in a set form or an array form, based on the information of the first sub-request and the information of the second sub-request, the data flattening service module is used to detect and determine that the first sub-request is the same as the second sub-request.
22. The device according to claim 21, wherein The first leveling processing unit is further used for: If the first sub-request and the second sub-request are different, the data leveling service module is used to issue an alarm message indicating that data leveling processing cannot be performed.
23. The device according to claim 17, wherein: The first difference rate obtaining unit is used for: For each access request pair, if the corresponding first response result and the second response result are different, marking the corresponding access request as a difference access request; counting a second number of different access requests among the multiple access requests; Based on the second number of the differential access requests and the total number of the plurality of access requests, a second differential rate of the distributed search engine system is obtained.
24. The device according to any one of claims 16 to 23, wherein: The first difference rate contribution acquisition module is used to acquire the difference between the first difference rate and the second difference rate as the contribution of the difference rate of the designated service.
25. The device according to any one of claims 16 to 23, wherein: The device also includes: A third difference rate acquisition module is used for, when determining that a difference rate contribution analysis of a secondary drill-down feature is required based on the contribution of the difference rate of the designated service, acquiring a third difference rate of the distributed search engine system based on the multiple access requests and taking data flattening processing of the designated feature in the intermediate response result of the designated service of the distributed search engine system as an intervention condition; The second difference rate contribution acquisition module is used to acquire the contribution of the difference rate of the specified feature of the specified service based on the first difference rate and the third difference rate, so as to identify the contribution degree of the specified feature in the specified service to the difference rate of the distributed search engine system.
26. The device according to claim 25, wherein The third difference rate acquisition module includes: a second balancing processing unit, configured to perform data balancing processing on a designated feature in an intermediate response result of two access requests of the corresponding access request pair at a designated service location of the distributed search engine system for the access request pair corresponding to each access request in the multiple access requests; A second response result obtaining unit is configured to obtain an intermediate response result after data flattening processing based on the specified feature, and obtain a third response result obtained by the distributed search engine system continuing to respond to the first access request in the access request pair, and a fourth response result obtained by continuing to respond to the second access request in the access request pair; The second difference rate acquisition unit is used to acquire a third difference rate of the distributed search engine system response based on the third response result and the fourth response result corresponding to each access request pair.
27. The device according to claim 26, wherein: The second flattening processing unit is used for: For a first access request in the access request pair, a first intermediate response result obtained in a process of obtaining a response to the first access request using the first service instance of the designated service; Using the first service instance of the designated service to send a first data flattening request carrying the access request identifier, the designated service identifier, and the first intermediate response result to a data flattening service module; The data flattening service module performs data flattening on the specified features in the first intermediate response result based on the first data flattening request and the identifier of the specified feature corresponding to the pre-configured specified service identifier that needs to be processed for data flattening, and returns the flattening result to the first service instance of the specified service.
28. The device according to claim 27, wherein The second flattening processing unit is used for: The data flattening service module is used to detect whether a corresponding second intermediate response result has been received in advance based on the access request identifier and the designated service identifier, where the second intermediate response result is a second service instance of the designated service of the distributed search engine system, obtained in the process of responding to the second access request in the corresponding access request pair, and a second data flattening request carrying the access request identifier, the designated service identifier and the second intermediate response result is sent to the data flattening service module in advance; In response to the data flattening service module having received the corresponding second intermediate response result in advance, the data flattening service module uses the information of the specified feature in the second intermediate response result to perform data flattening processing on the information of the specified feature in the first intermediate response result based on the first data flattening request, the specified service identifier and the identifier of the specified feature, and returns the data flattening processing result to the first service instance of the specified service; The second flattening processing unit is further configured to, in response to the data flattening service module not receiving the corresponding second intermediate response result in advance, use the data flattening service module to return a result without data flattening processing to the first service instance of the designated service.
29. The device according to claim 28, wherein The second flattening processing unit is further used to detect and determine, using the data flattening service module, whether the first intermediate response result and the second intermediate response result both include the information of the specified feature; The second flattening processing unit is also used to use the data flattening service module to issue an alarm message that the data flattening processing of the specified feature cannot be performed if the data flattening service module detects that the first intermediate response result or the second intermediate response result does not include the information of the specified feature.
30. The device according to claim 25, wherein: The second difference rate contribution acquisition module is used to: A difference between the first difference rate and the third difference rate is obtained as a contribution degree of the difference rate of the specified feature of the specified service.
31. An electronic device comprising: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 15.
32. A non-transitory computer-readable storage medium storing computer instructions, wherein: The computer instructions are used to cause the computer to execute the method according to any one of claims 1-15.
33. A computer program product comprising a computer program, which, when executed by a processor, implements the method according to any one of claims 1 to 15.
Citation Information
Patent Citations
Data retrieval method and device
CN109558444A
Search engine updating method and device, equipment, medium and product
CN113961643A