Data retrieval method and device, equipment and storage medium

Abstract

The embodiment of the invention provides a data retrieval method and device, equipment and a storage medium. The method comprises the steps that a retrieval request of a user is acquired; according to the retrieval request, judging whether the user has the authority to access the corresponding service data or not; if the user has the authority to access the corresponding service data, determining at least one service processor corresponding to the retrieval request; determining an effective data proportion of at least one service processor; querying corresponding service data in the at least one service processor according to the effective data proportion of the at least one service processor; outputting the business data according to a preset sequence; according to the method, the service processor needing to be used can be accurately positioned, blind searching in irrelevant processors is avoided, and therefore searching time is saved, the overall efficiency of data retrieval is improved, and expandability and development efficiency of the system are greatly improved.

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular to a data retrieval method, device, equipment and storage medium. Background Art

[0002] Given the massive number of users in today's computer systems, multi-way recall based on retrieval systems has become an indispensable capability. Multi-way recall based on retrieval systems is a method of enhancing information retrieval effects through multiple strategies or models. Currently, the more common implementation scheme is to access and retrieve one or more index data sources through hard coding, but the scalability and development efficiency are poor. Summary of the invention

[0003] In view of the above problems, embodiments of the present invention are proposed to provide a data retrieval method, apparatus, device and storage medium that overcome the above problems or at least partially solve the above problems.

[0004] In order to solve the above problem, an embodiment of the present invention discloses a data retrieval method, which includes:

[0005] Get the user's search request;

[0006] According to the search request, determining whether the user has the authority to access the corresponding business data;

[0007] If the user has the authority to access the corresponding business data, determining at least one business processor corresponding to the retrieval request;

[0008] Determining a valid data ratio of the at least one service processor;

[0009] According to the effective data ratio of the at least one service processor, querying the corresponding service data in the at least one service processor;

[0010] The business data is output in a preset order.

[0011] Optionally, the search request includes a user identifier and a type of business data to be accessed, and judging whether the user has the authority to access the corresponding business data according to the search request includes:

[0012] Acquire a preset mapping relationship, where the preset mapping relationship includes the types of business data with access rights corresponding to different user identifiers;

[0013] Querying the target service data type corresponding to the user identifier in the preset mapping relationship;

[0014] Determine whether the business data type to be accessed is included in the target business data type;

[0015] If the type of business data that needs to be accessed is included in the type of target business data, it is determined that the user has the authority to access the corresponding business data.

[0016] Optionally, the retrieval request includes a service vertical category identifier, and determining at least one service processor corresponding to the retrieval request includes:

[0017] Obtaining a preset correspondence relationship, where the preset correspondence relationship includes business processors corresponding to different business vertical category identifiers;

[0018] According to the service vertical category identifier, query at least one corresponding service processor in the preset corresponding relationship.

[0019] Optionally, the retrieval request includes the number of returned business data; and querying the corresponding business data in the at least one business processor according to the effective data ratio of the at least one business processor includes:

[0020] Determine the number of business data items that the at least one business processor needs to query according to the number of business return items and the valid data ratio of the at least one business processor;

[0021] According to the number of business data items that the at least one business processor needs to query, the corresponding business data is queried in the at least one business processor.

[0022] Optionally, the search request includes features of data to be searched, and outputting the business data in a preset order includes:

[0023] Determine a similarity score between the business data and the data features to be retrieved;

[0024] Arranging the output order of the business data in descending order of the similarity scores to obtain a preset order of the business data;

[0025] The business data is output according to the preset order.

[0026] Optionally, the method further comprises:

[0027] If the number of business data output by the target business processor is greater than the number of business data that needs to be output;

[0028] Then determining the number of service data items exceeded by the target service processor;

[0029] After the business data that needs to be output is output, the excess business data is output.

[0030] Optionally, the method further comprises:

[0031] determining whether the at least one service processor needs to be compensated;

[0032] If the at least one service processor needs to be compensated, determining the number of rows that the at least one service processor needs to be compensated for according to the effective data ratio of the at least one service processor;

[0033] The at least one service processor is compensated according to the number of rows that need to be compensated for the at least one service processor, and the row number start position and the row number end position of the at least one service processor are updated after the compensation is completed.

[0034] The present invention also discloses a data retrieval device, which comprises:

[0035] An acquisition module is used to obtain a user's search request;

[0036] A judgment module, used to judge whether the user has the authority to access the corresponding business data according to the search request;

[0037] a processor determination module, configured to determine at least one business processor corresponding to the search request if the user has the authority to access the corresponding business data;

[0038] A proportion determination module, used to determine the effective data proportion of the at least one service processor;

[0039] A query module, configured to query corresponding service data in the at least one service processor according to the effective data ratio of the at least one service processor;

[0040] The output module is used to output the business data in a preset order.

[0041] Optionally, the search request includes a user identifier and a type of business data to be accessed, and the query module includes:

[0042] A first acquisition submodule is used to acquire a preset mapping relationship, where the preset mapping relationship includes the types of business data with access rights corresponding to different user identifiers;

[0043] A first query submodule, used to query the target service data type corresponding to the user identifier in the preset mapping relationship;

[0044] A judgment submodule, used to judge whether the business data type to be accessed is included in the target business data type;

[0045] The first determination submodule is used to determine whether the user has the authority to access the corresponding business data if the business data type that needs to be accessed is included in the target business data type.

[0046] Optionally, the retrieval request includes a service vertical category identifier, and the processor determines the module, including:

[0047] A second acquisition submodule is used to acquire a preset correspondence relationship, where the preset correspondence relationship includes a service processor corresponding to different service vertical category identifiers;

[0048] The second query submodule is used to query at least one corresponding business processor in the preset corresponding relationship according to the business vertical category identifier.

[0049] Optionally, the retrieval request includes the number of returned business data; and the query module includes:

[0050] A second determination submodule is used to determine the number of business data items that the at least one business processor needs to query according to the number of business return items and the effective data ratio of the at least one business processor;

[0051] The third query submodule is used to query the corresponding business data in the at least one business processor according to the number of business data items that need to be queried by the at least one business processor.

[0052] Optionally, the search request includes data features to be searched, and the output module includes:

[0053] A score determination submodule, used to determine a similarity score between the business data and the data features to be retrieved;

[0054] A sorting module, used to arrange the output order of the business data in descending order of the similarity scores to obtain a preset order of the business data;

[0055] The first output submodule is used to output the business data according to the preset order.

[0056] Optionally, the device further comprises:

[0057] A first determination module, configured to determine the number of service data items that exceed the target service processor if the number of service data items output by the target service processor is greater than the number of items that need to be output;

[0058] The data output module is used to output the excess business data after the business data that needs to be output is output.

[0059] Optionally, it also includes:

[0060] A second determination module, configured to determine whether the at least one service processor needs to be compensated;

[0061] A third determination module is used to determine the number of rows that need to be compensated for the at least one service processor according to the effective data ratio of the at least one service processor if the at least one service processor needs to be compensated;

[0062] The compensation module is used to compensate the at least one service processor according to the number of rows that need to be compensated for the at least one service processor, and to update the row number start position and row number end position of the at least one service processor after the compensation is completed.

[0063] The present invention also discloses an electronic device, comprising: a processor, a memory, and a computer program stored in the memory and capable of running on the processor, wherein the computer program implements the steps of the above-mentioned data retrieval method when executed by the processor.

[0064] The present invention also discloses a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the above-mentioned data retrieval method are implemented.

[0065] The embodiments of the present invention include the following advantages:

[0066] The present invention discloses a data retrieval method. The present invention can accurately locate a business processor that needs to be used, avoid blind searching in irrelevant processors, thereby saving search time and improving the overall efficiency of retrieving data. The present invention determines the corresponding business data according to the proportion of effective data, and can preferentially search in places where the proportion of effective data is high, further optimize the query process, reduce unnecessary data screening and traversal, speed up the acquisition of target business data, and greatly improve the scalability and development efficiency of the system; the present invention authenticates users, and only authorized legal users can access the corresponding business data, which effectively guarantees the security of data, avoids security risks such as data leakage, and maintains the confidentiality and integrity of the entire business data system. BRIEF DESCRIPTION OF THE DRAWINGS

[0067] Figure 1 is a flow chart of steps of a data retrieval method provided by an embodiment of the present invention;

[0068] Figure 2 is a structural block diagram of a data retrieval system provided by an embodiment of the present invention;

[0069] Figure 3 It is a structural block diagram of a data retrieval device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0070] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and understandable, the present invention is further described in detail below with reference to the accompanying drawings and specific embodiments.

[0071] One of the core concepts of the embodiments of the present invention is that the present invention can accurately locate the business processor that needs to be used, avoiding blind searches in irrelevant processors, thereby saving search time and improving the overall efficiency of retrieving data. The present invention determines the corresponding business data based on the proportion of valid data, and can give priority to searching in places where the proportion of valid data is high, further optimizing the query process, reducing unnecessary data screening and traversal, and speeding up the acquisition of target business data, thereby greatly improving the scalability and development efficiency of the system; the present invention authenticates users, and only authorized legitimate users can access the corresponding business data, which effectively ensures the security of data, avoids security risks such as data leakage, and maintains the confidentiality and integrity of the entire business data system.

[0072] Reference Figure 1 , shows a flow chart of the steps of a data retrieval method provided by an embodiment of the present invention, the method may include the following steps:

[0073] Step 101: Obtain a user's search request.

[0074] In an embodiment of the present invention, by receiving a search request input by a user, the specific data content that the user wants to obtain can be clarified. For example, the user may enter a search request such as "query for a list of customers whose sales performance exceeded 100,000 yuan in the past month" in the company's internal database system, which provides a clear target direction for subsequent operations.

[0075] Step 102: judging whether the user has the authority to access the corresponding business data according to the search request;

[0076] In an embodiment of the present invention, different users can only access data within a specific range based on their positions, responsibilities and other factors. When a search request is obtained, the user's permissions can be accessed based on the data carried in the search request. This step can ensure the security and compliance of the data and prevent users from unauthorized access to sensitive information. For example, ordinary sales personnel may only be able to access the sales data of customers in the area they are responsible for, and have no right to view data in other areas. The access scope is strictly controlled through permission judgment.

[0077] It is usually associated with a pre-set permission management system, which records the accessible data range rules corresponding to different user roles, accounts, etc. The corresponding permission rules are matched according to key information such as the data type involved in the retrieval request and the business module to which it belongs to determine whether the user has access rights.

[0078] Step 103: If the user has the authority to access the corresponding business data, at least one business processor corresponding to the search request is determined.

[0079] In an embodiment of the present invention, a business processor refers to a module or component responsible for processing operations such as querying specific business data. Only by determining these processors can we further know where to find specific data. For example, in an e-commerce system, for the retrieval of product data, there may be a processor specifically for processing basic product information, a processor for processing product sales records, etc. According to the retrieval request, the relevant processors such as the basic product information processor and the inventory management business processor are determined.

[0080] It is generally determined by a pre-established mapping relationship between search requests and business processors. This mapping relationship may be designed based on business logic and data architecture to map different types of search requirements to corresponding business processors.

[0081] Step 104: determine the effective data ratio of at least one service processor.

[0082] In an embodiment of the present invention, the proportion of valid data can reflect the approximate proportion of data that meets the retrieval requirements in each business processor to the total data volume, which is helpful for subsequent selection of a more efficient data query path, giving priority to searching from processors with a higher proportion of valid data, thereby improving retrieval efficiency.

[0083] In one example, 100 pieces of data are stored in business processor A, 300 pieces of data are stored in business processor B, and 600 pieces of data are stored in business processor C, that is, the effective data proportion of business processor A is 100 / (100+300+600)=10%, the effective data proportion of business processor B is 300 / (100+300+600)=30%, which means that only 30% of the data is retrieved from business processor B, and the effective data proportion of business processor C is 600 / (100+300+600)=60%, which means that 60% of the data is retrieved from business processor C.

[0084] Step 105: query corresponding service data in at least one service processor according to the effective data ratio of at least one service processor.

[0085] In an embodiment of the present invention, after determining at least one business processor, business data can be queried from the at least one business processor based on the effective data ratio of the at least one business processor. Data that meets the retrieval request can be preferentially searched from business processors with a higher effective data ratio to obtain the required data as quickly as possible. For example, at least one business processor includes business processor 1 and business processor 2. The number of data items to be retrieved is 10, of which the effective data ratio of business processor 1 is 80% and the effective data ratio of business processor 2 is 20%. Eight data items can be searched from business processor 1, where the effective data ratio is 80%, and then two data items can be queried from business processor 2.

[0086] Step 106: output the business data in a preset order.

[0087] In an embodiment of the present invention, after obtaining business data, a preset order of the business data can be determined first, that is, the order in which the business data is displayed. The order can be determined based on the similarity between the business data and the data features to be queried, the importance of the business data, and the chronological order of the business data.

[0088] The present invention discloses a data retrieval method. The present invention can accurately locate a business processor that needs to be used, avoid blind searching in irrelevant processors, thereby saving search time and improving the overall efficiency of data retrieval. The present invention can determine the corresponding business data according to the proportion of effective data, and can preferentially search in places where the proportion of effective data is high, further optimize the query process, reduce unnecessary data screening and traversal, speed up the acquisition of target business data, and greatly improve the scalability and development efficiency of the system; the present invention authenticates users, and only authorized legal users can access the corresponding business data, which effectively guarantees the security of data, avoids security risks such as data leakage, and maintains the confidentiality and integrity of the entire business data system.

[0089] In one embodiment of the present invention, a retrieval request includes a user identifier and the type of business data that needs to be accessed, and based on the retrieval request, determining whether the user has the authority to access the corresponding business data includes: obtaining a preset mapping relationship, the preset mapping relationship includes business data types with access rights corresponding to different user identifiers; querying the target business data type corresponding to the user identifier in the preset mapping relationship; determining whether the business data type that needs to be accessed is included in the target business data type; if the business data type that needs to be accessed is included in the target business data type, determining that the user has the authority to access the corresponding business data.

[0090] In an embodiment of the present invention, the preset mapping relationship sorts out and records in advance the business data types with access rights corresponding to different user identifiers. For example, in the internal system of an e-commerce company, the business data types with access rights corresponding to the user identifier of employee A may include "basic information of goods" and "order status data", while the business data types with access rights corresponding to employee B may include "customer evaluation data" and "after-sales processing data", etc.

[0091] When receiving a search request from a user, the user identification information can be extracted from the search request, and then the identification can be used to perform an accurate search in the acquired preset mapping relationship to find the corresponding target business data type. For example, if the user identification in the search request is "USER001", the set of business data types that are allowed to be accessed corresponding to "USER001" is searched in the preset mapping relationship. In one example, the target business data types found are "sales report data" and "inventory warning data", etc. The data to be queried is sales report data, which is included in the target business data type, indicating that the user has the authority to access the corresponding business data.

[0092] In another example, when the type of business data that needs to be accessed is not included in the target business data type, it means that the user does not have permission to access the corresponding business data. At this time, a reminder message can be output to remind the user that he does not have permission to access the business data. The present invention carefully compares and judges the key information in the user's retrieval request based on the preset mapping relationship, forming a relatively complete user authority access judgment mechanism, which provides reliable protection for authority management in the entire data retrieval process, ensuring that only users with corresponding permissions can obtain the required business data, thereby ensuring the security of the data.

[0093] In one embodiment of the present invention, a retrieval request includes a business vertical category identifier, and determining at least one business processor corresponding to the retrieval request includes: obtaining a preset correspondence relationship, the preset correspondence relationship includes business processors corresponding to different business vertical category identifiers; and querying at least one corresponding business processor in the preset correspondence relationship according to the business vertical category identifier.

[0094] In an embodiment of the present invention, the retrieval request may include a business vertical category identifier. The preset correspondence refers to a pre-recorded association table between different business vertical category identifiers and corresponding business processors. The business vertical category identifiers here are usually used to classify and identify different business fields and business types. For example, in a comprehensive e-commerce platform system, business vertical category identifiers may include "product display", "order processing", "customer service", etc.; and the business processor is the functional module responsible for specifically processing a certain type of business-related data operation. For example, for the "product display" business vertical category identifier, there may be a processor specifically for processing product image display, a product details information processor, etc. By obtaining this preset correspondence, you can know which specific modules should handle different business classifications, which provides a key basis for subsequent search for corresponding business processors.

[0095] When a retrieval request containing a business vertical category identifier is received, the business vertical category identifier information can be extracted from it, and then used as a clue to search and match in the preset corresponding relationship that has been obtained. For example, if the business vertical category identifier in the retrieval request is "order processing", the business processor corresponding to "order processing" is searched in the preset corresponding relationship. You may find multiple related business processors such as "order creation processor", "order query processor", and "order status update processor". The purpose of this step is to accurately locate those specific business processors that can process data of the business type involved in the current retrieval request, so that you can further search and obtain the corresponding business data in these processors later.

[0096] In one embodiment of the present invention, a retrieval request includes the number of returned business data items; and according to the effective data ratio of at least one business processor, corresponding business data is queried in at least one business processor, including: determining the number of business data items that need to be queried by at least one business processor according to the number of returned business data items and the effective data ratio of at least one business processor; and according to the number of business data items that need to be queried by at least one business processor, querying corresponding business data in at least one business processor.

[0097] In an embodiment of the present invention, it is assumed that the number of business data items required to be returned in the retrieval request is N, and there are multiple business processors, which are respectively denoted as processors P1, P2, and P3, and their corresponding valid data accounts for 20%, 30%, and 50%, respectively. In order to reasonably allocate query tasks, improve query efficiency, and avoid unnecessary full data queries, it is necessary to determine the approximate number of data items that each processor needs to query based on these proportions.

[0098] The number of data items that processor P1 needs to query is N*20%, the number of data items that processor P2 needs to query is N*30%, and the number of data items that processor P3 needs to query is N*50%. For example, if 100 business data items are required to be returned (i.e., N=100), then the number of data items that P1 needs to query is 20, the number of data items that P2 needs to query is 30, and the number of data items that P3 needs to query is 50.

[0099] After determining the number of data items that each business processor needs to query, the corresponding query instructions can be sent to each business processor. After receiving the instructions, each business processor will perform data retrieval and matching operations according to the required number of data items based on its own internal data storage structure and query logic. For example, after business processor P1 receives an instruction to query 20 data, it can filter data line by line from its own stored data table according to other filtering conditions set in the previous search request until 20 data that meet the requirements are found. After business processor P2 receives an instruction to query 30 data, it can filter data line by line from its own stored data table according to other filtering conditions set in the previous search request until 30 data that meet the requirements are found. After business processor P3 receives an instruction to query 50 data, it can filter data line by line from its own stored data table according to other filtering conditions set in the previous search request until 50 data that meet the requirements are found. The present invention can reasonably determine the query task volume of each processor based on the number of business data returned and the proportion of effective data of the business processor, and then implement specific query operations based on this, thereby constructing a more scientific and flexible business data query mechanism, which can improve query efficiency as much as possible while meeting the user's requirements for the number of returned data, cope with various complex situations that may arise, and ensure that the entire data retrieval process is completed smoothly and outputs data results that meet expectations.

[0100] In one embodiment of the present invention, a retrieval request includes data features to be retrieved, and business data is output in a preset order, including: determining a similarity score between the business data and the data features to be retrieved; arranging the output order of the business data in descending order of the similarity score to obtain a preset order of the business data; and outputting the business data in the preset order.

[0101] In an embodiment of the present invention, after the corresponding business data is queried from each business processor, in order to sort these data according to the degree of fit with the user's expectations, it is necessary to first determine the similarity between each business data and the data feature to be retrieved set by the user in the search request, and quantify the degree of this match by assigning a similarity score. For example, the data feature to be retrieved in the search request is "product information with high recent sales and high customer satisfaction". For a certain business data queried, such as the relevant data record about product A, the sales situation, customer satisfaction situation, etc. of product A can be analyzed to see how well they match the set data features, and then a specific similarity score can be given, such as a score of 0.8.

[0102] After obtaining the similarity score corresponding to each piece of business data, these business data are sorted in descending order to form a preset order. For example, there are three pieces of business data with similarity scores of 0.8, 0.6, and 0.4 respectively. Then the preset order after sorting is to output the business data with a similarity score of 0.8 first, followed by 0.6, and finally 0.4. The business data is then output to the user according to the preset order.

[0103] The advantage of this sorting by similarity is that the data that best meets the user's search requirements can be presented to the user first, allowing the user to quickly focus on key information without having to sift and identify the disorganized query results themselves. This greatly improves the efficiency of users viewing and using search results and enhances the user experience, especially when a large amount of business data is queried.

[0104] It should be noted that the sorted business data can be displayed in the form of a table, list, etc. in a web interface, or the data can be exported as a file, filled with content in a preset order, and then provided to users for download and viewing.

[0105] In one embodiment of the present invention, the method also includes: if the number of business data items output by the target business processor is greater than the number required to be output; then determining the number of business data items that exceed the target business processor; and outputting the excess business data after the business data required to be output is output.

[0106] In an embodiment of the present invention, in the actual data retrieval and output process, due to various reasons, such as when the business processor searches for data according to its own query rules and preset filtering conditions, it may obtain more data than the user expects, or the estimation of the data volume is inaccurate, etc., it is possible that the number of business data that the target business processor finally finds and prepares to output is more than the number of business data specified by the user in the retrieval request. For example, the user clearly stated in the retrieval request that only 10 business data are needed, but after the business processor's query and screening, 15 qualified business data were obtained, and the judgment condition is met at this time.

[0107] When it is determined that the number of business data items output by the target business processor is greater than the number required to be output, the specific number of excess items needs to be calculated. The number of business data items that the target business processor is actually prepared to output can be subtracted from the number of business data items that the user needs to output. For example, if the target business processor is prepared to output 15 data items, and the user needs to output 10 data items, then the number of excess business data items is 15-10=5 items.

[0108] When the number of excess business data items is determined, the strategy set in this embodiment can be used to first output the business data that the user needs to output in a normal order according to the previously established order, ensuring that the user can first obtain the core data content that he or she expects in quantity and meets the expected requirements. After completing this operation, the excess business data calculated previously can be output. The present invention can prevent users from being disturbed by too much unnecessary data, allowing users to quickly focus on key data for viewing and analysis. At the same time, the additional data is not directly discarded, but provided to users after the basic needs of users are met, thereby retaining the integrity of the data. If the user has the need to further view more related data in the future, the excess data can still play a role, thereby improving data utilization and reflecting the flexibility and humanization of the entire data retrieval and output process.

[0109] In one embodiment of the present invention, the method also includes: determining whether at least one business processor needs to be compensated; if at least one business processor needs to be compensated, determining the number of rows that need to be compensated for the at least one business processor according to the effective data ratio of the at least one business processor; compensating the at least one business processor according to the number of rows that need to be compensated for the at least one business processor, and updating the starting position and ending position of the rows of the at least one business processor after the compensation is completed.

[0110] In an embodiment of the present invention, whether at least one business processor needs compensation is usually determined based on a variety of factors. It is possible that during the previous data query, processing or output process, due to data loss, partial data not meeting the expected quality standards, or the business processor not meeting the required data volume requirements according to established rules, the data in the business processor needs to be supplemented to ensure that it can subsequently participate normally in data retrieval, processing and other related work, and output accurate and complete data to the user.

[0111] In one example, business processor 1 stores 500 pieces of conference data, and business processor 2 stores 300 pieces of conference data. The current retrieval request needs to obtain 200 pieces of conference data. According to the configured multi-channel recall ratio, business processor 1 should provide 60% (i.e. 120 pieces), and business processor 2 should provide 40% (i.e. 80 pieces). Initially, the starting position of business processor 1 is 0, the planned rows to be obtained are 120 pieces, and the total data volume is 500 pieces; the starting position of business processor 2 is 0, the planned rows to be obtained are 80 pieces, and the total data volume is 300 pieces.

[0112] Assume that due to uneven data distribution or other factors, business processor 1 actually returns 130 data items and business processor 2 returns 80 data items. At this time, compensation calculation is required. First, the number of rows that need to be compensated, rowsLost, is calculated to be 130-120=10. For business processor 1, since its starting position 0 is less than the total data volume 500, the number of rows to be reduced is calculated proportionally, that is, the number of business data items of business processor 1 is reduced by 10 items so that it returns 120 data items. Then, after the compensation is completed, the starting position and ending position of the number of rows of at least one business processor are updated to ensure that the amount of recalled data of each data source is consistent with its proportion, thereby improving the accuracy of the results and the balance of the recall.

[0113] like Figure 2 , showing a structural block diagram of a retrieval system provided by an embodiment of the present invention, the retrieval system may include a service entry layer (search-web): this is the top layer of the system, responsible for receiving external requests.

[0114] Policy scheduling layer (thoth): below the service entry layer, responsible for scheduling and policy management, and can determine at least one corresponding business processor based on the retrieval request.

[0115] Basic recall layer (common-search): Below is the basic recall layer, which is used for preliminary data retrieval. The number of data items that each business processor needs to query can be determined based on the data ratio at the basic recall layer.

[0116] Data proxy layer (data-proxy): This layer contains multiple data proxy modules, namely business processors, such as knowledge-card, meeting, xplatform-accounts, hifile, etc.

[0117] knowledge-card: Data processor associated with knowledge cards.

[0118] meeting: A proxy processor for data related to meetings.

[0119] xplatform-accounts: Proxy processor for data related to cross-platform accounts.

[0120] hifile: A proxy processor for file-related data.

[0121] soir: A data proxy processor associated with a certain data type.

[0122] ecoloud: A data proxy processor related to cloud services.

[0123] weekly: Data proxy processor related to weekly reports.

[0124] kgdoc: A data agent processor related to knowledge documents.

[0125] mail: A proxy processor for mail-related data.

[0126] External services can interact with the service entry layer. The search process of the entire system starts from the external service, goes through various levels of processing, and finally obtains data from the underlying data storage and returns the results.

[0127] The present invention discloses a data retrieval method. The present invention can accurately locate a business processor that needs to be used, avoid blind searching in irrelevant processors, thereby saving search time and improving the overall efficiency of retrieving data. The present invention determines the corresponding business data according to the proportion of effective data, and can preferentially search in places where the proportion of effective data is high, further optimize the query process, reduce unnecessary data screening and traversal, speed up the acquisition of target business data, and greatly improve the scalability and development efficiency of the system; the present invention authenticates users, and only authorized legal users can access the corresponding business data, which effectively guarantees the security of data, avoids security risks such as data leakage, and maintains the confidentiality and integrity of the entire business data system.

[0128] It should be noted that, for the sake of simplicity, the method embodiments are described as a series of action combinations, but those skilled in the art should be aware that the embodiments of the present invention are not limited by the order of the actions described, because according to the embodiments of the present invention, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

[0129] Reference Figure 3 , shows a structural block diagram of a data retrieval device provided by an embodiment of the present invention, which is applied to a server, and the device includes:

[0130] The acquisition module 201 is used to acquire the search request of the user;

[0131] The judgment module 202 is used to judge whether the user has the authority to access the corresponding business data according to the search request;

[0132] The processor determination module 203 is used to determine at least one business processor corresponding to the search request if the user has the authority to access the corresponding business data;

[0133] A proportion determination module 204, used to determine a proportion of valid data of at least one service processor;

[0134] A query module 205, configured to query corresponding service data in at least one service processor according to a valid data ratio of at least one service processor;

[0135] The output module 206 is used to output the business data in a preset order.

[0136] The present invention discloses a data retrieval device. The present invention can accurately locate a business processor that needs to be used, avoid blind searching in irrelevant processors, thereby saving search time and improving the overall efficiency of retrieving data. The present invention determines the corresponding business data according to the proportion of effective data, and can preferentially search in places where the proportion of effective data is high, further optimize the query process, reduce unnecessary data screening and traversal, speed up the acquisition of target business data, and greatly improve the scalability and development efficiency of the system; the present invention authenticates users, and only authorized legal users can access the corresponding business data, which effectively guarantees the security of data, avoids security risks such as data leakage, and maintains the confidentiality and integrity of the entire business data system.

[0137] In one embodiment of the present invention, the search request includes a user identifier and the type of business data to be accessed, and the query module includes:

[0138] A first acquisition submodule is used to acquire a preset mapping relationship, where the preset mapping relationship includes the type of business data with access rights corresponding to different user identifiers;

[0139] A first query submodule, used to query the target service data type corresponding to the user identifier in a preset mapping relationship;

[0140] A judgment submodule is used to judge whether the business data type to be accessed is included in the target business data type;

[0141] The first determination submodule is used to determine whether the user has the authority to access the corresponding business data if the type of business data to be accessed is included in the target business data type.

[0142] In an embodiment of the present invention, the search request includes a service vertical category identifier, and the processor determines the module, including:

[0143] The second acquisition submodule is used to acquire a preset correspondence relationship, where the preset correspondence relationship includes a business processor corresponding to different business vertical category identifiers;

[0144] The second query submodule is used to query at least one corresponding business processor in a preset corresponding relationship according to the business vertical category identifier.

[0145] In an embodiment of the present invention, the search request includes the number of returned business data; the query module includes:

[0146] A second determination submodule is used to determine the number of business data items that at least one business processor needs to query according to the number of business return items and the effective data ratio of at least one business processor;

[0147] The third query submodule is used to query corresponding business data in at least one business processor according to the number of business data items that need to be queried by at least one business processor.

[0148] In one embodiment of the present invention, the search request includes data features to be searched, and the output module includes:

[0149] A score determination submodule is used to determine the similarity score between the business data and the data features to be retrieved;

[0150] A sorting module is used to arrange the output order of the business data in descending order of similarity scores to obtain a preset order of the business data;

[0151] The first output submodule is used to output business data in a preset order.

[0152] In one embodiment of the present invention, the device further includes:

[0153] A first determination module, configured to determine the number of service data items that the target service processor exceeds if the number of service data items output by the target service processor is greater than the number of items that need to be output;

[0154] The data output module is used to output the excess business data after the business data that needs to be output is output.

[0155] In one embodiment of the present invention, it also includes:

[0156] A second determination module, used to determine whether at least one service processor needs to be compensated;

[0157] A third determination module is used to determine the number of rows that need to be compensated for at least one business processor according to the effective data ratio of at least one business processor if at least one business processor needs to be compensated;

[0158] The compensation module is used to compensate at least one service processor according to the number of rows that need to be compensated for at least one service processor, and to update the row number start position and row number end position of at least one service processor after the compensation is completed.

[0159] The present invention discloses a data retrieval device. The present invention can accurately locate a business processor that needs to be used, avoid blind searching in irrelevant processors, thereby saving search time and improving the overall efficiency of retrieving data. The present invention determines the corresponding business data according to the proportion of effective data, and can preferentially search in places where the proportion of effective data is high, further optimize the query process, reduce unnecessary data screening and traversal, speed up the acquisition of target business data, and greatly improve the scalability and development efficiency of the system; the present invention authenticates users, and only authorized legal users can access the corresponding business data, which effectively guarantees the security of data, avoids security risks such as data leakage, and maintains the confidentiality and integrity of the entire business data system.

[0160] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0161] An embodiment of the present invention further provides an electronic device, including:

[0162] It includes a processor, a memory, and a computer program stored in the memory and capable of running on the processor. When the computer program is executed by the processor, the various processes of the above-mentioned data retrieval method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0163] An embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the various processes of the above-mentioned data retrieval method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0164] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0165] It will be appreciated by those skilled in the art that the embodiments of the present invention may be provided as methods, devices, or computer program products. Therefore, the embodiments of the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the embodiments of the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.

[0166] The embodiments of the present invention are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0167] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0168] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable terminal device to implement the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0169] Although the preferred embodiments of the present invention have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present invention.

[0170] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprises" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "including one..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.

[0171] The data retrieval method, device, equipment and storage medium provided by the present invention are introduced in detail above. The principle and implementation mode of the present invention are explained by using specific examples in this article. The description of the above embodiments is only used to help understand the method of the present invention and its core idea. At the same time, for those skilled in the art, according to the idea of ​​the present invention, there will be changes in the specific implementation mode and application scope. In summary, the content of this specification should not be understood as limiting the present invention.

Claims

1. A data retrieval method, characterized in that: The method comprises: Get the user's search request; According to the search request, determining whether the user has the authority to access the corresponding business data; If the user has the authority to access the corresponding business data, determining at least one business processor corresponding to the retrieval request; Determining a valid data ratio of the at least one service processor; According to the effective data ratio of the at least one service processor, querying the corresponding service data in the at least one service processor; The business data is output in a preset order.

2. The method according to claim 1, characterized in that: The search request includes a user identifier and the type of business data to be accessed, and judging whether the user has the authority to access the corresponding business data according to the search request includes: Acquire a preset mapping relationship, where the preset mapping relationship includes the types of business data with access rights corresponding to different user identifiers; Querying the target service data type corresponding to the user identifier in the preset mapping relationship; Determine whether the business data type to be accessed is included in the target business data type; If the type of business data that needs to be accessed is included in the type of target business data, it is determined that the user has the authority to access the corresponding business data.

3. The method according to claim 1, characterized in that: The retrieval request includes a service vertical category identifier, and determining at least one service processor corresponding to the retrieval request includes: Obtaining a preset correspondence relationship, where the preset correspondence relationship includes business processors corresponding to different business vertical category identifiers; According to the service vertical category identifier, query at least one corresponding service processor in the preset corresponding relationship.

4. The method according to claim 1, characterized in that: The retrieval request includes the number of returned business data; and querying the corresponding business data in the at least one business processor according to the effective data ratio of the at least one business processor includes: Determine the number of business data items that the at least one business processor needs to query according to the number of business return items and the valid data ratio of the at least one business processor; According to the number of business data items that need to be queried by the at least one business processor, corresponding business data is queried in the at least one business processor.

5. The method according to claim 1, characterized in that The retrieval request includes data features to be retrieved, and the outputting of the business data in a preset order includes: Determine a similarity score between the business data and the data features to be retrieved; Arranging the output order of the business data in descending order of the similarity scores to obtain a preset order of the business data; The business data is output according to the preset order.

6. The method according to claim 1, characterized in that The method further comprises: If the number of service data items output by the target service processor is greater than the number of items required to be output, determining the number of service data items exceeded by the target service processor; After the business data that needs to be output is output, the excess business data is output.

7. The method according to claim 1, characterized in that The method further comprises: determining whether the at least one service processor needs to be compensated; If the at least one service processor needs to be compensated, determining the number of rows that the at least one service processor needs to be compensated for according to the effective data ratio of the at least one service processor; The at least one service processor is compensated according to the number of rows that need to be compensated for the at least one service processor, and the row number start position and the row number end position of the at least one service processor are updated after the compensation is completed.

8. A data retrieval device, characterized in that: The device comprises: An acquisition module is used to obtain a user's search request; A judgment module, used to judge whether the user has the authority to access the corresponding business data according to the search request; a processor determination module, configured to determine at least one business processor corresponding to the search request if the user has the authority to access the corresponding business data; A proportion determination module, used to determine the effective data proportion of the at least one service processor; A query module, configured to query corresponding service data in the at least one service processor according to the effective data ratio of the at least one service processor; The output module is used to output the business data in a preset order.

9. An electronic device, characterized in that: The method comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor is used to execute the steps of the data retrieval method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the data retrieval method according to any one of claims 1 to 7 are implemented.

Images