Query method, device and related products for shared data in heterogeneous networks
By obtaining query requests in heterogeneous networks and performing well-structured verification, generating query links and mapping them to access interfaces, the problem of low query efficiency in hybrid cloud deployment is solved and more efficient query processing is achieved.
Patent Information
- Application Number
- CN202111258347.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-10-27
- Publication Date
- 2025-09-23
- Estimated Expiration
- 2041-10-27
AI Technical Summary
Hybrid cloud deployment leads to complex storage services and low query efficiency.
By obtaining query requests for shared data, performing well-structured verification, generating query links that meet the shared data requirements, and mapping them to access interfaces, query efficiency is improved.
The efficiency of determining query links and access interfaces is improved, and query efficiency is improved.
Smart Images

Figure CN113986945B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of heterogeneous technology, and in particular to a method, device and related products for querying shared data in a heterogeneous network. Background Art
[0002] With the continuous development of cloud computing technology, a wide variety of cloud platform products are becoming increasingly available. Different cloud service providers have launched their own basic community cloud platform products in the private, public, and community cloud sectors. With an increasing number of choices, more and more cloud computing users are deploying their businesses across different cloud platforms, demonstrating the trend towards hybrid and multi-cloud deployments.
[0003] In the process of implementing the present invention, the inventors found that the existing technology centers, hybrid clouds, and multi-cloud deployments have led to increasingly complex storage services and storage loads, resulting in lower query efficiency. Summary of the Invention
[0004] Based on the above problems, embodiments of the present application provide a method, device and related products for querying shared data in a heterogeneous network.
[0005] The embodiments of this application disclose the following technical solutions:
[0006] In a first aspect, an embodiment of the present application provides a method for querying shared data in a heterogeneous network, comprising:
[0007] Query requests to obtain shared data;
[0008] Performing well-formedness verification on the query request for the shared data;
[0009] If the query request for the shared data passes the well-formedness verification, parsing the query request for the shared data according to the query link model to generate a query link that satisfies the query request for the shared data;
[0010] An access interface matching the query link is determined, and the query request for the shared data is mapped to the access interface.
[0011] Optionally, in an embodiment of the present application, the performing well-formedness verification on the query request for the shared data includes: verifying the validity and standardization of the query request for the shared data.
[0012] Optionally, in an embodiment of the present application, the verifying the validity and standardization of the query request for the shared data includes: verifying the validity and standardization of the query request for the shared data based on a set batch processing model.
[0013] Optionally, in one embodiment of the present application, the query request for the shared data is parsed according to the query link model to generate a query link that satisfies the query request for the shared data, including: matching the source address, destination address and request data in the query request for the shared data according to the query link model to generate a query link that satisfies the query request for the shared data.
[0014] In a second aspect, an embodiment of the present application provides a device for querying shared data in a heterogeneous network, comprising:
[0015] A request acquisition unit, used to obtain query requests for shared data;
[0016] a request verification unit, configured to verify the well-formedness of the query request for the shared data;
[0017] a query link generating unit, configured to parse the query request for the shared data according to a query link model and generate a query link that satisfies the query request for the shared data if the query request for the shared data passes the well-formedness verification;
[0018] A mapping unit is configured to determine an access interface that matches the query link and map the query request for the shared data to the access interface.
[0019] Optionally, in an embodiment of the present application, the request verification unit is specifically used to verify the validity and standardization of the query request for the shared data.
[0020] Optionally, in an embodiment of the present application, the request verification unit is specifically used to verify the validity and standardization of the query request for the shared data based on a set batch processing model.
[0021] Optionally, in an embodiment of the present application, the request parsing unit is used to match the source address, destination address and request data in the query request for shared data according to a query link model, and generate a query link that satisfies the query request for shared data.
[0022] In a third aspect, an embodiment of the present application provides an electronic device, comprising: a memory and a processor, wherein the memory stores a computer executable program, and the processor is used to execute the computer executable program to implement the method described in any one of the embodiments of the present application.
[0023] In a fourth aspect, an embodiment of the present application provides a computer storage medium, on which a computer executable program is stored, and when the computer executable program is run, it implements the method described in any one of the embodiments of the present application.
[0024] In an embodiment of the present application, a query request for shared data is obtained; a well-formedness verification is performed on the query request for shared data; if the query request for shared data passes the well-formedness verification, the query request for shared data is parsed according to a query link model to generate a query link that satisfies the query request for shared data; an access interface that matches the query link is determined, and the query request for shared data is mapped to the access interface, thereby effectively determining the query link and the access interface, thereby improving the efficiency of the query. BRIEF DESCRIPTION OF THE DRAWINGS
[0025] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.
[0026] Figure 1 Schematic diagram of the process of querying shared data in a heterogeneous network in the first embodiment of the present application;
[0027] Figure 2 This is a schematic diagram of the structure of a device for querying shared data in a heterogeneous network in the second embodiment of the present application;
[0028] Figure 3 This is a schematic diagram of the structure of the electronic device in Example 3 of this application;
[0029] Figure 4 This is a schematic diagram of the hardware structure of the electronic device in the fourth embodiment of the present application;
[0030] Figure 5 This is a structural diagram of the computer storage medium in Example 5 of the present application. DETAILED DESCRIPTION
[0031] The implementation of any technical solution in the embodiments of the present application does not necessarily require achieving all of the above advantages at the same time.
[0032] In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts shall fall within the scope of protection of the present invention.
[0033] In an embodiment of the present application, a query request for shared data is obtained; a well-formedness verification is performed on the query request for shared data; if the query request for shared data passes the well-formedness verification, the query request for shared data is parsed according to a query link model to generate a query link that satisfies the query request for shared data; an access interface that matches the query link is determined, and the query request for shared data is mapped to the access interface, thereby effectively determining the query link and the access interface, thereby improving the efficiency of the query.
[0034] Figure 1 Schematic diagram of the query method for shared data in a heterogeneous network in the first embodiment of the present application; Figure 1 As shown, it can be specifically executed by the scheduling server, which includes:
[0035] S101, obtaining a query request for shared data;
[0036] Furthermore, the query request may include an identification of the request initiator, which may be the address of the request initiator, or a unique feature SN assigned to the request initiator. In addition, the query request may also include a request type identification.
[0037] Specifically, the query request may structurally include a request line, a request header, and a request body. The identity identifier of the request initiator is included in the request line, the type identifier of the request is included in the request header, and the data address pointed to by the request is included in the request data, thereby facilitating subsequent parsing, clustering, and response to the request.
[0038] In this embodiment, a unified API interface is used to obtain query requests for shared data initiated by heterogeneous networks. Specifically, the API interface can be periodically accessed according to a set polling rule to obtain query requests for shared data initiated by heterogeneous networks, thereby achieving real-time access.
[0039] S102, performing well-formedness verification on the query request for the shared data;
[0040] If the query request for the shared data passes the well-formedness verification, step S103 is executed; otherwise, the query request for the shared data is rejected;
[0041] Specifically, in this embodiment, in step S102 , the well-formedness verification of the query request for the shared data includes: verifying the validity and standardization of the query request for the shared data.
[0042] Furthermore, in this embodiment, in step S102 , the verifying the validity and standardization of the query request for the shared data includes: verifying the validity and standardization of the query request for the shared data based on a set batch processing model.
[0043] Specifically, in this embodiment, the validity and standardization verification includes the following verification contents:
[0044] Verify whether each component element in the query request includes start and end tags and whether they match each other; whether the nesting relationship between each component element is correct, such as whether the child element is nested in the parent element, whether the attribute description field of each component element is valid and correctly expressed, and whether there is any duplication of attributes between each element, so as to effectively and comprehensively verify the validity and normativeness of the query request and ensure the correctness of the query request.
[0045] Specifically, in this embodiment, the validation and standardization of the query request for the shared data based on the set batch processing model includes:
[0046] Converting the query request for the shared data into an XSL description file, and converting the XSL description file into a class file;
[0047] Based on the set batch processing model, the class file is called to verify the validity and standardization of the query request for the shared data.
[0048] In this embodiment, the XSL description file includes a preamble and a root element. The preamble includes a declaration and a file type definition, and the root element includes the share identifier in the query request, included in the request line and the data address pointed to by the request, etc., thereby ensuring that the class file can be input into the set batch model through the XSL data island method, so that it can be called by the batch model, thereby quickly completing the validity and standardization verification of the query request for the shared data.
[0049] Furthermore, converting the XSL description file into a class file may specifically include: converting the XSL description file into a source tree, traversing the source tree to form a result tree, and using the result tree as the class file.
[0050] Furthermore, in this embodiment, the data island can be implemented as a single-value object or a table object. In the single-value object, the data island is formed by setting a prefix tag and attribute identifier. In the table object, the data island is formed by using a data source object, thereby effectively processing query requests in a table format.
[0051] S103, parsing the query request for the shared data according to the query link model, and generating a query link that satisfies the query request for the shared data;
[0052] S104: Determine an access interface that matches the query link, and map the query request for the shared data to the access interface.
[0053] In this embodiment, in step S104, the query request for the shared data is parsed according to the query link model to generate a query link that satisfies the query request for the shared data, including: matching the source address, destination address and request data in the query request for the shared data according to the query link model to generate a query link that satisfies the query request for the shared data.
[0054] Specifically, the query link model is a neural network model that is pre-trained with a large amount of sample data, and is mainly used to achieve matching between query requests and query links.
[0055] In the above Figure 1 Based on the embodiment, the query method for shared data in a heterogeneous network further includes: storing the query link and the access interface in a connection pool as new samples for training the query link model, thereby increasing the accuracy of the query link model.
[0056] Figure 2 Schematic diagram of the structure of the query device for shared data in a heterogeneous network in the second embodiment of the present application; Figure 2 As shown, it is characterized by comprising:
[0057] A request obtaining unit 201 is used to obtain a query request for shared data;
[0058] A request verification unit 202, configured to verify the well-formedness of the query request for the shared data;
[0059] A query link generating unit 203 is configured to parse the query request for the shared data according to a query link model and generate a query link that satisfies the query request for the shared data if the query request for the shared data passes the well-formedness verification;
[0060] The mapping unit 204 is configured to determine an access interface that matches the query link and map the query request for the shared data to the access interface.
[0061] Optionally, in this embodiment, the request verification unit is specifically configured to verify the validity and standardization of the query request for the shared data.
[0062] Optionally, in this embodiment, the request verification unit is specifically configured to verify the validity and standardization of the query request for the shared data based on a set batch processing model.
[0063] Optionally, in this embodiment, the request verification unit is specifically used to: convert the query request for the shared data into an XSL description file, and convert the XSL description file into a class file; and based on the set batch processing model, call the class file to verify the validity and standardization of the query request for the shared data.
[0064] Optionally, in this embodiment, the query device for shared data in a heterogeneous network further includes a storage enabling unit, configured to store the query link and the access interface in a connection pool.
[0065] Optionally, in this embodiment, the request parsing unit is configured to match the source address, destination address and request data in the query request for shared data according to a query link model, and generate a query link that satisfies the query request for shared data.
[0066] Furthermore, the query request may include an identification of the request initiator, which may be the address of the request initiator, or a unique feature SN assigned to the request initiator. In addition, the query request may also include a request type identification.
[0067] Specifically, the query request may structurally include a request line, a request header, and a request body. The identity identifier of the request initiator is included in the request line, the type identifier of the request is included in the request header, and the data address pointed to by the request is included in the request data, thereby facilitating subsequent parsing, clustering, and response to the request.
[0068] In this embodiment, a unified API interface is used to obtain query requests for shared data initiated by heterogeneous networks. Specifically, the API interface can be periodically accessed according to a set polling rule to obtain query requests for shared data initiated by heterogeneous networks, thereby achieving real-time access.
[0069] Specifically, in this embodiment, the validity and standardization verification includes the following verification contents:
[0070] Verify whether each component element in the query request includes start and end tags and whether they match each other; whether the nesting relationship between each component element is correct, such as whether the child element is nested in the parent element, whether the attribute description field of each component element is valid and correctly expressed, and whether there is any duplication of attributes between each element, so as to effectively and comprehensively verify the validity and normativeness of the query request and ensure the correctness of the query request.
[0071] In this embodiment, the query link generating unit is specifically configured to match the source address, destination address and request data in the query request for shared data according to the query link model, and generate a query link that satisfies the query request for shared data.
[0072] Specifically, the query link model is a neural network model that is pre-trained with a large amount of sample data, and is mainly used to achieve matching between query requests and query links.
[0073] Figure 3 Schematic diagram of the structure of the electronic device in the third embodiment of the present application; Figure 3 As shown, it includes: a memory 301 and a processor 302, the memory stores a computer executable program, and the processor is used to execute the computer executable program to implement the method described in any embodiment of the present application.
[0074] Figure 4 Schematic diagram of the hardware structure of the electronic device in the fourth embodiment of the present application; Figure 4 As shown, the hardware structure of the electronic device may include: a processor 401, a communication interface 402, a computer-readable medium 403 and a communication bus 404;
[0075] The processor 401, the communication interface 402, and the computer-readable medium 403 communicate with each other via a communication bus 404;
[0076] Optionally, the communication interface 402 may be an interface of a communication module, such as an interface of a GSM module;
[0077] The processor 401 may be specifically configured to run an executable program stored in the memory, thereby executing all or part of the processing steps of any of the above method embodiments.
[0078] The processor 401 can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component. It can implement or execute the various methods, steps, and logic block diagrams disclosed in the embodiments of this application. The general-purpose processor can be a microprocessor or any conventional processor.
[0079] The electronic devices of the embodiments of the present application exist in various forms, including but not limited to:
[0080] (1) Mobile communication devices: These devices are characterized by their mobile communication capabilities and are primarily designed to provide voice and data communications. These terminals include smartphones (e.g., iPhones), multimedia phones, feature phones, and low-end phones.
[0081] (2) Ultra-mobile personal computer devices: These devices fall under the category of personal computers, have computing and processing capabilities, and generally also have mobile Internet access. These terminals include PDAs, MIDs, and UMPCs, such as the iPad.
[0082] (3) Portable entertainment devices: These devices can display and play multimedia content. These devices include audio and video players (such as iPods), handheld game consoles, e-books, smart toys, and portable car navigation devices.
[0083] (4) Server: A device that provides computing services. The server consists of a processor 410, a hard disk, memory, a system bus, etc. The server is similar to a general computer architecture, but because it needs to provide highly reliable services, it has higher requirements in terms of processing power, stability, reliability, security, scalability, and manageability.
[0084] (5) Other electronic devices with data interaction functions.
[0085] Figure 5 Schematic diagram of the structure of the computer storage medium in the seventh embodiment of the present application; Figure 5 As shown, the computer storage medium stores a computer executable program, and the computer executable program implements the method described in any embodiment of the present application when it is run.
[0086] An embodiment of the present application further provides a data system, which includes the electronic device described in any embodiment of the present application.
[0087] It should be noted that the various embodiments in this specification are described in a progressive manner, and the same or similar parts between the various embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the device and system embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiments. The device and system embodiments described above are merely schematic, wherein the modules described as separate components may or may not be physically separated, and the components indicated as modules may or may not be physical modules, that is, they may be located in one place, or they may be distributed on multiple network modules. Some or all of the modules can be selected according to actual needs to achieve the purpose of the scheme of this embodiment. A person of ordinary skill in the art can understand and implement it without paying any creative work.
[0088] The above is only a specific implementation of the present application, but the scope of protection of the present application is not limited thereto. Any changes or replacements that can be easily thought of by any technician familiar with this technical field within the technical scope disclosed in this application should be covered by the scope of protection of the present application.
Claims
1. A method for querying shared data in a heterogeneous network, characterized in that: include: Query requests to obtain shared data; Performing well-formedness verification on the query request for the shared data; The performing well-formedness verification on the query request for the shared data includes: verifying the validity and standardization of the query request for the shared data; The verifying the validity and standardization of the query request for the shared data includes: verifying the validity and standardization of the query request for the shared data based on a set batch processing model; The batch processing model based on the settings verifies the validity and standardization of the query request for the shared data, including: Converting the query request for the shared data into an XSL description file, and converting the XSL description file into a class file; Based on the set batch processing model, the class file is called to verify the validity and standardization of the query request for the shared data; When performing validity and standardization verification, it includes: verifying whether each component element in the query request includes the start and end tags and whether they match each other; whether the nesting relationship between the components is correct, such as whether the child element is nested in the parent element, whether the attribute description fields of each component element are valid and correctly expressed, and whether there is any duplication of attributes between the elements, so as to perform effective and comprehensive validity and standardization verification of the query request to ensure the correctness of the query request; If the query request for the shared data passes the well-formedness verification, parsing the query request for the shared data according to the query link model to generate a query link that satisfies the query request for the shared data; Determining an access interface that matches the query link, and mapping the query request for the shared data to the access interface; The step of parsing the query request for the shared data according to the query link model to generate a query link that satisfies the query request for the shared data includes: matching the source address, destination address, and request data in the query request for the shared data according to the query link model to generate a query link that satisfies the query request for the shared data, wherein the query link model is specifically a neural network model obtained by pre-training with a large amount of sample data; The method for querying shared data in a heterogeneous network further includes: storing the query link and the access interface in a connection pool as new samples for training the query link model.
2. The method for querying shared data in a heterogeneous network according to claim 1, characterized in that: The step of parsing the query request for the shared data according to the query link model and generating a query link that satisfies the query request for the shared data includes: matching the source address, the destination address, and the request data in the query request for the shared data according to the query link model and generating a query link that satisfies the query request for the shared data.
3. A query device for shared data in a heterogeneous network, characterized in that: include: A request acquisition unit, used to obtain query requests for shared data; a request verification unit, configured to verify the well-formedness of the query request for the shared data; The request verification unit is specifically used to verify the validity and standardization of the query request for the shared data; The request verification unit is specifically used to verify the validity and standardization of the query request for the shared data based on a set batch processing model; The request verification unit is specifically used to convert the query request of the shared data into an XSL description file, and convert the XSL description file into a class file; Based on the set batch processing model, the class file is called to verify the validity and standardization of the query request for the shared data; When performing validity and standardization verification, it includes: verifying whether each component element in the query request includes the start and end tags and whether they match each other; whether the nesting relationship between the components is correct, such as whether the child element is nested in the parent element, whether the attribute description fields of each component element are valid and correctly expressed, and whether there is any duplication of attributes between the elements, so as to perform effective and comprehensive validity and standardization verification of the query request to ensure the correctness of the query request; a query link generating unit, configured to parse the query request for the shared data according to a query link model and generate a query link that satisfies the query request for the shared data if the query request for the shared data passes the well-formedness verification; a mapping unit, configured to determine an access interface matching the query link and map the query request for the shared data to the access interface; The step of parsing the query request for the shared data according to the query link model to generate a query link that satisfies the query request for the shared data includes: matching the source address, destination address, and request data in the query request for the shared data according to the query link model to generate a query link that satisfies the query request for the shared data, wherein the query link model is specifically a neural network model obtained by pre-training with a large amount of sample data; The method for querying shared data in a heterogeneous network further includes: storing the query link and the access interface in a connection pool as new samples for training the query link model.
4. The device for querying shared data in a heterogeneous network according to claim 3, characterized in that: The request parsing unit is used to match the source address, destination address and request data in the query request for shared data according to the query link model, and generate a query link that meets the query request for shared data.
5. An electronic device, characterized in that: include: A memory and a processor, wherein the memory stores a computer executable program, and the processor is configured to execute the computer executable program to implement the method according to any one of claims 1 to 2.
6. A computer storage medium, characterized in that The computer storage medium stores a computer executable program, and the computer executable program implements the method according to any one of claims 1 to 2 when executed.
Citation Information
Patent Citations
Method for realizing optimization of data source extensive makeup language (XML) query system based on sub-queries
CN101984439A
Data query method and device, computer equipment and storage medium
CN112650759A