A Real-Time HTTP Request Method Based on Domestically Produced Strong Isolation Device

Abstract

This invention relates to a real-time HTTP request method based on a domestically produced strong isolation device, comprising the following steps: An external client clicks to view an official document; the external server receives the request and inserts the data information into a file intermediate table through the isolation device; a relay service monitors and parses changes in the file intermediate table of the business database, constructs intranet download file request parameters from the request information, and initiates an HTTP request to call the file download interface; the intranet business service receives the request, verifies whether the target user has download permissions, downloads the official document from the file server, and sends it to the relay service; based on the document data, the file intermediate table is updated, and the status data is updated; upon detecting that the status data has been updated to "processed," the data in the database is queried, and field information is read; after obtaining the document data, the external server deletes the temporary data to release space and returns the information to the external client, who can then view the document upon receiving the response from the external server.

Description

Technical Field

[0001] This invention relates to a real-time HTTP request method based on a domestically produced strong isolation device, belonging to the field of network communication technology. Background Technology

[0002] With the rapid development of network technology, traditional intranet-based office work no longer meets the development requirements of enterprises. Against this backdrop, building an internet-based mobile office is a crucial component of enterprise development. By constructing an efficient office ecosystem encompassing people, terminals, business processes, and information, it enables personnel at all levels to conveniently handle office tasks and respond promptly to work assignments, significantly improving work efficiency and reducing office and operational costs. The previous method of port mapping, which mapped a specific port of a public IP address to a designated port on an intranet device to allow external access to the intranet, no longer meets information security requirements. Instead, a domestically developed strong isolation device is used to convert and process database connection information before mapping it to the external network. This device only supports external systems connecting to the database and does not support direct external access to business systems. For small projects with few users and small data volumes, where business data can be stored in the database, a business application system can be deployed on the external network and connected directly to the database via the strong isolation device, allowing access to all the functions of the business system. However, for large enterprises with numerous users and massive amounts of data, business data is stored separately: basic information in databases, official documents in file service systems, indexes in Solr services, etc. Directly accessing the database through strong isolation devices prevents access to all business data, rendering some business functions unusable. To address this, a real-time HTTP request method based on a domestically developed strong isolation device was designed. This method, when using isolation devices in mobile business systems, allows access to not only database business data but also non-database business data via HTTP requests, fulfilling the requirement of accessing all intranet business data from the internet.

[0003] The patent application (patent) CN201910260637.7, entitled "An HTTP Request Method and Apparatus Based on Dual Queues," mentions using two circular queues to store execution data and return data, with operations executed by two separate threads. This eliminates the need for asynchronous calls from the application side, significantly improving the efficiency of receiving requests and returning data. However, it suffers from excessive data caching. Compared to this patent, the advantages of this patent are: 1. It avoids storing all files in the database, thus preventing the requirement of strong isolation for file data access and avoiding database performance issues such as large database space consumption and high IO resource pressure; 2. It enables external network systems to access not only the database but also other services such as internal network file services; 3. It initiates HTTP access to the internal network file service download interface after receiving external network request information via a trigger mechanism, ensuring high real-time performance. Problems with existing technologies: 1. Insufficient real-time performance: Existing technologies may use timed scheduling and polling, which leads to delays in request processing and fails to meet real-time requirements; 2. Data integrity issues: Directly accessing the database through a strong isolation device may not be able to obtain all business data, especially when business data is distributed across different systems (such as databases, file service systems, index services, etc.); 3. Performance pressure: Storing all business data in the database may cause the database to occupy a large amount of space, increase IO resource pressure, and affect database performance; 4. Security issues: Existing technologies may not be able to meet the stringent requirements of information and data security, especially in the context of comprehensively promoting information technology innovation (IT innovation and software innovation). Compared with existing technologies, this patent designs a real-time HTTP request method based on a domestically produced strong isolation device. This method enables external network systems to not only access the database but also obtain non-database business data via HTTP requests, while ensuring information security. It meets the needs of internet access to all business data on the internal network, improves the real-time performance and integrity of data access, reduces the performance pressure on the database, and enhances system security. Summary of the Invention

[0004] To address the problems existing in the prior art, this invention proposes a real-time HTTP request method based on a domestically produced strong isolation device.

[0005] The technical solution of the present invention is as follows:

[0006] On the one hand, this invention provides a real-time HTTP request method based on a domestically produced strong isolation device, comprising the following steps:

[0007] When a target user clicks to view an official document on an external client, the external server receives the request from the external client, generates a primary key UUID, and inserts the document ID, user information data, and unprocessed status data into the intermediate table of the file through an isolation device.

[0008] Through the relay service deployed on the intranet, the Canal component is used to monitor changes in the file intermediate table of the business database, obtain binlog and parse it to get the external client request information, construct the request parameters for downloading files on the intranet from the external client request information, and initiate an HTTP request to call the file download interface of the intranet business service.

[0009] The intranet service receives an HTTP request from the relay service, verifies whether the target user has download permission based on the target user data information, and if the verification is successful, downloads the corresponding document from the file server according to the document ID and sends the document to the relay service; the relay service updates the primary key UUID of the file intermediate table to the corresponding blob field according to the binary file data in the document, and updates the status data to processed.

[0010] The external network server detects that the status data has been updated to "processed", queries the database based on the primary key UUID, and reads the blob field information. After obtaining the document data, the external network server deletes the temporary data in the intermediate table of the document to free up space, and returns the document information to the external network client. The external network client receives the response from the external network server and can view the content information of the document through the external network client.

[0011] As a preferred embodiment, the specific steps of the canal component triggering method are as follows:

[0012] An external network initiates a request to download official documents. The external network server writes the request data into an intermediate table of the database through an isolation device. The database pushes binarylog data to an internal network relay service based on the Canal component. The internal network relay service obtains the binarylog data, parses it, obtains the request parameters from the log information, constructs the parameters for downloading the official documents, and initiates an HTTP request.

[0013] As a preferred option, the deployment architecture includes both the Internet and the intranet, specifically:

[0014] The Internet includes external network clients and external network servers; the intranet includes domestically produced strong isolation devices, intranet relay services, databases, business application services, file services, and intranet clients;

[0015] The external network server, external network client, domestically produced strong isolation device, internal network relay service, and internal network business service all communicate and exchange data through the HTTP protocol and database.

[0016] The external network server includes a status monitoring module, which is used to monitor the status changes of the intermediate table of the file and trigger the data retrieval process when the status changes;

[0017] Preferably, the data retrieval process includes the following steps: the external network server detects that the status of the intermediate table of the file has changed to "processed", the external network server uses a unique identifier to retrieve the corresponding data record from the database, after finding the matching record, extracts the corresponding data, and sends the data back to the client, which receives and processes the data.

[0018] On the other hand, the present invention also provides a real-time HTTP request system based on a domestically produced strong isolation device, comprising the following steps:

[0019] In the service request module, when the target user clicks to view the document on the external client, the external server receives the request from the external client, generates a primary key UUID, and inserts the document ID, user information data, and unprocessed status data into the intermediate file table through the isolation device.

[0020] The intranet business service module uses the Canal component to monitor changes in the file intermediate table of the business database through the relay service deployed on the intranet, obtains and parses the binlog to get the external client request information, constructs the request parameters for downloading files on the intranet from the external client request information, and initiates an HTTP request to call the file download interface of the intranet business service.

[0021] The relay service module receives HTTP requests from the intranet business service, verifies whether the target user has download permissions based on the target user data information, and if the verification is successful, downloads the corresponding document from the file server according to the document ID and sends the document to the relay service; the relay service updates the primary key UUID of the file intermediate table to the corresponding blob field according to the binary file data in the document, and updates the status data to processed.

[0022] In the service response module, the external network server detects that the status data has been updated to "processed," queries the database based on the primary key UUID, and reads the blob field information. After obtaining the document data, the external network server deletes the temporary data in the intermediate table of the document to free up space and returns the document information to the external network client. The external network client receives the response from the external network server and can view the content information of the document through the external network client.

[0023] As a preferred embodiment, the specific steps of the canal component triggering method are as follows:

[0024] An external network initiates a request to download official documents. The external network server writes the request data into an intermediate table of the database through an isolation device. The database pushes binarylog data to an internal network relay service based on the Canal component. The internal network relay service obtains the binarylog data, parses it, obtains the request parameters from the log information, constructs the parameters for downloading the official documents, and initiates an HTTP request.

[0025] As a preferred option, the deployment architecture includes both the Internet and the intranet, specifically:

[0026] The Internet includes external network clients and external network servers; the intranet includes domestically produced strong isolation devices, intranet relay services, databases, business application services, file services, and intranet clients;

[0027] The external network server, external network client, domestically produced strong isolation device, internal network relay service, and internal network business service all communicate and exchange data through the HTTP protocol and database.

[0028] Preferably, the data retrieval process includes the following steps: the external network server detects that the status of the intermediate table of the file has changed to "processed", the external network server uses a unique identifier to retrieve the corresponding data record from the database, after finding the matching record, extracts the corresponding data, and sends the data back to the client, which receives and processes the data.

[0029] In another aspect, the present invention also provides a computer-readable medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements a real-time HTTP request method based on a domestically produced strong isolation device as described in any embodiment of the present invention.

[0030] In another aspect, the present invention also provides a storage device for storing one or more programs, which, when executed by one or more processors, enable the one or more processors to implement a real-time HTTP request method based on a domestically produced strong isolation device as described in any embodiment of the present invention.

[0031] The present invention has the following beneficial effects:

[0032] 1. This invention can avoid storing all files in the database, thus meeting the requirement that file data can only be obtained through a strong isolation device, which would cause database performance problems such as large database space occupation and high IO resource pressure.

[0033] 2. This invention enables external network systems to access not only databases but also other services such as internal network file services.

[0034] 3. This invention receives request information from the external network through a triggering mechanism and then initiates an HTTP access to the file service download interface on the internal network, resulting in high real-time performance. Attached Figure Description

[0035] Figure 1 This is a flowchart of the technical solution of the present invention;

[0036] Figure 2 This is a deployment architecture diagram for the present invention. Detailed Implementation

[0037] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0038] It should be understood that the step numbers used in the text are for ease of description only and are not intended to limit the order in which the steps are performed.

[0039] It should be understood that the terminology used in this specification is for the purpose of describing particular embodiments only and is not intended to limit the invention. As used in this specification and the appended claims, the singular forms “a,” “an,” and “the” are intended to include the plural forms unless the context clearly indicates otherwise.

[0040] The terms “comprising” and “including” indicate the presence of the described feature, whole, step, operation, element and / or component, but do not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or collections thereof.

[0041] The term “and / or” refers to any combination of one or more of the associated listed items, as well as all possible combinations, and includes these combinations.

[0042] Example 1:

[0043] See Figure 1-2 This embodiment provides a real-time HTTP request method based on a domestically developed strong isolation device, including the following steps:

[0044] S10. When the target user clicks to view the document on the external network client, the external network server receives the request from the external network client, generates the primary key UUID, and inserts the document ID, user information data, and unprocessed status data into the intermediate table of the file through the isolation device.

[0045] S20. Through the relay service deployed on the intranet, use the Canal component to monitor changes in the file intermediate table data of the business database, obtain binlog and parse it to get the external client request information, construct the request parameters for downloading files on the intranet from the external client request information, and initiate an HTTP request to call the file download interface of the intranet business service.

[0046] S30. The intranet service receives an HTTP request from the relay service, verifies whether the target user has download permission based on the target user data information, and if the verification is successful, downloads the corresponding document from the file server according to the document ID and sends the document to the relay service; the relay service updates the primary key UUID of the file intermediate table to the corresponding blob field according to the binary file data in the document, and updates the status data to processed.

[0047] S40. The external network server detects that the status data has been updated to "processed", queries the database based on the primary key UUID, and reads the blob field information. After obtaining the document data, the external network server deletes the temporary data in the intermediate table of the document to release space, and returns the document information to the external network client. The external network client receives the response from the external network server and views the content information of the document through the external network client.

[0048] In a preferred embodiment of this example, in steps S10-S40, the external mobile client clicks to view the document; after receiving the client's request, the external server generates a primary key UUID and inserts the document ID, user information data, and unprocessed status data into the file intermediate table through an isolation device; the relay service deployed on the internal network uses the Canal component to monitor changes in the file intermediate table data of the business database, obtains binlog, and parses it to obtain the request information from the external network; the internal network relay service obtains the request information from the external client, including the file intermediate table primary key UUID, document ID, and user information, and constructs these information into request parameters for downloading the file on the internal network, and initiates an HTTP request to call the file download interface of the internal network service; the internal network business service receives... After receiving an HTTP request to the relay service, the system verifies the user's download permissions based on their information. If successful, it downloads the corresponding document from the file server using the document ID and returns it to the relay service. The relay service then takes the binary file data and updates the corresponding blob field based on the primary key UUID of the original intermediate table, changing the status from unprocessed to processed. Once the external network service detects the change from unprocessed to processed, it queries the database using the primary key UUID and retrieves the file's blob field information. After obtaining the document data, the external network server deletes the temporary data in the intermediate file table to free up space and returns the document information to the client. Upon receiving the response from the backend, the external network client opens and views the document's content.

[0049] There are several ways to access the intranet from the Internet. This embodiment uses b.2, triggered by Canal [high real-time performance].

[0050] 1. In the case of no isolation device:

[0051] By simply mapping the internal network's IP address and port to the internet and opening the ports, the external network can access the internal network via HTTP. No service deployment is required on the external network. Official document download addresses can be accessed directly.

[0052] 2. In cases where isolation devices are in place, internet services need to be deployed:

[0053] a) The database itself has HTTP capabilities. For example, Oracle database has a `utl_http.request()` method. When an application service is deployed on the internet, the Java code of the application service calls the Oracle database's `utl_http.request()` method to initiate an HTTP request to other services on the internal network, such as downloading internal documents (the data is not stored in the database). This allows the external network to access other HTTP services on the internal network (excluding the database) through the database's HTTP capabilities.

[0054] b) The database itself does not have HTTP capabilities:

[0055] b.1. Timed polling method [Low real-time performance, with scheduling delay]

[0056] When an external network requests to download an official document, the external network application service writes the requested data to an intermediate table in the database through an isolation device. The internal network deployment relay service uses a scheduling method to poll this intermediate table, periodically reads the data request, constructs the parameters for downloading the official document, and initiates an HTTP request to download the official document from the internal network.

[0057] b.2. Triggered via Canal [High Real-Time Performance]

[0058] When an external network requests to download an official document, the external network application service writes the requested data to an intermediate table in the database through an isolation device. The database then pushes the binary log to an internal network relay service based on the Canal component. After receiving the data, the relay service parses the log, constructs the parameters for downloading the official document from the parsed request parameters, and initiates an HTTP request to download the official document from the internal network.

[0059] Example 2:

[0060] This embodiment provides a real-time HTTP request system based on a domestically developed strong isolation device, including the following steps:

[0061] The service request module is used when the target user clicks to view the document on the external client. The external server receives the request from the external client, generates a primary key UUID, and inserts the document ID, user information data, and unprocessed status data into the intermediate table of the file through the isolation device. This module is used to implement the function of step S10 in the above implementation one, which will not be described in detail here.

[0062] The intranet business service module uses the Canal component to monitor changes in the file intermediate table of the business database through the relay service deployed on the intranet, obtains and parses the binlog to get the external client request information, constructs the request parameters for downloading files on the intranet from the external client request information, and initiates an HTTP request to call the file download interface of the intranet business service; this module is used to implement the function of step S20 in the above implementation one, and the details will not be elaborated further.

[0063] The relay service module receives HTTP requests from the intranet business service, verifies whether the target user has download permissions based on the target user data information, and if the verification is successful, downloads the corresponding document from the file server according to the document ID and sends the document to the relay service. The relay service updates the primary key UUID of the file intermediate table to the corresponding blob field according to the binary file data in the document, and updates the status data to "processed". This module is used to implement the function of step S30 in the above implementation one, and the details will not be elaborated further.

[0064] The service response module is used when the external network server detects that the status data has been updated to "processed". It queries the database based on the primary key UUID and reads the blob field information. After obtaining the document data, the external network server deletes the temporary data in the intermediate table of the document to free up space and returns the document information to the external network client. The external network client receives the response from the external network server and can view the content information of the document through the external network client. This module is used to implement the function of step S40 in the above implementation one, and the details will not be elaborated further.

[0065] Example 3:

[0066] This embodiment provides a computer-readable medium having a computer program stored thereon. When the computer program is executed by a processor, it implements a real-time HTTP request method based on a domestically produced strong isolation device as described in any embodiment of the present invention.

[0067] Example 4:

[0068] This embodiment provides a storage device for storing one or more programs. When the one or more programs are executed by the one or more processors, the one or more processors implement a real-time HTTP request method based on a domestically produced strong isolation device as described in any embodiment of the present invention.

[0069] In this application embodiment, "at least one" refers to one or more, and "more than one" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent the existence of A alone, A and B simultaneously, or B alone. A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" and similar expressions refer to any combination of these items, including any combination of singular or plural items. For example, at least one of a, b, and c can represent: a, b, c, a and b, a and c, b and c, or a and b and c, where a, b, and c can be single or multiple.

[0070] Those skilled in the art will recognize that the units and algorithm steps described in the embodiments disclosed herein can be implemented using electronic hardware, computer software, or a combination of electronic hardware and software. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0071] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0072] In the several embodiments provided in this application, any function, if implemented as a software functional unit and sold or used as an independent product, can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0073] The above description is merely an embodiment of the present invention and does not limit the patent scope of the present invention. Any equivalent structural or procedural transformations made based on the content of the present invention's specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent protection scope of the present invention.

Claims

1. A real-time HTTP request method based on a domestic strong isolation device, characterized in that, The method comprises the following steps: The target user clicks to view the official document on the external network client, the external network server receives the request of the external network client, generates a primary key uuid, and inserts the official document id, user information data, and unprocessed state data into the file intermediate table through the isolation device; The relay service deployed in the internal network uses the canal component to monitor the data changes of the file intermediate table of the business database, obtains the binlog, and parses it to obtain the external network client request information, constructs the request parameters of the internal network download file, and initiates an http request to call the file download interface of the internal network business service; The internal network business service receives the http request of the relay service, verifies whether the target user has the download permission based on the target user data information, and if the verification is successful, downloads the corresponding official document from the file server according to the official document id, and sends the official document to the relay service; the relay service updates the primary key uuid of the file intermediate table to the corresponding blob field according to the binary file data in the official document, and updates the state data to processed; The external network server monitors the update of the state data to processed, queries the database data based on the primary key uuid, and reads the blob field information; the external network server deletes the temporary data of the file intermediate table after obtaining the official document data to release space, and returns the official document information to the external network client; the external network client receives the response of the external network server and views the content information of the official document through the external network client.

2. The real-time HTTP request method based on a domestic strong isolation device according to claim 1, characterized in that, The specific steps of the canal component triggering method are as follows: The external network initiates a download official document request, the external network server writes the request data into the intermediate table of the database through the isolation device, and the database pushes the binarylog data to the internal network relay service based on the canal component; the internal network relay service obtains the binarlog data, parses the binarylog data to obtain the request parameters in the log information, constructs the download official document parameters, and initiates an http request.

3. The real-time HTTP request method based on a domestic strong isolation device according to claim 1, characterized in that, The deployment architecture includes the Internet and the internal network, specifically: The Internet includes an external network client and an external network server; the internal network includes a domestic strong isolation device, an internal network relay service, a database, a business application service, a file service, and an internal network client; The external network server, the external network client, the domestic strong isolation device, the internal network relay service, and the internal network business service communicate and exchange data through the HTTP protocol and the database.

4. The real-time HTTP request method based on the domestic strong isolation device according to claim 1, characterized in that: The external network server comprises a state monitoring module for monitoring the state change of the file intermediate table and triggering the data retrieval process when the state changes; The data retrieval process comprises that the external network server monitors the state change of the file intermediate table to processed, retrieves the corresponding data record from the database using the unique identifier, finds the matching record, extracts the corresponding data, and sends the data back to the client; the client receives and processes the data.

5. A real-time HTTP request system based on a domestic strong isolation device, characterized in that, The method comprises the following steps: The service request module: the target user clicks to view the official document on the external network client, the external network server receives the request of the external network client, generates a primary key uuid, and inserts the official document id, user information data, and unprocessed state data into the file intermediate table through the isolation device; The internal network business service module: through the relay service deployed in the internal network, the canal component is used to monitor the data changes of the file intermediate table of the business database, the binlog is obtained and parsed, the external network client request information is obtained, the request parameters of the internal network download file are constructed, and the http request is initiated to call the file download interface of the internal network business service; The relay service module: the internal network business service receives the http request of the relay service, verifies whether the target user has download permission based on the target user data information, and if the verification is successful, downloads the corresponding official document from the file server according to the official document id, and sends the official document to the relay service; the relay service updates the primary key uuid of the file intermediate table to the corresponding blob field according to the binary file data in the official document, and updates the state data to processed; The service response module: the external network server monitors that the state data is updated to processed, queries the database data based on the primary key uuid, and reads the blob field information; the external network server deletes the temporary data of the file intermediate table after obtaining the official document data to release space, and returns the official document information to the external network client; the external network client receives the response of the external network server, and views the content information of the official document through the external network client.

6. The real-time HTTP request system based on a domestic strong isolation device according to claim 5, characterized in that, The specific steps of the canal component triggering mode are as follows: The external network initiates a request to download the official document, the external network server writes the request data into the intermediate table of the database through the isolation device, and the database pushes the binarylog data to the internal network relay service based on the canal component; the internal network relay service obtains the binarlog data, parses the binarylog data, obtains the request parameters in the log information, constructs the download official document parameters, and initiates an http request.

7. The real-time HTTP request system based on a domestic strong isolation device according to claim 5, characterized in that, The deployment architecture includes the Internet and the internal network, specifically: The Internet includes an external network client and an external network server; the internal network includes a domestic strong isolation device, an internal network relay service, a database, a business application service, a file service, and an internal network client; The external network server, the external network client, the domestic strong isolation device, the internal network relay service, and the internal network business service communicate and exchange data through the HTTP protocol and the database.

8. The real-time HTTP request system based on the domestic strong isolation device according to claim 5, characterized in that: The external network server includes a state monitoring module for monitoring the state change of the file intermediate table and triggering the data retrieval process when the state changes; The data retrieval process includes that the external network server monitors that the state of the file intermediate table changes to processed, the external network server retrieves the corresponding data record from the database using the unique identifier, finds the matching record, extracts the corresponding data, and sends the data back to the client, and the client receives and processes the data.

9. An apparatus comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein, The processor implements the real-time HTTP request method based on the domestic strong isolation device according to any one of claims 1 to 4 when executing the program.

10. A computer-readable storage medium having stored thereon a computer program, characterized in that, The computer program implements the real-time HTTP request method based on the domestic strong isolation device according to any one of claims 1 to 4 when executed by the processor.

Images