Interface proxy method and device supporting dynamic parameter transmission and medium

Abstract

The invention discloses an interface proxy method and device supporting dynamic parameter transmission and a medium, and relates to the technical field of data services, and the method comprises the steps: carrying out the data tracking of a data flow direction, obtaining a data transmission link, and determining a proxy interface based on the data transmission link; receiving the dynamic call request parameter through the proxy interface, and performing dynamic security processing on the dynamic call request parameter to obtain a signature request; based on the signature request, performing polling paging calling to obtain complete calling data; performing paging state real-time storage on the paging process of paging parameter adjustment to obtain a request recovery backup; and performing incremental mode processing on the paging request result to obtain difference merged data. By means of the method, the technical problems that in an existing API proxy method, the data security is poor, and the paging obtaining efficiency is low are solved.

Description

Technical Field

[0001] The present application relates to the field of data service technology, and in particular to an interface proxy method, device, and medium supporting dynamic parameter transmission. Background Art

[0002] With the rapid development of internet technologies, the scale and complexity of data services have increased significantly. Enterprises, developers, and third-party applications typically access back-end data services through application programming interfaces (APIs) to obtain or process data. In existing technologies, API proxies are typically implemented using API gateways or reverse proxy tools, combining policy configuration with plug-in extensibility to form lightweight, highly scalable data service middleware.

[0003] In existing data service API proxy scenarios, there are problems with parameter passing and data transmission. On the one hand, traditional API proxy systems have a relatively fixed parameter passing method. In complex business processes, different parameter combinations need to be passed to the original interface based on real-time business needs, which cannot well support this requirement. On the other hand, when the original interface requires a signature, the existing proxy system lacks an effective parameter signature encryption mechanism, which makes the parameters at risk of malicious tampering during the data transmission process and cannot guarantee data security. In terms of data acquisition, traditional systems cannot efficiently perform paging acquisition when processing large amounts of data, and it is difficult to automatically distinguish between acquired and unacquired data, resulting in low data acquisition efficiency and serious waste of resources. Summary of the Invention

[0004] The embodiments of the present application provide an interface proxy method, device, and medium that support dynamic parameter transmission, which solve the technical problems of poor data security and low paging acquisition efficiency in existing API proxy methods.

[0005] In the first aspect, an embodiment of the present application provides an interface proxy method that supports dynamic parameter passing, characterized in that the method includes: tracking the data flow to obtain a data transmission link, and determining the proxy interface based on the data transmission link; accepting dynamic call request parameters through the proxy interface, and dynamically and securely processing the dynamic call request parameters to obtain a signature request; based on the signature request, obtaining complete call data through polling paging calls; storing the paging status of the paging process with adjusted paging parameters in real time to obtain a request recovery backup; and performing incremental mode processing on the paging request results to obtain differential merged data.

[0006] In one implementation of the present application, dynamic security processing is performed on the dynamic call request parameters to obtain a signature request, specifically including: risk interception of the dynamic call request parameters to obtain risk filtering parameters; determining the dynamic key through key configuration management based on the risk filtering parameters; sorting and splicing the risk filtering parameters and the dynamic key to obtain an encrypted signature; and dynamically attaching the encrypted signature to the call request to obtain a signature request.

[0007] In one implementation of the present application, based on a signature request, complete call data is obtained through polling paging calls, specifically including: based on the signature request, determining the paging parameters through paging parameter initialization; sending a data request to the original interface according to the paging parameters to obtain response data; uniquely identifying and caching the response data to determine the polling identifier; in the case of unobtained data, updating the paging parameters, and performing data polling based on the paging parameters after the parameter update; in the case that the response data is empty, terminating the polling and outputting all the data to obtain complete call data.

[0008] In one implementation of the present application, the response data is uniquely identified and cached to determine the polling identifier, specifically including: extracting the unique identifier of the response data to obtain the unique identifier of the response data; wherein the unique identifier of the response data includes: data ID, timestamp, and identification field; storing the unique identifier of the response data in a preset Redis collection, and based on the Redis collection, filtering by existing paging data to determine the polling identifier.

[0009] In one implementation of the present application, when there is no data obtained, the paging parameters are updated, specifically including: when there is no data obtained, determining the paging type of the paging parameters; when the paging type is page number paging, updating the paging parameter value; when the paging type is cursor paging, extracting the next_cursor value from the response data as the parameter update value of the paging parameter.

[0010] In one implementation of the present application, the paging status of the paging process with adjusted paging parameters is stored in real time to obtain a request recovery backup, specifically including: extracting the paging status of the paging process to obtain paging status data; wherein the paging status data includes: page number, last data ID, checksum; obtaining a unique request ID, and caching the paging status data and the unique request ID to obtain a request recovery backup.

[0011] In one implementation of the present application, the paging request result is processed in incremental mode to obtain differential merged data, specifically including: when the paging request result is in incremental mode, reading the polling identifier and appending the polling identifier to the dynamic call request parameter to determine the incremental request parameter; based on the incremental request parameter, obtaining differential data by deduplication of data; merging the differential data into the polling identifier to obtain differential merged data.

[0012] In one implementation of the present application, after performing incremental mode processing on the paging request results to obtain differential merged data, the method further includes: dynamically selecting data on the differential merged data to determine an update data acquisition decision; when the update data acquisition decision is to obtain updated data, obtaining first request data through an update data request; when the update data acquisition decision is to obtain all data, obtaining second request data through data polling paging.

[0013] In the second aspect, an embodiment of the present application also provides an interface proxy device that supports dynamic parameter passing, characterized in that the device includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can: track the data flow to obtain a data transmission link, and determine the proxy interface based on the data transmission link; accept dynamic call request parameters through the proxy interface, and dynamically and securely process the dynamic call request parameters to obtain a signature request; based on the signature request, obtain complete call data through polling paging calls; store the paging status of the paging process with adjusted paging parameters in real time to obtain a request recovery backup; and perform incremental mode processing on the paging request results to obtain differential merged data.

[0014] In the third aspect, an embodiment of the present application also provides a non-volatile computer storage medium of an interface agent that supports dynamic parameter transmission, which stores computer executable instructions, and is characterized in that the computer executable instructions are set to: track the data flow to obtain a data transmission link, and determine the proxy interface based on the data transmission link; accept dynamic call request parameters through the proxy interface, and dynamically and securely process the dynamic call request parameters to obtain a signature request; based on the signature request, obtain complete call data through polling paging calls; store the paging status of the paging process with adjusted paging parameters in real time to obtain a request recovery backup; perform incremental mode processing on the paging request results to obtain differential merged data.

[0015] The embodiments of the present application provide an interface proxy method, device, and medium that support dynamic parameter transmission. By combining dynamic parameter transmission, signature encryption, and dynamic analysis of polling paging, the technical problems of poor data security and low paging acquisition efficiency in existing API proxy methods are solved, dynamic demand configuration of business interfaces is realized, and parameter security of data transmission and data acquisition efficiency are improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings: Figure 1 A flow chart of an interface proxy method supporting dynamic parameter transmission provided in an embodiment of the present application; Figure 2 A schematic diagram of the internal structure of an interface proxy device that supports dynamic parameter transmission provided in an embodiment of the present application. DETAILED DESCRIPTION

[0017] To make the purpose, technical solutions, and advantages of this application more clear, the technical solutions of this application will be clearly and completely described below in conjunction with the specific embodiments of this application and the corresponding drawings. Obviously, the embodiments described are only part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0018] The embodiments of the present application provide an interface proxy method, device, and medium that support dynamic parameter transmission. By combining dynamic parameter transmission, signature encryption, and dynamic analysis of polling paging, the technical problems of poor data security and low paging acquisition efficiency in existing API proxy methods are solved, dynamic demand configuration of business interfaces is realized, and parameter security of data transmission and data acquisition efficiency are improved.

[0019] The technical solutions proposed in the embodiments of the present application are described in detail below with reference to the accompanying drawings.

[0020] Figure 1 This is a flow chart of an interface proxy method that supports dynamic parameter transmission provided by an embodiment of the present application. Figure 1 As shown, an interface proxy method supporting dynamic parameter transmission provided by an embodiment of the present application specifically includes the following steps: Step 101: Track the data flow to obtain a data transmission link, and determine a proxy interface based on the data transmission link.

[0021] For example, data flow trackers are deployed at various data operation nodes in the data platform, including the data integration module, data governance module, and resource mobilization module. As data is transferred and processed between these modules, the trackers capture the data's transmission path in real time, recording in detail the data's origin, intermediate processing steps, and final destination storage or business module.

[0022] Trackers are deployed in the data integration, governance, and resource utilization modules to capture data transfer paths in real time. The data transfer path follows the sequence of data source, processing steps, and target storage. During data integration, the tracker records the entire process of data extracted from database A, processed through ETL (Extract, Transform, Load), and then flowing into data warehouse B.

[0023] Step 102: Accept the dynamic call request parameters through the proxy interface and perform dynamic security processing on the dynamic call request parameters to obtain a signature request.

[0024] For example, when external calls are made to published data services, the system supports dynamic parameter transfer required by the original interface. Because existing encryption methods for parameters are relatively simple, this application utilizes dynamic security processing that combines keys and risk filtering parameters. This not only satisfies the signature requirements of the original interface, but also enables dynamic parameter transfer, improving parameter security.

[0025] Specifically, dynamic security processing is performed on the dynamic call request parameters to obtain a signature request, including: risk interception of the dynamic call request parameters to obtain risk filtering parameters; determining the dynamic key through key configuration management based on the risk filtering parameters; sorting and concatenating the risk filtering parameters and the dynamic key to obtain an encrypted signature; and appending the encrypted signature to the dynamic call request to obtain a signature request.

[0026] In one embodiment, the request parameters are intercepted and encrypted, generating a signed security request consisting of the original risk-filtering parameters and the dynamically generated signature parameters. The system parses and processes the incoming parameters, using a specific encryption algorithm to encrypt and sign them based on the signature requirements of the original interface. During the encryption process, a unique signature is generated using a combination of a pre-set key and specific parameters, and sent along with the parameters to the original interface.

[0027] Step 103: Based on the signature request, complete call data is obtained through polling and paging calls.

[0028] Exemplarily, this application obtains complete call data through polling and paging calls based on signature requests, thereby achieving complete data acquisition in polling calls of large amounts of data and avoiding repeated acquisition of data.

[0029] Specifically, based on the signature request, complete call data is obtained through polling paging calls, including: based on the signature request, determining the paging parameters through paging parameter initialization; sending a data request to the original interface according to the paging parameters to obtain response data; uniquely identifying and caching the response data to determine the polling identifier; in the case of unobtained data, updating the paging parameters, and performing data polling based on the updated paging parameters; in the case of empty response data, terminating polling and outputting all data to obtain complete call data.

[0030] In one embodiment, to facilitate access to large amounts of data, the system supports polling and paging to call the original interface. Paging parameters, such as the amount of data per page and the page number, are set in the system. First, a request is sent to the original interface based on the initially set page number and amount of data per page to retrieve the first page of data. A loop then determines whether any unretrieved data remains. If so, the page number is updated and requests are sent to the next page of data until all data is retrieved. During the polling process, the system records the data already retrieved to avoid duplicate retrieval.

[0031] Furthermore, the response data is uniquely identified and cached to determine the polling identifier, specifically including: extracting the unique identifier of the response data to obtain the unique identifier of the response data; wherein the unique identifier of the response data includes: data ID, timestamp, and identification field; storing the unique identifier of the response data in a preset Redis collection, and based on the Redis collection, filtering by existing paging data to determine the polling identifier.

[0032] Similarly, when there is unobtained data, the paging parameters are updated, specifically including: when there is unobtained data, determining the paging type of the paging parameters; when the paging type is page number paging, updating the paging parameter value; when the paging type is cursor paging, extracting the next_cursor value from the response data as the parameter update value of the paging parameter.

[0033] Step 104: The paging state of the paging process with adjusted paging parameters is stored in real time to obtain a requested recovery backup.

[0034] Specifically, the paging status of the paging process with adjusted paging parameters is stored in real time to obtain a request recovery backup, including: extracting the paging status of the paging process to obtain paging status data; wherein the paging status data includes: page number, last data ID, checksum; obtaining a unique request ID, and caching the paging status data and the unique request ID to obtain a request recovery backup.

[0035] Step 105: Perform incremental mode processing on the paging request results to obtain differential merged data.

[0036] For example, the polling paging method of calling the original interface can efficiently obtain a large amount of data, avoiding performance problems caused by obtaining a large amount of data at one time. The differential merging data can dynamically adapt to the paging request in the incremental mode, thereby improving the efficiency of data paging.

[0037] Specifically, the paging request result is processed in incremental mode to obtain differential merged data, which specifically includes: when the paging request result is in incremental mode, reading the polling identifier, and appending the polling identifier to the dynamic call request parameter to determine the incremental request parameter; based on the incremental request parameter, obtaining differential data by deduplication of data; merging the differential data into the polling identifier to obtain differential merged data.

[0038] Furthermore, after performing incremental mode processing on the paging request results to obtain differential merged data, the method also includes: dynamically selecting data on the differential merged data to determine an update data acquisition decision; when the update data acquisition decision is to obtain updated data, obtaining the first request data through an update data request; when the update data acquisition decision is to obtain all data, obtaining the second request data through data polling paging.

[0039] For example, when calling the original interface, the system can automatically distinguish between acquired data and data that has not been updated. By recording the identifier of each data acquisition (data's unique ID, timestamp, etc.) in a database or cache, the system can compare the newly acquired data with the recorded data during subsequent calls to determine which data is updated. The system also provides a dynamic selection function, allowing users to choose whether to only retrieve updated data based on their actual needs. If the user chooses to retrieve updated data, the system will only request the updated data from the original interface; if the user chooses to retrieve all data, the system will retrieve all data using a polling and paging method.

[0040] The above is an embodiment of the method proposed in this application. Based on the same inventive concept, this application embodiment also provides an interface proxy device that supports dynamic parameter transmission, and its structure is as follows: Figure 2 shown.

[0041] Figure 2 This is a schematic diagram of the internal structure of an interface proxy device that supports dynamic parameter transmission provided by an embodiment of the present application. Figure 2 As shown, the equipment includes: at least one processor 201; and, a memory 202 communicatively coupled to the at least one processor; The memory 202 stores instructions that can be executed by at least one processor, and the instructions are executed by the at least one processor 201 to enable the at least one processor 201 to: The data flow is tracked to obtain the data transmission link, and the proxy interface is determined based on the data transmission link; through the proxy interface, dynamic call request parameters are accepted and dynamically and securely processed to obtain a signature request; based on the signature request, complete call data is obtained through polling paging calls; the paging status of the paging process adjusted by the paging parameters is stored in real time to obtain a request recovery backup; the paging request results are processed in incremental mode to obtain differential merged data.

[0042] Some embodiments of the present application provide corresponding Figure 1 A non-volatile computer storage medium supporting dynamic parameter transmission interface agent stores computer executable instructions, wherein the computer executable instructions are set to: The data flow is tracked to obtain the data transmission link, and the proxy interface is determined based on the data transmission link; through the proxy interface, dynamic call request parameters are accepted and dynamically and securely processed to obtain a signature request; based on the signature request, complete call data is obtained through polling paging calls; the paging status of the paging process adjusted by the paging parameters is stored in real time to obtain a request recovery backup; the paging request results are processed in incremental mode to obtain differential merged data.

[0043] The various embodiments in this application are described in a progressive manner. Similar portions between the various embodiments can be referenced to each other. Each embodiment focuses on the differences from the other embodiments. In particular, the IoT device and media embodiments are generally similar to the method embodiments, so their description is relatively simple. For relevant portions, refer to the description of the method embodiments.

[0044] The system and medium provided in the embodiments of the present application correspond one-to-one to the method. Therefore, the system and medium also have similar beneficial technical effects to their corresponding methods. Since the beneficial technical effects of the method have been described in detail above, the beneficial technical effects of the system and medium will not be repeated here.

[0045] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware. Furthermore, the present application may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0046] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0047] These computer program instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes.

[0048] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing the instructions executed on the computer or other programmable device for implementing the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0049] In a typical configuration, a computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory.

[0050] Memory may include non-permanent storage in a computer-readable medium, in the form of random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of a computer-readable medium.

[0051] Computer-readable media includes both permanent and non-permanent, removable and non-removable media that can be implemented using any method or technology to store information. Information can be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include, but are not limited to, phase-change RAM (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include transitory computer-readable media such as modulated data signals and carrier waves.

[0052] It should also be noted that the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, commodity, or apparatus that includes a series of elements includes not only those elements but also other elements not explicitly listed, or includes elements inherent to such process, method, commodity, or apparatus. In the absence of further limitations, an element defined by the phrase "comprises a ..." does not exclude the presence of other identical elements in the process, method, commodity, or apparatus that includes the element.

[0053] The above are merely embodiments of the present application and are not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present application should all be included within the scope of the claims of the present application.

Claims

1. An interface proxy method supporting dynamic parameter transmission, characterized in that: The method comprises: Tracking the data flow to obtain a data transmission link, and determining a proxy interface based on the data transmission link; Accepting dynamic call request parameters through the proxy interface and performing dynamic security processing on the dynamic call request parameters to obtain a signature request; Based on the signature request, complete call data is obtained through polling and paging calls; The paging process of the paging parameter adjustment is performed with a paging state stored in real time to obtain a requested recovery backup; The paging request result is processed in incremental mode to obtain differential merged data.

2. The interface proxy method supporting dynamic parameter transmission according to claim 1, characterized in that: Performing dynamic security processing on the dynamic call request parameters to obtain a signature request, specifically including: Performing risk interception on the dynamic call request parameters to obtain risk filtering parameters; Determining a dynamic key through key configuration management based on the risk filtering parameters; Sorting and concatenating the risk filtering parameter and the dynamic key to obtain an encrypted signature; A dynamic call request is attached to the encrypted signature to obtain the signature request.

3. The interface proxy method supporting dynamic parameter transmission according to claim 1, characterized in that: Based on the signature request, complete call data is obtained through polling and paging calls, including: Based on the signature request, determine the paging parameters through paging parameter initialization; According to the paging parameters, a data request is sent to the original interface to obtain response data; Performing unique identification caching on the response data to determine a polling identifier; In the case that there is data that has not been obtained, the paging parameters are updated, and data polling is performed based on the paging parameters after the parameters are updated; When the response data is empty, the polling is terminated and all data are output to obtain complete call data.

4. The interface proxy method supporting dynamic parameter transmission according to claim 3, characterized in that: The response data is uniquely identified and cached to determine a polling identifier, specifically including: Extracting a unique identifier from the response data to obtain a unique identifier for the response data; wherein the unique identifier for the response data includes: a data ID, a timestamp, and an identification field; The unique identifier of the response data is stored in a preset Redis set, and based on the Redis set, the polling identifier is determined by filtering the existing paging data.

5. The interface proxy method supporting dynamic parameter transmission according to claim 3, characterized in that: In the case that there is no data obtained, the paging parameters are updated, specifically including: In the case that there is no data obtained, determining the paging type of the paging parameter; When the paging type is page number paging, updating the paging parameter value; In the case where the paging type is cursor paging, the next_cursor value is extracted from the response data as a parameter update value of the paging parameter.

6. The interface proxy method supporting dynamic parameter transmission according to claim 1, characterized in that: The paging process of the paging parameter adjustment is performed with real-time storage of the paging state to obtain a requested recovery backup, specifically including: Extracting paging status from the paging process to obtain paging status data; wherein the paging status data includes: page number, last data ID, and checksum; A unique request ID is obtained, and the paging state data and the unique request ID are cached to obtain a request recovery backup.

7. The interface proxy method supporting dynamic parameter transmission according to claim 1, characterized in that: The paging request results are processed in incremental mode to obtain differential merged data, specifically including: In the case where the paging request result is in incremental mode, reading the polling identifier and appending the polling identifier to the dynamic call request parameter to determine the incremental request parameter; Based on the incremental request parameters, differential data is obtained by deduplicating the data; The difference data is merged into the polling identifier to obtain difference merged data.

8. The interface proxy method supporting dynamic parameter transmission according to claim 1, characterized in that: After performing incremental mode processing on the paging request result to obtain differential merged data, the method further includes: Performing dynamic data selection on the differential merged data to determine an updated data acquisition decision; In a case where the update data acquisition decision is to acquire the update data, obtaining first request data through an update data request; When the update data acquisition decision is to acquire all data, the second requested data is obtained through data polling and paging.

9. An interface proxy device supporting dynamic parameter transmission, characterized in that: The device comprises: at least one processor; and, a memory communicatively coupled to the at least one processor; The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to: Tracking the data flow to obtain a data transmission link, and determining a proxy interface based on the data transmission link; Accepting dynamic call request parameters through the proxy interface and performing dynamic security processing on the dynamic call request parameters to obtain a signature request; Based on the signature request, complete call data is obtained through polling and paging calls; The paging process of the paging parameter adjustment is performed with a paging state stored in real time to obtain a requested recovery backup; The paging request result is processed in incremental mode to obtain differential merged data.

10. A non-volatile computer storage medium for an interface agent supporting dynamic parameter transmission, storing computer executable instructions, characterized in that: The computer executable instructions are configured to: Tracking the data flow to obtain a data transmission link, and determining a proxy interface based on the data transmission link; Accepting dynamic call request parameters through the proxy interface and performing dynamic security processing on the dynamic call request parameters to obtain a signature request; Based on the signature request, complete call data is obtained through polling and paging calls; The paging process of the paging parameter adjustment is performed with a paging state stored in real time to obtain a requested recovery backup; The paging request result is processed in incremental mode to obtain differential merged data.

Images