Data file hot loading updating system and method
By compressing and MD5 value calculation of the data files of the CDN edge cache server, the problems of untimely update and failed loading are solved, the speed and accuracy of data updates are improved, and the system resource usage is reduced.
Patent Information
- Application Number
- CN202410928103.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-11
- Publication Date
- 2024-11-12
- Estimated Expiration
- 2044-07-11
AI Technical Summary
When the CDN edge cache server updates data, due to too many cache servers and too large data files, the update is not timely and prone to loading failure.
By compressing the target data file and MD5 file, the transmission time and network bandwidth usage are reduced, and the integrity of the data file transmission process is ensured by calculating the MD5 value, reducing system resource usage.
It improves the speed and efficiency of data updates, ensures the accuracy and reliability of data updates, reduces the number of accesses to the central data management server, and reduces the use of system resources.
Smart Images

Figure CN118939619A_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the technical field of data processing, and in particular relates to a data file hot loading and updating system and method. Background Art
[0002] In the related art, many CDN edge cache servers usually need to perform some data update operations in real time. Such data update operations are generally managed through the control plane, such as using interfaces, files, message queues, etc. When the amount of data is large and needs to be pushed and updated to a large number of cache servers in real time, transferring files is a common method. The file update method often encounters problems such as untimely updates and easy loading failures due to too many cache edge servers and too large data files. Summary of the invention
[0003] In view of the above shortcomings of the prior art, the purpose of the invention is to provide a data file hot loading update system and method, which reduces the transmission time and network bandwidth occupation by compressing the target data file and MD5 file, and improves the speed and efficiency of data update. By calculating the MD5 value, it can be ensured that the data file has not been tampered with or damaged during the transmission process, thereby improving the accuracy and reliability of data update. By saving the target data file compressed package locally, the number of visits to the central data management server can be reduced, reducing the occupation of system resources.
[0004] According to a first aspect of the present invention, a data file hot loading and updating system is proposed, comprising: a first data management module of a central data management server, used to compress a generated target data file and a data MD5 file to obtain a target data file compression package and an MD5 file compression package; an edge cache comprises a second data management module and a service module, wherein the second data management module is used to save the MD5 file compression package locally when the MD5 file compression package and the target data file compression package are successfully pulled, and update the original data file based on the target data file, and trigger the service module to load the target data file at the same time, and determine the loading result when the service module loads the target data file, and perform related operations based on the loading result.
[0005] Furthermore, when the MD5 file compression package and the target data file compression package are successfully pulled, the MD5 file compression package is saved locally, including: when the MD5 file compression package is pulled, determining whether the first MD5 value in the MD5 file compression package is consistent with the second MD5 value in the local MD5 file compression package; when the first MD5 value is inconsistent with the second MD5 value, pulling the target data file compression package; when the target data file compression package is successfully pulled, saving the MD5 file compression package locally.
[0006] Further, successfully pulling the target data file compressed package includes: when the target data file is downloaded successfully and / or the pull request return code is normal, successfully pulling the target data file compressed package.
[0007] Furthermore, when the target data file compression package is successfully pulled, the MD5 file compression package is saved locally, including: when the target data file compression package is successfully pulled, the target data file compression package is decompressed; checking whether the third MD5 value of the data file corresponding to the target data file compression package is consistent with the fourth MD5 value of the data file corresponding to the MD5 file compression package; when the third MD5 value is consistent with the fourth MD5 value, the MD5 file compression package is saved locally.
[0008] Further, updating the original data file based on the target data file includes: determining the data file used in real time by the service module; and overwriting the data file used in real time with the target data file.
[0009] Furthermore, related operations are performed based on the loading result, including: generating a failure data file when the loading fails; generating a success data file when the loading succeeds, and updating the memory data stored in the cache module process memory in the edge cache based on the success data file.
[0010] Furthermore, the method further includes: when the service module is restarted, data recording is performed based on the success data file.
[0011] The second aspect of the present invention proposes a data file hot loading and updating method, comprising: compressing the generated target data file and data MD5 file to obtain a target data file compression package and an MD5 file compression package; when the MD5 file compression package and the target data file compression package are successfully pulled, the MD5 file compression package is saved locally, and the original data file is updated based on the target data file; when the target data file is loaded, the loading result is determined, and related operations are performed based on the loading result.
[0012] According to the third aspect of the present invention, an electronic device is proposed, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method described in the second aspect of the present invention.
[0013] According to a fourth aspect of the present invention, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to enable the computer to execute the method described in the second aspect of the present invention.
[0014] The beneficial effects of the present invention are as follows:
[0015] The data file hot loading and updating system and method of the present invention compresses the generated target data file and data MD5 file to obtain the target data file compression package and MD5 file compression package, and saves the MD5 file compression package to the local computer when the MD5 file compression package and the target data file compression package are successfully pulled, and updates the original data file based on the target data file, and triggers the service module to load the target data file at the same time. When the service module loads the target data file, the loading result is determined, and related operations are performed based on the loading result. Thus, by compressing the target data file and the MD5 file, the transmission time and the occupation of network bandwidth are reduced, and the speed and efficiency of data updating are improved. By calculating the MD5 value, it can be ensured that the data file is not tampered with or damaged during the transmission process, thereby improving the accuracy and reliability of data updating. By saving the target data file compression package to the local computer, the number of visits to the central data management server can be reduced, and the occupation of system resources can be reduced. BRIEF DESCRIPTION OF THE DRAWINGS
[0016] The accompanying drawings are only used to illustrate specific embodiments and are not considered to limit the present invention. In the entire drawings, the same reference symbols represent the same components. Obviously, the drawings described below are only some embodiments recorded in the embodiments of the present invention. For those of ordinary skill in the art, other drawings can also be obtained based on these drawings.
[0017] Figure 1 is a schematic diagram of a data file hot loading and updating system according to an embodiment of the present invention;
[0018] Figure 2 is a flow chart of a data file hot loading and updating method according to an embodiment of the present invention;
[0019] Figure 3 It is a structural block diagram of an electronic device according to an embodiment of the present invention. DETAILED DESCRIPTION
[0020] In order to enable those skilled in the art to better understand the technical solutions in the embodiments of the present invention, the technical solutions of the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present invention, rather than all of the embodiments. It should be understood that these descriptions are only exemplary and are not intended to limit the scope of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in the field without making creative work should fall within the scope of protection of the present invention.
[0021] Furthermore, in the following description, descriptions of well-known structures and technologies are omitted to avoid unnecessarily obscuring the concepts disclosed in the present invention.
[0022] In the description of the present invention, it should be noted that, unless otherwise clearly specified and limited, the orientation or position relationship indicated by the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inside", "outside", etc. is based on the orientation or position relationship shown in the drawings, which is only for the convenience of describing the present invention and simplifying the description, and does not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation of the present invention. In addition, the terms "first", "second", and "third" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance. The terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be a connection between the two elements. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.
[0023] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Instead, they are merely examples of methods and systems consistent with some aspects of the present invention as detailed in the appended claims.
[0024] Currently, CDN acceleration mainly relies on server clusters deployed at edge nodes around the world. Through load balancing, content publishing, content management, and content storage functions, the CDN server cluster shares the pressure of the source site server cluster, allowing users to obtain cached access resources nearby, avoiding network congestion and speeding up access.
[0025] These numerous CDN edge cache servers usually need to perform some data update operations in real time. Such data update operations are generally managed through the control plane, such as using interfaces, files, message queues, etc. When the amount of data is large and needs to be pushed and updated to a large number of cache servers in real time, transferring files is a common method. The file update method often encounters problems such as untimely updates and easy loading failures due to too many cache edge servers and too large data files.
[0026] To this end, the present invention proposes a data file hot loading and updating system, method and related equipment. Specifically, the data file hot loading and updating system, method and related equipment of an embodiment of the present invention are described below with reference to the accompanying drawings.
[0027] Figure 1 It is a schematic diagram of a data file hot loading and updating system according to an embodiment of the present invention. It should be noted that the data file hot loading and updating system according to the embodiment of the present invention can be applied to the data file hot loading and updating method according to the embodiment of the present invention.
[0028] like Figure 1 As shown, the data file hot loading and updating system includes:
[0029] The first data management module 111 of the central data management server 110 is used to compress the generated target data file and data MD5 file to obtain a target data file compression package and an MD5 file compression package;
[0030] The edge cache 210 includes a second data management module 211 and a service module 212. The second data management module 211 is used to save the MD5 file compression package locally when the MD5 file compression package and the target data file compression package are successfully pulled, and update the original data file based on the target data file, and at the same time trigger the service module 212 to load the target data file. When the service module 212 loads the target data file, it determines the loading result and performs related operations based on the loading result.
[0031] According to the data file hot loading and updating system of the embodiment of the present invention, the generated target data file and data MD5 file are compressed to obtain the target data file compression package and MD5 file compression package. By successfully pulling the MD5 file compression package and the target data file compression package, the MD5 file compression package is saved locally, and the original data file is updated based on the target data file, and the service module is triggered to load the target data file at the same time. When the service module loads the target data file, the loading result is determined, and related operations are performed based on the loading result. Thus, by compressing the target data file and the MD5 file, the transmission time and the occupation of network bandwidth are reduced, and the speed and efficiency of data update are improved. By calculating the MD5 value, it can be ensured that the data file is not tampered with or damaged during the transmission process, thereby improving the accuracy and reliability of data update. By saving the target data file compression package locally, the number of visits to the central data management server can be reduced, and the occupation of system resources can be reduced.
[0032] In one embodiment of the present invention, when the MD5 file compression package and the target data file compression package are successfully pulled, the implementation method of saving the MD5 file compression package locally is as follows: when the MD5 file compression package is pulled, determine whether the first MD5 value in the MD5 file compression package is consistent with the second MD5 value in the local MD5 file compression package; when the first MD5 value is inconsistent with the second MD5 value, pull the target data file compression package; when the target data file compression package is successfully pulled, save the MD5 file compression package locally.
[0033] Among them, the first MD5 value in the MD5 file compression package can be understood to refer to a file downloaded from the central data management server 110, and the content stored in it is the MD5 value corresponding to the compression package. This MD5 value is calculated by the MD5 algorithm and is unique.
[0034] Among them, the second MD5 value in the local MD5 file compression package can be understood as that each time it is downloaded from the central data management server 110, a copy will be saved locally as the last MD5 value to determine whether the compression package has changed. If it has changed, it means that a new compression package has been generated and the latest compression package needs to be downloaded.
[0035] Among them, when the target data file is downloaded successfully and / or the pull request return code is normal, it can be determined that the target data file compression package is pulled successfully.
[0036] Among them, if the target data file compression package is successfully pulled, the target data file compression package is decompressed; check whether the third MD5 value of the data file corresponding to the target data file compression package is consistent with the fourth MD5 value of the data file corresponding to the MD5 file compression package; if the third MD5 value is consistent with the fourth MD5 value, save the MD5 file compression package locally.
[0037] In the embodiment of the present invention, the implementation method of updating the original data file based on the target data file is: determining the data file used in real time by the service module 212; and overwriting the data file used in real time with the target data file.
[0038] In the embodiment of the present invention, when the service module 212 loads the target data file, relevant operations can be performed based on the loading result. In the case of a loading failure, a failed data file is generated; in the case of a loading success, a successful data file is generated, and the memory data stored in the cache module process memory in the edge cache 210 is updated based on the successful data file.
[0039] In the embodiment of the present invention, when the service module 212 is restarted, data recording is performed based on the success data file.
[0040] That is, when the service module 212 is restarted, data can be recorded based on the successful data file to avoid loading failure caused by errors in the original data file and abnormal startup of the service module 212.
[0041] In one embodiment of the present invention, the second data management module 211 on the edge cache 210 saves files in three states, namely, original data files, in-use data files and failed data files. The original data files are files that need to be updated each time, the in-use data files are files generated after a successful update, and the failed data files are files generated after a failed update; for example, the original update file: example.data, the in-use data file: example.data.inuse, and the failed data file: example.data.fail.
[0042] In a specific embodiment of the present invention, 1) the first data management module in the central data management server generates the latest data file (i.e., the target data file) and the data MD5 file, and compresses the latest data file and the data MD5 file to generate a data file compression package (i.e., the target data file compression package) and a compression package MD5 file (i.e., the MD5 file compression package),
[0043] For example, the embodiments are:
[0044] The latest data file: example.data, which contains business data;
[0045] Data MD5 file: example.data.md5, the content is the MD5 value of the example.data file;
[0046] The latest data file generates a compressed data file package: example.data.tar.gz, with the contents of example.data and example.data.md5;
[0047] The compressed package MD5 file generated by the data MD5 file is: example.data.tar.gz.md5, and the content is the MD5 value of example.data.tar.gz;
[0048] 2) The second data management module of the edge cache periodically goes to the central data management server to fetch the compressed MD5 file example.data.tar.gz.md5;
[0049] 3) After pulling, determine whether the V1 value in the compressed package MD5 file is consistent with the V2 value in the local MD5 file compressed package. If they are consistent, repeat 2). If they are different, pull the data file compressed package;
[0050] 4) If the data file compression package fails to be pulled, repeat 2). If the data file compression package is successfully pulled, the data file compression package is decompressed to check whether the V3 value of the file corresponding to the decompressed data file compression package is consistent with the V4 value of the compression package MD5 file;
[0051] For example, after the data file compression package is decompressed, it becomes the latest data file: example.data, which contains business data. The MD5 value of the example.data file is calculated by the MD5 algorithm, that is, V3. After the compressed package MD5 file is decompressed, it becomes the data MD5 file: example.data.md5, which contains the MD5 value of the example.data file, that is, V4. Calculate whether the V3 value is consistent with the V4 value.
[0052] If the V3 value and V4 value are inconsistent, repeat 2). If they are consistent, save the compressed MD5 file locally and overwrite the data file used in real time by the service module with the latest data file.
[0053] 5) Trigger the service module to load the latest data file. When the service module loads the latest data file, it verifies the format and data correctness. If the loading fails, it generates a failed data file example.data.fail, and keeps the module memory data unchanged. If the loading is successful, it generates the latest inuse data file example.data.inuse, and updates the memory data stored in the cache module process memory in the edge cache, thereby realizing data hot loading;
[0054] When loading fails, the failed data file example.data.fail can be analyzed, and after repair, the latest data file example.data can be regenerated and the service module can be triggered to load.
[0055] Based on the above description, the data file hot loading and updating system of the embodiment of the present invention ensures the correctness of the data file by double determining the MD5 method, thereby achieving the purpose of saving bandwidth and improving the performance of pulling files. And by coexisting multiple state files such as original data files, failed data files, and in-use data files, the timeliness and success rate of data loading on each edge server are improved, and the normal operation of the edge cache service module is guaranteed to the greatest extent.
[0056] In order to make it easier for those skilled in the art to understand the present invention, Figure 2 A data file hot loading and updating method according to a specific embodiment of the present invention is as follows. Figure 2 As shown, the data file hot loading update method includes:
[0057] S210, compressing the generated target data file and data MD5 file to obtain a target data file compression package and an MD5 file compression package.
[0058] In an embodiment of the present invention, the generated target data file and data MD5 file may be compressed by the first data management module of the central data management server to obtain a target data file compression package and an MD5 file compression package.
[0059] S220, when the MD5 file compression package and the target data file compression package are successfully pulled, the MD5 file compression package is saved locally, and the original data file is updated based on the target data file. When the target data file is loaded, the loading result is determined, and related operations are performed based on the loading result.
[0060] In an embodiment of the present invention, when an MD5 file compression package is pulled, it is determined whether the first MD5 value in the MD5 file compression package is consistent with the second MD5 value in the local MD5 file compression package; when the first MD5 value is inconsistent with the second MD5 value, the target data file compression package is pulled; when the target data file compression package is successfully pulled, the MD5 file compression package is saved locally.
[0061] In an embodiment of the present invention, when the target data file is downloaded successfully and / or the pull request return code is normal, the target data file compression package is pulled successfully.
[0062] In an embodiment of the present invention, when the target data file compression package is successfully pulled, the target data file compression package is decompressed; it is verified whether the third MD5 value of the data file corresponding to the target data file compression package is consistent with the fourth MD5 value of the data file corresponding to the MD5 file compression package; when the third MD5 value is consistent with the fourth MD5 value, the MD5 file compression package is saved locally.
[0063] In the embodiment of the present invention, the implementation method of updating the original data file based on the target data file is: determining the data file used in real time by the service module; and overwriting the data file used in real time with the target data file.
[0064] In an embodiment of the present invention, in case of a loading failure, a failure data file is generated; in case of a loading success, a success data file is generated, and the memory data stored in the cache module process memory in the edge cache is updated based on the success data file.
[0065] In an embodiment of the present invention, when the service module is restarted, data recording is performed based on the success data file.
[0066] According to the data file hot loading and updating method of the embodiment of the present invention, the generated target data file and data MD5 file are compressed to obtain the target data file compression package and MD5 file compression package. By successfully pulling the MD5 file compression package and the target data file compression package, the MD5 file compression package is saved locally, and the original data file is updated based on the target data file, and the service module is triggered to load the target data file. When the service module loads the target data file, the loading result is determined, and related operations are performed based on the loading result. The method reduces the transmission time and network bandwidth occupation by compressing the target data file and the MD5 file, and improves the speed and efficiency of data update. By calculating the MD5 value, it can be ensured that the data file is not tampered with or damaged during the transmission process, thereby improving the accuracy and reliability of data update. By saving the target data file compression package locally, the number of visits to the central data management server can be reduced, and the occupation of system resources can be reduced.
[0067] Through the description of the above implementation methods, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes a number of instructions for a terminal device (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods of each embodiment of the present application.
[0068] According to one aspect of an embodiment of the present invention, an electronic device is provided.
[0069] Figure 3 Schematic diagram of the structure of an electronic device according to an embodiment of the present invention. Figure 3 As shown, the electronic device may include one or more ( Figure 3 Only one is shown in the figure) processor 102 (processor 102 may include but is not limited to a microprocessor (Microprocessor Unit, referred to as MPU) or a programmable logic device (Programmable logic device, referred to as PLD)) and a memory 104 for storing data. In an exemplary embodiment, the electronic device may also include a transmission device 106 and an input / output device 108 for communication functions. It can be understood by those skilled in the art that Figure 3 The structure shown is for illustration only and does not limit the structure of the above terminal device. Figure 3 More or fewer components as shown, or with Figure 3 Equivalent functions or comparisons shown Figure 3 A different configuration with more features is shown.
[0070] The memory 104 can be used to store computer programs, for example, software programs and modules of application software, such as the computer program corresponding to the data file hot loading and updating method in the embodiment of the present invention. The processor 102 executes various functional applications and data processing by running the computer program stored in the memory 104, that is, to implement the above method. The memory 104 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 104 may further include a memory remotely arranged relative to the processor 102, and these remote memories may be connected to the terminal device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.
[0071] The transmission device 106 is used to receive or send data via a network. The specific example of the above network may include a wireless network provided by a communication provider of the switching device. In one example, the transmission device 106 includes a network adapter (Network Interface Controller, referred to as NIC), which can be connected to other network devices through a base station so as to communicate with the Internet. In one example, the transmission device 106 can be a radio frequency (RF) module, which is used to communicate with the Internet wirelessly.
[0072] The present invention provides a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to enable the computer to execute a data file hot loading and updating method.
[0073] The applicant of the present invention has made a detailed explanation and description of the implementation examples of the present invention in conjunction with the drawings in the specification. However, those skilled in the art should understand that the above implementation examples are only preferred implementation schemes of the present invention, and the detailed description is only to help readers better understand the spirit of the present invention, but not to limit the scope of protection of the present invention. On the contrary, any improvements or modifications based on the inventive spirit of the present invention should fall within the scope of protection of the present invention.
[0074] In addition, each functional unit in each embodiment of the present invention may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.
[0075] The storage medium mentioned above may be a read-only memory, a magnetic disk or an optical disk, etc. Although the embodiments of the present invention have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limiting the present invention. A person of ordinary skill in the art may change, modify, replace and modify the above embodiments within the scope of the present invention.
[0076] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the embodiments of the present invention, rather than to limit them. Although the present invention has been described in detail with reference to the above embodiments, those skilled in the art should understand that they can still modify the technical solutions recorded in the above embodiments, or replace some of the technical features therein by equivalents; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention. Any changes or replacements that can be easily thought of by those skilled in the art within the technical scope disclosed in the present invention should be covered within the protection scope of the present invention.
Claims
1. A data file hot loading and updating system, characterized in that: include: The first data management module of the central data management server is used to compress the generated target data file and data MD5 file to obtain a target data file compression package and an MD5 file compression package; The edge cache includes a second data management module and a service module. The second data management module is used to save the MD5 file compression package locally when the MD5 file compression package and the target data file compression package are successfully pulled, and update the original data file based on the target data file, and at the same time trigger the service module to load the target data file. When the service module loads the target data file, the loading result is determined, and related operations are performed based on the loading result.
2. The data file hot loading and updating system according to claim 1 is characterized in that: When the MD5 file compression package and the target data file compression package are successfully pulled, the MD5 file compression package is saved locally, including: In the case where the MD5 file compression package is pulled, determining whether the first MD5 value in the MD5 file compression package is consistent with the second MD5 value in the local MD5 file compression package; When the first MD5 value is inconsistent with the second MD5 value, pulling the target data file compression package; When the target data file compression package is successfully pulled, the MD5 file compression package is saved locally.
3. The data file hot loading and updating system according to claim 2 is characterized in that: Pulling the compressed package of the target data file successfully includes: When the target data file is downloaded successfully and / or the pull request return code is normal, the target data file compression package is pulled successfully.
4. The data file hot loading and updating system according to claim 2 is characterized in that: When the target data file compression package is successfully pulled, the MD5 file compression package is saved locally, including: If the compressed package of the target data file is successfully pulled, the compressed package of the target data file is decompressed; Verify whether the third MD5 value of the data file corresponding to the target data file compression package is consistent with the fourth MD5 value of the data file corresponding to the MD5 file compression package; When the third MD5 value is consistent with the fourth MD5 value, the MD5 file compression package is saved locally.
5. The data file hot loading and updating system according to claim 2, characterized in that: Updating the original data file based on the target data file includes: Determine the data files used in real time by the service module; The target data file overwrites the data file used in real time.
6. The data file hot loading and updating system according to claim 1, characterized in that: Performing related operations based on the loading result includes: In case of a loading failure, a failure data file is generated; In the case of successful loading, a success data file is generated, and the memory data stored in the cache module process memory in the edge cache is updated based on the success data file.
7. The data file hot loading and updating system according to claim 6, characterized in that: Also includes: When the service module is restarted, data is recorded based on the success data file.
8. A data file hot loading and updating method, characterized in that: include: The generated target data file and data MD5 file are compressed to obtain a target data file compression package and an MD5 file compression package; When the MD5 file compression package and the target data file compression package are successfully pulled, the MD5 file compression package is saved locally, and the original data file is updated based on the target data file. When the target data file is loaded, the loading result is determined, and related operations are performed based on the loading result.
9. An electronic device, characterized in that: include: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method of claim 8.
10. A non-transitory computer-readable storage medium storing computer instructions, characterized in that: The computer instructions are used to cause the computer to execute the method according to claim 8.
Citation Information
Patent Citations
Method, device and system for loading software on basis of gateway data processing plate
CN103402221A
System and method for updating obtained webpage data
CN104424188A
A method and system for automatically updating data
CN109543155A
File filing method, device and equipment and computer readable storage medium
CN113220635A
Electronic material evidence document management method and system
CN113987040A
