A data file hot loading update system and method
Patent Information
- Application Number
- CN202410928103.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-11
- Publication Date
- 2026-09-25
- Estimated Expiration
- 2044-07-11
AI Technical Summary
通过文件更新的方式往往会遇到因为缓存边缘服务器过多,数据文件过大导致更新不及时、容易加载失败等问题
[0015]本发明所述的数据文件热加载更新系统及方法,将生成的目标数据文件和数据MD5文件进行压缩,得到目标数据文件压缩包和MD5文件压缩包,通过在拉取MD5文件压缩包和目标数据文件压缩包成功的情况下,将MD5文件压缩包保存至本地,并基于目标数据文件更新原始数据文件,同时触发服务模块加载目标数据文件,在服务模块加载目标数据文件的情况下,确定加载结果,并基于加载结果执行相关操作。由此,通过压缩目标数据文件和MD5文件,减少了传输时间和网络带宽的占用,提高了数据更新的速度和效率。通过计算MD5值,可以确保数据文件在传输过程中没有被篡改或损坏,从而提高了数据更新的准确性和可靠性。通过将目标数据文件压缩包保存至本地,可以减少对中心数据管理服务器的访问次数,降低系统资源的占用。
Smart Images

Figure CN118939619B_ABST
Abstract
Description
Technical Field
[0001] This invention belongs to the field of data processing technology, and in particular relates to a data file hot loading and updating system and method. Background Technology
[0002] In related technologies, many CDN edge caching servers typically require real-time data updates. These updates are generally managed through the control plane, using methods such as interfaces, files, and message queues. When the data volume is large and updates need to be pushed to a large number of caching servers in real time, file transfer is a common method. However, file updates often encounter problems such as untimely updates and frequent loading failures due to the large number of edge caching servers and the large data files. Summary of the Invention
[0003] In view of the shortcomings of the existing technology, the purpose of this invention is to provide a data file hot-loading and updating system and method. This system reduces transmission time and network bandwidth usage by compressing the target data file and its MD5 value, thereby improving the speed and efficiency of data updates. By calculating the MD5 value, it can be ensured that the data file has not been tampered with or corrupted during transmission, thus improving the accuracy and reliability of data updates. By saving the compressed target data file package locally, the number of accesses to the central data management server can be reduced, lowering the consumption of system resources.
[0004] In a first aspect, the present invention proposes a data file hot-loading and updating system, comprising: a first data management module of a central data management server, used to compress a generated target data file and a data MD5 file to obtain a target data file compressed package and an MD5 file compressed package; and an edge cache including a second data management module and a service module, wherein the second data management module is used to save the MD5 file compressed package to local storage and update the original data file based on the target data file when the MD5 file compressed package and the target data file compressed package are successfully retrieved, and simultaneously trigger the service module to load the target data file, and, when the service module loads the target data file, determine the loading result and perform related operations based on the loading result.
[0005] Furthermore, if the MD5 file compressed package and the target data file compressed package are successfully retrieved, the MD5 file compressed package is saved locally, including: if the MD5 file compressed package is retrieved, determining whether the first MD5 value in the MD5 file compressed package is consistent with the second MD5 value in the local MD5 file compressed package; if the first MD5 value and the second MD5 value are inconsistent, retrieving the target data file compressed package; if the target data file compressed package is successfully retrieved, saving the MD5 file compressed package locally.
[0006] Furthermore, successfully pulling the target data file compressed package includes: successfully pulling the target data file compressed package if the target data file is successfully downloaded and / or the pull request return code is normal.
[0007] Furthermore, if the target data file compressed package is successfully retrieved, the MD5 file compressed package is saved locally, including: if the target data file compressed package is successfully retrieved, decompressing the target data file compressed package; verifying whether the third MD5 value of the data file corresponding to the target data file compressed package is consistent with the fourth MD5 value of the data file corresponding to the MD5 file compressed package; if the third MD5 value is consistent with the fourth MD5 value, saving the MD5 file compressed package locally.
[0008] Furthermore, updating the original data file based on the target data file includes: determining the data file used by the service module in real time; and overwriting the real-time used data file with the target data file.
[0009] Furthermore, based on the loading result, related operations are performed, including: generating a failure data file if loading fails; generating a success data file if loading succeeds, and updating the memory data stored in the cache module process memory in the edge cache based on the success data file.
[0010] Furthermore, it also includes: recording data based on the success data file when the service module restarts.
[0011] In a second aspect, the present invention provides a method for hot-loading and updating data files, comprising: compressing a generated target data file and a data MD5 file to obtain a target data file compressed package and an MD5 file compressed package; if the MD5 file compressed package and the target data file compressed package are successfully retrieved, saving the MD5 file compressed package locally, and updating the original data file based on the target data file; if the target data file is loaded, determining the loading result, and performing related operations based on the loading result.
[0012] A third aspect of the present invention provides an electronic device comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method described in the second aspect of the present invention.
[0013] A fourth aspect of the present invention provides a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to cause the computer to perform the method described in the second aspect of the present invention.
[0014] The beneficial effects of this invention are as follows:
[0015] The data file hot-loading and updating system and method described in this invention compresses the generated target data file and data MD5 file to obtain a target data file compressed package and an MD5 file compressed package. If the MD5 file compressed package and the target data file compressed package are successfully retrieved, the MD5 file compressed package is saved locally. The original data file is then updated based on the target data file, and a service module is triggered to load the target data file. If the service module loads the target data file, the loading result is determined, and relevant operations are performed based on the loading result. Therefore, by compressing the target data file and the MD5 file, transmission time and network bandwidth consumption are reduced, improving the speed and efficiency of data updates. By calculating the MD5 value, it is ensured that the data file has not been tampered with or corrupted during transmission, thereby improving the accuracy and reliability of data updates. By saving the target data file compressed package locally, the number of accesses to the central data management server can be reduced, lowering system resource consumption. Attached Figure Description
[0016] The accompanying drawings are for illustrative purposes only and are not intended to limit the invention. Throughout the drawings, the same reference numerals denote the same parts. It is obvious that the drawings described below are merely some embodiments of the present invention, and those skilled in the art can obtain other drawings based on these drawings.
[0017] Figure 1 This is a schematic diagram of a data file hot-loading and updating system according to an embodiment of the present invention;
[0018] Figure 2 This is a flowchart of a data file hot-loading and updating method according to an embodiment of the present invention;
[0019] Figure 3 This is a structural block diagram of an electronic device according to an embodiment of the present invention. Detailed Implementation
[0020] To enable those skilled in the art to better understand the technical solutions in the embodiments of the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, not all embodiments. It should be understood that these descriptions are merely exemplary and are not intended to limit the scope of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.
[0021] Furthermore, descriptions of well-known structures and techniques are omitted in the following description to avoid unnecessarily obscuring the concepts disclosed in this invention.
[0022] In the description of this invention, it should be noted that, unless otherwise explicitly specified and limited, the terms "center," "upper," "lower," "left," "right," "vertical," "horizontal," "inner," and "outer," etc., indicating orientation or positional relationships based on the orientation or positional relationships shown in the accompanying drawings, are only for the convenience of describing the invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of the invention. Furthermore, the terms "first," "second," and "third" are used for descriptive purposes only and should not be construed as indicating or implying relative importance. The terms "installed," "connected," and "linked" should be interpreted broadly; for example, they can refer to a fixed connection, a detachable connection, or an integral connection; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; and they can refer to the internal communication of two components. Those skilled in the art can understand the specific meaning of the above terms in this invention based on the specific circumstances.
[0023] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numerals in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Rather, they are merely examples of methods and systems consistent with some aspects of the invention as detailed in the appended claims.
[0024] Currently, CDN acceleration mainly relies on server clusters deployed at edge nodes around the world. Through load balancing, content publishing, content management, and content storage, the CDN server clusters alleviate the pressure on the origin site server clusters, allowing users to access cached resources from the nearest location, avoiding network congestion and speeding up access.
[0025] These numerous CDN edge caching servers typically require real-time data updates, which are generally managed through the control plane, using methods such as interfaces, files, and message queues. When the data volume is large and updates need to be pushed to a large number of caching servers in real time, file transfer is a common method. However, file updates often encounter problems such as untimely updates and frequent loading failures due to the large number of caching edge servers and the large data files.
[0026] To this end, the present invention proposes a data file hot-loading and updating system, method and related equipment. Specifically, the data file hot-loading and updating system, method and related equipment of the present invention are described below with reference to the accompanying drawings.
[0027] Figure 1 This is a schematic diagram of a data file hot-loading and updating system according to an embodiment of the present invention. It should be noted that the data file hot-loading and updating system of this embodiment can be applied to the data file hot-loading and updating method of this embodiment.
[0028] like Figure 1 As shown, the data file hot reloading and update system includes:
[0029] The first data management module 111 of the central data management server 110 is used to compress the generated target data file and data MD5 file to obtain a target data file compressed package and an MD5 file compressed package;
[0030] The edge cache 210 includes a second data management module 211 and a service module 212. The second data management module 211 is used to save the MD5 file compressed package to the local machine and update the original data file based on the target data file when the MD5 file compressed package and the target data file compressed package are successfully retrieved. At the same time, it triggers the service module 212 to load the target data file. When the service module 212 loads the target data file, it determines the loading result and performs related operations based on the loading result.
[0031] According to an embodiment of the present invention, a data file hot-loading update system compresses a generated target data file and a data MD5 file to obtain a target data file compressed package and an MD5 file compressed package. If the MD5 file compressed package and the target data file compressed package are successfully retrieved, the MD5 file compressed package is saved locally. The original data file is then updated based on the target data file, and a service module is triggered to load the target data file. If the service module loads the target data file, the loading result is determined, and related operations are performed based on the loading result. Therefore, by compressing the target data file and the MD5 file, transmission time and network bandwidth consumption are reduced, improving the speed and efficiency of data updates. By calculating the MD5 value, it is ensured that the data file has not been tampered with or corrupted during transmission, thereby improving the accuracy and reliability of data updates. By saving the target data file compressed package locally, the number of accesses to the central data management server can be reduced, lowering system resource consumption.
[0032] In one embodiment of the present invention, when the MD5 file compressed package and the target data file compressed package are successfully retrieved, the MD5 file compressed package is saved locally as follows: when the MD5 file compressed package is retrieved, it is determined whether the first MD5 value in the MD5 file compressed package is consistent with the second MD5 value in the local MD5 file compressed package; if the first MD5 value and the second MD5 value are inconsistent, the target data file compressed package is retrieved; if the target data file compressed package is successfully retrieved, the MD5 file compressed package is saved locally.
[0033] The first MD5 value in the MD5 compressed file can be understood as a file downloaded from the central data management server 110, which contains the MD5 value corresponding to the compressed file. This MD5 value is calculated using the MD5 algorithm and is unique.
[0034] The second MD5 value in the local MD5 compressed file can be understood as a copy that is saved locally each time it is downloaded from the central data management server 110. This copy serves as the previous MD5 value and is used to determine whether the compressed file has been changed. If it has been changed, it means that a new compressed file has been generated and the latest compressed file needs to be downloaded.
[0035] If the target data file is downloaded successfully and / or the pull request return code is normal, it can be determined that the target data file compressed package was successfully pulled.
[0036] If the target data file compressed package is successfully retrieved, the target data file compressed package is decompressed; the third MD5 value of the data file corresponding to the target data file compressed package is verified to be consistent with the fourth MD5 value of the data file corresponding to the MD5 file compressed package; if the third MD5 value and the fourth MD5 value are consistent, the MD5 file compressed package is saved locally.
[0037] In an embodiment of the present invention, the method of updating the original data file based on the target data file is as follows: determine the data file used by the service module 212 in real time; overwrite the data file used in real time with the target data file.
[0038] In this embodiment of the invention, when the service module 212 loads the target data file, related operations can be performed based on the loading result. Specifically, if loading fails, a failure data file is generated; if loading succeeds, a success data file is generated, and the memory data stored in the cache module process memory in the edge cache 210 is updated based on the success data file.
[0039] In an embodiment of the present invention, when the service module 212 restarts, data is recorded based on the success data file.
[0040] In other words, when service module 212 restarts, data can be recorded based on the successful data file, avoiding loading failure and abnormal startup of service module 212 due to errors in the original data file.
[0041] In one embodiment of the present invention, the second data management module 211 on the edge cache 210 stores files in three states: original data file, in-use data file, and failed data file. The original data file is the file that needs to be updated each time, the in-use data file is the file generated after a successful update, and the failed data file is the file generated after a failed update. For example, the original update file is example.data, the in-use data file is example.data.inuse, and the failed data file is example.data.fail.
[0042] In one specific embodiment of the present invention, 1) the first data management module in the central data management server generates the latest data file (i.e., the target data file) and the data MD5 file, and compresses the latest data file and the data MD5 file to generate a data file compressed package (i.e., the target data file compressed package) and a compressed package MD5 file (i.e., an MD5 file compressed package).
[0043] For example, the embodiment is as follows:
[0044] The latest data file is example.data, which contains business data.
[0045] Data MD5 file: example.data.md5, the content of which is the MD5 value of the example.data file;
[0046] The latest data file generated is a compressed data file package: example.data.tar.gz, containing example.data and example.data.md5;
[0047] The MD5 file generated from the data MD5 file is named example.data.tar.gz.md5, and its content is the MD5 value of example.data.tar.gz.
[0048] 2) The second data management module of the edge cache periodically retrieves the MD5 file example.data.tar.gz.md5 from the central data management server;
[0049] 3) After pulling, check if the V1 value in the MD5 file of the compressed package is consistent with the V2 value in the local MD5 compressed package. If they are consistent, repeat step 2). If they are not consistent, pull the data file compressed package.
[0050] 4) If the data file compressed package fails to be retrieved, repeat step 2). If the data file compressed package is successfully retrieved, decompress the data file compressed package and check whether the V3 value of the corresponding file in the decompressed data file compressed package is consistent with the V4 value of the corresponding MD5 file of the compressed package.
[0051] For example: After decompressing the data file compressed package, the latest data file is named example.data, which contains business data. The MD5 value of the example.data file is calculated using the MD5 algorithm, which is V3. After decompressing the compressed package MD5 file, the data MD5 file is named example.data.md5, which contains the MD5 value of the example.data file, which is V4. The V3 value and V4 value are compared to see if they match.
[0052] If the V3 and V4 values are inconsistent, repeat step 2). If they are consistent, save the MD5 file of the compressed package to the local machine and overwrite the data file used by the service module in real time with the latest data file.
[0053] 5) Trigger the service module to load the latest data file. When the service module loads the latest data file, it verifies the format and data correctness. If the loading fails, it generates a failed data file example.data.fail and keeps the module's memory data unchanged. If the loading succeeds, it generates the latest in-use data file example.data.inuse and updates the memory data stored in the cache module process memory in the edge cache, thereby achieving hot data loading.
[0054] In the event of a loading failure, the failed data file example.data.fail can be analyzed, repaired, and then the latest data file example.data can be regenerated and the service module can be triggered to load it.
[0055] Based on the above description, the data file hot-loading and updating system of this embodiment ensures the correctness of data files through a dual-deterministic MD5 method, thereby saving bandwidth and improving file retrieval performance. Furthermore, by coexisting multiple status files—original data files, failed data files, and in-use data files—the system improves the timeliness and success rate of data loading on each edge server, maximizing the normal operation of the edge caching service module.
[0056] To enable those skilled in the art to more readily understand the present invention, Figure 2 This is a data file hot-loading and updating method according to a specific embodiment of the present invention, such as... Figure 2 As shown, the hot reloading and updating method for this data file includes:
[0057] S210, compress the generated target data file and data MD5 file to obtain a target data file compressed package and an MD5 file compressed package.
[0058] In an embodiment of the present invention, the generated target data file and data MD5 file can be compressed by the first data management module of the central data management server to obtain a target data file compressed package and an MD5 file compressed package.
[0059] S220: If the MD5 file compressed package and the target data file compressed package are successfully retrieved, the MD5 file compressed package is saved locally, and the original data file is updated based on the target data file. If the target data file is loaded, the loading result is determined, and related operations are performed based on the loading result.
[0060] In an embodiment of the present invention, when an MD5 file compressed package is retrieved, it is determined whether the first MD5 value in the MD5 file compressed package is consistent with the second MD5 value in the local MD5 file compressed package; if the first MD5 value and the second MD5 value are inconsistent, the target data file compressed package is retrieved; if the target data file compressed package is successfully retrieved, the MD5 file compressed package is saved locally.
[0061] In an embodiment of the present invention, if the target data file is successfully downloaded and / or the pull request return code is normal, the target data file compressed package is successfully pulled.
[0062] In an embodiment of the present invention, if the target data file compressed package is successfully retrieved, the target data file compressed package is decompressed; the third MD5 value of the data file corresponding to the target data file compressed package is verified to be consistent with the fourth MD5 value of the data file corresponding to the MD5 file compressed package; if the third MD5 value and the fourth MD5 value are consistent, the MD5 file compressed package is saved locally.
[0063] In an embodiment of the present invention, the method for updating the original data file based on the target data file is as follows: determine the data file used by the service module in real time; overwrite the data file used in real time with the target data file.
[0064] In an embodiment of the present invention, in the event of loading failure, a failure data file is generated; in the event of loading success, a success data file is generated, and the memory data stored in the cache module process memory in the edge cache is updated based on the success data file.
[0065] In an embodiment of the present invention, when the service module restarts, data is recorded based on the success data file.
[0066] According to the data file hot-loading update method of this invention, the generated target data file and data MD5 file are compressed to obtain a target data file compressed package and an MD5 file compressed package. If the MD5 file compressed package and the target data file compressed package are successfully retrieved, the MD5 file compressed package is saved locally, and the original data file is updated based on the target data file. Simultaneously, a service module is triggered to load the target data file. If the service module loads the target data file, the loading result is determined, and related operations are performed based on the loading result. This method reduces transmission time and network bandwidth usage by compressing the target data file and the MD5 file, improving the speed and efficiency of data updates. By calculating the MD5 value, it ensures that the data file has not been tampered with or corrupted during transmission, thereby improving the accuracy and reliability of data updates. By saving the target data file compressed package locally, the number of accesses to the central data management server can be reduced, lowering the system resource consumption.
[0067] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods according to the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods of the various embodiments of this application.
[0068] According to one aspect of the present invention, an electronic device is provided.
[0069] Figure 3 This is a schematic diagram of the structure of an electronic device according to an embodiment of the present invention. Figure 3 As shown, an electronic device may include one or more ( Figure 3 Only one is shown in the image. A processor 102 (which may include, but is not limited to, a microprocessor unit (MPU) or a programmable logic device (PLD)) and a memory 104 for storing data are also shown. In one exemplary embodiment, the electronic device may further include a transmission device 106 for communication functions and an input / output device 108. Those skilled in the art will understand that... Figure 3 The structure shown is for illustrative purposes only and does not limit the structure of the terminal device described above. For example, the terminal device may also include components that are more... Figure 3 The more or fewer components shown, or having the same Figure 3 Equivalent functions or ratios shown Figure 3 The functions shown have more different configurations.
[0070] The memory 104 can be used to store computer programs, such as application software programs and modules, like the computer program corresponding to the data file hot-loading update method in this embodiment of the invention. The processor 102 executes various functional applications and data processing by running the computer program stored in the memory 104, thereby implementing the above-described method. The memory 104 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 104 may further include memory remotely located relative to the processor 102, and these remote memories can be connected to terminal devices via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.
[0071] The transmission device 106 is used to receive or send data via a network. Specific examples of the network described above may include a wireless network provided by the communication provider of the switching device. In one example, the transmission device 106 includes a Network Interface Controller (NIC), which can connect to other network devices via a base station to communicate with the Internet. In another example, the transmission device 106 may be a Radio Frequency (RF) module used for wireless communication with the Internet.
[0072] This invention proposes a non-transitory computer-readable storage medium storing computer instructions, which are used to cause the computer to execute a data file hot-loading update method.
[0073] The applicant of this invention has provided a detailed description of the embodiments of the invention in conjunction with the accompanying drawings. However, those skilled in the art should understand that the above embodiments are merely preferred embodiments of the invention. The detailed description is only intended to help readers better understand the spirit of the invention and is not intended to limit the scope of protection of the invention. On the contrary, any improvements or modifications made based on the inventive spirit of the invention should fall within the scope of protection of the invention.
[0074] Furthermore, the functional units in the various embodiments of the present invention can be integrated into a processing module, or each unit can exist physically separately, or two or more units can be integrated into a module. The integrated module can be implemented in hardware or as a software functional module. If the integrated module is implemented as a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium.
[0075] The storage medium mentioned above can be a read-only memory, a disk, or an optical disk, etc. Although embodiments of the present invention have been shown and described above, it is to be understood that the above embodiments are exemplary and should not be construed as limiting the present invention. Those skilled in the art can make changes, modifications, substitutions, and variations to the above embodiments within the scope of the present invention.
[0076] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the embodiments of the present invention, and are not intended to limit them. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention. Any changes or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in the present invention should be included within the protection scope of the present invention.
Claims
1. A data file hot-loading and updating system, characterized in that, include: The first data management module of the central data management server is used to compress the generated target data file and data MD5 file to obtain a target data file compressed package and an MD5 file compressed package; The edge cache includes a second data management module and a service module. The second data management module is used to save the MD5 file compressed package to the local machine and update the original data file based on the target data file when the MD5 file compressed package and the target data file compressed package are successfully retrieved. At the same time, it triggers the service module to load the target data file. When the service module loads the target data file, it determines the loading result and performs related operations based on the loading result.
2. The data file hot-loading and updating system according to claim 1, characterized in that, If the MD5 file archive and the target data file archive are successfully retrieved, the MD5 file archive is saved locally, including: If the MD5 file archive is retrieved, determine whether the first MD5 value in the MD5 file archive is consistent with the second MD5 value in the local MD5 file archive. If the first MD5 value and the second MD5 value are inconsistent, retrieve the target data file compressed package; If the target data file compressed package is successfully retrieved, the MD5 file compressed package is saved locally.
3. The data file hot-loading and updating system according to claim 2, characterized in that, The target data file compressed package was successfully retrieved, including: If the target data file is downloaded successfully and / or the pull request return code is normal, the target data file compressed package is successfully pulled.
4. The data file hot-loading and updating system according to claim 2, characterized in that, If the target data file compressed package is successfully retrieved, the MD5 file compressed package is saved locally, including: If the target data file compressed package is successfully retrieved, the target data file compressed package is decompressed; Verify whether the third MD5 value of the data file corresponding to the target data file compressed package is consistent with the fourth MD5 value of the data file corresponding to the MD5 file compressed package; If the third MD5 value matches the fourth MD5 value, the MD5 file archive is saved locally.
5. The data file hot-loading and updating system according to claim 2, characterized in that, Updating the original data file based on the target data file includes: Determine the data file used by the service module in real time; Overwrite the real-time data file with the target data file.
6. The data file hot-loading and updating system according to claim 1, characterized in that, Based on the loading result, perform related operations, including: In the event of a loading failure, a failure data file is generated. If the loading is successful, a success data file is generated, and the memory data stored in the cache module process memory in the edge cache is updated based on the success data file.
7. The data file hot-loading and updating system according to claim 6, characterized in that, Also includes: When the service module restarts, data is recorded based on the success data file.
8. A method for hot-loading and updating data files, characterized in that, include: The generated target data file and data MD5 file are compressed to obtain a target data file compressed package and an MD5 file compressed package. If the MD5 file archive and the target data file archive are successfully retrieved, the MD5 file archive is saved locally, and the original data file is updated based on the target data file. If the target data file is loaded, the loading result is determined, and related operations are performed based on the loading result.
9. An electronic device, characterized in that, include: At least one processor; as well as A memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor to enable the at least one processor to perform the method of claim 8.
10. A non-transitory computer-readable storage medium storing computer instructions, characterized in that, The computer instructions are used to cause the computer to perform the method according to claim 8.
Citation Information
Patent Citations
System and method for updating obtained webpage data
CN104424188A
File filing method, device and equipment and computer readable storage medium
CN113220635A