A method and apparatus for distributed log storage and fast access in edge computing

Abstract

This application relates to a method, apparatus, computer device, and storage medium for distributed log storage and fast access in edge computing. The method includes establishing multiple edge storage centers globally based on the distribution of edge computing devices. These centers are used for the local storage of general logs, while important logs are stored in a domestic management center. By classifying logs and storing general logs locally, the amount of log data transmitted remotely is significantly reduced, improving the success rate of log transmission. Simultaneously, this invention proposes a fast access method corresponding to the distributed log storage in edge computing. This method enables fast log access based on the type of log to be accessed and the device ID. Important logs are read from the domestic management center, while general logs are read from the device's corresponding home storage center, improving the efficiency of log reading.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to a method, apparatus, computer device, and storage medium for distributed log storage and fast access in edge computing. Background Technology

[0002] In edge networks, devices and servers are distributed globally, necessitating log collection. Log collection has the following characteristics:

[0003] 1. Log importance differs. Some business logs are very important and need to be stored long-term for later processing; most data consists of information such as machine and device memory, network, packet loss, and latency, which are time-sensitive and do not need to be stored long-term.

[0004] 2. The transmission distance is long and the transmission cost is high.

[0005] Currently, a centralized storage approach is used, storing logs in a domestic data center regardless of whether the machines are located overseas or domestically. The advantages are a simple system structure and convenient access and processing. However, it has the following disadvantages:

[0006] 1. For domestic machines and equipment, the network is relatively good, and log collection can meet real-time requirements; however, for overseas machines and equipment, the upload failure rate increases. As the number of machines and equipment increases, this contradiction becomes more and more prominent.

[0007] 2. Logs were not processed according to their characteristics. A large amount of unnecessary data consumed significant bandwidth and storage resources, increasing costs.

[0008] 3. To adapt to unstable network conditions, the reporting interval has been extended, which has reduced real-time performance to some extent.

[0009] Therefore, existing technologies suffer from poor adaptability. Summary of the Invention

[0010] Therefore, it is necessary to provide a method, apparatus, computer device, and storage medium for distributed log storage and fast access in edge computing that can improve the efficiency and adaptability of edge computing log storage and address the aforementioned technical problems.

[0011] A method for distributed log storage in edge computing, the method comprising:

[0012] In the edge network, post logs are initiated by edge computing devices; the post logs contain meta information; the meta information includes information about the device's home storage center; the home storage center is the edge storage center to which the device belongs according to a pre-planned schedule; there are multiple edge storage centers, distributed in various locations around the world; each edge storage center includes a Director server and a storage cluster;

[0013] After receiving the post log from the Director server of the edge storage center closest to the device, the Director server determines the log type. If it is an important log, the Director server forwards the log to the domestic management center for storage. If it is a general log, the Director server determines whether the current edge storage center is the home storage center of the device based on the meta information. If not, the Director server forwards the log to the corresponding home storage center.

[0014] The Director server of the current edge storage center stores the post logs to the storage cluster of the current edge storage center, thus completing the distributed storage of logs in edge computing.

[0015] In one embodiment, the storage cluster includes multiple buckets and multiple storage machines;

[0016] The Director server of the current edge storage center performs a hash calculation on the device ID of the device.

[0017] The bucket corresponding to the device is determined based on the obtained hash value;

[0018] The storage machine corresponding to the bucket is determined according to the preset bucket-storage mapping table.

[0019] In one embodiment, the method further includes: the number of buckets is fixed, and each bucket corresponds to one storage machine; the number of storage machines can be increased or decreased according to storage needs; when adding or removing storage machines, the bucket-storage mapping table is modified accordingly.

[0020] A method for fast log access in edge computing, the method comprising:

[0021] In the edge network, the management terminal obtains the log type and its device ID for the log to be accessed;

[0022] The system determines the type of log entry based on the log type. If the log is important, the system accesses the log from the domestic management center using the device ID.

[0023] If it is a general log, its Home storage center is determined according to the device ID; the Home storage center is the edge storage center to which the device belongs according to a pre-planned schedule; there are multiple edge storage centers, distributed in many locations around the world, used to store the device's general logs in the nearest location; each edge storage center includes a Director server and a storage cluster;

[0024] Access to general logs is accomplished by the Director server of the Home storage center reading logs from the storage cluster of the Home storage center based on the device ID.

[0025] In one embodiment, the method further includes: performing a hash calculation based on the device ID through the Director server of the Home storage center, and determining the bucket corresponding to the device based on the obtained hash value;

[0026] Based on the preset bucket-storage mapping table, the storage machine corresponding to the bucket is determined, and logs are read from the storage machine to complete the access to general logs.

[0027] A log distributed storage device for edge computing, the device comprising:

[0028] The log sending module is used to initiate post logs by edge computing devices in the edge network; the post logs contain meta information; the meta information includes information about the device's Home storage center; the Home storage center is the edge storage center to which the device belongs according to a pre-planned plan; there are multiple edge storage centers, distributed in various locations around the world; each edge storage center includes a Director server and a storage cluster;

[0029] The log receiving module is used to receive the post log from the Director server of the edge storage center closest to the device, determine the log type, and if it is an important log, the Director server forwards the log to the domestic management center for storage. If it is a general log, the module determines whether the current edge storage center is the home storage center of the device based on the meta information. If not, the Director server forwards the log to the corresponding home storage center.

[0030] The log storage module is used to store the post logs from the Director server of the current edge storage center to the storage cluster of the current edge storage center, thereby completing the distributed storage of logs in edge computing.

[0031] A fast log access device in edge computing, the device comprising:

[0032] The access information acquisition module is used to obtain the log type and device ID of the log to be accessed from the management terminal in the edge network;

[0033] The important log access module is used to determine the log type. If the log is important, the module accesses the log from the domestic management center based on the device ID.

[0034] The general log access module is used to determine the Home storage center for general logs based on the device ID. The Home storage center is the edge storage center to which the device belongs according to a pre-planned schedule. There are multiple edge storage centers, distributed in various locations around the world, used for storing the device's general logs in the nearest available location. Each edge storage center includes a Director server and a storage cluster. Access to general logs is completed by reading logs from the storage cluster of the Home storage center through the Director server of the Home storage center based on the device ID.

[0035] A computer device includes a memory and a processor, the memory storing a computer program, and the processor executing the computer program performing the following steps:

[0036] In the edge network, post logs are initiated by edge computing devices; the post logs contain meta information; the meta information includes information about the device's home storage center; the home storage center is the edge storage center to which the device belongs according to a pre-planned schedule; there are multiple edge storage centers, distributed in various locations around the world; each edge storage center includes a Director server and a storage cluster;

[0037] After receiving the post log from the Director server of the edge storage center closest to the device, the Director server determines the log type. If it is an important log, the Director server forwards the log to the domestic management center for storage. If it is a general log, the Director server determines whether the current edge storage center is the home storage center of the device based on the meta information. If not, the Director server forwards the log to the corresponding home storage center.

[0038] The Director server of the current edge storage center stores the post logs to the storage cluster of the current edge storage center, thus completing the distributed storage of logs in edge computing.

[0039] A computer device includes a memory and a processor, the memory storing a computer program, and the processor executing the computer program performing the following steps:

[0040] In the edge network, the management terminal obtains the log type and its device ID for the log to be accessed;

[0041] The system determines the type of log entry based on the log type. If the log is important, the system accesses the log from the domestic management center using the device ID.

[0042] If it is a general log, its Home storage center is determined according to the device ID; the Home storage center is the edge storage center to which the device belongs according to a pre-planned schedule; there are multiple edge storage centers, distributed in many locations around the world, used to store the device's general logs in the nearest location; each edge storage center includes a Director server and a storage cluster;

[0043] Access to general logs is accomplished by the Director server of the Home storage center reading logs from the storage cluster of the Home storage center based on the device ID.

[0044] A computer-readable storage medium having a computer program stored thereon, the computer program performing the following steps when executed by a processor:

[0045] In the edge network, post logs are initiated by edge computing devices; the post logs contain meta information; the meta information includes information about the device's home storage center; the home storage center is the edge storage center to which the device belongs according to a pre-planned schedule; there are multiple edge storage centers, distributed in various locations around the world; each edge storage center includes a Director server and a storage cluster;

[0046] After receiving the post log from the Director server of the edge storage center closest to the device, the Director server determines the log type. If it is an important log, the Director server forwards the log to the domestic management center for storage. If it is a general log, the Director server determines whether the current edge storage center is the home storage center of the device based on the meta information. If not, the Director server forwards the log to the corresponding home storage center.

[0047] The Director server of the current edge storage center stores the post logs to the storage cluster of the current edge storage center, thus completing the distributed storage of logs in edge computing.

[0048] A computer-readable storage medium having a computer program stored thereon, the computer program performing the following steps when executed by a processor:

[0049] In the edge network, the management terminal obtains the log type and its device ID for the log to be accessed;

[0050] The system determines the type of log entry based on the log type. If the log is important, the system accesses the log from the domestic management center using the device ID.

[0051] If it is a general log, its Home storage center is determined according to the device ID; the Home storage center is the edge storage center to which the device belongs according to a pre-planned schedule; there are multiple edge storage centers, distributed in many locations around the world, used to store the device's general logs in the nearest location; each edge storage center includes a Director server and a storage cluster;

[0052] Access to general logs is accomplished by the Director server of the Home storage center reading logs from the storage cluster of the Home storage center based on the device ID.

[0053] The aforementioned edge computing log distributed storage, fast access method, apparatus, computer equipment, and storage medium establish multiple edge storage centers globally based on the distribution of edge computing devices. These centers store general logs locally, while important logs are stored in a domestic management center. Through log classification and localized storage of general logs, the amount of log data transmitted remotely is significantly reduced, improving the success rate of log transmission. Simultaneously, this invention proposes a fast access method corresponding to the distributed log storage in edge computing. This method enables fast log access based on the log type and device ID. Important logs are read from the domestic management center, while general logs are read from the device's corresponding home storage center, thus improving log reading efficiency. Attached Figure Description

[0054] Figure 1 This is a diagram illustrating an application scenario of log distributed storage and fast access methods in edge computing, as shown in one embodiment.

[0055] Figure 2 This is a flowchart illustrating a log distributed storage method in edge computing in one embodiment;

[0056] Figure 3 This is a flowchart illustrating a fast log access method in edge computing in one embodiment;

[0057] Figure 4 This is a structural block diagram of a log distributed storage device in edge computing in one embodiment;

[0058] Figure 5 This is a structural block diagram of a log fast access device in edge computing in one embodiment;

[0059] Figure 6 This is an internal structural diagram of a computer device in one embodiment. Detailed Implementation

[0060] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0061] The log distribution storage and fast access method provided in this application for edge computing can be applied to, for example... Figure 1 The application environment shown is as follows. Domestic management center 102 stores important logs; multiple edge storage centers 104, distributed globally, store general logs; and multiple edge computing devices 106, also distributed globally, are included. Each edge storage center 104 includes a Director server 1042 and a storage cluster 1044. The storage cluster 1044 includes multiple buckets and multiple storage machines. The number of buckets is fixed, while the number of storage machines can be increased or decreased according to storage needs. The correspondence between buckets and storage machines is determined by a pre-defined bucket-storage mapping table.

[0062] In one embodiment, such as Figure 2 As shown, a method for distributed log storage in edge computing is provided, including the following steps:

[0063] Step 202: In the edge network, the edge computing device initiates the post log.

[0064] The Home storage center is where devices are stored according to their pre-planned assigned edge storage centers, such as devices in China or Southeast Asia. Post logs contain meta information, which includes information about the device's Home storage center. However, retrieving the Home storage center via the device ID incurs a cost. A more reasonable approach is to include the Home name in the meta information when the device submits data, such as `POST / log / home_code / network_statistics`. This way, the Home identifier is included in every request, regardless of the recipient, who knows where the device intends to post content.

[0065] There are multiple edge storage centers distributed globally, used for general logs stored on nearby devices. Each edge storage center includes a Director server and a storage cluster. When the management terminal accesses the storage center from the outside, it does not need to know which specific storage machine the logs are stored on; instead, the Director server determines this when accessing the edge storage center. The Director service provides a unified access interface to the storage centers, so log uploads and services only require access to a fixed Director machine.

[0066] Step 204: After receiving the post log, the Director server of the edge storage center closest to the device determines the log type. If it is an important log, the Director server forwards the log to the domestic management center for storage. If it is a general log, the Director server determines whether the current edge storage center is the device's Home storage center based on the meta information. If not, the Director server forwards the log to the corresponding Home storage center.

[0067] This invention implements distributed storage for important logs and general logs. Important logs refer to business logs that are crucial and require long-term storage and subsequent post-storage; general logs comprise the majority of the log data, including information on machine and device memory, network, packet loss, latency, etc., which are time-sensitive but do not require long-term storage.

[0068] This invention uses distributed storage for both to avoid general logs consuming large amounts of bandwidth and storage resources, ensuring that important logs can be stably reported and stored, while general logs can be stored in a timely manner.

[0069] Typically, the nearest storage center that a device connects to via intelligent DNS resolution is its Home storage center. However, considering: 1. DNS resolution errors; 2. Device movement, the edge storage center obtained by the device through DNS may not be the center where it should be storing its data. Therefore, this invention proposes the concept of a Home storage center. The information of the Home storage center is stored in the meta information and sent to the nearest storage center along with the logs. The edge storage center needs to provide the function of forwarding logs to the device's Home storage center.

[0070] Step 206: The Director server of the current edge storage center stores the post logs to the storage cluster of the current edge storage center, completing the distributed storage of logs in edge computing.

[0071] In one embodiment, such as Figure 3 As shown, a method for fast log reading in edge computing is provided, including the following steps:

[0072] Step 302: In the edge network, the management terminal obtains the log type and its device ID of the log to be accessed.

[0073] The device ID determines which region the device belongs to, and then determines which log center the logs are stored in, which requires accessing the corresponding Director server.

[0074] Step 304: Determine the log type. If it is an important log, access the log from the domestic management center based on the device ID.

[0075] Step 306: If it is a general log, determine its Home storage center based on the device ID.

[0076] Home storage center is the edge storage center to which the device belongs according to the pre-planned plan; there are multiple edge storage centers, which are distributed in many places around the world and are used to store the general logs of the device locally; each edge storage center includes a Director server and a storage cluster.

[0077] Step 308: Access to general logs is completed by reading logs from the storage cluster of the Home storage center through the Director server of the Home storage center based on the device ID.

[0078] In the aforementioned edge computing log distributed storage and fast access method, multiple edge storage centers are established globally based on the distribution of edge computing devices. These centers are used for the local storage of general logs, while important logs are stored in the domestic management center. Through log classification and local storage of general logs, the amount of log data transmitted remotely is significantly reduced, improving the success rate of log transmission. Simultaneously, this invention proposes a fast access method corresponding to the distributed log storage in edge computing. This method enables fast log access based on the log type and device ID. Important logs are read from the domestic management center, while general logs are read from the device's corresponding home storage center, improving log reading efficiency.

[0079] In one embodiment, the storage cluster includes multiple buckets and multiple storage machines. The Director server of the current edge storage center performs a hash calculation on the device ID of the device. The bucket corresponding to the device is determined based on the obtained hash value. The storage machine corresponding to the bucket is determined according to a preset bucket-storage mapping table. The number of buckets is fixed, and each bucket corresponds to one storage machine. The number of storage machines can be increased or decreased according to storage needs. When adding or removing storage machines, the bucket-storage mapping table is modified accordingly.

[0080] In this embodiment, regardless of the number of machines, the number of buckets is a prime number of 8191. Each device is hashed into these buckets based on its ID. Each bucket is stored on the same machine. Thus, when the Director addresses a device's log, it needs to hash the device ID and determine which bucket it belongs to based on the hash value.

[0081] The reason for this design is that, since the device ID is not directly hashed to a specific storage machine, but rather hashed into a fixed number of buckets, changes in the storage machine will not cause changes in the device ID hash.

[0082] Specifically, if a device ID is hashed to storage machines 1..n, when the total number of storage machines is increased to (n+1), using the same hashing algorithm, such as modulo operation, the storage machine for the device will change, leading to data migration. Different hashing algorithms result in different amounts of data being migrated. However, by introducing the concept of buckets, since the number of buckets remains constant, devices will always hash to the same bucket. When adding storage machines, the buckets do not automatically migrate to the new storage; manual migration and modification of the bucket-storage mapping table are required. In this way, the addition or removal of storage machines does not affect device hashing, and the migration progress can be controlled.

[0083] In one embodiment, the method further includes: performing a hash calculation based on the device ID through the Director server of the Home storage center, determining the bucket corresponding to the device based on the obtained hash value; determining the storage machine corresponding to the bucket based on a preset bucket-storage mapping table, and reading logs from the storage machine to complete the access to general logs.

[0084] It should be understood that, although Figure 2-3 The steps in the flowchart are shown sequentially as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order in which these steps are executed, and they can be performed in other orders. Figure 2-3 At least some of the steps in the process may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed in turn or alternately with other steps or at least some of the sub-steps or stages of other steps.

[0085] In one embodiment, such as Figure 4 As shown, a log distributed storage device for edge computing is provided, comprising: a log sending module 402, a log receiving module 404, and a log storage module 406, wherein:

[0086] The log sending module 402 is used to initiate post logs by edge computing devices in the edge network. The post logs contain meta information. The meta information includes information about the device's Home storage center. The Home storage center is the edge storage center to which the device belongs according to a pre-planned plan. There are multiple edge storage centers, distributed in many locations around the world. Each edge storage center includes a Director server and a storage cluster.

[0087] The log receiving module 404 is used to receive post logs from the Director server of the edge storage center closest to the device, determine the log type, and if it is an important log, the Director server will forward the log to the domestic management center for storage. If it is a general log, the Director server will determine whether the current edge storage center is the device's Home storage center based on the meta information. If not, the Director server will forward the log to the corresponding Home storage center.

[0088] The log storage module 406 is used to store post logs from the Director server of the current edge storage center to the storage cluster of the current edge storage center, thus completing the distributed storage of logs in edge computing.

[0089] The log storage module 406 is also used to perform a hash calculation on the device ID of the device by the Director server of the current edge storage center; determine the bucket corresponding to the device based on the obtained hash value; and determine the storage machine corresponding to the bucket based on the preset bucket-storage mapping table.

[0090] In one embodiment, such as Figure 5 As shown, a fast log reading device for edge computing is provided, including: an access information acquisition module 502, an important log access module 504, and a general log access module 506, wherein:

[0091] Access information acquisition module 502 is used to obtain the log type and its device ID of the log to be accessed from the management terminal in the edge network;

[0092] The important log access module 504 is used to determine the log type. If it is an important log, the log is accessed from the domestic management center based on the device ID.

[0093] The general log access module 506 is used to determine the Home storage center for general logs based on the device ID. The Home storage center is the edge storage center to which the device belongs according to a pre-planned plan. There are multiple edge storage centers, which are distributed in many places around the world and are used to store the device's general logs locally. Each edge storage center includes a Director server and a storage cluster. The general log access is completed by reading the logs from the storage cluster of the Home storage center based on the device ID through the Director server of the Home storage center.

[0094] The general log access module 506 is also used to perform hash calculation based on the device ID through the Director server of the Home storage center, determine the bucket corresponding to the device based on the obtained hash value, determine the storage machine corresponding to the bucket based on the preset bucket-storage mapping table, and read the log from the storage machine to complete the access to general logs.

[0095] For specific limitations regarding log distributed storage and fast access devices in edge computing, please refer to the limitations on log distributed storage and fast access methods in edge computing mentioned above, which will not be repeated here. Each module in the aforementioned log distributed storage and fast access device in edge computing can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in or independent of the processor in a computer device in hardware form, or stored in the memory of a computer device in software form, so that the processor can call and execute the corresponding operations of each module.

[0096] In one embodiment, a computer device is provided, which may be a terminal, and its internal structure diagram may be as follows: Figure 6 As shown, the computer device includes a processor, memory, network interface, display screen, and input devices connected via a system bus. The processor provides computing and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs stored in the non-volatile storage media. The network interface is used to communicate with external terminals via a network connection. When the computer program is executed by the processor, it implements a log distributed storage and fast access method in edge computing. The display screen can be an LCD screen or an e-ink screen. The input devices can be a touch layer covering the display screen, buttons, a trackball, or a touchpad mounted on the computer device casing, or an external keyboard, touchpad, or mouse.

[0097] Those skilled in the art will understand that Figure 6 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0098] In one embodiment, a computer device is provided, including a memory and a processor, the memory storing a computer program, the processor executing the computer program to implement the steps in the above method embodiment.

[0099] In one embodiment, a computer-readable storage medium is provided having a computer program stored thereon, which, when executed by a processor, implements the steps in the above method embodiments.

[0100] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, storage, databases, or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in various forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), dual data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), Rambus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

[0101] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0102] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the invention patent. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this patent application should be determined by the appended claims.

Claims

1. A method for log distribution storage in edge computing, characterized in that, The method comprises: In an edge network, a post log is initiated by an edge computing device; the post log contains meta information; the meta information contains information of a Home storage center of the device; the Home storage center is an edge storage center to which the device belongs according to a pre-planning; the edge storage center is multiple and is distributed in multiple places in the world; each edge storage center comprises a Director server and a storage cluster; After the Director server of the edge storage center closest to the device receives the post log, the Director server judges the log type; if the log is an important log, the Director server forwards the log to a domestic management center storage; if the log is a general log, the Director server judges whether the current edge storage center is the Home storage center of the device according to the meta information; if not, the Director server forwards the log to the corresponding Home storage center; The Director server of the current edge storage center stores the post log in the storage cluster of the current edge storage center, thereby completing distributed storage of the log in edge computing; wherein the important log comprises a business log and needs long-term storage; the general log comprises device monitoring data and does not need long-term storage; the Home storage center is specified by the meta information.

2. The method of claim 1, wherein, The storage cluster comprises multiple buckets and multiple storage machines; the Director server of the current edge storage center stores the post log in the storage cluster of the current edge storage center, thereby completing distributed storage of the log in edge computing, which comprises: The Director server of the current edge storage center performs hash calculation on the device ID of the device; The corresponding bucket of the device is determined according to the obtained hash value; According to a preset bucket-storage mapping table, the corresponding storage machine of the bucket is determined.

3. The method of claim 2, wherein, The number of buckets is fixed, and each bucket corresponds to a storage machine; the number of storage machines can be increased or decreased according to storage requirements; when the storage machine is increased or decreased, the bucket-storage mapping table is modified correspondingly.

4. A log distribution storage apparatus in edge computing, characterized by, The device comprises: A log sending module is configured to initiate a post log by an edge computing device in an edge network; the post log contains meta information; the meta information contains information of a Home storage center of the device; the Home storage center is an edge storage center to which the device belongs according to a pre-planning; the edge storage center is multiple and is distributed in multiple places in the world; each edge storage center comprises a Director server and a storage cluster; The log receiving module is configured to, after receiving the post log by the Director server of the edge storage center closest to the device, determine the log type, and if the log is an important log, forward the log to the domestic management center storage by the Director server, and if the log is a general log, determine whether the current edge storage center is the Home storage center of the device according to the meta information, and if not, forward the log to the corresponding Home storage center by the Director server. The log storage module is configured to store the post log to the storage cluster of the current edge storage center by the Director server of the current edge storage center, to complete the distributed storage of the log in edge computing; wherein the important log includes a business log and needs long-term storage; the general log includes device monitoring data and does not need long-term storage; and the Home storage center is specified by the meta information.

5. A method for fast access of logs in edge computing, characterized in that, The method comprises: In the edge network, the management end acquires the log type and the device ID of the log to be accessed; According to the log type, if it is an important log, the log is accessed from the domestic management center according to the device ID; If it is a general log, the Home storage center of the device is determined according to the device ID; the Home storage center is the edge storage center to which the device belongs according to the pre-planning; the edge storage center is multiple and is dispersed in multiple places in the world, and is used for storing the general log of the device nearby; each edge storage center includes a Director server and a storage cluster; The Director server of the Home storage center reads the log from the storage cluster of the Home storage center according to the device ID to complete the access of the general log; wherein the important log includes a business log and needs long-term storage; the general log includes device monitoring data and does not need long-term storage; and the Home storage center is specified by the meta information.

6. The method of claim 5, wherein, The storage cluster includes multiple buckets and multiple storage machines, and the Director server of the Home storage center reads the log from the storage cluster of the Home storage center according to the device ID to complete the access of the general log, including: The Director server of the Home storage center performs hash calculation according to the device ID, and determines the bucket corresponding to the device according to the obtained hash value; According to a preset bucket-storage mapping table, the storage machine corresponding to the bucket is determined, and the log is read from the storage machine to complete the access of the general log.

7. The method of claim 6, wherein, The number of buckets is fixed, and each bucket corresponds to a storage machine; the number of storage machines can be increased or decreased according to storage requirements; when the storage machine is increased or decreased, the bucket-storage mapping table is modified correspondingly.

8. A device for fast access of logs in edge computing, characterized in that, The device comprises: The access information acquisition module is configured to, in the edge network, acquire the log type and the device ID of the log to be accessed by the management end; An important log access module is configured to determine the log type, and if the log is an important log, access the log from the home management center according to the device ID; A general log access module is configured to determine the Home storage center of a general log according to the device ID, wherein the Home storage center is an edge storage center to which the device belongs according to a pre-planning, the edge storage center is multiple and is distributed in multiple places in the world, and is configured to store the general log of the device in a nearby manner; each edge storage center comprises a Director server and a storage cluster; the Director server of the Home storage center reads the log from the storage cluster of the Home storage center according to the device ID, thereby completing the access of the general log; wherein the important log comprises a business log and needs to be stored for a long time, the general log comprises device monitoring data and does not need to be stored for a long time, and the Home storage center is specified by meta information. 9.A computer device, comprising a memory and a processor, wherein the memory stores a computer program, and the computer device is configured to perform the method according to any one of claims 1-8 when the computer program is executed by the processor. The processor executes the computer program to implement the steps of the method in any one of claims 1 to 7.

10. A computer-readable storage medium having stored thereon a computer program, characterized in that, The computer program is executed by the processor to implement the steps of the method in any one of claims 1 to 7.

Images