Data processing method and related apparatus thereof

Abstract

The application relates to a data processing method and a related device, which is applied to a first content distribution network node to be delivered to a content distribution network, a plurality of second content distribution network nodes of the content distribution network establish a communication connection based on a peer-to-peer network service to constitute a peer-to-peer network, content management data of the first content distribution network node is split into a plurality of management sub-data by the peer-to-peer network service and is stored in the plurality of second content distribution network nodes respectively, the method comprises the following steps: obtaining a data list used for describing the management sub-data required for constituting the content management data, and accessing the peer-to-peer network based on the pre-deployed peer-to-peer network service; obtaining the plurality of management sub-data from the plurality of second content distribution network nodes respectively according to the data list; and splicing the obtained plurality of management sub-data into the content management data. The application solves the problem of poor timeliness of content management data synchronization to the corresponding content distribution network node.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to data processing methods and related equipment. Background Technology

[0002] This section is intended to provide background or context for the embodiments of the invention set forth in the claims. It should not be construed as an admission that the description herein is prior art.

[0003] A Content Delivery Network (CDN) is a distributed network built on top of a backbone network and composed of edge node servers located in different regions. The working principle of a CDN is to cache the resources of the origin server on edge node servers (also known as CDN nodes) in various locations. When a user requests access to and obtains resources, the resources cached on the nearest CDN node are called, replacing the traditional server-centric data transmission model.

[0004] Besides caching static data resources, a significant portion of the services provided by Content Delivery Network (CDN) nodes require dynamic updates and loading. CDN nodes are managed by a deployed Content Management Service (CMS), which provides users with dynamic updates, configuration distribution, and other management services. The CMS consists of a Content Management Center located on the host machine and service programs deployed on the CDN nodes. CDN nodes communicate with the Content Management Center through these service programs. The Content Management Center executes services such as configuration distribution, which involves the Content Management Center sending the dynamic configuration requested by the user to the CDN nodes. The service programs' act of reading the dynamic configuration obtained from the CDN nodes constitutes the dynamic loading process. The service programs are also responsible for executing dynamic update tasks issued by the Content Management Center. For example, user static pages or dynamic configurations are not static but require dynamic updates based on actual service conditions; these updates are performed by the service programs. The Content Management Center needs to store the content management data required for the Content Management Service to implement its management services. Without this content management data, problems such as user-initiated dynamic configuration requests failing to load correctly and service updates failing may occur. Given the importance of the content management service to the content delivery network (CDN) nodes, whenever a CDN node needs to be deployed to provide services to users, after the content management service is deployed on the CDN node, the CDN node needs to pull content management data stored in file format from the content management center according to the data list issued by the content management center (which indicates the content management data required by the CDN node). Since the amount of content management data stored in file format is large, pulling the full amount of content management data from the content management center takes a long time, resulting in poor timeliness of content management data synchronization to the corresponding CDN node, thus hindering the delivery of the entire CDN node. Summary of the Invention

[0005] The data processing method and related equipment provided in this invention at least solve the problem of poor timeliness in synchronizing content management data to the corresponding content distribution network nodes.

[0006] According to one aspect of the present invention, a data processing method is provided, the method being applied to a first content distribution network node to be delivered to a content distribution network, the content distribution network including a plurality of second content distribution network nodes, the plurality of second content distribution network nodes establishing communication connections based on their respective deployed peer-to-peer network services to form a peer-to-peer network, and the content management data of the content management service deployed by the first content distribution network node being split into a plurality of management sub-data by the peer-to-peer network service and stored respectively in the plurality of second content distribution network nodes, the method comprising:

[0007] Obtain a data list describing the management sub-data required to constitute the content management data, and access the peer-to-peer network based on the pre-deployed peer-to-peer network service to establish a communication connection with each of the second content distribution network nodes in the peer-to-peer network;

[0008] According to the data list, multiple management sub-data are obtained from multiple second content distribution network nodes respectively;

[0009] The acquired multiple management sub-data are concatenated to form the content management data.

[0010] In some embodiments, before obtaining the multiple management sub-data from the multiple second content delivery network nodes according to the data list, the method further includes:

[0011] The index file generated after the peer-to-peer network service stores multiple management sub-data in multiple second content distribution network nodes is obtained. The index file includes index information of the management sub-data, and the index information is information used to describe the second content distribution network node storing the management sub-data.

[0012] The step of obtaining multiple management sub-data from multiple second content distribution network nodes according to the data list includes:

[0013] After determining the required management sub-data based on the data list, the second content distribution network node storing the management sub-data is determined based on the index information, so as to obtain the management sub-data from the second content distribution network node.

[0014] In some embodiments, the content management service includes a content management center and a service program. The content management center stores the data list, the service program is deployed on the first content delivery network node, and the content management center is deployed on the host side of the content management service. The step of obtaining a data list describing the management sub-data required to constitute the content management data includes:

[0015] After establishing a communication connection with the host through the service program, the data list is obtained from the content management center.

[0016] In some embodiments, before obtaining the multiple management sub-data from the multiple second content delivery network nodes according to the data list, the method further includes:

[0017] Obtain data update information issued by the content management center for updating the data list, update the data list to a target data list based on the data update information, and obtain multiple management sub-data from multiple second content distribution network nodes according to the target data list.

[0018] According to another aspect of the present invention, a data processing apparatus is provided for performing the aforementioned data processing method.

[0019] According to another aspect of the present invention, a content delivery network node is provided, the content delivery network node including the aforementioned data processing device.

[0020] According to another aspect of the present invention, a content delivery network system is provided, the content delivery network system comprising a first content delivery network node and a plurality of second content delivery network nodes, wherein the plurality of second content delivery network nodes establish communication connections based on their respective deployed peer-to-peer network services to form a peer-to-peer network, and wherein content management data of a content management service deployed by the first content delivery network node is split into a plurality of management sub-data by the peer-to-peer network service and stored respectively in the plurality of second content delivery network nodes, the first content delivery network node being configured to perform the following steps when delivering to the content delivery network:

[0021] Obtain a data list describing the management sub-data required to constitute the content management data, and access the peer-to-peer network based on the pre-deployed peer-to-peer network service to establish a communication connection with each of the second content distribution network nodes in the peer-to-peer network;

[0022] According to the data list, multiple management sub-data are obtained from multiple second content distribution network nodes respectively;

[0023] The acquired multiple management sub-data are concatenated into the content management data.

[0024] In some embodiments, before the first content delivery network node obtains the multiple management sub-data from the multiple second content delivery network nodes according to the data list, the following method steps are also performed:

[0025] The index file generated after the peer-to-peer network service stores multiple management sub-data in multiple second content distribution network nodes is obtained. The index file includes index information of the management sub-data, and the index information is information used to describe the second content distribution network node storing the management sub-data.

[0026] Then, the step of the first content delivery network node obtaining multiple management sub-data from multiple second content delivery network nodes according to the data list includes:

[0027] After determining the required management sub-data based on the data list, the second content distribution network node storing the management sub-data is determined based on the index information, so as to obtain the management sub-data from the second content distribution network node.

[0028] According to another aspect of the present invention, an electronic device is provided, comprising: a processor, and a memory storing a program, wherein the program includes instructions that, when executed by the processor, cause the processor to perform the data processing method.

[0029] According to another aspect of the invention, a non-transitory machine-readable medium storing computer instructions is provided, wherein the computer instructions are used to cause the computer to perform the data processing method described above.

[0030] According to another aspect of the present invention, a computer program product is provided, comprising a computer program, wherein the computer program, when executed by a computer's processor, is used to cause the computer to perform the data processing method described above.

[0031] Beneficial effects of the embodiments of the present invention:

[0032] In this embodiment of the invention, the content management data of the content management service deployed by the first content distribution network node is split into multiple management sub-data from the peer-to-peer network service and stored separately on multiple second content distribution network nodes that have been delivered and are online and can provide management services to users. During the online delivery process, the first content distribution network node determines the management sub-data it needs based on the data list and establishes a communication connection with the second content distribution network node based on the peer-to-peer network service. Then, it splices the management sub-data obtained from the corresponding second content distribution network node into content management data. As a result, the first content distribution network node does not need to spend a long time pulling the full amount of content management data from the content management center of the content management service, and can obtain the content management data in a timely manner. This improves the timeliness of obtaining content management data when the first content distribution network node deploys the content management service, thereby accelerating the delivery rhythm of the first content distribution network node.

[0033] Details of one or more embodiments of the present invention are set forth in the following drawings and description, so that other features, objects and advantages of the invention will be more readily understood. Attached Figure Description

[0034] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the accompanying drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other embodiments can be obtained based on these drawings without creative effort.

[0035] Figure 1 This is a flowchart illustrating a data processing method provided in an embodiment of the present invention.

[0036] Figure 2 This is a schematic diagram of a content delivery network system provided in an embodiment of the present invention. Detailed Implementation

[0037] Embodiments of this embodiment will now be described in more detail with reference to the accompanying drawings. While some embodiments of this embodiment are shown in the drawings, it should be understood that this embodiment can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this embodiment. It should be understood that the accompanying drawings and embodiments are for illustrative purposes only and are not intended to limit the scope of protection of this embodiment.

[0038] First, some nouns or terms that appear in the description of the embodiments of the present invention shall be interpreted as follows:

[0039] Peer-to-Peer (P2P) networking is an internet system without a central server, relying on a group of users (peers) to exchange information. It is not a physical network but a logical network, carried on top of other networks, such as the content delivery network in this embodiment. In a peer-to-peer network structure, each peer node typically possesses the functions of an information consumer, information provider, and information communicator. Therefore, each peer node contributes its capabilities and collaborates to provide peer-to-peer network services. Currently, peer-to-peer network services mainly include distributed storage services and distributed delivery services. From a computing model perspective, peer-to-peer networks break the traditional client / server (C / S) model; each peer node in a peer-to-peer network has an equal status. Each peer node acts as a server, providing services to other nodes, while also enjoying the services provided by other nodes.

[0040] To address the issue of poor timeliness in synchronizing content management data to the corresponding content distribution network nodes due to the significant time required to retrieve the full amount of content management data from the content management center of the content management service before the delivery and deployment of content distribution network nodes, the first embodiment of this invention provides a data processing method. This method is applied to a first content distribution network node to be delivered to the content distribution network, which includes multiple second content distribution network nodes. These multiple second content distribution network nodes establish communication connections based on their respective deployed peer-to-peer network services to form a peer-to-peer network. Specifically, the currently online second content distribution network nodes automatically construct a peer-to-peer network based on their respective deployed peer-to-peer network services. Furthermore, the content management data of the content management service deployed by the first content distribution network node is split into multiple management sub-data by the peer-to-peer network service and stored separately on multiple second content distribution network nodes. Specifically, the distributed storage service of the peer-to-peer network service is used to split and distribute the content management data to the located second content distribution network nodes, achieving distributed storage of content management data through the peer-to-peer network carried by the content distribution network. Figure 1 As shown, the method provided in this embodiment of the invention includes the following steps:

[0041] Step S11: Obtain a data list describing the management sub-data required to constitute the content management data, and access the peer-to-peer network based on the pre-deployed peer-to-peer service to establish communication connections with each of the second content delivery network nodes in the peer-to-peer network. The first content delivery network node can then determine from the data list which management sub-data it needs to constitute the content management data in order to provide services to users normally through the content management service. After the first content delivery network node accesses the peer-to-peer network and establishes communication connections with each of the second content delivery network nodes based on the deployed peer-to-peer service, the first and second content delivery network nodes can communicate with each other.

[0042] Step S12: Obtain multiple management sub-data from multiple second content delivery network nodes according to the data list. The second content delivery network nodes in the peer-to-peer network act as information providers for the first content delivery network node. When the first content delivery network node needs the corresponding management sub-data, it can obtain the required management sub-data from the second content delivery network nodes that store the management sub-data.

[0043] Step S13: The acquired multiple management sub-data are concatenated into content management data, so that after being delivered to the content delivery network, the content management service can provide the predetermined management service to the user based on the content management data. Therefore, in this embodiment of the invention, when the first content delivery network node deploys the content management service online, it does not need to spend a lot of time pulling the full amount of content management data from the content management center of the content management service. Instead, it can directly and quickly obtain smaller management sub-data that has been broken down into smaller chunks for transmission from the second distribution network node. For example, if the management sub-data is a distributed storage service for peer-to-peer network services, it can break down the 10 gigabytes (generally represented by gigabytes) of content management data into only a few megabytes of management sub-data. Therefore, based on the distributed storage and distributed transmission characteristics of peer-to-peer networks, this embodiment of the invention enables the first content distribution network node to promptly obtain the management sub-data required to constitute content management data for its own node. The obtained management sub-data can then be concatenated into complete content management data. Furthermore, since the first content distribution network node is provided with information communication services through the collaboration of multiple second content distribution network nodes acting as peers, the single point of failure risk inherent in traditional client / server architectures can be avoided. Moreover, based on the scale of the second content distribution network nodes in the entire peer-to-peer network, the frequency of synchronizing management sub-data to the first content distribution network node can be greatly increased, thereby improving the timeliness of content management data synchronization, ensuring timely delivery by the first content distribution network node, and guaranteeing the service performance of the content distribution network.

[0044] As can be seen, in this embodiment of the invention, the content management data of the content management service deployed by the first content distribution network node is split into multiple management sub-data from the peer-to-peer network service and stored separately on multiple second content distribution network nodes that have been delivered and are online and can provide management services to users. During the online delivery process, the first content distribution network node determines the management sub-data it needs based on the data list and establishes a communication connection with the second content distribution network node based on the peer-to-peer network service. Then, it splices the management sub-data obtained from the corresponding second content distribution network node into content management data. As a result, the first content distribution network node does not need to spend a long time pulling the full amount of content management data from the content management center of the content management service, and can obtain the content management data in a timely manner. This improves the timeliness of obtaining content management data when the first content distribution network node deploys the content management service, thereby accelerating the delivery rhythm of the first content distribution network node.

[0045] Before step S12, which retrieves multiple management sub-data from multiple second content distribution network nodes according to the data list, the method provided in this embodiment of the invention further includes: obtaining an index file generated after the peer-to-peer network service stores the multiple management sub-data on multiple second content distribution network nodes. The index file includes index information of the management sub-data, which describes the second content distribution network node storing the management sub-data; that is, the index information indicates which second content distribution network node the corresponding management sub-data is specifically stored on. In this embodiment of the invention, after the peer-to-peer network service performs distributed storage on the split management sub-data, it indexes the management sub-data to indicate its storage location and stores the obtained index information in an index file. The index information indicates the second content distribution network node storing the corresponding management sub-data. Thus, after the first content distribution network node to be delivered deploys the peer-to-peer network service, it can obtain the index file from the connected peer network and then retrieve the corresponding content management data from the corresponding second content distribution network node according to the index file. Therefore, in step S12 of this embodiment of the invention, the step of obtaining multiple management sub-data from multiple second content distribution network nodes according to the data list includes: after determining the required management sub-data according to the data list, determining the second content distribution network node storing the management sub-data according to the index information, so as to obtain the management sub-data from the second content distribution network node.

[0046] The content management service in this embodiment of the invention includes a content management center and a service program. The content management center is used to store a data list, the service program is deployed on a first content distribution network node, and the content management center is deployed on the host side of the content management service. The content management center is mainly used to execute configuration distribution tasks and save data information related to the content management service. The configuration distribution task is the task of the content management center sending the dynamic configuration that the user wants to access to the content distribution network node. The service program is mainly used to dynamically load the information that the user wants to access, and the service program is also responsible for executing dynamic update tasks issued by the content management center, etc. In step S11, the step of obtaining a data list for describing the management sub-data required to constitute the content management data includes: after establishing a communication connection between the service program and the host side, obtaining the data list from the content management center. In this embodiment of the invention, the first content distribution network node only needs to obtain a data list of content management data from the content management center. It does not need to pull the full amount of content management data from the content management center. Instead, it can obtain the management sub-data required to constitute the content management data from the corresponding second content distribution network node in the peer network based on the data list. This improves the timeliness of obtaining content management data when the first content distribution network node deploys content management services, thereby accelerating the delivery rhythm of the first content distribution network node and ensuring the service performance of the content distribution network.

[0047] In step S12, before obtaining multiple management sub-data from multiple second content distribution network nodes according to the data list, the method provided in this embodiment of the invention further includes: obtaining data update information issued by the content management center for updating the data list; updating the data list to a target data list based on the data update information; and obtaining multiple management sub-data from multiple second content distribution network nodes according to the target data list. That is, when the original data list stored in the content management center is no longer applicable to the first content distribution network node to be delivered online, or when the data list needs to be updated according to the latest content management data of the content management service, the invention sends data update information to the first content distribution network node. Thus, the first content distribution network node can pull the required management sub-data based on the updated target data list, ensuring that after the first content distribution network node is delivered to the content distribution network, it can accurately provide the predetermined management service to the user through the content management data obtained by splicing the management sub-data from the target data list, thus guaranteeing service performance.

[0048] As can be seen from the above, the data processing method provided by the embodiments of the present invention can ensure that content management data is synchronized to the first content distribution network node to be delivered in real time. Moreover, based on the scale of content distribution network nodes in the peer-to-peer network, it can avoid complex network environments and realize transparent transmission of content management data. It can avoid problems such as data transmission failure caused by the risk of single point of failure in the traditional client / server architecture, thereby ensuring that the first content distribution network node can obtain content management data in a timely and effective manner, thereby accelerating the delivery rhythm of the first content distribution network node.

[0049] The second embodiment of the present invention provides a data processing apparatus for performing a data processing method. For details of the data processing method, please refer to the content provided in the first embodiment of the present invention. The embodiments of the present invention will not be described again here.

[0050] The data processing apparatus provided in this embodiment of the invention can split the content management data of the content management service deployed by the first content distribution network node into multiple management sub-data from the peer-to-peer network service, and store them respectively on multiple second content distribution network nodes that have been delivered and are online and can provide management services to users. During the online delivery process, the first content distribution network node determines the management sub-data it needs according to the data list and establishes a communication connection with the second content distribution network node based on the peer-to-peer network service. Then, it splices the management sub-data obtained from the corresponding second content distribution network node into content management data. As a result, the first content distribution network node does not need to spend a long time pulling the full amount of content management data from the content management center of the content management service, and can obtain the content management data in a timely manner. This improves the timeliness of obtaining content management data when the first content distribution network node deploys the content management service, and thus speeds up the delivery rhythm of the first content distribution network node.

[0051] The third embodiment of the present invention provides a content distribution network node, which includes a data processing device. For details of the data processing device, please refer to the content provided in the second embodiment of the present invention. The embodiments of the present invention will not be described again here.

[0052] The fourth embodiment of the present invention provides a content delivery network system, such as... Figure 2 As shown, the content delivery network system includes a first content delivery network node and multiple second content delivery network nodes. The multiple second content delivery network nodes establish communication connections based on their respective deployed peer-to-peer network services to form a peer-to-peer network. Furthermore, the content management data of the content management service deployed by the first content delivery network node is split into multiple management sub-data by the peer-to-peer network service and stored separately on the multiple second content delivery network nodes. The first content delivery network node is used to perform the following steps when delivering to the content delivery network:

[0053] Step S11: Obtain a data list describing the management sub-data required to constitute the content management data, and access the peer-to-peer network based on the pre-deployed peer-to-peer service to establish communication connections with each of the second content delivery network nodes in the peer-to-peer network. The first content delivery network node can then determine from the data list which management sub-data it needs to constitute the content management data in order to provide services to users normally through the content management service. After the first content delivery network node accesses the peer-to-peer network and establishes communication connections with each of the second content delivery network nodes based on the deployed peer-to-peer service, the first and second content delivery network nodes can communicate with each other.

[0054] Step S12: Obtain multiple management sub-data from multiple second content delivery network nodes according to the data list. The second content delivery network nodes in the peer-to-peer network act as information providers for the first content delivery network node. When the first content delivery network node needs the corresponding management sub-data, it can obtain the required management sub-data from the second content delivery network nodes that store the management sub-data.

[0055] Step S13: The acquired multiple management sub-data are concatenated into content management data, so that after being delivered to the content delivery network, the content management service can provide the predetermined management service to the user based on the content management data. Therefore, in this embodiment of the invention, when the first content delivery network node deploys the content management service online, it does not need to spend a lot of time pulling the full amount of content management data from the content management center of the content management service. Instead, it can directly and quickly obtain smaller management sub-data that has been broken down into smaller chunks for transmission from the second distribution network node. For example, if the management sub-data is a distributed storage service for peer-to-peer network services, it can break down the 10 gigabytes (generally represented by gigabytes) of content management data into only a few megabytes of management sub-data. Therefore, based on the distributed storage and distributed transmission characteristics of peer-to-peer networks, this embodiment of the invention enables the first content distribution network node to promptly obtain the management sub-data required to constitute content management data for its own node. The obtained management sub-data can then be concatenated into complete content management data. Furthermore, since the first content distribution network node is provided with information communication services through the collaboration of multiple second content distribution network nodes acting as peers, the single point of failure risk inherent in traditional client / server architectures can be avoided. Moreover, based on the scale of the second content distribution network nodes in the entire peer-to-peer network, the frequency of synchronizing management sub-data to the first content distribution network node can be greatly increased, thereby improving the timeliness of content management data synchronization, ensuring timely delivery by the first content distribution network node, and guaranteeing the service performance of the content distribution network.

[0056] As can be seen, the system provided in this embodiment of the invention, after splitting the content management data of the content management service deployed by the first content distribution network node into multiple management sub-data from the peer-to-peer network service, stores them respectively on multiple second content distribution network nodes that have been delivered and are online and can provide management services to users. During the online delivery process, the first content distribution network node determines the management sub-data it needs according to the data list and establishes a communication connection with the second content distribution network node based on the peer-to-peer network service. Then, it splices the management sub-data obtained from the corresponding second content distribution network node into content management data. As a result, the first content distribution network node does not need to spend a long time pulling the full amount of content management data from the content management center of the content management service, and can obtain the content management data in a timely manner. This improves the timeliness of obtaining content management data when the first content distribution network node deploys the content management service, and thus speeds up the delivery rhythm of the first content distribution network node.

[0057] In step S12, before the first content delivery network node obtains multiple management sub-data from multiple second content delivery network nodes according to the data list, it further performs the following steps: obtaining an index file generated after the peer-to-peer network service stores the multiple management sub-data on multiple second content delivery network nodes. The index file includes index information of the management sub-data, which describes the second content delivery network node storing the management sub-data; that is, the index information indicates which second content delivery network node the corresponding management sub-data is specifically stored on. In the system provided by this embodiment, after the peer-to-peer network service performs distributed storage on the split management sub-data, it indexes the management sub-data to indicate its storage location and stores the obtained index information in an index file. The index information indicates the second content delivery network node storing the corresponding management sub-data. Thus, after the first content delivery network node deploys the peer-to-peer network service, it can obtain the index file from the connected peer network and then retrieve the corresponding content management data from the corresponding second content delivery network node according to the index file. Therefore, in the embodiment of the present invention, the step of the first content distribution network node obtaining multiple management sub-data from multiple second content distribution network nodes according to the data list includes: after determining the required management sub-data according to the data list, determining the second content distribution network node storing the management sub-data according to the index information, so as to obtain the management sub-data from the second content distribution network node.

[0058] The content management service in this embodiment of the invention includes a content management center and a service program. The content management center stores a data list, the service program is deployed on a first content distribution network node, and the content management center is deployed on the host side of the content management service. The content management center is mainly used to execute configuration distribution tasks and save data information related to the content management service. The configuration distribution task is the task of the content management center sending the dynamic configuration that the user wants to access to the content distribution network node. The service program is mainly used to dynamically load the information that the user wants to access, and the service program is also responsible for executing dynamic update tasks issued by the content management center, etc. The step of the first content distribution network node obtaining the data list used to describe the management sub-data required to constitute the content management data includes: after the first content distribution network node establishes a communication connection with the host side through the service program, it obtains the data list from the content management center. In this embodiment of the invention, the first content distribution network node only needs to obtain a data list of content management data from the content management center. It does not need to pull the full amount of content management data from the content management center. Instead, it can obtain the management sub-data required to constitute the content management data from the corresponding second content distribution network node in the peer network based on the data list. This improves the timeliness of obtaining content management data when the first content distribution network node deploys content management services, thereby accelerating the delivery rhythm of the first content distribution network node and ensuring the service performance of the content distribution network.

[0059] The fifth embodiment of the present invention provides an electronic device, including: a processor and a memory storing a program, wherein the program includes instructions, which, when executed by the processor, cause the processor to perform a data processing method. For details of the data processing method, please refer to the content provided in the first embodiment of the present invention, and the embodiments of the present invention will not be described again here.

[0060] The sixth embodiment of the present invention provides a non-transitory machine-readable medium storing computer instructions, wherein the computer instructions are used to cause a computer to execute a data processing method. For details of the data processing method, please refer to the content provided in the first embodiment of the present invention. The embodiments of the present invention will not be described again here.

[0061] The seventh embodiment of the present invention provides a computer program product, including a computer program, wherein the computer program, when executed by the processor of a computer, is used to cause the computer to perform a data processing method. For details of the data processing method, please refer to the content provided in the first embodiment of the present invention. The embodiments of the present invention will not be described again here.

[0062] The eighth embodiment of the present invention provides an application embodiment of a data processing method. This application embodiment relies on peer-to-peer network technology to solve the problem that before a content distribution network node is delivered and put online to provide corresponding management services to users, it is necessary to manually spend a lot of time to pull the full amount of large data stream of content management data from the content management center of the content management service, which affects the timeliness of synchronizing content management data to the content distribution network node.

[0063] To avoid the timeliness issues caused by fetching all data from a single node, this embodiment of the invention first needs to adjust the storage method for content management data. For this purpose, the distributed storage characteristics of peer-to-peer network services can be used to distribute the content management data.

[0064] Existing peer-to-peer (P2P) network architectures mainly fall into three categories: general, special, and hybrid. General P2P networks have no central server or router; peer nodes act as both clients and servers. Special P2P networks have a central server that stores resource information for peer nodes and responds to requests for resource information. Peer nodes are responsible for publishing information, letting the central server know what files they want to share, and allowing other peer nodes to download the shareable resources. Hybrid P2P networks are an architecture that combines the above two forms.

[0065] Regardless of the peer-to-peer network architecture used in this embodiment of the invention, the data shared within each peer node needs to be packaged and distributed. Given that existing technologies store content management data as files in the content management center of the content management service, and considering the large size of individual files containing content management data, the first improvement required in this embodiment is to utilize the distributed storage characteristics of the peer-to-peer network service for distributed storage of the content management data. This involves breaking down the content management data into manageable sub-data that can be transmitted in chunks, and distributing these sub-data chunks to different content distribution network nodes for storage. This facilitates the transmission and distribution of manageable sub-data across multiple content distribution network nodes. After the peer-to-peer network service performs distributed storage on the split manageable sub-data, this embodiment of the invention indexes the manageable sub-data to indicate its storage location and stores the obtained index information in an index file. The index information identifies the second content distribution network node storing the corresponding manageable sub-data.

[0066] After modifying the storage method for content management data, this embodiment of the invention establishes peer-to-peer network services within each content distribution network (CDN) node. When establishing these services, a peer-to-peer server can be set up on the corresponding CDN node to provide the service, or the service can be directly configured within the CDN node. This embodiment adopts a general, serverless peer-to-peer network architecture. In this way, each CDN node can act as a server providing data to other CDN nodes and as a client pulling data from them. This lays the foundation for the first CDN node to obtain the necessary management sub-data from multiple second CDN nodes to form the content management data before deployment.

[0067] In practical applications, the second online content delivery network (CDN) nodes automatically form a peer-to-peer network. During the deployment of a newly developed first CDN node, content management services are deployed first. Then, the first CDN node automatically connects to the peer-to-peer network, including the second CDN nodes, based on the pre-deployed peer-to-peer service and obtains the index file for content management data. During deployment, the first CDN node obtains a data list from the content management center node of the content management service. This data list indicates the management sub-data required by the first CDN node to assemble the content management data. Therefore, based on the data list and index file, the first CDN node combines multiple management sub-data obtained from multiple second CDN nodes into the content management data, achieving automatic acquisition of content management data. This eliminates the need for the first CDN node to fetch the full content management data from the content management center, ensuring the timeliness of acquiring content management data synchronously when deploying the content management service. Meanwhile, based on the peer-to-peer and distributed storage characteristics of peer-to-peer networks, network complexity can be naturally avoided. Peer-to-peer network services will store data in content distribution network nodes that belong to peer nodes with better network environments, avoiding data retrieval failures caused by single points of failure. Based on the scale of the entire network of content distribution network nodes, data synchronization efficiency can be greatly improved.

[0068] As can be seen from the above, the data processing method provided by the embodiments of the present invention can ensure that content management data is synchronized to the first content distribution network node to be delivered in real time. Moreover, based on the scale of content distribution network nodes in the peer-to-peer network, it can avoid complex network environments and realize transparent transmission of content management data. It can avoid problems such as data transmission failure caused by the risk of single point of failure in the traditional client / server architecture, thereby ensuring that the first content distribution network node can obtain content management data in a timely and effective manner, thereby accelerating the delivery rhythm of the first content distribution network node.

[0069] Computer programs for implementing the methods of embodiments of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus, such that when executed by the processor or controller, the computer programs cause the functions / operations specified in the flowcharts and / or block diagrams to be implemented. The computer programs may be executed entirely on a machine, partially on a machine, or as a standalone software package, partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0070] In the context of embodiments of the present invention, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable signal medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0071] It should be noted that the term "comprising" and its variations used in the embodiments of the present invention are open-ended, meaning "including but not limited to". The term "based on" means "at least partially based on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". The modifications of "one" and "multiple" mentioned in the embodiments of the present invention are illustrative and not restrictive. Those skilled in the art should understand that, unless explicitly indicated otherwise in the context, they should be understood as "one or more".

[0072] The user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in the embodiments of the present invention are all information and data authorized by the user or fully authorized by all parties. Furthermore, the collection, use and processing of the relevant data must comply with the relevant laws, regulations and standards of the relevant countries and regions, and corresponding operation entry points are provided for users to choose to authorize or refuse.

[0073] The steps described in the method embodiments provided by this invention can be performed in different orders and / or in parallel. Furthermore, the method embodiments may include additional steps and / or omit the steps shown. The scope of protection of this invention is not limited in this respect.

[0074] The term "embodiment" in this specification refers to a specific feature, structure, or characteristic described in connection with an embodiment that may be included in at least one embodiment of the invention. The appearance of this phrase in various places in the specification does not necessarily imply the same embodiment, nor does it imply independence or alternativeity from other embodiments. The various embodiments in this specification are described in a related manner, with reference to each other for similar or identical parts. In particular, for apparatus, device, and system embodiments, since they are substantially similar to method embodiments, the description is relatively simple, and relevant details are referred to in the description of the method embodiments.

[0075] The embodiments described above are merely illustrative of several implementations of the present invention, and while the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of patent protection. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of the present invention, and these all fall within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the appended claims.

Claims

1. A data processing method, the method being applied to a first content delivery network node to be delivered to a content delivery network, the content delivery network including multiple second content delivery network nodes, the multiple second content delivery network nodes establishing communication connections based on their respective deployed peer-to-peer network services to form a peer-to-peer network, and the content management data of the content management service deployed by the first content delivery network node being split into multiple management sub-data by the peer-to-peer network service and stored respectively in the multiple second content delivery network nodes, the method comprising: Obtain a data list describing the management sub-data required to constitute the content management data, and access the peer-to-peer network based on the pre-deployed peer-to-peer network service to establish a communication connection with each of the second content distribution network nodes in the peer-to-peer network; The first content delivery network node can determine the management sub-data that constitutes the content management data based on the data list; According to the data list, multiple management sub-data are obtained from multiple second content distribution network nodes respectively; The acquired multiple management sub-data are concatenated into the content management data; After the content management data is delivered to the content distribution network, the content management service provides services to users based on the content management data.

2. The method according to claim 1, wherein, Before obtaining the multiple management sub-data from the multiple second content distribution network nodes according to the data list, the method further includes: The index file generated after the peer-to-peer network service stores multiple management sub-data in multiple second content distribution network nodes is obtained. The index file includes index information of the management sub-data, and the index information is information used to describe the second content distribution network node storing the management sub-data. The step of obtaining multiple management sub-data from multiple second content distribution network nodes according to the data list includes: After determining the required management sub-data based on the data list, the second content distribution network node storing the management sub-data is determined based on the index information, so as to obtain the management sub-data from the second content distribution network node.

3. The method according to claim 1, wherein, The content management service includes a content management center and a service program. The content management center stores the data list, the service program is deployed on the first content distribution network node, and the content management center is deployed on the host side of the content management service. The step of obtaining the data list used to describe the management sub-data required to constitute the content management data includes: After establishing a communication connection with the host through the service program, the data list is obtained from the content management center.

4. The method according to claim 3, wherein, Before obtaining the multiple management sub-data from the multiple second content distribution network nodes according to the data list, the method further includes: Obtain data update information issued by the content management center for updating the data list, update the data list to a target data list based on the data update information, and obtain multiple management sub-data from multiple second content distribution network nodes according to the target data list.

5. A content delivery network system, comprising a first content delivery network node and a plurality of second content delivery network nodes, wherein the plurality of second content delivery network nodes establish communication connections based on their respective deployed peer-to-peer network services to form a peer-to-peer network, and wherein content management data of a content management service deployed by the first content delivery network node is split into multiple management sub-data by the peer-to-peer network service and stored respectively on the plurality of second content delivery network nodes, wherein the first content delivery network node is configured to perform the following steps when delivering to the content delivery network: Obtain a data list describing the management sub-data required to constitute the content management data, and access the peer-to-peer network based on the pre-deployed peer-to-peer network service to establish a communication connection with each of the second content distribution network nodes in the peer-to-peer network; The first content delivery network node can determine the management sub-data that constitutes the content management data based on the data list; According to the data list, multiple management sub-data are obtained from multiple second content distribution network nodes respectively; The acquired multiple management sub-data are concatenated into the content management data; After the content management data is delivered to the content distribution network, the content management service provides services to users based on the content management data.

6. The system according to claim 5, wherein, Before the first content delivery network node obtains the multiple management sub-data from the multiple second content delivery network nodes according to the data list, the following steps are also performed: The index file generated after the peer-to-peer network service stores multiple management sub-data in multiple second content distribution network nodes is obtained. The index file includes index information of the management sub-data, and the index information is information used to describe the second content distribution network node storing the management sub-data. Then, the step of the first content delivery network node obtaining multiple management sub-data from multiple second content delivery network nodes according to the data list includes: After determining the required management sub-data based on the data list, the second content distribution network node storing the management sub-data is determined based on the index information, so as to obtain the management sub-data from the second content distribution network node.

7. An electronic device, comprising: A processor, and a memory storing a program, wherein the program includes instructions that, when executed by the processor, cause the processor to perform the method of any one of claims 1 to 4.

8. A non-transitory machine-readable medium storing computer instructions, wherein, The computer instructions are used to cause the computer to perform the method described in any one of claims 1 to 4.

Images