File uploading method, file downloading method, device and electronic equipment

Abstract

The present disclosure relates to a file uploading method, a file downloading method, a device and an electronic device. The file uploading method comprises: receiving, by a protocol converter in any edge node, a file uploading request and a to-be-uploaded file sent by a client; performing, by the protocol converter, slicing processing on the to-be-uploaded file in response to the file uploading request to obtain a plurality of slice files; performing, by the protocol converter, encapsulation processing on each slice file respectively to obtain a first slice interest package corresponding to each slice file respectively, and sending each first slice interest package to a content-centric network router in any edge node; and uploading, by the content-centric network router in any edge node, each first slice interest package to a center node. The center node is configured to receive each first slice interest package and store each first slice interest package. The method can save resource consumption caused by transmission control for the center node.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of Internet, and particularly relates to a file uploading method, a file downloading method, an apparatus and an electronic device. BACKGROUND

[0002] In recent years, the emergence of popular network applications such as network voice call, real-time text and picture communication, and short video has put forward higher requirements on the quality of network transmission. The commonly used network service mode at present is a content delivery network (CDN). The basic idea of the content delivery network is to deploy a network resource cache server at the network edge close to the user, and connect the network edge server and a data center (IDC) service cluster through a network private line to construct a distributed service access acceleration network. In the CDN network, users far from the data center can directly access the resource cache server located at the network edge.

[0003] However, in the application scenario of the CDN network, after receiving a file uploading or file downloading request of a user, the network edge server needs to upload or download the file to or from the IDC through an HTTP protocol (Hyper Text Transfer Protocol) or a custom TCP (Transmission Control Protocol) based transmission protocol. In the process of uploading and downloading, the IDC needs to maintain a group of TCP connection states and transmission control parameters for the transmission of the file. The larger the file to be transmitted, the longer the maintenance time, which undoubtedly increases the resource overhead of the IDC server. SUMMARY

[0004] The present disclosure provides a file uploading method, a file downloading method, an apparatus and an electronic device to at least solve the problem that the IDC needs to maintain a group of TCP connection states and transmission control parameters for the transmission of the file, resulting in an increase in resource overhead of the IDC server. The technical solutions of the present disclosure are as follows:

[0005] According to a first aspect of the embodiments of the present disclosure, a file uploading method is provided, comprising:

[0006] receiving, by a protocol converter in any edge node, a file uploading request and a to-be-uploaded file sent by a client;

[0007] performing, by the protocol converter, slicing processing on the to-be-uploaded file in response to the file uploading request, to obtain a plurality of slice files;

[0008] The protocol converter encapsulates each of the slice files respectively to obtain a first slice interest package corresponding to each of the slice files, and sends each of the first slice interest packages to a content-centric network router in any of the edge nodes;

[0009] The content-centric network router in any of the edge nodes uploads each of the first slice interest packages to the center node; the center node is configured to receive each of the first slice interest packages and store each of the first slice interest packages.

[0010] In an example embodiment, the file to be uploaded is processed by slicing to obtain a plurality of slice files, including:

[0011] The file size of the file to be uploaded is obtained.

[0012] The number of slices and the file size of each slice of the file to be uploaded are determined based on the file size of the file to be uploaded according to a positive correlation between the file size and the number of slices.

[0013] The file to be uploaded is processed by slicing based on the number of slices and the file size of each slice to obtain a plurality of slice files.

[0014] In an example embodiment, the center node is deployed with a content-centric network router and a service broker, and the file upload request carries user permission information and file characteristic information of the file to be uploaded.

[0015] Before the file to be uploaded is processed by slicing to obtain a plurality of slice files, further including:

[0016] The user permission information and the file characteristic information of the file to be uploaded are extracted from the file upload request by the protocol converter, and the user permission information and the file characteristic information are encapsulated to obtain an authentication interest package, and the authentication interest package is sent to the content-centric network router in any of the edge nodes.

[0017] The content-centric network router in any of the edge nodes sends the authentication interest package to the content-centric network router of the center node; the content-centric network router of the center node is configured to forward the authentication interest package to the service broker, so that the service broker performs authentication processing on the authentication interest package to obtain an authentication result package, and the content-centric network router of the center node and the content-centric network router in any of the edge nodes are used to return the authentication result package to the protocol converter in any of the edge nodes.

[0018] The file to be uploaded is processed by slicing to obtain a plurality of slice files, including:

[0019] When the protocol converter of any one edge node receives the authentication result package returned by the center node, the to-be-uploaded file is fragmented to obtain a plurality of fragmented files.

[0020] In an exemplary embodiment, the authentication result package carries a non-caching identifier, which is used to prompt the content-centric network router on the way of the authentication result package to forward the authentication result package without caching the authentication result package.

[0021] In an exemplary embodiment, the method further comprises:

[0022] When a network link from any one edge node to the center node is faulty, a target edge node is determined from other edge nodes; the target edge node is an edge node that is in a communication distance meeting a preset condition with any one edge node;

[0023] The content-centric network router in any one edge node sends each first fragmented interest package to the target edge node, so that the target edge node sends each first fragmented interest package to the center node.

[0024] According to a second aspect of the embodiments of the present disclosure, a file downloading method is provided, comprising:

[0025] The protocol converter in any one edge node acquires fragmented information of a to-be-downloaded file in response to a file downloading request for the to-be-downloaded file sent by a client; the fragmented information comprises a number of fragments in which the to-be-downloaded file is fragmented;

[0026] The protocol converter generates a plurality of second fragmented interest packages corresponding to the number of fragments, and sends the plurality of second fragmented interest packages to the content-centric network router in any one edge node, so that the content-centric network router forwards the plurality of second fragmented interest packages to a target node; the target node represents an edge node or the center node that stores a fragmented file of the to-be-downloaded file, and the second fragmented interest package carries a file identifier of the fragmented file;

[0027] The content-centric network router receives a plurality of fragmented files of the to-be-downloaded file returned by the target node, and forwards the plurality of fragmented files to the protocol converter; the protocol converter combines each fragmented file to obtain a complete file, and returns the complete file to the client.

[0028] In an exemplary embodiment, the center node and each edge node further cache fragmented files of historical transmission files, and before the content-centric network router forwards the plurality of second fragmented interest packages to the target node, the method further comprises:

[0029] The content-centric network router queries the fragmented file cached by any one edge node;

[0030] forwarding, by the content-centric network router, the plurality of second slice interest packets to the target node, comprising:

[0031] In the case that the slice file corresponding to any of the second slice interest packets is not queried from the slice file cached by any of the edge nodes, forwarding, by the content-centric network router, the plurality of second slice interest packets to the target node.

[0032] In an exemplary embodiment, each edge node is further configured with a forwarding information base for forwarding the second slice interest packets; the forwarding information base records node information for receiving the interest packets forwarded by each edge node;

[0033] forwarding, by the content-centric network router, the plurality of second slice interest packets to the target node, comprising:

[0034] For each second slice interest packet, obtaining file information corresponding to the second slice interest packet;

[0035] querying, by the content-centric network router and the file information, the forwarding information base of any of the edge nodes to obtain node information for receiving the second slice interest packets forwarded by any of the edge nodes;

[0036] forwarding, by the content-centric network router, the second slice interest packets to the central node or other edge node corresponding to the node information.

[0037] In an exemplary embodiment, the file download request carries user authority information and file characteristic information of the file to be downloaded;

[0038] Before obtaining the slice information of the file to be downloaded, further comprising:

[0039] extracting, by the protocol converter, the user authority information and the file characteristic information of the file to be downloaded from the file download request, encapsulating the user authority information and the file characteristic information to obtain an authentication interest packet, and forwarding, by the content-centric network router in any of the edge nodes, the authentication interest packet to the central node;

[0040] adding, by the protocol converter, an authentication record about the file to be downloaded in a preset authentication waiting table.

[0041] In an exemplary embodiment, before returning the complete file to the client, further comprising:

[0042] detecting, by the protocol converter, the authentication record of the file to be downloaded;

[0043] in the case that the authentication result corresponding to the authentication record is authentication passed, returning the complete file to the client;

[0044] In the case that the authentication record shows an authentication result waiting state, the complete file is cached in the content-centric network router of any edge node, and a prompt information is set in the authentication record that the to-be-downloaded file has completed downloading.

[0045] In an exemplary embodiment, the authentication interest package carries a non-query cache identifier, which is used to prompt the content-centric network router through which the authentication interest package passes to forward the authentication interest package without performing a cache query on the authentication interest package.

[0046] In an exemplary embodiment, the method further comprises:

[0047] When the protocol converter receives a plurality of file download requests respectively sent by the clients, the file characteristic information of the to-be-downloaded file in each file download request is extracted;

[0048] In the case that the file characteristic information carried in each file download request is the same, the file download requests respectively sent by the plurality of clients are aggregated by the content-centric network router to obtain an aggregated file download request;

[0049] In response to the aggregated file download request, the shard information of the to-be-downloaded file is obtained.

[0050] According to a third aspect of the embodiments of the present disclosure, a file uploading device is provided, comprising:

[0051] A receiving unit is configured to receive a file uploading request and a to-be-uploaded file sent by a client through a protocol converter in any edge node;

[0052] A sharding unit is configured to perform sharding processing on the to-be-uploaded file through the protocol converter in response to the file uploading request to obtain a plurality of shard files;

[0053] An encapsulating unit is configured to perform encapsulating processing on each shard file through the protocol converter to obtain a first shard interest package corresponding to each shard file respectively, and send each first shard interest package to a content-centric network router in any edge node;

[0054] An uploading unit is configured to upload each first shard interest package to a center node through the content-centric network router in any edge node; the center node is configured to receive each first shard interest package and store each first shard interest package.

[0055] In an example embodiment, the fragmentation unit is further configured to perform obtaining a file size of the file to be uploaded; determining, according to a positive correlation between the file size and the number of fragments, the number of fragments of the file to be uploaded and the file size of each fragment based on the file size of the file to be uploaded; and performing fragmentation processing on the file to be uploaded based on the number of fragments and the file size of each fragment to obtain a plurality of fragment files.

[0056] In an example embodiment, the central node is deployed with a content-centric network router and a service broker, the file upload request carries user permission information and file characteristic information of the file to be uploaded; the apparatus further comprises an authentication unit configured to perform extracting the user permission information and the file characteristic information of the file to be uploaded from the file upload request through a protocol converter, encapsulating the user permission information and the file characteristic information to obtain an authentication interest packet, and sending the authentication interest packet to the content-centric network router in any edge node; sending the authentication interest packet to the content-centric network router of the central node through the content-centric network router in any edge node; the content-centric network router of the central node is configured to forward the authentication interest packet to the service broker, so that the service broker performs authentication processing on the authentication interest packet to obtain an authentication result packet, and returns the authentication result packet to the protocol converter in any edge node through the content-centric network router of the central node and the content-centric network router in any edge node; when the protocol converter in any edge node receives the authentication result packet returned by the central node, the authentication result packet indicates that the authentication is passed, and the protocol converter performs fragmentation processing on the file to be uploaded to obtain a plurality of fragment files.

[0057] In an example embodiment, the authentication result packet carries a non-caching identifier, the non-caching identifier is used to prompt the content-centric network router through which the authentication result packet passes to forward the authentication result packet without caching the authentication result packet.

[0058] In an example embodiment, the apparatus further comprises a fault processing unit configured to perform, when a network link from any edge node to the central node is faulty, determining a target edge node from other edge nodes; the target edge node is an edge node that has a communication distance meeting a preset condition with any edge node; sending each first fragment interest packet to the target edge node through the content-centric network router in any edge node, so that the target edge node sends each first fragment interest packet to the central node.

[0059] According to a fourth aspect of the embodiments of the present disclosure, a file download apparatus is provided, comprising:

[0060] An obtaining unit is configured to perform, through a protocol converter in any edge node, obtaining fragment information of a file to be downloaded in response to a file download request for the file to be downloaded sent by a client; the fragment information comprises a number of fragments in which the file to be downloaded is fragmented.

[0061] The sending unit is configured to generate a plurality of second slice interest packets corresponding to the number of slices through the protocol converter, and send the plurality of second slice interest packets to the content-centric network router in any of the edge nodes, and forward the plurality of second slice interest packets to the target node through the content-centric network router; the target node represents an edge node or a center node that stores a slice file of a to-be-downloaded file, and the second slice interest packet carries a file identifier of the slice file;

[0062] The returning unit is configured to receive a plurality of slice files of the to-be-downloaded file returned by the target node through the content-centric network router, and forward the plurality of slice files to the protocol converter, combine each slice file through the protocol converter to obtain a complete file, and return the complete file to the client.

[0063] In an example embodiment, the sending unit is further configured to query the slice files cached by any of the edge nodes through the content-centric network router; and in a case where no slice file corresponding to any of the second slice interest packets is queried from the slice files cached by any of the edge nodes, forward the plurality of second slice interest packets to the target node through the content-centric network router.

[0064] In an example embodiment, each edge node is further configured with a forwarding information base for forwarding the second slice interest packets; the forwarding information base records node information for receiving the interest packets forwarded by each edge node; and the sending unit is further configured to, for each second slice interest packet, obtain file information corresponding to the second slice interest packet, query the forwarding information base of any of the edge nodes through the content-centric network router and the file information to obtain node information for receiving the second slice interest packets forwarded by any of the edge nodes, and forward the second slice interest packet to the center node or other edge node corresponding to the node information through the content-centric network router.

[0065] In an example embodiment, the file download request carries user authority information and file characteristic information of a to-be-downloaded file; and the device further includes an authentication unit configured to extract the user authority information and the file characteristic information of the to-be-downloaded file from the file download request through the protocol converter, encapsulate the user authority information and the file characteristic information to obtain an authentication interest packet, and forward the authentication interest packet to the center node through the content-centric network router in any of the edge nodes; and the protocol converter adds an authentication record about the to-be-downloaded file in a preset authentication waiting table.

[0066] In an example embodiment, the returning unit is further configured to detect, by the protocol converter, an authentication record of the file to be downloaded; in a case where an authentication result corresponding to the authentication record is an authentication pass, return the complete file to the client; in a case where the authentication record shows an authentication result in a waiting state, cache the complete file in a content-centric network router of any edge node, and set a prompt information in the authentication record that the file to be downloaded has been completed downloading.

[0067] In an example embodiment, the authentication interest packet carries a non-query cache identifier, the non-query cache identifier being used to prompt a content-centric network router through which the authentication interest packet passes to forward the authentication interest packet without performing a cache query on the authentication interest packet.

[0068] In an example embodiment, the apparatus further includes an aggregating unit configured to: when the protocol converter receives a plurality of file download requests respectively sent by a plurality of clients, extract file feature information of the file to be downloaded in each file download request; in a case where the file feature information carried in each file download request is the same, perform an aggregating processing on the file download requests respectively sent by the plurality of clients by the content-centric network router to obtain an aggregated file download request; and in response to the aggregated file download request, obtain the shard information of the file to be downloaded.

[0069] According to a fifth aspect of embodiments of the present disclosure, an electronic device is provided, including:

[0070] a processor;

[0071] a memory for storing processor-executable instructions;

[0072] The processor is configured to execute the instructions to implement the method of any of the above.

[0073] According to a sixth aspect of embodiments of the present disclosure, a computer-readable storage medium is provided, when instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to perform the method of any of the above.

[0074] According to a seventh aspect of embodiments of the present disclosure, a computer program product is provided, the computer program product includes instructions, when the instructions are executed by a processor of an electronic device, the electronic device is enabled to perform the method of any of the above.

[0075] The technical solutions provided by the embodiments of the present disclosure at least bring the following beneficial effects:

[0076] By deploying the software virtualized CCN router in the edge node, the single-side transmission control is facilitated, and after receiving the to-be-uploaded file and the file uploading request in the edge node, the edge node processes the to-be-uploaded file in slices, and encapsulates each slice file as a first slice interest packet, so that when the file is uploaded, each first slice interest packet can be uploaded to the center node through the transmission protocol dominated by the edge node in a single side, the file is transmitted in a weak connection or no connection manner, so that the center node does not need to maintain any state of the transmission control, and only needs to be responsible for collecting and storing the first slice interest packet, and the transmission rate is completely adjusted by the edge node in a single side according to the network state, so that the center node can save the resource overhead caused by the transmission control, and the HTTP stick problem can be solved.

[0077] It should be understood that the foregoing general description and the following detailed description are only exemplary and explanatory, and cannot limit the present disclosure. BRIEF DESCRIPTION OF DRAWINGS

[0078] The drawings incorporated into the specification and forming a part thereof illustrate embodiments consistent with the present disclosure and together with the description serve to explain the principles of the present disclosure, and do not limit the present disclosure.

[0079] Figure 1 is a structural schematic diagram of an improved content distribution system according to an exemplary embodiment.

[0080] Figure 2 is a flow schematic diagram of a file uploading method according to an exemplary embodiment.

[0081] Figure 3 is a principle diagram of a file uploading process according to an exemplary embodiment.

[0082] Figure 4 is a flow schematic diagram of a file downloading method according to an exemplary embodiment.

[0083] Figure 5 is a schematic diagram of downloading a slice file from different CCN routers according to an exemplary embodiment.

[0084] Figure 6 is a schematic diagram of a routing topology according to an exemplary embodiment.

[0085] Figure 7 is a structural diagram of an authentication waiting table according to an exemplary embodiment.

[0086] Figure 8 is an abstract data structure schematic diagram of a FIB table according to an exemplary embodiment.

[0087] Figure 9 is a data structure diagram of a PIT entry according to an example embodiment.

[0088] Figure 10 is a structural block diagram of a file uploading device according to an example embodiment.

[0089] Figure 11 is a structural block diagram of a file downloading device according to an example embodiment.

[0090] Figure 12 is a block diagram of an electronic device according to an example embodiment. DETAILED DESCRIPTION

[0091] In order for those skilled in the art to better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be described clearly and completely below with reference to the drawings.

[0092] It should be noted that the implementations described in the following example embodiments do not represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0093] It should be noted that the terms "first", "second", and the like in the specification and claims of the present disclosure and the above-described drawings are used to distinguish similar objects, and do not necessarily have to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged under appropriate circumstances, so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. It should also be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for display, analyzed data, etc.) involved in the present disclosure are all information and data authorized by the user or authorized by all parties.

[0094] Reference Figure 1 The structural schematic diagram of the improved Content Delivery Networks (CDN) provided by the embodiments of the present disclosure, which can support the operation of the principle of Content Center Network (CCN) in the existing CDN system and obtain the operation results without upgrading the original network equipment. The specific improvement method includes software implementation of the principle of the content center network router in the CDN edge node and the center node, and solves several key problems in the existing system by designing a unilateral dominant transmission method, a routing node information synchronization protocol, and a parallel authentication method to improve the performance of the current system.

[0095] AsFigure 1 As shown, the improved content distribution system includes an IDC 102 and a plurality of edge nodes 104, the IDC 102 and each edge node 104 are provided with a software virtualized content-centric network router (virtual CCN router). The IDC 102 is further provided with a backend service agent function, and a service agent is deployed in the IDC 102, and a protocol converter is deployed in each edge node 104, the content-centric network router and the protocol converter in each edge node 104 communicate through a network, the service agent and the content-centric network router in the IDC 102 communicate through a network, and the IDC 102 and each edge node 104 communicate through a network leased line. Among them,

[0096] The content-centric network router is used for intelligent forwarding of client requests, aggregation of client requests, caching of packets, and forwarding of packets, and the functions of the CCN router are realized in a software manner.

[0097] The service agent is used for receiving CCN network packets, calling storage and caching services provided by a background, saving files uploaded by a client to a backend storage system, and performing client behavior authentication.

[0098] The protocol converter is used for receiving client requests and data, performing data slicing and uploading and downloading of data slices after client behavior authentication, and implementing unilateral transmission control.

[0099] Reference Figure 2 As shown in FIG. 2, a flowchart of a file uploading method according to an example embodiment is shown, and the method includes the following steps: Figure 2 As shown, the method is applied to any one of the edge nodes 104 in the system. Figure 1 The method includes the following steps:

[0100] In step S210, a protocol converter in any one of the edge nodes receives a file uploading request and a to-be-uploaded file sent by a client.

[0101] The file uploading request carries user permission information and file characteristic information of the to-be-uploaded file.

[0102] The user permission information can be a cookie (data stored on a local terminal of a user) of the user.

[0103] The file characteristic information can include file size and file identification of the to-be-uploaded file, and the file identification can be a file ID.

[0104] In a specific implementation, a user sends a file upload request and a to-be-uploaded file to an edge node through an HTTP protocol at a client, receives the file upload request and the to-be-uploaded file sent by the client through a protocol converter deployed in the edge node, and performs subsequent processing.

[0105] At step S220, the protocol converter responds to the file upload request and performs sharding processing on the to-be-uploaded file to obtain a plurality of shard files.

[0106] In a specific implementation, after receiving the complete to-be-uploaded file, the protocol converter in the edge node responds to the file upload request, obtains the file size of the to-be-uploaded file, and performs sharding processing on the to-be-uploaded file based on the file size of the to-be-uploaded file to obtain a plurality of shard files.

[0107] More specifically, the sharding process of the to-be-uploaded file can include: determining the number of shards and the file size of each shard of the to-be-uploaded file based on the file size of the to-be-uploaded file according to a positive correlation between the file size and the number of shards, and further performing sharding processing on the to-be-uploaded file based on the number of shards and the file size of each shard to obtain a plurality of shard files.

[0108] At step S230, the protocol converter performs encapsulation processing on each shard file respectively to obtain a first shard interest packet corresponding to each shard file.

[0109] The first shard interest packet is used to carry the shard file.

[0110] In a specific implementation, the first shard interest packet corresponding to each shard file can have different identifiers to distinguish the first shard interest packets. For example, assuming that the file ID of the to-be-uploaded file is 13089.mp4, the size is 18000 bytes, the to-be-uploaded file is sharded into 3 shards by the protocol converter, and the 3 shards are encapsulated to obtain 3 first shard interest packets, the names of the first shard interest packets are “ / 13089.mp4-0”, “ / 13089.mp4-1”, and “ / 13089.mp4-2” respectively.

[0111] At step S240, the content-centric network router in any one of the edge nodes uploads each first shard interest packet to the center node; and the center node is configured to receive each first shard interest packet and store each first shard interest packet.

[0112] In a specific implementation, after the encapsulation of each fragment file is completed, each first fragment interest packet carrying the fragment file can be uploaded to the content-centric network router of the center node through the single-side leading transmission protocol via the content-centric network router in any of the edge nodes, the content-centric network router of the center node forwards each first fragment interest packet to the service agent, the service agent judges the type of the interest packet through the content carried by the first fragment interest packet, specifically, if it is determined that the first fragment interest packet is a data packet carrying a fragment file, the service agent can write each first fragment interest packet into the backend storage system through a remote call interface, and returns a response packet to the edge node sending the first fragment interest packet, thereby realizing the uploading of the file to be uploaded.

[0113] Further, in an exemplary embodiment, before uploading each first fragment interest packet to the center node, an information fragment containing file description information also needs to be generated, the information fragment is encapsulated to obtain an interest packet corresponding to the information fragment, and the interest packet corresponding to the information fragment is uploaded to the center node at the same time when each first fragment interest packet is uploaded to the center node.

[0114] In this step, the single-side leading transmission protocol means that the center node (IDC) is only responsible for receiving and saving data, and does not need to guarantee the order of receiving data and the integrity of receiving data, and the integrity of receiving data of the center node is guaranteed by the protocol converter of the edge node.

[0115] Reference Figure 3 For an exemplary embodiment, the schematic diagram of the file uploading process is shown in FIG. 1. Figure 3 As shown in FIG. 1, in the file uploading process, the backend server agent program is only responsible for packet receiving, storage and response packet returning (the response is returned through a data packet carrying a non-cache identifier), and does not need to be responsible for any transmission control state maintenance work. The transmission rate is completely adjusted by the protocol converter according to the network and the state of the opposite end, so that the backend server resource saves the resource overhead caused by the transmission control. At the same time, since the transmission process uses the UDP protocol, there is no connection like TCP, so there is no need to solve the problem of packet splitting between requests.

[0116] The file uploading method provided by the embodiment facilitates single-side transmission control by deploying a software virtualized CCN router at an edge node, and after the edge node receives a to-be-uploaded file and a file uploading request, the to-be-uploaded file is fragmented, and each fragmented file obtained is encapsulated into a first fragmented interest packet, so that when the file is uploaded, each first fragmented interest packet can be uploaded to a center node by a transmission protocol dominated by the edge node, the file is transmitted in a weak connection or no connection manner, the center node does not need to maintain any state of transmission control, and only needs to be responsible for collecting and storing the first fragmented interest packet, and the transmission rate is completely adjusted by the edge node according to the network state, so that the center node can save resource overhead caused by transmission control, and the HTTP sticking problem can be solved.

[0117] In an example embodiment, in step S220, the to-be-uploaded file is fragmented to obtain a plurality of fragmented files, including:

[0118] In step S2201, the file size of the to-be-uploaded file is obtained.

[0119] In step S2202, based on the file size of the to-be-uploaded file, the number of fragments of the to-be-uploaded file and the file size of each fragment are determined according to a positive correlation relationship between the file size and the number of fragments.

[0120] In step S2203, based on the number of fragments and the file size of each fragment, the to-be-uploaded file is fragmented to obtain a plurality of fragmented files.

[0121] In a specific implementation, the positive correlation between the file size and the number of fragments means that the larger the to-be-uploaded file, the more the number of fragments, and the smaller the to-be-uploaded file, the less the number of fragments. Through this relationship, the number of fragments of the to-be-uploaded file and the file size of each fragment can be determined, and then the to-be-uploaded file is fragmented according to the number of fragments and the file size of each fragment to obtain a plurality of fragmented files, and each fragmented file can be stored.

[0122] In an implementation, the to-be-uploaded file can be fragmented according to a preset fragment size, for example, the to-be-uploaded file can be divided into fragments of a fixed size (such as 8000 bytes per fragment).

[0123] In the embodiment, the to-be-uploaded file is fragmented based on the file size of the to-be-uploaded file, which can ensure that the file sizes of the fragmented files are uniform, and avoid that the file size of a single fragmented file is too large or too small.

[0124] In an example embodiment, before the to-be-uploaded file is fragmented in step S220 to obtain a plurality of fragmented files, the method further includes:

[0125] Step S211, extracting the user authority information and the file characteristic information of the to-be-uploaded file from the file uploading request through the protocol converter, encapsulating the user authority information and the file characteristic information to obtain an authentication interest package, and sending the authentication interest package to the content-centric network router in the any one edge node;

[0126] Step S212, sending the authentication interest package to the content-centric network router in the center node through the content-centric network router in the any one edge node; the content-centric network router in the center node is configured to forward the authentication interest package to the service agent, so that the service agent performs authentication processing on the authentication interest package to obtain an authentication result package, and returns the authentication result package to the edge node sending the authentication interest package through the content-centric network router in the center node and the content-centric network router in the any one edge node.

[0127] Step S213, when the protocol converter in the any one edge node receives the authentication result package of the authentication pass returned by the center node, performing fragmentation processing on the to-be-uploaded file to obtain a plurality of fragment files.

[0128] In the authentication information includes the user authority information and the file characteristic information of the to-be-uploaded file.

[0129] In the specific implementation, the authentication and the forwarding of the uploading request in the file uploading process are serial, that is, only the client passing the authentication can upload the file to the center node (IDC). Therefore, the protocol converter in the edge node needs to perform authentication after receiving the file uploading request and the complete to-be-uploaded file sent by the client.

[0130] More specifically, the authentication process includes: the protocol converter in the edge node extracts the user authority information and the file characteristic information of the to-be-uploaded file in the file uploading request as authentication information, encapsulates the authentication information in a JSON (JavaScript Object Notation, JS object profile, which is a lightweight data exchange format) format or the like to obtain an authentication interest package. The authentication interest package is forwarded to the service agent in the center node through the routing of the content-centric network router in the edge node and the content-centric network router in the center node. The authentication service process in the service agent receives the authentication interest package, extracts the authentication information in the authentication interest package, performs authentication processing to obtain an authentication result, and returns the authentication result package to the edge node through the routing of the content-centric network router in the center node and the content-centric network router in the edge node. When the authentication result in the authentication result package received by the protocol converter in the edge node is authentication pass, the protocol converter performs fragmentation processing on the to-be-uploaded file to obtain a plurality of fragment files.

[0131] Wherein, the data structure of the authentication result can be defined according to different scenes and requirements, the authentication result is encapsulated in the payload field of the data packet as an authentication result packet, and the name of the authentication result packet is the same as the name of the corresponding authentication interest packet.

[0132] Wherein, for the name of the authentication interest packet, since the authentication interest packet does not need to be aggregated, the name of the authentication interest packet sent by each node should be different. The method of the present disclosure is to concatenate a fixed prefix with the edge node ID (the IDs of the edge servers are different from each other) and then concatenate a self-incrementing sequence number, which can ensure that the name of each sent authentication interest packet is different. If it is assumed that the prefix of the interest packet listened to by the IDC authentication service process is " / ks / upload / auth", then the name of a certain authentication interest packet sent by an edge node with an ID of "4678" can be " / ks / upload / auth / 4678 / 1".

[0133] In the embodiment, by performing authentication processing on the user permission information and the file characteristic information of the file to be uploaded, the uploading of harmful files by abnormal users can be avoided.

[0134] Further, in an example embodiment, the authentication result packet carries a non-caching identifier, and the non-caching identifier is used to prompt the content-centric network routers on the way of the authentication result packet to forward the authentication result packet without caching the authentication result packet.

[0135] Specifically, since the authentication result packet is one-time consumption data and does not need to be cached, a non-caching identifier can be attached to the authentication result packet. When the service agent of the center node sends the authentication result packet, the content-centric network routers of the center node will forward the authentication result packet to the access point that sent the authentication interest packet corresponding to the authentication result packet according to the related records of the PIT table (Pending Interest Table). Since the authentication result packet carries a non-caching identifier, the content-centric network routers on the way of the authentication result packet will only forward the authentication result packet and will not cache the authentication result packet.

[0136] In the embodiment, by causing the authentication result packet to carry a non-caching identifier, the content-centric network routers can be prevented from caching some data packets that obviously do not need to be cached, so that the forwarding rate of the authentication result packet can be improved.

[0137] In an example embodiment, it also includes: determining a target edge node from other edge nodes when a network link from any edge node to the center node is faulty; and the target edge node is an edge node that meets a preset condition in terms of communication distance with any edge node.

[0138] edge node; sending, by a content-centric network router in the any one edge node, each first fragment interest packet to the target edge node, so that the target edge node sends each first fragment interest packet to the central node.

[0139] wherein the other edge node is an edge node in the content distribution system other than the any one edge node.

[0140] wherein the preset condition can be that the other edge node is closest to the any one edge node in communication distance.

[0141] 0Specifically, in the communication between the edge node and the central node, the communication link can fail at any time, resulting in the inability of the central node to receive the file.

[0142] upload, in order to improve the timeliness of file upload, when the network link from the any one edge node to the central node fails, the edge node closest to the any one edge node in communication distance can be determined from the other edge nodes as a target edge node, and each interest packet is sent to the target edge node, so that the target edge node replaces the central node to send each interest packet.

[0143] The embodiment can quickly determine link failure and re-plan optimal routing through a general router information synchronization algorithm, and flexibly cope with link failure, overcoming the defects of traditional methods that lack intelligent routing between edge nodes and cannot flexibly cope with link failure.

[0144] Reference Figure 4 For another example embodiment, a flowchart of a file download method is shown as follows. Figure 2 As shown in the figure, the method is applied to any one edge node 104 in the content distribution system 100 as an example for description, and includes the following steps. Figure 1

[0145] Step S410: obtaining, by a protocol converter in the any one edge node, fragment information of a to-be-downloaded file in response to a file download request for the to-be-downloaded file sent by a client; the fragment information includes a number of fragments of the to-be-downloaded file.

[0146] wherein the file download request can carry user permission information and file characteristic information of the to-be-downloaded file.

[0147] wherein the user permission information can be a cookie (data stored on a local terminal of a user) of the user.

[0148] wherein the file characteristic information can include a file identifier of the to-be-downloaded file, and the file identifier can be a file ID.

[0149] wherein the fragment information includes a number of fragments of the to-be-downloaded file and a size of each fragment file. ​

[0150] 5In a specific implementation, a user sends a file download request to an edge node through an HTTP protocol at a client side, and the edge node

[0151] The deployed protocol converter acquires the information of the file fragments to be downloaded in response to the file download request sent by the client.

[0152] For example, the file to be downloaded received by the protocol converter is “ / IDC / 001.mp4”, and the information of the file fragments can be acquired by sending an interest packet with the name of “ / IDC / 001.mp4-info”, which contains the file size, the number of fragments into which the file is divided, and the size of each fragment file.

[0153] For example, the file to be downloaded received by the protocol converter is “ / IDC / 001.mp4”, and the information of the file fragments can be acquired by sending an interest packet with the name of “ / IDC / 001.mp4-info”, which contains the file size, the number of fragments into which the file is divided, and the size of each fragment file.

[0154] 0At step S420, the protocol converter generates a plurality of second fragment interest packets corresponding to the number of fragments, and sends the plurality of second fragment interest packets to a content-centric network router in any edge node, which forwards the plurality of second fragment interest packets to a target node through the content-centric network router; the target node is a center node or an edge node that stores the fragment files of the file to be downloaded, and the second fragment interest packets carry the file identifiers of the fragment files.

[0155] 0At step S420, the protocol converter generates a plurality of second fragment interest packets corresponding to the number of fragments, and sends the plurality of second fragment interest packets to a content-centric network router in any edge node, which forwards the plurality of second fragment interest packets to a target node through the content-centric network router; the target node is a center node or an edge node that stores the fragment files of the file to be downloaded, and the second fragment interest packets carry the file identifiers of the fragment files.

[0156] 0At step S420, the protocol converter generates a plurality of second fragment interest packets corresponding to the number of fragments, and sends the plurality of second fragment interest packets to a content-centric network router in any edge node, which forwards the plurality of second fragment interest packets to a target node through the content-centric network router; the target node is a center node or an edge node that stores the fragment files of the file to be downloaded, and the second fragment interest packets carry the file identifiers of the fragment files.

[0157] In a specific implementation, the name of the second fragment interest packet can be the file identifier of each fragment file, which can be the file name + fragment sequence number. For example, assuming that the file to be downloaded is “ / IDC / 001.mp4” and the number of fragments is 3, three second fragment interest packets are generated, and the names of the second fragment interest packets can be “ / IDC / 001.mp4-0”, “ / IDC / 001.mp4-1” and “ / IDC / 001.mp4-2”.

[0158] Further, after obtaining the second chunk interest packets, the sending of the second chunk interest packets can be based on bandwidth. Specifically, the protocol converter can adjust the number of second chunk interest packets sent at the same time according to the network state through a unilateral transmission control mechanism. For example, if the initial bandwidth state can accommodate two second chunk interest packets, two second chunk interest packets with names of " / IDC / 001.mp4-0" and " / IDC / 001.mp4-1" can be sent at the same time, and then two second chunk interest packets can be sent at the same time at the next time. The second chunk interest packets sent by the protocol converter will be routed to the content-centric network routers or servers storing the chunk files according to the FIB table by the content-centric network routers, and the content-centric network routers or servers storing the chunk files will return the corresponding chunk files to the edge node according to the received second chunk interest packets.

[0159] At step S430, the content-centric network routers receive the multiple chunk files of the to-be-downloaded file returned by the target node and forward the multiple chunk files to the protocol converter. The protocol converter combines each chunk file to obtain a complete file and returns the complete file to the client.

[0160] In a specific implementation, after the content-centric network routers in the edge node receiving the file download request receive the multiple chunk files of the to-be-downloaded file returned by the target node, the multiple chunk files can be forwarded to the protocol converter. After the protocol converter combines each chunk file to obtain a complete file, the complete file is returned to the client.

[0161] Reference Figure 5 FIG. 1 shows a schematic diagram of downloading chunk files from different CCN routers according to an exemplary embodiment. Each chunk file of a to-be-downloaded file can be stored in any node, such as a content-centric network router of a Guangdong access point, a content-centric network router of a Liaoning access point, a content-centric network router of a Beijing IDC, or a backend server of the Beijing IDC. Figure 5 As shown in FIG. 1, for the multiple second chunk interest packets sent by the Guangdong access point, chunk file 1 can be obtained from the Liaoning access point, chunk file 2 can be obtained from itself, chunk file 3 can be obtained from the content-centric network router of the Beijing IDC, and chunk file 4 can be obtained from the backend server of the Beijing IDC.

[0162] The file downloading method provided by the embodiment facilitates to realize unilateral transmission control by deploying a software virtualized CCN router at the edge node, and after receiving a file downloading request at the edge node, a plurality of second fragment interest packets corresponding to the number of fragments of the file to be downloaded are generated, each second fragment interest packet is sent to the center node or other edge node during downloading of the file, fragment downloading of the file to be downloaded is realized, and the file is transmitted in a weak connection or no connection manner, so that the center node does not need to maintain any state of transmission control, and the transmission rate is completely adjusted by the edge node according to the network state, so that the center node can save resource overhead caused by transmission control.

[0163] In an example embodiment, the center node and each edge node also cache fragment files of historical transmission files, and before forwarding the plurality of second fragment interest packets to the target node through the content center network router, the method further comprises: querying the fragment files cached by any edge node through the content center network router;

[0164] Forwarding the plurality of second fragment interest packets to the target node through the content center network router comprises:

[0165] In the case that no fragment file corresponding to any second fragment interest packet is queried from the fragment files cached by any edge node, the plurality of second fragment interest packets are forwarded to the target node through the content center network router.

[0166] In an example embodiment, each edge node is further configured with a forwarding information base for forwarding the second fragment interest packets; and the forwarding information base records node information for receiving the interest packets forwarded by each edge node;

[0167] Forwarding the plurality of second fragment interest packets to the target node through the content center network router comprises: for each second fragment interest packet, obtaining file information corresponding to the second fragment interest packet; querying the forwarding information base of any edge node through the content center network router by using the file information, to obtain node information for receiving the second fragment interest packets forwarded by any edge node; and forwarding the second fragment interest packet to the center node or other edge node corresponding to the node information through the content center network router.

[0168] In a specific implementation, in order to realize intelligent searching of content fragments among content center network routers, the disclosure further introduces a Bloom filter for recording fragment files cached by the content center network router. The Bloom filter is a data structure for judging whether a value exists in a set, and the basic implementation logic is to use a plurality of hash functions to map an element to different bitmaps or different positions of the same bitmap. The Bloom filter can use a plurality of hash algorithms to quickly judge whether an element is in a set.

[0169] More specifically, a Bloom filter can be introduced in each content-centric network router, and the data names cached in the content-centric network router can be taken as input elements of the Bloom filter, so that the Bloom filter can record the cached file fragments in a bitmap. When a content-centric network router caches a file fragment, the name of the file fragment is added to the Bloom filter record, and when the cache is removed, the record in the Bloom filter needs to be cleared at the same time. When the content-centric network routers synchronize routing information, the bitmaps of the Bloom filters at the current time node need to be synchronized between the adjacent content-centric network routers.

[0170] Reference Figure 6 With reference to the schematic diagram of a routing topology structure shown in an example embodiment, after the Bloom filter is introduced, the process of forwarding an interest packet by a content-centric network router (CCN router) can include:

[0171] (1) checking a local cache repository, and directly returning if there is a cache.

[0172] (2) checking the Bloom filter bitmaps of all adjacent routers, and forwarding the interest packet to an adjacent router if the resource requested by the interest packet exists in the adjacent router and the overhead from the local router to the adjacent router is much lower than the overhead of requesting data from an IDC (a threshold value can be set by the system). If the adjacent router also does not cache the data requested by the interest packet, that is, the Bloom filter itself causes a judgment error, the interest packet will be forwarded to the IDC by the adjacent router. Therefore, the negative influence of the Bloom filter on the system operation is not great.

[0173] (3) if there is no record of the resource requested by the interest packet in the Bloom filter bitmaps of all adjacent routers, the interest packet is forwarded according to the general forwarding process of the content-centric network router, the FIB table is queried, the interest packet is forwarded, and the reverse path is recorded in the PIT table.

[0174] In the above example, after the content-centric network virtual router is introduced in the traditional CDN system, a dynamic routing protocol such as the OSPF protocol is introduced to realize intelligent routing of nodes, and the introduction of the dynamic routing protocol can greatly improve the stability, fault tolerance and content intelligent searching capability of the system. At the same time, by introducing the Bloom filter to record the internal cache data of the node and synchronizing the Bloom filter bitmap information during routing synchronization, each node can search the cache of itself and its adjacent nodes, so that data downloading is more efficient.

[0175] In an example embodiment, before obtaining the fragment information of the file to be downloaded, the following steps are further included:

[0176] Step S411, extracting the user permission information and the file characteristic information of the file to be downloaded from the file download request through the protocol converter, encapsulating the user permission information and the file characteristic information to obtain an authentication interest package, and forwarding the authentication interest package to the center node through a content center network router in any edge node;

[0177] Step S412, adding an authentication record about the file to be downloaded in the preset authentication waiting table through the protocol converter.

[0178] The authentication information includes the user permission information and the file characteristic information of the file to be downloaded.

[0179] In a specific implementation, in order to realize the parallelization of authentication and source downloading in the file download process and reduce the time consumption of the file download request, the present disclosure introduces an authentication waiting table in the protocol converter. The structure of the authentication waiting table is as shown in Figure 7 The file download process includes:

[0180] After the protocol converter of the edge node receives the file download request sent by the client, the user permission information and the file ID of the file to be downloaded are extracted from the file download request, the file ID is mapped into the hierarchical data name “ / IDC / 348df8349hfds8lreur.mp4” in the content center network according to a self-defined rule, the user permission information and the file ID are taken as authentication information, and the authentication information is encapsulated to obtain an authentication interest package. The name of the authentication interest package can be the name prefix of the authentication service process of the service agent in the center node, such as “ / IDC / AuthServer”. After the authentication interest package is sent out through the content center network router, the protocol converter adds an authentication record about the file to be downloaded in the authentication waiting table or adds a node in the existing entry chain table. After the authentication record is added in the authentication waiting table, the process of downloading the file from the center node can be started without waiting for the authentication result, so that the parallelization of authentication and source downloading can be realized, and the time consumption of the file download request can be reduced.

[0181] Further, in an example embodiment, before returning the complete file to the client, the method further includes: detecting the authentication record of the file to be downloaded through the protocol converter; if the authentication result corresponding to the authentication record is authentication passed, returning the complete file to the client; if the authentication record shows that the authentication result is in a waiting state, caching the complete file in the content center network router of the edge node, and setting prompt information that the file to be downloaded has been downloaded in the authentication record.

[0182] In the implementation, after the combination of each fragment file is completed to obtain a complete file, the protocol converter can check the authentication waiting table. If the authentication waiting table has recorded information of authentication passing, the corresponding table entry or linked list node is deleted, and the complete file is returned to the client through the HTTP protocol. If the authentication waiting table shows a waiting state of the authentication result, i.e., the authentication is still in progress, the complete file is cached to the local disk, and the file existence flag of the corresponding table entry of the authentication waiting table is set to 1. Further, if the authentication response is received during the waiting process, if the authentication result is failure, the corresponding entry in the authentication waiting table is deleted, and the authentication failure information is returned to the client. If the authentication result is success, the corresponding entry in the authentication waiting table is checked. If the file download result entry shows that the file download is success, the file is read and returned to the client. If the download result entry shows that the file download is failure, the file download failure information is returned. If it shows that the file is still in the process of downloading, the authentication result is written into the authentication result entry.

[0183] In the embodiment, by introducing the authentication waiting table, after the authentication record is added in the authentication waiting table, the process of downloading the file from the center node can be started without waiting for the authentication result. After the downloading of each fragment file of the to-be-downloaded file is completed, whether the downloaded file is returned to the client is determined based on the authentication result corresponding to the authentication record. The method realizes the parallelization of the authentication and the origin server downloading, and reduces the time consumption of the file download request.

[0184] In an example embodiment, the authentication interest package carries a non-query cache identifier, which is used to prompt the content-centric network router through which the authentication interest package passes to forward the authentication interest package without performing cache query on the authentication interest package.

[0185] Specifically, since the authentication request does not need to and should not hit the intermediate content-centric network router cache, the authentication interest package for authentication can carry a non-query cache identifier to instruct the content-centric network router through which the authentication interest package passes to not perform cache query when receiving such an interest package, but only to perform forwarding, so as to improve the forwarding rate of some interest packages that obviously do not need to hit the cache.

[0186] In the embodiment, by using the authentication interest package for authentication to carry the identifier for prompting the content-centric network router through which the authentication interest package passes to not query the cache, the authentication behavior is more reasonable, and the rate of forwarding the authentication interest package by the content-centric network router can be improved.

[0187] In one exemplary embodiment, the method further includes: when the protocol converter receives file download requests sent by multiple clients respectively, extracting file feature information of the file to be downloaded from each file download request; when the file feature information carried by each file download request is the same, aggregating the file download requests sent by multiple clients respectively through the content center network router to obtain an aggregated file download request; and in response to the aggregated file download request, obtaining the fragment information of the file to be downloaded.

[0188] In the specific implementation, considering that edge nodes may receive multiple file download requests for the same file, in order to avoid performing a file download for each request, this embodiment also proposes a method to aggregate multiple file download requests for the same file. That is, for the same file to be downloaded, only one file download process is performed, and after the download is completed, the downloaded fragment files are sent to each client respectively.

[0189] It should be noted that, since each client has different permissions, file download requests can be aggregated, but the authentication interest packets of each client during authentication cannot be aggregated. That is, although file download requests from multiple clients are aggregated, each client still needs to be authenticated separately during authentication.

[0190] In this embodiment, by aggregating multiple file download requests for the same file, only one file download process is performed for the same file to be downloaded. This can save bandwidth resources of the dedicated network line and overcome the shortcomings of traditional methods, which cannot effectively aggregate the same origin requests between each node, resulting in a waste of dedicated line bandwidth.

[0191] In one exemplary embodiment, the Content Center Network (CCN) router can implement a Forwarding Information Base (FIB) table through a prefix tree to forward received CCN network packets. The abstract data structure of an FIB table is as follows: Figure 8 As shown, after an interest packet flows into the router, it is identified by its name (…). Figure 8 The FIB index (e.g., / ks, / ks / video) is searched to determine which process the interest packet is forwarded to, and the protocol used for packet transmission is UDP. Similarly, this disclosure uses a hash table to implement the CCN router's PIT (Pending Interest Table), although other data structures such as red-black trees and skip lists can also be used. In this disclosure, the data structure of the PIT table entries is as follows: Figure 9 As shown.

[0192] In addition, the content repository of the content-centric network router is directly implemented using a solid state disk (SSD disk) and a file system, and additionally, a double-linked list and a hash table for managing cache data are established in the memory, which are used to implement a least recently used mode cache eviction mechanism. Similarly, the content repository in the present disclosure has two additional functions in addition to the functions of a common CCN router: (1) allowing a data packet to carry a non-cache identifier, which is used to avoid caching some data packets that obviously do not need to be cached; and (2) allowing an interest packet to carry a non-query cache identifier, which is used to instruct the CCN router to not cache to respond to the interest packet when the interest packet is received, and meanwhile, the forwarding rate of some interest packets that obviously do not need to hit the cache can be improved.

[0193] The CCN network packet designed in the present disclosure also has a distinction between an interest packet and a data packet, but the system designed in the present disclosure allows an interest packet to carry load data. By carrying data in the interest packet, active pushing of data can be implemented, thereby perfecting the shortcoming of the CCN network architecture that is not designed for file uploading.

[0194] The protocol converter can be implemented through nginx (a high-performance HTTP and reverse proxy web server), and part of the code needs to be added to increase the protocol conversion function. For the uploading process, after the protocol converter completely receives the file uploaded by the client, the protocol converter first sends an authentication interest packet to the background server to obtain an authentication result. After the authentication passes, the protocol converter is responsible for splitting the file uploaded by the client into fixed-size slices (such as 8000 bytes per slice) according to specific rules, and finally sending the data slices to the upstream content-centric network router through the interest packet by using the single-sided dominant transmission protocol. For the file downloading process, the protocol converter receives a download request through the HTTP protocol, and also needs to complete authentication first, and then encapsulates the HTTP request into a CCN interest packet according to a specific method, and then sends the CCN interest packet to the upstream CCN router, which routes and forwards the request by itself.

[0195] In order to save the backend machine resources, the function of the service agent in the present disclosure is designed to be relatively simple, and the function mainly judges the interest packet received. If the interest packet is an uploading request interest packet, the data is carried, and then the data is written into the backend storage system through a remote interface. If the interest packet is a downloading request interest packet, the data is obtained from the backend service agent according to the information carried by the interest packet, encapsulated into a data packet, and returned to the CCN router.

[0196] The file transmission acceleration system based on the content-centric network proposed in the present disclosure integrates the idea of the content-centric network into the specific CDN use scenario of small file uploading and downloading including the authentication process, thereby further improving the utilization rate of resources and the efficiency of file uploading and downloading.

[0197] It should be understood that although each step in the flowchart involved in each embodiment as described above is shown in sequence according to the direction of the arrow, these steps are not necessarily executed in the order indicated by the arrow. Unless explicitly stated otherwise herein, there is no strict order limitation for the execution of these steps, and these steps can be executed in other orders. Moreover, at least some of the steps in the flowchart involved in each embodiment as described above can include multiple steps or multiple stages, which are not necessarily executed at the same time but can be executed at different times, and the execution order of these steps or stages is not necessarily sequential but can be alternately or alternately executed with at least some of the other steps or steps or stages in other steps.

[0198] It can be understood that the same / similar parts between each embodiment of the above method in the specification can be referred to each other, and each embodiment focuses on the difference from other embodiments, and the related part can be referred to the description of other method embodiments.

[0199] Based on the same inventive concept, the embodiments of the present disclosure also provide a file uploading device for implementing the above-mentioned file uploading method, and a file downloading device for implementing the above-mentioned file downloading method.

[0200] Figure 10 is a structural block diagram of a file uploading device according to an exemplary embodiment. Referring to Figure 10 The device includes a receiving unit 1001, a slicing unit 1002, an encapsulating unit 1003, and an uploading unit 1004, wherein

[0201] The receiving unit 1001 is configured to receive a file uploading request and a to-be-uploaded file sent by a client through a protocol converter in any edge node;

[0202] The slicing unit 1002 is configured to perform slicing processing on the to-be-uploaded file to obtain a plurality of slice files in response to the file uploading request through the protocol converter;

[0203] The encapsulating unit 1003 is configured to perform encapsulation processing on each slice file respectively to obtain a first slice interest packet corresponding to each slice file respectively, and send each first slice interest packet to a content-centric network router in any edge node;

[0204] The uploading unit 1004 is configured to upload each first slice interest packet to a center node through the content-centric network router in any edge node; the center node is configured to receive each first slice interest packet and store each first slice interest packet.

[0205] In an example embodiment, the fragmentation unit 1002 is further configured to perform obtaining a file size of the file to be uploaded; determining a number of fragments of the file to be uploaded and a file size of each fragment based on the file size of the file to be uploaded according to a positive correlation between the file size and the number of fragments; and performing fragmentation processing on the file to be uploaded based on the number of fragments and the file size of each fragment to obtain a plurality of fragment files.

[0206] In an example embodiment, the content-centric network router and the service broker are deployed in the center node, the file upload request carries user permission information and file characteristic information of the file to be uploaded; the apparatus further includes an authentication unit configured to perform extracting the user permission information and the file characteristic information of the file to be uploaded from the file upload request through the protocol converter, encapsulating the user permission information and the file characteristic information to obtain an authentication interest packet, and sending the authentication interest packet to the content-centric network router in any of the edge nodes; sending the authentication interest packet to the content-centric network router in the center node through the content-centric network router in any of the edge nodes; the content-centric network router in the center node is configured to forward the authentication interest packet to the service broker, so that the service broker performs authentication processing on the authentication interest packet to obtain an authentication result packet, and returns the authentication result packet to the protocol converter in any of the edge nodes through the content-centric network router in the center node and the content-centric network router in any of the edge nodes; when the protocol converter in any of the edge nodes receives the authentication result packet returned by the center node, the authentication result packet indicates that the authentication is passed, and performs fragmentation processing on the file to be uploaded to obtain a plurality of fragment files.

[0207] In an example embodiment, the authentication result packet carries a non-caching identifier, the non-caching identifier is used to prompt the content-centric network router through which the authentication result packet passes to forward the authentication result packet without caching the authentication result packet.

[0208] In an example embodiment, the apparatus further includes a fault processing unit configured to perform determining a target edge node from other edge nodes when a network link from any of the edge nodes to the center node is faulty; the target edge node is an edge node that has a communication distance meeting a preset condition with any of the edge nodes; sending each first fragment interest packet to the target edge node through the content-centric network router in any of the edge nodes, so that the target edge node sends each first fragment interest packet to the center node.

[0209] Figure 11 FIG. 1 is a structural block diagram of a file download apparatus according to an example embodiment. Referring to FIG. 1, Figure 11 The apparatus includes an obtaining unit 1110, a sending unit 1120, and a returning unit 1130.

[0210] The obtaining unit 1110 is configured to obtain, by the protocol converter in any edge node, in response to a file download request for a to-be-downloaded file sent by a client, piece information of the to-be-downloaded file; the piece information includes a number of pieces in which the to-be-downloaded file is divided;

[0211] The sending unit 1120 is configured to generate, by the protocol converter, a plurality of second piece interest packets corresponding to the number of pieces, and send the plurality of second piece interest packets to a content-centric network router in any edge node, so that the content-centric network router forwards the plurality of second piece interest packets to a target node; the target node represents an edge node or a center node that stores a piece file of the to-be-downloaded file, and the second piece interest packet carries a file identifier of the piece file.

[0212] The returning unit 1130 is configured to receive, by the content-centric network router, a plurality of piece files of the to-be-downloaded file returned by the target node, and forward the plurality of piece files to the protocol converter, so that the protocol converter combines each piece file to obtain a complete file, and returns the complete file to the client.

[0213] In an exemplary embodiment, the sending unit 1120 is further configured to query, by the content-centric network router, a piece file cached by any edge node; and in a case where no piece file corresponding to any second piece interest packet is queried from the piece file cached by any edge node, the content-centric network router forwards the plurality of second piece interest packets to the target node.

[0214] In an exemplary embodiment, each edge node is further configured with a forwarding information base for forwarding the second piece interest packet; the forwarding information base records node information for receiving the interest packet forwarded by each edge node; and the sending unit 1120 is further configured to obtain, for each second piece interest packet, file information corresponding to the second piece interest packet; query, by the content-centric network router and the file information, the forwarding information base of any edge node to obtain node information for receiving the second piece interest packet forwarded by any edge node; and forward, by the content-centric network router, the second piece interest packet to a center node or another edge node corresponding to the node information.

[0215] In an example embodiment, the file download request carries user permission information and file characteristic information of the file to be downloaded; the apparatus further comprises an authentication unit configured to perform extracting the user permission information and the file characteristic information of the file to be downloaded from the file download request through the protocol converter, encapsulating the user permission information and the file characteristic information to obtain an authentication interest packet, forwarding the authentication interest packet to the central node through a content-centric network router in any edge node, and adding an authentication record about the file to be downloaded in a preset authentication waiting table through the protocol converter.

[0216] In an example embodiment, the returning unit 1130 is further configured to perform detecting the authentication record of the file to be downloaded through the protocol converter, returning the complete file to the client in a case where an authentication result corresponding to the authentication record is authentication passed, and caching the complete file into the content-centric network router in any edge node and setting prompt information that the file to be downloaded has been downloaded in the authentication record in a case where the authentication record shows an authentication result waiting state.

[0217] In an example embodiment, the authentication interest packet carries a non-query cache identifier, which is used to prompt the content-centric network router through which the authentication interest packet passes to forward the authentication interest packet without performing cache query on the authentication interest packet.

[0218] In an example embodiment, the apparatus further comprises an aggregation unit configured to perform extracting file characteristic information of a file to be downloaded in each file download request when the protocol converter receives a plurality of file download requests respectively sent by a plurality of clients, performing aggregation processing on the file download requests respectively sent by the plurality of clients through the content-centric network router in a case where the file characteristic information carried by each file download request is the same to obtain an aggregated file download request, and obtaining shard information of the file to be downloaded in response to the aggregated file download request.

[0219] As to the apparatus in the above embodiments, the specific manners in which the modules perform operations have been described in detail in the embodiments of the method, and will not be described here in detail.

[0220] Figure 12 FIG. 12 is a block diagram illustrating an electronic device 1200 for implementing a file upload method according to an example embodiment. The electronic device 1200 can be, for example, a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, or the like.

[0221] Reference is made to Figure 12The electronic device 1200 can include one or more of the following components: a processing component 1202, a memory 1204, a power component 1206, a multimedia component 1208, an audio component 1210, an input / output (I / O) interface 1212, a sensor component 1214, and a communication component 1216.

[0222] The processing component 1202 usually controls overall operations of the electronic device 1200, such as operations associated with displaying, making phone calls, data communications, camera operations, and recording operations. The processing component 1202 can include one or more processors 1220 to execute instructions to complete all or part of steps of the methods described above. In addition, the processing component 1202 can include one or more modules to facilitate the interaction between the processing component 1202 and other components. For example, the processing component 1202 can include a multimedia module to facilitate the interaction between the multimedia component 1208 and the processing component 1202.

[0223] The memory 1204 is configured to store various types of data to support operations of the electronic device 1200. Examples of these data include instructions for any application or method operating on the electronic device 1200, contact data, phonebook data, messages, pictures, videos, and the like. The memory 1204 can be implemented by any type of volatile or non-volatile storage devices or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disc, optical disc, or graphene memory.

[0224] The power component 1206 provides power to various components of the electronic device 1200. The power component 1206 can include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the electronic device 1200.

[0225] The multimedia component 1208 includes a screen to provide an output interface between the electronic device 1200 and a client. In some embodiments, the screen can include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from a client. The touch panel includes one or more touch sensors to sense touch, swiping, and gestures on the touch panel. The touch sensors can not only sense a boundary of a touching or swiping action, but also detect duration and pressure related to the touching or swiping action. In some embodiments, the multimedia component 1208 includes a front camera and / or a rear camera. The front camera and / or the rear camera can receive external multimedia data when the electronic device 1200 is in an operation mode, such as a shooting mode or a video mode. Each of the front camera and the rear camera can be a fixed optical lens system or have a focal length and optical zoom capability.

[0226] The audio component 1210 is configured to output and / or input audio signals. For example, the audio component 1210 includes a microphone (MIC) configured to receive external audio signals when the electronic device 1200 is in an operation mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals can be further stored in the memory 1204 or transmitted via the communication component 1216. In some embodiments, the audio component 1210 also includes a speaker for outputting audio signals.

[0227] The I / O interface 1212 provides an interface between the processing component 1202 and peripheral interface modules, which can be a keypad, a click wheel, buttons, and the like. The buttons can include, but are not limited to, a home button, a volume button, a start button, and a lock button.

[0228] The sensor component 1214 includes one or more sensors to provide various state assessments for the electronic device 1200. For example, the sensor component 1214 can detect an open / closed state of the electronic device 1200, relative positioning of components, such as a display and a keypad of the electronic device 1200, a change in position of the electronic device 1200 or components of the electronic device 1200, presence or absence of user contact with the electronic device 1200, a change in orientation of the device 1200 or acceleration / deceleration of the electronic device 1200, and a temperature change of the electronic device 1200. The sensor component 1214 can include a proximity sensor configured to detect presence of a nearby object without any physical touch. The sensor component 1214 can further include a light sensor, such as a CMOS or CCD image sensor, for use in an imaging application. In some embodiments, the sensor component 1214 can further include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0229] The communication component 1216 is configured to facilitate wired or wireless communication between the electronic device 1200 and other devices. The electronic device 1200 can access a wireless network based on a communication standard, such as WiFi, a cellular network standard (such as 2G, 3G, 4G, or 5G), or a combination thereof. In an exemplary embodiment, the communication component 1216 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 1216 can further include a Near Field Communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technology.

[0230] In an exemplary embodiment, the electronic device 1200 can be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, micro-controllers, microprocessors, or other electronic elements, for performing the above-described methods.

[0231] In an exemplary embodiment, a computer-readable storage medium, such as the memory 1204 including instructions, is also provided. The instructions can be executed by the processor 1220 of the electronic device 1200 to complete the above-described methods. For example, the computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disc, and an optical data storage device, etc.

[0232] In an exemplary embodiment, a computer program product including instructions is also provided. The instructions can be executed by the processor 1220 of the electronic device 1200 to complete the above-described methods.

[0233] It should be noted that the above-described apparatus, electronic device, computer-readable storage medium, computer program product, and the like according to the method embodiments can also include other implementation manners, and the specific implementation manners can be referred to the description of the related method embodiments, which will not be repeated here.

[0234] Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the features of the disclosure as set forth herein. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

[0235] It should be understood that the present disclosure is not limited to the precise construction that has been described above and shown in the accompanying drawings, and that various modifications and changes can be made by those skilled in the art without departing from the scope of the present disclosure. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A file uploading method characterized by, The application is applied to any one edge node in a content distribution system, the content distribution system further comprising a center node and other edge nodes, the other edge nodes being edge nodes other than the any one edge node in the content distribution system, each edge node being deployed with a software virtualized content-centric network router and a protocol converter, the center node being deployed with a content-centric network router and a service broker, comprising: receiving, by the protocol converter in the any one edge node, a file upload request and a to-be-uploaded file sent by a client; the file upload request carrying user authority information and file characteristic information of the to-be-uploaded file; extracting, by the protocol converter, the user authority information and the file characteristic information of the to-be-uploaded file from the file upload request, encapsulating the user authority information and the file characteristic information, obtaining an authentication interest package, and sending the authentication interest package to the content-centric network router in the any one edge node; sending, by the content-centric network router in the any one edge node, the authentication interest package to the content-centric network router of the center node; the content-centric network router of the center node is configured to forward the authentication interest package to the service broker, so that the service broker performs authentication processing on the authentication interest package to obtain an authentication result package, and returns the authentication result package to the protocol converter in the any one edge node through the content-centric network router of the center node and the content-centric network router in the any one edge node; when the protocol converter receives the authentication result package returned by the center node, and the authentication result package indicates that the authentication is passed, responding to the file upload request, performing fragmentation processing on the to-be-uploaded file to obtain a plurality of fragmented files; encapsulating each fragmented file by the protocol converter to obtain a first fragmented interest package corresponding to each fragmented file, and sending each first fragmented interest package to the content-centric network router in the any one edge node; uploading, by the content-centric network router in the any one edge node, each first fragmented interest package to the center node; the center node is configured to receive the first fragmented interest packages and store the first fragmented interest packages.

2. The method of claim 1, wherein, The fragmentation processing on the to-be-uploaded file to obtain a plurality of fragmented files comprises: obtaining a file size of the to-be-uploaded file; determining a number of fragments of the to-be-uploaded file and a file size of each fragment based on the file size of the to-be-uploaded file according to a positive correlation between the file size and the number of fragments; performing fragmentation processing on the to-be-uploaded file based on the number of fragments and the file size of each fragment to obtain a plurality of fragmented files.

3. The method of claim 1, wherein, The authentication result package carries a non-caching identifier, the non-caching identifier being used to prompt the content-centric network routers through which the authentication result package passes to forward the authentication result package without caching the authentication result package.

4. The method according to any one of claims 1 to 3, characterized in that, The method further comprises: determining a target edge node from the other edge nodes when a network link from the any edge node to the center node is faulty; the target edge node is an edge node that meets a preset condition in terms of communication distance with the any edge node; sending, by the content-centric network router in the any edge node, the respective first slice interest packets to the target edge node, so that the target edge node sends the respective first slice interest packets to the center node.

5. A file download method characterized by, The application is applied to an any edge node in a content distribution system, the content distribution system further comprising a center node and other edge nodes, the other edge nodes being edge nodes in the content distribution system except the any edge node, each edge node being provided with a software-virtualized content-centric network router and a protocol converter, and comprising: obtaining, by the protocol converter in the any edge node, slice information of a to-be-downloaded file in response to a file download request for the to-be-downloaded file sent by a client; the file download request carrying user authority information and file feature information of the to-be-downloaded file, and the slice information comprising a slice number of the to-be-downloaded file; generating, by the protocol converter, a plurality of second slice interest packets corresponding to the slice number, and sending the plurality of second slice interest packets to the content-centric network router in the any edge node, and forwarding, by the content-centric network router, the plurality of second slice interest packets to a target node; the target node representing an edge node or the center node that stores a slice file of the to-be-downloaded file, and the second slice interest packet carrying a file identifier of the slice file; receiving, by the content-centric network router, a plurality of slice files of the to-be-downloaded file returned by the target node, and forwarding the plurality of slice files to the protocol converter, combining, by the protocol converter, each slice file to obtain a complete file, and returning the complete file to the client; Before obtaining the slice information of the to-be-downloaded file, the method further comprises: extracting, by the protocol converter, the user authority information and the file feature information of the to-be-downloaded file from the file download request, encapsulating the user authority information and the file feature information to obtain an authentication interest packet, forwarding, by the content-centric network router in the any edge node, the authentication interest packet to the center node, and adding an authentication record about the to-be-downloaded file in a preset authentication waiting table.

6. The method of claim 5, wherein, The center node and each edge node further cache slice files of historical transmission files, and before the forwarding, by the content-centric network router, of the plurality of second slice interest packets to the target node, the method further comprises: querying, by the content-centric network router, the slice files cached by the any edge node; the forwarding, by the content-centric network router, of the plurality of second slice interest packets to the target node comprises: In the case that no file corresponding to any of the second slice interest packets is found in the cached file in any of the edge nodes, the second slice interest packets are forwarded to the target node through the content-centric network router.

7. The method of claim 6, wherein, Each edge node is further configured with a forwarding information base for forwarding the second slice interest packets, and the forwarding information base records node information for receiving the interest packets forwarded by each edge node; The forwarding of the second slice interest packets to the target node through the content-centric network router includes: For each second slice interest packet, file information corresponding to the second slice interest packet is obtained; The content-centric network router and the file information are used to query the forwarding information base of any edge node to obtain node information for receiving the second slice interest packets forwarded by any edge node; The content-centric network router is used to forward the second slice interest packets to the central node or other edge node corresponding to the node information.

8. The method of claim 5, wherein, Before returning the complete file to the client, the method further includes: The protocol converter detects the authentication record of the file to be downloaded; In the case that the authentication result corresponding to the authentication record is authentication passed, the complete file is returned to the client; In the case that the authentication record shows that the authentication result is in a waiting state, the complete file is cached in the content-centric network router of any edge node, and prompt information indicating that the file to be downloaded has been downloaded is set in the authentication record.

9. The method of claim 5, wherein, The non-query caching identifier is carried by the authentication interest packet, and is used to prompt the content-centric network router through which the authentication interest packet passes to forward the authentication interest packet without caching and querying the authentication interest packet.

10. The method of claim 5, wherein, The method further includes: When the protocol converter receives a plurality of file download requests sent by a plurality of clients respectively, file feature information of the file to be downloaded in each file download request is extracted; In the case that the file feature information carried in each file download request is the same, the file download requests sent by the plurality of clients are aggregated through the content-centric network router to obtain an aggregated file download request; In response to the aggregated file download request, slice information of the file to be downloaded is obtained.

11. A file upload apparatus for application to any edge node in a content distribution system, characterized by, The content distribution system further includes a central node and other edge nodes, the other edge nodes being edge nodes other than the any edge node in the content distribution system, each edge node being deployed with a software-virtualized content-centric network router and a protocol converter, and the central node being deployed with a content-centric network router and a service agent, and including: A receiving unit configured to receive a file upload request and a file to be uploaded sent by a client through the protocol converter in the any edge node, the file upload request carrying user authority information and file feature information of the file to be uploaded; authentication units configured to perform extracting the user permission information and file characteristic information of the to-be-uploaded file from the file upload request through the protocol converter, encapsulating the user permission information and the file characteristic information to obtain an authentication interest package, and sending the authentication interest package to a content-centric network router in the any one edge node; sending the authentication interest package to a content-centric network router in the center node through the content-centric network router in the any one edge node; the content-centric network router in the center node is configured to forward the authentication interest package to the service agent, so that the service agent performs authentication processing on the authentication interest package to obtain an authentication result package, and returns the authentication result package to the protocol converter in the any one edge node through the content-centric network router in the center node and the content-centric network router in the any one edge node; fragmentation units configured to perform, when the protocol converter receives the authentication result package of authentication passing returned by the center node, fragmenting the to-be-uploaded file in response to the file upload request to obtain a plurality of fragment files; encapsulation units configured to perform encapsulating each fragment file through the protocol converter to obtain a first fragment interest package corresponding to each fragment file, respectively, and sending each first fragment interest package to the content-centric network router in the any one edge node; upload units configured to perform uploading each first fragment interest package to the center node through the content-centric network router in the any one edge node; and the center node is configured to receive the each first fragment interest package and store the each first fragment interest package.

12. A file downloading apparatus applied to any edge node in a content distribution system, characterized in that, The content distribution system further includes a center node and other edge nodes, the other edge nodes being edge nodes other than the any one edge node in the content distribution system, each edge node being deployed with a software-virtualized content-centric network router and a protocol converter, comprising: acquisition units configured to perform, through the protocol converter in the any one edge node, acquiring fragment information of a to-be-downloaded file in response to a file download request for the to-be-downloaded file sent by a client; the file download request carrying user permission information and file characteristic information of the to-be-downloaded file, and the fragment information including a number of fragments into which the to-be-downloaded file is fragmented; sending units configured to perform, through the protocol converter, generating a plurality of second fragment interest packages corresponding to the number of fragments, and sending the plurality of second fragment interest packages to the content-centric network router in the any one edge node, and forwarding the plurality of second fragment interest packages to a target node through the content-centric network router; the target node representing an edge node or a center node that stores a fragment file of the to-be-downloaded file, and the second fragment interest package carrying a file identifier of the fragment file; The returning unit is configured to receive the plurality of fragment files of the to-be-downloaded file returned by the target node through the content-centric network router, and forward the plurality of fragment files to the protocol converter, combine each fragment file through the protocol converter to obtain a complete file, and return the complete file to the client; The authentication unit is configured to extract the user permission information and file characteristic information of the to-be-downloaded file from the file download request through the protocol converter, encapsulate the user permission information and the file characteristic information to obtain an authentication interest package, forward the authentication interest package to the center node through the content-centric network router in the any one edge node, and add an authentication record about the to-be-downloaded file in a preset authentication waiting table.

13. An electronic device, comprising: Comprise: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to execute the instructions to implement the method of any one of claims 1 to 10.

14. A computer-readable storage medium, characterized in that, When the instructions in the computer-readable storage medium are executed by the processor of the electronic device, the electronic device can perform the method of any one of claims 1 to 10.

Images