Content Delivery Network Origin Recovery Method and System Based on Alibaba Cloud Object Storage

Abstract

This invention discloses a content delivery network (CDN) origin pull method and system based on Alibaba Cloud Object Storage. The method includes the following steps: a client initiates a resource request; the origin CDN receives the resource request and forwards it to the origin service, while configuring it to support redirection; the redirect CDN interacts with Alibaba Cloud Object Storage; a verification module verifies the validity of the user to which the current resource belongs and verifies the legality of the resource, and passes the verified address to the signature module for processing; the signature module generates a redirect CDN address and generates an access signature for the private object storage, facilitating interaction between the redirect CDN address and Alibaba Cloud Object Storage; Alibaba Cloud Object Storage provides resource storage management functions and is configured to support redirect CDN origin pull to object storage.

Description

Technical Field

[0001] This invention belongs to the field of object storage technology, specifically relating to a content delivery network origin-following method and system based on Alibaba Cloud object storage. Background Technology

[0002] A Content Delivery Network (CDN) is a distributed network built upon and overlaying the backbone network, consisting of edge node servers distributed across different regions. CDNs have wide applications, supporting content acceleration for various industries and scenarios, such as small image file downloads, large file downloads, video-on-demand, live streaming, site-wide acceleration, and security acceleration. Object Storage Service (OSS), also known as object-based storage, is a method for solving and processing discrete units, providing data storage services in the form of objects on a distributed system.

[0003] In the era of the short video boom, many companies choose to store users' audio and video resources in object storage because object storage supports massive storage and the unit price of storage is much lower than the cost of building a data center and purchasing hard drives for storage. At the same time, in order to solve the problem of concurrent access to audio and video resources, CDN is usually chosen to accelerate content and improve user experience. Among the two products mentioned above, Alibaba Cloud has a high usage rate in China.

[0004] Based on the above scenarios, business users often need to provide an origin-pull module to handle multi-user resource isolation or verification. Since object storage doesn't have a user concept, the business layer needs to differentiate between them. Simply using the address provided by object storage for direct resource access fails to achieve resource isolation or verification. Furthermore, if object storage is set to private, this method cannot provide a public resource access address. Currently, a common solution is to use CDN wildcard domains combined with an origin-pull module to achieve multi-user resource isolation and verification. This model can handle multi-user business scenarios, but because the origin-pull module directly accesses resources in object storage for responses, it involves public network traffic outflow. The unit price on Alibaba Cloud is much higher than the unit price of CDN traffic, resulting in higher operating costs. Summary of the Invention

[0005] In view of the above-mentioned problems, the present invention provides a content delivery network origin-following method and system based on Alibaba Cloud object storage, which can isolate users of resources in object storage at a lower operating cost and verify the validity of users and resources.

[0006] To solve the above-mentioned technical problems, the present invention adopts the following technical solution:

[0007] The first aspect of this invention provides a content delivery network (CDN) origin pull method based on Alibaba Cloud Object Storage, applied to a content delivery network (CDN) origin pull system based on Alibaba Cloud Object Storage, comprising a client, Alibaba Cloud CDN, origin pull service, and Alibaba Cloud Object Storage. The Alibaba Cloud CDN further includes an origin pull content delivery network (CDN) and a redirection content delivery network (CDN). The origin pull service includes a verification module and a signature module. The method includes the following steps:

[0008] The client initiates a resource request;

[0009] The origin CDN receives resource requests and forwards them to the origin service, while also configuring it to support redirection.

[0010] Redirecting the interaction between CDN and Alibaba Cloud Object Storage;

[0011] The verification module verifies the validity of the user to which the current resource belongs, and also verifies the legality of the resource. The address that passes the verification is then passed to the signature module for processing. The signature module generates a redirect CDN address and generates an access signature for the private object storage, which facilitates the interaction between the redirect CDN address and Alibaba Cloud object storage.

[0012] Alibaba Cloud Object Storage provides resource storage management functions and can be configured to support redirecting CDN back to object storage.

[0013] In one possible implementation, the client is a device that supports sending HTTP requests.

[0014] In one possible implementation, the simultaneous configuration to support redirection specifically includes: the origin CDN adopts Alibaba Cloud wildcard domain name format, identifies an independent user through the user information identifier defined by the business system, and configures the domain name in the Alibaba Cloud CDN console. First, the origin address is set to point to the origin service, and the "origin 302 follow" attribute is enabled for the domain name to support the redirection CDN address of the origin service response.

[0015] In one possible implementation, the origin address configured in the CDN address points to the specific bucket domain name address of the Alibaba Cloud Object Storage to be accessed.

[0016] In one possible implementation, the object storage is configured with buckets and keys, where the bucket belongs to the top-level category and is private. A redirect CDN can only return to one bucket. A corresponding CDN access address is generated for each bucket in the Alibaba Cloud Object Storage console, and the key is the storage path.

[0017] A second aspect of this invention provides a content delivery network (CDN) origin-pull system based on Alibaba Cloud Object Storage, comprising a client, Alibaba Cloud CDN, origin-pull service, and Alibaba Cloud Object Storage. The Alibaba Cloud CDN further includes an origin-pull content delivery network (CDN) and a redirection content delivery network (CDN). The origin-pull service includes a verification module and a signature module.

[0018] The client is used to initiate resource requests;

[0019] The origin CDN is used to receive resource requests and forward them to the origin service. It is also configured to support redirection.

[0020] Redirecting CDN is used for interaction with Alibaba Cloud Object Storage;

[0021] The verification module verifies the validity of the user to which the current resource belongs, and also verifies the legality of the resource. The verified address is then passed to the signature module for processing. The signature module generates a redirect CDN address and generates an access signature for the private object storage, facilitating the interaction between the redirect CDN address and Alibaba Cloud object storage.

[0022] Alibaba Cloud Object Storage is used to provide resource storage management functions, and can also be configured to support redirecting CDN back to the object storage origin.

[0023] In one possible implementation, the client is a device that supports sending HTTP requests.

[0024] In one possible implementation, the simultaneous configuration to support redirection specifically includes: the origin CDN adopts Alibaba Cloud wildcard domain name format, identifies an independent user through the user information identifier defined by the business system, and configures the domain name in the Alibaba Cloud CDN console. First, the origin address is set to point to the origin service, and the "origin 302 follow" attribute is enabled for the domain name to support the redirection CDN address of the origin service response.

[0025] In one possible implementation, the origin address configured in the CDN address points to the specific bucket domain name address of the Alibaba Cloud Object Storage to be accessed.

[0026] In one possible implementation, the object storage is configured with buckets and keys, where the bucket belongs to the top-level category and is private. A redirect CDN can only return to one bucket. A corresponding CDN access address is generated for each bucket in the Alibaba Cloud Object Storage console, and the key is the storage path.

[0027] The present invention has the following advantages: it can isolate users of resources in object storage at a lower operating cost and verify the validity of users and resources. Attached Figure Description

[0028] Figure 1 This is a schematic diagram of the content delivery network origin-following system based on Alibaba Cloud object storage, according to an embodiment of the present invention.

[0029] Figure 2 This is a flowchart illustrating the steps of the content delivery network origin-following method based on Alibaba Cloud Object Storage according to an embodiment of the present invention. Detailed Implementation

[0030] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0031] See Figure 2 The diagram shows a flowchart of the origin-pull method based on Alibaba Cloud Object Storage's Content Delivery Network (CDN) according to an embodiment of the present invention. It is applied to an origin-pull system based on Alibaba Cloud Object Storage, including a client, Alibaba Cloud CDN, an origin-pull service, and Alibaba Cloud Object Storage. The Alibaba Cloud CDN further includes an origin-pull content delivery network (CDN) and a redirection content delivery network (CDN). The origin-pull service includes a verification module and a signature module. (See [link to relevant documentation]). Figure 1 This is a schematic diagram of the content delivery network origin-following system based on Alibaba Cloud Object Storage, including the following steps:

[0032] S10, the client initiates a resource request;

[0033] S20: The origin content delivery network receives resource requests and forwards them to the origin service, while configuring it to support redirection.

[0034] S30 redirects the interaction between the Content Delivery Network and Alibaba Cloud Object Storage;

[0035] S40 uses a verification module to verify the validity of the user to which the current resource belongs, and also verifies the legality of the resource. The verified address is then passed to the signature module for processing. The signature module generates a redirected content distribution network address and generates an access signature for the private object storage, which facilitates the interaction between the redirected content distribution network address and Alibaba Cloud object storage.

[0036] S50, Alibaba Cloud Object Storage provides resource storage management functions, and can also be configured to support redirecting the content delivery network back to the object storage origin.

[0037] In one embodiment of the present invention, the client is all visitors to the resource, used to initiate resource requests. Any device that supports sending HTTP requests, such as browsers, iOS, Android, etc., can be used as a client. A request example is as follows: http: / / test.vod.com / demo.mp4.

[0038] In one embodiment of the present invention, Alibaba Cloud Content Delivery Network (CDN) is used to create a new CDN domain name on the Alibaba Cloud platform. To support multi-user scenarios, the origin CDN adopts the Alibaba Cloud wildcard domain name format, such as the domain name format *.vod.com. Then, the subdomains can be: test1.vod.com, test2.vod.com, and testn.vod.com, where test1, test2, and testn are user identification information defined by the business system. This identifier can be used to locate an independent user. At the same time, in the Alibaba Cloud CDN console, the *.vod.com domain name needs to be configured. First, the origin address needs to point to the origin service, which can be an external IP address or an external domain name, without limitation. In addition, the "Origin 302 Follow" attribute needs to be enabled for this domain name to support the redirection of the origin service response to the CDN address. The redirect CDN is used for direct interaction with object storage. The redirect CDN address is generated by the signature module in the origin service and initiated by the origin CDN. This redirect CDN address is not visible to the client and the request interaction is carried out internally within Alibaba Cloud CDN. The domain name address of the redirect CDN can be customized and does not require a wildcard domain name, for example: vod-bs.com. The origin address configured for this redirect CDN address must point to the specific bucket domain name address of the Alibaba Cloud object storage to be accessed. This bucket domain name address is provided by Alibaba Cloud object storage and is associated here.

[0039] In one embodiment of the present invention, the origin service is used to verify users and resources without actually transmitting data streams, i.e., it does not generate traffic. The verification module filters users and resources in the origin CDN address requested by the client according to business requirements, such as whether the user is in arrears, disabled, or blacklisted, and whether the resource belongs to the current user or has been deleted. Taking the above client request example: http: / / test.vod.com / demo.mp4, the user identifier is test. The verification module queries the user test to determine if it meets the business conditions. If it does not meet the conditions, it responds with the corresponding error code, such as an HTTP status code 403 if the user is disabled. The accessed resource is demo.mp4. The verification module queries the demo.mp4 resource to determine if it meets the business conditions. If it does not meet the conditions, it responds with the corresponding error code, such as an HTTP status code 404 if the resource has been deleted. After passing the business verification, the origin CDN address is forwarded to the signature module for processing. The signature module receives resource requests that meet the business requirements. This module primarily handles signature processing for private Alibaba Cloud Object Storage. After signing, it generates a redirect CDN address, converting the access address http: / / test.vod.com / demo.mp4 into an HTTP-302 response of http: / / vod-bs.com / test / demo.mp4?sign=xxx to the origin CDN. Here, vod-bs.com is the redirect CDN address configured in Alibaba Cloud CDN, test is the user owning the resource, demo.mp4 is the resource path name, and the sign parameter is the signature authentication required by Alibaba Cloud Object Storage. When the origin CDN receives the HTTP-302 status code from the signature module, because it has previously configured the "Origin 302 Follow" attribute, it will continue to request the redirect CDN address. The redirect CDN then accesses Alibaba Cloud Object Storage and sends the file stream back.

[0040] In one embodiment of the present invention, Alibaba Cloud Object Storage is used to provide basic resource storage management functions. It also requires special configuration to support redirected CDNs that can return to the object storage origin. Object storage has the concepts of bucket and key, where bucket is a top-level category. For data security, buckets are generally private. A redirected CDN can only return to one bucket. By default, the Alibaba Cloud Object Storage console generates a corresponding origin CDN address for each bucket, and the key is the storage path, for example: http: / / vod-bucket.com. This redirected CDN address needs to be configured as origin information in the redirected CDN domain name.

[0041] For the method implementation examples, see [link to relevant documentation]. Figure 1 The diagram illustrates the principle block diagram of a content delivery network (CDN) origin-pull system based on Alibaba Cloud Object Storage, according to an embodiment of the present invention. It includes a client, Alibaba Cloud CDN, origin-pull service, and Alibaba Cloud Object Storage. The Alibaba Cloud CDN further comprises an origin-pull CDN and a redirection CDN. The origin-pull service includes a verification module and a signature module. The client initiates resource requests; the origin-pull CDN receives resource requests and forwards them to the origin-pull service, while also being configured to support redirection; the redirection CDN interacts with Alibaba Cloud Object Storage; the verification module verifies the validity of the user to which the resource belongs and the legality of the resource, then passes the verified address to the signature module for processing; the signature module generates a redirection CDN address and generates an access signature for the private object storage, facilitating interaction between the redirection CDN address and Alibaba Cloud Object Storage; and Alibaba Cloud Object Storage provides resource storage management functions and is configured to support redirection CDN origin-pull to object storage.

[0042] In one embodiment of the present invention, the client is all visitors to the resource, used to initiate resource requests. Any device that supports sending HTTP requests, such as browsers, iOS, Android, etc., can be used as a client. A request example is as follows: http: / / test.vod.com / demo.mp4.

[0043] In one embodiment of the present invention, Alibaba Cloud Content Delivery Network (CDN) is used to create a new CDN domain name on the Alibaba Cloud platform. To support multi-user scenarios, the origin CDN adopts the Alibaba Cloud wildcard domain name format, such as the domain name format *.vod.com. Then, the subdomains can be: test1.vod.com, test2.vod.com, and testn.vod.com, where test1, test2, and testn are user identification information defined by the business system. This identifier can be used to locate an independent user. At the same time, in the Alibaba Cloud CDN console, the *.vod.com domain name needs to be configured. First, the origin address needs to point to the origin service, which can be an external IP address or an external domain name, without limitation. In addition, the "Origin 302 Follow" attribute needs to be enabled for this domain name to support the redirection of the origin service response to the CDN address. The redirect CDN is used for direct interaction with object storage. The redirect CDN address is generated by the signature module in the origin service and initiated by the origin CDN. This redirect CDN address is not visible to the client and the request interaction is carried out internally within Alibaba Cloud CDN. The domain name address of the redirect CDN can be customized and does not require a wildcard domain name, for example: vod-bs.com. The origin address configured for this redirect CDN address must point to the specific bucket domain name address of the Alibaba Cloud object storage to be accessed. This bucket domain name address is provided by Alibaba Cloud object storage and is associated here.

[0044] In one embodiment of the present invention, the origin service is used to verify users and resources without actually transmitting data streams, i.e., it does not generate traffic. The verification module filters users and resources in the origin CDN address requested by the client according to business requirements, such as whether the user is in arrears, disabled, or blacklisted, and whether the resource belongs to the current user or has been deleted. Taking the above client request example: http: / / test.vod.com / demo.mp4, the user identifier is test. The verification module queries the user test to determine if it meets the business conditions. If it does not meet the conditions, it responds with the corresponding error code, such as an HTTP status code 403 if the user is disabled. The accessed resource is demo.mp4. The verification module queries the demo.mp4 resource to determine if it meets the business conditions. If it does not meet the conditions, it responds with the corresponding error code, such as an HTTP status code 404 if the resource has been deleted. After passing the business verification, the origin CDN address is forwarded to the signature module for processing. The signature module receives resource requests that meet the business requirements. This module primarily handles signature processing for private Alibaba Cloud Object Storage. After signing, it generates a redirect CDN address, converting the access address http: / / test.vod.com / demo.mp4 into an HTTP-302 response of http: / / vod-bs.com / test / demo.mp4?sign=xxx to the origin CDN. Here, vod-bs.com is the redirect CDN address configured in Alibaba Cloud CDN, test is the user owning the resource, demo.mp4 is the resource path name, and the sign parameter is the signature authentication required by Alibaba Cloud Object Storage. When the origin CDN receives the HTTP-302 status code from the signature module, because it has previously configured the "Origin 302 Follow" attribute, it will continue to request the redirect CDN address. The redirect CDN then accesses Alibaba Cloud Object Storage and sends the file stream back.

[0045] In one embodiment of the present invention, Alibaba Cloud Object Storage is used to provide basic resource storage management functions. It also requires special configuration to support redirected CDNs that can return to the object storage origin. Object storage has the concepts of bucket and key, where bucket is a top-level category. For data security, buckets are generally private. A redirected CDN can only return to one bucket. By default, the Alibaba Cloud Object Storage console generates a corresponding origin CDN address for each bucket, and the key is the storage path, for example: http: / / vod-bucket.com. This redirected CDN address needs to be configured as origin information in the redirected CDN domain name.

[0046] The content delivery network origin-pull system based on Alibaba Cloud object storage, implemented through the above embodiments, can isolate users from resources in object storage and verify the validity of users and resources at a lower operating cost. The cost calculation is shown in the table below. The technical solution of this application can significantly reduce costs compared to existing technologies.

[0047] Table 1. Cost Comparison of Existing Technology and the Embodiment of this Invention

[0048]

[0049] It should be understood that the exemplary embodiments described herein are illustrative and not restrictive. Although one or more embodiments of the invention have been described in conjunction with the accompanying drawings, those skilled in the art will understand that various changes in form and detail may be made without departing from the spirit and scope of the invention as defined by the appended claims.

Claims

1. An Aliyun object storage-based content distribution network source returning method, characterized in that, The application is applied to an object storage-based content distribution network back-to-source system including a client, an Aliyun content distribution network, a back-to-source service and an Aliyun object storage, wherein the Aliyun content distribution network CDN further includes a back-to-source content distribution network CDN and a redirection content distribution network CDN, the back-to-source service includes a verification module and a signature module, and the method comprises the following steps: The client initiates a resource request; The back-to-source CDN receives the resource request and forwards the resource request to the back-to-source service while being configured to support redirection jumping; The redirection CDN interacts with the Aliyun object storage; The verification module is used to verify the validity of a user to which the current resource belongs and the legality of the resource, that is, the user and the resource in the back-to-source CDN address requested by the client are filtered according to business requirements, and the address passing the verification is transmitted to the signature module for processing; the signature module is used to generate a redirection CDN address and an access signature for a private object storage, so as to facilitate the interaction between the redirection CDN address and the Aliyun object storage; The Aliyun object storage provides resource storage management functions and is configured to support redirection CDN back-to-source to the object storage; The back-to-source CDN adopts an Aliyun generic domain name format, locates an independent user through user information defined by a business system, and configures a domain name in the console of the Aliyun CDN, first sets a back-to-source address pointing to the back-to-source service, enables a "back-to-source 302 follow" attribute for the domain name, and uses the attribute to support the redirection CDN address in the response of the back-to-source service; the object storage is provided with a bucket and a key, wherein the bucket belongs to a top-level classification, the bucket is private, a redirection CDN can only back-to-source to one bucket, a CDN access address corresponding to each bucket is generated in the console of the Aliyun object storage, and the key is a storage path.

2. The content delivery network origin pulling method based on Aliyun object storage of claim 1, wherein, The client is a device supporting sending an HTTP request.

3. The content delivery network origin pulling method based on Aliyun object storage of claim 1, wherein, The back-to-source address of the CDN address configuration points to a specific bucket domain name address of the Aliyun object storage to be accessed.

4. An Aliyun object storage-based content distribution network source return system characterized in that, The application is applied to an object storage-based content distribution network back-to-source system including a client, an Aliyun content distribution network, a back-to-source service and an Aliyun object storage, wherein the Aliyun content distribution network CDN further includes a back-to-source content distribution network CDN, a redirection content distribution network CDN, the back-to-source service includes a verification module and a signature module, and the method comprises the following steps: The client initiates a resource request; The back-to-source CDN receives the resource request and forwards the resource request to the back-to-source service while being configured to support redirection jumping; The redirection CDN interacts with the Aliyun object storage; The verification module is configured to verify the validity of a user to which a current resource belongs, and to verify whether the resource is legal, that is, to filter the user and the resource in a back-to-source CDN address requested by a client according to business requirements, and to deliver the address passing the verification to the signature module for processing; the signature module is configured to generate a redirected CDN address, and to generate an access signature for a private object storage, so as to facilitate the interaction between the redirected CDN address and the Aliyun object storage; The Aliyun object storage is configured to provide a resource storage management function, and to support redirection of a CDN back to the object storage; The configuration to support redirection jump specifically includes that the back-to-source CDN adopts an Aliyun generic domain name format, and is configured to locate an independent user by user information defined by a business system, and to configure a domain name in a console of the Aliyun CDN, first set a back-to-source address to point to a back-to-source service, and enable a "back-to-source 302 follow" attribute for the domain name, to support a redirected CDN address in a response of the back-to-source service; the object storage is configured to have a bucket and a key, wherein the bucket belongs to a top-level classification, the bucket is private, and a redirected CDN can only back to a bucket, a corresponding CDN access address of each bucket is generated in a console of the Aliyun object storage, and the key is a storage path. 5.The Aliyun Object Storage Service based content delivery network origin system of claim 4, wherein, The client is a device configured to support sending an HTTP request. 6.The Aliyun Object Storage Service based content delivery network origin system of claim 4, wherein, The back-to-source address of the CDN address configuration is configured to point to a specific bucket domain name address of the Aliyun object storage to be accessed. The signature module is configured to generate a redirected CDN address, and to generate an access signature for a private object storage, so as to facilitate the interaction between the redirected CDN address and the Aliyun object storage;

Images