Resource access processing method and device, computer equipment and readable storage medium
By receiving resource access requests in the content distribution node of the content distribution network, acquiring and identifying target resources, and blocking them when abnormal content is found, the problem of low processing efficiency of abnormal content in the prior art is solved, and the rapid identification and processing of abnormal content in the content distribution network is realized.
Patent Information
- Application Number
- CN202411748973.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-02
- Publication Date
- 2025-02-25
- Estimated Expiration
- 2044-12-02
AI Technical Summary
In the prior art, the detection and processing efficiency of abnormal content in the content distribution network is low, and it depends on user fault reporting and operation and maintenance personnel to handle abnormal content in a timely and effective manner.
In the content distribution node of the content distribution network, the resource access request sent by the terminal is received. If the local side does not cache the target resource, the target resource will be obtained from the source station server and the content authentication will be performed. If the target resource is abnormal content, it will be blocked in the content distribution network to prevent the terminal from accessing the resource.
By obtaining and identifying resources in the content distribution node in real time and banning abnormal content in a timely manner, the processing efficiency of abnormal content in the content distribution network is significantly improved and the risk of users being affected by adverse content is reduced.
Smart Images

Figure CN119520145A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of computer technology, and in particular to a resource access processing method, apparatus, computer equipment, computer-readable storage medium, and computer program product. Background Art
[0002] With the rapid development of Internet technology, Content Delivery Network (CDN) has become an indispensable part of the modern Internet architecture. It has greatly accelerated the transmission of data around the world and improved the speed and experience of users accessing content. However, with the explosive growth of network content, abnormal content such as bad content and illegal resources frequently appear in content distribution networks, such as malware, pirated film and television works, infringing music works, etc. These contents have greatly damaged the legitimate rights and interests of users, and brought great psychological distress and network security risks to users.
[0003] However, currently, the detection of abnormal content often relies on user reports and inspections by operation and maintenance personnel, resulting in low efficiency in handling abnormal content in content distribution networks. Summary of the invention
[0004] Based on this, it is necessary to provide a resource access processing method, apparatus, computer equipment, computer-readable storage medium and computer program product that can improve the efficiency of abnormal content processing in a content distribution network in response to the above technical problems.
[0005] In a first aspect, the present application provides a resource access processing method, which is applied to a content distribution node in a content distribution network, comprising:
[0006] receiving a resource access request sent by a terminal, and obtaining the target resource from an origin server of a content distribution network when the target resource requested by the resource access request is not cached by the local end;
[0007] When the local end obtains the target resource from the source server, it performs content identification on the target resource and obtains the content identification result of the target resource;
[0008] When the content identification result indicates that the target resource is abnormal content, the target resource is blocked in the content distribution network to prevent the terminal from accessing the target resource through a resource access request.
[0009] In a second aspect, the present application further provides a resource access processing device, which is applied to a content distribution node in a content distribution network, comprising:
[0010] An access request receiving module, used to receive a resource access request sent by a terminal, and when the local end does not cache the target resource requested by the resource access request, obtain the target resource from the source server of the content distribution network;
[0011] The content identification module is used to perform content identification on the target resource when the local end obtains the target resource from the source server, and obtain the content identification result of the target resource;
[0012] The resource blocking module is used to block the target resource in the content distribution network when the content identification result indicates that the target resource belongs to abnormal content, so as to prevent the terminal from accessing the target resource through the resource access request.
[0013] In a third aspect, the present application further provides a computer device, wherein the computer device comprises a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the steps of the above resource access processing method are implemented.
[0014] In a fourth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the steps of the above resource access processing method are implemented.
[0015] In a fifth aspect, the present application further provides a computer program product, which includes a computer program, and when the computer program is executed by a processor, the steps of the above resource access processing method are implemented.
[0016] The resource access processing method, apparatus, computer device, computer-readable storage medium and computer program product described above, when the local end of the content distribution node in the content distribution network does not cache the target resource requested by the resource access request, obtains the target resource from the source station server of the content distribution network, and identifies the content of the obtained target resource. When the content identification result indicates that the obtained target resource belongs to abnormal content, the target resource is blocked in the content distribution network to prevent the terminal from accessing the target resource through the resource access request. Therefore, when the content distribution node obtains the target resource belonging to abnormal content from the source station server, the target resource can be blocked in the content distribution network in a timely manner, thereby improving the processing efficiency of abnormal content in the content distribution network. BRIEF DESCRIPTION OF THE DRAWINGS
[0017] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the drawings required for use in the embodiments of the present application or related technical descriptions will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.
[0018] Figure 1 An application environment diagram of a resource access processing method in an embodiment;
[0019] Figure 2 A schematic diagram of a process flow of a resource access processing method in one embodiment;
[0020] Figure 3 A schematic diagram of a process flow of resource pre-identification processing in one embodiment;
[0021] Figure 4 A schematic diagram of a flow chart of a resource access processing method in another embodiment;
[0022] Figure 5 is a structural block diagram of a resource access processing device in an embodiment;
[0023] Figure 6 FIG. 4 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION
[0024] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0025] The resource access processing method provided in the embodiment of the present application can be applied to Figure 1 In the application environment shown. Among them, the terminal 102 communicates with the content distribution node 104 in the content distribution network through the network, and the data storage system connected to the content distribution node 104 can store the data that the content distribution node 104 needs to process. The data storage system can be integrated on the content distribution node 104, or it can be placed on the cloud or other network servers. The content distribution node 104 communicates with the source station server 106 in the content distribution network through the network, and the data storage system connected to the source station server 106 can store the data that the source station server 106 needs to process. The data storage system can be integrated on the source station server 106, or it can be placed on the cloud or other network servers.
[0026] The user may send a resource access request to the content distribution node 104 in the content distribution network through the terminal 102 to request access to the target resource. When the content distribution node 104 determines that the local end has not cached the target resource requested by the resource access request, the content distribution node 104 may obtain the target resource from the source station server 106. After the content distribution node 104 obtains the target resource from the source station server 106, the content distribution node 104 may perform content identification on the obtained target resource. When the content identification result indicates that the obtained target resource is abnormal content, the content distribution node 104 may block the target resource in the content distribution network to prevent the terminal 102 from accessing the target resource through the resource access request.
[0027] The terminal 102 may be, but is not limited to, various personal computers, laptops, smart phones, tablet computers, IoT devices, and portable wearable devices. IoT devices may be smart speakers, smart TVs, smart air conditioners, smart car devices, projection devices, etc. Portable wearable devices may be smart watches, smart bracelets, head-mounted devices, etc. Head-mounted devices may be virtual reality (VR) devices, augmented reality (AR) devices, smart glasses, etc. The content distribution node 104 or the source server 106 may be an independent physical server, or a server cluster or distributed system consisting of multiple physical servers, or a cloud server that provides cloud computing services.
[0028] In an exemplary embodiment, Figure 2 As shown, a resource access processing method is provided, which is applied to Figure 1 The content distribution node in is taken as an example to illustrate, including the following steps 202 to 206. Among them:
[0029] Step 202: receiving a resource access request sent by a terminal, and when the local end does not cache the target resource requested by the resource access request, obtaining the target resource from an origin server of a content distribution network.
[0030] Among them, the content distribution network is a technology that achieves efficient content distribution and accelerated transmission by deploying multiple node servers in the network. The content distribution node is a node server deployed in the content distribution network, which is used to transmit content between the source server and the terminal. The resource access request is sent by the terminal to the content distribution node in the content distribution network to request the content distribution node to return the required resource content. The target resource is the resource content requested by the user through the resource access request, which may include various forms of resource content such as web pages, videos, images, and audio. The source server is a server that stores the original content in the content distribution network. The source server stores all the original data of the website or application, including static or dynamic resources such as web pages, pictures, videos, and audio. As the original provider of content, the source server is the source of data distribution, and can specifically distribute content to the terminal through the content distribution node.
[0031] Exemplarily, a content distribution node in a content distribution network may receive a resource access request sent by a terminal, and determine the target resource requested to be accessed by the user based on the resource access request. For example, the resource access request may carry a resource identifier of the target resource, and the content distribution node may determine the target resource requested to be accessed by the user based on the resource identifier. The content distribution node may query whether the target resource is cached at the local end, such as the content distribution node may query at the local end according to the resource identifier of the target resource to determine whether the local end has pre-cached the target resource. When it is determined that the local end does not cache the target resource, the content distribution node may obtain the target resource from the source station server of the content distribution network. In some embodiments, the content distribution node may send a resource acquisition request to the source station server to request to obtain the target resource.
[0032] Step 204: When the local end obtains the target resource from the source server, content identification is performed on the target resource to obtain a content identification result of the target resource.
[0033] Among them, the content identification result is obtained by performing content identification on the target resource, such as performing content identification on the target resource through a third-party security service or a self-defined identification algorithm to obtain a corresponding content identification result. Optionally, the content distribution node can obtain the target resource from the source station server, and perform content identification on the obtained target resource to obtain a content identification result of the target resource. In some embodiments, the content distribution node can directly perform content identification on the target resource to identify whether the target resource belongs to abnormal content, such as identifying whether the target resource includes illegal content. The content distribution node can also send the target resource to a third party, and the third party will perform content identification on the target resource and return the corresponding content identification result.
[0034] Step 206: When the content identification result indicates that the target resource is abnormal content, the target resource is blocked in the content distribution network to prevent the terminal from accessing the target resource through the resource access request.
[0035] Exemplarily, when the content identification result indicates that the target resource belongs to abnormal content, it indicates that the target resource includes illegal content and needs to be restricted in access. The content distribution node can block the target resource in the content distribution network, such as removing the target resource in the content distribution network, thereby preventing the terminal from accessing the target resource through a resource access request. In some embodiments, after the content distribution node blocks the target resource, it can return a prompt message of access failure to the terminal, thereby prompting the terminal that the access to the target resource has failed. In some embodiments, when the content identification result indicates that the target resource does not belong to abnormal content, indicating that the target resource is safe content, the content distribution node can send the obtained target resource to the terminal to implement response processing for the resource access request.
[0036] In the above-mentioned resource access processing method, when the local end of the content distribution node in the content distribution network does not cache the target resource requested by the resource access request, the target resource is obtained from the source station server of the content distribution network, and the content of the obtained target resource is identified. When the content identification result indicates that the obtained target resource belongs to abnormal content, the target resource is blocked in the content distribution network to prevent the terminal from accessing the target resource through the resource access request. Therefore, when the content distribution node obtains the target resource belonging to abnormal content from the source station server, the target resource can be blocked in the content distribution network in a timely manner, thereby improving the processing efficiency of abnormal content in the content distribution network.
[0037] In an exemplary embodiment, when the local end obtains the target resource from the source station server, content authentication is performed on the target resource to obtain the content authentication result of the target resource, including: determining the resource identification information of the target resource and the node information of the content distribution node; generating a content authentication request based on the resource identification information and the node information; sending the content authentication request to the content authentication server, the content authentication request is used to instruct the content authentication server to perform content authentication on the target resource and return the content authentication result; obtaining the content authentication result for the target resource returned by the content authentication server.
[0038] The resource identification information is used to identify the target resource, and specifically may include but is not limited to at least one of various identification information including the resource name of the target resource, resource ID (Identification), resource address, etc. The node information is used to describe the content distribution node, and specifically may include but is not limited to at least one of various information including the network address of the content distribution node, the hardware address, node identification, etc. The content authentication request is used to request the content authentication server to perform content authentication on the target resource, and the content authentication server may be a server dedicated to performing content authentication.
[0039] Exemplarily, the content distribution node can determine the resource identification information of the target resource and the node information of the content distribution node, such as the content distribution node can determine the URL (Uniform Resource Locator) of the target resource and the IP (Internet Protocol) address of the content distribution node. The content distribution node can generate a content identification request based on the resource identification information and the node information, and send the content identification request to the content identification server to instruct the content identification server to perform content identification on the target resource and return the content identification result. In some embodiments, the content identification server can obtain the target resource based on the content identification request, perform content identification on the obtained target resource, and return the obtained content identification result to the content distribution node. The content distribution node can receive the content identification result returned by the content identification server, and block or distribute the target resource based on the content identification result.
[0040] In some embodiments, the content distribution node can directly perform preliminary content identification on the target resource, that is, the content distribution node can perform content identification on the target resource at the local end to obtain a preliminary identification result. When the preliminary identification result indicates that the target resource belongs to abnormal content, the content distribution node can send a content identification request to the content identification server to perform further in-depth content identification on the target resource, and obtain the content identification result according to the in-depth identification result returned by the content identification server. In some embodiments, the content distribution node can perform multiple preliminary content identifications on the target resource at the local end, and obtain the preliminary identification result by combining the identification results of multiple preliminary content identifications. In some embodiments, the content distribution node can also set different weights for the preliminary content identification at the local end and the in-depth content identification of the content identification server, and obtain the content identification result by combining the preliminary identification results and the in-depth identification results according to their respective weights.
[0041] In this embodiment, the content distribution node generates a content identification request based on the resource identification information of the target resource and the node information of the content distribution node, and instructs the content identification server to perform content identification on the target resource through the content identification request, thereby achieving accurate content identification of the target resource, so as to timely detect the resource content that needs to be blocked.
[0042] In an exemplary embodiment, the content identification server is also used to: upon receiving a content identification request, determine a resource identification database, the resource identification database including various resources that have completed content identification and their corresponding content identification results; based on the resource identification information in the content identification request, query the resource identification database to obtain the query result; when the query result indicates that the target resource has not completed content identification, perform content identification on the target resource, and return the obtained content identification result to the content distribution node; when the query result indicates that the target resource has completed content identification, obtain the content identification result of the target resource from the resource identification database, and return the content identification result to the content distribution node.
[0043] The resource identification database is used to record various resources that have completed content identification and their corresponding content identification results, that is, the resources that have completed content identification can be recorded through the resource identification database.
[0044] Exemplarily, after receiving the content identification request, the content identification server can determine the pre-built resource identification database, and query the resource identification database to determine whether the content identification record of the target resource is stored in the resource identification database. Optionally, the content identification server can extract the resource identification information from the content identification request, and perform a matching query in the resource identification database according to the resource identification information to obtain a corresponding query result. When the query result indicates that the target resource has not completed content identification, that is, the resource identification database does not include the content identification record of the target resource, the content identification server can perform content identification on the target resource, such as the content identification server can obtain the target resource from the content distribution node according to the resource identification information and node information in the content identification request, and perform content identification on the target resource, and return to the content distribution node after obtaining the corresponding content identification result. In some embodiments, when the query result indicates that the target resource has completed content identification, that is, the content identification record of the target resource has been stored in the resource identification database, indicating that the target resource has completed content identification, the content identification server can directly obtain the content identification result of the target resource from the resource identification database, and return it to the content distribution node.
[0045] In some embodiments, the resource identification database may only store content identification records corresponding to resources that do not belong to abnormal content, that is, if the resource identification database does not include a content identification record for a resource A, it indicates that the resource A may belong to abnormal content or may belong to content that has not yet been identified, and in this case, the content identification server needs to trigger content identification processing. On the other hand, if the resource identification database includes a content identification record for a resource B, it indicates that the resource B does not belong to abnormal content, and in this case, the content identification server can directly obtain the content identification result of the resource B.
[0046] In this embodiment, the content identification server queries the resource identification database to see whether there is a content identification record for the target resource. If there is a corresponding content identification record, the corresponding content identification result can be directly obtained from the resource identification database, thereby improving the processing efficiency of content identification.
[0047] In an exemplary embodiment, when the content identification result indicates that the target resource belongs to abnormal content, the target resource is blocked in the content distribution network to prevent the terminal from accessing the target resource through a resource access request, including: when the content identification result indicates that the target resource belongs to abnormal content, a blocking instruction is sent to each node in the content distribution network, and the blocking instruction is used to instruct each node to block access to the target resource.
[0048] The blocking instruction is used to instruct each node to block access to the target resource, and can be specifically propagated by the content distribution node in the content distribution network, or by the content authentication server that performs content authentication among the various content distribution nodes in the content distribution network.
[0049] Exemplarily, when the content identification result indicates that the target resource belongs to abnormal content, it indicates that the target resource may have security risks and needs to be banned. The content distribution node can send a banning instruction to each node in the content distribution network to instruct each node to block access to the target resource through the banning instruction. In some embodiments, when the content identification result indicates that the target resource belongs to abnormal content, the content distribution node can return a banning instruction to the content identification server or the source server, so that the content identification server or the source server sends a banning instruction to each node in the content distribution network, thereby blocking access to the target resource in the content distribution network. In some embodiments, after receiving the banning instruction, each node in the content distribution network can delete the target resource cached locally and block the terminal from accessing the target resource.
[0050] In this embodiment, when the content identification result indicates that the target resource belongs to abnormal content, a ban instruction is sent to each node in the content distribution network to instruct each node to block access to the target resource through the ban instruction. The target resource can be banned in each node of the content distribution network in a timely manner, thereby improving the processing efficiency of abnormal content in the content distribution network.
[0051] In an exemplary embodiment, the resource access processing method further includes: when the local end has cached the target resource requested by the resource access request, obtaining the target resource from the local end; and sending the target resource to the terminal according to the resource access request.
[0052] Exemplarily, when the target resource requested by the resource access request has been cached in the local end of the content distribution node, it indicates that the target resource does not belong to abnormal content, that is, any node in the content distribution network did not block the target resource when caching the target resource. The content distribution node can directly obtain the target resource from the local end and distribute the target resource to the terminal to implement response processing for the resource access request.
[0053] In this embodiment, when the local end of the content distribution node has cached the target resource, the content distribution node can directly distribute the target resource to the corresponding terminal, thereby enabling the terminal to quickly access the target resource.
[0054] In an exemplary embodiment, Figure 3 As shown, the resource access processing method also includes resource pre-identification processing, specifically including steps 302 to 306. Among them:
[0055] Step 302: When it is detected that the content authentication trigger condition is met, the resource to be authenticated is obtained from the content distribution network.
[0056] The content identification triggering condition is used to determine whether to trigger content identification processing for resources. The content identification triggering condition can be flexibly set according to actual needs, such as including triggering conditions such as identification cycle and resource popularity. The resource to be identified is the resource that needs to be identified.
[0057] Exemplarily, the content distribution node can detect whether a preset content identification trigger condition is met, such as whether a preset identification period is reached, or whether there are unidentified hot resources. When the content identification trigger condition is met, the content distribution node can obtain the resources to be identified from the content distribution network. For example, the content distribution node can obtain resources from the content distribution network within the identification period, or obtain hot resources from the content distribution network whose resource heat exceeds a heat threshold.
[0058] Step 304: Perform content identification on the resource to be identified, and obtain a content identification result corresponding to the resource to be identified.
[0059] Optionally, the content distribution node may trigger content authentication for the resource to be authenticated. Specifically, the content distribution node may directly authenticate the resource to be authenticated, or a content authentication server may authenticate the resource to be authenticated, thereby obtaining a content authentication result corresponding to the resource to be authenticated.
[0060] Step 306: When the content identification result corresponding to the resource to be identified indicates that the resource to be identified is abnormal content, the resource to be identified is blocked in the content distribution network to prevent access to the resource to be identified.
[0061] Exemplarily, when the content identification result corresponding to the resource to be identified indicates that the resource to be identified is abnormal content, the content distribution node can block the resource to be identified in the content distribution network. For example, the content distribution node can send a blocking instruction to each node in the content distribution network to instruct each node to block access to the resource to be identified.
[0062] In this embodiment, the content distribution node can perform content identification on the resources to be identified in the content distribution network when the content identification trigger condition is met, so that content identification can be performed before the terminal accesses it, thereby improving the processing efficiency of abnormal content in the content distribution network.
[0063] The present application also provides an application scenario, and the application scenario applies the above-mentioned resource access processing method. Specifically, the application of the resource access processing method in the application scenario is as follows:
[0064] With the rapid development of Internet technology, content distribution network (CDN) has become an important tool to improve website access speed and performance. Content distribution network is a network that stores resources needed by users in a distributed manner and serves customers nearby. However, when the domain name accelerated website cached by CDN nodes is full of bad resources, the processing methods of existing technologies often seem to be stretched. At present, after detecting abnormal resources, CDN nodes usually adopt a post-processing mechanism, that is, after waiting for customers to report the problem, the operation and maintenance personnel will go online urgently and delete the abnormal resources from the entire network. This processing method is not only inefficient and difficult to respond in time and eliminate adverse effects, but also may cause users to encounter bad content during the access process, causing customer complaints and dissatisfaction. Therefore, the existing CDN cache management mechanism has obvious limitations and shortcomings in dealing with bad resources. In order to solve these problems, we urgently need a system and device that can realize timely identification and effective interception of user access content. The system and device should have the ability to automatically identify abnormal resources in real time, and can automatically issue blocking measures after abnormal resources are found to ensure the purity and security of user access content.
[0065] Based on this, this embodiment provides a solution that can automatically identify illegal resources and issue a network-wide ban in real time, so as to overcome the drawback that the current CDN node needs to manually delete the illegal resources after discovering them. With the increasing complexity and diversity of the network environment, bad content and illegal resources frequently appear in the network, which brings great troubles and security risks to users. The traditional processing method often relies on user reporting and manual operation of operation and maintenance personnel. This processing method is inefficient and cannot effectively and timely curb the spread of illegal resources. Therefore, the present application aims to achieve rapid positioning, accurate identification and immediate processing of illegal resources by introducing automatic identification technology and real-time ban mechanism. The resource access processing method provided by the present application will monitor the cache resources in the CDN node in real time. Once illegal content is found, the system will immediately start the automatic ban process and completely remove the relevant resources from the CDN network to ensure the purity and security of the user's access to the content. Based on the resource access processing method provided by the present application, the processing efficiency of CDN nodes for illegal resources can be significantly improved, the impact of bad content on users can be reduced, and the work pressure of operation and maintenance personnel can be reduced, and the health and security of the entire network environment can be improved.
[0066] Specifically, the resource access processing method provided in this embodiment focuses on the automatic identification and real-time blocking of illegal resources. CDN resources are pulled layer by layer from edge nodes to parent nodes and then to the source station to achieve efficient content distribution. In order to ensure the legitimacy and security of the content, the resource access processing method provided in this embodiment introduces content identification processing after the resource is first cached in the parent layer. Specifically, when the resource is cached in the parent node for the first time, an identification request is automatically triggered to the content identification center. The identification request contains the IP address of the device where the resource to be identified is located and the unique identifier of the resource. The content identification center is responsible for receiving the identification request and obtaining the resource from the specified device and then calling the external interface to identify the resource content. These external interfaces may include but are not limited to various security scanning tools, virus detection services or content filtering APIs (Application Programming Interfaces). Once the content identification center detects that the resource is abnormal through the external interface, such as containing malicious code, viruses, pornographic content, etc., it will immediately start the whole network blocking process. The blocking task will be directly issued by the content identification center to all CDN devices, including edge nodes and parent nodes, to ensure that abnormal resources are quickly isolated and removed throughout the network.
[0067] In addition, in order to improve the response speed and accuracy of the system, the resource access processing method provided in this embodiment also introduces a cache preheating and content pre-checking mechanism. Specifically, before the resource is requested by the user, the system can pull the resource to the parent node in advance and perform content authentication, thereby ensuring that legal and safe content can be provided immediately when the user requests it.
[0068] Specifically, when the resource access processing method provided in this embodiment is applied to a CDN system, it can realize automatic identification and real-time blocking of illegal resources, thereby ensuring the legality and security of user access to content. Figure 4 As shown, when a CDN node caches a resource for the first time, it can initiate a resource review request to the content identification center. The resource identification interface of the content identification center pulls the resource to be identified from the CDN node and initiates an external call to perform content identification. For the identified abnormal resources, a network-wide ban instruction can be issued so that the CDN network-wide nodes can ban them. The specific processing may include the following:
[0069] 1. Resource Pull: When a user requests a resource for the first time, if the cache does not hit, that is, the parent cache device ctl-cache-status response header is miss, the CDN system will pull the resource from the origin site, cache it in the parent node, respond to the user, and asynchronously start the content review logic. If the cache hits, that is, the parent cache device ctl-cache-status response header is hit, it will directly respond to the user and skip the content review logic;
[0070] 2. Identification request: Once a resource is successfully cached for the first time in the parent node, the system will automatically send an identification request to the content identification center. This request will contain the resource's unique identifier (such as URL or file hash value) and the IP address of the parent device where the resource is located, as well as other necessary metadata information; the URL contains the address and location information of the resource, which is used to uniquely identify a resource;
[0071] 3. Content Identification: After receiving the identification request, the content identification center will use the provided unique identifier and the IP address of the resource to pull the corresponding resource from the cache of the CDN node and call the external interface to identify the resource content. These external interfaces can be third-party security services or custom identification algorithms. If the resource is identified as abnormal, such as pornographic, terrorist, and violent content given by the AI (Artificial Intelligence) algorithm, the content identification center will generate a ban instruction, which can be an HTTP (HyperTextTransfer Protocol) interface call containing the unique identifier of the resource. In order to ensure the uniqueness of resource verification and save the cost of using the verification interface, a global database is deployed in the content identification center. Before starting each resource verification, the resource verification result is queried from the database. If it hits, it means that the resource has been verified. If it does not hit, the verification of the external interface is started.
[0072] 4. Network-wide ban: The ban command will be issued by the content identification center to all CDN devices through interface calls. These devices will immediately remove abnormal resources from the cache and prevent subsequent users from accessing the resources. At the same time, the system will also record relevant logs for subsequent analysis and auditing;
[0073] 5. Cache preheating and content prechecking: In order to improve the response speed and accuracy of the system, the system can perform cache preheating and content prechecking for popular resources regularly or on demand. This means that before the resource is requested by the user, the system has already pulled it to the parent node and performed content identification in advance. Therefore, when the user requests these resources, the system can immediately provide legal and safe content.
[0074] The resource access processing method provided in this embodiment is intended to realize an efficient and accurate automatic content review system, which can detect the content transmitted in the CDN network in real time and immediately ban abnormal resources. Specifically, it includes:
[0075] Real-time monitoring and detection: the system monitors the traffic and content transmission of CDN nodes in real time, and starts the verification mechanism after the resource is cached in the CDN network for the first time. Once an abnormal resource is detected, such as malicious code, pornographic content, infringing information, etc., the review mechanism is immediately triggered;
[0076] Instant blocking and isolation: For abnormal resources that are confirmed to be in violation, the system will immediately issue a blocking instruction and notify CDN devices across the entire network to ensure that abnormal resources are quickly isolated and removed. At the same time, the system will also record relevant logs for subsequent analysis and auditing;
[0077] Uniqueness of resource verification: In order to save the high cost of API interface calls, an authentication request is only initiated when the parent node caches the resource for the first time, and a secondary deduplication mechanism is implemented in the content authentication center to ensure the uniqueness of resource verification.
[0078] In the resource access processing method provided in this embodiment, through real-time monitoring and automated auditing, the system can timely discover and process illegal content, effectively curb the spread of bad information, protect users from the infringement of bad content, and improve content security. Moreover, the traditional content audit method usually requires manual participation, which is time-consuming and error-prone, while the resource access processing method provided in this embodiment can quickly and accurately complete the content audit work, greatly improving the audit efficiency. In addition, the automated audit system reduces the demand for manual auditing and reduces the manpower cost of the enterprise. At the same time, since the system can discover and process abnormal resources in real time, it reduces complaints and disputes caused by illegal content, further reducing the operating costs of the enterprise. Further, by improving content security and audit efficiency, the resource access processing method provided in this embodiment can provide users with safer and more efficient network services. When using the CDN network, users can enjoy a purer and healthier network environment, thereby improving user experience. In addition, the resource access processing method provided in this embodiment is highly adaptable and can adapt to different types of CDN networks and diversified content formats. Whether it is text, pictures or multimedia content such as video, the system can effectively audit and ban. Finally, the resource access processing method provided in this embodiment has a low authentication cost. Authentication is initiated when resources are first cached, and the content authentication center supports an authentication deduplication mechanism, which effectively ensures a one-time inspection of resources across the entire network and greatly saves API call costs.
[0079] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.
[0080] Based on the same inventive concept, the embodiment of the present application also provides a resource access processing device for implementing the resource access processing method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in the one or more resource access processing device embodiments provided below can refer to the limitations on the resource access processing method above, and will not be repeated here.
[0081] In an exemplary embodiment, Figure 5 As shown, a resource access processing device 500 is provided, which is applied to a content distribution node in a content distribution network, including: an access request receiving module 502, a content identification module 504 and a resource blocking module 506, wherein:
[0082] The access request receiving module 502 is used to receive a resource access request sent by a terminal, and when the local terminal does not cache the target resource requested by the resource access request, obtain the target resource from the source server of the content distribution network;
[0083] The content identification module 504 is used to perform content identification on the target resource when the local end obtains the target resource from the source server, and obtain the content identification result of the target resource;
[0084] The resource blocking module 506 is used to block the target resource in the content distribution network when the content identification result indicates that the target resource belongs to abnormal content, so as to prevent the terminal from accessing the target resource through the resource access request.
[0085] In an exemplary embodiment, the content identification module 504 is also used to determine the resource identification information of the target resource and the node information of the content distribution node; generate a content identification request based on the resource identification information and the node information; send the content identification request to the content identification server, the content identification request is used to instruct the content identification server to perform content identification on the target resource and return the content identification result; obtain the content identification result for the target resource returned by the content identification server.
[0086] In an exemplary embodiment, the content identification server is also used to, upon receiving a content identification request, determine a resource identification database, the resource identification database including various resources that have completed content identification and their corresponding content identification results; based on the resource identification information in the content identification request, query the resource identification database to obtain the query result; when the query result indicates that the target resource has not completed content identification, perform content identification on the target resource, and return the obtained content identification result to the content distribution node; when the query result indicates that the target resource has completed content identification, obtain the content identification result of the target resource from the resource identification database, and return the content identification result to the content distribution node.
[0087] In an exemplary embodiment, the resource blocking module 506 is also used to send a blocking instruction to each node in the content distribution network when the content identification result indicates that the target resource belongs to abnormal content, and the blocking instruction is used to instruct each node to block access to the target resource.
[0088] In an exemplary embodiment, it also includes a resource distribution module, which is used to obtain the target resource from the local end when the local end has cached the target resource requested by the resource access request; and send the target resource to the terminal according to the resource access request.
[0089] In an exemplary embodiment, it also includes a pre-identification module, which is used to obtain resources to be identified from the content distribution network when it is detected that a content identification trigger condition is met; perform content identification on the resources to be identified to obtain content identification results corresponding to the resources to be identified; when the content identification results corresponding to the resources to be identified indicate that the resources to be identified are abnormal content, ban the resources to be identified in the content distribution network to prevent access to the resources to be identified.
[0090] Each module in the resource access processing device can be implemented in whole or in part by software, hardware, or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each module.
[0091] In an exemplary embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as shown in FIG. Figure 6 As shown. The computer device includes a processor, a memory, an input / output interface (Input / Output, referred to as I / O) and a communication interface. The processor, the memory and the input / output interface are connected through a system bus, and the communication interface is connected to the system bus through the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store various data involved in the resource access processing method. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a resource access processing method is implemented.
[0092] Those skilled in the art will understand that Figure 6The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.
[0093] In one embodiment, a computer device is further provided, including a memory and a processor, wherein a computer program is stored in the memory, and the processor implements the steps in the above method embodiments when executing the computer program.
[0094] In one embodiment, a computer-readable storage medium is provided, storing a computer program, which implements the steps in the above method embodiments when executed by a processor.
[0095] In one embodiment, a computer program product is provided, including a computer program, which implements the steps in the above method embodiments when executed by a processor.
[0096] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant regulations.
[0097] A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, an artificial intelligence (AI) processor, etc., but are not limited to this.
[0098] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.
[0099] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.
Claims
1. A resource access processing method, characterized in that: Applied to a content distribution node in a content distribution network, the method comprises: receiving a resource access request sent by a terminal, and obtaining the target resource from an origin server of the content distribution network when the local end does not cache the target resource requested by the resource access request; When the local end obtains the target resource from the source server, content identification is performed on the target resource to obtain a content identification result of the target resource; When the content identification result indicates that the target resource belongs to abnormal content, the target resource is blocked in the content distribution network to prevent the terminal from accessing the target resource through the resource access request.
2. The method according to claim 1, characterized in that When the local end obtains the target resource from the source server, performing content identification on the target resource to obtain a content identification result of the target resource includes: Determine resource identification information of the target resource and node information of the content distribution node; Generate a content authentication request according to the resource identification information and the node information; Sending the content authentication request to a content authentication server, wherein the content authentication request is used to instruct the content authentication server to perform content authentication on the target resource and return a content authentication result; The content identification result for the target resource returned by the content identification server is obtained.
3. The method according to claim 2, characterized in that The content authentication server is also used for: When receiving the content identification request, determining a resource identification database, wherein the resource identification database includes various resources that have completed content identification and their corresponding content identification results; Based on the resource identification information in the content identification request, querying the resource identification database to obtain a query result; When the query result indicates that the target resource has not completed content identification, performing content identification on the target resource, and returning the obtained content identification result to the content distribution node; When the query result indicates that the target resource has completed content identification, the content identification result of the target resource is obtained from the resource identification database, and the content identification result is returned to the content distribution node.
4. The method according to claim 1, characterized in that: When the content identification result indicates that the target resource belongs to abnormal content, blocking the target resource in the content distribution network to prevent the terminal from accessing the target resource through the resource access request includes: When the content identification result indicates that the target resource is abnormal content, a blocking instruction is sent to each node in the content distribution network, and the blocking instruction is used to instruct each node to block access to the target resource.
5. The method according to claim 1, characterized in that The method further comprises: When the local end has cached the target resource requested by the resource access request, obtaining the target resource from the local end; The target resource is sent to the terminal according to the resource access request.
6. The method according to any one of claims 1 to 5, characterized in that: The method further comprises: When it is detected that a content authentication trigger condition is met, obtaining a resource to be authenticated from the content distribution network; Performing content identification on the resource to be identified, and obtaining a content identification result corresponding to the resource to be identified; When the content identification result corresponding to the resource to be identified indicates that the resource to be identified is abnormal content, the resource to be identified is blocked in the content distribution network to prevent access to the resource to be identified.
7. A resource access processing device, characterized in that: Applied to a content distribution node in a content distribution network, the device comprises: An access request receiving module, configured to receive a resource access request sent by a terminal, and when the local terminal does not cache the target resource requested by the resource access request, obtain the target resource from the source server of the content distribution network; A content identification module, used for performing content identification on the target resource when the local end obtains the target resource from the source server, and obtaining a content identification result of the target resource; The resource blocking module is used to block the target resource in the content distribution network when the content identification result indicates that the target resource belongs to abnormal content, so as to prevent the terminal from accessing the target resource through the resource access request.
8. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 6 are implemented.
9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.
10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.
Citation Information
Patent Citations
Method and system for performing authentication on access request
CN105357190A
Access request processing method and CDN node server
CN109391686A
Resource management method and system and storage medium
CN111327606A
Network distribution content detection processing device, method, system and electronic equipment
CN111600772A
CDN resource banning method and device, electronic equipment and storage medium
CN114070652A