Application layer protection capability threat feature unified scanning engine scanning improvement method
By establishing a comprehensive feature engine library in the next-generation cloud firewall, using a multi-mode matching finite state machine to perform a scan to achieve detection of multiple application layer protection capabilities, solving the problem of slow processing capabilities of traditional firewalls in the application layer protection under the cloud. , improves business detection efficiency and performance.
Patent Information
- Application Number
- CN202410857414.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-06-28
- Publication Date
- 2024-11-08
- Estimated Expiration
- 2044-06-28
AI Technical Summary
In the application layer protection of traditional next-generation firewalls under the cloud, the characteristic engine scanning of multiple protection capabilities results in slow processing capabilities, affecting business detection efficiency and performance.
By establishing a comprehensive feature engine library, using feature rule IDs for marking processing, and generating a multi-mode matching finite state machine, service traffic can achieve safe detection of all protection capabilities in just one scan, improving detection efficiency.
It realizes efficient detection and processing of business traffic, improves the efficiency of application layer protection, supports rich application layer protection capabilities, such as IPS, AV, and WAF, reduces repeated scanning of feature libraries, and improves the service processing speed of cloud next-generation firewalls.
Smart Images

Figure CN118921185A_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the field of cloud security network communication technology, and in particular relates to a method for improving the threat feature unified scanning engine scanning of application layer protection capabilities. Background Art
[0002] With the widespread application of cloud computing, more and more users are starting to move their businesses to the cloud. The security protection of cloud businesses is becoming more and more important. Cloud next-generation firewalls provide protection for the boundaries of user cloud businesses. In terms of application layer protection, cloud next-generation firewalls need to have more protection functions (such as IPS, AV, WAF, threat intelligence, etc.) and more efficient protection processing to provide users with comprehensive and efficient cloud security protection.
[0003] The application layer protection of traditional next-generation firewalls has multiple protection capabilities, including but not limited to intrusion detection, virus protection, web application protection, threat intelligence analysis, etc., which should also be available on cloud next-generation firewalls. The mainstream of the above-mentioned multiple application layer protection capabilities is still that each has its own feature library. Each feature library generates a feature engine, and the user business traffic is scanned and matched in each feature engine to determine whether it is a threat traffic.
[0004] Cloud next-generation firewalls integrate multiple protection capabilities, and business traffic needs to be scanned in multiple feature engines. Cloud next-generation firewalls are the boundary protection attacks for user cloud services. User cloud services must pass through cloud next-generation firewalls when entering and leaving the cloud. The more protection capabilities cloud next-generation firewalls have, the more feature engines cloud business traffic needs to be scanned, and the slower the processing capacity will be.
[0005] The cloud next-generation firewall provides protection for the user's cloud business boundary and has multiple application layer protection capabilities. Business traffic passes through the cloud next-generation firewall and must be tested by multiple application layer protection capabilities. User cloud services entering and leaving the cloud must pass through the cloud next-generation firewall, which is the performance bottleneck of user services. Therefore, how to perform efficient detection and processing so that the cloud next-generation firewall has rich protection functions and efficient business detection capabilities is a technical problem that needs to be solved at present. Summary of the invention
[0006] In view of the above deficiencies in the prior art, the object of the invention is to provide a threat feature unified scanning engine scanning enhancement method for application layer protection capabilities with efficient detection processing, so that the cloud next-generation firewall has rich protection functions and efficient business detection capabilities.
[0007] The present invention proposes a method for improving the threat feature unified scanning engine scanning of application layer protection capability, comprising:
[0008] S1, each protection capability of the application layer establishes its own feature description information storage data structure to generate a feature library; wherein the feature library of each protection capability is independent, and the feature description information in the feature library uses the feature rule ID as a keyword to uniquely determine the feature;
[0009] S2, marking the feature rule IDs of all protection capabilities and establishing a comprehensive feature engine library;
[0010] S3, executes application layer business protection processing, the business traffic is scanned by the comprehensive feature engine library, and all hit features are returned. The feature rule ID is reversely processed into the features of each protection capability, and the feature description information storage data structure of each protection capability is searched to obtain the hit feature information, send log information, process the execution action of the feature, and determine whether to prohibit or release the business traffic.
[0011] Furthermore, in step S1, the feature rule ID number is 32 bits.
[0012] Furthermore, in step S1, each feature includes: a feature description and a feature content, wherein the feature description includes description information of the feature, a priority of the feature and an execution action of the feature; and the feature content includes: key information of whether it is a threat.
[0013] Furthermore, in step S2, the establishment of a comprehensive feature engine library includes: modifying the feature rule ID for the features of the feature library of all protection capabilities, taking the lower 24 bits of the feature rule ID, and setting the upper 8 bits 0x01 to 0xFF to specify the classification of different protection capabilities, thereby serving as a protection classification to distinguish features. After the feature library rule ID of all protection capabilities is modified based on this, the feature library rule IDs of all protection capabilities are unique.
[0014] Furthermore, in step S2, a comprehensive feature engine is jointly established for all protection capabilities, and the comprehensive feature engine is a finite state machine for multi-mode matching.
[0015] Furthermore, the comprehensive feature engine is generated using an AC algorithm or a hyperscan tool.
[0016] Furthermore, in step S3, the business traffic is scanned by the comprehensive feature engine. According to the multi-mode matching principle of the scanning engine, the business traffic is scanned once by the comprehensive feature engine, and all hit results are generated, corresponding to the hit feature rule ID. All hit rule IDs are traversed, and the obtained ID is the actual feature rule ID of this protection capability.
[0017] Furthermore, the actual feature rule ID is searched on the global radix tree Xxx_radix_tree of the protection capability, thereby obtaining a description data structure of the feature.
[0018] Furthermore, all hit feature rule IDs are traversed, the upper 8 bits of each feature rule ID are checked, the category of the protection capability is identified, the upper 8 bits of the feature rule ID are cleared, and the obtained feature rule ID is the actual rule ID of this protection capability.
[0019] Furthermore, for all hit features of the protection capability, extract the information of the feature description data structure to perform attack hit log processing, determine the feature that needs to be executed according to the priority of all features, and execute the action of the feature.
[0020] The threat feature unified scanning engine scanning improvement method of the application layer protection capability proposed in the present invention has the following beneficial effects:
[0021] (1) The business content part of the features in the feature library of all protection capabilities is used to jointly build a comprehensive feature engine. The business traffic only needs to pass through the comprehensive feature engine once to achieve security detection of all protection capabilities, thereby improving business processing efficiency and improving the detection efficiency of application layer protection.
[0022] (2) Multiple application layer protection capabilities can generate a comprehensive feature scanning engine through manual classification, which can scan business packets once and obtain the hit results of all protection capabilities. That is, the business traffic is scanned by the engine library once and all protection results, that is, the hit features, are returned, thereby improving the scanning efficiency of business traffic through the feature engine library and improving the business processing speed of the cloud next-generation firewall. All features create a unified feature engine library.
[0023] (3) Cloud next-generation firewall products can support a variety of application layer protection capabilities, such as IPS, AV, WAF, threat intelligence analysis, etc.
[0024] (4) Specify the tags of multiple application layer protections, reconstruct the feature IDs of multiple protections, ensure that all feature IDs are unique and can trace the protection to which the feature belongs. BRIEF DESCRIPTION OF THE DRAWINGS
[0025] The accompanying drawings are only used to illustrate specific embodiments and are not considered to limit the present invention. In the entire drawings, the same reference symbols represent the same components. Obviously, the drawings described below are only some embodiments recorded in the embodiments of the present invention. For those of ordinary skill in the art, other drawings can also be obtained based on these drawings.
[0026] Figure 1A flowchart of a method for improving scanning of threat characteristics of a unified scanning engine for application layer protection capability according to an embodiment of the present invention;
[0027] Figure 2 A schematic diagram of an example of a feature rule according to an embodiment of the present invention;
[0028] Figure 3 This is a diagram showing an example of a storage structure of certain protection capability characteristic information according to an embodiment of the present invention;
[0029] Figure 4 After processing the IDs for the feature libraries of all protection capabilities of the embodiment of the present invention, a unified engine library example diagram is generated;
[0030] Figure 5 The figure is a flowchart of message processing according to an embodiment of the present invention. DETAILED DESCRIPTION
[0031] In order to enable those skilled in the art to better understand the technical solutions in the embodiments of the present invention, the technical solutions of the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present invention, rather than all of the embodiments. It should be understood that these descriptions are only exemplary and are not intended to limit the scope of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in the field without making creative work should fall within the scope of protection of the present invention.
[0032] Furthermore, in the following description, descriptions of well-known structures and technologies are omitted to avoid unnecessarily obscuring the concepts disclosed in the present invention.
[0033] In the description of the present invention, it should be noted that, unless otherwise clearly specified and limited, the orientation or position relationship indicated by the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inside", "outside", etc. is based on the orientation or position relationship shown in the drawings, which is only for the convenience of describing the present invention and simplifying the description, and does not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation of the present invention. In addition, the terms "first", "second", and "third" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance. The terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be a connection between the two elements. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.
[0034] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Instead, they are merely examples of methods and systems consistent with some aspects of the present invention as detailed in the appended claims.
[0035] The technical terms involved in the present invention are explained below:
[0036] IPS (Intrusion Prevention System) is a computer network security protection capability that monitors network or network device network data transmission behavior. It can timely interrupt, adjust or isolate some abnormal or harmful network data transmission behaviors, identify malicious traffic, and actively prevent such traffic from entering the protected assets.
[0037] CVE (Common Vulnerabilities & Exposures). CVE is like a dictionary table, giving a common name to widely recognized information security vulnerabilities or weaknesses that have been exposed. Using a common name can help users share data in various independent vulnerability databases and vulnerability assessment tools, although these tools are difficult to integrate together. This makes CVE a "keyword" for sharing security information. If a vulnerability specified in a vulnerability report has a CVE name, you can quickly find the corresponding patch information in any other CVE-compatible database to solve the security problem.
[0038] like Figure 1 As shown, the present invention provides a method for improving scanning with a unified scanning engine for threat features of application layer protection capabilities. This is a method for jointly building and sharing a unified scanning engine for threat features of multiple application layer protection capabilities in a cloud next-generation firewall to improve scanning efficiency. It relates to the field of cloud security network communication technology, and particularly to the field of cloud security application layer data security scanning and processing.
[0039] The method provided by the present invention realizes the multiple application layer protection capabilities of the cloud next-generation firewall. The feature library of each protection capability does not construct a feature engine separately, but the business content part of the features in the feature library of all protection capabilities is used to jointly build a comprehensive feature engine. The business traffic only needs to pass through the comprehensive feature engine once to realize the security detection of all protection capabilities.
[0040] like Figure 1 As shown, the threat feature unified scanning engine scanning improvement method of the application layer protection capability provided by the present invention includes the following steps:
[0041] S1, each protection capability of the application layer establishes its own feature description information storage data structure and generates a feature library.
[0042] Specifically, first of all, it is clear that the feature library of each protection capability is independent, and the features (rules) in the feature library use the feature rule ID as the keyword to uniquely determine the feature.
[0043] In the embodiment of the present invention, the feature rule ID number occupies 32 bits and 4 bytes. Excluding the rule ID, each feature includes: feature description and feature content. Figure 2 As shown, the feature description includes a description of the feature (such as which CVE it is), a priority of the feature, and an execution action of the feature, etc. The feature content includes key information of whether it is a threat.
[0044] Each protection capability establishes its own feature description information storage data structure. Taking the ips capability as an example, the global radix tree Ips_radix_tree, each feature of the ips feature library, with {ID, descript, priority, action} information, and ID as the keyword, is mounted to Ips_radix_tree, such as Figure 3 shown.
[0045] S2, mark the feature rule IDs of all protection capabilities and establish a comprehensive feature engine library.
[0046] Specifically, a comprehensive feature engine is jointly established for all protection capabilities. The comprehensive feature engine is a finite state machine for multi-mode matching, which is usually generated by the AC algorithm or the hyperscan tool. Among them, the AC algorithm is a classic multi-mode matching algorithm, and hyperscan is a high-performance regular expression engine and regular matching tool.
[0047] The comprehensive feature engine records all processed feature rule IDs, which is actually equivalent to a feature rule ID library for subsequent matching.
[0048] It should be noted that the method provided by the present invention does not expand the principle of the finite state machine, but only uses it.
[0049] like Figure 4As shown in the figure, for the features of the feature library of all protection capabilities, the feature rule ID is first modified. According to the empirical value, the size of the feature library of each protection capability is limited. The rule ID is 32 bits, and the lower 24 bits, that is, the size of 0xFFFFFF is 16777215, which meets the specifications of any feature library. Therefore, in theory, the upper 8 bits of the rule ID are always 0. Using this 8-bit information, the upper 8 bits 0x01 to 0xFF are manually set to specify the classification of different protection capabilities. This is used as the protection classification to distinguish features. After modifying the feature rule ID based on this, the feature library rule ID of all protection capabilities is unique.
[0050] For example, for ips capabilities, you can specify the high 8 bits of the rule ID of each ips feature as 0x01 to distinguish the protection classification of the feature.
[0051] It should be noted that the method provided by the present invention is to calculate that the types of protection capabilities of the cloud next-generation firewall do not exceed 16, so 8 bits and 1 byte can be used to distinguish. If the types of protection capabilities exceed 16, you can continue to borrow bits from the high bits, such as changing the high 8 bits to the high 10 bits, and the low 22 bits can still meet the specification of the feature.
[0052] S3, executes application layer business protection processing, the business traffic is scanned by the comprehensive feature engine library, all hit features are returned, the feature rule ID is reversed into the features of each protection capability, the feature description information storage data structure of each protection capability is searched, the hit feature information is obtained, the log information is sent, the execution action of the feature is processed, and the business traffic is determined to be prohibited or released.
[0053] like Figure 5 As shown, the business traffic is scanned by the comprehensive feature engine. According to the principle of multi-mode matching of the scanning engine, the business traffic passes through the scanning engine once, and all hit results are generated, corresponding to the hit feature rule ID. All hit feature rule IDs are traversed, and the high 8 bits of each ID are checked to identify the category of protection capability. The high 8 bits of the feature rule ID are cleared, and the obtained feature rule ID is the actual rule ID of this protection capability.
[0054] On the global radix tree Xxx_radix_tree of the protection capability, search for the actual feature rule ID, and then obtain the description data structure {ID, descript, priority, action} of the feature. For all hit features of the protection capability, extract the information of the feature description data structure to perform attack hit log processing. According to the priority of all features, determine the features that need to be executed, and execute the action of the feature, that is, determine whether to prohibit or release the business traffic.
[0055] The threat feature unified scanning engine scanning improvement method of application layer protection capability proposed in the present invention is that the feature libraries of various protection capabilities of the cloud next-generation firewall create their own description information storage structure based on the fire protection capability. After the feature library of all protection capabilities is processed by the feature rule ID tag, a unified feature engine library is established to improve the efficiency of business traffic processing in the engine library, which is applied to the business of application layer protection of the cloud next-generation firewall.
[0056] The threat feature unified scanning engine scanning enhancement method of the application layer protection capability proposed in the present invention can be applied to cloud security, cloud firewall, network security and other scenarios to achieve deep message detection of application layer message data.
[0057] The threat feature unified scanning engine scanning improvement method of the application layer protection capability proposed in the present invention has the following beneficial effects:
[0058] (1) The business content part of the features in the feature library of all protection capabilities is used to jointly build a comprehensive feature engine. The business traffic only needs to pass through the comprehensive feature engine once to achieve security detection of all protection capabilities, thereby improving business processing efficiency and improving the detection efficiency of application layer protection.
[0059] (2) Multiple application layer protection capabilities can generate a comprehensive feature scanning engine through manual classification, which can scan business packets once and obtain the hit results of all protection capabilities. That is, the business traffic is scanned by the engine library once and all protection results, that is, the hit features, are returned, thereby improving the scanning efficiency of business traffic through the feature engine library and improving the business processing speed of the cloud next-generation firewall. All features create a unified feature engine library.
[0060] (3) Cloud next-generation firewall products can support a variety of application layer protection capabilities, such as IPS, AV, WAF, threat intelligence analysis, etc.
[0061] (4) Specify the tags of multiple application layer protections, reconstruct the feature IDs of multiple protections, ensure that all feature IDs are unique and can trace the protection to which the feature belongs.
[0062] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the embodiments of the present invention, rather than to limit them. Although the present invention has been described in detail with reference to the above embodiments, those skilled in the art should understand that they can still modify the technical solutions recorded in the above embodiments, or replace some of the technical features therein by equivalents; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention. Any changes or replacements that can be easily thought of by those skilled in the art within the technical scope disclosed in the present invention should be covered within the protection scope of the present invention.
Claims
1. A method for improving the threat signature unified scanning engine scanning of application layer protection capability, characterized in that: include: S1, each protection capability of the application layer establishes its own feature description information storage data structure to generate a feature library; wherein the feature library of each protection capability is independent, and the feature description information in the feature library uses the feature rule ID as a keyword to uniquely determine the feature; S2, marking the feature rule IDs of all protection capabilities and establishing a comprehensive feature engine library; S3, executes application layer business protection processing, the business traffic is scanned by the comprehensive feature engine library, and all hit features are returned. The feature rule ID is reversely processed into the features of each protection capability, and the feature description information storage data structure of each protection capability is searched to obtain the hit feature information, send log information, process the execution action of the feature, and determine whether to prohibit or release the business traffic.
2. According to claim 1, a method for improving the threat characteristics of the application layer protection capability by a unified scanning engine, characterized in that: In step S1, the feature rule ID number is 32 bits.
3. A method for improving the threat signature of the application layer protection capability by a unified scanning engine according to claim 1 or 2, characterized in that: In step S1, Each feature includes: a feature description and feature content, wherein the feature description includes feature description information, feature priority and feature execution action; the feature content includes: key information of whether it is a threat.
4. The method for improving the threat signature unified scanning engine scanning of the application layer protection capability according to claim 2, characterized in that: In step S2, the establishment of a comprehensive feature engine library includes: The feature rule ID is modified for the features of the feature library of all protection capabilities. The lower 24 bits of the feature rule ID are taken, and the upper 8 bits 0x01 to 0xFF are set to specify the classification of different protection capabilities. This is used as the protection classification to distinguish the features. After the feature rule ID is modified based on this, the feature library rule IDs of all protection capabilities are unique.
5. The method for improving the threat signature unified scanning engine scanning of the application layer protection capability according to claim 4 is characterized in that: In step S2, A comprehensive feature engine is jointly established for all protection capabilities, and the comprehensive feature engine is a finite state machine for multi-mode matching.
6. The method for improving the threat signature unified scanning engine scanning of the application layer protection capability according to claim 5, characterized in that: The comprehensive feature engine is generated by using an AC algorithm or a hyperscan tool.
7. The method for improving the threat signature unified scanning engine scanning of the application layer protection capability according to claim 1, characterized in that: In step S3, the business traffic is scanned by the comprehensive feature engine. According to the multi-mode matching principle of the scanning engine, the business traffic is scanned once by the comprehensive feature engine, and all hit results are generated, corresponding to the hit feature rule ID. All hit rule IDs are traversed, and the obtained ID is the actual feature rule ID of this protection capability.
8. The method for improving the threat signature unified scanning engine scanning of the application layer protection capability according to claim 7, characterized in that: The actual feature rule ID is searched on the global radix tree Xxx_radix_tree of the protection capability, and then the description data structure of the feature is obtained.
9. The method for improving the threat signature unified scanning engine scanning of the application layer protection capability according to claim 7, characterized in that: Traverse all hit feature rule IDs, check the upper 8 bits of each feature rule ID, identify the category of the protection capability, clear the upper 8 bits of the feature rule ID, and the obtained feature rule ID is the actual rule ID of this protection capability.
10. The method for improving the threat signature unified scanning engine scanning of the application layer protection capability according to claim 7, characterized in that: For all hit features of the protection capability, extract the information of the feature description data structure to perform attack hit log processing, determine the feature that needs to be executed based on the priority of all features, and execute the action of the feature.
Citation Information
Patent Citations
Method for strategy processing and network equipment
CN103688489A
Firewall control method for realizing traffic monitoring of application layer
CN103957185A
Unified scan engine
CN104221024A
PCIE firewall
CN111541658A
Civil aviation air traffic control network security detection early warning platform
CN113486351A
