A Text Classification and Grading Method and System Based on Sigma Rules

CN117520547BActive Publication Date: 2026-11-17北京中睿天下信息技术有限公司
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202311488811.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-11-09
Publication Date
2026-11-17
Estimated Expiration
2043-11-09

AI Technical Summary

Technical Problem

In existing technologies, the data classification and grading detection results are strongly correlated with the detection platform, which makes it impossible for the detection rules to be universal and requires the rules to be repeatedly created on multiple platforms.

Method used

The Sigma rule conversion tool is used to preprocess text files into a unified format, and the rules are edited through a classification and grading editor. After generating Sigma rules, they are converted into query statements for various detection platforms to achieve cross-platform detection.

Benefits of technology

It achieves the universality of detection rules, enabling the use of a single set of rules for data classification and grading detection across multiple platforms, thus eliminating platform limitations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117520547B_ABST
    Figure CN117520547B_ABST
Patent Text Reader

Abstract

This invention discloses a text classification and grading method and system based on Sigma rules. The method extracts document content and converts it into corresponding text. Then, based on different detection platforms, it converts the text into import configurations for each platform. User-inputted custom rules are uniformly converted into Sigma rules, and then these Sigma rules are converted into rules for each detection platform. After both rules and content are imported into the detection platforms, the platforms perform content detection. The results from each platform are then uniformly converted into universal detection results, which are then displayed and exported using a unified structure and export component. This invention utilizes the rule conversion tool provided by Sigma to convert Sigma rules into rules for various analysis platforms. This allows for data classification and grading detection using only one set of rules across different detection platforms, overcoming platform limitations and facilitating convenient cross-platform detection.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to the field of data security technology, specifically to a text classification and grading method and system based on Sigma rules. Background Technology

[0002] In today's society, "data" has become a "factor of production" alongside land, capital, and labor, and has significant value. Once data is damaged or leaked, its use will cause harm to national security, public interests, and other areas.

[0003] The Data Security Law also clearly stipulates that failure to establish a data classification and grading protection system and implement classified and graded protection of data will result in legal liability, which should be given high priority by regulators and law enforcement.

[0004] Data classification and grading, as the foundation and core of the data classification and grading protection system, is not only the first step in data security governance, but also a pain point and challenge in current data security governance.

[0005] Sigma is a universal and open signature format that describes relevant log events in a straightforward manner. The Sigma rule format is highly flexible, easy to write, and suitable for any type of log file. Researchers or analysts can use it to describe the detection methods they have designed and developed, and share them with other security personnel. Sigma also provides rule conversion tools that can convert Sigma rules into rule formats for other systems.

[0006] Currently, data classification and grading detection is performed through private deployment or by registering accounts on relevant platforms, importing data into the platform for execution. Each platform has its own classification and grading recognition engine, and the recognition results are strongly bound to the detection platform. When using multiple platforms for data classification and grading detection, if rules with the same detection content need to be created, they must be created on each of the multiple platforms. This results in a strong correlation between the generated rules and the query platform, making it impossible to achieve universality of the detection rules. Summary of the Invention

[0007] To address this issue, this invention provides a text classification and grading method and system based on Sigma rules, thereby solving the technical problems of strong correlation between existing recognition results and detection platforms, and poor universality.

[0008] To achieve the above objectives, the embodiments of the present invention provide the following technical solutions:

[0009] According to a first aspect of the present invention, a text classification and grading method based on Sigma rules is provided, characterized in that the method includes:

[0010] S1. Import the first document file to be classified and graded, preprocess the first document file to be classified and graded, parse and obtain the second document file to be classified and graded with uniform text format;

[0011] S2. Obtain the current platform's data import configuration and convert the second document file to be classified and graded into a third document file to be classified and graded that conforms to the data import configuration;

[0012] S3. Edit the classification and grading rules through the classification and grading editor, set the rules for the attribution and detection of relevant grades and categories, and convert the edited classification and grading rules into Sigma rules and generate the corresponding fields of the Sigma rules;

[0013] S4. Convert the fields in the Sigma rule into query statements for the corresponding detection platform, and use the query statements and the corresponding detection platform to perform text detection on the third document file to be classified and graded, and generate corresponding classification and grading detection results.

[0014] Furthermore, the classification and grading rules can be edited using the classification and grading editor, setting the rules for the attribution and detection of relevant grades and categories, including:

[0015] The detection rule is keyword matching or regular expression matching;

[0016] Editing classification and grading rules includes inputting classification, grading, and detection content.

[0017] Furthermore, editing classification and grading rules involves inputting classification, grading, and detection content, including:

[0018] The detection content includes regular expressions, enumerations, and string matching.

[0019] Furthermore, the fields in the Sigma rules are converted into query statements for the corresponding detection platform, including:

[0020] Receive conversion commands and obtain the rule type of the corresponding detection platform that needs to be converted;

[0021] The conversion command converts the fields in the Sigma rules into corresponding fields that conform to the rules of the corresponding detection platform.

[0022] Generate a query statement for the corresponding detection platform based on the platform's rules and fields.

[0023] Furthermore, the text detection of the third document file to be classified and graded is performed using the query statement and the corresponding detection platform to generate the corresponding classification and grading detection results, which also includes:

[0024] Obtain the returned data and the corresponding configuration file from the classification and grading detection results;

[0025] The returned data is mapped using the corresponding configuration file, thus mapping the classification and grading detection results to standard classification and grading detection results.

[0026] The results of the standard classification and grading test are stored and output.

[0027] Furthermore, it also includes exporting and displaying standard classification and grading test results using a unified structure display and export component.

[0028] According to a second aspect of the present invention, a text classification and grading system based on Sigma rules is provided, characterized in that the system comprises:

[0029] The import module is used to import the first document file to be classified and graded, preprocess the first document file to be classified and graded, parse and obtain the second document file to be classified and graded with uniform text format;

[0030] The conversion module is used to obtain the data import configuration of the current platform and convert the second document file to be classified and graded into a third document file to be classified and graded that conforms to the data import configuration;

[0031] The Sigma rule conversion module is used to edit classification and grading rules through the classification and grading editor, set the rules for the attribution and detection of related grades and categories, and convert the edited classification and grading rules into Sigma rules and generate the corresponding fields of the Sigma rules;

[0032] The text detection module is used to convert the fields in the Sigma rules into query statements of the corresponding detection platform, and use the query statements and the corresponding detection platform to perform text detection on the third document file to be classified and graded, and generate corresponding classification and grading detection results.

[0033] Furthermore, the system also includes:

[0034] The format conversion module is used to obtain the returned data from the classification and grading detection results and obtain the corresponding configuration file; to perform content mapping on the returned data through the corresponding configuration file, mapping the classification and grading detection results to standard classification and grading detection results; and to store and output the standard classification and grading detection results.

[0035] The embodiments of the present invention have the following advantages:

[0036] This invention extracts document content and converts it into corresponding text. Then, based on different detection platforms, it converts the text into import configurations for each platform. User-inputted custom rules are uniformly converted into Sigma rules, and then these Sigma rules are converted into rules for each detection platform. After both rules and content are imported into the detection platforms, the platforms perform content detection. The results from each platform are then uniformly converted into universal detection results, and finally displayed and exported using a unified structure and export component. This invention utilizes the rule conversion tool provided by Sigma to convert Sigma rules into rules for various analysis platforms. This allows for the use of only one set of rules to perform corresponding data classification and grading detection on various detection platforms, overcoming platform limitations and facilitating convenient cross-platform detection. Attached Figure Description

[0037] To more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are merely exemplary, and those skilled in the art can derive other embodiments based on the provided drawings without creative effort.

[0038] The structures, proportions, sizes, etc. illustrated in this specification are only for the purpose of assisting those skilled in the art in understanding and reading the content disclosed herein, and are not intended to limit the conditions under which the present invention can be implemented. Therefore, they have no substantial technical significance. Any modifications to the structure, changes in the proportions, or adjustments to the size, without affecting the effects and objectives that the present invention can produce, should still fall within the scope of the technical content disclosed in the present invention.

[0039] Figure 1 A schematic diagram of the logical structure of a text classification and grading system based on Sigma rules provided in an embodiment of the present invention;

[0040] Figure 2 A flowchart illustrating a text classification and grading method based on Sigma rules provided in an embodiment of the present invention;

[0041] Figure 3 A schematic diagram of the technical architecture of a text classification and grading method based on Sigma rules provided in an embodiment of the present invention;

[0042] Figure 4 This is a flowchart illustrating the operation of a text classification and grading method based on Sigma rules, provided in an embodiment of the present invention. Detailed Implementation

[0043] The following specific embodiments illustrate the implementation of the present invention. Those skilled in the art can easily understand other advantages and effects of the present invention from the content disclosed in this specification. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0044] Currently, data classification and grading detection is performed through private deployment or by registering accounts on relevant platforms, importing data into the platform for execution. Each platform has its own classification and grading recognition engine, and the recognition results are strongly bound to the detection platform. When using multiple platforms for data classification and grading detection, if rules with the same detection content need to be created, they must be created on each of the multiple platforms. This results in a strong correlation between the generated rules and the query platform, making it impossible to achieve universality of the detection rules.

[0045] In order to solve the above-mentioned technical problems of strong correlation between existing identification results and detection platforms and poor universality.

[0046] refer to Figure 1 This invention discloses a text classification and grading system based on Sigma rules. The system includes: an import module 1; a conversion module 2; a Sigma rule conversion module 3; a text detection module 4; and a format conversion module 5.

[0047] Corresponding to the aforementioned text classification and grading system based on Sigma rules, this invention also discloses a text classification and grading method based on Sigma rules. The following details the text classification and grading method based on Sigma rules disclosed in this invention, in conjunction with the aforementioned text classification and grading system based on Sigma rules.

[0048] refer to Figures 2 to 4 This invention discloses a text classification and grading method based on Sigma rules, the method comprising:

[0049] S1. Import the first document file to be classified and graded, preprocess the first document file to be classified and graded, parse and obtain the second document file to be classified and graded with uniform text format.

[0050] In this invention, the embodiments can not only parse commonly used document formats such as doc, xslx, and csv, but also read-only files such as pdf, and generate corresponding text.

[0051] S2. Obtain the current platform's data import configuration and convert the second document file to be classified and graded into a third document file to be classified and graded that conforms to the data import configuration.

[0052] The data import configuration includes, but is not limited to, SQL statement configuration and JSON format ES insert statement configuration. If the current platform uses SQL statement configuration, it will be converted to SQL statement configuration.

[0053] S3. Edit the classification and grading rules through the classification and grading editor, set the rules for the attribution and detection of relevant grades and categories, and convert the edited classification and grading rules into Sigma rules and generate the corresponding fields of the Sigma rules.

[0054] For example, the format of a rule is as follows:

[0055]

[0056] In this context, "title" represents the name of the rule, "description" is used to add a description of the rule, "logsource" is used to add the source file path, for example, in this case, the "product" field in the "logsource" field is "mall", indicating that the product is named "mall", the "service" field is "order", indicating that the data is obtained from the order service, and the "detection" field is used to fill in the specific detection content, for example, in this case, the detection content is to detect text that contains the field "phone_number".

[0057] The "fields" field is used to indicate the category of the rule. For example, if the current category is "privacy", it means that the data detected by the current rule belongs to privacy information. "level" indicates the level, which means that the sensitivity level of the current rule is high.

[0058] S4. Convert the fields in the Sigma rule into query statements for the corresponding detection platform, and use the query statements and the corresponding detection platform to perform text detection on the third document file to be classified and graded, and generate corresponding classification and grading detection results.

[0059] Furthermore, the classification and grading rules can be edited through the classification and grading editor to set the attribution and detection rules for relevant grades and categories, including: the detection rules are keyword matching or regular expression matching; editing the classification and grading rules includes inputting the classification, grade and detection content.

[0060] Furthermore, editing classification and grading rules includes inputting classification, grading, and detection content, including: the detection content being regular expressions, enumerations, and string matching.

[0061] Further, converting the fields in the Sigma rules into query statements for the corresponding detection platform includes: receiving a conversion command and obtaining the rule type of the corresponding detection platform to be converted; converting the fields in the Sigma rules into corresponding fields that conform to the rules of the corresponding detection platform according to the conversion command; and generating query statements for the corresponding detection platform based on the rules and corresponding fields of the corresponding detection platform.

[0062] Furthermore, the text detection of the third document file to be classified and graded is performed using the query statement and the corresponding detection platform to generate the corresponding classification and grading detection results. This also includes: obtaining returned data from the classification and grading detection results and obtaining the corresponding configuration file; mapping the returned data through the corresponding configuration file to map the classification and grading detection results to standard classification and grading detection results; and storing and outputting the standard classification and grading detection results.

[0063] Because the result formats differ across platforms—for example, Elasticsearch queries produce JSON data while MySQL queries output standard SQL statements—a unified result conversion module is needed to transform the classification and grading results from various platforms into a single, standardized output for storage. This module could convert Sigma rules to Elastic rules, or to rules from other platforms like Splunk, and vice versa, enabling bidirectional conversion.

[0064] Furthermore, it also includes exporting and displaying standard classification and grading test results using a unified structure display and export component.

[0065] The embodiments of the present invention have the following advantages:

[0066] 1) Configure data classification and grading using Sigma rules, including three configurations: detection rules, data classification, and data grading;

[0067] 2) Use format conversion module 5 to convert the rules into detection statements for various detection platforms;

[0068] 3) Parse the content of various documents by importing module 1;

[0069] 4) Convert the text to be detected into data for each platform and import it into the configuration;

[0070] 5) Convert the detection results from various platforms into general results, and use a general display template to classify and display sensitive data in a hierarchical manner.

[0071] In addition, embodiments of the present invention also provide a text classification and grading device based on Sigma rules, the device comprising: a processor and a memory; the memory for storing one or more program instructions; the processor for running one or more program instructions to perform the steps of a text classification and grading method based on Sigma rules as described in any of the preceding embodiments.

[0072] Although the present invention has been described in detail above with general descriptions and specific embodiments, modifications or improvements can be made to it, which will be obvious to those skilled in the art. Therefore, all such modifications or improvements made without departing from the spirit of the present invention fall within the scope of protection claimed by the present invention.

Claims

1. A method of text classification ranking based on Sigma rules, characterized in that, The method includes: S1. Import the first document file to be classified and graded, preprocess the first document file to be classified and graded, parse and obtain the second document file to be classified and graded with uniform text format; S2. Obtain the current platform's data import configuration and convert the second document file to be classified and graded into a third document file to be classified and graded that conforms to the data import configuration; S3. Edit the classification and grading rules through the classification and grading editor, set the rules for the attribution and detection of relevant grades and categories, and convert the edited classification and grading rules into Sigma rules and generate the corresponding fields of the Sigma rules; S4. Convert the fields in the Sigma rule into query statements for the corresponding detection platform, and use the query statements and the corresponding detection platform to perform text detection on the third document file to be classified and graded, and generate corresponding classification and grading detection results.

2. A method for text classification and categorization based on Sigma rules as claimed in claim 1 wherein, Edit classification and grading rules using the classification and grading editor, and set the rules for assigning and detecting related grades and categories, including: The detection rule is keyword matching or regular expression matching; Editing classification and grading rules includes inputting classification, grading, and detection content.

3. A method of text classification and categorization based on Sigma Rules as claimed in claim 2, wherein, Editing classification and grading rules involves inputting classification, grading, and detection content, including: The detection content includes regular expressions, enumerations, and string matching.

4. A method of text classification and categorization based on Sigma Rules as claimed in claim 3 wherein, Convert the fields in the Sigma rules into query statements for the corresponding detection platforms, including: Receive conversion commands and obtain the rule type of the corresponding detection platform that needs to be converted; The conversion command converts the fields in the Sigma rules into corresponding fields that conform to the rules of the corresponding detection platform. Generate a query statement for the corresponding detection platform based on the platform's rules and fields.

5. A method of text classification and categorization based on Sigma Rules as claimed in claim 4 wherein, The process of performing text detection on the third document file to be classified and graded using the query statement and the corresponding detection platform to generate corresponding classification and grading detection results also includes: Obtain the returned data and the corresponding configuration file from the classification and grading detection results; The returned data is mapped using the corresponding configuration file, thus mapping the classification and grading detection results to standard classification and grading detection results. The results of the standard classification and grading test are stored and output.

6. A method of text classification and categorization based on Sigma Rules as claimed in claim 5 wherein, It also includes exporting and displaying standard classification and grading test results using a unified structure display and export component.

7. A text classification hierarchy system based on Sigma rules, characterized by, The system includes: The import module is used to import the first document file to be classified and graded, preprocess the first document file to be classified and graded, parse and obtain the second document file to be classified and graded with uniform text format; The conversion module is used to obtain the data import configuration of the current platform and convert the second document file to be classified and graded into a third document file to be classified and graded that conforms to the data import configuration; The Sigma rule conversion module is used to edit classification and grading rules through the classification and grading editor, set the rules for the attribution and detection of related grades and categories, and convert the edited classification and grading rules into Sigma rules and generate the corresponding fields of the Sigma rules; The text detection module is used to convert the fields in the Sigma rules into query statements of the corresponding detection platform, and use the query statements and the corresponding detection platform to perform text detection on the third document file to be classified and graded, and generate corresponding classification and grading detection results.

8. A text classification and grading system based on Sigma rules as described in claim 7, characterized in that, The system also includes: The format conversion module is used to obtain the returned data from the classification and grading detection results and obtain the corresponding configuration file; to perform content mapping on the returned data through the corresponding configuration file, mapping the classification and grading detection results to standard classification and grading detection results; and to store and output the standard classification and grading detection results.

Citation Information

Patent Citations

  • Chinese text classification rule generation method and system based on BP network

    CN106294568A

  • Data classification processing apparatus, data classification processing method and computer program

    JP2005208709A