Threat detection method and device based on multi-dimensional data and electronic equipment
Through threat detection methods based on multi-dimensional data, multi-dimensional security information data is collected and analyzed, and combined with rule matching and statistical analysis technology, the problem of network threat identification in massive data is solved, effectively identifying and predicting potential threats, and improving the effectiveness of the problem of potential threats Defensive capabilities for network security.
Patent Information
- Application Number
- CN202411445663.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-16
- Publication Date
- 2024-12-06
AI Technical Summary
In the digital economy era, with the increase in network scale and complexity, how to effectively identify and respond to diversified and complex cyber threat attacks from massive big data has become a major challenge for network security.
Using threat detection methods based on multi-dimensional data, data cleaning, analysis and replenishment are carried out by collecting multi-dimensional security information data, using rule matching and statistical analysis technology, combining detection models and rules engines to identify potential malicious behaviors and security events. , realize the integration, association and intelligent analysis of multi-dimensional information.
The ability to discover security issues hidden in the data, identify potential intrusions and highly concealed attacks, predict upcoming security events, and improve the accuracy and predictive capabilities of cyber threat detection.
Smart Images

Figure CN119094238A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of network security technology, and in particular to a threat detection method, device and electronic device based on multi-dimensional data. Background Art
[0002] With the deepening of digital transformation in traditional fields and the accelerated integration of the Internet of Things and new technologies, information and communication networks have penetrated into various fields such as the economy and society. At the same time, network security risks and threats have also spread, diffused and overlapped. It has become a major strategic issue that affects economic and social development and the interests of the people. Only by ensuring network security can we lay a solid foundation for the development of the digital economy. In the context of the digital economy era, with the development of the information industry and computer computing, the rapid development of new scenarios and new technologies such as big data, the Internet of Things, cloud computing, and mobile Internet, the scale and complexity of the network are increasing, and the challenges of responding to malicious network attacks are becoming increasingly severe. Network attack incidents are becoming more diversified and complex. How to effectively identify effective network threat attack behaviors from massive big data is the key and difficulty. Summary of the invention
[0003] (1) Technical issues to be solved
[0004] The present application provides a threat detection method, device and electronic device based on multi-dimensional data to solve the problem of effectively identifying effective network threat attacks from massive big data.
[0005] (2) Technical solution
[0006] In a first aspect, the present application provides a threat detection method based on multi-dimensional data, comprising:
[0007] Collect multi-dimensional security information data, associate the multi-dimensional security information data, and obtain associated security information data;
[0008] The detection model is used to perform threat detection on the associated security information data to identify threats in multi-dimensional security information data.
[0009] Furthermore, the collection of multi-dimensional security information data includes:
[0010] Collect security information data such as configuration, operating status, security events, vulnerabilities, and traffic of security objects.
[0011] Furthermore, after collecting multi-dimensional security information data, the process further includes:
[0012] Perform data cleaning, data analysis and data completion on multi-dimensional security information data.
[0013] Furthermore, correlating the multi-dimensional security information data to obtain correlated security information data includes:
[0014] A rule-based matching method is used to perform feature matching analysis on multi-dimensional security information data, and when the association rule conditions are met, the associated security information data is obtained.
[0015] Furthermore, before performing threat detection on the associated security information data through the detection model to identify threats in the multi-dimensional security information data, the method further includes:
[0016] Modeling is performed through a rule engine, and models of specific security business scenarios are developed based on rules such as security events, security alerts, and user behaviors.
[0017] Furthermore, the threat detection method based on multi-dimensional data further includes:
[0018] Conduct statistical analysis on multi-dimensional security information data to identify potential malicious behavior threats and confirm possible security incidents.
[0019] Furthermore, the statistical analysis of the multi-dimensional security information data includes:
[0020] Statistical methods are used to calculate the quantitative characteristics of data such as the status, frequency, and occurrence cycle of various events;
[0021] The distribution status of event data, main characteristics, trend of time series, whether there are outliers, event summary results, etc. are obtained.
[0022] In a second aspect, the present application provides a threat detection device based on multi-dimensional data, comprising:
[0023] A data collection module is used to collect multi-dimensional security information data, associate the multi-dimensional security information data, and obtain the associated security information data;
[0024] The threat detection module is used to perform threat detection on the associated security information data through the detection model and identify threats in the multi-dimensional security information data.
[0025] In a third aspect, the present application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the threat detection method based on multidimensional data as described above when executing the computer program.
[0026] In a fourth aspect, the present application provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the threat detection method based on multidimensional data as described above is implemented.
[0027] (3) Beneficial effects
[0028] The above technical solution of the present application has the following advantages:
[0029] The first aspect of the present application provides a threat detection method based on multidimensional data, which collects multidimensional security information data, correlates the multidimensional security information data, obtains correlated security information data, performs threat detection on the correlated security information data through a detection model, identifies threats in the multidimensional security information data, and can integrate, correlate, intelligently analyze and predict multidimensional information and data, discover security issues hidden in various types of data, discover potential intrusions and highly concealed attacks, and predict upcoming security incidents.
[0030] It can be understood that the beneficial effects of the second, third and fourth aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0031] In order to more clearly illustrate the specific implementation methods of the present application or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.
[0032] Figure 1 A flowchart of a threat detection method based on multidimensional data provided in this application;
[0033] Figure 2 A schematic diagram of the structure of a threat detection device based on multi-dimensional data provided by this application;
[0034] Figure 3 A schematic diagram of the structure of the electronic device provided in this application. DETAILED DESCRIPTION
[0035] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.
[0036] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.
[0037] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.
[0038] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways. "Multiple" means "two or more".
[0039] The specific implementation methods of the present application are further described in detail below in conjunction with the accompanying drawings and examples. The following examples are used to illustrate the present application but are not intended to limit the scope of the present application.
[0040] like Figure 1 As shown, the threat detection method based on multi-dimensional data provided in this embodiment specifically includes the following steps:
[0041] Collect multi-dimensional security information data, associate the multi-dimensional security information data, and obtain associated security information data;
[0042] The detection model is used to perform threat detection on the associated security information data to identify threats in multi-dimensional security information data.
[0043] By utilizing a variety of new threat monitoring methods and adopting big data technology to integrate, correlate, intelligently analyze and predict multi-dimensional information and data, we can discover security issues hidden in various types of data, detect potential intrusions and highly concealed attacks, and predict impending security incidents.
[0044] With big data analysis technology as the core, combined with the application of big data in the field of network security, and based on the big data analysis technology architecture, it collects, analyzes, standardizes and centrally stores massive multi-source security data such as various logs of network equipment, security equipment, application systems, terminals, databases, and network traffic.
[0045] Data collection can collect security event information sent by event sources in a variety of ways, including but not limited to: reading the log files of event sources through files to obtain security-related information; receiving security events sent by event sources through syslog, SNMP Trap and other methods; obtaining security-related information or database operation logs stored in various databases by event sources through database interfaces such as JDBC and ODBC; receiving events sent from security event servers of this type through OPSEC interfaces; forwarding security events directly to the security event collection system through third-party reliable applications or self-developed agents, combined with the above methods or standard outputs; and real-time collection of detected asset anomalies, traffic anomalies, and threat perceptions through probes deployed on the situational awareness platform.
[0046] Data collection is responsible for collecting various logs, and according to the rule base, data cleaning, data completion, event identification, data alignment, and finally output to storage facilities such as ES and KAFKA, providing standardized data for data processing.
[0047] It is necessary to collect data from multiple data sources. Therefore, it is necessary to support the adaptation of multiple collection interfaces to realize the collection of data including the configuration, operation status, security events, vulnerabilities, etc. of security objects. Data collection involves the access of multiple security data, and these data are gradually connected to the big data platform of the network security operation center for collection and storage. These security data include:
[0048] Security data: Security data is the main data collected for security threat analysis and early warning. It collects security asset information by connecting to the security asset management subsystem, and collects security vulnerability information by connecting to the vulnerability management platform.
[0049] Management data: Management data involves user data and is used to form the basic environment data required for security threat analysis and early warning.
[0050] Basic data: In order to enrich the value of information such as assets and attacks, it is necessary to collect and manage information such as relevant products and address location information. This type of data is maintained manually.
[0051] In some embodiments, the collecting of multi-dimensional security information data includes:
[0052] Collect security information data such as configuration, operating status, security events, vulnerabilities, and traffic of security objects.
[0053] In some embodiments, after collecting multi-dimensional security information data, the method further includes:
[0054] Perform data cleaning, data analysis and data completion on multi-dimensional security information data.
[0055] After collecting various types of data together, in order to meet the requirements of security threat analysis and early warning, the security data must be processed to a certain extent. Data processing (ETL) cleans / filters, standardizes, completes associations, adds labels, etc. on the collected data, and loads the standard data into the data storage. The original logs should be saved for the standardized data.
[0056] The data cleaning and filtering of security event log data include: data that does not belong to the data source of the big data platform of the network security operation center; duplicate data; noise data; incomplete or unreasonable data; and data below the minimum level required by the business.
[0057] Log standardization parsing rules include rule nesting and logical combination methods, which can perform multi-layer rule parsing on a set of events, add, delete, rename, merge, remove duplicates and trim existing fields, and clean and process logs through standardization.
[0058] Re-analyze the standardized fields. After pattern matching, exact matching, and regular matching, perform secondary analysis from the data head and tail.
[0059] Heterogeneous raw data is parsed and formatted uniformly to meet the requirements of the data format definition of the storage layer of the big data platform of the network security operation center. The original log should be saved for the standardized data. A large part of the data after cleaning and filtering is unstructured data. Data parsing and standardization are required.
[0060] The principles of data standardization include: on the basis of ensuring basic expansion capabilities, standardize related fields according to the standard library rules of each type of data; for commonly used fields, ensure the consistency of field content, eliminate the inconsistency of descriptions of similar problems in different events, and meet the portability of rules that rely on these fields. The original log of unstandardized data should be saved. It can be used to redefine standardization rules for the specific data afterwards.
[0061] There is a correlation between the collected data through data completion. After data completion, complete data is formed, which can enrich the data itself and facilitate subsequent statistical analysis.
[0062] After the data is formatted, some data needs to be supplemented according to the original formatting needs for subsequent correlation analysis. The security situation awareness platform also provides a set of chain pluggable components that support reading the original formatted data and associating it with the basic data stored in the DB. The associated data includes but is not limited to user information, asset information, IP regional information, etc.
[0063] In some embodiments, associating the multi-dimensional security information data to obtain the associated security information data includes:
[0064] A rule-based matching method is used to perform feature matching analysis on multi-dimensional security information data, and when the association rule conditions are met, the associated security information data is obtained.
[0065] In some embodiments, before performing threat detection on the associated security information data by using the detection model to identify threats in the multi-dimensional security information data, the method further includes:
[0066] Modeling is performed through a rule engine, and models of specific security business scenarios are developed based on rules such as security events, security alerts, and user behaviors.
[0067] In some embodiments, the threat detection method based on multi-dimensional data further includes:
[0068] Conduct statistical analysis on multi-dimensional security information data to identify potential malicious behavior threats and confirm possible security incidents.
[0069] In some embodiments, the statistical analysis of the multi-dimensional security information data includes:
[0070] Statistical methods are used to calculate the quantitative characteristics of data such as the status, frequency, and occurrence cycle of various events;
[0071] The distribution status of event data, main characteristics, trend of time series, whether there are outliers, event summary results, etc. are obtained.
[0072] The threat analysis function collects data from network devices, security devices, hosts, application systems, etc. in the network, and uses the powerful processing capabilities of the analysis engine to perform intelligent threat detection and analysis to try to mine. It realizes multi-event correlation, multi-device correlation, vulnerability analysis, attack scenario analysis, etc. through state analysis, feature detection, intelligence matching, etc. It extracts various hacker attack behaviors such as buffer overflow, SQL injection, brute force cracking, scanning detection, worm outbreak, etc. that may exist in massive data, and generates security events through alarms.
[0073] Analysis management provides calculation models and calculation methods. Analysis methods include: association analysis, statistical analysis and other methods. Data mining uses general mathematical calculation models to conduct in-depth analysis of data.
[0074] Security event correlation analysis is a process of using a rule-based matching method to perform feature matching analysis on multiple heterogeneous events, and to draw conclusions on event analysis when the correlation rule conditions are met. It provides rule-based, statistical-based, and asset-based correlation analysis functions, which can eliminate false positives of security events, infer event sources, and redefine security event levels. It supports horizontal and vertical correlation analysis of security events, and supports correlation threshold settings and security event blacklist settings.
[0075] The rule-based association analysis conditions are the restriction conditions of certain attributes in security events, that is, the activation conditions of the rules, which have the functions of detecting the existence of facts, comparing facts, and verifying facts according to signs. The conditions can be composed of a single detection attribute or multiple detection attributes, and each attribute uses the logical symbols OR, AND, and NOT to represent the logical relationship of multiple attributes. The result is the assertion of new evidence or the suspiciousness of a user's behavior, which has the function of generating a high-priority association event.
[0076] Event statistical analysis refers to the use of statistical methods to calculate the quantitative data characteristics of various events, such as the status, frequency, and occurrence cycle, to derive the distribution status, main characteristics, trend of time series, whether there are outliers, event summary results, etc. The results of event statistical analysis can be directly used to determine, interpret and make decisions on the nature of events.
[0077] The threat detection method based on multi-dimensional data provided in the embodiment of the present application collects multi-dimensional security information data, associates the multi-dimensional security information data to obtain the associated security information data, performs threat detection on the associated security information data through a detection model, identifies threats in the multi-dimensional security information data, and can integrate, associate, intelligently analyze and predict multi-dimensional information and data, discover security issues hidden in various types of data, discover potential intrusions and highly concealed attacks, and predict upcoming security incidents.
[0078] Corresponding to the threat detection method based on multidimensional data described in the above embodiment, Figure 2 As shown, this embodiment provides a threat detection device based on multi-dimensional data. The threat detection device 200 based on multi-dimensional data includes:
[0079] The data collection module 201 is used to collect multi-dimensional security information data, associate the multi-dimensional security information data, and obtain associated security information data;
[0080] The threat detection module 202 is used to perform threat detection on the associated security information data through a detection model to identify threats in the multi-dimensional security information data.
[0081] It should be noted that the information interaction, execution process, etc. between the above-mentioned modules / units are based on the same concept as the method embodiment of the present application. Their specific functions and technical effects can be found in the method embodiment part and will not be repeated here.
[0082] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.
[0083] The present application embodiment also provides an electronic device 300, such as Figure 3 As shown, it includes a memory 301, a processor 302, and a computer program 303 stored in the memory 301 and executable on the processor 302. When the processor 302 executes the computer program 303, the steps of the threat detection method based on multi-dimensional data provided in the first aspect are implemented.
[0084] In applications, the electronic device may include, but is not limited to, a processor and a memory. Figure 3 This is only an example of an electronic device and does not constitute a limitation on the electronic device. It may include more or fewer components than shown in the figure, or combine certain components, or different components, such as input and output devices, network access devices, etc. Input and output devices may include cameras, audio acquisition / playback devices, display screens, etc. Network access devices may include a network module for wirelessly communicating with external devices.
[0085] In applications, the processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or the processor may be any conventional processor, etc.
[0086] In application, the memory may be an internal storage unit of an electronic device in some embodiments, such as a hard disk or memory of the electronic device. The memory may also be an external storage device of the electronic device in other embodiments, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. equipped on the electronic device. The memory may also include both an internal storage unit and an external storage device of the electronic device. The memory is used to store operating systems, applications, boot loaders (BootLoader), data, and other programs, such as program codes of computer programs, etc. The memory may also be used to temporarily store data that has been output or is to be output.
[0087] The embodiment of the present application further provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments can be implemented.
[0088] The present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a computer-readable storage medium. When the computer program is executed by the processor, the steps of each of the above-mentioned method embodiments can be implemented. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may at least include: any entity or device that can carry the computer program code to an electronic device, a recording medium, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electrical carrier signal, a telecommunication signal, and a software distribution medium. For example, a USB flash drive, a mobile hard disk, a disk or an optical disk.
[0089] Those of ordinary skill in the art will appreciate that the devices and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.
[0090] In the embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interface, indirect coupling or communication connection of devices, which can be electrical, mechanical or other forms.
[0091] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.
Claims
1. A threat detection method based on multidimensional data, characterized in that: include: Collect multi-dimensional security information data, associate the multi-dimensional security information data, and obtain associated security information data; The detection model is used to perform threat detection on the associated security information data to identify threats in multi-dimensional security information data.
2. The threat detection method based on multidimensional data according to claim 1, characterized in that: The collecting of multi-dimensional security information data includes: Collect security information data such as configuration, operating status, security events, vulnerabilities, and traffic of security objects.
3. The threat detection method based on multidimensional data according to claim 1, characterized in that: After collecting multi-dimensional security information data, the method further includes: Perform data cleaning, data analysis and data completion on multi-dimensional security information data.
4. The threat detection method based on multidimensional data according to claim 1, characterized in that: The step of associating the multi-dimensional security information data to obtain the associated security information data includes: A rule-based matching method is used to perform feature matching analysis on multi-dimensional security information data, and when the association rule conditions are met, the associated security information data is obtained.
5. The threat detection method based on multidimensional data according to claim 1, characterized in that: Before performing threat detection on the associated security information data by using the detection model to identify threats in the multi-dimensional security information data, the method further includes: Modeling is performed through a rule engine, and models of specific security business scenarios are developed based on rules such as security events, security alerts, and user behaviors.
6. The threat detection method based on multidimensional data according to claim 1, characterized in that: The threat detection method based on multi-dimensional data also includes: Conduct statistical analysis on multi-dimensional security information data to identify potential malicious behavior threats and confirm possible security incidents.
7. The threat detection method based on multidimensional data according to claim 6, characterized in that: The statistical analysis of multi-dimensional security information data includes: Statistical methods are used to calculate the quantitative characteristics of data such as the status, frequency, and occurrence cycle of various events; The distribution status of event data, main characteristics, trend of time series, whether there are outliers, event summary results, etc. are obtained.
8. A threat detection device based on multidimensional data, characterized in that: include: A data collection module is used to collect multi-dimensional security information data, associate the multi-dimensional security information data, and obtain the associated security information data; The threat detection module is used to perform threat detection on the associated security information data through the detection model and identify threats in the multi-dimensional security information data.
9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the threat detection method based on multi-dimensional data as described in any one of claims 1 to 7 is implemented.
10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the threat detection method based on multi-dimensional data as described in any one of claims 1 to 7 is implemented.
Citation Information
Cited By
Intelligent safety early warning method and system based on multi-source heterogeneous data
CN120602131A
