Abnormal access data judgment method and device, electronic equipment and storage medium

By using machine learning algorithms and specific algorithm combinations to perform abnormal detection in the network behavior analysis of internal enterprises, the problem of difficulty in managing abnormal network behavior in the existing technology is solved, and accurate detection of user behavior and network security is achieved. .

CN118890189AActive Publication Date: 2024-11-01XINYANG BRANCH HENAN CO LTD OF CHINA MOBILE COMM CORP +1
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202411046148.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-01
Publication Date
2024-11-01
Estimated Expiration
2044-08-01

AI Technical Summary

Technical Problem

The prior art is difficult to effectively detect and manage abnormal network behaviors of users within the enterprise, making it difficult to solve data security problems.

Method used

Using machine learning algorithms based on user and entity behavior analysis, the access data is processed through the K-Means algorithm, the isolated forest 50% cross-validation method and the residual algorithm to generate an exception score, and the behavior model is used to determine whether the access data is abnormal, and Alarms and model retrain.

Benefits of technology

Accurate abnormal detection of user behavior is achieved, thereby improving network security and improving the security and reliability of data access.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118890189A_ABST
    Figure CN118890189A_ABST
Patent Text Reader

Abstract

The invention provides an abnormal access data judgment method and device, electronic equipment and a storage medium, and the method comprises the steps: obtaining access data, a data security access baseline model and a behavior model, and obtaining a rate density distribution curve of the access data; generating first processing data based on a K-Means algorithm, generating second processing data based on an isolated forest five-fold cross validation method, and generating third processing data based on a residual algorithm; determining whether the access data is abnormal based on the first processing data, the second processing data and the third processing data; and in response to determining that the access data is abnormal, processing the access data through the behavior model, and determining whether the access data is abnormal access data based on a processing result. Therefore, the access data is processed through the K-Means algorithm, the isolated forest five-fold cross validation method and the residual algorithm on the behavior data of the user, whether the behavior of the user is abnormal or not can be accurately detected, and the network security is improved from the household behavior level.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of network security technology, and in particular to a method, device, electronic device and storage medium for determining abnormal access to data. Background Art

[0002] In current technology, data flows have become more extensive and frequent, and each business system provides convenient services to other business systems or external partners through open application programming interfaces (APIs). For example, when a user logs in to access the company's data, he first sends the unique ID or key to verify his identity. Only after successful verification can data access be allowed. However, in some cases, malicious behavior, system failure, misconfiguration or operational errors may cause abnormal access when accessing data.

[0003] For computers, people are also viruses. Malicious access, high-frequency access, and abnormal permission access are all abnormal behaviors. Therefore, this application proposal is based on User and Entity Behavior Analytics (UEBA), defines the network operation behavior of internal enterprise users, and builds a behavior anomaly detection model through machine learning algorithms to determine which internal user behaviors are normal and which are abnormal, and manage the security of internal networks and data from the user behavior level. Summary of the invention

[0004] The present disclosure aims to solve one of the technical problems in the related art at least to some extent.

[0005] To this end, one purpose of the present disclosure is to provide a method for determining abnormal access to data.

[0006] The second objective of the present disclosure is to provide a device for determining abnormal access to data.

[0007] A third objective of the present disclosure is to provide an electronic device.

[0008] A fourth object of the present disclosure is to provide a non-transitory computer-readable storage medium.

[0009] A fifth object of the present disclosure is to provide a computer program product.

[0010] To achieve the above-mentioned purpose, the first aspect of the present disclosure proposes a method for judging abnormal access data, including: obtaining access data, and obtaining a data security access baseline model and a behavior model, and processing the access data based on the data security access baseline model to obtain a rate density distribution curve of the access data; processing the rate density distribution curve based on the K-Means algorithm to generate first processed data, and processing the rate density distribution curve based on the isolation forest 5-fold cross-validation method to generate second processed data, and processing the rate density distribution curve based on the residual algorithm to generate third processed data; determining whether the access data is abnormal based on the first processed data, the second processed data and the third processed data; in response to determining that the access data is abnormal, processing the access data through the behavior model, and determining whether the access data is abnormal access data based on the processing result.

[0011] According to one embodiment of the present disclosure, determining whether the access data is abnormal based on the first processed data, the second processed data, and the third processed data includes: determining a first score based on the first processed data, and determining a second score based on the second processed data, and determining a third score based on the third processed data; determining an abnormality score of the access data based on the first score, the second score, and the third score; and comparing the abnormality score with the abnormality score threshold to determine whether the access data is abnormal.

[0012] According to one embodiment of the present disclosure, after obtaining the access data, it also includes: preprocessing the access data; extracting features from the preprocessed access data to obtain multiple candidate features; screening the multiple candidate features to determine the target feature, and screening the access data based on the target feature.

[0013] According to one embodiment of the present disclosure, the processing of the access data through the behavior model includes: inputting the access data into the behavior model to generate candidate processing results; processing the candidate processing results based on the K-Means algorithm to generate fourth processing data, and processing the candidate processing results based on the isolation forest 5-fold cross validation method to generate fifth processing data, and processing the candidate processing results based on the residual algorithm to generate sixth processing data; determine whether the access data is abnormal based on the fourth processing data, the fifth processing data and the sixth processing data.

[0014] According to an embodiment of the present disclosure, determining whether the access data is abnormal access data based on the processing result includes: in response to the processing result being abnormal; determining that the access data is abnormal access data.

[0015] According to one embodiment of the present disclosure, the method further includes: in response to the processing result being normal; retraining the data security access baseline model and the behavior model.

[0016] According to an embodiment of the present disclosure, the method further includes: in response to the access data being abnormal access data, issuing an alarm.

[0017] To achieve the above-mentioned purpose, the second aspect embodiment of the present disclosure proposes an abnormal access data judgment device, including: an acquisition module, used to acquire access data, and acquire a data security access baseline model and a behavior model, and process the access data based on the data security access baseline model to obtain a rate density distribution curve of the access data; a generation module, used to process the rate density distribution curve based on the K-Means algorithm to generate first processed data, and process the rate density distribution curve based on the isolation forest 5-fold cross-validation method to generate second processed data, and process the rate density distribution curve based on the residual algorithm to generate third processed data; a determination module, used to determine whether the access data is abnormal based on the first processed data, the second processed data and the third processed data; a judgment module, used to process the access data through the behavior model in response to determining that the access data is abnormal, and determine whether the access data is abnormal access data based on the processing result.

[0018] To achieve the above-mentioned purpose, the third aspect embodiment of the present disclosure proposes an electronic device, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to implement the abnormal access data judgment method as described in the first aspect embodiment of the present disclosure.

[0019] To achieve the above-mentioned purpose, the fourth aspect embodiment of the present disclosure proposes a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to implement the abnormal access data judgment method as described in the first aspect embodiment of the present disclosure.

[0020] To achieve the above-mentioned purpose, the fifth aspect of the present disclosure proposes a computer program product, including a computer program, which, when executed by a processor, is used to implement the abnormal access data judgment method as described in the first aspect of the present disclosure.

[0021] Therefore, by processing the user's behavior data through the K-Means algorithm, the isolation forest 5-fold cross validation method and the residual algorithm, it is possible to accurately detect whether the user's behavior is abnormal, thereby improving network security from the user behavior level. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 It is a schematic diagram of a method for determining abnormal access data according to an embodiment of the present disclosure;

[0023] Figure 2 It is a schematic diagram of a probability density distribution curve of the time and probability of occurrence of an event within a day according to an embodiment of the present disclosure;

[0024] Figure 3 is a schematic diagram of another abnormal access data judgment method according to an embodiment of the present disclosure;

[0025] Figure 4 is a schematic diagram of another abnormal access data judgment method according to an embodiment of the present disclosure;

[0026] Figure 5 is a schematic diagram of an abnormal access data judgment device according to an embodiment of the present disclosure;

[0027] Figure 6 is a schematic diagram of an electronic device according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0028] Embodiments of the present disclosure are described in detail below, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present disclosure, and should not be construed as limiting the present disclosure.

[0029] The acquisition, storage, use, and processing of data in the technical solution disclosed in this disclosure are in compliance with the relevant provisions of relevant laws and regulations.

[0030] It should be noted that in the embodiments of the present application, certain software, components, models and other existing solutions in the industry may be mentioned, and they should be considered as exemplary. Their purpose is only to illustrate the feasibility of implementing the technical solution of the present application, but it does not mean that the applicant has or will necessarily use the solution.

[0031] Figure 1 is a schematic diagram of a method for determining abnormal access data according to an embodiment of the present disclosure. Figure 1 As shown, the abnormal access data judgment method includes the following steps:

[0032] S101, obtaining access data, and obtaining a data security access baseline model and a behavior model, and processing the access data based on the data security access baseline model to obtain a rate density distribution curve of the access data.

[0033] The abnormal access data judgment method of the embodiment of the present application can be applied to the scenario of network security protection. The executor of the abnormal access data judgment of the embodiment of the present application can be the abnormal access data judgment device of the embodiment of the present application, and the abnormal access data judgment device can be set on an electronic device.

[0034] In the embodiments of the present disclosure, there may be multiple methods for obtaining access data, which are not limited here.

[0035] In one possible implementation, the access data may be manually input.

[0036] In another possible implementation, access data can also be obtained by analyzing log data. For example, the log data of the user during his / her time in the company can be obtained and sorted, and the log information can be collected to a local disk or a remote server using Log4j, and the collected log information can be stored in a database, and the logs can be analyzed using the ELK tool, and the analysis results can be visualized using a visualization tool.

[0037] In the embodiment of the present disclosure, the data security access baseline model is a model constructed by time series processing. In the embodiment of the present disclosure, the data security access baseline model of users and entities can be constructed by constructing a behavioral model of the collected data, using machine learning and statistical methods, including feature construction using time series analysis to identify normal behavior patterns.

[0038] The behavioral model is generated by combining the autoregressive model (AR model) and the moving average model (MA model).

[0039] It should be noted that the probability density function (PDF) is a way to describe the probability distribution of a continuous random variable. The probability density function provides the probability density of the value of a random variable in a certain interval, rather than the direct probability value. The graph of the probability density function is called the probability density distribution curve. For example, Figure 2 The probability density distribution curve shown is the probability density distribution curve of the time of day and the probability of an event occurring.

[0040] S102, processing the rate density distribution curve based on the K-Means algorithm to generate first processed data, processing the rate density distribution curve based on the isolation forest 5-fold cross validation method to generate second processed data, and processing the rate density distribution curve based on the residual algorithm to generate third processed data.

[0041] It should be noted that the K-Means algorithm is a commonly used unsupervised learning method, mainly used for cluster analysis. Its goal is to divide the data set into K clusters, so that the data points in each cluster are as similar as possible, while the data points between different clusters are as different as possible. Each cluster is represented by its center point (centroid).

[0042] Isolation Forest (iForest) is an unsupervised learning algorithm for anomaly detection. It isolates outliers by building multiple trees (usually decision trees) to detect outliers in a data set. The core idea of ​​Isolation Forest is that outliers are more likely to be isolated, so in the process of building a tree, outliers are usually separated at a shallow level.

[0043] Residual arithmetic is a method used to evaluate the goodness of fit of data, especially in regression analysis. The residual is the difference between the actual observed value and the model's predicted value. Calculating the residual can help us understand the performance of the model and whether there is any systematic deviation.

[0044] S103, determining whether the access data is abnormal based on the first processed data, the second processed data, and the third processed data.

[0045] In the embodiment of the present disclosure, after the first processed data, the second processed data, and the third processed data are acquired, there may be multiple methods for determining whether the access data is abnormal, which are not limited here.

[0046] In a possible implementation, the first processed data, the second processed data, and the third processed data may be processed by a judgment algorithm to obtain a judgment value, and whether the access data is abnormal may be determined based on the judgment value.

[0047] It should be noted that the judgment algorithm is designed in advance and can be changed according to actual design needs.

[0048] In another possible implementation, the first processed data, the second processed data, and the third processed data may be processed by a judgment model to determine whether the access data is abnormal.

[0049] It should be noted that the judgment model is trained in advance and stored in the storage space of the electronic device to facilitate retrieval and use when needed.

[0050] S104, in response to determining that the access data is abnormal, processing the access data through the behavior model, and determining whether the access data is abnormal access data based on the processing result.

[0051] In the embodiments of the present disclosure, since there may be problems such as the data security access baseline model training not achieving the expected results, data errors, model output errors, etc., after determining that the access data is abnormal, the access data can also be processed again through the behavioral model, thereby improving the accuracy of the final judgment.

[0052] In the disclosed embodiment, firstly, the access data is obtained, and the data security access baseline model and the behavior model are obtained, and the access data is processed based on the data security access baseline model to obtain the rate density distribution curve of the access data, and then the rate density distribution curve is processed based on the K-Means algorithm to generate the first processed data, and the rate density distribution curve is processed based on the isolation forest 5-fold cross validation method to generate the second processed data, and the rate density distribution curve is processed based on the residual algorithm to generate the third processed data, and then based on the first processed data, the second processed data and the third processed data, it is determined whether the access data is abnormal, and finally in response to determining that the access data is abnormal, the access data is processed through the behavior model, and it is determined whether the access data is abnormal access data based on the processing result. Therefore, by processing the user's behavior data through the K-Means algorithm, the isolation forest 5-fold cross validation method and the residual algorithm, it is possible to accurately detect whether the user's behavior is abnormal, thereby improving network security from the user behavior level.

[0053] In the above embodiment, whether the access data is abnormal is determined based on the first processed data, the second processed data and the third processed data, and the Figure 3 Explaining further, the method includes:

[0054] S301 , determining a first score based on first processed data, determining a second score based on second processed data, and determining a third score based on third processed data.

[0055] In the embodiment of the present disclosure, the first score may be a direct result of the first processed data, or may be obtained after processing based on the first processed data, which is not limited here.

[0056] In the embodiment of the present disclosure, the second score may be a direct result of the second processed data, or may be obtained after processing based on the second processed data, which is not limited here.

[0057] In the embodiment of the present disclosure, the third score may be a direct result of the third processed data, or may be obtained after processing based on the third processed data, which is not limited here.

[0058] S302 : Determine an abnormality score of the access data based on the first score, the second score, and the third score.

[0059] In the embodiment of the present disclosure, after the first score, the second score, and the third score are obtained, the first score, the second score, and the third score may be calculated using an abnormality score algorithm to obtain an abnormality score.

[0060] It should be noted that the anomaly scoring algorithm is designed in advance and can be changed according to actual design needs, and no limitation is made here.

[0061] In one possible implementation, it can be expressed as follows:

[0062] 1) If the first score obtained by the K-Means algorithm is 0, and the second score obtained by the Isolation Forest 5-fold Cross Validation method is less than 0.5, then the abnormal score of the access data is 0.5*the second score, as shown in the following formula:

[0063] if KOFi=0and IFSi<0.5, then OSi=IFSi*0.5

[0064] 2) If the first score obtained by the K-Means algorithm is 1, and the second score obtained by the Isolation Forest 5-fold Cross Validation method is greater than 0.5, then the behavior anomaly score is the smaller value of 1.5*the second score and 1, as shown in the following formula:

[0065] if KOFi=1and IFSi>0.5, then OSi=min(IFSi*1.5, 1)

[0066] 3) If the third score obtained by the residual algorithm is 1, and the second score obtained by the isolation forest 5-fold cross validation method is greater than 0.5, then the behavior anomaly score is the smaller value of 1.5*the second score and 1, as shown in the following formula:

[0067] if AK=1and IFSi>0.5, then OSi=min(IFSi*1.5,1)

[0068] 4) Other situations include: the first score obtained by the K-Means algorithm is 0, and the second score obtained by the Isolation Forest 5-fold Cross Validation method is greater than 0.5, or the first score obtained by the K-Means algorithm is 1, and the second score obtained by the Isolation Forest 5-fold Cross Validation method is less than 0.5, or the first score obtained by the K-Means algorithm is 0 or 1, and the second score obtained by the Isolation Forest 5-fold Cross Validation method is equal to 0.5, then the user and entity behavior abnormality score is the third score, and the expression is shown in the following formula:

[0069] OSi=IFSi

[0070] KOFi (K-MeansOutlierFlag) represents the first score of the i-th user and entity behavior log calculated by the K-Means algorithm. IFSi (IsolationForestScore) represents the second score of the i-th user and entity behavior log obtained by the isolation forest 5-fold cross validation method; AK represents the third score; OSi (OutlierScore) represents the final abnormal behavior score of the i-th user and entity behavior log

[0071] S303: Compare the abnormality score with the abnormality score threshold to determine whether the access data is abnormal.

[0072] It should be noted that the abnormal score threshold is designed in advance and can be changed according to actual design needs, and no limitation is made here.

[0073] In the disclosed embodiment, firstly, a first score is determined based on the first processed data, a second score is determined based on the second processed data, and a score is determined based on the third processed data, then an abnormal score of the access data is determined based on the first score, the second score, and the third score, and finally the abnormal score is compared with the abnormal score threshold to determine whether the access data is abnormal. Thus, by calculating the abnormal score of the access data and determining whether the user behavior is abnormal based on the abnormal score, the judgment can be digitized, and the judgment accuracy can be controlled by controlling the size of the abnormal score threshold according to the actual needs of the user.

[0074] In the above embodiment, after obtaining the access data, the following steps are also included: Figure 4 Steps shown:

[0075] S401, pre-processing the access data.

[0076] In the embodiments of the present disclosure, there may be multiple methods for preprocessing access data, which are not limited herein.

[0077] For example, this could include removing missing values:

[0078] You can use the dropna() method to delete rows or columns containing missing values. This method deletes rows containing any missing values ​​by default, or you can specify to delete columns containing missing values.

[0079] Interpolation fills missing values:

[0080] Use the interpolate() method to interpolate missing values;

[0081] This can also include removing duplicate values:

[0082] When there are identical records in the data set, you can call the drop_duplicates() function to delete the duplicate records in the data set, thereby avoiding data redundancy and misleading;

[0083] It can also include merging duplicate values:

[0084] When there are some identical records in the data set, we can use the groupby() and sum() functions in the Pandas library to merge them into one record, thereby retaining all information and reducing data redundancy.

[0085] This can also include removing outliers:

[0086] Outliers can be handled by removing them. Use the read_csv function in the pandas library to read the csv file and use Boolean indexing to remove outliers with values ​​greater than 100 or less than 0.

[0087] Interpolation methods can also be included to handle outliers:

[0088] Interpolation is another way to deal with outliers. It can estimate the true value of the outlier based on other values ​​in the data set. You can use nan in the numpy library to set outliers with values ​​greater than 100 or less than 0 to NaN, and then use the interpolate function in the pandas library to fill the missing values ​​using linear interpolation.

[0089] S402: extracting features from the preprocessed access data to obtain a plurality of candidate features.

[0090] It should be noted that there are many methods for feature extraction, and no limitation is made here.

[0091] In a possible implementation, the access data may be processed by a feature extraction model to obtain a plurality of candidate features. It should be noted that the feature extraction model is trained in advance and stored in a storage space of the electronic device.

[0092] In the embodiments of the present disclosure, candidate features may include multiple types, without any limitation herein. For example, candidate features may include a single account access time baseline, a single account at terminal IP and access time baseline, a single account at terminal IP, application port and access time baseline, a single account at terminal connection switch IP and access time baseline, a single account access website and access time baseline, and one or more of a single account at terminal IP, access website and access time baseline.

[0093] S403, screening multiple candidate features to determine a target feature, and screening access data based on the target feature.

[0094] It should be noted that since there may be errors in the data or errors in the data processing, the generated candidate features may be inaccurate.

[0095] In the embodiments of the present disclosure, there may be multiple methods for screening candidate features, which are not limited here.

[0096] In a possible implementation, a screening rule may be preset, and the target feature may be screened out from the candidate features according to the screening rule.

[0097] In another possible implementation, the candidate features and access data may be processed by a screening model to output a target feature. The screening model is trained in advance and stored in a storage space of the electronic device to facilitate retrieval and use when needed.

[0098] In the disclosed embodiment, the access data is first preprocessed, and then the preprocessed access data is subjected to feature extraction to obtain multiple candidate features, and finally the multiple candidate features are screened to determine the target feature, and the access data is screened based on the target feature. Thus, by extracting the data to generate the target feature, and further screening the data by the target feature, the validity of the access data can be improved, and the efficiency and accuracy of subsequent data processing and analysis can be improved.

[0099] In an embodiment of the present disclosure, access data is processed through a behavior model. The access data can be first input into the behavior model to generate candidate processing results, and then the candidate processing results are processed based on the K-Means algorithm to generate fourth processing data, and the candidate processing results are processed based on the isolation forest 5-fold cross validation method to generate fifth processing data, and the candidate processing results are processed based on the residual algorithm to generate sixth processing data. Finally, it is determined whether the access data is abnormal based on the fourth processing data, the fifth processing data and the sixth processing data.

[0100] It should be noted that the method for determining whether the access data is abnormal based on the fourth processed data, the fifth processed data and the sixth processed data can refer to the content of determining whether the access data is abnormal based on the first processed data, the second processed data and the third processed data in the above embodiment, and will not be repeated here.

[0101] In the embodiment of the present disclosure, if the access data is determined to be abnormal based on the fourth processed data, the fifth processed data, and the sixth processed data, the access data is determined to be abnormal access data.

[0102] If the access data is determined to be normal based on the fourth processed data, the fifth processed data and the sixth processed data, the output results of the data security access baseline model and the behavior model are inconsistent, and it is impossible to determine whether the access data is abnormal access data.

[0103] At this point, the data security access baseline model and behavior model need to be retrained to ensure the accuracy of the subsequent prediction process and prediction results.

[0104] In one possible implementation, after determining that the access data is abnormal, a personnel behavior alert can be issued. The abnormal behavior is defined based on the current behavior data, and the learned data is used as the basis for normal behavior. The abnormal behavior is set, such as the maximum frequency of users visiting a website, the time when users log in at unusual times, or other abnormal access behaviors, so that other users can refer to it to determine whether it is normal behavior when using it later.

[0105] In another possible implementation method, the normal baseline model library can also be scanned regularly to detect whether there is any new abnormal information. If there is new vulnerability information, an update monitoring rule is generated and the new monitoring rule is added to the security behavior baseline knowledge base. Then, it is continued to detect whether the abnormal behavior information has been repaired. If so, the corresponding update monitoring detection rule in the security baseline knowledge base is queried and deleted.

[0106] Corresponding to the abnormal access data judgment methods provided in the above-mentioned embodiments, an embodiment of the present disclosure further provides an abnormal access data judgment device. Since the abnormal access data judgment device provided in the embodiment of the present disclosure corresponds to the abnormal access data judgment methods provided in the above-mentioned embodiments, the implementation method of the above-mentioned abnormal access data judgment method is also applicable to the abnormal access data judgment device provided in the embodiment of the present disclosure, and will not be described in detail in the following embodiments.

[0107] Figure 5 is a schematic diagram of an abnormal access data judgment device according to an embodiment of the present disclosure, such as Figure 5 As shown, the abnormal access data judgment device 500 includes: an acquisition module 510, a generation module 520, a determination module 530 and a judgment module 540.

[0108] The acquisition module 510 is used to acquire access data, acquire a data security access baseline model and a behavior model, and process the access data based on the data security access baseline model to acquire a rate density distribution curve of the access data.

[0109] The generation module 520 is used to process the rate density distribution curve based on the K-Means algorithm to generate the first processed data, and to process the rate density distribution curve based on the isolation forest 5-fold cross validation method to generate the second processed data, and to process the rate density distribution curve based on the residual algorithm to generate the third processed data.

[0110] The determination module 530 is used to determine whether the access data is abnormal based on the first processed data, the second processed data and the third processed data.

[0111] The judgment module 540 is used to process the access data through the behavior model in response to determining that the access data is abnormal, and determine whether the access data is abnormal access data based on the processing result.

[0112] In one possible implementation, the determination module 530 is further used to: determine a first score based on the first processed data, determine a second score based on the second processed data, and determine a third score based on the third processed data; determine an abnormality score of the access data based on the first score, the second score, and the third score; and compare the abnormality score with an abnormality score threshold to determine whether the access data is abnormal.

[0113] The acquisition module 510 is further used to: pre-process the access data; perform feature extraction on the pre-processed access data to obtain multiple candidate features; screen the multiple candidate features to determine the target feature, and screen the access data based on the target feature.

[0114] The judgment module 540 is also used to: input the access data into the behavior model to generate candidate processing results; process the candidate processing results based on the K-Means algorithm to generate fourth processing data, and process the candidate processing results based on the isolation forest 5-fold cross-validation method to generate fifth processing data, and process the candidate processing results based on the residual algorithm to generate sixth processing data; determine whether the access data is abnormal based on the fourth processing data, the fifth processing data and the sixth processing data.

[0115] The judgment module 540 is further configured to: in response to the processing result being abnormal, determine that the access data is abnormal access data.

[0116] The judgment module 540 is further used to: in response to the processing result being normal; retrain the data security access baseline model and the behavior model.

[0117] The judgment module 540 is further used to: generate an alarm in response to the access data being abnormal access data.

[0118] In order to implement the above embodiment, the present disclosure further provides an electronic device 600, Figure 6is a schematic diagram of an electronic device according to an embodiment of the present disclosure, such as Figure 6 As shown, the electronic device 600 includes: a processor 601 and a memory 602 that is communicatively connected to the processor, the memory 602 stores instructions that can be executed by at least one processor, and the instructions are executed by at least one processor 601 to implement the present disclosure. Figure 1-Figure 4 The abnormal access data judgment method of the embodiment.

[0119] In order to implement the above embodiments, the present disclosure also provides a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to enable the computer to implement the above embodiments. Figure 1-Figure 4 The abnormal access data judgment method of the embodiment.

[0120] In order to implement the above embodiments, the present disclosure also provides a computer program product, including a computer program. When the computer program is executed by a processor, the computer program implements the above embodiments. Figure 1-Figure 4 The abnormal access data judgment method of the embodiment.

[0121] It should be noted that personal information from users should be collected for legitimate and reasonable purposes and should not be shared or sold outside of these legitimate uses. In addition, such collection / sharing should be carried out after receiving the user's informed consent, including but not limited to notifying the user to read the user agreement / user notice and sign the agreement / authorization including authorization of relevant user information before the user uses the function. In addition, any necessary steps should be taken to protect and safeguard access to such personal information data and ensure that others who have access to personal information data comply with its privacy policy and procedures.

[0122] The present application is expected to provide an implementation scheme for users to selectively block the use or access of personal information data. That is, the present disclosure is expected to provide hardware and / or software to prevent or block access to such personal information data. Once the personal information data is no longer needed, the risk can be minimized by limiting data collection and deleting the data. In addition, when applicable, such personal information is de-identified to protect the privacy of the user.

[0123] In the description of the aforementioned embodiments, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, without contradiction.

[0124] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In the description of this application, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0125] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, fragment or portion of code comprising one or more executable instructions for implementing the steps of a custom logical function or process, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present application belong.

[0126] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purpose of this specification, "computer-readable medium" can be any device that contains, stores, communicates, propagates or transmits a program for use by an instruction execution system, device or apparatus, or in combination with these instruction execution systems, devices or apparatuses. More specific examples (non-exhaustive list) of computer-readable media include the following: an electrical connection with one or more wires (electronic device), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), a fiber optic device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or processing in other suitable ways if necessary, and then stored in a computer memory.

[0127] It should be understood that the various parts of the present application can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, multiple steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0128] A person skilled in the art may understand that all or part of the steps in the method for implementing the above-mentioned embodiment may be completed by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, which, when executed, includes one or a combination of the steps of the method embodiment.

[0129] In addition, each functional unit in each embodiment of the present application may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.

[0130] The storage medium mentioned above may be a read-only memory, a magnetic disk or an optical disk, etc. Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limiting the present application. A person of ordinary skill in the art may change, modify, replace and modify the above embodiments within the scope of the present application.

Claims

1. A method for judging abnormal access data. It is characterized in that include: Acquire access data, and acquire a data security access baseline model and a behavior model, and process the access data based on the data security access baseline model to acquire a rate density distribution curve of the access data; Processing the rate density distribution curve based on a K-Means algorithm to generate first processed data, processing the rate density distribution curve based on an isolation forest 5-fold cross validation method to generate second processed data, and processing the rate density distribution curve based on a residual algorithm to generate third processed data; determining whether the access data is abnormal based on the first processed data, the second processed data, and the third processed data; In response to determining that the access data is abnormal, the access data is processed by the behavior model, and it is determined whether the access data is abnormal access data based on the processing result.

2. The method according to claim 1, It is characterized in that The determining whether the access data is abnormal based on the first processed data, the second processed data, and the third processed data includes: determining a first score based on the first processed data, and determining a second score based on the second processed data, and determining a third score based on the third processed data; determining an anomaly score for the access data based on the first score, the second score, and the third score; The anomaly score is compared with the anomaly score threshold to determine whether the access data is abnormal.

3. The method according to claim 1, It is characterized in that After obtaining the access data, the method further includes: Preprocessing the access data; Perform feature extraction on the preprocessed access data to obtain multiple candidate features; A plurality of candidate features are screened to determine a target feature, and the access data is screened based on the target feature.

4. The method according to claim 1, It is characterized in that The processing of the access data by using the behavior model includes: inputting the access data into the behavior model to generate candidate processing results; Processing the candidate processing results based on a K-Means algorithm to generate fourth processing data, processing the candidate processing results based on an isolation forest 5-fold cross validation method to generate fifth processing data, and processing the candidate processing results based on a residual algorithm to generate sixth processing data; It is determined whether the access data is abnormal based on the fourth processed data, the fifth processed data, and the sixth processed data.

5. The method according to claim 4, It is characterized in that The determining whether the access data is abnormal access data based on the processing result includes: In response to the processing result being abnormal; It is determined that the access data is abnormal access data.

6. The method according to claim 5, It is characterized in that The method further comprises: In response to the processing result being normal; The data security access baseline model and the behavior model are retrained.

7. The method according to any one of claims 1 to 6, It is characterized in that The method further comprises: In response to the access data being abnormal access data, an alarm is issued.

8. An abnormal access data judgment device, It is characterized in that include: An acquisition module, used to acquire access data, acquire a data security access baseline model and a behavior model, and process the access data based on the data security access baseline model to acquire a rate density distribution curve of the access data; A generating module, configured to process the rate density distribution curve based on a K-Means algorithm to generate first processed data, process the rate density distribution curve based on an isolation forest 5-fold cross validation method to generate second processed data, and process the rate density distribution curve based on a residual algorithm to generate third processed data; a determination module, configured to determine whether the access data is abnormal based on the first processed data, the second processed data, and the third processed data; The judgment module is used for processing the access data through the behavior model in response to determining that the access data is abnormal, and determining whether the access data is abnormal access data based on the processing result.

9. An electronic device, It is characterized in that Including memory and processor; The processor runs a program corresponding to the executable program code by reading the executable program code stored in the memory, so as to implement the method according to any one of claims 1 to 7.

10. A computer-readable storage medium, It is characterized in that The computer-readable storage medium stores computer-executable instructions, which are used to implement the method according to any one of claims 1 to 7 when executed by a processor.

Citation Information

Patent Citations

  • Abnormal behavior detection method and device

    CN113051552A

  • Dam safety monitoring data anomaly detection method based on unsupervised learning

    CN113076975A

  • KPI anomaly detection method, electronic equipment and storage medium

    CN116431432A

  • Electric power data cleaning method based on bee colony optimization and isolated forest

    CN117725050A