Enterprise credit data anomaly detection method and device based on artificial intelligence

Through adaptive selection of anomaly detection algorithm and training machine learning models based on artificial intelligence, the problem of sensitivity to normal distribution dependence and outliers in the existing technology is solved, and more accurate and efficient abnormal detection of enterprise credit data is achieved.

CN119475166AActive Publication Date: 2025-02-18CHINA CYBER SECURITY REVIEW CERTIFICATION AND MARKET SUPERVISION BIG DATA CENT
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
CN202411543988.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-10-31
Publication Date
2025-02-18
Estimated Expiration
2044-10-31

AI Technical Summary

Technical Problem

Existing enterprise credit data anomaly detection methods rely on the normal distribution assumption, cannot accurately reflect the true degree of dispersion of the data, and are too sensitive to outliers, resulting in normal data points being wrongly marked as abnormal.

Method used

Using an artificial intelligence-based method, we collect and preprocess enterprise credit data, adaptively select anomaly detection algorithm, train and verify machine learning models, detect anomalies in credit data in real time, and optimize the model through feedback mechanism.

Benefits of technology

This method can more accurately identify outliers, reduce mislabeling, improve the accuracy and efficiency of abnormal detection, and is suitable for various data distribution types.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119475166A_ABST
    Figure CN119475166A_ABST
Patent Text Reader

Abstract

The embodiment of the invention provides an enterprise credit data anomaly detection method and device based on artificial intelligence, and the method comprises the steps: collecting enterprise credit data, and carrying out the preprocessing of the data; adaptively selecting an anomaly detection algorithm according to the enterprise credit data type; training and verifying the machine learning model; performing real-time detection on newly input credit data by using the trained model, identifying an anomaly, and presenting a detection result in a visual mode; establishing a feedback mechanism, comparing a detection result with set data to optimize the model, and updating the data and the model regularly; a machine learning model can learn actual distribution of data through training data instead of hypothetical normal distribution, even if the data distribution is skewed or multi-modal, the model can identify abnormal values more accurately, and abnormal samples are added in the training process to train the model, so that the model is more accurate to identify abnormal values. The performance of the model in facing abnormal values in real-world data can be improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of credit data anomaly detection, and more specifically, to an artificial intelligence-based enterprise credit data anomaly detection method and device. Background Art

[0002] Anomaly detection of corporate credit data refers to the use of statistical analysis, machine learning, deep learning and other technical means to monitor and analyze corporate credit data to identify anomalies that do not conform to normal behavior patterns. These anomalies may indicate data entry errors, fraudulent behavior, system vulnerabilities or other risks. Anomaly detection is crucial for risk management, credit rating and compliance auditing.

[0003] In the detection of anomalies in corporate credit data, the standard deviation method (3-sigma rule) is commonly used. The standard deviation method is suitable for scenarios where the data is assumed to roughly follow a normal distribution. In corporate credit data analysis, this method can be used to quickly screen for possible input errors, fraudulent behavior, or other abnormal activities. For example, if a company's financial indicators suddenly exceed the 3-sigma range of long-term historical data, this may indicate potential risks or problems.

[0004] However, this method has some limitations: Dependence on normal distribution: The standard deviation method assumes that the data follows a normal distribution, which means that the data should be symmetrically distributed around the mean. However, data in the real world often do not conform to a normal distribution and may be skewed or have multiple peaks. In this case, the standard deviation method may not accurately reflect the true degree of discreteness of the data; Sensitivity to outliers: The standard deviation method is very sensitive to outliers. In a data set, even if there are only a few outliers, it may cause the standard deviation to increase significantly, thereby mistakenly marking normal data points as abnormal. Summary of the invention

[0005] The purpose of the embodiments of the present application is to provide an artificial intelligence-based enterprise credit data anomaly detection method and device to solve the problem that the existing methods cannot accurately reflect the true discreteness of the data and are very sensitive to outliers, resulting in normal data points being mistakenly marked as abnormal.

[0006] In a first aspect, the present application provides an artificial intelligence-based enterprise credit data anomaly detection method, including:

[0007] Collect enterprise credit data and pre-process the data;

[0008] Adaptively select anomaly detection algorithms based on the type of enterprise credit data;

[0009] Train and validate machine learning models;

[0010] Use the trained model to perform real-time detection on newly input credit data, identify anomalies, and present the detection results in a visual way;

[0011] Establish a feedback mechanism to compare the test results with the set data to optimize the model, and update the data and model regularly.

[0012] In the above implementation process, enterprise credit data is collected and preprocessed; an anomaly detection algorithm is adaptively selected according to the type of enterprise credit data; the machine learning model is trained and verified; the newly input credit data is detected in real time using the trained model, anomalies are identified, and the detection results are presented in a visual manner; a feedback mechanism is established to compare the detection results with the set data to optimize the model, and the data and model are updated regularly; the machine learning model can learn the actual distribution of the data through training data, rather than just assuming a normal distribution. Even if the data distribution is skewed or multimodal, the model can more accurately identify outliers. Adding abnormal samples to train the model during the training process can improve the performance of the model when facing outliers in real-world data.

[0013] Furthermore, the collection of enterprise credit data and pre-processing of the data include:

[0014] Collect corporate credit data and clean the data; data cleaning includes processing missing values, removing duplicate data and outliers;

[0015] Select key features of corporate credit data and normalize and standardize them.

[0016] In the above implementation process, the enterprise credit data is preprocessed to ensure the quality of the data.

[0017] Furthermore, the adaptive selection of anomaly detection algorithms according to the enterprise credit data type includes:

[0018] Analyze corporate credit data types;

[0019] According to the type of enterprise credit data, the anomaly detection algorithm is adaptively selected according to the algorithm selection strategy.

[0020] In the above implementation process, a suitable anomaly detection algorithm is automatically selected according to the type of enterprise credit data to improve the accuracy and efficiency of anomaly detection.

[0021] Furthermore, the training and verification of the machine learning model includes:

[0022] Get training data and divide the data set into training set and test set;

[0023] Adjust the hyperparameters of the machine learning model, including cross validation and grid search.

[0024] In the above implementation process, the data set is divided into a training set and a test set to ensure the generalization ability of the model; the hyperparameters of the model are adjusted to optimize the performance of the model.

[0025] Furthermore, the collection of enterprise credit data and data cleaning of the data include:

[0026] Conduct a comprehensive check on the corporate credit data to identify the fields with missing values ​​and record the number of missing values ​​and the fields in which they are located;

[0027] Analyze the reasons for missing values ​​and classify missing values ​​into missing types according to the reasons for missing values. Missing types include: random missing, completely random missing, and non-random missing.

[0028] Select missing value processing method according to the proportion of missing values;

[0029] Use the set function to identify duplicate data in corporate credit data and record the number and specific content of the duplicate data;

[0030] Delete or merge duplicate data;

[0031] Identify outliers in corporate credit data and analyze the causes of outliers;

[0032] An outlier processing method is used to process outliers, wherein the outlier processing method includes deleting outliers, replacing outliers, and binning;

[0033] The process of selecting key features of enterprise credit data and performing normalization and standardization includes:

[0034] Select key features according to feature selection methods, where the feature selection methods include filtering methods, wrapping methods, and embedded methods;

[0035] For each selected key feature, determine its normalization method;

[0036] Calculate statistics of key features;

[0037] According to the selected normalization method, the eigenvalues ​​are transformed;

[0038] Select the standardization method;

[0039] Calculate the mean and standard deviation of each key feature;

[0040] For each eigenvalue, subtract the mean of the key feature from it, and then divide it by the standard deviation of the key feature to obtain the standardized eigenvalue.

[0041] Furthermore, the method of adaptively selecting an anomaly detection algorithm according to the enterprise credit data type and the algorithm selection strategy includes:

[0042] For numerical data, choose statistical methods or machine learning methods;

[0043] For data with time series characteristics, choose time series analysis methods or deep learning methods;

[0044] For public opinion data, choose text processing and machine learning methods;

[0045] Wherein, the algorithm selection strategy includes:

[0046] Perform feature analysis on the input corporate credit data, determine the data type, distribution characteristics, and dimensions, and calculate the statistical characteristics of the data;

[0047] Build a library of anomaly detection algorithms for different data types;

[0048] Encapsulate each algorithm to give it a unified interface;

[0049] Select evaluation indicators to measure the performance of the algorithm, including: accuracy, recall, and F1 value;

[0050] For different types of data, choose different evaluation indicators;

[0051] According to the results of feature analysis, select an algorithm suitable for the current data from the algorithm library;

[0052] Use a portion of labeled data sets to evaluate the algorithm and select the algorithm based on the evaluation indicators;

[0053] If the data type changes or new data is added, re-analyze the features and select the algorithm to make adaptive adjustments.

[0054] Furthermore, adjusting the hyperparameters of the machine learning model includes:

[0055] Select a cross-validation method, where the cross-validation method includes: K-fold cross-validation, leave-one-out cross-validation, and stratified cross-validation;

[0056] Divide the enterprise credit data set according to the selected cross-validation method;

[0057] For each split, the model is trained using the training set, and the performance indicators of the model are evaluated on the validation set, including accuracy, recall, and F1 value;

[0058] Record the results of each validation and calculate the mean and standard deviation to evaluate model performance;

[0059] For anomaly detection models, determine the hyperparameters that need to be tuned;

[0060] Combine the value range of each hyperparameter into a parameter grid;

[0061] Use cross-validation to train and validate the model on each hyperparameter combination in the parameter grid;

[0062] Record the verification results of each hyperparameter combination and select the hyperparameter combination;

[0063] If the results obtained by grid search do not meet the set requirements, search for hyperparameter combinations.

[0064] In a second aspect, an embodiment of the present application provides an enterprise credit data anomaly detection device based on artificial intelligence, comprising:

[0065] The data collection module is used to collect enterprise credit data and pre-process the data;

[0066] An algorithm selection module is used to adaptively select an anomaly detection algorithm based on the type of enterprise credit data;

[0067] Model training module, used to train and validate machine learning models;

[0068] The anomaly detection module is used to use the trained model to perform real-time detection on newly input credit data, identify anomalies, and present the detection results in a visual manner;

[0069] The feedback adjustment module is used to establish a feedback mechanism to compare the test results with the set data to optimize the model and regularly update the data and model.

[0070] In a third aspect, an embodiment of the present application provides an electronic device, including:

[0071] A processor, a memory and a bus, wherein the processor is connected to the memory via the bus, and the memory stores computer-readable instructions. When the computer-readable instructions are executed by the processor, they are used to implement the enterprise credit data anomaly detection method based on artificial intelligence as described above.

[0072] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a server, the method for detecting anomalies in enterprise credit data based on artificial intelligence as described above is implemented. BRIEF DESCRIPTION OF THE DRAWINGS

[0073] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments of the present application will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0074] Figure 1 A flowchart of an artificial intelligence-based corporate credit data anomaly detection method provided in an embodiment of the present application;

[0075] Figure 2 It is a structural schematic diagram of an enterprise credit data anomaly detection device based on artificial intelligence provided in an embodiment of the present application;

[0076] Figure 3 It is a structural schematic diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0077] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application.

[0078] It should be noted that similar reference numerals and letters represent similar items in the following drawings, so once an item is defined in one drawing, it does not need to be further defined and explained in subsequent drawings. At the same time, in the description of this application, the terms "first", "second", etc. are only used to distinguish the description and cannot be understood as indicating or implying relative importance.

[0079] Anomaly detection of corporate credit data refers to the use of statistical analysis, machine learning, deep learning and other technical means to monitor and analyze corporate credit data to identify anomalies that do not conform to normal behavior patterns. These anomalies may indicate data entry errors, fraudulent behavior, system vulnerabilities or other risks. Anomaly detection is crucial for risk management, credit rating and compliance auditing.

[0080] In the detection of anomalies in corporate credit data, the commonly used method is the standard deviation method (3-sigma rule). The standard deviation method, also known as the 3-sigma rule or the Laida criterion, is a statistical method based on the normal distribution assumption and is used to identify outliers in a data set. The core idea of ​​this method is that in a normal distribution, most data points will be concentrated in a region around the mean, and data points far from the mean may be outliers.

[0081] Calculate the mean and standard deviation: First, calculate the mean (μ) and standard deviation (σ) of the given corporate credit data set. These statistics describe the central location of the data and the degree of dispersion of the data distribution, respectively.

[0082] Applying the 3-sigma rule: According to the characteristics of the normal distribution, approximately 99.73% of the data points will fall within three standard deviations of the mean, i.e. (μ-3σ,μ+3σ). Therefore, the standard deviation method considers data points that are more than three standard deviations away from the mean as outliers.

[0083] Identify outliers: Calculate the difference between each data point and the mean and check whether these differences exceed the ±3σ limit. Data points outside this range will be marked as outliers.

[0084] The standard deviation method is suitable for scenarios where the data is assumed to roughly follow a normal distribution. In corporate credit data analysis, this method can be used to quickly screen for possible input errors, fraud or other abnormal activities. For example, if a company's financial indicators suddenly exceed the 3-sigma range of long-term historical data, this may indicate potential risks or problems.

[0085] In the detection of anomalies in corporate credit data, the standard deviation method is commonly used, but this method has some limitations: Dependence on normal distribution: The standard deviation method assumes that the data follows a normal distribution, which means that the data should be symmetrically distributed around the mean. However, data in the real world often do not conform to a normal distribution and may be skewed or have multiple peaks. In this case, the standard deviation method may not accurately reflect the true degree of discreteness of the data; Sensitivity to outliers: The standard deviation method is very sensitive to outliers. In a data set, even if there are only a few outliers, it may cause the standard deviation to increase significantly, thereby mistakenly marking normal data points as abnormal.

[0086] Based on this, an embodiment of the present application proposes an enterprise credit data anomaly detection method based on artificial intelligence to solve the above problems.

[0087] Please see Figure 1 , Figure 1 A flowchart of an artificial intelligence-based corporate credit data anomaly detection method provided in an embodiment of the present application. The artificial intelligence-based corporate credit data anomaly detection method includes:

[0088] 100. Collect enterprise credit data and pre-process the data.

[0089] 110. Collect corporate credit data and perform data cleaning on the data; the data cleaning includes processing missing values, removing duplicate data and outliers.

[0090] Optionally, corporate credit data includes financial statements, transaction records, customer feedback, and social media data.

[0091] 111. Conduct a comprehensive check on the corporate credit data, determine the fields with missing values, and record the number of missing values ​​and the fields in which they are located.

[0092] Specifically, first, conduct a comprehensive check on the corporate credit data to determine which fields have missing values. You can use data visualization tools (such as bar charts, heat maps, etc.) or data analysis software to quickly identify the distribution of missing values; record the number of missing values ​​and the fields they are in so that targeted processing measures can be taken later.

[0093] 112. Analyze the reasons for missing values ​​and classify the missing values ​​into missing types according to the reasons for missing values. The missing types include: random missing, completely random missing and non-random missing.

[0094] Specifically, understanding the causes of missing values ​​is crucial to choosing the appropriate treatment method. Missing values ​​may be caused by errors in the data collection process, data transmission problems, and failure of the surveyed enterprises to provide information. Optionally, depending on the causes of missing values, missing values ​​can be divided into random missing, completely random missing, and non-random missing.

[0095] 113. Select the missing value processing method based on the proportion of missing values.

[0096] Optionally, if the proportion of missing values ​​is low, you can consider directly deleting the records containing missing values. This method is simple and direct, but it may result in a reduction in the amount of data and affect the accuracy of subsequent analysis. In addition, for a specific variable, if the proportion of missing values ​​is high and the importance of the variable to credit assessment is low, you can consider deleting the variable.

[0097] Optionally, for numeric variables, the mean or median of the variable can be used to fill missing values. This method is suitable for cases where the data distribution is relatively symmetrical. For categorical variables, the mode of the variable can be used to fill missing values. In addition, linear interpolation, polynomial interpolation and other methods can be used to fill missing values. This method is suitable for cases where the data has certain trends or regularities.

[0098] Optionally, you can also use model prediction to fill in missing values ​​using machine learning algorithms, such as regression models and decision trees. This method can make full use of other information in the data, but the computational cost is high.

[0099] 114. Use set functions to identify duplicate data in corporate credit data and record the number and specific content of duplicate data.

[0100] Specifically, data processing tools or functions in programming languages ​​are used to deduplicate corporate credit data. The presence of duplicate data can be determined by comparing key fields of each record in the data set (such as company name, unified social credit code, etc.), and the number and specific content of the duplicate data can be recorded for subsequent processing.

[0101] 115. Delete or merge duplicate data.

[0102] Specifically, delete duplicate records: For completely duplicate records, you can directly delete the redundant records and only keep one unique record.

[0103] Specifically, merge duplicate records: If there are some differences between duplicate records, you can merge them according to the specific situation. For example, you can merge different field values ​​in duplicate records, or select one of the records as a representative and integrate the information of other records into this record.

[0104] 116. Identify outliers in corporate credit data and analyze the causes of the outliers.

[0105] Specifically, outliers refer to data points that are significantly different from other data in the data set. The following methods can be used to identify outliers: Statistical methods: By calculating the mean, median, standard deviation and other statistical quantities of the data, using box plots, 3σ principles and other methods to determine outliers, box plots can intuitively display the distribution of data, outliers are usually defined as data points outside the upper and lower boundaries of the box plot, and the 3σ principle is based on the assumption of normal distribution, and data points that are more than 3 times the standard deviation away from the mean are considered outliers; Machine learning methods: Use unsupervised learning algorithms, such as clustering algorithms, isolation forests, etc., to identify outliers. These algorithms can automatically discover abnormal patterns in data without pre-setting the definition of outliers.

[0106] Understandably, determining the cause of outliers is very important, as some outliers may be due to data errors or unusual circumstances, while others may reflect real special circumstances.

[0107] Optionally, for outliers that may be caused by data errors, further inspection of the data collection and processing process is required to determine whether there are errors; for outliers that reflect real special circumstances, consideration may be given to retaining these data points, but special processing is required in subsequent analysis.

[0108] 117. Use an exception handling method to handle the outliers, wherein the exception handling method includes deleting outliers, replacing outliers, and binning.

[0109] Exemplarily, deleting outliers: If the number of outliers is small, you can consider deleting these outliers directly.

[0110] Exemplary, replace outliers: You can use statistics such as mean, median, mode, etc. to replace outliers. This method is suitable for situations where the number of outliers is small and the impact on data distribution is small.

[0111] For example, binning: For continuous variables, binning can be performed to assign outliers to specific bins. This method can reduce the impact of outliers on the model while retaining the distribution information of the data.

[0112] As mentioned above, in the process of dealing with missing values, removing duplicate data and outliers, it is necessary to continuously check and verify data quality to ensure that the processed data is accurate, complete and reliable. At the same time, you can also choose appropriate processing methods based on specific business needs and data analysis purposes to improve data quality and availability.

[0113] 120. Select key features of corporate credit data and perform normalization and standardization.

[0114] Understandably, clarifying the specific goals of corporate credit assessment, such as judging the company's debt repayment ability, operational stability, compliance, etc., will help determine which data features are most relevant to credit assessment. In addition, communicate with the business department to understand the key indicators and risk points they focus on when assessing corporate credit.

[0115] In addition, study the relevant theories and methods of corporate credit assessment, and understand traditional credit assessment indicators, such as financial ratios (asset-liability ratio, current ratio, etc.), operating performance indicators (operating income growth rate, net profit margin, etc.), industry-specific indicators, etc. Consider the characteristics of different industries and determine the key characteristics applicable to specific industries. For example, for manufacturing companies, they may focus on production capacity, inventory turnover rate and other characteristics; for service industry companies, customer satisfaction, employee turnover rate, etc. may be more important.

[0116] Optionally, collect data sets related to corporate credit, including financial data, operating data, market data, public opinion data, etc. Perform data visualization and statistical analysis to understand the distribution and correlation of each feature and its potential relationship with the credit assessment target. For example, observe the distribution of features by drawing histograms, scatter plots, etc., and calculate the correlation coefficients between features to find redundant features.

[0117] 121. Select key features according to feature selection methods, where feature selection methods include filtering methods, wrapping methods and embedded methods.

[0118] Exemplary filtering method: selection is made based on the correlation between the feature and the target variable. Indicators such as the Pearson correlation coefficient and mutual information can be used to measure the degree of correlation between the feature and the credit assessment result, and features with higher correlation can be selected.

[0119] Exemplary, wrapper approach: treat feature selection as an optimization problem, use machine learning algorithms (such as random forests, support vector machines, etc.) for feature selection, evaluate model performance by continuously trying different feature combinations, and select the optimal feature subset.

[0120] Exemplary, embedded method: Automatic feature selection during model training. For example, when using Lasso regression or Ridge regression, the regularization term can prompt the model to automatically select important features and compress the coefficients of unimportant features.

[0121] 122. For each selected key feature, determine its normalization method.

[0122] Exemplary, minimum-maximum normalization: map the eigenvalues ​​to the interval [0, 1], and the calculation formula is:

[0123]

[0124] Among them, X is the original eigenvalue, X min is the minimum value of the feature, X max is the maximum value of the feature.

[0125] For example, mean normalization: map the feature value to a specific interval centered on the mean, and the calculation formula is:

[0126]

[0127] Here, μ is the mean of the feature and σ is the standard deviation of the feature.

[0128] For each selected feature, determine its normalization method.

[0129] 123. Calculate statistics of key features.

[0130] Specifically, statistics such as the minimum, maximum, mean, and standard deviation of the features are calculated.

[0131] 124. Transform the eigenvalues ​​according to the selected normalization method.

[0132] Optionally, the eigenvalues ​​are transformed according to the selected normalization method. For example, if the minimum-maximum normalization is used, for each eigenvalue, the original eigenvalue is subtracted from the minimum value of the feature and then divided by the difference between the maximum value and the minimum value of the feature to obtain the normalized eigenvalue.

[0133] 125. Select a standardization method.

[0134] For example, Z-score standardization: convert the feature value into a distribution with a mean of 0 and a standard deviation of 1, and the calculation formula is:

[0135]

[0136] Here, μ is the mean of the feature and σ is the standard deviation of the feature.

[0137] 126. Calculate the mean and standard deviation of each key feature.

[0138] 127. For each eigenvalue, subtract the mean of the key feature from it, and then divide it by the standard deviation of the key feature to obtain the standardized eigenvalue.

[0139] As described above, the embodiments of the present application can select key features and normalize and standardize them, so as to provide high-quality input data for artificial intelligence-based enterprise credit data anomaly detection and improve the performance and accuracy of the model.

[0140] 200. Adaptively select anomaly detection algorithm based on the type of enterprise credit data.

[0141] 210. Analyze corporate credit data types.

[0142] For example, financial data, features: usually include balance sheet, income statement, cash flow statement and other data, with numerical characteristics, and may have certain distribution patterns. For example, debt-to-asset ratio, current ratio, net profit and other indicators.

[0143] Exemplary, operational data, features: covers data on production, sales, inventory, etc. of an enterprise, which may contain numerical and categorical features, and the distribution of data may be complex. For example, sales, output, customer satisfaction ratings, etc.

[0144] For example, market data, features: reflects the performance of enterprises in the market, such as stock price, market value, price-earnings ratio, etc. The data may have time series characteristics and be greatly affected by market factors. For example, stock price fluctuations, market share changes, etc.

[0145] For example, public opinion data, features: mainly text data, including news reports, social media comments, etc., which need to be processed and analyzed to extract valuable information. For example, news headlines, Weibo comments, etc.

[0146] 220. Based on the type of enterprise credit data, an anomaly detection algorithm is adaptively selected based on the algorithm selection strategy.

[0147] 221. For numerical data, choose statistical methods or machine learning methods.

[0148] Exemplary statistical-based methods: Normal distribution hypothesis test: If the data approximately follows a normal distribution, outliers can be detected using methods such as the 3σ rule or the Grubbs test. These methods calculate a threshold based on the mean and standard deviation of the data, and data points exceeding the threshold are considered outliers.

[0149] Exemplary statistical-based methods: Box plot method: By drawing a box plot, the distribution of the data is observed, and data points that are beyond 1.5 times the interquartile range of the upper and lower quartiles are regarded as outliers.

[0150] Exemplary machine learning methods: Isolation Forest: Applicable to high-dimensional data, it can effectively detect outliers. The algorithm quickly isolates outliers by randomly splitting the data space.

[0151] Exemplary machine learning method: Local Outlier Factor (LOF): Calculate the local outlier factor of each data point. The larger the value, the more likely the point is an outlier. It takes into account the local density of the data point and works better for data with different density areas.

[0152] 222. For data with time series characteristics, choose time series analysis method or deep learning method.

[0153] Exemplary time series analysis method: ARIMA model residual analysis: Establish an autoregressive moving average model (ARIMA) to fit the time series data, and then analyze whether there are outliers in the model residuals. If the residuals exceed a certain range, the corresponding time point data can be considered to be an outlier.

[0154] Exemplary time series analysis methods: Sliding window method: Set a sliding window of fixed length, calculate the statistical characteristics of the data in the window, such as mean, standard deviation, etc. When the statistical characteristics of the new data point are significantly different from those of the data in the window, it is determined to be an outlier.

[0155] Exemplary, deep learning methods: Long Short-Term Memory Network (LSTM): can model time series data and detect anomalies by predicting the difference between future values ​​and actual values. If the prediction error is large, there may be anomalies.

[0156] 223. For public opinion data, choose text processing and machine learning methods.

[0157] For example, text preprocessing: cleaning, word segmentation, and stop word removal of public opinion data to convert the text into a computable vector representation.

[0158] For example, topic models such as Latent Dirichlet Allocation (LDA) can be used to discover the topic distribution in a text. Abnormal public opinion may be quite different from common topics, and whether it is abnormal can be determined by calculating the distance between the text and the topic.

[0159] Exemplary, machine learning classifier: Use classifiers such as support vector machine (SVM) and random forest to classify public opinion data into normal and abnormal categories, train by annotating a portion of the data, and then classify new public opinion data.

[0160] On the basis of the above embodiment, the method of the embodiment of the present application can also be embodied as follows: the algorithm selection strategy includes:

[0161] 231. Perform feature analysis on the input corporate credit data, determine the data type, distribution characteristics, and dimensions, and calculate the statistical characteristics of the data.

[0162] Specifically, the feature analysis module is used to perform feature analysis on the input corporate credit data to determine the type, distribution characteristics, dimension and other information of the data; the statistical characteristics of the data, such as mean, standard deviation, skewness, kurtosis, etc., are calculated to provide a basis for algorithm selection.

[0163] 232. Establish a library containing multiple anomaly detection algorithms, which targets algorithms for different data types.

[0164] Optionally, build a library of multiple anomaly detection algorithms, including the above algorithms for different data types.

[0165] 233. Encapsulate each algorithm so that it has a unified interface.

[0166] It is understandable that each algorithm is encapsulated so that it has a unified interface for easy calling and evaluation.

[0167] 234. Select evaluation indicators to measure the performance of the algorithm, where the evaluation indicators include: accuracy, recall rate, and F1 value.

[0168] 235. Choose different evaluation indicators for different types of data.

[0169] Optionally, for different types of data, different evaluation indicators can be selected according to their characteristics. For example, for financial data, more attention is paid to accuracy; for public opinion data, recall may be more important.

[0170] 236. Based on the results of feature analysis, select an algorithm suitable for the current data from the algorithm library.

[0171] 237. Use a portion of labeled data sets to evaluate the algorithm and select the algorithm based on the evaluation indicators.

[0172] 238. If the data type changes or new data is added, re-analyze the features and select the algorithm to make adaptive adjustments.

[0173] As described above, the embodiment of the present application automatically selects a suitable anomaly detection algorithm according to the type of enterprise credit data, thereby improving the accuracy and efficiency of anomaly detection.

[0174] 300. Train and validate machine learning models.

[0175] 310. Obtain training data and divide the data set into a training set and a test set.

[0176] 320. Adjust the hyperparameters of the machine learning model, wherein the hyperparameters include: cross validation and grid search.

[0177] Optionally, understand the purpose of cross-validation. Cross-validation is mainly used to evaluate the performance and stability of the model. It can also help choose appropriate hyperparameters. It divides the dataset into multiple subsets and performs training and validation on different subset combinations to obtain more reliable model evaluation results.

[0178] 321. Select a cross-validation method, wherein the cross-validation method includes: K-fold cross-validation, leave-one-out cross-validation, and stratified cross-validation.

[0179] Exemplary, K-fold cross validation: randomly divide the data set into K subsets of similar size, select one of the subsets as the validation set in turn, and the remaining K-1 subsets as the training set, perform K training and validation, and finally calculate the average of the K validation results as the performance indicator of the model.

[0180] Exemplary, leave-one-out cross validation: When the data set is small, leave-one-out cross validation can be used. Each time, only one sample is left as the validation set, and the remaining samples are used as the training set, and training and validation are performed N times (N is the size of the data set).

[0181] For example, stratified cross validation: In classification problems, if the category distribution of the dataset is unbalanced, stratified cross validation can be used to ensure that the category ratio in each subset is the same as that in the original dataset.

[0182] 322. Divide the enterprise credit data set according to the selected cross-validation method.

[0183] 323. For each split, use the training set to train the model and evaluate the performance indicators of the model on the validation set, including accuracy, recall, and F1 value.

[0184] 324. Record the results of each validation and calculate the mean and standard deviation to evaluate the model performance.

[0185] 325. For anomaly detection models, determine the hyperparameters that need to be adjusted.

[0186] Optionally, for the anomaly detection model, determine the hyperparameters that need to be adjusted. For example, for the isolation forest model, possible hyperparameters include the number of trees, subsampling size, etc.; for the support vector machine model, hyperparameters may include the kernel function type, regularization parameter, etc. Among them, it is necessary to set and determine the reasonable value range of each hyperparameter.

[0187] 326. Combine the value range of each hyperparameter into a parameter grid.

[0188] Exemplarily, the value range of each hyperparameter is combined into a parameter grid. For example, if there are two hyperparameters A and B, the value range of A is [1,2,3], and the value range of B is [0.1,0.2,0.3], then the parameter grid is {(1,0.1), (1,0.2), (1,0.3), (2,0.1), (2,0.2), (2,0.3), (3,0.1), (3,0.2), (3,0.3)}.

[0189] 327. Use the cross-validation method to train and validate the model on each hyperparameter combination in the parameter grid.

[0190] 328. Record the verification results of each hyperparameter combination and select the hyperparameter combination.

[0191] Optionally, a hyperparameter combination with the best performance is selected. The best performance can be determined based on a specific evaluation metric, such as the highest accuracy, the largest F1 value, etc.

[0192] 329. If the results of the grid search do not meet the set requirements, search for the hyperparameter combination.

[0193] Optionally, if the grid search results are not satisfactory, you can perform a more refined search near the best performing hyperparameter combination. For example, you can narrow the range of hyperparameter values ​​or use a denser grid for the search.

[0194] Optionally, you can also try other hyperparameter tuning methods, such as random search, which randomly selects some points in the hyperparameter space for evaluation. Compared with grid search, it can try more hyperparameter combinations with the same computing resources.

[0195] In addition, when adjusting hyperparameters, we should not only pay attention to the performance of the model on the validation set, but also consider the complexity and generalization ability of the model. An overly complex model may overfit the training data and perform poorly on new data.

[0196] For example, you can judge whether the model is overfitting by observing the performance difference between the training set and the validation set. If the performance on the training set is very good, but the performance on the validation set is poor, it means that the model may be overfitting. You can try to reduce the complexity of the model, such as reducing the number of trees, lowering the regularization parameter, etc.

[0197] Therefore, the final hyperparameter combination should be combined with actual business needs. For example, if the recall rate of the model is high, a hyperparameter combination with good recall rate can be selected, even if the accuracy rate may be reduced. At the same time, factors such as the computational efficiency and interpretability of the model should also be considered.

[0198] In some embodiments, model performance is evaluated using metrics such as accuracy, recall, and F1 score.

[0199] For example, accuracy refers to the ratio of the number of samples correctly predicted by the model to the total number of samples, and the calculation formula is:

[0200]

[0201] Among them, TP (True Positive) represents true positive examples, that is, the number of samples that are actually positive examples and predicted as positive examples by the model; TN (True Negative) represents true negative examples, that is, the number of samples that are actually negative examples and predicted as negative examples by the model; FP (False Positive) represents false positive examples, that is, the number of samples that are actually negative examples but predicted as positive examples by the model; FN (False Negative) represents false negative examples, that is, the number of samples that are actually positive examples but predicted as negative examples by the model.

[0202] Specifically, for the corporate credit data anomaly detection model, abnormal companies in the data set are marked as positive examples, and normal companies are marked as negative examples; the model makes predictions for each company to determine whether it is an abnormal company; the number of true positive examples, true negative examples, false positive examples, and false negative examples is counted, and then the accuracy is calculated according to the formula; the higher the accuracy, the better the overall prediction accuracy of the model, but when the ratio of positive and negative examples in the data set is unbalanced, the accuracy may be misleading.

[0203] For example, recall rate (Recall), also known as recall rate, refers to the ratio of the number of positive examples correctly predicted by the model to the total number of actual positive examples. The calculation formula is:

[0204]

[0205] Specifically, in the anomaly detection of corporate credit data, the recall rate measures how many abnormal companies the model can correctly identify. A higher recall rate means that the model can find all abnormal companies as much as possible and reduce missed detections. However, simply pursuing a high recall rate may lead to an increase in false positives, that is, misjudging some normal companies as abnormal companies.

[0206] For example, the F1 score is the harmonic mean of the precision and recall, which takes into account the accuracy and completeness of the model. The calculation formula is:

[0207]

[0208] in, is the precision, which indicates the proportion of true positive examples among the samples predicted by the model as positive examples.

[0209] Specifically, the F1 score strikes a balance between precision and recall. When the F1 score is high, it means that the model performs well in both accuracy and completeness. When evaluating the anomaly detection model for corporate credit data, the F1 score can be optimized by adjusting the model's hyperparameters or selecting different algorithms.

[0210] Exemplarily, a comprehensive evaluation is performed based on various indicators: a ROC curve is drawn and an AUC value is calculated.

[0211] The ROC (Receiver Operating Characteristic) curve is a curve drawn with the false positive rate (FPR) as the horizontal axis and the true positive rate (TPR, i.e., recall rate) as the vertical axis.

[0212] Among them, the AUC (Area Under the Curve) value is the area under the ROC curve. The larger the AUC value, the better the performance of the model.

[0213] Specifically, by drawing the ROC curve and calculating the AUC value, the performance of the model at different thresholds can be more comprehensively evaluated.

[0214] For example, according to the specific business needs of anomaly detection of corporate credit data, determine the degree of emphasis on accuracy, recall and F1 score. For example, if the risk of missing abnormal companies is high, more attention may be paid to recall; if the cost of misjudging normal companies as abnormal companies is high, more attention may be paid to accuracy; consider multiple indicators comprehensively and select the model that best suits the business needs.

[0215] As described above, the embodiments of the present application can comprehensively evaluate the performance of the enterprise credit data anomaly detection model by using indicators such as accuracy, recall rate, and F1 score, thereby providing a basis for optimizing and improving the model.

[0216] 400. Use the trained model to perform real-time detection on newly input credit data, identify anomalies, and present the detection results in a visual manner.

[0217] Specifically, the trained model is used to perform real-time detection on newly input credit data to identify potential anomalies; a real-time monitoring system is built to present the detection results in a visual manner to facilitate timely processing by relevant personnel.

[0218] 500. Establish a feedback mechanism to compare the test results with the set data to optimize the model, and update the data and model regularly.

[0219] For example, a feedback mechanism is established to compare the detection results with manually confirmed anomalies to optimize the model. Incremental learning: Update the model regularly and retrain with new data to maintain the effectiveness of the model.

[0220] In the above implementation process, the embodiment of the present application collects enterprise credit data and pre-processes the data; adaptively selects anomaly detection algorithms according to the type of enterprise credit data; trains and verifies machine learning models; uses the trained model to perform real-time detection on newly input credit data, identifies anomalies, and presents the detection results in a visual manner; establishes a feedback mechanism to compare the detection results with the set data to optimize the model, and regularly updates the data and model; the machine learning model can learn the actual distribution of the data through training data, rather than just assuming a normal distribution. Even if the data distribution is skewed or multimodal, the model can more accurately identify outliers. Adding abnormal samples to train the model during the training process can improve the performance of the model when facing outliers in real-world data.

[0221] The machine learning model of the embodiment of the present application can learn the actual distribution of the data through training data, rather than just assuming a normal distribution, which means that even if the data distribution is skewed or multimodal, the model can more accurately identify outliers.

[0222] Deep learning models can be designed to be more robust to outliers. For example, adversarial training can make models more robust and less susceptible to outliers. Intentionally adding outliers to the training process can improve the performance of the model in the face of outliers in real-world data.

[0223] The traditional 3-sigma rule uses a fixed threshold to identify outliers. The machine learning model of the embodiment of the present application can dynamically adjust the threshold according to the real-time changes of the data, thereby providing a more flexible and adaptable anomaly detection mechanism. This method can better cope with the situation where the data distribution evolves over time.

[0224] The above steps are not to be performed in a strict order as described in the numbers, but should be understood as an overall solution.

[0225] In the second aspect, based on the above embodiments, Figure 2 A schematic diagram of the structure of an enterprise credit data anomaly detection device based on artificial intelligence provided in an embodiment of the present application. Figure 2 The enterprise credit data anomaly detection device based on artificial intelligence provided in this embodiment specifically includes: a data collection module 201, an algorithm selection module 202, a model training module 203, an anomaly detection module 204 and a feedback adjustment module 205.

[0226] Among them, the data collection module 201 is used to collect enterprise credit data and pre-process the data; the algorithm selection module 202 is used to adaptively select anomaly detection algorithms according to the type of enterprise credit data; the model training module 203 is used to train and verify machine learning models; the anomaly detection module 204 is used to use the trained model to perform real-time detection on newly input credit data, identify anomalies, and present the detection results in a visual manner; the feedback adjustment module 205 is used to establish a feedback mechanism, compare the detection results with the set data to optimize the model, and regularly update the data and model.

[0227] As described above, the embodiments of the present application collect enterprise credit data and pre-process the data; adaptively select anomaly detection algorithms according to the type of enterprise credit data; train and verify machine learning models; use the trained model to perform real-time detection on newly input credit data, identify anomalies, and present the detection results in a visual manner; establish a feedback mechanism to compare the detection results with the set data to optimize the model, and regularly update the data and model; the machine learning model can learn the actual distribution of the data through training data, rather than just assuming a normal distribution. Even if the data distribution is skewed or multimodal, the model can more accurately identify outliers. Adding abnormal samples to train the model during the training process can improve the performance of the model when facing outliers in real-world data.

[0228] The artificial intelligence-based enterprise credit data anomaly detection device provided in the embodiment of the present application can be used to execute the artificial intelligence-based enterprise credit data anomaly detection method provided in the above embodiment, and has corresponding functions and beneficial effects.

[0229] On the third aspect, the embodiments of the present application also provide an electronic device that can integrate the artificial intelligence-based enterprise credit data anomaly detection device provided in the embodiments of the present application. Figure 3 Schematic diagram of the structure of an electronic device provided by an embodiment of the present application. Figure 3 The electronic device includes: an input device 33, an output device 34, a memory 32 and one or more processors 31; the memory 32 is used to store one or more programs; when the one or more programs are executed by the one or more processors 31, the one or more processors 31 implement the enterprise credit data anomaly detection method based on artificial intelligence as provided in the above embodiment. The input device 33, the output device 34, the memory 32 and the processor 31 can be connected by a bus or other means. Figure 3 The example of connecting through bus is taken in the following.

[0230] The processor 31 executes various functional applications and data processing of the device by running the software programs, instructions and modules stored in the memory 32, that is, realizes the above-mentioned enterprise credit data anomaly detection method based on artificial intelligence.

[0231] The electronic device provided above can be used to execute the artificial intelligence-based enterprise credit data anomaly detection method provided in the above embodiment, and has corresponding functions and beneficial effects.

[0232] In a fourth aspect, an embodiment of the present application also provides a computer-readable storage medium, which includes a stored computer program; wherein, when the computer program is running, the device where the computer-readable storage medium is located is controlled to execute the above-mentioned artificial intelligence-based enterprise credit data anomaly detection method, and can achieve the same beneficial effects.

[0233] Of course, the storage medium containing computer executable instructions provided in the embodiments of the present application is not limited to the artificial intelligence-based enterprise credit data anomaly detection method as described above, and can also execute related operations in the artificial intelligence-based enterprise credit data anomaly detection method provided in any embodiment of the present application.

[0234] In a fifth aspect, the embodiments of the present application also provide a computer program product, and the methods described in the various embodiments of the present application can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer programs or instructions. When the computer program or instruction is loaded and executed on a computer, the process or function described in the various embodiments of the present application is executed in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, a network device, a user device, a core network device, an OAM (Open Application Model) or other programmable device.

[0235] The computer program or instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer program or instructions may be transmitted from one website, computer, server or data center to another website, computer, server or data center by wired or wireless means. The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server or data center that integrates one or more available media. The available medium may be a magnetic medium, such as a floppy disk, a hard disk, or a magnetic tape; it may also be an optical medium, such as a digital video disk; it may also be a semiconductor medium, such as a solid-state drive. The computer-readable storage medium may be a volatile or non-volatile storage medium, or may include both volatile and non-volatile types of storage media.

[0236] In several embodiments provided in the present application, it should be understood that the disclosed devices and methods can also be implemented in other ways. The device embodiments described above are merely schematic. For example, the flowcharts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the devices, methods and computer program products according to multiple embodiments of the present application. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of a code, and the module, a program segment or a part of a code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of boxes in the block diagram and / or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or action, or can be implemented with a combination of dedicated hardware and computer instructions.

[0237] In addition, the functional modules in the various embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.

[0238] If the functions are implemented in the form of software function modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium, including several instructions for enabling an electronic device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0239] The above description is only an embodiment of the present application and is not intended to limit the scope of protection of the present application. For those skilled in the art, the present application may have various changes and variations. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application should be included in the scope of protection of the present application. It should be noted that similar reference numerals and letters represent similar items in the following drawings, so once an item is defined in one drawing, it does not need to be further defined and explained in the subsequent drawings.

[0240] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0241] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

Claims

1. An artificial intelligence-based enterprise credit data anomaly detection method, characterized in that: The method comprises: Collect enterprise credit data and pre-process the data; Adaptively select anomaly detection algorithms based on the type of enterprise credit data; Train and validate machine learning models; Use the trained model to perform real-time detection on newly input credit data, identify anomalies, and present the detection results in a visual way; Establish a feedback mechanism to compare the test results with the set data to optimize the model, and update the data and model regularly.

2. The method for detecting anomalies in enterprise credit data based on artificial intelligence according to claim 1 is characterized in that: The collecting of enterprise credit data and preprocessing of the data include: Collect corporate credit data and clean the data; data cleaning includes processing missing values, removing duplicate data and outliers; Select key features of corporate credit data and normalize and standardize them.

3. The method for detecting anomalies in corporate credit data based on artificial intelligence according to claim 1 is characterized in that: The adaptively selecting anomaly detection algorithm according to the enterprise credit data type includes: Analyze corporate credit data types; According to the type of enterprise credit data, the anomaly detection algorithm is adaptively selected according to the algorithm selection strategy.

4. The method for detecting anomalies in enterprise credit data based on artificial intelligence according to claim 1 is characterized in that: The training and verification of the machine learning model includes: Get training data and divide the data set into training set and test set; Adjust the hyperparameters of the machine learning model, including cross validation and grid search.

5. The method for detecting anomalies in corporate credit data based on artificial intelligence according to claim 2 is characterized in that: The collecting of enterprise credit data and data cleaning of the data include: Conduct a comprehensive check on the corporate credit data to identify the fields with missing values ​​and record the number of missing values ​​and the fields in which they are located; Analyze the reasons for missing values ​​and classify missing values ​​into missing types according to the reasons for missing values. Missing types include: random missing, completely random missing, and non-random missing. Select missing value processing method according to the proportion of missing values; Use the set function to identify duplicate data in corporate credit data and record the number and specific content of the duplicate data; Delete or merge duplicate data; Identify outliers in corporate credit data and analyze the causes of outliers; An outlier processing method is used to process outliers, wherein the outlier processing method includes deleting outliers, replacing outliers, and binning; The process of selecting key features of enterprise credit data and performing normalization and standardization includes: Select key features according to feature selection methods, where the feature selection methods include filtering methods, wrapping methods, and embedded methods; For each selected key feature, determine its normalization method; Calculate statistics of key features; According to the selected normalization method, the eigenvalues ​​are transformed; Select the standardization method; Calculate the mean and standard deviation of each key feature; For each eigenvalue, subtract the mean of the key feature from it, and then divide it by the standard deviation of the key feature to obtain the standardized eigenvalue.

6. The method for detecting anomalies in corporate credit data based on artificial intelligence according to claim 3 is characterized in that: The method of adaptively selecting an anomaly detection algorithm according to the enterprise credit data type and the algorithm selection strategy includes: For numerical data, choose statistical methods or machine learning methods; For data with time series characteristics, choose time series analysis methods or deep learning methods; For public opinion data, choose text processing and machine learning methods; Wherein, the algorithm selection strategy includes: Perform feature analysis on the input corporate credit data, determine the data type, distribution characteristics, and dimensions, and calculate the statistical characteristics of the data; Build a library of anomaly detection algorithms for different data types; Encapsulate each algorithm to give it a unified interface; Select evaluation indicators to measure the performance of the algorithm, including: accuracy, recall, and F1 value; For different types of data, choose different evaluation indicators; According to the results of feature analysis, select an algorithm suitable for the current data from the algorithm library; Use a portion of labeled data sets to evaluate the algorithm and select the algorithm based on the evaluation indicators; If the data type changes or new data is added, re-analyze the features and select the algorithm to make adaptive adjustments.

7. The method for detecting anomalies in corporate credit data based on artificial intelligence according to claim 4 is characterized in that: The hyperparameters of the machine learning model are adjusted, including: Select a cross-validation method, where the cross-validation method includes: K-fold cross-validation, leave-one-out cross-validation, and stratified cross-validation; Divide the enterprise credit data set according to the selected cross-validation method; For each split, the model is trained using the training set and the performance indicators of the model are evaluated on the validation set, including accuracy, recall, and F1 value. Record the results of each validation and calculate the mean and standard deviation to evaluate model performance; For a specific anomaly detection model, determine the hyperparameters that need to be tuned; Combine the value range of each hyperparameter into a parameter grid; Use cross-validation to train and validate the model on each hyperparameter combination in the parameter grid; Record the verification results of each hyperparameter combination and select the hyperparameter combination; If the results obtained by the grid search do not meet the set requirements, further search for the hyperparameter combination is performed.

8. An artificial intelligence-based enterprise credit data anomaly detection device, characterized in that: include: The data collection module is used to collect enterprise credit data and pre-process the data; An algorithm selection module is used to adaptively select an anomaly detection algorithm based on the type of enterprise credit data; Model training module, used to train and validate machine learning models; The anomaly detection module is used to use the trained model to perform real-time detection on newly input credit data, identify anomalies, and present the detection results in a visual manner; The feedback adjustment module is used to establish a feedback mechanism to compare the test results with the set data to optimize the model and regularly update the data and model.

9. An electronic device, characterized in that: include: A processor, a memory and a bus, wherein the processor is connected to the memory via the bus, and the memory stores computer-readable instructions. When the computer-readable instructions are executed by the processor, they are used to implement the enterprise credit data anomaly detection method based on artificial intelligence as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, which, when executed by a server, implements the artificial intelligence-based enterprise credit data anomaly detection method as described in any one of claims 1 to 7.

Citation Information

Patent Citations

  • Image anomaly detection platform based on incremental learning and open set recognition algorithm

    CN116486239A

  • Water environment dynamic monitoring system and method based on Internet of Things

    CN116796907A

  • SDWAN abnormal traffic identification method based on XGBoost model

    CN117834202A

  • Enterprise big data analysis system based on artificial intelligence

    CN117993737A

  • Network traffic anomaly detection method based on isolation forest algorithm

    CN118233135A