A risk monitoring and early warning system and method based on data analysis

The risk monitoring and early warning system, which uses data analysis, filters out abnormal users and key files, monitors high-risk operations in real time and issues warnings, thus solving the problems of accidental file deletion and resource waste in data storage and achieving efficient file backup and monitoring.

CN116701118BActive Publication Date: 2024-11-15NETKY TECH (BEIJING) CO LTD
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
CN202310703116.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-06-14
Publication Date
2024-11-15
Estimated Expiration
2043-06-14

AI Technical Summary

Technical Problem

Existing technologies suffer from problems such as accidental file deletion and resource waste during data storage, especially in preventing the omission and accidental deletion of important files.

Method used

The risk monitoring and early warning system based on data analysis collects user operation and file information, filters out abnormal users and key files, monitors high-risk operations in real time and sends out early warnings, and performs necessary file backups.

Benefits of technology

It effectively reduces the probability of accidental deletion of important files, reduces system resource consumption, and improves backup efficiency and accuracy.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116701118B_ABST
    Figure CN116701118B_ABST
Patent Text Reader

Abstract

The present invention discloses a risk monitoring and early warning system and method based on data analysis, belonging to the field of data storage technology. By monitoring and early warning users, files and operation behaviors, the risk probability of data loss is reduced. The system includes a data acquisition module, a data processing module, an operation management module and a data backup module; the data acquisition module is used to collect the operation information of all users in a specified area, as well as the file information in the user's computer; the data processing module screens out users with a high data leakage rate through the operation information and file information, analyzes and judges the files in these users' computers, and finds out key files for monitoring; the operation management module is used to analyze the risk level of key file operations, send early warning information to users in a timely manner in the case of high-risk operations, and perform corresponding operations according to user feedback; the data backup module is used to back up files that users need to save.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of data storage, and in particular to a risk monitoring and early warning system and method based on data analysis. Background Art

[0002] With the continuous development of information technology, all walks of life are accelerating the pace of digital transformation, and data storage has become one of the indispensable infrastructures in the digital age. People are increasingly relying on electronic devices to store and manage important personal and corporate data. However, due to human factors or technical constraints, files are often lost during use, transmission and storage. Human factors are one of the main reasons for file loss.

[0003] At present, data loss prevention is mainly focused on software: using data backup software, data recovery software and other technical means to protect data and ensure data integrity. These technical means can solve the problem of data loss to a certain extent, but there are also some other problems; for example: not all files are important, and rough backup of all files wastes computer resources and takes up a lot of storage space; or, when the original file is deleted, the original storage area is overwritten by other files, resulting in permanent loss of the original file and irrecoverable. How to back up files on demand, and how to minimize accidental deletion, so as to reduce backup pressure while improving backup efficiency and reducing the probability of accidental deletion, these problems are already in urgent need of being solved. Summary of the invention

[0004] The purpose of the present invention is to provide a risk monitoring and early warning system and method based on data analysis to solve the problems raised in the above background technology.

[0005] In order to solve the above technical problems, the present invention provides the following technical solutions: a risk monitoring and early warning system based on data analysis, the early warning system includes a data acquisition module, a data processing module, an operation management module and a data backup module.

[0006] The data acquisition module is used to collect the operation information of all users and the file information in the user's computer; the data processing module screens out users with a high data leakage rate through the operation information and file information, analyzes and judges the files in these users' computers, and finds key files for monitoring; the operation management module is used to analyze the risk level of operations on key files, send early warning information to users in time in high-risk operations, and perform corresponding operations based on user feedback; the data backup module is used to back up files that users need to save.

[0007] The data acquisition module includes an operation information acquisition unit and a file information acquisition unit.

[0008] The operation information collection unit is used to collect the operation information of all users on the files in the specified area, and the operation information includes opening operation, closing operation, cleaning operation and saving operation, as well as the time corresponding to these operations.

[0009] The file information acquisition unit is used to acquire file information in the user's computer, and the file information includes file format, file name and validity period.

[0010] The collection of operation information is for all users in the specified area, and the collection of file information is for some abnormal users.

[0011] The data processing module includes a user screening unit and a file definition unit.

[0012] The user screening unit is used to screen out abnormal users from all users in a specified area.

[0013] First, the operation information of all users is collected to identify the number of files that users fail to open and the number of files saved by the corresponding users. Second, the information of both quantities is substituted into the formula to calculate the file leakage rate. Finally, users whose file leakage rate is greater than the leakage rate threshold are screened out and defined as abnormal users.

[0014] In order to improve the overall operating efficiency of the system and reduce the interference caused by redundant data, the system sets an effective period for each received file. During the effective period, the file can be opened normally even if it is not saved; after the effective period, the system will automatically clear it.

[0015] Normally, users browse the transfer records to quickly find and open files. The transfer records store index information for all files, and it is impossible to tell with the naked eye whether a file in the transfer record is out of date. When a user clicks to open a file, the system automatically searches the hard disk according to the index information stored in the transfer record. If the file is within the validity period, it can be opened normally. If it is beyond the validity period, it will be automatically cleared by the system, and the corresponding file cannot be found according to the index information, so the opening fails.

[0016] When a user clicks to open a file, it means that the user has a need for this file. If the file has not been saved before and has expired, it cannot be opened. This behavior is a missed save phenomenon. If the user does this too many times, it means that the corresponding user often forgets to save important files. In order to reduce the probability of data loss, it is necessary to screen out such users for monitoring.

[0017] The file definition unit is used to define the status information and type information of the file; the status information includes saved and unsaved, and the type information includes important and ordinary.

[0018] Firstly, the file information in all abnormal users' computers is collected, and the saved and unsaved files are distinguished according to whether they are saved by the users; secondly, the unsaved files whose browsing time is greater than the time threshold are defined as key files; then, a format information set and a name information set are established according to the format and name of the saved files, and it is determined whether the format of the unsaved file belongs to the format information set, and the similarity between the name of the unsaved file and each element in the name information set is calculated; finally, the unsaved files that belong to the format information set and whose maximum similarity is greater than the similarity threshold are defined as key files, and the other cases are defined as ordinary files.

[0019] Saved files and unsaved files refer to a state of a file. When a user receives a file, if he chooses to save it actively, it is a saved file. If he does not save it, it is an unsaved file. Saved files will be permanently stored on the computer and have no validity period. Unsaved files will be temporarily stored on the computer and will be automatically cleared by the system as cache after the validity period expires. However, the transfer record still exists, but the file cannot be opened.

[0020] The operation management module includes an operation management unit and a risk management unit.

[0021] The operation management unit is used to determine the risk level of user operations. The operation information and file information of abnormal users are obtained in real time for monitoring. When a user performs a cleanup operation on a folder containing key files, or the system automatically performs a cleanup operation on key files that have reached their validity period, it is determined to be a high-risk operation; in other cases, it is determined to be a low-risk operation.

[0022] The risk management unit is used to warn of high-risk operations. When a high-risk operation is detected, the system automatically intercepts the corresponding operation and sends a warning message to the corresponding user, reminding the user to further confirm the cleanup behavior. If the user chooses to confirm, the file or folder will be deleted; if the user chooses to cancel, it will jump to the data backup module.

[0023] When a user cleans up a folder containing key files, since the user may not be fully aware of every cleanup object in the cleanup folder, the probability of accidental deletion is high, and the system determines it as a high-risk operation. However, when the user directly cleans up key files, since the user already knows the cleanup object, this situation will not be determined by the system as a high-risk operation.

[0024] When key files are being cleaned up, the system automatically intercepts the operation and sends a warning message for the user to further confirm. The warning message includes the display of the names of key files in the folder to be cleaned up, or text content such as the system will clean up key files that have reached their validity period, and provides two options, Confirm and Cancel, to perform corresponding operations based on the user's selection. Key files will not be cleaned up during the time selected by the user. In this way, it can avoid the accidental deletion of important files due to user negligence, and also avoid important files being automatically cleaned up by the system as cache after exceeding their validity period.

[0025] The data backup module is used to back up the files that the user has saved and the files that need to be saved.

[0026] A risk monitoring and early warning method based on data analysis, the early warning method comprises the following steps:

[0027] S1. Filter out abnormal users from all users;

[0028] S2. Detect key files in the abnormal user's computer;

[0029] S3. Monitor all operations on key files and determine the degree of risk;

[0030] S4. Provide timely warnings for high-risk operations.

[0031] In S1, the steps for screening abnormal users are as follows:

[0032] S101, obtain the operation information of all users in the specified area and the file information in the user's computer. The operation information includes the opening operation, closing operation, cleaning operation and saving operation, and the time corresponding to these operations; the file information includes the file format, file name and validity period.

[0033] The operation information is bound to the user, and a user can operate the same file or different files multiple times. The file is bound to the operation information, and one operation information can only correspond to one file.

[0034] S102, identifying the number of failed opening operations for each user, where an opening failure means that when a user opens a file, the corresponding file expires and is automatically cleared by the system, so the file cannot be opened, resulting in an opening failure. Filter out users whose opening failure times are not zero, and mark these users.

[0035] To ensure the accuracy of subsequent calculations, each file will only be counted in the number of failures if it fails to be opened for the first time. Even if it fails to be opened again later, it will not be counted in the number of failures. The number of failures is linked to the number of files. If the same file fails to be opened multiple times at the same time, it will only be counted as one failure. If N different files fail to be opened at the same time, it will be counted as N failures.

[0036] S103, obtaining the number of files saved in the marked user's computer, substituting it into a formula together with the number of times the corresponding user failed to open the file, calculating the file leakage rate, and successively screening out users whose file leakage rates are greater than the leakage rate threshold, and defining these users as abnormal users; the formula is as follows:

[0037]

[0038] Where result is the user type judgment result, e is the number of user opening failures, f is the number of files saved by the user, and F is the leakage rate threshold.

[0039] In S2, the steps for detecting key files are as follows:

[0040] S201, obtaining file information in all abnormal user computers, and classifying the files into saved files and unsaved files according to whether they are saved by the user. Saved files refer to files saved by the user, and unsaved files refer to files that are not saved by the user and have not expired.

[0041] S202, obtain the operation information corresponding to the unsaved file, determine the time difference between the opening operation and the closing operation, and define the time difference as the browsing time of the file. Determine whether the browsing time is greater than the time threshold. If the result is yes, define the corresponding file as a key file and proceed to the next step; if the result is no, directly proceed to the next step.

[0042] S203, obtain the format information of the stored file, and put the information into a format information set X, where the set X includes {Q1, Q2, Q3, ..., Q i}, where i represents the number of format information, Q i Indicates the value of the i-th format information.

[0043] S204, obtain the name information of the stored files, and put the information into a name information set Y, where the set Y includes {W1, W2, W3, ..., W j}, where j represents the number of name information, W j Indicates the value of the j-th name information.

[0044] S205, obtaining format information of the remaining undefined unsaved files, and determining in turn whether they belong to the format information set. If the result is yes, marking the corresponding unsaved files; if the result is no, defining the corresponding files as common files.

[0045] S206, obtain the name information of the marked file, calculate the similarity with each element in the name information set in turn, and put the obtained similarity into the similarity set Z. Each marked file corresponds to a similarity set. The similarity calculation steps are as follows:

[0046] S206-1. Perform word segmentation on the file name, and convert each name into a word list.

[0047] S206-2. Remove duplicate words in each word list to obtain two different word sets.

[0048] S206-3. Merge two different word sets to obtain a total word set.

[0049] S206-4. Construct a vector for each word in the total word set, where each dimension of the vector represents the number of times the word appears in the text. Use the formula to calculate the similarity between two vectors, which is as follows:

[0050]

[0051] Where cos(θ) is the similarity of the file names, |a| represents the modulus of vector a, |b| represents the modulus of vector b, and a×b represents the inner product of vector a and vector b.

[0052] S207, judging whether the largest number in the similarity set corresponding to each marked file is greater than the similarity threshold, if the result is yes, the corresponding file is defined as a key file; if the result is no, the corresponding file is defined as a common file. The judgment formula is as follows:

[0053]

[0054] In the formula, FT is the file type, GS is the file format, X is the format information set, max(Z) is the maximum value in the file similarity set, and Z 阈 is the similarity threshold, T end is the file closing time, T start is the file opening time, T 阈 is the time threshold.

[0055] In S3, risk levels are divided into high risk and low risk.

[0056] High risk refers to the cleanup operation on key files. When a user cleans up a folder containing key files, or the system automatically cleans up key files that have reached their validity period, it is judged as a high-risk operation. Low risk refers to all operations except high-risk operations.

[0057] There is a difference between cleaning up a folder containing key files and directly cleaning up key files. When cleaning up a folder directly, it is possible that the user does not fully understand all the contents in the folder, and this behavior is very likely to cause the needed files to be accidentally deleted along with the folder. Directly cleaning up files, on the other hand, indicates that the user made the operation after subjective judgment, and the above phenomenon does not exist. Therefore, when the user directly cleans up key files, it is not included in the high-risk operation, but when the user cleans up the folder containing key files, it is judged as a high-risk operation.

[0058] In S4, early warning reminder means that when a high-risk operation is detected, the system automatically intercepts the corresponding operation and sends a warning message to the corresponding user, reminding the user to confirm the cleanup operation. If the user chooses to confirm, the file or folder will be deleted; if the user chooses to cancel, the corresponding key files will be automatically backed up.

[0059] Compared with the prior art, the beneficial effects achieved by the present invention are:

[0060] 1. The present invention screens all users and monitors users with a high file leakage rate, thereby reducing system resource consumption and improving monitoring efficiency.

[0061] 2. The present invention divides the files on the monitored user's computer into key files. The key file division is dynamically adjusted according to the file information saved by the user, and the monitoring is only performed on the key files, which can improve the monitoring quality and reduce the monitoring pressure.

[0062] 3. The present invention issues early warnings for sensitive operations on key files. When a user cleans up a folder containing key files or a key file is about to be automatically cleaned up by the system, an early warning message is automatically sent to the user, thereby minimizing the probability of accidental deletion. BRIEF DESCRIPTION OF THE DRAWINGS

[0063] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:

[0064] Figure 1 It is a structural schematic diagram of a risk monitoring and early warning system and method based on data analysis of the present invention;

[0065] Figure 2 It is a flow chart of a risk monitoring and early warning system and method based on data analysis of the present invention. DETAILED DESCRIPTION

[0066] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0067] See also Figure 1 The present invention provides a technical solution: a risk monitoring and early warning system based on data analysis, which includes a data acquisition module, a data processing module, an operation management module and a data backup module.

[0068] The data collection module is used to collect the operation information of all users and the file information in the user's computer; the data processing module screens out users with high data leakage rates through operation information and file information, analyzes and judges the files in these users' computers, and finds key files for monitoring; the operation management module is used to analyze the risk level of operations on key files, send early warning information to users in time in high-risk operations, and perform corresponding operations based on user feedback; the data backup module is used to back up files that users need to save.

[0069] The data acquisition module includes an operation information acquisition unit and a file information acquisition unit.

[0070] The operation information collection unit is used to collect the operation information of all users on the files in the specified area. The operation information includes opening operation, closing operation, cleaning operation and saving operation, as well as the time corresponding to these operations.

[0071] The file information collection unit is used to collect file information in the user's computer. The file information includes file format, file name and validity period.

[0072] The collection of operation information is for all users in the specified area, and the collection of file information is for some abnormal users.

[0073] The data processing module includes a user screening unit and a file definition unit.

[0074] The user screening unit is used to screen out abnormal users from all users in a specified area.

[0075] First, the operation information of all users is collected to identify the number of files that users fail to open and the number of files saved by the corresponding users. Second, the information of both quantities is substituted into the formula to calculate the file leakage rate. Finally, users whose file leakage rate is greater than the leakage rate threshold are screened out and defined as abnormal users.

[0076] In order to improve the overall operating efficiency of the system and reduce the interference caused by redundant data, the system sets an effective period for each received file. During the effective period, the file can be opened normally even if it is not saved; after the effective period, the system will automatically clear it.

[0077] Normally, users browse the transfer records to quickly find and open files. The transfer records store index information for all files, and it is impossible to tell with the naked eye whether a file in the transfer record is out of date. When a user clicks to open a file, the system automatically searches the hard disk according to the index information stored in the transfer record. If the file is within the validity period, it can be opened normally. If it is beyond the validity period, it will be automatically cleared by the system, and the corresponding file cannot be found according to the index information, so the opening fails.

[0078] When a user clicks to open a file, it means that the user has a need for this file. If the file has not been saved before and has expired, it cannot be opened. This behavior is a missed save phenomenon. If the user does this too many times, it means that the corresponding user often forgets to save important files. In order to reduce the probability of data loss, it is necessary to screen out such users for monitoring.

[0079] The file definition unit is used to define the status information and type information of the file; the status information includes saved and unsaved, and the type information includes important and ordinary.

[0080] Firstly, the file information in all abnormal users' computers is collected, and the saved and unsaved files are distinguished according to whether they are saved by the users; secondly, the unsaved files whose browsing time is greater than the time threshold are defined as key files; then, a format information set and a name information set are established according to the format and name of the saved files, and it is determined whether the format of the unsaved file belongs to the format information set, and the similarity between the name of the unsaved file and each element in the name information set is calculated; finally, the unsaved files that belong to the format information set and whose maximum similarity is greater than the similarity threshold are defined as key files, and the other cases are defined as ordinary files.

[0081] Saved files and unsaved files refer to a state of a file. When a user receives a file, if he chooses to save it actively, it is a saved file. If he does not save it, it is an unsaved file. Saved files will be permanently stored on the computer and have no validity period. Unsaved files will be temporarily stored on the computer and will be automatically cleared by the system as cache after the validity period expires. However, the transfer record still exists, but the file cannot be opened.

[0082] The operation management module includes the operation management unit and the risk management unit.

[0083] The operation management unit is used to determine the risk level of user operations. It obtains the operation information and file information of abnormal users in real time for monitoring. When a user cleans up a folder containing key files, or the system automatically cleans up key files that have reached their validity period, it is determined to be a high-risk operation; in other cases, it is determined to be a low-risk operation.

[0084] The risk management unit is used to warn of high-risk operations. When a high-risk operation is detected, the system automatically intercepts the corresponding operation and sends a warning message to the corresponding user, reminding the user to further confirm the cleanup behavior. If the user chooses to confirm, the file or folder will be deleted; if the user chooses to cancel, it will jump to the data backup module.

[0085] When a user cleans up a folder containing key files, since the user may not be fully aware of every cleanup object in the cleanup folder, the probability of accidental deletion is high, and the system determines it as a high-risk operation. However, when the user directly cleans up key files, since the user already knows the cleanup object, this situation will not be determined by the system as a high-risk operation.

[0086] When key files are being cleaned up, the system automatically intercepts the operation and sends a warning message for the user to further confirm. The warning message includes the display of the names of key files in the folder to be cleaned up, or text content such as the system will clean up key files that have reached their validity period, and provides two options, Confirm and Cancel, to perform corresponding operations based on the user's selection. Key files will not be cleaned up during the time selected by the user. In this way, it can avoid the accidental deletion of important files due to user negligence, and also avoid important files being automatically cleaned up by the system as cache after exceeding their validity period.

[0087] The data backup module is used to back up the files that the user has saved and the files that need to be saved.

[0088] See also Figure 2 The present invention provides a technical solution, a risk monitoring and early warning method based on data analysis, the early warning method comprises the following steps:

[0089] S1. Filter out abnormal users from all users;

[0090] S2. Detect key files in the abnormal user's computer;

[0091] S3. Monitor all operations on key files and determine the degree of risk;

[0092] S4. Provide timely warnings for high-risk operations.

[0093] In S1, the steps for screening abnormal users are as follows:

[0094] S101, obtain the operation information of all users in the specified area and the file information in the user's computer. The operation information includes the opening operation, closing operation, cleaning operation and saving operation, and the time corresponding to these operations; the file information includes the file format, file name and validity period.

[0095] The operation information is bound to the user, and a user can operate the same file or different files multiple times. The file is bound to the operation information, and one operation information can only correspond to one file.

[0096] S102, identifying the number of failed opening operations for each user, where an opening failure means that when a user opens a file, the corresponding file expires and is automatically cleared by the system, so the file cannot be opened, resulting in an opening failure. Filter out users whose opening failure times are not zero, and mark these users.

[0097] To ensure the accuracy of subsequent calculations, each file will only be counted in the number of failures if it fails to be opened for the first time. Even if it fails to be opened again later, it will not be counted in the number of failures. The number of failures is linked to the number of files. If the same file fails to be opened multiple times at the same time, it will only be counted as one failure. If N different files fail to be opened at the same time, it will be counted as N failures.

[0098] S103, obtaining the number of files saved in the marked user's computer, substituting it into a formula together with the number of times the corresponding user failed to open the file, calculating the file leakage rate, and successively screening out users whose file leakage rates are greater than the leakage rate threshold, and defining these users as abnormal users; the formula is as follows:

[0099]

[0100] Where result is the user type judgment result, e is the number of user opening failures, f is the number of files saved by the user, and F is the leakage rate threshold.

[0101] In S2, the steps for detecting key files are as follows:

[0102] S201, obtaining file information in all abnormal user computers, and classifying the files into saved files and unsaved files according to whether they are saved by the user. Saved files refer to files saved by the user, and unsaved files refer to files that are not saved by the user and have not expired.

[0103] S202, obtain the operation information corresponding to the unsaved file, determine the time difference between the opening operation and the closing operation, and define the time difference as the browsing time of the file. Determine whether the browsing time is greater than the time threshold. If the result is yes, define the corresponding file as a key file and proceed to the next step; if the result is no, directly proceed to the next step.

[0104] S203, obtain the format information of the stored file, and put the information into a format information set X, where the set X includes {Q1, Q2, Q3, ..., Q i}, where i represents the number of format information, Q i Indicates the value of the i-th format information.

[0105] S204, obtain the name information of the stored files, and put the information into a name information set Y, where the set Y includes {W1, W2, W3, ..., W j}, where j represents the number of name information, W j Indicates the value of the j-th name information.

[0106] S205, obtaining format information of the remaining undefined unsaved files, and determining in turn whether they belong to the format information set. If the result is yes, marking the corresponding unsaved files; if the result is no, defining the corresponding files as common files.

[0107] S206, obtain the name information of the marked file, calculate the similarity with each element in the name information set in turn, and put the obtained similarity into the similarity set Z. Each marked file corresponds to a similarity set. The similarity calculation steps are as follows:

[0108] S206-1. Perform word segmentation on the file name, and convert each name into a word list.

[0109] S206-2. Remove duplicate words in each word list to obtain two different word sets.

[0110] S206-3. Merge two different word sets to obtain a total word set.

[0111] S206-4. Construct a vector for each word in the total word set, where each dimension of the vector represents the number of times the word appears in the text. Use the formula to calculate the similarity between two vectors, which is as follows:

[0112]

[0113] Where cos(θ) is the similarity of the file names, |a| represents the modulus of vector a, |b| represents the modulus of vector b, and a×b represents the inner product of vector a and vector b.

[0114] S207, judging whether the largest number in the similarity set corresponding to each marked file is greater than the similarity threshold, if the result is yes, the corresponding file is defined as a key file; if the result is no, the corresponding file is defined as a common file. The judgment formula is as follows:

[0115]

[0116] In the formula, FT is the file type, GS is the file format, X is the format information set, max(Z) is the maximum value in the file similarity set, and Z 阈 is the similarity threshold, T end is the file closing time, T start is the file opening time, T 阈 is the time threshold.

[0117] In S3, risk levels are divided into high risk and low risk.

[0118] High risk refers to the cleanup operation on key files. When a user cleans up a folder containing key files, or the system automatically cleans up key files that have reached their validity period, it is judged as a high-risk operation. Low risk refers to all operations except high-risk operations.

[0119] There is a difference between cleaning up a folder containing key files and directly cleaning up key files. When cleaning up a folder directly, it is possible that the user does not fully understand all the contents in the folder, and this behavior is very likely to cause the needed files to be accidentally deleted along with the folder. Directly cleaning up files, on the other hand, indicates that the user made the operation after subjective judgment, and the above phenomenon does not exist. Therefore, when the user directly cleans up key files, it is not included in the high-risk operation, but when the user cleans up the folder containing key files, it is judged as a high-risk operation.

[0120] In S4, early warning reminder means that when a high-risk operation is detected, the system automatically intercepts the corresponding operation and sends a warning message to the corresponding user, reminding the user to confirm the cleanup operation. If the user chooses to confirm, the file or folder will be deleted; if the user chooses to cancel, the corresponding key files will be automatically backed up.

[0121] Embodiment 1:

[0122] Assume that there are three users A, B and C in the specified area. The number of failed opening attempts and the number of saved files are:

[0123] User A: 15 opening failures, 85 saved files;

[0124] User B: 10 opening failures, 90 saved files;

[0125] User C: 20 failed opening attempts, 60 saved files;

[0126] Assuming the leakage rate threshold is 0.1, the user type judgment result is:

[0127] User A: Abnormal users;

[0128] User B: Normal user;

[0129] CUser: Abnormal users;

[0130] The key files in the computers of user A and user B are monitored. When the user cleans up the folder containing the key files, or the system automatically cleans up the key files that have reached their validity period, an automatic warning and reminder will be issued.

[0131] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device.

[0132] Finally, it should be noted that the above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art can still modify the technical solutions described in the aforementioned embodiments or replace some of the technical features therein by equivalents. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A risk monitoring and early warning system based on data analysis, characterized in that: The early warning system includes a data acquisition module, a data processing module, an operation management module and a data backup module; The data collection module is used to collect the operation information of all users and the file information in the user's computer; the data processing module screens out abnormal users with high data leakage rate through the operation information and file information, analyzes and judges the files in the computers of these abnormal users, and finds out the key files for monitoring; The operation management module is used to analyze the risk level of key file operations, send warning information to users in a timely manner in the case of high-risk operations, and perform corresponding operations based on user feedback; the data backup module is used to back up files that users need to save; The steps for screening abnormal users are as follows: S101, obtaining operation information of all users in a specified area and file information in the user's computer; the operation information includes opening operation, closing operation, cleaning operation and saving operation, and the time corresponding to these operations; the file information includes file format, file name and validity period; S102, identifying the number of failed opening operations of each user, where the opening failure means that when a user opens a file, the corresponding file expires and is automatically cleared by the system, so the file cannot be opened, resulting in the opening failure; filtering out users whose opening failure number is not zero, and marking these users; S103, obtaining the number of files saved in the marked user's computer, substituting it into a formula together with the number of times the corresponding user failed to open the file, calculating the file leakage rate, and successively screening out users whose file leakage rates are greater than the leakage rate threshold, and defining these users as abnormal users; the formula is as follows: In the formula, result is the result of user type judgment, e is the number of times the user fails to open the file, f is the number of files saved by the user, and F is the leakage rate threshold; The steps to detect key files are as follows: S201, obtaining file information in all abnormal user computers, and classifying the files into saved files and unsaved files according to whether they are saved by the user; saved files refer to files saved by the user, and unsaved files refer to files that are not saved by the user and have not expired; S202, obtaining operation information corresponding to the unsaved file, determining the time difference between the opening operation and the closing operation, and defining the time difference as the browsing time of the file; determining whether the browsing time is greater than a time threshold, if the result is yes, defining the corresponding file as a key file and proceeding to the next step; if the result is no, directly proceeding to the next step; S203, obtain the format information of the stored file, and put the information into a format information set X, where the set X includes {Q1, Q2, Q3, ..., Q i }, where i represents the number of format information, Q i Indicates the value of the i-th format information; S204, obtain the name information of the stored files, and put the information into a name information set Y, where the set Y includes {W1, W2, W3, ..., W j }, where j represents the number of name information, W j Indicates the value of the j-th name information; S205, obtaining format information of the remaining undefined unsaved files, and determining in turn whether they belong to the format information set, if the result is yes, marking the corresponding unsaved files; if the result is no, defining the corresponding files as ordinary files; S206, obtain the name information of the marked file, calculate the similarity with each element in the name information set in turn, and put the obtained similarity into a similarity set Z. Each marked file corresponds to a similarity set. The similarity calculation steps are as follows: S206-1, perform word segmentation on the file name, converting each name into a word list; S206-2, removing duplicate words in each word list to obtain two different word sets; S206-3, merging two different word sets to obtain a total word set; S206-4. Construct a vector for each word in the total word set, where each dimension of the vector represents the number of times the word appears in the text; use a formula to calculate the similarity between two vectors, which is as follows: In the formula, cos(θ) is the similarity of the file name, |a| represents the modulus of vector a, |b| represents the modulus of vector b, and a×b represents the inner product of vector a and vector b; S207, judging whether the largest number in the similarity set corresponding to each marked file is greater than the similarity threshold, if the result is yes, the corresponding file is defined as a key file; if the result is no, the corresponding file is defined as a common file; the judging formula is as follows: In the formula, FT is the file type, GS is the file format, X is the format information set, max(Z) is the maximum value in the file similarity set, and Z 阈 is the similarity threshold, T end is the file closing time, T start is the file opening time, T 阈 is the time threshold.

2. A risk monitoring and early warning system based on data analysis according to claim 1, characterized in that: The data acquisition module includes an operation information acquisition unit and a file information acquisition unit; The operation information collection unit is used to collect the operation information of all users on the file in the specified area, and the operation information includes opening operation, closing operation, cleaning operation and saving operation, as well as the time corresponding to these operations; The file information acquisition unit is used to acquire file information in the user's computer, and the file information includes file format, file name and validity period.

3. The risk monitoring and early warning system based on data analysis according to claim 1 is characterized in that: The data processing module includes a user screening unit and a file definition unit; The user screening unit is used to screen out abnormal users from all users in a specified area; First, collect the operation information of all users, identify the number of files that users fail to open, and obtain the number of files saved by the corresponding users; second, substitute the information of both quantities into the formula to calculate the file leakage rate; finally, filter out users whose file leakage rate is greater than the leakage rate threshold and define them as abnormal users; The file definition unit is used to define the status information and type information of the file; the status information includes saved and unsaved, and the type information includes key and common; First, the file information in all abnormal users' computers is collected, and the saved and unsaved files are distinguished according to whether they are saved by the user; second, the unsaved files whose browsing time is greater than the time threshold are defined as key files; Then, a format information set and a name information set are established according to the format and name of the stored files, and it is determined whether the format of the unstored file belongs to the format information set, and the similarity between the unstored file name and each element in the name information set is calculated; finally, the unstored files that belong to the format information set and whose maximum similarity is greater than the similarity threshold are defined as key files, and other cases are defined as ordinary files.

4. The risk monitoring and early warning system based on data analysis according to claim 1 is characterized in that: The operation management module includes an operation management unit and a risk management unit; The operation management unit is used to determine the risk level of the user operation; Acquire abnormal user operation information and file information in real time for monitoring. When a user cleans up a folder containing key files, or the system automatically cleans up key files that have reached their validity period, it is considered a high-risk operation. In other cases, it is considered a low-risk operation. The risk management unit is used to issue early warning for high-risk operations; When a high-risk operation is detected, the system automatically intercepts the corresponding operation and sends a warning message to the corresponding user, reminding the user to make further confirmation on the cleanup behavior. If the user chooses to confirm, the file or folder will be deleted; if the user chooses to cancel, it will jump to the data backup module.

5. The risk monitoring and early warning system based on data analysis according to claim 1 is characterized in that: The data backup module is used to back up the files that the user has saved and the files that need to be saved.

6. A risk monitoring and early warning method based on data analysis, the method being applied to the risk monitoring and early warning system according to any one of claims 1 to 5, characterized in that: The early warning method includes the following steps: S1. Filter out abnormal users from all users; S2. Detect key files in the abnormal user's computer; S3. Monitor all operations on key files and determine the degree of risk; S4. Provide timely warnings for high-risk operations.

7. The risk monitoring and early warning method based on data analysis according to claim 6 is characterized in that: In S3, the risk level is divided into high risk and low risk; High risk refers to the cleanup operation on key files. When a user cleans up a folder containing key files, or the system automatically cleans up key files that have reached their validity period, it is judged as a high-risk operation. Low risk refers to all operations except high-risk operations.

8. The risk monitoring and early warning method based on data analysis according to claim 6 is characterized by: In S4, early warning reminder means that when a high-risk operation is detected, the system automatically intercepts the corresponding operation and sends a warning message to the corresponding user, reminding the user to confirm the cleanup operation; if the user chooses to confirm, the file or folder will be deleted; if the user chooses to cancel, the corresponding key files will be automatically backed up.

Citation Information

Patent Citations

  • File protection realization method and device and computation equipment

    CN106980797A

  • File downloading early warning prompt system and early warning prompt method thereof

    CN110895608A

  • Data security access system and method of computer storage system

    CN114398667A

  • Information security management and control system and method for computer big data processing

    CN115033885A

  • Method and device for detecting file leakage behavior

    CN115146304A