A method for deduplication of audit data on a distributed deployment audit platform

Abstract

The invention belongs to the field of network security auditing, and relates to an auditing data duplication eliminating method of a distributed deploying and auditing platform. The method comprises that an auditing center stores auditing record information reported by each auditing unit; the auditing center starts a thread or a process and periodically detects and processes the auditing record information stored by the auditing center; whether newly uploaded auditing records are duplicated data or not is judged according to the auditing record information stored by the auditing center; and the repeatedly uploaded auditing records are discarded. According to the method, the auditing data duplication eliminating processing of the distributed deploying and auditing platform is realized; the duplicated data in the newly uploaded auditing data is effectively eliminated; the storage space is saved; and the auditing processing speed is improved.

Description

technical field [0001] The invention belongs to the field of network security auditing, and in particular relates to a method for deduplicating audit data on a distributed deployment audit platform. Background technique [0002] The network security audit system provides effective behavior audit, content audit, behavior alarm, behavior control and related audit functions for network behavior; provides effective supervision of the network from the management level, prevents and stops data leakage; satisfies users' requirements for network behavior audit filing and security According to the requirements of protection measures, complete network behavior records are provided to facilitate information tracking, system security management and risk prevention. [0003] Existing distributed network audit systems generally use multiple audit units to collect data and aggregate the audit data to the deployment mode of the audit center. Distributed deployment audit platforms such as f...

AI Technical Summary

Problems solved by technology

The problem with this audit system is that if the same network traffic passes through some different audit units, when these audit units summarize the audit data to the audit center, the audit data of the above network traffic will have multiple duplicate records, which not only occupies Excessive storage space also increases the amount of data processed and reduces processing speed

Images