A preprocessing method for industrial safety equipment Json type Syslog

Abstract

The application provides a preprocessing method for industrial safety equipment Json type Syslog, and relates to the technical field of data preprocessing. The method comprises the following steps: selecting a set of final output data indexes of industrial safety equipment; classifying and extracting features of Syslog, and establishing a feature index table; for each type of Syslog, finding out original fields with consistent meanings to obtain a field mapping table; finding the original fields and corresponding values of the data indexes in the Syslog, converting them into text character types, and obtaining key-value pairs of the data indexes and the corresponding values; generating a new Json from the key-value pairs and attaching it to the front of the original main information of the Syslog. After preprocessing the Syslog, the subsequent processing link can use unified data index fields, and it is no longer necessary to customize field extraction for different Syslogs, so that all Syslogs are adapted, and the processing efficiency is greatly improved.

Images