Log data processing method, device and system and medium

Abstract

The invention provides a log data processing method, device and system and a medium. The method comprises the following steps: an obtaining step: obtaining log data of vehicle insurance; a preprocessing step: based on the service type, utilizing an Flink engine to preprocess the obtained log data to generate semi-structured log data with a predetermined format; a structured processing step: performing structured processing on the semi-structured log data according to the type of the log data so as to convert the semi-structured log data into structured log data suitable for data statistical analysis; and a loading step: loading the structured log data into a database. According to the method, the log data of the vehicle insurance can be effectively analyzed and stored, so that data statistical services such as multi-dimensional and deep report generation and data analysis can be supported.

Description

technical field [0001] The invention relates to the field of vehicles, and relates to a log data processing method, device, system and medium. Background technique [0002] There are various reporting tools on the market in recent years, but most reporting tools only focus on data processing and data presentation. In the professional fields of different industries, especially in the field of auto insurance, a relatively professional and targeted reporting system is required. [0003] At present, the loss estimation, loss verification, and claim verification systems used in the field of auto insurance support data export and data analysis, but the exported data and analysis results are relatively simple. Moreover, relevant data is usually obtained directly through the indicators entered by the user, and reports are generated based on the entered indicators and related data, but multi-dimensional or in-depth indicator analysis cannot be performed, resulting in low practicabil...

AI Technical Summary

Problems solved by technology

[0003] At present, the damage assessment, loss verification, and claim verification systems used in the field of auto insurance support data export and data analysis, but the exported data and analysis results are relatively simple

Moreover, relevant data is usually obtained directly through the indicators entered by the user, and reports are generated based on the entered indicators and related data, but multi-dimensional or in-depth indicator analysis cannot be performed, resulting in low practicability, poor pertinence of indicators and high utilization rate. Not advanced defect

There are also methods of generating reports using the more traditional method of dragging and dropping indicators, or using simple query modules to generate target reports, etc., but these traditional methods have problems such as slow running speed, unstable data loading and refreshing, and low efficiency

In addition, for automobile insurance data, there are usually large and complex historical data, current data, etc., and the current data processing system cannot effectively analyze and process this large and complex data for the report generation required by the service, Data analysis and other statistical services

Images