Log data processing method and device, terminal equipment and storage medium

A processing method and processing device technology, applied in the field of data processing, can solve problems such as increased data processing delay and increased client performance consumption, and achieve the effects of reducing data delay, improving processing and analysis efficiency, and increasing performance consumption

Pending Publication Date: 2021-08-31
深圳市明源云科技有限公司
View PDF7 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Currently, there are two options for processing raw log data: processing before raw log data is reported, or centralized processing after raw log data is reported; among them, the former will increase the performance consumption of the client, while the latter will cause Increased data processing latency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log data processing method and device, terminal equipment and storage medium
  • Log data processing method and device, terminal equipment and storage medium
  • Log data processing method and device, terminal equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

no. 1 example

[0073] The first embodiment: please refer to figure 2 , figure 2 It is a schematic flowchart of the first embodiment of the log data processing method of the present invention. The processing method of log data of the present invention, the processing method of log data of the present invention comprises:

[0074] Step S100, write the collected log data into multiple preset log storage spaces.

[0075] It should be noted that, in this embodiment, the preset log storage space refers to a log storage space designated by an instruction issued by a user, or a log storage space automatically generated by the system for storing log data.

[0076] The data processing terminal collects log data from the front-end application, and writes the collected log data into multiple preset log storage spaces.

[0077] Specifically, for example, the data processing terminal writes the log data collected from the front-end application into multiple default log storage spaces such as the defa...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a log data processing method and device, terminal equipment and a storage medium. The method includes: writting the collected log data into a plurality of preset log storage spaces through a data processing terminal; processing the log data in the preset log storage space by a consumer according to preset data to obtain processed log data; and transmitting the processed log data to a total database. Therefore, according to the log data processing method, the original log data can be processed in real time more efficiently without increasing the performance consumption of the client, and the processing and analysis efficiency of the original log data is improved to a great extent.

Description

technical field [0001] The present invention relates to the technical field of data processing, in particular to a log data processing method, device, terminal equipment and storage medium. Background technique [0002] With the development and popularization of the Internet, various network-based activities are continuously generating data. Data mining technology can discover valuable knowledge, patterns, rules and other information from a large amount of data, provide auxiliary support for scientific research, business decision-making, process control, etc., and become an important way of data utilization. Network-based activities are usually recorded in the form of logs by various business platforms of network service providers, and become data sources for mining and analysis. In practical applications, a large amount of raw log data generated by the client is often reported through the collector, and the raw log data needs to be processed before it can be analyzed. [...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/17G06F16/18G06F16/182
CPCG06F16/1734G06F16/1815G06F16/182
Inventor 王磊
Owner 深圳市明源云科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap