Log management method

A management method and log technology, applied in the field of log management

Inactive Publication Date: 2014-12-03
INSPUR BEIJING ELECTRONICS INFORMATION IND
View PDF2 Cites 23 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The invention provides a log management method, which sol

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log management method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] In terms of distributed computing, there are about hundreds of different solutions around the world. Hadoop is a widely used distributed storage and distributed computing framework, suitable for large-scale distributed computing, more and more attention has been paid, and it has been widely used in advertising computing, log analysis, web search and data mining. application. In recent years, the storage capacity of hard disks has been increasing rapidly, but the access speed of hard disks cannot keep pace with the times. When the amount of data is very large, the read operation will take a long time. But if you read and write data from multiple disks in parallel, it will save a lot of time.

[0041] Therefore, in order to increase the speed of log processing and improve some problems that enterprises currently encounter in data processing, it is necessary to design a streamlined and unified log analysis system based on distributed storage and computing. This system ta...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a log management method, and relates to the field of computer application. By the aid of the log management method, log data can be stored and managed in a distributed manner. The log management method includes collecting traffic log and click log; preprocessing the acquired traffic log and the acquired click log; storing the preprocessed traffic log and the preprocessed click log in a distributed manner. According to the technical scheme, the log management method has the advantages that the log management method is applicable to data mining, and log files can be stored in the distributed manner on the basis of HDFS (Hadoop distributed file system) architectures.

Description

technical field [0001] The invention relates to the field of computer applications, in particular to a log management method. Background technique [0002] With the rapid development of the Internet, the number of Internet users has also increased rapidly, and the user's access logs have also rapidly expanded. For the Internet, web logs are very important information. Especially for some large-scale e-commerce websites or social networking sites, the potential access patterns of users can be found out by mining web logs, so as to design a webpage organization pattern that is more convenient for users to visit. However, how to dig out useful information for enterprises from these massive logs and make correct decisions based on this is a very important task. Since the web log is generated by many users, it has the characteristics of data source diversity, massiveness, and uncertain transmission conditions, and a complete log is a guarantee for subsequent analysis work. Fro...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/172G06F16/137G06F16/1734G06F16/1815
Inventor 刘璧怡郭美思吴楠
Owner INSPUR BEIJING ELECTRONICS INFORMATION IND
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap