Method for acquiring and retrieving distributed log

A distributed, log technology, applied in the field of computer information

Inactive Publication Date: 2016-01-20
XIAN FUTURE INT INFORMATION CO LTD
View PDF3 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to provide a method for collecting and retrieving distributed logs, which solves the problem that traditional data processing methods are difficult to collect, process and retrieve a large amount of log data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0021] The present invention will be described in detail below in combination with specific embodiments.

[0022] The technical solution of the present invention is a method for collecting and retrieving distributed logs, specifically implemented according to the following steps:

[0023] Step 1. Log collection:

[0024] The log collection network collects log information, stores log information from different sources in the storage system through common interfaces such as log generation interface, log arrangement interface, and log transmission interface, and saves log information of different types and sources into unified characters through common interfaces Encoded log files.

[0025] Step 2. Log processing:

[0026] The log search system splits the log files saved in the storage system, and performs indexing operations on the split log information. According to the key attributes in the log, the log search system extracts data from unstructured log data and reorganizes ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for acquiring and retrieving distributed logs. The method comprises the following steps: a log acquiring network acquiring log messages, through a universal interface, storing the log messages from different sources in a storage system, through the universal interface, storing the log messages in different types from different sources in log files in unified character codes; a log search system segmenting the log files which are stored in the storage system, and performing index operation on the segmented log messages, according to key attributes in the logs, the log search system extracting data from unstructured log data, and reorganizing the data to form a log message index; and using the formed log message index to retrieve logs. The method makes logs become a systematic structure, and log messages in different types form a log acquiring network which can acquire different protocols, so as to realize an objective of a distributed, high-performance, real-time, and extensible log search system of a cloud calculation data center.

Description

technical field [0001] The invention belongs to the technical field of computer information, and relates to a method for collecting and retrieving distributed logs. Background technique [0002] A large number of physical devices and business systems are deployed in the cloud computing environment. At the same time, platform monitoring and management systems such as operation and maintenance and security management are also deployed. Log information has become an important means of platform monitoring and management. Massive data from different devices, The log information of the system needs to be used by multiple systems. At the same time, once there is a problem with the equipment on the platform, the log information becomes an important means of troubleshooting and preventing failures. [0003] Due to the large amount of data in the physical equipment and business systems in the cloud computing data center, different equipment and systems use different protocols to gener...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/134G06F16/1815
Inventor 杨剑张磊
Owner XIAN FUTURE INT INFORMATION CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products