Log storage and processing method and log server

A server and main server technology, applied in the field of log management, can solve the problems of long processing time, log loss, limited performance, etc., to achieve the effect of improving system performance, improving capacity, and reducing occupancy

Active Publication Date: 2013-03-13
GUANGDONG EFLYCLOUD COMPUTING CO LTD
View PDF5 Cites 43 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Under the background of cloud storage and big data, in the face of massive storage data, the existing log storage and processing methods have the following deficiencies: 1) The storage space of the log server is limited, so the log storage space is also limited; 2 ) The log is not compressed and stored directly on the disk, which wastes a lot of storage space; 3) The log storage is not backed up, and it is easy to cause a large number of logs to be lost; 4) A single server processes the log, and its performance is limited. It takes a long time to process big data well

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log storage and processing method and log server
  • Log storage and processing method and log server
  • Log storage and processing method and log server

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] The present invention will be further described below in conjunction with drawings and embodiments.

[0036] figure 2 It is a flow chart of a log storage method in an embodiment of the present invention. Such as figure 2 As shown, the method includes,

[0037] Step 201: the log server stores the received log data in the current local file;

[0038] The log storage program receives the log data, analyzes the ip address of the source of the log data, and saves the received log data into a local file. The file storage name is named as follows: { / opt / log / ip address / date / time}.

[0039] Step 202: judging whether the attributes of the current local file conform to the preset jump processing rules;

[0040] The attributes of the current local file include file size and current time,

[0041] The preset jump processing rules include:

[0042] Judging whether the current local file size exceeds a preset file size threshold or judging whether the current time and the file...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a log storage and processing method and a log server. Firstly, log data are stored into a file, and the file is uploaded to a distributed file system after being compressed. The method of storing after compression reduces occupation of storage space. Distributed storage enables memory capacity of a log to be expanded dynamically. A copy is backed up and uploaded, and data can be safely stored. When the data are processed in a distributed mode, synchronous processing is performed on a plurality of data blocks, big data processing capability is improved, and system performance is improved.

Description

technical field [0001] The invention relates to the technical field of log management, in particular to a log storage and processing method and a log server. Background technique [0002] A log is an event record called log generated by network devices, systems, and service programs when they are running; each line of log records the description information of related operations such as date, time, user, and action. The log records the life cycle of the system. By consulting the log, you can know the state of the system at a certain moment; by analyzing the log and collecting useful data, you can get the user's usage information and access statistics to serve the system. Provide basis for optimization and prevention of network security issues. [0003] Log storage, processing and analysis are essential for a mature service system. figure 1 It is a process flowchart of log storage and processing in the prior art, including: 1) the application program generates log data by c...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L12/24H04L29/08
Inventor 何作祥闵宇史伟麦剑
Owner GUANGDONG EFLYCLOUD COMPUTING CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap