Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and system for storing and querying mass logs

A query method and query system technology, which is applied in the field of massive log storage and query methods and systems, can solve the problems of low query efficiency and achieve the effects of easy compression, convenient storage, and good user experience

Active Publication Date: 2015-01-14
NEUSOFT CORP
View PDF4 Cites 16 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0010] In view of the above problems, the purpose of the present invention is to provide a massive log storage and query method and system to solve the existing problems of low query efficiency such as querying, grouping and sorting with master-slave tables in log processing

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for storing and querying mass logs
  • Method and system for storing and querying mass logs
  • Method and system for storing and querying mass logs

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] In the following description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of one or more embodiments. It may be evident, however, that these embodiments may be practiced without these specific details.

[0032] According to the currently used master-slave table for joint query, grouping, and sorting, there is a problem of very low query performance. Even if partitioned storage is used, the query effect is not good, and after the query is obtained, the result must be returned after the sorting is completed. In view of the problems existing in the above-mentioned prior art, the present invention divides the aggregated logs into segments, stores the segmented data in segments, and quickly assembles the segmented data according to the query conditions to improve log query efficiency. And can quickly return query results.

[0033] Specific embodiments of the present invention will be described in detail b...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a method and a system for storing and querying mass logs. The method includes storing fragmented logs in file structures according to master-slave relations, and to be more specific, storing the fragmented logs in master files and slave files according to the master-slave relations; querying the logs in the master files and the slave files. The master files comprise log aggregation quantities, fragmentation start time and fragmentation finish time, are of XML (extensive markup language) data structures and contain event elements, count elements, Level elements and Keyword elements, and the slave files comprise log occurrence time and IP (internet protocols) of log occurrence equipment. The method and the system have the advantages that all the logs which meet requirements on time ranges and certain conditions can be queried among the mass logs, can be stored by the aid of the file structures and are small in storage size and convenient to compress, and the method and the system bring convenience for storing the logs for a long time.

Description

technical field [0001] The present invention relates to the technical field of communication log processing, and more specifically, to a method and system for storing and querying massive logs. Background technique [0002] With the rise and development of cloud computing, mobile Internet, and Internet of Things, the era of big data has come. Logs of various systems, programs, operation and maintenance, transactions, etc. are becoming more and more important as an important basis for system recovery, error tracking, security testing and other operations. Therefore, it becomes very important to quickly find useful information in massive logs. [0003] For example, systems such as intrusion monitoring, vulnerability scanning, and auditing, as a security monitoring system, can complete any behavior that poses a threat to security and alarm, that is, generate operation logs. When a certain operation continues, the same operation log will be sent out. Suppose a hacker uses brut...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
CPCG06F16/1815G06F16/83
Inventor 王承志
Owner NEUSOFT CORP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com