Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Log real-time processing system

A real-time processing and log technology, applied in the computer field, can solve the problems of not being able to upload log data to the storage system in real time, high maintenance costs, and a large number of files, and achieve the effects of easy analysis and processing, simplified structure, and reduced number of files

Active Publication Date: 2021-07-23
BEIJING QIHOO TECH CO LTD
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, this processing system in the prior art is scattered in each computer room, which is troublesome to deploy; and the logs of each computer room are processed separately, so that the number of processed files is large; in addition, when a fault occurs or a new business is added, it is necessary to The processing system in each computer room is maintained, which is costly and difficult; at the same time, the processing system cannot upload real-time log data to the storage system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log real-time processing system
  • Log real-time processing system
  • Log real-time processing system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0032] figure 1 A functional block diagram of a log real-time processing system according to an embodiment of the present invention is shown. The system performs download, real-time processing, and upload processing in the same processor. Such as figure 1 As shown, the system includes: a log discovery machine 11 and at least one processing machine 12 .

[0033] The log discovery machine 11 is adapted to receive log report messag...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a log real-time processing system, which includes: a log discovery machine, adapted to receive log report messages from log machines located in various computer rooms, and obtain the address of the log content to be processed provided by the log machine; at least one processing machine, It is suitable for downloading the log content generated by each computer room according to the address of the log content, performing real-time consumption processing on the log content, and uploading the log content to the distributed storage system. Utilize a log real-time processing system provided by the present invention, collect the real-time log data generated by each computer room into one computer room for downloading, real-time consumption and upload processing, and simultaneously download, real-time consumption and upload processing are all performed in the same processor , simplifies the system structure, and can maintain or expand the one computer room after a failure or new business is added, which can greatly reduce the maintenance difficulty and cost.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a log real-time processing system. Background technique [0002] With the continuous development of Internet technology, the trend of Internet big data is becoming more and more significant. Every Internet business line is constantly generating real-time log data. It is necessary to further process the generated real-time log data to provide feedback on Internet business operations. One of the most important jobs. In the prior art, real-time log data is analyzed and processed by establishing processing systems in each computer room, and each processing system performs analysis and processing for a corresponding computer room. [0003] However, this processing system in the prior art is scattered in each computer room, which is troublesome to deploy; and the logs of each computer room are processed separately, so that the number of processed files is large; in addition, when a ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04L12/24H04L29/08G06F16/18G06F11/34G06F11/30
CPCG06F11/3065G06F11/3476G06F16/1815H04L41/069H04L67/1097
Inventor 魏自立杜旭东李威袁冲王志超杨胜智
Owner BEIJING QIHOO TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com