Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Log real-time processing system

A real-time processing and logging technology, applied in the computer field, can solve the problems of inability to upload real-time log data to the storage system, high maintenance cost, large number of files, etc., to achieve the effect of easy analysis and processing, simple structure, and reduction of the number of files

Inactive Publication Date: 2021-03-23
BEIJING QIHOO TECH CO LTD
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, this processing system in the prior art is scattered in each computer room, which is troublesome to deploy; and the logs of each computer room are processed separately, so that the number of processed files is large; in addition, when a fault occurs or a new business is added, it is necessary to The processing system in each computer room is maintained, which is costly and difficult; at the same time, the processing system cannot upload real-time log data to the storage system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log real-time processing system
  • Log real-time processing system
  • Log real-time processing system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0048] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present disclosure, and to fully convey the scope of the present disclosure to those skilled in the art.

[0049] figure 1 A functional block diagram of a log real-time processing system according to an embodiment of the present invention is shown. The real-time log processing system provided in this embodiment is set in one computer room, and the real-time log processing system can collect and process real-time logs generated by all other computer rooms. Such as figure 1 As shown, the system includes: a log discovery machine 10 , at...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a log real-time processing system. The system comprises a log discovery machine suitable to receive log reporting messages of log machines located in machine rooms and obtain to-be-processed log content addresses provided by the log machines, at least one downloading machine suitable to download log contents generated by the machine rooms according to the log content addresses, a log consumption machine suitable to perform real-time consumption processing on the log contents, and at least one uploading machine suitable to upload the log contents to a distributed storagesystem. By utilizing the log real-time processing system provided by the invention, real-time log data generated by the machine rooms is concentrated in one machine room to be downloaded, consumed inreal time and uploaded, so that the real-time log processing efficiency is improved; and after a fault occurs or a new business is added, the one machine room can be maintained or expanded, so that the maintenance difficulty and cost are greatly lowered.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a log real-time processing system. Background technique [0002] With the continuous development of Internet technology, the trend of Internet big data is becoming more and more significant. Every Internet business line is constantly generating real-time log data. It is necessary to further process the generated real-time log data to provide feedback on Internet business operations. One of the most important jobs. In the prior art, the analysis and processing of real-time log data is by establishing a processing system in each computer room, and each processing system performs analysis and processing for a corresponding computer room. [0003] However, this processing system in the prior art is scattered in each computer room, which is troublesome to deploy; and the logs of each computer room are processed separately, so that the number of processed files is large; in addition...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/18G06F16/11G06F16/13G06F11/30
Inventor 魏自立杜旭东李浩袁冲王志超杨胜智
Owner BEIJING QIHOO TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com