Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data processing system and method

A data processing system and data processing technology, applied in the computer field, can solve problems such as unfavorable analysts' work efficiency and increased analysts' workload, and achieve the effect of reducing analysis and saving the process of re-analysis

Active Publication Date: 2018-12-11
BEIJING QIHOO TECH CO LTD
View PDF8 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, at present, when analysts use this system to query files, what they find is that the files are usually original logs, so the original logs need to be reprocessed, processed, analyzed, etc., which will undoubtedly increase the workload of analysts and is not conducive to Improve analyst productivity

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing system and method
  • Data processing system and method
  • Data processing system and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0075] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0076] To solve the above technical problem, an embodiment of the present invention provides a data processing system. figure 1 A schematic structural diagram of a data processing system according to an embodiment of the present invention is shown. see figure 1 , the data processing system 100 includes at least a distributed scheduler 110, a data processing device 120, and a storage component 130 having multiple preset databases. ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A data processing system and method are provided. The system comprises a distributed scheduler, a data processing device and a storage component with a plurality of preset databases, wherein the distributed scheduler is adapted to acquire offline logs to be processed, extract log metadata from the offline logs, and transmit the offline logs and log metadata to the data processing device; the dataprocessing device is adapted to classify and merge the received offline logs to generate a corresponding virtual table, and statistics the log metadata to obtain the corresponding statistical information; the data processing device is further adapted to store virtual tables and statistical information in a storage component including a plurality of preset databases. The invention realizes the centralized index of the log, also improves the searching efficiency of the log, and can directly obtain the characteristic data of each dimension of the log, thereby greatly saving the flow of analysts in analyzing the log.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to a data processing system and method. Background technique [0002] Heimdall is a massive data mining and analysis system with completely independent intellectual property rights, which can realize the mining and processing of massive data, and provide convenient and easy-to-use tools for data mining personnel and operational analysts to use. [0003] However, at present, when analysts use this system to query files, what they find is that the files are usually original logs, so the original logs need to be reprocessed, processed, analyzed, etc., which will undoubtedly increase the workload of analysts and is not conducive to Improve analyst productivity. Therefore, how to directly realize the further extraction and refinement of the original log in the Heimdall system, for example, the system can directly reflect when the file was uploaded, who uploaded it, when it app...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06Q50/18G06F17/30
CPCG06Q50/184
Inventor 王志超王肖磊杨东高其林李敬轩王旭东刘陟
Owner BEIJING QIHOO TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com