Unlock instant, AI-driven research and patent intelligence for your innovation.

Data processing method and apparatus

A technology for processing data and databases, applied in the field of data processing, it can solve problems such as low efficiency, spending developers' energy, and difficulty in finding data exceptions, so as to achieve reliable data feedback and reduce troubleshooting time.

Inactive Publication Date: 2018-04-06
RUN TECH CO LTD BEIJING
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Locating these reasons often takes a lot of energy for developers, and sometimes it even happens that everyone in the team is dispatched to find a reason
It is becoming more and more difficult and inefficient to find data anomalies by checking each node item by item

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and apparatus
  • Data processing method and apparatus

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0044] The embodiments of the present invention will be further described in detail below in conjunction with the drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the embodiments of the present invention, rather than to limit the embodiments of the present invention. In addition, it should be noted that, for the convenience of description, the drawings only show some but not all structures related to the embodiments of the present invention.

[0045] refer to figure 1 , figure 1 It is a schematic flowchart of a method for processing data provided by an embodiment of the present invention. Such as figure 1 As shown, the method for processing data includes:

[0046] Step 110, the client receives the log command sent by the server;

[0047] Step 120, the client judges whether the log command is a log command from the previous day;

[0048] Step 130, if the log command is the command of the previous day's...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

Embodiments of the invention disclose a data processing method and apparatus. The method comprises the steps that a client receives a log command sent by a server; the client judges whether the log command is a command of a log in the previous day or not; if the log command is the command of the log in the previous day, a thread of processing the log in the previous day is created; the client judges whether configuration information is read or not; and if the configuration information is read, the client performs analysis according to a received log type and inserts the analyzed information ina database. Cluster data quantity statistics information and data set statistics data can be accurately displayed; and cluster running states, processing speed and hardware resource occupation statescan be monitored in real time.

Description

technical field [0001] The embodiments of the present invention relate to the technical field of data processing, and in particular, to a method and device for processing data. Background technique [0002] In the daily operation and maintenance of big data products, abnormal data often occurs. When analyzing the causes of these abnormalities, it is found that the data will go wrong in many links, such as YCL, kafka, storm, solr, Hadoop, etc. Locating these reasons often takes a lot of energy for developers, and sometimes it even happens that everyone in the team is dispatched to find a reason. It is increasingly difficult and inefficient to find data anomalies by checking each node item by item. Contents of the invention [0003] The purpose of the embodiments of the present invention is to provide a method and device for processing data, aiming at solving the need to develop a set of efficient, reliable and integrated operation and maintenance products. [0004] To ach...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/07G06F17/30H04L12/24
CPCG06F11/0766G06F16/1815H04L41/069
Inventor 黄朝顺万月亮王梅
Owner RUN TECH CO LTD BEIJING