Method and device for data collection

A data collection and data technology, which is applied in electrical digital data processing, special data processing applications, instruments, etc., and can solve problems such as data lag

Inactive Publication Date: 2011-08-24
INSPUR BEIJING ELECTRONICS INFORMATION IND
View PDF5 Cites 24 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The invention provides a data collection method and device, which solves the problem of data lag caused by database storage

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for data collection
  • Method and device for data collection
  • Method and device for data collection

Examples

Experimental program
Comparison scheme
Effect test

specific example

[0070]

[0071] The above is a node class of a doubly linked list. previous and next respectively record the pointers of the preceding and following nodes, object is used to record the aggregate object to be cached, and timestamp is used to record the timestamp when the current node was created. When the timestamp exceeds the life cycle of the node, it will be deleted by the remove() method. The main function of this class is to form a LinkedList linked list from LinkedListNode, and implement the basic methods of getFirst(), getLast(), addFirst(), addLast(), clear() and other linked lists by the LinkedList class.

[0072] This ensures that the aggregated objects are the latest data, and puts frequently accessed objects at the front of the linked list, which improves access efficiency.

[0073] 4. Database synchronization operation;

[0074] The purpose of using the cache in the embodiments of the present invention is to improve the concurrent access speed and the real-time...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a method and a device for data collection, which relate to the field of mass data processing and solve the problem of data lag caused by database storage. The method comprises the steps of: collecting data from nodes in cluster; and establishing aggregation in cache, using the collected data as the object of the aggregation and storing the data in the cache. The technical proposal provided by the invention is suitable for high performance cluster.

Description

technical field [0001] The invention relates to the field of mass data processing, in particular to a data collection method and device. Background technique [0002] The data volume of high-performance cluster monitoring is increasing, and at the same time, the requirements for monitoring performance are also getting higher and higher, so higher requirements are also put forward for cluster monitoring. At present, the mainstream cluster monitoring technology is to monitor data in real time. However, when the amount of data is large, data monitoring will cause a certain delay, which may cause the response time of the page to be too long, and then cause the page to freeze. The problem of unresponsive pages can be solved through database buffering, that is, the nodes put all the data in the database in a unified way, and the wen server takes out the data from the database in a unified way to form a page. Although this approach has greatly alleviated the phenomenon of suspende...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30H04L29/08
Inventor 段国栋
Owner INSPUR BEIJING ELECTRONICS INFORMATION IND
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products