Data processing method and device

A data processing device and data processing technology, which are applied in the computer field, can solve problems such as resource coordination and data interaction burden, failure stagnation, and low data processing efficiency, so as to solve low reading and writing efficiency, reduce overhead, and improve data reading. The effect of writing efficiency

Active Publication Date: 2013-07-24
INST OF INFORMATION ENG CAS
View PDF4 Cites 16 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

(2) Consumers have zombie problems, that is, consumers with heavy calculations have extremely low data processing efficiency or stagnant failures,

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device
  • Data processing method and device
  • Data processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] The principles and features of the present invention are described below in conjunction with the accompanying drawings, and the examples given are only used to explain the present invention, and are not intended to limit the scope of the present invention.

[0038] figure 1 It is a flow chart of the data processing method in the embodiment of the present invention. Such as figure 1 As shown, in this embodiment, the data processing method includes the following steps:

[0039] Step 101, create a shared memory ring;

[0040] Wherein, the shared memory ring is a ring structure space for storing data to be operated.

[0041] figure 2 It is a schematic diagram of a shared memory ring system. Such as figure 2 As shown, the core structure of the shared memory ring system includes a producer, multiple consumers and a shared memory ring. The shared memory ring describes the cache structure of data in the shared memory. The shared memory ring is composed of multiple data...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a data processing method and a data processing device. The data processing method comprises the following steps: creating a shared memory ring, wherein the shared memory ring is a ring-shaped structural space for storing data to be operated; before operating a next operation destination unit in the shared memory ring, setting an operation zone bit of the next operation destination unit into an operation type corresponding to a next operation; judging whether the next operation destination unit can carry out the next operation; and according to a judgment result, processing the data in the next operation destination unit. According to the data processing method and the data processing device, which are disclosed by the invention, a ring-shaped data structure in a shared memory is designed, a data coordinating rule of producers and consumers and a shared memory ring overwriting mechanism are combined, a control identifier bit of the ring is updated on the basis of the atomic bit operation, data read-write efficiency of shared resources in the data parallel processing scene is improved, and the cost of data synchronism is reduced, so that the problems of low read-write efficiency of the shared resources and high synchronism cost are solved.

Description

technical field [0001] The invention relates to the field of computers, in particular to a data processing method and device. Background technique [0002] The rapid development of the Internet has brought about the expansion of network data. High-speed, massive network data contains intricate information, such as IP service flow, user click flow, user query flow, server logs, etc. Massive business data brings huge challenges to network data processing. Due to the low utilization rate of equipment in the traditional data synchronization processing method, the advantages of multi-core computing and parallel computing cannot be utilized, and a lot of additional system resource overhead will be paid to maintain the effectiveness of synchronization, and its processing efficiency is often difficult to meet the needs of business systems. demand. Therefore, asynchronous program processing has basically become the mainstream idea of ​​program design. The benefit of asynchronous p...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/06G06F12/02
Inventor 王勇王树鹏张永铮王曦吴广君李斌斌安丰春
Owner INST OF INFORMATION ENG CAS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products