Data processing method and device

A data processing and data technology, applied in the computer field, can solve problems such as thread deadlock and excessive number of threads, and achieve the effects of fast processing, improved computing performance, and reasonable use of computing resources

CN106528299BActive Publication Date: 2019-12-03北京华泰德丰技术有限公司
6 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Publication Date
2019-12-03

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention discloses a data processing method and device, and belongs to the technical field of computers. The method comprises the following steps of receiving data to be processed; according to the data to be processed, creating a distribution thread in a single thread pool, wherein at most one distribution thread under an operation state is in the single thread pool; through the distribution thread under the operation state, creating m1 pieces of processing threads in a maximum operation thread pool; and in the maximum operation thread pool, through the processing threads under the operation state, processing the data, wherein the at most m2 pieces of processing threads under the operation state are in the maximum operation thread pool. By use of the method, through a condition that at most one distribution thread under the operation state is in the single thread pool, a situation that a plurality of processing threads need to access the same resource is avoided, and the problem of thread deadlock is solved. Calculation resources are reasonably utilized, and a multi-processing-thread mechanism is stably used for quickly processing the data so as to achieve an effect on improving the calculation performance of a system.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] Embodiments of the present invention relate to the field of computer technology, and in particular to a data processing method and device. Background technique

[0002] A thread is the smallest unit in a program and a single sequential flow of control in a program. Running two or more threads simultaneously in a single program to complete different data processing, this data processing method is called multi-thread processing.

[0003] At present, in multi-thread processing, when the processor receives a large amount of data to be processed, the data to be processed is split according to a fixed amount to obtain at least one set of data; multiple threads are created according to the data to be processed, and then Multiple threads are allocated so that multiple threads correspond to each set of data, and finally, the data to be processed is processed by the thread in the running state.

[0004] However, when the number of threads created in multi-thre...

Examples

Embodiment Construction

[0025] In order to make the object, technical solution and advantages of the present invention clearer, the implementation manner of the present invention will be further described in detail below in conjunction with the accompanying drawings.

[0026] Please refer to figure 1 , which shows a flowchart of a data processing method provided by an embodiment of the present invention. The data processing method can be applied to a server with multi-thread processing capability, and the server includes a processor and a memory. The data processing methods include:

[0027] Step 102, receiving data to be processed.

[0028] Optionally, the processor receives data to be processed. Optionally, the data is streaming data, such as meteorological data observed by meteorological observation stations at different times and locations. The data is divided into multiple data according to different times and different locations.

[0029] Step 104, create an allocation thread in a single t...