Data processing method and device

A data processing and database technology, applied in the direction of electrical digital data processing, special data processing applications, multi-programming devices, etc., can solve the problems of increased database pressure and low operating efficiency

Pending Publication Date: 2020-10-23
XINYANG BRANCH HENAN CO LTD OF CHINA MOBILE COMM CORP +1
View PDF4 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The purpose of the embodiments of the present invention is to provide a data processing method and device to solve the problem of increasing the parallelism in or

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device
  • Data processing method and device
  • Data processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] In order to enable those skilled in the art to better understand the technical solutions in the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described The embodiments are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

[0029] The embodiment of the present invention provides a data processing method and device. By reading the business data to be processed from the database in batches in advance, and loading the read data into multiple caches for classification and sorting, the program is running. Using multiple processing threads to take out the business data...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a data processing method and device, and the method comprises the steps of completely reading to-be-processed business data from a target database, and storingthe business data into a plurality of caches according to a preset classification rule; creating a plurality of data processing tasks according to the classification result of the business data; andallocating the plurality of data processing tasks to a preset number of data processing threads to trigger the data processing threads to process the service data in the corresponding caches based onthe data processing tasks. The method comprises reading to-be-processed business data from a database in batches in advance; loading all the read data into a plurality of caches for classification andarrangement; in the program running process, taking the to-be-processed service data out of the caches to be processed through the multiple processing threads, so the multiple processing threads executed in parallel are directly in butt joint with the multiple caches, and therefore pressure on a database cannot be caused by increase of the number of the processing threads, high concurrency and high expansion are achieved, and the running efficiency of data processing is greatly improved.

Description

technical field [0001] The present invention relates to the technical field of mobile communication, in particular to a data processing method and device. Background technique [0002] In the era of mobile Internet, China Mobile has become a link in the mobile Internet industry chain. Faced with the growth of users and business development, the amount of data is also growing rapidly, which poses new challenges to the processing performance of batch processing operations in the business support system. . [0003] The existing technology mainly relies on the performance of the database. Using the database DML language to operate tens of millions of data has high requirements on the performance of the database and the host used. The oracle database currently used is expensive, difficult to expand, and large-scale. During concurrent operations, the competition for resources is serious, resulting in low operating efficiency of each module. [0004] It can be seen that the data ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/2455G06F9/50
CPCG06F16/24552G06F9/5011
Inventor 崔广维王守初马辉孙志彪
Owner XINYANG BRANCH HENAN CO LTD OF CHINA MOBILE COMM CORP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap