Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data processing method and device and readable storage medium

A data processing and database technology, applied in the field of data processing, can solve the problems of resource contention and low execution efficiency, and achieve the effect of avoiding duplication and improving execution efficiency.

Active Publication Date: 2021-10-26
用友汽车信息科技(上海)股份有限公司
View PDF10 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] In related technologies, when database scripts are executed by multiple data sources, the same thread pool is used to execute different database scripts. However, when multiple database scripts are executed by the same thread pool at the same time, resource contention will occur, and the execution efficiency is low.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device and readable storage medium
  • Data processing method and device and readable storage medium
  • Data processing method and device and readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0052] like figure 1 As shown, according to an embodiment of the present invention, a data processing method is proposed, the method includes:

[0053] Step 102, receiving a data processing request;

[0054] Step 104, according to the data processing request, obtain the information of the data source to be processed and the information of multiple database scripts;

[0055] Step 106, obtaining the data source to be processed in the database according to the information of the data source to be processed;

[0056] Step 108, generating a plurality of mutually independent thread pools according to the information of multiple database scripts and the information of the data source to be processed;

[0057] Step 110, using the thread pool to process the data source to be processed according to the information of the database script;

[0058] Step 112, generating a processing report.

[0059] In this embodiment, after the data processing request is received, the information of t...

Embodiment 2

[0063] like figure 2 As shown, according to an embodiment of the present invention, a data processing method is proposed, the method includes:

[0064] Step 202, receiving a data processing request;

[0065] Step 204, according to the data processing request, obtain the information of the data source to be processed and the information of multiple database scripts;

[0066] Step 206, obtaining the data source to be processed in the database according to the information of the data source to be processed;

[0067] Step 208, analyzing the information of multiple database scripts to obtain the script statement and the execution order of the script statement in each database script;

[0068] Step 210, generating a plurality of thread pools according to the script statement, execution sequence and data sources to be processed of each database script;

[0069] Step 212, using the thread pool to process the data source to be processed according to the information of the database ...

Embodiment 3

[0077] In this embodiment, the above-mentioned step of using the thread pool to process the data source to be processed according to the information of the database script includes: obtaining the thread corresponding to the data source to be processed in the thread pool according to the script statement and execution sequence; , process the data source to be processed according to the script statement and execution sequence.

[0078] In this embodiment, during the execution of multiple database scripts, according to the script statements in each database script and the execution sequence between the statements, the threads for executing database scripts for multiple data sources are determined in the thread pool, and the determined Thread executes database scripts for multiple data sources according to the statements of database scripts and the execution sequence between statements.

[0079] Through the above method, use the dedicated thread corresponding to each database scri...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a data processing method and device and a readable storage medium. The data processing method comprises the following steps: receiving a data processing request; acquiring information of a to-be-processed data source and information of a plurality of database scripts according to the data processing request; obtaining the to-be-processed data source from a database according to the information of the to-be-processed data source; generating a plurality of mutually independent thread pools according to the information of the database scripts and the information of the to-be-processed data source; and processing the to-be-processed data source by utilizing the thread pool according to the information of the database script to generate a processing report. According to the technical scheme, the independent thread pool is created for each database script, so that the execution task of each database script shares the special thread pool, the multiple database scripts can execute the process at the same time, the thread pools are mutually independent and do not influence each other in the execution process, and the execution efficiency of the database script is effectively improved.

Description

technical field [0001] The present invention relates to the technical field of data processing, in particular to a data processing method, a data processing device and a readable storage medium. Background technique [0002] In related technologies, when database scripts are executed by multiple data sources, the same thread pool is used to execute different database scripts. However, when multiple database scripts are executed by the same thread pool at the same time, resource contention will occur, and the execution efficiency is low. Contents of the invention [0003] The present invention aims to solve at least one of the technical problems existing in the prior art or related art. [0004] To this end, the first aspect of the present invention provides a data processing method. [0005] The second aspect of the present invention also provides a data processing device. [0006] The third aspect of the present invention also provides a readable storage medium. [000...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/52
CPCG06F9/52G06F2209/5011
Inventor 邱明杰尹洪伟高海龙
Owner 用友汽车信息科技(上海)股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com