System and method for task processing

A task processing and task technology, applied in electrical digital data processing, special data processing applications, instruments, etc., can solve the problems of high response delay of large data set query tasks, reducing real-time database query performance, affecting task request response rate, etc. Achieve the effect of improving query performance and improving response rate

Inactive Publication Date: 2014-07-23
STATE GRID CORP OF CHINA +2
View PDF8 Cites 51 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This processing method greatly affects the response rate of task requests, which will lead to a high response delay for large data set query tasks (such as the number of measurement points above tens of millions or long-term historical data query tasks), which in turn reduces the real-time database. query performance

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • System and method for task processing
  • System and method for task processing
  • System and method for task processing

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0052] Embodiment 1 of the present invention discloses a task processing system, please refer to figure 1 , the system includes a request receiving module 100 , a task splitting module 200 , a task processing module 300 , a result integrating module 400 and a result returning module 500 .

[0053] The request receiving module 100 is configured to receive request information from a user, and the request information includes a query task for querying a target data set in a data source.

[0054] In this embodiment, the data source is specifically a real-time database. The present invention will be described in detail below by processing a task request submitted by a user for querying historical data in the real-time database.

[0055]Wherein, the task request submitted by the user may specifically be a request for a single-point historical query of the real-time database, or a request for a cross-sectional historical query of the real-time database.

[0056] The task splitting m...

Embodiment 2

[0068] Embodiment 2 of the present invention continues to optimize the task processing system disclosed in Embodiment 1. Please refer to image 3 , in this embodiment, the task processing module 300 further includes a subtask splitting unit 330, which is specifically located between the task allocation unit 310 and the parallel processing unit 320, and is logically connected with the two units.

[0069] The subtask splitting unit 330 is configured to split each of the subtasks twice based on a preset second task splitting strategy to obtain M secondary subtasks of the subtasks, wherein the M is a natural number greater than 1.

[0070] Wherein, the second task splitting strategy is specifically formulated based on the task amount of the corresponding subtask, the time attribute of the target data corresponding to the subtask, and the current multi-thread concurrent processing capability of the corresponding database server. Similarly, the formulation of the splitting strategy...

Embodiment 3

[0075] This embodiment continues to supplement and improve the task processing systems disclosed in the above two embodiments.

[0076] The task processing process of Embodiment 1 and Embodiment 2 needs to be based on the premise that each database server works normally. In an actual cluster system, it is common for any one or more server nodes to go offline temporarily due to failure. In this case, see Figure 4 In this embodiment, on the basis of the original functional modules, a fault processing module 600 is added to the task processing system.

[0077] The failure processing module 600 is configured to transfer the subtasks in charge of the failed database server to the non-faulted database server for processing when the database server fails.

[0078] Specifically, the failure processing module 600 monitors each database server in a periodic polling manner. When a database server receives the polling command sent by the module and has not responded within the set time...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a system and method for task processing. The system comprises a request receiving module, a task splitting module, a task processing module, a result integration module and a result returning module. According to the characteristic that historical data of a real-time database are managed through a non-shared mechanism in the prior art, a shared management mechanism is adopted in the system. A query task requested by a user is split into a plurality of sub-tasks by various functional modules of the system on the basis of a preset splitting strategy. Parallel processing is conducted on the sub-tasks on the basis of a data source shared mechanism. When the method is specifically implemented, a plurality of database servers can be arranged to serve as equal nodes to be connected to the real-time database, so that a data access right of the real-time database is shared. Parallel access is conducted on the real-time database, so that the sub-tasks are processed in parallel. Compared with an existing task processing method based on the non-shared management mechanism, the inquiry performance of the real-time database is greatly improved through the system and method for task processing.

Description

technical field [0001] The invention belongs to the technical field of database access and access, and in particular relates to a task processing system and method. Background technique [0002] The query performance of historical data is an important performance index of real-time database. [0003] At present, for the data query tasks requested by users, the real-time database does not provide task splitting function or only provides a simple average splitting function based on task volume, and uses a non-sharing mechanism to manage its historical data. Based on this, for the data requested by users For query tasks, the real-time database can only be accessed by a fixed service program and access its historical data to process the corresponding task, or multiple service programs can access and access its historical data in a polling manner to achieve simple split The resulting corresponding subtasks are processed. This processing method greatly affects the response rate ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/46G06F17/30
Inventor 张杨孙雷
Owner STATE GRID CORP OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap