Unlock instant, AI-driven research and patent intelligence for your innovation.

Methods and systems for dynamically allocating resources and tasks among database work agents in smp environment

A work and task technology, applied in the field of processing systems, can solve the problems of database performance and throughput reduction, low resource utilization, high processing delay, etc.

Inactive Publication Date: 2016-09-28
HUAWEI TECH CO LTD
View PDF6 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The time required for worker agents to complete their respective sets of tasks may vary widely due to data skew (such as uneven load distribution) and other factors (such as input / output (I / O) and CPU sharing time, etc.) , which leads to low resource utilization and high processing delays, which greatly reduces database performance and throughput

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Methods and systems for dynamically allocating resources and tasks among database work agents in smp environment
  • Methods and systems for dynamically allocating resources and tasks among database work agents in smp environment
  • Methods and systems for dynamically allocating resources and tasks among database work agents in smp environment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022] The making and using of the disclosed embodiments are discussed in detail below. It should be appreciated, however, that the present invention provides many applicable inventive concepts that can be embodied in a wide variety of specific contexts. The specific embodiments discussed are merely illustrative of specific ways to make and use the invention, and do not limit the scope of the invention.

[0023] Typically, databases are pre-allocated to data partitions, which are assigned to worker agents for processing. Different data partitions may include different amounts of data to be processed for a given query, which may result in an unequal number of tasks for that query being allocated to worker agents (known as data skew). In the present invention, a "task" corresponds to a uniform amount of data that needs to be processed (eg, scanned, looked up, etc.) during the execution of a query. For example, a task can be defined as a fixed number of database pages that need...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

Dynamically re-allocating tasks and / or memory quotas amongst work agents in symmetric multiprocessing (SMP) systems can significantly mitigate delays and inefficiencies associated with data skew. For example, unfinished tasks can be reallocated from a busy work agent to an idle work agent upon determining that the idle work agent has finished processing its originally assigned set of tasks. Alternatively, a portion of a memory quota assigned to an idle work agent can be reallocated to a busy work agent for use in processing the remaining tasks. Memory quotas can be re-assigned by releasing the memory quota back into a memory pool once the idle work agent has finished processing its originally assigned tasks, and then reallocating some or all of the memory quota to the busy work agent.

Description

technical field [0001] The present invention generally relates to processing systems, and more particularly to a method and system for dynamically allocating resources and tasks among database working agents in an SMP environment. Background technique [0002] A feature of a symmetric multiprocessing (SMP for short) system is that two or more working agents (such as processors and processing cores) using shared memory resources jointly perform task processing. SMP systems are often used to manage large databases and perform database queries. To execute a query, an SMP system can identify the tasks to be processed by the query and assign different sets of tasks to different worker agents for parallel / synchronous processing. The time required for worker agents to complete their respective sets of tasks may vary widely due to data skew (such as uneven load distribution) and other factors (such as input / output (I / O) and CPU sharing time, etc.) , which leads to low resource uti...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/50
CPCG06F9/5088G06F2209/504G06F2209/5011Y02D10/00G06F16/2455G06F9/5027
Inventor 李怀智周庆庆杰森·扬·孙
Owner HUAWEI TECH CO LTD