Unlock instant, AI-driven research and patent intelligence for your innovation.

Resource management method and device of ETL system

A resource management and resource technology, applied in the computer field, can solve problems such as low resource utilization, resource waste, and resource shortage

Active Publication Date: 2018-06-22
JUHAOKAN TECH CO LTD
View PDF6 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

When the task needs to process a large amount of data in a certain period of time, the resources allocated to the task may be insufficient; when the task needs to process a small amount of data in a certain period of time, the resources allocated to the task may be wasted
As can be seen from the above, the utilization rate of resources in the prior art is low

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Resource management method and device of ETL system
  • Resource management method and device of ETL system
  • Resource management method and device of ETL system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0065] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0066] figure 1 The application scene diagram of the resource management method of the ETL system provided by the embodiment of the present invention. See figure 1 , including a data source system 101 , an ETL system 102 and a database 103 . Optionally, the data source system 101 may include a business system, a third-party system, a prese...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides a resource management method and a resource management device of an ETL system. The method includes steps of acquiring, extracting, converting and loading first data volume of the ETL system for processing a first task in a preset time section during a first window cycle of a first task; confirming resource reference quantity for adjusting the resource of the first task according to the first data volume; in a second window cycle of the first task, performing resource distribution on the first task according to the current resource amount and the resource reference quantity of the first task, wherein the second window cycle is the window cycle after the first window cycle and used for improving the utilization rate of the resource.

Description

technical field [0001] Embodiments of the present invention relate to the field of computer technology, and in particular to a resource management method and device for an ETL system. Background technique [0002] The Extract-Transform-Load (ETL) system can obtain data from data source systems (such as business systems, third-party systems, etc.), and extract, transform and load the obtained data, and process the processed The data is stored in the target database. [0003] ETL systems can execute multiple tasks in parallel, each task is used to process a type of data. In the prior art, before the ETL system executes the task, it allocates resources for the task according to the preset configuration information, such as central processing unit (Central Processing Unit, referred to as CPU) resources, memory resources, and hard disk resources, etc., and configures the tasks according to the The resource executes the task until the task execution ends. However, in the prior ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/50G06F17/30
CPCG06F9/5005G06F16/254
Inventor 周娣
Owner JUHAOKAN TECH CO LTD