Method for automatically generating optimization strategy orientating complex data warehouse environment
A data warehouse and optimization strategy technology, applied in the direction of electrical digital data processing, special data processing applications, instruments, etc., can solve problems such as poor tuning effect and no consideration of differences
Inactive Publication Date: 2009-10-14
PEKING UNIV
View PDF0 Cites 3 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
The existing general tuning strategies for data warehouses often do not consider these differences, which is also one of the important reasons for poor tuning results
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0034] The following examples are used to illustrate the present invention, but are not intended to limit the scope of the present invention.
[0035] This specific implementation is based on some basic concepts, as follows:
[0036] Definition 1: Diagnostic Point
[0037] Diagnostic point DGN= is a basic component element in a data warehouse system, and it is also a suspicious point that may cause a system bottleneck. For example, the IO and storage of the operating system, the index and storage space allocation of the data warehouse software, the load of the network system, and the corresponding time of the ETL process are all diagnostic points of the data warehouse system. A diagnostic point is a triplet where:
[0038] The name is the name of the diagnosis point;
[0039] The corresponding strategy is the corresponding tuning strategy when the diagnosis point is abnormal;
[0040] The semantic pointer represents the semantics of this diagnostic point, that is, its mean...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention provides a complex data warehouse environment orientated automatic generation method of an optimization strategy, which comprises the following steps of: (1) generating a diagnosis point diagram formed according to semantic link of diagnosis points; (2) ascending-sorting all diagnosis points DGNj according to the diagnosis point distance*Dis(DGNj,DGNi), wherein the diagnosis distance is the distance of diagnosis points corresponding to the elements in a semantic corpus; (3) processing all N units DGNj at the gravity center of the diagnosis points according to the following modes: (3-1) adding new nodes in optimizing procedure; (3-2) according to the distances of the diagnosis points, conducting breadth-first traversal on DGNj from big to small till a semantic distance is smaller than certain limit value Dismax; and (3-3) adding the new nodes if the new nodes are not in the optimizing procedure; (4) for each diagnosis point in a diagnosis procedure, detecting the diagnosis point, and using corresponding optimization strategy if the diagnosis point is abnormal; and (5) outputting the optimization procedure. Aiming at different application backgrounds, the generation method can generate different optimization strategies for different data warehouse systems.
Description
technical field [0001] The invention relates to the technical field of computer databases, in particular to a method for automatically generating optimization strategies oriented to complex data warehouse environments. Background technique [0002] Large-scale data warehouse systems usually encounter performance tuning problems, but the current data warehouse systems are becoming larger and larger in scale, more complex in structure, and involve more and more extensive software technologies. The increasingly complex application architecture and database products make tuning more complicated, and the complex influence between their various tuning strategies also makes tuning more and more difficult. Most of the current tuning techniques are limited to the tuning of a specific detail of the data warehouse system. For example, in the performance tuning of the data warehouse, the tuning of the operating system, data warehouse system, ETL tools, analysis and mining tools, etc. T...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 隋琪王腾蛟杨冬青
Owner PEKING UNIV