Prediction method of operational performance based on historical data modeling in grid

A performance prediction and historical data technology, applied in the field of distributed technology and systems, can solve problems such as software is difficult to implement, cannot adapt to both computing-intensive and communication-intensive job types, and large prediction errors

Inactive Publication Date: 2010-04-21
TSINGHUA UNIV
View PDF0 Cites 30 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

And this is often difficult to achieve for most software
[0016] 3) It cannot adapt to both computation-intensive and communication-intensive job types, and can only be modeled separately for computation-intensive and communication-intensive jobs
However, other studies have demonstrated that the NWS prediction error for actual file transfer bandwidth is quite large
[0018] 5) Evaluate in the simulated environment, set the resource load to a fixed state, and do not reflect the dynamic change of resource load

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Prediction method of operational performance based on historical data modeling in grid
  • Prediction method of operational performance based on historical data modeling in grid
  • Prediction method of operational performance based on historical data modeling in grid

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0058] Before giving the main content of the present invention, it is necessary to explain the process of job execution in the grid environment. Figure 2 Shown as a schematic diagram of the process of grid job execution. It can be seen from the figure that the execution process of the grid job can be roughly divided into three stages.

[0059] 1) Input data preparation stage. The input data for a job is transferred from the user to the resource that executes the job. This stage mainly occupies the network bandwidth, and does not occupy much CPU cycles.

[0060] 2) Data processing stage. It mainly analyzes and processes the input data. This stage occupies relatively more CPU cycles, but less network bandwidth.

[0061] 3) Output data acquisition stage. The output data of the job is transferred from the computing resource to the user. Similar to the first stage, it mainly occupies the network bandwidth and does not occupy a large amount of CPU cycles.

[0062] Based on ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a prediction method of operational performance based on a historical data modeling in grid, belonging to an operation completing time modeling and prediction method in high-performance grid. The prediction method is characterized by comprising the steps of establishing a historical operational information bank based on a CGDP grid software and a CGSV grid software in grid nodes, wherein the historical operational information bank contains N historical operational information, relating to four aspects of resource allocation, resources loading, operation request and operation actual performance; and simultaneously establishing a set comprising one or more candidate regressive functions, wherein when predicting, the N+1th operation submitted by a user is acquired according to a regressive model of the Nth operation, and the regressive model of the Nth operation is acquired by selecting a candidate regressive model with the smallest difference value from differences of predicted value results of operation actual performance of the Nth operation and the actual performance of the candidate regressive models of the N-1th operation. According to a simulation experiment, the invention can solve the problem of surging operation time and operation expense caused by excessive resource load.

Description

technical field [0001] The invention relates to a modeling method for job completion time in a high-performance grid, and belongs to the field of distributed technology and systems. Background technique [0002] In modern scientific research, the field for people to solve problems is constantly expanding, and the problems they encounter are becoming more and more complex, and the scale is getting larger and larger. Unable to meet demand. With the rapid development of computer and network technology, many organizations and scientific research units have supercomputers with strong computing power, but these machines often do not fully function because they only serve their own units in isolation, and are idle most of the time . Therefore, it has become a necessary requirement to break the geographical restrictions and use various resources widely distributed on the network in coordination. [0003] The proposal and development of grid technology is just to meet the above-me...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/50H04L29/08
Inventor 武永卫杨广文陈刚柳佳
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products