Task data compression switching method, compression degree evaluation method and relevant devices
A technology of task data and positive correlation, applied in the database field, can solve the problems of reducing the task execution efficiency of the computing platform, excessive time, consumption, etc., and achieve the effect of avoiding the decline of task execution efficiency
Inactive Publication Date: 2017-09-22
ALIBABA GRP HLDG LTD
View PDF15 Cites 1 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
For example, when the preset parameters indicate that the task data should be compressed, the data generated by all computing tasks will be compressed, which will consume more time for task execution, especially when the amount of computing tasks is large, which will greatly reduce the calculation time. The task execution efficiency of the platform; on the contrary, when the preset parameters indicate that the task data is not compressed, the data generated by all computing tasks will not be compressed, which will bring huge pressure to the disk storage and network transmission of the computing platform
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0064] Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with aspects of the present application as recited in the appended claims.
[0065] In the following detailed description, numerous specific details are set forth in order to provide a comprehensive understanding of the application, but those skilled in the art will understand that the application may be practiced without these specific details. In other embodiments, well-known methods, procedures, components and circuits have not been described in detail so as n...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a computing platform task data compression switching method, a compression degree evaluation method and relevant devices. According to the compression switching method, positive compression indicators and negative compression indicators of a computing platform are acquired to comprehensively evaluate whether the computing platform is suitable for compressing task data under the current situation; if yes, that is, compression switching conditions are met, the computing platform is controlled to compress the task data generated under the situation; and if the practical application situation changes and the switching conditions are no longer met, the computing platform is controlled to stop compressing the task data. Obviously, through the compression switching method, compression control and switching can be performed in real time according to the practical application situation of the computing platform, and the phenomenon that task execution efficiency is lowered because a large amount of data waits to be compressed, or disk and network pressure is increased due to storage and transmission of a large amount of uncompressed data is avoided.
Description
technical field [0001] The invention relates to the technical field of databases, in particular to a computing platform task data compression and switching method, a suitable compression degree evaluation method and related devices. Background technique [0002] A large computing platform, such as a distributed computing cluster, usually runs a large number of computing tasks at the same time; in some cases, the computing platform will compress the data generated by the intermediate process and output results of these computing tasks to reduce the pressure on disk storage And the subsequent pressure on the network transmission of data. In related technologies, it is generally determined whether to compress the task data by preset parameters, that is, as long as the preset parameters indicate that the task data is compressed, the task data will be compressed regardless of other actual conditions, otherwise, as long as the preset The parameter indicates that the task data wil...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More IPC IPC(8): G06F9/48G06F17/30
CPCG06F9/4806G06F16/1744
Inventor 贾元乔孙伟光苏艳
Owner ALIBABA GRP HLDG LTD