Log compression method and device
A compression method and a technology of a compression device, which are applied in digital data information retrieval, special data processing applications, instruments, etc., can solve problems such as frequent hard disk occupation, log storage occupation, and impact on server operation, and meet the needs of timeliness and small CPU Use time, reduce the effect of impact
Pending Publication Date: 2020-11-24
北京人大金仓信息技术股份有限公司
View PDF0 Cites 2 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
In the case of long-running and frequent trigger operations, the server will generate a large number of log files; the log files are stored in the hard disk of the server and consume a lot of hard disk resources, and in order to write the log to the hard disk, it is necessary to frequently occupy the IO service of the hard disk, crowding out Normal business use of hard disk IO services
[0003] In order to solve the problem that log storage takes up a lot of resources and affects the operation of the server, the existing method is to periodically compress the accumulated log files stored in the hard disk, store and compress the files
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0036] In order to more clearly understand the above objects, features and advantages of the present disclosure, the solutions of the present disclosure will be further described below. It should be noted that, in the case of no conflict, the embodiments of the present disclosure and the features in the embodiments can be combined with each other.
[0037] In the following description, many specific details are set forth in order to fully understand the present disclosure, but the present disclosure can also be implemented in other ways than described here; obviously, the embodiments in the description are only some of the embodiments of the present disclosure, and Not all examples.
[0038] The embodiment of the present application provides a log compression method that can reduce the occupation of memory IO and at the same time reduce the long-term occupation of the CPU during log compression; the log compression method provided by the embodiment of the present application i...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention provides a log compression method and device. The log compression method comprises the steps that newly generated logs are written into a log buffer in a memory; under the condition thatthe log buffer is filled, the logs temporarily stored in the log buffer are compressed to obtain a compressed log file; and the compressed log file is stored, and the log buffer is emptied. Accordingto the log compression method provided by the invention, the newly generated los are stored in the log buffer of the memory, the logs stored in the log buffer are compressed after the log buffer is filled to obtain the compressed log file, and then the compressed log file is stored in the memory. Since the IO process is called only when the compressed logs are stored, the IO process does not needto be used repeatedly as in the prior art. As the compressed log file is a compressed file, the time for the IO process to execute storage of the compressed log file is short when the IO process is occupied.
Description
technical field [0001] The present application relates to the technical field of computer data processing, in particular to a log compression method and device. Background technique [0002] When the database is running and providing services to the outside, the server will record various operation behaviors to form a log. In the case of long-running and frequent trigger operations, the server will generate a large number of log files; the log files are stored in the hard disk of the server and consume a lot of hard disk resources, and in order to write the log to the hard disk, it is necessary to frequently occupy the IO service of the hard disk, crowding out Normal business use of hard disk IO services. [0003] In order to solve the problem that log storage takes up a lot of resources and affects the operation of the server, the existing method is to periodically compress the accumulated log files stored in the hard disk, store and compress the files. However, to compre...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More IPC IPC(8): G06F16/18G06F16/174G06F16/172
CPCG06F16/1815G06F16/1744G06F16/172
Inventor 车晓瑶王建华
Owner 北京人大金仓信息技术股份有限公司