Pooling-based log storage method and device, computer equipment and storage medium

Abstract

The embodiment of the invention discloses a pooling-based log storage method and device, computer equipment and a storage medium. The method comprises the steps that if a log storage request is received, judging whether a memory meets a first preset storage condition or not wherein a log comprises data length and log data; if the memory meets a first preset storage condition, judging whether a storage area in a preset memory pool meets a second preset storage condition or not wherein the memory pool comprises a plurality of storage areas; if a storage area in a preset memory pool meets a second preset storage condition, obtaining the storage area meeting the second preset storage condition from the memory pool, and writing the log data into the storage area meeting the second preset storage condition; if the memory does not meet the first preset storage condition, writing a full-load storage area in a preset memory pool into a database; and emptying the full-load storage area and recovering the full-load storage area into the memory pool.

Description

technical field [0001] The present invention relates to the technical field of data processing, in particular to a log storage method, device, computer equipment and storage medium based on pooling. Background technique [0002] In the existing task scheduling system developed based on Java, the task execution log management is an important module, and the task scheduling system generally consists of the following modules: a scheduling module, used to schedule tasks and issue tasks; an execution module, mainly used for Execute tasks; the management module is used to provide a visual interface for users to use; the log module is used to collect task logs and provide logs for users to view. [0003] The log module is responsible for log management, including log collection, storage, and service log interface. The existing log collection method is as follows: tasks will run on each executor, and the executor will periodically send log data to the log On the collection service,...

AI Technical Summary

Problems solved by technology

[0004] The embodiment of the present invention provides a log storage method, device, computer equipment, and storage medium based on pooling, aiming to solve the problem that the object used to encapsulate log data in the memory becomes memory garbage and is recycled by the JVM, causing the system to stop and fail to work normally. Respond to requests in a timely manner, affecting the performance of the entire system

Images