A simplified logging method, system, readable storage medium and computer device

Abstract

The application provides a log simplification method, system, readable storage medium and computer device, the method comprises the following steps: obtaining file events in a log, distinguishing the levels of the log according to the file events, and compressing the logs of different levels; creating a storage folder and classifying the storage folder to obtain different kinds of storage folders; storing the logs of different levels into the storage folders of corresponding kinds, extracting feature data in the logs of different levels, and naming the corresponding storage folders according to the feature data; obtaining log files of the same level as the log, storing the log files into the corresponding storage folders, obtaining the storage time of the log files, storing the storage time into the corresponding storage folders, and compressing the log files. The application can effectively increase the readability of the log and reduce the waste of disk resources caused by the log.

Description

Technical Field

[0001] This invention relates to the field of data simplification technology, and in particular to a simplified log method, system, readable storage medium, and computer device. Background Technology

[0002] With the development of computer, communication, and network technologies, many companies, enterprises, and operators possess their own IT systems and network equipment. Managing various software, systems, and devices requires more than just focusing on the services and functions provided; it also necessitates understanding system access patterns, throughput, abnormal user behavior, and system fault alarms to improve service content and quality, enhance user experience, and ultimately improve the company's competitiveness. Logs have become a crucial resource in this process. For example, e-commerce service providers can leverage website service logs to uncover hidden business value and transform user behavior data into effective information that decision-makers can utilize, providing decision support for business operations.

[0003] Log files are files or collections of files used to record system operation events, and can be divided into event logs and message logs. They play an important role in processing historical data, tracing problems for diagnosis, and understanding system activity. In computers, log files record events that occur during the operation of the operating system or other software, or messages between different users in communication software. Recording is the act of keeping a log. In the simplest case, messages are written to a single log file.

[0004] Various systems have various log files, which usually record some relevant information about our operations. By reading and analyzing the logs, we can quickly locate the problem, program changes, etc.

[0005] In existing technologies, the readability of system logs is very poor, and outputting to the console or folder requires a lot of resources, resulting in a large number of I / O operations and huge resource consumption. Summary of the Invention

[0006] Therefore, the purpose of this invention is to provide a simplified logging method, system, readable storage medium, and computer device to at least address the shortcomings of the prior art.

[0007] This invention provides a simplified logging method, the method comprising:

[0008] Obtain file items from the log, classify the log levels according to the file items, and compress the logs of different levels;

[0009] Create storage folders and categorize them to obtain different types of storage folders;

[0010] The logs of different levels are stored in the corresponding storage files, and the feature data of the logs of different levels is extracted. The corresponding storage folders are named according to the feature data.

[0011] Obtain a log file at the same level as the log file, store the log file in the corresponding storage folder, obtain the storage time of the log file, store the storage time in the corresponding storage folder, and compress the log file.

[0012] Compared with the prior art, the beneficial effects of the present invention are as follows: Logs are classified according to the levels of the file items within them, and the classified logs are stored in different types of folders, enhancing the readability of the logs. Furthermore, naming the storage folders according to the log's characteristic data further improves the readability of the stored logs. Moreover, by compressing the logs and extracting their characteristic data for compression without affecting readability, the consumption of disk resources by the logs can be effectively reduced. Furthermore, when storing log files at the same level as the logs, only storage time is required, and further compression of the log files can further reduce disk resource consumption.

[0013] Furthermore, the step of obtaining file items from the log and distinguishing the log level based on the file items includes:

[0014] Based on the log, examine the file items and extract the file size, file type, and file string from the file items;

[0015] The logs are classified into different levels based on their size, type, and string.

[0016] Furthermore, the steps of creating storage folders and categorizing the storage folders include:

[0017] The size of the logs is obtained in advance, and corresponding storage folders are created according to the size of the logs, and the storage folders are sorted.

[0018] A sequence list consisting of the storage folders is obtained by sorting the storage folders, and the sequence list includes the storage folders arranged in ascending order;

[0019] The storage folders are initially classified according to their ascending order of size to obtain preliminary classification results;

[0020] Obtain the number of storage folders and the number of logs, and classify each storage folder based on the preliminary classification results, the number of storage folders, and the number of logs.

[0021] Furthermore, the step of extracting feature data from the logs at different levels and naming the corresponding storage folders based on the feature data includes:

[0022] Obtain the file items from the log and extract the key characters from the file items;

[0023] Based on the key characters, the feature data corresponding to the log is obtained, and the readable features corresponding to the log are obtained based on the feature data.

[0024] Furthermore, the steps of obtaining the storage time of the log file, storing the storage time in the corresponding storage folder, and compressing the log file include:

[0025] Record the timestamp of the log file being stored in the corresponding storage folder, and record the timestamp in the corresponding storage folder;

[0026] Locate the storage folder containing the timestamp and the log files, and compress the log files within the storage folder.

[0027] Furthermore, the step of compressing the log files within the storage folder includes:

[0028] The event collection and strings in the log file are mined based on the mining model;

[0029] The log file is compressed based on the compression model, the event set, and the string.

[0030] The present invention also proposes a simplified log system, the system comprising:

[0031] The acquisition module is used to acquire file items in the log, distinguish the log level according to the file items, and compress the logs of different levels;

[0032] A module is created to create storage folders and categorize these folders to obtain different types of storage folders;

[0033] The naming module is used to store logs of different levels into storage files of corresponding types, extract feature data from logs of different levels, and name the corresponding storage folders according to the feature data.

[0034] The storage compression module is used to obtain log files at the same level as the logs, store the log files in the corresponding storage folder, obtain the storage time of the log files, store the storage time in the corresponding storage folder, and compress the log files.

[0035] Furthermore, the acquisition module includes:

[0036] The query unit is used to query the file items according to the log, and extract the file size, file type and file string from the file items;

[0037] The differentiation unit is used to differentiate the logs according to the file size, the file type, and the file string.

[0038] The present invention also proposes a readable storage medium on which a computer program is stored, which, when executed by a processor, implements the simplified logging method described above.

[0039] The present invention also proposes a computer device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the simplified logging method described above. Attached Figure Description

[0040] Figure 1 This is a flowchart of the simplified logging method in the first embodiment of the present invention;

[0041] Figure 2 This is a flowchart illustrating the specific steps of step S1 in the simplified log method of the first embodiment of the present invention.

[0042] Figure 3 This is a flowchart illustrating the specific steps of step S2 in the simplified log method of the first embodiment of the present invention.

[0043] Figure 4 This is a flowchart illustrating the specific steps of step S3 in the simplified log method of the first embodiment of the present invention;

[0044] Figure 5 This is a flowchart illustrating the specific steps of step S4 in the simplified log method of the first embodiment of the present invention.

[0045] Figure 6 This is a flowchart illustrating the specific steps of step S42 in the simplified log method of the first embodiment of the present invention.

[0046] Figure 7 This is a simplified block diagram of the log system in the second embodiment of the present invention;

[0047] Figure 8This is a structural block diagram of a computer device according to the third embodiment of the present invention.

[0048] Explanation of key component symbols:

[0049] 10. Obtain module; 20. Create module; 30. Name module; 40. Store and compress module;

[0050] 100. Memory; 200. Processor; 300. Computer program.

[0051] The following detailed description, in conjunction with the accompanying drawings, will further illustrate the present invention. Detailed Implementation

[0052] To facilitate understanding of the present invention, a more complete description will be given below with reference to the accompanying drawings. Several embodiments of the invention are illustrated in the drawings. However, the invention can be implemented in many different forms and is not limited to the embodiments described herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete.

[0053] It should be noted that when a component is said to be "fixed to" another component, it can be directly on the other component or there may be an intervening component. When a component is said to be "connected to" another component, it can be directly connected to the other component or there may be an intervening component. The terms "vertical," "horizontal," "left," "right," and similar expressions used in this document are for illustrative purposes only.

[0054] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention pertains. The terminology used herein in the description of the invention is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. The term "and / or" as used herein includes any and all combinations of one or more of the associated listed items.

[0055] Example 1

[0056] Please see Figure 1 The image shows a simplified log method according to the first embodiment of the present invention, the method comprising steps S1 to S4:

[0057] S1, obtain file items from the log, distinguish the log level according to the file items, and compress the logs of different levels;

[0058] Specifically, the log entries are based on items recorded during daily work or study. The logs are then categorized according to the size and importance of the recorded items, and finally compressed into ZIP format to reduce their size.

[0059] like Figure 2 As shown, step S1 includes steps S11 to S12:

[0060] S11, based on the log, review the file items and extract the file size, file type, and file string from the file items;

[0061] S12, classify the logs into different levels based on the file size, file type, and file string;

[0062] Specifically, the file items in the log are extracted, including file size, file type, and file string. The file string is the character that makes up the file item, the file type indicates whether the log belongs to office or study records, and the file size indicates the specific space occupied by the log. Then, the log level is distinguished according to the file type, file string, and file size.

[0063] S2, create storage folders and classify the storage folders to obtain different types of storage folders;

[0064] Specifically, different types of storage folders can be created to store logs at different levels. Different types of folders can store logs at different levels. For example, logs of different sizes can be stored in different types of storage folders.

[0065] Among them, such as Figure 3 As shown, step S2 includes steps S21 to S24:

[0066] S21, the size of the log is obtained in advance, and a corresponding storage folder is created according to the size of the log, and the storage folders are sorted.

[0067] Specifically, in this process, the storage folder containing the logs is first sorted according to the size of the logs stored within it.

[0068] S22, a sequence list consisting of the storage folders is obtained according to the sorting of the storage folders, the sequence list including the storage folders arranged in ascending order;

[0069] S23, perform preliminary classification of each storage folder according to the storage folders arranged in ascending order, and obtain preliminary classification results;

[0070] Specifically, the sorted storage folders form a sequence list of storage folders. The sequence list includes storage folders with the smallest to largest space occupied. Storage folders with logs stored within them can be classified into the same type, such as those with logs ranging from 104,857,600 bytes to 314,572,800 bytes, and those with logs ranging from 419,430,400 bytes to 629,145,600 bytes. At this point, the initial classification is complete.

[0071] S24, obtain the number of storage folders and the number of logs, and classify each storage folder based on the preliminary classification result, the number of storage folders and the number of logs.

[0072] Specifically, after obtaining a certain number of storage folders, each storage folder is categorized according to the number of logs stored within it.

[0073] S3, store the logs of different levels into the corresponding storage files, extract the feature data from the logs of different levels, and name the corresponding storage folders according to the feature data;

[0074] Specifically, extract the main information from the log. For example, if the log records items in a certain task, the theme of that task can be used as feature data, and the storage folder can be named after that theme.

[0075] Among them, such as Figure 4 As shown, step S3 includes steps S31 to S32:

[0076] S31, obtain the file item in the log and extract the key characters in the file item;

[0077] Specifically, for specific items in a document, such as study, work, or meeting minutes, keywords are extracted from the specific items in the document.

[0078] S32, calculate the feature data corresponding to the log based on the key characters, and obtain the readable features corresponding to the log based on the feature data.

[0079] Specifically, keywords are obtained from specific events such as learning, work, or meeting minutes. These keywords can then be used to identify the concise and short features of the log, thereby increasing its readability.

[0080] S4, obtain a log file of the same level as the log file, store the log file in the corresponding storage folder, obtain the storage time of the log file, store the storage time in the corresponding storage folder, and compress the log file;

[0081] Among them, such as Figure 5 As shown, step S4 includes steps S41 to S42:

[0082] S41, record the timestamp of the log file being stored in the corresponding storage folder, and record the timestamp in the corresponding storage folder;

[0083] S42, Locate the storage folder that records the timestamp and stores the log files, and compress the log files in the storage folder.

[0084] Specifically, when storing log files of the same level later, the timestamp of the log file being stored in the storage folder is recorded first, and then the current timestamp is stored. Then, the log files stored in the storage folder are compressed, which reduces the disk resources they occupy.

[0085] Among them, such as Figure 6 As shown, step S42 includes steps S421 to S422:

[0086] S421, Mine the event set and strings in the log file based on the mining model;

[0087] S422, Compress the log file based on the compression model, the event set, and the string.

[0088] Specifically, in this embodiment, a mining model is constructed. The mining model can extract keywords and key strings from the log file according to the actual needs of the keyword extraction algorithm. A compression model can also be constructed, and then the compression model compresses the log file based on the keywords and key strings, so that the log file only contains more representative keywords, thereby effectively reducing the consumption of disk resources.

[0089] In summary, the simplified log method in the first embodiment of the present invention classifies logs according to the levels of the file items within them and stores the classified logs in different types of folders, thereby enhancing the readability of the logs. Furthermore, naming the storage folders according to the log's characteristic data can further improve the readability of the stored logs. Moreover, by compressing the logs and extracting their characteristic data to compress them without affecting their readability, the consumption of disk resources by the logs can be effectively reduced. In addition, when storing log files of the same level as the logs, only storage time is required, and then compressing the log files can further reduce the consumption of disk resources.

[0090] Example 2

[0091] Please see Figure 7 The image shows a simplified log system according to a second embodiment of the present invention, the simplified log system comprising:

[0092] The acquisition module 10 is used to acquire file items in the log, distinguish the level of the log according to the file items, and compress the logs of different levels.

[0093] Module 20 is used to create storage folders and classify the storage folders to obtain different types of storage folders;

[0094] The naming module 30 is used to store the logs of different levels into the corresponding storage files, extract the feature data from the logs of different levels, and name the corresponding storage folders according to the feature data.

[0095] The storage compression module 40 is used to obtain log files at the same level as the logs, store the log files in the corresponding storage folder, obtain the storage time of the log files, store the storage time in the corresponding storage folder, and compress the log files.

[0096] In some optional embodiments, the acquisition module 10 includes:

[0097] The query unit is used to query the file items according to the log, and extract the file size, file type and file string from the file items;

[0098] The differentiation unit is used to differentiate the logs according to the file size, the file type, and the file string;

[0099] The creation module 20 includes:

[0100] A creation unit is used to pre-obtain the size of the log, create corresponding storage folders according to the size of the log, and sort the storage folders.

[0101] A sorting unit is used to obtain a sequence list composed of the storage folders according to the sorting of the storage folders, the sequence list including the storage folders arranged in ascending order;

[0102] The first classification unit is used to perform preliminary classification of each of the storage folders according to the storage folders arranged in ascending order, and to obtain preliminary classification results;

[0103] The second classification unit is used to obtain the number of storage folders and the number of logs, and classify each of the storage folders based on the preliminary classification results, the number of storage folders and the number of logs;

[0104] The naming module 30 includes:

[0105] The acquisition unit is used to acquire the file items in the log and extract the key characters in the file items;

[0106] The calculation unit is used to calculate the feature data corresponding to the log based on the key characters, and to obtain the readable features corresponding to the log based on the feature data;

[0107] The storage compression module 40 includes:

[0108] A recording unit is used to record the timestamp of the log file being stored in the corresponding storage folder, and to record the timestamp in the corresponding storage folder;

[0109] The search unit is used to locate the storage folder that records the timestamp and stores the log files, and to compress the log files in the storage folder.

[0110] In some alternative embodiments, the lookup unit includes:

[0111] The mining subunit is used to mine event sets and strings in the log file based on the mining model.

[0112] A compression unit is used to compress the log file based on a compression model, the event set, and the string.

[0113] The simplified log system provided in this embodiment of the invention has the same implementation principle and technical effects as the aforementioned method embodiment. For the sake of brevity, any parts not mentioned in the system embodiment can be referred to the corresponding content in the aforementioned method embodiment.

[0114] Example 3

[0115] The present invention also proposes a computer device, please refer to [link / reference]. Figure 8 The diagram shows a computer device according to a third embodiment of the present invention, including a memory 100, a processor 200, and a computer program 300 stored in the memory 100 and executable on the processor 200. When the processor 200 executes the computer program 300, it implements the simplified logging method described above.

[0116] The memory 100 includes at least one type of readable storage medium, such as flash memory, hard disk, multimedia card, card-type memory (e.g., SD or DX memory), magnetic memory, magnetic disk, optical disk, etc. In some embodiments, the memory 100 may be an internal storage unit of a computer device, such as the hard disk of that computer device. In other embodiments, the memory 100 may be an external storage device, such as a plug-in hard disk, a SmartMedia Card (SMC), a Secure Digital (SD) card, a Flash Card, etc. Furthermore, the memory 100 may include both internal and external storage units of the computer device. The memory 100 can be used not only to store application software and various types of data installed on the computer device, but also to temporarily store data that has been output or will be output.

[0117] In some embodiments, the processor 200 may be an electronic control unit (ECU, also known as a vehicle computer), a central processing unit (CPU), a controller, a microcontroller, a microprocessor, or other data processing chip, used to run program code stored in the memory 100 or process data, such as executing access restriction programs.

[0118] It should be pointed out that, Figure 8 The structure shown does not constitute a limitation on the computer device. In other embodiments, the computer device may include fewer or more components than shown, or combine certain components, or have different component arrangements.

[0119] This invention also proposes a readable storage medium storing a computer program that, when executed by a processor, implements the simplified logging method described above.

[0120] Those skilled in the art will understand that the logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a sequential list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus, or device (such as a computer-based system, a processor-included system, or other system that can fetch and execute instructions from, an instruction execution system, apparatus, or device). For the purposes of this specification, "computer-readable medium" can mean any means that can contain, store, communicate, propagate, or transmit programs for use by, or in conjunction with, an instruction execution system, apparatus, or device.

[0121] More specific examples of computer-readable media (a non-exhaustive list) include: electrical connections (electronic devices) having one or more wires, portable computer disk drives (magnetic devices), random access memory (RAM), read-only memory (ROM), erasable and editable read-only memory (EPROM or flash memory), fiber optic devices, and portable optical disc read-only memory (CDROM). Furthermore, computer-readable media can even be paper or other suitable media on which the program can be printed, since the program can be obtained electronically, for example, by optically scanning the paper or other medium, followed by editing, interpreting, or otherwise processing as necessary, and then stored in computer memory.

[0122] It should be understood that various parts of the present invention can be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods can be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented using any one or a combination of the following techniques known in the art: discrete logic circuits having logic gates for implementing logical functions on data signals, application-specific integrated circuits (ASICs) having suitable combinational logic gates, programmable gate arrays (PGAs), field-programmable gate arrays (FPGAs), etc.

[0123] In the description of this specification, references to terms such as "one embodiment," "some embodiments," "example," "specific example," or "some examples," etc., indicate that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of the invention. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples.

[0124] The embodiments described above are merely illustrative of several implementations of the present invention, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of the present invention. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of the present invention, and these modifications and improvements all fall within the scope of protection of the present invention. Therefore, the scope of protection of this patent should be determined by the appended claims.

Claims

1. A simplified logging method, characterized in that, The method includes: Obtain file items from the log, classify the log levels according to the file items, and compress the logs of different levels; Creating storage folders and categorizing them into different types of storage folders includes the following steps: The size of the logs is obtained in advance, and corresponding storage folders are created according to the size of the logs, and the storage folders are sorted. A sequence list consisting of the storage folders is obtained by sorting the storage folders. The sequence list includes the storage folders arranged in ascending order. The logs stored in the sequence list are initially classified according to their size. The storage folders are initially classified according to their ascending order of size to obtain preliminary classification results; Obtain the number of storage folders and the number of logs, and classify each storage folder based on the preliminary classification results, the number of storage folders, and the number of logs; The logs of different levels are stored in the corresponding storage files, and the feature data of the logs of different levels is extracted. The corresponding storage folders are named according to the feature data. Obtain a log file at the same level as the log file, store the log file in the corresponding storage folder, obtain the storage time of the log file, store the storage time in the corresponding storage folder, and compress the log file. This step specifically includes: Record the timestamp of the log file being stored in the corresponding storage folder, and record the timestamp in the corresponding storage folder; Locate the storage folder containing the timestamp and the log files, and compress the log files within the storage folder. This step specifically includes: The event set and strings in the log file are mined based on the mining model, wherein the mining model extracts keywords; The log file is compressed based on the compression model, the event set, and the string, wherein the compression model is constructed based on the event set and the string.

2. The simplified log method according to claim 1, characterized in that, The step of obtaining file items from the log and distinguishing the log level based on the file items includes: Based on the log, examine the file items and extract the file size, file type, and file string from the file items; The logs are classified into different levels based on their size, type, and string.

3. The simplified log method according to claim 1, characterized in that, The steps of extracting feature data from the logs at different levels and naming the corresponding storage folders based on the feature data include: Obtain the file items from the log and extract the key characters from the file items; Based on the key characters, the feature data corresponding to the log is obtained, and the readable features corresponding to the log are obtained based on the feature data.

4. A simplified log system, characterized in that, The system includes: The acquisition module is used to acquire file items in the log, distinguish the log level according to the file items, and compress the logs of different levels; A module is created to create storage folders and categorize these folders to obtain different types of storage folders; The creation module includes: A creation unit is used to pre-obtain the size of the log, create corresponding storage folders according to the size of the log, and sort the storage folders. A sorting unit is used to obtain a sequence list composed of the storage folders according to the sorting of the storage folders. The sequence list includes the storage folders arranged in ascending order, wherein the logs stored in the sequence list are initially classified. The first classification unit is used to perform preliminary classification of each of the storage folders according to the storage folders arranged in ascending order, and to obtain preliminary classification results; The second classification unit is used to obtain the number of storage folders and the number of logs, and classify each of the storage folders based on the preliminary classification results, the number of storage folders and the number of logs; The naming module is used to store logs of different levels into storage files of corresponding types, extract feature data from logs of different levels, and name the corresponding storage folders according to the feature data. The storage compression module is used to obtain log files at the same level as the logs, store the log files in the corresponding storage folder, obtain the storage time of the log files, store the storage time in the corresponding storage folder, and compress the log files. The storage compression module includes: A recording unit is used to record the timestamp of the log file being stored in the corresponding storage folder, and to record the timestamp in the corresponding storage folder; The search unit is used to locate the storage folder that records the timestamp and stores the log files, and to compress the log files in the storage folder. The search unit includes: The mining subunit is used to mine the event set and strings in the log file based on the mining model, wherein the mining model extracts keywords; A compression unit is used to compress the log file based on a compression model, the event set, and the string, wherein the compression model is constructed based on the event set and the string.

5. The simplified log system according to claim 4, characterized in that, The acquisition module includes: The query unit is used to query the file items according to the log, and extract the file size, file type and file string from the file items; The differentiation unit is used to differentiate the logs according to the file size, the file type, and the file string.

6. A readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the simplified logging method as described in any one of claims 1 to 3.

7. A computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the simplified logging method as described in any one of claims 1 to 3.

Images