Supercharge Your Innovation With Domain-Expert AI Agents!

Local log processing method, device and equipment and storage medium

A processing method and log technology, which is applied in the field of data processing, can solve problems such as high cost and poor writing performance, and achieve the effects of reducing development costs, improving writing performance, and realizing persistent processing

Pending Publication Date: 2021-01-15
SHANGHAI XIAOI ROBOT TECH CO LTD
View PDF8 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

For example, when recording log data to KAFKA, at least 3 servers need to be deployed, and RabbitMq requires at least 2 servers as active and standby. Bandwidth limitation, this method has poor write performance and high cost

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Local log processing method, device and equipment and storage medium
  • Local log processing method, device and equipment and storage medium
  • Local log processing method, device and equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0029] figure 1 It is a flow chart of a local log processing method provided by Embodiment 1 of the present invention. This embodiment is applicable to the case of locally storing log data generated by the system. This method can be executed by a local log processing device. The device can be implemented by software and / or hardware, and can generally be integrated into computers and all intelligent devices (such as terminal devices or servers) that include program running functions, specifically including the following steps:

[0030] Step 110, when it is detected that the device generates a local log, determine the log data volume of the local log.

[0031] In this step, the log can be data generated during device operation, including program data, business data, and system data. In a specific embodiment, the local log of the native device can be viewed through the development toolkit (such as Microsoft VisualStudio, VS), and when it is detected that the native device genera...

Embodiment 2

[0042] This embodiment is a further refinement of the foregoing embodiments, and explanations of terms that are the same as or corresponding to those of the foregoing embodiments will not be repeated in this embodiment. Figure 2a A flow chart of a local log processing method provided in Embodiment 2. In this embodiment, the technical solution of this embodiment can be combined with one or more methods in the solutions of the above embodiments, such as Figure 2a As shown, the method provided in this embodiment may also include:

[0043] Step 210, when it is detected that the device generates a local log, determine the log data volume of the local log.

[0044] Step 220 , judging whether the amount of log data is less than or equal to the preset standard log data amount, if yes, execute steps 230-270 ; if not, execute step 280 .

[0045]In this embodiment, optionally, the standard log data volume can be preset according to the memory in the Linux kernel, which can be the maxi...

Embodiment 3

[0076] This embodiment is a further refinement of the foregoing embodiments, and explanations of terms that are the same as or corresponding to those of the foregoing embodiments will not be repeated in this embodiment. Figure 3a A flow chart of a local log processing method provided in Embodiment 3. In this embodiment, the technical solution of this embodiment can be combined with one or more methods in the solutions of the above embodiments, such as Figure 3a As shown, the method provided in this embodiment may also include:

[0077] Step 310, when it is detected that the device generates a local log, determine the log data volume of the local log.

[0078] Step 320 , according to the amount of log data, determine in the Linux kernel of the device a target write team matching the local log, and a target write location matching the target write team.

[0079] Step 330, calling a memory mapping function, and writing the local log at the target writing position of the target...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a local log processing method and device, equipment and a storage medium, and the method comprises the steps: determining the log data size of a local log when the equipment isdetected to generate the local log; determining a target write-in team matched with the local log and a target write-in position matched with the target write-in team in a Linux kernel of the equipment according to the log data volume; and calling a memory mapping function, and writing a local log at the target writing position of the target writing team. According to the technical scheme, persistent processing of the log can be achieved, the write-in performance of the log is improved, and the development cost is reduced.

Description

technical field [0001] Embodiments of the present invention relate to the technical field of data processing, and in particular, to a local log processing method, device, device, and storage medium. Background technique [0002] During the operation of the server, a large amount of log data (such as business data and system data) will be generated, and the generated log data will be stored in a database or an external network system. However, due to the large amount of log data, the server writes the log data into the database at a slow speed, and the database write performance is low; if it is stored in an external network system, it will also be limited by the network bandwidth, and the write performance is poor. [0003] In existing methods, in order to solve the problem of low storage performance, log data is usually recorded in local memory. However, this method has poor durability. Once the server is restarted, the data that has not been stored in the memory in time i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/18G06F16/25G06F11/34
CPCG06F16/1815G06F16/25G06F11/3476
Inventor 宋建
Owner SHANGHAI XIAOI ROBOT TECH CO LTD
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More