Method and device for processing client log

A processing method and client-side technology, applied in the communication field, can solve the problems of limited number of logs, limited disk space, and low log security, and achieve the effect of ensuring security.
CN103309767AActive Publication Date: 2013-09-18TAOBAO CHINA SOFTWARE
5 Cites 51 Cited by

Patent Information

Authority / Receiving Office
CN ยท China
Patent Type
Applications(China)
Current Assignee / Owner
TAOBAO CHINA SOFTWARE
Publication Date
2013-09-18

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The embodiment of the invention provides a method and a device for processing a client log. The method comprises the following steps of adopting a double buffering mechanism, previously setting two MMAP (map files or devices into memory) internal memories to be respectively used as a current buffering area and a standby buffering area, switching the standby buffering area to be the current buffering area when the current buffering area is filled, and transmitting a log stored in the filled buffering area to a distributed file system to be stored, so that the problem that the log processing capacity is limited because the quantity of the processed logs is limited by the limit space of the existing disk can be solved. Due to the characteristics of the MMAP technology, in the operation process, the data in the buffering area can be forcedly outputted to the disk by the system, so that even if a server is restarted or collapsed, the data stored in the buffering area can be restored through the disk without being lost, and the safety of the log stored in the buffering area can be guaranteed.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The present application relates to the field of communications, and in particular to a client log processing method and device. Background technique

[0002] In the existing client log collection and processing scheme, when the client exits, it will compress the collected logs into data packets, for example, compress them into data packets in common formats such as RAR and zip, and send the data packets to to the server. The server verifies the validity of the received data packet according to the relevant protocol, decompresses the data packet after the verification is passed, stores the log obtained after decompression in the log file, and can transmit the log to the distributed server through the background program. On the distributed file system (such as HDFS, Hadoop Distributed File System) implemented by the system infrastructure (such as hadoop). That is, the collected logs are printed to log files. The log system implements a memory-based log...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More