Unlock instant, AI-driven research and patent intelligence for your innovation.

Database log processing method and device

A processing method and database technology, applied in the computer field, can solve the problems of long preprocessing time, low log processing efficiency, etc., and achieve the effect of improving processing speed and processing efficiency

Active Publication Date: 2015-03-04
BEIJING GRIDSUM TECH CO LTD
View PDF10 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The main purpose of the present invention is to provide a database log processing method and device to solve the problem in the prior art that repeated read and write operations on the entire log file make the preprocessing of the website access log file take a long time, resulting in low efficiency of log processing question

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Database log processing method and device
  • Database log processing method and device
  • Database log processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0021] The embodiment of the present invention provides a database log processing method.

[0022] figure 1 is a flow chart of a database log processing method according to an embodiment of the present invention. Such as figure 1 As shown, the method includes the following steps:

[0023] Step S11, obtaining log files.

[0024] Specifically, through the above step S11, the log file generated by the server is obtained.

[0025] Step S13, read the segmentation rules of the log file.

[0026] Specifically, through the above-mentioned step S13, the preset division rule for dividing the log file is read.

[0027] Step S15, splitting the log file according to the splitting rule to obtain at least two pre-processed log files.

[0028] Specifically, according to the above step S15, the entire acquired log file is divided according to the read division rule, and the log file is divided into two or more pre-processed log files for subsequent use.

[0029] In step S17, at least tw...

Embodiment 2

[0082] The embodiment of the present invention also provides a database log processing device, such as Figure 4 As shown, the device may include: a first acquisition module 31 , a first reading module 33 , a segmentation module 35 and a first storage module 37 .

[0083] Wherein, the first acquiring module 31 is configured to acquire log files.

[0084] Specifically, the log file generated by the server is obtained through the above-mentioned first obtaining module 31 .

[0085] The first reading module 33 is configured to read the division rules of the log file.

[0086] Specifically, through the above-mentioned first reading module 33, the preset division rule for dividing the log file is read.

[0087] The splitting module 35 is configured to split the log file according to the splitting rule to obtain at least two pre-processed log files.

[0088] Specifically, the above-mentioned segmentation module 35 divides the entire acquired log file according to the read segment...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a database log processing method and device. The method includes acquiring a log file; reading segmentation rules of the log file; segmenting the log file according to the segmentation rules, and acquiring at least two pre-processed log files; writing the at least two pre-processed log files into a pre-processing database sequentially. By the aid of the method, the problems that in the prior art, repeated reading and writing operations are performed on the entire log file, the pre-processing time for a website accessing the log file is long, and the log processing efficiency is low are solved.

Description

technical field [0001] The invention relates to the field of computers, in particular to a database log processing method and device. Background technique [0002] With the development of the Internet, the number of website visits and the amount of data have soared, and a single server can no longer meet the application needs. Therefore, the more commonly used method at present is to use the computer cluster load balancing method to distribute the server load to a group of back-end servers through one or more front-end load servers, and the back-end servers receive requests and record logs. [0003] As the number of visits to the website increases, the log files used to record the access requests received by the server also expand continuously with the increase in the number of visits to the website. However, the processing time requirements for log files are not reduced. Therefore, how to improve the processing efficiency of log files has become a problem that must be fac...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/27G06F16/958
Inventor 戴飞张同欣刘凯
Owner BEIJING GRIDSUM TECH CO LTD