Method and device for analyzing log
An analysis method and log technology, applied in the field of Internet communication, can solve problems such as inability to analyze log files in real time and unbalanced use of system resources, and achieve the effects of improving timeliness, improving timeliness, and rationally and balanced use.
- Application Information
AI Technical Summary
Problems solved by technology
 Based on the above-mentioned preferred embodiments, the present application provides a preferred log analysis device, so as to achieve the technical effect of improving the timeliness of log analysis and using system resources in a reasonable and balanced manner. Preferably, the log analysis device in this embodiment can be set in figure 1 In the log analysis server cluster 106 in. In order to achieve the above purpose, specifically, as figure 2 As shown, the above-mentioned log analysis device includes: a collection unit 202, which is used to collect log files generated by a cluster of website log servers; an analysis unit 204, which communicates with the collection unit 202, and is used to perform session-by-session analysis on the collected log files at predetermined intervals Distributed clickstream log analysis based on units of , wherein the interval period makes the resources of the system for analyzing log files evenly used in a day.
In the above-ment...
 exist Figure 1-10 Based on the above, the present application provides an optimal log analysis method, so as to improve the timeliness of log analysis and use system resources in a reasonable and balanced manner. In order to achieve the above purpose, specifically, as Figure 11 As shown, the above log analysis methods include:
 S1102: Collect log files generated by the website log server cluster;
 S1104: Perform a session-based distributed clickstream log analysis on the collected log files at a predetermined interval period, wherein the interval period enables the resources of the system used to analyze the log files to be used evenly in a day.
 In the preferred embodiment above, the collected log files are analyzed in session units at predetermined intervals, and while the timeliness of log file analysis is improved, the system resources for analyzing log files are averaged every day in a day. It can be used in a predetermined period, whic...
 On the basis of the above preferred embodiments, the present application provides a preferred log analysis method, so as to improve the timeliness of log analysis and use system resources in a reasonable and balanced manner. In order to achieve the above purpose, specifically, as Figure 12 As shown, the above log analysis methods include:
 S1: Download the original log file by the hour and upload it to the distributed computing file system;
 Preferably, downloading log files on an hourly basis is equivalent to setting the predetermined period to 1 hour, but it is not limited thereto. According to different needs, it can also be 30 minutes, 2 hours, etc., so as to improve the timeliness of log analysis. At the same time, when log files Or when an error occurs in the analysis result, the data can be reprocessed or re-analyzed for the predetermined cycle in which the error occurs, so as to reduce the workload. In addition, the distributed framework has u...
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction