Interactive analyzing method for website logs

An analysis method and interactive technology, applied in the field of computer large-scale data analysis, can solve the problem that interactive analysis is not very friendly, and achieve the effect of easy expansion

Active Publication Date: 2015-09-30
FOCUS TECH +1
View PDF2 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] 1) In terms of data processing capabilities, in the face of large-scale data sets, traditional technical solutions are difficult to operate and visualize these data friendly in a stand-alone environment, at least the support of high-performa

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Interactive analyzing method for website logs
  • Interactive analyzing method for website logs
  • Interactive analyzing method for website logs

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] The implementation process of the present invention will be described in detail below in conjunction with examples and accompanying drawings.

[0035] First, if figure 2 :

[0036] (1) Export the log file from the log server and upload it to the distributed file system HDFS;

[0037] (2) Write the MapReduce program, the main function is to realize the preprocessing of log data, as well as the statistics of related indicators and data mining algorithms, and store the processed results into the database. (In order to improve the speed, when the amount of data is relatively large, the results can be written into the distributed file system first, and then imported into the database).

[0038] Log data before processing:

[0039] 1.0.181.143201408102014-08-102014-08-1015:18:25--host1213

[0040] GET

[0041] / product / lqpmcaUVqotH / China-My6812-24V100W-Electric-Bike-Electric-Scooter-Belt-Driven-Motor.html https: / / www.google.co.th /

[0042] The processed log data is stor...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an interactive analyzing method for website logs. A visual analysis system of a log visual data processing system is adopted and comprises three main assemblies including a data preprocessor, a data server and a visual interface assembly module, and an assembly separating strategy is adopted, in other words, all the assemblies of the system can be arranged on a single machine or a cluster. The data preprocessor is used for filtering, washing and extracting data and executing simple data mining operation based on original data. The data preprocessor conducts compiling based on a MapReduce normal form and processes data from a log server. When the process is executed, the data can be divided into sub-data with a file as a unit and sent to a target database. In a system architecture system, the database plays a role of a transfer station and is used for storing intermediate files, namely conversation files.

Description

1. Technical field [0001] The invention belongs to the technical field of computer large-scale data analysis, and in particular relates to an interactive analysis technology for website logs. 2. Background technology [0002] The rapid development of the Internet makes people's study and work more and more dependent on the Internet, especially in the fields of e-commerce and finance. The traditional store transaction model is largely affected by online transactions. The emergence of giant e-commerce websites such as Taobao and JD.com, and online trading websites with sudden traffic such as 12306 not only tests the traditional website architecture technology, but also tests whether merchants can respond to the needs of different groups of websites in a timely and effective manner. Variety. For these large-scale e-commerce websites, the increase in visits makes the log system generate a large number of visit records every day. How to understand users' access behavior patterns...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/182G06F16/2465G06F16/248
Inventor 邵明路滕晓程陈茂榕马成平倪俊辉
Owner FOCUS TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap