Website operation state monitoring and abnormal detection based on MapReduce

A technology for operating status and anomaly detection, applied in data exchange networks, digital transmission systems, electrical components, etc., to solve problems such as inability to apply traffic portals, delays reducing the value of network information, and failure to use parallel mechanisms.

Inactive Publication Date: 2012-10-10
常熟市支塘镇新盛技术咨询服务有限公司
View PDF3 Cites 56 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

There are also good works in this area in China. For example, Professor Liu Dayou and Professor Yang Bo of Jilin University use machine learning methods to identify repetitive tasks in logs, thereby saving computing time (Li Jiafei et al., 2007); Professor Chen Guolong of Fuzhou University uses Machine learning and optimization...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Website operation state monitoring and abnormal detection based on MapReduce
  • Website operation state monitoring and abnormal detection based on MapReduce
  • Website operation state monitoring and abnormal detection based on MapReduce

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0065] The maintenance of the website is mostly based on the website’s access log, which records the visit behavior of all users, and can effectively find out the interaction rules between users and the website, so as to increase the attention of the website and improve the website service (including improving the effectiveness of links and Use cache to improve website access speed, etc.) all play an important role

[0066] The traditional log analysis method does not take advantage of the parallel mechanism, so it is destined to be unable to be applied to portal websites with a huge number of visits. Moreover, Internet information is changing rapidly, and the delay brought by traditional analysis greatly reduces the value of network information. Under such circumstances, it is particularly important to propose a low-cost, real-time, efficient and accurate analysis strategy.

[0067] The present invention adopts four parallel strategies to analyze and process the web address ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses website operation state monitoring and abnormal detection based on MapReduce. By utilizing a MapReduce parallel programming model, the state monitoring and abnormal detection can be finished, an optimal information point is captured from massive journal files, and abnormal behaviours in the access process are effectively and accurately captured by adopting an effective strategy. A website journal is analyzed by adopting four parallel strategies, namely state monitoring, characteristic abnormal detection, flow peak value detection and decision tree learning access rules, so that the monitoring and abnormal access detection of the website operation state can be achieved.

Description

technical field [0001] The monitoring and anomaly detection of website running status based on MapReduce belong to the technical field of improving website service performance by mining and processing website logs. Background technique [0002] A website, a fixed place on the Internet to publish news to the world, is composed of a domain name (that is, a website address) and a website space, usually including a homepage and other pages with hyperlinked files. Its appearance has brought an irreplaceable role to modern society, such as promoting self-image, providing rich and convenient information, expanding business channels for businesses, etc. In order to allow the website to run stably on the Internet for a long time, let users change rapidly In order to seize more network business opportunities in the information society, the maintenance and improvement of the website has become a crucial link. [0003] The maintenance of the website is mostly based on the website’s acc...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L12/24
Inventor 邹权唐振坤蒋文瑞林琛
Owner 常熟市支塘镇新盛技术咨询服务有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap