Supercharge Your Innovation With Domain-Expert AI Agents!

Distributed data mining system and method

A distributed data and data mining technology, applied in digital transmission systems, transmission systems, data exchange networks, etc., can solve the problems of paralysis of the task scheduling system and inability to complete task scheduling and processing.

Active Publication Date: 2017-02-22
INDUSTRIAL AND COMMERCIAL BANK OF CHINA
View PDF5 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Embodiments of the present invention provide a distributed data mining system and method to solve the problem that once the JobTracker server currently serving as the master control node fails, the task scheduling system of the entire Hadoop framework will be paralyzed, and task scheduling and processing cannot be completed.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed data mining system and method
  • Distributed data mining system and method
  • Distributed data mining system and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0071] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0072] Such as figure 1 As shown, the embodiment of the present invention provides a distributed data mining system 10, including: a user terminal group 11, a front server group 12, a first control server 13, a second control server 14, and a computing server group 15; the user The terminal group 11 includes a plurality of user terminals 111; the front-end server group 12 includes a plurality of front-end servers 121; the computing server group 15 includes a p...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a distributed data mining system and method, and relates to the technical field of data mining. The distributed data mining system is characterized in that a first control server is used as a work node; and a second control server is used for real-time monitoring, and sending a work node replacing request to a prepositive server to complete replacing of the work node when the second control servers determines that the first control server malfunctions. Therefore, after completing switching of the work node, the normal working of the whole distributed data mining system is recovered. The distributed data mining system and method can avoid the problem that once the current JobTracker server as the main control node malfunctions, the task scheduling system of the whole hadoop framework becomes paralysed so that the task scheduling and processing cannot be finished.

Description

technical field [0001] The invention relates to the technical field of data mining, in particular to a distributed data mining system and method. Background technique [0002] In recent years, the rise of a new generation of information technology represented by big data, cloud computing, and mobile Internet has set off the "third IT revolution" on a global scale. With the advent of the era of big data, how to further improve data analysis capabilities, dig deep into the business value of data, and drive product innovation, business process and management system changes, and truly "speak with data" has become a new topic. The essence of data mining is to dig out hidden relationships, patterns and trends that are potentially valuable for decision-making from a large amount of data. Due to the calculation involving massive data, there are high requirements for the framework of the realization system. [0003] At present, the mainstream big data mining system adopts a distrib...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): H04L12/24H04L29/08
Inventor 丁贤金焰王备
Owner INDUSTRIAL AND COMMERCIAL BANK OF CHINA
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com