Data mining method and system

A data mining and mining algorithm technology, applied in the field of communication, can solve the problem of low processing efficiency and achieve the effect of improving data mining efficiency

Active Publication Date: 2010-08-11
CHINA MOBILE SUZHOU SOFTWARE TECH CO LTD +2
View PDF0 Cites 47 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] The data mining method and data mining system provided by the embodiments of the present invention are used to solve the problem of low processing efficiency caused by using a single-node serial method for data mining in the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data mining method and system
  • Data mining method and system
  • Data mining method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] Embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings.

[0029] see figure 1 , is a schematic diagram of the data mining system architecture in the embodiment of the present invention, the data mining system can be divided into three layers: business application layer 1, data mining platform layer 2 and distributed computing platform layer 3.

[0030] in:

[0031] Data mining platform layer 2 is the key layer for the data mining system to realize business data mining. The data mining process can be realized through the functions of workflow setting, data loading, data preprocessing, mining algorithm implementation and result display provided by this layer;

[0032] Business application layer 1 provides GUI (user interface interface) and API (application program interface) of data mining algorithm library. The data mining platform layer 2 can call the GUI to realize the graphical setting, control and task s...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data mining method and a data mining system. The data mining method comprises the following steps of: setting a workflow for data mining, wherein the workflow comprises a plurality of parallel data processing tasks; starting the workflow, and when the plurality of the parallel data processing tasks are triggered, allocating an execution node to each one of the data processing tasks to ensure that the plurality of the parallel data processing tasks are executed in parallel on the allocated execution nodes; and when the execution nodes execute each data processing task, allocating the data processing tasks to Map tasks executed in parallel to perform processing by a Map/Reduce mechanism, and combining processing results of all the Map tasks corresponding to the data processing tasks through a corresponding Reduce task so as to obtain the processing results of corresponding data processing tasks. By adopting the data mining method and the data mining system, the data mining efficiency can be improved.

Description

technical field [0001] The invention relates to data mining technology in the field of communication, in particular to a data mining method and a data mining system. Background technique [0002] Data mining is to extract potentially useful information and knowledge hidden in it from a large number of incomplete, noisy, fuzzy and random practical application data. process. [0003] Data mining is applied in a wide range of fields, such as banking, telecommunications, insurance, transportation, retail and other commercial fields. Typical business problems that data mining can solve include: Database Marketing, Customer Segmentation & Classification, Profile Analysis, Cross-selling and other market analysis behaviors, as well as customer churn Analysis (Churn Analysis), customer credit scoring (Credit Scoring), fraud detection (Fraud Detection) and so on. [0004] The data mining process usually includes three main steps: data preprocessing (ETL), data mining algorithm impl...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 徐萌邓超高丹罗治国周文辉郑诗豪沈亚飞陈磊
Owner CHINA MOBILE SUZHOU SOFTWARE TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap