Real-time mining method and device based on distributed data

A technology of distributed data and data, applied in the fields of electronic digital data processing, structured data retrieval, special data processing applications, etc., can solve the problems of difficult to meet the real-time data processing, can only continue to wait, low efficiency and so on
CN107220261AActive Publication Date: 2017-09-29SHANXI CHINA MOBILE COMM CORP
3 Cites 15 Cited by

Patent Information

Authority / Receiving Office
CN · China
Current Assignee / Owner
SHANXI CHINA MOBILE COMM CORP
Publication Date
2017-09-29

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention discloses a real-time mining method and device based on distributed data. The method comprises the steps that centralized serial data is decomposed into executable parallelly-operated data; when the executable parallelly-operated data is accumulated to reach a predetermined quantity, and data modeling is performed according to a distributed algorithm based on a memory to obtain a data model; processing is performed according to the data model and auxiliary data to obtain a data processing result.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The invention relates to mining technology, in particular to a real-time mining method and device based on distributed data. Background technique

[0002] Existing data mining platforms basically adopt the client / server (C / S) architecture, using a minicomputer with excellent performance as the server and an ordinary PC as the client. The main job of the server is to do calculations, including operations such as Extract-Transform-Load (ETL, Extract-Transform-Load), algorithmic operations, scoring, etc., and the client is mainly to do preliminary data processing and display functions. A more common method is to divide a minicomputer into a partition, including CPU, memory and disk array, as a server, and use an ordinary PC or notebook as a client.

[0003] This model has encountered great challenges in the era of big data. First of all, due to the high price of minicomputers, many companies have begun to go to IOE and rarely buy minicomputers. The abo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More