Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Big data flow type cluster processing system and method for carrying out clustering as required

A data streaming and processing system technology, applied in the field of data processing

Inactive Publication Date: 2018-05-18
柳州健鱼科技有限公司
View PDF1 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The purpose of the present invention is to address the above problems, to propose an on-demand clustering big data stream clustering processing system and method, in order to enhance the scalability and sensitivity of the system, and efficiently solve the problems of data streams in the big data environment. Advantages of Quickly Processed Issues

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] Preferred embodiments of the present invention are described below, and it should be understood that the preferred embodiments described here are only used to illustrate and explain the present invention, and are not intended to limit the present invention.

[0025] An on-demand clustering big data streaming clustering processing system mainly includes:

[0026] A data processing module, a statistical module and a clustering module, the output terminal of the data processing is connected to the first input terminal of the clustering module through the statistical module, and the clustering module is connected to the data processing module.

[0027] The system also includes a resource monitoring module, the first output of the resource monitoring module is connected to the input of the data processing module, and the second output of the resource monitoring module is connected to the second input of the clustering module .

[0028] The data processing module includes a ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a big data flow type cluster processing system for carrying out clustering as required. The system mainly comprises a data processing module, a statistical module and a clustering module; an output end of the data processing module is connected with a first input end of the clustering module through the statistical module; and the clustering module is connected with the data processing module. The big data flow type cluster processing system for carrying out clustering as required is capable of effectively utilizing existing traditional clustering algorithms, and enhancing the expansibility and sensitivity of the system, so as to effectively solve the rapid data flow processing problem under big data environment.

Description

technical field [0001] The present invention relates to the technical field of data processing, and in particular, to an on-demand clustering big data streaming clustering processing system and method. Background technique [0002] Big Data: Refers to the amount of data involved that is too large to be captured, managed, processed, and organized within a reasonable period of time through current mainstream software tools to help enterprises make more positive business decisions. The 4V characteristics of big data: Volume, Velocity, Variety, Veracity. [0003] Data Streams: A data stream is a sequence of data that arrives in a certain order and is only added with a timestamp. For an ordered data point (x1,x2,...,xn) must be accessed in sequence or read very few times, the sequential reading of data sequence data is also called linear scanning or one-time processing . Data Mining: Refers to the non-trivial process of revealing implicit, previously unknown and potentially va...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/25G06F16/24568G06F16/285
Inventor 李炜
Owner 柳州健鱼科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com