Big data processing method based on granularity calculation in cloud environment

A technology of big data processing and cloud environment, applied in the direction of fuzzy logic-based systems, electrical components, logic circuits, etc., to achieve the effect of improving processing efficiency, improving processing efficiency, and improving efficiency

Inactive Publication Date: 2020-04-07
UNIV OF ELECTRONICS SCI & TECH OF CHINA
View PDF0 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This project focuses on the variable precision fuzzy rough set model, the roughness measurement method based on this model, and the massive data parallel attribute reduction acceleration algorit

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Big data processing method based on granularity calculation in cloud environment
  • Big data processing method based on granularity calculation in cloud environment
  • Big data processing method based on granularity calculation in cloud environment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0082] According to the characteristics of big data, the commonly used big data problem granular computing solution framework is as follows: figure 2 shown. The basic process of big data processing can be summarized as the following seven steps:

[0083] Step 1. Use data filtering and data integration to convert, extract, and granulate the diverse and heterogeneous data in distributed storage to obtain a more standardized data table and eliminate the uncertainty.

[0084] Step 2. For the problem, introduce specific models and technologies in granular computing to granulate the original data into granules with appropriate granularity, reduce the data scale, and construct the corresponding granular layer and the structure on each granular layer.

[0085] Step 3. Under the guidance of other machine learning methods, perform data mining or machine learning on the information granules.

[0086] Step 4. Transform the method used into a distributed, online incremental learning ver...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a big data method based on granularity calculation in a cloud environment. The method comprises the following steps: (1) establishing a variable-precision fuzzy rough set modeloriented to hybrid data analysis; an extended ziarko variable-precision rough set thought is combined with a fuzzy rough set theory; wherein the innovation point of the variable-precision fuzzy roughset model is a determination rule of upper and lower approximate sets, information table elements are considered in the approximation of the upper and lower sets to evaluate the inclusion degree of the decision approximate set, and the elements are included in the approximate set with high enough inclusion degree; (2) a data roughness measurement method based on random entropy is provided, and aneffective roughness measurement technology is convenient to research; and (3) designing a mass data parallel attribute reduction acceleration algorithm based on granular calculation, fully combiningbig data analysis and processing with a cloud calculation platform, and adopting a model-data parallel research method to solve the problem of mass data and high-dimensional complex data attribute reduction.

Description

technical field [0001] Based on the research on the basic principles and applications of granular computing, the present invention systematically and comprehensively analyzes and summarizes the status quo of big data processing, and uses the cloud platform as the basis to introduce the "divide and conquer" feature of granular computing to reduce big data processing. In order to study the complexity of the three key technologies of big data processing, the main work is divided into the following three aspects: establish a variable precision fuzzy rough set model for mixed data, propose a measurement method for data roughness, and propose a granularity-based Computational massive data parallel attribute reduction acceleration algorithm. Background technique [0002] With the rapid development and popularization of computer and information technology, the scale of industrial application systems has expanded rapidly, and the data generated by industrial applications has grown ex...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06N7/02
CPCG06N7/023
Inventor 惠孛郑莉华陈佳黎明徐嘉莉
Owner UNIV OF ELECTRONICS SCI & TECH OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap