Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Big data analysis and extraction method

An extraction method and big data technology, applied in the field of big data analysis, can solve the problems of small number of rule sets, difficult to mine various types of data, and insufficient utilization, etc., to achieve the effect of improving performance

Inactive Publication Date: 2015-07-08
成都博元时代软件有限公司
View PDF3 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in the actual mining process, due to the large scale of mining rule sets and high correlation dimensions, the mining calculations on large-scale data sets are large and inefficient.
Moreover, most of the existing technologies optimize indexing for a single type of data set, and the number of rule sets is relatively small, and the relationship between different attributes in multiple types of data sets is not fully utilized, so it is difficult to directly apply to multiple types of data sets. In data mining, it directly affects the mining performance

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Big data analysis and extraction method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0013] The following and accompanying appendices illustrating the principles of the invention Figure 1 A detailed description of one or more embodiments of the invention is provided together. The invention is described in connection with such embodiments, but the invention is not limited to any embodiment. The scope of the invention is limited only by the claims and the invention encompasses numerous alternatives, modifications and equivalents. In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention. These details are provided for the purpose of example and the invention may be practiced according to the claims without some or all of these specific details.

[0014] One aspect of the present invention provides a big data analysis extraction method. figure 1 It is a flowchart of a big data analysis and extraction method according to an embodiment of the present invention.

[0015] The prese...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a big data analysis and extraction method. The method comprises the steps that attributes included in a data set are divided into a non-continuous type and a continuous type according to the characteristics of data types in the data set, two stages of indexes are built on the basis of multi-dimension indexes, and the data set is mined and matched in real time through the graded indexes. According to the data analysis and extraction method, performance is greatly improved under the conditions that mining accuracy is not reduced by a data matching method according to the built graded indexes.

Description

technical field [0001] The invention relates to big data analysis, in particular to a big data analysis and extraction method. Background technique [0002] Using big data processing to realize online mining of operational data of large enterprises has broad application prospects. For big data environments, datasets containing different media formats. By generating indexes for mining rules, the discrimination speed of rule calculation can be improved, and the efficiency of online mining of data sets can be greatly improved. The dataset contains meta information of different attributes such as text, pictures, audio and video, etc., and there are large differences among attributes. However, in the actual mining process, due to the large scale of mining rule sets and high correlation dimensions, mining on large-scale data sets is computationally intensive and inefficient. Moreover, most of the existing technologies optimize indexing for a single type of data set, and the num...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 杨立波
Owner 成都博元时代软件有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products