Processing method and system of big data

A processing method and data processing technology, applied in the field of big data, can solve problems such as the inability to exert the value of big data information, no solution proposed, and limited processing of association mining.

Inactive Publication Date: 2016-06-15
DAWNING INFORMATION IND BEIJING
View PDF5 Cites 25 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Due to the development of industry applications, many technologies are limited to data in a certain field. When various data are collected, the association mining processing of data between different data sources is

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Processing method and system of big data
  • Processing method and system of big data
  • Processing method and system of big data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. All other embodiments obtained by persons of ordinary skill in the art based on the embodiments of the present invention belong to the protection scope of the present invention.

[0038] According to an embodiment of the present invention, a method for processing big data is provided.

[0039] Such as figure 1 As shown, the processing method according to the embodiment of the present invention includes:

[0040] Step S101, extracting big data from multiple data sources, and performing regular transformation on the big data;

[0041] Step S103, performing data processing on the big data after rule conversion;

[0042] Step S105, establishing a database according to t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention discloses a processing method and system of big data. The method comprises the steps of exacting big data from a plurality of data sources, and performing rule conversion on the big data; performing data processing on the big data after rule conversion; and establishing a database according to the big data after data processing. Various information is analyzed from multi-source heterogeneous data and the database is established, and therefore data support is provided for various data analysis, behavior analysis, user figure analysis and relation discovery.

Description

technical field [0001] The present invention relates to the field of big data, in particular to a method and system for processing big data. Background technique [0002] In the big data application system, currently many industries, especially the field of intelligence analysis, will obtain different data from multiple data sources, including various types of information from industry and commerce, civil aviation, immigration, household registration, etc., as well as from various Registration information of portal sites (such as group buying sites, recruitment sites, social networking sites) and various types of data obtained through web crawlers; data types include structured data, semi-structured data, and unstructured data; data content formats are messy, Combination of fact and fiction. Therefore, it is necessary to use big data analysis technology to mine useful value information from massive multi-source heterogeneous data to provide data support for various analysis...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/214G06F16/258
Inventor 惠润海郭庆张建磊谢莹莹宋怀明
Owner DAWNING INFORMATION IND BEIJING
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products