A Method for Fusing Heterogeneous Data to Facilitate Rapid Big Data Analysis

A technology of heterogeneous data and big data, which is applied in the field of big data and data integration, can solve the problems of not being able to remember the standard, no standard of data, and insufficient standard setting, etc., and achieve the effect of easy memory and fast SQL statistical analysis

Active Publication Date: 2021-07-13
党玉龙
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The purpose of the present invention is to overcome the defects and insufficiencies of the prior art, and provide a method for merging heterogeneous data to facilitate fast big data analysis that solves the problems of data without standards, standards that cannot be ordered, standards that cannot be remembered, and standards that cannot be combined

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Method for Fusing Heterogeneous Data to Facilitate Rapid Big Data Analysis
  • A Method for Fusing Heterogeneous Data to Facilitate Rapid Big Data Analysis

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0014] Such as figure 1 and figure 2 As shown, a method for fusing heterogeneous data to facilitate rapid big data analysis includes the following steps:

[0015] Step 1: Design a universal table that is compatible and merges all data. The fields are designed as follows (all character types unless otherwise specified): (1) Data type, number name, number, number 2, time (date type), time 2 (date type), location, location 2, as the core fields of the table; (2) multiple key fields can be defined: key, key 2, key 3, key 4, key 5 (digital decimal type), key 6 (digital decimal type), key 7 (date type), used to realize SQL retrieval of structured data outside the core field; (3) two more fields can be defined: field name collection, field content collection, the former is used to illustrate this table The meanings of all the fields in and the remaining fields in the original table, the latter is used to fill in the values ​​corresponding to the former fields one by one (the same ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a method for fusing heterogeneous data to facilitate rapid big data analysis. The method designs a method that includes 1 data type field, 2 unique number fields, 2 time fields, 2 location fields, and 1 field containing A field with all field names, a field containing all field values, and a table with several key fields. By creating the table in advance in a database with big data processing capabilities, all collected data of any kind can be sorted out. Then import the table; this method can not only integrate various types of data tables, even data with non-uniform or non-standard standards, but also has the basic functions of a graph database, and is also easy to remember, without having to look through the data Thousands of data standards enable fast SQL statistical analysis, and will always be at the forefront in the era of big data where opportunities are fleeting.

Description

technical field [0001] The invention belongs to the field of big data and data integration, and in particular relates to a method for fusing heterogeneous data to facilitate fast big data analysis. Background technique [0002] With the advent of the era of big data, various industries, especially government agencies, integrate more and more types of data, and some data do not even have standards. The usual solution is to spend a lot of energy to formulate standards, but even so, the following problems still exist : (1) Data without a well-defined data standard cannot be stored immediately and cannot be used; (2) The same type of data has different standards due to different sources, so it cannot be stored immediately and cannot be used; (3) due to the type of data Too many, more fields, and different types of fields, so data analysts will inevitably be unable to remember the huge and complex data tables and their fields, and in emergency events, they cannot quickly analyze ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/22G06F16/245
CPCG06F16/2282G06F16/245
Inventor 党玉龙
Owner 党玉龙
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap