Parallel processing method for industrial big data heterogeneous data

A parallel processing, heterogeneous data technology, applied in the direction of digital data processing, special data processing applications, database management systems, etc., can solve problems such as weak unstructured data processing capabilities, and ensure reliability and scalability. , the effect of easy operation and maintenance and control

Inactive Publication Date: 2020-05-12
济宁昊瀛天成大数据信息技术有限公司
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] Traditional data warehouses are more capable of processing structured data and weaker in processing unstructured data. However, after ...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0026] A method for parallel processing of industrial big data heterogeneous data, comprising the following steps:

[0027] Step 1. Provide a database conversion tool, which can convert the data model defined in one database system into the data model in another database, and then import the data as needed. At this time, users can use their familiar database system and query language to achieve the goal of data sharing. The database conversion tool first performs type conversion, accesses the source database system, converts the data definition model of the source database into the data definition model of the target database, and then performs data reorganization, that is, loads the data in the source database system into the target database;

[0028] Step 2. After the data conversion, on the one hand, all the information that needs to be shared in the source database schema is converted to the destination database, and on the other hand, this conversion cannot contain redund...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a parallel processing method for industrial big data heterogeneous data. The method comprises the following steps: firstly, performing type conversion through a database conversion tool, accessing a source database system, and then performing data recombination; after data conversion is carried out, converting all information needing to be shared in the source database modeinto a target database, wherein the conversion cannot contain redundant associated information; adopting a heterogeneous database system constructed by a database conversion tool to realize combination and sharing of data information, equipment resources and human resources among different databases; adopting a distributed database system to solve the problem of data parallel processing; and finally, adopting a multi-database management system to operate and maintain a database system. The invention relates to the technical field of industrial big data. According to the parallel processing method for the industrial big data heterogeneous data, the problem of heterogeneous big data parallel processing in the existing industrial field is solved, and the reliability and expandability of dataprocessing are ensured.

Description

technical field [0001] The invention relates to the technical field of industrial big data, in particular to a parallel processing method for heterogeneous data of industrial big data. Background technique [0002] Traditional data warehouses are more capable of processing structured data and weaker in processing unstructured data. However, after big data lands in industrial enterprises, in-depth industry data mining is required, and the ability to process unstructured data is indispensable. [0003] In the process of enterprise informatization construction, due to the phased, technical and other economic and human factors in the construction of various business systems and the implementation of data management systems, the enterprise has accumulated a large number of businesses with different structures and different storage methods in the development process. Data, including the data management systems adopted, are also very different, ranging from simple databases to comp...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/25G06F16/2453G06F16/27
CPCG06F16/254G06F16/24532G06F16/27
Inventor 王昊瀛
Owner 济宁昊瀛天成大数据信息技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap