Method for describing multi-source heterogeneous data, analysis method and device

A multi-source heterogeneous data and analysis method technology, applied in the field of analysis methods and devices for multi-source heterogeneous data description, can solve the problems of high coupling between business applications and data sources, poor compatibility of multi-source heterogeneous data, etc., and achieve Improve development efficiency and improve compatibility

Active Publication Date: 2021-08-20
NARI TECH CO LTD +3
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The purpose of the present invention is to overcome the deficiencies in the prior art, provide a description method of multi-source heterogeneous data, solve the problem of high coupling between business applications and data sources, and the compatibility of business applications with multi-source heterogeneous data problems such as poor sex

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for describing multi-source heterogeneous data, analysis method and device
  • Method for describing multi-source heterogeneous data, analysis method and device
  • Method for describing multi-source heterogeneous data, analysis method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0071] A description method for multi-source heterogeneous data in the field of power grid regulation and control of the present invention, see figure 1 shown, including the following steps:

[0072] Step S1: By describing the data source type, data source name, and data source version information of multi-source heterogeneous data, a data source information description item is formed.

[0073] The data source may be a database, or any system platform that provides data, which is not limited. Such as figure 1 As shown, business applications such as big data analysis and mining can obtain multi-source heterogeneous data from the database through the data read-write service for front-end display and data analysis processing, and can also write the data to be stored into the corresponding database through the data read-write service, and then Realize data exchange and sharing.

[0074] In this embodiment, it is assumed that the source of multi-source heterogeneous data in the ...

Embodiment 2

[0182] Based on the same inventive concept as in Embodiment 1, a device for describing multi-source heterogeneous data according to the present invention, the device specifically includes the following modules:

[0183] Module M1: Generation of multi-source heterogeneous data description format, converting data from heterogeneous data sources into multi-source heterogeneous data description format.

[0184] The M1 module includes the following modules:

[0185] Module M101: data source information processing sub-module, generating data source type, data source name, and data source version information;

[0186] Module M102: metadata information processing sub-module, obtains the data interactive encoding format, describes the name and type of each attribute in the data in a fixed format, and counts the number of data attributes;

[0187] Module M103: Cell translation sub-module, which reads the value according to the attribute type of the data and translates it into a specified...

Embodiment 3

[0200] Based on the same inventive concept as in Embodiment 1, a multi-source heterogeneous data description analysis device of the present invention includes:

[0201] Module M2: Analysis and utilization of multi-source heterogeneous data description format, parsing multi-source heterogeneous data description format data and converting it into several entity class objects.

[0202] The M2 module includes the following modules:

[0203] Module M201: verification sub-module, which verifies the integrity and accuracy of multi-source heterogeneous data description format data;

[0204] Module M202: the data source information acquisition sub-module, which analyzes the data source information description items in the multi-source heterogeneous data description format, and generates data source information.

[0205] Module M203: Entity class generation sub-module, analyze metadata information to obtain the names and types of all attributes, and dynamically generate entity classes....

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for describing multi-source heterogeneous data, which comprises the following steps of describing data source information of the multi-source heterogeneous data to form a data source information description item; describing metadata information of the multi-source heterogeneous data, and forming metadata information description items; describing data of the multi-source heterogeneous data to form a multi-dimensional data description area; and sequentially combining the data source information description item, the metadata information description item and the multi-dimensional data description area to obtain a complete multi-source heterogeneous data description. According to the multi-source heterogeneous data description method, self-description, self-check and expandability of the multi-source heterogeneous data description method are achieved by describing data source information and metadata information; multi-level nested complex data structure storage is supported through a multi-dimensional data grid and a hierarchical description method.

Description

technical field [0001] The invention belongs to the technical field of electric power control, and specifically relates to a description method and device for multi-source heterogeneous data in the field of power grid control, and also relates to an analysis method and device for describing multi-source heterogeneous data generated by the above description method. Background technique [0002] With the rapid expansion of the smart grid construction and the business scope of the power grid regulation system, the number of data sources has increased, the types of data have been diverse, and the scale of data has increased sharply. The power industry has entered the era of big data. The application prospect of electric power big data is broad, but it faces problems such as scattered data, multiple types of data sources, and inconsistent data structures. [0003] In the power dispatching control system, business applications in the field of power grid control aim at data stored ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/28G06F16/22
CPCG06F16/283G06F16/22Y04S10/50
Inventor 沈嘉灵刘金波张伟万雄蔡宇孙广辉习新魁王亚军邹乐翟明玉李昊季学纯张珂珩陈子韵王宇冬
Owner NARI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products