Data source data automatic modeling method

An automatic modeling and data source technology, applied in the direction of electrical digital data processing, special data processing applications, instruments, etc., can solve the problems of cumbersome and complex data processing methods, and achieve the effect of convenient data modeling

Active Publication Date: 2018-07-17
SUZHOU GUOYUN DATA GOD TECH CO LTD
View PDF5 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

When users process data in trillions of hours, such data processing methods are very complicated and cumbersome

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data source data automatic modeling method
  • Data source data automatic modeling method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0022] Such as figure 1 As shown, a method for automatically modeling and displaying complex data source data, the specific steps are as follows:

[0023] A. Multiple data source access and table structure analysis

[0024] Access the data in different data sources of the user, analyze and resolve the table structure of all tables in each data source. The data source can be a relational database such as mysql, oracle, DB2, etc. For example, a user has a mysql database, which contains two tables A and B. Table A contains A1, A2, A3...A10, 10 fields, and B The table contains three fields B1, B2, and B3. In this step, the two tables A and B in the mysql database and all the fields (including field types) in each table can be analyzed to obtain the table structure of the two tables A and B by using SQL syntax to obtain metadata of the data source. A table contains A1, A2, A3...A10, 10 fields, B table contains B1, B2, B3 three fields, and the type of each field, the type can be ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an automatic modeling method for data of data sources. The method comprises following steps: accessing multiple data sources and analyzing table structures; accessing data of different data sources and analyzing table structures of all tables of all data sources; identifying business objects of table structures in the data sources; traversing all the tables of the data sources, extracting attribute lists needed modeling, setting attributes in all the attribute lists with names for business objects, types for business objects and clustering modes for business objects; merging business objects in similar terms; summarizing attributes set with business objects and clustering similar terms; analyzing business objects and modeling in order to generate a modeling structure set; and modeling attributes set with business objects according to setting parameters and modeling attributes not set with business objects according to a modeling rule. The modeling rule comprises: numeric attributes marked as metric; non-numeric attributes marked as dimensionality; and business objects in similar terms are merged. Data modeling operation can be conveniently performed, which is beneficial for analyses of mass data of users.

Description

technical field [0001] The invention relates to an automatic modeling method for data source data, in particular to a method for automatically modeling and displaying complex data source data. Background technique [0002] Many data sources that store complex data, such as social databases, e-commerce databases, and human genetic databases, are based on complex multi-dimensional, large-scale data sets. For the processing of this kind of data set, there is a huge challenge how to discover the hidden data structure, data association relationship, and finally extract meaningful data from the massive data. Generally speaking, it is not realistic for analysts to extract meaningful data from such a huge amount of data without using any tools. Usually analysts will use various analysis tools to help extract some meaningful data. But relying on existing analytics tools to model and represent data from complex data sources requires constant human-computer interaction. Users need t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30
CPCG06F16/9017
Inventor 马晓东马小东谢晓芳王鹏
Owner SUZHOU GUOYUN DATA GOD TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap