Industrial big data multidimensional analysis and visualization method based on JSON document structure

A technology of multi-dimensional analysis and document structure, applied in structured data retrieval, structured data browsing, database indexing, etc., can solve the problem of slow query speed of traditional data warehouse, complex analysis and mining of industrial big data, and representation of multi-source heterogeneous industrial data. data and other issues to achieve the effect of efficient storage

Active Publication Date: 2019-12-27
FUDAN UNIV
View PDF10 Cites 60 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004]Industrial data itself has complex relationships, coupled with the multi-source and heterogeneous characteristics of industrial data, if you use a relational database as a data warehouse, you cannot pass a complete The object represents...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Industrial big data multidimensional analysis and visualization method based on JSON document structure
  • Industrial big data multidimensional analysis and visualization method based on JSON document structure
  • Industrial big data multidimensional analysis and visualization method based on JSON document structure

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0079] The content of the invention of the present invention will be further elaborated below in conjunction with the implementation examples.

[0080](1) Industrial data source configuration: Industrial big data includes various multi-source heterogeneous data types, such as traditional relational database table data, log file data, time series file data, etc. First, configure the information of various data sources through JSON configuration files for centralized management. For example, the data in the electronics industry includes test procedures such as SPI, AOI, FT, FIX and other operations, including detailed data such as workorder and process_rec. First, we configure the data source and data location according to the database information, and the definition of the merged data set is as follows Figure 10 shown.

[0081] (2) Definition of data conversion operations: For the same data, the business system and the analysis system may have different ways of defining it. ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to the technical field of industrial big data application, and particularly relates to an industrial big data multidimensional analysis and visualization method based on a JSON document structure. The method comprises the following steps: by taking JSON as a basic carrier of data, constructing an industrial data mart in parallel by utilizing Spark and ElasticSearch through configuring a relational database and a file system data source and defining data conversion and data cleaning operations; configuring an overall process of data analysis in a graphical mode to construct an analysis data set of a multi-dimensional structure, and repeated association operation on massive data being avoided; and for a specific data analysis scene, customizing each dimension calculation index of the data analysis report in a visual dragging mode based on a pre-constructed multi-dimensional analysis data set, and generating an interactive graphic analysis report. According to the method, the JSON document format is used as a carrier of basic data, and the advantages of the JSON document format in storage and analysis are utilized, so that multi-dimensional analysis structure modeling and user-defined interactive analysis are more convenient and efficient.

Description

technical field [0001] The invention belongs to the technical field of industrial big data, and in particular relates to a method for multidimensional analysis and visualization of industrial big data based on a JSON document structure. Background technique [0002] With the deep integration of informatization and industrialization, informatization and intelligent technologies have gradually penetrated into all aspects of industrial enterprises. Compared with the Internet industry, the massive production and manufacturing data accumulated by industrial enterprises has higher value density and higher mining value. Therefore, industrial big data is the core advantage and competitiveness of industrial enterprises in the future global competition. [0003] The establishment of a data model usually depends on its usage scenario: for purely storing data or for data analysis. For general business databases, the data model is used to store data generated during system operation. It...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/215G06F16/22G06F16/25G06F16/26G06F16/28
CPCG06F16/215G06F16/2228G06F16/258G06F16/26G06F16/283
Inventor 李敏波许鑫星董伟伟
Owner FUDAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap