Multi-data-source dynamic data synchronous treatment method and system based on Internet supervision

A multi-data source, dynamic data technology, applied in database management systems, data processing applications, electronic digital data processing, etc.

Pending Publication Date: 2021-06-08
SHANDONG LANGCHAO YUNTOU INFORMATION TECH CO LTD
View PDF6 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The technical task of the present invention is to provide a multi-data source dynamic data synchronization management method and system based on Internet supervision to solve the problem of how to help users quickly build a big data processing and analysis process and realize low-cost and fast construction of a data center

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-data-source dynamic data synchronous treatment method and system based on Internet supervision

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0096] as attached figure 1 As shown, the multi-data source dynamic data synchronization management method based on Internet supervision of the present invention, the method integrates the data trends of various structured data, semi-structured data and unstructured data, and provides a one-stop Advanced data development environment, visual process design, rich data types and intelligent task monitoring enable users to quickly build big data processing and analysis processes and quickly build data centers at low cost; the details are as follows:

[0097] S1. Data source management: manage data connection services;

[0098] S2. Data governance: data process design, data process debugging, data process monitoring, and data process operation and maintenance, each data processing process is defined as a data flow job, and the data processing process is managed through the data flow job;

[0099] S3. Template management: process migration and reuse, providing functions of uploadin...

Embodiment 2

[0163] The multi-data source dynamic data synchronization management system based on Internet supervision of the present invention, the system includes:

[0164] A data source management unit, configured to manage data connection services;

[0165] Data governance unit, used for data governance, defines each data processing process as a data flow job, and manages the data processing process through data flow jobs; the data governance unit includes data process design sub-unit, data process debugging sub-unit, data process monitoring Subunits and data flow operation and maintenance subunits; template management unit, used for process migration and reuse, providing upload, delete and download functions of data flow templates.

[0166] The data flow design subunit in this embodiment includes:

[0167] The process grouping module is used to provide the functions of adding, deleting, modifying groups, starting and stopping process design, and classifying data flow operations hiera...

Embodiment 3

[0176] The embodiment of the present invention also provides a computer-readable storage medium, in which a plurality of instructions are stored, and the instructions are loaded by the processor, so that the processor executes the dynamic data synchronization of multiple data sources based on Internet supervision in any embodiment of the present invention Governance method. Specifically, a system or device equipped with a storage medium may be provided, on which the software program code for realizing the functions of any of the above embodiments is stored, and the computer (or CPU or MPU of the system or device) ) to read and execute the program code stored in the storage medium.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a multi-data-source dynamic data synchronous treatment method and system based on Internet supervision, belongs to the field of Internet + supervision, and aims to solve the technical problem of how to help a user to quickly construct a big data processing analysis process and realize low-cost quick construction of a data center. According to the technical scheme, data trends of various structured data, semi-structured data and unstructured data are fused, and a one-stop data development environment, visual process design, rich data types and intelligent task monitoring are provided; a user can quickly construct a big data processing and analysis process and quickly construct a data center at low cost. The method specifically comprises the following steps: data source management: managing a data connection service; data flow design: defining each data processing flow as a data flow job, and managing the data processing flows through the data flow jobs; and template management: carrying out process migration and reuse.

Description

technical field [0001] The invention relates to the field of Internet plus supervision, in particular to a method and system for synchronous management of multi-data source dynamic data based on Internet supervision. Background technique [0002] At present, the new generation of information technology is rapidly changing the production and lifestyle of society. Data has become the core asset of organizations and enterprises. The digital economy is driving a new round of global change. The digital transformation of enterprises has become a new trend in the era of big data. trend. [0003] The deep integration of the Internet, big data, artificial intelligence and the real economy promotes the integration and innovation of all walks of life. In the era of converged innovation, making full use of data association, intersection and fusion to maximize the value of big data has become the key to digital transformation in all walks of life. In this context, cross-domain, cross-i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/21G06F16/215G06F16/25G06Q10/10
CPCG06F16/21G06F16/215G06F16/254G06Q10/10
Inventor 侯居永栾丽丽张雷陈兆亮
Owner SHANDONG LANGCHAO YUNTOU INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap