A data processing method, device, system, equipment and storage medium

A data processing and data technology, applied in the field of data management, can solve the problems of low quantity and quality of data resource catalogues, large investment in government data resource collation, and error-prone manual intervention methods, so as to achieve less manual intervention and extensive cooperation. and synergistic, efficient effect

Active Publication Date: 2021-03-05
杭州城市大数据运营有限公司 +2
View PDF10 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The purpose of the embodiments of the present invention is to provide a data processing method, device, system, equipment, and storage medium, aiming at solving the problem that in the prior art, the government affairs data resource sorting investment is relatively large, and the manual intervention method is relatively error-prone, and the formed data The problem of low quantity and quality of resource catalog

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data processing method, device, system, equipment and storage medium
  • A data processing method, device, system, equipment and storage medium
  • A data processing method, device, system, equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0043] Such as figure 1 As shown, in the embodiment of the present invention, a data processing method is proposed, and this embodiment is mainly described by taking the method applied to a terminal as an example. A data processing method may specifically include the following steps:

[0044] Step S110, acquiring target data of the target database, the target data includes but not limited to database metadata information and database log information;

[0045] Step S120, call the preset intelligent analysis algorithm engine to process the target data according to the preset scheduling task, and generate a data portrait;

[0046] In step S130, the target data is arranged into a data directory according to the data portrait, and a target data directory is generated.

[0047] In the embodiment of the present invention, the target database may include various commonly used database types supporting mysql, oracle, sqlserver, rds, etc., and various heterogeneous data corresponding ...

Embodiment 2

[0070] Such as Figure 5 As shown, in the embodiment of the present invention, a data processing device is provided, and the data processing device can be integrated into the above-mentioned terminal or computer equipment, and can specifically include:

[0071] A data acquisition module 510, configured to acquire target data of the target database, the target data including but not limited to database metadata information and database log information;

[0072] The data processing module 520 is used to call the preset intelligent analysis algorithm engine to process the target data according to the preset scheduling task, and generate a data portrait;

[0073] The directory generation module 530 arranges the target data into a data directory according to the data image, and generates a target data directory.

[0074] In the embodiment of the present invention, the target database may include various commonly used database types supporting mysql, oracle, sqlserver, rds, etc., a...

Embodiment 3

[0097] Such as Figure 6 As shown, in an embodiment of the present invention, a data processing system is provided, including:

[0098] Government affairs data platform 610, on which government affairs data information is stored;

[0099] Data processing center 620, the data processing center includes the data processing device in the embodiment, used to obtain the target data from the government data platform 610, and execute the steps of the data processing method in the embodiment to process the target data and generate the target data directory.

[0100] In the embodiment of the present invention, the government affairs data platform 610 may be a data platform set up for different departments of the government affairs department. Departments can independently set up corresponding data platforms to record their own business data. The above are examples only.

[0101] A data processing system provided in the embodiment of the present invention performs automatic and intel...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to the technical field of data management, and in particular relates to a data processing method, device, system, equipment and storage medium. The data processing method is to obtain the target data of the target database; call the preset intelligent analysis algorithm engine to process the target data according to the preset scheduling task, and generate a data portrait; store the target data in the data directory according to the data portrait Orchestrate and generate the target data directory. A data processing method provided in an embodiment of the present invention performs automatic and intelligent data analysis on database data, analyzes data portraits, arranges these data, and forms a data directory. The entire process requires less manual intervention, high efficiency, and high-quality catalogs, which facilitate government departments to more accurately understand the core business of each party, carry out targeted data sharing, and carry out more extensive cooperation and collaboration.

Description

technical field [0001] The invention belongs to the technical field of data management, and in particular relates to a data processing method, device, system, equipment and storage medium. Background technique [0002] In the process of the government's digital transformation, integrate government data resources, find out the "data background", rationally develop and utilize data resources, and improve the data sharing capabilities between government departments. These measures can effectively support different business conditions among government departments. Online collaboration and support for assetization and listing of government data to meet the needs of comprehensive sharing, development and use of data resources. [0003] However, there are currently information barriers between government departments, insufficient manpower investment, and the low number of service-oriented and cataloged government data resources, which makes it difficult to widely carry out and coor...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/248G06F16/2457G06F16/2458
CPCG06F16/2457G06F16/2458G06F16/248
Inventor 高明鹏王崯黄国乔誉彭程远朱享军唐拓
Owner 杭州城市大数据运营有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap