Government data processing method and device

A data and government technology, applied in the database field, can solve problems such as waste of resources, large demand for resources, large amount of data, etc., and achieve the effect of improving implementability

Pending Publication Date: 2022-07-29
国泰新点软件股份有限公司
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] This application provides a method and device for processing government data, which can solve the problem of waste of resources caused by the large amount of data due to the large demand for resources when Hadoop is used to process government data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Government data processing method and device
  • Government data processing method and device
  • Government data processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0059] The specific embodiments of the present application will be described in further detail below with reference to the accompanying drawings and embodiments. The following examples are used to illustrate the present application, but are not intended to limit the scope of the present application.

[0060] First, some terms involved in this application are introduced.

[0061] Metadata: data used to describe data, such as "age", "height", these data are data describing a person, these data are metadata, that is, the smallest granularity data.

[0062] DorisDB: Redefines the MPP distributed architecture, the cluster can be extended to hundreds of nodes, supports PB-level data scale, and is an enterprise-level analytical database that can be elastically expanded online under the scale of big data.

[0063] DorisDB's overall architecture reference figure 1As shown, the overall architecture of DorisDB adopts Massively Parallel Processing (MPP) architecture. MPP distributes tas...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a government data processing method and device, and belongs to the technical field of databases. The method comprises the steps that metadata of all departments of a government is collected, and a department resource library is obtained; accessing the department resource library to a number bin source pasting layer of the DorisDB; associating the data bin source layer metadata with data elements to obtain a standard table; according to a preset data cleaning rule, performing data cleaning on the source-attached layer table data to obtain cleaned data; writing correct data in the cleaned data into a standard table; creating a data fusion table, and fusing the cleaned data into the data fusion table; the problem of resource waste when government data is processed by using Hadoop can be solved; the DorisDB is used for replacing traditional Hadoop to serve as a data bin, the whole process of large-data-volume data governance is achieved, the data query performance is improved while the server resource requirement is lowered, and the feasibility of small and medium-sized data governance projects is improved.

Description

【Technical field】 [0001] The present application relates to a method and device for processing government data, belonging to the technical field of databases. 【Background technique】 [0002] With the in-depth application of big data, government data resources have been paid more and more attention. The application of the Internet and big data technology has continuously created and strengthened the management requirements for various types of data, including government business data. From "document management" to "data governance" has become an inevitable requirement to modernize the governance system and governance capabilities. [0003] Existing government data processing methods include: using Hadoop as the underlying architecture. However, this architecture can support large and medium-sized governments well, but for districts and counties and small prefecture-level governments, it will have the following problems: [0004] 1. The demand for resources is large; [000...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/215G06F16/242G06F16/28
CPCG06F16/215G06F16/2433G06F16/283
Inventor 包永廉周韬季振宇沈飞陆莉军
Owner 国泰新点软件股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap