Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Emergency management service data cleaning method and system, terminal and readable storage medium

A business data, data cleaning technology

Pending Publication Date: 2020-11-17
深圳市安亿通科技发展有限公司
View PDF4 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Due to data entry errors, merging or migration of data sources with different representation methods, etc., it is inevitable that the system will have many situations such as redundant data, missing data, uncertain data, and inconsistent data. Such data is called "dirty data". Seriously affect the efficiency of data utilization and the quality of decision-making

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Emergency management service data cleaning method and system, terminal and readable storage medium
  • Emergency management service data cleaning method and system, terminal and readable storage medium
  • Emergency management service data cleaning method and system, terminal and readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0052] Please refer to figure 1 , this embodiment proposes a method for cleaning emergency management business data, which can be used for data cleaning of business data. Through this method, the accuracy of data cleaning can be improved, and the cleaning content can be more comprehensive. The method will be described in detail below.

[0053] S110, when the data cleaning task is started, acquire cleaning configuration data of items to be cleaned according to the data cleaning task, wherein the cleaning configuration data includes target business fields and corresponding business attributes.

[0054] Exemplarily, the data cleaning task includes at least one item to be cleaned, and each item to be cleaned is configured with a corresponding business attribute. Wherein, the business attribute can be used to determine the type of the cleaning rule for the data to be cleaned. For example, in one embodiment, the type of the business attribute may include, but not limited to, non-r...

Embodiment 2

[0092] Please refer to Figure 5 , based on the above-mentioned embodiment 1, this embodiment proposes an emergency management business data cleaning system. Exemplarily, the system mainly includes a task configuration module, a task cleaning module and a visual display module. Each module will be described below.

[0093] The task configuration module is configured to provide a data cleaning configuration interface, and generate a data cleaning task when receiving the cleaning configuration data input by the user in the data cleaning configuration interface.

[0094] Exemplarily, as Image 6 As shown, the cleaning configuration interface may include, but is not limited to, the name of the item to be cleaned, the cleaning method, the first data interface, the second data interface, and related configuration items of the cleaning result. For example, the cleaning method may include using oracle functions or interfaces such as big data to perform cleaning. Among them, the orac...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides an emergency management service data cleaning method and system, a terminal and a readable storage medium, and the method comprises the steps: obtaining the cleaning configuration data of a to-be-cleaned item when a data cleaning task is started, and enabling the cleaning configuration data to comprise a target service field and a corresponding service attribute; extracting corresponding emergency management service data from a database according to the target service field, importing the emergency management service data into a data warehouse, and performing data preprocessing to obtain to-be-cleaned data; determining a corresponding cleaning rule according to the service attribute and performing data cleaning on to-be-cleaned data; and outputtinga data cleaning result and carrying out visual display. According to the technical scheme, emergency management service requirements are combined, corresponding cleaning rules are set for data with different service attributes, the cleaning content is richer and more comprehensive, the cleaning accuracy is higher, display is carried out through a visual interface, and the user experience is improved.

Description

technical field [0001] The present application relates to the technical field of data processing, and in particular to a method, system, terminal and readable storage medium for cleaning emergency management business data. Background technique [0002] With the rapid development of informatization and intelligence in the emergency management industry and the continuous improvement of the demand for business application refinement, the amount of data generated by emergency management departments at all levels and supervision objects has exploded. Facing the huge amount of data, how to dig out valuable information or knowledge from massive data and provide reference for decision makers has become an important issue that cannot be ignored. Due to data entry errors, merging or migration of data sources with different representation methods, etc., it is inevitable that the system will have many situations such as redundant data, missing data, uncertain data, and inconsistent data...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/215G06F16/2458G06F16/248G06F16/27G06F16/28
CPCG06F16/215G06F16/2471G06F16/248G06F16/27G06F16/283
Inventor 李莉王志刚周锟罗敏夏昕郭宇
Owner 深圳市安亿通科技发展有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products