Emergency management service data cleaning method and system, terminal and readable storage medium
What is Al technical title?
Al technical title is built by PatSnap Al team. It summarizes the technical point description of the patent document.
A business data, data cleaning technology
Pending Publication Date: 2020-11-17
深圳市安亿通科技发展有限公司
View PDF4 Cites 12 Cited by
Summary
Abstract
Description
Claims
Application Information
AI Technical Summary
This helps you quickly interpret patents by identifying the three key elements:
Problems solved by technology
Method used
Benefits of technology
Problems solved by technology
Due to data entry errors, merging or migration of data sources with different representation methods, etc., it is inevitable that the system will have many situations such as redundant data, missing data, uncertain data, and inconsistent data. Such data is called "dirty data". Seriously affect the efficiency of data utilization and the quality of decision-making
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more
Image
Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
Click on the blue label to locate the original text in one second.
Reading with bidirectional positioning of images and text.
Smart Image
Examples
Experimental program
Comparison scheme
Effect test
Embodiment 1
[0052] Please refer to figure 1 , this embodiment proposes a method for cleaning emergency management business data, which can be used for data cleaning of business data. Through this method, the accuracy of data cleaning can be improved, and the cleaning content can be more comprehensive. The method will be described in detail below.
[0053] S110, when the data cleaning task is started, acquire cleaning configuration data of items to be cleaned according to the data cleaning task, wherein the cleaning configuration data includes target business fields and corresponding business attributes.
[0054] Exemplarily, the data cleaning task includes at least one item to be cleaned, and each item to be cleaned is configured with a corresponding business attribute. Wherein, the business attribute can be used to determine the type of the cleaning rule for the data to be cleaned. For example, in one embodiment, the type of the business attribute may include, but not limited to, non-r...
Embodiment 2
[0092] Please refer to Figure 5 , based on the above-mentioned embodiment 1, this embodiment proposes an emergency management business data cleaning system. Exemplarily, the system mainly includes a task configuration module, a task cleaning module and a visual display module. Each module will be described below.
[0093] The task configuration module is configured to provide a data cleaning configuration interface, and generate a data cleaning task when receiving the cleaning configuration data input by the user in the data cleaning configuration interface.
[0094] Exemplarily, as Image 6 As shown, the cleaning configuration interface may include, but is not limited to, the name of the item to be cleaned, the cleaning method, the first data interface, the second data interface, and related configuration items of the cleaning result. For example, the cleaning method may include using oracle functions or interfaces such as big data to perform cleaning. Among them, the orac...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more
PUM
Login to view more
Abstract
The embodiment of the invention provides an emergency management service data cleaning method and system, a terminal and a readable storage medium, and the method comprises the steps: obtaining the cleaning configuration data of a to-be-cleaned item when a data cleaning task is started, and enabling the cleaning configuration data to comprise a target service field and a corresponding service attribute; extracting corresponding emergency management service data from a database according to the target service field, importing the emergency management service data into a data warehouse, and performing data preprocessing to obtain to-be-cleaned data; determining a corresponding cleaning rule according to the service attribute and performing data cleaning on to-be-cleaned data; and outputtinga data cleaning result and carrying out visual display. According to the technical scheme, emergency management service requirements are combined, corresponding cleaning rules are set for data with different service attributes, the cleaning content is richer and more comprehensive, the cleaning accuracy is higher, display is carried out through a visual interface, and the user experience is improved.
Description
technical field [0001] The present application relates to the technical field of data processing, and in particular to a method, system, terminal and readable storage medium for cleaning emergency management business data. Background technique [0002] With the rapid development of informatization and intelligence in the emergency management industry and the continuous improvement of the demand for business application refinement, the amount of data generated by emergency management departments at all levels and supervision objects has exploded. Facing the huge amount of data, how to dig out valuable information or knowledge from massive data and provide reference for decision makers has become an important issue that cannot be ignored. Due to data entry errors, merging or migration of data sources with different representation methods, etc., it is inevitable that the system will have many situations such as redundant data, missing data, uncertain data, and inconsistent data...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more
Application Information
Patent Timeline
Application Date:The date an application was filed.
Publication Date:The date a patent or application was officially published.
First Publication Date:The earliest publication date of a patent with the same application number.
Issue Date:Publication date of the patent grant document.
PCT Entry Date:The Entry date of PCT National Phase.
Estimated Expiry Date:The statutory expiry date of a patent right according to the Patent Law, and it is the longest term of protection that the patent right can achieve without the termination of the patent right due to other reasons(Term extension factor has been taken into account ).
Invalid Date:Actual expiry date is based on effective date or publication date of legal transaction data of invalid patent.
Login to view more 
Login to view more