Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and system for processing dirty data

A dirty data and database technology, applied in a method and system field of dirty data, can solve problems affecting user operation time, slow query speed, low execution efficiency, etc., to improve data exchange efficiency, avoid time consumption, improve The effect of experience

Active Publication Date: 2015-02-04
北京思特奇信息技术股份有限公司
View PDF6 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The traditional method of processing dirty data is to use complex SQL statements, which has low execution efficiency and slow query speed. Especially the larger the data volume, the faster the query speed will drop, which greatly affects the user operation time and reduces the user experience. bring unnecessary trouble
With the development of the Internet industry and the increasing emphasis on user experience, traditional data query methods can no longer meet the needs of today's systems, especially due to the existence of dirty data, which brings certain troubles to query valid data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for processing dirty data
  • Method and system for processing dirty data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0032] A method for processing dirty data, comprising the steps of:

[0033] Step 1: The database acquires the data information in the state library and stores the acquired data information in the form of data records;

[0034] Step 2: the client generates a retrieval request according to the retrieval information input by the user, the retrieval request includes keywords to be queried, and the client sends the retrieval request to the processing center and the database;

[0035] Step 3: The database queries all data records related to the keyword according to the retrieval request, and sends all the relevant data records found to the processing center;

[0036] Step 4: The processing center verifies and compares all the data records received with the data information in the state database, and judges whether each data record is dirty data one by one according to the comparison results. If there is dirty data, mark all as dirty data data records, and clear the data records ma...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a method and system for processing dirty data. The method comprises the following steps: generating a retrieve request by a client according to retrieve information inputted by a user, and transmitting the retrieve request to a processing center and a database; transmitting all inquired relevant data records to the processing center by the database; verifying and comparing all data records with data information in a state library by the processing center, gradually judging whether each data record is dirty data or not, marking all data records which are the dirty data if the dirty data exists, eliminating the data records which are marked as the dirty data, and returning all relevant records to the client if no dirty data exists; transmitting the retrieve request to the database by the processing center, re-acquiring all relevant data records from the database, and eliminating the dirty data until all requested data records are returned. By adopting the method and system, time consumption for processing complicated SQL sentences can be avoided, the data exchanging efficiency of the system also can be improved, and the user experience can be improved.

Description

technical field [0001] The invention relates to a data interaction method, in particular to a method and system for processing dirty data. Background technique [0002] The data interaction between the front end and the server is one of the core businesses of the B / S system, and efficient, fast, and real-time data interaction is the long-term goal of the system. The traditional method of processing dirty data is to use complex SQL statements, which has low execution efficiency and slow query speed. Especially the larger the data volume, the faster the query speed will drop, which greatly affects the user operation time and reduces the user experience. cause unnecessary trouble. With the development of the Internet industry and the increasing emphasis on user experience, traditional data query methods can no longer meet the needs of today's systems, especially due to the existence of dirty data, which brings certain troubles to query valid data. Contents of the invention ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30H04L29/06
CPCG06F16/215G06F16/24553G06F16/248
Inventor 张劲松
Owner 北京思特奇信息技术股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products