Unlock instant, AI-driven research and patent intelligence for your innovation.

Data filtering engine and system and filtering method

A filtering method and data technology, applied in the field of data cleaning, can solve the problems of prolonging the development and testing process, increasing the communication cost, and consuming energy, and achieving the effect of simplifying the development and testing process, easy operation, and strong adaptability.

Pending Publication Date: 2019-09-27
北京善义善美科技有限公司
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Due to different backgrounds, in order to accurately implement the filtering rules formulated by the product manager, the developer needs to communicate and confirm repeatedly with the product manager. Even a small part of the change needs to be confirmed by the product manager. Communication costs, consume a lot of energy on both sides, and prolong the development and testing process

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data filtering engine and system and filtering method
  • Data filtering engine and system and filtering method
  • Data filtering engine and system and filtering method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0032] In the following detailed description, reference is made to the accompanying drawings which are included in the specification and which illustrate specific embodiments of the application and which are included in this application. In the drawings, like reference numerals describe substantially similar components in different views. Va...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a data filtering engine and system and a filtering method, and belongs to the technical field of data cleaning. The data filtering engine includes: a rule interpreter configured to convert a filtering rule into a corresponding code tree, the code tree including at least one UDF; and a filtering module which is configured to call the UDF in the filtering rules to process the original data and determine whether the original data conforms to the filtering rules or not according to the output value of the final UDF in each filtering rule. The communication cost between a rule maker and a developer is reduced, the development and test process is simplified, the filtering condition can be changed by modifying the rule, the adaptability is high, and the operation is simple and convenient.

Description

technical field [0001] The invention relates to the technical field of data cleaning, in particular to a data filtering engine, system and filtering method. Background technique [0002] In today's Internet and big data era, data cleaning is becoming more and more important. For an enterprise or a platform, a large amount of internal data and / or external data are generated every day or even every second. Useless data not only takes up valuable space, but also interferes with data analysis, resulting in large errors and low reliability of analysis results. Even if it is useful data, the format of the same type of data may be different, and it needs to be normalized, or the original data must be completed or deleted before it can continue to be used. [0003] Filtering out useless data is a necessary and important means of data cleaning. The usual filtering method is to design different screening mechanisms according to needs, and distinguish useless data by setting screeni...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/215
CPCG06F16/215
Inventor 杨超
Owner 北京善义善美科技有限公司