Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method for removing exceptional data

An abnormal data and abnormal technology, applied in the computer field, can solve the problems of not considering the composition of data sources, unable to eliminate abnormal data, unreasonable calculation of average value and standard deviation, etc., to achieve the effect of ensuring accuracy

Active Publication Date: 2013-09-11
SERVYOU SOFTWARE GRP
View PDF7 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In the actual application process, when the amount of data is relatively large, only one 3 sigma filter cannot remove all abnormal data, and the calculation of the average and standard deviation is still unreasonable
[0006] In addition, only applying 3 sigma filtering to the final data without considering the source composition of the data will also lead to unreasonable calculation of the mean and standard deviation
For example, the final data C=A / B, only applying 3 sigma filtering to C, regardless of the values ​​​​of A and B, will lead to unreasonable calculation of the mean and standard deviation of C

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for removing exceptional data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0029] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0030] The embodiment of the present invention provides a method for removing abnormal data, and removes all abnormal data to ensure the rationality of the calculation process.

[0031] Since there are many ways to implement the method for removing abnormal data above, the following is a detailed description through specific embodiments:

[0032] See figure 1 as shown, figure 1 Shown is a method for removing abnormal data, which includes:

[0033] Step 1: O...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method for removing exceptional data, which comprises the steps of acquiring a date exception rule of a single analysis object, applying the data exception rule for the single analysis object and making a mark, and removing the analysis object with the mark. According the method, the exceptional data are processed by the data exception rule and an entire exception rule, a user is allowed to customize a data exception rule, and the entire exception rule is recycled to remove the exceptional data. The exceptional data exists in a data analysis application generally, and the method can remove all the exceptional data, so that the precision of an analysis result is ensured.

Description

technical field [0001] The invention relates to the field of computer technology, and more specifically, to a method for removing abnormal data. Background technique [0002] In the data analysis application system, it is a very common method to screen the analysis objects with problems according to the overall distribution of the data. The overall distribution is generally expressed using the mean and standard deviation. Therefore, the calculation of the mean and standard deviation has a great influence on the analysis results. In actual use, there are often abnormal data (data with too large or too small values), which will cause the calculation of the average and standard deviation to be very unreasonable. Therefore, it is necessary to remove abnormal data when calculating the mean and standard deviation. [0003] In the existing solutions, the 3 sigma method is generally used to eliminate abnormal data, that is, first calculate the average value and standard deviation...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
Inventor 陈宏仁
Owner SERVYOU SOFTWARE GRP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products