Method and system for improving data quality of sample data set

A sample data set and sample data technology, applied in the computer field, can solve problems such as low efficiency and high cost of high-quality data, and achieve the effects of solving the scarcity of talents, ensuring accuracy, and improving results

Pending Publication Date: 2021-10-22
SHENZHEN POWER SUPPLY BUREAU
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to propose a method and system for improving the data quality of sample data sets, so as to solve the technical problem of high cost and low efficiency of obtaining high-quality data of training sets in the existing deep learning process

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for improving data quality of sample data set
  • Method and system for improving data quality of sample data set
  • Method and system for improving data quality of sample data set

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0047] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings.

[0048] Such as figure 1 As shown in , it is a schematic diagram of an embodiment of a method for improving the data quality of a sample data set provided by the present invention. In this embodiment, the method includes the steps of:

[0049] Step S1, obtain sample data and filter according to the preset filter conditions to obtain high-quality sample data; judge the high-quality sample data according to the preset sample type filter conditions, and retain the sample type filter that meets the preset High-quality sample data of the sample type in the conditions; it can be understood that high-quality sample data can be manually selected, or can be automatically selected by a machine, and the setting of high-quality sample data can be manually set judgment conditi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a method and system for improving the data quality of a sample data set, and the method comprises the steps: S1, obtaining and screening sample data, and obtaining high-quality sample data; judging the high-quality sample data, and judging whether the high-quality sample data is reserved or not; S2, training the reserved high-quality sample data to obtain a reference model; S3, judging whether the performance of the reference model meets a preset threshold value or not, and obtaining a standard model when the performance of the reference model meets the preset threshold value; S4, predicting the newest sample data through the standard model to obtain a standard prediction result; predicting the latest sample data through the reference model to obtain a reference prediction result; comparing to determine whether the standard model is reserved or not; and S5, when the standard model is reserved, judging that the latest sample data is high in quality. According to the method, the manual screening time is saved, the accuracy of determining that the data is high-quality data is ensured, and the effect of the model is improved.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a method and system for improving the data quality of a sample data set. Background technique [0002] With the increasing digitization and intelligence of enterprises, not only has the scale of development been significantly improved compared to before, but the current information and communication system construction is also increasing, which has also caused a series of troubles while developing. The continuous upgrading and improvement of the communication system undoubtedly increases the difficulty and complexity of operation and maintenance. Constructing a reasonable and scientific management and operation platform is an urgent problem for electric power enterprises. Through the construction of an integrated operation and maintenance system, on the basis of its technical framework, combined with the actual situation of the current IT infrastructure of the power informatio...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/215G06N20/00
CPCG06F16/215G06N20/00
Inventor 陈瑞冷迪黄建华
Owner SHENZHEN POWER SUPPLY BUREAU
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap