Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

Unsupervised machine learning system selection method based on metamorphic testing

A technology of machine learning and metamorphosis testing, applied in the computer field, can solve problems such as poor performance and inability to select clustering algorithms

Inactive Publication Date: 2020-07-28
WUHAN UNIV
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0010] The present invention proposes a method for selecting an unsupervised machine learning system based on a metamorphosis test, which is used to solve or at least partially solve the technical problem that the existing method cannot select a suitable clustering algorithm or the effect is poor

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Unsupervised machine learning system selection method based on metamorphic testing
  • Unsupervised machine learning system selection method based on metamorphic testing
  • Unsupervised machine learning system selection method based on metamorphic testing

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0047]The purpose of the present invention is to solve the oracle problem existing in the unsupervised machine learning system (for the clustering algorithm), and the lack of evaluation standards, resulting in the inability to select a suitable clustering algorithm or the technical problem of poor effect, and provides a metamorphosis-based A selection method for unsupervised machine learning systems for testing. The present invention adopts metamorphosis testing technology to alleviate the oracle problem existing in machine learning testing, and through the characteristic analysis of unsupervised machine learning system, proposes 11 general metamorphic relations, and these relations cover the characteristic generally expected by users that machine learning system should have, thus Use these metamorphic relations to verify whether an unsupervised machine learning algorithm meets the requirements; secondly, users define the clustering system evaluation scheme according to their o...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method for selecting an unsupervised machine learning system based on metamorphic testing. According to the method, 11 universal metamorphic relations suitable for most application scenes are defined on the basis of general expectation of a user on a clustering system by taking dynamic characteristics of measurement data as a purpose, so that the oracle problem in the field of unsupervised machine learning is effectively relieved, and the purpose of verifying the unsupervised machine learning system is achieved; secondly, a system characteristic-oriented sufficiency criterion based on the metamorphic relationship is defined, the metamorphic relationship is endowed with different weights by a user according to importance and severity of a failure clustering mode, and a final weighted score is calculated; according to the invention, a set of complete unsupervised machine learning system verification and evaluation system is finally formed; a user is allowed to select a part of universal metamorphic relations according to own requirements or define a new specific metamorphic relation according to domain related knowledge, and finally the user is helped to deeply understand algorithm characteristics and select an unsupervised machine learning system suitable for a specific scene.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a method for selecting an unsupervised machine learning system based on metamorphosis testing. Background technique [0002] Unsupervised machine learning algorithms are widely used in the computer field. Among them, clustering algorithms can mine the internal relationships in unlabeled data sets and establish corresponding models to meet the various needs of users. However, due to the characteristics of the algorithm, it is difficult or impossible to verify the correctness of the output results, so as to select the corresponding clustering algorithm (unsupervised machine learning system). [0003] In the existing technology, there are roughly two ways to choose an unsupervised machine learning system: [0004] The first is to select through external validation techniques: the basic idea is to compare the clustering results with external benchmarks or metrics corresponding to ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06N20/00G06K9/62
CPCG06N20/00G06F18/23
Inventor 谢晓园徐静迪张芷祎浦帆李家豪
Owner WUHAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products