Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data processing method and related device and system

A technology of data processing and data similarity, applied in the field of artificial intelligence, which can solve problems such as exponential growth of candidate data sets

Pending Publication Date: 2020-07-21
HUAWEI TECH CO LTD
View PDF0 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The embodiment of the present application provides a data processing method and related equipment and system, which solves the defect of exponential growth in the transformed candidate data sets when there are many feature transformation operations in the prior art, and improves the efficiency of feature engineering automation

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and related device and system
  • Data processing method and related device and system
  • Data processing method and related device and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment approach

[0345] As a possible implementation manner, the system also includes:

[0346] The third evaluation unit 710 is configured to: before the transformation evaluation module performs feature transformation on each data set in the nth group of data sets to obtain multiple candidate data sets, input the meta-features of the third data set to the third The machine learning model is predicted to obtain a fourth evaluation value, and the fourth evaluation value is used to evaluate the accuracy of the model obtained by training the third data set through the candidate data set obtained by the second feature transformation, and the third data Set is any data set in the nth group of data sets, and the second feature transformation is any one of the B types of feature transformations, where B is a positive integer;

[0347] The second screening unit 711 is configured to select, among the B types of feature transformations, the feature transformation corresponding to the fourth evaluation ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention discloses a data processing method and related device and system. The invention relates to the field of artificial intelligence, in particular to the field of automaticfeature engineering. The method comprises the following steps that: an executing device performs multi-order feature transformation on a plurality of data features in an obtained first group of datasets, and selects an optimal data set from the data sets obtained by the plurality of feature transformation; wherein when the nth-order feature transformation is carried out, feature transformation is carried out on each data set in the nth group of data sets to obtain a plurality of candidate data sets; calculating a first evaluation value of each candidate data set in the plurality of candidatedata sets; and then, according to the first evaluation value of each candidate data set, determining an (n + 1) th group of data sets entering the next-order feature transformation, the number of thedata sets in the (n + 1) th group of data sets being smaller than the number of the plurality of candidate data sets.

Description

technical field [0001] This application relates to the technical field of artificial intelligence, and in particular to a data processing method and related equipment and systems. Background technique [0002] With the advent of Industry 4.0, traditional industries are gradually transforming to digital services. However, some traditional industries lack technology accumulation in big data processing, cloud computing, and artificial intelligence (AI), and do not have the ability to apply AI technology transformation. As cloud computing is an important service platform of the digital economy, providing automatic machine learning services based on the cloud has become the core competitiveness of the cloud platform. [0003] Feature engineering is an important part of automatic machine learning. Feature engineering is to transform the original data set through feature transformation to obtain multiple candidate data sets, and to obtain the optimal data set by evaluating multipl...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06N20/00
Inventor 权涛缪丹丹孙伟健
Owner HUAWEI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com