Unlock instant, AI-driven research and patent intelligence for your innovation.

Data processing method and equipment

A data processing equipment and data processing technology, applied in the direction of electrical digital data processing, special data processing applications, relational databases, etc., to achieve the effect of improving utilization, ensuring resource balance, and improving accuracy

Active Publication Date: 2017-05-03
ADVANCED NEW TECH CO LTD
View PDF5 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] In view of this, the embodiment of the present application provides a data processing method and device for solving the problem of how to determine more accurate parameters for the analysis model

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and equipment
  • Data processing method and equipment
  • Data processing method and equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022] In order to achieve the purpose of this application, the embodiment of this application provides a data processing method and equipment, by obtaining a data sample set, the data sample set includes a test data sample set and a training data sample set; for the analysis model to be processed For each parameter combination, send the parameter combination and the data sample set to the calculation unit that matches the resource indication attribute of the parameter combination, so that the calculation unit uses the training data sample set and the A sub-analysis model of the analysis model is obtained through parameter combination training, and the parameter combination corresponding to each sub-analysis model is scored by using the test data sample set to obtain a scoring result of each parameter combination. The resource indication attribute is used to characterize the computing resources required to complete the calculation based on the analysis model using the parameter...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data processing method and equipment. The method comprises the following steps of obtaining a data sample set including a training data sample set and a test data sample set; respectively sending a parameter combination and a data sample set to a computing element matched with a resource indication attribute of the parameter combination for each parameter combination of a to-be-processed analysis model in order to make the computing element utilize the training data sample set and the parameter combination to train to obtain a sub analysis module of the analysis model; utilizing the test data sample set to score the parameter combination corresponding to each sub analysis model to obtain a score result of each parameter combination; and determining the parameter combination which meets set conditions according to the score result, selecting an optimal parameter combination from global parameters and establishing the analysis model with the reliable performance. When the global parameters are analyzed, a heterogeneous computing cluster system is adopted, system resources are effectively used and the utilization rate of the system resources is improved.

Description

technical field [0001] The present application relates to the technical field of Internet information processing, and in particular to a data processing method and device. Background technique [0002] With the development of Internet technology, people use the Internet platform to conduct various online communications, thus storing a large amount of data in the server of the Internet platform. How to analyze these data to obtain the commercial value contained in the data has become an important issue in the field of data processing. [0003] At present, the methods used to solve the above problems include but are not limited to: firstly extract data samples from a large amount of data, use these data samples to construct an analysis model through a learning algorithm, and secondly use the obtained analysis model to analyze a large amount of data. [0004] However, it is necessary to determine the parameters used in the analysis model when constructing the analysis model. I...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
CPCG06F16/285G06F16/35
Inventor 王凯毛仁歆
Owner ADVANCED NEW TECH CO LTD