Data processing method, device and system and storage medium

A data processing and data processing technology, applied in the field of data processing, can solve problems such as long training time, unfavorable data processing process optimization, and difficulty in neural network model convergence, and achieve the effect of easy convergence and high accuracy

CN110288085AActive Publication Date: 2019-09-27XIAMEN MEIYA PICO INFORMATION
8 Cites 4 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Publication Date
2019-09-27

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention provides a data processing method, device and system and a storage medium. The method comprises the steps of obtaining to-be-processed data; performing feature extraction on the to-be-processed data to obtain data features of the to-be-processed data; inputting the data features into a trained data processing model to obtain a data processing result; wherein the training of the data processing model comprises the following steps: selecting a number type of training samples from training data; inputting the category weight of the number category into a layer of a corresponding category of the neural network; training the neural network by adopting the training samples to obtain new category weights of the quantity categories; and repeating the above steps, and stopping training when the neural network model satisfies a training condition to obtain a trained data processing model. According to the method, the device, the system and the storage medium, the neural network model obtained by training the neural network by disorderly selecting the training samples with the fixed number of categories is easy to converge, the accuracy is high, the method and the device are suitable for data processing application, and the data processing process is optimized.
Need to check novelty before this filing date? Find Prior Art

Description

Technical field

[0001] The present invention relates to the field of data processing technology, and more specifically to data processing methods, devices, systems and storage media. Background technique

[0002] With the widespread application of neural networks in image processing, text processing, and language processing, the demands and requirements for neural networks have gradually increased. Neural networks often need to contain category information to complete multi-category tasks such as classification, detection of different categories, or regression. Usually, because these category information is also undetermined, it needs to be optimized or optimized during the training process. These category information are often stored as network weights in a specific layer of the neural network to participate in training and inference. The more categories there are, the more weights are required, and the slower the training and inference of these layers.

[0003] At present, when...

Examples

Embodiment Construction

[0031] In order to make the objectives, technical solutions and advantages of the present invention more obvious, exemplary embodiments according to the present invention will be described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments of the present invention. It should be understood that the present invention is not limited by the exemplary embodiments described herein. Based on the embodiments of the present invention described in the present invention, all other embodiments obtained by those skilled in the art without creative work should fall within the protection scope of the present invention.

[0032] See figure 1 , figure 1 Shows a data processing method 100 according to an embodiment of the present invention, such as figure 1 As shown, a data processing method 100 includes:

[0033] Step A, obtain the data to be processed;

[0034]...