Artificial intelligence-based neural network network parameter processing method and device

A neural network and network parameter technology, applied in the Internet field, can solve problems such as restricting neural network application scenarios and memory resource consumption growth, and achieve the effects of reducing memory resource consumption, increasing compression space, and reducing dependencies

Active Publication Date: 2019-07-23
BEIJING BAIDU NETCOM SCI & TECH CO LTD
View PDF3 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] With the increase of training data of neural networks, especially deep neural networks, in order to better learn the effect of data feature enhancement, the neural network parameters used to represent the neural network increase rapidly, which will lead to a rapid increase in the consumption of memory resources. This restricts the application scenarios of neural networks, such as mobile phones and other terminals with limited memory resources.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Artificial intelligence-based neural network network parameter processing method and device
  • Artificial intelligence-based neural network network parameter processing method and device
  • Artificial intelligence-based neural network network parameter processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0057] In order to make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be described clearly and completely in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of the embodiments of the present invention, not all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.

[0058] It should be noted that the terminals involved in the embodiments of the present invention may include, but are not limited to, mobile phones, personal digital assistants (Personal Digital Assistant, PDA), wireless handheld devices, tablet computers, and personal computers (PCs). ), MP3 players, MP4 players, wearable devices (f...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a neural network parameter processing method and device based on artificial intelligence. According to the embodiment, N random seeds adopted by each element identifier in M element identifiers of neural network parameters are obtained, N compression parameters of each element identifier are further obtained according to each element identifier and the N random seed adopted by the element identifier, and a reconstruction neural network is utilized to obtain reconstruction elements corresponding to each element identifier according to the N compression parameters of each element identifier, so that the neural network parameters can be obtained according to the reconstruction elements corresponding to each element identifier; and in the calculation process of the neural network parameters, the plurality of random seeds are used to carry out a plurality of times of random operation, a plurality of compression parameters are obtained, the reconstruction neural network is used again, and the reconstruction elements of the neural network parameters are calculated according to the compression parameters. Only a certain number of compression parameters such as compression space information of eight compression parameters are set, and specific elements of the neural network parameters are not set respectively, and the neural network parameter of the neural network are effectively reduced, so that the memory resource consumption of the neural network is lowered.

Description

[0001] 【Technical Field】 [0002] The present invention relates to Internet technology, in particular to a method and device for processing network parameters of a neural network based on artificial intelligence. [0003] 【Background technique】 [0004] Artificial Intelligence (Artificial Intelligence), the English abbreviation is AI. It is a new technological science that studies and develops theories, methods, techniques and application systems used to simulate, extend and expand human intelligence. Artificial intelligence is a branch of computer science. It attempts to understand the essence of intelligence and produce a new intelligent machine that can respond in a similar way to human intelligence. Research in this field includes robotics, language recognition, image recognition, Natural language processing and expert systems, etc. [0005] With the increase of training data for neural networks, especially deep neural networks, in order to better learn the characteristics of the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04L12/24
CPCH04L41/0896H04L41/145
Inventor 朱志凡冯仕堃周坤胜石磊何径舟
Owner BEIJING BAIDU NETCOM SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products