Check patentability & draft patents in minutes with Patsnap Eureka AI!

Neural network method and device, electronic equipment and storage medium

A neural network model and neural network training technology, applied in the computer field, can solve problems such as consumption of memory resources

Pending Publication Date: 2022-03-01
SHANGHAI SENSETIME INTELLIGENT TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Backpropagation has the same amount of calculation as forward propagation, or even larger, and consumes more memory resources

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Neural network method and device, electronic equipment and storage medium
  • Neural network method and device, electronic equipment and storage medium
  • Neural network method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0046] Various exemplary embodiments, features, and aspects of the present disclosure will be described in detail below with reference to the accompanying drawings. The same reference numbers in the figures indicate functionally identical or similar elements. While various aspects of the embodiments are shown in drawings, the drawings are not necessarily drawn to scale unless specifically indicated.

[0047] The word "exemplary" is used exclusively herein to mean "serving as an example, embodiment, or illustration." Any embodiment described herein as "exemplary" is not necessarily to be construed as superior or better than other embodiments.

[0048] The term "and / or" in this article is just an association relationship describing associated objects, which means that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist simultaneously, and there exists alone B these three situations. In addition, the term "at least one" herein mean...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a neural network method and device, electronic equipment and a storage medium, and the method comprises the steps: carrying out the processing of a training sample through a neural network model, and obtaining the network loss of a neural network; performing back propagation according to the network loss to obtain an update gradient of a plurality of network nodes of the neural network, and performing optimized back propagation on at least one network node; and obtaining an updated neural network based on the update gradient of the neural network. According to the neural network training method disclosed by the embodiment of the invention, the back propagation of at least one network node can be optimized, and the updated gradient is determined by using the optimized network node, so that the operand in the back propagation is reduced, the memory resource is saved, and the training efficiency is improved.

Description

technical field [0001] The present disclosure relates to the field of computer technology, in particular to a neural network method and device, electronic equipment and storage media. Background technique [0002] Forward propagation and backpropagation are common training processes for neural network training. Forward propagation determines the output of the neural network and determines the network loss. Backpropagation feeds back through the network loss and iteratively adjusts the parameters of each layer in the neural network. . Backpropagation has the same amount of calculation as forward propagation, or even larger, and consumes more memory resources. Contents of the invention [0003] The disclosure proposes a neural network method and device, electronic equipment and a storage medium. [0004] According to one aspect of the present disclosure, a neural network training method is provided, including: processing the training samples through the neural network mode...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06N3/08
CPCG06N3/084
Inventor 徐迟张行程王志宏
Owner SHANGHAI SENSETIME INTELLIGENT TECH CO LTD
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com