Non-linear activation function RELU implementation method, equipment and medium

A technology of activation function and implementation method, applied in the direction of neural architecture, biological neural network model, etc., can solve the problems of high power consumption, slow speed, and reducing the advantages of photonic neural network, and achieve the effect of low power consumption, guaranteed speed and function

Active Publication Date: 2021-11-19
SHANDONG YUNHAI GUOCHUANG CLOUD COMPUTING EQUIP IND INNOVATION CENT CO LTD
View PDF4 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This scheme requires a lot of photoelectric conversion, slow speed and high power consumption, which will reduce the advantages of photonic neural network

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Non-linear activation function RELU implementation method, equipment and medium
  • Non-linear activation function RELU implementation method, equipment and medium
  • Non-linear activation function RELU implementation method, equipment and medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0042] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0043] The present invention provides a method for realizing the nonlinear activation function RELU, such as figure 1 shown, including the following steps:

[0044] S101. Obtain the original input amount;

[0045] In practical applications, the original input is a digital signal, assuming that the original input is x 1 ,x 2 ,...x n-1 ,x n , the expression of the activation function RELU should be:

[0046]

[0047] At this time, the form of the activa...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a non-linear activation function RELU implementation method and equipment and a medium. The method comprises the steps of obtaining an original input quantity; mapping the original input quantity to light intensity to obtain a light signal; inputting the optical signal to the micro-ring resonator; applying corresponding current to the micro-ring resonator to adjust the phase of the micro-ring resonator to achieve activation function RELU operation. Therefore, on the basis of the micro-ring resonator, the characteristics of the RELU of the activation function can be simulated without a large amount of photoelectric conversion, the method has the advantages of rapidness and low power consumption, and the advanced layout of the optical neural network chip is realized.

Description

technical field [0001] The invention relates to the technical field of optoelectronic chips, in particular to a method, device and medium for realizing a nonlinear activation function RELU. Background technique [0002] Chips are the foundation and core of the modern electronic information industry. In the era of big data, people have higher and higher requirements for the computing power and speed of electronic computer processing systems. The failure of Moore's Law has made electronic chips encounter great challenges in terms of computing speed and power consumption. Photon computing chips use photons as information. The carrier has the advantages of high-speed parallelism and low power consumption, so it is considered to be the most promising solution for high-speed, large data volume, and artificial intelligence computing processing in the future. [0003] Although the largest number of operations in the Artificial Neural Network (ANN) comes from convolution operations,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06N3/04
CPCG06N3/048Y02D30/70
Inventor 陈静静黄萍吴睿振王凛
Owner SHANDONG YUNHAI GUOCHUANG CLOUD COMPUTING EQUIP IND INNOVATION CENT CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap