A memristor neural network circuit simulating biological functions
By designing a memristor neural network circuit that simulates biological functions, using reward signal and clue signal modulation modules, the generalization and differentiation functions in operational conditioning are realized, solving the problem of lack of these functions in existing circuits, and enhancing The biological simulation capability of the circuit.
Patent Information
- Application Number
- CN202410259359.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-03-07
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2044-03-07
AI Technical Summary
The existing circuit lacks the generalization and differentiation functions in the operating conditioned reflection circuit, and cannot effectively simulate the behavioral adjustment and distinction of organisms under different stimuli.
A memristor neural network circuit that simulates biological functions is designed, including reward signal modulation module, clue signal modulation module, voltage control module and addition circuit. By adjusting the input voltage of the excitation signal, clue signal and synaptic module, it realizes Learning, forgetting, generalization and differentiation functions in operational conditioning reflex.
It realizes the generalization and differentiation functions of organisms in operant conditioning, and supports biological functions such as learning, natural forgetting, artificial interference forgetting and secondary learning, which enhances the biological simulation capabilities of the circuit.
Smart Images

Figure CN118114731B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of memristor neural network circuits, and in particular to a memristor neural network circuit simulating biological functions. Background Art
[0002] Memristor is an emerging nanoscale electronic device that can be used in fields such as information storage, logical operations, neural networks, and biological behavior simulation. Memristor is non-volatile and can be used to simulate biological synapses and construct circuits with biological characteristics.
[0003] Operant conditioning is a process and method of behavior change caused by stimuli, characterized by the fact that after a behavior is rewarded or punished, it affects the probability of the behavior occurring again. Behavioral plasticity establishes a connection between stimuli and behavior, allowing organisms to adjust their behavior according to stimuli.
[0004] Generalization and differentiation are concepts in classical conditioning, and they also exist in operant conditioning. Generalization means that after a certain conditioned stimulus response is formed, similar stimuli can also stimulate the same conditioned response, and differentiation is the ability of organisms to distinguish similar but different stimuli.
[0005] Many people have proposed circuits for generalization and differentiation in classical conditioning. For example, Wang Yangyang et al. proposed a memristive neural network circuit for associative learning and brain-like emotions. They used the fact that the dog's salivation behavior was initially caused by food (the dog could not salivate using other things), and used bells and food together for training. Classical conditioning has no exploration stage, and the behavior is passive, not the result of active learning by the organism. Operant conditioning, on the other hand, has an exploration stage, and the exploratory behavior is actively generated by the organism, and is the result of active learning by the organism. Summary of the invention
[0006] In view of the shortcomings of the existing circuits, the present invention solves the problem of the lack of a memristor neural network circuit with generalization and differentiation functions in an operant conditioning circuit.
[0007] The technical solution adopted by the present invention is: a memristor neural network circuit simulating biological functions includes: a reward signal modulation module, a first clue signal modulation module, a second clue signal modulation module, a first voltage control module, a second voltage control module, a first addition circuit, a second addition circuit, a first synapse module and a second synapse module; wherein,
[0008] The reward signal modulation module modulates the excitation signal V 食物 Convert to get voltage V reward ;
[0009] The first clue signal modulation module modulates the first clue signal V线索1 Convert to get voltage V cuel ;
[0010] The second clue signal modulation module modulates the second clue signal V 线索2 Convert to get voltage V cue2 ;
[0011] The first voltage control module controls the voltage V reward and voltage V cuel The voltage V is converted and obtained through the first adding circuit. 输出1 ;
[0012] The second voltage control module controls the voltage V reward and voltage V cue2 The voltage V is converted and obtained through the second adding circuit. 输出2 ;
[0013] By adjusting the excitation signal V 食物 , the first clue signal V 线索1 and the second clue signal V 线索2 , realizing the learning function in operant conditioning.
[0014] As a preferred embodiment of the present invention, the secondary learning function in operant conditioning is realized by adjusting the excitation signal, the first cue signal and the second cue signal.
[0015] As a preferred embodiment of the present invention, by adjusting the excitation signal V 食物 , the first clue signal V 线索1 and the second clue signal V 线索2 , realizing the natural forgetting function in operant conditioning.
[0016] As a preferred embodiment of the present invention, by adjusting the excitation signal V 食物 , the first clue signal V 线索1 and the second clue signal V 线索2 , realizing the function of forgetting by artificial interference in operant conditioning.
[0017] As a preferred embodiment of the present invention, by adjusting the excitation signal V 食物 , the first clue signal V 线索1 and the second clue signal V 线索2 , realizing the generalization function in operant conditioning.
[0018] As a preferred embodiment of the present invention, by adjusting the excitation signal V 食物 , the first clue signal V 线索1 and the second clue signal V 线索2 , realizing the differentiation function in operant conditioning.
[0019] As a preferred embodiment of the present invention, the reward signal modulation module, the first clue signal modulation module and the second clue signal modulation module use three cascaded NOT gate circuits composed of PMOS tubes and NMOS tubes as the first-level comparator and the second-level comparator respectively; the resistor, the memristor and the operational amplifier constitute a reverse proportional circuit; and different output voltages are obtained by adjusting the high and low values of the input voltages of the reward signal modulation module, the first clue signal modulation module and the second clue signal modulation module.
[0020] The reward signal modulation module includes: a memristor M1, PMOS tubes P1 to P6, NMOS tubes N1 to N6, an operational amplifier U1 and a resistor R1. The drains of P1 and N1 are connected and then connected to the gates of P2 and N2. The drains of P2 and N2 are connected and then connected to the gates of P3 and N3. The drains of P3 and N3 are connected and then connected to one end of R1. The other end of R1 is respectively connected to one end of M1 and the reverse input end of U1. The other end of M1 is connected to the output end of U1. The output end of U1 is also connected to the gates of P4 and N4. The drains of P4 and N4 are connected and then connected to the gates of P5 and N5. The drains of P5 and N5 are connected and then connected to the gates of P6 and N6. The drains of P6 and N6 are connected.
[0021] The first clue signal modulation module includes: a memristor M2, a PMOS tube P7 to P 12 、NMOS tube N7 to N 12 , operational amplifier U2 and resistor R3, the drains of P7 and N7 are connected to the gates of P8 and N8, the drains of P8 and N8 are connected to the gates of P9 and N9, the drains of P9 and N9 are connected to one end of R3, the other end of R3 is connected to one end of M2 and the reverse input end of U2 respectively, the other end of M2 is connected to the output end of U2, and the output end of U2 is also connected to P 10 and N 10 The gate connection, P 10 and N 10 The drain is connected to P 11 and N 11 The gate connection, P 11 and N 11 The drain is connected to P 12 and N 12 The gate connection, P 12 and N 12 The drain is connected.
[0022] The second clue signal modulation module includes: a memristor M3, a PMOS tube P 13 To P 18 、NMOS tube N 13 To N 18, operational amplifier U5 and resistor R 14 , P 13 and N 13 The drain is connected to P 14 and N 14 The gate connection, P 14 and N 14 The drain is connected to P 15 and N 15 The gate connection, P 15 and N 15 The drain is connected to R 14 One end of the connection, R 14 The other end of M3 is connected to one end of M3 and the reverse input end of U5 respectively. The other end of M3 is connected to the output end of U5. The output end of U5 is also connected to P 16 and N 16 The gate connection, P 16 and N 16 The drain is connected to P 17 and N 17 The gate connection, P 17 and N 17 The drain is connected to P 18 and N 18 The gate connection, P 18 and N 18 The drain is connected.
[0023] As a preferred embodiment of the present invention, the first voltage module and the second voltage module use resistors and operational amplifiers to form a common-phase proportional circuit, and adjust the common-phase proportional circuit to output different voltage values according to the output voltages of the reward signal modulation module and the first clue signal modulation module.
[0024] The first voltage control module includes a resistor R2, resistors R4 to R 12 、NMOS tube N 19 To N 20 、PMOS tube P 19 To P 22 , operational amplifiers U3 to U4; one end of R2 is connected to P 19 , P 21 The gate of R2 is connected to N 19 The drain connection, N 19 The gate of R4 and P 19 The drain of R4 is connected to the ground, the source of N19 is connected to the power supply, and P 19 The source of R5 and P 20 The drain of R5 is connected to the ground. 20 The gate and P 12 and N 12The drain connection, P 21 The source of R7 and P 22 The drain of R7 is connected to the ground. 22 The gate and P 11 and N 11 The drain connection, P 21 The drain of R6 and N 20 The gate of R6 is connected to the ground, and the other end of R6 is grounded. 20 The drain of is connected to one end of R8 and R9 respectively, the other end of R8 is grounded, the source of N20 is connected to the power supply, and the other end of R9 is connected to the reverse input end of U3 and R 10 One end of the connection, R 10 The other end is connected to the output of U3 and R 11 One end of the connection, R 11 The other end is connected to R 12 One end is connected to the inverting input terminal of U4, R 12 The other end is connected to the output end of U4.
[0025] The second voltage control module includes a resistor R 13 , resistor R 15 To R 23 、NMOS tube N 21 To N 22 、PMOS tube P 23 To P 26 , operational amplifiers U6 and U7, R 13 One end of each 23 , P 25 The gate connection, R 13 The other end of N 21 The drain connection, N 21 The gate of R 15 One end and P 23 The drain connection, R 15 The other end of N21 is connected to the ground, the source of N21 is connected to the power supply, 23 The source of R 16 One end and P 24 The drain connection, R 16 The other end of the ground, P 24 The gate and P 18 and N 18 The drain connection, P 25 The source of R 18 One end and P 26 The drain connection, R 18 The other end of the ground, P 26 The source is connected to the power supply, P 26 The gate and P 17and N 17 The drain connection, P 25 The drain of R 17 One end and N 22 The gate connection, R 17 The other end is grounded, N 22 The drain of R 19 and R 20 One end of the connection, R 19 The other end is grounded, N 22 The source is connected to the power supply, R 20 The other end is connected to the inverting input of U6 and R 21 One end of the connection, R 21 The other end is connected to the output of U6 and R 22 One end of the connection, R 22 The other end is connected to R 23 One end is connected to the inverting input of U7, R 23 The other end is connected to the output end of U7.
[0026] As a preferred embodiment of the present invention, the first synaptic module and the second synaptic module use three cascaded NOT gate circuits composed of PMOS tubes and NMOS tubes as comparators and inverters, and by adjusting the input voltage of the first synaptic module and the second synaptic module, the on-off of different switch groups is changed, thereby changing the input voltage of the memristor, so that the output voltage of the first synaptic module and the second synaptic module is changed.
[0027] The first synaptic module includes a PMOS tube P 27 To P 29 、NMOS tube N 23 To N 25 , switches S1 to S4, memristor M4, resistor R 25 , operational amplifiers U8 and U9, P 27 and N 23 The drain is connected to P 28 and N 24 The gate connection, P 28 and N 24 The drain is connected to P 29 and N 25 The gate connection, P 29 and N 25 The drain of S1 and S3 is connected to pin 1 respectively, pin 4 of S1 and pin 2 of S2 are connected to one end of M4, the other end of M4 is connected to pin 2 of S3 and S4 respectively, and pin 1 of S4 and S2 are connected to P 28 and N 24 The drain of S4 is connected to the reverse input terminal of U8 and R 25 One end of the connection, R25 The other end of U8 is connected to the output end of U8, and the output end of U8 is also connected to the reverse input end of U9.
[0028] The second synaptic module includes a PMOS tube P 30 To P 32 、NMOS tube N 26 To N 28 , switches S5 to S8, memristor M5, resistor R 27 、Operational amplifier U 10 to U 11 , P 30 and N 26 The drain is connected to P 31 and N 27 The gate connection, P 31 and N 27 The drain is connected to P 32 and N 28 The gate connection, P 32 and N 28 The drain of S5 and S7 is connected to the pin 1 respectively, the pin 4 of S5 and the pin 2 of S6 are connected to one end of M5, the other end of M5 is connected to the pin 2 of S7 and S8 respectively, the pin 1 of S8 and S6 are connected to P 31 and N 27 The drain of S8 is connected to pin 4 of U 10 The inverting input terminal and R 27 One end of the connection, R 27 The other end of U 10 Output connection, U 10 The output terminal is also connected to U 11 The inverting input terminal is connected.
[0029] As a preferred implementation of the present invention, the first adding circuit and the second adding circuit are two-stage operational amplifier adding circuits.
[0030] The first adding circuit includes a resistor R 28 To R 32 , operational amplifier U 12 to U 13 , R 28 and R 29 R 30 One end and U 12 The inverting input terminal is connected to R 30 The other end is connected to R 31 One end and U 12 The output connection of R 31 The other end is connected to R 32 One end and U 13 The inverting input terminal is connected to R 32 The other end of the13 The output terminal is connected.
[0031] The second adding circuit includes a resistor R 33 To R 37 、Operational amplifier U 14 to U 15 , R 33 and R 34 R 35 and U 14 The inverting input terminal is connected to R 35 The other end is connected to R 36 One end and U 14 The output connection of R 36 The other end is connected to R 37 One end and U 15 The inverting input terminal is connected to R 37 The other end of the 15 The output terminal is connected.
[0032] Beneficial effects of the present invention:
[0033] 1. By designing neurons and synaptic circuits, the generalization and differentiation functions of organisms in the learning process of operant conditioning are realized, and at the same time, biological functions such as learning, natural forgetting, artificial interference forgetting, and secondary learning are realized. BRIEF DESCRIPTION OF THE DRAWINGS
[0034] Figure 1 This is a schematic diagram of a memristor neural network circuit for simulating biological functions according to the present invention.
[0035] Figure 2 The simulation results of the learning and forgetting functions of the present invention are Figure 1 ;
[0036] Figure 3 The simulation results of the learning and forgetting functions of the present invention are Figure 2 ;
[0037] Figure 4 The simulation result of the secondary learning function of the present invention is Figure 1 ;
[0038] Figure 5 The simulation result of the secondary learning function of the present invention is Figure 2 ;
[0039] Figure 6 The simulation result of the secondary learning function of the present invention is Figure 3 ;
[0040] Figure 7 This is a simulation result diagram of the generalization and differentiation functions of the present invention. DETAILED DESCRIPTION
[0041] The present invention is further described below in conjunction with the accompanying drawings and embodiments. This figure is a simplified schematic diagram, which only illustrates the basic structure of the present invention in a schematic manner, and therefore it only shows the components related to the present invention.
[0042] like Figure 1 As shown, a memristor neural network circuit simulating biological functions includes: a reward signal modulation module, a first clue signal modulation module, a second clue signal modulation module, a first voltage control module, a first addition circuit, a second addition circuit, a second voltage control module, a first synapse module and a second synapse module; wherein the reward signal V 食物 The reward signal modulation module is connected to the reward signal modulation module, the reward signal modulation module and the first clue signal modulation module are both connected to the first voltage control module, the output signals of the reward signal modulation module and the first voltage control module are respectively connected to the first addition circuit, the first addition circuit is connected to the first synapse module, the reward signal modulation module and the second clue signal modulation module are both connected to the second voltage control module, the output signals of the reward signal modulation module and the second voltage control module are respectively connected to the second addition circuit, and the second addition circuit is connected to the second synapse module.
[0043] The reward signal modulation module converts the reward signal V 食物 The output result is used as the input of the first adding circuit, and the first clue signal modulation module converts V 线索1 The output result is used as the input of the first voltage control module, and the second clue signal modulation module converts V 线索2 The output result is used as the input of the second voltage control module, the output of the first voltage control module is used as the input of the first adding circuit, the output of the second voltage control module is used as the input of the second adding circuit, the output of the first adding circuit is used as the input of the first synaptic module, and the output of the second adding circuit is used as the input of the second synaptic module; when V 食物 and V 线索1 When the signals exist at the same time, the first synaptic module is trained to increase the memristor weight of the first synaptic module, and the second synaptic module is trained to increase the memristor weight of the second synaptic module, thereby realizing the generalization function in operant conditioning. 线索2 , without applying V 食物 , V 线索2 The corresponding memristor weight of the second synaptic module gradually decreases. After multiple trainings, the organism can distinguish V 线索1 and V 线索2 , realizing the differentiation function in operant conditioning.
[0044] The reward signal modulation module includes a memristor M1, PMOS tubes P1-P6, NMOS tubes N1-N6, an operational amplifier U1 and a resistor R1; the common gate of the PMOS tube P1 and the NMOS tube N1 is connected to the reward signal input V 食物 The common drain of PMOS tube P1 and NMOS tube N1 is connected to the common gate of PMOS tube P2 and NMOS tube N2, the common drain of PMOS tube P2 and NMOS tube N2 is connected to the common gate of PMOS tube P3 and NMOS tube N3, the common drain of PMOS tube P3 and NMOS tube N3 is connected to the left end of resistor R1, the positive end of memristor M1 is connected to the right end of resistor R1 and the negative input end of operational amplifier U1, the negative end of memristor M1 is connected to the output end of operational amplifier U1 The positive input terminal of the operational amplifier U1 is grounded, the common gate of the PMOS tube P4 and the NMOS tube N4 is connected to the output terminal of the operational amplifier U1, the common drain of the PMOS tube P4 and the NMOS tube N4 is connected to the common gate of the PMOS tube P5 and the NMOS tube N5, the common drain of the PMOS tube P5 and the NMOS tube N5 is connected to the common gate of the PMOS tube P6 and the NMOS tube N6, and the common drain of the PMOS tube P6 and the NMOS tube N6 is the output V of the reward signal modulation module Reward .
[0045] PMOS tubes P1-P3 and NMOS tubes N1-N3 form comparator COM1, and the threshold voltage of comparator COM1 is 0.2V; PMOS tubes P4-P6 and NMOS tubes N4-N6 form comparator COM2, and the threshold voltage of comparator COM2 is -0.6V; when the input V 食物 When it is high level, the output voltage of comparator COM1 is -1.2V; resistor R1, memristor M1 and operational amplifier U1 form an inverse proportional circuit. The inverse proportional output voltage V1 is related to the resistance value of memristor M1. When V1 is a positive voltage, the resistance value of memristor M1 gradually increases. When the inverse proportional output voltage V1 is positive, the output voltage of comparator COM2 is 0V. When the input V 食物 When the voltage level is low, the output voltage of the comparator COM1 is 1.2V, and V1 becomes a negative voltage. When V1 is a negative voltage, the resistance of the memristor M1 gradually decreases. When V1 is less than -0.6V, the output voltage of the reward signal modulation module V Reward becomes a high level; the input and output relationship of the reward signal modulation module can be expressed as:
[0046]
[0047]
[0048] The first clue signal modulation module includes a memristor M2, a PMOS tube P7-P 12、NMOS tube N7-N 12 , operational amplifier U2, resistor R3; the common gate of PMOS tube P7 and NMOS tube N7 and the signal input V of thread I 线索1 The common drain of PMOS tube P7 and NMOS tube N7 is connected to the common gate of PMOS tube P8 and NMOS tube N8, the common drain of PMOS tube P8 and NMOS tube N8 is connected to the common gate of PMOS tube P9 and NMOS tube N9, the common drain of PMOS tube P9 and NMOS tube N9 is connected to the left end of resistor R3, the positive end of memristor M2 is connected to the right end of resistor R3 and the negative input end of operational amplifier U2, the negative end of memristor M2 is connected to the output end of operational amplifier U2, the positive input end of operational amplifier U2 is grounded, PMOS tube P 10 And NMOS tube N 10 The common gate of the PMOS tube P is connected to the output terminal of the operational amplifier U2. 10 And NMOS tube N 10 The common drain of the PMOS tube P 11 And NMOS tube N 11 The common gate connection of PMOS tube P 11 And NMOS tube N 11 The common drain of the PMOS tube P 12 And NMOS tube N 12 The common gate connection of PMOS tube P 12 And NMOS tube N 12 The common drain is the output V of the first clue signal modulation module Cue1 .
[0049] Among them, PMOS tubes P7-P9 and NMOS tubes N7-N9 form comparator COM3, the threshold voltage of comparator COM3 is 0.2V, and the PMOS tube P 10 -P 12 And NMOS tube N 10 -N 12 The comparator COM4 has a threshold voltage of -0.6V. 线索1 When it is high level, the output voltage of comparator COM3 is -1.2V; resistor R3, memristor M2 and operational amplifier U2 form an inverse proportional circuit, and the inverse proportional output voltage V2 is related to the resistance value of memristor M2. When the inverse proportional output voltage V2 is a positive voltage, the resistance value of memristor M2 gradually increases. When the inverse proportional output voltage V2 is positive, the output voltage of comparator COM4 is -1V; when V 线索1 When the input is low level, the output voltage of comparator COM3 is 1.2V, and V2 becomes a negative voltage. When V2 is a negative voltage, the resistance of memristor M1 gradually decreases; when V2 is less than -0.6V, the output VCue1 becomes a high level; the input and output relationship of the first clue signal modulation module can be expressed as:
[0050]
[0051]
[0052] The second clue signal modulation module includes a memristor M3, a PMOS tube P 13 -P 18 、NMOS tube N 13 -N 18 , operational amplifier U5 and resistor R 14 ; PMOS tube P 13 And NMOS tube N 13 The common gate and lead II signal input V 线索2 Connection, PMOS tube P 13 And NMOS tube N 13 The common drain of the PMOS tube P 14 And NMOS tube N 14 The common gate connection of PMOS tube P 14 And NMOS tube N 14 The common drain of the PMOS tube P 15 And NMOS tube N 15 The common gate connection of PMOS tube P 15 And NMOS tube N 15 The common drain and resistor R 14 The left end is connected to the positive end of the memristor M3 and the resistor R 14 The right end is connected to the negative input terminal of the operational amplifier U5, the negative end of the memristor M3 is connected to the output terminal of the operational amplifier U5, the positive input terminal of the operational amplifier U5 is grounded, and the PMOS tube P 16 And NMOS tube N 16 The common gate of the PMOS tube is connected to the output terminal of the operational amplifier U5. 16 And NMOS tube N 16 The common drain of the PMOS tube P 17 And NMOS tube N 17 The common gate connection of PMOS tube P 17 And NMOS tube N 17 The common drain of the PMOS tube P 18 And NMOS tube N 18 The common gate connection of PMOS tube P 18 And NMOS tube N 18 The common drain is the output V of the first clue signal modulation module Cue2 .
[0053] PMOS tubes P13-P15 and NMOS tubes N13-N15 form a comparator COM5. The threshold voltage of comparator COM5 is 0.2V. 16 -P 18 And NMOS tube N 16 -N 18 The threshold voltage of the comparator COM5 is -0.6V. 线索2 When the voltage level is high, the output voltage of comparator COM5 is -1.2V; the resistor R 14 , memristor M3 and operational amplifier U5 form an inverse proportional circuit. The inverse proportional output voltage V3 is related to the resistance value of memristor M3. When V3 is a positive voltage, the resistance value of memristor M3 gradually increases. When the inverse proportional output voltage V3 is positive, the output voltage of comparator COM6 is -1V; when V 线索2 When the input is low level, the output voltage of the comparator COM5 is 1.2V, and V3 becomes a negative voltage. When V3 is a negative voltage, the resistance of the memristor M3 gradually decreases. When V3 is less than -0.6V, the output of the reward signal modulation module becomes a high level. The input and output relationship of the second clue signal modulation module can be expressed as:
[0054]
[0055]
[0056] The first voltage control module includes a resistor R2, a resistor R4-R 12 、NMOS tube N 19 、N 20 、PMOS tube P 19 -P 22 , operational amplifiers U3 and U4; the output V of the reward signal modulation module Reward Respectively connected to the left end of resistor R2 and PMOS tube P 19 The gate of the PMOS tube P 21 The gate connection of the first clue signal modulation module output V Cue1 With PMOS tube P 20 The gate connection of NMOS tube N 19 The drain of the NMOS tube is connected to the right end of the resistor R2. 19 The source of the PMOS tube is connected to the power supply. 19 The drain of NMOS tube N 19 The gate of the PMOS tube is connected to the left end of the resistor R4, and the right end of the resistor R4 is grounded. 20 The drain of the PMOS tube P 19 The source of is connected to the left end of resistor R5, the right end of resistor R5 is grounded, and the PMOS tube P 20The source of the PMOS tube is connected to the power supply; 22 The gate of the PMOS tube P 11 The drain connection of the PMOS tube P 22 The source of the PMOS tube is connected to the power supply. 22 The drain of the PMOS tube P 21 The source of is connected to the left end of resistor R7, the right end of resistor R7 is grounded, and the PMOS tube P 21 The drain of NMOS tube N 20 The gate of the NMOS tube is connected to the left end of the resistor R6, and the right end of the resistor R6 is grounded. 20 The source of NMOS tube is connected to the power supply. 20 The drain of is connected to the left end of resistor R8 and the left end of resistor R9, the right end of resistor R8 is grounded, and the right end of resistor R9 is connected to resistor R 10 The left end of the resistor R is connected to the inverting input terminal of the operational amplifier U3, the positive input terminal of the operational amplifier U3 is grounded, and the 11 The left end of the resistor R 10 The right end is connected to the output of operational amplifier U3, and the resistor R 12 The left end of the resistor R 11 The right end of the resistor R is connected to the inverting input terminal of the operational amplifier U4, the positive input terminal of the operational amplifier U4 is grounded, and the 12 The right end of the resistor R2 is connected to the output end of the operational amplifier U4 and the VIN2 port of the first adding circuit, the right end of the resistor R2 is connected to the VIN1 port of the first adding circuit, and the OUT port of the first adding circuit is the output V 输出1 .
[0057] Resistor R9-R 12 And operational amplifiers U3 and U4 form a common-phase proportional circuit; when the output voltage V Reward When the PMOS tube P is high, 19 , P 21 Cut off, the output V of the first voltage control module 输出1 is 2.5V; when the output voltage of comparator COM2 V Reward The output voltage of comparator COM4 is low level. Cue1 When the PMOS tube P is high, 20 Cut-off, PMOS tube P 21 , P 22 On, NMOS tube N 20 The gate voltage becomes 1.5V, and the NMOS tube N 20 The output V of the first voltage control module is turned on. 输出1 becomes -6.75V; when the output voltage of comparator COM2 V RewardWhen the comparator COM4 output voltage V Cue1 When the PMOS tube P is low, 19 , P 20 PMOS tube P 22 Cut-off, NMOS tube N 19 The gate voltage becomes 1.5V, and the NMOS tube N 19 is turned on, and the output of the first voltage control module becomes -1V.
[0058] The second voltage control module includes a resistor R 13 , resistor R 15 -R 23 、NMOS tube N 21 、N 22 , PMOS tube P 23 -P 26 , operational amplifiers U6 and U7; the output V of the reward signal modulation module Reward Respectively with the resistor R 13 The left end of the PMOS tube P 23 The gate of the PMOS tube P 25 The gate connection of the second clue signal modulation module output V Cue2 With PMOS tube P 24 The gate connection of NMOS tube N 21 The drain and resistor R 13 The right end of the NMOS tube N 21 The source of the PMOS tube is connected to the power supply. 23 The drain of NMOS tube N 21 The gate and resistor R 15 The left end of the resistor R 15 The right end of the PMOS tube P 24 The drain of the PMOS tube P 23 The source and resistor R 16 The left end of the resistor R 16 The right end of the PMOS tube P 24 The source of the PMOS tube is connected to the power supply; 26 The gate of the PMOS tube P 17 The drain connection of the PMOS tube P 26 The source of the PMOS tube is connected to the power supply. 26 The drain of the PMOS tube P 25 The source and resistor R 18 The left end of the resistor R 18 The right end of the PMOS tube P 25 The drain of NMOS tube N 22 The gate and resistor R 17 The left end of the resistor R17 The right end of the NMOS tube is grounded, 22 The source of NMOS tube is connected to the power supply. 22 The drain and resistor R 19 The left end and resistor R 20 The left end of the resistor R 19 The right end of the resistor R 20 The right end of the resistor R 21 The left end of the resistor R is connected to the inverting input terminal of the operational amplifier U6, the positive input terminal of the operational amplifier U6 is grounded, and the 22 The left end of the resistor R 21 The right end is connected to the output of the operational amplifier U6, and the resistor R 23 The left end of the resistor R 22 The right end of the resistor R is connected to the inverting input terminal of the operational amplifier U7, the positive input terminal of the operational amplifier U7 is grounded, and the 23 The right end is connected to the output of the operational amplifier U7 and the VIN4 port of the second adding circuit, and the resistor R 13 The right end is connected to the VIN3 port of the second adding circuit, and the OUT port of the second adding circuit is the output V 输出2 .
[0059] Resistor R 20 -R 23 And operational amplifiers U6 and U7 form a common-phase proportional circuit; when the output voltage V Reward When the PMOS tube P is high, 23 , P 25 Cut off, the output V of the second voltage control module 输出2 is 2.5V; when the output voltage of comparator COM2 V Reward is low level, the output voltage V Cue2 When the PMOS tube P is high, 24 Cut-off, PMOS tube P 25 , P 26 On, NMOS tube N 22 The gate voltage becomes 1.5V, and the NMOS tube N 22 The output of the second voltage control module V 输出2 becomes -6.75V; when the output voltage of comparator COM2 V Reward When the comparator COM6 is at a low level, the output voltage V Cue2 When the PMOS tube P is low, 23 , P 24 PMOS tube P 26 Cut-off, NMOS tube N 21 The gate voltage becomes 1.5V, and the NMOS tube N21 is turned on, and the output of the second voltage control module becomes -1V.
[0060] The first synaptic module includes a PMOS tube P 27 -P 29 、NMOS tube N 23 -N 25 , switches S1-S4, memristor M4, resistor R 25 , operational amplifiers U8, U9; PMOS tube P 27 And NMOS tube N 23 The common gate and the lead I signal input V 线索1 Connection, PMOS tube P 27 And NMOS tube N 23 The common drain of the PMOS tube P 28 And NMOS tube N 24 The common gate connection of PMOS tube P 28 And NMOS tube N 24 The common drain of the PMOS tube P 29 And NMOS tube N 25 The common gate of the switch S2 and the switch S4 are connected to the 1 port, and the PMOS tube P 29 And NMOS tube N 25 The common drain of the switches S1 and S3 is connected to the 1 ports of the switches S1 and S3 respectively, and the 2 port of the switch S1 is connected to the output V 输出1 The 3rd port of switch S1 is connected to the ground, the 2nd port of switch S2 is connected to the 4th port of switch S1 and the positive end of memristor M4 respectively, the 3rd port of switch S2 is connected to the ground, the 4th port of switch S2 is connected to the power supply, the 2nd port of switch S3 is connected to the negative end of memristor M4 and the 2nd port of switch S4, the 3rd port and the 4th port of switch S3 are connected to the ground, the 3rd port of switch S4 is connected to the ground, the 4th port of switch S4 is connected to the resistor R 25 The left end of the operational amplifier U8 is connected to the reverse input end of the operational amplifier U8, the positive input end of the operational amplifier U8 is grounded, the output end of the operational amplifier U8 is connected to the reverse input end of the operational amplifier U9, the positive input end of the operational amplifier U9 is connected to the power supply, and the output end of the operational amplifier U9 is the output V of the first synaptic module Out1 .
[0061] PMOS tube P 27 -P 28 、NMOS tube N 23 -N 24 The comparator COM7 has a threshold voltage of 0.2V and a PMOS tube P 29 And NMOS tube N 25 To form an inverter; when V 线索1When the voltage is high, the output of comparator COM7 is high, and the output of the inverter is low. At this time, switches S2 and S4 are turned on, and a voltage of -0.2V is applied across memristor M4. Memristor M4 and resistor R 25 The reverse proportional circuit is formed with the operational amplifier U8. The output voltage V4 of the reverse proportional circuit is compared with the negative input voltage of the operational amplifier U9. When the output voltage V4 of the reverse proportional circuit is less than 2V, the operational amplifier U9 outputs a high level. When V 线索1 When the voltage is low, the output of comparator COM7 is low, and the output of the inverter is high. At this time, switches S1 and S3 are turned on, and V is applied to both ends of memristor M4. 输出1 The voltage changes the resistance of the memristor M4, and the reverse input terminal of the operational amplifier U8 is 0V.
[0062] The second synaptic module includes a PMOS tube P 30 -P 32 、NMOS tube N 26 -N 28 , switches S5-S8, memristor M5, resistor R 27 、Operational amplifier U 10 and U 11 ; PMOS tube P 30 The common gate of NMOS tube N26 and the signal input V 线索2 Connection, PMOS tube P 30 And NMOS tube N 26 The common drain of the PMOS tube P 31 And NMOS tube N 27 The common gate connection of PMOS tube P 31 And NMOS tube N 27 The common drain of the PMOS tube P 32 And NMOS tube N 28 The common gate of the switch S6 and the 1 port of the switch S8 are connected, and the PMOS tube P 32 And NMOS tube N 28 The common drain of the switches S5 and S7 is connected to the 1 ports of the switches S5 and S7 respectively, and the 2 port of the switch S5 is connected to the output V 输出2 The 3rd port of switch S5 is connected to the ground, the 2nd port of switch S6 is connected to the 4th port of switch S5 and the positive end of memristor M5 respectively, the 3rd port of switch S6 is connected to the ground, the 4th port of switch S6 is connected to the power supply, the 2nd port of switch S7 is connected to the negative end of memristor M5 and the 2nd port of switch S8, the 3rd port and the 4th port of switch S7 are grounded, the 3rd port of switch S8 is grounded, and the 4th port of switch S8 is connected to the resistor R 27 The left end and operational amplifier U 10 The inverting input terminal of the operational amplifier U 10The positive input terminal of the operational amplifier U 10 The output terminal of the operational amplifier U 11 The inverting input terminal of the operational amplifier U 11 The positive input terminal of the operational amplifier U is connected to the power supply. 11 The output end is the output V of the second synaptic module Out2 .
[0063] PMOS tube P 30 -P 31 , NMOS tube N 26 -N 27 The comparator COM8 has a threshold voltage of 0.2V and a PMOS tube P 32 And NMOS tube N 28 To form an inverter; when V 线索2 When the voltage is high, the output of the comparator COM8 is high, and the output of the inverter is low. At this time, the switches S6 and S8 are turned on, and a voltage of -0.2V is applied across the memristor M5. The memristor M5 and the resistor R 27 and operational amplifier U 10 The output voltage V5 of the reverse proportional circuit is compared with the negative input voltage of the operational amplifier U9. When the output voltage V5 of the reverse proportional circuit is less than 1.6V, the operational amplifier U 11 Output high level; when V 线索2 When the voltage is low, the output of comparator COM8 is low, and the output of the inverter is high. At this time, switches S5 and S7 are turned on, and V is applied to both ends of memristor M5. 输出2 voltage, changes the resistance of memristor M5, op amp U 10 The inverting input terminal is 0V.
[0064] The first adding circuit includes: a resistor R 28 -R 32 、Op amp U 12 and U 13 , resistor R 28 The left end is the input V in1 , resistor R 29 The left end is the input V in2 , resistor R 28 The right end and the resistor R 29 The right end and resistor R 30 The left end is connected to the resistor R 30 The left end and the operational amplifier U 12 The inverting input terminal of the operational amplifier U 12 The positive input terminal is grounded, and the resistor R 31 The left end of the resistor R 30 The right side and operational amplifier U12 The output terminal is connected to the resistor R 32 The left end of the resistor R 31 The right end and operational amplifier U 13 The inverting input terminal of the operational amplifier U 13 The positive input terminal of the operational amplifier U 13 The output terminal is V 输出1 .
[0065] The second adding circuit includes: a resistor R 33 -R 37 、Op amp U 14 and U 15 , resistor R 33 The left end is the input V in3 , resistor R 34 The left end is the input V in4 , resistor R 33 The right end and the resistor R 34 The right end and resistor R 35 The left end is connected to the resistor R 35 The left end and the operational amplifier U 14 The inverting input terminal of the operational amplifier U 14 The positive input terminal is grounded, and the resistor R 36 The left end of the resistor R 35 The right end and operational amplifier U 14 The output terminal is connected to the resistor R 37 The left end of the resistor R 36 The right end and operational amplifier U 15 The inverting input terminal of the operational amplifier U 15 The positive input terminal of the operational amplifier U 15 The output terminal is V 输出2 .
[0066] Where R1 = 250Ω, R2 = R 13 =100Ω, R3 = R 14 =250Ω, R 12 =R 23 =1.5KΩ, R3=R4=R5=R6=R7=R8=R9=R 10 =R 11 =R 15 =R 16 =R 17 =R 18 =R 19 =R 20 =R 21 =R 22 =1KΩ, R 25 =R 27 =R 28 =R29 =R 30 =R 31 =R 32 =R 33 =R 34 =R 35 =10KΩ;
[0067] P1 to P5, P7 to P 12 , P 13 To P 18 , P 27 To P 32 The model of P6 is M2SJ116; the model of P6 is M2SJ132, 19 To P 26 The model is M2SJ114;
[0068] N1 to N5, N7 to N 11 、N 13 To N 17 、N 23 To N 28 The model is M2SK2493; N6, N 12 、N 18 The model is M2SK2549; N 19 、N 21 The model is M2SK1530; N 20 、N 22 The model is M2SK1411; operational amplifier U1-U 15 The model is AD8538.
[0069] Figure 2-3 is a simulation result diagram of the learning and forgetting functions of the present invention, V 食物 is the input voltage of the reward signal input, V 线索1 is the input voltage of the first clue signal modulation module, M4 is the resistance change of memristor M4, V 行为1 is the output voltage of the first synaptic module; this circuit realizes learning function, natural forgetting and artificial interference forgetting; when food signal and clue signal are applied at the same time, the resistance of memristor M4 decreases continuously, indicating that training has started. When the resistance of memristor M4 drops to 1kΩ, behavioral signal will appear when clue signal is provided. When food signal is not provided, only clue signal is provided, and the resistance of memristor M4 increases continuously. When the resistance of memristor M4 is greater than 1kΩ, no behavioral signal appears when clue signal is provided. It can be seen from the figure that when food and clue signal exist at the same time, after a period of learning process, behavior appears. When only clue signal is provided without food signal, behavior still exists, indicating that the organism has learned the action of button under the training of reward condition. After a period of time, the action of organism disappears, indicating that forgetting phenomenon has occurred. Figure 2 Always provide clues, Figure 3 Only when food is provided are clue signals provided. By comparison, it can be seen that the resistance of memristor M4 changes at different speeds in the two cases, achieving natural forgetting and artificial interference forgetting; Figure 2 Forgotten by human interference, Figure 3 Forgotten by nature.
[0070] Figure 4-6 is the simulation result diagram of the secondary learning of the present invention, V 食物 is the input voltage of the reward signal input, V 线索1 is the input voltage of the first clue signal modulation module, M4 is the resistance change of memristor M4, V 行为1 is the output voltage of the first synaptic module; for a clue, the time spent by the organism on learning the second time is shorter than the first time; as can be seen from the figure, after the same amount of learning, the resistance of memristor M4 drops to the same value, and the learning is successful at this time. When the clue signal is provided, the corresponding behavior signal will appear; when the food is stopped, the organism forgets, and the resistance of memristor M4 begins to rise. When the resistance of memristor M4 is greater than 1kΩ, no corresponding behavior signal will appear when the clue signal is provided, and the second learning is carried out at this time. At different degrees of forgetting, the time required for the second learning is different.
[0071] Figure 7 is the simulation result diagram of generalization and differentiation of the present invention, V 食物 is the input voltage of the reward signal input, V 线索1 is the input voltage of the first clue signal modulation module, V 线索2 is the input voltage of the second clue signal modulation module, M4 is the resistance change of memristor M4, M5 is the resistance change of memristor M5, V 行为 is the output voltage of the first synaptic module and the second synaptic module. Generalization means that after learning a behavior, an individual can produce similar reactions in similar situations; differentiation means that an individual can distinguish stimuli in different situations to produce specific reactions; in the present invention, V 线索1 and V 线索2 are two similar clues; as can be seen from the figure, providing organisms with food signals and V 线索1 signal, the resistance of memristor M4 and memristor M5 decreases. When the resistance is less than 1kΩ, V 线索1 signal, the behavior signal has a corresponding output. After a period of training, V is provided in the test phase I. 线索1 and V 线索2 , behavioral signals appear, indicating that biological behavior has been learned and generalized behavior has been generated. After 4 cycles of training, a second test is conducted to provide V 线索1 , the behavior signal generates an output, providing V 线索2Signal, behavioral signal has no output, indicating that organisms can distinguish V 线索1 and V 线索2 , achieving differentiated behavior.
[0072] Based on the above ideal embodiments of the present invention, the relevant staff can make various changes and modifications without departing from the technical concept of the present invention through the above description. The technical scope of the present invention is not limited to the contents of the specification, and its technical scope must be determined according to the scope of the claims.
Claims
1. A memristor neural network circuit simulating biological functions, characterized in that: include: A reward signal modulation module, a first cue signal modulation module, a second cue signal modulation module, a first voltage control module, a second voltage control module, a first adding circuit, a second adding circuit, a first synapse module, and a second synapse module; Among them, the reward signal is connected to the reward signal modulation module, the reward signal modulation module and the first clue signal modulation module are both connected to the first voltage control module, the output signals of the reward signal modulation module and the first voltage control module are respectively connected to the first addition circuit, the first addition circuit is connected to the first synapse module, the reward signal modulation module and the second clue signal modulation module are both connected to the second voltage control module, the output signals of the reward signal modulation module and the second voltage control module are respectively connected to the second addition circuit, and the second addition circuit is connected to the second synapse module; the reward signal modulation module transforms the reward signal, and the output result is used as the input of the first addition circuit, the first clue signal modulation module transforms the first clue signal, and the output result is used as the input of the first voltage control module, and the second clue signal modulation module transforms the second clue signal The output result is used as the input of the second voltage control module, the output of the first voltage control module is used as the input of the first adding circuit, the output of the second voltage control module is used as the input of the second adding circuit, the output of the first adding circuit is used as the input of the first synaptic module, and the output of the second adding circuit is used as the input of the second synaptic module; when the reward signal and the first cue signal exist at the same time, the first synaptic module is trained to increase the memristor weight of the first synaptic module, and the second synaptic module is trained to increase the memristor weight of the second synaptic module, thereby realizing the generalization function in operant conditioning; only the second cue signal is applied without applying the reward signal, the memristor weight of the second synaptic module corresponding to the second cue signal gradually decreases, and the first cue signal and the second cue signal are distinguished after multiple trainings, thereby realizing the differentiation function in operant conditioning.
2. The memristor neural network circuit simulating biological functions according to claim 1, characterized in that: Also includes: By adjusting the incentive signal, the first cue signal and the second cue signal, the secondary learning function in operant conditioning is realized; The method realizes the secondary learning function in operant conditioning by adjusting the excitation signal, the first cue signal and the second cue signal, including: After the same amount of learning, the resistance of the memristor drops to the same value. This means that the learning is successful, and corresponding behavioral signals will appear when clue signals are provided. Stop providing the excitation signal, the organism starts to forget, and the resistance of the memristor starts to rise. When the resistance of the memristor is greater than 1kΩ, providing the clue signal will not produce a corresponding behavioral signal, and the second learning is carried out at this time. Under different degrees of forgetting, the time required for the second learning is different.
3. The memristor neural network circuit simulating biological functions according to claim 1, characterized in that: Also includes: By adjusting the incentive signal, the first clue signal and the second clue signal, the natural forgetting function and the artificial interference forgetting function in operant conditioning are realized; When the excitation signal and the cue signal are applied at the same time, the resistance of the memristor decreases continuously, indicating that the training has started. When the resistance of the memristor drops to 1kΩ, a behavioral signal will appear when the cue signal is provided. When no excitation signal is provided and only the cue signal is provided, the resistance of the memristor continues to rise. When the resistance of the memristor is greater than 1kΩ, no behavioral signal appears when the cue signal is provided. When the excitation signal and the cue signal exist at the same time, after a period of learning process, the behavior appears. When only the cue signal is provided without the excitation signal, the behavior still exists. After a period of time, the biological action disappears, indicating that forgetting has occurred.
4. The memristor neural network circuit simulating biological functions according to claim 1, characterized in that: The reward signal modulation module, the first clue signal modulation module and the second clue signal modulation module are used as the first-level comparator and the second-level comparator respectively through three cascaded NOT gate circuits composed of PMOS tubes and NMOS tubes; a reverse proportional circuit is formed by resistors, memristors and operational amplifiers; different output voltages are obtained by adjusting the input voltages of the reward signal modulation module, the first clue signal modulation module and the second clue signal modulation module.
5. The memristor neural network circuit simulating biological functions according to claim 1, characterized in that: The first voltage control module and the second voltage control module use resistors and operational amplifiers to form a common-phase proportional circuit, and adjust the common-phase proportional circuit to output different voltage values according to the output voltages of the reward signal modulation module and the first clue signal modulation module.
6. The memristor neural network circuit simulating biological functions according to claim 1, characterized in that: The first synaptic module and the second synaptic module use three cascaded NOT gate circuits composed of PMOS tubes and NMOS tubes as comparators and inverters. By adjusting the input voltage of the first synaptic module and the second synaptic module, the on-off of different switch groups is changed, so that the input voltage of the memristor changes, thereby changing the output voltage of the first synaptic module and the second synaptic module.
7. The memristor neural network circuit simulating biological functions according to claim 1, characterized in that: The first adding circuit and the second adding circuit are two-stage operational amplifier adding circuits.
