Module circuit and reservoir circuit

Abstract

A module circuit comprises a first block circuit and a second block circuit. The first block circuit is provided with a first input terminal to which an input pulse signal is inputted, a holding unit that holds an average value of the input pulse signal for a predetermined period in accordance with the interval of the input pulse signal and the width of the input pulse signal, an oscillator that generates an output pulse signal at a frequency according to the average value, and a first output terminal that outputs the output pulse signal. The second block circuit is provided with a second input terminal to which the output pulse signal outputted from the first block circuit is inputted, a duty ratio adjuster that adjusts the duty ratio of the output pulse signal, and a second output terminal that outputs the output pulse signal adjusted by the duty ratio adjuster.

Description

[Technical field]

[0001] The present invention relates to a module circuit and a reservoir circuit. This application claims priority based on Japanese Patent Application No. 2021-198579, filed on December 7, 2021, the contents of which are incorporated herein by reference. [Background technology]

[0002] An analog (integration circuit) type LIF (Leaky Integration and Fire) element is known (Patent Document 1). [Prior art documents] [Non-patent literature]

[0003] [Non-Patent Document 1] "IEEE Transactions on Circuits and Systems II: Express Briefs", July 14, 2015, Vol. 62, No. 11, pp. 1088-1092 Summary of the Invention [Problem to be solved by the invention]

[0004] However, analog LIF elements as described in Patent Document 1 tend to consume large amounts of power. There is a demand for LIF elements that consume less power.

[0005] The present invention has been made in view of the above points, and provides a module circuit and a reservoir circuit that can realize low power consumption in an LIF element. [Means for solving the problem]

[0006] The present invention has been made to solve the above-mentioned problems, and one aspect of the present invention is a module circuit comprising a first block circuit and a second block circuit, the first block circuit comprising a first input terminal to which an input pulse signal is input, a holding unit to hold an average value of the input pulse signal for a predetermined period according to the interval of the input pulse signal and the width of the input pulse signal, an oscillator unit to generate an output pulse signal at a frequency according to the average value, and a first output terminal to output the output pulse signal, and the second block circuit comprises a second input terminal to which the output pulse signal output from the first block circuit is input, a duty ratio adjuster to adjust the duty ratio of the output pulse signal, and a second output terminal to output the output pulse signal adjusted by the duty ratio adjuster.

[0007] Moreover, in one aspect of the present invention, in the above-mentioned module circuit, the first block circuit includes a high-side switching element, wherein the holding unit includes a capacitor, integrates a pulse voltage indicative of the input pulse signal, and holds the result of integrating the pulse voltage as the average value, and the oscillator unit receives an integral current from the holding unit that monotonically increases with respect to the result of integrating the pulse voltage obtained by integrating the pulse voltage by the holding unit, generates the output pulse signal having a frequency that depends on the magnitude of the integral current, and forms the pulse voltage to be charged to the capacitor by opening and closing in response to the input pulse signal indicative of an excitatory input.

[0008] In addition, in one aspect of the present invention, in the above-mentioned module circuit, the first block circuit further includes a low-side switching element that discharges the charge in the capacitor by opening and closing in response to the input pulse signal indicating an inhibitory input.

[0009] In one aspect of the present invention, in the module circuit described above, the first block circuit further includes a flow limiter that limits a flow of the integral current from the holding section to the oscillation section.

[0010] Moreover, one aspect of the present invention is the above-mentioned module circuit, further comprising a third block circuit, the third block circuit comprising: a third input terminal to which the output pulse signal output from the second block circuit is input; a charging unit that is charged by a leakage current of a MOS transistor; a pulse signal generating unit that generates a pulse signal and resets the charge amount of the charging unit when the charge amount of the charging unit exceeds a threshold value; and a third output terminal that outputs the pulse signal generated by the pulse signal generating unit, wherein the frequency at which the pulse signal generating unit generates the output pulse signal increases or decreases according to the frequency at which the output pulse signal is input to the third input terminal.

[0011] In one aspect of the present invention, in the above module circuit, the third block circuit includes a CMOS inverter including a P-type MOS transistor and an N-type MOS transistor connected in series between a power supply terminal and a ground terminal, an inverter that generates an inverted signal by inverting an output from the CMOS inverter, a switching element that is disposed between the P-type MOS transistor and the N-type MOS transistor and opens and closes in response to the inverted signal, a delay circuit that delays the output from the CMOS inverter and inputs it again to the CMOS inverter, a second capacitor that is charged by a pulse voltage that indicates the output pulse signal input to the third input terminal, a second low-side switching element that opens and closes in response to a second input pulse signal that indicates an inhibitory input to discharge the charge of the second capacitor in a closed state, and a second high-side switching element that opens and closes in response to a first input pulse signal that indicates an excitatory input to generate a pulse voltage that indicates the first input pulse signal, and the charging unit includes the second capacitor, and the pulse signal generating unit includes the inverter, the switching element, and the delay circuit, and the voltage of the second capacitor is input to the CMOS inverter.

[0012] In addition, one embodiment of the present invention is a semiconductor device including a plurality of the above-described module circuits. A linear combination of the average values ​​of the input pulse signals input to each of the plurality of module circuits is used as an output signal, and the coefficients of the linear combination are used as learning objects. This is the reservoir circuit.

[0013] In addition, one aspect of the present invention is such that, in the above-mentioned reservoir circuit, the second output terminal provided in each of one or more of the module circuits is connected to the first input terminal provided in one of the module circuits, or the second output terminal provided in one of the module circuits is connected to the first input terminal provided in each of one or more of the module circuits. Effect of the Invention

[0014] According to the present invention, low power consumption can be achieved in the LIF element. [Brief description of the drawings]

[0015] [Figure 1] 1 is a diagram showing an example of a configuration of a module circuit according to an embodiment of the present invention; [Diagram 2] FIG. 2 is a diagram showing an example of a configuration of a synapse element circuit according to an embodiment of the present invention. [Diagram 3] FIG. 2 is a diagram illustrating an example of a configuration of a weight adjustment circuit according to an embodiment of the present invention. [Figure 4] FIG. 1 is a diagram showing an example of the configuration of an LIF neuron circuit according to an embodiment of the present invention. [Diagram 5] FIG. 2 is a diagram showing an example of a configuration of a reservoir circuit according to an embodiment of the present invention. [Figure 6] FIG. 13 is a diagram showing an example of an operation check result when one synapse element circuit, one weight adjustment circuit, and one LIF neuron circuit according to an embodiment of the present invention are connected. [Figure 7] FIG. 13 is a diagram showing an example of an operation check result when one synapse element circuit, one weight adjustment circuit, and one LIF neuron circuit according to an embodiment of the present invention are connected. [Figure 8] FIG. 1 is a diagram showing an example of an operation confirmation result of a spiking neural network according to an embodiment of the present invention. [Figure 9] FIG. 4 is a diagram showing an example of a time change in a synapse output signal according to an embodiment of the present invention. [Figure 10]FIG. 2 is a diagram showing an example of a time change in a neuron voltage according to an embodiment of the present invention. [Figure 11] FIG. 2 is a diagram showing an example of a change over time in synaptic current according to an embodiment of the present invention. [Figure 12] FIG. 2 is a diagram showing the appearance of a semiconductor chip produced according to an embodiment of the present invention. [Figure 13] 1 is a diagram showing a configuration of a module circuit according to a first embodiment of the present invention; [Figure 14] FIG. 4 is a diagram showing the results of measuring the operation of the module circuit according to the first embodiment of the present invention. [Figure 15] FIG. 11 is a diagram showing a configuration of a module circuit according to a second embodiment of the present invention. [Figure 16] FIG. 11 is a diagram showing the results of measuring the operation of a module circuit according to a second embodiment of the present invention. [Figure 17] FIG. 11 is a diagram showing a configuration of a module circuit according to a third embodiment of the present invention. [Figure 18] FIG. 11 is a diagram showing the results of measuring the operation of a module circuit according to a third embodiment of the present invention. [Figure 19] FIG. 13 is a diagram showing a configuration of a module circuit according to a fourth embodiment of the present invention. [Figure 20] FIG. 13 is a diagram showing the results of measuring the operation of a module circuit according to a fourth embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0016] (Embodiment) Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. Fig. 1 is a diagram showing an example of the configuration of a module circuit 1 according to this embodiment. The module circuit 1 includes a synapse element circuit 2, a weight adjustment circuit 4, and an LIF neuron circuit 3. The synapse element circuit 2, the weight adjustment circuit 4, and the LIF neuron circuit 3 are connected in series in this order and included in the module circuit 1.

[0017] The module circuit 1 is used, for example, as a synapse of a neural network. An input pulse signal IP1 is input to the synapse element circuit 2. The input pulse signal IP1 is a pulse signal output from a synapse provided in a stage preceding the module circuit 1. The synapse element circuit 2 integrates the input pulse signal IP1 and outputs a pulse signal MP2 as an output pulse signal having a frequency according to the integral value. The synapse element circuit 2 is an example of a first block circuit.

[0018] The weight adjustment circuit 4 adjusts the pulse width of the pulse signal MP2 output from the module circuit 1. The wider the pulse width, the faster the charging and discharging speed of the subsequent neurons. In other words, a wide pulse width corresponds to a large weight in the neural network. The weight adjustment circuit 4 outputs the pulse signal MP2 with the adjusted pulse width as a pulse signal MP3. The pulse signal MP3 is output to the LIF neuron circuit 3. The weight adjustment circuit 4 is an example of a second block circuit.

[0019] The LIF neuron circuit 3 charges a node using the leakage current of a transistor. When the voltage of the node to be charged exceeds a threshold, the LIF neuron circuit 3 outputs an output pulse signal OP1 and is reset. The output pulse signal OP1 is output to a neuron in the subsequent stage. In the LIF neuron circuit 3, the frequency at which a pulse signal is output increases or decreases depending on a pulse signal MP3 input from a weight adjustment circuit 4. The LIF neuron circuit 3 is an example of a third block circuit.

[0020] The module circuit 1 is an LIF (Leaky Integration and Fire) element that uses analog quantities in the time domain (pulse interval and pulse width). By using analog quantities in the time domain, the module circuit 1 realizes an LIF element that consumes less power than an LIF element that uses a conventional analog method (integration circuit).

[0021] [Configuration of synapse element circuit 2] 2 is a diagram showing an example of the configuration of the synapse element circuit 2 according to this embodiment. The synapse element circuit 2 includes an input terminal IN21, an inverter D21, a P-type MOS transistor T21, a power supply terminal P2, an input terminal IN22, an N-type MOS transistor T22, a ring oscillator O2, a capacitor C2, an N-type MOS transistor T23, an output terminal OUT21, and an output terminal OUT22. The P-type MOS transistor T21, the N-type MOS transistor T22, and the N-type MOS transistor T23 are in an off state when no signal is input.

[0022] An input pulse signal IP21 is input to the input terminal IN21. As shown in Fig. 2, the input pulse signal IP21 is a square wave that goes high for a short period of time in a predetermined cycle. The input pulse signal IP21 corresponds to the input pulse signal IP1 shown in Fig. 1. The input terminal IN21 is an example of a first input terminal.

[0023] The inverter D21 inverts the polarity of the input pulse signal IP21 input to the input terminal IN21. The input pulse signal IP21 with the polarity inverted is a square wave that goes low for a short period of time in a predetermined cycle.

[0024] The P-type MOS transistor T21 has its source connected to the power supply terminal P2, its gate connected to the inverter D21, and its drain connected to the connection point J22 of the wiring L21. The P-type MOS transistor T21 is on only while the input pulse signal IP21 whose polarity has been inverted by the inverter D21 is low, and a current I21 flows from the source to the drain. As described above, the input pulse signal IP21 whose polarity has been inverted is low only for a short period of time, so that the P-type MOS transistor T21 is on only for that short period of time.

[0025] The P-type MOS transistor T21 is an example of a high-side switching element that opens and closes in response to an input pulse signal IP21 indicating an excitatory input to generate a pulse voltage that is charged to the capacitor C2.

[0026] An input pulse signal IP22 is input to the input terminal IN22. As shown in Fig. 2, the input pulse signal IP22 is a square wave that goes high for a short period of time in a predetermined cycle. As shown in Fig. 2, the pulse width of the input pulse signal IP22 is narrower than the pulse width of the input pulse signal IP21, for example. The input pulse signal IP22 corresponds to the input pulse signal IP1 shown in Fig. 1. The input terminal IN21 is an example of a first input terminal.

[0027] The N-type MOS transistor T22 has a source connected to a connection point J21 between the capacitor C2 and the line L21, a gate connected to the input terminal IN22, and a drain grounded. The N-type MOS transistor T22 is on only while the input pulse signal IP22 is high, and a current I22 flows from the source to the drain. As described above, the input pulse signal IP22 is high only for a short time, so that the N-type MOS transistor T22 is on only for that short time.

[0028] The N-type MOS transistor T22 is an example of a low-side switching element that opens and closes in response to an input pulse signal IP22 indicating an inhibitory input, thereby discharging the charge in the capacitor C2.

[0029] The capacitor C2 is provided on the wiring L21. Each time the P-type MOS transistor T21 is turned on for a short time and a current I21 flows, the capacitor C2 is charged for that short time and accumulates electric charge. The capacitance of the capacitor C2 is, for example, 150 fF (femtofarads). The other end of the capacitor C2 is grounded.

[0030] The capacitor C2 is an example of a holding unit. The holding unit holds an average value of the input pulse signal IP21 for a predetermined period according to the interval of the input pulse signal IP21 and the width of the input pulse signal IP21. The holding unit includes the capacitor C2, integrates a pulse voltage indicating the input pulse signal IP21, and holds the result of integrating the pulse voltage as an average value.

[0031] The ring oscillator O2 is an oscillation circuit (oscillator) that outputs a pulse signal. The ring oscillator O2 includes three inverters: an inverter D22, an inverter D23, and an inverter D24. The inverter D22 is connected to a wiring L21 by a connection point J21. The inverter D23 is connected to a wiring L21 by a connection point J22. The inverter D24 is connected to a wiring L21 by a connection point J23. The inverters D22, D23, and D24 are connected in series in this order. The inverter D24 is connected in series to the inverter D22 by the wiring L24 via the connection point J26. That is, the ring oscillator O2 has a ring-shaped structure.

[0032] The ring oscillator O2 is an example of an oscillator. The oscillator generates an output pulse signal OP2 at a frequency corresponding to the average value of the input pulse signal IP21 held by the holding unit. The oscillator receives an integral current obtained by integrating the pulse voltage by the holding unit from the holding unit, and generates an output pulse signal OP2 having a frequency that depends on the magnitude of the integral current. The integral current is a current that monotonically increases with respect to the result of integrating the pulse voltage by the holding unit.

[0033] The signal output from the inverter D24 is branched into two at the connection point J26. One of the signals branched at the connection point J26 is output to the output terminal OUT22. The output terminal OUT22 outputs one of the branched signals as an output pulse signal OP2. The output pulse signal OP2 corresponds to the pulse signal MP2 shown in FIG. 1. The other of the signals branched at the connection point J26 is input to the inverter D22 via the wiring L24.

[0034] When a low signal is input to the inverter D22, the polarity of the signal is inverted by the inverter D22, the inverter D23, and the inverter D24, and a high signal is output from the inverter D24. Similarly, when a high signal is input to the inverter D22, a low signal is output from the inverter D24. The signal output from the inverter D24 periodically alternates between low and high. As a result, the inverter D24 outputs an output pulse signal OP2.

[0035] The pulse interval of the output pulse signal OP2 depends on the voltage V2 of the node. Here, the connection points J21, J22, and J23 are collectively referred to as the node. The voltage is determined by the voltage of the capacitor C2. Therefore, the pulse interval of the output pulse signal OP2 depends on the voltage of the capacitor C2. The narrower the pulse interval of the input pulse signal IP21, the more pulses are input per unit time, and the more charge is stored in the capacitor C2. The more charge is stored in the capacitor C2, the higher the voltage of the capacitor C2. The higher the voltage of the capacitor C2, the narrower the pulse interval of the output pulse signal OP2, and the more pulses are output per unit time.

[0036] That is, in the synapse element circuit 2, the input pulse signal IP21 is integrated by accumulating electric charge in the capacitor C2, and an output pulse signal OP2 having a frequency (pulse interval) according to the integrated value is output. That is, the waveform of the output pulse signal OP2 corresponds to the result of integrating the waveform of the input pulse signal IP21. The waveform of the output pulse signal OP2 is used for learning when the synapse element circuit 2 is used as a node of a neural network. The output pulse signal OP2 corresponds to the pulse signal MP2 shown in FIG. 1.

[0037] At the same time as outputting the output pulse signal OP2, the ring oscillator O2 consumes a current. The current consumed by the ring oscillator O2 is called a leakage current I23. The leakage current I23 flows out from the connection point J24.

[0038] 2 rises every time the P-type MOS transistor T21 is turned on, and decreases as the ring oscillator O2 operates and the leakage current I23 flows out. In the synapse element circuit 2, the output pulse signal OP2 is generated by the leakage current I23 that flows out in response to the operation of the ring oscillator O2. That is, in the synapse element circuit 2, the leakage current is converted into a pulse train.

[0039] 2, the amount of leakage current I23 is adjusted by an N-type MOS transistor T23. The N-type MOS transistor T23 has a source connected to a connection point J24, and a drain and a gate grounded via a connection point J25. The N-type MOS transistor T23 is an example of a current limiter that limits the flow of an integral current from the holding unit to the oscillation unit.

[0040] The N-type MOS transistor T23 may be omitted from the configuration of the synapse element circuit 2. If the N-type MOS transistor T23 is not provided, the amount of leakage current I23 flowing out from the ring oscillator O2 cannot be adjusted by adjusting only the amount of current I21 flowing through the P-type MOS transistor T21. Therefore, the accuracy of adjustment for making the output pulse signal OP2 output from the ring oscillator O2 a desired pulse train is higher when the N-type MOS transistor T23 is provided than when it is not provided.

[0041] Furthermore, the input terminal IN22 and the N-type MOS transistor T22 may be omitted from the configuration of the synapse element circuit 2.

[0042] [Configuration of weight adjustment circuit 4] FIG. 3 is a diagram showing an example of the configuration of the weight adjustment circuit 4 according to the present embodiment. The weight adjustment circuit 4 includes an input terminal IN4, an inverter D41, a delay line D42, a multiplexer M4, a gate A4, and an output terminal OUT4.

[0043] An input pulse signal IP4 is input to the input terminal IN4. The input pulse signal IP4 corresponds to the pulse signal MP2 shown in Fig. 1 (in other words, the output pulse signal OP2 shown in Fig. 2). In other words, the output pulse signal OP2 output from the first block circuit is input to the input terminal IN4.

[0044] An input pulse signal IP4 input to an input terminal IN4 is branched at a connection point J41 into a pulse signal IP41 and a pulse signal IP42. The pulse signal IP41 is input to an inverter D41. The pulse signal IP42 is input to a gate A4.

[0045] The inverter D41 inverts the polarity of the pulse signal IP41 and outputs it to the delay line D42. The delay line D42 is composed of a plurality of delay elements connected in series. The multiplexer M4 selects one of the plurality of delay elements constituting the delay line D42 and outputs it as a pulse signal IP43. The pulse signal IP43 is delayed compared to the pulse signal IP42 depending on which delay element the signal is extracted from. The further the delay element from which the signal is extracted among the plurality of delay elements connected in series in the delay line D42 is from the inverter D41 side, the more delayed the extracted pulse signal IP43 is compared to the pulse signal IP42.

[0046] The gate A4 receives a pulse signal IP42 and a pulse signal IP43 delayed from the pulse signal IP42. The gate A4 outputs a signal corresponding to the logical product of the input pulse signal IP42 and the pulse signal IP43. The signal output from the gate A4 is output from the output terminal OUT4 as an output pulse signal OP4.

[0047] The pulse width of the output pulse signal OP4 is narrower than that of the input pulse signal IP4, depending on which delay element in the delay line D42 the signal is taken out from. Figure 3 shows the waveforms of the pulse signal IP43, the pulse signal IP42, and the output pulse signal OP4.

[0048] Since the pulse signal IP42 is simply the input pulse signal IP4 branched at the connection point J41, the waveform of the pulse signal IP42 is the same as that of the input pulse signal IP4. On the other hand, the pulse signal IP43 is delayed with respect to the pulse signal IP42. By combining the waveform of the pulse signal IP42 and the waveform of the pulse signal IP43 which is delayed with respect to the pulse signal IP42, an output pulse signal OP4 having a narrower pulse width than the input pulse signal IP4 is obtained.

[0049] Therefore, in the weight adjustment circuit 4, the pulse width of the output pulse signal OP4 is adjusted depending on which delay element in the delay line D42 the signal is taken out from. The inverter D41, the delay line D42, and the multiplexer M4 are an example of a duty ratio adjuster. The duty ratio adjuster adjusts the duty ratio of the output pulse signal OP4. The output terminal OUT4 is an example of a second output terminal. The second output terminal outputs the output pulse signal OP4 adjusted by the duty ratio adjuster.

[0050] As long as the duty ratio of the pulse can be adjusted, the configuration of the weight adjustment circuit 4 is not limited to the configuration shown in Fig. 3. The weight adjustment circuit 4 may have another configuration, such as a configuration in which the load capacitance is made variable to adjust the pulse width.

[0051] [Construction of LIF neuron circuit 3] 4 is a diagram showing an example of the configuration of the LIF neuron circuit 3 according to this embodiment. The LIF neuron circuit 3 includes an input terminal IN31, a P-type MOS transistor T31, an input terminal IN32, an N-type MOS transistor T32, a power supply terminal P31, a capacitor C3, a power supply terminal P32, a P-type MOS transistor T33, a P-type MOS transistor T34, an N-type MOS transistor T35, an inverter D31, an inverter D32, an inverter D33, an inverter D34, and an output terminal OUT3.

[0052] The P-type MOS transistor T31, the N-type MOS transistor T32, the P-type MOS transistor T33, the P-type MOS transistor T34, and the N-type MOS transistor T35 are in an off state when no signal is input. The parasitic capacitance of each of the P-type MOS transistor T31, the N-type MOS transistor T32, the P-type MOS transistor T33, the P-type MOS transistor T34, and the N-type MOS transistor T35 is, for example, 10 fF (femtofarads).

[0053] The P-type MOS transistor T33 has its source connected to the power supply terminal P32, its gate connected to the connection point J35, and its drain connected to the source of the P-type MOS transistor T34. The P-type MOS transistor T34 has its source connected to the drain of the P-type MOS transistor T33, its gate connected to the junction J34, and its drain connected to the junction J33.

[0054] As described above, the P-type MOS transistor T33 and the P-type MOS transistor T34 are in the off state. Even when the P-type MOS transistor T33 and the P-type MOS transistor T34 are in the off state, the leakage current I31 flows. The leakage current I31 always flows even in the off state.

[0055] The capacitor C3 is connected to the connection point J33 through the connection point J32. When the leakage current I31 flows through the P-type MOS transistor T33 and the P-type MOS transistor T34, the capacitor C3 is charged. Therefore, in the LIF neuron circuit 3, the capacitor C3 is charged by the leakage current I31 flowing through the P-type MOS transistor T33 and the P-type MOS transistor T34. That is, the capacitor C3 is charged by the leakage current I31 of the P-type MOS transistor T33 and the P-type MOS transistor T34, which are MOS transistors. The capacitor C3 is included in the charging section.

[0056] Charge accumulates in the capacitor C3, and the voltage V3 at the connection point J32 rises in response to the rise in the voltage of the capacitor C3. That is, the voltage of the capacitor C3 is input to a CMOS inverter (a P-type MOS transistor T33 and an N-type MOS transistor T35). When the voltage at the connection point J32 exceeds the threshold of the inverter D31, the inverter D31 outputs a signal according to the voltage V3 at the connection point J32 with its polarity inverted.

[0057] Inverter D32, inverter D33, and inverter D34 are provided in series in this order. Inverter D32 is connected to node J34, and inverter D34 is connected to node J35. The signal output from inverter D31 is inverted by three inverters, inverter D32, inverter D33, and inverter D34, and then output from inverter D34. The pulse signal output from the inverter D34 is output as an output pulse signal OP3 from an output terminal OUT3 to a connection point J35. The output pulse signal OP3 corresponds to the output pulse signal OP1 shown in FIG.

[0058] The N-type MOS transistor T35 has its source connected to the connection point J33, its gate connected to the connection point J35, and its drain grounded. When the output pulse signal OP3 output from the inverter D34 becomes high for a short period of time, the N-type MOS transistor T35 turns on for that short period of time. When the N-type MOS transistor T35 turns on, the charge stored in the capacitor C3 flows out, and a current I32 flows in the N-type MOS transistor T35 from the source to the drain. The current I32 flows in the N-type MOS transistor T35, resetting the voltage of the capacitor C3.

[0059] Here, the connection points J31, J32, and J33 are collectively referred to as a node. Therefore, the voltage V3 is the voltage of the node. 4 increases due to accumulation of electric charge caused by leakage current I31 from P-type MOS transistor T33 and P-type MOS transistor T34. The way in which the value of voltage V3 increases due to leakage current I31 is expressed as a gradually increasing function that is upwardly convex when the value is expressed as a function of time.

[0060] When the voltage V3 at the node exceeds the threshold of the inverter D31 and an inverted signal is output from the inverter D31, the voltage V3 rises suddenly. The signal output from the inverter D31 is inverted by the three inverters, inverter D32, inverter D33, and inverter D34, and then the N-type MOS transistor T35 turns on with a delay of the time required for the signal to be inverted. When the N-type MOS transistor T35 turns on, the capacitor C3 is reset and the value of the voltage V3 decreases suddenly.

[0061] A peak is formed in the time change of the voltage V3 due to the sudden increase of the voltage V3 at the node caused by the voltage V3 exceeding the threshold of the inverter D31 and the sudden decrease of the voltage V3 caused by the resetting of the capacitor C3. The time when the output pulse signal OP3 becomes high corresponds to the peak in the time change of the voltage V3 at the node.

[0062] As described above, the P-type MOS transistor T33 and the N-type MOS transistor T35 are connected in series between the power supply terminal and the ground terminal. The P-type MOS transistor T33 and the N-type MOS transistor T35 are provided as a CMOS inverter. The inverter D31 generates an inverted signal by inverting the output from the CMOS inverter. The inverter D31 is an example of an inverter.

[0063] The P-type MOS transistor T34 is disposed between the P-type MOS transistor T33 and the N-type MOS transistor T35, and opens and closes in response to an inverted signal generated by an inverter D31. The P-type MOS transistor T34 is an example of a switching element.

[0064] The inverters D32, D33, and D34 delay the output from the CMOS inverter (P-type MOS transistor T33 and N-type MOS transistor T35) and input the delayed output to the CMOS inverter again. The inverters D32, D33, and D34 are an example of a delay circuit.

[0065] The inverter D31, the P-type MOS transistor T34, the inverter D32, the inverter D33, and the inverter D34 are included in a pulse signal generating unit. The pulse signal generating unit includes an inverter (the inverter D31), a switching element (the P-type MOS transistor T34), and a delay circuit (the inverter D32, the inverter D33, and the inverter D34). When the charge amount of the charging unit exceeds a threshold, the pulse signal generating unit generates a pulse signal and resets the charge amount of the charging unit.

[0066] The output terminal OUT3 is an example of a third output terminal. The third output terminal outputs an output pulse signal OP3 generated by the pulse signal generating unit. The output pulse signal OP3 corresponds to the output pulse signal OP1 shown in FIG. 1, and is output to the neuron in the subsequent stage.

[0067] The P-type MOS transistor T31 and the N-type MOS transistor T32 adjust the pulse interval of the output pulse signal OP3. Adjustment of the pulse interval of the output pulse signal OP3 by the P-type MOS transistor T31 and the N-type MOS transistor T32 will be described below.

[0068] An input pulse signal IP31 is input to the input terminal IN31. As shown in Fig. 4, the input pulse signal IP31 is a square wave that goes low for a short period of time in a predetermined cycle. The input terminal IN31 is an example of a third input terminal to which an output pulse signal OP4 (in other words, the pulse signal MP3 shown in Fig. 1) output from the second block circuit (weight adjustment circuit 4) is input. The P-type MOS transistor T31 has its source connected to the power supply terminal P31, its gate connected to the input terminal IN31, and its drain connected to the connection point J31.

[0069] When the input pulse signal IP31 input to the gate of the P-type MOS transistor T31 becomes low for a short time, the P-type MOS transistor T31 turns on for the short time. When the P-type MOS transistor T31 turns on, a current I33 flows through the P-type MOS transistor T31 from the source to the drain. When the current I33 flows through the P-type MOS transistor T31, a charge is accumulated in the capacitor C3. As described above, a charge is also accumulated in the capacitor C3 due to the leakage current I31 flowing through the P-type MOS transistors T33 and T34. Therefore, when the P-type MOS transistor T31 turns on, a larger charge is accumulated in the capacitor C3 than when the P-type MOS transistor T31 is off.

[0070] An input pulse signal IP32 is input to the input terminal IN32. As shown in Fig. 4, the input pulse signal IP32 is a square wave that goes high for a short period of time in a predetermined cycle. The input terminal IN32 is an example of a third input terminal to which the output pulse signal OP1 output from the second block circuit (weight adjustment circuit 4) is input. The N-type MOS transistor T32 has its source connected to the connection point J31, its gate connected to the input terminal IN32, and its drain grounded.

[0071] When the input pulse signal IP32 input to the gate of the N-type MOS transistor T32 becomes high for a short time, the N-type MOS transistor T32 turns on for the short time. When the N-type MOS transistor T32 turns on, a current I34 flows through the N-type MOS transistor T32 from the source to the drain. When the current I34 flows through the N-type MOS transistor T32, charge flows out of the capacitor C3. Therefore, when the N-type MOS transistor T32 turns on, less charge accumulates in the capacitor C3 than when the N-type MOS transistor T32 is off.

[0072] As described above, the N-type MOS transistor T32 opens and closes in response to the input pulse signal IP32 indicating an inhibitory input, thereby discharging the charge of the input pulse signal IP32 in the closed state. The N-type MOS transistor T32 is an example of a second low-side switching element. The input pulse signal IP32 is an example of a second input pulse signal.

[0073] The P-type MOS transistor T31 opens and closes in response to an input pulse signal IP31 indicating an excitatory input, thereby generating a pulse voltage indicative of the input pulse signal IP31. The P-type MOS transistor T31 is an example of a second high-side switching element. The input pulse signal IP31 is an example of a first input pulse signal.

[0074] As described above, the charge stored in the capacitor C3 increases or decreases depending on the input of a pulse signal to the P-type MOS transistor T31 or the N-type MOS transistor T32. When the charge stored in the capacitor C3 increases or decreases, the voltage V3 at the node changes. In addition, the output pulse signal OP3 output from the output terminal OUT3 becomes high when the voltage V3 exceeds the threshold of the inverter D31. By changing the voltage V3 at the node by inputting a pulse signal to the P-type MOS transistor T31 or the N-type MOS transistor T32, the time when the voltage V3 exceeds the threshold of the inverter D31 can be adjusted. The pulse interval of the output pulse signal OP3 is determined according to the time when the voltage V3 exceeds the threshold of the inverter D31.

[0075] Therefore, in the LIF neuron circuit 3, the pulse interval of the output pulse signal OP3 can be adjusted by the input pulse signal IP31 or IP32. In other words, in the LIF neuron circuit 3, the output frequency of the output pulse signal OP3 can be increased or decreased by the input pulse signal IP31 or IP32. The input pulse signal IP31 corresponds to an excitatory pulse. The input pulse signal IP32 corresponds to an inhibitory pulse.

[0076] As described above, the capacitor C3 is charged by the pulse voltage representing the input pulse signal (the input pulse signal IP31 or the input pulse signal IP32). The capacitor C3 is an example of a second capacitor that is charged by the pulse voltage representing the output pulse signal OP4 (that is, the input pulse signal IP31 or the input pulse signal IP32) input to the third input terminal (the input terminal IN31 or the input terminal IN32).

[0077] Here, the input pulse signal IP31 or the input pulse signal IP32 is an output pulse signal OP4 output from a weight adjustment circuit 4 provided in the preceding stage of the LIF neuron circuit 3. For example, two weight adjustment circuits 4 are provided in the preceding stage of the LIF neuron circuit 3, and the input pulse signal IP31 is input from one weight adjustment circuit 4, and the input pulse signal IP32 is input from the other weight adjustment circuit 4. In addition, a synapse element circuit 2 is provided in the preceding stage of each of these weight adjustment circuits 4.

[0078] Therefore, the frequency with which the pulse signal generating unit generates the output pulse signal OP3 increases or decreases depending on the frequency with which the output pulse signal OP4 output from the weight adjustment circuit 4 is input to the third input terminal (input terminal IN31 or input terminal IN32).

[0079] In addition, either the P-type MOS transistor T31 or the N-type MOS transistor T32 may be omitted from the configuration of the LIF neuron circuit 3. For example, if the LIF neuron circuit 3 is only intended to shorten the pulse interval, it is sufficient to provide the P-type MOS transistor T31. On the other hand, if the LIF neuron circuit 3 is only intended to lengthen the pulse interval, it is sufficient to provide the N-type MOS transistor T32.

[0080] The pulse interval of the output pulse signal OP3 also depends on the size of the transistors (P-type MOS transistor T31, N-type MOS transistor T32, P-type MOS transistor T33, P-type MOS transistor T34, and N-type MOS transistor T35) included in the LIF neuron circuit 3. Therefore, the pulse interval of the output pulse signal OP3 output from the LIF neuron circuit 3 can be adjusted by adjusting the size of the transistors included in the LIF neuron circuit 3. However, since the size of the transistor is determined at the time of assembling the LIF neuron circuit 3, the adjustment of the pulse interval by the size of the transistor is an adjustment made at the time of assembling the LIF neuron circuit 3.

[0081] The magnitude of the leakage current I31 is much smaller than the magnitude of the current I33 flowing through the P-type MOS transistor T31 or the magnitude of the current I34 flowing through the N-type MOS transistor T32. Furthermore, leakage current also flows through the P-type MOS transistor T31 and the N-type MOS transistor T32 even when they are in the off state. The charge stored in the capacitor C3 also increases or decreases due to the leakage current flowing through the P-type MOS transistor T31 and the N-type MOS transistor T32. Charge is stored in the capacitor C3 due to the leakage current flowing through the P-type MOS transistor T31. Charge flows out of the capacitor C3 due to the leakage current flowing through the N-type MOS transistor T32.

[0082] In the module circuit 1, by including the LIF neuron circuit 3, the relationship between the pulse interval of the input pulse signal (input pulse signal IP1 shown in FIG. 1) and the pulse interval of the output pulse signal (output pulse signal OP1 shown in FIG. 1) becomes nonlinear.

[0083] The LIF neuron circuit 3 may be omitted from the configuration of the module circuit 1. In that case, the output pulse signal OP2 output from the synapse element circuit 2 is directly input to the input terminal IN4, which is the second input terminal.

[0084] As described above, the configuration of the low-side switching element may be omitted from the configuration of the synapse element circuit 2. In this embodiment, the synapse element circuit 2 includes a low-side switching element, so that an input pulse signal IP22 indicating an inhibitory input can be input to the synapse element circuit 2. Therefore, in the synapse element circuit 2 including the configuration of the low-side switching element, even if the LIF neuron circuit 3 is omitted from the configuration of the module circuit 1, the greater the frequency and width of the pulse input to the synapse element circuit 2, the lower the frequency of the output pulse can be.

[0085] As a result, even if the LIF neuron circuit 3 is omitted from the configuration of the module circuit 1, when the module circuit 1 is applied to a neural network as described below, the operation of the neural network can be stabilized. In this embodiment, the function of stabilizing the operation of the neural network is carried out by the LIF neuron circuit 3.

[0086] [Application to reservoir circuits and spiking neural networks] Next, with reference to Figs. 5 to 11, an example of application of the module circuit 1, which is an LIF element, to a reservoir circuit and a spiking NN (Neural Network) will be described. 5 is a diagram showing an example of the configuration of the reservoir circuit N1 according to this embodiment. As an example, the reservoir circuit N1 is composed of three layers, an input layer, a middle layer, and an output layer. The input layer includes LIF elements M11, M12, M13, and M14. The middle layer includes LIF elements M21, M22, and M23. The output layer includes LIF elements M31, M32, M33, and M34. Each of these LIF elements (LIF elements M11, M12, . . . , M34) has the same configuration as the module circuit 1 shown in FIG. 1. In other words, the reservoir circuit N1 is a reservoir circuit including a plurality of module circuits 1.

[0087] Here, for example, attention is paid to LIF elements M11 and M12 provided in the input layer, and LIF element M21 provided in the middle layer. An output terminal OUT3 (FIG. 4) provided in the LIF element M11 is connected to an input terminal IN21 or an input terminal IN22 (FIG. 2) provided in the LIF element M21. An output terminal OUT3 (FIG. 4) provided in the LIF element M12 is connected to an input terminal IN21 or an input terminal IN22 (FIG. 2) provided in the LIF element M21. As a result, an output pulse signal OP3 outputted from each of the LIF elements M11 and M12 is inputted to the LIF element M21 as an input pulse signal IP21 or an input pulse signal IP22. Therefore, the output terminal OUT3 included in each of the one or more modular circuits 1 and the input terminal IN21 or the input terminal IN22 included in one modular circuit 1 are connected.

[0088] On the other hand, for example, attention is paid to the LIF element M12 provided in the input layer, and the LIF elements M21 and M22 provided in the middle layer. The output terminal OUT3 (FIG. 4) provided in the LIF element M12 is connected to the input terminal IN21 or the input terminal IN22 (FIG. 2) provided in the LIF element M21. The output terminal OUT3 (FIG. 4) provided in the LIF element M12 is connected to the input terminal IN21 or the input terminal IN22 (FIG. 2) provided in the LIF element M22. As a result, the output pulse signal OP3 output from the LIF element M12 is input to the LIF elements M21 and M22 as the input pulse signal IP21 or the input pulse signal IP22, respectively. Therefore, the output terminal OUT3 of one module circuit 1 and the input terminal IN21 or the input terminal IN22 of each of one or more module circuits 1 are connected.

[0089] Next, the results of the operation check performed when one synapse element circuit 2, one weight adjustment circuit 4, and one LIF neuron circuit 3 are connected in this order will be described. FIG. 6 is a diagram showing an example of the operation check result when one synapse element circuit, one weight adjustment circuit, and one LIF neuron circuit according to this embodiment are connected. The multiple graphs shown in FIG. 6 show the time changes of each value of the weight setting, the excitatory pulse, the intraneuron integration terminal, the neuron output pulse, the intrasynaptic integration output, the integration result readout, and the synapse output signal. In the operation check result shown in FIG. 6, only the excitatory pulse is input to the LIF neuron circuit 3, and no inhibitory pulse is input.

[0090] The weight setting indicates data for setting the duty ratio of the weight adjustment circuit 4. In other words, it indicates the value of a signal that instructs the multiplexer M4 (FIG. 3) provided in the weight adjustment circuit 4 to select one of the multiple delay elements constituting the delay line D42 as a delay element from which a pulse signal is to be extracted. The excitatory pulse indicates the value of the input pulse signal IP4 input to the input terminal IN4 provided in the weight adjustment circuit 4. The excitatory pulse is a pulse signal generated with a constant period, amplitude, and duty ratio.

[0091] The intra-neuron integration terminal indicates the value of the voltage V3 of the nodes (connection points J31, J32, and J33) included in the LIF neuron circuit 3. The value of the node voltage V3 is equal to the value of the voltage of the capacitor C3 as described above. The neuron output pulse indicates the value of the output pulse signal OP3 output from the output terminal OUT3 provided in the LIF neuron circuit 3.

[0092] The intra-synaptic integration output indicates the value of the voltage V2 at the nodes (connection point J21, connection point J22, and connection point J23) included in the synapse element circuit 2. The value of the node voltage V2 is equal to the value of the voltage of the capacitor C2, as described above. The integration result readout indicates the value of the signal output from the output terminal OUT21 of the synapse element circuit 2. The synapse output signal indicates the value of the output pulse signal OP2 output from the output terminal OUT22 of the synapse element circuit 2.

[0093] From the intra-synapse integration output or the time change in the integration result readout, it is understood that the synapse element circuit 2 functions as an LIF element.

[0094] 6, the average power consumption in the LIF neuron circuit 3 was 2.5 nW (nanowatts), and the average power consumption in the synapse element circuit 2 was 3.0 nW.

[0095] Fig. 7 is a diagram showing an example of the operation check result when one synapse element circuit, one weight adjustment circuit, and one LIF neuron circuit according to the present embodiment are connected. The graphs shown in Fig. 7 show the time changes of each value of the excitatory pulse, the inhibitory pulse, the intra-synaptic integral output, the integral result readout, the synaptic output signal, the intra-neuron integral terminal, and the neuron output pulse. In the operation check result shown in Fig. 7, an excitatory pulse and an inhibitory pulse are input to the LIF neuron circuit 3.

[0096] The excitatory pulse indicates the value of the input pulse signal IP31 input to the input terminal IN4 provided in the weight adjustment circuit 4. The excitatory pulse is a pulse signal generated with a constant period, amplitude, and duty ratio. The inhibitory pulse indicates the value of the input pulse signal IP32 input to the input terminal IN32 provided in the weight adjustment circuit 4. The inhibitory pulse is a pulse signal generated with a constant period, amplitude, and duty ratio. The meanings of the other intra-synaptic integration outputs, integration result readouts, synapse output signals, intra-neuron integration terminals, and neuron output pulses are the same as those in FIG. 6, and therefore will not be described.

[0097] The time changes of the values ​​of the intra-synaptic integration output, integration result readout, synaptic output signal, intra-neuron integration terminal, and neuron output pulse are different from those shown in FIG. 6 because an excitatory pulse and an inhibitory pulse are input to the LIF neuron circuit 3 in the operation confirmation results shown in FIG. 7.

[0098] During the period when the inhibitory pulse is input, the neuron output pulse is always low. Also, during the period when the pulse interval of the excitatory pulse is short, the pulse interval of the neuron output pulse is short. In other words, as described above, in the LIF neuron circuit 3, the output frequency of the output pulse signal OP3 can be increased or decreased by the input pulse signal IP31 which is an excitatory pulse or the input pulse signal IP32 which is an inhibitory pulse.

[0099] Next, the results of operation check of a spiking NN configured by a module circuit 1 that is an LIF element will be described. FIG. 8 is a diagram showing an example of the results of operation check of a spiking NN according to this embodiment. As an example, the spiking NN is configured by four module circuits 1. The multiple graphs shown in FIG. 8 show the time changes of each value of the spike output, the integral output, and the VCO (Voltage-controlled oscillator) output. The multiple graphs shown in FIG. 8 show the values ​​of the spike output, the integral output, and the VCO output for each of the four module circuits 1.

[0100] The spike output indicates the value of the output pulse signal OP3 output from the output terminal OUT3 provided in the LIF neuron circuit 3. The integral output indicates the value of the voltage V2 at the nodes (connection point J21, connection point J22, and connection point J23) included in the synapse element circuit 2. The four integral outputs are different for each of the four module circuits 1. By adjusting the four integral outputs, the four module circuits 1 can be operated as a spiking NN. The VCO output indicates the value of the output pulse signal OP2 output from the output terminal OUT22 provided in the synapse element circuit 2.

[0101] Next, the results of learning performed by the above-mentioned spiking NN will be explained. 9 is a diagram showing an example of a time change of a synapse output signal according to the present embodiment. The synapse output signal indicates the value of an output pulse signal OP2 output from an output terminal OUT21 included in the synapse element circuit 2.

[0102] In Fig. 9, a teacher signal is shown together with the synapse output signal. The teacher signal is a signal for learning that makes the value of the synapse output signal closer to the value of the teacher signal. The teacher signal is input during the period from the time shown as "RLS on" to the time shown as "off" in Fig. 9.

[0103] The graph of the synapse output signal almost overlaps with the graph of the teacher signal during the period when the teacher signal is input. The graph of the synapse output signal shows the same time change during the period after the input of the teacher signal has ended (the period after the time shown as "off") as during the period when the teacher signal is input. In other words, the graph of the synapse output signal changes due to the teacher signal so as to show the same time change as the graph of the teacher signal. In other words, it can be seen that learning can be realized by a spiking NN composed of the module circuit 1.

[0104] Fig. 10 is a diagram showing an example of a time change of a neuron voltage according to the present embodiment. The neuron voltage indicates a value of a voltage V3 of the nodes (connection points J31, J32, and J33) provided in the LIF neuron circuit 3, similarly to the above-mentioned intra-neuron integration terminal (Figs. 6 and 7).

[0105] 11 is a diagram showing an example of a change over time in a synapse current according to the present embodiment. The synapse current indicates the value of a voltage V2 at the nodes (connection points J21, J22, and J23) in the synapse element circuit 2, similar to the above-mentioned intrasynaptic integral output (FIGS. 6 and 7).

[0106] As described above, the module circuit 1 according to this embodiment includes a first block circuit (in this embodiment, the synapse element circuit 2) and a second block circuit (in this embodiment, the weight adjustment circuit 4). The first block circuit (in this embodiment, the synapse element circuit 2) includes a first input terminal (in this embodiment, the input terminal IN21), a holding unit (in this embodiment, the capacitor C2), an oscillator unit (in this embodiment, the ring oscillator O2), and a first output terminal (in this embodiment, the output terminal OUT22). The first input terminal (in this embodiment, the input terminal IN21) receives the input pulse signal IP1. The holding section (capacitor C2 in this embodiment) holds the average value of the input pulse signal IP1 for a predetermined period according to the interval of the input pulse signal IP1 and the width of the input pulse signal IP1. An oscillator (in this embodiment, a ring oscillator O2) generates an output pulse signal OP2 at a frequency according to the average value. The first output terminal (in this embodiment, the output terminal OUT22) outputs an output pulse signal OP2. The second block circuit (in this embodiment, the weight adjustment circuit 4) has a second input terminal (in this embodiment, the input terminal IN4), a duty ratio adjuster (in this embodiment, an inverter D41, a delay line D42, and a multiplexer M4), and a second output terminal (in this embodiment, the output terminal OUT4). The second input terminal (input terminal IN4 in this embodiment) receives the output pulse signal OP2 output from the first block circuit (synapse element circuit 2 in this embodiment). The duty ratio adjuster (in this embodiment, an inverter D41, a delay line D42, and a multiplexer M4) adjusts the duty ratio of the output pulse signal OP2. The second output terminal (in this embodiment, the output terminal OUT4) outputs an output pulse signal (in this embodiment, the output pulse signal OP4) adjusted by a duty ratio adjuster (in this embodiment, the inverter D41, the delay line D42, and the multiplexer M4).

[0107] With this configuration, the module circuit 1 according to this embodiment can output an output pulse signal at a frequency according to time domain information such as the interval between input pulse signals and the width of the pulse signal, thereby achieving low power consumption in the LIF element.

[0108] The module circuit 1 according to the present embodiment relates to a low-power integrated circuit implementation method for neuron elements used in neural networks and the like. The module circuit 1 according to the present embodiment does not use voltage or current as information, but uses information in the time domain, such as the period and pulse width of a binary pulse signal of low and high values, thereby enabling low power consumption, low heat generation, and high integration. The module circuit 1 according to the present embodiment operates mainly by utilizing the leakage current flowing through transistors in the off state, and therefore can operate with extremely low power consumption. The module circuit 1 according to the present embodiment can operate with low power consumption, does not require a large capacity, and can realize a time constant in the millisecond order with a relatively small area.

[0109] Unlike conventional analog LIF elements, the module circuit 1 according to this embodiment adjusts the time for transitioning between binary voltages of 0 and 1 without precisely controlling analog quantities that are sensitive to noise, etc. Therefore, it has the advantages of being easy to realize even in low-voltage process technology, having high affinity with advanced processes, and enabling increased integration.

[0110] (Example) In the following, examples of the present invention will be described. The module circuits used in the examples described below were fabricated as semiconductor chips as shown in FIG. 12. The enlarged region R2 is an enlarged region of the rectangular region R1 in the semiconductor chip. The enlarged region R2 has a long side length of 70 μm and a short side length of 30 μm. The area of ​​the semiconductor chip of the LIF neuron circuit is 127 mm 2 The area of ​​the semiconductor chip for the synapse element circuit is 231 mm 2 The area of ​​the weight adjustment circuit semiconductor chip is 525 mm 2 It is.

[0111] In the examples described below, the configuration of the synapse element circuit 20 is the same as the configuration of the synapse element circuit 2 according to the above-mentioned embodiment (FIG. 2). The configuration of the weight adjustment circuit 40 is the same as the configuration of the weight adjustment circuit 4 according to the above-mentioned embodiment (FIG. 3). The configuration of the LIF neuron circuit 30 is the same as the configuration of the LIF neuron circuit 3 according to the above-mentioned embodiment (FIG. 4). Therefore, in the examples described below, the symbols used in the above-mentioned embodiment may be used for explanation.

[0112] (First Example) In the first embodiment, a description will be given of the results of measuring the operation of an actually fabricated circuit in the case where one weight adjustment circuit and one LIF neuron circuit are connected. 13 is a diagram showing an example of the configuration of a module circuit 10a according to this embodiment. The module circuit 10a includes a pulse generator 50, a weight adjustment circuit 40, and an LIF neuron circuit 30. The pulse generator 50, the weight adjustment circuit 40, and the LIF neuron circuit 30 are connected in series in this order and included in the module circuit 10a.

[0113] The pulse generator 50 generates a 100 Hz rectangular wave as the input pulse signal IP4. The input pulse signal IP4 generated by the pulse generator 50 is input to the input terminal IN4 of the weight adjustment circuit 40. When the input pulse signal IP4 is input to the input terminal IN4, an output pulse signal OP4 is output from the output terminal OUT4 of the weight adjustment circuit 40. The output pulse signal OP4 output from the weight adjustment circuit 40 is input to the input terminal IN31 of the LIF neuron circuit 30. A spike signal V is output as the output pulse signal OP3 from the output terminal OUT3 of the LIF neuron circuit 30. spike will be output.

[0114] FIG. 14 shows a spike signal V output from the module circuit 10a as a result of measuring the operation of the module circuit 10a. spike 14(A), 14(B), 14(C), and 14(D) show the waveforms of the spike signal V when the weighting value for adjusting the pulse width of the output pulse signal OP4 by the weighting adjustment circuit 40 is 1, 2, 4, and 8, respectively. spike As shown in FIG. 14, the larger the weight, the smaller the spike signal V spike It was confirmed that the spike period of

[0115] (Second Example) In the second embodiment, a description will be given of the results of measuring the operation of an actually fabricated circuit in the case where two weight adjustment circuits are connected to two input terminals of one LIF neuron circuit. 15 is a diagram showing an example of the configuration of a module circuit 10b according to this embodiment. The module circuit 10b includes a pulse generator 51, a pulse generator 52, a weight adjustment circuit 41, a weight adjustment circuit 42, and an LIF neuron circuit 30. The pulse generator 51 and the weight adjustment circuit 41 are connected in series in this order. The pulse generator 52 and the weight adjustment circuit 42 are connected in series in this order. The pulse generator 51 and the weight adjustment circuit 41 connected in series, and the pulse generator 52 and the weight adjustment circuit 42 connected in series are connected in parallel to the LIF neuron circuit 30.

[0116] The configurations of the weight adjustment circuits 41 and 42 are similar to that of the weight adjustment circuit 40. The configurations of the pulse generators 51 and 52 are similar to that of the pulse generator 50. An input pulse signal IP4 which is a 100 Hz rectangular wave generated by the pulse generator 51 is input to an input terminal IN4 of the weight adjustment circuit 41, and is output from an output terminal OUT4 of the weight adjustment circuit 41 as an output pulse signal OP4. Similarly, an input pulse signal IP4 which is a 100 Hz rectangular wave generated by the pulse generator 52 is input to an input terminal IN4 of the weight adjustment circuit 42, and is output from an output terminal OUT4 of the weight adjustment circuit 42 as an output pulse signal OP4.

[0117] The output pulse signal OP4 output from the weight adjustment circuit 41 is input to the input terminal IN31 of the LIF neuron circuit 30 as the input pulse signal IP31, which is an excitatory pulse. On the other hand, the output pulse signal OP4 output from the weight adjustment circuit 42 is input to the input terminal IN32 of the LIF neuron circuit 30 as the input pulse signal IP32, which is an inhibitory pulse. The output terminal OUT3 of the LIF neuron circuit 30 outputs a spike signal V spike will be output.

[0118] FIG. 16 shows a spike signal V output from the module circuit 10b as a result of measuring the operation of the module circuit 10b. spike 16A shows the waveform of a spike signal V when no signal is input to the input terminal IN31 and an inhibitory pulse (input pulse signal IP32) is input to the input terminal IN32. spike FIG. 16B shows the waveform of the spike signal V when no signal is input to either the input terminal IN31 or the input terminal IN32. spike FIG. 16C shows the waveform of the spike signal V when an excitatory pulse (input pulse signal IP31) is input to the input terminal IN31 and no signal is input to the input terminal IN32. spikeAs shown in FIG. 16B, the LIF neuron circuit 30 periodically outputs a spike signal V spike As shown in FIG. 16(A), when an inhibitory pulse is input from the input terminal IN32, the spike signal V spike On the other hand, as shown in FIG. 16(C), when an excitatory pulse is input from the input terminal IN31, the period of the spike signal V spike The period becomes shorter.

[0119] (Third Example) In the third embodiment, a description will be given of the results of measuring the operation of an actually fabricated circuit in the case where the module circuit according to the second embodiment is connected to a synapse circuit. 17 is a diagram showing an example of the configuration of a module circuit 10c according to this embodiment. Comparing the configuration of the module circuit 10c with the configuration of the module circuit 10b (FIG. 15) according to the second embodiment, the synapse element circuit 20 is different. In the module circuit 10c, the synapse element circuit 20 is connected in series to the LIF neuron circuit 30.

[0120] The spike signal V output from the output terminal OUT3 of the LIF neuron circuit 30 spike is input to the input terminal IN22 of the synapse element circuit 20. A pulse signal V generated by the ring oscillator O2 is output from the output terminal OUT22 of the synapse element circuit 20. ring is output as the output pulse signal OP2.

[0121] FIG. 18 shows a pulse signal V output from the module circuit 10c as a result of measuring the operation of the module circuit 10c. ring 18A shows the waveform of the pulse signal V when no signal is input to the input terminal IN31 and an inhibitory pulse (input pulse signal IP32) is input to the input terminal IN32. ring FIG. 16B shows the waveform of the pulse signal V when no signal is input to either the input terminal IN31 or the input terminal IN32. ringFIG. 16C shows the waveform of the pulse signal V when an excitatory pulse (input pulse signal IP31) is input to the input terminal IN31 and no signal is input to the input terminal IN32. ring As shown in FIG. 18B, the synapse element circuit 20 detects the waveform of the spike signal V spike A pulse signal V is periodically generated according to the ring As shown in Fig. 18(A), when an inhibitory pulse is input from input terminal IN32, the frequency of the square wave decreases. On the other hand, as shown in Fig. 18(C), when an excitatory pulse is input from input terminal IN31, the frequency of the square wave increases.

[0122] (Fourth Example) In the fourth embodiment, a description will be given of the results of measuring the operation of an actually fabricated circuit in which one weight adjustment circuit and one synapse circuit are connected. 19 is a diagram showing an example of the configuration of a module circuit 10d according to this embodiment. The module circuit 10d includes a pulse generator 50, a weight adjustment circuit 40, and a synapse element circuit 20. The pulse generator 50, the weight adjustment circuit 40, and the synapse element circuit 20 are connected in series in this order and included in the module circuit 10d.

[0123] The pulse generator 50 generates a 10 Hz rectangular wave as the input pulse signal IP4. The input pulse signal IP4 generated by the pulse generator 50 is input to an input terminal IN4 of the weight adjustment circuit 40. When the input pulse signal IP4 is input to the input terminal IN4, an output pulse signal OP4 is output from an output terminal OUT4 of the weight adjustment circuit 40. The output pulse signal OP4 output from the weight adjustment circuit 40 is input to an input terminal IN22 of the synapse element circuit 20. A synapse potential signal V SYN is output as a signal (integration result readout). Meanwhile, a pulse signal V ring will be output.

[0124] FIG. 20 shows a synapse potential signal V SYN The waveform of the pulse signal V ring FIG. 20(A) shows the waveform of the synaptic potential signal V SYN FIG. 20(B) shows the waveform of the pulse signal V ring As shown in FIG. 20A, in the module circuit 10d, when an input is input to the input terminal IN22, first, the synapse potential signal V SYN increases instantaneously, and then the synaptic potential signal V SYN On the other hand, as shown in FIG. 20(B), the pulse signal V ring is the synaptic potential signal V SYN The synapse potential signal V SYN When increases, the pulse signal V ring If there is no input to the input terminal IN22, the frequency of the synaptic potential signal V SYN decreases, and the pulse signal V ring The frequency of becomes smaller.

[0125] Although one embodiment of the present invention has been described in detail above with reference to the drawings, the specific configuration is not limited to the above, and various design changes, etc. are possible within the scope that does not deviate from the gist of the present invention. [Explanation of symbols]

[0126] 1...module circuit, 2...synapse element circuit, 4...weight adjustment circuit, IN2...input terminal, C2...capacitor, O2...ring oscillator, OUT22...output terminal, IN4...input terminal, D41...inverter, D42...delay line, M4...multiplexer, OUT4...output terminal, IP1...input pulse signal, OP2, OP4...output pulse signal

Claims

1. A first block circuit; A second block circuit; Equipped with The first block circuit includes: a first input terminal to which an input pulse signal is input; a holding unit that holds an average value of the input pulse signal for a predetermined period in accordance with an interval of the input pulse signal and a width of the input pulse signal; an oscillator for generating an output pulse signal at a frequency corresponding to the average value; a first output terminal for outputting the output pulse signal; Equipped with The second block circuit includes: a second input terminal to which the output pulse signal output from the first block circuit is input; a duty ratio adjuster for adjusting a duty ratio of the output pulse signal; a second output terminal for outputting the output pulse signal adjusted by the duty ratio adjuster; Equipped Module circuit.

2. The first block circuit includes: the holding unit includes a capacitor, integrates a pulse voltage representing the input pulse signal, and holds a result of integrating the pulse voltage as the average value; the oscillation unit receives an integral current from the holding unit, the integral current increasing monotonically with respect to a result of integrating the pulse voltage obtained by the holding unit integrating the pulse voltage, and generates the output pulse signal having a frequency that depends on the magnitude of the integral current; a high-side switching element that opens and closes in response to the input pulse signal indicative of an excitatory input to form the pulse voltage that is charged to the capacitor; Equipped 2. The module circuit of claim 1.

3. The first block circuit includes: The input pulse signal indicates an inhibitory input, and the low-side switching element opens and closes in response to the input pulse signal to discharge the charge in the capacitor.

3. The module circuit of claim 2.

4. The first block circuit further includes an inflow limiter that limits an inflow of the integral current from the holding unit to the oscillation unit.

3. The module circuit of claim 2.

5. A third blocking circuit is further included, The third block circuit includes: a third input terminal to which the output pulse signal output from the second block circuit is input; a charging section that is charged by a leakage current of a MOS transistor; a pulse signal generating unit that generates a pulse signal and resets the charge amount of the charging unit when the charge amount of the charging unit exceeds a threshold value; a third output terminal that outputs the pulse signal generated by the pulse signal generating unit; Equipped with The frequency at which the pulse signal generating unit generates the output pulse signal increases or decreases according to the frequency at which the output pulse signal is input to the third input terminal.

2. The module circuit of claim 1.

6. The third block circuit includes: a CMOS inverter including a P-type MOS transistor and an N-type MOS transistor connected in series between a power supply terminal and a ground terminal; an inverter that generates an inverted signal by inverting an output from the CMOS inverter; a switching element that is disposed between the P-type MOS transistor and the N-type MOS transistor and opens and closes in response to the inverted signal; a delay circuit which delays an output from the CMOS inverter and inputs the delayed output back to the CMOS inverter; a second capacitor that is charged by a pulse voltage representing the output pulse signal input to the third input terminal; at least one of a second low-side switching element that opens and closes in response to a second input pulse signal indicative of an inhibitory input, thereby discharging the charge of the second capacitor in a closed state, and a second high-side switching element that opens and closes in response to a first input pulse signal indicative of an excitatory input, thereby generating a pulse voltage indicative of the first input pulse signal; Equipped with the charging unit includes the second capacitor, the pulse signal generating unit includes the inverter, the switching element, and the delay circuit, The voltage of the second capacitor is input to the CMOS inverter.

6. The module circuit of claim 5.

7. A plurality of module circuits according to any one of claims 1 to 6 are provided, A linear combination of the average values ​​of the input pulse signals input to each of the plurality of module circuits is used as an output signal, and the coefficients of the linear combination are used as learning targets. Reservoir circuit.

8. The second output terminal provided in each of the one or more module circuits is connected to the first input terminal provided in one of the module circuits, or the second output terminal provided in one of the module circuits is connected to the first input terminal provided in each of the one or more module circuits. The reservoir circuit of claim 7.

Images