Reconfigurable optical convolution operation device and optical convolution operation method

Abstract

The present invention provides a reconfigurable optical convolution operation device and an optical convolution operation method, which relate to the field of optical computing, and include: a multi-wavelength signal loading module, which is used to generate N continuous carrier lasers of different wavelengths, and respectively modulate the N continuous carrier lasers of different wavelengths, so that each wavelength of the continuous carrier laser carries K data, and obtains N laser signals of different wavelengths; a data shift processing module, which is used to equally divide the laser signal of each wavelength in the N different wavelengths into M laser signals, perform a timing shift operation on the M laser signals corresponding to each wavelength, combine laser signals with the same timing shift in the laser signals of different wavelengths, and transmit the data through the same data port, so that the data obtained after the adjacent laser signals in the M laser signals corresponding to each wavelength are shifted differ by one bit in timing; and a reconfigurable optical convolution module, which is used to simultaneously perform parallel convolution operation on N×K data, and obtain parallel convolution results.

Description

Technical Field

[0001] The present invention relates to the field of optical computing technology, and in particular to a reconfigurable optical convolution operation device and an optical convolution operation method. Background Art

[0002] In recent years, with the rapid development of artificial intelligence technologies represented by neural networks, deep learning, and large models, the requirements for fast computing and processing of massive data have continued to increase. However, the manufacturing process of traditional electronic chips is difficult to significantly reduce, and its energy efficiency and computing efficiency cannot be improved through large-scale expansion. Summary of the invention

[0003] In view of the above problems, the present invention provides a reconfigurable optical convolution operation device and an optical convolution operation method, which are used to at least partially solve the above technical problems.

[0004] A first aspect of an embodiment of the present invention provides a reconfigurable optical convolution operation device, comprising: a multi-wavelength signal loading module, used to generate N continuous carrier lasers of different wavelengths, and modulate the N continuous carrier lasers of different wavelengths respectively, so that each wavelength of the continuous carrier laser carries K data, and obtains N laser signals of different wavelengths; a data shift processing module, used to divide the laser signal of each wavelength in the N different wavelengths into M laser signals, perform a timing shift operation on the M laser signals corresponding to each wavelength, and combine the laser signals with the same timing shift in the laser signals of different wavelengths and transmit the data through the same data port, wherein the data obtained after the adjacent laser signals in the M laser signals corresponding to each wavelength are shifted differ by one bit in timing; a reconfigurable optical convolution module, used to perform parallel convolution operations on N×K data at the same time to obtain parallel convolution results; wherein the value of the convolution kernel is regulated by external control; wherein N, M, and K are all positive integers greater than or equal to 1.

[0005] According to an embodiment of the present invention, a multi-wavelength signal loading module device includes: a multi-wavelength laser array, including N lasers, each laser is used to generate a continuous carrier laser of a different wavelength; a modulator array, including N modulators, each modulator is used to modulate a continuous carrier laser of a wavelength, and N groups of information are loaded into N continuous carrier lasers of different wavelengths respectively, wherein each group contains K data.

[0006] According to an embodiment of the present invention, a data shift processing module includes: an optical beam splitter array, including N 1×M optical beam splitters, each 1×M optical beam splitter is used to split and fan out each single wavelength input carrying a group of K data; a delay shift array, including N delay shift groups, each group contains M or M-1 delay shift units, each delay shift group is used to shift the timing of M laser signals fanned out by a 1×M optical beam splitter; a wavelength division multiplexer array, including M wavelength division multiplexers, each wavelength division multiplexer is used to combine laser signals with the same timing shift in laser signals of different wavelengths to the same output port, wherein each output port contains N laser signals of different wavelengths.

[0007] According to an embodiment of the present invention, the delay shift unit includes an optical delay line or a phase modulator.

[0008] According to an embodiment of the present invention, the reconfigurable optical convolution module includes: an M×I multimode interference coupler, a cascaded convolution kernel control unit, and an output detection unit; the M×I multimode interference coupler is used to generate a transfer matrix that matches the output port of the data shift processing module and the input of the cascaded convolution kernel control unit; the cascaded convolution kernel control unit is used to realize the control of the overall transmission matrix of the reconfigurable optical convolution module so as to perform parallel convolution operations on N×K data at the same time; the output detection unit includes an output detection of O output signals, which is used to realize the photoelectric conversion process and simultaneously detect the intensities of different wavelengths in each output to obtain parallel convolution results, where O is an integer greater than or equal to 1.

[0009] According to an embodiment of the present invention, the cascaded convolution kernel control unit includes at least one internal control unit and a matching control unit connected in series; the internal control unit includes an array including I phase shifters and an I×I multimode interference coupler, the array including I phase shifters is used to perform phase control on each input laser signal, and the I×I multimode interference coupler is used to distribute each processed input laser signal to I output ports; the matching control unit includes an array including I phase shifters and an I×O multimode interference coupler, the array including I phase shifters is used to perform phase control on each input laser signal, and the I×O multimode interference coupler is used to match the laser signal after the internal control unit to O output ports, where I is an integer greater than or equal to 1.

[0010] According to an embodiment of the present invention, the number of input ports of the first internal control unit in the series connection is M, the number of input ports and output ports of the remaining internal control units is any positive integer, and the number of adjacent input ports and output ports is the same.

[0011] According to an embodiment of the present invention, the output detection unit includes: a wavelength division multiplexer array and a photodetector array; the wavelength division multiplexer array includes O wavelength division multiplexers, which are used to perform wavelength division multiplexing on the laser signal of each output port, input the signal light of different wavelengths into the detectors respectively, and extract the parallel operation results; the photodetector array includes O×N photodetectors, and each output signal passes through a group of N photodetectors to detect the light intensity of different wavelengths and convert them into electrical signals as the result of the convolution operation.

[0012] According to an embodiment of the present invention, the output detection unit includes: a multi-channel spectrometer, which is used to detect the intensity value of each wavelength in each optical signal; wherein the intensity value of each wavelength in one channel is used as a reference value, and the intensity value of each wavelength in the remaining optical signals is calculated as the value of the convolution kernel.

[0013] Another aspect of an embodiment of the present invention provides an optical convolution operation, which is implemented based on the above-mentioned reconfigurable optical convolution operation device, including: using a multi-wavelength signal loading module to generate N continuous carrier lasers of different wavelengths, and modulating the N continuous carrier lasers of different wavelengths respectively, so that each wavelength of the continuous carrier laser carries K data, and obtains N laser signals of different wavelengths; using a data shift processing module to divide the laser signal of each wavelength in the N different wavelengths into M laser signals, performing a timing shift operation on the M laser signals corresponding to each wavelength, and combining the laser signals with the same timing shift in the laser signals of different wavelengths through the same data port data, wherein the data obtained after the adjacent laser signals in the M laser signals corresponding to each wavelength are shifted differ by one bit in timing; using a reconfigurable optical convolution module to simultaneously perform parallel convolution operations on N×K data to obtain parallel convolution results; wherein the value of the convolution kernel is regulated by an external control; wherein N, M, and K are all positive integers greater than or equal to 1.

[0014] The reconfigurable optical convolution operation device and optical convolution operation method provided by the present invention have at least the following technical effects:

[0015] After the data shift processing module performs a time-series shift operation on the M laser signals corresponding to each wavelength, the reconfigurable optical convolution module is used to perform parallel convolution operations on N×K data at the same time, realizing multi-channel parallel computing and greatly improving the computational efficiency of large-scale convolution operations. By propagating multi-wavelength signal light in the cascaded multi-mode interference coupler structure of the controllable transmission matrix, multi-channel parallel computing is better realized, further improving the computational efficiency of large-scale convolution operations. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] The above contents and other objects, features and advantages of the present invention will become more apparent through the following description of the embodiments of the present invention with reference to the accompanying drawings, in which:

[0017] Figure 1 The schematic diagram shows the structure of a reconfigurable optical convolution operation device provided according to an embodiment of the present invention;

[0018] Figure 2 The structure diagram of the wavelength signal loading module provided according to the embodiment of the present invention is schematically shown;

[0019] Figure 3 A schematic diagram of the structure of a data shift processing module provided according to an embodiment of the present invention is shown;

[0020] Figure 4 The schematic diagram shows the structure of a reconfigurable optical convolution module provided according to an embodiment of the present invention;

[0021] Figure 5 The schematic diagram shows the structure of the cascaded convolution kernel control unit provided according to an embodiment of the present invention;

[0022] Figure 6 The schematic diagram shows the structure of an output detection unit provided according to an embodiment of the present invention.

[0023] Reference numerals:

[0024] 1-multi-wavelength signal loading module; 11-multi-wavelength laser array; 12-modulator array;

[0025] 2-data shift processing module; 21-optical beam splitter array; 22-delay shift array; 23-wavelength division multiplexer array;

[0026] 3-reconfigurable optical convolution module; 31-M×I multimode interference coupler; 32-cascaded convolution kernel control unit; 32a-internal control unit; 32b-matching control unit; 33-output detection unit; 33a-wavelength division multiplexer array; 33b-photodetector array. DETAILED DESCRIPTION

[0027] Below, embodiments of the present invention will be described with reference to the accompanying drawings. However, it should be understood that these descriptions are exemplary only and are not intended to limit the scope of the present invention. In the following detailed description, for ease of explanation, many specific details are set forth to provide a comprehensive understanding of embodiments of the present invention. However, it is apparent that one or more embodiments may also be implemented without these specific details. In addition, in the following description, descriptions of known structures and technologies are omitted to avoid unnecessary confusion of concepts of the present invention.

[0028] The terms used herein are only for describing specific embodiments and are not intended to limit the present invention. The terms "comprise", "include", etc. used herein indicate the existence of the features, steps, operations and / or components, but do not exclude the existence or addition of one or more other features, steps, operations or components.

[0029] All terms (including technical and scientific terms) used herein have the meanings commonly understood by those skilled in the art unless otherwise defined. It should be noted that the terms used herein should be interpreted as having a meaning consistent with the context of this specification and should not be interpreted in an idealized or overly rigid manner.

[0030] When using expressions such as "at least one of A, B, and C, etc.", they should generally be interpreted according to the meaning of the expression commonly understood by those skilled in the art (for example, "a system having at least one of A, B, and C" should include but is not limited to a system having A alone, B alone, C alone, A and B, A and C, B and C, and / or A, B, C, etc.).

[0031] In the process of realizing the present invention, the applicant found that: as an emerging computing paradigm based on the characteristics of optical propagation, optical chips have the advantages of high bandwidth, low transmission loss, low latency and low power consumption. Due to the weak interaction between photons, they can propagate multiple signals in the same path and ensure extremely low crosstalk, so that optical chip operations naturally have the advantage of high parallelism. Convolutional neural network is a deep learning architecture that is widely used in machine vision fields such as image classification and video recognition. The convolution operation used for data feature extraction is an important component of convolutional neural networks, and its operation speed determines the training and reasoning efficiency of the overall model. The convolution process often contains a large number of calculation parameters and operation operations. Based on this, the present invention uses the advantages of high parallelism, low crosstalk and low loss of optical computing to get rid of the shortcomings of low computing efficiency of electrical computing and improve the efficiency of convolution operations, thereby further improving the performance indicators of convolutional neural networks.

[0032] Figure 1 The schematic diagram shows the structure of a reconfigurable optical convolution operation device provided according to an embodiment of the present invention.

[0033] like Figure 1 As shown, the reconfigurable optical convolution operation device may include: a multi-wavelength signal loading module 1, a data shift processing module 2 and a reconfigurable optical convolution module 3.

[0034] The multi-wavelength signal loading module 1 is used to generate N continuous carrier lasers of different wavelengths, and modulate the N continuous carrier lasers of different wavelengths respectively, so that each wavelength of the continuous carrier laser carries K data, thereby obtaining N laser signals of different wavelengths.

[0035] The data shift processing module 2 is used to equally divide the laser signal of each wavelength among N different wavelengths into M laser signals, perform a timing shift operation on the M laser signals corresponding to each wavelength, and combine the laser signals with the same timing shift among the laser signals of different wavelengths and transmit them through the same data port.

[0036] The reconfigurable optical convolution module 3 is used to perform parallel convolution operations on N×K data at the same time to obtain parallel convolution results; wherein the value of the convolution kernel is regulated by external control; wherein N, M, and K are all positive integers greater than or equal to 1.

[0037] Among them, the data obtained after the adjacent laser signals in the M laser signals corresponding to each wavelength are shifted differ by one bit in timing. For example, for the M laser signals with a wavelength of λ1, the timing of the first laser signal differs by one bit from the timing of the second laser signal, the timing of the second laser signal differs by one bit from the timing of the third laser signal, and so on.

[0038] Among them, the value of the convolution kernel can also be adjusted through external control.

[0039] Figure 2 The structure diagram of the wavelength signal loading module provided according to the embodiment of the present invention is schematically shown.

[0040] like Figure 2 As shown, based on the above embodiment, the multi-wavelength signal loading module 1 may include:

[0041] The multi-wavelength laser array 11 includes N lasers, each laser being used to generate a continuous carrier laser of a different wavelength.

[0042] The modulator array 12 includes N modulators, each modulator is used to modulate a continuous carrier laser of one wavelength, and N groups of information are loaded onto N continuous carrier lasers of different wavelengths, wherein each group contains K data.

[0043] In another possible implementation, the modulator array allows different wavelengths to carry the same K data information when modulating N wavelengths. In this case, the wavelengths carrying the same information can be merged into a single channel through a wavelength division multiplexer and then loaded with information using a modulator that is insensitive to a single wavelength, thereby reducing the number of modulators and reducing data modulation errors.

[0044] Figure 3The structure diagram of the data shift processing module provided according to the embodiment of the present invention is schematically shown.

[0045] like Figure 3 As shown, based on the above embodiment, the data shift processing module 2 may include:

[0046] The optical beam splitter array 21 includes N 1×M optical beam splitters, each of which is used to split and fan out each single wavelength input carrying a group of K data.

[0047] The delay shift array 22 includes N delay shift groups, each group includes M or M-1 delay shift units, and each delay shift group is used to shift the timing of M laser signals fanned out by a 1×M optical beam splitter.

[0048] The wavelength division multiplexer array 23 includes M wavelength division multiplexers, each of which is used to combine laser signals with the same timing shift among laser signals of different wavelengths and output them to the same output port, wherein each output port contains N laser signals of different wavelengths.

[0049] The data shift processing module 2 has N inputs in total, representing N laser signals of different wavelengths after being modulated by information.

[0050] According to the transmission path of the optical signal, first, N lasers of different wavelengths enter N 1×M optical splitters respectively, and each wavelength is fanned out as a group of signals (similar to the concept of replication, the same group comes from one wavelength, each in a group carries the same information but the average power becomes 1 / M of the original, and there are N groups here in total).

[0051] The M signals fanned out for each wavelength (ie the same group) are input into the corresponding optical delay line in the data shift module 22 (optical delay line NM, N represents the Nth group, and M represents the delay processing for the Mth signal in a group).

[0052] For example, taking the Nth group as an example, the optical delay line N1 shifts the first signal among the M signals fanned out from the Nth group (that is, the Nth wavelength) and delays it by one bit; the optical delay line N2 shifts the second signal among the M signals fanned out from the Nth group (that is, the Nth wavelength) and delays it by 2 bits relative to the original signal; the optical delay line N3 shifts the third signal among the M signals fanned out from the Nth group (that is, the Nth wavelength) and delays it by 3 bits relative to the original signal; and so on until the delay is M bits. (Here you can also choose not to delay N1, delay N2 by 1 bit, delay N3 by 2 bits... NM delays by M-1 bits). Here N comes from the N wavelengths, and M comes from the maximum shift difference of the processed data.

[0053] For the delayed light, data with the same shift but different wavelengths (e.g., 1, 21, 31, ..., N1, which are all shifted by 1 bit or not shifted, and the wavelengths are from the 1st to the Nth) are multiplexed into the same channel through the wavelength division multiplexer 1 and finally transmitted to the next module.

[0054] Figure 3 The solid, dashed and dotted lines between 22 and 23 in FIG. 2 are from the same set of data (ie, the result of fan-out shifting of the same wavelength); each line type in input 23 is included, that is, with all N wavelengths. Figure 3 The connecting lines (solid lines, dashed lines, and dotted lines) in the medium delay line array and the wavelength division multiplexer array all represent waveguide or optical fiber connections. Their different line styles are only used to facilitate distinction and observation, and do not represent differences in their connection methods.

[0055] In another possible implementation, the delay shift unit includes an optical delay line or a phase modulator. That is, the delay shift array 22 can also be replaced by a phase modulator array of the same size, which also includes N groups of phase modulators, and each group can also include M or M-1 phase modulators, which are also used to achieve successive delays of one bit on the data bits of the M-channel outputs to meet the data input format of the subsequent convolution process.

[0056] Figure 4 A schematic diagram of a reconfigurable optical convolution module structure provided according to an embodiment of the present invention is schematically shown.

[0057] like Figure 4 As shown, based on the above embodiment, the reconfigurable optical convolution module 3 may include: an M×I multi-mode interference coupler 31, a cascaded convolution kernel control unit 32, and an output detection unit 33.

[0058] The M×I multimode interference coupler 31 is used to generate a transfer matrix that matches the output port of the data shift processing module 2 and the input of the cascaded convolution kernel control unit 32. Each of the M beams contains N lights of different wavelengths that enter the multimode interference coupler through the M ports and undergo preliminary interference.

[0059] The cascaded convolution kernel control unit 32 includes multiple control units connected in series. The dimension of the overall transfer matrix formed in series is I×O. The fine control of the overall transmission matrix of the reconfigurable optical convolution module is achieved through the phase shifter control inside the control unit, so as to perform parallel convolution operations on N×K data at the same time.

[0060] The output detection unit 33 includes an output detection unit for O output signals, which is used to realize the photoelectric conversion process and simultaneously detect the intensity of different wavelengths in each output to obtain a parallel convolution result, where O is an integer greater than or equal to 1.

[0061] Figure 5 A schematic diagram of the structure of a cascaded convolution kernel control unit provided according to an embodiment of the present invention is shown schematically.

[0062] like Figure 5 As shown, based on the above embodiment, the cascaded convolution kernel control unit 32 may include at least one internal control unit 32a and one matching control unit 32b connected in series.

[0063] The internal control unit 32a includes an array of I phase shifters and an I×I multimode interference coupler. The array of I phase shifters is used to perform phase control on each input laser signal, and the I×I multimode interference coupler is used to distribute each processed input laser signal to I output ports.

[0064] The matching control unit 32b includes an array of I phase shifters and an I×O multimode interference coupler. The array of I phase shifters is used to perform phase control on each input laser signal. The I×O multimode interference coupler is used to match the laser signal after passing through the internal control unit 32a to O output ports to ensure that the overall transfer matrix dimension of the reconfigurable optical convolution module meets the preset requirements. I is an integer greater than or equal to 1.

[0065] Based on the above embodiment, the number of input ports of the first internal control unit 32a in series is M, the number of input ports and output ports of the remaining internal control units 32a is any positive integer, and the number of adjacent input ports and output ports is the same.

[0066] That is, except for the input port number M at the first serial position of the internal control unit 32a which needs to match the output port of the previous module, the remaining port numbers can be defined as any positive integers, but are subject to the constraint that the numbers of adjacent input and output ports at the serial positions must remain consistent, for example, I×1 phase shifter array-I×5 multi-mode interference coupler-5×1 phase shifter array-5×9 multi-mode interference coupler-9×1 phase shifter array-9×4 multi-mode interference coupler are connected in series; and under this condition, the number of input ports of the matching control unit (32b) needs to be consistent with the number of output ports of the internal control unit at the last position of the serial connection. In the above example, the matching control unit should be set to 4×1 phase shifter array and 4×O multi-mode interference coupler connected in series.

[0067] Figure 6 The schematic diagram shows the structure of an output detection unit provided according to an embodiment of the present invention.

[0068] like Figure 6 As shown, based on the above embodiment, the output detection unit 33 may include: a wavelength division multiplexer array 33a and a photodetector array 33b.

[0069] The wavelength division multiplexer array 33a includes O wavelength division multiplexers, which are used to perform wavelength division multiplexing on the laser signal of each output port, input signal lights of different wavelengths into detectors respectively, and extract parallel operation results.

[0070] The photodetector array 33b includes O×N photodetectors. Each output signal passes through a group of N photodetectors to detect light intensities of different wavelengths and is converted into electrical signals as the result of convolution operation to facilitate subsequent processing.

[0071] Based on the above embodiment, the output detection unit 33 may include:

[0072] A multi-channel spectrometer is used to detect the intensity value of each wavelength in each optical signal.

[0073] The intensity values ​​of each wavelength in one channel are used as reference values, and the intensity values ​​of each wavelength in the remaining channels of optical signals are calculated as the value of the convolution kernel. For example, the intensity values ​​of each wavelength in each channel are directly obtained from the spectrometer, one of the channels is selected as the reference value, and the difference between the remaining intensities and the reference value is selected as the value of the convolution kernel.

[0074] The reconfigurable optical convolution operation structure provided by the present invention combines the advantages of high bandwidth and high parallelism of optical computing to realize fast and parallel convolution operations on massive raw data, thereby further improving the efficiency of convolution operations, thereby improving the training and reasoning efficiency of convolutional neural networks, and broadening the capacity space of neuron parameters that affect the performance of convolutional neural networks.

[0075] Based on the above-mentioned reconfigurable optical convolution operation device, an embodiment of the present invention further provides an optical convolution operation method, which is implemented based on the above-mentioned reconfigurable optical convolution operation device and may include:

[0076] The multi-wavelength signal loading module 1 is used to generate N continuous carrier lasers of different wavelengths, and the N continuous carrier lasers of different wavelengths are modulated respectively, so that each wavelength of the continuous carrier laser carries K data, thereby obtaining N laser signals of different wavelengths.

[0077] The data shift processing module 2 is used to equally divide the laser signal of each wavelength among N different wavelengths into M laser signals, and a timing shift operation is performed on the M laser signals corresponding to each wavelength. The laser signals with the same timing shift among the laser signals of different wavelengths are combined and transmitted through the same data port. Among them, the data obtained after the adjacent laser signals among the M laser signals corresponding to each wavelength are shifted differ by one bit in timing.

[0078] The reconfigurable optical convolution module 3 is used to perform parallel convolution operations on N×K data at the same time to obtain parallel convolution results; wherein the value of the convolution kernel is regulated by external control.

[0079] Wherein, N, M, and K are all positive integers greater than or equal to 1.

[0080] It should be noted that the implementation details and technical effects of the optical convolution operation method embodiment part are similar or identical to the implementation details and technical effects of the reconfigurable optical convolution operation device embodiment part. For specific details, please refer to the system embodiment part, which will not be repeated here.

[0081] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems and methods according to various embodiments of the present invention. In this regard, each box in the flowchart or block diagram may represent a module, a program segment or a part of a code, and the above-mentioned module, a program segment or a part of a code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box may also occur in an order different from that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart, can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0082] It will be appreciated by those skilled in the art that the features described in the various embodiments and / or claims of the present invention may be combined and / or combined in various ways, even if such combinations and / or combinations are not explicitly described in the present invention. In particular, the features described in the various embodiments and / or claims of the present invention may be combined and / or combined in various ways without departing from the spirit and teachings of the present invention. All of these combinations and / or combinations fall within the scope of the present invention.

[0083] The embodiments of the present invention are described above. However, these embodiments are only for the purpose of illustration, and are not intended to limit the scope of the present invention. Although each embodiment is described above, it does not mean that the measures in each embodiment cannot be used in combination. The scope of the present invention is defined by the attached claims and their equivalents. Without departing from the scope of the present invention, those skilled in the art may make various substitutions and modifications, which should all fall within the scope of the present invention.

Claims

1. A reconfigurable optical convolution operation device, characterized in that: include: A multi-wavelength signal loading module (1) is used to generate N continuous carrier lasers of different wavelengths, and modulate the N continuous carrier lasers of different wavelengths respectively, so that each wavelength of the continuous carrier laser carries K data, thereby obtaining N laser signals of different wavelengths; A data shift processing module (2) is used to equally divide the laser signal of each wavelength among the N different wavelengths into M laser signals, perform a time shift operation on the M laser signals corresponding to each wavelength, and combine the laser signals with the same time shift among the laser signals of different wavelengths and transmit the data through the same data port, wherein the data obtained after the adjacent laser signals among the M laser signals corresponding to each wavelength are shifted differ by one bit in terms of time sequence; A reconfigurable optical convolution module (3) is used to perform parallel convolution operations on N×K data at the same time to obtain parallel convolution results; wherein the value of the convolution kernel is regulated by an external control; Wherein, N, M, and K are all positive integers greater than or equal to 1.

2. The reconfigurable optical convolution operation device according to claim 1, characterized in that: The multi-wavelength signal loading module (1) comprises: A multi-wavelength laser array (11), comprising N lasers, each laser being used to generate a continuous carrier laser of a different wavelength; The modulator array (12) includes N modulators, each modulator is used to modulate a continuous carrier laser of one wavelength, and N groups of information are respectively loaded into N continuous carrier lasers of different wavelengths, wherein each group contains K data.

3. The reconfigurable optical convolution operation device according to claim 1, characterized in that: The data shift processing module (2) comprises: An optical beam splitter array (21), comprising N 1×M optical beam splitters, each 1×M optical beam splitter being used to split and fan out each single wavelength input carrying a group of K data; A delay shift array (22) includes N delay shift groups, each group includes M or M-1 delay shift units, and each delay shift group is used to shift the timing of M laser signals fanned out by a 1×M optical beam splitter; The wavelength division multiplexer array (23) comprises M wavelength division multiplexers, each wavelength division multiplexer is used to combine laser signals with the same timing shift among laser signals of different wavelengths and output them to the same output port, wherein each output port contains N laser signals of different wavelengths.

4. The reconfigurable optical convolution operation device according to claim 3, characterized in that: The delay shift unit includes an optical delay line or a phase modulator.

5. The reconfigurable optical convolution operation device according to claim 1, characterized in that: The reconfigurable optical convolution module (3) comprises: an M×I multi-mode interference coupler (31), a cascaded convolution kernel control unit (32), and an output detection unit (33); The M×I multi-mode interference coupler (31) is used to generate a transfer matrix that matches the output port of the data shift processing module (2) and the input of the cascade convolution kernel control unit (32); A cascade convolution kernel control unit (32) is used to control the overall transmission matrix of the reconfigurable optical convolution module so as to perform parallel convolution operations on N×K data at the same time; The output detection unit (33) includes an output detection unit for O output signals, which is used to implement a photoelectric conversion process and simultaneously detect the intensity of different wavelengths in each output to obtain a parallel convolution result, where O is an integer greater than or equal to 1.

6. The reconfigurable optical convolution operation device according to claim 5, characterized in that: The cascaded convolution kernel control unit (32) comprises at least one internal control unit (32a) and a matching control unit (32b) connected in series; The internal control unit (32a) comprises an array of I phase shifters and an I×I multimode interference coupler, wherein the array of I phase shifters is used to perform phase control on each input laser signal, and the I×I multimode interference coupler is used to distribute each processed input laser signal to I output ports; The matching and regulating unit (32b) comprises an array including I phase shifters and an I×O multimode interference coupler, wherein the array including I phase shifters is used to perform phase control on each input laser signal, and the I×O multimode interference coupler is used to match the laser signal after passing through the internal regulating unit (32a) to O output ports, where I is an integer greater than or equal to 1.

7. The reconfigurable optical convolution operation device according to claim 6, characterized in that: The number of input ports of the first internal control unit (32a) in the series connection is M, the number of input ports and output ports of the remaining internal control units (32a) are any positive integers, and the number of adjacent input ports and output ports is the same.

8. The reconfigurable optical convolution operation device according to claim 5, characterized in that: The output detection unit (33) comprises: a wavelength division multiplexer array (33a) and a photodetector array (33b); The wavelength division multiplexer array (33a) comprises O wavelength division multiplexers, which are used to perform wavelength division multiplexing on the laser signal of each output port, input signal lights of different wavelengths into the detectors respectively, and extract parallel operation results; The photoelectric detector array (33b) comprises O×N photoelectric detectors, and each output signal passes through a group of N photoelectric detectors to detect light intensities of different wavelengths and is converted into electrical signals as the result of a convolution operation.

9. The reconfigurable optical convolution operation device according to claim 5, characterized in that: The output detection unit (33) comprises: A multi-channel spectrometer is used to detect the intensity value of each wavelength in each optical signal; The intensity values ​​of each wavelength in one path are taken as reference values, and the intensity values ​​of each wavelength in the remaining paths of optical signals are calculated as the values ​​of the convolution kernel.

10. An optical convolution operation method, characterized in that: The reconfigurable optical convolution operation device according to any one of claims 1 to 9 is implemented, comprising: Using a multi-wavelength signal loading module (1) to generate N continuous carrier lasers with different wavelengths, and modulating the N continuous carrier lasers with different wavelengths respectively, so that each wavelength of the continuous carrier laser carries K data, thereby obtaining N laser signals with different wavelengths; The laser signal of each wavelength among the N different wavelengths is equally divided into M laser signals by using the data shift processing module (2), and a time shift operation is performed on the M laser signals corresponding to each wavelength. The laser signals with the same time shift among the laser signals of different wavelengths are combined and then transmitted through the same data port, wherein the data obtained after the adjacent laser signals among the M laser signals corresponding to each wavelength are shifted differ by one bit in terms of time sequence; The reconfigurable optical convolution module (3) is used to perform parallel convolution operations on N×K data at the same time to obtain parallel convolution results; wherein the value of the convolution kernel is regulated by an external control; Wherein, N, M, and K are all positive integers greater than or equal to 1.

Images