Optical computing method, system and chip based on extraction of on-chip diffractive optical features
By performing feature extraction and preliminary calculations in the optical domain and utilizing on-chip diffraction optical feature extraction technology, the problems of computational delay and data redundancy in traditional computing systems are solved, achieving high-speed parallel processing and efficient computing.
Patent Information
- Application Number
- CN202411335990.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-24
- Publication Date
- 2025-10-21
- Estimated Expiration
- 2044-09-24
AI Technical Summary
传统计算系统中计算延时和处理速度受阻,数据冗余严重,无法满足高实时性和高速计算需求。
On-chip diffraction optical feature extraction technology is used to perform feature extraction and preliminary calculations in the optical domain. Components such as the input coupling grating, reconfigurable power divider, delay line, amplitude and phase modulator in the optical computing system are used to preprocess and extract features of the optical signal. Parallel calculations are performed through the on-chip diffraction optical feature extractor to output optical feature information.
Significantly reduce computing time, compress redundant data, improve the speed and bandwidth of computing systems, solve the bottleneck problem of electronic computing, and achieve high-speed parallel processing.
Smart Images

Figure CN119493975B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of optical computing technology, and in particular to an optical computing method, system and chip based on on-chip diffraction optical feature extraction. Background Art
[0002] In the era of booming information technology, massive amounts of multimodal information are generated across industries, including industry, finance, and services. This data contains crucial insights into the operations of numerous industries and has become a crucial factor in production. However, the vast majority of this information is implicit, requiring the extraction of key features to support analysis. In high-real-time computing scenarios, millisecond or even sub-microsecond computing response latencies are essential. However, in traditional "sensing, transmission, and computing" chains, the perception, transmission, and computation of information are separated, severely hindering the end-to-end computing latency of the entire computing system. Furthermore, the data volume is significantly greater than the information volume, leading to significant redundancy. Consequently, the latency and processing speed of the entire computing system face severe bottlenecks. Summary of the Invention
[0003] This invention provides an optical computing method, system, and chip based on on-chip diffraction optical feature extraction, addressing the significant bottlenecks in latency and processing speed faced by existing computing systems. By performing feature extraction and preliminary calculations in the optical domain, this invention significantly reduces computation time, enabling high-speed computation, compressing redundant data, and improving the speed, bandwidth, and efficiency of the entire computing system, addressing the critical bottlenecks inherent in electronic computing.
[0004] The present invention provides an optical computing method based on on-chip diffraction optical feature extraction, comprising: loading data from an input end onto an input optical signal; performing optical domain preprocessing on the input optical signal to obtain a preprocessed optical signal; the preprocessing method includes power allocation, time delay, amplitude and phase adjustment; performing feature extraction calculation on the preprocessed optical signal by an on-chip diffraction optical feature extractor to obtain parallel output optical feature information; and the optical feature information is used to transmit to a receiving end.
[0005] According to an optical computing method based on on-chip diffraction optical feature extraction provided by the present invention, the data at the input end is loaded onto the input optical signal, including: when the data at the input end is image data, the image data is converted into a time series signal; and an electrical signal generated by an arbitrary waveform generator is used to control an off-chip phase modulator to map the time series signal onto the phase of the input optical signal.
[0006] According to an optical computing method based on on-chip diffraction optical feature extraction provided by the present invention, the input optical signal is preprocessed in the optical domain to obtain a preprocessed optical signal, including: the input optical signal enters a waveguide through an input coupling grating; the optical signal in the waveguide is distributed to different paths through the reconfigurable power divider to obtain a power-distributed optical signal; the power distribution ratio of the optical signal on each path can be dynamically adjusted; the power-distributed optical signal is delayed through a delay line to obtain a delayed optical signal; the optical signals on different paths have different delays after passing through the delay line; the delayed optical signal is amplitude-adjusted through the amplitude modulator to obtain an amplitude-adjusted optical signal; the amplitude-adjusted optical signal is phase-adjusted through the phase modulator, and the phase-adjusted optical signal is used as the preprocessed optical signal.
[0007] According to an optical calculation method based on on-chip diffraction optical feature extraction provided by the present invention, after performing feature extraction calculation on the preprocessed optical signal by the on-chip diffraction optical feature extractor to obtain optical feature information, the method includes: performing incoherent power summation on multiple groups of parallel optical feature information to obtain a summed optical signal; and the summed optical signal is used to transmit to the receiving end.
[0008] According to an optical computing method based on on-chip diffraction optical feature extraction provided by the present invention, before loading the information of the input end onto the input optical signal, it also includes: calibrating multiple reconfigurable power dividers, amplitude modulators and phase modulators.
[0009] According to an optical calculation method based on on-chip diffraction optical feature extraction provided by the present invention, the correction of multiple reconfigurable power dividers, amplitude modulators and phase modulators includes: using a femtosecond laser as an input light source, the receiving end includes an oscilloscope and an optical power meter connected to a photodetector; initializing the multiple reconfigurable power dividers and the amplitude modulators; maximizing the output power of the optical power meter so that the multiple amplitude modulators are in a fully open state; adjusting the multiple reconfigurable power dividers in sequence from front to back, minimizing the output power of the optical power meter so that all input powers are injected into the longest Delay path; scanning the voltage bias of multiple reconfigurable power dividers from back to front in sequence until the power ratio of the outputs with different delays obtained on the oscilloscope meets the preset ratio requirement, completing the calibration of the reconfigurable power divider and the amplitude modulator; switching the input light source to a continuous laser; scanning the loading bias of multiple phase modulators from front to back in sequence, maximizing the output power of the optical power meter to align the phases; again adjusting the voltage bias of multiple phase modulators according to the phase-voltage mapping curve so that the phase relationship meets the preset phase requirement, completing the calibration of the phase modulator.
[0010] According to an optical computing method based on on-chip diffraction optical feature extraction provided by the present invention, the on-chip diffraction optical feature extractor includes an input array, a diffraction zone and an output array; the on-chip diffraction optical feature extractor performs feature extraction calculation on the preprocessed optical signal to obtain optical feature information, including: the preprocessed optical signal is diffracted when entering the diffraction zone through the input array; the optical signal diffuses while propagating in the diffraction zone; and the edge features of the preprocessed signal are extracted in the output array through coherent superposition of the optical signals.
[0011] According to an optical computing method based on on-chip diffraction optical feature extraction provided by the present invention, the communication band of the on-chip diffraction optical feature extractor is 1.55μm communication band, the delay range of the delay line is 80-240ps, the frequency range of the input optical signal is 4.16-12.5Gbaud / s, and the area range of the diffraction zone is 10×8μm 2 .
[0012] The present invention also provides an optical computing system based on on-chip diffraction optical feature extraction, comprising: a loading module for loading data from an input end onto an input optical signal; a preprocessing module for performing optical domain preprocessing on the input optical signal to obtain a preprocessed optical signal; the preprocessing method includes power allocation, time delay, amplitude and phase adjustment; an on-chip diffraction optical feature extractor for performing feature extraction calculation on the preprocessed optical signal to obtain optical feature information output in parallel; the optical feature information is used to be transmitted to a receiving end.
[0013] The present invention also provides a chip, comprising the above-mentioned optical computing system based on on-chip diffraction optical feature extraction.
[0014] The present invention provides an optical computing method, system, and chip based on on-chip diffraction optical feature extraction. The method comprises: loading input data onto an input optical signal; preprocessing the input optical signal in the optical domain to obtain a preprocessed optical signal; the preprocessing method includes power allocation, time delay, amplitude, and phase adjustment; performing feature extraction and calculation on the preprocessed optical signal using an on-chip diffraction optical feature extractor to obtain parallel output optical feature information; and transmitting the optical feature information to a receiving end. By performing feature extraction and preliminary calculations in the optical domain, the present invention significantly reduces computation time, enabling high-speed requirements, compressing redundant data, and improving the speed, bandwidth, and efficiency of the entire computing system, thereby resolving the severe bottlenecks associated with electronic computing. BRIEF DESCRIPTION OF THE DRAWINGS
[0015] In order to more clearly illustrate the technical solutions in the present invention or the prior art, a brief introduction is given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.
[0016] Figure 1 It is a flow chart of an optical calculation method based on on-chip diffraction optical feature extraction provided by the present invention.
[0017] Figure 2 It is a schematic diagram of the principle of an optical calculation method based on on-chip diffraction optical feature extraction provided by the present invention.
[0018] Figure 3 It is a schematic diagram of the principle of amplitude phase correction provided by the present invention.
[0019] Figure 4a It is a schematic diagram of an electron microscope of the on-chip diffraction optical feature extractor provided by the present invention.
[0020] Figure 4bThis is one of the electric field simulation schematic diagrams of the on-chip diffraction optical feature extractor provided by the present invention.
[0021] Figure 4c This is the second electric field simulation schematic diagram of the on-chip diffraction optical feature extractor provided by the present invention.
[0022] Figure 4d This is a relationship diagram between the output power and the sampling point phase increase value provided by the present invention.
[0023] Figure 5a This is an example input diagram of an optical calculation based on on-chip diffraction optical feature extraction provided by the present invention.
[0024] Figure 5b This is an example output diagram of an optical calculation based on on-chip diffraction optical feature extraction provided by the present invention.
[0025] Figure 6 It is a structural schematic diagram of an optical computing system based on on-chip diffraction optical feature extraction provided by the present invention.
[0026] Figure 7 It is a structural schematic diagram of the electronic device provided by the present invention. DETAILED DESCRIPTION
[0027] To make the objectives, technical solutions, and advantages of the present invention more clear, the technical solutions of the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the embodiments described are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts shall fall within the scope of protection of the present invention.
[0028] With the rapid development of information technology, industries across the globe, from manufacturing to financial services to healthcare, are continuously generating and accumulating vast quantities of data. This data is not only massive in volume but also diverse in types, including text, images, sound, and video, collectively constituting what is known as "big data." The value inherent in this data is immeasurable, making it a critical resource for driving economic growth and innovation. However, despite the enormous potential of this data, transforming it into practical insights and value presents significant challenges. The enormous computing resource demands and energy consumption of the traditional "sensing, transmission, and computing" chain are increasingly becoming bottlenecks hindering its development.
[0029] Please refer to Figure 1 , Figure 1 A schematic flow chart of an optical calculation method based on on-chip diffraction optical feature extraction provided by the present invention.
[0030] The present invention provides an optical calculation method based on on-chip diffraction optical feature extraction, comprising:
[0031] 101: Load the input data onto the input optical signal;
[0032] 102: Perform optical domain preprocessing on the input optical signal to obtain a preprocessed optical signal; the preprocessing method includes power allocation, delay, amplitude and phase adjustment;
[0033] 103: Perform feature extraction calculation on the pre-processed optical signal through the on-chip diffraction optical feature extractor 5 to obtain parallel output optical feature information; the optical feature information is used to transmit to the receiving end.
[0034] To address the technical issues inherent in existing technologies, the entire information processing system requires the addition of a lightweight, high-speed computing network at the starting point to perform preliminary computations, reduce data redundancy, relieve pressure on the computing center, and reduce communication traffic. At the starting point, light is used as the computing medium, leveraging its advantages of high parallelism, low power consumption, and rapid signal processing. The computational output can be directly fed into the optical transmission component. Compared to deploying an electronic computing network at the starting point, since feature extraction and preliminary computations are performed directly in the optical domain, computation time is significantly reduced, enabling high-speed requirements. Due to the high bandwidth of the entire system, the frequency of computations can be increased, thereby achieving a higher computational rate. Upgrading the "computation-by-transmission" approach to "computation-by-computation" allows for redundant data compression, feature extraction, and simple computations at the starting point. This can further improve the speed, bandwidth, and efficiency of the entire system, resolving the severe bottlenecks presented by electronic computing.
[0035] Specifically, multiple modal information, as input data, can be mapped according to certain rules and quickly loaded onto the phase of the input optical signal via an off-chip phase modulator. Using the on-chip fully reconfigurable power splitter and delay path, the input high-speed optical signal is reconstructed (pre-processed) within the on-chip structure with low loss, converting the high-speed time series signal into a parallel high-speed sequence with accurate delay and precisely corrected amplitude and phase. A low-complexity on-chip diffractive optical feature extractor 5 performs convolution calculations on the prepared parallel high-speed sequence (feature extraction calculations on the pre-processed optical signal) to obtain optical feature information. After the optical feature information is processed by the entire system and transmitted via optical fiber, the calculation results are sent to the receiver. This system can perform operations such as image recognition, edge detection, and segmentation. Simultaneously, the optical feature signals output by multiple on-chip diffractive optical feature extractors 5 running in parallel on the chip are incoherently summed, resulting in a comprehensive output that enables the perception of multiple source signals (processing high-speed, multi-source information and generating decision actions). The entire system is deployed on a chip with a compact structure and stable functions.
[0036] Please refer to Figure 2 , Figure 2 A schematic diagram of the principle of an optical calculation method based on on-chip diffraction optical feature extraction provided by the present invention.
[0037] As a preferred embodiment, the data at the input end is loaded onto the input optical signal, including: when the data at the input end is image data, converting the image data into a time series signal; and using an electrical signal generated by an arbitrary waveform generator to control an off-chip phase modulator to map the time series signal onto the phase of the input optical signal.
[0038] In this embodiment, for the task of high-speed image edge feature extraction, the image data to be transmitted is first prepared, and then the static image data is converted into a time series signal to facilitate transmission and processing through the optical system. A header is also added to the time series signal for synchronization, error detection, or more complex data organization to ensure the integrity and identifiability of the data during transmission. The electrical signal generated by the arbitrary waveform generator is used to control the off-chip phase modulator to load the image's time series signal onto the phase of the optical signal. The signal generated by the arbitrary waveform generator is synchronized with the time series signal to ensure accurate encoding of the information. This is the process of converting electrical signals or data into optical signals, encoding information by changing the phase of the light wave through phase modulation.
[0039] As a preferred embodiment, the input optical signal is preprocessed in the optical domain to obtain a preprocessed optical signal, including: the input optical signal enters the waveguide through the input coupling grating 7; the optical signal in the waveguide is distributed to different paths through a reconfigurable power divider 2 to obtain an optical signal after power distribution; the power distribution ratio of the optical signal on each path can be dynamically adjusted; the optical signal after power distribution is delayed through a delay line 1 to obtain a delayed optical signal; the optical signals on different paths have different delays after passing through the delay line 1; the delayed optical signal is amplitude-adjusted through an amplitude modulator 3 to obtain an optical signal after amplitude adjustment; the optical signal after amplitude adjustment is phase-adjusted through a phase modulator 4, and the optical signal after phase adjustment is used as the preprocessed optical signal.
[0040] In this embodiment, the entire optical computing system includes an input coupling grating 7, a reconfigurable power divider 2, a spiral delay line 1, an amplitude modulator 3, a phase modulator 4, an on-chip diffraction optical feature extractor 5, and an output coupling grating 8. The input coupling grating 7 introduces the input optical signal into the waveguide, initiating transmission within the optical computing system. The reconfigurable power divider 2 distributes the optical signal in the waveguide onto different paths. Its reconfigurability means that the power distribution ratio of the optical signal on each path can be dynamically adjusted to accommodate different computing requirements. The delay line 1 introduces different delays onto different paths to enable parallel processing of signals in time. The spiral design facilitates the realization of longer optical paths within a limited space, thereby introducing larger delays. The amplitude modulator 3 performs amplitude correction on the delayed optical signal to maintain the relative amplitude relationship of the optical signals. The optical signal passing through the amplitude modulator 3 undergoes phase correction via the phase modulator 4 to maintain the relative phase relationship of the signals. The phase-adjusted optical signal is then used as the preprocessed optical signal. The preprocessed optical signal can be a set of multiple parallel signals. The on-chip diffraction optical feature extractor 5 is the core component of the optical computing system. It extracts and calculates features from parallel signals using the principles of diffraction optics. It performs operations similar to convolution calculations, extracting features and calculating features from preprocessed optical signals to produce the final result. The output coupling grating 8 directs the optical signal from the waveguide to the outside, ensuring that the optical signal can enter and exit the waveguide efficiently.
[0041] As a preferred embodiment, after the pre-processed optical signal is subjected to feature extraction calculation by the on-chip diffraction optical feature extractor 5 to obtain optical feature information, the method includes: performing incoherent power summing 6 on multiple groups of parallel optical feature information to obtain a summed optical signal; the summed optical signal is used to transmit to the receiving end.
[0042] In this embodiment, the outputs of multiple parallel on-chip diffraction optical feature extractors 5 are summed incoherently through Y-branching 6. The resulting optical signal, representing the calculated result, is coupled into an optical fiber via a grating. After transmission, it is received by a receiver (optical power meter, optical detector, and oscilloscope). At the receiver, the optical signal is converted back into an electrical signal, from which the original image data is recovered.
[0043] An optical power meter is used to measure the power of an optical signal; a photodetector is used to convert an optical signal into an electrical signal; and an oscilloscope is used to observe and analyze the waveform of the electrical signal output by the photodetector.
[0044] The calibrated thermo-optical amplitude and phase modulators 4 in the optical computing system enable parallel preprocessing of high-speed signals while maintaining the relative amplitude and phase relationships of the signals. The optical signal then propagates through the on-chip diffractive optical feature extractor 5, which performs edge feature calculations. The two output results represent the edge information of the input signal, enabling high-speed, high-throughput edge feature extraction.
[0045] As a preferred embodiment, before the information at the input end is loaded onto the input optical signal, the method further includes: calibrating a plurality of reconfigurable power dividers 2, amplitude modulators 3 and phase modulators 4.
[0046] Please refer to Figure 3 , Figure 3 This is a schematic diagram of the principle of amplitude and phase correction provided by the present invention.
[0047] As a preferred embodiment, multiple reconfigurable power dividers 2, amplitude modulators 3 and phase modulators 4 are calibrated, including: using a femtosecond laser as an input light source, and the receiving end includes an oscilloscope and an optical power meter connected to a photodetector; initializing multiple reconfigurable power dividers 2 and amplitude modulators 3; maximizing the output power of the optical power meter to put multiple amplitude modulators 3 in a fully open state; adjusting multiple reconfigurable power dividers 2 in sequence from front to back, and minimizing the output power of the optical power meter so that all input power is injected into the path with the longest delay; scanning the voltage bias of multiple reconfigurable power dividers 2 in sequence from back to front until the power ratio of the outputs with different delays obtained on the oscilloscope meets the preset ratio requirement, thereby completing the calibration of the reconfigurable power divider 2 and amplitude modulator 3; switching the input light source to a continuous laser; scanning multiple phase modulators 4 in sequence from front to back to load the bias, and maximizing the output power of the optical power meter to align the phase planes; and adjusting the voltage bias of multiple phase modulators 4 again according to the phase-voltage mapping curve so that the phase relationship meets the preset phase requirement, thereby completing the calibration of the phase modulator 4.
[0048] To achieve the intended utility of the on-chip diffraction optical feature extractor 5, the latency, amplitude, and phase of the parallel high-speed data provided by the fully reconfigurable on-chip power splitter and delay path must conform to the intended design. Therefore, calibration must be performed before the entire optical computing system is officially operational. In this embodiment, power distribution calibration is first performed. This step uses a femtosecond laser as the light source input. The output optical signal is distributed to a power meter, a photodetector, and an oscilloscope for signal observation. All power dividers and amplitude modulators 3 are randomly initialized to an open state. Random amplitude pulse outputs with non-overlapping time can be observed on the oscilloscope. By maximizing the output power, all amplitude modulators 3 are fully on. The power dividers are adjusted sequentially from front to back to minimize the output power, ensuring that all optical energy enters the last path. The outputs of each path are then adjusted to conform to the predetermined amplitude state. According to the intended design, the output power ratio of each path is obtained. The voltage bias of the power divider is scanned sequentially from back to front until the output power ratio obtained on the oscilloscope meets the preset ratio requirement. After the calibration of the reconfigurable power divider 2 and amplitude modulator 3 is completed, phase calibration is performed.
[0049] Switch the light source to a continuous laser. Sweep the phase modulator 4 from front to back to apply bias. Select the bias position at which the output power is maximum. Repeat this cycle until the maximum output power remains constant, thus achieving phase plane alignment. Sweep the phase modulator 4 bias again to obtain the phase-power mapping relationship for each modulator. Based on the desired phase relationship (preset phase requirements), load each phase modulator 4 to the corresponding state. This completes the calibration process for the phase modulator 4.
[0050] As a preferred embodiment, the on-chip diffraction optical feature extractor 5 includes an input array, a diffraction zone and an output array; the on-chip diffraction optical feature extractor 5 performs feature extraction calculations on the preprocessed optical signal to obtain optical feature information, including: diffraction occurs when the preprocessed optical signal enters the diffraction zone through the input array; the optical signal diffuses while propagating in the diffraction zone; and edge features of the preprocessed signal are extracted in the output array through coherent superposition of the optical signals.
[0051] As a preferred embodiment, the wavelength band of the on-chip diffraction optical feature extractor 5 is the 1.55 μm communication band, the delay range of the delay line 1 is 80-240 ps, the frequency range of the input optical signal is 4.16-12.5 Gbaud / s, and the area of the diffraction zone is 10×8 μm 2 .
[0052] Please refer to Figure 4a , Figure 4a Schematic diagram of an electron microscope of the on-chip diffraction optical feature extractor 5 provided by the present invention.
[0053] In this embodiment, the on-chip diffraction optical feature extractor 5 is capable of extracting features from high-speed signals. The on-chip diffraction optical feature extractor 5 includes an input array, a diffraction zone, and an output array. After the fully reconfigurable power splitter and delay path, the optical signal forms multiple groups of signals with stable delays, relatively flat phases, and correct amplitudes. The signal groups form effective sampling in the time domain. When the optical signal group passes through the end of the input array and enters the diffraction zone through the waveguide, strong diffraction occurs. While propagating in the diffraction zone, the light wave diffuses, and the energy is coupled into different output arrays. The coupling amplitude and phase relationship are related to the position and structure of the input and output waveguides. The light waves at different input array ports have different coupling amplitude and phase relationships at the output, and coherent superposition is achieved here. The on-chip diffraction optical feature extractor 5 itself is equivalent to a matrix-vector multiplication calculation for the input high-speed multi-sampled signal.
[0054] When the input and output arrays are centered and the output array waveguides are symmetrical and cross-oriented, fluctuations in the phase of the high-speed optical signal will be reflected in the deflection of the coherent superposition enhancement point after the diffraction of multiple groups of parallel signals. The upper and lower edge features of the high-speed signal can be output at different output array ports, thereby achieving effective extraction of the edge features of the high-speed signal.
[0055] The on-chip diffraction optical feature extractor 5 of the present invention operates in the near-infrared communication band (1550nm), and the adapted fully reconfigurable power splitter and delay path design delay is 80ps, which can realize effective rising and falling edge feature detection of high-speed optical phase modulated signals in the frequency range of 4.16-12.5Gbaud / s.
[0056] Please refer to Figure 4b , Figure 4b This is a schematic diagram of the electric field simulation of the on-chip diffraction optical feature extractor 5 provided by the present invention. When there is no phase difference between the input array waveguides, the output power of the output array is equal.
[0057] Please refer to Figure 4c , Figure 4c This is the second electric field simulation diagram of the on-chip diffraction optical feature extractor 5 provided by the present invention. When there is a phase difference between the input array waveguides, that is, there is edge information in the temporal sequence, the light spot is deflected, and the output power of the output array is unequal.
[0058] Please refer to Figure 4d , Figure 4d A graph showing the relationship between output power and the phase increase at the sampling point provided by the present invention. The relationship between output power and the phase increase at the sampling point is nonlinear. The diffraction structure occupies a 4μm x 14μm area, ensuring minimal computational latency and meeting real-time processing requirements.
[0059] Please refer to Figure 5a , Figure 5aThis is an example input diagram for optical calculation based on on-chip diffraction optical feature extraction provided by the present invention.
[0060] Please refer to Figure 5b , Figure 5b This is an example output diagram of an optical calculation based on on-chip diffraction optical feature extraction provided by the present invention.
[0061] The optical computing system based on on-chip diffraction optical feature extraction provided by the present invention is described below. The optical computing system based on on-chip diffraction optical feature extraction described below and the optical computing method based on on-chip diffraction optical feature extraction described above can be referenced to each other.
[0062] Please refer to Figure 6 , Figure 6 A schematic structural diagram of an optical computing system based on on-chip diffraction optical feature extraction provided by the present invention.
[0063] The present invention also provides an optical computing system based on on-chip diffraction optical feature extraction, including: a loading module 610, used to load data from an input end onto an input optical signal; a preprocessing module 620, used to preprocess the input optical signal in the optical domain to obtain a preprocessed optical signal; the preprocessing method includes power allocation, time delay, amplitude and phase adjustment; an on-chip diffraction optical feature extractor 5, used to perform feature extraction calculations on the preprocessed optical signal to obtain parallel output optical feature information; the optical feature information is used to be transmitted to a receiving end.
[0064] The optical computing system based on on-chip diffraction optical feature extraction of the present invention can realize the parallel processing of arbitrary amplitude and phase programmable high-speed optical signals, and proposes a correction method for the optical computing system. After the pre-processed optical signal enters the on-chip diffraction optical feature extractor 5, the optical feature extraction can be realized. By designing the diffraction structure, different features can be extracted. The features can be further supplied to complex networks or directly form strategy functions. This optical computing system is compact in function, flexible in adjustment, and suitable for task environments with strong real-time requirements. The computing rate reaches 12.5Gbaud / s, which is significantly higher than the computing rate of existing diffraction structures. At the same time, the area of the diffraction part is less than 56μm 2 , the computing area is significantly reduced. Feature calculation is transferred from the back end of the system to the front end of transmission, effectively reducing system power consumption and latency.
[0065] The chip provided by the present invention is described below. The chip described below and the optical calculation method based on on-chip diffraction optical feature extraction described above can be referenced to each other.
[0066] The present invention also provides a chip, comprising the above-mentioned optical computing system based on on-chip diffraction optical feature extraction.
[0067] Figure 7 An example of a physical structure diagram of an electronic device is shown below. Figure 7 As shown, the electronic device may include: a processor 710, a communications interface 720, a memory 730, and a communication bus 740, wherein the processor 710, the communications interface 720, and the memory 730 communicate with each other via the communication bus 740. The processor 710 may call logic instructions in the memory 730 to execute an optical calculation method based on on-chip diffraction optical feature extraction, the method comprising: loading data from an input end onto an input optical signal; performing optical domain preprocessing on the input optical signal to obtain a preprocessed optical signal; the preprocessing method includes power allocation, time delay, amplitude, and phase adjustment; performing feature extraction calculations on the preprocessed optical signal by the on-chip diffraction optical feature extractor 5 to obtain parallel output optical feature information; and the optical feature information is used to transmit to a receiving end.
[0068] Furthermore, the logic instructions in the aforementioned memory 730 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the portion that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product, stored in a storage medium, includes instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as a USB flash drive, a mobile hard drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.
[0069] On the other hand, the present invention also provides a computer program product, which includes a computer program, which can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the optical calculation method based on on-chip diffraction optical feature extraction provided by the above-mentioned methods, and the method includes: loading the data at the input end onto the input optical signal; preprocessing the input optical signal in the optical domain to obtain a preprocessed optical signal; the preprocessing method includes power allocation, time delay, amplitude and phase adjustment; performing feature extraction calculation on the preprocessed optical signal through the on-chip diffraction optical feature extractor 5 to obtain parallel output optical feature information; the optical feature information is used to transmit to the receiving end.
[0070] On the other hand, the present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, is implemented to execute the optical calculation method based on on-chip diffraction optical feature extraction provided by the above-mentioned methods, the method comprising: loading the data at the input end onto the input optical signal; performing optical domain preprocessing on the input optical signal to obtain a preprocessed optical signal; the preprocessing method includes power allocation, time delay, amplitude and phase adjustment; performing feature extraction calculation on the preprocessed optical signal through the on-chip diffraction optical feature extractor 5 to obtain parallel output optical feature information; the optical feature information is used to transmit to the receiving end.
[0071] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, i.e., they may be located in one location or distributed across multiple network units. Some or all of the modules may be selected based on actual needs to achieve the objectives of the present embodiment. Persons of ordinary skill in the art will be able to understand and implement the present invention without inventive effort.
[0072] Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented using software plus a necessary general-purpose hardware platform, or of course, hardware. Based on this understanding, the essence of the above technical solution, or the portion that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a magnetic disk, or an optical disk, and includes a number of instructions for causing a computer device (such as a personal computer, server, or network device) to execute the methods described in each embodiment or certain portions of the embodiments.
[0073] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present invention.
Claims
1. An optical calculation method based on on-chip diffraction optical feature extraction, characterized in that: include: Loading the data at the input end onto the input optical signal; performing optical domain preprocessing on the input optical signal to obtain a preprocessed optical signal; The pre-processing method includes power allocation, time delay, amplitude and phase adjustment; performing feature extraction calculation on the pre-processed optical signal by an on-chip diffraction optical feature extractor to obtain optical feature information output in parallel; The optical characteristic information is used to be transmitted to a receiving end; The preprocessing of the input optical signal in the optical domain to obtain a preprocessed optical signal includes: The input optical signal enters the waveguide through the input coupling grating; The optical signal in the waveguide is distributed to different paths through a reconfigurable power divider to obtain a power-distributed optical signal; the power distribution ratio of the optical signal on each path can be dynamically adjusted; The optical signal after power distribution is delayed by a delay line to obtain a delayed optical signal; optical signals on different paths have different delays after passing through the delay line; The delayed optical signal is subjected to amplitude adjustment by an amplitude modulator to obtain an optical signal with adjusted amplitude; The optical signal after the amplitude adjustment is passed through a phase modulator to adjust the phase of the optical signal, and the optical signal after the phase adjustment is used as the pre-processed optical signal; The on-chip diffractive optical feature extractor includes an input array, a diffraction region, and an output array; The on-chip diffraction optical feature extractor performs feature extraction calculation on the pre-processed optical signal to obtain optical feature information, including: The pre-processed optical signal is diffracted when entering the diffraction region through the input array; The light signal diffuses while propagating in the diffraction region; By coherent superposition of optical signals, edge features of the pre-processed signal are extracted in the output array.
2. The optical calculation method based on on-chip diffraction optical feature extraction according to claim 1, characterized in that: The step of loading the data at the input end onto the input optical signal comprises: In a case where the data at the input end is image data, converting the image data into a time series signal; An electrical signal generated by an arbitrary waveform generator is used to control an off-chip phase modulator to map the time series signal onto the phase of the input optical signal.
3. The optical calculation method based on on-chip diffraction optical feature extraction according to claim 1, characterized in that: After performing feature extraction calculation on the pre-processed light signal by the on-chip diffraction optical feature extractor to obtain optical feature information, the method includes: Incoherent power summing is performed on multiple groups of parallel optical characteristic information to obtain a summed optical signal; the summed optical signal is used to transmit to the receiving end.
4. The optical calculation method based on on-chip diffraction optical feature extraction according to claim 1, characterized in that: Before the step of loading the information of the input end onto the input optical signal, the method further comprises: Calibrate multiple reconfigurable power dividers, amplitude modulators, and phase modulators.
5. The optical calculation method based on on-chip diffraction optical feature extraction according to claim 4, characterized in that: The correction of multiple reconfigurable power dividers, amplitude modulators and phase modulators includes: A femtosecond laser is used as an input light source, and the receiving end includes an oscilloscope and an optical power meter connected to a photodetector; Initializing a plurality of the reconfigurable power dividers and the amplitude modulator; Maximizing the output power of the optical power meter so that the plurality of amplitude modulators are in a fully-on state; sequentially adjusting the plurality of reconfigurable power dividers from front to back, minimizing the output power of the optical power meter so that all input power is injected into the path with the longest delay; Scanning the voltage biases of the plurality of reconfigurable power dividers sequentially from back to front until the power ratio of the outputs with different delays obtained on the oscilloscope meets the preset ratio requirement, thereby completing the calibration of the reconfigurable power divider and the amplitude modulator; Switching the input light source to a continuous laser; Scanning the bias loading of the plurality of phase modulators sequentially from front to back to align the phases by maximizing the output power of the optical power meter; The voltage biases of the plurality of phase modulators are adjusted again according to the phase-voltage mapping curve so that the phase relationship meets the preset phase requirement, thereby completing the calibration of the phase modulators.
6. The optical calculation method based on on-chip diffraction optical feature extraction according to claim 1, characterized in that: The wavelength band of the on-chip diffraction optical feature extractor is 1.55 μm communication band, the delay range of the delay line is 80-240 ps, the frequency range of the input optical signal is 4.16-12.5 Gbaud / s, and the area of the diffraction zone is 10×8 μm. 2 .
7. An optical computing system based on on-chip diffraction optical feature extraction, characterized in that: include: A loading module, used for loading the data at the input end onto the input optical signal; a preprocessing module, configured to perform optical domain preprocessing on the input optical signal to obtain a preprocessed optical signal; The pre-processing method includes power allocation, time delay, amplitude and phase adjustment; An on-chip diffraction optical feature extractor, configured to perform feature extraction calculations on the pre-processed optical signal to obtain optical feature information output in parallel; The optical characteristic information is used to be transmitted to a receiving end; The preprocessing of the input optical signal in the optical domain to obtain a preprocessed optical signal includes: The input optical signal enters the waveguide through the input coupling grating; The optical signal in the waveguide is distributed to different paths through a reconfigurable power divider to obtain a power-distributed optical signal; the power distribution ratio of the optical signal on each path can be dynamically adjusted; The optical signal after power distribution is delayed by a delay line to obtain a delayed optical signal; optical signals on different paths have different delays after passing through the delay line; The delayed optical signal is subjected to amplitude adjustment by an amplitude modulator to obtain an optical signal with adjusted amplitude; The optical signal after the amplitude adjustment is passed through a phase modulator to adjust the phase of the optical signal, and the optical signal after the phase adjustment is used as the pre-processed optical signal; The on-chip diffractive optical feature extractor includes an input array, a diffraction region, and an output array; The on-chip diffraction optical feature extractor performs feature extraction calculation on the pre-processed optical signal to obtain optical feature information, including: The pre-processed optical signal is diffracted when entering the diffraction region through the input array; The light signal diffuses while propagating in the diffraction region; By coherent superposition of optical signals, edge features of the pre-processed signal are extracted in the output array.
8. A chip, characterized in that: The optical computing system comprising the on-chip diffraction optical feature extraction system as claimed in claim 7.
Citation Information
Patent Citations
Optical graph neural classification network and method based on on-chip diffraction neural network
CN114519403A
Epileptic seizure monitoring method and device based on diffraction photon calculation processor
CN116269432A