Optical image processing system and method based on terahertz diffraction
By using terahertz diffraction technology in the optical image processing system, the target to be imaged is directly modulated onto the terahertz wave and beam-divided through the diffraction plate, the system complexity and high power consumption problems caused by the photo-electron-optical conversion in the prior art are solved, and high-performance all-optical operational image processing is achieved.
Patent Information
- Application Number
- CN202311147274.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-09-06
- Publication Date
- 2025-03-07
- Estimated Expiration
- 2043-09-06
AI Technical Summary
The existing optical diffraction network models require optical-electro-optical conversion during image processing, resulting in high system complexity, high cost, and large volume and power consumption.
Using an optical image processing system based on terahertz diffraction, the target to be imaged is directly modulated onto the terahertz wave through the terahertz source, lens, modulated diffraction plate and detection device, and the diffraction terahertz waves are beam-divided through the diffraction plate to converge at different locations to achieve all-optical operation.
While maintaining the recognition accuracy, it significantly reduces the system complexity, cost, volume and power consumption, and improves the overall performance of the system.
Smart Images

Figure CN119575683A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of all-optical computing and image recognition, and in particular to an optical image processing system and method based on terahertz diffraction. Background Art
[0002] In recent years, with the rapid development of the Internet and artificial intelligence technology, machine learning algorithms represented by artificial neural networks have achieved great success in image processing, speech recognition, natural language processing and other fields. These powerful algorithms require high-performance hardware support. The current hardware development based on electronic computing has deviated from Moore's Law and is difficult to meet the requirements of hardware computing power and power consumption for the deployment of advanced algorithms in the future. Combining the wide bandwidth and high parallelism of optical signals, people have proposed photonic neural network technology, which is expected to achieve high-speed, low-power, high-performance computing to meet the development needs of artificial intelligence technology.
[0003] The diffraction neural network designed based on the principle of optical diffraction and combined with the deep learning method is a photonic neural network. The diffraction network maps the weight parameters and biases in conventional neurons to the transmission or reflection coefficients in the optical system, and engraves the trained transmission or reflection system on the diffraction plate. In the specific recognition process, the data to be recognized or processed is first modulated onto a beam of coherent light. After passing through the multi-level diffraction plate, the coherent light is emitted from the corresponding direction and detected. Different emission directions and orientations represent different data categories, thereby realizing the classification of data. In this process, the data, especially the data obtained by optical imaging, needs to be converted into electrical signals through photoelectric conversion, and then the electrical signals are used to modulate the coherent light, which extends the processing link, increases the optical-electrical and electrical-optical conversion equipment, and greatly increases the system complexity, cost, volume and power consumption. Summary of the invention
[0004] The present invention provides an optical image processing system and method based on terahertz diffraction, which can solve the technical problems in the prior art that the optical-electrical-optical conversion of the optical diffraction network model during optical image processing leads to high system complexity and cost as well as large volume and power consumption.
[0005] According to one aspect of the present invention, there is provided an optical image processing system based on terahertz diffraction, the system comprising:
[0006] A terahertz source, used for emitting terahertz waves;
[0007] A terahertz lens, used for transmitting the terahertz wave to the terahertz modulation diffraction plate;
[0008] An optical imaging device, used for imaging a target to be imaged onto a terahertz modulated diffraction plate;
[0009] A terahertz modulated diffraction plate is used to modulate and diffract the transmitted terahertz wave according to the target imaging light field to obtain n beams of terahertz waves with different powers;
[0010] The terahertz detection device is used to convert n beams of terahertz waves into n electrical signals respectively, and is also used to realize the recognition and classification of the target to be imaged according to the n electrical signals.
[0011] Preferably, centers of the terahertz source, the terahertz lens, and the terahertz modulation diffraction plate are located on the same optical axis.
[0012] Preferably, the terahertz modulating diffraction plate comprises a modulating plate, a first diffraction plate and a second diffraction plate which are arranged in sequence along the terahertz wave optical path, and the modulating plate is used to modulate the transmitted terahertz wave according to the target imaging light field; the first diffraction plate is used to diffract the modulated terahertz wave once; and the second diffraction plate is used to diffract the terahertz wave after the first diffraction twice to obtain n beams of terahertz waves with unequal powers.
[0013] Preferably, centers of the modulation plate, the first diffraction plate and the second diffraction plate are located on the same optical axis.
[0014] Preferably, the modulation plate uses a semiconductor silicon wafer for visible light imaging and uses a semiconductor mercury cadmium telluride material for infrared light imaging.
[0015] Preferably, the first diffraction plate has a specific thickness pattern, and the second diffraction plate has a specific thickness pattern.
[0016] Preferably, the first diffraction plate and the second diffraction plate are both made of plastic material.
[0017] Preferably, the terahertz detection device includes n terahertz detectors and a processing unit, the n terahertz detectors correspond one-to-one to n beams of terahertz waves, and each of the terahertz detectors is used to convert a beam of terahertz waves into an electrical signal; the processing unit is used to realize the identification and classification of the target to be imaged according to the n electrical signals.
[0018] Preferably, the center of each of the terahertz detectors coincides with the optical axis of the corresponding terahertz wave.
[0019] Preferably, the light spot of the terahertz wave completely covers the light spot of the target to be imaged.
[0020] Preferably, the terahertz source is a terahertz source based on electronic frequency doubling.
[0021] Preferably, the terahertz lens adopts a plano-convex or bi-convex structure.
[0022] According to another aspect of the present invention, there is provided an optical image processing method based on terahertz diffraction, wherein the method uses any of the above-mentioned systems to perform image processing, and the method comprises:
[0023] The terahertz source emits terahertz waves;
[0024] The terahertz lens transmits the terahertz wave to the terahertz modulation diffraction plate;
[0025] The optical imaging device images the target to be imaged onto the terahertz modulated diffraction plate;
[0026] The terahertz modulated diffraction plate modulates and diffracts the transmitted terahertz wave according to the target imaging light field to obtain n beams of terahertz waves with different powers;
[0027] The terahertz detection device converts n terahertz waves into n electrical signals respectively, and recognizes and classifies the target to be imaged according to the n electrical signals.
[0028] By applying the technical solution of the present invention, according to the principle of optical diffraction, the principle of terahertz modulation and the mechanism of artificial neural network, the target to be imaged is directly modulated onto the terahertz wave and split by a diffraction plate, so that the diffracted terahertz wave converges at different positions, realizing all-optical computing for image classification processing, greatly reducing the system complexity, cost, volume and power consumption while maintaining the system recognition accuracy, and improving the overall performance of the system. BRIEF DESCRIPTION OF THE DRAWINGS
[0029] The included drawings are used to provide a further understanding of the embodiments of the present invention, which constitute a part of the specification, are used to illustrate the embodiments of the present invention, and together with the text description, explain the principles of the present invention. Obviously, the drawings in the following description are only some embodiments of the present invention, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0030] Figure 1 A schematic structural diagram of an optical image processing system based on terahertz diffraction according to an embodiment of the present invention is shown;
[0031] Figure 2 Shows Figure 1 Schematic diagram of the structure of the diffraction plate.
[0032] The above drawings include the following reference numerals:
[0033] 1. Terahertz source; 2. Terahertz lens; 3. Terahertz modulation diffraction plate; 3-1. Modulation plate; 3-2. First diffraction plate; 3-3. Second diffraction plate; 4. Optical imaging device; 5. Terahertz detection device; 5-1~5-n. Terahertz detector. DETAILED DESCRIPTION
[0034] It should be noted that, in the absence of conflict, the embodiments in this application and the features in the embodiments can be combined with each other. The technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. The following description of at least one exemplary embodiment is actually only illustrative and is by no means intended to limit the present invention and its application or use. Based on the embodiments in the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0035] It should be noted that the terms used herein are only for describing specific embodiments and are not intended to limit the exemplary embodiments according to the present application. As used herein, unless the context clearly indicates otherwise, the singular form is also intended to include the plural form. In addition, it should be understood that when the terms "comprise" and / or "include" are used in this specification, it indicates the presence of features, steps, operations, devices, components and / or combinations thereof.
[0036] Unless otherwise specifically stated, the relative arrangement of the parts and steps described in these embodiments, numerical expressions and numerical values do not limit the scope of the present invention. At the same time, it should be understood that, for ease of description, the sizes of the various parts shown in the accompanying drawings are not drawn according to the actual proportional relationship. The technology, method and equipment known to ordinary technicians in the relevant field may not be discussed in detail, but in appropriate cases, the technology, method and equipment should be regarded as a part of the authorization specification. In all examples shown and discussed here, any specific value should be interpreted as being merely exemplary, rather than as a limitation. Therefore, other examples of exemplary embodiments may have different values. It should be noted that similar reference numerals and letters represent similar items in the following drawings, so once a certain item is defined in an accompanying drawing, it does not need to be further discussed in subsequent drawings.
[0037] like Figure 1 As shown, the present invention provides an optical image processing system based on terahertz diffraction, the system comprising:
[0038] A terahertz source 1, used for emitting terahertz waves;
[0039] A terahertz lens 2 is used to transmit the terahertz wave to the terahertz modulation diffraction plate 3;
[0040] An optical imaging device 4, used for imaging the target to be imaged onto the terahertz modulated diffraction plate 3;
[0041] The terahertz modulated diffraction plate 3 is used to modulate and diffract the transmitted terahertz wave according to the target imaging light field to obtain n beams of terahertz waves with different powers;
[0042] The terahertz detection device 5 is used to convert n beams of terahertz waves into n electrical signals respectively, and is also used to realize the recognition and classification of the target to be imaged according to the n electrical signals.
[0043] Based on the principles of optical diffraction, terahertz modulation and artificial neural network mechanism, the present invention directly modulates the target to be imaged onto the terahertz wave and splits the beam through a diffraction plate, so that the diffracted terahertz wave converges at different positions, realizing all-optical computing for image classification and processing. While maintaining the system recognition accuracy, it greatly reduces the system complexity, cost, volume and power consumption, and improves the overall performance of the system.
[0044] In the present invention, the centers of the terahertz source 1 , the terahertz lens 2 , and the terahertz modulation diffraction plate 3 are located on the same optical axis.
[0045] According to an embodiment of the present invention, the terahertz modulating diffraction plate 3 comprises a modulating plate 3-1, a first diffraction plate 3-2 and a second diffraction plate 3-3 which are sequentially arranged along the optical path of the terahertz wave. At this time, the target to be imaged is imaged onto the surface of the modulating plate 3-1, and the terahertz wave is irradiated onto the surface of the modulating plate 3-1 through the terahertz lens 2. The modulating plate 3-1 is used to modulate the transmitted terahertz wave according to the target imaging light field; the first diffraction plate 3-2 is used to diffract the modulated terahertz wave once; the first diffraction plate 3-3 ... The plate 3-2 has a specific thickness pattern, which is obtained through training; the terahertz wave after the first diffraction freely propagates in space for a certain distance and then enters the second diffraction plate 3-3, and the second diffraction plate 3-3 is used to perform a second diffraction on the terahertz wave after the first diffraction to obtain n beams of terahertz waves with unequal powers; the second diffraction plate 3-3 has a specific thickness pattern, which is obtained through training; wherein the centers of the modulation plate 3-1, the first diffraction plate 3-2 and the second diffraction plate 3-3 are located on the same optical axis.
[0046] Specifically, the modulation plate 3-1 uses semiconductor silicon wafers for visible light imaging and semiconductor mercury cadmium telluride materials for infrared light imaging. The modulation principle of the modulation plate 3-1 is: when the modulation plate 3-1 is irradiated by the target imaging light field, the valence electrons of the semiconductor material in the corresponding illuminated area are excited to the conduction band to become photogenerated carriers, so that the corresponding area is transformed from an insulating state to a metallic state. These semiconductor materials in the metallic state reduce the transmittance of the corresponding area to terahertz waves. In this way, when the modulation plate 3-1 is irradiated by the target imaging light field, the concentration of photogenerated carriers generated at different light intensities is different, and the transmittance of terahertz waves is also different. In this way, the spatial modulation of the target imaging light field to the terahertz wave is achieved through the modulation plate 3-1.
[0047] Specifically, the first diffraction plate 3-2 and the second diffraction plate 3-3 are both made of plastic material. The first diffraction plate 3-2 and the second diffraction plate 3-3 have similar structures, such as Figure 2 As shown, it can be divided into N×M regions, and each region (i, j) has the same thickness d i,j , and the thickness of different regions is different, then the phase of the terahertz wave transmitted through each region is affected by the different thickness d i,j Modulation. According to Huygens' principle, any point (area) on the diffraction plate can be regarded as a secondary wave source, and the wavefront of the terahertz wave after transmitting the diffraction plate is the envelope surface of the sub-waves emitted by these secondary wave sources. The terahertz wave modulated by the modulation plate 3-1 is diffracted by the first diffraction plate 3-2 and the second diffraction plate 3-3 and converges at different positions, wherein the number of convergence positions n is set to be greater than the number of target image categories to be imaged.
[0048] According to one embodiment of the present invention, the terahertz detection device 5 includes n terahertz detectors and a processing unit, the n terahertz detectors correspond one-to-one to n beams of terahertz waves, and each of the terahertz detectors is used to convert a beam of terahertz waves into an electrical signal; the processing unit is used to realize the identification and classification of the target to be imaged according to the n electrical signals.
[0049] Specifically, the n terahertz detectors can be room temperature terahertz detectors such as Golay detectors. A terahertz detector is placed at each possible terahertz convergence point behind the diffraction plate to detect the terahertz wave at that position, and finally image recognition is achieved based on the detection results.
[0050] According to an embodiment of the present invention, the center of each of the terahertz detectors coincides with the optical axis of the corresponding terahertz wave.
[0051] According to an embodiment of the present invention, the light spot of the terahertz wave completely covers the light spot of the object to be imaged. The imaging is located at the center of the modulation plate 3-1 by setting the system parameters of the optical imaging device 4, wherein the optical imaging device 4 adopts existing mature devices.
[0052] According to an embodiment of the present invention, the terahertz source 1 is a terahertz source 1 based on electronic frequency doubling. The frequency of the terahertz source 1 based on electronic frequency doubling can be selected to be 0.3THz-1THz, so as to have good monochromaticity and certain power.
[0053] According to an embodiment of the present invention, the terahertz lens 2 is used to adjust the divergence angle of the terahertz wave. The terahertz lens 2 adopts a plano-convex or bi-convex structure so that the terahertz wave is irradiated onto the modulation plate 3 - 1 at a smaller emission angle.
[0054] The present invention also provides an optical image processing method based on terahertz diffraction, wherein the method uses any of the above-mentioned systems to perform image processing, and the method comprises:
[0055] The terahertz source 1 emits terahertz waves;
[0056] The terahertz lens 2 transmits the terahertz wave to the terahertz modulation diffraction plate 3;
[0057] The optical imaging device 4 images the target to be imaged onto the terahertz modulated diffraction plate 3;
[0058] The terahertz modulated diffraction plate 3 modulates and diffracts the transmitted terahertz wave according to the target imaging light field to obtain n beams of terahertz waves with different powers;
[0059] The terahertz detection device 5 converts n terahertz waves into n electrical signals respectively, and realizes the recognition and classification of the target to be imaged according to the n electrical signals.
[0060] In summary, the present invention provides an optical image processing system and method based on terahertz diffraction. According to the principle of optical diffraction, the principle of terahertz modulation and the mechanism of artificial neural network, the target to be imaged is directly modulated onto the terahertz wave and split by a diffraction plate, so that the diffracted terahertz wave converges at different positions, realizing all-optical operation of image classification processing, greatly reducing the system complexity, cost, volume and power consumption while maintaining the system recognition accuracy, and improving the overall performance of the system.
[0061] Parts of the present invention that are not described in detail are well known to those skilled in the art.
[0062] In the description of the present invention, it is necessary to understand that the directions or positional relationships indicated by directional words such as "front, back, up, down, left, right", "lateral, vertical, perpendicular, horizontal" and "top, bottom" are usually based on the directions or positional relationships shown in the drawings. They are only for the convenience of describing the present invention and simplifying the description. Unless otherwise specified, these directional words do not indicate or imply that the devices or elements referred to must have a specific direction or be constructed and operated in a specific direction. Therefore, they cannot be understood as limiting the scope of protection of the present invention. The directional words "inside and outside" refer to the inside and outside relative to the contours of each component itself.
[0063] For ease of description, spatially relative terms such as "above", "above", "on the upper surface of", "above", etc. may be used here to describe the spatial positional relationship between a device or feature and other devices or features as shown in the figure. It should be understood that spatially relative terms are intended to include different orientations of the device in use or operation in addition to the orientation described in the figure. For example, if the device in the accompanying drawings is inverted, the device described as "above other devices or structures" or "above other devices or structures" will be positioned as "below other devices or structures" or "below other devices or structures". Thus, the exemplary term "above" can include both "above" and "below". The device can also be positioned in other different ways (rotated 90 degrees or in other orientations), and the spatially relative descriptions used here are interpreted accordingly.
[0064] In addition, it should be noted that the use of terms such as "first" and "second" to limit components is only for the convenience of distinguishing the corresponding components. If not otherwise stated, the above terms have no special meaning and therefore cannot be understood as limiting the scope of protection of the present invention.
[0065] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.
Claims
1. An optical image processing system based on terahertz diffraction, characterized in that: The system comprises: A terahertz source, used for emitting terahertz waves; A terahertz lens, used for transmitting the terahertz wave to the terahertz modulation diffraction plate; An optical imaging device, used for imaging a target to be imaged onto a terahertz modulated diffraction plate; A terahertz modulated diffraction plate is used to modulate and diffract the transmitted terahertz wave according to the target imaging light field to obtain n beams of terahertz waves with different powers; The terahertz detection device is used to convert n beams of terahertz waves into n electrical signals respectively, and is also used to realize the recognition and classification of the target to be imaged according to the n electrical signals.
2. The system according to claim 1, characterized in that The centers of the terahertz source, the terahertz lens, and the terahertz modulation diffraction plate are located on the same optical axis.
3. The system according to claim 1 or 2, characterized in that: The terahertz modulating diffraction plate comprises a modulating plate, a first diffraction plate and a second diffraction plate which are sequentially arranged at intervals along the optical path of the terahertz wave. The modulating plate is used to modulate the transmitted terahertz wave according to the target imaging light field; the first diffraction plate is used to diffract the modulated terahertz wave once; and the second diffraction plate is used to diffract the terahertz wave after the first diffraction twice to obtain n beams of terahertz waves with unequal powers.
4. The system according to claim 3, characterized in that Centers of the modulation plate, the first diffraction plate, and the second diffraction plate are located on the same optical axis.
5. The system according to claim 3 or 4, characterized in that: The modulation plate adopts semiconductor silicon wafer for visible light imaging and adopts semiconductor mercury cadmium telluride material for infrared light imaging.
6. The system according to claim 3, characterized in that The first diffraction plate has a specific thickness pattern, and the second diffraction plate has a specific thickness pattern.
7. The system according to claim 6, characterized in that The first diffraction plate and the second diffraction plate are both made of plastic material.
8. The system according to claim 1, characterized in that The terahertz detection device includes n terahertz detectors and a processing unit. The n terahertz detectors correspond one-to-one to n beams of terahertz waves. Each of the terahertz detectors is used to convert a beam of terahertz waves into an electrical signal. The processing unit is used to realize the recognition and classification of the target to be imaged according to the n electrical signals.
9. The system according to claim 8, characterized in that The center of each terahertz detector coincides with the optical axis of the corresponding terahertz wave.
10. The system according to claim 1, characterized in that The light spot of the terahertz wave completely covers the light spot of the target to be imaged.
11. The system according to claim 1, characterized in that The terahertz source is a terahertz source based on electronic frequency doubling.
12. The system according to claim 1, characterized in that The terahertz lens adopts a plano-convex or bi-convex structure.
13. An optical image processing method based on terahertz diffraction, characterized in that: The method uses any system described in claims 1-12 to perform image processing, and the method comprises: The terahertz source emits terahertz waves; The terahertz lens transmits the terahertz wave to the terahertz modulation diffraction plate; The optical imaging device images the target to be imaged onto the terahertz modulated diffraction plate; The terahertz modulated diffraction plate modulates and diffracts the transmitted terahertz wave according to the target imaging light field to obtain n beams of terahertz waves with different powers; The terahertz detection device converts n terahertz waves into n electrical signals respectively, and recognizes and classifies the target to be imaged according to the n electrical signals.
Citation Information
Patent Citations
Terahertz wave 3D image acquisition method and system
CN105158196A
Super-diffraction resolution limit terahertz spectrum imaging system
CN106932357A
Terahertz imaging system and method based on metasurface structure
CN113218910A
Terahertz coherent diffraction image processing system and method for suppressing infrared interference
CN115755373A
Terahertz imaging system
CN211528196U
