Multi-modal vision sensing system, use method and preparation method of vision sensor

By designing a multimodal vision sensing system and utilizing the photoresponse characteristics of perovskite synaptic transistors, a multimodal perception and processing of optical signals is achieved. This solves the problem of insufficient information diversity in existing vision sensing systems, improves detection efficiency and system stability, and is applicable to fields such as autonomous driving, robot vision, and security monitoring.

CN118921571AActive Publication Date: 2024-11-08CHENGDU RUIJUE SENSING TECHNOLOGY CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202410951846.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-16
Publication Date
2024-11-08
Estimated Expiration
2044-07-16

AI Technical Summary

Technical Problem

Existing visual sensing systems cannot fully utilize the capabilities of perovskite synaptic transistors, cannot meet the demand for diverse information, and are difficult to implement complex neuromorphic computing.

Method used

A multimodal vision sensing system was designed, employing a vision sensor composed of a substrate, a bottom gate layer, an insulating layer, a photosensitive floating gate layer, a tunneling layer, a channel layer, and a metal electrode layer. Combined with a power supply module, a VI conversion transimpedance amplifier module, a microcontroller system, and a result output module, the system controls the separation and capture of photogenerated carriers by different bias voltages, thereby achieving multimodal perception and processing of optical signals.

Benefits of technology

It improves the information processing capability of visual sensing systems, enabling them to quickly and accurately detect photocurrent information and output information on color, motion state, spatial position, and light polarization state. It has the advantages of high efficiency, fast response, and high integration, and is suitable for fields such as autonomous driving, robot vision, and security monitoring.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118921571A_ABST
    Figure CN118921571A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of vision sensing, and provides a multi-modal vision sensing system, a use method and a preparation method of vision sensors, the multi-modal vision sensing system comprises an array formed by a plurality of vision sensors, a power supply module, a VI conversion transimpedance amplification module, a single-chip microcomputer system and a result output module, the photosensitive floating gate layer structurally comprises a two-dimensional perovskite layer and a three-dimensional perovskite layer, the two-dimensional perovskite layer is used for responding to the polarization state of light, the two-dimensional perovskite layer and the three-dimensional perovskite layer are both used for generating photon-generated carriers, and the single-chip microcomputer system is used for receiving voltage signals, converting the voltage signals into digital signals and processing the digital signals. The output module is used for outputting information according to a processing result of the single chip microcomputer system; the information output by the output module comprises wavelength information, the motion state of the object, the spatial position, the time and the polarization state information of the light. By using the system, the problem that an existing visual sensing system can detect and output limited visual information and cannot meet the requirement for diversified information can be solved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of visual sensing technology, in particular to a multimodal visual sensing system and a use method thereof, and a method for preparing a visual sensor. Background Art

[0002] Visual sensors use perovskite synaptic transistor structures to show great potential in improving the ability of computers to process visual information. Synaptic transistors use non-volatile synaptic oxide media, which requires almost no energy for each operation, thereby significantly reducing power consumption. Compared with traditional flash memory devices, synaptic transistors are more energy-efficient and can significantly reduce the overall power consumption of the device. The structure of synaptic transistors is simple and stable, not easy to damage, and can withstand high electron injection, so they have higher reliability. At the same time, synaptic oxide transistors are not prone to failure phenomena such as "leakage" and have a longer service life. Synaptic transistors are manufactured based on CMOS technology, so their manufacturing cost is low and the size of the components is relatively small. This enables synaptic transistors to meet the requirements of various miniaturized devices, further expanding their application areas.

[0003] Although perovskite synaptic transistors can simulate the synapses used to store memories in the brain, there are still challenges in achieving more complex neuromorphic computing. The high interconnectivity and complexity of the brain's neural network make it extremely difficult to simulate its functions, and current technology cannot achieve complete human brain simulation. Therefore, when using perovskite synaptic transistors for visual detection, it may not be possible to fully utilize their capabilities to improve the diversity of detection results. Summary of the invention

[0004] The purpose of the present invention is to solve the problem that the existing visual sensor system can detect and output limited visual information and cannot meet the demand for diverse information. A multimodal visual sensor system and a method for using it, and a method for preparing a visual sensor are provided. The synaptic transistor has sensitive light response and the separation gate can be independently regulated.

[0005] In order to achieve the above object, the technical solution adopted by the present invention is:

[0006] A multimodal visual sensing system, comprising an array formed by a plurality of visual sensors, a power module, a VI conversion transimpedance amplifier module, a single-chip computer system and a result output module, characterized in that the structure of the visual sensor is a substrate, a bottom gate layer, an insulating layer, a photosensitive floating gate layer, a tunneling layer, a channel layer and a metal electrode layer connected in sequence, the substrate is made of flexible material, the bottom gate layer and the metal electrode layer are used to connect the power module, the metal electrode is used as a source and a drain, the photosensitive floating gate layer is a double-layer perovskite film, the structure of the photosensitive floating gate layer from top to bottom is a two-dimensional perovskite layer and a three-dimensional perovskite layer, the two-dimensional perovskite layer is used to respond to the polarization state of light, the two-dimensional perovskite layer and the three-dimensional perovskite layer are used to generate photogenerated carriers, the channel layer is used to transmit carriers, and the tunneling layer is used to capture the carriers and isolate the photogenerated carriers;

[0007] The power module is connected to the bottom gate layer, the metal electrode layer, the VI conversion transimpedance amplifier module, the single-chip computer system and the result output module at the same time. The power module is used to apply a bias voltage to the visual sensor array and to power the VI conversion transimpedance amplifier module, the single-chip computer system and the result output module. The VI conversion transimpedance amplifier module is connected to the metal electrode layer. The VI conversion transimpedance amplifier module is used to amplify the photocurrent signal and convert it into a voltage signal. The single-chip computer system is connected to the VI conversion transimpedance amplifier module. The single-chip computer system is used to receive the voltage signal and convert it into a digital signal and process it. The output module is connected to the single-chip computer system. The output module is used to output the identified information according to the processing result of the single-chip computer system.

[0008] The information output by the output module includes color information, object motion state information, object spatial position information, time information and light polarization state information.

[0009] The present invention provides a multimodal visual sensing system, which uses an array formed by a plurality of the visual sensors to detect photocurrent information more quickly and accurately. When the photosensitive floating gate layer receives a light pulse, photogenerated excitons are generated, and the photogenerated excitons are quickly separated into photogenerated holes and electrons under light. The photogenerated holes enter the channel layer through the tunneling layer, and the electrons are captured at the interface defects between the photosensitive floating gate layer and the tunneling layer in the initial state, and current is generated in the process; therefore, after the light pulse disappears, the current will not drop to the dark state level in the first time, and the photoelectric signal can be used to detect the action that generates the current change.

[0010] Different from the conventional photodetector with constant saturation photocurrent, the visual sensor realizes the interface state and quasi-Fermi level (E) by regulating the gate voltage under various lighting conditions. F) is subjected to a positive (negative) bias voltage V G When the bias is high, E F It can be raised (lowered) and plays a leading role in releasing captured electrons into the channel layer to promote (weaken) recombination with holes, thereby completing the writing and erasing of optical signals and the perception and processing of multi-mode information. The visual sensor uses the two-dimensional perovskite layer and the three-dimensional perovskite layer as a photosensitive floating gate layer to improve the absorption capacity and response to light. The two-dimensional perovskite can have a good response to the polarization state of light and can cooperate with the single-chip system to detect the polarization state digital information of light.

[0011] The power supply module applies different bias voltages to the visual sensor to control the working state of the visual sensor, thereby outputting different photocurrent signals, so that the visual sensor operates in weak light. The photocurrent array detected by the visual sensor array is converted into the voltage signal by the VI conversion transimpedance amplifier module and amplified. After the single-chip computer system receives the voltage signal and converts it into a digital signal and processes it, the output module can output color information, object movement direction information, object spatial position information, time information and light polarization state information according to the processing results.

[0012] As the core control unit of the multimodal visual sensing system, the single-chip microcomputer system can coordinate the work of each part to ensure the efficient operation of the entire multimodal visual sensing system. At the same time, the powerful computing power of the single-chip microcomputer system further enhances the information processing capability of the multimodal visual sensing system. The combination of the visual sensor and the single-chip microcomputer system enables the entire system to be highly integrated in a smaller space. This integration not only reduces the volume and weight of the system, but also improves the stability and reliability of the multimodal visual sensing system.

[0013] The multi-mode visual sensing system used in the present invention has the advantages of high-efficiency information processing, fast response speed, high integration, good compatibility and reliability, strong learning ability, etc., and can also output a variety of information. These advantages make the system have broad application prospects in the fields of autonomous driving, robot vision, security monitoring, etc.

[0014] As a preferred embodiment of the present invention, the component of the two-dimensional perovskite layer is R-configuration phenylethylamine lead iodine, and the component of the three-dimensional perovskite layer is FAPbBr3.

[0015] As a preferred solution of the present invention, the material of the tunneling layer includes polymethyl methacrylate (PMMA).

[0016] A method for using a multimodal visual sensing system includes using the multimodal visual sensing system as described above for detection, first starting a power module, and the visual sensor array performs detection and outputs a photocurrent signal array; the VI conversion transimpedance amplifier module receives the photocurrent signal of each visual sensor, converts it into a voltage signal, amplifies it, and then transmits it to the single-chip computer system;

[0017] The steps to detect wavelength information are as follows:

[0018] A1, the single chip computer system converts the voltage signal into a digital signal, compares it with the wavelength digital information of different color lights recorded in the first database in turn, and outputs a first digital signal;

[0019] A2, an output module receives the first digital signal and outputs color information corresponding to each of the visual sensors;

[0020] The steps to detect the polarization state information of light are as follows:

[0021] B1, the single chip computer system converts the voltage signal into a digital signal and compares it with the digital information of the polarization states of light recorded in the second database in sequence, identifies the polarization information of the photocurrent signal array and outputs it as a second digital signal;

[0022] B2, the output module receives the second digital signal and outputs the corresponding light polarization state information;

[0023] The steps to detect spatial location information and time information are as follows:

[0024] C1, the single-chip computer system converts the voltage signal into a digital signal and calculates the coordinates of each of the visual sensors in the visual sensor array as a mapping digital signal of the light source, and the single-chip computer system sequentially compares the mapping digital signal with the third database to obtain the spatial information of the object and outputs a third digital signal; the single-chip computer system continuously calculates the change trend of the photocurrent signal array and compares it with the time digital information in the fourth database, and outputs a fourth digital signal;

[0025] C2, the output module receives the third digital signal and outputs the spatial position information of the object; the output module receives the fourth digital signal and outputs the time information;

[0026] The steps to detect the motion state information of an object are as follows:

[0027] D1, the single-chip microcomputer system converts the voltage signal into a digital signal, uses the single-chip microcomputer system to scan the digital signal of the visual sensor array at a certain moment when the object is moving, and compares it with the fifth database to obtain the movement information of the object at a certain moment and outputs a fifth digital signal;

[0028] D2. The output module receives the fifth digital signal and outputs the motion state information of the object at a certain moment.

[0029] The present invention provides a method for using a multimodal visual sensing system. Using the visual sensor array, a variety of information can be detected, the detection efficiency in practical applications can be improved, and the detection cost can be reduced.

[0030] When detecting the movement of an object, unlike the motion detection of the traditional visual sensor system, which requires a high-speed camera to take multiple frames of the moving object and process the redundant information, the digital information of the object's movement direction is detected by using a multimodal visual sensor system. It only needs to scan the digital signals of each visual sensor in the visual sensor array at a certain moment when the object is moving to obtain the current object's movement direction. Since the object will block the light irradiated on the visual sensor array when moving in space, the light signal received by the visual sensor array will become weaker, and the photocurrent signal of the visual sensor array will also become weaker. Because the structure used by the visual sensor has a memory characteristic, when the object moves horizontally, the position passed by the object first and the position passed by the object later are mapped in the array to show the state of device current from large to small; and when approaching and moving away, as the relative position of the object, the light source and the visual sensor array changes, the area of ​​the visual sensor array receiving the photocurrent signal will also change. Therefore, only the scanning result at a certain moment in the object's movement is needed to determine the object's movement direction.

[0031] Using synaptic transistors as the visual sensor has a good response to light, is sensitive to light changes, can detect time, color, the spatial position of an object and the polarization state of light quickly and accurately, and improves detection efficiency.

[0032] As a preferred solution of the present invention, the digital information of the wavelengths of light of different colors, the digital information of different polarization states of light, the mapped digital signals corresponding to the light sources at different positions, the digital information at different times and the digital information of objects moving in different directions are respectively input as learning samples into the single-chip computer system and a Bayesian regularized mathematical model is fitted, and then the corresponding first database, second database, third database, fourth database and fifth database are obtained through machine learning and neural network training.

[0033] The single-chip computer system repeatedly performs optical programming and electrical erasing operations on a single visual sensor in the visual sensor array using light pulses and electrical pulses of different wavelengths, and records the measured photocurrent signal. The photocurrent signal of the visual sensor array is used as the mapping result of light pulses of different wavelengths and as the input data of the mathematical model to fit the Bayesian regularized mathematical model. Through machine learning and neural network training, the visual sensor array will have good recognition capabilities for light of different wavelengths and can be applied to the fields of color detection and color imaging.

[0034] When the light source is located in different positions in space, the distribution of photocurrent signals received by the visual sensors in the visual sensor array is also different. The coordinates of each visual sensor in the visual sensor array are used as the mapping result of the position of the light source and as the input data of the mathematical model to fit the Bayesian regularized mathematical model. Through machine learning and neural network training, the visual sensor array can complete the detection of the spatial position of the object.

[0035] Due to the memory characteristics of the visual sensor, when the light pulse disappears, the photocurrent signal of the visual sensor array will not instantly drop to the low level of the off state. Therefore, when the object is within the detection range of the visual sensor array, the photocurrent signal generated will gradually decrease, so it can cooperate with the single-chip computer system to detect the state of the object when it is moving.

[0036] The photocurrent signals corresponding to different times and the photocurrent signals corresponding to different skew normal states of light are used as mathematical model input data and the Bayesian regularized mathematical model is fitted. Through machine learning and neural network training, the visual sensor array can complete the detection of the light source position.

[0037] A method for preparing a visual sensor includes preparing a visual sensor in a multimodal visual sensing system, and the steps are as follows:

[0038] S1. Cleaning, drying and ozone treatment of the substrate;

[0039] S2, forming a bottom gate layer on the top surface of the substrate;

[0040] S3, preparing an insulating layer on the top surface of the bottom gate layer by an atomic deposition method;

[0041] S4, preparing a perovskite precursor solution, coating the perovskite precursor solution on the top surface of the insulating layer and performing annealing treatment to obtain a photosensitive floating gate layer;

[0042] S5, preparing a tunneling layer on the top surface of the photosensitive floating gate layer by atomic deposition;

[0043] S6, preparing a channel layer on the top surface of the tunnel layer by a thermal evaporation coating method;

[0044] S7. Preparing a metal electrode layer on the top surface of the channel layer.

[0045] As a preferred embodiment of the present invention, in step S1, the substrate is firstly ultrasonically cleaned, and then nitrogen is used to remove the liquid remaining on the surface of the substrate, and the substrate is vacuum dried and then ozone treated.

[0046] As a preferred embodiment of the present invention, in step S4, FABr and PbBr2 are dissolved in a mixed solution of anhydrous dimethylformamide (DMF) and dimethyl sulfoxide (DMSO) in a volume ratio of 1:4 to obtain a first perovskite precursor solution; an aqueous solution of hydroiodic acid and an aqueous solution of methylamine (MA) and R-configuration phenylethylamine lead iodine are added to a mixed solution of deionized water and PbI2 to obtain a second perovskite precursor solution, wherein the pH value of the second perovskite precursor solution is less than 4; the first perovskite precursor solution is scraped on the top surface of the bottom gate layer and annealed to obtain a three-dimensional perovskite layer, and then the second perovskite precursor solution is scraped on the top surface of the three-dimensional perovskite layer and annealed and separated to obtain a two-dimensional perovskite layer, thereby completing the preparation of the photosensitive floating gate layer.

[0047] As a preferred solution of the present invention, in step S5, the thickness of the tunneling layer is 8-15 nm.

[0048] As a preferred solution of the present invention, in step S6, the material of the channel layer is pentacene, and the thickness of the channel layer is 30-90 nm.

[0049] As a preferred embodiment of the present invention, in step S7, the metal electrode layer comprises copper, silver or gold, and the metal electrode layer is uniformly prepared on the top surface of the channel layer by thermal evaporation coating method, and the thickness of the metal electrode layer is 80 to 120 nm.

[0050] In summary, due to the adoption of the above technical solution, the beneficial effects of the present invention are:

[0051] 1. A multimodal visual sensing system uses synaptic transistors as visual sensors, which have good response to light, are sensitive to light changes, and can detect time, wavelength, spatial position of objects, motion state of objects, and polarization state of light quickly and accurately, thereby improving detection efficiency.

[0052] 2. A method for using a multimodal visual sensing system, wherein the single-chip computer system compares the received voltage signal with the first database, the second database, the third database, the fourth database and the fifth database respectively, and can quickly determine the wavelength information array, the object's movement direction information, the object's spatial position information, time information and the polarization state information of light.

[0053] 3. A method for preparing a visual sensor. The preparation method is simple and can be prepared using the commonly used preparation method of perovskite photodetectors, which reduces the demand for instruments and thus reduces the cost of introducing new equipment. The prepared visual sensor has sensitive induction and high detection efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0054] Figure 1 It is a connection diagram of a multimodal visual sensing system. DETAILED DESCRIPTION

[0055] The present invention will be described in detail below in conjunction with the accompanying drawings.

[0056] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0057] Example 1

[0058] like Figure 1 As shown, a perovskite synaptic transistor used in the present invention comprises an array formed by a plurality of visual sensors, a power module, a VI conversion transimpedance amplifier module, a single-chip computer system and a result output module, characterized in that the structure of the visual sensor is a substrate, a bottom gate layer, an insulating layer, a photosensitive floating gate layer, a tunneling layer, a channel layer and a metal electrode layer connected in sequence, the substrate is made of flexible material, the bottom gate layer and the metal electrode layer are used to connect the power module, the metal electrode is used as a source and a drain, the photosensitive floating gate layer is a double-layer perovskite film, the structure of the photosensitive floating gate layer from top to bottom is a two-dimensional perovskite layer and a three-dimensional perovskite layer, the two-dimensional perovskite layer is used to respond to the polarization state of light, the two-dimensional perovskite layer and the three-dimensional perovskite layer are used to generate photogenerated carriers, the channel layer is used to transmit carriers, and the tunneling layer is used to capture the carriers and isolate the photogenerated carriers;

[0059] The power module is connected to the bottom gate layer, the metal electrode layer, the VI conversion transimpedance amplifier module, the single-chip computer system and the result output module at the same time. The power module is used to apply a bias voltage to the visual sensor array and to power the VI conversion transimpedance amplifier module, the single-chip computer system and the result output module. The VI conversion transimpedance amplifier module is connected to the metal electrode layer. The VI conversion transimpedance amplifier module is used to amplify the photocurrent signal and convert it into a voltage signal. The single-chip computer system is connected to the VI conversion transimpedance amplifier module. The single-chip computer system is used to receive the voltage signal and convert it into a digital signal and process it. The output module is connected to the single-chip computer system. The output module is used to output the identified information according to the processing result of the single-chip computer system.

[0060] The information output by the output module includes color information, object motion state information, object spatial position information, time information and light polarization state information.

[0061] Furthermore, the component of the two-dimensional perovskite layer is R-configuration phenylethylamine lead iodine, and the component of the three-dimensional perovskite layer is FAPbBr3.

[0062] Furthermore, the material of the tunneling layer includes polymethyl methacrylate (PMMA).

[0063] An array formed by using several of the visual sensors can detect photocurrent information more quickly and accurately. When the photosensitive floating gate layer receives a light pulse, photogenerated excitons are generated. The photogenerated excitons are quickly separated into photogenerated holes and electrons under light. The photogenerated holes enter the channel layer through the tunneling layer, and the electrons are captured at the interface defects between the photosensitive floating gate layer and the tunneling layer in the initial state; therefore, after the light pulse disappears, the current will not drop to the dark state level in the first time, and the photoelectric signal can be used to detect the action that produces the current change. The power supply module applies different bias voltages to the visual sensor to control the working state of the visual sensor, thereby outputting different photocurrent signals. After amplification by the VI conversion transimpedance amplifier module and processing by the single-chip microcomputer system, the output module can output time information, position information, motion trajectory information, spectrum information or polarization state information of light according to the processing results.

[0064] Example 2

[0065] A method for using a multimodal visual sensing system adopted by the present invention comprises using a multimodal visual sensing system as described in Example 1 for detection, firstly starting a power module, and the visual sensor array performs detection and outputs a photocurrent signal array; the VI conversion transimpedance amplifier module receives the photocurrent signal of each visual sensor, converts it into a voltage signal, amplifies it, and transmits it to the single-chip computer system;

[0066] The steps to detect wavelength information are as follows:

[0067] A1, the single chip computer system converts the voltage signal into a digital signal, compares it with the wavelength digital information of different color lights recorded in the first database in turn, and outputs a first digital signal;

[0068] A2, an output module receives the first digital signal and outputs color information corresponding to each of the visual sensors;

[0069] The steps to detect the polarization state information of light are as follows:

[0070] B1, the single chip computer system converts the voltage signal into a digital signal and compares it with the digital information of the polarization states of light recorded in the second database in sequence, identifies the polarization information of the photocurrent signal array and outputs it as a second digital signal;

[0071] B2, the output module receives the second digital signal and outputs the corresponding light polarization state information;

[0072] The steps to detect spatial location information and time information are as follows:

[0073] C1, the single-chip computer system converts the voltage signal into a digital signal and calculates the coordinates of each of the visual sensors in the visual sensor array as a mapping digital signal of the light source, and the single-chip computer system sequentially compares the mapping digital signal with the third database to obtain the spatial information of the object and outputs a third digital signal; the single-chip computer system continuously calculates the change trend of the photocurrent signal array and compares it with the time digital information in the fourth database, and outputs a fourth digital signal;

[0074] C2, the output module receives the third digital signal and outputs the spatial position information of the object; the output module receives the fourth digital signal and outputs the time information;

[0075] The steps to detect the motion state information of an object are as follows:

[0076] D1, the single-chip microcomputer system converts the voltage signal into a digital signal, uses the single-chip microcomputer system to scan the digital signal of the visual sensor array at a certain moment when the object is moving, and compares it with the fifth database to obtain the movement information of the object at a certain moment and outputs a fifth digital signal;

[0077] D2. The output module receives the fifth digital signal and outputs the motion state information of the object at a certain moment.

[0078] Furthermore, the digital information of the wavelengths of light of different colors, the digital information of different polarization states of light, the mapped digital signals corresponding to the light sources at different positions, the digital information at different times and the digital information of objects moving in different directions are respectively input as learning samples into the single-chip computer system and a Bayesian regularized mathematical model is fitted, and then the corresponding first database, second database, third database, fourth database and fifth database are obtained through machine learning and neural network training.

[0079] In this embodiment, a synaptic transistor is used as the visual sensor, which has a good response to light, is sensitive to light changes, and can detect time, color, the spatial position of an object, and the polarization state of light quickly and accurately, thereby improving detection efficiency. Because the structure used by the visual sensor has a memory characteristic, when the object moves horizontally, the position passed first and the position passed later are mapped in the array to present a state of large to small device current; and when approaching and moving away, as the relative position of the object, the light source, and the visual sensor array changes, the area of ​​the visual sensor array receiving the photocurrent signal will also change. Therefore, only the scanning result at a certain moment in the object's movement is required to determine the direction of movement of the object. The single-chip computer system compares the received voltage signal with the first database, the second database, the third database, the fourth database, and the fifth database, respectively, so as to determine the wavelength information array, the object's movement direction information, the object's spatial position information, the time information, and the polarization state information of light.

[0080] Example 3

[0081] A method for preparing a visual sensor used in the present invention comprises preparing a visual sensor in a multimodal visual sensing system as described in Example 1, and the steps are as follows:

[0082] S1. Cleaning, drying and ozone treatment of the substrate;

[0083] S2, forming a bottom gate layer on the top surface of the substrate;

[0084] S3, preparing an insulating layer on the top surface of the bottom gate layer by an atomic deposition method;

[0085] S4, preparing a perovskite precursor solution, coating the perovskite precursor solution on the top surface of the insulating layer and performing annealing treatment to obtain a photosensitive floating gate layer;

[0086] S5, preparing a tunneling layer on the top surface of the photosensitive floating gate layer by atomic deposition;

[0087] S6, preparing a channel layer on the top surface of the tunnel layer by a thermal evaporation coating method;

[0088] S7. Preparing a metal electrode layer on the top surface of the channel layer.

[0089] Furthermore, in step S2, the bottom gate layer is a silicon wafer grown with silicon dioxide. The bottom gate layer is first ultrasonically cleaned, and then nitrogen is used to remove residual liquid on the surface of the bottom gate layer. The bottom gate layer is vacuum dried and then ozone treated, and the bottom gate layer is prepared on the top surface of the substrate by evaporation.

[0090] Furthermore, in step S4, FABr and PbBr2 are dissolved in a mixed solution of anhydrous dimethylformamide (DMF) and dimethyl sulfoxide (DMSO) in a volume ratio of 1:4 to obtain a first perovskite precursor solution; an aqueous solution of hydroiodic acid and an aqueous solution of methylamine (MA) and R-configuration phenylethylamine lead iodine are added to a mixed solution of deionized water and PbI2 to obtain a second perovskite precursor solution, wherein the pH value of the second perovskite precursor solution is less than 4; the first perovskite precursor solution is scraped on the top surface of the bottom gate layer and annealed to obtain a three-dimensional perovskite layer, and then the second perovskite precursor solution is scraped on the top surface of the three-dimensional perovskite layer and annealed and separated to obtain a two-dimensional perovskite layer, thereby completing the preparation of the photosensitive floating gate layer.

[0091] Furthermore, in step S5, the thickness of the tunneling layer is 8-15 nm.

[0092] Furthermore, in step S6, the material of the channel layer is pentacene, and the thickness of the channel layer is 30-90 nm.

[0093] Furthermore, in step S7, the metal electrode layer comprises copper, silver or gold, and the metal electrode layer is prepared on the top surface of the channel layer by thermal evaporation coating method, and the thickness of the metal electrode layer is 80-120 nm.

[0094] Prepare the substrate: take out the substrate and ultrasonically clean it with acetone, ethanol and deionized water for 15 minutes in sequence; take out the cleaned substrate and blow dry the deionized water remaining on the surface with N2; put the blow-dried substrate into a vacuum drying oven set at a temperature of 80°C and keep it for 30 minutes until it is dried; take out the dried substrate from the vacuum drying oven, place it in an ozone environment for 15 minutes, and then take it out for use.

[0095] The bottom gate layer is prepared by using metal copper to evaporate the bottom gate layer with a thickness of 50 nm on the top surface of the substrate.

[0096] Preparing the insulating layer: the material of the insulating layer is aluminum oxide, and the insulating layer is prepared on the top surface of the bottom gate layer by ALD growth. In this embodiment, the thickness of the insulating layer is 100 nm.

[0097] Prepare the photosensitive floating gate layer: take 100 mg of FABr and 293.6 mg of PbBr2 and dissolve them in 4 ml of a mixed solution of anhydrous dimethylformamide (DMF) and dimethyl sulfoxide (DMSO) to obtain the perovskite precursor solution, use a perovskite thin film coating equipment to scrape the above precursor solution on the insulating layer, and after scraping, anneal at 85°C for 10 minutes to obtain the photosensitive floating gate layer.

[0098] Preparation of the tunneling layer: The material of the tunneling layer is PMMA, and the tunneling layer is prepared on the top surface of the photosensitive floating gate layer by ALD growth. In this embodiment, the thickness of the tunneling layer is 10 nm.

[0099] Preparation of the channel layer: The material of the channel layer is pentacene, and the channel layer is prepared on the top surface of the tunneling layer by thermal evaporation coating method. In this embodiment, the thickness of the channel layer is 50 nm.

[0100] Preparation of the metal electrode layer: In this embodiment, the material of the metal electrode layer is copper. The metal electrode layer is prepared on the top surface of the channel layer by thermal evaporation coating method. The thickness of the metal electrode layer is 100 nm.

[0101] The above are only preferred embodiments of the present invention and are not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. A multimodal visual sensing system, comprising an array formed by a plurality of visual sensors, a power module, a VI conversion transimpedance amplifier module, a single-chip computer system and a result output module, characterized in that: The structure of the visual sensor is a substrate, a bottom gate layer, an insulating layer, a photosensitive floating gate layer, a tunneling layer, a channel layer and a metal electrode layer connected in sequence, the substrate is made of flexible material, the bottom gate layer and the metal electrode layer are used to connect the power module, the metal electrode is used as a source and a drain, the photosensitive floating gate layer is a double-layer perovskite film, the structure of the photosensitive floating gate layer from top to bottom is a two-dimensional perovskite layer and a three-dimensional perovskite layer, the two-dimensional perovskite layer is used to respond to the polarization state of light, the two-dimensional perovskite layer and the three-dimensional perovskite layer are used to generate photogenerated carriers, the channel layer is used to transmit carriers, and the tunneling layer is used to capture the carriers and isolate the photogenerated carriers; The power module is connected to the bottom gate layer, the metal electrode layer, the VI conversion transimpedance amplifier module, the single-chip computer system and the result output module at the same time. The power module is used to apply a bias voltage to the visual sensor array and to power the VI conversion transimpedance amplifier module, the single-chip computer system and the result output module. The VI conversion transimpedance amplifier module is connected to the metal electrode layer. The VI conversion transimpedance amplifier module is used to amplify the photocurrent signal and convert it into a voltage signal. The single-chip computer system is connected to the VI conversion transimpedance amplifier module. The single-chip computer system is used to receive the voltage signal and convert it into a digital signal and process it. The output module is connected to the single-chip computer system. The output module is used to output the identified information according to the processing result of the single-chip computer system. The information output by the output module includes color information, object motion state information, object spatial position information, time information and light polarization state information.

2. A multimodal visual sensing system according to claim 1, characterized in that: The component of the two-dimensional perovskite layer is R-configuration phenylethylamine lead iodine, and the component of the three-dimensional perovskite layer is FAPbBr3.

3. A multimodal visual sensing system according to claim 1, characterized in that: The material of the tunneling layer includes polymethyl methacrylate (PMMA).

4. A method for using a multimodal visual sensing system, characterized in that: The method comprises using a multimodal visual sensing system as claimed in any one of claims 1 to 3 for detection, firstly starting a power module, and the visual sensor array performs detection and outputs a photocurrent signal array; the VI conversion transimpedance amplifier module receives the photocurrent signal of each visual sensor, converts it into a voltage signal, amplifies it, and then transmits it to the single-chip computer system; The steps to detect wavelength information are as follows: A1, the single chip computer system converts the voltage signal into a digital signal, compares it with the wavelength digital information of different color lights recorded in the first database in turn, and outputs a first digital signal; A2, an output module receives the first digital signal and outputs color information corresponding to each of the visual sensors; The steps to detect the polarization state information of light are as follows: B1, the single chip computer system converts the voltage signal into a digital signal and compares it with the digital information of the polarization states of light recorded in the second database in sequence, identifies the polarization information of the photocurrent signal array and outputs it as a second digital signal; B2, the output module receives the second digital signal and outputs the corresponding light polarization state information; The steps to detect spatial location information and time information are as follows: C1, the single-chip computer system converts the voltage signal into a digital signal and calculates the coordinates of each of the visual sensors in the visual sensor array as a mapping digital signal of the light source, and the single-chip computer system sequentially compares the mapping digital signal with the third database to obtain the spatial information of the object and outputs a third digital signal; the single-chip computer system continuously calculates the change trend of the photocurrent signal array and compares it with the time digital information in the fourth database, and outputs a fourth digital signal; C2, the output module receives the third digital signal and outputs the spatial position information of the object; the output module receives the fourth digital signal and outputs the time information; The steps to detect the motion state information of an object are as follows: D1, the single-chip microcomputer system converts the voltage signal into a digital signal, uses the single-chip microcomputer system to scan the digital signal of the visual sensor array at a certain moment when the object is moving, and compares it with the fifth database to obtain the movement information of the object at a certain moment and outputs a fifth digital signal; D2. The output module receives the fifth digital signal and outputs the motion state information of the object at a certain moment.

5. The method for using a multimodal visual sensing system according to claim 4, characterized in that: The digital information of the wavelengths of light of different colors, the digital information of light of different polarization states, the mapped digital signals corresponding to the light sources at different positions, the digital information at different times and the digital information of the objects moving in different directions are respectively used as learning samples to fit the Bayesian regularized mathematical model, and then the corresponding first database, second database, third database, fourth database and fifth database are obtained through machine learning and neural network training.

6. A method for preparing a visual sensor, characterized in that: The method comprises preparing a visual sensor in a multimodal visual sensing system as claimed in any one of claims 1 to 3, the steps of which are as follows: S1. Cleaning, drying and ozone treatment of the substrate; S2, forming a bottom gate layer on the top surface of the substrate; S3, preparing an insulating layer on the top surface of the bottom gate layer by an atomic deposition method; S4, preparing a perovskite precursor solution, coating the perovskite precursor solution on the top surface of the insulating layer and performing annealing treatment to obtain a photosensitive floating gate layer; S5, preparing a tunneling layer on the top surface of the photosensitive floating gate layer by atomic deposition; S6, preparing a channel layer on the top surface of the tunnel layer by a thermal evaporation coating method; S7. Preparing a metal electrode layer on the top surface of the channel layer.

7. The method for preparing a perovskite synaptic transistor according to claim 6, characterized in that: In step S4, FABr and PbBr2 are dissolved in a mixed solution of anhydrous dimethylformamide (DMF) and dimethyl sulfoxide (DMSO) in a volume ratio of 1:4 to obtain a first perovskite precursor solution; an aqueous solution of hydroiodic acid and an aqueous solution of methylamine (MA) and R-configuration phenylethylamine lead iodine are added to a mixed solution of deionized water and PbI2 to obtain a second perovskite precursor solution, wherein the pH value of the second perovskite precursor solution is less than 4; The first perovskite precursor solution is scraped on the top surface of the bottom gate layer and annealed to obtain a three-dimensional perovskite layer, and then the second perovskite precursor solution is scraped on the top surface of the three-dimensional perovskite layer and annealed and separated to obtain a two-dimensional perovskite layer, thereby completing the preparation of the photosensitive floating gate layer.

8. The method for preparing a perovskite synaptic transistor according to claim 6, characterized in that: In step S5, the thickness of the tunneling layer is 8-15 nm.

9. The method for preparing a perovskite synaptic transistor according to claim 6, characterized in that: In step S6, the material of the channel layer is pentacene, and the thickness of the channel layer is 30-90 nm.

10. The method for preparing a perovskite synaptic transistor according to claim 6, characterized in that: In step S7, the metal electrode layer comprises copper, silver or gold, and the metal electrode layer is prepared on the top surface of the channel layer by thermal evaporation coating method, and the thickness of the metal electrode layer is 80-120 nm.

Citation Information

Patent Citations

  • Synaptic transistor based on two-dimensional and three-dimensional perovskite composite structure and preparation method of synaptic transistor

    CN111628078A

  • Mixed-dimension composite perovskite thin film, preparation method and application thereof, and photosensitive thin film transistor

    CN113130767A

  • Plastic identification system based on near-infrared dual-wavelength coherent light source

    CN114354531A

  • Retinomorphic sensor array and image convolution method therefor

    US20240136461A1