Diamond single crystal heteroepitaxial growth intelligent bias regulation and control method and diamond single crystal heteroepitaxial growth intelligent bias regulation and control system

Through intelligent bias regulation method, reinforcement learning and dual-channel LSTM network are used to optimize bias output in real time, solving the problem of uneven nucleation density during the growth of diamond film on large-size substrates, achieving high quality of diamond films and stable growth on large-size substrates.

CN120082964AActive Publication Date: 2025-06-03HARBIN INST OF TECH

Patent Information

Application Number
CN202510570428.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-05-06
Publication Date
2025-06-03
Estimated Expiration
2045-05-06

AI Technical Summary

Technical Problem

When growing diamond films on large-sized substrates, high-density defects and internal stresses are often caused by lattice mismatch and differences in thermal expansion coefficients, which affects the uniformity and quality of the film. Traditional bias voltage regulation methods lack real-time feedback regulation capabilities, making it difficult to adapt to the differences in plasma environment between the center and edge areas, resulting in uneven nucleation density.

Method used

Using intelligent bias regulation method, data is collected through plasma emission spectrometer and thermal radiation sensor, reinforcement learning model is constructed to dynamically optimize bias output, and a dual-channel LSTM network is used to predict the nucleation probability of each region of the substrate in real time, and an asymmetric bias waveform is automatically generated for compensation and adjustment, realizing closed-loop adjustment of bias output.

Benefits of technology

The difference in nucleation density between the center and edge regions of the substrate is significantly reduced, the uniformity and controllability of the epitaxial growth process are improved, and the high quality of the diamond film and stable growth on large-size substrates are ensured.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120082964A_ABST
    Figure CN120082964A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of diamond epitaxial growth, and discloses an intelligent bias voltage regulation and control method and system for diamond single crystal heteroepitaxial growth, and the system comprises a data acquisition module, a prediction module, an intelligent optimization module, a gradient field compensation module and a feedback and regulation and control module. The future trend is pre-judged by adopting the prediction model, and potential growth abnormality such as nucleation probability reduction in a certain area can be perceived in advance, so that the control system has perspectiveness, and lagging of post passive compensation is avoided; the reinforcement learning controller comprehensively considers an accumulative effect and a long-term target in a strategy optimization process, so that bias voltage regulation and control are more intelligent; the intelligent decision-making capability is far better than that of an adjustment mode of artificial experience or a preset program, so that the growth process has stronger robustness on external disturbance such as airflow fluctuation and discharge state change; in the whole growth process, the consistency of crystal nucleuses and growth rates in all regions is kept, and the accumulation of thermal stress and defects in the large-size thin film can be inhibited.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of diamond epitaxial growth, and more specifically to an intelligent bias voltage regulation method and system for heteroepitaxial growth of single-crystal diamond. Background Art

[0002] Single-crystal diamond has excellent properties in mechanics, acoustics, thermotics, optoelectronics, etc., and has broad application prospects in fields such as high-power electronic devices, quantum devices, and optical windows; growing large-size single-crystal diamond thin films on substrates such as iridium (Ir) / yttrium-stabilized zirconia (YSZ) / silicon by heteroepitaxial method is an important way to achieve large-area single-crystal diamond at present; however, there are still many challenges in realizing large-size heteroepitaxial diamond in practice; for example, due to the large lattice mismatch and difference in thermal expansion coefficient between diamond and common substrate materials, high-density defects and internal stress up to several GPa are easily introduced in the diamond epitaxial layer with a thickness of hundreds of micrometers, which may cause cracking of the grown diamond thin film; in addition, when performing plasma chemical vapor deposition (CVD) growth on a large-size substrate, the plasma state and temperature field in the center and edge of the reaction zone are often non-uniform; this non-uniformity will cause a difference in nucleation density between the center region and the edge region of the substrate. If not controlled, it may lead to non-uniform thickness and quality of the grown diamond thin film, affecting the yield of device fabrication.

[0003] In order to improve the uniformity of heteroepitaxial single-crystal diamond growth, researchers often use bias-enhanced nucleation (BEN) technology to apply a bias voltage to the substrate at the initial stage of growth to increase the nucleation density; however, traditional bias voltage regulation usually remains constant during the growth process or is adjusted according to a preset program, lacking the ability of feedback regulation on the real-time state of the growth process; when the substrate size expands to the inch level, the fixed bias voltage scheme is difficult to adapt to the difference in plasma environment between the center and edge regions over time, resulting in a large deviation in nucleation density between different regions; according to existing experience estimates, when no special control measures are adopted, the difference in nucleation density between the center and edge of a large-size substrate can reach about ±15%; this difference will further affect the consistency of grain growth, which is not conducive to obtaining high-quality large-area single-crystal diamond thin films.

[0004] In view of this, the present invention provides an intelligent bias voltage regulation method and system for heteroepitaxial growth of single-crystal diamond, which can realize intelligent dynamic adjustment of the bias voltage to significantly reduce the difference in nucleation density between the center and edge regions of the substrate, and improve the uniformity and controllability of the epitaxial growth process. Summary of the Invention

[0005] To overcome the above-mentioned defects of the prior art, the present invention provides an intelligent bias voltage regulation method and system for diamond single crystal heteroepitaxial growth to solve the problems existing in the above-mentioned background technology.

[0006] The present invention provides the following technical solutions: An intelligent bias voltage regulation method for diamond single crystal heteroepitaxial growth, comprising the following steps: Step S1: Collect characteristic spectral data of the plasma through an inductively coupled plasma optical emission spectrometer, and collect substrate surface thermal radiation data through a thermal radiation sensor to obtain characteristic information on the substrate state; Step S2: Construct a bias voltage regulation model based on reinforcement learning, use the characteristic information of the substrate state to obtain a reward function, and dynamically optimize the bias voltage output of each region of the substrate during the epitaxial growth process according to the reward function; Step S3: Use a dual-channel LSTM network to fuse and process the characteristic spectral data and the substrate surface thermal radiation data to predict the nucleation probability of each local region of the substrate in real time; Step S4: When it is detected that the electron density in the substrate edge region is lower than a preset threshold, an asymmetric bias voltage waveform is automatically generated and a compensation adjustment is applied to the edge region; Step S5: Based on the real-time feedback information during the epitaxial growth process, perform a closed-loop adjustment on the bias voltage output.

[0007] Preferably, the reward function is defined as the total reward with a discount factor accumulated at each time step t, and the formula is expressed as: ; Wherein, represents the reward function, represents the immediate reward corresponding to the deviation between the nucleation density in the central region and the preset target value at time step t; represents the immediate reward corresponding to the deviation between the nucleation density in the edge region and the preset target value at time step t; and are the weight coefficients of the central region and the edge region respectively, represents the discount factor, and the value range satisfies ; is the total number of time steps.

[0008] Preferably, the dual-channel LSTM network prediction model in step S3 has a dual-input channel structure. The first channel inputs the spectral intensity sequence of the plasma, and the second channel inputs the substrate temperature sequence; the hidden states of the two channels are fused in the network to output the nucleation probability estimation value of each spatial position at the corresponding time; The prediction steps of the dual-channel LSTM network prediction model are as follows: The first channel receives the characteristic spectral data of the plasma and extracts spectral features to predict the initial value of the nucleation probability for each local region; The second channel receives the substrate surface thermal radiation data and extracts temperature features, combines them with the spectral features to optimize the prediction accuracy, and generates the nucleation probability prediction value for each local region.

[0009] Preferably, the expression of the dual-channel LSTM network prediction model is: ; where, represents the predicted nucleation probability at the substrate position at time step ; represents the LSTM network output function, which is used to map the input membership sequence to the current prediction output; represents the number of historical time steps; is the weight coefficient of the characteristic spectral data for the historical time step ; is the weight coefficient of the thermal radiation data for the historical time step ; represents the characteristic spectral data collected at the position at time step ; represents the substrate surface thermal radiation data collected at the position at time step ; represents the number of historical time steps considered for prediction.

[0010] Preferably, the asymmetric bias waveform in step S4 can be expressed by the formula: ; where, is the representation of the asymmetric bias waveform at the position at time step ; represents the bias value applied to the central region of the substrate at time step ; represents the compensation coefficient, and the value range is ; represents the change in the electron density of the edge region detected at time step ; is the position compensation function, which is used to dynamically adjust the compensation amplitude according to the specific position of the edge region.

[0011] An intelligent bias voltage regulation system for heteroepitaxial growth of single crystal diamond, comprising a data acquisition module, a prediction module, an intelligent optimization module, a gradient field compensation module, and a feedback and regulation module; The data acquisition module is used to collect the characteristic spectral data of the plasma and the substrate surface thermal radiation data in real time through a collection device, and obtain the characteristic information of the substrate state; The prediction module is used to receive the characteristic information output by the data acquisition module, and perform real-time processing on the characteristic information by using a dual-channel LSTM network to predict the nucleation probability of each local area of the substrate; The intelligent optimization module is used to receive the characteristic information output by the data acquisition module, obtain the reward function of nucleation uniformity, and generate a dynamically optimized bias voltage regulation strategy; The gradient field compensation module is used to automatically generate an asymmetric bias voltage waveform according to the change of the electron density in the edge area monitored in real time, and apply bias voltage compensation adjustment to the substrate edge area; The feedback and regulation module is used to perform closed-loop regulation on the bias voltage output based on the data monitored in real time.

[0012] Preferably, the collection device includes a plasma emission spectrometer and a thermal radiation sensor; the plasma emission spectrometer is used to monitor the characteristic spectral intensity of the plasma in the growth reaction chamber in real time; the thermal radiation sensor is used to measure the temperature and radiation intensity of the substrate surface in real time.

[0013] Preferably, the gradient field compensation module is provided with an independent bias voltage application unit for applying an additional bias voltage signal to the substrate edge area; the gradient field compensation module outputs a bias voltage waveform to the edge bias voltage source according to a predetermined asymmetric waveform generation rule.

[0014] Preferably, the intelligent optimization module is preset with a reward function and a reinforcement learning algorithm strategy for measuring nucleation uniformity, and the control instructions output by the intelligent optimization module include adjustment suggestions for the bias voltage values of the central area and the edge area, and a decision signal on whether to trigger gradient field compensation.

[0015] The technical effects and advantages of the present invention: The present invention is provided with step S2 and step S3, which is conducive to predicting future trends by adopting a prediction model, and can perceive potential growth anomalies in advance, such as a reduced nucleation probability in a certain area, so that the control system is forward-looking and avoids the lag of passive compensation afterwards; in addition, the reinforcement learning controller can comprehensively consider the cumulative effect and long-term goals in the process of strategy optimization, so that the bias regulation is more intelligent and adaptive; for example, when the edge area is in an unfavorable state for a long time, the system may increase the bias of the area in advance or even adjust the vapor deposition parameters in the entire substrate range to prevent the expansion of non-uniformity; this intelligent decision-making ability is far superior to the adjustment method of manual experience or preset programs, so that the growth process has stronger robustness to external disturbances such as airflow fluctuations, discharge state changes, etc.

[0016] The present invention is provided with step S4, which is beneficial to significantly reduce the difference in nucleation density between the center and edge areas of the substrate by real-time monitoring of the center and edge plasma states and dynamically adjusting the bias voltage. This improvement in uniformity ensures that the density of diamond nuclei on the entire substrate surface is more consistent, providing equal starting conditions for subsequent grain growth, thereby helping to obtain high-quality single crystal films with small thickness differences and smaller stress concentration areas; at the same time, stable single crystal diamond epitaxial growth can be achieved on a larger substrate; uniform nucleation density avoids the problem of local grain size being too large or too small, reduces the concentration of stress in the film from the source, and is expected to reduce the risk of cracks in the epitaxial layer; and maintains the consistency of nuclei and growth rates in each region throughout the growth process, which is beneficial to suppressing the accumulation of thermal stress and defects in large-size films. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 This is a flow chart of the intelligent bias control method for diamond single crystal heteroepitaxial growth of the present invention.

[0018] Figure 2 This is a structural diagram of the intelligent bias control system for diamond single crystal heteroepitaxial growth of the present invention.

[0019] Figure 3 This is a flow chart of the intelligent bias control system for diamond single crystal heteroepitaxial growth of the present invention.

[0020] Figure 4 This is the reward function and LSTM prediction graph of the present invention.

[0021] Figure 5 Schematic diagram of the gradient field compensation algorithm of the present invention.

[0022] Figure 6 It is an experimental comparison diagram of the present invention. DETAILED DESCRIPTION

[0023] Next, the technical solutions of the present invention will be clearly and completely described in conjunction with the accompanying drawings of the present invention. In addition, the forms of each structure described in the following embodiments are merely examples, and a method and system for intelligent bias control of diamond single crystal heteroepitaxial growth according to the present invention are not limited to the structures described in the following embodiments. All other embodiments obtained by those of ordinary skill in the art without creative efforts fall within the scope of protection of the present invention.

[0024] Example 1 As Figure 1 shown, the present invention provides a method for intelligent bias control of diamond single crystal heteroepitaxial growth, including the following steps: Step S1: Collect characteristic spectral data of the plasma, and use a thermal radiation sensor to collect thermal radiation data on the substrate surface, so as to form characteristic information describing the substrate state; The collection method of the characteristic spectral data of the plasma is: select the characteristic emission peak in the plasma, for example, take the spectral line at about 405 nm wavelength as the monitoring object to obtain the light intensity information reflecting the plasma activity or electron density; the thermal radiation sensor is used to obtain the thermal radiation data of the substrate to measure the temperature distribution or average temperature on the substrate surface; Step S2: Build a bias control model based on reinforcement learning, calculate the reward function using the characteristic information describing the substrate state, and dynamically optimize the bias output of each region of the substrate during the epitaxial growth process; the purpose is to use the data collected in Step S1, through the definition and solution of the reward function, to dynamically optimize the bias output of each region during the epitaxial growth process; in Step S2, reinforcement learning can directly use the data collected in Step S1, or analyze it in combination with the information output in Step S3, so as to take into account the forward-looking and real-time nature when dynamically optimizing the bias output; Input the real-time obtained characteristic information into the bias control model constructed by the reinforcement learning algorithm. The reinforcement learning controller takes the characteristic information as the environmental state, evaluates the quality of the growth uniformity under the current strategy according to the pre-set reward function, and adjusts the bias output strategy through continuous exploration and learning; among them, the reward function is designed to characterize the uniformity of the nucleation density on the substrate surface, and the reinforcement learning controller optimizes the bias control strategy with the goal of maximizing this reward function; Step S3: Use a dual-channel LSTM network to fuse the characteristic spectral data and the substrate surface thermal radiation data, and predict the nucleation probability of each local area of the substrate in real time, so as to realize the prediction and control of the epitaxial growth process; its purpose is that Step S3 focuses on using a dual-channel LSTM network to fuse the collected spectral data and thermal radiation data, and predict the nucleation probability of each local area of the substrate in real time, so as to predict the future growth trend in advance and provide a reference for subsequent control; Step S2 and Step S3 have independent functions. In the actual control process, Step S2 and Step S3 can be processed synchronously within the same control cycle, so as to realize the monitoring of the current growth state and the prediction of the future trend; Step S4: When it is detected that the electron density in the edge area of the substrate is lower than the preset threshold, an asymmetric bias waveform is automatically generated and applied to the edge area for compensation adjustment, so as to reduce the difference in nucleation density between the central area and the edge area; When it is detected that the plasma state in the edge area of the substrate deteriorates significantly, for example, the electron density indicated by the spectral intensity is lower than the preset threshold, the gradient field compensation algorithm will be triggered to generate an asymmetric bias waveform to perform additional bias compensation adjustment on the edge area; the so-called "asymmetric bias waveform" refers to superimposing a bias component with different synchronization or amplitude on the edge area relative to the bias applied to the central area, so as to differentially strengthen the ion bombardment or electric field intensity in the edge area; Step S5: According to the real-time feedback information during the epitaxial growth process, perform closed-loop adjustment on the bias output to ensure that the nucleation density on the substrate surface always remains uniform.

[0025] In this embodiment, it should be specifically noted that the reward function is defined as the total reward with a discount factor accumulated at each time step t, and the formula is expressed as: ; Among them, represents the reward function, represents the immediate reward corresponding to the deviation between the nucleation density in the central area and the preset target value at time step t; represents the immediate reward corresponding to the deviation between the nucleation density in the edge area and the preset target value at time step t; and are the weight coefficients of the central area and the edge area respectively, used to balance the influence of the two areas on the overall uniformity, satisfying ; represents the discount factor, and the value range satisfies , used to reflect the influence of future rewards on the current decision; is the total number of time steps, that is, the number of decisions considered in the entire reinforcement learning process; When the nucleation density in the central region or the edge region of the substrate deviates more from the preset target, the corresponding immediate reward function or is lower (the negative value of the deviation or the opposite of its absolute value can be used as the reward, so that the greater the deviation, the smaller the reward), thereby reducing the accumulated reward , and the reinforcement learning controller thus tends to take actions that can improve , that is, a bias control strategy that reduces the deviation of the nucleation density in each region.

[0026] In this embodiment, it should be specifically noted that the step S3 uses a dual-channel LSTM network prediction model to process the plasma spectral data and the substrate surface thermal radiation data provided by the data acquisition module, so as to predict the nucleation probability at different positions of the substrate in real time; LSTM is a recurrent neural network that can capture long-term dependencies in time series. In this embodiment, it is designed as a dual-input channel structure. The first channel inputs the spectral intensity sequence of the plasma, and the second channel inputs the substrate temperature sequence; the hidden states of the two channels are fused in the network to output the nucleation probability estimation value at each spatial position at the corresponding time; The prediction steps of the dual-channel LSTM network prediction model are as follows: The first channel extracts features such as the change of the 405nm characteristic spectral intensity over time to preliminarily predict the change trend of the nucleation probability; The second channel extracts the features of the substrate temperature change over time, and fuses it with the output features of the first channel to correct and optimize the prediction result of the nucleation probability; Through this dual-source information fusion, the prediction accuracy of the complex growth process can be effectively improved.

[0027] In this embodiment, it should be specifically noted that the expression of the dual-channel LSTM network prediction model is: ; wherein, represents the predicted nucleation probability at the substrate position at the time step ; represents the LSTM network output function, which is a non-linear output mapping function obtained by training the LSTM network, and is used to map the input membership sequence to the current prediction output; represents the number of historical time steps; is the weight coefficient of the characteristic spectral data for the historical time step ; is the weight coefficient of the thermal radiation data for the historical time step ; the weight coefficient is comprehensively generated by the memory cells and gating mechanisms of the LSTM, and reflects the relative influence of each historical data on the current prediction; Indicates the characteristic spectral data collected at position at time step ; Indicates the substrate surface thermal radiation data collected at position at time step ; Indicates the number of historical time steps considered for prediction, i.e., the number of past time data included in the network input; Adopts a dual-channel LSTM network prediction model, which can predict the probability of forming crystal nuclei at different positions at the current moment based on the spectral and temperature information of the past N samplings, providing a forward-looking basis for bias regulation decisions; As Figure 4 shown, it shows the calculation process of the reward function and the prediction schematic diagram of the dual-channel LSTM network. The blue curve represents the change of the immediate reward corresponding to the deviation between the nucleation density in the central region and the preset target value over time, the green curve represents the change of the immediate reward corresponding to the deviation between the nucleation density in the edge region and the preset target value over time, and the red dashed line represents the total reward obtained after weighting. Figure 4 It shows how to evaluate the impact of the current bias strategy on nucleation uniformity through the reinforcement learning algorithm, and intuitively shows how the dual-channel LSTM uses historical data to predict the future nucleation probability; In each control decision cycle, for example, a control update is performed every several seconds. Preferably, the plasma state vector and the calculation results of each module are updated every 5 seconds. The reinforcement learning controller takes the latest sensing data and the LSTM prediction result as the current state input and outputs the corresponding bias regulation action. This regulation action adjusts the bias of different regions of the substrate to maximize the aforementioned reward function. Usually, the reinforcement learning controller will gradually approach the optimal strategy during training or online learning, so that the nucleation rates in the center and edge of the substrate tend to be consistent. The present invention introduces a gradient field compensation mechanism in the control process to further handle the abnormal situation of the edge region state in extreme cases, such as significant attenuation of the plasma.

[0028] In this embodiment, it should be specifically noted that the asymmetric bias waveform in step S4 can be expressed by the formula: ; where is the representation of the asymmetric bias waveform at position at time step ; represents the bias value applied to the central region of the substrate at time step ; represents the compensation coefficient, and its value range is , for adjusting the amplitude of the bias compensation; Indicates the change in the electron density of the edge region detected at time step It can be defined as the deviation of the electron density in the edge region from the normal level or from the electron density in the central region; is a position compensation function for dynamically adjusting the compensation amplitude according to the specific position of the edge region; the position compensation function can be a constant, a radial distance function, a sine function, etc., and the specific form of the position compensation function is determined by the substrate geometry; When the plasma in the edge region becomes weak, relative to will be increased or adjusted to increase the actual effective bias at the edge; conversely, if the state of the edge region improves, the additional amount of the edge bias can also be reduced accordingly; the asymmetric bias waveform usually shows high-speed pulses or fluctuations superimposed on the reference bias, and its frequency and amplitude can be selected by those skilled in the art according to the actual situation, as long as it can improve the nucleation conditions in the edge region without significantly affecting the growth in the central region; such as Figure 5 shown, which shows the principle of the gradient field compensation algorithm. The blue curve in the figure represents the reference bias maintained in the central region (for example, -150V), and the orange curve represents the asymmetric bias waveform generated by superimposing high pulses through the compensation algorithm due to the detected decrease in electron density in the edge region. This figure intuitively shows how the gradient field compensation algorithm automatically generates an asymmetric bias waveform according to the detected change in the electron density in the edge region, so as to perform additional compensation on the edge region and effectively improve the problem of insufficient edge nucleation.

[0029] In this embodiment, it should be specifically noted that the intelligent bias regulation method for diamond single crystal heteroepitaxial growth provided in this embodiment can form a closed-loop control, continuously adjust the bias distribution according to the feedback of the growth process, ensure that the nucleation density on the entire surface of the substrate is uniform and stable, and the method provided in this embodiment is applicable to the single crystal diamond growth on large-size hetero-substrates such as 4 inches and above, and can still dynamically correct the center-edge deviation during a long growth time, thereby effectively improving the overall quality of the epitaxial film.

[0030] Embodiment 2 such as Figure 2 shown, the present invention provides an intelligent bias regulation system for diamond single crystal heteroepitaxial growth, including a data acquisition module, a prediction module, an intelligent optimization module, a gradient field compensation module, and a feedback and regulation module; The data acquisition module is used to collect the characteristic spectral data of the plasma and the thermal radiation data of the substrate surface in real time through a collection device, and form characteristic information describing the substrate state; the collection device includes an inductively coupled plasma optical emission spectrometer and a thermal radiation sensor, and the two work together to obtain the characteristic spectral data and the thermal radiation data of the substrate surface in real time; the inductively coupled plasma optical emission spectrometer is used to monitor the characteristic spectral intensity of the plasma in the growth reaction chamber in real time to reflect the change in the concentration of specific active substances or the electron density in the plasma; the thermal radiation sensor is used to measure the temperature or radiation intensity of the substrate surface in real time to reflect the heating of the substrate by the plasma. The data collected by the spectrometer and the temperature sensor are transmitted to the control unit through a high-speed data interface to form a plasma state vector for characterizing the current substrate state; The prediction module is used to receive the characteristic information output by the data acquisition module, and use a dual-channel LSTM network to process the characteristic information in real time to predict the nucleation probability of each local area of the substrate, so as to realize the prediction and control of the epitaxial growth process; The intelligent optimization module is used to receive the characteristic information output by the data acquisition module, obtain the reward function of nucleation uniformity, and generate a dynamically optimized bias voltage regulation strategy; an enhanced learning controller is provided in the intelligent optimization module, and the enhanced learning algorithm is used to make decision control on the bias voltage output. Its optimization goal is to minimize the difference in nucleation density between the central area and the edge area of the substrate. The enhanced learning algorithm dynamically adjusts the bias voltage of each area by maximizing the reward function based on the nucleation density difference; The gradient field compensation module is used to automatically generate an asymmetric bias voltage waveform according to the change in the electron density in the edge area monitored in real time, and apply bias voltage compensation adjustment to the edge area of the substrate; The feedback and regulation module is used to perform closed-loop regulation on the bias voltage output based on the data monitored in real time to ensure the uniformity of the nucleation density on the substrate surface.

[0031] In this embodiment, it should be specifically noted that the intelligent optimization module is the decision-making center, which receives the feature information from the data acquisition module and the nucleation probability prediction result from the prediction module, and comprehensively uses them as the input of the current environmental state to the reinforcement learning controller; the intelligent optimization module is pre-set with a reward function and a reinforcement learning algorithm strategy for measuring the nucleation uniformity, such as specific implementation methods like the deep Q-network DQN or the policy gradient algorithm, etc., and this embodiment does not make specific limitations on this; in each control cycle, the reinforcement learning controller quickly evaluates the immediate reward and long-term value of each optional control action according to the current state, such as different amplitudes or different distribution schemes of adjusting the bias voltage, and selects the optimal action to execute the bias voltage adjustment strategy; the control instructions output by the intelligent optimization module include the adjustment suggestions for the bias voltage values in the central region and the edge region, as well as the decision signal on whether to trigger the gradient field compensation. When the reinforcement learning controller converges after sufficient training or online learning, its strategy will significantly reduce the difference in nucleation density in each region, thus maximizing the reward function. The introduction of the intelligent optimization module enables the intelligent bias voltage regulation system to autonomously adapt to complex and changeable growth conditions and avoid relying on human experience for adjustment.

[0032] In this embodiment, it should be specifically noted that the prediction module is equipped with a dual-channel LSTM prediction model for processing and analyzing the plasma state vector obtained each time it is updated; the prediction module is used to go through three main steps: spectral channel feature extraction, temperature channel feature extraction, and feature fusion in sequence, and output the nucleation probability prediction values for each monitoring region. For example, when the substrate is divided into two major regions, the central region and the edge region, the prediction module can output the "nucleation probability in the central region" and the "nucleation probability in the edge region". The design details of the prediction module are as described in part of Embodiment 1: preferably, an LSTM neural network is used to utilize the time series history to improve the prediction reliability; when it is found that the predicted nucleation probability in a certain region is continuously low, it indicates that there may be a problem of insufficient nucleation in this region in the future and attention needs to be paid.

[0033] In this embodiment, it should be specifically noted that the gradient field compensation module mainly compensates for the bias voltage for the special conditions in the edge region; the gradient field compensation module is equipped with an independent bias voltage application unit, such as a ring electrode or a controllable bias voltage source, which is specifically used to apply an additional bias voltage signal to the edge region of the substrate; once the intelligent optimization module issues a trigger compensation instruction (usually based on detecting that the edge plasma parameters drop below the threshold or the edge nucleation probability is too low), the gradient field compensation module outputs a bias voltage waveform to the edge bias voltage source according to the predetermined asymmetric waveform generation rule.

[0034] In this embodiment, it should be specifically noted that the feedback and regulation module includes the comparison and adjustment units required for the closed-loop control circuit, which sends the bias voltage output strategy formulated by the intelligent optimization module to the actual bias voltage power supply / electrode to apply corresponding voltages to the central and edge regions in the growth reactor. At the same time, it continuously monitors the feedback from the data acquisition module and feeds back the new state to the intelligent optimization module when the next cycle arrives, thus completing the closed-loop. The feedback and regulation module is also responsible for some safety and stability strategies. For example, when abnormal peaks in the bias voltage or plasma parameters are detected, the output of the controller is temporarily locked or adjusted to avoid system instability.

[0035] As Figure 3 shown, a flowchart of the intelligent bias voltage regulation system for diamond single crystal heteroepitaxial growth is provided. The main data streams include the characteristic spectral data and temperature data collected from the data acquisition module, which are simultaneously transmitted to the prediction module and the intelligent optimization module. After the prediction module processes the data using the dual-channel LSTM model, it transmits the nucleation probability prediction result to the intelligent optimization module. The intelligent optimization module calculates the reward function based on the prediction and real-time data, generates the bias voltage regulation strategy, and the strategy signal is respectively transmitted to the gradient field compensation module and the feedback and regulation module. Finally, the compensation module and the feedback and regulation module jointly adjust the actually applied bias voltage and feed back the new state data to the data acquisition module. Through the collaborative action of each module, the intelligent bias voltage regulation system provided by the present invention can achieve adaptive and high-precision control of the diamond epitaxial growth process.

[0036] Example 3 The intelligent bias voltage regulation system for diamond single crystal heteroepitaxial growth provided by the present invention is applied to a set of 4-inch hetero-substrate single crystal diamond CVD growth equipment. The implementation methods of each module and their working conditions in the actual growth process are as follows: A circular substrate with a size of 4 inches (with an iridium thin film deposited on a silicon substrate as an epitaxial growth substrate) is used. Inside the reaction chamber, the substrate is placed above the grounded electrode, and the reaction atmosphere is a typical diamond growth gas (such as a mixture of hydrogen and methane). Plasma is generated by microwave plasma CVD. Above the growth surface of the substrate, an optical fiber probe is arranged and connected to an optical emission spectrometer to monitor the characteristic spectra in the plasma. In this embodiment, a spectral line closely related to hydrocarbon radicals or other relevant active particles in the plasma is selected as the monitoring index, and this spectral line is located near a wavelength of 405 nm. Through calibration, the change in the light intensity of this spectral line can reflect the change trend of the plasma electron density and the carbon material supply state near the substrate surface. At the same time, a high-temperature infrared sensor is installed on the side wall of the reactor, aiming at the substrate surface, to measure the thermal radiation intensity of the substrate. The signal detected by the infrared sensor can be converted by an algorithm to obtain an approximate temperature value of the substrate surface. The above two sensors collect data once every 5 seconds respectively and transmit the data to the central control computer. The central control computer is pre-installed with the software of the intelligent bias voltage regulation system for diamond single crystal heteroepitaxial growth provided by the present invention, which is used to execute the prediction algorithm and the reinforcement learning control algorithm.

[0037] Before the growth starts, the system is first initialized: the reaction chamber is evacuated and the reaction gas is introduced, the plasma is ignited and made to operate stably; then an initial bias voltage is applied to the substrate for plasma cleaning and pretreatment. In this embodiment, the initial bias voltage is set to a constant -150 V DC bias voltage in the central region of the substrate, and no additional signal is superimposed in the edge region. At this time, the data acquisition module starts to record the initial spectral intensity and temperature information, which is used as the reference starting point for the reinforcement learning algorithm.

[0038] After the formal growth stage starts, the intelligent bias voltage regulation system enters the closed-loop control operation. In each control cycle, the data acquisition module sends the most recently monitored 405 nm spectral intensity value and the substrate temperature value to the prediction module. The prediction module calls the dual-channel LSTM model to perform update calculations on these two time series. In actual implementation, the LSTM model will maintain the data of the most recent several time points as the input state (in this embodiment, N = 5 is set, that is, the sensing data within the past 25 seconds is used to predict the current nucleation probability). Through the aforementioned dual-channel architecture, the LSTM model outputs the estimated nucleation probability values of the central region and the edge region of the substrate at the current moment. Suppose in a certain cycle, the prediction result shows that the nucleation probability in the edge region is significantly lower than that in the central region, which may be due to the decrease in the edge temperature or the reduction in the plasma intensity, then the intelligent optimization module will pay more attention to this.

[0039] The reinforcement learning controller within the intelligent optimization module then takes the state vector composed of the current sensing data and prediction results as input, and evaluates the reward values of different bias voltage regulation actions. In this embodiment, the control actions are set to fine-tune the central bias voltage and the edge bias voltage, and their values can vary continuously within a certain range. To simplify the problem, the reinforcement learning controller can define the action as two real numbers and , representing the increments applied to the central and edge bias voltages respectively based on the current bias voltage. Since we hope to keep the nucleation densities at the center and the edge balanced, the controller will refer to the reward function to evaluate each alternative and combination. If an action is expected to increase the nucleation probability in the edge region and will not significantly reduce the nucleation probability in the central region, its reward value will be higher; conversely, if an action exacerbates the non-uniformity between the two regions, the reward value will be lower or even negative. The reinforcement learning controller selects the action with the highest expected cumulative reward from these candidate actions through an algorithm. For example, in the case where the nucleation probability in the edge is low as described above, the controller may choose to increase the edge bias voltage ( , that is, further increase the absolute value of the negative bias voltage) while slightly reducing the central bias voltage ( , reducing the absolute value of the central negative bias voltage), so as to tilt the plasma resources towards the edge. It should be noted that this decision is not based on a simple comparison of current values, but comprehensively considers the impact on the next few steps - for example, excessive increase in the edge bias voltage may lead to too fast growth at the edge in the subsequent steps, so the controller will choose a compromise optimal strategy.

[0040] When the intelligent optimization module determines the optimized bias voltage strategy, the system will judge according to the actual situation whether it is necessary to trigger the gradient field compensation module. In most cases, if the state of the edge region is only slightly lower than that of the center, the decision of the reinforcement learning controller (the small-scale and as described above) can gradually correct the difference without additional compensation. However, when it is detected that the electron density in the edge region is significantly lower than the threshold (for example, the spectral intensity drops by more than a certain predetermined ratio, indicating a serious shortage of edge plasma), in addition to selecting and , the controller will issue a compensation trigger signal. After receiving this signal, the gradient field compensation module is activated to output an additional bias voltage waveform to the edge region. In this embodiment, the compensation module applies a high-frequency pulsed bias voltage with a frequency of 50 kHz to the annular electrode in the edge region, and its peak amplitude is calculated according to the previous formula. For example, when the 405 nm light intensity at the edge drops suddenly at a certain moment, and the corresponding is -20 (normalized unit), the compensation coefficient per unit is selected, and assuming the position compensation function Taking a constant value of 1 for the entire edge, the amplitude of the applied pulsed bias voltage . This pulsed bias voltage is superimposed on the original -150V reference, causing the edge electrode to reach an instantaneous bias voltage of -250V at the negative peak, thereby significantly enhancing the electric field strength and plasma density at the edge. After applying compensation for several cycles, the spectral intensity in the edge region begins to recover. Once the monitored value returns above the threshold, the gradient field compensation module will gradually reduce the pulse amplitude until the output stops. The entire compensation process is supervised by the feedback and regulation module to avoid overshoot or oscillation.

[0041] The above decision-making and execution processes continue throughout the growth cycle, forming a closed-loop control. Through continuous "sensing - predicting - decision-making - applying - feedback", it can adapt to slow changes and even sudden fluctuations in growth conditions. For example, as deposition progresses, the substrate temperature may gradually increase, and the spectral intensity baseline may change. The reinforcement learning controller will dynamically adjust the ratio of the center and edge bias voltages to maintain balance. If there are external disturbances, such as a slight fluctuation in microwave power causing a change in the overall plasma, since the controller focuses on relative uniformity, its output will correspondingly adjust the bias voltages in the two regions to maintain a stable difference level. In this embodiment, through the action of the intelligent bias voltage regulation system, the nucleation density on the entire 4-inch substrate surface remains highly consistent. After growing for a period of time and diagnosing the substrate, it is found that the number of nuclei per unit area in the center region and the edge region is almost the same, and the difference is statistically less than 3%. In contrast, if the intelligent regulation function of this system is turned off, for example, only using a constant bias voltage for a comparative experiment, the nucleation density in the edge region is on average about 15% lower than that in the center region, fully demonstrating the effectiveness of the present invention in improving the epitaxial growth uniformity of large substrates.

[0042] As Figure 6 shown, the experimental comparison data are presented through a histogram. The blue histogram represents the nucleation density distribution in the center region and the edge region under traditional bias voltage control, showing a difference of approximately ±15% between the two. The red histogram represents the nucleation density distribution after adopting the intelligent bias voltage regulation method of the present invention, showing that the difference has dropped to approximately ±3%. This figure provides a comparison of experimental data and intuitively demonstrates the significant effect of the present invention in improving the nucleation uniformity of the substrate.

[0043] In the embodiments of the present invention, the bias voltage regulation model uses a reinforcement learning algorithm. The training process can be performed offline through a simulation environment before actual growth, or online learning can be carried out at the initial stage of growth with a safe small amplitude exploration to obtain a better initial strategy. In actual operation, considering safety and convergence speed, a supervised learning model can also be used to provide the initial strategy, and then fine-tuned by reinforcement learning. The dual-channel LSTM prediction model can be trained through historical experimental data, and its structure (including the number of hidden layer units, etc.) and hyperparameters can be adjusted by those skilled in the art according to actual needs. In addition, the present invention does not limit which specific reinforcement learning algorithm or neural network structure to adopt. Other types of neural networks, fuzzy control, or expert systems can also be introduced as prediction or decision-making modules, as long as they can improve the adaptive ability of bias voltage regulation to complex environments. The hardware for applying the bias voltage can be a single electrode with a waveform change to achieve equivalent area control, or multiple independent electrodes can be used to apply different bias voltages respectively; these are all equivalent deformations of the present invention. The present invention realizes the intelligent regulation of the bias voltage during the heteroepitaxial growth process of single crystal diamond by innovatively combining advanced sensing technology, dual-channel LSTM prediction algorithm, and reinforcement learning optimization control. On the premise of ensuring growth stability, it greatly improves the nucleation and growth uniformity of large-size substrates, providing important technical support for the industrial preparation of diamond materials.

[0044] Finally: The above are only the preferred embodiments of the present invention and are not used to limit the present invention. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

[0045] The above is only the specific implementation manner of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily think of changes or replacements within the technical scope disclosed in the present application, and all should be covered by the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A method for intelligent bias control of diamond single crystal heteroepitaxial growth, characterized in that: The following steps are involved: Step S1: collecting characteristic spectrum data of plasma through a plasma emission spectrometer, collecting thermal radiation data of the substrate surface through a thermal radiation sensor, and obtaining characteristic information of the substrate state; Step S2: constructing a bias voltage control model based on reinforcement learning, obtaining a reward function using characteristic information of the substrate state, and dynamically optimizing the bias voltage output of each region of the substrate during the epitaxial growth process according to the reward function; Step S3: using a dual-channel LSTM network to fuse the characteristic spectrum data and the substrate surface thermal radiation data, and predicting the nucleation probability of each local area of ​​the substrate in real time; Step S4: when it is detected that the electron density in the edge region of the substrate is lower than a preset threshold, an asymmetric bias waveform is automatically generated, and a compensation adjustment is applied to the edge region; Step S5: Based on the real-time feedback information during the epitaxial growth process, the bias output is adjusted in a closed loop.

2. The method for intelligent bias control of diamond single crystal heteroepitaxial growth according to claim 1, characterized in that: The reward function is defined as the total reward accumulated with a discount factor at each time step t, and the formula is expressed as: ; in, Expressed as a reward function, Represents the immediate reward corresponding to the deviation between the central area nucleation density and the preset target value at time step t; Represents the immediate reward corresponding to the deviation between the edge region nucleation density and the preset target value at time step t; and are the weight coefficients of the central area and the edge area respectively, Represents the discount factor, and its value range satisfies ; is the total number of time steps.

3. The method for intelligent bias control of diamond single crystal heteroepitaxial growth according to claim 2, characterized in that: The dual-channel LSTM network prediction model in step S3 is a dual-input channel structure, the first channel inputs the plasma spectral intensity sequence, and the second channel inputs the substrate temperature sequence; the implicit states of the two channels are fused in the network to output the nucleation probability estimation value of each spatial position at the corresponding time; The prediction steps of the dual-channel LSTM network prediction model are: The first channel receives characteristic spectrum data of the plasma and extracts the spectrum features to predict the initial value of the nucleation probability in each local area; The second channel receives the thermal radiation data of the substrate surface and extracts the temperature characteristics, combines them with the spectral characteristics to optimize the prediction accuracy, and generates a nucleation probability prediction value for each local area.

4. The method for intelligent bias control of diamond single crystal heteroepitaxial growth according to claim 3, characterized in that: The expression of the dual-channel LSTM network prediction model is: ; in, Represents the predicted substrate position At time step The probability of nucleation when Represents the LSTM network output function, which is used to map the input membership sequence to the current prediction output; represents the number of historical time steps; For the historical time step The characteristic spectrum data weight coefficient; For the historical time step Thermal radiation data weight coefficient; Indicates at location At, the time step is Characteristic spectral data collected at Indicates at location At, the time step is The thermal radiation data of the substrate surface collected at the time; Represents the number of historical time steps considered for prediction.

5. The method for intelligent bias control of diamond single crystal heteroepitaxial growth according to claim 4, characterized in that: The asymmetric bias waveform in step S4 can be expressed by the formula: ; in, For the location At, the time step is The asymmetric bias waveform is shown when ; Indicates that at the time step The bias value applied to the central area of ​​the substrate when Represents the compensation coefficient, the value range is ; Represents the time step The change in electron density in the edge region detected when is a position compensation function, which is used to dynamically adjust the compensation amplitude according to the specific position of the edge area.

6. A diamond single crystal heteroepitaxial growth intelligent bias control system, used to implement any of the methods described in claims 1-5, characterized in that: It includes data acquisition module, prediction module, intelligent optimization module, gradient field compensation module and feedback and control module; The data acquisition module is used to collect characteristic spectrum data of plasma and thermal radiation data of substrate surface in real time through acquisition equipment to obtain characteristic information of substrate state; The prediction module is used to receive the characteristic information output by the data acquisition module, use a dual-channel LSTM network to process the characteristic information in real time, and predict the nucleation probability of each local area of ​​the substrate; The intelligent optimization module is used to receive the characteristic information output by the data acquisition module, obtain the reward function of nucleation uniformity, and generate a dynamically optimized bias control strategy; The gradient field compensation module is used to automatically generate an asymmetric bias waveform according to the real-time monitored change in the electron density of the edge area, and to apply bias compensation adjustment to the edge area of ​​the substrate; The feedback and regulation module is used to perform closed-loop regulation on the bias output based on real-time monitoring data.

7. The intelligent bias control system for heteroepitaxial growth of diamond single crystal according to claim 6, characterized in that: The acquisition equipment includes a plasma emission spectrometer and a thermal radiation sensor; the plasma emission spectrometer is used to monitor the characteristic spectrum intensity of the plasma in the growth reaction chamber in real time; the thermal radiation sensor is used to measure the temperature and radiation intensity of the substrate surface in real time.

8. The intelligent bias control system for heteroepitaxial growth of diamond single crystal according to claim 7, characterized in that: The gradient field compensation module is provided with an independent bias applying unit for applying an additional bias signal to the edge region of the substrate; the gradient field compensation module outputs a bias waveform to the edge bias source according to a predetermined asymmetric waveform generation rule.

9. The intelligent bias control system for heteroepitaxial growth of diamond single crystal according to claim 8, characterized in that: The intelligent optimization module is pre-set with a reward function and a reinforcement learning algorithm strategy for measuring nucleation uniformity. The control instructions output by the intelligent optimization module include adjustment suggestions for the bias values ​​of the central area and the edge area, and a decision signal on whether gradient field compensation needs to be triggered.

Citation Information

Patent Citations

  • Method for improving heteroepitaxy large-size nucleation uniformity of diamond based on composite structure sample table

    CN112609240A

  • Diamond growth regulation and control device of bias voltage coupling microwave plasma

    CN117551979A

  • Fixed-abrasive polishing pad using vertically aligned carbon nanotube and method of manufacturing the same

    KR1020260026621A

  • Distributed disturbance sensing device and the related demodulation method based on polarization sensitive optical frequency domain reflectometry

    US20140176937A1

  • Method and Process of Implementing Machine Learning in Complex Multivariate Wafer Processing Equipment

    US20180082826A1

Cited By

  • Dynamic detection method and system for crystal growth

    CN120635093A

  • A method and system for dynamic detection of crystal growth

    CN120635093B

  • Sub-nano patterned substrate assisted MPCVD diamond heteroepitaxy system and sub-nano patterned substrate assisted MPCVD diamond heteroepitaxy method

    CN120866937A