Predictive Modeling for Monitoring Chamber Conditions
Patent Information
- Application Number
- JP2024540904
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2022-01-07
- Filing Date
- 2023-01-06
- Publication Date
- 2025-01-24
- Estimated Expiration
- 2043-01-06
Smart Images

Figure 2025502068000001_ABST
Abstract
Description
[Technical field]
[0001] FIELD OF THE DISCLOSURE Embodiments herein relate generally to predictive modeling for monitoring of chamber conditions. More particularly, embodiments herein relate to multiple-input multiple-output (MIMO) modeling for prediction and monitoring of chamber conditions. [Background technology]
[0002] Many industries utilize sophisticated manufacturing equipment that includes multiple sensors and controls, each of which may be carefully monitored during processing to ensure product quality. One method of monitoring multiple sensors and controls is statistical process monitoring (means of performing statistical analysis on sensor measurements and process control values (process variables)) that allows for automatic detection and / or diagnosis of "faults." A "fault" may include a malfunction or misalignment of manufacturing equipment (e.g., deviation of a machine's operating parameters from an intended value) or an indication of the need for preventive maintenance to prevent an impending malfunction or misalignment. A fault may cause a defect in the device being manufactured. Thus, one goal of statistical process monitoring is to detect and / or diagnose a fault before it causes such a defect.
[0003] During process monitoring, a fault is detected when one or more of the statistics of the recent process data deviate from the statistical model by an amount large enough that the model metric exceeds the respective confidence threshold. The model metric is a scalar number whose value represents the magnitude of deviation between the statistical characteristics of the process data collected during actual process monitoring and the statistical characteristics predicted by the model. Each model metric is a unique mathematical method of estimating this deviation. Each model metric has a respective confidence threshold, also called a confidence limit or control limit, whose value represents the upper or lower acceptable limit for the model metric. If the model metric exceeds the respective confidence threshold during process monitoring, it can be inferred that the process data has abnormal statistics due to a fault.
[0004] A hindrance to accurate defect detection is that manufacturing processes typically flow over time, even when there are no problems. For example, operating conditions in a semiconductor process chamber typically flow between successive cleanings of the chamber and successive replacements of consumable chamber parts. Traditional statistical process monitoring methods for defect detection have shortcomings in distinguishing normal flow from faults. In particular, some defect detection methods utilize statistical models that assume that process conditions remain constant over the life of the tool. Such models do not distinguish between expected changes over time and unexpected deviations caused by faults. To prevent process flow from causing a large number of false alarms, control limits must be set that are wide enough to accommodate the flow. As a result, the models may not be able to detect subtle faults. Summary of the Invention
[0005] Methods, systems, and computer readable media (CRM) for chamber condition prediction and monitoring are provided. In some embodiments, the method performed by the processing device can include receiving training including first sensor data indicative of a first state of an environment of a first processing chamber processing a first substrate. The training data can further include first process tool data indicative of a time-dependent state of a first processing tool processing the first substrate. The training data can further include first process result data corresponding to the first substrate. The processing device can further train the first model with input data including the first sensor data and the first process tool data, and a target output including the process result data. The trained first model can receive new input having second sensor data indicative of a second state of an environment of a second processing tool processing a second substrate, and second process tool data indicative of a second time-dependent state of a second processing tool processing the second substrate, and produce a second output based on the new input. The second output indicative of the second process result data can correspond to the second substrate.
[0006] In some embodiments, the method can include receiving sensor data indicative of a condition of an environment of a processing chamber in which a processing device processes a first substrate according to a substrate treatment process. The processing device can receive process tool data indicative of a relative operational lifetime of the processing tool processing the first substrate compared to other process tools in a group of process tools. The method can include processing the sensor data and the process tool data using one or more machine learning models (MLMs) to determine a prediction of a process result measurement of the first substrate. The processing can further prepare the prediction for presentation in a graphical user interface (GUI). The processing device can further alter operation of at least one of the process chambers of the processing tool based on the prediction.
[0007] In some embodiments, a method includes training a machine learning model (MLM). Training the MLM can include receiving training data including first sensor data indicative of a first condition of an environment of a first process chamber processing a first substrate. The training data further includes metrology data including a process result measurement and position data indicative of a first position across a surface of the substrate corresponding to the process result measurement. Training the MLM can further include encoding the training data to generate encoded training data. Training the MLM can further include performing a regression using the encoded training data. The method can further include receiving second sensor data indicative of a second condition of an environment of a second process chamber processing a second substrate. The method can further include encoding the sensor data to generate encoded sensor data. The method can further include using the encoded sensor data as an input to the trained MLM and receiving one or more outputs from the trained MLM. The one or more outputs can include encoded prediction data. The method may further include decoding the encoded prediction data to generate prediction data including a value indicative of a process result of the second substrate at a second position across a surface of the second substrate, the second position corresponding to the first position of the first substrate.
[0008] Aspects and embodiments of the present disclosure will become more fully understood from the following detailed description and accompanying drawings, which are intended to illustrate aspects and embodiments by way of example and not by way of limitation. [Brief description of the drawings]
[0009] [Figure 1] FIG. 1 is a block diagram illustrating an example system architecture in which embodiments of the present disclosure can function. [Diagram 2] 1 is a block diagram illustrating a process outcome prediction system in which embodiments of the present disclosure can function. [Figure 3A]1 is a graph illustrating process result data according to some embodiments of the present disclosure. [Figure 3B] 11 is a graph illustrating process result data after data pre-processing logic according to some embodiments of the present disclosure. [Figure 4] 1 is a block diagram illustrating a process outcome prediction system in which embodiments of the present disclosure can function. [Figure 5A] FIG. 1 illustrates an example dataset generator for creating a dataset for a machine learning model (e.g., one of the MLMs described herein) using substrate processing data, in accordance with certain embodiments. [Figure 5B] FIG. 1 is a block diagram illustrating a system for training a machine learning model and generating an output, in accordance with certain embodiments. [Figure 6] FIG. 1 is a block diagram of a process outcome prediction system using layered modeling according to an aspect of the present disclosure. [Figure 7] FIG. 1 illustrates a model training workflow and a model application workflow for substrate process outcome prediction, according to an aspect of the present disclosure. [Figure 8] 1 is a flow diagram of an example method for predicting process results of a substrate process, according to some embodiments of the present disclosure. [Figure 9] 1 is a flow diagram of an example method for monitoring and predicting process results according to some embodiments of the present disclosure. [Figure 10] FIG. 1 is a block diagram of an example computing device that operates in accordance with one or more aspects of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] Substrate processing can include a series of processes that fabricate electrical circuits on substrates, semiconductors, silicon wafers, etc., according to a circuit design. These processes can be performed in a series of chambers. Successful operation of modern semiconductor manufacturing facilities can be aimed at facilitating the movement of a steady flow of substrates (e.g., wafers) from one chamber to another in the course of forming electrical circuits in the substrates. In processes that perform many substrate procedures, the processing chamber and processing conditions can be adjusted (e.g., depreciated) over time, resulting in processed substrates that fail to meet the desired conditions or process results (e.g., critical dimensions, process uniformity, thickness dimensions, etc.). The drift of film properties is a cause for concern as it affects device performance and yield. Metrology (e.g., metrology of wafers) can incur additional costs of using metrology tools, measurement time, and additional risk that additional defects may be added to the substrates. Corrective actions may be taken as a result of metrology, but delays occur when waiting for metrology results, and it can be expensive to perform metrology on a large number of substrates (e.g., all wafers).
[0011] Critical dimension (CD) measurement is an important step for substrate processing such as etching. However, for various reasons such as throughput requirements, the measurement sampling rate is very slow among conventional systems. Therefore, in high volume manufacturing, it is very difficult to use CD measurements to monitor whether the substrate process is in good condition. To address this issue, many types of predictive models have been developed, as discussed herein. The predictive models can generate predicted CD values for every substrate, which can be utilized to detect abnormal CD changes before the measurements are completed by conventional metrology systems. The disclosed predictive models can be further integrated with tool-to-tool matching (TTTM) processes, which can detect abnormal conditions with higher efficiency and take corrective actions faster (e.g., improve "green-to-green" time).
[0012] Traditional predictive modeling algorithms do not consider physical meaning or process knowledge when building models. Traditional models often only consider correlation patterns between inputs and outputs statistically, where it can be difficult to extract the relevant relationships without knowing how the process was performed, especially in semiconductor processes. For example, traditional predictive models often do not compensate for spatial correlation across the substrate, and predictive models based on traditional regression techniques do not meet threshold accuracy standards.
[0013] Aspects and embodiments of the present disclosure address these and other shortcomings of existing techniques by providing methods and systems in various embodiments capable of predicting substrate quality (e.g., process results) based on process parameters (e.g., chamber conditions, process tool conditions, etc.). A new ensemble modeling approach is proposed (e.g., to address the limitations discussed above). First, the output values in the model training data are preprocessed to remove time-dependent variations. Such behavior is due to changes due to different chamber conditions, which are due to differences in chamber life within manufacturing equipment. Second, boosting techniques are applied to improve prediction performance. Since CD profiles from different chambers are often nonlinear, boosting can extract useful relationship information. Third, a spatial function is developed and integrated with a regression model to train the model to exploit process patterns across multiple locations of the processed substrate.
[0014] In an exemplary embodiment, a method, system, and computer readable medium (CRM) for chamber condition prediction and monitoring are provided. In some embodiments, the method performed by the processing device can include receiving training including first sensor data indicative of a first state of an environment of a first processing chamber processing a first substrate. The training data can further include first process tool data indicative of a time-dependent state of a first processing tool processing the first substrate. The training data can further include first process result data corresponding to the first substrate. The processing device can further train the first model with input data including the first sensor data and the first process tool data, and a target output including the process result data. The trained first model can receive new input having second sensor data indicative of a second state of an environment of a second processing tool processing a second substrate, and second process tool data indicative of a second time-dependent state of a second processing tool processing the second substrate, and produce a second output based on the new input. The second output indicative of the second process result data can correspond to the second substrate.
[0015] In an exemplary embodiment, the method can include receiving sensor data indicative of a condition of an environment of a processing chamber in which a processing device processes a first substrate according to a substrate treatment process. The processing device can receive process tool data indicative of a relative operational life of the processing tool processing the first substrate compared to other process tools in a group of process tools. The method includes processing the sensor data and the process tool data using one or more machine learning models (MLMs) to determine a prediction of a process result measurement of the first substrate. The processing can further prepare the prediction for presentation in a graphical user interface (GUI). The processing device can further alter operation of at least one of the process chambers of the processing tool based on the prediction.
[0016] In an exemplary embodiment, a method includes training a machine learning model (MLM). Training the MLM can include receiving training data including first sensor data indicative of a first condition of an environment of a first process chamber processing a first substrate. The training data further includes metrology data including a process result measurement and position data indicative of a first position across a surface of the substrate corresponding to the process result measurement. Training the MLM can further include encoding the training data to generate encoded training data. Training the MLM can further include performing a regression using the encoded training data. The method can further include receiving second sensor data indicative of a second condition of an environment of a second process chamber processing a second substrate. The method can further include encoding the sensor data to generate encoded sensor data. The method can further include using the encoded sensor data as an input to the trained MLM and receiving one or more outputs from the trained MLM. The one or more outputs can include encoded prediction data. The method may further include decoding the encoded prediction data to generate prediction data including a value indicative of a process result of the second substrate at a second position across a surface of the second substrate, the second position corresponding to the first position of the first substrate.
[0017] FIG. 1 is a block diagram illustrating an example system architecture 100 in which embodiments of the present disclosure can function. As shown in FIG. 1, the system architecture 100 includes a manufacturing system 102, a metrology system 110, a client device 150, a data store 140, a server 120, and a machine learning system 170. The machine learning system 170 may be part of the server 120. In some embodiments, one or more components of the machine learning system 170 may be fully or partially integrated into the client device 150. The manufacturing system 102, the metrology system 110, the client device 150, the data store 140, the server 120, and the machine learning system 170 may each be hosted by one or more computing devices, including a server computer, a desktop computer, a laptop computer, a tablet computer, a notebook computer, a personal digital assistant (PDA), a mobile communication device, a mobile phone, a handheld computer, a cloud server, a cloud-based system (e.g., a cloud service device, a cloud network device, or a similar computing device).
[0018] The manufacturing system 102, the metrology system 110, the client device 150, the data store 140, the server 120, and the machine learning system 170 can be coupled to each other (e.g., to perform the techniques described herein) via a network 160. In some embodiments, the network 160 is a private network, providing each element of the system architecture 100 with access to each other and to other privately available computing devices. The network 160 can include one or more wide area networks (WANs), local area networks (LANs), wired networks (e.g., Ethernet networks), wireless networks (e.g., 802.11 networks or Wi-Fi networks), cellular networks (e.g., Long Term Evolution (LTE) networks), routers, hubs, switches, server computers, and / or any combination thereof. In some embodiments, the network 160 is a cloud-based network capable of performing cloud-based functions (e.g., providing cloud service functions to one or more devices in the system). Alternatively or additionally, any of the elements of the system architecture 100 can be integrated together or otherwise coupled without the use of the network 160.
[0019] The client device 150 can be or include any personal computer (PC), laptop, mobile phone, tablet computer, netbook computer, networked television ("Smart TV"), networked media player (e.g., Blue-ray player), set-top box, over-the-top (OOT) streaming device, operator box, etc. The client device may be capable of performing cloud-based operations (e.g., in conjunction with the server 120, data store 140, manufacturing system 102, machine learning system 170, metrology system 110, etc.). The client device 150 can include a browser 152, an application 154, and / or other tools described and executed by other systems of the system architecture 100. In some embodiments, client device 150 may be capable of accessing manufacturing system 102, metrology system 110, data store 140, server 120, and / or machine learning system 170 at various processing stages of system architecture 100, as described herein, and communicating (e.g., transmitting and / or receiving) sensor data, processed data, data classification (e.g., process result prediction), process result data (e.g., critical dimension data, thickness data), and / or instructions for input and output of various process tools (e.g., metrology tool 114, data preparation tool 116, critical dimension prediction tool 124, thickness prediction tool 126, critical dimension component 194, and / or thickness component 196).
[0020] As shown in FIG. 1, the manufacturing system 102 includes process tools 104, process steps 106, and a process controller 108. The process controller 108 can coordinate the operation of the process tools 104 to be performed in one or more process steps 106. For example, the various process tools can include specialized chambers such as etch chambers, deposition chambers (including chambers for atomic layer deposition, chemical vapor deposition, sputtering chambers, physical vapor deposition, or plasma-enhanced versions thereof), anneal chambers, implantation chambers, plating chambers, treatment chambers, etc. In another example, a machine can incorporate a sample transport system (e.g., a selective compliance assembly robotic arm (SCARA) robot, transfer chambers, front opening pods (FOUPs), lateral storage pods (SSPs), etc.) to transport samples between machines and process steps.
[0021] The process steps 106, which may also be referred to as process recipes or process steps, may include various specifications for performing operations with the process tool 104. For example, the process steps 106 may include process specifications such as duration of start-up of the process operation, process tools used for the operation, machine (e.g., chamber) temperatures, flow rates, pressures, etc., deposition sequence, etc. In another example, the process steps may include transport instructions for transporting a sample to further process steps or for measurement by the metrology system 110.
[0022] The process controller 108 may include devices designed to manage and coordinate the operation of the process tool 104. In some embodiments, the process controller 108 is associated with a process recipe, or a set of process steps 106 instructions, which when applied in a designed manner, result in a desired process result of the substrate process. For example, a process recipe may be associated with processing a substrate to produce a target process result (e.g., critical dimension, thickness, uniformity criteria, etc.).
[0023] As shown in FIG. 1, the metrology system 110 includes a metrology tool 114 and a data preparation tool 116. The metrology tool 114 can include various sensors to measure process results (e.g., critical dimensions, thickness, uniformity, etc.) in the manufacturing system 102. For example, critical dimensions can be measured using wafers processed in one or more processing chambers. The metrology tool 114 can also include devices to measure process results of substrates processed using the manufacturing system. For example, process results such as critical dimensions, thickness measurements (e.g., film layers from etching, deposition, etc.) can be evaluated for substrates processed according to a process recipe and / or operations performed by the process controller 108. The measurements can also be used to measure chamber conditions throughout the substrate processing procedure.
[0024] The data preparation tool 116 may include process techniques for feature extraction and / or generation of synthetic / processed data associated with data measured by the metrology tool 114. In some embodiments, the data preparation tool 116 may identify correlations, patterns, and / or anomalies in metrology or process performance data. For example, the data preparation tool 116 may perform feature extraction where the data preparation tool 116 uses a combination of measurement data to determine whether a criterion is satisfied. For example, the data preparation tool 116 may analyze multiple data points of an associated parameter (e.g., thickness, critical dimension, defects, plasma conditions, etc.) to determine whether rapid changes occurred during a substrate process procedure across multiple processing chambers. In some embodiments, the data preparation tool 116 performs normalization across different sensor data associated with different process chamber conditions. Normalization may include processing the incoming sensor data to look similar across different chambers and sensors used to acquire the data.
[0025] In some embodiments, the data preparation tool 116 can perform one or more of a process control analysis, a univariate limit violation analysis, or a multivariate limit violation analysis on the metrology data (e.g., obtained by the metrology tool 114). For example, the data preparation tool 116 can perform statistical process control (SPC) by utilizing statistical information-based techniques to monitor and control the process controller 108. For example, SPC can increase the efficiency and accuracy of a substrate processing procedure (e.g., by identifying data points that are within and / or outside of control limits).
[0026] In some embodiments, the processing chamber may be measured throughout the substrate processing procedure. In some embodiments, the amount of sensor data acquired during a given substrate processing procedure is increased. For example, additional sensors may be activated and / or currently activated sensors may acquire additional data during or immediately after processing of a wafer. In some embodiments, the process controller 108 may trigger measurements by the metrology tool 114 based on operations performed by the process tool 104. For example, the process controller 108 may trigger the activation of one or more process results (e.g., process results of the metrology tool 114) in response to a transition period between a first substrate processing procedure and a second substrate processing procedure, during which the processing chamber is waiting for an incoming wafer to be processed.
[0027] In some embodiments, the extracted features, generated synthetic / processed data, and statistical analysis can be used in connection with the machine learning system 170 (e.g., to train, validate, and / or test the machine learning model 190). Additionally and / or alternatively, the data preparation tool 116 can output data to the server 120 to be used by either the critical dimension prediction tool 124 and / or the thickness prediction tool 126.
[0028] The data store 140 can be a memory (e.g., random access memory), a drive (e.g., hard drive, flash drive), a database system, a cloud-based system, or another type of component or device capable of storing data. The data store 140 can store one or more pieces of historical data 142 including historical sensor data 144, historical process tool data 146, and / or historical process result data 148 of previous chamber conditions, process results, and process results of substrates processed at associated chamber conditions. In some embodiments, the historical data 142 can be used to train, validate, and / or test a machine learning model 190 of the machine learning system 170 (see, e.g., FIGS. 5A-5B for techniques).
[0029] The server 120 may include one or more computing devices, such as a rack mount server, a router computer, a server computer, a personal computer, a mainframe computer, a laptop computer, a tablet computer, a desktop computer, etc. The server 120 may include a critical dimension prediction tool 124 and a thickness prediction tool 126. The server 120 may include a cloud server or a server capable of performing one or more cloud-based functions. For example, one or more of the operations of the critical dimension prediction tool 124 and the thickness prediction tool 126 may be provided to a remote device (e.g., the client device 120) using a cloud environment.
[0030] The critical dimension prediction tool 124 receives chamber process data from the manufacturing system 102 and determines process result predictions, such as critical dimension predictions, for a substrate processed in an environment associated with the chamber sensor data. In some embodiments, the critical dimension prediction tool 124 receives raw sensor data from a chamber monitor system of the manufacturing system 102, and in other embodiments, the raw sensor data is combined with processed synthetic data from the data preparation tool 116. The critical dimension prediction tool 124 can process the sensor data to determine a critical dimension for a substrate processed in association with the processed sensor data. For example, the critical dimension can include a difference between a desired process result parameter and an actual process result parameter (e.g., etch bias). In some embodiments, the critical dimension prediction tool 124 includes a machine learning model that uses the sensor data (e.g., from the metrology tool 114), the synthetic and / or processed data (e.g., from the data preparation tool 116), and generic process parameter values (corresponding to the process step 106) to determine a critical dimension for a substrate processed in an environment associated with the metrology data. In some embodiments, the critical dimension prediction tool receives process tool data (e.g., from the metrology system 110). The machine learning model may further use the process tool data to predict process result data for substrates processed by a process tool corresponding to the process tool data. The process tool data may be indicative of a relative lifetime of a process tool. For example, the process tool data may be indicative of a number of substrates previously processed by a process tool compared to the process volume or lifetime of other tools in a group of process tools (e.g., a cluster or group of process tools in the manufacturing system 102). As discussed below, the machine learning model may include a bootstrap aggregation model, a random forest tree decision tree model, and a partial least squares regression (PLS) model, among other models.Machine learning models can include ensemble modeling (e.g., stacked models, boosting models, etc.), which includes multiple models and leverages a more reliable model for the final prediction (e.g., regression) of the received data.
[0031] The thickness prediction tool 126 can receive data from the metrology tool 114 and / or the data preparation tool 116, such as sensor data indicative of conditions of the environment of the processing chamber, and determine a substrate process prediction. For example, the substrate process prediction can include values indicative of a thickness of a film at positions across a surface of the substrate. In some embodiments, the thickness prediction tool 126 can receive sensor data indicative of conditions of the environment of the processing chamber from the metrology tool 114 and use a machine learning model to output a thickness prediction. The thickness prediction can include an average thickness of the film on a first region (e.g., a center region) of the substrate and an average thickness of the film on a second region (e.g., an edge region) of the substrate.
[0032] As mentioned above, some embodiments of the critical dimension prediction tool 124 and / or thickness prediction tool 126 may use machine learning models to perform the described techniques. The associated machine learning models may be generated (e.g., trained, validated, and / or tested) using a machine learning system 170. The following exemplary description of the machine learning system 170 is described in the context of using the machine learning system 170 to generate the machine learning models 190 associated with the critical dimension prediction tool 124. However, it should be noted that this description is purely illustrative. Similar processing hierarchies and techniques may be used, individually and / or in combination with each other, in generating and executing the machine learning models associated with the critical dimension prediction tool 124 and / or thickness prediction tool 126, as discussed further in connection with other embodiments.
[0033] The machine learning system 170 can include one or more computing devices, such as a rack mount server, a router computer, a server computer, a personal computer, a mainframe computer, a laptop computer, a tablet computer, a desktop computer, a cloud computer, a cloud server, a system stored on one or more clouds, etc. The machine learning system 170 can include a critical dimension component 194 and a thickness component 196. In some embodiments, the critical dimension component 194 and the thickness component 196 can use the historical data 142 to determine a critical dimension and / or thickness prediction for a substrate processed by the manufacturing system 102. In some embodiments, the critical dimension component 194 can use a trained machine learning model 190 to determine a critical dimension prediction based on sensor data and / or process tool data. In some embodiments, the thickness component 196 can use a trained machine learning model to determine a thickness prediction based on sensor data and / or process tool data. The trained machine learning model 190 can use the historical data to determine chamber conditions.
[0034] In some embodiments, machine learning system 170 further includes server machine 172 and server machine 180. Server machines 172 and 180 can be one or more computing devices (such as a rack mount server, a router computer, a server computer, a personal computer, a mainframe computer, a laptop computer, a tablet computer, a desktop computer, a cloud computer, a cloud server, a system stored on one or more clouds, etc.), a data store (e.g., a hard disk, a memory database), a network, a software component, or a hardware component.
[0035] The server machine 172 may include a dataset generator 174 capable of generating a dataset (e.g., a set of data inputs and a set of target outputs) for training, validating, or testing a machine learning model. The dataset generator 174 may partition the historical data 142 into a training set (e.g., 60 percent of the historical data, or any other portion of the historical data), a validation set (e.g., 20 percent of the historical data, or some other portion of the historical data), and a test set (e.g., 20 percent of the historical data). In some embodiments, the dataset generator 174 generates multiple sets of training data. For example, the one or more sets of training data may include each of the datasets (e.g., a training set, a validation set, and a test set).
[0036] The server machine 180 includes a training engine 182, a validation engine 184, and a testing engine 186. The training engine 182 may be capable of training a machine learning model 190 using one or more of the historical sensor data 144, the historical process tool data 146, and / or the historical process result data 148 of the historical data 142 (of the data store 140). In some embodiments, the machine learning model 190 may be trained using one or more outputs of the data preparation tool 116, the critical dimension prediction tool 124, the thickness prediction tool, and / or 126. For example, the machine learning model 190 may be a hybrid machine learning model that uses sensor data and / or mechanical features, such as feature extraction, mechanical modeling, and / or statistical modeling. The training engine 182 may generate multiple trained machine learning models 190, each trained machine learning model 190 corresponding to a separate set of features of each training set.
[0037] The validation engine 184 can determine the accuracy of each of the trained machine learning models 190 based on the corresponding set of features of each training set. The validation engine 184 can discard trained machine learning models 190 that have an accuracy that does not meet a threshold accuracy. The test engine 186 can determine the trained machine learning model 190 that has the highest accuracy of all of the trained machine learning models based on the test (and optionally validation) set.
[0038] In some embodiments, the training data is provided to train the machine learning model 190 such that the trained machine learning model can receive new inputs having new sensor data indicative of new conditions for the new processing chamber, and the new outputs can indicate new process result predictions for substrates processed by the new process chamber under the new conditions.
[0039] The machine learning model 190 may refer to a model created by the training engine 182 using a training set that includes data inputs and corresponding target outputs (historical results of the process chamber under parameters associated with the target inputs). Within the data set, patterns may be found that map the data inputs to the target outputs (e.g., identifying associations between portions of sensor data and resulting chamber conditions), and the machine learning model 190 is provided with mappings that capture these patterns. The machine learning model 190 may use one or more of logistic regression, syntactic analysis, decision trees, or support vector machines (SVMs). The machine learning may consist of single-level linear and nonlinear operations (e.g., SVMs) and / or may be neural networks.
[0040] The critical dimension component 194 can provide current data (e.g., current sensor data associated with processing chamber conditions during a substrate processing procedure) as input to the trained machine learning model 190, which can be run on the input to obtain one or more outputs including a set of values indicative of a process outcome prediction. For example, the process outcome prediction can include values indicative of critical dimensions (e.g., etch bias, uniformity conditions, thickness, etc.). The critical dimension component 194 can be capable of identifying confidence data from the output indicative of a confidence level of the prediction. In one non-limiting example, the confidence level is a real number between 0 and 1, inclusive, where 0 indicates no confidence in one or more chamber conditions and 1 represents absolute confidence in the chamber conditions.
[0041] For purposes of illustration and not limitation, aspects of the disclosure describe training of a machine learning model and use of the trained learning model using information about historical data 142. In other embodiments, heuristic or rule-based models are used to determine chamber conditions.
[0042] In some embodiments, the functionality of client device 150, server 120, data store 140, and machine learning system 170 may be provided by fewer machines than those shown in Figure 1. For example, in some embodiments, server machines 172 and 180 may be combined into a single machine, and in some other embodiments, server machines 172, 180, and 192 may be combined into a single machine. In some embodiments, machine learning system 170 may be provided in whole or in part by server 120.
[0043] In general, functions described in one embodiment as being performed by client device 150, data store 140, metrology system 110, manufacturing system 102, and machine learning system 170 may in other embodiments be performed on server 120, where appropriate. Additionally, functions attributed to particular components may be performed by different or multiple components operating together.
[0044] In embodiments, a "user" may be represented as a single individual. However, other embodiments of the present disclosure encompass a "user" that is an entity controlled by multiple users and / or automated sources. For example, a set of individual users that are aggregated as a group of administrators may be considered a "user."
[0045] 2 is a block diagram illustrating a process outcome prediction system 200 in which embodiments of the present disclosure can function. The process outcome prediction system 200 can include aspects and / or features of the system architecture 100.
[0046] As shown in FIG. 2, the process result prediction system 200 can include pre-processing logic 204. The pre-processing logic receives process result data in the form of critical dimension (CD) bias data 202 (e.g., etch bias), etc. The process result system can also receive process tool data 216 and sensor data 214. The process result data can be indicative of a lifetime of a process tool. For example, the lifetime can include a value indicative of a number of substrates processed by a processing tool (e.g., relative to other tools in a group of process tools). The sensor can indicate an associated state of an environment of a process chamber process substrates that results in the CD bias data 202. The pre-processing logic 204 can include processing logic that operates as a feature extractor. The pre-processing logic 204 can reduce the dimensionality of the process result data and the process tool data 216 into groups or features. For example, the pre-processing logic 204 can generate features that include one or more tool independent data, time independent data (e.g., data weighted based on the process tool data), sensor data, etc. In some embodiments, the pre-processing logic 204 performs any of partial least squares (PLS) analysis, principal component analysis (PCA), multi-factor dimensionality reduction, non-linear dimensionality reduction, and / or any combination thereof. In some embodiments, the process logic is designed for edge detection of the process result data and / or process tool data. For example, the processing logic includes techniques aimed at identifying sensor data, process result data, and / or process tool data that change rapidly and / or include discontinuities (e.g., discontinuities or inconsistencies in process result data from the same process tool). For example, the pre-processing logic 204 can process the first process result data using the first process tool data to generate time-independent process result data.
[0047] 2, the process outcome prediction system 200 can include one or more regression models 206, 208. The regression models can be generated and / or trained using the CD bias data 202, the process tool data 216, and / or the output of the pre-processing logic 204. The regression models 206 and / or 208 can include general purpose predictive models.
[0048] In some embodiments, the regression models 206 and / or 208 may include a generic predictive model or function for determining substrate process results for given chamber conditions (e.g., from sensor data) and process tool data (e.g., relative life of the process tool). y = F(r)
[0049] In this example, F can represent a function (e.g., a linear function, a non-linear function, a custom algorithm, etc.), y is the process outcome prediction (CD bias), and r is a vector of features from historical data, r having a length from 1 to n, where n is the total number of features (e.g., can be dynamically determined by the pre-processing logic 204). The function F can handle dynamic vector lengths, and thus can calculate process outcome predictions as additional features are determined by the pre-processing logic 204. Given a sufficient amount of y and r data, the function F can be modeled to allow prediction of y from a given r. The prediction model can be provided by the critical dimension prediction tool 124 of FIG. 1 or other components.
[0050] In some embodiments, a boosting algorithm may be used to model one or more of the regression models 206 and / or 208. For example, the regression models 206, 208 may be represented by a predicted function F. The predicted function F may be represented by an ensemble technique such as gradient boosting regression, where F is represented by the following equation:
[0051]
number
[0052] In the above equation, λ defines the learning rate. The smaller the learning rate, the larger the total boost number B required, and therefore the more decision trees to be trained. This can increase accuracy, but at the expense of higher training and model evaluation costs. The subfunctions of b are individual decision trees fitted to the remaining residuals with a tree depth of b. To train this model, individual models are trained on the residual errors, and then these individual error models are summed together to obtain the final process outcome prediction. For example, one or more individual trees can be run as part of a gradient boosting regression (GBR) algorithm.
[0053] In some embodiments, one or more of the regression models 206 and / or 208 may be modeled using a Bayesian approach. For example, a Bayesian approach may be utilized that uses previous outcomes to create simple probabilities of future outcomes, also referred to as the naive Bayes technique, where F is defined by:
[0054]
number
[0055] where the probability of Y is equal to y based on feature x being equal to its combined historical probability using Bayes' Theorem shown above. The function P is simply the historical probability of the input constraints (i.e., Y=y, X=x).
[0056] In some embodiments, the regression models 206 and / or 208 can be run on different data subsets including different outputs of the pre-processing logic and / or outputs of other models. The regression model 206 can be modeled by performing a regression between the time independent CD bias data (output from the pre-processing logic 204) and the sensor data 214. As previously described, the time independent CD can include the processed CD bias data 202 by weighting the data using the process tool data 216 as shown in FIGS. 3A-3B. The regression model 206 can be generated and / or trained using residuals based on the difference predictions from the regression model 206. For example, the pre-processing logic 204 can output the processed CD data (e.g., time independent or process time life compensated for the data). The regression model 206 can be trained to receive the sensor data and / or process tool data and determine a prediction of the processed CD of the associated substrate. The regression model 208 can receive the output from the regression model 206 and determine a prediction of the residual CD. The residual CD may be the difference between the actual CD prediction and the output from the regression model 206.
[0057] A re-conversion tool 210 may provide processing logic that acts as an aggregator of one or more regression models 206, 208. For example, the output from each regression model 206, 208 may be aggregated to determine a final CD bias prediction 212. To the extent possible (e.g., to the extent the regression models can operate independently of one another), the re-conversion tool may interleave one or more regression models 206 to operate in parallel or in individual threads.
[0058] FIG. 3A depicts a graph 300A showing process result data according to some embodiments of the present disclosure. The graph 300A depicts CD results from substrate processes in different chambers with different chamber lifetimes (e.g., different amounts of process substrates by process tool and / or process chamber to date). The graph 300A includes a first axis 304A that identifies various individual substrates and a second axis 302A that shows the CD results of the substrates. A data series 306A shows the relationship between the identified substrates and the process or CD results of the associated substrates. FIG. 3B depicts a graph 300B showing process result data after data pre-processing logic according to some embodiments of the present disclosure. The data in the graph 300A is processed (e.g., using the pre-processing logic 204 of FIG. 2) to generate processed CD result data. The graph 300B includes a similar first axis 304B and second axis 302B. Data series 306B includes the same identified substrates, but with processed CD results (data that has been processed to remove time dependent effects such as process tool life data, as described above).
[0059] 4 is a block diagram illustrating a process result prediction system 400 in which embodiments of the present disclosure can function. The process result prediction system 400 can receive process result data 402 (e.g., from the metrology system 110 and / or data store 140 of FIG. 1). The process result data 402 can include values indicative of the process results (e.g., CD measurements, thickness measurements of the film, etc.). The process result data can include location or portion data for regions such as center data 404 and edge data 406 indicative of process result measurements associated with various localized regions of the substrate.
[0060] As shown in FIG. 4, the process result prediction system 400 can include statistical process tools 408A-408B. The statistical process tools 408A-408B can be used to process data based on statistical operations to validate, predict, and / or transform the process result data 402. In some embodiments, the statistical process tools 408A-408B include models generated using statistical process control (SPC) analysis to determine control limits for the data and identify the data as more or less dependable based on those control limits. In some embodiments, the statistical process tools 408A-408B are associated with univariate and / or multivariate data analysis. For example, the statistical process tools 408A-408B can be used to analyze various parameters and determine patterns and correlations (e.g., range, minimum, maximum, quartiles, variance, standard deviation, etc.) through statistical processes. In another example, regression analysis, path analysis, factor analysis, multivariate statistical process control (MCSPC), and / or multivariate analysis of variance (MANOVA) can be used to ascertain relationships between multiple variables. In some embodiments, a first statistical process tool 408A is associated with process result data 402 corresponding to a first local region of the substrate (e.g., center data 404), and a second statistical process tool 408B is associated with process result data 402 corresponding to a second local region of the substrate (e.g., edge data 406).
[0061] As shown in FIG. 4, the process result prediction system 400 includes an encoding tool 410. The encoding tool 410 can perform dimensionality reduction of the process result data and the position data (e.g., center data 404, edge data 406) into groups or features. For example, the encoding tool 410 can generate features including one or more tool-independent data, position-dependent process result data, sensor data, etc. In some embodiments, the encoding tool performs any of partial least squares (PLS) analysis, principal component analysis (PCA), multi-factor dimensionality reduction, non-linear dimensionality reduction, and / or any combination thereof. In some embodiments, the encoding tool 410 is designed for edge detection of the process result data and / or the position data. For example, the encoding tool 410 includes techniques aimed at identifying sensor data, process result data, and / or process tool data that change abruptly and / or include discontinuities (e.g., discontinuities or inconsistencies in process results across positions on the substrate).
[0062] In some embodiments, the encoding tool 410 builds a model (e.g., PCA model) to extract correlations between the process results of the center / edge areas and the sensor data of the process chambers processing the substrate that result in the process results corresponding to the process results associated with the center / edge areas. In some embodiments, the number of features (e.g., principal components) is dynamic and is determined by the encoding tool 410 based on the received process result data 402, sensor data, position data, etc. For a selected number of features (e.g., principal components), a spatial function can be calculated as follows:
[0063] For a selected number of PCs, the spatial function can be calculated by the following formula:
number
[0064] where Y is the process result data and P nis a spatial transformation of the process result data based on the location to which the process result data corresponds. For example, the spatial transformation may incorporate location data such as a coordinate representation (e.g., Cartesian, polar, etc.) of the associated measured process result. For this PCA procedure, the location corresponding to the associated measurement may be compensated to generate a correction of the spatially dependent data set Z.
[0065] 4, the process outcome prediction system 400 may include a regression tool 412. The regression tool 412 builds a prediction model based on the received encoded data (spatial dependent data). For example, the regression model may be trained by projects (PCs) from the encoding tool 410 and may be expressed as:
[0066]
number
[0067] In this example, f n can represent functions (e.g., linear functions, nonlinear functions, custom algorithms, etc.),
number
number
number
[0068] In some embodiments, a boosting algorithm (e.g., using gradient boosting regression) may be used to model one or more models generated and / or trained by the regression tool 412. For example, the regression tool 412 may generate and / or train a model represented by a predicted function F. The predicted function F may be represented by an ensemble technique such as gradient boosting regression, where F is represented by the following equation:
[0069]
number
[0070] In the above equation, λ defines the learning rate. The smaller the learning rate, the larger the total number of boosts B required, and therefore the more decision trees to be trained. This can increase accuracy, but at the expense of higher training and model evaluation costs. A subfunction of b can include a model (e.g., individual decision trees) fitted to the remaining residuals (e.g., with a tree depth of b). To train this model, individual models are trained on the residual errors, and then these individual error models are summed to obtain the final process outcome prediction.
[0071] 4, the process outcome prediction system 400 may include a decoding tool that performs a decoding technique associated with (e.g., its inverse, transpose, inverse, etc.) the technique performed by the encoding tool 410. For example, the decoding tool may receive a dimensionality reduced data set from the regression tool 412 and decode the data to generate a data set indicative of a process outcome prediction value. For example, the decoding tool 414 may identify features utilized by the encoding tool 410 and perform a counter to the dimensionality reduction provided by the encoding tool 410. In some embodiments, the decoding tool 414 performs any of partial least squares (PLS) analysis, principal component analysis (PCA), multi-factor dimensionality reduction, non-linear dimensionality reduction, and / or any combination thereof (e.g., the inverse, transpose, inverse, etc. of the technique performed by the encoding tool 410). For example, an exemplary representation of a technique performed by the decoding tool 414 may include the following:
[0072]
number
[0073] In the above formula,
number
number
number
[0074] In some embodiments, the process result prediction system 400 (e.g., the decoding tool 414) further determines a statistical average of the process result predictions decoded by the decoding tool 414. In some embodiments, the process result prediction system 400 determines a first average thickness associated with a center region of the second substrate and a second average thickness associated with an edge region of the second substrate. For example, techniques for performing the statistical average can include the following:
[0075]
number
[0076] where K is the number of points in the corresponding region (e.g., center or edge area) being calculated. These averages may be output, and include center prediction data 416 and / or edge prediction data 418.
[0077] 5A is an example dataset generator 572 (e.g., dataset generator 174 of FIG. 1 ) for creating a dataset for a machine learning model (e.g., one of the MLMs described herein) using substrate processing data 560 (e.g., sensor data 144 and / or process tool data 146 of FIG. 1 ) in accordance with certain embodiments. The system 500A of FIG. 5A shows the dataset generator 572, a data input 501, and a target output 503.
[0078] In some embodiments, the dataset generator 572 generates a dataset (e.g., a training set, a validation set, a test set) that includes one or more data inputs 501 (e.g., training inputs, validation inputs, test inputs). In some embodiments, the dataset further includes one or more target outputs 503 that correspond to the data inputs 501. The dataset can also include mapping data that maps the data inputs 501 to labels 566 of the target outputs 503. The data inputs 501 can also be referred to as “features,” “attributes,” or information. In some embodiments, the dataset generator 572 can provide a dataset to the training engine 182, the validation engine 184, and / or the test engine 186, where the dataset is used to train, validate, and / or test the machine learning model.
[0079] In some embodiments, the data set generator 572 generates the data input 501 based on the substrate process data 560. In some embodiments, the data set generator 572 generates labels 566 (e.g., process result measurements such as critical dimension measurements and / or film thickness measurements) associated with the substrate process data 560. In some cases, the labels 566 may be manually added to the images by a user (e.g., inputting the measurements). In other cases, the labels 566 may be automatically added to the input data. In some embodiments, the data input 501 may include sensor data indicative of a condition of the environment of the process chamber and a condition of the processing tool relative to the substrate process data 560.
[0080] In some embodiments, the dataset generator 572 may generate a first data input corresponding to a first set of features to train, validate, or test a first machine learning model, and the dataset generator 572 may generate a second data input corresponding to a second set of features to train, validate, or test a second machine learning model.
[0081] In some embodiments, the dataset generator 572 may discretize one or more of the data inputs 501 or the target outputs 503 (e.g., for use in a classification algorithm for a regression problem). Discretization of the data inputs 501 or the target outputs 503 may transform the sensor data into an instantiable state or feature vector. In some embodiments, the discrete values for the data inputs 501 represent individual sensor parameters of a process chamber (temperature, pressure, vacuum conditions) and / or lifetime data of a process tool (e.g., number of substrates processed).
[0082] The data inputs 501 and target outputs 503 being used to train, validate, or test the machine learning model may include information for individual process chambers and / or process tools. For example, substrate process data 560 and labels 566 may be used to train the system for a particular process tool and / or process chamber.
[0083] In some embodiments, the information used to train the machine learning model can be from a specific type of processing chamber and / or processing tool having specific characteristics, allowing the trained machine learning model to determine substrate process results for a group of substrates where one or more components share a specific group characteristic (e.g., a common process recipe). In some embodiments, the information used to train the machine learning model can be for data points from two or more process results, allowing the trained machine learning model to determine multiple output data points from the same sensor data (e.g., thickness, critical dimensions, uniformity parameters, etc.). For example, an MLM model that infers process results can provide thickness predictions for multiple regions and predict CD bias.
[0084] In some embodiments, after generating a dataset and using the dataset to train, validate, or test a machine learning model, the machine learning model may be further trained, validated, or tested (e.g., with additional sensor data, process tool data, process result data, and / or labels) or adjusted (e.g., adjusting weights associated with input data for the machine learning model 190, such as weights of connections in a neural network).
[0085] 5B is a block diagram illustrating a system 500B for training machine learning models to generate outputs 564 (e.g., process result predictions, thickness predictions, critical dimension predictions, process uniformity predictions, etc.) in accordance with certain embodiments. The system 500B can be used to train one or more machine learning models and determine outputs associated with process result data (e.g., critical dimension predictions, thickness predictions, etc.).
[0086] At block 510, the system 500B performs data partitioning (e.g., by a data set generator 572) of the substrate processing data 560 (e.g., sensor data indicative of a condition of the environment of the processing chamber, process tool data indicative of process tool life data, and, in some embodiments, the labels 566) to generate a training set 502, a validation set 504, and a test set 506. For example, the training set 502 may be 60% of the substrate processing data 560, the validation set 504 may be 20% of the substrate processing data 560, and the test set 506 may be 20% of the substrate processing data 560. The system 500B may generate multiple sets of features for each of the training set 502, the validation set 504, and the test set 506.
[0087] At block 512, the system 500B performs model training using the training set 502. The system 500B can train one or more machine learning models using multiple sets of training data items (e.g., each including multiple sets of features) of the training set 502 (e.g., a first set of features of the training set 502, a second set of features of the training set 502, etc.). For example, the system 500 can train the machine learning models to generate a first trained machine learning model (e.g., regression model 206) using a first set of features in the training set (e.g., CD bias data 202) and a second trained machine learning model (e.g., regression model 208) using a second set of features in the training set (e.g., process tool data 216). These machine learning models can also be trained to output one or more other types of predictions, classifications, decisions, etc. For example, the machine learning models can be trained to predict process outcomes of processed substrates according to the substrate process data 560.
[0088] The processing logic determines whether a stopping criterion is met. If the stopping criterion is not met, the training process is repeated with an additional training data item, and another training data item is input to the machine learning model. If the stopping criterion is met, the training of the machine learning model is completed.
[0089] In some embodiments, the first trained machine learning model and the second trained machine learning model can be combined to generate a third trained machine learning model (e.g., which may be a better predictor than the first or second trained machine learning models themselves). In some embodiments, the sets of features used in comparing the models (e.g., substrate processes from different processing chambers under different processing conditions) can overlap.
[0090] At block 514, the system 500B performs model validation (e.g., by validation engine 184 of FIG. 1 ) using the validation set 504. The system 500B may validate each of the trained models using a corresponding set of features in the validation set 504. For example, the system 500B may validate a first trained machine learning model using a first set of features in the validation set (e.g., feature vectors forming a first embedding network) and may validate a second trained machine learning model using a second set of features in the validation set (e.g., feature vectors from a second embedding network).
[0091] At block 514, the system 500B may determine the accuracy of each of the one or more trained models (e.g., by model validation) and may determine whether one or more of the trained models have an accuracy that meets a threshold accuracy. In response to determining that one or more of the trained models have an accuracy that meets the threshold accuracy, flow proceeds to block 516.
[0092] At block 518, the system 500B performs model testing using the test set 506 to test the selected model 508. The system 500B can test the first trained machine learning model using a first set of features in the test set (e.g., feature vectors from the encoding tool 410) and determine that the first trained machine learning model meets a threshold accuracy (e.g., based on the first set of features of the test set 506). In response to the accuracy of the selected model 508 not meeting the threshold accuracy (e.g., the selected model 508 is overfitted to the training set 502 and / or the validation set 504 and is not applicable to other data sets such as the test set 506), the flow proceeds to block 512, where the system 500 performs model training (e.g., retraining) using additional training data items. In response to determining that the selected model 508 has an accuracy that meets the threshold accuracy based on the test set 506, the flow proceeds to block 520. At least in block 512, the model can learn patterns in the substrate process data 560 to make a prediction, and in block 518, the system 500 can apply the model to the remaining data (e.g., the test set 506) to test the prediction.
[0093] At block 520, the system 500B receives current data (e.g., current sensor data and process tool data) using the trained model (e.g., selected model 508) and receives current output 564 based on processing the current substrate processing data 562 by the trained model at block 520. In some embodiments, the output 564 corresponding to the current substrate processing data 562 is received and the model 508 is re-trained based on the current substrate processing data 562 and the current output 564.
[0094] In some embodiments, one or more of the operations of blocks 510-520 may be performed in various orders and / or with other operations not presented and described herein. In some embodiments, one or more of the operations of blocks 510-520 may not be performed. For example, in some embodiments, one or more of the data partitioning of block 510, the model validation of block 514, the model selection of block 516, or the model testing of block 518 may not be performed.
[0095] 6 illustrates a block diagram of a process outcome prediction system 600 using stacked modeling according to an embodiment of the disclosure. One or more of the models (e.g., machine learning models) described herein may incorporate model stacking as described in connection with FIG 6. For example, one or more of the regression model 206, the regression model 208, and / or the models generated and / or trained by the regression tool 412 may include one or more techniques and / or processes presented in FIG 6.
[0096] 6, the process outcome prediction system 600 can include a data set including a set of input data 602 and a set of output data 604 corresponding to the respective input data 602. The input data 602 and the output data 604 can be received by a data processing tool 606. The data processing tool 606 can perform a partitioning of the input and output data into data groups 608 (e.g., performing the techniques described in connection with data partitioning in block 510 of FIG. 5). The data groups 608 can include different combinations of groupings of the input data 602 and the output data 604. In some embodiments, the data groups 608 are mutually exclusive, while in other embodiments, the data groups 608 include overlapping data points.
[0097] As shown in FIG. 6, the process outcome prediction system generates a stack of local models 610. Each local model can be generated and / or trained based on an individual associated data group 608. Each local model 610 can be trained to generate independent outputs from the other local models 610 based on the same received inputs. Each local model can receive new input data and provide new output data based on the trained model. Each model (e.g., by training dataset differencing) can identify different features, artificial parameters, and / or principal components based on the differences in the data group 604 used to train the corresponding model 610.
[0098] The local models 610 can be used together to generate and / or train a final model. In some embodiments, the final model includes a weighted average ensemble. The weighted average ensemble weights the contribution of each local model 610 by the confidence or trust level of the contribution (e.g., output) received by its corresponding model. In some embodiments, the weights are equal across the local models 610 (e.g., each output from each local model 610 is treated equally across these models). In some embodiments, the final model is trained (e.g., using a neural network or a deep learning network) to determine the various weights (e.g., contribution weights) of the local models. For example, one or more types of regressions (e.g., gradient boosting regression, linear regression, logistic regression, etc.) can be performed to determine one or more contribution weights associated with the local models. The final model 612 can receive outputs from the local models 610 as inputs and attempts to learn how to best combine the input predictions to make improved output predictions.
[0099] 7 illustrates a model training workflow 705 and a model application workflow 717 for substrate process outcome prediction according to aspects of the disclosure. In an embodiment, the model training workflow 705 can be executed on a server, which may or may not include a process outcome prediction application, to which the trained model is provided, and which can execute the model application workflow 717. The model training workflow 705 and the model application workflow 717 can be executed by processing logic executed by a processor of a computing device (e.g., server 120 of FIG. 1). One or more of these workflows 705, 717 can be executed by, for example, a processing device implementing one or more machine learning modules and / or other software and / or firmware executing on the processing device.
[0100] A model training workflow 705 is for training one or more machine learning models (e.g., regression models, boosted regression models, principal component analysis models, deep learning models) to perform one or more determination, prediction, correction, etc. tasks associated with the process result predictor (e.g., critical dimension prediction, film thickness prediction). A model application workflow 717 is for applying one or more trained machine learning models to perform determination and / or adjustment, etc. tasks for chamber data (e.g., raw sensor data indicative of processing chamber conditions, synthetic data). One or more of the machine learning models can receive process result data (e.g., substrate metrology data).
[0101] Various machine learning outputs are described herein. Particular numbers and configurations of machine learning models are described and illustrated. However, it should be understood that the number and types of machine learning models used, as well as the configurations of such machine learning models, can be modified to achieve the same or similar end results. Thus, the machine learning model configurations described and illustrated are merely examples and should not be construed as limiting.
[0102] In an embodiment, one or more machine learning models are trained to perform one or more of the following tasks: Each task may be performed by a separate machine learning model. Alternatively, a single machine learning model may perform each of the tasks or a portion of the tasks. Additionally or alternatively, different machine learning models may be trained to perform different combinations of tasks. In one example, one or several machine learning models may be trained, and the trained machine learning (ML) model is a single shared neural network, with multiple shared layers and multiple higher-level separate output layers, each of which outputs a different prediction, classification, discrimination, etc. Tasks that the one or more trained machine learning models may be trained to perform are: a. Critical Dimension Predictor - As previously discussed, various input data, such as sensor data, process tool data, pre-processed data, and synthetic data, indicative of conditions of a processing chamber during substrate processing, can be received and processed by a critical dimension predictor. The critical dimension predictor can output various values corresponding to various predicted process results of a substrate processed under conditions associated with the input data. For example, the critical dimension predictor can output a process result prediction, such as a critical dimension prediction (e.g., an etch bias value). b. Film Thickness Predictor - As previously discussed, various input data, such as sensor data, pre-processed data, and synthetic data, indicative of conditions of a processing chamber during substrate processing, can be received and processed by a film thickness predictor. The film thickness predictor can output various values corresponding to various predicted process results of a substrate processed under conditions associated with the input data. For example, the film thickness predictor can output process result predictions, such as a film thickness prediction (e.g., average film thickness in a center region of the substrate, average film thickness in an edge region of the substrate).
[0103] For model training workflow 705, a training data set including hundreds, thousands, tens of thousands, hundreds of thousands, or more of chamber data 710 (e.g., sensor data indicative of conditions of associated processing chambers, synthetic data) and / or process tool data 712 (e.g., lifetime data including multiple substrates processed by associated process tools) must be used to form the training data set. In an embodiment, the training data set may also include associated process result data 714 (e.g., measured parameters of a substrate (e.g., critical dimensions, uniformity requirements, film thickness results, etc.), where each data point may include various labels or classifications of one or more types of useful information) to form the training data set. In either case, data may be included that are indicative of, for example, one or more processing chambers that process the substrates, as well as associated process results of the substrates evaluated during and / or after the substrate processing procedure. This data may be processed to generate one or more training data sets 736 for training one or more machine learning models. The machine learning models may be trained, for example, to automate prediction of process results of substrates processed under conditions associated with the chamber data 710 and / or process tool data 712.
[0104] In one embodiment, generating the one or more training data sets 736 includes performing substrate processing and performing metrology to determine one or more process result measurements (e.g., measured parameters of the substrate (e.g., critical dimensions, uniformity requirements, film thickness results, etc.). One or more labels may be used in the various iterations of substrate processing and the measured process results. The labels used may depend on what a particular machine learning model is trained to do. In some embodiments, the chamber data, process results, and / or process tool data may be represented as vectors and process rates may be represented as one or more matrices, as described in other embodiments.
[0105] To perform the training, processing logic inputs the training dataset 736 to one or more untrained machine learning models. Prior to inputting the first input to the machine learning models, the machine learning models may be initialized. The processing logic trains the untrained machine learning models based on the training dataset to generate one or more trained machine learning models that perform the various operations described above.
[0106] Training can be performed by inputting one or more of the chamber data 710, the process tool data 712, and the process results data 714 into the machine learning model one at a time.
[0107] After one or more training rounds, the processing logic can determine whether a stopping criterion has been met. The stopping criterion may be a target accuracy level, a target number of processed images from the training dataset, a target amount of change to the parameter at one or more previous data points, combinations thereof, and / or other criteria. In one embodiment, the stopping criterion is met when at least a minimum number of data points have been processed and at least a threshold accuracy has been achieved. The threshold accuracy may be, for example, 70%, 80%, or 90% accuracy. In one embodiment, the stopping criterion is met when the accuracy of the machine learning model stops improving. If the stopping criterion is not met, further training is performed. If the stopping criterion is met, the training can be completed. After the machine learning model is trained, the model can be tested using a reserved portion of the training dataset.
[0108] After the one or more trained machine learning models 738 are generated, they can be stored in model storage 745 and added to a substrate process rate determination and / or process adjustment application. The substrate process rate determination and / or process adjustment application can then use the one or more trained ML models 738, as well as additional processing logic, to implement an automatic mode in which user manual input of information is minimized or even eliminated in some cases.
[0109] According to one embodiment, for the model application workflow 717, the input data 762 can be input to a critical dimension predictor 767, which can include a trained machine learning model. Based on the input data 762, the critical dimension predictor 767 outputs information indicative of one or more critical dimension values of a substrate processed under the conditions represented by the input data 762. According to one embodiment, the input data 762 can be input to a film thickness predictor 764, which can include a trained machine learning model. Based on the input data 762, the film thickness predictor 764 outputs information indicative of one or more film thickness values of a substrate processed under the conditions represented by the input data 762.
[0110] 8 depicts a flow diagram of one exemplary method 800 of predicting a process outcome of a substrate process, according to some embodiments of the present disclosure. The method 800 is performed by processing logic, which may comprise hardware (e.g., circuitry, dedicated logic, etc.), software (such as running on a general-purpose computer system or a dedicated machine), or any combination thereof. In one embodiment, the method is performed using the server 120 and trained machine learning model 190 of FIG. 1, while in some other embodiments, one or more blocks of FIG. 8 may be performed by one or more other machines not depicted in these figures.
[0111] The method 800 may include receiving sensor data (e.g., associated with a processing chamber that processes a substrate) and process tool data (e.g., associated with a lifetime of a process tool that processes the substrate) and processing the received sensor data and process tool data using a trained machine learning model 190. The trained model may be configured to generate one or more outputs indicative of a process result prediction based on the sensor data and the process tool data and a confidence level that the process result prediction accurately represents a process result for a substrate processed under conditions associated with the sensor data and the process tool data.
[0112] At block 802, the processing logic receives sensor data indicative of a condition of an environment of a processing chamber processing a first substrate according to a substrate processing procedure. At block 804, the processing logic receives process tool data indicative of a relative operational life of the processing tool processing the first substrate compared to other process tools in the group of process tools. For example, the process tool data can indicate that the process tool has processed a first number of substrates since a last preventive maintenance procedure and / or that the process tool has processed a second number of substrates that is greater than another process tool or the group of process tools. The condition of the processing chamber environment is measured during the substrate processing procedure. The sensor data and / or the process tool data can be raw data or can be processed using one or more of feature extraction, mechanical models, and / or statistical models to prepare the sensor for input to a machine learning model. The sensor data can be indicative of one or more parameters of the processing chamber (e.g., temperature, pressure, vacuum conditions, spectroscopic data, etc.).
[0113] In some embodiments, the sensor data and / or process tool data may further include synthetic data or data processed from the raw sensor data. For example, as described in the previous embodiments, various processing tools may perform feature extraction and / or create combinations of artificial and / or virtual parameters. A feature extractor (e.g., data preparation tool 116 of FIG. 1 ) may create various features by performing variable analysis, such as process control analysis, univariate limit violation analysis, and / or multivariate limit violation analysis, on the raw sensor data. In some embodiments, the sensor data is normalized across multiple processing chambers and / or process recipes to create comparable data sets with a common base. In some embodiments, the processing logic processes the sensor data and / or process tool data to generate modified sensor data. The modified sensor data may include sensor data weighted according to the process tool data.
[0114] At block 806, processing logic uses the sensor data and the process tool data as inputs to the trained machine learning model. At block 808, processing logic obtains output from the machine learning model.
[0115] At block 810, processing logic predicts a process result for the first substrate based on output from the machine learning model. In some embodiments, the process result prediction includes a value corresponding to an etch bias for the first substrate. In some embodiments, the process result prediction indicates a first average thickness associated with a center region of the first substrate and a second average thickness associated with an edge region of the first substrate.
[0116] In some embodiments, multiple machine learning models may be used. For example, a first MLM may be used to process the sensor data to obtain a first process outcome prediction. The processing logic may use a second machine learning model to process the first process result to obtain a second process outcome prediction. The processing logic may further combine the first process outcome prediction and the second process outcome prediction to obtain a final process outcome prediction.
[0117] At block 812, the processing logic may prepare the process result prediction for presentation on a graphical user interface (GUI). For example, the process result prediction may include a notification associated with the process result prediction, such as that the process result has exceeded a threshold window of acceptable values (e.g., statistical process control (SPC)). The notification may include an action to be performed in association with the process chamber and / or process tool (e.g., preventive maintenance). In another example, the process result prediction may be displayed on the GUI by displaying changes to the substrate process (e.g., adjustments to process parameters) to be taken to remedy deficiencies identified by the process result prediction. At block 814, the processing logic may modify the operation of the process chamber and / or processing tool based on the process result prediction. For example, the processing logic may transmit instructions to one or more process controllers to modify one or more operations of the processing device (e.g., modify a process recipe and / or process parameters, terminate substrate processing of one or more process tools and / or process chambers, initiate preventive maintenance associated with one or more process chambers and / or process tools, etc.).
[0118] 9 depicts a flow diagram of one exemplary method 900 of predicting a process outcome of a substrate process, according to some embodiments of the present disclosure. The method 900 is performed by processing logic, which may comprise hardware (e.g., circuitry, dedicated logic, etc.), software (such as running on a general-purpose computer system or a dedicated machine), or any combination thereof. In one embodiment, the method is performed using the server 120 and trained machine learning model 190 of FIG. 1, while in some other embodiments, one or more blocks of FIG. 9 may be performed by one or more other machines not depicted in these figures.
[0119] At block 902, the processing logic receives training data including (i) first sensor data and (ii) metrology data. The first sensor data is indicative of a condition of an environment of a processing chamber processing a first substrate. The metrology data includes process result data associated with the first substrate processed under conditions associated with the first sensor data. The sensor data and / or metrology tool data may be raw data or may be processed using one or more of a mechanical model and / or a statistical model to prepare the sensor for input to the machine learning model. The sensor data may be indicative of one or more parameters of the processing chamber (e.g., temperature, pressure, vacuum conditions, spectroscopic data, etc.).
[0120] At block 904, the processing logic encodes the training data to generate encoded training data. In some embodiments, various processing tools can perform feature extraction and / or create combinations of artificial and / or virtual parameters. A feature extractor (e.g., data preparation tool 116 of FIG. 1) can create various features by performing variable analysis, such as process control analysis, univariate limit violation analysis, and / or multivariate limit violation analysis, on the raw sensor data. In some embodiments, the sensor data is normalized across multiple processing chambers and / or process recipes to create comparable data sets with a common base. In some embodiments, the processing logic processes the sensor data and / or process tool data to generate modified sensor data. The modified sensor data can include sensor data weighted according to the process tool data. For example, principal component analysis (PCA) can be used to perform the encoding of the data.
[0121] At block 906, the processing logic runs a regression using the encoded training data to train a machine learning model (MLM). For example, the processing logic can generate a regression model according to the project (e.g., principal components) generated at block 904. In some embodiments, the regression can be based on a linear function, a non-linear function, a custom algorithm, etc. In some embodiments, a boosting algorithm can be used (e.g., using gradient boosting regression) to model one or more models generated and / or trained by the regression tool 412. For example, the regression tool 412 can generate and / or train a model represented by a predicted function F. The prediction function F can be represented by an ensemble technique such as gradient boosting regression (GBR). The model can be composed of sub-functions including individual decision trees fitted to the remaining residuals of a previous set of sub-functions. To train this model, individual models are trained on the remaining errors, and then these individual error models are summed to obtain the final process outcome prediction.
[0122] At block 908, the processing logic receives second sensor data. The second sensor data may be indicative of a condition of an environment in a second process chamber for processing a second substrate. At block 910, the processing logic encodes the second sensor data to generate encoded sensor data. The processing logic may utilize one or more features and / or aspects of the data encoding performed at block 904.
[0123] At block 912, the processing logic uses the encoded sensor data as input to the trained MLM. At block 914, the processing logic receives one or more outputs from the trained MLM. The one or more outputs include encoded predicted data. At block 916, the processing logic decodes the encoded predicted data to generate predicted data indicative of a process outcome for a substrate processed under conditions associated with the second sensor data. The processing logic may perform a technique associated with (e.g., its inverse, transpose, inverse, etc.) the technique performed to encode the data at blocks 904 and / or 912. For example, the processing logic may receive a dimensionality-reduced data set from the trained MLM and then decode the data to generate a data set indicative of a process outcome prediction. For example, the processing logic may identify features utilized to encode the data at blocks 904 and / or 910 and perform a counter to the corresponding dimensionality reduction. In some embodiments, the processing logic performs any of partial least squares (PLS) analysis, principal component analysis (PCA), multi-factor dimensionality reduction, non-linear dimensionality reduction, and / or any combination thereof (e.g., the inverse, transpose, inverse, etc. of the techniques performed in blocks 904 and / or 912).
[0124] 10 depicts a block diagram of an exemplary computing device 1000 operating in accordance with one or more aspects of the present disclosure. In various illustrative examples, various components of the computing device 1000 may represent various components of the client device 150, the measurement system 110, the server 120, the data store 140, and the machine learning system 170 shown in FIG.
[0125] The exemplary computing device 1000 may be connected to other computer devices in a LAN, an intranet, an extranet, and / or the Internet. The computing device 1000 may operate in the capacity of a server in a client-server network environment. The computing device 1000 may be a personal computer (PC), a set-top box (STB), a server, a network router, switch or bridge, or any device capable of executing (sequentially or otherwise) a set of instructions that specify operations to be performed by the device. Furthermore, although only a single exemplary computing device is shown, the term "computer" shall also be taken to include any group of computers that individually or together execute a set (or sets) of instructions to perform any one or more of the methodologies discussed herein.
[0126] The exemplary computing device 1000 may include a processing device 1002 (also referred to as a processor or CPU), a main memory 1004 (e.g., read only memory (ROM), flash memory, dynamic random access memory (DRAM), such as synchronous DRAM (SDRAM), etc.), a static memory 1006 (e.g., flash memory, static random access memory (SRAM), etc.), and a secondary memory (e.g., a data storage device 1018), which may communicate with each other via a bus 1030.
[0127] The processing device 1002 represents one or more general-purpose processing devices, such as a microprocessor, a central processing unit, or the like. More specifically, the processing device 1002 may be a complex instruction set computing (CISC) microprocessor, a reduced instruction set computing (RISC) microprocessor, a very long instruction word (VLIW) microprocessor, a processor implementing other instruction sets, or a processor implementing a combination of instruction sets. The processing device 1002 may also be one or more special-purpose processing devices, such as an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), a digital signal processor (DSP), a network processor, or the like. According to one or more aspects of the present disclosure, the processing device 1002 may be configured to execute instructions implementing the methods 500A-500B, 800-900 illustrated in FIGS. 5, 8-9.
[0128] The exemplary computing device 1000 may further comprise a network interface device 1008, which may be communicatively coupled to a network 1020. The exemplary computing device 1000 may further comprise a video display 1010 (e.g., a liquid crystal display (LCD), touch screen, or cathode ray tube (CRT)), an alphanumeric input device 1012 (e.g., a keyboard), a cursor control device 1014 (e.g., a mouse), and an audio signal generating device 1016 (e.g., a speaker).
[0129] The data storage device 1018 may include a machine-readable storage medium (or, more specifically, a non-transitory machine-readable storage medium) 1028 having stored thereon one or more sets of executable instructions 1022. According to one or more aspects of the present disclosure, the executable instructions 1022 may include executable instructions associated with performing the methods 500A-500B, 800-900 shown in FIGS.
[0130] The executable instructions 1022 may also reside, completely or at least partially, within the main memory 1004 and / or within the processing device 1002 during execution thereof by the exemplary computing device 1000, with the main memory 1004 and the processing device 1002 also constituting computer-readable storage media. The executable instructions 1022 may further be transmitted or received over a network via the network interface device 1008.
[0131] Although the computer-readable storage medium 1028 is illustrated in FIG. 10 as a single medium, the term "computer-readable storage medium" should be interpreted to include a single medium or multiple media (e.g., a centralized or distributed database, and / or associated caches and servers) that store one or more sets of operating instructions. The term "computer-readable storage medium" should also be interpreted to include any medium capable of storing or encoding a set of instructions for execution by a machine that causes the machine to perform any one or more of the methods described herein. Thus, the term "computer-readable storage medium" should be interpreted to include, but is not limited to, solid-state memories and optical and magnetic media.
[0132] Some portions of the above detailed descriptions are presented in terms of algorithms and symbolic representations of operations on data bits within a computer memory. These algorithmic descriptions and representations are the means used by those skilled in the data processing arts to most effectively convey the substance of their work to others skilled in the art. An algorithm is here conceived to be a self-consistent sequence of steps leading to a desired result. These steps require physical manipulations of physical quantities. Usually, though not necessarily, these quantities take the form of electrical or magnetic signals capable of being stored, transferred, combined, compared, and otherwise manipulated. It has proven convenient at times, primarily for reasons of common usage, to refer to these signals as bits, values, elements, symbols, characters, terms, numbers, or the like.
[0133] It should be noted, however, that all of these and similar terms are to be associated with the appropriate physical quantities and are merely convenient labels applied to these quantities. As will become apparent from the discussion that follows, unless specifically stated otherwise, discussions utilizing terms such as "identify," "determine," "store," "adjust," "cause," "return," "compare," "create," "stop," "load," "copy," "inject," "exchange," "execute," and the like throughout the description will be understood to refer to operations and processes of a computer system or similar electronic computing device that manipulate and transform data, represented as physical (electronic) quantities in the computer system's registers and memory, into other data, similarly represented as physical quantities in the computer system's memory or registers or other such information storage, transmission, or display device.
[0134] An example of the present disclosure also relates to an apparatus for carrying out the methods described herein. This apparatus may be specially constructed for the required purpose, or may be a general-purpose computer system selectively programmed by a computer program stored in the computer system. Such a computer program may be stored in a computer-readable storage medium, such as any type of disk, including, but not limited to, optical disk, compact disk read-only memory (CD-ROM), and magneto-optical disk, read-only memory (ROM), random access memory (RAM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), magnetic disk storage media, optical storage media, flash memory devices, other types of machine-accessible storage media, or any type of media suitable for storing electronic instructions, each of which is coupled to a computer system bus.
[0135] The methods and displays presented herein are not inherently related to any particular computer or other apparatus. Various general-purpose systems can be used with programs in accordance with the teachings herein, or it may prove convenient to construct more specialized apparatus to perform the required method steps. The required structure for a variety of these systems is set forth in the description below. In addition, the scope of the disclosure is not limited to any particular programming language. It will be understood that a variety of programming languages can be used to implement the teachings of the disclosure.
[0136] It should be understood that the above description is intended to be illustrative and not restrictive. Many other embodiments will be apparent to those skilled in the art upon reading and understanding the above description. Although specific examples are described in this disclosure, it will be understood that the systems and methods of the present disclosure are not limited to the examples described herein, but may also be practiced with modifications within the scope of the appended claims. Accordingly, the specification and drawings should be considered in an illustrative sense and not in a restrictive sense. The scope of the present disclosure should therefore be determined with reference to the appended claims, along with the full scope of equivalents to which such claims are entitled.
Claims
1. receiving, by a processing device, training data including: (i) first sensor data indicative of a first condition of an environment of a first processing chamber for processing a first substrate; (ii) first process tool data indicative of a time-dependent condition of a first processing tool for processing the first substrate; and (iii) first process result data corresponding to the first substrate; training, by the processing device, a first model with input data including the first sensor data and the first process tool data, and a target output including the process result data, wherein the trained first model is adapted to receive new input having second sensor data indicative of a second state of an environment of a second processing chamber processing a second substrate, and second process tool data indicative of a second time-dependent state of a second processing tool processing the second substrate, and to generate a second output based on the new input, wherein the second output indicative of second process result data corresponds to the second substrate. method.
2. Training the first model comprises: processing the first process result data using the first process tool data to generate time independent process result data; The method of claim 1 , further comprising: performing a first regression using the time-independent process result data and the first sensor data.
3. Training the first model comprises: determining a residual between the first process result data and the time-independent process result data; The method of claim 2 , further comprising: performing a second regression using the residuals and the first sensor data.
4. The method of claim 3 , wherein at least one of the first regression or the second regression is performed using a partial least squares (PLS) algorithm.
5. The method of claim 3 , wherein at least one of the first regression or the second regression is performed as part of a Gradient Boosting Regression (GBR) algorithm.
6. Training the first model comprises: performing a first regression using a first subset of the training data to generate a first regression model; performing a second regression using a second subset of the training data to generate a second regression model; 2. The method of claim 1 , further comprising: determining, based on a comparison of the first regression model, the second regression model, and the training data, that a first accuracy of the first regression model is greater than a second accuracy of the second regression model.
7. The method of claim 1 , wherein the first process result data comprises a value corresponding to an etch bias of the first substrate.
8. The method of claim 1 , wherein the first process tool data is indicative of a relative operational life of the first process tool as compared to other process tools in a fleet of process tools.
9. 2. The method of claim 1, wherein the first process result data indicates a first average thickness associated with a center region of the first substrate and a second average thickness associated with an edge region of the first substrate.
10. receiving, by a processing device, (i) sensor data indicative of a condition of an environment of a processing chamber in which a first substrate is processed according to a substrate processing procedure, and (ii) process tool data indicative of a relative operational lifetime of a processing tool in a fleet of process tools indicative of a relative operational lifetime of a processing tool in which the first substrate is processed compared to other process tools in a fleet of process tools; processing the sensor data and the process tool data using one or more machine learning models (MLMs) to determine a prediction of a process result measurement for the first substrate; performing, by the processing device, at least one of: a) preparing the prediction for presentation in a graphical user interface (GUI); or b) modifying operation of at least one of the processing chamber or the processing tool based on the prediction; A method comprising:
11. The method of claim 10 , wherein the prediction of the process result measurement includes a value corresponding to an etch bias of the first substrate.
12. 11. The method of claim 10, wherein the prediction of the process result measurement comprises a first average thickness associated with a center region of the first substrate and a second average thickness associated with an edge region of the first substrate.
13. 11. The method of claim 10, wherein processing the sensor data and the process tool data further comprises processing the sensor data using the process tool data to generate modified sensor data, the modified sensor data comprising sensor data weighted according to the process tool data, and the prediction is determined based on the modified sensor data.
14. Processing the sensor data and the process tool data includes: processing the sensor data using a first MLM of the one or more MLMs to obtain a first process outcome prediction; processing the first process outcome prediction using a second MLM of the one or more MLMs to obtain a second process outcome prediction; 11. The method of claim 10, further comprising: determining the prediction based on a combination of at least the first process outcome prediction and the second process outcome prediction.
15. training a machine learning model (MLM), wherein training the MLM comprises: (i) receiving first sensor data indicative of a first condition of an environment of a first process chamber for processing a first substrate, and (ii) training data including metrology data including process result measurements and position data indicative of a first position across a surface of the first substrate corresponding to the process result measurements; encoding the training data to generate encoded training data; and performing a regression using the encoded training data. method.
16. receiving second sensor data indicative of a second condition of an environment in a second process chamber for processing a second substrate; encoding the second sensor data to generate encoded sensor data; using the encoded sensor data as input to the trained MLM; receiving one or more outputs from the trained MLM, the one or more outputs including encoded prediction data; decoding the encoded prediction data to generate prediction data including values indicative of a process result for the second substrate at a second location across a surface of the second substrate, the second location corresponding to the first location of the first substrate; The method of claim 15 further comprising:
17. 17. The method of claim 16, wherein at least one of encoding the sensor data or decoding the encoded predictive data is performed using principal component analysis (PCA).
18. 17. The method of claim 16, wherein the prediction data indicates a first average thickness associated with a central region of the second substrate and a second average thickness associated with an edge region of the second substrate.
19. 16. The method of claim 15, wherein the process result measurement comprises a value indicative of an etch bias of the first substrate.
20. The method of claim 15 , wherein the regression is performed as part of Gradient Boosting Regression (GBR).
Citation Information
Patent Citations
Improving tool performance by linking tool operation parameters and material measurement with spectroscopic information.
JP2014507801A
Material property prediction device and material property prediction method
JP2021039534A
Predicting device, predicting method, and predicting program
JP2021086572A
Information processing apparatus, information processing method, and program
JP2021093020A