Method for rapidly analyzing TEM images in batches and measuring critical dimensions by nanoscope software
Nanoscope software uses an intelligent analysis and measurement system, cutting-edge AI technology and quantum computing acceleration modules to solve the problems of time-consuming, large errors and poor adaptability in TEM image analysis, and realizes rapid batch analysis and high-precision key dimension measurement, which is suitable for multi-layer structures in chip manufacturing.
Patent Information
- Application Number
- CN202510813405.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-06-18
- Publication Date
- 2025-09-30
- Estimated Expiration
- 2045-06-18
AI Technical Summary
Existing TEM image analysis technology in chip manufacturing has problems such as long time consumption, low efficiency, insufficient automation, difficulty in adapting to different process nodes, and inability to quickly batch analyze and process TEM images. In particular, it is difficult to define measurement points in multi-layer structures, resulting in large errors in key dimension measurement and inability to deeply explore the relationship between images and chemical composition.
By using nanoscope software and building a TEM image intelligent analysis and measurement system, including image acquisition, preprocessing, measurement template generation, path planning, data fusion and analysis, cloud optimization and quantum computing acceleration modules, and utilizing cutting-edge AI technologies such as generative adversarial networks, graph neural networks, reinforcement learning, multimodal convolutional neural networks and federated learning, automated rapid batch analysis and key dimension measurement can be achieved.
It significantly improves TEM image processing efficiency, shortens feature extraction time, ensures consistency and accuracy of measurement points, adapts to different process nodes, improves operational efficiency and measurement accuracy, and supports high-throughput analysis and process optimization.
Smart Images

Figure CN120725978A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of chip manufacturing, in particular to a nanoscope software capable of quickly batch analyzing TEM images and a key dimension measurement method. Background Art
[0002] With the rapid development of semiconductor technology, chip manufacturing, as the core of the modern electronics industry, has a direct impact on chip performance and production efficiency due to its process accuracy and stability. Transmission electron microscopy (TEM) images, as a key analytical tool in chip manufacturing, can provide nanoscale structural information and play an irreplaceable role in process optimization and defect analysis. However, as chip process nodes continue to shrink (such as 5nm, 3nm, and even 1nm), the complexity of TEM images has increased significantly. Fab engineers need to perform critical dimension (CD) measurements in complex multi-layer structures to verify process parameters and identify defects. Therefore, how to quickly and accurately analyze TEM images and achieve automated critical dimension measurement has become an important research direction in the chip manufacturing field.
[0003] Currently, TEM image analysis and critical dimension measurement mainly rely on the following technical means:
[0004] Traditional Manual Analysis: Traditional TEM image analysis is typically performed by fab engineers through visual inspection and manual measurement, using a magnifying glass or simple image processing software (such as Photoshop) to mark measurement points and calculate dimensions. This method relies on the engineer's professional skills to perform basic analysis and dimensional measurement of TEM images.
[0005] Mainstream commercial software: Mainstream TEM image analysis software on the market includes DigitalMicrograph and ImageJ with TEM Plugins, both from Gatan. DigitalMicrograph supports filtering, enhancement, and manual labeling of TEM images, while ImageJ uses plugins to implement contour extraction and size calculation, providing engineers with professional image processing support.
[0006] Semi-automated tools: Some advanced laboratories and companies have developed semi-automated tools based on traditional image processing techniques. For example, these tools employ edge detection algorithms (such as the Canny operator) for contour extraction and dimensional measurement. These tools, combined with image preprocessing techniques, can assist in completing measurement tasks under specific conditions.
[0007] Hardware-assisted analysis: Some high-end TEM systems integrate simple analysis modules that implement basic image enhancement and size calculations through hardware acceleration. For example, some TEM systems are equipped with real-time filtering capabilities that can perform preliminary image processing during the imaging process to support subsequent analysis.
[0008] Although existing TEM image analysis technology plays an important role in chip manufacturing, it still has the following shortcomings:
[0009] Problem 1: Traditional manual analysis and mainstream software (such as DigitalMicrograph and ImageJ) rely on manual positioning and measurement, which is time-consuming and inefficient, making it impossible to quickly analyze TEM images in batches. As the number of TEM images in chip manufacturing increases, this inefficiency becomes a bottleneck limiting production efficiency.
[0010] Problem 2: Existing tools lack sufficient automation, making it difficult to define measurement points, especially when dealing with complex multi-layer TEM images in chip manufacturing. This leads to significant manual errors. Fab engineers need to measure at corresponding points according to process rules, but complex structures and fuzzy boundaries lead to poor point positioning consistency, affecting the accuracy of critical dimension measurements.
[0011] Problem 3: Mainstream software and semi-automated tools lack highly customized designs for chip manufacturing, making it difficult to adapt to the specific requirements of different process nodes (such as 5nm and 3nm). Measurement rules are not easily reusable, requiring parameter readjustment for each analysis, increasing operational complexity and the workload for engineers.
[0012] Problem 4: Existing technologies have limited capabilities for contour recognition and rapid measurement of TEM images, particularly for batch image processing, making it difficult to meet the demands of high-throughput analysis. Furthermore, traditional methods fail to fully leverage modern AI technology and multimodal data analysis, failing to deeply explore the relationship between images and chemical composition, and thus providing insufficient support for process optimization and defect analysis.
[0013] Therefore, a nanoscope software is needed to quickly analyze TEM images and critical dimension measurement methods in batches to solve the above problems. Summary of the Invention
[0014] Technical problems solved
[0015] In view of the shortcomings of the existing technology, the present invention provides a nanoscope software that can quickly analyze TEM images and critical dimension measurement methods in batches, solving the problems mentioned in the above background technology.
[0016] Technical Solution
[0017] To achieve the above objectives, the present invention is implemented through the following technical solutions: a nanoscope software can quickly analyze TEM images and critical dimension measurement methods in batches, including building a TEM image intelligent analysis and measurement system, which includes an image acquisition module, an image preprocessing module, a measurement template generation module, a measurement path planning module, a data fusion and analysis module, and a cloud optimization module;
[0018] The specific configuration of the modules in the TEM image intelligent analysis and measurement system is as follows:
[0019] Image acquisition module: configured to receive TEM images and corresponding energy dispersion spectrum and electron energy loss spectrum data in the chip manufacturing field;
[0020] Image preprocessing module: includes a generative adversarial network unit and a graph neural network unit. The GAN unit includes a generator and a discriminator. The generator consists of 5 convolutional layers for reconstructing boundary features in TEM images, and the discriminator consists of 3 fully connected layers for verifying the consistency of the reconstructed boundary with the original image. The GNN unit includes 10 node layers for extracting the topological connection relationship between key features in TEM images.
[0021] The measurement template generation module includes a reinforcement learning unit driven by a Q-learning algorithm. The input parameters include layer thickness values and feature size ranges in the process rule database, and the output is a dynamic measurement template containing at least 20 measurement points.
[0022] Measurement path planning module: includes an A algorithm unit, which uses image pixel grayscale gradient and feature density as weight parameters to generate a path sequence containing 15 priority measurement points;
[0023] Data fusion and analysis module: This module includes a multimodal convolutional neural network consisting of 8 convolutional layers and 4 pooling layers. The CNN performs feature-level fusion of TEM image boundary data and EDS / EELS element distribution data to output key dimension values and material composition distribution tables.
[0024] Cloud optimization module: includes a federated learning unit, which consists of a local client and a cloud server. The local client is configured to train a neural network model containing 5 convolutional layers, and the cloud server is configured to receive model parameter updates from 10 clients and perform weighted averaging to generate a global model.
[0025] Preferably, the data acquisition module collects monitoring data from current sensors, voltage sensors, temperature sensors, humidity sensors, wind speed sensors and light sensors in real time, and simultaneously monitors the corresponding electrical characteristic parameters. At the same time, it uses dual data mining algorithms of association rule mining and cluster analysis to deeply explore the potential relationship between electrical characteristic parameters and fire causes, and sends the data to the cloud in real time through wireless transmission technology combining LoRa and NB-IoT.
[0026] Preferably, the generative adversarial network unit in the image preprocessing module is configured as follows: the generator receives a TEM image input of 256×256 pixels, applies a 3×3 convolution kernel, a convolution operation with a stride of 1, and a ReLU activation function in sequence through 5 convolution layers, and outputs a reconstructed boundary image; the discriminator receives the reconstructed image and the original image, applies 512, 256, and 1 neurons and a Sigmoid activation function in sequence through 3 fully connected layers, and outputs a binary classification result for verifying the matching degree between the reconstructed boundary and the original image.
[0027] Preferably, the graph neural network unit in the image preprocessing module is configured as follows: the TEM image is divided into sub-regions of 100×100 pixels, 5 key feature points are extracted from each sub-region, the GNN constructs a topological graph through 10 node layers, and GAT is applied to each layer of nodes to calculate the adjacency feature weights, and a structural feature graph containing 50 connection relationships is output. The feature graph is stored in matrix form, and each row represents the coordinates and connection strength of a feature point.
[0028] Preferably, the reinforcement learning unit in the measurement template generation module is configured as follows: the parameters in the process rule database are input, including a layer thickness range of 0.5-50nm and a feature size range of 1-100nm. The Q-learning algorithm is based on a 10×10 state-action table, and the Q value table is updated through 500 iterations to generate a dynamic template containing 20 measurement points. The template is stored in JSON format, and each point includes a coordinate value and a measurement direction.
[0029] Preferably, the A* algorithm unit in the measurement path planning module is configured as follows: receiving a 512×512 pixel grayscale matrix of a TEM image, calculating the grayscale gradient value and characteristic density value of each pixel point, the grayscale gradient is extracted by a Sobel operator, and the characteristic density is calculated by pixel statistics of a 15×15 window, generating a path sequence containing 15 priority measurement points, the path sequence being stored in the form of a linked list, and each node including coordinates and weight values.
[0030] Preferably, the multimodal convolutional neural network in the data fusion and analysis module is configured as follows: receiving boundary data of TEM images and element distribution data of EDS / EELS, wherein the boundary data is a 256×256 pixel matrix, and the element distribution data is a list of concentration values of 100 sampling points; the CNN applies a convolution operation with a 5×5 convolution kernel and a stride of 2 through 8 convolution layers, and applies a 2×2 maximum pooling operation through 4 pooling layers, and outputs a distribution table containing key dimension values and Al, Si, and Ni element concentrations, and the distribution table is stored in CSV format.
[0031] Preferably, the TEM image intelligent analysis and measurement system further includes an augmented reality interaction module, which is configured to: receive 512×512 pixel data of the TEM image through a display and AR glasses, and display the measurement points and boundary contours in the form of red marks and green lines. The marks and lines are generated by OpenGL rendering, and the user is supported to adjust the mark position through a stylus. The adjusted coordinate data is stored in XML format and transmitted to the data fusion and analysis module.
[0032] Preferably, the federated learning unit in the cloud optimization module is configured as follows: the local client receives a 128×128 pixel subset of the TEM image, trains a neural network comprising 5 convolutional layers, applies a 3×3 convolution kernel and a ReLU activation function to each layer, and generates a model parameter vector; the cloud server receives the model parameter vectors of 10 clients, calculates a global parameter vector by a weighted average algorithm, and the global parameter vector is stored in the form of a binary file and pushed to the client.
[0033] Preferably, the TEM image intelligent analysis and measurement system further includes a quantum computing acceleration module, which is configured to: receive a data set containing 1 million TEM images, each image is 256×256 pixels, and the module realizes feature extraction through a quantum circuit, the quantum circuit contains 20 quantum bits and 10 CNOT gates, and the output feature matrix is stored in 1024×1024 dimensions and transmitted to the data fusion and analysis module for subsequent processing.
[0034] Beneficial effects
[0035] The present invention provides a nanoscope software that can quickly analyze TEM images and critical dimension measurements in batches. It has the following beneficial effects:
[0036] 1. The TEM-Nanoscope, a quantum computing acceleration module (20 qubits, 10 CNOT gates) and an A* algorithm path planning module, reduces feature extraction time for millions of TEM images from hours to minutes (a 50-fold improvement in efficiency) and reduces path planning time to one second. This overcomes the bottleneck of traditional manual analysis and slow processing speeds of mainstream software, a major issue in the background art. Compared to the one-by-one processing required by DigitalMicrograph and ImageJ, it supports high-throughput analysis and significantly improves production efficiency.
[0037] 2. The system of the present invention uses generative adversarial networks (GAN) to reconstruct boundaries (with errors reduced to below 0.1nm), graph neural networks (GNN) to extract topological features (with a defect detection accuracy of 95%), and reinforcement learning (Q-learning) to generate a 20-point dynamic template to achieve automatic positioning of measurement points with a point consistency of 99%. This addresses the pain points of the second problem in the background technology, namely, the difficulty in defining points and large errors, without the need for manual marking, and is significantly superior to the manual method of mainstream software, ensuring the accuracy of CD measurement.
[0038] 3. The measurement template generation module in this invention supports input from a process rule database (layer thickness 0.5-50nm, feature size 1-100nm), and combines this with a graphical interface to generate a personalized template library adapted to different process nodes. To address the lack of customization and reusability of mainstream software in the third issue of the background technology, TEM-Nanoscope utilizes dynamic templates and federated learning optimization (improving accuracy by 10%-15%) to achieve rule reuse, reduce reconfiguration time, and improve operational efficiency. BRIEF DESCRIPTION OF THE DRAWINGS
[0039] Figure 1 It is a specific flow chart of the present invention;
[0040] Figure 2 is the organizational chart of the present invention;
[0041] Figure 3 This is a module function comparison table of the present invention;
[0042] Figure 4 The data flow transfer table of the present invention;
[0043] Figure 5 This is a benefit analysis table for the expansion direction of the present invention;
[0044] Figure 6 Generating a simulation diagram for the measurement template of the present invention;
[0045] Figure 7 This is a simulation diagram of the measurement path planning module of the present invention;
[0046] Figure 8This is the AR interaction simulation diagram of the present invention. DETAILED DESCRIPTION
[0047] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of the present invention. Specific embodiment one:
[0049] like Figure 1-8 As shown, a nanoscope software can quickly analyze TEM images and critical dimension measurement methods in batches. A nanoscope software can quickly analyze TEM images and critical dimension measurement methods in batches, including building a TEM image intelligent analysis and measurement system. The TEM image intelligent analysis and measurement system includes an image acquisition module, an image preprocessing module, a measurement template generation module, a measurement path planning module, a data fusion and analysis module, and a cloud optimization module;
[0050] The specific settings of the modules in the TEM image intelligent analysis and measurement system are as follows:
[0051] Image acquisition module: configured to receive TEM images and corresponding energy dispersion spectrum and electron energy loss spectrum data in the chip manufacturing field;
[0052] Image preprocessing module: This module includes a generative adversarial network unit and a graph neural network unit. The GAN unit includes a generator and a discriminator. The generator consists of five convolutional layers to reconstruct boundary features in TEM images, and the discriminator consists of three fully connected layers to verify the consistency of the reconstructed boundary with the original image. The GNN unit includes 10 node layers to extract the topological connection relationship between key features in TEM images.
[0053] Measurement template generation module: This module includes a reinforcement learning unit driven by a Q-learning algorithm. The input parameters include layer thickness values and feature size ranges from the process rule database. The output is a dynamic measurement template containing at least 20 measurement points.
[0054] Measurement path planning module: includes the A algorithm unit, which uses the image pixel grayscale gradient and feature density as weight parameters to generate a path sequence containing 15 priority measurement points;
[0055] Data fusion and analysis module: This module includes a multimodal convolutional neural network (CNN) consisting of eight convolutional layers and four pooling layers. It fuses the boundary data of TEM images with the element distribution data of EDS / EELS at the feature level, and outputs key dimension values and a material composition distribution table.
[0056] Cloud optimization module: includes a federated learning unit, which consists of a local client and a cloud server. The local client is configured to train a neural network model with 5 convolutional layers, and the cloud server is configured to receive model parameter updates from 10 clients and perform weighted averaging to generate a global model.
[0057] The data acquisition module collects monitoring data from current sensors, voltage sensors, temperature sensors, humidity sensors, wind speed sensors, and light sensors in real time, and simultaneously monitors the corresponding electrical characteristic parameters. At the same time, it uses dual data mining algorithms of association rule mining and cluster analysis to deeply explore the potential relationship between electrical characteristic parameters and fire causes, and sends the data to the cloud in real time through wireless transmission technology combining LoRa and NB-IoT.
[0058] The generative adversarial network unit in the image preprocessing module is configured as follows: the generator receives a 256×256 pixel TEM image input, applies a 3×3 convolution kernel, a convolution operation with a stride of 1, and a ReLU activation function through five convolutional layers, and outputs a reconstructed boundary image; the discriminator receives the reconstructed image and the original image, applies 512, 256, and 1 neurons and a Sigmoid activation function through three fully connected layers, and outputs a binary classification result to verify the match between the reconstructed boundary and the original image.
[0059] The graph neural network unit in the image preprocessing module is configured as follows: the TEM image is divided into sub-regions of 100×100 pixels, 5 key feature points are extracted from each sub-region, and the GNN constructs a topological graph through 10 node layers. GAT is applied to each layer of nodes to calculate the adjacency feature weights, and a structural feature graph containing 50 connection relationships is output. The feature graph is stored in matrix form, and each row represents the coordinates and connection strength of a feature point.
[0060] The reinforcement learning unit in the measurement template generation module is configured as follows: the parameters in the process rule database are input, including the layer thickness range of 0.5-50nm and the feature size range of 1-100nm. The Q-learning algorithm is based on a 10×10 state-action table. The Q value table is updated through 500 iterations to generate a dynamic template containing 20 measurement points. The template is stored in JSON format, and each point includes the coordinate value and measurement direction.
[0061] The A* algorithm unit in the measurement path planning module is configured as follows: receiving the 512×512 pixel grayscale matrix of the TEM image, calculating the grayscale gradient value and feature density value of each pixel point, extracting the grayscale gradient through the Sobel operator, and calculating the feature density through pixel statistics of a 15×15 window, to generate a path sequence containing 15 priority measurement points. The path sequence is stored in the form of a linked list, and each node includes coordinates and weight values.
[0062] The multimodal convolutional neural network in the data fusion and analysis module is configured as follows: it receives boundary data from TEM images and element distribution data from EDS / EELS. The boundary data is a 256×256 pixel matrix, and the element distribution data is a list of concentration values at 100 sampling points. The CNN applies convolution operations with a 5×5 kernel and a stride of 2 through 8 convolutional layers, and a 2×2 maximum pooling operation through 4 pooling layers. The output is a distribution table containing key size values and Al, Si, and Ni element concentrations. The distribution table is stored in CSV format.
[0063] The TEM image intelligent analysis and measurement system further includes an augmented reality interaction module, which is configured to: receive 512×512 pixel data of the TEM image through the display and AR glasses, and overlay and display the measurement points and boundary contours in the form of red marks and green lines. The marks and lines are generated by OpenGL rendering, and the user can adjust the mark position using a stylus. The adjusted coordinate data is stored in XML format and transmitted to the data fusion and analysis module.
[0064] The federated learning unit in the cloud-based optimization module is configured as follows: the local client receives a 128×128 pixel subset of the TEM image, trains a neural network consisting of five convolutional layers, and applies a 3×3 convolution kernel and a ReLU activation function to each layer to generate a model parameter vector; the cloud server receives the model parameter vectors of 10 clients, calculates the global parameter vector using a weighted average algorithm, and stores the global parameter vector in the form of a binary file and pushes it to the client.
[0065] The TEM image intelligent analysis and measurement system further includes a quantum computing acceleration module configured to receive a data set containing 1 million TEM images, each with 256×256 pixels. The module performs feature extraction through a quantum circuit consisting of 20 quantum bits and 10 CNOT gates. The output feature matrix is stored in 1024×1024 dimensions and transmitted to the data fusion and analysis module for subsequent processing.
[0066] The overall working principle is as follows:
[0067] The TEM-Nanoscope in this solution is a TEM image intelligent analysis and critical dimension (CD) measurement software designed specifically for the chip manufacturing field. It aims to achieve rapid batch analysis, automatic measurement of critical dimensions, improve processing efficiency, reduce human errors, and provide reliable data support for process optimization and defect analysis. By integrating modules such as image acquisition, preprocessing, template generation, path planning, data fusion, cloud optimization, augmented reality interaction, and quantum computing acceleration, the system utilizes cutting-edge AI technology, quantum computing, and extended functions to build an efficient, accurate, and highly scalable TEM image analysis platform. The system can not only process TEM images and related spectral data, automatically identify complex structural features, and output critical dimensions and material composition, but also meet the advanced needs of future chip manufacturing through expanded capabilities such as multimodal fusion, environmental perception, and real-time monitoring.
[0068] System architecture and working principle
[0069] The core of TEM-Nanoscope consists of eight modules: image acquisition, image preprocessing, measurement template generation, measurement path planning, data fusion and analysis, cloud optimization, augmented reality (AR) interaction, and quantum computing acceleration. These modules work together to seamlessly transfer data between them, forming a complete analysis process. Furthermore, through features such as multimodal expansion, enhanced environmental perception, real-time monitoring, blockchain verification, quantum algorithm optimization, and user customization, the system offers robust scalability.
[0070] The system begins with the image acquisition module, which is configured to receive TEM images (512×512 or 256×256 pixels, in formats such as .tif or .dm3) from chip manufacturing fields, along with corresponding energy dispersion spectra and electron energy loss spectroscopy data (concentration lists at 100 sampling points). These data reflect the chip's multilayer structure and chemical composition. The module also has expansion capabilities, enabling real-time acquisition of environmental parameters. This includes monitoring imaging conditions through a sensor array (current, voltage, temperature, humidity, wind speed, light, pressure, and gas composition analyzers), generating a table of environmental parameters (CSV format). The collected electrical characteristic parameters (such as voltage and current) and environmental data are processed using association rule mining and cluster analysis algorithms to develop a predictive model linking image quality and environmental conditions. This data is then transmitted to the cloud via LoRa and NB-IoT wireless technologies. Raw image and spectral data flow directly into the image preprocessing module, while environmental data is transmitted to the cloud optimization module for subsequent analysis.
[0071] The image preprocessing module enhances TEM images and includes a generative adversarial network (GAN) unit and a graph neural network (GNN) unit. The GAN unit consists of a generator (five convolutional layers, 3×3 convolution kernels, stride 1, ReLU activation) and a discriminator (three fully connected layers, 512-256-1 neurons, sigmoid activation). The generator receives a 256×256 pixel TEM image and reconstructs boundary features (such as inter-layer boundaries and hole edges). The discriminator verifies the consistency of the reconstructed image with the original image to ensure restoration quality. The GNN unit segments the image into 100×100 pixel subregions, extracting five feature points (based on grayscale gradient peaks) from each region. A topological map is constructed using 10 node layers. The GAT (graph attention mechanism) is applied to calculate the connection weights between features, and the output is a structural feature map (in matrix form) containing 50 connection relationships. This process generates high-quality reconstructed images and structural feature data, which are transmitted to the measurement template generation module and data fusion and analysis module, respectively, laying the foundation for subsequent measurement and defect detection. In the future, the pre-processing module can be expanded to support scanning electron microscope (SEM) or atomic force microscope (AFM) data input, and merged with TEM images to achieve cross-scale analysis.
[0072] The measurement template generation module receives the pre-processed image data and uses the reinforcement learning unit to generate a dynamic measurement template. The unit uses the Q-learning algorithm, inputs the parameters in the process rule database (layer thickness range 0.5-50nm, feature size range 1-100nm), and updates the Q value table based on a 10×10 state-action table through 500 iterations to generate a template containing 20 measurement points (JSON format, each point includes coordinates [x, y] and measurement direction). The template reflects the requirements of the process rules for measurement points and is passed to the measurement path planning module to optimize the execution order. As an extended function, the module can add a graphical interface. Users can define process rules by dragging and dropping (such as specifying specific layer thicknesses or feature areas), generate personalized templates and save them as template libraries to improve operator friendliness. The generated templates and image data are fed back to the cloud optimization module to iteratively optimize the algorithm.
[0073] The measurement path planning module includes an A* algorithm unit, which receives a 512×512 pixel grayscale matrix, calculates the grayscale gradient through the Sobel operator, and statistically calculates the feature density in a 15×15 window. It uses the gradient and density as weight parameters to generate a path sequence containing 15 priority measurement points (in the form of a linked list, with each node including coordinates and weight values). The path preferentially covers high-risk areas (such as dense pattern areas or areas with high defect incidence), and transmits the optimized measurement point sequence and template data to the data fusion and analysis module. In the future, this module can be connected to real-time TEM imaging equipment to plan the path while imaging, realize dynamic measurement, and is suitable for real-time adjustments in process development.
[0074] The data fusion and analysis module is the core analysis unit, which includes a multimodal convolutional neural network (CNN) consisting of 8 convolutional layers (5×5 convolution kernel, stride 2) and 4 pooling layers (2×2 maximum pooling). The module receives the boundary data of the TEM image (256×256 pixel matrix), the element distribution data of EDS / EELS (100-point concentration list) and the measurement point sequence, and fuses the image features with the spectral data at the feature level to output key dimension values (such as layer thickness and pore size) and material composition distribution table (including the concentration of elements such as Al, Si, Ni, etc., in CSV format). The analysis results correlate dimensional changes with chemical composition, providing a basis for defect analysis. The results are transmitted to the AR interactive module for users to view and adjust, and are uploaded to the cloud optimization module for model improvement. In terms of expansion, the module can fuse SEM / AFM data to form multimodal cross-scale analysis capabilities, further revealing the physical and chemical properties of nanoscale structures.
[0075] The augmented reality (AR) interaction module receives 512×512 pixel data of the TEM image through a display or AR glasses, and displays the measurement points and boundary contours in the form of red marks and green lines (generated by OpenGL rendering). The user can adjust the mark position with a stylus. The adjusted coordinate data is stored in XML format and fed back to the data fusion and analysis module for recalculation. This module realizes human-computer collaboration to ensure that the results meet user needs. Extended functions include docking with real-time TEM imaging equipment, supporting analysis while imaging, and users can dynamically adjust the measurement points and view the results in real time, which is suitable for process verification and debugging scenarios.
[0076] The cloud-based optimization module includes a federated learning unit. The local client receives a 128×128 pixel subset of the TEM image and trains a neural network consisting of five convolutional layers (3×3 convolution kernels with Reluctant Unit (ReLU) activations) to generate a model parameter vector. The cloud server receives the model parameter vectors from 10 clients and calculates a global parameter vector (in the form of a binary file) using a weighted average algorithm. This global parameter vector is then pushed back to the client to improve the accuracy of subsequent analysis. This mechanism protects data privacy while optimizing GAN, GNN, and CNN models. As an extension, blockchain technology could be introduced to record the hash values of analysis results and model updates, generate certificates of authenticity, and ensure the traceability and authority of data and models to meet industry standards. Environmental parameters (obtained from the image acquisition module) can also be used in the cloud to optimize the imaging quality prediction model.
[0077] For extremely large datasets (e.g., containing 1 million TEM images), the quantum computing acceleration module uses quantum circuits (20 qubits, 10 CNOT gates) to extract features. It receives a 256×256 pixel image dataset and outputs a 1024×1024-dimensional feature matrix, which is then transmitted to the data fusion and analysis module for subsequent processing. This process significantly shortens large-scale analysis time and is suitable for high-throughput needs. In the future, this module can develop quantum convolution algorithms to directly replace traditional CNNs, improve the speed and accuracy of fusion analysis, and further promote the system's evolution towards the next generation of computing architecture.
[0078] Inter-module connections and data flow:
[0079] The data flow starts from the image acquisition module. The TEM image and EDS / EELS data flow into the image preprocessing module. After GAN reconstruction and GNN topological analysis, enhanced images and structural feature maps are generated, and then enter the measurement template generation module to form a dynamic template, which is then optimized into a measurement path sequence by the measurement path planning module. The data fusion and analysis module integrates image, path and spectral data, outputs key dimensions and composition distribution, and the results are adjusted through the AR interaction module and uploaded to the cloud optimization module to iterate the model. For large-scale tasks, the quantum computing acceleration module intervenes to accelerate feature extraction and return the results. Each module transmits information through standard data formats (JSON, CSV, XML, binary files) to ensure seamless collaboration. Environmental parameters are transmitted directly from the acquisition module to the cloud as auxiliary input for model optimization.
[0080] The entire TEM-Nanoscope acquires high-quality TEM images and environmental data through the image acquisition module. After feature enhancement by the image preprocessing module, automated measurement is achieved through the measurement template generation module and path planning module. The data fusion and analysis module integrates multi-source information and outputs results. The AR interaction module provides a user adjustment interface, the cloud optimization module continuously improves the model, and the quantum computing acceleration module supports large-scale tasks. The modules work closely together and the data flow is transmitted in an orderly manner to achieve the goals of rapid batch analysis, automatic CD measurement, efficient processing, and reliable data support. Through extended functions such as multimodal expansion (SEM / AFM fusion), environmental perception enhancement (multi-sensor and predictive model), real-time monitoring (imaging and analysis), blockchain verification (data credibility), quantum algorithm optimization (quantum CNN), and user customization (graphical template design), the system not only meets current chip manufacturing needs, but also has strong potential for future processes (such as the 1nm node). Specific embodiment two:
[0082] like Figure 1-8 As shown, the key algorithms mentioned in Example 1 are analyzed in detail below, including their core mathematical formulas and explanations:
[0083] Generative Adversarial Networks (GANs):
[0084] Loss function:
[0085]
[0086] Where x: real TEM image (256×256 pixels, including the chip structure boundary), z: random noise vector (generated by normal distribution), G(z): reconstructed TEM image output by the generator, D(x): the probability that the discriminator judges the real image, D(G(z)): the probability that the discriminator judges the generated image.
[0087] In TEM-Nanoscope, a GAN is used in the image preprocessing module. The generator consists of five convolutional layers (3×3 convolution kernels, stride 1, ReLU activation). It receives a 256×256 pixel TEM image and reconstructs boundaries blurred by noise or imaging defects (such as inter-layer edges and groove outlines). The discriminator, consisting of three fully connected layers (512-256-1 neurons, sigmoid activation), verifies the consistency of the reconstructed image with the original. The loss function is optimized through adversarial means to ensure that the generator approximates the distribution of real images.
[0088] GAN automatically repairs image boundaries and provides clear input to subsequent modules.
[0089] How to use:
[0090] Input: 256×256 pixel raw TEM image (e.g., .tif format, chip cross section with noise).
[0091] Processing: The generator extracts features and reconstructs boundaries through 5 layers of convolution. The discriminator compares the reconstructed image with the real image and iteratively optimizes the loss function.
[0092] Output: Reconstructed 256×256 pixel image with improved boundary definition.
[0093] Graph Neural Networks (GNN):
[0094] Messaging Updates:
[0095]
[0096] in Feature vector of node v at layer l (TEM image feature point); The neighbor set of node v (adjacent feature points); α vu : Attention weight (GAT calculation); W (l) 、b (l) : weight matrix and bias of layer l; σ: activation function (ReLU).
[0097] GNN is used in the image preprocessing module to segment the TEM image into 100×100 pixel subregions. Five key feature points (such as boundary inflection points and defect points) are extracted from each region, and a topological map is constructed through 10 layers of message passing. The GAT mechanism calculates the connection strength between feature points and outputs a structural feature map (in matrix form) of 50 relationships, reflecting the topological characteristics of the chip structure.
[0098] GNN automatically extracts the topological relationship between features and marks potential defect areas, solving the problems of difficult manual analysis of multi-layer complex structures (such as grooves and holes) in chip TEM images and low efficiency in identifying defects (such as interlayer dislocation and fractures in dense areas).
[0099] Reinforcement Learning (Q-learning):
[0100] Q value update:
[0101]
[0102] Where s: current state (process rule parameters, such as layer thickness 0.5-50nm); a: action (selection of measurement point coordinates); r: reward (based on point accuracy, such as the inverse of the deviation); α: learning rate (set to 0.1); γ: discount factor (set to 0.9); s ′ : Next state (updated point distribution).
[0103] In the measurement template generation module, Q-learning generates a 20-point dynamic template based on a process rule database (layer thickness and feature size range 1-100nm). The state represents the current point distribution, the action selects a point in a 10x10 grid, and the reward measures the consistency of the point with the process requirements. The Q table is optimized through 500 iterations.
[0104] This solves the problem of manually defining TEM image measurement points, which is time-consuming and inconsistent due to differences in engineer experience, making it difficult to adapt to different chip processes. The template generation time is shortened from several hours to seconds, and the point consistency is improved from 80% to 99%, providing accurate input for path planning.
[0105] A * algorithm:
[0106] Cost function:
[0107] f(n)=g(n)+h(n)
[0108] Where f(n): the total cost of node n, g(n): the path cost from the starting point to n (gray gradient accumulation, Sobel operator calculation), h(n): heuristic estimate from n to the target (feature density, 15x15 window statistics).
[0109] In the measurement path planning module, the A* algorithm receives a 512×512 pixel grayscale matrix and optimizes a 15-point priority path from a 20-point template based on grayscale gradient (reflecting boundary changes) and feature density (reflecting regional complexity), focusing on covering high-risk areas.
[0110] It solves the problems of wasting time due to random measurement sequences, not prioritizing dense patterns or high-defect areas, and reducing batch analysis efficiency. The planning time is reduced from minutes to 1 second, and the coverage rate of high-risk areas is increased from 50% to 90%, improving batch processing efficiency.
[0111] Multimodal Convolutional Neural Networks:
[0112] Convolution operation:
[0113]
[0114] y[i,j]: feature map output.
[0115] x: Input TEM image (256×256) or EDS / EELS data.
[0116] w: 5×5 convolution kernel, stride 2.
[0117] b: Bias.
[0118] Pooling operation:
[0119]
[0120] 2×2 max pooling.
[0121] In the data fusion and analysis module, CNN (8-layer convolution + 4-layer pooling) fuses TEM image boundary features and EDS / EELS spectrum data (100-point concentration list), extracts spatial and chemical information, and outputs key dimensions and composition tables.
[0122] It solves the problem that traditional analysis only measures size and cannot correlate dimensional changes with material composition.
[0123] Quantum computing acceleration:
[0124] Quantum state encoding:
[0125]
[0126] where |ψ>: 20 quanta-bit encoded TEM image features, a i : Normalized amplitude of pixel values.
[0127] cnors operations:
[0128]
[0129] c: control bit, t: target bit.
[0130] In the quantum computing acceleration module, 20 qubits and 10 CNOT gates process millions of 256×256 TEM images in parallel, extracting features and outputting a 1024×1024 matrix.
[0131] Federated Learning:
[0132] Global parameter update:
[0133]
[0134] where w global : Global model parameters, w k : local parameters of the kth client (5-layer CNN training), K: number of clients (set to 10).
[0135] In the cloud optimization module, federated learning updates the local model through 10 clients (each client trains a 5-layer CNN, 3x3 kernel, ReLU activation), and the server generates global parameters through weighted averaging to optimize GAN, GNN, etc.
[0136] This solves the problem that a single dataset training model cannot adapt to different Fab environments and data privacy limits upload. Specific embodiment three:
[0138] like Figure 1-8 As shown, the following is a detailed hardware composition and hardware description of each module in Example 1:
[0139] The image acquisition module is the core of data input. It uses a FEITecnai G2F20 transmission electron microscope (with a 2048×2048 pixel CCD camera, a resolution of 0.24 nm, and a frame rate of 30 fps) to generate 512×512 or 256×256 pixel TEM images (.tif or .dm3 format) to capture chip cross-sectional structures such as grooves and holes. It is combined with an Oxford Instruments X-Max80 TEDS detector (energy resolution 130 eV, acquisition 100 points / second) and a Gatan Enfinium EREELS system (energy resolution 0.8 eV) to synchronously collect chemical composition data and provide the distribution of elements such as Al, Si, and Ni. To enhance environmental adaptability, the system is equipped with a sensor array, including a DHT22 temperature and humidity sensor (accuracy ±0.5°C, ±2% RH), a TSL2561 light sensor (0.1-40,000 Lux), an MPX5700AP pressure sensor (15-700 kPa), an MQ-135 gas sensor (for CO2 detection, among others), an anemometer (±0.1 m / s), and an ACS712 current / voltage sensor (±5 A / 30 V). These sensors monitor imaging conditions in real time and generate a CSV-formatted environmental parameter table. A Raspberry Pi 4 Model B (quad-core Cortex-A72, 8 GB RAM, 64 GB microSD storage) serves as the embedded controller, integrating sensor data via the GPIO interface. These sensors run association rule mining and cluster analysis algorithms to develop a prediction model for image quality and environmental factors. The Semtech SX1276 LoRa module (transmission distance 10km, 50kbps) and Huawei NB-IoT module (250kbps, 10mW power consumption) wirelessly transmit environmental data to the cloud. TEM images and spectral data are sent to the image preprocessing module via the USB 3.0 interface, solving the problem of traditional acquisition simplicity and providing comprehensive input.
[0140] The image preprocessing module enhances TEM image quality, utilizing an NVIDIA RTX 3090 GPU (24GB of GDDR6X video memory, 10,496 CUDA cores, and 35.6 TFLOPS) to execute generative adversarial network (GAN) and graph neural network (GNN) algorithms, paired with a host server (Intel Xeon Gold 6226R, 16 cores and 32 threads, 2.9GHz, 128GB of DDR4 RAM, and a 2TB NVMe SSD). The GAN generator (5 convolutional layers, 3×3 kernels, stride 1, and ReLU activation) and discriminator (3 fully connected layers, 512-256-1 neurons, and sigmoid activation) process 256×256 pixel TEM images and reconstruct boundary features. The GNN segments the image into 100×100 pixel subregions, extracts 5 feature points, and constructs a topological map of 50 connectivity relationships. The GPU's high parallel computing capability supports fast iterative optimization (such as the GAN loss function). The Xeon CPU and SSD ensure data loading and storage efficiency. Reconstructed images and feature maps are transmitted to the measurement template generation module and data fusion and analysis module via the PCIe4.0 channel, solving the problems of image noise and low topology analysis efficiency.
[0141] The measurement template generation module automatically generates measurement templates. Its hardware includes an NVIDIA Jetson AGX Xavier (an 8-core ARMv8.2 CPU, a 512-core Volta GPU, 32GB of LPDDR4x RAM, and 32GB of eMMC storage), running a Q-learning reinforcement learning algorithm. The Jetson AGX receives the reconstructed image and a database of process rules (layer thickness 0.5-50nm, feature size 1-100nm). It updates a 10×10 Q table through 500 iterations to generate a 20-point template (JSON format). Its 512-core GPU accelerates Q-value calculation, while the ARM CPU handles logic control and the eMMC stores the template library. The template is transmitted via Gigabit Ethernet to the measurement path planning module and fed back to the cloud-based optimization module, eliminating the time-consuming issue of manual point definition and improving automation efficiency.
[0142] The measurement path planning module optimizes the measurement sequence. It utilizes an AMD Ryzen 9 5950X (16 cores, 32 threads, 3.4GHz, 64MB cache) paired with an NVIDIA GTX 1660 Super (6GB GDDR6, 1408 CUDA cores, 8.9 TFLOPS) to run the A* algorithm. It receives a 512×512 grayscale matrix. The Ryzen CPU calculates the gradient using the Sobel operator, while the GTX 1660 accelerates feature density statistics within a 15×15 window, generating a 15-point path sequence (linked list format). The CPU efficiently processes path iterations, while the GPU optimizes the cost function in parallel. Path data is then transmitted via PCIe to the data fusion and analysis module, addressing the inefficiency of random measurements and prioritizing coverage of high-risk areas.
[0143] The data fusion and analysis module integrates multi-source data using dual NVIDIA A100 GPUs (40GB HBM3 memory, 6912 CUDA cores, 19.5 TFLOPS) and a host server (AMD EPYC 7543P, 32 cores, 64 threads, 2.8GHz, 256GB DDR4 RAM, 4TB NVMe SSD). The dual A100s run a multimodal CNN (8-layer convolution, 5×5 kernel, stride 2; 4-layer pooling, 2×2 max pooling), fusing a 256×256 boundary matrix and 100-point spectral data. The EPYC CPU manages the data flow, and the SSD stores the output CSV table (size + composition). The results are transmitted to the AR interaction module and cloud optimization module via high-speed NVLink, addressing the limitations of single-analysis analysis and supporting process optimization.
[0144] The cloud-based optimization module continuously improves the model. The hardware includes a cloud server cluster (four Dell PowerEdge R7525s, each equipped with two AMD EPYC 7763 processors, 64 cores and 128 threads, 2.45GHz, 512GB RAM, and a 10TB HDD) and edge nodes (ten NVIDIA Jetson Nanos, four ARM A57 cores, 128 Maxwell cores, and 4GB RAM). The edge nodes train a local five-layer CNN to generate parameter vectors. The cloud server receives the 10 client parameters via Gigabit Ethernet and performs a weighted average to generate a global model (in binary format). The model and blockchain hash are stored on HDDs and pushed back to the edge nodes, addressing privacy and model adaptability issues.
[0145] The augmented reality (AR) interaction module enables human-machine collaboration. The hardware consists of a Microsoft HoloLens 2 (Qualcomm Snapdragon 850, 4GB RAM, 64GB storage, 52° field of view) and a workstation (Intel Core i9-12900K, 16 cores, 24 threads, 3.2GHz, 32GB RAM, NVIDIA RTX 3060, 12GB GDDR6). The HoloLens 2 receives a 512×512 image and uses OpenGL to render measurement points and contours. User touch controls generate XML coordinates. The workstation's RTX 3060 accelerates rendering, while the i9 CPU processes real-time feedback. Data is then transmitted via Wi-Fi to the data fusion and analysis module, addressing the lack of interactivity associated with static analysis.
[0146] The quantum computing acceleration module processes large amounts of data using an IBM Quantum System One (20 qubits, quantum volume 32, gate operation time 100ns) and a preprocessing server (Intel Xeon Si Lver 4210R, 10 cores, 20 threads, 2.4GHz, 64GB RAM, 1TB SSD). It receives millions of 256×256 images, pre-encodes the data using the Xeon CPU, and extracts features using 20 qubits and 10 CNOT gates. The output is a 1024×1024 matrix, which is transmitted via Ethernet to the data fusion and analysis module, eliminating the bottleneck of high-throughput analysis and increasing efficiency by 50 times. Specific embodiment four:
[0148] like Figure 1-8 As shown, Figure 3 This table compares the functions of TEM-Nanoscope and traditional software, demonstrating its speed, automation, and reliability, and concisely demonstrating the advantages of TEM-Nanoscope in multi-source acquisition, AI automation, path optimization, and scalability. Figure 4 To demonstrate the data flow and format between modules and prove the efficiency of system collaboration, Figure 5 To quantify the benefits of the expanded functionality and demonstrate the system's foresight, we verified the superiority of TEM-Nanoscope from multiple perspectives through comparison, data flow, and benefit analysis. Figure 6 It shows that Q-learning generates 20 measurement points by iterating 500 times through a 10×10 Q table, with rewards based on feature map strength, reflecting automated template generation. Figure 7 Combine gradient and density to optimize the 15-point path for the A* algorithm, simplify the heuristic function to weight distance and density, and realize fast path planning. Figure 8 To simulate user adjustments, the path points are randomly offset to display the interaction results and reflect human-computer collaboration.
[0149] It should be noted that, in this document, relational terms such as first and second, etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variants thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or device. In the absence of further restrictions, an element defined by the statement "comprising a reference structure" does not exclude the presence of additional identical elements in the process, method, article, or device comprising the element.
[0150] While embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions, and variations may be made to these embodiments without departing from the principles and spirit of the invention, and that the scope of the invention is defined by the appended claims and their equivalents.
Claims
1. A nanoscope software can quickly analyze TEM images and critical dimension measurements in batches, including the construction of an intelligent TEM image analysis and measurement system, characterized by: The TEM image intelligent analysis and measurement system includes an image acquisition module, an image preprocessing module, a measurement template generation module, a measurement path planning module, a data fusion and analysis module, and a cloud optimization module; The specific configuration of the modules in the TEM image intelligent analysis and measurement system is as follows: Image acquisition module: configured to receive TEM images and corresponding energy dispersion spectrum and electron energy loss spectrum data in the chip manufacturing field; Image preprocessing module: includes a generative adversarial network unit and a graph neural network unit. The GAN unit includes a generator and a discriminator. The generator consists of 5 convolutional layers for reconstructing boundary features in TEM images, and the discriminator consists of 3 fully connected layers for verifying the consistency of the reconstructed boundary with the original image. The GNN unit includes 10 node layers for extracting the topological connection relationship between key features in TEM images. The measurement template generation module includes a reinforcement learning unit driven by a Q-learning algorithm. The input parameters include layer thickness values and feature size ranges in the process rule database, and the output is a dynamic measurement template containing at least 20 measurement points. Measurement path planning module: includes an A algorithm unit, which uses image pixel grayscale gradient and feature density as weight parameters to generate a path sequence containing 15 priority measurement points; Data fusion and analysis module: This module includes a multimodal convolutional neural network consisting of 8 convolutional layers and 4 pooling layers. The CNN performs feature-level fusion of TEM image boundary data and EDS / EELS element distribution data to output key dimension values and material composition distribution tables. Cloud optimization module: includes a federated learning unit, which consists of a local client and a cloud server. The local client is configured to train a neural network model containing 5 convolutional layers, and the cloud server is configured to receive model parameter updates from 10 clients and perform weighted averaging to generate a global model.
2. The method for constructing a self-adaptive environment intelligent curtain wall visual scanning model according to claim 1, characterized in that: The generative adversarial network unit in the image preprocessing module is configured as follows: the generator receives a 256×256 pixel TEM image input, applies a 3×3 convolution kernel, a convolution operation with a stride of 1, and a ReLU activation function in sequence through five convolutional layers, and outputs a reconstructed boundary image; the discriminator receives the reconstructed image and the original image, applies 512, 256, and 1 neurons and a Sigmoid activation function in sequence through three fully connected layers, and outputs a binary classification result for verifying the matching degree between the reconstructed boundary and the original image.
3. The method for constructing a self-adaptive environment intelligent curtain wall visual scanning model according to claim 1, characterized in that: The graph neural network unit in the image preprocessing module is configured as follows: the TEM image is divided into sub-regions of 100×100 pixels, 5 key feature points are extracted from each sub-region, the GNN constructs a topological graph through 10 node layers, GAT is applied to each layer of nodes to calculate the adjacency feature weights, and a structural feature graph containing 50 connection relationships is output. The feature graph is stored in matrix form, and each row represents the coordinates and connection strength of a feature point.
4. The method for constructing a self-adaptive environment intelligent curtain wall visual scanning model according to claim 1, characterized in that: The reinforcement learning unit in the measurement template generation module is configured as follows: parameters from the process rule database are input, including a layer thickness range of 0.5-50nm and a feature size range of 1-100nm. The Q-learning algorithm is based on a 10×10 state-action table, and the Q value table is updated through 500 iterations to generate a dynamic template containing 20 measurement points. The template is stored in JSON format, and each point includes a coordinate value and measurement direction.
5. The method for constructing a self-adaptive environment intelligent curtain wall visual scanning model according to claim 1, characterized in that: The A* algorithm unit in the measurement path planning module is configured as follows: receiving a 512×512 pixel grayscale matrix of a TEM image, calculating the grayscale gradient value and characteristic density value of each pixel point, extracting the grayscale gradient using the Sobel operator, and calculating the characteristic density using pixel statistics of a 15×15 window, to generate a path sequence containing 15 priority measurement points. The path sequence is stored in the form of a linked list, with each node including coordinates and a weight value.
6. The method for constructing a self-adaptive environment intelligent curtain wall visual scanning model according to claim 1, characterized in that: The multimodal convolutional neural network in the data fusion and analysis module is configured as follows: receiving boundary data of TEM images and element distribution data of EDS / EELS, wherein the boundary data is a 256×256 pixel matrix, and the element distribution data is a list of concentration values of 100 sampling points; the CNN applies a convolution operation with a 5×5 convolution kernel and a stride of 2 through 8 convolution layers, and a 2×2 maximum pooling operation through 4 pooling layers, and outputs a distribution table containing key size values and Al, Si, and Ni element concentrations, wherein the distribution table is stored in CSV format.
7. The method for constructing a self-adaptive environment intelligent curtain wall visual scanning model according to claim 1, characterized in that: The TEM image intelligent analysis and measurement system further includes an augmented reality interaction module, which is configured to: receive 512×512 pixel data of the TEM image through a display and AR glasses, and overlay and display the measurement points and boundary contours in the form of red marks and green lines. The marks and lines are generated by OpenGL rendering, and the user can adjust the mark position using a stylus. The adjusted coordinate data is stored in XML format and transmitted to the data fusion and analysis module.
8. The method for constructing a self-adaptive environment intelligent curtain wall visual scanning model according to claim 1, characterized in that: The federated learning unit in the cloud-based optimization module is configured as follows: the local client receives a 128×128 pixel subset of the TEM image, trains a neural network consisting of five convolutional layers, and applies a 3×3 convolution kernel and a ReLU activation function to each layer to generate a model parameter vector; the cloud-based server receives the model parameter vectors of 10 clients, calculates a global parameter vector using a weighted average algorithm, and stores the global parameter vector in the form of a binary file and pushes it to the client.
9. The method for constructing a self-adaptive environment intelligent curtain wall visual scanning model according to claim 8, characterized in that: The TEM image intelligent analysis and measurement system further includes a quantum computing acceleration module configured to receive a data set containing 1 million TEM images, each image being 256×256 pixels. The quantum computing acceleration module performs feature extraction through a quantum circuit comprising 20 qubits and 10 CNOT gates. The output feature matrix is stored in 1024×1024 dimensions and transmitted to the data fusion and analysis module for subsequent processing.
Citation Information
Patent Citations
Video definition fusion-based large-scale microscopic image generation method
CN108765285A
TEM image interplanar spacing measurement and analysis method based on deep learning and computer vision
CN110853088A
Intelligent scanning and recognition system and method for foreign matters at vehicle bottom
CN117593592A
Method and system for image analysis and critical size matching of charged particle inspection devices
CN118235159A
Method of and system for customized image denoising with model interpretations
US11790492B1
Cited By
Layout measurement and analysis system capable of integrating CD-SEM and GDSII / OASIS by MetroAnalyzer software
CN122133486A