How to Examine a Sample Using a Charged Particle Microscope
The method enhances charged particle microscopy by assigning different hues in the HSV color space to represent sample phases, allowing real-time image representation and improving data processing efficiency in sample analysis.
Patent Information
- Application Number
- JP2020124149
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2019-08-01
- Filing Date
- 2020-07-21
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2040-07-21
AI Technical Summary
Charged particle microscopy methods, such as SEM and EDS, are time-consuming and resource-intensive due to the need for extensive post-processing to combine topological and spectral data, limiting the speed and accuracy of sample analysis.
A method using a charged particle microscope that detects multiple types of radiation (e.g., secondary electrons and X-rays) and assigns different hues in the HSV color space to represent various phases of a sample, enabling real-time image representation with spectral information.
Facilitates rapid and accurate sample analysis by providing a real-time color image representation with phase information, enhancing data processing efficiency and reducing the need for extensive post-processing.
Smart Images

Figure 0007592955000001 
Figure 0007592955000002 
Figure 0007592955000003
Abstract
Description
[Technical field]
[0001] explanation The present invention relates to a method of inspecting a sample using a charged particle microscope, comprising the steps of detecting a first type of radiation from the sample using a first detector in response to a charged particle beam scanned across an area of the sample, and using spectral information of the first type of detected radiation to inspect the sample. [Background technology]
[0002] Charged particle microscopy is a well-known and increasingly important technique for imaging microscopic objects, especially in the form of electron microscopes. So far, the basic type of electron microscope has evolved into several well-known instruments, such as transmission electron microscopes (TEM), scanning electron microscopes (SEM) and scanning transmission electron microscopes (STEM), and also into various auxiliary instruments, such as so-called "dual beam" instruments (e.g., FIB-SEM), which further employ a "machining" focused ion beam (FIB) to allow auxiliary actions, such as ion beam milling or ion beam induced deposition (IBID). Those skilled in the art will be familiar with the different types of charged particle microscopes.
[0003] Irradiation of a sample with a scanning electron beam stimulates the emission of "auxiliary" radiation from the sample in the form of secondary electrons, backscattered electrons, X-rays, and cathodoluminescence (infrared, visible, and / or ultraviolet photons). One or more components of this emitted radiation can be detected and used for sample analysis.
[0004] Typically in an SEM, backscattered electrons are detected by a solid-state detector, and each backscattered electron is amplified to create many electron-hole pairs in the semiconductor detector. The backscattered electron detector signal is used to form an image as the beam is scanned, and the brightness of each image point is determined by the number of backscattered electrons detected at the corresponding point on the sample as the primary beam moves across the sample. The image only provides information about the topology of the sample being inspected.
[0005] In a process called "energy dispersive X-ray analysis" or "EDS", the energy of incoming X-rays from a sample in response to an electron beam is measured and plotted in a histogram to form a material-specific spectrum. The measured spectrum can be compared to known spectra of various elements to determine which elements and minerals are present in the sample.
[0006] One drawback of EDS is that it takes a significant amount of time to accumulate an X-ray spectrum of a sample. Typically, a grid with discrete analysis points is used. The electron beam dwells at each analysis point while the EDS detector records the X-rays. Once a sufficient number of X-ray counts have been recorded, the beam moves to the next analysis point. The signal from the EDS detector is fed to a signal processing unit which constructs an X-ray spectral curve for each analysis point, which can then be queried against an extensive library of known mineral phases to select the best match for that analysis point.
[0007] It is known to use extensive post-processing analysis to combine both the EDS and SEM data into a single image of the sample under inspection, which can be resource intensive, and therefore time consuming, before it is completed and presented to the user.
[0008] With this in mind, it is an object of the present invention to provide an improved method for inspecting a sample using a charged particle microscope, where spectral information of detected radiation is used to inspect said sample. In particular, it is an object of the present invention to provide a method and apparatus for more quickly and / or more accurately obtaining information about a sample and for providing said information to a user.
[0009] To this end, the present invention provides a method of inspecting a sample using a charged particle microscope, as defined in claim 1. The method includes the steps of providing a charged particle beam, as well as a sample, and scanning the charged particle beam across the sample. The method includes detecting a first type of radiation from the sample using a first detector in response to the beam scanned across the sample. The method further includes using spectral information of the detected first type of radiation to assign a plurality of mutually distinct phases to the sample. Here, as defined herein, the method includes associating a corresponding plurality of different hues to the plurality of mutually distinct phases with reference to an HSV color space. This means that different hues (e.g., green, red, orange, blue) are assigned to different phases (e.g., elements, chemicals, minerals, etc.). The HSV color space is a color space that describes attributes of a particular color using hue (often referred to as "color", e.g., red, green, blue), saturation (often referred to as the intensity or purity of a color), and color value (often referred to as the lightness or darkness of a color). The HSV color space can be represented as a cylinder, with its angular dimension, hue, starting with the red primary at 0°, passing through the green primary at 120° and the blue primary at 240°, before wrapping back around to red at 360°. The central vertical axis contains the neutral, achromatic, or gray colors, ranging from black at the bottom, with a value of 0, to white at the top, with a value of 1. With increasing radius, the saturation of the color increases.
[0010] In principle, any color can be described in the HSV color space, regardless of the actual color space used. Thus, the methods described herein are not limited to the use of any particular color space, but can also be applied to the RGB color space (as all RGB colors can also be described with reference to the HSV color space), or any other color space as the situation requires. Summary of the Invention
[0011] As defined herein, the method further includes detecting a second type of radiation from the sample in response to the beam scanned across the sample using a second detector.
[0012] According to the method, a control unit is used to provide an image representation of the sample, the second type of radiation being used, the image representation including the associated different hues for also representing the plurality of different phases. The control unit is arranged to analyze the first type of radiation and to combine the results of the analysis with the second type of radiation to provide an image representation of the sample. In particular, the control unit may be arranged to provide an image representation in real time, for example while a charged particle beam is scanning across the sample. By using the control unit, it is possible to provide a real time color image representation of the sample to a user, the color image including phase information encoded in the different hues. The image representation can be a single image, but the use of multiple images, or a data table including image representations, etc. is also conceivable. The image representation also includes different values and / or different saturations.
[0013] The second type of radiation may be, for example, secondary electrons and / or backscattered electrons. In an embodiment, the radiation of the second type is used to code different values in the image representation. In other words, the SEM is used to obtain a greyscale image of the sample under inspection, and color is preferably used on that image, in the image representation, to code spectral data related to the first type of radiation, preferably related to EDS. In an embodiment, the first type of radiation is used to code different saturations in the image representation. In this way, an image representation of the sample including meaningful data coded in HSV color space may be provided to a user, substantially in real time.
[0014] Thus, the objectives as defined herein are achieved.Embodiments of the method will now be described in more detail.
[0015] In one embodiment, the method includes providing a spectral data stack and storing the detected radiation of the first type and / or spectral information of the detected radiation of the first type in the spectral data stack. The spectral data stack is used as a data structure that allows for efficient creation, storage and maintenance of raw input data related to a first type of radiation. The spectral data stack can then be used to assign multiple mutually distinct phases to the sample using the spectral information of the detected first type of radiation. The spectral data stack can be used to organize the raw input data in a hierarchical manner, thereby enabling efficient computational processing of the raw input data by a control unit.
[0016] In one embodiment, the method includes providing a chemical composition data stack and storing the plurality of mutually distinct phases in the chemical composition data stack. The spectral data stack may include raw input data, and the chemical composition data stack may include analyzed data of the spectral data stack, including associated phases (i.e., chemical compositions). Thus, the spectral data stack is processed and analyzed, and the results are stored in a new data stack (a chemical composition data stack in this embodiment). This allows for efficient storage and manipulation of data, and also keeps the raw input data in an organized structure, e.g., for later use.
[0017] In one embodiment, the method includes providing a color data stack and storing the plurality of different hues in the color data stack. In this embodiment, additional data stacks may be provided (e.g., next to the spectral data stack and / or the chemical composition data stack). This allows for efficient storage and manipulation of data, with intermediate results readily available.
[0018] In one embodiment, at least one of the plurality of data stack layers comprises a number of pixels, each pixel being associated with a portion of the sample. As mentioned in the introduction, a pixel may be associated with an analysis point of a grid. A pixel may also be associated with a resolution obtainable with a charged particle microscope.
[0019] In one embodiment, at least one of the data stacks (e.g., a spectral data stack, a chemical composition data stack, and / or a color data stack) includes multiple data stack layers. A first data stack layer may include data for each pixel (i.e., substantially each pixel includes one associated data entry).
[0020] It is conceivable that the number of pixels may vary substantially from one data stack layer to another. Thus, the data stack layer may further comprise so-called superpixel-based data, each superpixel comprising a plurality of grouped pixels. In this way, two or more pixels are grouped into one superpixel, and each superpixel in effect comprises one data element associated with that superpixel. It is conceivable that further data stack layers may be used that comprise larger superpixels (i.e., more grouped pixels compared to the superpixels of the previous data stack layer). In practice, this allows a certain granularity to be increased and / or decreased with increasing / decreasing data stack layers. This allows for fast and efficient data processing and analysis, since data may be collected and stored on a very large superpixel basis, and with increasing input data, the granularity may be increased until the actual pixel size is obtained.
[0021] In one embodiment, the number of layers and pixels in the spectral data stack, the chemical composition stack, and the color data stack are identical, which allows for easy comparison of the various data stacks and data analysis.
[0022] In one embodiment, the method includes providing a mixed stack by flattening the color data stack and using the mixed stack in providing the image representation. Flattening may include manipulation of one or more data stack layers of the color data stack, if present, to provide a single layer color data stack. Flattening may include assigning weights to different layers and / or different pixels, whereby these layers and / or pixels contribute color with unequal intensity. Additionally, layer-dependent blurring may be used to achieve visually pleasing effects.
[0023] In one embodiment, the method includes combining the mixed stack with the second type of detected radiation to provide the image representation. The single layer color data stack can be combined with the second type of radiation (i.e. a black and white image) to provide an image representation including different hues (in HSV color space) to represent mutually distinct phases having an HSV color space.
[0024] In one embodiment, the first detector includes an EDS detector.
[0025] In one embodiment, the second detector comprises an electronic detector, such as a BSE detector.
[0026] According to one aspect there is provided a charged particle microscope for examining a sample using the method defined herein, said charged particle microscope comprising: an optical column for focusing a beam of charged particles emitted from the charged particle source onto a sample, the optical column including a charged particle source, a final probe forming lens, and a scanner; a sample stage positioned downstream of the final probe forming lens and arranged to hold the sample; and a first detector for detecting a first type of radiation arising from the sample in response to the incidence of charged particles emitted from the charged particle source; a second detector for detecting a second type of radiation arising from the sample in response to the incidence of charged particles emitted from the charged particle source; a control unit and a processing device connected to the first detector; The charged particle microscope is arranged to carry out the methods defined herein.
[0027] The invention will now be explained in more detail on the basis of exemplary embodiments and the accompanying schematic drawings. [Brief description of the drawings]
[0028] [Figure 1]1 shows a longitudinal section of a charged particle microscope according to a first embodiment of the invention; [Diagram 2] 2 shows a longitudinal section of a charged particle microscope according to a second embodiment of the invention; [Diagram 3] This shows a representation of the HSV color space. [Figure 4] 1 illustrates an embodiment of a data stack that may be used in the methods as disclosed herein. [Diagram 5] 1 illustrates an embodiment of a method as disclosed herein. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0029] FIG. 1 (not to scale) is a highly schematic illustration of an embodiment of a charged particle microscope M according to an embodiment of the present invention. More specifically, an embodiment of a transmission microscope M is shown, which in this case is a TEM / STEM (although in the context of the present invention it can usefully be an SEM (see FIG. 2) or, for example, an ion-based microscope). In FIG. 1, within a vacuum enclosure 2, an electron source 4 generates an electron beam B propagating along an electron-optical axis B′ and traversing an electron optical illuminator 6, which serves to direct / focus the electrons onto a selected portion of a sample S (e.g., to be (locally) thinned / flattened). A deflector 8 is also shown, which can be used to (among other things) effect a scanning movement of the beam B.
[0030] The sample S is held in a sample holder H that can be positioned in multiple degrees of freedom by a positioning device / stage A, which moves a cradle A' to which the holder H is (removably) fixed; for example, the sample holder H can be equipped with fingers that can move (among other things) in the XY plane (see the Cartesian coordinate system shown; typically, movements parallel to Z and tilts relative to X / Y are also possible). Such movements allow different parts of the sample S to be illuminated / imaged / inspected by the electron beam B traveling along an axis B' (in Z direction) (and / or allow a scanning movement to be performed, as an alternative to beam scanning). If desired, an optional cooling device (not depicted) can be in intimate thermal contact with the sample holder H to maintain the sample holder H (and the sample S thereon) at, for example, a cryogenic temperature.
[0031] The electron beam B interacts with the sample S in such a way as to cause it to emit various types of "stimulated" radiation, including (for example) secondary electrons, backscattered electrons, X-rays, and light radiation (cathodoluminescence). If desired, one or more of these types of radiation can be detected with the aid of an analyzer 22, for example a combination scintillator / photomultiplier tube or an EDX or EDS (energy dispersive X-ray spectroscopy) module, in which case an image can be constructed using essentially the same principles as in an SEM. However, alternatively or supplementarily, one can study the electrons that traverse (pass) the sample S, are emitted / emitted from the sample, and continue to propagate (substantially, but generally, deflected / scattered to some extent) along the axis B'. Such a transmitted electron bundle is incident on an imaging system (projection lens) 24, which typically comprises various electrostatic / magnetic lenses, deflectors, correctors (such as stigmators), etc. In normal (non-scanning) TEM mode, this imaging system 24 can focus the transmitted electron beam onto a phosphor screen 26, which can be retracted / withdrawn, if desired, so as to move it out of axis B' (as shown diagrammatically by arrow 26'). An image (or Fourier transform diagram) of (a part of) the sample S is formed on the screen 26 by the imaging system 24, which image can be viewed through a viewing port 28 located in a suitable part of the wall of the housing 2. The retraction mechanism of the screen 26 can be, for example, mechanical and / or electrical in nature, but is not depicted in the drawings.
[0032] As an alternative to viewing an image on screen 26, one can instead take advantage of the fact that the focal depth of the electron beam leaving imaging system 24 is typically quite deep (e.g., about one meter). As a result, various other types of analytical devices can be used downstream of screen 26, such as: -TEM camera 30. At the position of camera 30 the electron beam can form a still image (or Fourier transform diagram) which can be processed by controller / processor 20 and displayed on a display device (not shown), such as a flat panel display. When not required, camera 30 can be retracted / retracted (as shown diagrammatically by arrow 30') to move the camera off axis B'. - STEM camera 32. The output from camera 32 can be recorded as a function of the (X,Y) scanning position of beam B on sample S, and an image can be constructed that is a "map" of the output from camera 32 as a function of X,Y. Camera 32 can include a single pixel, e.g., with a diameter of 20 mm, as opposed to the matrix of pixels that is characteristically present in camera 30. Furthermore, camera 32 generally has a much higher acquisition rate (e.g., 106 points / sec) than camera 30 (e.g., 102 images / sec). Again, when not required, camera 32 can be retracted / withdrawn (as shown diagrammatically by arrow 32') to move the camera off axis B' (such retraction is not required, for example, in the case of a doughnut-shaped annular dark field camera 32, where a central hole allows the passage of flux when the camera is not in use). As an alternative to imaging using the cameras 30 or 32, a spectroscopic device 34 can also be invoked, which can be, for example, an EELS module.
[0033] It should be noted that the order / position of components 30, 32, and 34 is not strict and many possible variations are possible. For example, spectroscopic device 34 could be integrated with imaging system 24.
[0034] In the embodiment shown, the microscope M further comprises a retractable X-ray computed tomography (CT) module, generally indicated at 40. In computed tomography (also referred to as tomographic imaging), a source and a detector (at opposite poles) are used to interrogate the specimen along different lines of sight to obtain transmitted views of the specimen from various viewpoints.
[0035] It should be noted that a controller (computer processor) 20 is connected to the various components shown via control lines (bus) 20'. This controller 20 may provide various functions such as synchronizing operations, providing set points, processing signals, making calculations, and displaying messages / information on a display device (not shown). Of course, the controller 20 (schematically depicted) may be located (partially) inside or outside the housing 2 and may have a unitary or composite structure, as desired.
[0036] Those skilled in the art will understand that the interior of the enclosure 2 does not have to be kept in an airtight vacuum. For example, in so-called "environmental TEM / STEM", a background atmosphere of a given gas is intentionally introduced / maintained in the enclosure 2. Those skilled in the art will also understand that in practice it may be advantageous to confine the volume of the enclosure 2, possibly so that the enclosure 2 essentially envelops the axis B', and that the employed electron beam passes through and expands in the form of a small diameter tube (e.g., about 1 cm in diameter) to house structures such as the source 4, the sample holder H, the screen 26, the camera 30, the camera 32, the spectrometer 34, etc.
[0037] Thus, a charged particle microscope M according to the invention, an embodiment of which is shown in Fig. 1, comprises a charged particle source 4, a final probe-forming lens 6 and a scanner 8, and comprises an optical column O for focusing a beam B of charged particles emitted from said charged particle source 4 onto a sample. The device further comprises a sample stage A, H, positioned downstream of said final probe-forming lens 6 and arranged to hold said sample S. The device further comprises a first detector 22 for detecting a first type of radiation arising from said sample in response to the incidence of the charged particles B emitted from said charged particle source 4. The device further comprises a second detector 24 for detecting a second type of radiation arising from said sample in response to the incidence of the charged particles emitted from said charged particle source. In the embodiment shown, the first detector 22 is an analysis device 22, which may be a combined scintillator / photomultiplier or EDS (Energy Dispersive X-ray Spectroscopy) module, as described above. In a preferred embodiment, said first detector is an EDS. Furthermore, the device according to the invention comprises a control device 20 connected (by a line 20') to said first detector 22 (shown diagrammatically). According to the invention, said charged particle microscope M is arranged to carry out the method according to the invention, which is described below with reference to FIG.
[0038] Reference is now first made to Figure 2, which shows another embodiment of the apparatus according to the invention. Figure 2 (not to scale) is a very schematic representation of a charged particle microscope M according to the invention, and more specifically shows an embodiment of a non-transmission microscope M, in this case an SEM (although in the context of the invention, for example, an ion-based microscope may be equally useful). In the figure, parts corresponding to those in Figure 1 are indicated using the same reference numbers and are not described separately here. The following parts (among others) are added to Figure 1: -2a: a vacuum port that can be opened to introduce / remove parts (components, samples) into / from the interior of the vacuum chamber 2 or onto which, for example, auxiliary devices / modules can be mounted. The microscope M can be equipped with multiple such ports 2a if desired. - 10a, 10b: lenses / optical elements within the illuminator 6 shown diagrammatically. -12: A voltage source that allows the sample holder H or at least the sample S to be biased (floated) to a certain potential with respect to ground, if desired. -14: Display such as FPD or CRT. 22a, 22b: a segmented electron detector 22a, comprising a number of independent detection segments (e.g. quadrants) arranged around a central aperture 22b (allowing the passage of the beam B). Such a detector can be used, for example, to investigate the (angular dependence of) the output (secondary or backscattered) electron flux emanating from the sample S. -22: EDS or EDX detector.
[0039] Thus, the charged particle microscope M shown in Fig. 2 comprises an optical column O, including a charged particle source 4, final probe-forming lenses 6, 10a, 10b and a scanner 8, for focusing a beam B of charged particles emitted from said charged particle source 4 onto a sample S. The device further comprises a sample stage A, H, positioned downstream of said final probe-forming lens 6 and arranged to hold said sample S. The device further comprises a first detector 22 for detecting a first type of radiation arising from said sample in response to the incidence of the beam B of charged particles emitted from said charged particle source 4. In the embodiment shown, the first detector 22 is said analysis device 22, which may be a combined scintillator / photomultiplier or EDS (Energy Dispersive X-ray Spectroscopy) module, as described above. The device comprises a second detector 22a, 22b for detecting a second type of radiation. Furthermore, the device according to the invention comprises said control device 20 which is connected (by a line 20') to said first detector 22 and to said second detector 22a, 22b.
[0040] The apparatus shown in Figures 1 and 2 may be used to test a sample using the method according to the invention. In general, the embodiments of the method all include the following general steps: Providing a charged particle beam and a sample; scanning the charged particle beam across the sample; detecting a first type of radiation from the sample using a first detector in response to the beam being scanned across the sample; assigning a plurality of mutually distinct phases to the sample using spectral information of the detected first type of radiation; referring to an HSV color space to associate a corresponding plurality of distinct hues with said plurality of mutually distinct hues; detecting a second type of radiation from the sample in response to the beam scanned across the sample using a second detector; and providing, by a control unit, an image representation of the sample, wherein the second type of radiation is used and the image representation includes the associated different hues to represent the plurality of different phases.
[0041] The above mentioned method steps are explained in more detail below.
[0042] FIG. 3 shows an example of an HSV color space 101 used in the method defined herein. The HSV color space 101 is a color space that describes the attributes of a particular color using hue (often referred to as "color", e.g., red, green, blue), saturation (often referred to as the intensity or purity of the color), and color value (often referred to as the lightness or darkness of the color). The HSV color space can be represented in a cylindrical shape, with its angular dimension, hue, starting with the red primary at 0°, passing through the green primary at 120° and the blue primary at 240°, before wrapping back to red at 360°, as shown in FIG. 3. The central vertical axis includes neutral, achromatic, or gray colors ranging from black with a value of 0 (bottom of FIG. 3) to white with a value of 1 (top of FIG. 3). The saturation of the color increases with increasing radius, i.e., from the center outward. The details of the HSV color space are per se known to those skilled in the art of color spaces.
[0043] FIG. 4 illustrates an embodiment of a method as disclosed herein, which generally includes: -120: Scanning a charged particle beam across a sample to collect data and acquiring a first type of radiation using a first detector; -121: processing the detected radiation of the first type, in particular using spectral information of the detected radiation of the first type to assign a plurality of mutually distinct phases to the sample; 122 and 123: associating a corresponding plurality of different hues with said plurality of mutually different hues, with reference to the HSV color space; -124: detecting a second type of radiation from the sample in response to the beam scanned across the sample using a second detector; -125: Providing, by a control unit, an image representation 311 of the sample, wherein the second type of radiation 302 is used, and the image representation 311 includes the associated different hues to represent the plurality of different phases.
[0044] In fact, the method uses data collection 120, 124, data analysis 121, color determination 122 and mixing 123, and color fusion 125 to provide a sample image representation 311 in HSV color space. The image can be shown to a user 201, who can modify several settings 203, 205 to fine-tune the final result. Figure 4 shows multiple data stacks 501-504 that are used for efficient data storage and provide effective and rapid data processing of the acquired data so that substantially real-time analysis is possible.
[0045] Fig. 4 will now be described in more detail. In multimodal colour electron microscopy, the central idea is to encode multimodal information about a sample by colours 301 superimposed on a conventional greyscale electron image 302. The method according to the present embodiment comprises data acquisition 120, 124, spectral processing 121, colouring 122, mixing 123 and fusion 125, allowing efficient generation of a colour image 311 from a stream of raw input data 120, 124, such as X-ray photon detection events in EDS (Energy Dispersive Spectroscopy).
[0046] In particular, the following are exemplary steps of a method according to the present embodiment, which may be performed sequentially or in parallel, and synchronously or asynchronously.
[0047] In the data collection step 120, 124, a data structure 501 called "data cube" or "data stack" DS is created and maintained. The main task of the data stack DS is to keep the raw input data 120, preferably in a hierarchical structure, thereby allowing efficient computational processing. Such a hierarchical data cube may consist of several data layers 601-603 (see FIG. 5), each layer consisting of 601-603 sub-areas 611-613 called super-pixels. In the right-hand illustration of FIG. 5, the super-pixels 613 are relatively large, in the left-hand illustration of FIG. 5, the super-pixels 611 are relatively small. In the case of relatively sparse spectral data, the large super-pixels 611 can be associated with a data entry, and as the granularity increases, the smaller pixels 611 can be filled with associated data. In this way, the super-pixels can be combined and composited across the layers 601-603.
[0048] For purposes of the present embodiment shown in Figure 4, each superpixel contains a set of collected spectral data in either a raw format (e.g., a list of EDS events) or in a more efficient and compact data structure (compact format, e.g., an energy histogram). To optimize performance and memory requirements for data processing, these representations may be alternated (i.e., alternating between raw and compact formats).
[0049] In a second step 121, the raw data collected in the data cube 501 is processed and analyzed. Although the data cube 501 can be expanded, in the embodiment shown, a new data cube 502 is created and updated. In this embodiment, the new data cube 502 contains the same super-pixel structure per layer and is called a chemical composition stack CCS. The super-pixels of the CCS contain the analysis results corresponding to the collected raw data DS, obtained by using a spectral processing library (e.g., chemical quantification). Furthermore, the data analysis results may be augmented with data quality metrics (also called "confidence metrics") that represent the certainty of the results. Global predictors may be used based on spectral clustering or other data processing algorithms that may dramatically improve the analysis results.
[0050] In a third step 122, the analyzed data 502 is used as input to a color decision algorithm, in which a data quality metric can be used. The result is a color stack CS, in this case a new data cube 503. Alternatively, an extended data cube may be used. In a color stack CS, pixels (or super pixels) have an associated color, in particular an associated hue, to represent the phase.
[0051] In a fourth step 123, the hierarchical color structure (color stack CS) needs to be blended with a flat color map that can later be used for fusion. Colors from multiple layers 601-603 are combined to generate a single-layer color data stack 504 (blended stack BS). This blending can be based on (a) the confidence metric formula above, and / or (b) a confidence formula for the shape of the super-pixel (e.g., the larger the super-pixel, the more likely it is to miss fine details). In one embodiment, step (a) can be represented primarily by modifying the color, particularly its transparency, saturation, hue, or other properties, and step (b) can be represented primarily by applying blur-like operators to the projection of the super-pixel shape. A preferred embodiment of (b) includes a simple kernel-based blur and anisotropic diffusion operator.
[0052] The data quality metrics mentioned above can be used to flatten the color stack CS, which improves the speed and quality of the final result.
[0053] The pixels used may be normal (square) pixels or SLIC (Simple Linear Iterative Clustering) pixels such as SLIC0 pixels. Graph algorithms can be used for pixel merging that proceed from the finest layer 601 to the coarsest layer 603 and maintain some properties of the pixels 611-613 that are desirable for good visual appearance. In other cases that focus on the quality of the image itself, parallelization can be used in these algorithms (to speed up the analysis).
[0054] In the fifth and final step 125, the flat color map (mixed stack BS) is fused with the grayscale image obtained in the data acquisition step 124. 2D or 3D geometric transformations can be applied to the color map to allow for multi-modal, multi-viewpoint alignment of the map and the image. The fusion is preferably proposed by using operations in the HSV color domain, although other domains such as RGB and / or RGBA are also conceivable. The result is a color image 311, which can be shown 401 to the user 201.
[0055] A user 201 may, for example, determine some settings 203 regarding the spectral processing 121. A user 201 may determine some settings 205 regarding color schemes that may be used in the coloring step 122. Additional settings and controls for the user 201 are also contemplated.
[0056] Furthermore, the blending step 123 is relatively specific when multi-layer data stacks 501-503 are used. It is contemplated that the blending step 123 may be omitted if a different data structure DS is used. On the other hand, the use of such a data structure DS allows for effective and efficient data processing, and thus provides a color image substantially in real time.
[0057] The method has been described above with reference to one or more embodiments. The desired protection is determined by the appended claims.
Claims
1. 1. A method of examining a sample using a charged particle microscope, comprising: providing a charged particle beam and a sample; scanning the charged particle beam across the sample; detecting a first type of radiation from the sample using a first detector in response to the charged particle beam scanned across the sample; assigning a plurality of mutually distinct phases to the sample using spectral information of the detected first type of radiation; associating a corresponding plurality of different hues with said plurality of mutually different phases with reference to an HSV color space; detecting a second type of radiation from the sample in response to the charged particle beam scanned across the sample using a second detector; providing, by a control unit, an image representation of the sample, wherein the second type of radiation is used, the image representation including the associated different hues for representing the plurality of different phases; The method includes providing a spectral data stack and storing the detected radiation of the first type and / or spectral information of the detected radiation of the first type in the spectral data stack; the spectral data stack includes a plurality of data stack layers; At least one of the plurality of data stack layers includes a number of pixels, each pixel associated with a portion of the samples; The number of pixels varies for each of the data stack layers. method.
2. 1. A method of examining a sample using a charged particle microscope, comprising: providing a charged particle beam and a sample; scanning the charged particle beam across the sample; detecting a first type of radiation from the sample using a first detector in response to the charged particle beam scanned across the sample; assigning a plurality of mutually distinct phases to the sample using spectral information of the detected first type of radiation; associating a corresponding plurality of different hues with said plurality of mutually different phases with reference to an HSV color space; detecting a second type of radiation from the sample in response to the charged particle beam scanned across the sample using a second detector; providing, by a control unit, an image representation of the sample, wherein the second type of radiation is used, the image representation including the associated different hues for representing the plurality of different phases; The method includes providing a chemical composition data stack and storing the plurality of distinct phases in a second data stack; the chemical composition data stack includes a plurality of data stack layers; At least one of the plurality of data stack layers includes a number of pixels, each pixel associated with a portion of the samples; The number of pixels varies for each of the data stack layers. method.
3. 1. A method of examining a sample using a charged particle microscope, comprising: providing a charged particle beam and a sample; scanning the charged particle beam across the sample; detecting a first type of radiation from the sample using a first detector in response to the charged particle beam scanned across the sample; assigning a plurality of mutually distinct phases to the sample using spectral information of the detected first type of radiation; associating a corresponding plurality of different hues with said plurality of mutually different phases with reference to an HSV color space; detecting a second type of radiation from the sample in response to the charged particle beam scanned across the sample using a second detector; providing, by a control unit, an image representation of the sample, wherein the second type of radiation is used, the image representation including the associated different hues for representing the plurality of different phases; The method includes providing a color data stack and storing the plurality of different hues in the color data stack; the color data stack includes a plurality of data stack layers; At least one of the plurality of data stack layers includes a number of pixels, each pixel associated with a portion of the samples; The number of pixels varies for each of the data stack layers. method.
4. 4. The method of claim 2 or 3, wherein the method comprises the step of providing a spectral data stack and storing the detected radiation of the first type and / or spectral information of the detected radiation of the first type in the spectral data stack.
5. The method of claim 1 or 3, wherein the method includes providing a chemical composition data stack and storing the plurality of distinct phases in a second data stack.
6. The method of claim 1 or 2, wherein the method includes the step of providing a color data stack and storing the plurality of different hues in the color data stack.
7. 6. A method according to claim 3, 6 or claim 4 or 5 when dependent on claim 3, comprising the steps of flattening the color data stack to provide a mixed stack and using the mixed stack in providing the image representation, the flattening comprising combining colors from multiple data layers to generate the mixed stack.
8. The method of claim 7 , further comprising combining the mixed stack with the detected radiation of the second type to provide the image representation.
9. The method of any one of claims 1 to 8, wherein the first detector comprises an EDS detector.
10. The method of any preceding claim, wherein the second detector comprises an electron detector, such as a BSE detector.
11. Charged particle microscope for examining a sample using the method according to any one of claims 1 to 10, comprising: an optical column for focusing the beam of charged particles emitted from the charged particle source onto a sample, the optical column including a charged particle source, a final probe-forming lens, and a scanner; a sample stage positioned downstream of the final probe-forming lens and arranged to hold the sample; a first detector for detecting a first type of radiation arising from the sample in response to the incidence of charged particles emitted from the charged particle source; a second detector for detecting a second type of radiation arising from the sample in response to the incidence of charged particles emitted from the charged particle source; a control unit and a processing device connected to the first detector; Charged particle microscope, wherein the charged particle microscope is arranged to carry out the method according to any one of claims 1 to 10.
Citation Information
Patent Citations
Scanning-type electron microscope device for semiconductor observation
JP1988141250A
Apparatus and method for display of visual image of x-ray response of test object
JP1994265490A
Material identification using multiple images
JP2014506996A
Blend Modes for Mineralogy Images
US20150262400A1
Improved navigation for electron microscopy
WO2019016559A1
