Method and system for optical three-dimensional shape measurement

By moving relative to the object and the objective lens and using patterned illumination, combining bevel movement and focal plane contrast change, the problem of insufficient resolution and repeatability of the three-dimensional morphology measurement method in the prior art in semiconductor device inspection is solved. It realizes low-cost and efficient three-dimensional morphological measurements, suitable for a variety of surface types.

CN113607088BActive Publication Date: 2024-12-03KLA CORP
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202110901243.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2016-02-01
Filing Date
2016-11-04
Publication Date
2024-12-03
Estimated Expiration
2036-11-04

AI Technical Summary

Technical Problem

When the existing three-dimensional morphology measurement methods meet the requirements of low cost and high resolution, it is difficult to expand the processing volume, and there are problems such as high equipment cost and high data rate, especially in the inspection of semiconductor devices, which is difficult to achieve sufficient in-plane resolution. rate and repeatability.

Method used

By moving relative to the object and the objective lens, using patterned illumination to project and record the image of the surface, combining bevel movement and focal plane contrast change, surface height information is derived, and structured illumination is generated using pattern masks or gratings to reduce space Optical modulator reliance to achieve compact and low-cost optical setup.

Benefits of technology

High resolution and repeatability measurements in the vertical direction are achieved, reducing equipment costs and improving processing volume expansion, and are suitable for a variety of surface types, including significant specular and diffuse reflective surfaces.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113607088B_ABST
    Figure CN113607088B_ABST
Patent Text Reader

Abstract

Embodiments of the present application relate to a method and system for optical three-dimensional shape measurement. For the three-dimensional shape measurement of the surface of an object, patterned illumination is projected onto the surface through an object lens. Relative movement is performed between the object and the object lens, and a plurality of images of the surface are recorded by a detector through the object lens. The direction of the relative movement includes an oblique angle relative to the optical axis of the object lens. Height information of a given position on the surface is derived based on the change in intensity recorded from the corresponding position. In addition, patterned illumination and uniform illumination can be alternately projected onto the surface, while the image of the surface is recorded during the relative movement of the object and the object lens along the optical axis of the object lens. Uniform illumination is used to obtain height information of the mirror structure on the surface, and patterned illumination is used to obtain height information of other parts of the surface.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application is a divisional application of the invention patent application with the application date of November 4, 2016, application number "201680080685.2", and invention name "Method and system for optical three-dimensional shape measurement".

[0002] CROSS REFERENCE TO RELATED APPLICATIONS

[0003] This application claims priority to U.S. Provisional Application No. 62 / 289,889, filed on February 1, 2016, the entire contents of which are incorporated herein by reference. Technical Field

[0004] The present invention relates to a method and a system for three-dimensional (3D) topography measurement of a surface of an object, wherein patterned illumination is projected onto the surface of the object through an objective lens and height information about the surface is obtained from images of the surface recorded during relative movement between the object and the objective lens. Background Art

[0005] Information about the topography of an object's surface is needed in various manufacturing fields. An area where the need for such information is particularly significant is semiconductor manufacturing, where semiconductor devices need to be inspected to ensure proper function. Such inspections include the specific structures that make up the device on the wafer, as well as the entities required to hold the components of the device together, such as solder bumps. For example, a bare die cut from a wafer may first be contacted to the pins of the chip using an array of solder bumps. The chip may then be contacted to external circuitry via solder balls. For quality assurance, the height of the solder bumps and solder balls relative to the substrate must be inspected before soldering is completed.

[0006] Several methods for 3D topography measurement are well known in the art. These methods include white light interferometry, confocal microscopy, methods based on structured illumination, and laser triangulation with stereo vision. All of these methods have their specific advantages and disadvantages.

[0007] White light interferometry is able to provide height information with extremely high accuracy. The surface is moved in the interferometer in steps smaller than one wavelength; therefore, when inspecting semiconductor devices, a large number of frames of the surface need to be taken and processed, since the step size must extend over a range comparable to the height variations occurring on the surface.

[0008] Both confocal microscopy and structured illumination-based methods require fairly standard microscope optics. Both methods are well suited for examining surface topography at the scale of typical semiconductor devices. While confocal microscopy generally provides better height resolution than structured illumination-based methods, it also requires a more complex and expensive optical setup.

[0009] The basic concept of structured illumination based methods is to project a pattern (eg, a grating) onto the surface of an object. There are two general approaches.

[0010] For imaging systems with low numerical aperture (NA) (e.g., below 0.1), for which longer working distances and larger depths of focus are possible, the pattern can be projected onto the surface at an angle relative to the imaging optical axis. Such an arrangement is similar to laser triangulation, in that the surface height is extracted using a phase shift of the fringes of line illumination rather than a position shift. This method is also known as a phase-shifted fringe projection method.

[0011] In case of imaging systems with higher NA (above 0.1), oblique projection or oblique imaging cannot be easily implemented due to the limited depth of focus and working distance. Here, instead, a pattern (e.g. a grating) is projected onto the surface by an imaging optics, and the optical axis of the imaging optics is perpendicular to the surface of the object, more precisely to the plane defined by the general macroscopic extension of the surface. Due to this arrangement, height information cannot be extracted from the fringe phase shift. Instead, height information can be obtained by moving the object in a direction parallel to the optical axis and finding the position shift along this direction where the contrast of the projected pattern is maximal.

[0012] This setup has similarities to confocal microscopy, but the optics are simpler and no relay optics are required. However, a higher data rate is required because extracting the contrast of the pattern image requires three or more frames for each height position.

[0013] An example of such a method for structured illumination perpendicular to a surface can be found in US Pat. No. 8,649,024 B2 issued on application Ser. No. 13 / 309,244. A pattern is generated by a spatial light modulator (SLM) and projected onto the surface of an object along the optical axis of an imaging objective. The object is moved relative to the objective along the optical axis while the SLM modulates the projected pattern and records multiple images. The maximum contrast of the projected pattern at a specific location on the surface yields height information for the corresponding location.

[0014] Which of the methods for 3D topography measurement mentioned above is best depends on the requirements of the specific measurement application. For semiconductor device inspection, some key requirements are: a resolution of several μm in a plane defined by the macroscopic extension of the surface, a repeatability of less than 1 μm for positioning the object in a direction perpendicular to this plane, and a total range of several hundred μm for movement in this vertical direction. In view of this situation, a method based on structured illumination seems to be most suitable for semiconductor device inspection by 3D topography measurement. The configuration of the relevant system can cover a wide range of both resolution in the surface plane and repeatability perpendicular to the plane, and the method achieves a large range of relative movement along the vertical direction. The optics are relatively simple and low-cost, and the settings for illumination and imaging along the vertical direction are suitable for a variety of surface types, including both surfaces with significant specular reflection and surfaces with significant diffuse reflection. In particular, relative to the inspection of solder bumps, a larger NA produces a larger number of available pixels at the top of the spherical bump of a smaller bump.

[0015] While the basic concept of structured illumination outlined above and exemplified in the cited patent US 8,649,024 B2 achieves the desired precision and accuracy, an unresolved issue is how to achieve these desired characteristics while meeting increasing throughput requirements at preferably low cost (and furthermore in a scalable manner.) For example, the spatial light modulators used in the cited patent US 8,649,024 B2 to generate patterned illumination are expensive and do not have the resolution and pixel count to cover a large field of view, which would be necessary for higher throughput. Summary of the invention

[0016] An object of the present invention is to provide a method for three-dimensional topography measurement of a surface of an object, which is easy to implement, provides sufficient in-plane resolution and repeatability along the vertical direction, and is scalable.

[0017] A further object of the present invention is to provide a system for three-dimensional topography measurement of a surface of an object which is of simple configuration, provides sufficient in-plane resolution and repeatability along the vertical direction, and is modular and compact, thereby being expandable.

[0018] The objective of the method is achieved by the method according to Technical Solution 1 or Technical Solution 11.

[0019] The objective regarding the system is achieved by a system according to technical solution 23 or technical solution 33.

[0020] In the method according to the invention for optical three-dimensional topography of a surface of an object, patterned illumination is projected onto the surface of the object by an objective lens. A relative movement is performed between the object and the objective lens. The direction of this relative movement comprises an oblique angle relative to the optical axis of the objective lens. During the relative movement, the surface of the object passes through the focal plane of the objective lens; the optical axis of the objective lens is perpendicular to the focal plane. During the relative movement, a plurality of images of the surface are recorded by the objective lens. The pattern of the patterned illumination is at the best focus of the focal plane of the objective lens; in a plane parallel to the focal plane but offset from the focal plane along the optical axis, the pattern is out of focus. In the image of the surface, those parts of the surface that are in the focal plane appear in the best focus in the image; parts of the surface that are not in the focal plane appear out of focus. The pattern on the surface that is in the best focus (also imaged at the best focus) has a high contrast, while the pattern on the surface that is out of focus (also imaged out of focus) has a reduced contrast in the recorded image of the surface. This dependence of the contrast on the position of the portions of the surface along the optical axis results in a variation of the intensity recorded from these portions of the surface of the object during the relative movement. Height information of the respective positions on the surface of the object is derived from the variation of the intensity recorded from the respective positions in the plurality of images.

[0021] The height of a position on the surface refers to the distance of the position from the reference plane along a direction perpendicular to the reference plane. Typically, the reference plane is defined by the macroscopic extension of the surface; for example, a manufactured wafer carries a plurality of microstructures on its surface, however, macroscopically, this surface behaves as a planar surface and thus defines a plane. When performing the method, if the object is correctly aligned, the reference plane is parallel to the focal plane of the objective lens. The height of all positions on the surface gives the topography of the surface. Due to the oblique angle between the relative movement direction of the objective lens and the optical axis, the position of the pattern of the patterned illumination relative to the surface of the object changes during the relative movement. This obviates the need to modulate the pattern individually (which is necessary in prior art methods of structured or patterned illumination) and thus renders the method easier to implement. The relative movement between the object and the objective lens causes a modulation of the light intensity irradiated on any particular position on the surface to be measured during the relative movement. In one aspect, as just discussed above, this modulation is due to the relative movement between the pattern of the projected illumination and the surface, but importantly, this modulation contains an additional contribution due to the change in contrast of the pattern at a particular position when the object moves relative to the objective. This in turn results in a modulation of the light intensity recorded from the corresponding position in the plurality of images. The height of each corresponding position is derived from this modulation of the recorded light intensity. The corresponding position of the object along the optical axis (e.g., expressed as a position on the optical axis where the reference plane intersects the optical axis where each of the plurality of images has been recorded separately) is the information used in the analysis to derive the height information.

[0022] In an advantageous embodiment particularly suitable for computer-driven performance of the method and data analysis performed by a computer, each of the plurality of images is recorded as a digital image, in other words as an array of pixels. Each of the images processed by digital image processing is offset so that a given position on the surface of the object corresponds to the same pixel in the array of pixels for all images in the plurality of images. This offset compensates for the displacement between the objective lens and the object in a plane perpendicular to the optical axis of the objective lens, the displacement being due to the oblique angle of the relative movement between the object and the objective lens. In this way, the modulation of the light intensity recorded from a specific position on the surface of the object is monitored by the value taken in various images of the plurality of images by a specific pixel representing the array, the specific pixel representing the position on the surface in all recorded images after the offset. Depending on the number of pixels in the array (i.e., in the digital image) and the resolution requirements, the values ​​of more than one pixel are combined, for example by summing or averaging, and the result can be considered as corresponding to the light intensity recorded from the corresponding position on the surface of the object for the further process of the method. Averaging multiple pixels reduces noise. For example, the values ​​of an NxN array of pixels may be averaged, where N=2, 3, 4 or 5, for example.

[0023] In an embodiment, the patterned illumination is generated by incoherent illumination of a pattern mask. In particular, the pattern mask may be a grating. More specifically, the grating may be an amplitude grating or a phase grating. Non-limiting examples of grating geometries that can be used are line gratings, sinusoidal gratings or cross-line gratings. The grating may also be a blazed grating. More generally, the pattern mask may have a checkerboard pattern or a pinhole array, but is not limited to these options. Any pattern known in the art for generating structured illumination is also suitable for the method according to the present invention. The grating is preferably mechanical, for example, an etched metal foil or a metal-coated glass structure, such as, for example, chrome (Cr) on glass.

[0024] In principle, a spatial light modulator can also be considered for generating the patterned illumination. However, a pattern mask or a grating is preferred for several reasons: a grating can be obtained with a significantly higher resolution than a spatial light modulator and is not limited by the pixel count; this is advantageous in terms of both resolution in the plane perpendicular to the optical axis and field of view. The available and envisaged pixel counts of spatial light modulators are much lower than the pixel counts of cameras (e.g., CMOS-based cameras) that can be used to record digital images of the surface of the object according to the method of the present invention. This means in this context that a spatial light modulator will be the main limitation and should therefore be avoided. Furthermore, a spatial light modulator capable of generating a modulation of a specific minimum wavelength (limited by the pixel count) is much more expensive than a grating with a distance between adjacent lines of a grating that is several orders of magnitude lower.

[0025] In order to improve the contrast of the projected patterned illumination on the surface of the object, the patterned illumination may advantageously be generated such that it contains only the 0th diffraction order and one diffraction order, for example one 1st diffraction order, in equal intensity. This may be achieved, for example, by using a blazed grating.

[0026] The steps of the method of the present invention described above generally and with respect to specific embodiments can advantageously be performed in parallel on a plurality of objects. In this way, the throughput can be increased; since the method is easier to implement than the methods of the prior art, this increase in throughput can also be achieved easily and at a relatively low cost.

[0027] In a further general embodiment of the method according to the invention for optical three-dimensional topography measurement of a surface of an object, patterned illumination and uniform illumination are alternately projected onto the surface of the object by an objective lens. Thus, there are time intervals during which the surface of the object is illuminated using patterned illumination, and there are time intervals during which the surface of the object is illuminated using uniform illumination.

[0028] A relative movement is performed between the object and the objective lens. The direction of the relative movement includes a component along the optical axis of the objective lens; during the relative movement, the surface passes through the focal plane of the objective lens. The optical axis is perpendicular to the focal plane. During the relative movement, a plurality of images of the surface are recorded by the objective lens. Height information of the corresponding position on the surface of the object is derived from the change of the intensity recorded from the corresponding position in the plurality of images.

[0029] The height of a position on the surface refers to the distance of the position from the reference plane along a direction perpendicular to the reference plane. Typically, the reference plane is defined by a macroscopic extension of the surface; for example, a manufactured wafer carries a plurality of microstructures on its surface, however, macroscopically this surface behaves as a planar surface and thus defines a plane. When performing the method, if the object is correctly aligned, the reference plane is parallel to the focal plane of the objective lens. The height of all positions on the surface gives the topography of the surface. The corresponding position of the object along the optical axis (for example, expressed as a position on the optical axis, where the reference plane intersects the optical axis, where each of the plurality of images has been recorded separately) is the information used in the analysis to derive the height information.

[0030] Of the plurality of images recorded during the relative movement between the object and the objective lens, some images are recorded under the uniform illumination and some images are recorded under the patterned illumination. In an embodiment, images in the plurality of images recorded under the uniform illumination are used to derive height information of a mirror structure on the surface, and images in the plurality of images recorded under the patterned illumination are used to derive height information of a portion of the surface between mirror structures. For example, the mirror structure may be a solder bump on the surface. Then, height information about the solder bump is derived from the image recorded under uniform illumination, and height information about the surface between the solder bumps is derived from the image recorded under patterned illumination. In a specific embodiment, the height information of the mirror structure is derived from the size of the image of the top portion of the mirror structure (such as, for example, a solder bump). This size varies between the images recorded under uniform illumination, and the variation also constitutes an intensity variation of a pixel in the image representing the top portion in various images. The position of the top portion of the mirror structure along the optical axis of the objective lens can be derived from this size variation, and thus the height information of the mirror structure can be indirectly obtained. At best focus, i.e. when the top part of the mirror structure is in the focal plane, the size of the image of the top part is smallest. As an alternative, the height information of the mirror structure can be obtained from the peak pixel intensity during the relative movement. If the top of the mirror structure is in the focal plane of the objective lens, the intensity recorded from the top of the mirror structure and therefore also the value of the pixel corresponding to the top of the mirror structure is highest.

[0031] In particular embodiments, the direction of the relative movement is parallel to the optical axis of the objective. In these embodiments, in the case of a digital image, in particular no shift of the recorded image is required (as mentioned above), since there is no displacement of the object perpendicular to the optical axis of the objective. A given pixel in the pixel array of the recorded digital image will correspond to the same position on the surface of the object without such a shift.

[0032] The contrast of the pattern of the patterned illumination in the recorded images of the surface of the object under patterned illumination varies during the relative movement, since it depends on the position that any imaged portion of the surface or imaged position on the surface has along the optical axis of the objective lens. The contrast is optimal if such portion of the surface or position on the surface is in the focal plane of the objective lens. Therefore, height information about the portion of the surface or position on the surface can be derived from the contrast of the pattern in the multiple images.

[0033] In embodiments with alternating illumination, the patterned illumination may also be produced by incoherent illumination of a pattern mask. In particular, the pattern mask may be a grating. More specifically, the grating may be an amplitude grating or a phase grating. Non-limiting examples of grating geometries that may be used are line gratings, sinusoidal gratings or cross-line gratings. The grating may also be a blazed grating. More generally, the pattern mask may have a checkerboard pattern or a pinhole array, but is not limited to these options. Any pattern known in the art for producing structured illumination is also suitable for the method according to the invention. The grating is preferably mechanical, for example, an etched metal foil or a metal-coated glass structure, like, for example, chrome (Cr) on glass.

[0034] Furthermore, and similarly to the embodiment with only patterned illumination, in order to improve the contrast of the projected patterned illumination on the surface of the object, the patterned illumination may advantageously be generated such that it contains only the 0th diffraction order and one diffraction order, e.g., one 1st diffraction order, at equal intensity. This may be achieved, for example, by using a blazed grating.

[0035] As for the embodiment with patterned illumination only, the steps of the method can advantageously be performed in parallel on a plurality of objects. In this way, the throughput can be increased; since the method is easier to implement than the methods of the prior art, this increase in throughput can also be achieved easily and at a relatively low cost.

[0036] A system according to the invention for optical three-dimensional topography measurement of a surface of an object comprises a patterned illumination source, an objective lens, a detector, and means for performing a relative movement between the objective lens and the object.

[0037] The objective lens is arranged to direct the patterned illumination to the surface of the object and is also arranged to image the surface of the object onto the detector, which in turn is arranged and configured to record a plurality of images of the surface of the object. The detector may, for example, be part of a camera configured to record digital images. The detector may, for example, be based on CMOS or CCD technology. The means for performing relative movement between the objective lens and the object are configured so that the direction of the relative movement includes an oblique angle relative to the optical axis of the objective lens. It is therefore sufficient to implement means capable of performing a one-dimensional translational relative movement between the objective lens and the object. There is no need to move the object, for example, along the optical axis of the objective lens for imaging the surface of the object, as in the prior art, and there is also no need to modulate the patterned illumination, for example, by using a spatial light modulator or by additionally moving a grating.

[0038] In an embodiment, the patterned illumination source includes a light source and a pattern mask. In particular, the light source may be an incoherent light source, such as one or more light emitting diodes (LEDs).

[0039] In an embodiment, the pattern mask has a checkerboard pattern or a pinhole array, but is not limited to such cases.Other patterns known in the art for producing patterned illumination may also be used.

[0040] In particular, the pattern mask may be a grating, more particularly an amplitude grating or a phase grating. The grating may be, for example, a line grating or a sinusoidal grating or a crossed line grating. The grating may also be a blazed grating. The grating is preferably mechanical, for example, an etched metal foil or a metal-coated glass structure, like, for example, chrome (Cr) on glass.

[0041] In an advantageous embodiment, a beam splitter is arranged such that both the illumination path between the patterned illumination source and the objective lens and the imaging path between the objective lens and the detector pass through the beam splitter. In particular, the objective lens can be corrected for diffraction-limited performance, the correction also taking the beam splitter into account. In this way, a high-quality optical setup is achieved while the setup is a fairly compact and simple configuration. Thus, the setup can be realized as a low-cost module and a plurality of modules can be combined into a device for performing 3D topography measurements on a plurality of objects in parallel.

[0042] A further reduction of imaging errors and thus ultimately an increase in measurement accuracy is obtained by placing the pattern mask and the detector in conjugate planes.

[0043] In another general embodiment of a system for optical three-dimensional topography measurement of a surface of an object, the system includes both a patterned illumination source and a uniform illumination source, an objective lens, a detector, and means for performing relative movement between the objective lens and the object.

[0044] The objective lens is arranged to direct both the patterned illumination and the uniform illumination to the surface of the object and to image the surface of the object onto the detector, which in turn is arranged and configured to record a plurality of images of the surface of the object. The detector may, for example, be part of a camera configured to record digital images. The detector may, for example, be based on CMOS or CCD technology. The means for performing relative movement between the objective lens and the object is configured such that the direction of the relative movement includes at least a component along the optical axis of the objective lens. The system may be configured such that the patterned illumination source and the uniform illumination source may be activated independently of each other.

[0045] In an embodiment, the patterned illumination source includes a light source and a pattern mask. In particular, the light source may be an incoherent light source, such as one or more light emitting diodes (LEDs).

[0046] In an embodiment, the pattern mask has a checkerboard pattern or a pinhole array, but is not limited to such cases.Other patterns known in the art for producing patterned illumination may also be used.

[0047] In particular, the pattern mask may be a grating, more particularly an amplitude grating or a phase grating. The grating may be, for example, a line grating or a sinusoidal grating or a crossed line grating. The grating may also be a blazed grating. The grating is preferably mechanical, for example, an etched metal foil or a metal-coated glass structure, like, for example, chrome (Cr) on glass.

[0048] In an advantageous embodiment, a beam splitter is arranged such that an imaging path between the objective lens and the detector and at least one of an illumination path between the patterned illumination source and the objective lens and an illumination path between the uniform illumination source and the objective lens pass through the beam splitter. In particular, both the illumination path between the patterned illumination source and the objective lens and the illumination path between the uniform illumination source and the objective lens may pass through the beam splitter. The objective lens may be corrected for diffraction limited performance, the correction also taking the beam splitter into account. In this way, a high quality optical arrangement is achieved, while this arrangement is a fairly compact and simple configuration. Thus, the arrangement may be realized as a low-cost module, and a plurality of modules may be combined into a device for performing 3D topography measurements on a plurality of objects in parallel.

[0049] A further reduction of imaging errors and thus ultimately an increase in measurement accuracy is obtained by placing the pattern mask and the detector in conjugate planes.

[0050] In an embodiment, the direction of the relative movement between the object and the objective lens is parallel to the optical axis of the objective lens.

[0051] The system according to the invention may generally comprise or be connected to one or more computers for controlling the system and / or performing data analysis related to three-dimensional topography measurement of the surface of an object. In particular, the system may be used and appropriately controlled to perform any embodiment of the method according to the invention. The one or more computers may be any suitable known data processing device (embedded or non-embedded), a single processor, a multiprocessor (single core, multi-core); a plurality of computers may work in parallel to perform control and / or data analysis of the system, and may be connected to each other and to the system via a local connection or via a data network (such as the Internet). BRIEF DESCRIPTION OF THE DRAWINGS

[0052] The nature and mode of operation of this invention will now be more fully described in the following detailed description of the invention taken in conjunction with the accompanying schematic diagrams.

[0053] Figure 1 An embodiment of a system for 3D topography measurement of a surface of an object is presented.

[0054] Figure 2 It is a schematic enlarged view of the surface of an object.

[0055] Figure 3 is a top view of the surface of the object having the projected pattern.

[0056] Figure 4a Display objects with step-like shapes.

[0057] Figure 4b Demonstrating the use of the method according to the invention from Figure 4a The light intensity signal obtained from the object in the image.

[0058] Figure 5 An optical configuration as used in the method and system according to the present invention is described.

[0059] Figure 6 Demonstrates contrast depending on the spatial frequency of the grating.

[0060] Figure 7 Demonstrates repeatability as a function of grating pitch.

[0061] Figure 8 Demonstration of the optical setup combining diffraction orders.

[0062] Fig. 9 Show relative to Figure 8 The positions of the diffraction orders that set the imaging pupil.

[0063] Fig.10 Demonstration of the optical setup combining diffraction orders.

[0064] Fig.11 Show relative to Fig.10 The positions of the diffraction orders that set the imaging pupil.

[0065] Fig.12 An embodiment of a system for 3D topography measurement of a surface of an object is presented.

[0066] Fig.13 The optical situation when imaging a solder bump is described.

[0067] Fig.14 Display for Fig.12 An operating sequence of an embodiment of a system for 3D topography measurement of a surface of an object is shown.

[0068] Fig.15 Show how to Fig.14 The sequence of operations shown in Figure 2 obtains the height measurement.

[0069] Fig.16 Demonstrates the relationship between pixel intensity and the position of the illumination focus relative to the object for surfaces with small curvature.

[0070] Fig.17 Several examples of pattern masks for producing patterned illumination are shown.

[0071] Fig.18 An embodiment of a system for 3D topography measurement of a surface of an object is presented.

[0072] Fig.19 An optics module for carrying out the method according to the invention is shown.

[0073] Fig. 20 A system for parallel inspection of multiple objects is presented. DETAILED DESCRIPTION

[0074] The same element symbols refer to the same elements of similar functions throughout the various figures. In addition, only the element symbols necessary for the description of the corresponding figure are shown in the figures. The shown embodiments only represent examples of how the present invention can be implemented. This should not be considered as limiting the present invention.

[0075] Figure 1An embodiment of a system 1 for 3D topography measurement of a surface 21 of an object 2 is shown. The system 1 has a patterned illumination source 3; in the embodiment shown, the patterned illumination source 3 has a light source 31 (e.g., one or more LEDs), a condenser optics 32, and a pattern mask 33. The patterned illumination of the surface 21 of the object 2 is produced by projecting the pattern mask 33 onto the surface 21. More precisely, in the embodiment shown, the light from the light source 31, after passing through the condenser 32 and the pattern mask 33, reaches a beam splitter 4, which directs at least a portion of the light toward an objective lens 5, through which the light reaches the surface 21 of the object 2. The light from the surface 21 then passes through the objective lens 5 and reaches the beam splitter 4, which directs a portion of the light from the surface 21 to a detector 61, which, as shown here, can be part of a camera 6. The objective lens 5 defines an optical axis 51 and a focal plane 52; the optical axis 51 is perpendicular to the focal plane 52. The projected pattern mask 33 is at best focus in the focal plane 52 .

[0076] Via the detector 61, multiple images of the surface 21 are recorded while a relative movement is performed between the object 2 and the objective lens 5. The relative movement direction 22 between the object 2 and the objective lens 5 includes an oblique angle 23 relative to the optical axis 51. During the relative movement, the surface 21 of the object 2 passes through the focal plane 52 of the objective lens 5. In this macroscopic view of the system 1, the focal plane 52 is shown as coinciding with the surface 21 of the object 2. The portion of the surface 21 that is located in the focal plane appears at the best focus in the image of the surface 21 recorded via the detector 61. Due to the oblique angle 23 between the relative movement direction 22 and the optical axis 51, the pattern of the patterned illumination moves relative to the surface 21 of the object 2; in addition, as the surface 21 passes through the focal plane 52 during the relative movement along the direction 22, the contrast of the pattern as recorded in the image of the surface changes. Therefore, the light intensity recorded from a position on the surface 21 varies between images in the multiple images. Based on this variation in light intensity, height information of the corresponding position on the surface 21 can be obtained. For the sake of completeness, we point out that the relative movement between the object 2 and the objective 5 can be achieved, for example, by moving the object 2 or by moving the system 1 or by moving both the object 2 and the system 1 .

[0077] Figure 2 2 is a schematic enlarged view of a portion of a surface 21 of an object 2, which shows that the surface 21 is not substantially flat, but has structures such as, for example, protuberances 24. The 3D topography measurement of the invention is concerned with the goal of obtaining information about the height 25 of these structures (here explicitly shown for the protuberances 24). The height 25 of the protuberance 24 is understood to be the extension of the protuberance 24 relative to the reference plane 26 in a direction perpendicular to the reference plane 26. The objective lens 5 (see FIG. 2 ) is also shown. Figure 1) and the associated focal plane 52. If the object 2 is correctly aligned in the system 1, the focal plane 52 is parallel to the reference plane 26, and therefore, the optical axis 51 is perpendicular to both the focal plane 52 and the reference plane 26.

[0078] Figure 3 is a top view of the surface 21 of the object 2, which is shown as coming from the patterned illumination source 3 (see Figure 1 ) is a projection pattern 34. In the example shown, and with reference to the previous figures, the object 2 is moved relative to the objective 5 along the direction 22, so that this relative movement has a component 221 in the reference plane 26. Therefore, the pattern 34 moves relative to the surface 21 of the object 2 in the direction 35 opposite to the component 221. This means that during the relative movement, the light intensity incident on a given position on the surface 21 will vary, and therefore the light intensity recorded from this position will vary between the images of the surface 21 recorded by the camera 6.

[0079] Figure 4a Display object 2, reference plane 26, and objective lens 5 (see Figure 1 ) optical axis 51; optical axis 51 is perpendicular to reference plane 26. Object 2 has parts 271 and 272, whose height values ​​differ from reference plane 26 by an amount 251, so object 2 has step 27. Figure 4b , the corresponding intensity signal as obtained by the method according to the invention is shown in a diagram. In the diagram, the abscissa 81 corresponds to the position of the object 2 along the optical axis 51, and the ordinate 82 corresponds to the light intensity recorded from a position on the object 2 (more precisely from the position of the step here) during the relative movement. The light intensity shows two portions 273 and 274 that are significantly modulated. Assuming that in the case shown, the increasing values ​​along the abscissa 81 correspond to the movement of the object towards the objective lens, the modulation portion 273 results from the passage of the portion 271 (which has a greater height than the portion 272, being closer to the objective lens) through the focal plane of the objective lens, and the modulation portion 274 results from the passage of the portion 272 through the focal plane of the objective lens. The difference between the positions of the maxima of the modulation portions 273 and 274 on the abscissa 81 corresponds to the height difference 251 between the portions 271 and 272 of the object 2. The high-frequency modulation in the light intensity (discernible in particular in the modulation portions 273 and 274) results from the combined effect of the pattern and the relative movement between the object and the objective lens. For example, if the pattern is a line pattern, then when the light and dark lines of the pattern cross Figure 4a These high-frequency modulations are generated when the step 27 of the object 2 is located in the focal plane 52 of the objective 5. On the other hand, the amplitude of these high-frequency modulations is determined by the contrast of the line pattern on the surface of the object, more precisely here on the portions 271 and 272 of the object 2, respectively. If the portions 271 or 272, respectively, are in the focal plane 52 of the objective 5, the contrast is highest and, therefore, the amplitude of the high-frequency modulation is highest (see Figure 1 and 2 ).

[0080] Figure 5 An optical configuration of the illumination branch as can be used in the method according to the invention is shown. Figure 1 The beam splitter and camera in the image processing unit. Figure 5 The optical configuration shown in is used to discuss measurement uncertainties and possible improvements in this area, since a high degree of precise measurement is necessary for the present invention.

[0081] Show as in Figure 1 3, a light source 31, a condenser 32, a grating 33, an objective 5 with an optical axis 51, and a surface 21 of an object 2. The objective 5 comprises a pupil 53 which defines an imaging numerical aperture (imaging NA) 54. An illumination NA 36 is also indicated.

[0082] For the following discussion, we introduce Cartesian coordinates, a coordinate z along the optical axis 51 and a coordinate x perpendicular to the coordinate z.

[0083] In any plane perpendicular to the optical axis 51, the intensity I of the image of the grating projected onto the plane can be expressed as

[0084]

[0085] Here, C(z) specifies the amplitude of the intensity modulation according to z, Λ is the grating pitch, i.e. the distance between two adjacent lines of the grating 33, and Φ is the phase shift. In order to measure the contrast and ultimately determine the modulation part (as in Figure 4b 273 and 274) shown in the figure, the fringe pattern is shifted in the x direction, which is accomplished by the oblique angle of the relative movement between the object and the objective lens in the method according to the invention, see also Figure 3 Arrow 35 in FIG. A number M of such fringe pattern shifts are performed at a distance of one grating pitch, or in other words, M images are recorded while the pattern is shifted by one grating pitch due to the relative movement. The corresponding intensity value is, for example

[0086]

[0087] Where m is the counted fringe pattern deviation, 1≤m≤M. The maximum value of M is 3, but preferably, M is 4 or even higher. Fringe contrast can be evaluated according to the "M bucket" algorithm, described by the following calculation steps:

[0088]

[0089]

[0090]

[0091]

[0092] For example, if a one-dimensional sinusoidal grating is used, then the contrast of the projected image of the grating as a function of z varies approximately as follows

[0093] in

[0094] where NA i is the numerical aperture 36 of the illumination, NA is the imaging numerical aperture 54, λ is the wavelength (or average wavelength) of the light used for illumination, and C0 is the maximum fringe contrast at best focus.

[0095] Error propagation theory gives the following expression for the variance of fringe contrast:

[0096]

[0097] It can be shown to give

[0098]

[0099] Here, <σ I > is the average noise of pixel intensity, and <σ I > / I0 is the inverse of the detector dynamic range under sensor noise limitation and the inverse of the square root of the sensor's full well capacity under shot noise limitation.

[0100] The slope of the focus response at 64% of the peak can be used to estimate the measurement repeatability, giving

[0101]

[0102] Where N is the number of z-steps in the focal depth. Then, the measurement repeatability can be expressed as

[0103]

[0104] Where N t =MN indicates the total number of measurements resulting from M fringe shifts at each of the N z-steps, where a z-step is the change in position along the optical axis 51 when the projected pattern moves by one grating pitch due to relative movement between the object and the objective.

[0105] This error propagation model was developed to show how the optics parameters affect the performance at a fundamental level, so it was derived under ideal conditions ignoring mechanical motion errors and sensor noise. This model represents a best case scenario. Measurement Repeatability As shown in the previous equation, measurement repeatability can be improved by:

[0106] 1. Smaller grating pitch (Λ)

[0107] 2. Higher fringe contrast (C0)

[0108] 3. Higher numerical aperture (NA) i ), which is limited by the optical device

[0109] 4. The inverse of the higher image dynamic range, which is limited by the sensor

[0110] 5. Larger number of measurements, which is limited by data rate and processing capacity.

[0111] Therefore, smaller grating pitch and higher grating contrast are preferred. However, grating pitch and fringe contrast are generally two conflicting requirements, because fringe contrast decreases with smaller grating pitch, such as in Figure 6 The optical transfer function for an incoherent imaging system with a circular aperture is shown in . Figure 6 In , the grating pitch is shown as the spatial frequency of the grating, normalized by the maximum spatial frequency used. A high spatial frequency means many grating lines per unit length, and therefore a small distance between adjacent lines of the grating, ie a small grating pitch.

[0112] For incoherent illumination, the fringe contrast as a function of the grating pitch is given by:

[0113]

[0114]

[0115]

[0116] The measured repeatability error according to the grating pitch is obtained by combining these equations and σ z The above equations are combined to obtain; Figure 7 The results are depicted in Figure 2. The optimal grating pitch is 1 / 4 of the cutoff pitch Λ min For simplicity, it is written as:

[0117]

[0118] Therefore, for full NA illumination and shot noise limited case, the measurement repeatability is given by:

[0119]

[0120] And in the shot noise limited case:

[0121]

[0122] Here, N e Indicates the maximum well capacity of the imaging sensor. This is a best-case scenario to demonstrate the fundamental limitations of measurement performance. Real measurements are usually limited by mechanical noise, primarily from z-positioning stability.

[0123] As from Figure 6 It can be seen that the projected grating contrast at the optimum grating pitch (at half the cutoff frequency) is about 40%, which is given by the modulation transfer function (MTF) of the incoherent imaging system. The low contrast is a result of the unbalanced mixing of the diffraction orders at the object plane onto which the grating is projected. Figure 8 and 9 Further explanation in.

[0124] Figure 8 A condenser 32, a grating 33, an objective 5 with an optical axis 51 and a pupil 53, and an object 2 are shown. Also indicated are the depth of focus 28 and the grating pitch 331 as it appears projected onto the object 2. The indications 0th, +1st and -1st refer to the 0th diffraction order, and the two first order diffractions. It is assumed here that the grating has a pitch equal to the wavelength of the light used for illumination divided by the numerical aperture of the pupil 53.

[0125] Fig. 9 Display, for Figure 8 With the arrangement of , for any given point on the illumination pupil, only one of the two first-order diffractions (i.e., +1 or -1) passes through the optics, while the other is diffracted outside the pupil. Thus, the image of the grating 33 on the surface of the object 2 is formed by diffraction orders 0 and +1, or by diffraction orders 0 and -1, which regenerate an image of the grating by interference. Since for a standard grating, the intensity of light in one of the first orders is lower than the intensity of light in the 0th order, the resulting image of the grating has a low contrast.

[0126] Fig.10 How to improve the contrast is shown. A condenser 32, a grating 33, an objective 5 with a pupil 53, and an object 2 are shown. The depth of focus 28 and the grating pitch 331 as it appears on the object 2 are also indicated. It is assumed that the grating 33 here has a pitch equal to the wavelength of the light used for illumination divided by the numerical aperture of the pupil 53. The grating 33 here is such that it produces diffraction order 0 and only one first order diffraction (here -1), where the 0th diffraction order and the single first order diffraction have equal intensity. This can be achieved, for example, using a blazed grating.

[0127] Fig.11 Show, by Fig.10 In the case of the setup, the image of the grating is formed by interference of the 0th diffraction order and, in the case shown, the diffraction order -1. Fig.10 have equal intensity in the setting, so the resulting image of the grating is compared to Fig. 9 The case shown in has an improved contrast. In fact, the contrast can be improved to 100%, resulting in a corresponding improvement of more than 2 times in the measurement accuracy. Fig.10 Several variations of the setup are possible, for example off-axis apertures.

[0128] It should be noted that the improved contrast is not obtained at the expense of extended depth of focus. Figure 8 and 10 As shown in Figure 8 Incoherent illumination and Fig.10 The partially coherent off-axis illumination shown in FIG. 1 is defined as the distance from the best focus position where the grating contrast has dropped to half the maximum value) of about Λ / NA. For example, for an illumination with a numerical aperture NA i With nearly coherent illumination much smaller than the imaging numerical aperture NA, the fringe pitch can be at a minimum value of λ / (2NA) (corresponding to the maximum spatial frequency) and still have 100% fringe contrast. A system in which the contrast of the projected grating remains 100% over a virtually infinite focal range will not have a high sensitivity to specularly reflecting surfaces.

[0129] Fig.12 An embodiment of a system 100 for 3D topography measurement of a surface 21 of an object 2 is shown. The system 100 has a patterned illumination source 3; in the embodiment shown, the patterned illumination source 3 has a light source 31 (e.g., one or more LEDs), a condenser optics 32, and a pattern mask 33. The system 100 also has a uniform illumination source 7; in the embodiment shown, the uniform illumination source 7 has a light source 71 (e.g., one or more LEDs) and a condenser optics 72. A means 73 (e.g., a beam splitter, like a semi-transparent mirror) is provided for directing both light from the uniform illumination source 7 and light from the patterned illumination source 3 to a beam splitter 4. The beam splitter 4 directs at least a portion of the light toward an objective lens 5, through which the light reaches the surface 21 of the object 2. Then, the light from the surface 21 passes through the objective lens 5 and reaches the beam splitter 4, which directs a portion of the light from the surface 21 to a detector 61, which, as shown here, can be part of a camera 6. The objective lens 5 defines an optical axis 51 and a focal plane 52; the optical axis 51 is perpendicular to the focal plane 52. On the surface 21 of the object 2, structures are shown, which in particular may be mirror structures and here specifically are solder bumps 9.

[0130] By alternately operating the light sources 31 and 71, an alternating illumination of the surface 21 of the object 2 is provided. If the light source 71 is operated (i.e., it emits light), the illumination of the surface 21 of the object 2 is uniform. If the light source 31 is operated (i.e., it emits light), the illumination of the surface 21 of the object 2 is patterned.

[0131] When a relative movement is performed between the object 2 and the objective 5, a plurality of images of the surface 21 are recorded via the detector 61. Some of the plurality of images are recorded when the surface 21 is subjected to uniform illumination, and some of the plurality of images are recorded when the surface 21 is subjected to patterned illumination. In this embodiment, the direction 22 of relative movement between the object 2 and the objective 5 is parallel to the optical axis 51. During the relative movement, the surface 21 of the object 2 passes through the focal plane 52 of the objective 5. In this macroscopic view of the system 100, the focal plane 52 is shown to coincide with the surface 21 of the object 2.

[0132] Since in the illustrated embodiment, the relative movement direction 22 is parallel to the optical axis 51 of the objective lens 5 ( Figure 1 ), so there is no offset of the projection pattern relative to the surface 21 of the object 2. Fig.12 Embodiments of the present invention are particularly targeted at inspecting surfaces having solder bumps. The solder bumps are typically arranged in an array on the surface 21. Fig.12 Only one representative solder bump 9 is shown in FIG. In the region between the solder bumps where the distance between the solder bumps is greater than the pitch of the pattern (e.g., a grating) projected onto the surface, the height of the surface between the solder bumps can be measured from the contrast of the projected pattern without requiring an offset of the pattern relative to the surface. This means that it is not necessary to record multiple images for each relative position between the object 2 and the objective lens 5 along the optical axis 51, as is necessary in the prior art.

[0133] In this embodiment, the surface height between the solder bumps 9 is determined from the images recorded under patterned illumination, whereas the height of the solder bumps 9 is determined from the images recorded under uniform illumination.

[0134] We note that although Fig.12In the embodiment shown in , the patterned illumination source 3 and the uniform illumination source 7 each have a light source, but this is not a limitation of the present invention. It is conceivable that the embodiment in which the patterned illumination source 3 and the uniform illumination source 7 use a common light source. In such a case, suitable means are provided for realizing the alternating illumination of the surface of the object by patterned and uniform illumination. Such means may be, for example, a filter with switchable transmission, so that the light path from the light source to the further element for the patterned illumination source and the uniform illumination source, respectively, can be alternately blocked. The light intensity from the respective illumination source can also be controlled by controlling the transmission of the respective filter. Alternatively, the means may also be such that it collects light from the light source and alternately directs it to the further element of the patterned illumination source and the uniform illumination source, respectively.

[0135] Fig.13 The optical situation when a solder bump 9 (here with radius r) is imaged is illustrated. As a result, only a small portion of the top of the bump can be imaged due to the surface curvature of the reflective solder bump 9. The size of the top of the bump visible to the detector depends on both the illumination numerical aperture and the imaging numerical aperture. Under full numerical aperture (NA) illumination, the full width half height radius of the top of the bump visible to the detector is given by D=rNA. The optical NA needs to be large enough to provide sufficient optical resolution so that individual bumps in the array layout can be accurately measured. The bump layout is typically a 1:1 ratio of bump pitch to bump diameter, so the imaging point spread function (PSF) needs to be approximately the bump radius to avoid optical crosstalk between adjacent bumps. Therefore, the minimum NA is:

[0136]

[0137] And then, it can be seen that the corresponding minimum diameter of the bump top is

[0138] D min ≈λ

[0139] For device topography inspection, a typical NA is about NA=0.1-0.3 in order to have a large field size to image the entire device and also achieve high throughput, so it can be seen that the bump top is smaller than the optical PSF and can therefore be considered a point target for the imaging system. In this case, the peak pixel intensity or size of the image of the bump top itself can be used for height measurement since it closely follows how the imaging point spread function changes with focus.

[0140] Fig.13 5. As shown, although point P of the surface of bump 9 may still be illuminated by pupil 53, light reflected from point P does not pass through pupil 53 and therefore does not reach detector 61 (see FIG. Fig.12 ). Therefore, point P of the surface of solder bump 9 is not visible in the image recorded by detector 61. Fig.13It will be appreciated that this non-passage of pupil 53 of reflected light is primarily due to the specular nature of the reflection combined with the curvature of the surface of bump 9 .

[0141] Fig.14 exhibit Fig.12 The sequence of operations of the system shown in FIG. 1 is described by Fig.12 The alternating illumination produced by the patterned illumination source 3 and the uniform illumination source 7 in the diagram. The abscissa of the diagram shows the position z, which is the position of the object 2 along the optical axis 51 of the objective lens 5 during the movement along the direction 22 (see Fig.12 ). The ordinate shows the intensity of light emitted by light sources 31 and 71, respectively. Squares 143 with a checkerboard pattern represent the operation of patterned illumination source 3 (the pattern is not limited to a checkerboard), and blank squares 147 represent the operation of uniform illumination source 7. Arrows pointing from squares to bar graphs 144, 148 in the diagram indicate the phases of movement along the optical axis during which the respective illumination source is active. Thus patterned illumination source 3 is active, i.e., provides illumination for the phases of movement along optical axis 51 (where bar graph 144 is shown in the diagram), and uniform illumination source 7 is active, i.e., provides illumination for the phases of movement along optical axis 51 (where bar graph 148 is shown in the diagram).

[0142] Bar graph 144 indicates the intensity of light source 31 in patterned illumination source 3 which is higher than bar graph 148 which gives the intensity of light source 71 in uniform illumination source 7. This will show that the intensity of the light source can be adapted to the properties of the portion of surface 21 where the measurement is respectively performed. For measurements on specular solder bumps, a lower intensity is generally sufficient than for measurements on surfaces between solder bumps.

[0143] For illustrative purposes only, Fig.15 A combined image 151 of the solder bump under uniform illumination and the surface 21 between the solder bumps under patterned illumination is shown. Two diagrams are also shown. Diagram 157 shows the surface 21 between the solder bumps as a function of z position (i.e., along a direction 22 parallel to the optical axis 51 (see Fig.12 ) gives the intensity recorded from the solder bumps 9. Graph 153 gives the contrast measured from the surface 21 between the solder bumps 9 as a function of the z position. The intensity shown in graph 157 has a maximum at z position 158, and the contrast shown in graph 153 has a maximum at z position 159. These z positions 158, 159 (where the respective maxima occur) are the tops of the solder bumps 9 (maximum 158) and the surface 21 (maximum 159) respectively through the focal plane 52 (see Fig.12 ). Therefore, the difference 155 between these z positions 158 and 159 is the height of the solder bump 9.

[0144] As for the determination of the contrast value entered into diagram 153, if the projection pattern is a checkerboard pattern that matches the pixel size of detector 61 (see Fig.12 ), then these can be calculated from a minimum of 2×2 pixels. Larger pixel areas can also be used, i.e. N×N pixel areas, where N>2. The choice will generally depend on the distance between the bumps 9 and the spatial resolution required perpendicular to the optical axis 51. Larger pixel areas result in a higher accuracy of the calculated contrast, but obviously result in a lower spatial resolution perpendicular to the optical axis 51.

[0145] Fig.16 The pixel response (e.g., the value of a pixel representing the light intensity recorded by the corresponding pixel of the detector) in the method according to the present invention is shown for a surface with a small curvature (like a solder bump). On the left side of the figure, five images show light 164 directed to the focal point 165 (indicated in only two images) impinging on the hemisphere 163 (solder bump) for different relative positions between the hemisphere 163 and the focal point 165. The right side diagram gives the pixel response on the ordinate 162, while the abscissa 161 gives the relative position between the hemisphere 163 and the focal point 165. The arrows indicate which parts of the pixel response in the diagram correspond to which of the five images on the left.

[0146] As can be seen, the pixel response has two maxima. The maximum with the smaller value of the abscissa 161 corresponds to the situation where the focus 165 of the light ray 164 is at the top of the hemisphere 163, as shown in the second image from below on the left. In the measurement, this situation is when the top of the solder ball is in the focal plane 52 of the objective lens 5 (see Fig.12 ). The second maximum occurs when the focus 165 of the ray 164 coincides with the center of the hemisphere 163, as shown in the second image from above on the left; note that the ray 164 does not actually penetrate into the hemisphere 163, but is reflected at its surface. When performing the measurement, the direction of the relative movement between the object 2 and the objective lens 5 is known; therefore, it is clear which of the two peaks corresponds to the top of the solder ball in the focal plane 52. The other peak can be used to measure the curvature of the bump top surface, which in turn can be used for calibration purposes to improve the measurement accuracy.

[0147] Fig.17 Several examples of pattern masks for producing patterned illumination are shown. These pattern masks can be used Figure 1 Embodiments of the type shown in (with patterned illumination only) and Fig.12 ) with alternating patterned and uniform illumination. The invention is not limited to the type of pattern mask shown here. Specific examples shown are sinusoidal gratings (A), checkerboards (B), line grids or cross-line gratings (C), and pinhole arrays (D).

[0148] Fig.18 An embodiment of a system 200 for 3D topography measurement of a surface 21 of an object 2 is shown. The embodiment shown is very similar to Fig.12 The embodiment of the system 100 shown in FIG. Fig.18 In system 200, the pupil mask is included in the uniform illumination source 7. The pupil mask 74 acts as an illumination aperture. The illumination aperture can improve image contrast and focus response of various feature shapes. Fig.18 Two non-limiting examples of possible shapes for pupil mask 74 are shown in . Pupil mask example 741 is an annular aperture and pupil mask example 742 is a circular aperture.

[0149] Fig.19 An optics module 300 is shown which is an embodiment of a system according to the invention and which can therefore be used to carry out the invention. The configuration of the optics module 300 shown here is similar to Figure 1 The configuration of the system 1 shown in FIG. 1 can also be envisioned based on Fig.12 System 100 or Fig.18 An optical device module of a configuration of system 200 .

[0150] The patterned illumination source 3 comprises a light source 31, a condenser 32 and a pattern mask 33. From the patterned illumination source 3, light reaches a beam splitter 4, which directs part of the light to an objective 5, from which the part reaches the object 2 and provides a patterned illumination of a surface 21 of the object 2. The objective 5 comprises a pupil 53. The light from the surface 21 passes through the objective 5 and the beam splitter 4 and then reaches a detector 61 in a camera 6. The detector 61 is used to record multiple images of the surface 21 during the relative movement of the object 2 and the objective 5, as has been discussed above.

[0151] The module 300 is compact and simple and therefore suitable for inspecting multiple objects in parallel. To provide a very specific and non-limiting example, the objective 5 may have a 22 mm field diameter, a NA of 0.2, and may be corrected for LED illumination of a typical 30 nm wavelength bandwidth; this is preferred since one or more LEDs are typically used as the light source 31. The NA is large enough to achieve sub-micron measurement accuracy and the field size may cover most sizes of objects to be inspected. The beam splitter cube 4 in the imaging side separates the illumination path from the imaging path and is an integral part of the lens design. This is a much simpler and more compact design than conventional imaging microscopes, which have separate objectives and tube lenses and for which grating projection requires an additional tube lens since the illumination and imaging paths are separated at the collimation space between the objective and the tube lens. Another advantage of this design is that the pattern mask 33 and the detector 61 are located in completely conjugate planes, so residual field distortion is cancelled and sampling aliasing of the projected pattern is eliminated. The design is also telecentric on both the object and image sides to minimize through focus signal distortion.

[0152] Fig. 20 A system 400 for parallel inspection of multiple objects 2 is shown. Objects 2 are placed on a conveyor 401 by a pick-and-place device 402. Conveyor 401 carries objects 2 to and through an arrangement 403 of inspection modules 404; in the particular example shown, system 400 has three inspection modules 404. Each object 2 is inspected by one inspection module 404. Each inspection module 404 performs a method according to the invention for each object 2 that it inspects. It is also conceivable that system 400 is configured so that the number of inspection modules 404 can vary, i.e., inspection modules 404 can be added to or removed from system 400 depending on the number of objects 2 to be inspected and the throughput requirements.

[0153] Each inspection module 404 may be, for example, Fig.19 Module 300 as described in Figure 1 The system discussed in 1. Fig.12 The system 100 discussed in or in Fig.18 In general, the inspection module 404 can be a Figures 1 to 19 Any system according to the present invention discussed in the context of and any system configured to perform the method according to the present invention. Inspection module 404 may use a method according to the present invention based on patterned illumination and relative movement between the object and the objective lens (at an oblique angle between the direction of the relative movement and the optical axis of the objective lens), or a method according to the present invention that alternately employs patterned illumination and uniform illumination.

[0154] In the above description, numerous specific details are given to provide a thorough understanding of embodiments of the present invention. However, the above description of the illustrated embodiments of the present invention is not intended to be exhaustive or to limit the present invention to the precise form disclosed. Those skilled in the relevant art will recognize that the present invention can be practiced without one or more specific details or using other methods, components, etc. In other examples, well-known structures or operations are not shown or described in detail to avoid obscuring aspects of the present invention. As those skilled in the relevant art will recognize, although specific embodiments and examples of the present invention are described herein for illustrative purposes, various equivalent modifications are possible within the scope of the present invention.

[0155] In view of the above specific embodiments, these modifications can be made to the present invention. The terms used in the appended claims should not be interpreted as limiting the present invention to the specific embodiments disclosed in this specification and the claims. Instead, the scope of the present invention will be determined by the appended claims interpreted according to the established rules of claim interpretation.

[0156] Component Symbol List

[0157] 1 System

[0158] 2 Objects

[0159] 21 Surface of an object

[0160] 22 Relative moving direction

[0161] 221 Relative motion component

[0162] 23 Bevel

[0163] 24 Bump

[0164] 25 Height

[0165] 251 Height Difference

[0166] 27 steps

[0167] 271 Surface Parts

[0168] 272 Surface Parts

[0169] 273 Light Intensity Part

[0170] 274 Light Intensity Part

[0171] 26 Reference plane

[0172] 28 Depth of focus

[0173] 3 Patterned Illumination Source

[0174] 31 Light Source

[0175] 32 Concentrator

[0176] 33 Pattern Mask

[0177] 331 Grating pitch

[0178] 34 Pattern

[0179] 35 Direction of movement of the pattern relative to the surface

[0180] 36 Lighting aperture

[0181] 4 Beam splitter

[0182] 5 Objective lens

[0183] 51 Optical axis

[0184] 52 Focal plane

[0185] 53 pupil

[0186] 54 Imaging Pores

[0187] 6 Camera

[0188] 61 Detector

[0189] 7 Uniform illumination source

[0190] 71 Light Source

[0191] 72 Condenser

[0192] 73 Component (beam separation)

[0193] 74 pupil (illumination aperture)

[0194] 741 Annular pore

[0195] 742 Circular Pores

[0196] 81 horizontal axis

[0197] 82 total coordinates

[0198] 9 Solder balls

[0199] 100 Systems

[0200] 143 chessboard squares

[0201] 144 Bar Graph

[0202] 147 blank square

[0203] 148 Bar Graph

[0204] 151 Combined images

[0205] 153 Diagrams

[0206] 155 Height Difference

[0207] 157 Diagrams

[0208] 158 Maximum value (intensity)

[0209] 159 Maximum value (contrast)

[0210] 161 horizontal axis

[0211] 162 vertical coordinate

[0212] 163 Hemisphere

[0213] 164 Light

[0214] 165 Focus

[0215] 200 Systems

[0216] 300 modules

[0217] 400 System

[0218] 401 Conveyor

[0219] 402 Pick and Place Device

[0220] 403 Arrangement (of the inspection module)

[0221] 404 Check Module

[0222] A, B, C, D pattern mask examples

[0223] Dmin Minimum diameter of the visible solder ball top

[0224] P Point on the surface of the solder ball

Claims

1. A system for optical three-dimensional topography measurement of a surface of an object, the system comprising: a source of patterned illumination; an objective lens comprising an optical axis extending macroscopically perpendicular to the surface of the object, the objective lens being arranged to direct the patterned illumination onto the surface of the object; an optical detector arranged and configured to record a plurality of images of the surface of the object through the objective lens during movement of the object relative to the objective lens in a direction at an oblique angle to the optical axis of the objective lens, wherein a position on the surface of the object is in one or more of the plurality of images, wherein the surface of the object defines a reference plane parallel to the focal plane of the objective lens; as well as a computer connected to the optical detector, the computer configured to determine height information of the position on the surface of the object based on a difference in light intensity of the plurality of images, wherein the light intensity varies along the direction; wherein the patterned illumination is produced by incoherent illumination of a pattern mask, wherein the pattern mask is a grating, wherein the grating is a blazed grating; and For patterned illumination, only the 0th diffraction order and the 1st diffraction order generated by the pattern mask are used, and the two diffraction orders have the same intensity.

2. The system of claim 1, wherein the pattern mask and the detector are on conjugate planes.

3. The system of claim 1, wherein a beam splitter is arranged such that an illumination path between the source of the patterned illumination and the objective lens, and an imaging path between the objective lens and the detector both pass through the beam splitter.

4. The system of claim 3, wherein the objective lens is positioned to correct for diffraction caused by the beam splitter.

5. A system for optical three-dimensional topography measurement of a surface of an object, the system comprising: a source of patterned illumination; A source of uniform illumination; an objective lens arranged to direct both the patterned illumination and the uniform illumination onto the surface of the object; a detector arranged and configured to record a plurality of images of the surface of the object through the objective lens, wherein the surface of the object defines a reference plane parallel to the focal plane of the objective lens; as well as a computer connected to the detector, the detector being arranged to determine height information of a position on the surface of the object based on differences in light intensity of the plurality of images, wherein the light intensity varies along a direction including at least one component along an optical axis of the objective lens; wherein the patterned illumination is produced by incoherent illumination of a pattern mask, wherein the pattern mask is a grating, wherein the grating is a blazed grating; and For patterned illumination, only the 0th diffraction order and the 1st diffraction order generated by the pattern mask are used, and the two diffraction orders have the same intensity.

6. The system of claim 5 , wherein a beam splitter is arranged so that at least one of an imaging path between the objective and the detector, an illumination path between the source of patterned illumination and the objective, and an illumination path between the source of uniform illumination and the objective passes through the beam splitter.

7. The system of claim 6, wherein the illumination path between the source of patterned illumination and the objective lens and the illumination path between the source of uniform illumination and the objective lens both pass through the beam splitter.

8. The system of claim 6, wherein the objective lens is positioned to correct for diffraction caused by the beam splitter.

9. The system of claim 5, wherein the pattern mask and the detector are on conjugate planes.

10. The system of claim 5, wherein the direction of relative motion is parallel to the optical axis of the objective lens.