Detection light source, optical system and optical detection system

By combining multi-layer ring light source, coaxial light and projection device, the problem that optical devices in the prior art cannot effectively detect complex defects in semiconductor packaged products is solved, realizing high-precision 2D and 3D dimensional measurement and complex defect detection, improving detection efficiency and coverage.

CN222071025UActive Publication Date: 2024-11-26MATRIXTIME ROBOTICS (SHANGHAI) CO LTD
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202420485538.5
Authority / Receiving Office
CN · China
Patent Type
Utility models(China)
Current Assignee / Owner
Filing Date
2024-03-13
Publication Date
2024-11-26
Estimated Expiration
2034-03-13

AI Technical Summary

Technical Problem

In the existing technology, optical devices used for semiconductor packaging inspection cannot effectively distinguish defects such as dirt, scratches, metal layer damage and exposed copper, and cannot perform 2D and 3D dimensional measurements under high precision and high production capacity. The light source configuration is incomplete, the flexibility is poor, and it cannot cover the detection of various types of product surface defects.

Method used

Employing a multi-layered ring light source, coaxial light, projection device, and motion mechanism, and utilizing a multi-angle and multi-color light source environment, combined with a high-resolution telecentric lens and color camera, it enables the detection of complex defects in different materials and morphologies. High-precision Z-axis displacement design and algorithm optimization are employed to optimize image quality.

Benefits of technology

It improves detection coverage, reduces the missed detection rate, achieves high-precision 2D and 3D dimensional measurement and complex defect detection, reduces layout space, and improves detection efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN222071025U_ABST
    Figure CN222071025U_ABST
Patent Text Reader

Abstract

The utility model relates to the technical field of automatic detection and measurement, in particular to a detection light source, an optical system and an optical detection system. By arranging multiple layers of annular light, coaxial light, the projection device and the corresponding movement mechanism, lighting layout for different features can be realized on the premise of reducing the layout space, image acquisition for different features is realized, the detection coverage is improved, and the occurrence of missing detection conditions in the prior art is reduced.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of automatic detection and measurement technology, and in particular to a detection light source, an optical system and an optical detection system. Background Art

[0002] At present, with the iteration of semiconductor packaging technology, the front features of packaged products have gradually changed from flat surfaces to curved surfaces or multi-layer stacked surfaces. In order to improve product performance and shielding, multiple types of metal coatings are often added to the surface of inorganic or polymer packaging materials, and the process of engraving QR codes or characters on the surface of the product will also change accordingly. In order to cope with changes in product morphology, materials, processes, etc., the optical devices used for semiconductor post-packaging inspection also need to be upgraded to cope with 2D and 3D dimensional measurements under complex morphologies, and to make lighting solutions for complex defects under different materials.

[0003] In the prior art, there are the following problems:

[0004] 1. Commonly used cameras are black and white cameras with general resolution, which cannot distinguish defects such as dirt, scratches, broken metal layers and exposed copper on products; 2. The lenses are generally fixed-focus lenses, which cannot measure materials with high precision, because the materials are not tightly positioned in the tray and have slight height or tilt. Generally, FA lenses will have large dimensional measurement errors; 3. The light source configuration is not comprehensive, the effect compatibility is insufficient, and the flexibility is poor; 4. Lack of coaxial light and multiple angles and multiple color combinations cannot cover the surface defect detection of various types of products; 5. Line laser or point laser is used for 3D measurement, which cannot achieve both high precision and high productivity. Summary of the invention

[0005] In view of this, an object of the present invention is to provide a detection light source, an optical system and an optical detection system to achieve surface 2D, 3D dimension measurement and complex defect detection for chip packaging or 3C products.

[0006] In the first aspect, an embodiment of the present invention provides a detection light source, including a multi-layer ring light source for projecting light onto the surface of an object to be detected and a controller, wherein the multi-layer ring light source has multiple layers of independent ring lights, each layer of the independent ring lights has a different light incident angle relative to the object to be detected, and each layer of the independent ring lights is connected to the controller through a corresponding control channel; the controller controls the turning on and off of each layer of the independent ring lights through the control channel according to the item to be detected.

[0007] In some specific implementations, the multi-layer ring light source includes a first ring light, a second ring light, a third ring light, a fourth ring light, a fifth ring light, and a sixth ring light from far to near relative to the object to be detected.

[0008] In some specific implementations, the light incident angles of the first ring light, the second ring light, the third ring light, the fourth ring light, the fifth ring light, and the sixth ring light relative to the object to be detected decrease in sequence.

[0009] In some specific implementations, it is characterized in that the light incident angles of the first ring light, the second ring light, the third ring light, the fourth ring light, the fifth ring light and the sixth ring light relative to the object to be detected are 60°, 55°, 45°, 30°, 20° and 5°.

[0010] In some specific implementations, a plurality of infrared lamp beads are configured in the first ring light.

[0011] In some specific implementations, the second ring light, the third ring light, the fourth ring light and the sixth ring light are configured with a plurality of red lamp beads and a plurality of blue lamp beads, and the plurality of red lamp beads and the plurality of blue lamp beads are arranged at intervals.

[0012] In some specific implementations, a first control channel and a second control channel are provided in the second ring light, the third ring light, the fourth ring light and the sixth ring light, and the first control channel and the second control channel are connected to the plurality of red lamp beads and the plurality of blue lamp beads, respectively.

[0013] In some specific implementations, a plurality of white lamp beads are configured in the fifth ring light.

[0014] In some specific implementations, the fifth ring light is divided into four independent lighting areas, and each of the lighting areas has the same number of white lamp beads, and each lighting area is configured with a corresponding control channel connected to the controller.

[0015] In a second aspect, an optical system is provided, comprising the detection light source described in any one of the above items, and also comprising a projection device, wherein the projection device is connected to the controller; the projection device is set at an angle to the object to be detected, and is used to project a pattern onto the surface of the object to be detected.

[0016] In some specific implementations, it also includes a sensor component arranged in a forward direction relative to the surface of the object to be detected, and a coaxial light arranged relative to the sensor component, wherein the coaxial light is used to project light in a forward direction toward the surface of the object to be detected.

[0017] In some specific implementations, the sensor assembly includes a telecentric lens and a color camera, and the color camera is connected to the controller.

[0018] In a third aspect, an optical detection system is provided, comprising the optical system described in any one of the above items, and also comprising a motion mechanism connected to the detection light source, the coaxial light, and the projection device, wherein the motion mechanism is connected to the controller, and the motion mechanism drives any one or more of the detection light source, the coaxial light, and the projection device to approach or move away from the object to be detected in a vertical direction.

[0019] In some specific implementations, the motion mechanism includes a first motion mechanism, a second motion mechanism, and a third motion structure, which are respectively connected to the detection light source, the coaxial light, and the projection device; the first motion mechanism, the second motion mechanism, and the third motion mechanism are respectively connected to the controller through different control channels.

[0020] The embodiments of the present invention bring the following beneficial effects:

[0021] The embodiments of the present invention provide a detection light source, an optical system and an optical detection system. By arranging multiple layers of annular light, coaxial light, a projection device and a corresponding motion mechanism, it is possible to realize the lighting layout for different features while reducing the layout space, realize image acquisition for different features, improve the detection coverage, and reduce the occurrence of missed detection in the prior art.

[0022] Other features and advantages of the present disclosure will be set forth in the following description, or some features and advantages may be inferred or unambiguously determined from the description, or may be learned by implementing the above-mentioned technology of the present disclosure.

[0023] In order to make the above-mentioned objectives, features and advantages of the present disclosure more obvious and easy to understand, preferred embodiments are specifically cited below and described in detail with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] In order to more clearly illustrate the specific implementation methods of the present invention or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0025] Figure 1 A schematic diagram of the structure of a detection light source provided by an embodiment of the present invention;

[0026] Figure 2 A schematic diagram of the structure of an optical detection system provided by an embodiment of the present invention.

[0027] Icons: 100-optical detection system; 200-object to be detected; 110-detection light source; 120-coaxial light; 130-projection device; 140-sensor assembly; 150-motion mechanism; 111-first ring light, second ring light, third ring light, fourth ring light, fifth ring light, sixth ring light, 141-color camera; 142-telecentric lens; 151-first motion mechanism; 152-second motion mechanism; 153-third motion mechanism. DETAILED DESCRIPTION

[0028] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0029] The detection light source, optical system and optical detection system provided in the embodiments of the present application are applied to the inspection and measurement of electronic products, wherein the electronic products include packaged chips or printed circuit boards composed of multiple packaged chips. Among them, with the iteration of semiconductor packaging technology, the front features of packaged chip products gradually change from planes to curved surfaces or multi-layer stacked surfaces. For product performance and shielding, multiple types of metal coatings are often added to the surface of inorganic or polymer packaging materials, and the process of engraving QR codes or characters on the surface of the product will also change accordingly. In order to cope with changes in product morphology, materials, processes, etc., the optical device used for semiconductor post-packaging inspection also needs to be upgraded to cope with 2D and 3D dimensional measurements under complex morphologies, and make lighting and imaging solutions for complex defects under different materials.

[0030] Based on this background technology, an embodiment of the present application provides an optical inspection system that can provide different light source environments and optimal light source effects according to different inspection items to achieve imaging for different inspection items, and provide corresponding image information for subsequent machine vision inspection.

[0031] The optical detection system mainly consists of three parts: light source, imaging unit and controller. The light source is used to provide the detection light source, that is, to generate a light environment that can capture the image information of the object to be detected. The imaging unit is used to collect the corresponding image information based on the generated light environment. The controller is provided with a control channel for controlling the light source to generate the corresponding light environment.

[0032] Specifically, according to the characteristics of the product to be detected and the different detection objects, the detection tasks are roughly divided into two categories, namely 2D detection and 3D detection. In the embodiment of the present application, 2D detection is first explained, and how the light source environment in the 2D detection project is generated is explained first.

[0033] See also Figure 1 , the detection light source environment required for the 2D detection project is generated by the detection light source, wherein the detection light source 110 is specifically a multi-layer ring light source, and the multi-layer ring light source projects light toward the surface of the object to be detected. The multi-layer ring light source is arranged in a multi-layer ring stacking manner, and a channel for reflected light to pass through is provided in the middle of the overall detection light source. Each layer of independent ring light has a different light incident angle relative to the object to be detected, and each layer of independent ring light is connected to the controller (not marked) through a corresponding control channel to achieve separate control of the independent ring light, that is, each layer of independent ring light can be controlled separately, and according to different scene requirements, the controller implements corresponding control through the control channel corresponding to each layer of independent ring light, wherein the control result is turned on or off. In the embodiment of the present application, because the surface of the 3C product composed of a packaged chip or a plurality of packaged chips for the object to be detected has multiple features, if only one light source is used for single angle incident imaging, it is easy to cause the loss of key feature information, thereby resulting in missed detection. However, the multi-angle ring light can provide a light source of corresponding angle according to different detection items, reducing the missed detection problem caused by a single angle and a single light source.

[0034] Specifically, the multi-layer ring light includes a first ring light 111 , a second ring light 112 , a third ring light 113 , a fourth ring light 114 , a fifth ring light 115 and a sixth ring light 116 from far to near relative to the object to be detected.

[0035] Among them, because the multiple independent ring lights are in a stacked structure, in order to achieve shielding between the multiple independent ring lights, the light incident angles of the first ring light, the second ring light, the third ring light, the fourth ring light, the fifth ring light, and the sixth ring light relative to the object to be detected are reduced in sequence. In addition, the cross-sectional diameters of the first ring light, the second ring light, the third ring light, the fourth ring light, the fifth ring light, and the sixth ring light are increased in sequence.

[0036] Specifically, the light incident angles of the first ring light, the second ring light, the third ring light, the fourth ring light, the fifth ring light and the sixth ring light relative to the object to be detected are 65°, 55°, 45°, 30°, 20° and 5°.

[0037] Among them, since multiple infrared lamp beads are configured in the first ring light, the principle of its long wavelength and strong penetration can be used to detect hidden cracks in some products. In addition, because the incident angle of the first ring light is 65°, it can completely cover the object to be inspected.

[0038] Each of the second ring light, the third ring light, the third ring light and the sixth ring light is equipped with a plurality of red lamp beads and a plurality of blue lamp beads, and the plurality of red lamp beads and the plurality of blue lamp beads are arranged at intervals. The red lamp beads and the blue lamp beads are connected to the controller through the first control channel and the second control channel respectively, so as to realize the respective control of the red light source and the blue light source.

[0039] Among them, the sixth ring light can present the edge features of rounded corners or chamfers on the surface of the product through the low diffraction of blue light and the ultra-low working angle, which greatly improves the correlation of 2D size measurement of products with complex morphology or process.

[0040] There are multiple white lamp beads in the fifth ring light, and it is evenly divided into four independent lighting areas. Each lighting area has the same number of white lamp beads, and each lighting area is equipped with a corresponding control channel connected to the controller. Through multiple low-angle white multi-zone channels, lighting and taking pictures from four directions can be used to import photometric stereo algorithm detection, and 2.5D detection can be achieved for defects with concave and convex information such as scratches on the product surface.

[0041] See also Figure 2 In the embodiment of the present application, in addition to the above-mentioned multi-layer annular light source, the light source is also provided with an imaging unit corresponding to the coaxial light 120, and the coaxial light is also connected to the controller through a control channel. In the prior art, the coaxial light multi-dimensional cuboid has a light emitting area protruding from the main body, which will affect the spatial arrangement, so a split design is adopted to pull the light emitting area away and not interfere with the high-angle light arrangement; in the embodiment of the present application, since the coaxial light has the disadvantage of the light splitter causing the light to be weakened, a stroboscopic increment design is made to greatly reduce the problem of insufficient brightness caused by the splitting; the separate high-angle light in the embodiment of the present application needs to ensure the illumination and uniformity, and try to reduce its own three-dimensional size as much as possible, so as to leave enough adjustment space for the digital projector, so it is made into an integrated type with the coaxial light to reduce the space occupied by the wiring and installation of the lamp beads.

[0042] Among them, the coaxial light can weaken the impact of rough background surfaces such as metal coatings, highlighting features such as product characters; and the coaxial light can also be turned on simultaneously with the third ring light to achieve the capture of defective images such as exposed copper on metal or ceramic surfaces.

[0043] The above light sources are light sources for realizing non-3D detection. In order to realize 3D detection, in the embodiment of the present application, a projection device 130 is configured. The projection device is connected to the controller and is set at an angle to the object to be detected. The projection device realizes projecting an image onto the surface of the object to be detected. The imaging device realizes 3D morphology detection by capturing the image of the surface of the object to be detected.

[0044] Please see here Figure 2 In the embodiment of the present application, a motion mechanism 150 connected to the above-mentioned 2D detection light source and 3D detection light source is also provided to form a complete optical detection system 100. The motion mechanism is connected to the controller, and the motion mechanism drives any one or more of the detection light source, the coaxial light and the projection device to approach or move away from the object to be detected in the vertical direction. That is, the motion mechanism can drive the above light sources to move on the Z axis to adjust the distance between the light source and the object to be detected. In this embodiment, for products with different precision and field of view requirements, the working distance of the projection device can be flexibly adjusted to achieve mutual switching between precision and field of view to meet the use requirements of various scenarios.

[0045] In addition, according to the light source settings of the multi-layer annular light source, the coaxial light, and the projection device, the motion mechanism is provided with a first motion mechanism 151, a second motion mechanism 152, and a third motion mechanism 153 corresponding thereto. The first motion mechanism, the second motion mechanism, and the third motion mechanism are respectively connected to the controller through different control channels, that is, the controller can realize motion control of the first motion mechanism, the second motion mechanism, and the third motion mechanism by controlling different control channels, thereby realizing independent height adjustment of the multi-layer annular light source, the coaxial light, and the projection device.

[0046] Among them, for products with different thicknesses and surface morphologies, the movement of the multi-layer ring light source in the Z-axis direction can be controlled by controlling the first motion mechanism, so that the six originally determined working angles can be adjusted steplessly in the Z-direction fine-tuning process to achieve the light source angle and working distance relative to the inspected product. According to the optimal imaging logic written into the algorithm, the optimal working position and angle can be automatically calculated for different products, thereby achieving the best image effect.

[0047] Among them, for products with different surface material properties, the second motion mechanism, that is, the distance between the coaxial light and the object to be detected, can be adjusted separately to achieve the switching adjustment of the coaxial light between high concentration and high uniformity, thereby achieving the best image effect.

[0048] Among them, for products with different accuracy and field of view requirements, the third motion mechanism can be adjusted individually to control the working distance of the projection device relative to the object to be detected, thereby achieving mutual switching between accuracy and field of view to meet the usage requirements of various scenarios.

[0049] In the embodiment of the present application, the imaging device is a sensor assembly 140, including a telecentric lens 142 and a color camera 141, and the color camera is connected to the controller. The telecentric lens and the color camera are respectively a high-resolution telecentric lens and a high-resolution color camera.

[0050] In the embodiment of the present application, multi-layer annular light sources and coaxial light are used to cover the detection effect of the entire series of products while taking into account the optimization of the spatial layout. A high-precision Z-direction displacement design is adopted to achieve high-precision automatic adjustment of various components and devices in this optical module, and with the self-developed algorithm, the optimal working posture and image effect can be quickly solved. The use of high-resolution and high-frame-rate color cameras can greatly improve the ability to detect tiny defects on complex surfaces and perform high-speed 3D dimensional measurement; the use of high-resolution telecentric lenses can greatly reduce the impact of the product's posture differences in the tray on its dimensional measurement accuracy; the use of coaxial light sources is used to improve the lighting effect when the surface coating material background is uneven; the use of multi-angle and multi-color combined light sources is used to implement a variety of complex defect detection lighting solutions for various types of products, and multiple pictures can be used to detect multiple defects, optimizing the missed detection and over-detection rates of the detection system; a single high-precision digital projector is used for fast and high-precision 3D dimensional measurement of product surfaces. Compared with the use of two high-precision digital projectors, the time spent on image acquisition and calculation is halved; compared with sensors such as line lasers of the same accuracy, the detection time is reduced by at least one order of magnitude; a single 3D measurement data acquisition takes less than one hundred milliseconds, and a single 2D and multiple complex defect measurement data acquisition takes only tens of milliseconds.

[0051] In the description of the present invention, it should be noted that the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc., indicating the orientation or positional relationship, are based on the orientation or positional relationship shown in the drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as limiting the present invention. In addition, the terms "first", "second", and "third" are used for descriptive purposes only, and cannot be understood as indicating or implying relative importance.

[0052] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A detection light source, characterized in that: It comprises a multi-layer ring light source for projecting light onto the surface of an object to be detected and a controller, wherein the multi-layer ring light source has multiple layers of independent ring lights, each layer of the independent ring lights has a different light incident angle relative to the object to be detected, and each layer of the independent ring lights is connected to the controller via a corresponding control channel; the controller controls the opening and closing of each layer of the independent ring lights via the control channel according to the item to be detected.

2. The detection light source according to claim 1, characterized in that: The multi-layer annular light source includes a first annular light, a second annular light, a third annular light, a fourth annular light, a fifth annular light, and a sixth annular light from far to near relative to the object to be detected.

3. The detection light source according to claim 2, characterized in that: The light incident angles of the first ring light, the second ring light, the third ring light, the fourth ring light, the fifth ring light, and the sixth ring light relative to the object to be detected decrease in sequence.

4. The detection light source according to claim 3, characterized in that: The light incident angles of the first ring light, the second ring light, the third ring light, the fourth ring light, the fifth ring light and the sixth ring light relative to the object to be detected are 65°, 55°, 45°, 30°, 20° and 5°.

5. The detection light source according to claim 4, characterized in that: A plurality of infrared lamp beads are arranged in the first ring light.

6. The detection light source according to claim 4, characterized in that: The second ring light, the third ring light, the fourth ring light and the sixth ring light are configured with a plurality of red lamp beads and a plurality of blue lamp beads, and the plurality of red lamp beads and the plurality of blue lamp beads are arranged at intervals.

7. The detection light source according to claim 6, characterized in that: The second ring light, the third ring light, the fourth ring light and the sixth ring light are provided with a first control channel and a second control channel, and the first control channel and the second control channel are connected to the plurality of red lamp beads and the plurality of blue lamp beads respectively.

8. The detection light source according to claim 4, characterized in that: A plurality of white lamp beads are arranged in the fifth ring light.

9. The detection light source according to claim 8, characterized in that: The fifth ring light is divided into four independent lighting areas, and each lighting area has the same number of white lamp beads. Each lighting area is configured with a corresponding control channel connected to the controller.

10. An optical system, characterized in that: It comprises the detection light source according to any one of claims 1 to 9, and also comprises a projection device, wherein the projection device is connected to the controller; the projection device is arranged at an angle with the object to be detected, and is used to project a pattern onto the surface of the object to be detected.

11. The optical system according to claim 10, characterized in that It also includes a sensor component arranged forwardly relative to the surface of the object to be detected, and a coaxial light arranged relative to the sensor component, wherein the coaxial light is used to project forward light toward the surface of the object to be detected.

12. The optical system according to claim 11, characterized in that The sensor assembly includes a telecentric lens and a color camera, and the color camera is connected to the controller.

13. An optical detection system, characterized in that: The optical system comprises the optical system as described in any one of claims 10 to 12, and further comprises a motion mechanism connected to the detection light source, the coaxial light, and the projection device, wherein the motion mechanism is connected to the controller, and the motion mechanism drives any one or more of the detection light source, the coaxial light, and the projection device to approach or move away from the object to be detected in the vertical direction.

14. The optical detection system according to claim 13, characterized in that: The motion mechanism includes a first motion mechanism, a second motion mechanism and a third motion mechanism respectively connected to the detection light source, the coaxial light and the projection device; the first motion mechanism, the second motion mechanism and the third motion mechanism are respectively connected to the controller through different control channels.

Citation Information

Cited By

  • Super-depth-of-field image acquisition system and method for defect detection

    CN122631655A