DEVICE AND METHOD FOR THREE-DIMENSIONAL INVESTIGATION
The device and method enhance the accuracy and efficiency of three-dimensional inspections by using non-parallel image capture and analysis to improve the quality and consistency of inspections on objects like solder joints.
Patent Information
- Application Number
- DE102017112404
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2017-03-24
- Filing Date
- 2017-06-06
- Publication Date
- 2024-12-05
- Estimated Expiration
- 2037-06-06
AI Technical Summary
Conventional methods for inspecting three-dimensional objects, such as solder joints on circuit boards, are subjective and time-consuming, leading to inconsistent product quality and low productivity due to reliance on human inspectors and inefficient inspection processes.
A device and method utilizing multiple image sensors positioned along non-parallel axes to capture and analyze multiple images of an object, generating first and second directional stereo information to enhance inspection accuracy and efficiency.
Improves the accuracy and efficiency of three-dimensional inspections by providing precise and uniform quality assessment of objects, such as solder joints, through the use of non-parallel image capture and analysis.
Smart Images

Figure 00000000_0000_ABST 
Figure 00000000_0001_ABST
Abstract
Description
BACKGROUNDField of the invention
[0001] The present invention relates to a device and a method for a three-dimensional examination. Description of related technology
[0002] In recent years, the manufacturing processes for various electrical components include a process for inspecting a three-dimensional object. For example, in the electronic circuit board manufacturing process, a solder joint of each component is inspected after the component is mounted on a board and a reflow process is performed.
[0003] In conventional methods of inspecting three-dimensional objects (i.e., solder joints), inspection is performed in such a way that an inspector examines the three-dimensional object (i.e., solder joints) with the naked eye. Therefore, the quality of products using three-dimensional objects (i.e., solder joints) is not uniform, depending on the conditions and the inspectors' skills. Furthermore, conventional methods are problematic because product productivity is exceptionally low due to their long inspection times when inspecting complex electrical components (i.e., printed circuit boards).
[0004] US 2011 / 0 235 897 A1 discloses an apparatus and method for finding a three-dimensional reconstruction point set containing 3D position information of segments obtained by dividing a boundary of the object in the image data. Furthermore, a feature set is determined that contains three-dimensional information regarding vertices of the segments for each pair of two different images.
[0005] Beyerer, J.; León, FP; Frese, C.: Automatic Visual Inspection: Fundamentals, Methods, and Practice of Image Acquisition and Image Analysis. Berlin - Heidelberg: Springer, 2012. Pages 168-169, 302, 341-349 describe the acquisition of the three-dimensional shape of an object for automatic visual inspection using stereo images.
[0006] Kang, S.B.; et al.: A Multibaseline Stereo System with Active Illumination and Real-time Image Acquisition. In: Fifth International Conference on Computer Vision, 1995. IEEE, pages 88–93 discloses the implementation of a parallel depth detection scheme for a four-camera multibaseline stereo system in a convergent configuration. Dense stereo depth data is obtained by projecting a light pattern with frequency-modulated, sinusoidally varying intensity onto the scene, thereby increasing local discriminability at each pixel and facilitating matching. Most regions of the camera view are converged into a volume of interest. This allows stereo depth data to be extracted. SUMMARY
[0007] According to embodiments of the invention, the appearance of the object is reconstructed from the first and second directional stereo information. The first and second directional stereo information can be obtained by calculating two pairs of images each, where they may share one of the images. Alternatively, the first and second directional stereo information can be obtained from two pairs of different images, where the images are different from each other. This configuration improves the examination of the object, making it more accurate.
[0008] According to some embodiments of the present invention, an apparatus for three-dimensional examination includes a carrier, an image acquisition component, and a processor. The carrier is configured to hold an object. The image acquisition component is configured to capture a first image, a second image, and a third image of the object along a first axis, a second axis, and a third axis, respectively, and the first axis, the second axis, and the third axis are not parallel to each other. The processor is configured to analyze the first image and the second image to obtain first directional stereo information and to analyze the third image and a specific image of the object to obtain second directional stereo information, wherein a specific axis along which the specific image is captured is not parallel to the second axis or the third axis.
[0009] In some embodiments of the present invention, the image capture component includes a plurality of image sensors located on the first axis, the second axis, and the third axis, respectively, to capture the first image, the second image, and the third image.
[0010] In some embodiments of the present invention, the image capture component includes a static image sensor and a movable image sensor, the static image sensor is located on the first axis for capturing the first image, and the movable image sensor is configured to move from the second axis to the third axis for capturing the second image and the third image.
[0011] In some embodiments of the present invention, the particular image is the first image and the first axis is normal to a top surface of the carrier.
[0012] In some embodiments of the present invention, the particular image is the first image and the third axis is located on a first plane formed by the first axis and the second axis.
[0013] In some embodiments of the present invention, the particular image is the first image and the third axis is not located on a first plane formed by the first axis and the second axis.
[0014] In some embodiments of the present invention, the image capture component is further configured to capture a fourth image of the object along a fourth axis, and the processor is configured to analyze the first image and the fourth image to obtain third directional stereo information, wherein the third axis and the fourth axis each extend to opposite sides of the first plane.
[0015] In some embodiments of the present invention, the image capture component is further configured to capture a fifth image of the object along a fifth axis, and the processor is configured to analyze the first image and the fifth image to obtain fourth directional stereo information, wherein the second axis and the fifth axis each extend to opposite sides of a second plane formed by the third axis and the fourth axis.
[0016] In some embodiments of the present invention, the image capture component is further configured to capture a fourth image of the object along a fourth axis, wherein the fourth axis is not parallel to the first axis, the second axis, and the third axis, and the particular image is the fourth image.
[0017] In some embodiments of the present invention, the image capture component includes a plurality of image sensors located on the first axis, the second axis, the third axis, and the fourth axis, respectively, to capture the first image, the second image, the third image, and the fourth image.
[0018] In some embodiments of the present invention, the image capture component comprises a static image sensor and a movable image sensor, the static image sensor is located on the first axis and is configured to capture the first image, and the movable image sensor is configured to capture the second image and / or the third image and / or the fourth image along the second axis and / or the third axis and / or the fourth axis.
[0019] In some embodiments of the present invention, a first plane formed by the first axis and the second axis is vertical to a top surface of the support, and a second plane formed by the third axis and the particular axis along which the particular image is captured is vertical to a top surface of the support.
[0020] In some embodiments of the present invention, a first plane formed by the first axis and the second axis has an inclination angle with respect to an upper surface of the carrier, and the inclination angle is in a range of 80 degrees to 100 degrees.
[0021] In some embodiments of the present invention, a first plane formed by the first axis and the second axis is not parallel to a second plane formed by the third axis and the particular axis along which the particular image is captured.
[0022] In some embodiments of the present invention, the apparatus further includes a projector configured to project a light pattern onto the object.
[0023] According to some embodiments of the present invention, a method for three-dimensional examination includes placing an object on a support; acquiring a first image of the object along a first axis, acquiring a second image of the object along a second axis, and acquiring a third image of the object along a third axis, wherein the first axis, the second axis, and the third axis are not parallel to each other; analyzing the first image and the second image to obtain first directional stereo information; and analyzing the third image and a specific image of the object to obtain second directional stereo information, wherein a specific axis along which the specific image is acquired is not parallel to the second axis or the third axis.
[0024] In some embodiments of the present invention, the particular image is the first image.
[0025] In some embodiments of the present invention, the method further includes projecting a light pattern having a plurality of points randomly distributed on the object, wherein capturing the first image, the second image, and the third image of the object comprises capturing the light pattern on the object, and the points on one part of the object have a different distribution than the points on any other part of the object.
[0026] It is to be understood that both the foregoing general description and the following detailed description are illustrated by examples and are intended to provide additional explanation of the claimed invention. BRIEF DESCRIPTION OF THE DRAWINGS
[0027] The invention can be more fully understood by reading the following detailed description of the embodiment, with reference to the following accompanying drawings: Fig. 1 is a schematic stereo view of an apparatus for three-dimensional examination according to some embodiments of the invention; Fig. Figure 2 is a plan view of the device for the three-dimensional examination of Fig. 1; Fig. 3 is a schematic stereo view of an apparatus for three-dimensional examination according to some embodiments of the invention; Fig. 4 is a schematic stereo view of an apparatus for three-dimensional examination according to some embodiments of the invention; Fig. 5 is a flowchart of a method for three-dimensional examination according to some embodiments of the invention and Fig. 6 is a plan view of a light pattern on an object according to some embodiments of the invention. DETAILED DESCRIPTION
[0028] Reference will now be made in detail to the present embodiments of the invention, examples of which are illustrated in the accompanying drawings. Where possible, the same reference numerals are used throughout the drawings and the description to refer to the same or similar parts.
[0029] Fig. 1 is a schematic stereo view of an apparatus 100 for three-dimensional examination according to some embodiments of the invention. Fig. Figure 2 is a plan view of the device 100 for the three-dimensional examination of Fig. 1. The three-dimensional examination device 100 includes a carrier 110, an image acquisition component 120, a processor 130, and a projector 140. The carrier 110 is configured to hold an object 200. The projector 140 is configured to project a light pattern onto the object 200. The image acquisition component 120 is configured to capture a first image, a second image, a third image, a fourth image, and a fifth image of the object 200 along a first axis D1, a second axis D2, a third axis D3, a fourth axis D4, and a fifth axis D5, respectively. The first axis D1, the second axis D2, the third axis D3, the fourth axis D4, and the fifth axis D5 are not parallel to each other.Processor 130 is configured to analyze the first image and the second image to obtain first directional stereo information, and to analyze the third image and a specific image of object 200 to obtain second directional stereo information. In some embodiments of the present invention, the specific image is acquired along a specific axis that is not parallel to the second axis D2 or the third axis D3. For example, the specific axis may be the first axis D1, the fourth axis D4, or the fifth axis D5.
[0030] In some embodiments of the present invention, the image capture component 120 includes a plurality of image sensors 121-125 located on the first axis D1, the second axis D2, the third axis D3, the fourth axis D4, and the fifth axis D5, respectively, to capture the first image, the second image, the third image, the fourth image, and the fifth image. In some embodiments, the distances between the object and the image sensors 121-125 are substantially the same, the image sensors 121-125 are identical, and therefore the resolutions of the first to fifth images are substantially the same. Of course, this should not limit the scope of the present invention, and in some embodiments, the distances between the object and the image sensors 121-125 may be different. Furthermore, the image sensors 121-125 may be different.
[0031] Here, the angle X2-X5 between the second to fifth axes D2-D5 and the upper surface 112 of the carrier 110 is substantially the same in some embodiments, but this should not limit the scope of the present invention. In other embodiments, the angle X2-X5 may be different. Additionally, in some embodiments, the first to fifth axes D1-D5 intersect at a point on the object 200. In other embodiments, the first to fifth axes D1-D5 do not intersect at the same location, but are directed toward a portion of the object 200 (e.g., a region of interest ROI).
[0032] In some embodiments of the present invention, a first plane P1, formed by the first axis D1 and the second axis D2, is vertical to a top surface 112 of the support 110, and a second plane, formed by the third axis D3 and the specific axis along which the specific image is captured, is vertical to a top surface 112 of the support 110. The vertical configurations simplify the calculation in the analysis for obtaining the directional stereo information and therefore increase the accuracy of the directional stereo information. However, the angle between the first plane P1 and the top surface 112 of the support 110 is not intended to be precisely limited to 90 degrees; rather, a tolerance may be provided.For example, the first plane P1 may have an inclination angle relative to the upper surface 112 of the support 110, and the inclination angle may be in a range of 60 degrees to 120 degrees, preferably a range of 80 degrees to 100 degrees. The second plane may also have an inclination angle in a range of 60 degrees to 120 degrees, preferably a range of 80 degrees to 100 degrees, relative to an upper surface of the support. It is noted that the numerical value of the inclination angle should not limit the scope of the present invention.
[0033] In some other embodiments, the first plane P1 and the second plane may not be vertical to the top surface 112 of the support 110. The relevant details (e.g., the tilt angle between the first plane P1 and the top surface 112 or the tilt angle between the second plane and the top surface 112) may be factors in the analysis for obtaining the directional stereo information.
[0034] In the present invention, the first and second directional stereo information can be obtained by many methods, which are illustrated below.
[0035] For a first of the methods, the first axis D1 is normal to a top surface 112 of the support 110, and the particular image with respect to the second directional stereo information may be the first image. In the embodiments, the first plane P1, formed by the first axis D1 and the second axis D2, is substantially vertical to the top surface 112 of the support 110, and a second plane P2, formed by the third axis D3 and a particular axis along which the particular image is acquired (here referring to the first axis D1), is substantially vertical to the top surface 112 of the support 110.
[0036] Here, the third axis D3 relating to the second directional stereo information may not be located on the first plane P1. For example, the second plane P2 has an angle Z1 with respect to the first plane P1, where the angle Z1 may be in a range from 0 degrees to 90 degrees, such as 10 degrees to 90 degrees. In the present embodiments, the first plane P1 is orthogonal to the second plane P2 (i.e., the angle Z1 is 90 degrees), so that the first directional stereo information and the second directional stereo information reveal the appearance of the object in two orthogonal directions. However, this should not limit the scope of the present invention, and in some embodiments, the first plane P1 may not be orthogonal to the plane relating to the second directional stereo information.For example, if the second directional stereo information is obtained from images taken along the first axis D1 and the fifth axis D5 located on the first plane P1, the plane with respect to the second directional stereo information may be parallel to the first plane P1.
[0037] This configuration creates the first directional stereo information and the second directional stereo information from the first image, the second image, and the third image.
[0038] For a second of the methods, the particular image with respect to the second directional stereo information may be the first image, but the first axis D1 is not normal to a top surface 112 of the support 110. Fig. 3 is a schematic stereo view of a device 100 for a three-dimensional examination according to some embodiments of the invention. The embodiments of Fig. 3 are similar to the embodiments of Fig. 1, and the difference is that the first axis D1 is not normal to the upper surface 112 of the support 110. In the present embodiments, the first axis D1, the second axis D2, and the third axis D3 are formed on the same plane. With this configuration, the first plane P1 formed by the first axis D1 and the second axis D2 is parallel to a second plane P2 formed by the third axis D3 and the specific axis along which the specific image is captured (here referring to the first axis D1).
[0039] Here, the first plane P1 and the second plane P2 may be vertical to the upper surface 112 of the support 110. As previously illustrated, the vertical configurations simplify the calculation in the analysis for obtaining the directional stereo information and therefore increase the accuracy of the directional stereo information. Furthermore, the angle between the first plane P1 or the second plane P2 and the upper surface 112 of the support 110 is not intended to be precisely limited to 90 degrees; rather, a tolerance may be provided. For example, the first plane P1 or the second plane P2 has an inclination angle with respect to the upper surface 112 of the support 110, and the inclination angle may be in a range of 60 degrees to 120 degrees, preferably in a range of 80 degrees to 100 degrees. It is noted that the numerical value of the inclination angle should not limit the scope of the present invention.
[0040] As previously illustrated, the first image and the second image are analyzed to obtain the first directional stereo information, and the first image and the third image are analyzed to obtain the second directional stereo information.
[0041] For a third of the methods, the specific image may not be the first image, but the fourth image. Again, reference is made to Fig. 1. In some embodiments, the third image and the specific image (here being the fourth image) are analyzed to obtain the second directional stereo information. As previously illustrated, the second plane P2', formed by the third axis D3 and a specific axis along which the specific image is acquired (here referring to the fourth axis D4), may be vertical to the upper surface 112 of the support 110. As mentioned above, the second plane P2' may have an inclination angle in a range of 80 degrees to 100 degrees with respect to the upper surface 112 of the support 110.
[0042] Here, the first axis D1 may be normal to the upper surface 112 of the support 110. However, in some other embodiments, the first axis D1 may not be normal to the upper surface 112 of the support 110. In some other embodiments, the first axis D1 may be exchanged, for example, with the fifth axis D5, and therefore none of the images used to calculate the first and second directional stereo information are acquired along an axis normal to the upper surface 112 of the support 110.
[0043] In some embodiments, the third axis D3 and / or the specific axis (here referring to the fourth axis D4) are / are not located on the first plane P1 with respect to the second directional stereo information. For example, the second plane P2' has an angle Z1' with respect to the first plane P1, where the angle Z1' can be in a range of 10 degrees to 90 degrees, but it is noted that the numerical value of the angle Z1' should not limit the scope of the present invention. In the current embodiments, the first plane P1 is orthogonal to the second plane P2' (i.e., the angle Z1' is 90 degrees), so that the first directional stereo information and the second directional stereo information reveal the appearance of the object in two orthogonal directions.However, this should not limit the scope of the present invention and in some embodiments the first plane P1 may not be orthogonal to the second plane P2'.
[0044] The first and second pieces of directional stereo information are obtained by the method illustrated above. Processor 130 may optionally further combine the first and second pieces of directional stereo information into integrated stereo information. Note that more than two pieces of directional stereo information may be calculated and obtained and further used to create the integrated stereo information. For example, the third and fourth pieces of directional stereo information may be calculated and obtained from the fourth image and the fifth image.
[0045] For example, in some embodiments of the present invention, the processor 130 is configured to analyze the first image and the fourth image to obtain third directional stereo information. In some embodiments, a plane formed by the first axis D1 and the fourth axis D4 is vertical to the top surface 112 of the support 110. The first axis D1 is, for example, normal to the top surface 112 of the support 110. With this configuration, the processor 130 can analyze the first image and the second image to obtain the first directional stereo information, analyze the first image and the third image to obtain the second directional stereo information, and analyze the first image and the fourth image to obtain the third directional stereo information.
[0046] Here, the third axis D3 and the fourth axis D4 extend above the upper surface 112 of the carrier 110, respectively, to opposite sides of the first plane P1, so that the object 200 is detected in all respects. However, this should not limit the scope of the present invention; the third axis D3 and the fourth axis D4 extend above the upper surface 112 of the carrier 110 to the same side of the first plane P1, so that the object 200 is detected more precisely.
[0047] Furthermore, in some embodiments of the present invention, the processor 130 is configured to analyze the first image and the fifth image to obtain fourth directional stereo information. In some embodiments, a plane formed by the first axis D1 and the fifth axis D5 is vertical to the upper surface 112 of the support 110. For example, the first axis D1 is normal to the upper surface 112 of the support 110. With this configuration, the processor 130 can analyze the first image and the second image to obtain the first directional stereo information, analyze the first image and the third image to obtain the second directional stereo information, analyze the first image and the fourth image to obtain the third directional stereo information, and analyze the first image and the fifth image to obtain the fourth directional stereo information.
[0048] Here, the second axis D2 and the fifth axis D5 extend above the upper surface 112 of the support 110 to opposite sides of the second plane P2 formed by the third axis D3 and the first axis D1, or the second plane P2' formed by the third axis D3 and the fourth axis D4, respectively, so that the object 200 is detected in all respects. However, this should not limit the scope of the present invention; the third axis D3 and the fourth axis D4 extend above the upper surface 112 of the support 110 to the same side of the second plane P2 or P2', so that the object 200 is detected more precisely.
[0049] Furthermore, in some embodiments of the present invention, the processor 130 is configured to analyze the second image and the fifth image to obtain fifth directional stereo information. In some embodiments of the present invention, the processor 130 is configured to analyze the third image and the fourth image to obtain sixth directional stereo information. Through this configuration, some of the first to fifth directional stereo information is obtained and adopted as the criteria for an inspection of the object, for example, an inspection of solder joints on circuit boards. It is noted that some of the image sensors 121-125 may be omitted or disabled depending on the number of directional stereo information items required. In simple embodiments, the image acquisition component 120 may, for example, include only the image sensors 121-123.Alternatively, in some embodiments, the image capture component 120 may include only the image sensors 121, 122, and 125. In some other embodiments, the image capture component 120 may include only the image sensors 122-125.
[0050] In embodiments of the present invention, object 200 has at least one three-dimensional feature thereon. Object 200 may, for example, be a circuit board, and the three-dimensional feature may be a solder joint. Projector 140 may include a light source and a reticle having a pattern such that light emitted by the light source is partially shielded by the reticle, and light transmitted through the reticle includes the pattern. In some embodiments, image sensors 121-125 are capable of measuring the intensity of light reflected by object 200. Image sensors 121-125 are, for example, charged-coupled device (CCD) cameras, complementary metal-oxide-semiconductor (CMOS) image sensors, junction-gate field-effect transistor (JFET) imaging sensors, or other suitable light-sensitive devices.
[0051] Fig. Figure 4 is a schematic stereo view of an apparatus for three-dimensional examination according to some embodiments of the invention. The current embodiments are similar to the embodiments of Fig. 1, and the difference is that in the current embodiments, the image capture component 120 includes a static image sensor 126 and a movable image sensor 127 instead of the image sensors 121-125. The static image sensor 126 is located on the first axis D1 and is configured to capture the first image, and the movable image sensor 127 is configured to move from the second axis D2 to the third axis D3 to capture the second image and the third image.
[0052] In some embodiments, the second axis D2 and the third axis D3 have a similar angle X2 and X3, respectively, with respect to the upper surface 112 of the carrier 110, so that the movable image sensor 127 can be rotated horizontally from the position on the second axis D2 to the position on the third axis D3.
[0053] In some embodiments, as previously illustrated, more than the first to third images are captured, and the movable image sensor 127 is configured to capture the second image, the third image, the fourth image, and / or the fifth image along at least one of the second to fifth axes D2-D5, respectively. The movable image sensor 127 can move between the second to fifth axes D2-D5. In these embodiments, for example, some of the second axis D2, the third axis D3, and the fourth axis D4 can have a similar angle X2-X4 with respect to the top surface 112 of the carrier 110, such that the movable image sensor 127 can be rotated horizontally and moves to the free locations (i.e., dashed shapes). In some embodiments, the movable image sensor 127 can be rotated horizontally with respect to the first axis D1.However, in some other embodiments, the angle X2-X4 may not be the same and the movable image sensor 127 may move not only horizontally but also vertically.
[0054] It is noted that the image acquisition component 120 can be implemented in many ways to acquire the images along some of the first to fifth axes D1~D5, and not in the Fig. 1, Fig. 3 and Fig. 4. For example, the movable image sensor 127 may move between the first to fifth axes D1-D5, and the static image sensor 126 may be omitted.
[0055] Other details of the present embodiments are similar to those of Fig. 1 and are not repeated here.
[0056] Fig. 5 is a flowchart of a method 300 for a three-dimensional examination according to some embodiments of the invention. The method 300 includes steps 310-350 and is performed concurrently with Fig. 1 and / or Fig. 3 and / or Fig. 4 illustrates.
[0057] First, at step 310, the projector 140 projects a light pattern 140P onto an object 200. Fig.6 is a top view of a light pattern 140P on the object 200 according to some embodiments of the invention. The light pattern 140P projected onto the object 200 enables the captured images to be mapped more precisely later. In some embodiments, the light pattern 140P may be a striped pattern. In some embodiments, the light pattern 140P may be a random dot pattern, meaning that the light pattern 140P includes multiple dots randomly distributed. For the random dot pattern, the distributions of the dots on multiple parts of the object 200 are different and unique, so that each part of the object 200 is identifiable by the distribution of the dots thereon.
[0058] Furthermore, for the random point pattern, the points on the object 200 are arranged in a distribution such that the points in multiple regions of interest (ROIs) are uniquely arranged. That is, the points on one part of the object 200 have a distribution that is different from the points on any other part of the object. For example, the points in the region of interest (ROI) at a first position Q1 (indicated by the solid thick line) have a distribution that is different from that of the points in the region of interest (ROI) at a second position Q2 or any other position (indicated by the dashed thick line), where the region of interest (ROI) at the first position Q1 may overlap the region of interest (ROI) at the second position Q2.
[0059] Here, a first portion 210 of the object 200 corresponds to the region of interest ROI at the first position Q1, and a second portion 220 of the object 200 corresponds to the region of interest ROI at the second position Q2. The first portion 210 of the object 200 and the second portion 220 of the object 200 may or may not include the same feature of the object 200. In the current embodiments, the regions of interest ROI are located within the fields of view of the image sensors and may be associated with a portion of the captured image. The points of the light pattern 140P in the different regions of interest ROI are not limited to being distinguishably distributed. In some other embodiments, the regions of interest ROI may be distinguishable according to other factors.
[0060] In some situations, the inherent features of the object 200 are distinguishable and this step 310 can be omitted.
[0061] Second, at step 320, images of the first portion 210 of the object 200 are captured. As previously mentioned, the first through fifth images are captured along the first through fifth axes D1~D5. When the light pattern 140P is projected onto the object 200, capturing the first through fifth images of the object 200 involves capturing the light pattern 140P on the object 200.
[0062] Then, the first through fifth images of the first part 210 of the object 200 are analyzed at step 330 to obtain first directional stereo information and second directional stereo information of the first part 210 of the object 200. As previously mentioned, the specific image may be the first image, the fourth image, or any other images. The first directional stereo information and the second directional stereo information of the second part 220 of the object 200 may or may not be integrated into integrated stereo information. The analysis method is previously illustrated and is omitted here.
[0063] Next, at step 340, the region of interest ROI is moved to the second position Q2 of the object 200, and images of the second portion 220 of the object 200 are captured. As previously mentioned, the first through fifth images are captured along the first through fifth axes D1~D5. When the light pattern 140P is projected onto the object, capturing the first through fifth images of the object 200 involves capturing the light pattern 140P on the object 200.
[0064] Then, the first through fifth images of the second part 220 of the object 200 are analyzed at step 350 to obtain first directional stereo information and second directional stereo information of the second part 220 of the object 200. As previously mentioned, the specific image may be the first image, the fourth image, or any other images. The first directional stereo information and the second directional stereo information of the second part 220 of the object 200 may or may not be integrated into integrated stereo information. The analysis method is previously illustrated and is omitted here.
[0065] Through this configuration, stereo information of the first and second parts 210 and 220 of the object 200 is created, respectively. Note that more than two pieces of stereo information may be calculated and obtained, as previously illustrated and omitted here. The stereo information of the multiple parts of the object 200 may be processed and combined by the processor 130 into the integrated stereo information of the object.
[0066] In summary, according to embodiments of the invention, the appearance of the object is reconstructed from the first and second directional stereo information. The first and second directional stereo information can be obtained by calculating two pairs of images, each of which may share one of the images. Alternatively, the first and second directional stereo information can be obtained from two pairs of different images, each of which is different from the other. This configuration improves the accuracy of the object's examination.
[0067] Although the present invention has been described in considerable detail with reference to specific embodiments thereof, other embodiments are possible. Therefore, the spirit and scope of the appended claims should not be limited to the description of the embodiments contained herein.
[0068] It will be apparent to those skilled in the art that various modifications and variations can be made to the structure of the present invention without departing from the scope or spirit of the invention. In view of the foregoing, it is intended that the present invention cover modifications and variations of this invention, provided they fall within the scope of the following claims.
Claims
[1] Device (100) for a three-dimensional examination, comprising: a carrier (110) configured to hold an object (200); an image capture component (120) configured to capture a first image, a second image, and a third image of the object (200) along a first axis (D1), a second axis (D2), and a third axis (D3), respectively, wherein the image capture component (120) comprises a static image sensor (121; 126) and a movable image sensor (127), the static image sensor (121; 126) is located on the first axis (D1) for capturing the first image, and the movable image sensor (127) is configured to move from the second axis (D2) to the third axis (D3) to capture the second image and to take the third image, and wherein the first axis (D1), the second axis (D2) and the third axis (D3) are not parallel to each other and wherein the angle (X2) between the second axis (D2) and the upper surface (112) of the support (110) is the same as the angle (X3) between the third axis (D3) and the upper surface (112) of the support (110); a processor (130) configured to analyze the first image and the second image to obtain first directional stereo information, and is configured to analyze the third image and a specific image of the object (200) to obtain second directional stereo information, wherein a specific axis (D1) along which the specific image is captured is not parallel to the second axis (D2) or the third axis (D3); and a projector (140) configured to project a light pattern having a plurality of randomly distributed points onto the object (200), wherein the distributions of the points on multiple parts of the object (200) are different and unique, such that each part of the object (200) is identifiable by the distribution of the points thereon. [2] The device (100) of claim 1, wherein the particular image is the first image and the first axis (D1) is normal to the upper surface (112) of the support (110). [3] The apparatus (100) of claim 1, wherein the particular image is the first image and the third axis (D3) is located on a first plane (P1) formed by the first axis (D1) and the second axis (D2). [4] The apparatus (100) of claim 1, wherein the particular image is the first image and the third axis (D3) is not located on a first plane (P1) formed by the first axis (D1) and the second axis (D2). [5] The apparatus (100) of claim 4, wherein the image capture component (120) is further configured to capture a fourth image of the object (200) along a fourth axis (D4), the fourth axis (D4) not being parallel to the first, second, and third axes (D1, D2, D3), and the processor (130) is further configured to analyze the first image and the fourth image to obtain third directional stereo information, the third axis (D3) and the fourth axis (D4) each extending to opposite sides of the first plane (P1). [6] The apparatus (100) of claim 5, wherein the image capture component (120) is further configured to capture a fifth image of the object (200) along a fifth axis (D5), the fifth axis (D5) not being parallel to the first, second, third, and fourth axes (D1, D2, D3, D4), and the processor (130) is further configured to analyze the first image and the fifth image to obtain fourth directional stereo information, the second axis (D2) and the fifth axis (D5) each extending to opposite sides of a second plane (P2) formed by the third axis (D3) and the fourth axis (D4). [7] The apparatus (100) of claim 5, wherein the movable image sensor (127) is further configured to capture the fourth image along the fourth axis (D4). [8] The apparatus (100) of claim 1, wherein the image capture component (120) is further configured to capture a fourth image of the object (200) along a fourth axis (D4), and the particular image is the fourth image. [9] The device (100) of claim 1, wherein a first plane (P1) formed by the first axis (D1) and the second axis (D2) is vertical to the upper surface (112) of the support (110) and a second plane (P2) formed by the third axis (D3) and the particular axis (D1) along which the particular image is acquired is vertical to the upper surface (112) of the support (110). [10] The device (100) according to claim 1, wherein a first plane (P1) formed by the first axis (D1) and the second axis (D2) has an inclination angle with respect to the upper surface of the support, and the inclination angle is in a range of 80 degrees to 100 degrees. [11] The apparatus (100) of claim 1, wherein a first plane (P1) formed by the first axis (D1) and the second axis (D2) is not parallel to a second plane (P2) formed by the third axis (D3) and the particular axis (D1) along which the particular image is acquired. [12] A method (300) for a three-dimensional examination, comprising: Placing an object (200) on a carrier (110); Projecting a light pattern having a plurality of randomly distributed points onto the object (200), wherein the points on one part of the object (200) have a different distribution than the points on any other part of the object (200); Capturing a first image of the object (200) and the light pattern on the object (200) along a first axis (D1) by a static image sensor (121; 126); Capturing a second image of the object (200) and the light pattern on the object (200) along a second axis (D2) by a movable image sensor (127); Moving the movable image sensor (127) from the second axis (D2) to a third axis (D3) to capture a third image of the object (200) and the light pattern on the object (200) along the third axis (D3), wherein the first axis (D1), the second axis (D2) and the third axis (D3) are not parallel to each other and wherein an angle (X2) between the second axis (D2) and a top surface (121) of the carrier (110) is the same as the angle (X3) between the third axis (D3) and the top surface (112) of the carrier (110); analyzing the first image and the second image to obtain first directional stereo information; and Analyzing the third image and a specific image of the object (200) to obtain second directional stereo information, wherein a specific axis (D1) along which the specific image is taken is not parallel to the second axis (D2) or the third axis (D3). [13] The method (300) of claim 12, wherein the particular image is the first image.
Citation Information
Patent Citations
Device and process for three-dimensional localization and pose estimation using stereo image, and computer-readable storage medium storing the program thereof
US20110235897A1
