Camera module active alignment method, system and medium

Abstract

The application discloses a camera module active alignment method, system and medium, and belongs to the camera imaging field. The method comprises the following steps: after the optical axis of the lens of the camera module and the center point of the image sensor are aligned, the lens and / or the image sensor are controlled to step at a first preset step size, so that the relative position of the lens and the image sensor in the direction of the optical axis changes, and the definition data collected by the camera module for the target region of interest of the test card is obtained; wherein the first edge region of interest of the test card is closer to the field center than the second edge region of interest; based on the definition data, the best imaging position and the attitude adjustment parameter between the lens and the image sensor are determined; and based on the best imaging position and the attitude adjustment parameter, the spatial position of the lens and / or the image sensor is adjusted, so that the lens and the image sensor are aligned. The application can improve the imaging quality of the AA process.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of camera imaging, in particular to a camera module active alignment method, system and medium. BACKGROUND

[0002] Camera AA (active alignment) process is to compensate for the front-end process assembly tolerance of the lens, and correct the offset and tilt of the lens and image sensor in X, Y and Z axes, so that the center axis of the lens and the center axis of the image sensor overlap, and then the lens and the image sensor are adjusted to the best relative position, and then the process such as dispensing, UV pre-curing and thermal curing is carried out.

[0003] For the lens, the imaging quality decreases from the center to the edge, so the existing camera AA method adjusts the lens based on the definition of the four corners of the lens field of view. However, due to the manufacturing tolerance of the lens itself, the imaging performance of the lens is not uniform, so using the definition of the four corners as the evaluation standard leads to the phenomenon that the imaging quality of the lens module after the AA process is still not uniform.

[0004] SUMMARY

[0005] The main purpose of the present application is to provide a camera module active alignment method, system and medium, which aims to solve the phenomenon of non-uniform imaging quality of the camera module caused by the performance of the existing lens.

[0006] To achieve the above purpose, the present application provides a camera module active alignment method, comprising:

[0007] After the optical axis of the lens of the camera module and the center point of the image sensor are aligned, the lens and / or the image sensor are controlled to step at a first preset step size, so that the relative position of the lens and the image sensor in the direction of the optical axis changes, and definition data collected by the camera module for the target interest region of the test chart is obtained; wherein the test chart has a plurality of target interest regions, and the plurality of target interest regions include at least three first edge interest regions and at least three second edge interest regions, the at least three first edge interest regions are arranged at intervals around the field of view center of the test chart, the at least three second edge interest regions are arranged at intervals around the field of view center, and the first edge interest region is closer to the field of view center than the second edge interest region;

[0008] Based on the definition data, the best imaging position and attitude adjustment parameters between the lens and the image sensor are determined;

[0009] Adjust a spatial position of the lens and / or the image sensor based on the optimal imaging position and the pose adjustment parameter, so that the lens and the image sensor are aligned.

[0010] In a possible implementation of the present application, the sharpness data includes first sharpness data of a first edge region of interest and second sharpness data of a second edge region of interest.

[0011] The pose adjustment parameter between the lens and the image sensor is determined based on the sharpness data, including:

[0012] A first weight of the first sharpness data is determined, and a second weight of the second sharpness data is determined.

[0013] The pose adjustment parameter is determined based on the first sharpness data and the corresponding first weight, and the second sharpness data and the corresponding second weight.

[0014] In a possible implementation of the present application, the optimal imaging position and the pose adjustment parameter between the lens and the image sensor are determined based on the sharpness data, including:

[0015] An optimal imaging interval and an initial adjustment parameter between the lens and the image sensor are determined based on the sharpness data.

[0016] A relative pose between the lens and the image sensor is adjusted according to the optimal imaging interval and the initial adjustment parameter.

[0017] The lens and / or the image sensor are controlled to step at a second preset step size, so that a relative position of the lens and the image sensor in a direction of the optical axis changes within the optimal imaging interval, and a plurality of accurate sharpness data collected by the camera module for the target region of interest are obtained; the second preset step size is smaller than the first preset step size.

[0018] The optimal imaging position and the pose adjustment parameter are determined based on the accurate sharpness data.

[0019] In a possible implementation of the present application, the lens and / or the image sensor are controlled to move, so that a relative position of the lens and the image sensor in a direction of the optical axis changes within the optimal imaging interval, and a plurality of accurate sharpness data collected by the camera module for the target region of interest are obtained, including:

[0020] The lens and / or the image sensor are controlled to step at a second preset step size, and a change trend of the sharpness data is monitored.

[0021] when it is monitored that two consecutive sharpness values in the sharpness data are in a downward trend, controlling the lens and / or the image sensor to stop moving and stay at the current position;

[0022] adjusting the spatial position of the lens and / or the image sensor based on the optimal imaging position and the posture adjustment parameter to align the lens and the image sensor, comprising:

[0023] controlling the lens or the image sensor to retreat two second preset steps from the corresponding current position to adjust to the optimal imaging position.

[0024] In an embodiment of the present application, after the optical axis of the lens of the camera module and the center point of the image sensor are aligned, the lens and / or the image sensor are controlled to step with a first preset step to change the relative position of the lens and the image sensor in the direction of the optical axis, before the method further comprises:

[0025] In a uniform light source environment, a light source image collected by the camera module is obtained;

[0026] Based on a preset brightness value, the light source image is divided into an inner circular region and an outer region by a binary method algorithm;

[0027] The lens and / or the image sensor are controlled to move until the center point of the image sensor and the center of the inner circular region are aligned, so that the optical axis of the lens and the center point of the image sensor are aligned.

[0028] In an embodiment of the present application, after the spatial position of the lens and / or the image sensor is adjusted based on the optimal imaging position and the posture adjustment parameter to align the lens and the image sensor, the method further comprises:

[0029] The dispensing assembly is controlled to move along a dispensing path corresponding to the current side edge of the substrate and apply glue on the substrate; wherein the starting point of the dispensing path and one end corner of the current side edge of the substrate have a first distance, and the ending point of the dispensing path and the other end corner of the current side edge of the substrate have a second distance;

[0030] The dispensing assembly is controlled to move to the next side edge of the substrate, the next side edge of the substrate is taken as the current side edge of the substrate, and the method of determining the current side edge of the substrate corresponding to the dispensing assembly is returned to be executed until all side edges of the substrate are dispensed.

[0031] In a possible embodiment of the present application, a distance between the center of the first edge region of interest and the center of the field of view is D1, a distance between the center of the second edge region of interest and the center of the field of view is D2, D1 satisfies: 0.8r>D1≥0.6r, D2 satisfies: D2≥0.8r, and r is a field of view radius of the lens.

[0032] In a second aspect, the present application also provides a camera module active alignment system, comprising: a controller, the controller comprising a processor, a memory, and a computer program stored in the memory, the computer program being implemented when the processor is running to realize the steps of the camera module active alignment method as described above.

[0033] In a possible embodiment of the present application, the camera module active alignment system comprises:

[0034] a first station, the first station comprising a test chart assembly, a first clamping assembly and a second clamping assembly, the first clamping assembly being used to clamp a lens of the camera module, the second clamping assembly being used to clamp an image sensor of the camera module, and the first clamping assembly and / or the second clamping assembly being movable to adjust a relative position and a relative attitude between the lens and the image sensor, the test chart assembly having a uniform light source, and the test chart assembly being detachably installed with a test chart;

[0035] a second station, the second station having a dispensing assembly; and

[0036] a camera module moving assembly, used to move the camera module from the first station to the second station.

[0037] The controller is connected with the test chart assembly, the first clamping assembly, the second clamping assembly, the dispensing assembly and the camera module moving assembly.

[0038] In a third aspect, the present application also provides a computer readable storage medium, the computer readable storage medium storing a computer program, the computer program being implemented when a processor is running to realize the camera module active alignment method as described above.

[0039] The camera module active alignment method provided in the embodiments of the present application comprises the following steps: after the optical axis of a lens of a camera module and the center point of an image sensor are aligned, the lens and / or the image sensor are controlled to step at a first preset step size, so that the relative position of the lens and the image sensor in the direction of the optical axis changes, and the definition data collected by the camera module for a target region of interest of a test chart is obtained; wherein the test chart has a plurality of target regions of interest, the plurality of target regions of interest comprise at least three first edge regions of interest and at least three second edge regions of interest, the at least three first edge regions of interest are arranged at intervals around the field of view center of the test chart, the at least three second edge regions of interest are arranged at intervals around the field of view center, and the first edge regions of interest are closer to the field of view center than the second edge regions of interest; based on the definition data, the best imaging position and the attitude adjustment parameter between the lens and the image sensor are determined; and based on the best imaging position and the attitude adjustment parameter, the spatial position of the lens and / or the image sensor is adjusted, so that the lens and the image sensor are aligned.

[0040] Therefore, compared with the existing camera module AA process, the best imaging position is found according to the definition of the four corners of the field of view 4 for active alignment, and in the AA process of the embodiments of the present application, the definition of the inner first edge region of interest closer to the field of view center and the outer second edge region of interest farther away from the field of view center in the field of view is comprehensively used for active alignment, so that the influence of the performance unevenness phenomenon caused by the manufacturing tolerance of the lens on the imaging quality in the AA process can be reduced, and the imaging quality of the AA process is improved. BRIEF DESCRIPTION OF DRAWINGS

[0041] Figure 1 The figure is a schematic diagram of the azimuth of the AA process of the lens and the image sensor of the present application;

[0042] Figure 2 The figure is a schematic diagram of the azimuth of the AA process of the lens and the image sensor of the present application; Figure 1 The figure is a schematic diagram of the structure of the controller of the camera module active alignment system;

[0043] Figure 3 The figure is a flowchart of the first embodiment of the camera module active alignment method of the present application;

[0044] Figure 4 The figure is a schematic diagram of the test chart of the present application;

[0045] Figure 5 The figure is a flowchart of the third embodiment of the camera module active alignment method;

[0046] Figure 6 The figure is a flowchart of the fourth embodiment of the camera module active alignment method;

[0047] Figure 7 A flowchart of a fifth embodiment of a camera module active alignment method;

[0048] Figure 8 A schematic diagram of the dispensing trajectory after optimization of the fifth embodiment of the camera module active alignment method.

[0049] The implementation, functional features and advantages of the present application will be further described with reference to the embodiments and the accompanying drawings. DETAILED DESCRIPTION

[0050] It should be understood that the specific embodiments described herein are merely intended to explain the present application and are not intended to limit the present application.

[0051] In the existing camera AA process, the clarity of the four corners in the field of view of the lens is used as the evaluation standard. This evaluation method lacks pertinence for the performance unevenness of the lens itself due to manufacturing errors.

[0052] To this end, the present application provides a solution. Compared with the existing camera module AA process, the best imaging position is found according to the clarity of the four corners of the field of view for active alignment. In the AA process of the embodiments of the present application, the clarity of the first edge interest region closer to the center of the field of view and the second edge interest region farther from the center of the field of view is comprehensively used for active alignment, so as to reduce the influence of the performance unevenness of the lens itself caused by manufacturing tolerance on the imaging quality in the AA process, and further improve the imaging quality of the AA process.

[0053] The inventive concept of the present application will be further described below in conjunction with some specific embodiments.

[0054] The camera module active alignment system comprises a first clamping assembly and a second clamping assembly. The first clamping assembly is used to clamp the lens of the camera module, and the second clamping assembly is used to clamp the image sensor of the camera module. The first clamping assembly and / or the second clamping assembly is movable to adjust the relative position and relative attitude between the lens and the image sensor,

[0055] Please refer to Figure 1In particular, the AA process of the camera module is mainly used to adjust the offsets of the lens and the image sensor in the X and Y directions, and the tilts in the X and Y axis directions, and find the best imaging distance of the lens and the image sensor in the Z axis direction, i.e. the best imaging position. The Z axis direction is the direction of the optical axis of the lens. When the Z axis also passes through the center of the image sensor, the center points of the lens and the image sensor are aligned. The X axis direction and the Y axis direction are both perpendicular to the Z axis direction, and the X axis and the Y axis are perpendicular to each other, so that the X axis and the Y axis form an XY plane perpendicular to the Z axis. The relative slope around the X axis and the relative slope around the Y axis are used to reflect whether the image sensor is tilted relative to the XY plane, that is, whether the posture of the image sensor and the lens is aligned.

[0056] The first clamping assembly can be configured as a jaw structure for clamping the lens along the circumference of the lens and keeping the optical axis of the lens aligned with the Z axis. It can be understood that in some embodiments, the first clamping assembly can further include a first Z-direction guide rail, a first X-direction guide rail and a first Y-direction guide rail. The first clamping assembly can move on the first Z-direction guide rail to make the jaw structure drive the lens to rise and fall in the Z axis direction. Of course, the first clamping assembly can also move relative to the first X-direction guide rail and / or the first Y-direction guide rail to make the jaw structure drive the lens to move in the XY plane, thereby adjusting the position of the lens in space.

[0057] The second clamping assembly can be configured as a fixed clamping platform, and the fixed clamping platform is located below the first clamping assembly, so that the image sensor can be moved to the fixed clamping platform by the sensor unit moving carrier and fixed. Then the lens and the image sensor are actively aligned by the spatial position of the first clamping assembly.

[0058] Alternatively, in another embodiment, the second clamping assembly can also be configured as a jaw structure for clamping the lens along the circumference of the lens and keeping the optical axis of the lens aligned with the Z axis. It can be understood that the second clamping assembly can further include a second Z-direction guide rail, a second X-direction guide rail and a second Y-direction guide rail. The second clamping assembly can move on the second Z-direction guide rail to make the jaw structure drive the image sensor to rise and fall in the Z axis direction. Of course, the second clamping assembly can also move relative to the second X-direction guide rail and / or the second Y-direction guide rail to make the jaw structure drive the image sensor to move in the XY plane, thereby adjusting the position of the image sensor in space. At this time, the positions of the lens and the image sensor in space can be adjusted simultaneously.

[0059] Of course, in some embodiments, the first clamping assembly can be configured as a fixed clamping platform, and the second clamping assembly can also be configured as a movable jaw structure, which is not limited in this embodiment.

[0060] In the embodiment, the camera module active alignment system further comprises a test chart assembly, the test chart assembly is used for detachably mounting a test chart, so that the misaligned camera module composed of the lens in the first clamping assembly and the image sensor in the second clamping assembly can collect a test picture for the test chart, and the clarity of the region of interest in the test chart is obtained based on the test picture. The test chart assembly will further comprise a uniform light source, so that the lens and the image sensor work in an environment with the uniform light source.

[0061] In the embodiment, the camera module active alignment system further comprises a dispensing assembly. It can be understood that the dispensing assembly is located on a dispensing station, so that after the lens and the image sensor complete active alignment, a dispensing process is performed on the substrate of the image sensor, and a curing process is performed, so as to fix the lens and the image sensor together.

[0062] In the embodiment, the camera module active alignment system further comprises a controller, the controller is connected with the first clamping assembly, the second clamping assembly, the dispensing assembly and the test chart assembly, to drive the first clamping assembly, the second clamping assembly, the dispensing assembly and the test chart assembly to perform the steps in the AA process.

[0063] As shown in Figure 2 The controller can include a processor 1001, such as a central processing unit (CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. The communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 can include a display, an input unit such as a keyboard, and can also include a standard wired interface, a wireless interface. The network interface 1004 can optionally include a standard wired interface, a wireless interface (such as a wireless fidelity (WIreless-FIdelity, WI-FI) interface). The memory 1005 can be a high-speed random access memory (RAM) memory, or a stable non-volatile memory (Non-Volatile Memory, NVM) such as a disk memory. The memory 1005 can also be a storage device independent of the aforementioned processor 1001.

[0064] Those skilled in the art can understand that Figure 2 The structure shown in the embodiment does not constitute a limitation on the controller, and can include more or fewer components than shown, or combine certain components, or different component arrangements.

[0065] As shown in Figure 2As shown, the memory 1005 as a storage medium can include an operating system, a data storage module, a network communication module, a user interface module, and a computer program.

[0066] In Figure 2 In the computer shown, the network interface 1004 is mainly used for data communication with a network server; the user interface 1003 is mainly used for data interaction with a user; the processor 1001 and the memory 1005 in the computer can be arranged in the computer, the computer calls the computer program stored in the memory 1005 through the processor 1001, and executes the computer method provided in the embodiment of the application.

[0067] In some embodiments, the camera module active alignment system includes a first station, a second station, and a camera module moving assembly. The first station includes a test chart assembly, a first clamping assembly, and a second clamping assembly. The second station has a dispensing assembly. The camera module moving assembly is used to move the camera module from the first station to the second station.

[0068] That is, in the embodiment of the application, OC adjustment and AA calibration are combined in the same station, reducing the back-and-forth movement of the lens and the image sensor, thereby reducing the decline in product AA precision caused by the movement of the camera module.

[0069] Based on the hardware structure of the camera module active alignment system described above but not limited to the hardware structure described above, the application provides a first embodiment of a camera module active alignment method. Referring to Figure 3 , Figure 3 The flowchart of the first embodiment of the camera module active alignment method of the application is shown.

[0070] It should be noted that although the logical order is shown in the flowchart, in some cases, the steps shown or described can be performed in an order different from that shown here.

[0071] In this embodiment, a camera module active alignment method includes:

[0072] Step S100, after the optical axis of the lens of the camera module and the center point of the image sensor are aligned, the lens and / or the image sensor are controlled to step at a first preset step size, so that the relative position of the lens and the image sensor in the direction of the optical axis changes, and the clarity data collected by the camera module for the target region of interest of the test chart is obtained.

[0073] In this embodiment, after the completion of the OC adjustment, i.e. the alignment of the optical axis of the lens and the center point of the image sensor of the camera module, the offset of the lens and the image sensor on the XY plane is corrected, and the AA process is started. At this time, the test chart assembly is placed with a test chart, the controller drives the first clamping assembly to drive the lens to move in the Z direction towards the image sensor, or the controller drives the second clamping assembly to drive the image sensor to move in the Z direction towards the lens, or the controller drives the first clamping assembly to drive the lens to move in the Z direction towards the image sensor, and drives the second clamping assembly to drive the image sensor to move in the Z direction towards the lens. The following is specifically described taking the controller driving the first clamping assembly to drive the lens to move in the Z direction towards the image sensor as an example. The lens gradually approaches the image sensor, thereby simulating the focusing process.

[0074] In this simulated focusing process, the clarity of each of the plurality of target regions of interest of the test chart changes, and the clarity curve drawn by the clarity of each target region of interest in the simulated focusing process has a rising stage before the peak point, the peak point and a falling stage after the peak point.

[0075] The plurality of target regions of interest include at least three first edge regions of interest and at least three second edge regions of interest, the at least three first edge regions of interest are arranged at intervals from each other around the field of view center of the test chart, the at least three second edge regions of interest are arranged at intervals from each other around the field of view center, and the first edge regions of interest are closer to the field of view center than the second edge regions of interest.

[0076] Please refer to Figure 4 , the center point of the test chart is the field of view center, which can be represented as 0F point, and there are target ROIs (regions of interest) at the corners of the test chart. In the simulated focusing process, the image sensor is used to capture the target ROIs, thereby obtaining the clarity of the target ROIs. In this embodiment, the target ROIs include first edge regions of interest, the first edge regions of interest include at least three, and the distances from the at least three first edge regions of interest to the field of view center are the same. The target ROIs also include second edge regions of interest, the second edge regions of interest also include at least three, and the distances from the at least three second edge regions of interest to the field of view center are the same. It is worth mentioning that the first edge regions of interest are closer to the field of view center than the second edge regions of interest, i.e. the first edge regions of interest are located inside the second edge regions of interest.

[0077] Since 3 points constitute a plane, the first edge interest region and the second edge interest region each include at least 3 points to reflect the relative pose between the image sensor and the lens. Of course, since the image sensor is generally configured as a rectangle, the test chart is also configured as a rectangle. At this time, in order to accurately adjust the pose of the image sensor in the XY plane, i.e., the rotation around the X direction and the rotation around the Y direction, the four corner regions of the test chart each have a first edge interest region inside and a second edge interest region outside.

[0078] In the simulation focusing process, the image sensor continuously acquires the test picture and obtains the definition of each first edge interest region and each second edge interest region in multiple test pictures, i.e., the definition data. In this embodiment, the definition of each target ROI is measured by SFR (spatial frequency response).

[0079] With the definition of the eight target ROIs as the ordinate and the Z-axis coordinate corresponding to each definition, eight definition curves can be drawn. Of course, it can be understood that please refer to Figure 4 In the AA process, the target ROI generally also includes a field center ROI located at the center of the field of view, so in addition to the definition data of the aforementioned eight target ROIs located at the edge of the field of view, the definition data of the field center ROI can also be added to draw nine definition curves together to accurately reflect whether the position of the image sensor and the lens is aligned. Since the lens and the image sensor are not aligned at this time, the coordinates of the peak points of the nine definition curves in the Z-axis direction may not be consistent, i.e., the best imaging positions corresponding to different target ROIs are different. In a specific embodiment, the distance between the center of the first edge interest region and the field center is D1, and the distance between the center of the second edge interest region and the field center is D2, D1 satisfies: 0.8r>D1≥0.6r, and D2 satisfies: D2≥0.8r, r is the field radius of the lens. That is, the center of the second edge interest region is located near the position of 80% of the field of view from the field center to the field edge, and the center of the second edge interest region is located in the region between the position of 60% of the field of view from the field center to the field edge and the position of 80% of the field of view from the field center to the field edge. Hereinafter, D1=0.6r and D2=0.8r are taken as examples for specific description.

[0080] Step S200, based on the definition data, determining the best imaging position between the lens and the image sensor and the pose adjustment parameter.

[0081] It can be understood that after the lens and the image sensor are aligned, the coordinates of the peak points of the 9 sharpness curves in the Z-axis direction should be approximately consistent, that is, the error between the coordinates of the peak points of the 9 sharpness curves in the Z-axis direction is within a preset error range.

[0082] Therefore, in order to make the coordinates of the peak points of the 9 sharpness curves in the Z-axis direction approximately consistent, the posture adjustment parameters for adjusting the image sensor to be flush with the XY plane can be calculated according to the actual coordinates of the 9 peak points of the 9 sharpness curves in the Z-axis direction. The posture adjustment parameters include a first rotation parameter around the X direction and / or a second rotation parameter around the Y direction. Of course, it can be understood that in the embodiment, the image sensor is fixed and the lens is adjusted in the spatial position under the first clamping assembly, so the posture adjustment parameters can be specifically the first rotation parameter of the lens around the X direction and / or the second rotation parameter of the lens around the Y direction.

[0083] And the optimal imaging position between the lens and the image sensor can also be calculated according to the actual coordinates of the 9 peak points of the 9 sharpness curves in the Z-axis direction.

[0084] In step S300, the spatial position of the lens and / or the image sensor is adjusted based on the optimal imaging position and the posture adjustment parameters, so that the lens and the image sensor are aligned.

[0085] After the optimal imaging position and the posture adjustment parameters are calculated, the lens can be driven to move to the optimal imaging position based on the optimal imaging position, and then the lens is adjusted to rotate around the X direction and / or rotate around the Y direction based on the posture adjustment parameters, until the lens and the image sensor are aligned.

[0086] It can be seen that, compared with the existing camera module AA process, in which the optimal imaging position is found according to the sharpness of the four corner ROIs of the field of view for active alignment, in the AA process of the present embodiment, each corner of the test chart has an inner first edge of interest region closer to the center of the field of view and an outer second edge of interest region farther away from the center of the field of view, so that the coverage of the target interest region in the field of view can be improved. At this time, the active alignment is comprehensively performed according to the sharpness of the multiple target interest regions, which can reduce the influence of the performance unevenness of the lens itself caused by the manufacturing tolerance on the imaging quality in the AA process, and further improve the imaging quality of the AA process, so that the imaging quality of each point in the field of view is more uniform.

[0087] Based on the first embodiment of the active alignment method of the camera module, the second embodiment of the active alignment method of the camera module is proposed. It should be noted that although the logical order is shown in the flowchart, in some cases, the steps shown or described can be performed in an order different from that shown here.

[0088] In this embodiment, step S200 specifically includes:

[0089] Step S201, determining a first weight of the first sharpness data and a second weight of the second sharpness data.

[0090] Step S202, determining the pose adjustment parameter based on the first sharpness data and the corresponding first weight, and the second sharpness data and the corresponding second weight.

[0091] Specifically, the sharpness data at least includes the first sharpness data of the first edge interest region and the second sharpness data of the second edge interest region. That is, including 4 first sharpness curves of 4 first edge interest regions and 4 second sharpness curves of 4 second edge interest regions. At this time, if the adjustment target is to make the coordinates of the peak points of the 8 sharpness curves consistent in the Z-axis direction, it will lead to the increase of the calculation difficulty and complexity. In particular, due to the uneven performance of the lens itself, there may be a case that the directions of the pose adjustment parameters calculated by the first sharpness data and the second sharpness data are opposite, which will also lead to a sharp increase in the calculation difficulty and complexity.

[0092] In order to reduce the calculation difficulty and improve the AA efficiency, the embodiment gives the first sharpness data a first weight and the second sharpness data a second weight, and the values of the first weight and the second weight are different, so as to reduce the calculation difficulty and complexity by different weights.

[0093] At this time, if the predicted pose adjustment parameter predicted according to the 4 first sharpness data and the 4 second sharpness data can make the 4 first edge interest regions and the 4 second edge interest regions all achieve the best imaging effect, the predicted pose adjustment parameter is taken as the pose adjustment parameter. If the predicted pose adjustment parameter predicted according to the 4 first sharpness data and the 4 second sharpness data cannot make the 4 first edge interest regions and the 4 second edge interest regions all achieve the best imaging effect, then according to the value size relationship of the first weight and the second weight, the sharpness data with the greater weight value is used to mainly calculate the pose adjustment parameter.

[0094] It can be understood that, since the second edge interest region is closer to the edge of the field of view, in order to improve the imaging effect, the value of the second weight corresponding to the second edge interest region is greater than that of the first edge interest region.

[0095] As in an example, the first definition data is given a weight value of 0.4, and the second definition data is given a weight value of 0.6, and then the first definition data and the second definition data are calculated according to the weight value of 0.6 and the weight value of 0.4. At this time, since the weight value corresponding to the first definition data is greater than the weight of the second definition data, the first definition data is mainly considered.

[0096] Please refer to Figure 5 Based on the above embodiment, the third embodiment of the active alignment method of the camera module is proposed. It should be noted that although the logical sequence is shown in the flowchart, in some cases, the steps shown or described can be performed in an order different from that shown here.

[0097] In this embodiment, step S300 specifically includes:

[0098] Step S310, based on the definition data, determining the best imaging interval and the initial adjustment parameter between the lens and the image sensor.

[0099] Step S320, adjusting the relative attitude between the lens and the image sensor according to the best imaging interval and the initial adjustment parameter.

[0100] Step S330, controlling the lens and / or the image sensor to step with a second preset step size, so that the relative position of the lens and the image sensor in the direction of the optical axis changes within the best imaging interval, and a plurality of accurate definition data collected by the camera module for the target region of interest is obtained.

[0101] Wherein, the second preset step size is smaller than the first preset step size.

[0102] Step S340, determining the best imaging position and the attitude adjustment parameter based on the accurate definition data.

[0103] Specifically, the AA process in this embodiment includes two stages, the first stage is the coarse scanning stage, and the second stage is the fine scanning stage.

[0104] When the controller performs step S310, it will determine a best imaging interval and an initial adjustment parameter according to the definition data of the 8 target regions of interest. The best imaging interval can be determined according to the peak points of the 8 definition curves. As in an example, the peak point in the middle region of the 8 peak points in the 8 definition curves can be taken as the reference point, and then the best imaging interval can be obtained by taking values to the left and right sides of the peak point according to the interval length. Of course, it can be understood that the interval length can be a preset value, such as 10 microns, or it can also be obtained according to the maximum Z-direction distance between the peak points of the 8 definition curves, such as equal to the maximum Z-direction distance between the peak points of the 8 definition curves.

[0105] Then, when performing step S320, the first clamping assembly is driven to move in the Z direction, driving the lens to move into the optimal imaging region. Then, the attitude between the lens and the image sensor is roughly adjusted according to the initial adjustment parameter, that is, the XY plane tilt correction is roughly performed.

[0106] Thereafter, the fine scanning phase is entered, at which time, when performing step S330, the controller drives the lens to step in the direction of approaching the image sensor at a second preset step size on the far side of the optimal imaging region. The second preset step size is smaller than the first preset step size, so as to perform accurate AA scanning and improve the AA accuracy. As in an example, the first preset step size can be 3 microns, and the second preset step size can be 1 micron. During the fine scanning process, the controller also obtains a plurality of accurate sharpness data collected by the camera module for the target region of interest. That is, 8 accurate sharpness curves are obtained.

[0107] Then, when performing step S340, the controller determines the optimal imaging position and the attitude adjustment parameter based on the accurate sharpness data.

[0108] As can be seen, the present embodiment divides the existing AA process into two phases of coarse scanning and fine scanning. The first coarse scanning is to find the interval in which the approximate optimal imaging position of the lens and the image sensor is located, and then the second fine scanning is to accurately find the optimal imaging position, so as to improve the accuracy of the AA process.

[0109] In addition, in the present embodiment, when performing step 330, the controller controls the lens and / or the image sensor to step at the second preset step size, and monitors the change trend of the sharpness data; when it is monitored that the two consecutive sharpness values in the sharpness data are both in a downward trend, the lens and / or the image sensor are controlled to stop moving and stay at the current position.

[0110] At this time, when performing step S300, the controller controls the lens or the image sensor to retreat two second preset step sizes from the corresponding current position, so as to be adjusted to the optimal imaging position.

[0111] As in the present embodiment, the image sensor is fixed and immovable, and the lens moves in the positive direction of the Z axis, away from the image sensor to approach the image sensor, to simulate focusing. When performing fine scanning, when it is monitored that the two consecutive sharpness values in the sharpness data are both in a downward trend, the lens is controlled to stay at the current position. Obviously, the current position of the lens and the optimal imaging position are only two preset second step sizes apart. Therefore, when performing step S300, the lens is controlled to move two second preset step sizes in the reverse direction on the Z axis, so as to move to the optimal imaging position.

[0112] That is, in the embodiment, the clarity of the target region of interest is obtained during the control of the movement of the lens and / or image sensor, and the clarity region is drawn in real time to obtain the change trend of the clarity data. When it is monitored that the two consecutive clarity values in the clarity data are in a downward trend, that is, the peak point has been passed, the control of the movement of the lens and / or image sensor is stopped, and the best imaging position is returned to maximize the precision of the AA process.

[0113] It is worth mentioning that after adjustment, it is also necessary to determine whether the effect (clarity, posture between the lens and the image sensor, etc.) of the adjustment reaches the preset effect. If the expected effect is reached, the AA process is completed, and if the expected effect is not reached, the step S320 is returned to perform fine scanning again until the required preset effect is reached, and then the AA process is completed.

[0114] Based on the above embodiment, the fourth embodiment of the active alignment method of the camera module of the application is proposed. Please refer to Figure 6 , Figure 6 The flowchart of the fourth embodiment of the active alignment method of the camera module of the application is shown in the figure.

[0115] It should be noted that although the logical order is shown in the flowchart, in some cases, the steps shown or described can be performed in an order different from that shown here.

[0116] In the embodiment, before the step S100, the method further comprises:

[0117] Step S70, in a uniform light source environment, a light source image collected by the camera module is obtained.

[0118] Step S80, based on a preset brightness value, the light source image is divided into an inner circular region and an outer region by combining a binary method algorithm.

[0119] Step S90, the lens and / or image sensor is controlled to move until the center point of the image sensor and the center of the inner circular region are aligned, so that the optical axis of the lens and the center point of the image sensor are aligned.

[0120] Specifically, in the embodiment, when the lens and the image sensor are moved to the first station and clamped by the first clamping assembly and the second clamping assembly respectively, the controller controls the uniform light source to be turned on to provide a uniform light source environment. At this time, no test chart is placed on the test chart assembly, and therefore the camera module captures a blank light source image. At this time, due to the performance of the lens, the brightness value of the center of the field of view of the lens is greater than the brightness value of the edge of the field of view of the lens. Therefore, if the brightness of the light source image is divided into 256 parts from dark to light, i.e. 0-255 intensity values, at this time, the brightness value of the center of the field of view is 255, and the brightness value of the edge of the field of view of the lens is 0. When the controller executes step S80, a brightness value is taken as a preset brightness value, for example, the brightness 150 of the 0.3r region is taken as the preset brightness value. At this time, in the field of view of the lens, the region with a brightness of 150 forms a circle, and the light source image can be divided into an inner circular region and an outer region based on the inner circular region, and the optical axis of the lens can be determined. Then the lens and / or the image sensor are moved until the center point of the image sensor and the center of the circle are aligned, so that the optical axis of the lens and the center point of the image sensor are aligned, and the OC adjustment process is completed.

[0121] In addition, in order to improve the accuracy of the optical axis determination, when step S80 is executed, the image can be segmented based on the binary method, specifically, the brightness values of the inner circular region with a brightness higher than the preset brightness value in the light source image, i.e. 150-255, are all set to 255, and finally the inner circular region is fully bright to become an approximate absolute bright region, and the brightness values of the outer region lower than the preset brightness are all set to 0, thereby becoming an approximate absolute dark region. In this way, a clear circle is formed in the 0.3r region. The center of the circle is the optical axis of the lens, i.e. the optical center of the lens.

[0122] As can be seen, in the embodiment, the optical axis is determined based on the brightness value distribution of the light source image, so that the OC adjustment and the AA calibration are combined into the same station, the movement of the camera module between different stations is reduced, and the accuracy of the AA process is also improved.

[0123] Based on the above embodiment, the fifth embodiment of the active alignment method of the camera module is proposed. Please refer to Figure 7 , Figure 7 FIG. 4 is a flowchart of the fifth embodiment of the active alignment method of the camera module.

[0124] It should be noted that although the logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0125] In the embodiment, after step S300, the following steps are further included:

[0126] Step S400, controlling the dispensing assembly to move along the dispensing path corresponding to the current side edge of the substrate, and applying glue on the substrate.

[0127] The starting point of the dispensing path and one end corner of the current side edge of the substrate have a first distance, and the ending point of the dispensing path and the other end corner of the current side edge of the substrate have a second distance.

[0128] Step S500, controlling the dispensing assembly to move to the next side edge of the substrate, taking the next side edge of the substrate as the current side edge of the substrate, and returning to execute step S400 until all side edges of the substrate have been dispensed.

[0129] Specifically, after the optimal imaging position between the lens and the image sensor is found, dispensing is performed to fix the lens and the image sensor to each other to complete assembly.

[0130] Please refer to Figure 8 That is, in the embodiment, the dispensing assembly does not complete dispensing of the four side edges of the substrate along a closed dispensing path, but divides the dispensing paths into a corresponding number of dispensing paths according to the number of side edges of the substrate. It is worth mentioning that the starting point of the dispensing path corresponding to each current side edge of the substrate and one end corner of the current side edge of the substrate have a first distance, and the ending point of the dispensing path and the other end corner of the current side edge of the substrate have a second distance, that is, the plurality of dispensing paths are not connected to each other, so as to not form a closed dispensing path. In this way, when the dispensing assembly dispenses, the corners of the substrate of the image sensor are not dispensed. That is, when the dispensing assembly dispenses, the dispensing assembly stops dispensing when it moves to the corner of the substrate, and only after the dispensing assembly completes the turning operation, dispensing of the next basic side edge begins.

[0131] As can be seen, the dispensing assembly dispenses more glue when turning, resulting in more glue in the corners of the lens and the image sensor product, causing uneven product bonding force and even glue overflow and glue leakage. In the embodiment, the dispensing trajectory of the dispensing assembly is optimized, and dispensing at the corner turning position is cancelled, thereby ensuring the uniformity of the glue when dispensing to improve the uneven product bonding force and even glue overflow and glue leakage, thereby ensuring the strength of the camera module product.

[0132] In addition, the embodiment of the present application further provides a computer storage medium, and the computer storage medium stores a computer program. The computer program is executed by a processor to implement the steps of the camera module active alignment method described above. Therefore, the description will not be repeated here. In addition, the description of the beneficial effects of using the same method will not be repeated. For technical details not disclosed in the computer readable storage medium embodiments involved in the present application, please refer to the description of the method embodiments of the present application. It is determined that the program instructions can be deployed to execute on one computing device, or on multiple computing devices located in one place, or on multiple computing devices distributed in multiple places and interconnected through a communication network.

[0133] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by a computer program instructing related hardware. The above-mentioned program can be stored in a computer readable storage medium. When the program is executed, it can include the processes of the above-mentioned embodiment methods. The storage medium can be a magnetic disc, an optical disc, a read-only memory (ROM) or a random access memory (RAM).

[0134] In addition, it should be noted that the device embodiments described above are only schematic, and the units described as separate components can or can not be physically separated, and the components shown as units can or can not be physical units, that is, they can be located in one place or distributed on multiple network units. Part or all of the modules can be selected according to actual needs to achieve the purpose of the present embodiment. In addition, the connection relationship between the modules in the device embodiment provided by the present application indicates that there is a communication connection between them. Specifically, it can be implemented as one or more communication buses or signal lines. Those skilled in the art can understand and implement it without creative labor.

[0135] Those skilled in the art can clearly understand the application by the description of the above embodiments, and the application can be realized by means of software and necessary universal hardware, of course, can also be realized by special hardware including special integrated circuit, special CPU, special memory, special component and the like. Generally, the functions completed by computer program can be easily realized by corresponding hardware, and the specific hardware structure for realizing the same function can also be various, for example, analog circuit, digital circuit or special circuit and the like. However, for the application, the software program implementation is a better embodiment. Based on such understanding, the technical solutions of the application can be embodied in the form of software product, and the computer software product is stored in a readable storage medium, such as a floppy disk, a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and the like, including a plurality of instructions for enabling a computer device (which can be a personal computer, a server or a network device, etc.) to execute the method of each embodiment of the application.

[0136] The above is only the preferred embodiment of the application, and does not limit the patent scope of the application, and any equivalent structure or equivalent process transformation using the content of the specification and drawings, or direct or indirect application in other related technical fields, are also included in the patent protection scope of the application.

Claims

1. A method for active alignment of a camera module, characterized in that, include: After the optical axis of the camera module lens and the center point of the image sensor are aligned, the lens and / or the image sensor are controlled to move in a first preset step size to change the relative position of the lens and the image sensor in the direction of the optical axis, thereby obtaining the sharpness data collected by the camera module for the target region of interest of the test chart; wherein, the test chart has multiple target regions of interest, including at least three first edge regions of interest and at least three second edge regions of interest, the at least three first edge regions of interest are arranged around the center of the field of view of the test chart at intervals, the at least three second edge regions of interest are arranged around the center of the field of view at intervals, and the first edge regions of interest are closer to the center of the field of view than the second edge regions of interest, and the change in relative position is used to simulate the focusing process; Based on the resolution data, the optimal imaging position and attitude adjustment parameters between the lens and the image sensor are determined. The optimal imaging position is the position of the optimal imaging distance between the lens and the image sensor on the Z-axis, and the attitude adjustment parameters are the parameters for adjusting the image sensor to be flush with the XY plane. Based on the optimal imaging position and the attitude adjustment parameters, adjust the spatial position of the lens and / or the image sensor to align the lens and the image sensor.

2. The active alignment method for a camera module according to claim 1, characterized in that, The sharpness data includes first sharpness data of the first edge region of interest and second sharpness data of the second edge region of interest; The step of determining the attitude adjustment parameters between the lens and the image sensor based on the sharpness data includes: A first weight is determined for the first resolution data, and a second weight is determined for the second resolution data; wherein the values ​​of the first weight and the second weight are different; The attitude adjustment parameters are determined based on the first sharpness data and the corresponding first weight, and the second sharpness data and the corresponding second weight.

3. The active alignment method for a camera module according to claim 1, characterized in that, The process of determining the optimal imaging position and attitude adjustment parameters between the lens and the image sensor based on the sharpness data includes: Based on the resolution data, the optimal imaging range and initial adjustment parameters between the lens and the image sensor are determined; The relative orientation between the lens and the image sensor is adjusted according to the optimal imaging range and the initial adjustment parameters. The lens and / or the image sensor are controlled to move in a second preset step size, so that the relative position of the lens and the image sensor in the direction of the optical axis changes within the optimal imaging range, thereby obtaining multiple accurate sharpness data collected by the camera module for the target region of interest; wherein the second preset step size is smaller than the first preset step size; Based on the accurate resolution data, the optimal imaging position and the attitude adjustment parameters are determined.

4. The active alignment method for a camera module according to claim 3, characterized in that, The control of the lens and / or the image sensor to advance in a second preset step size causes the relative position of the lens and the image sensor in the direction of the optical axis to change within the optimal imaging range, thereby obtaining multiple accurate sharpness data acquired by the camera module for the target region of interest, including: Control the lens and / or the image sensor to move in steps of a second preset size, and monitor the changing trend of the sharpness data; When it is detected that two consecutive sharpness values ​​in the sharpness data show a downward trend, the lens and / or the image sensor are controlled to stop moving and remain at the current position. The step of adjusting the spatial position of the lens and / or the image sensor based on the optimal imaging position and the attitude adjustment parameters to align the lens and the image sensor includes: Control the lens or the image sensor to move back two second preset steps from the corresponding current position to adjust to the optimal imaging position.

5. The active alignment method for a camera module according to claim 1, characterized in that, Before obtaining the sharpness data acquired by the camera module for the target region of interest of the test chart after aligning the optical axis of the lens and the center point of the image sensor, the method further includes: In a uniform light source environment, acquire the light source image captured by the camera module; Based on a preset brightness value and combined with a binary algorithm, the light source image is divided into an inner circular region and an outer region. Control the movement of the lens and / or the image sensor until the center point of the image sensor and the center of the inner circular area are aligned, so that the optical axis of the lens and the center point of the image sensor are aligned.

6. The active alignment method for a camera module according to claim 1, characterized in that, After adjusting the spatial position of the lens and / or the image sensor based on the optimal imaging position and the attitude adjustment parameters to align the lens and the image sensor, the method further includes: The dispensing assembly is controlled to move along the dispensing path corresponding to the side edge of the current substrate and apply adhesive to the substrate; wherein the starting point of the dispensing path and one corner of the side edge of the current substrate have a first distance, and the ending point of the dispensing path and the other corner of the side edge of the current substrate have a second distance. The dispensing assembly is controlled to move to the next substrate side, which is then used as the current substrate side. The process then returns to control the dispensing assembly to move along the dispensing path corresponding to the current substrate side and apply adhesive to the substrate until all sides of the substrate have been dispensed.

7. The active alignment method for a camera module according to any one of claims 1 to 6, characterized in that, The distance between the center of the first edge interest region and the center of the field of view is The distance between the center of the second edge interest region and the center of the field of view is , satisfy: , satisfy: , Let be the field of view radius of the lens.

8. A camera module active alignment system, characterized in that, include: A controller, comprising a processor, a memory, and a computer program stored in the memory, the computer program being executed by the processor to implement the steps of the camera module active alignment method as described in any one of claims 1 to 7.

9. The camera module active alignment system according to claim 8, characterized in that, include: The first workstation includes a test pattern card assembly, a first clamping assembly, and a second clamping assembly. The first clamping assembly is used to clamp the lens of the camera module, and the second clamping assembly is used to clamp the image sensor of the camera module. The first clamping assembly and / or the second clamping assembly are movable to adjust the relative position and relative orientation between the lens and the image sensor. The test pattern card assembly has a uniform light source, and the test pattern card assembly is detachably mounted with a test pattern card. A second workstation, the second workstation having a dispensing assembly; and A camera module moving assembly is used to move the camera module from the first workstation to the second workstation; The controller is connected to the test chart assembly, the first clamping assembly, the second clamping assembly, the dispensing assembly, and the camera module moving assembly.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, implements the active alignment method for a camera module as described in any one of claims 1 to 7.

Images