A camera module and its gyro gain determination method, device and chip

Abstract

The embodiment of the present invention provides a camera module and a method, device and chip for determining a gyro gain thereof. Compared with the current method that requires the use of a vibration table, it is necessary to fit the acquired multiple imaging data, and infer the gyro gain based on the fitting result. The embodiment of the present invention obtains the first imaging data when the lens generates a first displacement relative to the image sensor, and the second imaging data when the lens generates a second displacement relative to the image sensor. By determining the coordinate change between the first imaging data and the second imaging data, and determining the lens movement amount based on the first displacement and the second displacement, the gyro gain of the camera module can be determined based on the coordinate change and the lens movement amount. Since the first imaging data, the second imaging data, the first displacement and the second displacement are relatively easy to obtain, and there is no need to use a vibration table, the time for obtaining the gyro gain process is effectively shortened, thereby improving the efficiency of the gyro gain determination process.

Description

Technical Field

[0001] The present invention relates to the field of camera technology, and in particular to a camera module and a gyro gain determination method, device and chip thereof. Background Art

[0002] To ensure that the camera module achieves the anti-shake effect, the lens needs to be pushed in the opposite direction to the appropriate position according to the external shaking angle. In this process, the external shaking angle can be obtained through external electronic devices, such as real-time acquisition through a gyroscope, and the Hall sensor integrated in the VCM (Voice Coil Motor) can provide real-time feedback on the position of the lens.

[0003] The angle of external vibration and the offset of the voice coil motor controlling the movement of the lens satisfy a certain relationship, which is expressed by GyroGain (gyro gain). Therefore, determining Gyrogain is a crucial step in optical image stabilization calibration. When determining the optimal GyroGain, the existing technology mainly sets the GyroGain value gradually in a certain Gain value range, and calculates the suppression ratio (SuppressRatio, SR) in real time at a high frame rate in a vibration environment with the optical image stabilization function turned on. According to the relationship curve between each GyroGain value and the corresponding suppression ratio value, the Gain value corresponding to the maximum suppression ratio is fitted.

[0004] However, even for the same module, the Gain values ​​obtained from multiple measurements are not exactly the same, and the vibration table and machine required are independent of each other and difficult to integrate, which not only increases the hardware cost but also prolongs the test time, seriously affecting the test efficiency of the camera module. Summary of the invention

[0005] The embodiment of the present invention solves the technical problem of low efficiency in determining the gyro gain of a camera in the related art by providing a camera module and a gyro gain determination method, device and chip thereof.

[0006] In a first aspect, the present invention provides a method for determining the gyro gain of a camera module through an embodiment of the present invention, wherein the camera module includes a lens and an image sensor, and the method includes: obtaining first imaging data of the camera module when the lens generates a first displacement relative to the image sensor, and second imaging data of the camera module when the lens generates a second displacement relative to the image sensor; determining a coordinate change between the first imaging data and the second imaging data; determining a lens movement based on the first displacement and the second displacement; and determining the gyro gain of the camera module based on the coordinate change and the lens movement.

[0007] Preferably, the method also includes: when the camera module is in a stationary state, loading a first preset movement amount, and pushing the lens to move based on the loaded first preset movement amount so that the lens generates the first displacement relative to the image sensor; when the camera module is in a stationary state, loading a second preset movement amount, and pushing the lens to move based on the loaded second preset movement amount so that the lens generates the second displacement relative to the image sensor.

[0008] Preferably, determining the coordinate change between the first imaging data and the second imaging data includes: determining the first center coordinates of the first imaging data; determining the second center coordinates of the second imaging data; and determining the coordinate change based on the first center coordinates and the second center coordinates.

[0009] Preferably, determining the gyro gain of the camera module based on the coordinate change and the lens movement includes: determining a unit pixel offset parameter of the camera module; determining the number of pixel offsets of the camera module according to the coordinate change and the unit pixel offset parameter, and determining the offset angle of the camera module according to the coordinate change and the number of pixel offsets; determining the gyro gain of the camera module according to the lens movement and the offset angle.

[0010] Preferably, the determining the unit pixel offset parameter of the camera module comprises: determining the unit pixel offset parameter of the camera module based on the field of view angle of the lens and actual size data of the image sensor.

[0011] Preferably, the pixel shift number includes: a first pixel shift number of the camera module in a first direction, and a second pixel shift number in a second direction; wherein the first direction is perpendicular to the second direction; and the lens movement amount includes a first movement change amount in the first direction and a second movement change amount in the second direction;

[0012] Determining the offset angle of the camera module according to the coordinate change amount and the number of pixel offsets includes: determining a first direction offset angle of the camera module based on the first pixel offset number, and determining a second direction offset angle of the camera module based on the second pixel offset number;

[0013] The gyro gain of the camera module is determined according to the lens movement amount and the offset angle, comprising: determining the gyro gain of the camera module in the first direction according to the first direction offset angle and the first movement change; and determining the gyro gain of the camera module in the second direction according to the second direction offset angle and the second movement change.

[0014] Preferably, after determining the gyro gain of the camera module, it also includes: monitoring actual gyro parameters of the camera module, and when it is detected that the actual gyro parameters trigger anti-shake control, controlling the lens to produce corresponding displacement based on the actual gyro parameters and the gyro gain.

[0015] In a second aspect, the present invention provides a gyro gain determination device for a camera module through an embodiment of the present invention, wherein the camera module includes a lens and an image sensor, and the device includes:

[0016] An image acquisition unit, used to acquire first imaging data of the camera module when the lens generates a first displacement relative to the image sensor, and second imaging data of the camera module when the lens generates a second displacement relative to the image sensor;

[0017] A data processing unit is used to determine the coordinate change between the first imaging data and the second imaging data, determine the lens movement based on the first displacement and the second displacement, and determine the gyro gain of the camera module based on the coordinate change and the lens movement.

[0018] In a third aspect, the present invention provides a gyro gain determination chip through an embodiment of the present invention, which is applied to a camera module, wherein the camera module includes a lens and an image sensor, and the gyro gain determination chip includes a memory, a processor, and a code stored in the memory and executable on the processor, and the processor implements any implementation of the first aspect when executing the code.

[0019] In a fourth aspect, the present invention provides a camera module through an embodiment of the present invention, wherein the camera module includes an image sensor, a lens, a voice coil motor and the gyro gain determination chip in the third aspect.

[0020] One or more technical solutions provided in the embodiments of the present invention have at least the following technical effects or advantages:

[0021] The embodiment of the present invention can determine the coordinate change between the first imaging data and the second imaging data by acquiring the first imaging data of the camera module when the lens generates a first displacement relative to the image sensor, and the second imaging data of the camera module when the lens generates a second displacement relative to the image sensor. Based on the first displacement and the second displacement generated by the lens relative to the image sensor, the lens movement amount can also be determined. Finally, based on the coordinate change amount and the lens movement amount, the gyro gain of the camera module can be determined.

[0022] Compared with the current method of obtaining static line widths under multiple gain values, and obtaining a relationship curve between the gain value and the suppression ratio according to the relationship between the jitter angle and the offset, and then fitting the curve by a polynomial, the gain value corresponding to the maximum suppression ratio is determined as the gyro gain. In the embodiment of the present invention, the process of obtaining the first imaging data, the second imaging data, the first displacement and the second displacement is relatively simple, and the relevant data is also relatively easy to obtain, and there is no need to use a vibration table, which effectively shortens the time of obtaining the gyro gain process, thereby improving the efficiency of determining the gyro gain process. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0024] Figure 1 is a flow chart of a method for determining a gyro gain of a camera module in an embodiment of the present invention;

[0025] Figure 2 Schematic diagram of the imaging principle of the camera module in an embodiment of the present invention;

[0026] Figure 3 It is a schematic diagram of lens jitter in comparison technology;

[0027] Figure 4 It is a schematic diagram of obtaining the lens amplitude curve by using a gyroscope in the comparison technology;

[0028] Figure 5 is a schematic diagram of lens movement in an embodiment of the present invention;

[0029] Figure 6 is a schematic diagram of a lens movement curve in an embodiment of the present invention;

[0030] Figure 7 It is a schematic diagram of the relationship curve between the gyro gain value and the suppression ratio in the comparison technology;

[0031] Figure 8Schematic diagram of a relationship curve between a gyro gain value and a suppression ratio in an embodiment of the present invention;

[0032] Fig. 9 It is a schematic diagram comparing the gyro gain along the x-axis direction on a vibrating machine and a static machine;

[0033] Fig.10 It is a schematic diagram comparing the gyro gain along the y-axis direction on a vibrating machine and a static machine;

[0034] Fig.11 It is a schematic diagram comparing the suppression ratio along the x-axis direction on a vibrating machine and a static machine;

[0035] Fig.12 A schematic diagram showing the comparison of the suppression ratio along the y-axis direction on a vibrating machine and a static machine;

[0036] Fig.13 It is a schematic diagram of the comparison of gyro gains along the x-axis direction obtained on three different vibration tables in the comparison technology;

[0037] Fig.14 It is a schematic diagram of the comparison of gyro gain along the y-axis direction obtained on three different vibration tables in the comparison technology;

[0038] Fig.15 It is a schematic diagram of the comparison of the suppression ratio along the x-axis direction obtained on three different vibration tables in the comparison technology;

[0039] Fig.16 It is a schematic diagram of the comparison of the suppression ratio along the y-axis direction obtained on three different vibration tables in the comparison technology;

[0040] Fig.17 Schematic diagram of comparison of gyro gains along the x-axis direction obtained on three different machines in an embodiment of the present invention;

[0041] Fig.18 Schematic diagram of comparison of gyro gains along the y-axis direction obtained on three different machines in an embodiment of the present invention;

[0042] Fig.19 Schematic diagram of comparison of suppression ratios along the x-axis direction obtained on three different machines in an embodiment of the present invention;

[0043] Fig. 20 Schematic diagram of comparison of suppression ratios along the y-axis direction obtained on three different machines in an embodiment of the present invention;

[0044] Fig.21 This is a schematic diagram of the comparison of gyro gain along the x-axis direction obtained by performing 10 tests on three camera modules on the same machine in the comparison technology;

[0045] Fig. 22 This is a schematic diagram of the comparison of gyro gain along the y-axis direction obtained by performing 10 tests on 3 camera modules on the same machine in the comparison technology;

[0046] Fig.23 This is a schematic diagram of the comparison of gyro gains along the x-axis direction obtained by performing 10 tests on three camera modules on the same machine in an embodiment of the present invention;

[0047] Fig.24 This is a schematic diagram of the comparison of gyro gains along the y-axis direction obtained by performing 10 tests on three camera modules on the same machine in an embodiment of the present invention;

[0048] Fig.25 A schematic diagram of the structure of a gyro gain determination device for a camera module in an embodiment of the present invention;

[0049] Fig.26 A schematic diagram of a gyro gain determination chip structure in an embodiment of the present invention;

[0050] Fig. 27 Schematic diagram of a camera module structure in an embodiment of the present invention. DETAILED DESCRIPTION

[0051] The embodiment of the present invention solves the technical problem of low efficiency in determining the gyro gain of a camera in the related art by providing a camera module and a gyro gain determination method, device and chip thereof.

[0052] The technical solution provided by the embodiment of the present invention is to solve the above technical problems, and the overall idea is as follows:

[0053] First, the first imaging data of the camera module when the lens produces a first displacement relative to the image sensor, and the second imaging data of the camera module when the lens produces a second displacement relative to the image sensor are obtained. According to the first imaging data and the second imaging data, the coordinate change between the first imaging data and the second imaging data is determined. At the same time, based on the first displacement and the second displacement of the lens relative to the image sensor, the lens movement amount can also be determined. Finally, based on the coordinate change amount and the lens movement amount, the gyro gain of the camera module can be determined.

[0054] In order to better understand the above technical solution, the above technical solution will be described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0055] First of all, the term "and / or" in this article is only a description of the association relationship of the associated objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.

[0056] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the numbers used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein.

[0057] In a first aspect, the present invention provides a method for determining the gyro gain of a camera module through an embodiment of the present invention, which can be applied to a camera module including a lens and an image sensor, and aims to determine the gyro gain of the camera module without using a vibration table.

[0058] See also Figure 1 As shown, the method may include the following steps S101 to S103:

[0059] Step S101: acquiring first imaging data of the camera module when the lens generates a first displacement relative to the image sensor, and acquiring second imaging data of the camera module when the lens generates a second displacement relative to the image sensor.

[0060] Specifically, the first displacement may be a displacement when the lens moves parallel to the image sensor from the initial position to the first position. Correspondingly, the first imaging data may be image data acquired by the image sensor when the lens is located at the first position.

[0061] Specifically, the second displacement may be a displacement when the lens moves parallel to the image sensor from the initial position to the second position; or a displacement when the lens moves parallel to the image sensor from the first position to the second position. Correspondingly, the second imaging data may be image data acquired by the image sensor when the lens is located at the second position.

[0062] It should be noted that the initial position of the lens setting can be set according to the actual test needs. For example, the center position of the image sensor can be set as the initial position of the lens, or any position on the image sensor can be set as the initial position of the lens. In addition, the first position and the second position do not overlap.

[0063] Specifically, when the camera module is in a stationary state, a first preset movement amount may be loaded, and the lens may be pushed to move based on the loaded first preset movement amount, so that the lens generates a first displacement relative to the image sensor. And when the camera module is in a stationary state, a second preset movement amount may be loaded, and the lens may be pushed to move based on the loaded second preset movement amount, so that the lens generates a second displacement relative to the image sensor.

[0064] In a specific implementation process, a first preset movement amount can be loaded on the lens driving device so that the lens driving device can be used to control the translation of the lens relative to the image sensor, and when the lens generates a first displacement, the image sensor is used to obtain the first image data of the object being photographed at this time to obtain the first imaging data.

[0065] Similarly, a second preset movement amount can be loaded on the lens driving device to control the lens to translate relative to the image sensor using the lens driving device, and when the lens produces a second displacement, the image sensor is used to obtain second image data of the subject being photographed at this time to obtain second imaging data.

[0066] As an optional implementation, in the process of controlling the lens to translate using a lens driving device, after the lens generates a first displacement, the lens can be controlled to generate a second displacement in a direction opposite to the first displacement, so that the initial position, the first position and the second position are all on the same straight line.

[0067] Furthermore, the second preset movement amount can be set to be twice the first preset movement amount, so that the initial position is located at the midpoint of the line connecting the first position and the second position, and the difference between the first imaging data and the second imaging data obtained will be larger, which is more conducive to the subsequent determination of the coordinate change amount based on the first imaging data and the second imaging data.

[0068] For example, the driving device may be a voice coil motor, which utilizes a changing magnetic field to drive the lens to move relative to the image sensor.

[0069] Step S102: determining a coordinate change amount between the first imaging data and the second imaging data, and determining a lens movement amount based on the first displacement and the second displacement.

[0070] Regarding how to determine the coordinate variation, specifically, the first center coordinates of the first imaging data and the second center coordinates of the second imaging data may be determined; and then the coordinate variation is determined according to the first center coordinates and the second center coordinates.

[0071] In the specific implementation process, the imaging coordinates can be set in advance on the photographed object. In this way, when the first imaging data and the second imaging data are acquired by the image sensor, the first imaging data and the second imaging data both include coordinate information. Therefore, the first center coordinates and the second center coordinates can be determined, and then the coordinate change amount can be determined.

[0072] For example, if the lens is in the first position, the first imaging data is acquired through the image sensor, and the first center coordinates in the first imaging data are (x1, y1); if the lens is in the second position, the second imaging data is acquired through the image sensor, and the second center coordinates in the second imaging data are (x2, y2). The coordinate change can be obtained using the following formula (1):

[0073]

[0074] in, is the coordinate change; , is the first center coordinate in the first imaging data; , is the second center coordinate in the second imaging data.

[0075] As for how to determine the lens movement amount, as an optional implementation, the lens movement coordinates can be set for the movement of the lens, and correspondingly, the first position and the second position are both on the lens movement coordinates. In addition, the initial position can be set as the coordinate origin of the lens movement coordinates and the imaging coordinates, that is, (0, 0).

[0076] For example, if the coordinates of the first position are (a1, b1) and the coordinates of the second position are (a2, b2), the lens movement amount can be obtained using the following formula (2):

[0077]

[0078] in, is the lens movement amount; , is the coordinate of the first position; , is the coordinate of the second position.

[0079] In a specific implementation process, the Hall sensor can be used to obtain the coordinates of the first position and the second position. Optionally, the electromagnetic signal obtained by the Hall sensor can be converted into coordinate information, that is, the electromagnetic signal corresponding to the lens being at the first position is converted into the coordinates of the first position, and the electromagnetic signal corresponding to the lens being at the second position is converted into the coordinates of the second position.

[0080] It should be noted that the horizontal axis direction of the imaging coordinates is consistent with the horizontal axis direction of the lens movement coordinates, and the vertical axis direction of the imaging coordinates is consistent with the vertical axis direction of the lens movement coordinates.

[0081] In addition, in order to better understand the process of obtaining the above-mentioned coordinate changes and lens movement, a brief example is given below. In the specific implementation process, the lens movement can be represented by the ADC Code, but the Hall sensor can also obtain the position information of the voice coil motor, and after preset processing, such as analog-to-digital conversion, the Hall Code obtained is used to represent the lens movement.

[0082] For example, if the imaging coordinates and the lens movement coordinates both include the x-axis and the y-axis, the initial position is (0, 0), and the first position to which the lens is controlled to move is (xcode, ycode), and a picture is taken at the first position to obtain the first center coordinate (X1, Y1); then the lens movement amount during the process of the lens moving from the initial position to the first position is for , the coordinate change L corresponds to .

[0083] Similarly, if the initial position is (0, 0), the second position to which the lens is controlled to move is (-xcode, -ycode), and a picture is taken at the second position to obtain the second center coordinates (X2, Y2); then the lens movement amount during the translation from the initial position to the second position is for , the coordinate change L corresponds to .

[0084] In this way, the lens movement amount during the process of the lens moving from the first position to the second position can be obtained as:

[0085] ;

[0086] The coordinate change is:

[0087] ;

[0088] Among them, the lens movement amount in the x-axis direction is 2 , the lens movement in the y-axis direction is 2y ; The coordinate change in the x-axis direction is (X2-X1), and the coordinate change in the y-axis direction is (Y2-Y1).

[0089] Step S103: Determine the gyro gain of the camera module based on the coordinate change amount and the lens movement amount.

[0090] Specifically, the unit pixel offset parameter of the camera module can be determined first, and then the number of pixel offsets of the camera module can be determined based on the coordinate change and the unit pixel offset parameter, and the offset angle of the camera module can be determined based on the coordinate change and the number of pixel offsets. Finally, the gyro gain of the camera module can be determined based on the lens movement and the offset angle.

[0091] Regarding how to determine the unit pixel offset parameter, specifically, the unit pixel offset parameter of the camera module may be determined based on the field of view angle of the lens and the actual size data of the image sensor.

[0092] In the specific implementation process, different lenses correspond to different field of view angles. Generally speaking, the shape of the image sensor is rectangular, and the unit pixel offset parameter of the camera module can be determined by the following formula (3):

[0093]

[0094] in, It is the unit pixel offset parameter of the camera module; is the actual size data of the image sensor; is the maximum imaging length.

[0095] It should be noted that the unit pixel offset parameter represents the imaging size corresponding to each pixel. For example, if the actual number of pixel offsets in a camera is 17 and the corresponding imaging size is 170um, the unit pixel offset parameter of the camera module is 10um. If the coordinate values ​​on the imaging coordinates are known or can be obtained by measurement, the maximum imaging length can be calculated according to the above formula (1).

[0096] If the coordinate values ​​on the imaging coordinates are unknown or cannot be obtained by measurement, see Figure 2 As shown, the maximum imaging length can be calculated by the following formula (4):

[0097]

[0098] in, is the maximum imaging length; is the distance between the camera module and the imaging object; is the field of view.

[0099] After the unit pixel offset parameter is determined, the number of pixel offsets of the camera module can be determined based on the lens movement amount and the unit pixel offset parameter. For example, the following formula (5) can be used to obtain the number of pixel offsets:

[0100]

[0101] In formula (5), The number of pixel offsets corresponding to a unit offset angle; is the coordinate change corresponding to an offset angle of 1, ; It is the unit pixel offset parameter of the camera module.

[0102] Next, the offset angle of the camera module can be determined based on the coordinate change amount and the number of pixel offsets. Specifically, the offset angle can be obtained based on the ratio of the coordinate change amount to the number of pixel offsets.

[0103] For example, the offset angle can be calculated using the following formula (6):

[0104]

[0105] In formula (6), is the offset angle; is the coordinate change; The number of pixel offsets.

[0106] Finally, the gyro gain of the camera module can be obtained using the following formula (7):

[0107]

[0108] In formula (7), is the gyro gain; is the lens movement amount; is the offset angle; Is a constant.

[0109] in, It can be set according to actual needs and can be any real number between 0.12 and 0.14, such as 1000 / 8192.

[0110] In a specific implementation process, the number of pixel offsets may include: a first number of pixel offsets of the camera module in a first direction, and a second number of pixel offsets in a second direction.

[0111] Wherein, the first direction is perpendicular to the second direction. If the first direction is the horizontal axis of the imaging coordinate axis, the second direction is the vertical axis of the imaging coordinate axis; conversely, if the first direction is the vertical axis of the imaging coordinate axis, the second direction is the horizontal axis of the imaging coordinate axis.

[0112] In a specific implementation process, the lens movement amount may include a first movement change amount in a first direction and a second movement change amount in a second direction.

[0113] When determining the offset angle of the camera module, the first direction offset angle of the camera module can be determined based on the first pixel offset number, and the second direction offset angle of the camera module can be determined based on the second pixel offset number.

[0114] In the process of determining the gyro gain of the camera module, the gyro gain of the camera module in the first direction can be determined according to the first direction offset angle and the first movement change; the gyro gain of the camera module in the second direction can be determined according to the second direction offset angle and the second movement change.

[0115] As an optional implementation, after determining the gyro gain of the camera module, the actual gyro parameters of the camera module can also be monitored, and when it is detected that the actual gyro parameters trigger anti-shake control, the lens is controlled to produce corresponding displacement based on the actual gyro parameters and gyro gain.

[0116] Specifically, the anti-shake control may be triggered when it is detected that the actual gyro parameter is greater than a preset deflection angle.

[0117] During the anti-shake control process, the lens movement amount used to determine the lens movement distance can be obtained according to the actual gyro parameters and gyro gain. The lens is controlled to produce corresponding displacement based on the lens movement amount, which can effectively reduce the image offset during imaging of the image sensor, ensure the stable imaging of the camera module in a shaking environment, and achieve the image anti-shake effect.

[0118] In order to better understand the advantages of the embodiments of the present invention over the prior art in determining the optimal gyro gain, the technical solution of determining the optimal gyro gain by vibrating the vibration table is used as a comparative technology, and a brief description is given as follows:

[0119] First, please see Figure 3 As shown, when determining the optimal gyro gain, the comparison technology requires the vibration table and lens jitter, and the vibration amplitude of the vibration table, lens, object being photographed, and imaging satisfies the following relationship:

[0120]

[0121] in, is the lens shake amplitude; is the vibration amplitude of the vibration table; is the shaking amplitude of the photographed object; is the jitter amplitude of the image. Usually 0, when When , calculate the lens shake amplitude , and then get the optimal gyro gain.

[0122] Specifically, in the comparison technology, the gyroscope senses the vibration of the vibration table to obtain the amplitude data. Figure 4 As shown, the valid data only include the maximum and minimum values ​​in the waveform data, and the lens is controlled to perform reverse motion compensation through these data to obtain the best gyro gain.

[0123] Unlike the contrast technique, see Figure 5 As shown, in the embodiment of the present invention, when determining the optimal gyro gain, the vibration table does not need to vibrate, only the lens and the image need to move, and the movement amplitudes of the vibration table, the lens, the photographed object, and the image satisfy the following relationship:

[0124]

[0125] in, is the lens movement amplitude; is the vibration table movement amplitude; is the movement amplitude of the photographed object; is the movement amplitude of the image. and vibration table movement Usually 0, can be based on , calculate the lens movement range , and then get the optimal gyro gain.

[0126] Specifically, Figure 6 As shown, in the embodiment of the present invention, the best gyro gain can be obtained by controlling the lens to move a certain distance, for example, controlling the lens to move to a maximum amplitude.

[0127] Second, please see Figure 7 As shown, when the contrast technology determines the relationship curve between the gyro gain value and the suppression ratio, at least 5 gyro gain values ​​and 5 suppression ratio values ​​are required, and fitting is performed to ensure accuracy.

[0128] When determining the relationship between the gyro gain value and the image offset, see Figure 8 As shown, the embodiment of the present invention only needs 2 gyro gain values ​​and 1 image offset to ensure accuracy.

[0129] In addition, since the vibration table in the contrast technology will shake, its shaking can easily cause the lens and the image sensor to be non-parallel, causing the angle between the lens and the gyroscope to change. When determining the optimal gyroscope gain, the optimal gyroscope gain may not be the actual optimal gyroscope gain, that is, the imaging may be blurred.

[0130] In addition, the vibration of the vibration table can easily cause the image sensor to have blurred images, and it may be necessary to take multiple images to obtain a clear image, resulting in low efficiency of the contrast technology in obtaining the optimal gyro gain.

[0131] Third, the camera module is installed on a vibration machine (i.e., comparison technology) to test the best gyro gain, and the same camera module is installed on a static machine (an embodiment of the present invention) to test the best gyro gain, and the following is obtained: Figures 9 and 10 The gyro gain comparison chart shown in Figures 11-12 The inhibition ratio comparison graph is shown.

[0132] It can be seen that the results measured by the comparison technology and the embodiment of the present invention are not much different.

[0133] Fourth, the comparison technique requires a vibration table, but the present invention does not require a vibration table. If the same camera module is installed on different vibration tables for related tests, the results obtained will also vary. For example, if the same camera module is installed on vibration table 1, vibration table 2 or vibration table 3 for testing, the gyro gain comparison results obtained on these three vibration tables are as follows: Figures 13 and 14 As shown, the inhibition ratio comparison results are as follows Figures 15 and 16 shown.

[0134] It can be seen that the vibration table has a certain influence on the results of the comparison technology, that is, the gyro gain obtained by using different vibration tables for jitter test is not stable. Different vibration tables may also have different optimal gyro gains. Therefore, the credibility of the gyro gain obtained by using the comparison technology is not high.

[0135] The embodiment of the present invention does not need to use a vibration table. Even if the relevant tests are performed on different machines, the test results obtained are relatively stable, and the test results will not vary greatly due to different machines. For example, the same camera module is installed on machine 1, machine 2 or machine 3 for testing. The gyro gain comparison results obtained on these three machines are as follows: Figures 17 and 18 As shown, the inhibition ratio comparison results are as follows Figures 19 and 20 shown.

[0136] It can be seen that the machine has almost no effect on the results of the embodiment of the present invention, that is, the gyro gain obtained by testing with different machines is relatively stable, and the optimal gyro gain does not vary much for different machines. Therefore, the embodiment of the present invention does not have the problem of low reliability of gyro gain.

[0137] Fifth, since the contrast technology requires the vibration table to shake, it is easy to cause the lens and image sensor to be non-parallel, causing the angle between the lens and the gyroscope to change. As a result, in the process of determining the optimal gyro gain, the optimal gyro gain obtained is not stable. For example, three camera modules are installed on the same vibration table for related tests, and the gyro gain is obtained 10 times. Figures 21 and 22 The comparison chart of 10 gyro gain changes is shown.

[0138] The embodiment of the present invention does not require a vibration table, which will not cause the lens and the image sensor to be non-parallel, and will not cause the angle between the lens and the gyroscope to change. Therefore, in the process of determining the optimal gyro gain, the optimal gyro gain obtained is relatively stable. For example, the gyro gain corresponding to 10 related tests of 3 camera modules is obtained, and the following is obtained: Figure 23-24 The comparison chart of 10 gyro gain changes is shown.

[0139] It can be seen that even if the same camera module and the same vibration platform are used in the comparison technology, the gyro gain results obtained vary greatly, and the gyro gain is not stable. In contrast, in the embodiment of the present invention, the gyro gain of the same camera module varies less, so the gyro gain obtained by the embodiment of the present invention is more stable and more reliable.

[0140] In a second aspect, the present invention provides a gyro gain determination device for a camera module through an embodiment of the present invention. The camera module includes a lens and an image sensor.

[0141] See also Fig.25 As shown, the device comprises:

[0142] The image acquisition unit 301 is used to acquire first imaging data of the camera module when the lens generates a first displacement relative to the image sensor, and second imaging data of the camera module when the lens generates a second displacement relative to the image sensor.

[0143] The data processing unit 302 is used to determine the coordinate change between the first imaging data and the second imaging data, determine the lens movement based on the first displacement and the second displacement, and determine the gyro gain of the camera module based on the coordinate change and the lens movement.

[0144] As an optional implementation, the device further includes:

[0145] The lens driving unit 303 is used to load a first preset movement amount when the camera module is in a stationary state, and push the lens to move based on the loaded first preset movement amount so that the lens generates a first displacement relative to the image sensor; when the camera module is in a stationary state, load a second preset movement amount, and push the lens to move based on the loaded second preset movement amount so that the lens generates a second displacement relative to the image sensor.

[0146] As an optional implementation, the data processing unit 302 includes:

[0147] The coordinate data processing subunit is used to determine the first center coordinates of the first imaging data; determine the second center coordinates of the second imaging data; and determine the coordinate change amount according to the first center coordinates and the second center coordinates;

[0148] The gyro gain determination subunit is used to determine the unit pixel offset parameter of the camera module; the number of pixel offsets of the camera module is determined according to the coordinate change and the unit pixel offset parameter, and the offset angle of the camera module is determined according to the coordinate change and the number of pixel offsets; the gyro gain of the camera module is determined according to the lens movement and the offset angle.

[0149] As an optional implementation manner, the gyro gain determination subunit is specifically used for:

[0150] Determine the unit pixel offset parameter of the camera module based on the field of view angle of the lens and the actual size data of the image sensor;

[0151] Determine a first direction offset angle of the camera module based on the first pixel offset number, and determine a second direction offset angle of the camera module based on the second pixel offset number;

[0152] The gyro gain of the camera module in the first direction is determined according to the first direction offset angle and the first movement change; the gyro gain of the camera module in the second direction is determined according to the second direction offset angle and the second movement change.

[0153] As an optional implementation, the device further includes:

[0154] The anti-shake control unit 304 is used to monitor the actual gyro parameters of the camera module, and when it is detected that the actual gyro parameters trigger the anti-shake control, control the lens to produce a corresponding displacement based on the actual gyro parameters and the gyro gain.

[0155] Since the gyro gain determination method of the camera module introduced in this embodiment is a method adopted by the gyro gain determination device of the camera module in the embodiment of the present invention, based on the gyro gain determination method of the camera module introduced in the embodiment of the present invention, a person skilled in the art can understand the specific implementation method of the method of the present embodiment and its various variations, so how the method implements the method in the embodiment of the present invention will not be described in detail here. As long as a person skilled in the art implements the method adopted by the gyro gain determination device of the camera module in the embodiment of the present invention, it belongs to the scope of protection of the present invention.

[0156] In a third aspect, the present invention provides a gyro gain determination chip through an embodiment of the present invention, which is applied to a camera module. The camera module includes a lens and an image sensor. The gyro gain determination chip includes a memory, a processor, and a code stored in the memory and executable on the processor. When executing the code, the processor implements any implementation in the first aspect.

[0157] refer to Fig.26 As shown, the gyro gain determination chip provided in an embodiment of the present invention includes: a memory 401, a processor 402, and a code stored in the memory and executable on the processor 402. When executing the code, the processor 402 implements any implementation of the gyro gain determination method of the camera module described above.

[0158] Among them, Figure 4 In the embodiment of the present invention, a bus architecture (represented by bus 400) is shown, and bus 400 may include any number of interconnected buses and bridges, and bus 400 links various circuits including one or more processors represented by processor 402 and memory represented by memory 401. Bus 400 may also link various other circuits such as peripherals, voltage regulators, and power management circuits, which are well known in the art and are therefore not further described herein. Bus interface 405 provides an interface between bus 400 and receiver 403 and transmitter 404. Receiver 403 and transmitter 404 may be the same element, i.e., a transceiver, providing a unit for communicating with various other devices on a transmission medium. Processor 402 is responsible for managing bus 400 and general processing, while memory 401 may be used to store data used by processor 402 when performing operations.

[0159] In a fourth aspect, the present invention provides a camera module through an embodiment of the present invention, see Fig. 27 As shown, the camera module includes an image sensor 501, a lens 502, a voice coil motor 503 and a gyro gain determination chip 504 in the third aspect.

[0160] The technical solutions in the above embodiments of the present invention have at least the following technical effects or advantages:

[0161] Compared with the current method of obtaining static line widths under multiple gain values, and obtaining a relationship curve between the gain value and the suppression ratio according to the relationship between the jitter angle and the offset, and then fitting the curve by a polynomial, the gain value corresponding to the maximum suppression ratio is determined as the gyro gain. In the embodiment of the present invention, the process of obtaining the first imaging data, the second imaging data, the first displacement and the second displacement is relatively simple, and the relevant data is also relatively easy to obtain, and there is no need to use a vibration table, which effectively shortens the time of obtaining the gyro gain process, thereby improving the efficiency of determining the gyro gain process.

[0162] It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as methods, systems, or computer products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Furthermore, the present invention may take the form of a computer product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable code.

[0163] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer instructions. These computer instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0164] These computer instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0165] These computer instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable device provide for implementing the process. Figure 1A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0166] Although the preferred embodiments of the present invention have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present invention.

[0167] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. A method for determining a gyro gain of a camera module, characterized in that: The camera module includes a lens and an image sensor, and the method includes: Acquire first imaging data of the camera module when the lens generates a first displacement relative to the image sensor, and acquire second imaging data of the camera module when the lens generates a second displacement relative to the image sensor; Determine a coordinate change L between the first imaging data and the second imaging data; Determine a lens movement amount l based on the first displacement and the second displacement; Determining the gyro gain of the camera module based on the coordinate change amount and the lens movement amount includes: Determining a unit pixel offset parameter of the camera module; According to the coordinate change corresponding to the 1° offset angle and the unit pixel offset parameter, the pixel offset number of the camera module is determined, and the formula is as follows: in, The number of pixel offsets corresponding to a unit offset angle; is the coordinate change corresponding to a 1° offset angle, ; ℎ is the distance between the camera module and the imaging object; It is the unit pixel offset parameter of the camera module; is the actual size data of the image sensor; is the field of view; And according to the coordinate change and the number of pixel offsets, the offset angle of the camera module is determined, and the formula is as follows: in, is the offset angle; is the coordinate change; is the number of pixel offsets; The gyro gain of the camera module is determined according to the lens movement amount and the offset angle, and the formula is as follows: in, is the gyro gain; is the lens movement amount; is the offset angle; is a constant; The unit pixel offset parameter represents the imaging size corresponding to each pixel.

2. The method according to claim 1, characterized in that Also includes: When the camera module is in a stationary state, a first preset movement amount is loaded, and the lens is pushed to move based on the loaded first preset movement amount, so that the lens generates the first displacement relative to the image sensor; When the camera module is in a stationary state, a second preset movement amount is loaded, and the lens is pushed to move based on the loaded second preset movement amount, so that the lens generates the second displacement relative to the image sensor.

3. The method according to claim 1, characterized in that The determining of the coordinate change between the first imaging data and the second imaging data comprises: determining first center coordinates of the first imaging data; determining second center coordinates of the second imaging data; The coordinate change amount is determined according to the first center coordinate and the second center coordinate.

4. The method according to claim 1, characterized in that The determining of the unit pixel offset parameter of the camera module includes: Based on the field of view angle of the lens and the actual size data of the image sensor, a unit pixel offset parameter of the camera module is determined.

5. The method according to claim 1, characterized in that The number of pixel shifts includes: a first number of pixel shifts of the camera module in a first direction, and a second number of pixel shifts in a second direction; wherein the first direction is perpendicular to the second direction; and the lens movement includes a first movement change in the first direction and a second movement change in the second direction; The step of determining the offset angle of the camera module according to the coordinate change amount and the number of pixel offsets includes: Determine a first direction offset angle of the camera module based on the first pixel offset number, and determine a second direction offset angle of the camera module based on the second pixel offset number; The step of determining the gyro gain of the camera module according to the lens movement amount and the offset angle includes: Determining a gyro gain of the camera module in the first direction according to the first direction offset angle and the first movement change; The gyro gain of the camera module in the second direction is determined according to the second direction offset angle and the second movement change.

6. The method according to claim 1, characterized in that After determining the gyro gain of the camera module, the method further includes: The actual gyro parameters of the camera module are monitored, and when it is detected that the actual gyro parameters trigger anti-shake control, the lens is controlled to generate a corresponding displacement based on the actual gyro parameters and the gyro gain.

7. A gyro gain determination device for a camera module, characterized in that: The camera module includes a lens and an image sensor, and the device includes: An image acquisition unit, used to acquire first imaging data of the camera module when the lens generates a first displacement relative to the image sensor, and second imaging data of the camera module when the lens generates a second displacement relative to the image sensor; A data processing unit, configured to determine a coordinate change L between the first imaging data and the second imaging data, determine a lens movement l based on the first displacement and the second displacement, and determine a gyro gain of the camera module based on the coordinate change and the lens movement, comprising: Determining a unit pixel offset parameter of the camera module; According to the coordinate change corresponding to the 1° offset angle and the unit pixel offset parameter, the pixel offset number of the camera module is determined, and the formula is as follows: in, The number of pixel offsets corresponding to a unit offset angle; is the coordinate change corresponding to a 1° offset angle, ; ℎ is the distance between the camera module and the imaging object; It is the unit pixel offset parameter of the camera module; is the actual size data of the image sensor; is the field of view; And according to the coordinate change and the number of pixel offsets, the offset angle of the camera module is determined, and the formula is as follows: in, is the offset angle; is the coordinate change; is the number of pixel offsets; The gyro gain of the camera module is determined according to the lens movement amount and the offset angle, and the formula is as follows: in, is the gyro gain; is the lens movement amount; is the offset angle; is a constant; The unit pixel offset parameter represents the imaging size corresponding to each pixel.

8. A gyro gain determination chip, characterized in that: Applied to a camera module, the camera module includes a lens and an image sensor, the gyro gain determination chip includes a memory, a processor, and a code stored in the memory and executable on the processor, and the processor implements any one of the methods described in claims 1-6 when executing the code.

9. A camera module, characterized in that: The camera module includes an image sensor, a lens, a voice coil motor and the gyro gain determination chip as claimed in claim 8.

Images