Imaging method, imaging device and electronic equipment

Abstract

An imaging method, an imaging device and an electronic device are disclosed, wherein the imaging method comprises: obtaining calibration data of a zoomable camera module; constructing a calibration data table with object distance, zoom factor, position data of a zoom part and position data of a focus part in the calibration data as columns; obtaining the distance of a photographed object relative to the zoomable camera module; obtaining the zoom factor to be changed; extracting the position data of a matching focus part and the position data of a zoom part from the calibration data table based on the distance and the zoom factor to be changed; and driving the focus part to a first preset position through a first driving element based on the position data of the zoom part, and driving the focus part to a second preset position through a second driving element based on the position data of the focus part, in this way, performing optical zoom. In this way, optical zoom is performed at a relatively fast rate using an optimized control scheme.

Description

Technical Field

[0001] The present application relates to the field of camera modules, and in particular to an imaging method, an imaging device and an electronic device for a variable-focus camera module, wherein the imaging method utilizes an optimized control scheme to perform optical zoom at a relatively fast rate. Background Art

[0002] With the popularization of mobile electronic devices, the relevant technologies of camera modules used in mobile electronic devices to help users obtain images have been rapidly developed and improved. At present, in the market, with the improvement of living standards, consumers have increasingly higher and more diverse functional requirements for camera modules configured in mobile electronic devices (e.g., smart phones). They not only require special shooting effects such as background blur and night shooting, but also put forward requirements for long-range shooting, that is, consumers expect to be able to clearly capture clear images of the subject at different distances.

[0003] In order to achieve the functional requirement of long-range shooting, the current solution is to configure a zoom lens group in the camera module to form an optical variable camera module. Specifically, the optical variable camera module achieves the purpose of zooming by changing the distance between the lenses in the zoom lens group to change the focal length of the zoom lens group, and it can capture clear images of subjects at different distances relatively clearly.

[0004] However, as consumers have increasingly higher requirements for zoom accuracy, zoom speed, and size of optical variable camera modules, existing structural design solutions and optical variable drive solutions of optical variable camera modules have gradually failed to meet the requirements.

[0005] Therefore, a solution for an optimized camera module with zoom function is desired. Summary of the invention

[0006] One advantage of the present application is that it provides an imaging method, an imaging device and an electronic device for a variable-focus camera module, wherein the variable-focus camera module adopts a "parent-child" drive scheme to provide support for the zoom drive at the structural end, and utilizes an optimized drive control scheme to enable the variable-focus camera module to perform optical zoom at a relatively fast rate.

[0007] Another advantage of the present application is that it provides an imaging method, an imaging device and an electronic device for a variable-focus camera module, wherein the imaging method determines the positions to which the various parts of the zoom lens group need to be moved during the zooming process in a pre-calibrated manner, thereby improving the zoom and focus rates of the variable-focus camera module and avoiding image blur caused by focusing to infinity during the zooming process.

[0008] Other advantages and features of the present application will become apparent from the following description, and may be achieved by the means and combinations particularly pointed out in the claims.

[0009] To achieve at least one of the above advantages, the present application provides an imaging method, comprising:

[0010] Obtaining calibration data of the zoom camera module, wherein the calibration data includes position data of a focus part and a zoom part of the zoom camera module at different object distances and different zoom factors;

[0011] Constructing a calibration data table with the object distance, zoom factor, position data of the zoom part and position data of the focus part in the calibration data as columns;

[0012] Obtaining the distance of the photographed object relative to the variable-focus camera module;

[0013] Get the zoom factor to be changed;

[0014] Based on the distance and the to-be-zoomed magnification, extracting the matching position data of the focus portion and the position data of the zoom portion from the calibration data table; and

[0015] The focusing part is driven to a first preset position by a first driving element based on the position data of the zoom part, and the focusing part is driven to a second preset position by a second driving element based on the position data of the focusing part, so that optical zoom is performed.

[0016] In the imaging method according to the present application, the focusing part is driven to a first preset position by a first driving element based on position data of the zoom part, and the focusing part is driven to a second preset position by a second driving element based on the position data of the focusing part, including: based on the position data of the zoom position and the position data of the focusing position, the zoom part and the focusing part are driven simultaneously by the first driving element and the second driving element to move the focusing part to the first preset position and to move the focusing part to the second preset position.

[0017] In the imaging method according to the present application, the focusing part is driven to a first preset position by a first driving element based on position data of the zoom part, and the focusing part is driven to a second preset position by a second driving element based on the position data of the focusing part, including: based on the position data of the zoom part and the position data of the focusing part, the zoom part and the focusing part are simultaneously driven by the first driving element and the second driving element to move the focusing part to the first preset position and to move the focusing part to the third preset position; and, based on the position data of the focusing position, the focusing part is moved from the third preset position to the second preset position by the second driving element.

[0018] In the imaging method according to the present application, based on the distance and the zoom factor to be changed, the matching position data of the focus part and the position data of the zoom part are extracted from the calibration data table, including: matching the object distance that is smallest different from the distance from the data table; and, based on the object distance, extracting the matching position data of the focus part and the position data of the zoom part.

[0019] In the imaging method according to the present application, the imaging method further includes: after zooming is completed, obtaining at least one first image of the subject through the variable-focus camera module; obtaining a second image of the subject through the second camera module; and fusing the at least one first image and the second image to generate at least one fused image.

[0020] In the imaging method according to the present application, the field of view angle of the second camera module is greater than the field of view angle of the variable-focus camera module.

[0021] In the imaging method according to the present application, the effective focal length of the second camera module is smaller than the effective focal length of the variable-focus camera module.

[0022] In the imaging method according to the present application, after zooming is completed, at least one first image of the subject is acquired through the variable-focus camera module, including: acquiring a first image of the subject at a first shooting angle through the variable-focus camera module; and acquiring another first image of the subject at a second shooting angle through the variable-focus camera module.

[0023] In the imaging method according to the present application, another first image of the subject is acquired at a second shooting angle through the zoom camera module, including: rotating the light turning element of the zoom camera module so that the zoom camera module switches from the first shooting angle to the second shooting angle.

[0024] In the imaging method according to the present application, the zoom factor to be changed is input by a user.

[0025] In the imaging method according to the present application, the zoom factor to be changed is automatically generated by the system.

[0026] In the imaging method according to the present application, obtaining the distance of the object relative to the variable-focus camera module includes: obtaining the distance of the object relative to the variable-focus camera module through a laser ranging unit.

[0027] According to another aspect of the present application, an imaging device is also provided, comprising:

[0028] A calibration data acquisition unit, used to obtain calibration data of the zoom camera module, wherein the calibration data includes position data of a focus part and a zoom part of the zoom camera module at different object distances and different zoom factors;

[0029] A calibration data table construction unit, used to construct a calibration data table with object distance, zoom factor, position data of zoom part and position data of focus part in the calibration data as columns;

[0030] A shooting distance acquisition unit, used to acquire the distance of the photographed object relative to the variable-focus camera module;

[0031] A unit for obtaining a zoom factor to be changed, used for obtaining a zoom factor to be changed;

[0032] a matching unit, configured to extract, from the calibration data table, the position data of the focused portion and the position data of the zoomed portion to be matched based on the distance and the zoom factor to be changed; and

[0033] A driving control unit is used to drive the focusing part to a first preset position through a first driving element based on the position data of the zoom part, and to drive the focusing part to a second preset position through a second driving element based on the position data of the focusing part, so as to perform optical zoom.

[0034] According to another aspect of the present application, there is also provided an electronic device, comprising:

[0035] Memory; and

[0036] A processor, wherein computer program instructions are stored in the memory, and when the computer program instructions are executed by the processor, the processor performs the imaging method as described above.

[0037] Further objectives and advantages of the present application will be fully reflected through understanding of the following description and drawings.

[0038] These and other objects, features and advantages of the present application are fully reflected in the following detailed description, drawings and claims. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] By describing the embodiments of the present application in more detail in conjunction with the accompanying drawings, the above and other purposes, features and advantages of the present application will become more apparent. The accompanying drawings are used to provide a further understanding of the embodiments of the present application and constitute a part of the specification. Together with the embodiments of the present application, they are used to explain the present application and do not constitute a limitation of the present application. In the accompanying drawings, the same reference numerals generally represent the same components or steps.

[0040] Figure 1 A schematic diagram of the optical system of a zoom camera module according to an embodiment of the present application is illustrated.

[0041] Figure 2 A schematic diagram of the variable-focus camera module according to an embodiment of the present application is illustrated.

[0042] Figure 3 The figure illustrates a flow chart of the imaging method of the variable-focus camera module according to an embodiment of the present application.

[0043] Figure 4 Another flowchart of the imaging method of the variable-focus camera module according to an embodiment of the present application is illustrated.

[0044] Figure 5A The figure shows a schematic diagram of the effect of the imaging method according to an embodiment of the present application.

[0045] Figure 5B Another schematic diagram of the effect of the imaging method according to an embodiment of the present application is illustrated.

[0046] Figure 5C FIG. 1 is another schematic diagram showing another effect of the imaging method according to an embodiment of the present application.

[0047] Figure 5D FIG. 4 is a diagram illustrating another effect schematic diagram of the imaging method according to an embodiment of the present application.

[0048] Figure 6 A block diagram of an imaging device according to an embodiment of the present application is illustrated.

[0049] Figure 7 A block diagram of an electronic device according to an embodiment of the present application is illustrated. DETAILED DESCRIPTION

[0050] Below, the exemplary embodiments according to the present application will be described in detail with reference to the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments of the present application, and it should be understood that the present application is not limited to the exemplary embodiments described here.

[0051] Application Overview

[0052] As mentioned above, in order to achieve the functional requirement of long-range shooting, the current solution is to configure a zoom lens group in the camera module to form an optical variable camera module. Specifically, the optical variable camera module achieves the purpose of zooming by changing the distance between the lenses in the zoom lens group to change the focal length of the zoom lens group, and it can capture clear images of subjects at different distances more clearly.

[0053] Figure 1 The figure shows a schematic diagram of the optical system of the variable-focus camera module according to an embodiment of the present application, that is, Figure 1 Schematic diagram of the optical system of the optical variable imaging module. Figure 1 As shown, the optical system of the zoom camera module is implemented as an optical system of a periscope camera module, which includes: a light deflection element, a zoom lens group held on the light deflection path of the light deflection element, and a photosensitive component held on the light path of the zoom lens group, wherein the zoom lens group includes a fixed part, a zoom part, and a focusing part. Furthermore, the zoom camera module also includes a driving mechanism for driving the zoom part and / or the focusing part to move, so that the zoom part and the focusing part are driven by the driving mechanism to adjust the optical performance.

[0054] In order to achieve zooming, the driving mechanism includes a first driving element for driving the zoom part and a second driving element for driving the focus part, that is, in order to achieve zooming, driving elements are configured for the zoom part and the focus part respectively. In a specific implementation, the types of the first driving element and the second driving element are not limited by the present application, and include but are not limited to: electromagnetic motors, shape memory alloy actuators, piezoelectric actuators, etc.

[0055] During the zooming process, the current practice is: first, the zoom part is driven by the first driving element to move along the direction set by the optical axis; after the zoom part is moved to a preset position, the focus part is driven by the second driving element to perform automatic focusing, so that the imaging of the zoom camera module is clear.

[0056] However, as consumers have increasingly higher requirements for zoom accuracy, zoom speed, and size of optical variable camera modules, existing structural design solutions and optical variable drive solutions of optical variable camera modules have gradually failed to meet the requirements.

[0057] Specifically, as described above, in the current zooming scheme of the zoom camera module, it is selected to drive the zoom part and the focus part in batches to perform optical zoom. It should be understood that the zooming scheme driven in batches is relatively slow in zooming rate, affecting the user experience.

[0058] Secondly, in order to obtain a clear image, when the focusing part is driven by the second driving element, it is necessary to control the focusing part to move out of focus in the entire stroke, that is, the focusing part needs to move from the farthest point to the closest point to determine the position where the image is clear. This approach is inefficient on the one hand, and on the other hand, the image will be blurred when focusing to infinity, affecting the user's shooting experience.

[0059] In response to the above technical problems, the technical route of this application is to construct a new type of driving scheme for a zoom lens group, and use an optimized driving control scheme to enable the zoom camera module to perform optical zoom at a relatively fast rate. Specifically, in this application, the zoom camera module adopts a "parent-child" driving scheme to provide support for the zoom drive at the structural end, and uses an optimized driving control scheme to enable the zoom camera module to perform optical zoom at a relatively fast rate.

[0060] Specifically, the technical solution of the present application provides an imaging method, which includes: obtaining calibration data of a variable-focus camera module, wherein the calibration data includes position data of a focus part and a zoom part of the variable-focus camera module at different object distances and different zoom factors; constructing a calibration data table with the object distance, zoom factor, position data of the zoom part and position data of the focus part in the calibration data as columns; obtaining the distance of the photographed target relative to the variable-focus camera module; obtaining the zoom factor to be changed; based on the distance and the zoom factor to be changed, extracting matching position data of the focus part and position data of the zoom part from the calibration data table; and, based on the position data of the zoom part, driving the focus part to a first preset position through a first driving element, and, based on the position data of the focus part, driving the focus part to a second preset position through a second driving element, in this way, performing optical zoom.

[0061] After introducing the basic principles of the present application, various non-limiting embodiments of the present application will be described in detail with reference to the accompanying drawings.

[0062] Exemplary Imaging Methods

[0063] As mentioned above, in order to meet consumers' demand for camera module functions, the technical concept of this application is to construct a new type of drive scheme for a zoom lens group, and use an optimized drive control scheme to enable the zoom camera module to perform optical zoom at a relatively fast rate. Specifically, in this application, the zoom camera module adopts a "parent-child" drive scheme to provide support for zoom drive at the structural end, and uses an optimized drive control scheme to enable the zoom camera module to perform optical zoom at a relatively fast rate.

[0064] Figure 2 FIG. 1 is a schematic diagram of the variable-focus camera module according to an embodiment of the present application. Figure 2 As shown, in the embodiment of the present application, the variable-focus camera module is implemented as a variable-focus periscope camera module, which includes: a light turning element 10, a zoom lens group 20, a photosensitive component 30 and a driving component 40.

[0065] Accordingly, if Figure 1 and Figure 2 As shown, in the embodiment of the present application, the light deflection element 10 is used to receive imaging light from the object to be photographed, and deflect the imaging light to the zoom lens group 20. In particular, in the embodiment of the present application, the light deflection element 10 is configured to deflect the imaging light from the object by 90°, so that the overall height size of the zoom camera module can be reduced. Here, considering the manufacturing tolerance, in the actual working process, the angle at which the light deflection element 10 deflects the imaging light may have an error within 1°, which should be understood by those of ordinary skill in the art.

[0066] In a specific example of the present application, the light deflection element 10 can be implemented as a reflector (e.g., a plane reflector) or a light deflection prism (e.g., a triangular prism). For example, when the light deflection element 10 is implemented as a light deflection prism, the light incident surface of the light deflection prism and its light exit surface are perpendicular to each other and the light reflection surface of the light deflection prism is inclined at an angle of 45° to the light incident surface and the light exit surface, so that when the imaging light enters the light deflection prism in a manner perpendicular to the light incident surface, the imaging light can be deflected 90° at the light reflection surface and output from the light exit surface in a manner perpendicular to the light exit surface.

[0067] Of course, in other examples of the present application, the light deflection element 10 can also be implemented as other types of optical elements, which is not limited by the present application. Moreover, in an embodiment of the present application, the variable-focus camera module can also include a larger number of light deflection elements 10. One reason for this is that one of the functions of introducing the light deflection element 10 is to deflect the imaging light so that the optical system of the variable-focus camera module with a longer total optical length (TTL: Total Track Length) can be folded in terms of structural dimension. Accordingly, when the total optical length (TTL) of the variable-focus camera module is too long, a larger number of light deflection elements 10 can be provided to meet the size requirements of the variable-focus camera module. For example, the light deflection element 10 can be provided on the image side of the variable-focus camera module or between two optical lenses.

[0068] like Figure 2As shown, in the embodiment of the present application, the zoom lens group 20 corresponds to the light deflection element 10, and is used to receive the imaging light from the light deflection element 10 and converge the imaging light. Figure 2 As shown, the zoom lens group 20 includes: a fixed part 21, a zoom part 22 and a focus part 23 along the set optical axis direction, wherein the fixed part 21 has a predetermined installation position, and the zoom part 22 and the focus part 23 can be adjusted respectively relative to the position of the fixed part 21 under the action of the driving component 40, so as to achieve the adjustment of the optical performance of the variable-focus camera module, including but not limited to the optical focus and optical zoom functions. For example, the zoom part 22 and the focus part 23 can be adjusted by the driving component 40 so that the focal length of the zoom lens group 20 of the variable-focus camera module is adjusted, so that objects at different distances can be clearly photographed.

[0069] In the embodiment of the present application, the fixed part 21 includes a first lens barrel and at least one optical lens accommodated in the first lens barrel. In addition, the fixed part 21 is adapted to be fixed to a non-moving part in the driving assembly 40 so that the fixed part 21 maintains a constant position in the zoom lens group 20.

[0070] It is worth mentioning that in other examples of the present application, the fixing part 21 may not be provided with the first lens barrel, and only includes at least one optical lens, for example, only includes a plurality of optical lenses that are interlocked. That is, in other examples of the present application, the fixing part 21 may be implemented as a "naked lens".

[0071] The zoom part 22 includes a second lens barrel and at least one optical lens accommodated in the second lens barrel, wherein the zoom part 22 is suitable for being driven by the driving component 40 to move along the optical axis direction set by the zoom lens group 20, thereby realizing the optical zoom function of the variable-focus camera module, so that the variable-focus camera module can achieve clear shooting of subjects at different distances.

[0072] It is worth mentioning that in other examples of the present application, the zoom part 22 may not be provided with the second lens barrel, and only includes at least one optical lens, for example, only includes a plurality of optical lenses that are interlocked. That is, in other examples of the present application, the zoom part 22 may also be implemented as a "naked lens".

[0073] The focusing part 23 includes a third lens barrel and at least one optical lens accommodated in the third lens barrel, wherein the focusing part 23 is adapted to be driven by the driving assembly 40 to move along the optical axis direction set by the zoom lens group 20, thereby realizing the focusing function of the variable-focus camera module. More specifically, the optical focusing realized by driving the focusing part 23 can compensate for the focus shift caused by moving the zoom part 22, thereby compensating for the imaging performance of the variable-focus camera module, so that its imaging quality meets the preset requirements.

[0074] It is worth mentioning that in other examples of the present application, the focusing part 23 may not be provided with the third lens barrel, and only includes at least one optical lens, for example, only includes a plurality of optical lenses that are mutually embedded. That is, in other examples of the present application, the focusing part 23 may also be implemented as a "naked lens".

[0075] More specifically, if Figure 2 As shown, in the embodiment of the present application, the fixed part 21, the zoom part 22 and the focusing part 23 of the zoom lens group 20 are arranged in sequence (that is, in the zoom lens group 20, the zoom part 22 is located between the fixed part 21 and the focusing part 23), that is, the imaging light from the light deflection element 10 will first pass through the fixed part 21, then pass through the zoom part 22, and then pass through the focusing part 23 during the process of passing through the zoom lens group 20.

[0076] Of course, in other examples of the present application, the relative positional relationship between the fixed part 21, the zoom part 22 and the focus part 23 can also be adjusted, for example, the fixed part 21 is set between the zoom part 22 and the focus part 23, and for another example, the focus part 23 is set between the zoom part 22 and the fixed part 21. It should be understood that in the embodiment of the present application, the relative positional relationship between the fixed part 21, the zoom part 22 and the focus part 23 can be adjusted according to the optical design requirements and structural design requirements of the variable-focus camera module.

[0077] But in particular, in the embodiment of the present application, considering the structural design of the zoom camera module (more specifically, in order to facilitate the layout of the drive assembly 40), preferably, the focus part 23 and the zoom part 22 are arranged adjacent to each other. That is, according to the position of each part in the zoom lens group 20 of the embodiment of the present application, it is preferably configured as follows: the zoom part 22 is located between the fixed part 21 and the focus part 23, or the focus part 23 is located between the fixed part 21 and the zoom part 22. It should be understood that the zoom part 22 and the focus part 23 are the parts that need to be moved in the zoom lens group 20. Therefore, arranging the focus part 23 and the zoom part 22 adjacent to each other is conducive to the layout of the drive assembly 40, and this part will be expanded in the specific description of the drive assembly 40.

[0078] It is also worth mentioning that in Figure 2 In the illustrated example, although the zoom lens group 20 is taken as an example, including a fixed part 21, a zoom part 22 and a focusing part 23, a person skilled in the art should know that in other examples of the present application, the specific number of the fixed part 21, the zoom part 22 and the focusing part 23 is not limited to the present application, and can be adjusted according to the optical design requirements of the variable-focus camera module.

[0079] like Figure 2 As shown, in the embodiment of the present application, the photosensitive component 30 corresponds to the zoom lens group 20, and is used to receive imaging light from the zoom lens group 20 and perform imaging, wherein the photosensitive component 30 includes a circuit board 31, a photosensitive chip 32 electrically connected to the circuit board 31, and a filter element 33 held on the light sensing path of the photosensitive chip 32. More specifically, in the embodiment of the present application, Figure 1 and Figure 2 In the illustrated example, the photosensitive component 30 further includes a bracket 34 disposed on the circuit board 31 , wherein the filter element 33 is mounted on the bracket 34 to be maintained on the photosensitive path of the photosensitive chip 32 .

[0080] It is worth mentioning that in other examples of the present application, the specific implementation method of the filter element 33 being maintained on the photosensitive path of the photosensitive chip 32 is not limited to the present application. For example, the filter element 33 can be implemented as a filter film and coated on the surface of an optical lens of the zoom lens group 20 to achieve a filtering effect. For another example, the photosensitive component 30 may further include a filter element bracket mounted on the bracket 34 (not shown in the figure), wherein the filter element 33 is maintained on the photosensitive path of the photosensitive chip 32 by being mounted on the filter element bracket.

[0081] Furthermore, in the embodiment of the present application, the zoom camera module adopts a "parent-child" driving scheme to provide support for zoom driving at the structural end. Specifically, Figure 2 As shown, the driving assembly 40 includes: a driving shell 41, a first carrier 44 located in the driving shell 41, a second carrier 45 and a first driving element 42 and a second driving element 43, wherein the zoom part 22 is installed in the first carrier 44, the focusing part 23 is installed in the second carrier 45, and the second carrier 45 is installed on the first carrier 44.

[0082] Accordingly, in this embodiment, the first driving element 42 is configured to drive the first carrier 44 to drive the zoom part 22 and the second carrier 45 on which the focus part 23 is installed to move along the direction set by the optical axis, so as to simultaneously drive the zoom part 22 and the focus part 23 to move along the direction set by the optical axis, so as to improve the driving efficiency. The second driving element 43 is configured to drive the second carrier 45 alone to move along the direction set by the optical axis. It should be understood that since the first driving element 42 can drive the zoom part 22 and the focus part 23 to move simultaneously, and the second driving element 43 can only drive the focus part 23 to move, therefore, in the present application, this driving scheme is defined as a "parent-child" driving scheme, wherein the parent drive is the first driving element 42, and the child drive is the second driving element 43.

[0083] Further, in the embodiment of the present application, the types of the first driving element 42 and the second driving element 43 are not limited by the present application, and include but are not limited to: electromagnetic motors, shape memory alloy motors, piezoelectric motors, etc. Preferably, in order to avoid electromagnetic interference, the first driving element 42 and the second driving element 32 are not implemented as electromagnetic motors at the same time, for example, the first driving element 42 is implemented as a piezoelectric motor, and the second driving element 43 is implemented as an electromagnetic motor.

[0084] It is worth mentioning that compared with traditional electromagnetic motors and shape memory alloy motors, piezoelectric motors can provide relatively high driving force. In addition to being able to provide relatively large driving force, piezoelectric motors also have other advantages compared with traditional electromagnetic motor solutions and shape memory alloy motor solutions, including but not limited to: relatively small size (slender shape), better response accuracy, relatively simpler structure, relatively simpler drive control, high product consistency, no electromagnetic interference, relatively larger stroke, short stabilization time, relatively small weight, etc.

[0085] It is also worth mentioning that, when a piezoelectric motor is used as a driving element, a guiding mechanism (e.g., Figure 2 46) so that the movement of the zoom part 22 and / or the focus part 23 is smoother, which is also not limited to the present application.

[0086] Furthermore, after adopting a "mother-and-child" driving scheme to provide support for zoom drive at the structural end, an optimized driving control scheme is configured for the zoom camera module so that the zoom camera module can perform optical zoom at a relatively fast rate.

[0087] Figure 3 FIG. 1 is a flowchart of an imaging method of the variable-focus camera module according to an embodiment of the present application. Figure 3 As shown, the imaging method according to the embodiment of the present application includes the steps of: S110, obtaining calibration data of a variable-focus camera module, wherein the calibration data includes position data of a focus part and a zoom part of the variable-focus camera module at different object distances and different zoom factors; S120, constructing a calibration data table with the object distance, zoom factor, position data of the zoom part and position data of the focus part in the calibration data as columns; S130, obtaining the distance of the photographed target relative to the variable-focus camera module; S140, obtaining the zoom factor to be changed; S150, extracting matching position data of the focus part and position data of the zoom part from the calibration data table based on the distance and the zoom factor to be changed; and, S160, driving the focus part to a first preset position through a first driving element based on the position data of the zoom part, and driving the focus part to a second preset position through a second driving element based on the position data of the focus part, in this way, optical zoom is performed.

[0088] In step S110, calibration data of the zoom camera module is obtained, wherein the calibration data includes position data of the focus part and the zoom part of the zoom camera module at different object distances and different zoom factors. A person of ordinary skill in the art should know that for any zoom optical system, at any focal length state at any object distance, the positions of the fixed part, the focus part and the zoom part in the zoom lens group are fixed and unique. Therefore, in an embodiment of the present application, the zoom camera module is pre-calibrated to obtain the position data of the focus part and the zoom part of the zoom camera module at different object distances and different zoom factors.

[0089] In a specific implementation, the position of each lens part in the zoom lens group can be adjusted by focusing first and then zooming, that is, first determine the object distance and then adjust the focal length. Specifically, first shoot the image of the sub-plate at different set distances (such as 1 / 3 / 5 / 8 / 10 / 15 / 20 / 30 / 50 / 100m / infinity, etc.) through the zoom camera module, move the position of the zoom part in the zoom lens group to adjust the effective focal length of the zoom camera module, and then move the position of the focus part in the zoom lens group so that the zoom camera module can obtain clear imaging at different set zoom magnifications (such as 3X / 4X / 5X / 6X / 7X / 8X / 9X / 10X). In this way, the position information of the zoom component and the position information of the focus component at different object distances and different zoom magnifications are recorded.

[0090] For example: set the target plate distance to 1m, move the position of the zoom part so that the zoom factor of the zoom camera module is 3, move the focus part to make the image clear, complete the auto focus, and obtain the position information of the zoom part and the focus part of the zoom camera module at an object distance of 1m and a zoom factor of 3. Then change the zoom factor, repeat the above actions, and further obtain the position information of the zoom part and the focus part of the zoom camera module at an object distance of 1m and a zoom factor of 4. After the position information of the zoom part and the focus part of the zoom camera module at an object distance of 1m is obtained, set the target plate distance to 3m, and then obtain the position information of the zoom part and the focus part of the zoom camera module at an object distance of 3m, until the position information of the zoom part and the focus part of the zoom camera module at all set zoom factors at all different set distances (object distances) is obtained.

[0091] In this embodiment, the position information of the zoom part and the focus part of the zoom camera module can be represented by the motor Code value of the first driving element and the motor Code value of the second driving element.

[0092] In step S120, a calibration data table is constructed with the object distance, zoom factor, position data of the zoom part, and position data of the focus part in the calibration data as columns. That is, a structured data table is constructed to represent the calibration data and the calibration data table is burned into a memory, for example, stored in a cloud server or a memory of a smart phone, which is not limited by the present application.

[0093] In step S130, the distance of the subject relative to the zoom camera module is obtained. During the shooting process, the distance of the subject from the zoom camera module is obtained to determine the object distance. In a specific implementation, the distance of the subject relative to the zoom camera module can be obtained by a laser ranging unit (for example, a laser ranging unit provided in a smartphone) to determine the object distance.

[0094] It is worth mentioning that in other examples of the present application, the distance between the subject and the variable-focus camera module can also be obtained by other ranging methods, for example, by triangulation, contrast detection, phase detection, etc., which is not limited to the present application.

[0095] In step S140, the zoom factor to be changed is obtained. In the embodiment of the present application, the zoom factor to be changed is input by the user or automatically generated by the system. For example, when the zoom camera module is applied to a smart phone, the user can input the zoom factor through the touch screen of the smart phone.

[0096] In step S150, based on the distance and the zoom factor to be changed, the position data of the focus part and the position data of the zoom part that match are extracted from the calibration data table. That is, after obtaining the distance (shooting distance) and the zoom factor to be changed, the position data of the focus part and the position data of the zoom part that match are extracted from the calibration data table.

[0097] It is worth mentioning that, in a specific implementation, since the distance of the focused object is not necessarily equal to the distance of the object distance in the burned-in position information, a similar object distance can be selected for subsequent imaging. For example, when the distance of the focused object is 6m, which is between the set object distances of 5m and 8m, an object distance of 5m can be selected for subsequent imaging. That is, in the embodiment of the present application, based on the distance and the zoom factor to be changed, the process of extracting the matching position data of the focused part and the position data of the zoom part from the calibration data table includes: matching the object distance with the smallest difference from the distance from the data table; and, based on the object distance, extracting the matching position data of the focused part and the position data of the zoom part.

[0098] In step S160, the focus part is driven to a first preset position by a first driving element based on the position data of the zoom part, and the focus part is driven to a second preset position by a second driving element based on the position data of the focus part, so that optical zoom is performed.

[0099] It should be understood that, since the position information of the focus part and the focus part of the variable-focus module at different object distances and zoom factors has been obtained, during the module zoom imaging process, the focus part and the focus part can be driven to a preset position for imaging through the first driving element and the second driving element according to the position data of the focus part and the focus part, without the need for the focus part to be moved to the distance at which the variable-focus camera module focuses to infinity. Therefore, the zoom and focus speed of the variable-focus camera module can be improved and blurring during the zooming process caused by focusing to infinity can be avoided.

[0100] In a specific example, the process of driving the focus part to a first preset position through a first driving element based on position data of the zoom part, and driving the focus part to a second preset position through a second driving element based on the position data of the focus part, includes: based on the position data of the zoom position and the position data of the focus position, simultaneously driving the zoom part and the focus part through the first driving element and the second driving element to move the focus part to the first preset position and to move the focus part to the second preset position.

[0101] That is, the zoom part and the focus part are driven simultaneously by the first driving element and the second driving element to move the focus part to the first preset position and to move the focus part to the second preset position, that is, the focus part and the focus part are driven to the preset positions simultaneously by the first driving element and the second driving element.

[0102] In another specific example of the present application, the process of driving the focusing part to a first preset position through a first driving element based on the position data of the zoom part, and driving the focusing part to a second preset position through a second driving element based on the position data of the focusing part, includes first: based on the position data of the zoom part and the position data of the focusing part, driving the zoom part and the focusing part simultaneously through the first driving element and the second driving element to move the focusing part to the first preset position and to move the focusing part to the third preset position; and then, based on the position data of the focusing position, moving the focusing part from the third preset position to the second preset position through the second driving element.

[0103] That is, in this example, the focusing part and the zoom part do not reach the preset positions at the same time, but the focusing part is first moved to the first preset position and the focusing part is moved to the third preset position by the first driving element and the second driving element. At this time, the zoom part reaches the preset position, but the focusing part does not reach the preset position; then, the focusing part is driven from the third preset position to the second preset position by the second driving element alone, that is, the focusing part is driven to the preset position by the second driving element.

[0104] Furthermore, the variable-focus camera module can also cooperate with other camera modules to achieve more diverse imaging effects, for example, cooperate with the second camera module to achieve "picture-in-picture" or "background blur" imaging effects. For example, when the field of view angle of the second camera module is greater than the field of view angle of the variable-focus camera module and the effective focal length of the second camera module is less than the effective focal length of the variable-focus camera module, when the image of the photographed target is captured by the second camera module and the variable-focus camera module, the area of ​​the photographed target captured by the second camera module is greater than the area of ​​the photographed target captured by the variable-focus camera module, that is, the content in the image captured by the second camera module includes the content in the image captured by the variable-focus camera module, thereby achieving "picture-in-picture" or "background blur" imaging effects, such as Figure 5A shown.

[0105] Accordingly, in the embodiments of the present application, Figure 4 As shown, the imaging method further includes the steps of: S170, after zooming is completed, acquiring at least one first image of the subject through the variable-focus camera module; S180, acquiring a second image of the subject through the second camera module; and, S190, fusing the at least one first image and the second image to generate at least one fused image.

[0106] In step S170, after zooming is completed, at least one first image of the photographed object is acquired through the variable-focus camera module. In a specific implementation, the field of view of the variable-focus camera module is suitable for rotating to obtain a plurality of the first images, such as Figure 5B For example, the field of view of the variable-focus camera module can be changed by rotating the light deflection element of the variable-focus camera module, or by moving the variable-focus camera module.

[0107] That is, in an embodiment of the present application, after zooming is completed, the process of acquiring at least one first image of the subject through the variable-focus camera module includes: acquiring a first image of the subject at a first shooting angle through the variable-focus camera module; and acquiring another first image of the subject at a second shooting angle through the variable-focus camera module, wherein acquiring another first image of the subject at the second shooting angle through the variable-focus camera module includes: rotating the light turning element of the variable-focus camera module so that the variable-focus camera module switches from the first shooting angle to the second shooting angle.

[0108] exist Figure 5D In the illustrated example, the variable-focus optical module obtains 6 first images after rotating around the first axis and the second axis, wherein there are overlapping portions between the 6 first images. In a specific implementation, the variable-focus camera module can be driven to rotate around the first axis and the second axis by a driving mechanism such as a pan / tilt to obtain the 6 first images. Of course, the light turning element can also be driven to rotate around the first axis and the second axis perpendicular to each other by a prism rotation mechanism to obtain the 6 first images, which is not limited to the present application.

[0109] In summary, the imaging method based on the embodiment of the present application is explained, wherein the zoom camera module adopts a "parent-child" driving scheme to provide support for the zoom drive at the structural end, and utilizes an optimized driving control scheme to enable the zoom camera module to perform optical zoom at a relatively fast rate.

[0110] Exemplary Imaging Devices

[0111] Figure 6 A block diagram of an imaging device according to an embodiment of the present application is illustrated.

[0112] like Figure 6As shown, according to an embodiment of the present application, the imaging device 600 includes: a calibration data acquisition unit 610, which is used to obtain calibration data of a zoom camera module, wherein the calibration data includes position data of a focus part and a zoom part of the zoom camera module at different object distances and different zoom factors; a calibration data table construction unit 620, which is used to construct a calibration data table with the object distance, zoom factor, position data of the zoom part and position data of the focus part in the calibration data as columns; a shooting distance acquisition unit 630, which is used to obtain the position data of the subject relative to the zoom camera module. The invention relates to a method for optical zooming, comprising: providing a distance between the focus group and the zoom factor to be adjusted; a zoom factor acquisition unit 640 for acquiring the zoom factor to be adjusted; a matching unit 650 for extracting the position data of the matched focus part and the position data of the zoom part from the calibration data table based on the distance and the zoom factor to be adjusted; and a driving control unit 660 for driving the focus part to a first preset position through a first driving element based on the position data of the zoom part, and driving the focus part to a second preset position through a second driving element based on the position data of the focus part, so as to perform optical zooming.

[0113] In one example, in the above-mentioned imaging device 600, the driving control unit 660 is further used to simultaneously drive the zoom part and the focus part through the first driving element and the second driving element based on the position data of the zoom position and the position data of the focus position, so as to move the focus part to the first preset position and move the focus part to the second preset position.

[0114] In one example, in the above-mentioned imaging device 600, the driving control unit 660 is further used to simultaneously drive the zoom part and the focus part through the first driving element and the second driving element based on the position data of the zoom part and the position data of the focus part, so as to move the focus part to the first preset position and to move the focus part to the third preset position; and, based on the position data of the focus position, move the focus part from the third preset position to the second preset position through the second driving element.

[0115] In one example, in the above-mentioned imaging device 600, the matching unit 650 is further used to match the object distance with the smallest difference from the distance from the data table; and, based on the object distance, extract the matched position data of the focus part and the position data of the zoom part.

[0116] In one example, in the above-mentioned imaging device 600, the imaging device 600 further includes: a first image acquisition unit 670, used to acquire at least one first image of the subject through the zoom camera module after the zoom is completed; a second image acquisition unit 680, used to acquire a second image of the subject through the second camera module; and an image fusion unit 690, used to fuse the at least one first image and the second image to generate at least one fused image.

[0117] In one example, in the above-mentioned imaging device 600, the field of view angle of the second camera module is greater than the field of view angle of the variable-focus camera module.

[0118] In one example, in the above-mentioned imaging device 600, the effective focal length of the second camera module is smaller than the effective focal length of the variable-focus camera module.

[0119] In one example, in the above-mentioned imaging device 600, the first image acquisition unit 670 is further used to acquire a first image of the subject at a first shooting angle through the variable-focus camera module; and to acquire another first image of the subject at a second shooting angle through the variable-focus camera module.

[0120] In one example, in the above-mentioned imaging device 600, the first image acquisition unit 670 is further used to rotate the light turning element of the variable-focus camera module so that the variable-focus camera module switches from a first shooting angle to a second shooting angle.

[0121] In one example, in the imaging device 600 , the zoom factor to be changed is input by a user.

[0122] In one example, in the above-mentioned imaging device 600, the zoom factor to be changed is automatically generated by the system.

[0123] In one example, in the above-mentioned imaging device 600, the shooting distance acquisition unit 630 is further used to: acquire the distance of the photographed target relative to the variable-focus camera module through a laser ranging unit.

[0124] Here, those skilled in the art will appreciate that the specific functions and operations of the various units and modules in the imaging device 600 have been described in detail above. Figure 1 The imaging method of FIG. 5 has been described in detail, and therefore, a repeated description thereof will be omitted.

[0125] As described above, the imaging device 600 according to the embodiment of the present application can be implemented in various terminal devices, such as smart phones. In one example, the imaging device 600 according to the embodiment of the present application can be integrated into the terminal device as a software module and / or a hardware module. For example, the imaging device 600 can be a software module in the operating system of the terminal device, or can be an application developed for the terminal device; of course, the imaging device 600 can also be one of the many hardware modules of the terminal device.

[0126] Alternatively, in another example, the imaging apparatus 600 and the terminal device may also be separate devices, and the imaging apparatus 600 may be connected to the terminal device via a wired and / or wireless network, and transmit interactive information in accordance with an agreed data format.

[0127] Exemplary Electronic Devices

[0128] Below, reference Figure 7 To describe an electronic device according to an embodiment of the present application.

[0129] Figure 7 A block diagram of an electronic device according to an embodiment of the present application is illustrated.

[0130] like Figure 7 As shown, the electronic device 10 includes one or more processors 11 and a memory 12 .

[0131] The processor 11 may be a central processing unit (CPU) or other forms of processing units having data processing capabilities and / or instruction execution capabilities, and may control other components in the electronic device 10 to perform desired functions.

[0132] The memory 12 may include one or more computer program products, and the computer program product may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The volatile memory may include, for example, a random access memory (RAM) and / or a cache memory (cache), etc. The non-volatile memory may include, for example, a read-only memory (ROM), a hard disk, a flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium, and the processor 11 may run the program instructions to implement the imaging method of each embodiment of the present application described above and / or other desired functions. Various contents such as calibration data, calibration data tables, etc. may also be stored in the computer-readable storage medium.

[0133] In one example, the electronic device 10 may further include: an input device 13 and an output device 14, and these components are interconnected via a bus system and / or other forms of connection mechanisms (not shown).

[0134] The input device 13 may include, for example, a keyboard, a mouse, etc.

[0135] The output device 14 can output various information to the outside, including fused images, etc. The output device 14 can include, for example, a display, a speaker, a printer, a communication network and a remote output device connected thereto, and the like.

[0136] Of course, to simplify, Figure 7 Only some of the components related to the present application in the electronic device 10 are shown, and components such as a bus, an input / output interface, etc. are omitted. In addition, according to specific application situations, the electronic device 10 may also include any other appropriate components.

[0137] The basic principles of the present application are described above in conjunction with specific embodiments. However, it should be noted that the advantages, strengths, effects, etc. mentioned in the present application are only examples and not limitations, and it cannot be considered that these advantages, strengths, effects, etc. are required by each embodiment of the present application. In addition, the specific details disclosed above are only for the purpose of illustration and ease of understanding, not for limitation, and the above details do not limit the present application to being implemented by adopting the above specific details.

[0138] The block diagrams of the devices, apparatuses, equipment, and systems involved in this application are only illustrative examples and are not intended to require or imply that they must be connected, arranged, and configured in the manner shown in the block diagram. As will be appreciated by those skilled in the art, these devices, apparatuses, equipment, and systems can be connected, arranged, and configured in any manner. Words such as "including", "comprising", "having", etc. are open words, referring to "including but not limited to", and can be used interchangeably with them. The words "or" and "and" used here refer to the words "and / or" and can be used interchangeably with them, unless the context clearly indicates otherwise. The words "such as" used here refer to the phrase "such as but not limited to", and can be used interchangeably with them.

[0139] It should also be noted that in the apparatus, device and method of the present application, each component or each step can be decomposed and / or recombined. Such decomposition and / or recombination should be regarded as equivalent solutions of the present application.

[0140] The above description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present application. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects without departing from the scope of the present application. Therefore, the present application is not intended to be limited to the aspects shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.

[0141] The above description has been given for the purpose of illustration and description. In addition, this description is not intended to limit the embodiments of the present application to the forms disclosed herein. Although multiple example aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, changes, additions and sub-combinations thereof.

[0142] It should be understood by those skilled in the art that the embodiments of the present invention described above and shown in the accompanying drawings are only examples and do not limit the present invention. The purpose of the present invention has been fully and effectively achieved. The functional and structural principles of the present invention have been demonstrated and explained in the embodiments, and the embodiments of the present invention may be deformed or modified in any way without departing from the principles.

Claims

1. An imaging method, characterized in that: include: Obtaining calibration data of the zoom camera module, wherein the calibration data includes position data of a focus part and a zoom part of the zoom camera module at different object distances and different zoom factors; Constructing a calibration data table with the object distance, zoom factor, position data of the zoom part and position data of the focus part in the calibration data as columns; Obtaining the distance of the photographed object relative to the variable-focus camera module; Get the zoom factor to be changed; and Based on the distance and the zoom factor to be changed, extracting the matching position data of the focus part and the position data of the zoom part from the calibration data table, so that the position data of the focus part and the position data of the zoom part can be obtained at the same time; At the same time, the zoom part is driven by a first driving element based on the position data of the zoom part, and the focus part is driven by a second driving element based on the position data of the focus part, so as to move the zoom part to a first preset position and move the focus part to a second preset position to perform optical zoom.

2. The imaging method according to claim 1, wherein: Simultaneously driving the zoom part through a first driving element based on the position data of the zoom part, and driving the focus part through a second driving element based on the position data of the focus part, comprising: Based on the position data of the zoom part and the position data of the focus part, the zoom part and the focus part are simultaneously driven by the first drive element, and the focus part is individually driven by the second drive element while the zoom part and the focus part are simultaneously driven by the first drive element.

3. The imaging method according to claim 1, wherein: Simultaneously driving the zoom part through a first driving element based on the position data of the zoom part, and driving the focus part through a second driving element based on the position data of the focus part, comprising: Based on the position data of the zoom part and the position data of the focus part, the zoom part and the focus part are simultaneously driven by the first drive element, and the focus part is individually driven by the second drive element while the zoom part and the focus part are simultaneously driven by the first drive element; and After the zoom part and the focus part are simultaneously driven by the first drive element and the focus part is independently driven by the second drive element, the focus part is driven by the second drive element based on position data of the focus part.

4. The imaging method according to claim 1, wherein: Based on the distance and the zoom factor to be changed, the position data of the focused part and the position data of the zoomed part that match are extracted from the calibration data table, including: Matching the object distance with the smallest difference from the distance from the data table; and Based on the object distance, the position data of the focused part and the position data of the zoomed part that match are extracted.

5. The imaging method according to claim 1, further comprising: After zooming is completed, obtaining at least one first image of the photographed object through the zoom camera module; Acquire a second image of the photographed object through a second camera module; as well as The at least one first image and the second image are fused to generate at least one fused image.

6. The imaging method according to claim 5, wherein: The field of view of the second camera module is greater than the field of view of the zoom camera module.

7. The imaging method according to claim 6, wherein: The effective focal length of the second camera module is smaller than the effective focal length of the variable-focus camera module.

8. The imaging method according to claim 5, wherein: After the zooming is completed, obtaining at least one first image of the photographed object through the zoom camera module includes: Acquire a first image of the photographed object at a first shooting angle through the variable-focus camera module; and Another first image of the object is acquired at a second shooting angle through the variable-focus camera module.

9. The imaging method according to claim 8, wherein: Acquiring another first image of the photographed object at a second shooting angle by using the variable-focus camera module, comprising: The light turning element of the variable-focus camera module is rotated so that the variable-focus camera module switches from a first shooting angle to a second shooting angle.

10. The imaging method according to claim 1, wherein: The zoom factor to be changed is input by the user.

11. The imaging method according to claim 1, wherein: The zoom factor to be changed is automatically generated by the system.

12. The imaging method according to claim 1, wherein: Obtaining the distance of the photographed object relative to the variable-focus camera module includes: The distance of the photographed target relative to the variable-focus camera module is obtained through a laser ranging unit.

13. An imaging device, characterized in that: include: A calibration data acquisition unit, used to obtain calibration data of the zoom camera module, wherein the calibration data includes position data of a focus part and a zoom part of the zoom camera module at different object distances and different zoom factors; A calibration data table construction unit, used to construct a calibration data table with object distance, zoom factor, position data of zoom part and position data of focus part in the calibration data as columns; A shooting distance acquisition unit, used to acquire the distance of the photographed object relative to the variable-focus camera module; A unit for obtaining a zoom factor to be changed, used for obtaining a zoom factor to be changed; a matching unit, configured to extract the matched position data of the focus part and the position data of the zoom part from the calibration data table based on the distance and the zoom factor to be changed, so that the position data of the focus part and the position data of the zoom part can be obtained simultaneously; and A driving control unit is used to simultaneously drive the zoom part through a first driving element based on the position data of the zoom part, and drive the focus part through a second driving element based on the position data of the focus part, so as to move the zoom part to a first preset position and move the focus part to a second preset position.

14. An electronic device, characterized in that: include: Memory; as well as A processor, wherein computer program instructions are stored in the memory, and when the computer program instructions are executed by the processor, the processor performs the imaging method according to any one of claims 1 to 12.

Images