Camera module device, multi-camera camera module, camera system, electronic device, and automatic zoom imaging method

Abstract

Disclosed are a camera module device, a multi-camera camera module, a camera system, an electronic device, and an automatic zoom imaging method. The multi-camera camera module comprises a first camera unit having a zoom function, and a second camera unit having a preset relative positional relationship with the first camera unit, wherein a driving assembly of the first camera unit drives at least part of a lens in at least one lens group of the first camera unit based on an adjustment instruction to perform optical zoom, and the adjustment instruction is generated based on a distance between the multi-camera camera module and a target object, and the distance is obtained by the first camera module and the second camera module based on a binocular distance measurement principle. In this way, the structural configuration of the multi-camera camera module enables the multi-camera camera module to automatically perform optical zoom based on the distance between the multi-camera camera module and the target object, thereby providing a better shooting experience.

Description

Technical Field

[0001] This application relates to the field of camera modules, and more particularly to camera module devices, multi-camera camera modules, camera systems, electronic devices, and automatic zoom imaging methods. Background Technology

[0002] With the widespread adoption of mobile electronic devices, the technology behind camera modules used in these devices to help users acquire images (such as videos or pictures) has developed and progressed rapidly. Especially with the development of smartphones, consumers' demands for shooting functions have become increasingly diverse, and their requirements for image quality have also increased, posing greater challenges to camera modules.

[0003] In recent years, camera modules have evolved from single-camera to multi-camera modules, and recently, camera modules with optical zoom capabilities have been found on smartphones to meet the needs of shooting at different distances.

[0004] In current solutions, manual optical zoom is required when using a camera module with optical zoom capabilities. One existing solution involves the user manually controlling the optical zoom by swiping their finger across the screen to switch between close-up and distant shots. However, in practical use, this manual zoom operation has several drawbacks.

[0005] First, when a user holds a mobile electronic device with one hand and swipes on the screen with the other, it reduces the stability of the user's grip on the electronic device, resulting in blurry or unclear images or videos.

[0006] Secondly, when users take long-distance shots using the zoomed-in camera module, the adverse effects of electronic device shake are amplified, reducing the shooting experience.

[0007] Third, it is difficult to control the adjustment range when using manual zoom. Often, the zoom is too large or too small. Therefore, users often need to make multiple manual adjustments to ensure that the shooting range and image quality meet their requirements.

[0008] Therefore, a multi-camera module with automatic zoom function and its imaging solution are needed. Summary of the Invention

[0009] One advantage of this application is that it provides a multi-camera module, a camera system, an electronic device, and an automatic zoom imaging method, wherein the structural configuration of the multi-camera module enables the multi-camera module to perform automatic optical zoom based on the distance between itself and the target, so as to provide a better shooting experience.

[0010] Another advantage of the present application is to provide a multi-camera camera module, a camera system, an electronic device and an automatic zoom imaging method, wherein the multi-camera camera module performs distance measurement based on its own configured camera unit to provide the required distance information for automatic optical zoom, that is, the multi-camera camera module according to the embodiments of the present application expands the function of its own configured camera unit to realize the automatic zoom function. That is, the multi-camera camera module according to the embodiments of the present application realizes the automatic optical zoom function without the need for additional configuration of a distance measurement module.

[0011] Other advantages and features of the present application will become apparent from the following description, and can be achieved by means and combinations particularly pointed out in the claims.

[0012] To achieve at least one of the above objectives or advantages, the present application provides a multi-camera camera module, comprising:

[0013] a first camera unit, comprising a photosensitive chip, at least one lens group located on a photosensitive path of the photosensitive chip, and a driving assembly for driving at least part of the at least one lens group to perform optical zoom; and

[0014] a second camera unit having a predetermined relative positional relationship with the first camera unit;

[0015] wherein the driving assembly is configured to drive at least part of the at least one lens group to perform optical zoom based on an adjustment instruction, the adjustment instruction being generated based on the distance of the multi-camera camera module relative to the target object, and the distance of the multi-camera camera module relative to the target object being calculated based at least in part on a first image of the target object captured by the first camera unit, a second image of the target object captured by the second camera unit, and the relative positional relationship between the first camera unit and the second camera unit.

[0016] In the multi-camera camera module according to the present application, the at least one lens group comprises a first lens group and a second lens group, and the driving assembly comprises a first driving element configured to drive at least part of the first lens group to perform optical zoom based on the adjustment instruction.

[0017] In the multi-camera camera module according to the present application, the driving assembly further comprises a second driving element configured to drive the second lens group to perform optical focusing based on the adjustment instruction.

[0018] In the multi-camera camera module according to the present application, the first camera unit further comprises a reflecting element arranged on the photosensitive path of the photosensitive chip for turning the imaging light.

[0019] In the multi-camera camera module according to the present application, the driving assembly further comprises an anti-shake mechanism for driving the reflecting element to perform optical anti-shake.

[0020] In the multi-camera camera module according to the present application, the driving assembly further comprises an anti-shake mechanism for driving the first lens group and / or the second lens group to perform optical anti-shake.

[0021] In the multi-camera camera module according to the present application, the multi-camera camera module further comprises a third camera unit having a preset positional relationship with the first camera unit, and a third equivalent focal length of the third camera unit is greater than a second equivalent focal length of the second camera unit. When a distance of the multi-camera camera module relative to the photographed target exceeds a preset threshold based at least in part on a first image of the photographed target captured by the first camera unit, a second image of the photographed target captured by the second camera unit, and a relative positional relationship between the first camera unit and the second camera unit, the adjustment instruction is generated based on a second distance of the multi-camera camera module relative to the photographed target, wherein the second distance is calculated based at least in part on the first image of the photographed target captured by the first camera unit, a third image of the photographed target captured by the third camera unit, and a relative positional relationship between the first camera unit and the third camera unit.

[0022] According to another aspect of the present application, a camera system is also provided, which comprises:

[0023] The multi-camera camera module as described above; and

[0024] A processor communicably connected to the multi-camera camera module, wherein the processor is configured to generate an adjustment instruction based on a distance of the multi-camera camera module relative to a photographed target.

[0025] In the camera system according to the present application, the processor is further configured to fuse a first image of the photographed target captured by the first camera module after optical zooming and a second image of the photographed target captured by the second camera module to obtain a fused image of the photographed target; or, fuse a first image of the photographed target captured by the first camera module after optical zooming and a third image of the photographed target captured by the third camera module to obtain a fused image of the photographed target.

[0026] According to still another aspect of the present application, an automatic zoom imaging method is also provided, which comprises:

[0027] Obtaining a zoom instruction;

[0028] In response to the zoom instruction, a distance between the multi-camera camera module and the target object is obtained, the multi-camera camera module including a first camera unit;

[0029] Based on the distance, an adjustment instruction is generated, the adjustment instruction being used to drive a driving assembly of the first camera unit to drive at least part of a lens group of the first camera unit to perform optical zooming; and

[0030] A fused image is obtained by fusing a first image of the target object captured by the first camera unit after optical zooming and images of the target object captured by other camera units of the multi-camera camera module.

[0031] In the automatic zoom imaging method according to the present application, in response to the zoom instruction, the distance between the multi-camera camera module and the target object is obtained, including:

[0032] The first image of the target object is obtained by the first camera unit;

[0033] The second image of the target object is obtained by the second camera unit; and

[0034] The first distance between the multi-camera camera module and the target object is obtained based at least in part on the first image, the second image, and a relative position relationship between the first camera unit and the second camera unit, wherein the first distance is the distance between the multi-camera camera module and the target object.

[0035] In the automatic zoom imaging method according to the present application, before the first image of the target object is obtained by the first camera unit, the driving assembly of the first camera unit is pre-driven to drive at least part of a lens group of the first camera unit to perform optical zooming.

[0036] In the automatic zoom imaging method according to the present application, in response to the zoom instruction, the distance between the multi-camera camera module and the target object is further obtained, including:

[0037] When the first distance is greater than a preset threshold, a third camera unit of the multi-camera camera module is started to obtain a third image of the target object by the third camera unit, a third equivalent focal length of the third camera unit being greater than a second equivalent focal length of the second camera unit; and

[0038] The second distance between the multi-camera camera module and the target object is obtained based at least in part on the first image, the third image, and a relative position relationship between the first camera unit and the third camera unit, wherein the second distance is the distance between the multi-camera camera module and the target object.

[0039] In the automatic zoom imaging method according to the present application, the adjustment instruction is further used to drive the first driving element of the driving assembly to drive at least part of the lenses in the first lens group of the at least one lens group to perform optical zooming.

[0040] In the automatic zoom imaging method according to the present application, the adjustment instruction is further used to drive the second driving element of the driving assembly to drive the second lens group of the at least one lens group to perform optical focusing.

[0041] In the automatic zoom imaging method according to the present application, the fusion of the first image of the target object collected by the first imaging unit after optical zooming and the images of the target object collected by the other imaging units of the multi-camera imaging module to obtain a fusion image includes: fusion of the first image of the target object collected by the first imaging unit after optical zooming and the second image of the target object collected by the second imaging unit to obtain a fusion image.

[0042] In the automatic zoom imaging method according to the present application, the fusion of the first image of the target object collected by the first imaging unit after optical zooming and the images of the target object collected by the other imaging units of the multi-camera imaging module to obtain a fusion image includes: fusion of the first image of the target object collected by the first imaging unit after optical zooming and the third image of the target object collected by the third imaging unit to obtain a fusion image.

[0043] In the automatic zoom imaging method according to the present application, the automatic zoom imaging method further includes: moving the multi-camera imaging module based on the motion trajectory of the target object, so that the target object is always located within the shooting window of the multi-camera imaging module.

[0044] In the automatic zoom imaging method according to the present application, the automatic zoom imaging method further includes: moving the reflecting element of the first imaging unit based on the motion trajectory of the target object.

[0045] In the automatic zoom imaging method according to the present application, the automatic zoom imaging method further includes: rotating the reflecting element of the first imaging unit based on the motion trajectory of the target object.

[0046] According to still another aspect of the present application, a camera module device is also provided, which includes:

[0047] an imaging unit including a photosensitive chip, at least one lens group located on the photosensitive path of the photosensitive chip, and a driving assembly for driving at least part of the lenses in the at least one lens group to perform optical zooming; and

[0048] a ranging unit;

[0049] wherein the driving assembly is configured to drive at least part of the lens in the at least one lens group to perform optical zooming based on adjustment instructions, the adjustment instructions being generated based on the distance between the image capturing module device and the target object, the distance between the image capturing module device and the target object being measured by the distance measuring unit.

[0050] In the image capturing module device according to the present application, the at least one lens group comprises a first lens group and a second lens group, and the driving assembly comprises a first driving element configured to drive at least part of the lens in the first lens group to perform optical zooming based on the adjustment instructions.

[0051] In the image capturing module device according to the present application, the driving assembly further comprises a second driving element configured to drive the second lens group to perform optical focusing based on the adjustment instructions.

[0052] In the image capturing module device according to the present application, the image capturing unit further comprises a reflecting element arranged on the light path of the photosensitive chip for reflecting the imaging light.

[0053] In the image capturing module device according to the present application, the driving assembly further comprises an anti-shake mechanism for driving the reflecting element to perform optical anti-shake.

[0054] In the image capturing module device according to the present application, the driving assembly further comprises an anti-shake mechanism for driving the first lens group and / or the second lens group to perform optical anti-shake.

[0055] In the image capturing module device according to the present application, the distance measuring unit comprises a projector and a receiver, the projector is configured to project a detection signal with a specific wavelength to the target object, and the receiver is configured to receive the detection signal reflected back from the target object and determine the distance between the distance measuring module and the target object based on the time of flight principle.

[0056] In the image capturing module device according to the present application, the detection signal comprises an ultrasonic detection signal, a millimeter wave detection signal, or a laser pulse detection signal.

[0057] In the image capturing module device according to the present application, the distance measuring unit is implemented as a TOF image capturing unit to acquire the distance between the image capturing module device and the target object by the TOF image capturing unit.

[0058] According to another aspect of the present application, there is also provided an image capturing system, which comprises:

[0059] the image capturing module device as described above; and the image capturing module device as described above.

[0060] a processor communicatively connected to the camera module device, wherein the processor is configured to generate an adjustment instruction based on a distance between the camera module device and the target object.

[0061] According to yet another aspect of the present application, there is also provided an automatic zoom imaging method, comprising:

[0062] obtaining a zoom instruction;

[0063] in response to the zoom instruction, obtaining a distance between the camera module device and the target object by a ranging module;

[0064] generating an adjustment instruction based on the distance, the adjustment instruction being used to drive a driving assembly of the camera unit to drive at least part of a lens group of the camera unit to perform optical zooming; and

[0065] obtaining an image of the target object captured by the camera unit after performing optical zooming.

[0066] In the automatic zoom imaging method according to the present application, in response to the zoom instruction, the distance between the camera module device and the target object is obtained by a ranging module, comprising:

[0067] projecting a detection signal to the target object;

[0068] receiving the detection signal reflected back from the target object; and

[0069] determining the distance between the ranging module and the target object based on the time of flight principle, wherein the distance between the ranging module and the target object is set as the distance between the camera module device and the target object.

[0070] In the automatic zoom imaging method according to the present application, the adjustment instruction is further used to drive a first driving element of the driving assembly to drive at least part of a first lens group of the at least one lens group to perform optical zooming.

[0071] In the automatic zoom imaging method according to the present application, the adjustment instruction is further used to drive a second driving element of the driving assembly to drive a second lens group of the at least one lens group to perform optical focusing.

[0072] In the automatic zoom imaging method according to the present application, the automatic zoom imaging method further comprises: moving the camera module device based on a motion trajectory of the target object, so that the target object is always located within a shooting window of the camera module device.

[0073] In the automatic zoom imaging method according to the present application, the automatic zoom imaging method further comprises: moving the reflecting element of the image capturing unit based on the motion trajectory of the photographed object.

[0074] In the automatic zoom imaging method according to the present application, the automatic zoom imaging method further comprises: rotating the reflecting element of the image capturing unit based on the motion trajectory of the photographed object

[0075] The further objects and advantages of the present application will be more readily understood from the following description, taken in conjunction with the accompanying drawings.

[0076] The objects, features and advantages of the present application will be better understood from the following detailed description taken in conjunction with the accompanying drawings. BRIEF DESCRIPTION OF DRAWINGS

[0077] The foregoing and other objects, features and advantages of the present application will be more readily understood upon consideration of the following detailed description, taken in conjunction with the accompanying drawings.

[0078] FIG. 1 FIG. 1 illustrates a schematic diagram of a multi-camera image capturing module according to an embodiment of the present application.

[0079] FIG. 2 FIG. 2 illustrates a schematic diagram of a binocular distance principle according to an embodiment of the present application.

[0080] FIG. 3 FIG. 3 illustrates a schematic diagram of another multi-camera image capturing module according to an embodiment of the present application.

[0081] FIG. 4 FIG. 4 illustrates a schematic diagram of an image capturing system according to an embodiment of the present application.

[0082] FIG. 5 FIG. 5 illustrates a perspective schematic diagram of an electronic device according to an embodiment of the present application.

[0083] FIG. 6 FIG. 6 illustrates a flowchart of an automatic zoom imaging method according to an embodiment of the present application.

[0084] FIG. 7 FIG. 7 illustrates a first schematic diagram of tracking a photographed object in an automatic zoom imaging method according to an embodiment of the present application.

[0085] FIG. 8 FIG. 8 illustrates a second schematic diagram of tracking a photographed object in an automatic zoom imaging method according to an embodiment of the present application.

[0086] FIG. 9 FIG. 3 illustrates a third schematic diagram of tracking a target object in an automatic zoom imaging method according to an embodiment of the present application.

[0087] FIG. 10 FIG. 4 illustrates a schematic diagram of a camera module device according to an embodiment of the present application.

[0088] FIG. 11 FIG. 5 illustrates a ranging schematic diagram of a ranging unit according to an embodiment of the present application.

[0089] FIG. 12 FIG. 6 illustrates a schematic diagram of the ranging unit being implemented as a TOF camera unit according to an embodiment of the present application.

[0090] FIG. 13 FIG. 7 illustrates a partitioning schematic diagram of a projection area of a projection element of the TOF camera unit according to an embodiment of the present application.

[0091] FIG. 14 FIG. 8 illustrates another schematic diagram of the ranging unit being implemented as a TOF camera unit according to an embodiment of the present application.

[0092] FIG. 15 FIG. 9 illustrates a flowchart of an automatic zoom imaging method according to an embodiment of the present application.

[0093] FIG. 16 FIG. 10 illustrates a schematic diagram of a camera system according to an embodiment of the present application.

[0094] FIG. 17 FIG. 11 illustrates a perspective schematic diagram of an electronic device according to an embodiment of the present application.

[0095] FIG. 18 FIG. 12 illustrates a first schematic diagram of tracking a target object in an automatic zoom imaging method according to an embodiment of the present application.

[0096] FIG. 19 FIG. 13 illustrates a second schematic diagram of tracking a target object in an automatic zoom imaging method according to an embodiment of the present application.

[0097] FIG. 20 FIG. 14 illustrates a third schematic diagram of tracking a target object in an automatic zoom imaging method according to an embodiment of the present application. DETAILED DESCRIPTION

[0098] Hereinafter, example embodiments according to the present application will be described in detail with reference to accompanying drawings. Obviously, the described embodiments are only a part but not all of the embodiments of the present application. It should be understood that the present application is not limited to the described embodiments.

[0099] Exemplary multi-camera camera module

[0100] AsFIG. 1 As shown, a multi-camera module according to an embodiment of this application is illustrated, wherein the structural configuration of the multi-camera module enables the multi-camera module to perform automatic optical zoom based on the distance between itself and the subject, so as to provide a better shooting experience.

[0101] like FIG. 1 As shown, the multi-camera module 710 according to an embodiment of this application includes a first camera unit 711 with optical zoom function, and a second camera unit 712 having a preset relative positional relationship with the first camera unit 711. Specifically, the first camera unit 711 includes a photosensitive chip 7111, at least one lens group 7112 located on a photosensitive path set by the photosensitive chip 7111, and a driving component 7113 for driving at least some of the lenses in the at least one lens group 7112 to perform optical zoom.

[0102] Accordingly, the first camera unit 711 and the second camera unit 712 are capable of acquiring images of the target. Specifically, in this embodiment, the application of the first camera unit 711 and the second camera unit 712 of the multi-camera module 710 is further expanded. More specifically, in this embodiment, the first camera unit 711 and the second camera unit 712 measure the distance information between the multi-camera module 710 and the target based on the binocular ranging principle. That is, the distance between the multi-camera module 710 and the target is calculated at least partially based on the first image of the target acquired by the first camera unit 711, the second image of the target acquired by the second camera unit 712, and the relative positional relationship between the first camera unit 711 and the second camera unit 712. Furthermore, the driving component 7113 of the first camera unit 711 is configured to drive at least a portion of the lenses in the at least one lens group 7112 to perform optical zoom based on the adjustment command generated by the distance information. In this way, the multi-camera module 710 structure configuration realizes the function of automatic optical zoom.

[0103] FIG. 2 The illustration shows a schematic diagram of the binocular ranging principle according to an embodiment of this application. FIG. 2As shown, P is a certain point on the target, OR and OT are the optical centers of the first camera unit 711 and the second camera unit 712 respectively, the imaging points of point P on the photosensitive chips 7111 of the first camera unit 711 and the second camera unit 712 are P and P' respectively, f is the effective focal length of the second camera unit 712, B is the center distance between the first camera unit 711 and the second camera unit 712, Z is the depth information (i.e. distance information) to be calculated, and X is the distance between the imaging points P and P'.

[0104] X = B - (X R -X T )

[0105] According to the principle of similar triangles:

[0106] (B - (X R -X T )) / B = (Z - f) / Z

[0107] Therefore, Z = fB / (X R -X T )

[0108] Therefore, the focal length and the center distance B can be obtained by calibration, and thus the depth information Z (i.e. distance) can be obtained by obtaining the value of X R -X (i.e. parallax d).

[0109] It is worth mentioning that the first camera unit 711 and the second camera unit 712 have radial distortion due to the characteristics of the optical lens, and the distortion degree can be determined by three parameters K71, K72 and K73. In addition, due to the error in assembly and other aspects, the photosensitive chip 7111 and the optical lens are not completely parallel, and thus the imaging of the first camera unit 711 and the second camera unit 712 also has tangential distortion, and the distortion degree can be determined by two parameters P71 and P72. In the calibration of a single camera unit, the internal parameters (including but not limited to focal length f, imaging origin Cx, Cy, and the above five distortion parameters) and external parameters (world coordinates of the calibration object) of the single camera unit are mainly determined, while the calibration of the binocular camera module (i.e. the camera unit combination composed of the first camera unit 711 and the second camera unit 712) not only needs to obtain the internal parameters of each camera unit, but also needs to measure the relative position between the first camera unit 711 and the second camera unit 712 (i.e. the rotation matrix R and the translation vector t of the second camera unit 712 relative to the first camera unit 711) through calibration.

[0110] After calibration, the images captured by the first camera unit 711 and the second camera unit 712 can be corrected based on the calibrated intrinsic parameters and the relative position relationship between the two cameras to eliminate distortion and perform line alignment, so as to perform binocular distance measurement.

[0111] It is worth mentioning that, in the embodiments of the present application, since the multi-camera camera module 710 has relatively low requirements on distance measurement accuracy, in order to reduce the workload, calibration can be performed at some specific points, for example, points in the depth of field region (i.e., the window region) of the first camera unit 711 and the second camera unit 712. Furthermore, for example, the farthest depth point and the nearest depth point are selected, and the line between the nearest depth point X71 and the farthest depth point X72 is divided into N equal parts, and then the farthest depth point, the nearest depth point and each equal part point are calibrated, and the obtained parameters are programmed, thereby improving the efficiency of distance measurement and reducing the workload required for calibration.

[0112] Further, in the embodiments of the present application, the second camera unit 712 can be configured as a main camera unit for capturing a first image of the target object, which preferably has a relatively large field of view, for example, the field of view of the second camera unit 712 is greater than 760°; and the first camera unit 711 is configured as a sub-camera unit for adjusting its focal length based on the distance between the multi-camera module and the target object and capturing a first image of the target object. Accordingly, after obtaining the first image and the second image, the multi-camera camera module 710 can fuse the first image and the second image to generate a fused image with higher imaging quality.

[0113] More specifically, as shown in FIG. 1 In the embodiments of the present application, at least one lens group 7112 of the first camera unit 711 includes a first lens group 7114 and a second lens group 7115, and the driving assembly 7113 includes a first driving element 7117, which is configured to drive at least part of the lenses in the first lens group 7114 to perform optical zoom based on the adjustment instruction. That is, in the embodiments of the present application, the first driving element 7117 is a zoom driver for driving at least part of the lenses in the first lens group 7114 to move to perform optical zoom.

[0114] As shown in FIG. 1It is shown in the embodiments of the present application that the driving assembly 7113 of the first camera unit 711 further comprises a second driving element 7118 configured to drive the second lens group 7115 to perform optical focusing based on the adjustment instruction. That is, in the embodiments of the present application, the first camera unit 711 further has a focusing function, and the second driving element 7118 is a focusing driver. It can be understood that after optical zooming is performed by the first driving element 7117, the second driving element can drive the second lens group 7115 to move to not only achieve optical focusing, but also compensate for the impact after optical zooming, so as to improve the imaging quality. That is, in the present application, the first driving element 7117 and the second driving element 7118 drive the first lens group 7114 and the second lens group 7115 respectively to jointly realize optical zooming and ensure that the TTL (Total Track length) is unchanged to still have high imaging quality after optical zooming; that is, the first driving element 7117 drives the first lens group 7114 to realize zooming, and the second driving element 7118 drives the second lens group 7115 to realize compensation and / or focusing, so as to obtain high-quality images.

[0115] It is worth mentioning that in other examples of the present application, the first driving element 7117 and the second driving element 7118 can be implemented as the same driver (that is, the zooming driver and the focusing driver are implemented as the same driver), or the first driving element 7117 and the second driving element 7118 have an integrated structure, and the present application is not limited thereto. Preferably, the first lens group 7114 and the second lens group 7115 are fixed to a connecting shaft at the same time, so that the first lens group 7114 and the second lens group 7115 do not deviate during movement, and the connecting shaft can be a guide rail (the first lens group 7114 and the second lens group 7115 are assembled on the same guide rail) or a hole shaft structure (the first lens group 7114 and the second lens group 7115 are connected by a shaft and move along the shaft).

[0116] It can be understood that in the embodiments of the present application, the at least one lens group 7122 can further include a larger number of lens groups, for example, a third lens group 7126, the position of which is fixed as a fixed lens group, and the present application is not limited thereto.

[0117] It is also worth mentioning that there are requirements for the thickness of the multi-camera camera module 710 for some terminal devices (for example, smart phones), that is, it is necessary to ensure that the thickness of the multi-camera camera module 710 is less than a certain value. Accordingly, in other examples of the present application, the first camera unit 711 can be implemented as a periscopic camera unit, and accordingly, in these examples, the first camera unit 711 further includes a reflecting element 7119 disposed on the light path of the photosensitive chip 7111 for turning the imaging light.

[0118] In order to further improve the imaging performance of the first camera unit 711, in some examples of the present application, the first camera unit 711 is also configured with an optical image stabilization function. For example, in some examples of the present application, the first camera unit 711 further includes a reflecting element 7119 disposed on the light path of the photosensitive chip 7111 for turning the imaging light; or the driving assembly 7113 further includes an anti-shake mechanism for driving the first lens group 7114 and / or the second lens group 7115 to perform optical image stabilization, thereby compensating for errors caused by the photographer's hand shake.

[0119] In actual application, when the distance between the photographed target and the multi-camera camera module 710 is far, the first camera unit 711 and the second camera unit 712 may not be able to measure the distance, that is, the distance between the photographed target and the multi-camera camera module 710 exceeds the shooting range. Accordingly, as shown in FIG. 3 In the embodiments of the present application, a third camera unit 713 with a longer shooting range can be further configured on the basis of the original structure of the multi-camera camera module 710, that is, the third equivalent focal length of the third camera unit 713 is greater than the second equivalent focal length of the second camera unit 712. Further, the third camera unit 713 and the first unit obtain the distance between the multi-camera camera module 710 and the photographed target through binocular distance measurement principle, that is, at least partially based on the first image of the photographed target collected by the first camera unit 711, the third image of the photographed target collected by the third camera unit 713, and the relative position relationship between the first camera unit 711 and the third camera unit 713.

[0120] More specifically, in this embodiment, when the distance between the multi-camera module 710 and the target is greater than a preset threshold, the first camera unit 711 and the third camera unit 713 cooperate to measure the distance; when the distance between the multi-camera module 710 and the target is less than the preset threshold, the first camera unit 711 and the second camera unit 712 cooperate to measure the distance. That is, in some examples of this application, the multi-camera module 710 may further include a judgment module for determining the shooting distance to decide which two camera units to activate for distance measurement.

[0121] In summary, the multi-camera module 710 based on the embodiments of this application is explained. The structural configuration of the multi-camera module 710 enables the multi-camera module 710 to perform automatic optical zoom based on the distance between itself and the subject, so as to provide a better shooting experience.

[0122] Schematic camera system

[0123] According to another aspect of this application, a camera system is also provided.

[0124] FIG. 4 The illustration shows a schematic diagram of the camera system according to an embodiment of this application.

[0125] like FIG. 4 As shown, the camera system 730 includes a multi-camera module 710 as described above and a processor 720 communicatively connected to the multi-camera module 710. The processor 720 is configured to generate adjustment commands based on the distance of the multi-camera module 710 relative to the target. Accordingly, upon receiving the adjustment command, the driving component 7113 of the first camera unit 711 drives at least a portion of the lenses in the at least one lens group 7112 to perform optical zoom. In this way, the camera system 730 achieves automatic zoom shooting functionality.

[0126] Accordingly, in this embodiment, the processor 720 is further configured to fuse the first image of the target captured by the first camera module after optical zoom and the second image of the target captured by the second camera module to obtain a fused image of the target.

[0127] Alternatively, in this embodiment, the processor 720 is further configured to fuse a first image of the target captured by the first camera module after optical zoom and a third image of the target captured by the third camera module to obtain a fused image of the target.

[0128] Schematic electronic device

[0129] According to another aspect of the present application, an electronic device is also provided.

[0130] FIG. 5 A perspective view of an electronic device according to an embodiment of the present application is shown.

[0131] As shown in FIG. 5 the electronic device 7100 according to an embodiment of the present application includes an electronic device body 7101 and a multi-camera camera module 710 as described above assembled to the electronic device body 7101. In a specific implementation, the multi-camera camera module 710 is preferably configured on the back of the electronic device body 7101 to be configured as a rear camera module, of course, it can also be configured on the front of the electronic device body 7101 to be configured as a front camera module.

[0132] As shown in FIG. 5 in an embodiment of the present application, the electronic device body 7101 includes a screen and an integrated circuit, wherein the screen can be used to display image data collected by the multi-camera camera module 710, and the integrated circuit can be used to process image data collected by the multi-camera camera module 710 to control the multi-camera camera module 710 to realize an automatic zoom shooting function.

[0133] Schematic auto-zoom imaging method

[0134] According to yet another aspect of the present application, an automatic zoom imaging method is also provided.

[0135] FIG. 6 A flowchart of an automatic zoom imaging method according to an embodiment of the present application is shown.

[0136] As shown in FIG. 6 the automatic zoom imaging method according to an embodiment of the present application includes the steps of: S7110, obtaining a zoom instruction; S7120, in response to the zoom instruction, obtaining a distance between a multi-camera camera module 710 and a target to be photographed, the multi-camera camera module 710 including a first camera unit 711; S7130, based on the distance, generating an adjustment instruction for driving a driving assembly 7113 of the first camera unit 711 to drive at least part of a lens group 7112 of the first camera unit 711 to perform optical zoom; and S7140, fusing a first image of the target to be photographed collected by the first camera unit 711 after optical zoom and an image of the target to be photographed collected by another camera unit of the multi-camera camera module 710 to obtain a fused image.

[0137] In step S7110, a zoom instruction is acquired. In the embodiments of the present application, the zoom instruction includes but is not limited to single-clicking a target object displayed on the screen, double-clicking the target object displayed on the screen, double-hand zooming the target object displayed on the screen, etc. It should be understood that the zoom instruction can be set in advance based on the needs of the user, and cannot conflict with other instruction settings.

[0138] In step S7120, a distance between the multi-camera camera module 710 and the target object is acquired in response to the zoom instruction, and the multi-camera camera module 710 includes the first camera unit 711.

[0139] In an example of the present application, in response to the zoom instruction, the process of acquiring the distance between the multi-camera camera module 710 and the target object includes: first obtaining a first image of the target object by the first camera unit 711 and a second image of the target object by the second camera unit 712; and then, based at least in part on the first image, the second image, and the relative positional relationship between the first camera unit 711 and the second camera unit 712, obtaining a first distance between the multi-camera camera module 710 and the target object, wherein the first distance is the distance between the multi-camera camera module 710 and the target object.

[0140] It is worth mentioning that when the distance is measured by the binocular distance measurement principle through the first camera unit 711 and the second camera unit 712, in order to take a better first image to improve the distance measurement accuracy, at least part of the lenses of at least one lens group 7112 of the first camera unit 711 can be moved by the driving assembly 7113 to perform optical zoom before binocular distance measurement.

[0141] That is, in the embodiments of the present application, before the first image of the target object is obtained by the first camera unit 711, the driving assembly 7113 of the first camera unit 711 is pre-driven to drive at least part of the lenses of at least one lens group 7112 of the first camera unit 711 to perform optical zoom.

[0142] It should be understood that because the first camera unit 711 has been pre-zoomed in step S7120, the driving assembly 7113 can reduce the required movement distance for zooming in step S7130, thereby improving the zooming efficiency and enhancing the shooting experience.

[0143] In another example of this application, the process of obtaining the distance between the multi-camera module 710 and the target in response to the zoom command further includes: in response to the first distance being greater than a preset threshold, activating the third camera unit 713 of the multi-camera module 710 to obtain a third image of the target through the third camera unit 713, wherein the third equivalent focal length of the third camera unit 713 is greater than the second equivalent focal length of the second camera unit 712; and obtaining a second distance between the multi-camera module 710 and the target based at least in part on the first image, the third image, and the relative positional relationship between the first camera unit 711 and the third camera unit 713, wherein the second distance is the distance between the multi-camera module 710 and the target.

[0144] In step S7130, an adjustment command is generated based on the distance. The adjustment command is used to drive the drive component 7113 of the first camera unit 711 to drive at least a portion of the lenses in at least one lens group 7112 of the first camera unit 711 to perform optical zoom.

[0145] Specifically, in this embodiment of the application, the adjustment command is used to drive the first driving element 7117 of the driving assembly 7113 to drive at least a portion of the lenses in the first lens group 7114 of the at least one lens group 7112 to perform optical zoom; and the adjustment command is further used to drive the second driving element 7118 of the driving assembly 7113 to drive the second lens group 7115 of the at least one lens group 7112 to perform optical focus.

[0146] That is, in this embodiment of the application, after optical zooming is performed by the first driving element 7117, optical focusing is performed by the second driving element 7118 to achieve compensation and improve the imaging quality of the first camera unit 711 after zooming.

[0147] In step S7140, the first image of the target captured by the first camera unit 711 after optical zoom and the images of the target captured by the other camera units of the multi-camera module 710 are fused to obtain a fused image.

[0148] In one example of this application, fusing the first image of the subject captured by the first camera unit 711 after optical zoom and the images of the subject captured by other camera units of the multi-camera module 710 to obtain a fused image includes: fusing the first image of the subject captured by the first camera unit 711 after optical zoom and the second image of the subject captured by the second camera unit 712 to obtain a fused image.

[0149] In another example of this application, fusing the first image of the subject captured by the first camera unit 711 after optical zoom and the images of the subject captured by other camera units of the multi-camera module 710 to obtain a fused image includes: fusing the first image of the subject captured by the first camera unit 711 after optical zoom and the third image of the subject captured by the third camera unit 713 to obtain a fused image.

[0150] In summary, the autofocus imaging method based on the embodiments of this application has been clarified, which is implemented based on the structural configuration of the multi-camera module 710 to improve the shooting experience of the photographer.

[0151] Specifically, the automatic zoom imaging method can be applied to image capture as well as video capture. When capturing an image, the multi-camera module 710 (or the electronic device) is usually kept in a disabled state. At this time, the photographer can capture a complete image by issuing a zoom command to initiate automatic zoom.

[0152] When the autofocus imaging method is applied to video shooting, the subject may move during the shooting process, and this movement may be irregular, especially movement along the shooting direction (i.e., distance variation), making it difficult to match with the movement of the mobile device, thus ensuring that the shape and size of the object in the video remain unchanged or that the image quality is guaranteed. That is, the movement of the subject is irregular, moving left-right or up-down relative to the photographer. The photographer can achieve this by moving the mobile device in the same direction, keeping the subject centered in the frame. To further better meet the needs of video shooting, in practical applications, the photographer can shoot in the following way:

[0153] 1. Without the photographer moving the electronic device, the multi-camera module 710 is driven by a driver to achieve tracking shooting, such as... FIG. 7 As shown;

[0154] 2. The photographer does not move the electronic device, and the multi-camera module 710 remains stationary relative to the electronic device. The reflective unit of the first camera unit 711 is moved to achieve tracking shooting, such as... FIG. 8 As shown;

[0155] 3. The photographer does not move the electronic device, and the multi-camera module 710 remains stationary relative to the electronic device. The reflective unit of the first camera unit 711 is rotated to achieve tracking shooting. FIG. 9 As shown.

[0156] Furthermore, it's important to note that during video recording, the distance between the subject and the photographer often changes. If the zoom level isn't adjusted promptly, it can lead to blurry images or changes in the size of the subject. Therefore, this invention's automatic zoom function continuously adjusts the zoom level, ensuring that the subject remains sharp or its size remains constant in the video. In other words, when applied to video recording, this invention ensures the subject is always centered in the frame (or at the photographer's desired position), while also maintaining its sharpness and size.

[0157] Accordingly, in this embodiment of the application, the automatic zoom imaging method may further include: moving the multi-camera module 710 based on the motion trajectory of the target, so that the target is always located within the shooting window of the multi-camera module 710.

[0158] Accordingly, in this embodiment of the application, the automatic zoom imaging method may further include: moving the reflective element 7119 of the first camera unit 711 based on the motion trajectory of the target.

[0159] Accordingly, in the embodiments of this application, the automatic zoom imaging method may further include: rotating the reflective element 7119 of the first camera unit 711 based on the motion trajectory of the target.

[0160] Based on the method described above, during video shooting, the zoom level can be adjusted according to the movement of the object, so that the size of the subject displayed in the image can remain unchanged, or its position can remain the same, thereby improving the shooting experience.

[0161] Exemplary camera module apparatus

[0162] like FIG. 10 As shown, a camera module device according to an embodiment of this application is illustrated, wherein the structural configuration of the camera module device enables the camera module device to perform automatic optical zoom based on the distance between itself and the subject, so as to provide a better shooting experience.

[0163] like FIG. 10 As shown, the camera module device 810 according to an embodiment of this application includes a camera unit 811 with optical zoom function, and a ranging unit 812 configured to measure the distance between the camera module device 810 and the target being photographed. Specifically, as FIG. 10As shown, the camera unit 811 includes a photosensitive chip 8111, at least one lens group 8112 located on the photosensitive path set by the photosensitive chip 8111, and a driving component 8113 for driving at least some of the lenses in the at least one lens group 8112 to perform optical zoom.

[0164] Accordingly, in this embodiment, the ranging unit 812 can measure the distance information between the camera module device 810 and the target, so that the driving component 8113 of the camera unit 811 can be configured to drive at least some of the lenses in the at least one lens group 8112 to perform optical zoom based on the adjustment command generated by the distance information. In this way, the structural configuration of the camera module device 810 realizes the function of automatic optical zoom.

[0165] It is worth noting that, in this embodiment, the camera unit 811 and the ranging unit 812 refer to two structurally integrated components in the camera module device 810, rather than structurally separate components. Specifically, in the camera module device 810, the ranging unit 812 and the camera unit 811 can be integrally formed through processes such as molding to create the camera module device 810, and the camera module device 810 is connected as a whole to other peripheral devices, such as an image processor.

[0166] Specifically, in this embodiment, the ranging unit 812 can obtain the distance between the camera module device 810 and the target object using the time-of-flight law. Depending on the wavelength of the detection signal used, the ranging unit 812 can be implemented using ultrasonic waves, millimeter-wave radar, lidar, or other means.

[0167] FIG. 11 The figure illustrates a ranging schematic diagram of the ranging unit 812 according to an embodiment of this application. For example... FIG. 11 As shown, the ranging unit 812 includes a projector 8121 and a receiver 8122. The projector 8121 is configured to project a detection signal with a specific wavelength onto the target. The receiver 8122 is configured to receive the detection signal reflected back from the target and determine the distance between the ranging module and the target based on the time-of-flight law.

[0168] Specifically, when the ranging unit 812 measures distance using ultrasonic waves, the projector 8121 projects an ultrasonic detection signal towards the target. The ultrasonic detection signal propagates through the air, is reflected back upon encountering the target, and is received by the receiver 8122. Correspondingly, a timer calculates the time elapsed from the emission of the ultrasonic wave to its reception. The distance between the ranging unit 812 and the target is S = 8340t / 82, where S represents the distance between the ranging unit 812 and the target, and t represents the time elapsed from the emission of the ultrasonic wave to its reception.

[0169] When the ranging unit 812 performs ranging using millimeter radar waves, the projector 8121 projects a millimeter wave detection signal toward the target. Millimeter waves refer to electromagnetic waves in the 830–8300 GHz frequency range (wavelength 81–810 mm). Because millimeter waves attenuate weakly in the atmosphere, they can detect and sense much greater distances; long-range radar can achieve detection and sensing distances exceeding 8200 m.

[0170] When the ranging unit 812 performs ranging using a lidar, the projector 8121 projects a laser pulse detection signal towards the target. The laser pulse detection signal propagates through the air, is reflected back upon hitting the target, and is received by the receiver 8122. Correspondingly, a timer calculates the time elapsed from the emission of the laser pulse detection signal to its reception, and based on this time elapsed and the propagation speed of the laser pulse detection signal, the distance between the ranging unit 812 and the target can be obtained.

[0171] It should be understood that in this embodiment of the application, the ranging unit 812 is an integrated component of the camera module device 810. Therefore, the distance between the ranging unit 812 and the target is the same as the distance between the camera module device 810 and the target.

[0172] It is worth mentioning that the ranging unit 812 can be composed of one or more of the above types, thereby realizing ranging at different distances and improving the overall ranging accuracy.

[0173] Preferably, in this embodiment of the application, the ranging unit 812 is implemented as a TOF camera unit 812A. That is, preferably, the TOF camera unit 812A not only obtains distance information through the time-of-flight law, but also obtains image data of the target being measured (i.e., obtains texture information of the target being photographed).

[0174] Those skilled in the art will know that, with market development, terminal devices, especially smartphones, are increasingly using rear-mounted TOF camera units 812A, which can be used to capture 83D images or for other applications. Accordingly, in this embodiment, the distance information collected by the TOF camera unit 812A is incorporated into the application. It should be understood that in existing TOF camera units 812A, their main function is to collect texture and depth information of the target object; therefore, their accuracy must be sufficiently high. However, in this embodiment, the main function of the TOF camera unit 812A is to provide distance information; therefore, its accuracy requirement can be relatively lower to reduce costs. It is worth noting that the projection power may be relatively high when performing distance measurement; therefore, eye safety must be ensured.

[0175] FIG. 12 The illustration shows a schematic diagram of the ranging unit 812 according to an embodiment of this application being implemented as a TOF camera unit 812A. For example... FIG. 12 As shown, the TOF camera unit 812A includes a projection component 8121A and a receiving component 8122A. The projection component 8121A includes a projection element 8123A, an optical element 8124A, a circuit board 8125A, and a bracket 8126A. The projection element 8123A is attached to the circuit board 8125A. The optical element 8124A is held on the projection path of the projection element 8123A by the bracket 8126A to perform optical processing on the detection signal projected by the projection element 8123A. The receiving component 8122A is configured to receive the detection signal from the target to obtain the distance between the TOF camera unit 812A and the target based on the time-of-flight law.

[0176] Furthermore, such as FIG. 12 As shown, the projection component 8121A further includes a detection element 8127A, configured to detect whether the working state of the TOF camera unit 812A is abnormal. For example, in one example of this application, the detection element 8127A is a PD element (Photo-Diode) to detect the energy of the projection signal generated by the projection element 8123A. Of course, the detection element 8127A can also be implemented as other mechanisms to detect whether the projection element 8123A is normal.

[0177] Furthermore, in this embodiment, the projection element 8123A is implemented as a VCSEL laser projector, and the VCSEL laser projector is divided into multiple regions, wherein the VCSEL projection includes multiple laser projection points. Examples are given, but not limited to, such as... FIG. 13As shown, the projection element 8123A is divided into four projection regions A, B, C, and D. Region A has fewer projection dots than the other regions, but the energy of the projection dots in region A is greater than that in the other regions. Accordingly, region A is preferably used for projection to achieve distance measurement, while regions B, C, and D, due to their larger number of projection dots, offer higher measurement accuracy and are suitable for other applications, such as acquiring depth information. It should be understood that the number of regions to which the projection element 8123A is divided is not limited by this application; the division only needs to satisfy the following: at least one region has fewer dots than the other regions, and preferably, the region with the most dots is 83-810 times the region with the fewest dots.

[0178] FIG. 14 The illustration shows another schematic diagram of the ranging unit 812 according to an embodiment of this application being implemented as a TOF camera unit 812A. Compared to FIG. 12 The TOF camera unit 812A shown in this embodiment further includes a collimating element 8129A disposed between the projection element 8123A and the optical element 8124A, configured to align the detection signal projected by the projection element 8123A. Accordingly, when the projection area of ​​the projection element 8123A is divided into multiple areas, the collimating unit collimates the generated detection signal during ranging, allowing for a longer projection distance and reducing the power consumption required for projection. Preferably, the projection element 8123A is implemented as a VCSEL laser projector, and the pattern formed by the projection points of the VCSEL laser is regular.

[0179] It is worth noting that, in this embodiment, when the ranging unit 812 is implemented as the TOF camera unit, that is, when the camera module device 810 is implemented as a multi-camera camera module, the camera unit 811 and the TOF camera unit 812A refer to two camera units 811 that are structurally integrated in the camera module device 810, rather than structurally separate camera modules. Specifically, in the camera module device 810, the TOF camera unit 812A and the camera unit 811 can be integrally formed by molding or other processes to create the camera module device 810, and the camera module device 810 is connected as a whole to other peripheral devices, such as an image processor.

[0180] It is worth mentioning that, in this embodiment of the application, the ranging unit 812 can also be used as an auxiliary ranging tool in the calibration process of the camera unit 811 of the camera module device 810, that is, to capture scenes at different distances and burn them to the camera unit 811.

[0181] Furthermore, such as FIG. 10 As shown in this embodiment, the camera unit 811 includes at least one lens group 8112 comprising a first lens group 8114 and a second lens group 8115, and the driving assembly 8113 includes a first driving element 8117. The first driving element 8117 is configured to drive at least a portion of the lenses in the first lens group 8114 to perform optical zoom based on the adjustment command. That is, in this embodiment, the first driving element 8117 is a zoom driver, which is used to drive at least a portion of the lenses in the first lens group 8114 to move to perform optical zoom.

[0182] like FIG. 10 As shown in this embodiment, the driving component 8113 of the camera unit 811 further includes a second driving element 8118, which is configured to drive the second lens group 8115 based on the adjustment command to perform optical focusing and / or compensation. That is, in this embodiment, the camera unit 811 further has a focusing function, and the second driving element 8118 is a focus driver. It should be understood that after optical zooming via the first driving element 8117, the second driver can drive the second lens group 8115 to move to compensate for the effects of optical zoom, thereby improving image quality.

[0183] It is worth mentioning that in other examples of this application, the first driving element 8117 and the second driving element 8118 may be implemented as the same driver (i.e., the zoom driver and the focus driver are implemented as the same driver), or the first driving element 8117 and the second driving element 8118 may have an integral structure, which is not limited to this application.

[0184] It should be understood that in the embodiments of this application, the at least one lens group 8112 may also include more lens groups, for example, it may also include a third lens group 8116, the position of which is fixed as a fixed lens group, which is not limited by this application.

[0185] It is also worth mentioning that for some terminal devices (e.g., smartphones), there are requirements regarding the thickness of the camera module device 810; that is, the thickness of the camera module device 810 needs to be less than a certain value. Accordingly, in other examples of this application, the camera unit 811 can be implemented as a periscope camera unit 811. Accordingly, in these examples, the camera unit 811 further includes a reflective element 8119 disposed on the light-sensing path of the photosensitive chip 8111 for deflecting imaging light.

[0186] To further improve the imaging performance of the camera unit 811, in some examples of this application, the camera unit 811 is also configured with optical image stabilization. For example, in some examples of this application, the camera unit 811 further includes a reflective element 8119 disposed on the light-sensing path of the photosensitive chip 8111 for deflecting imaging light; or, the driving assembly 8113 further includes an image stabilization mechanism for driving the first lens group 8114 and / or the second lens group 8115 to perform optical image stabilization, thereby compensating for errors caused by the photographer's hand tremors.

[0187] In summary, the camera module device 810 based on the embodiments of this application is explained. The structural configuration of the camera module device 810 enables the camera module device 810 to perform automatic optical zoom based on the distance between itself and the target, so as to provide a better shooting experience.

[0188] To illustrate how the camera module device 810 performs automatic optical zoom (i.e., how the camera unit 811 performs automatic optical zoom), the automatic zoom imaging method applicable to the camera module device 810 is described below.

[0189] Schematic auto-zoom imaging method

[0190] FIG. 15 The illustration shows a flowchart of an automatic zoom imaging method according to an embodiment of this application.

[0191] like FIG. 15 As shown, the automatic zoom imaging method according to an embodiment of this application includes the following steps: S8110, obtaining a zoom command; S8120, in response to the zoom command, obtaining the distance between the camera module device 810 and the target, the camera module device 810 including a camera unit 811; S8130, based on the distance, generating an adjustment command, the adjustment command being used to drive the driving component 8113 of the camera unit 811 to drive at least a portion of the lenses in at least one lens group 8112 of the camera unit 811 to perform optical zoom; and S8140, obtaining an image of the target captured by the camera unit 811 after optical zoom.

[0192] In step S8110, a zoom command is obtained. In this embodiment, the zoom command includes, but is not limited to, clicking on the subject displayed on the screen, double-clicking on the subject displayed on the screen, or zooming in and out on the subject displayed on the screen with both hands. It should be understood that the zoom command can be preset based on the user's needs and cannot conflict with other command settings.

[0193] In step S8120, in response to the zoom command, the distance between the camera module device 810 and the target is obtained, wherein the camera module device 810 includes a camera unit 811.

[0194] In one example of this application, the process of obtaining the distance between the camera module device 810 and the target in response to the zoom command includes: the projector 8121 of the ranging unit 812 projects a detection signal onto the target; then, the detection signal reflected back from the target is received; and then, the distance between the ranging module and the target is determined based on the time-of-flight law, wherein the distance between the ranging module and the target is set as the distance between the camera module device 810 and the target.

[0195] In this embodiment, the detection signal includes, but is not limited to, millimeter-wave detection signal, ultrasonic detection signal, and laser pulse detection signal.

[0196] Preferably, in this embodiment of the application, the ranging unit 812 is implemented as a TOF camera unit 812A.

[0197] When the ranging unit 812 is implemented as a TOF camera unit 812A, the detection signal projected by the TOF camera unit 812A is a laser pulse, which poses a certain safety hazard to the human eye. Accordingly, before the TOF camera unit 812A performs ranging, the autofocus imaging method further includes: acquiring an image of the target through the TOF camera unit 812A; analyzing the image to determine whether the image content contains a human eye; and delaying ranging if the image content contains a human eye, otherwise starting ranging.

[0198] Similarly, in another embodiment of this application, the autofocus imaging method further includes: in response to the presence of a human eye in the content of the image, projecting a detection signal through a region with relatively low projection energy of the TOF camera unit 812A to perform distance measurement. That is, in this example, the projection area of ​​the TOF camera unit 812A comprises multiple regions, wherein some regions generate projection beams with lower energy. In other words, when the image contains a human eye, the region with lower energy is used to project the beam for distance measurement.

[0199] In step S8130, an adjustment command is generated based on the distance. The adjustment command is used to drive the drive component 8113 of the camera unit 811 to drive at least a portion of the lenses in at least one lens group 8112 of the camera unit 811 to perform optical zoom.

[0200] Specifically, in this embodiment, the adjustment command is used to drive the first driving element 8117 of the driving assembly 8113 to drive at least a portion of the lenses in the first lens group 8114 of the at least one lens group 8112 to perform optical zoom; and the adjustment command is further used to drive the second driving element 8118 of the driving assembly 8113 to drive the second lens group 8115 of the at least one lens group 8112 to perform optical focus.

[0201] That is, in this embodiment of the application, after optical zooming is performed by the first driving element 8117, optical focusing is performed by the second driving element 8118 to achieve compensation and improve the imaging quality of the camera unit 811 after zooming.

[0202] In step S8140, an image of the target is obtained by the camera unit 811 after optical zoom. That is, after optical zoom, the image of the target is acquired by the zoomed camera unit 811.

[0203] In summary, an autofocus imaging method applicable to the camera module device 810 described above, based on the embodiments of this application, has been explained. This method is implemented based on the structural configuration of the camera module device 810 to improve the shooting experience for the photographer.

[0204] Specifically, the automatic zoom imaging method can be applied to image capture as well as video capture. When capturing an image, the camera module device 810 (or the electronic device) is typically kept in a disabled state. At this time, the photographer issues a zoom command to initiate automatic zoom, thus capturing a complete image.

[0205] When the autofocus imaging method is applied to video shooting, the subject may move during the shooting process, and this movement may be irregular. To better meet the needs of video shooting, in practical applications, the photographer can shoot in the following ways:

[0206] 1. The photographer does not move the electronic device; the entire camera module 810 is driven by a driver to achieve tracking and shooting. FIG. 18 As shown;

[0207] 2. The photographer does not move the electronic device, and the camera module device 810 remains stationary relative to the electronic device. The reflective unit of the camera unit 811 is moved to achieve tracking shooting, such as... FIG. 19 As shown;

[0208] 3. The photographer does not move the electronic device, and the camera module device 810 remains stationary relative to the electronic device. The reflective unit of the camera unit 811 is rotated to achieve tracking shooting. FIG. 20 As shown.

[0209] Accordingly, in this embodiment of the application, the automatic zoom imaging method may further include: moving the camera module device 810 based on the motion trajectory of the target, so that the target is always located within the shooting window of the camera module device 810.

[0210] Accordingly, in the embodiments of this application, the automatic zoom imaging method may further include: moving the reflective element 8119 of the camera unit 811 based on the motion trajectory of the target.

[0211] Accordingly, in the embodiments of this application, the automatic zoom imaging method may further include: rotating the reflective element 8119 of the camera unit 811 based on the motion trajectory of the target.

[0212] Based on the method described above, during video shooting, the zoom level can be adjusted according to the movement of the object, so that the size of the subject displayed in the image can remain unchanged, or its position can remain the same, thereby improving the shooting experience.

[0213] Schematic camera system

[0214] According to another aspect of this application, a camera system is also provided.

[0215] FIG. 16 The illustration shows a schematic diagram of the camera system according to an embodiment of this application.

[0216] like FIG. 16 As shown, the camera system 830 includes a camera module device 810 as described above and a processor 820 communicatively connected to the camera module device 810. The processor 820 is configured to generate adjustment commands based on the distance of the camera module device 810 relative to the target. Accordingly, upon receiving the adjustment commands, the driving component 8113 of the camera unit 811 drives at least a portion of the lenses in the at least one lens group 8112 to perform optical zoom. In this way, the camera system 830 achieves automatic zoom shooting functionality.

[0217] Schematic electronic device

[0218] According to another aspect of this application, an electronic device is also provided.

[0219] FIG. 17The illustration shows a perspective view of an electronic device according to an embodiment of this application.

[0220] like FIG. 17 As shown, the electronic device 8100 according to an embodiment of this application includes an electronic device 8100 body and a camera module device 810 as described above, which is assembled on the electronic device body 8101. In a specific implementation, the camera module device 810 is preferably disposed on the back of the electronic device body 8101 to be configured as a rear camera module. Of course, it can also be disposed on the front of the electronic device body 8101 to be configured as a front camera module.

[0221] like FIG. 17 As shown in the embodiment of this application, the main body 8101 of the electronic device includes a screen and an integrated circuit. The screen can be used to display image data collected by the camera module device 810, and the integrated circuit can be used to process the image data collected by the camera module device 810 to control the camera module device 810 to realize the automatic zoom shooting function.

[0222] Those skilled in the art should understand that the embodiments of the present invention described above and shown in the accompanying drawings are merely examples and do not limit the present invention. The objectives of the present invention have been fully and effectively achieved. The functions and structural principles of the present invention have been demonstrated and explained in the embodiments, and any variations or modifications may be made to the implementation of the present invention without departing from the stated principles.

Claims

1. A multi-camera module, characterized in that, include: The first camera unit includes a photosensitive chip, a driving component, a reflective element, and at least a portion of a lens, wherein the at least portion of the lens is adapted for optical zoom; as well as The second camera unit has a preset relative positional relationship with the first camera unit; The driving component is configured to drive the partial lens to perform optical zoom based on an adjustment command, wherein the adjustment command is generated based on the distance of the multi-camera module relative to the target. The reflective element moves toward or away from the lens of the first camera unit to achieve tracking and shooting.

2. The multi-camera module according to claim 1, wherein, The at least some lenses include a first lens group and a second lens group, and the driving assembly includes a first driving element configured to drive at least some lenses in the first lens group to perform optical zoom based on the adjustment command.

3. The multi-camera module according to claim 2, wherein, The driving assembly further includes a second driving element configured to drive the second lens group based on the adjustment command.

4. The multi-camera module according to claim 1, wherein, The reflective element is disposed on the photosensitive path of the photosensitive chip to deflect the imaging light.

5. The multi-camera module according to claim 4, wherein, The driving assembly further includes a stabilization mechanism for driving the reflective element to perform optical image stabilization.

6. The multi-camera module according to claim 2, wherein, The driving assembly further includes a stabilization mechanism for driving the first lens group and / or the second lens group to perform optical image stabilization.

7. The multi-camera module according to claim 1, further comprising a third camera unit having a preset positional relationship with the first camera unit, wherein the third equivalent focal length of the third camera unit is greater than the second equivalent focal length of the second camera unit, wherein, When the distance between the multi-camera module and the target, obtained at least in part based on the first image of the target captured by the first camera unit, the second image of the target captured by the second camera unit, and the relative positional relationship between the first camera unit and the second camera unit, exceeds a preset threshold, the adjustment command is generated based on the second distance between the multi-camera module and the target, wherein the second distance is calculated at least in part based on the first image of the target captured by the first camera unit, the third image of the target captured by the third camera unit, and the relative positional relationship between the first camera unit and the third camera unit.

8. A camera system, characterized in that, include: The multi-camera module as described in any one of claims 1 to 7; as well as A processor communicatively connected to the multi-camera module, wherein the processor is configured to generate adjustment instructions based on the distance of the multi-camera module relative to the target.

9. The camera system according to claim 8, wherein, The processor is further configured to fuse a first image of the subject captured by the first camera unit after optical zoom and a second image of the subject captured by the second camera unit to obtain a fused image of the subject; Alternatively, a fused image of the subject can be obtained by fusing the first image of the subject captured by the first camera unit after optical zoom and the third image of the subject captured by the third camera unit.

10. An electronic device, characterized in that, Includes the multi-camera module according to any one of claims 1-7.

11. An automatic zoom imaging method, characterized in that, include: Get zoom command; In response to the zoom command, the distance between the multi-camera module and the target is obtained, wherein the multi-camera module includes a first camera unit; Based on the distance, an adjustment command is generated, which is used to drive the drive component of the first camera unit to drive at least a portion of the lenses in at least one lens group of the first camera unit to perform optical zoom; as well as The first image of the target captured by the first camera unit after optical zoom and the images of the target captured by the other camera units of the multi-camera module are fused to obtain a fused image; During tracking and shooting, the reflective element of the first camera unit is moved toward or away from the lens of the first camera unit.

12. The automatic zoom imaging method according to claim 11, wherein, In response to the zoom command, the distance between the multi-camera module and the target is obtained, including: The first image of the target is obtained through the first camera unit; A second image of the target is obtained through the second camera unit; and Based at least in part on the first image, the second image, and the relative positional relationship between the first camera unit and the second camera unit, a first distance between the multi-camera module and the target is obtained, wherein the first distance is the distance between the multi-camera module and the target.

13. The automatic zoom imaging method according to claim 12, wherein, Before obtaining a first image of the subject through the first camera unit, the method further includes: The drive assembly of the first camera unit is pre-driven to drive at least a portion of the lenses in at least one lens group of the first camera unit to perform optical zoom.

14. The automatic zoom imaging method according to claim 12, wherein, In response to the zoom command, obtaining the distance between the multi-camera module and the target subject further includes: In response to the first distance being greater than a preset threshold, the third camera unit of the multi-camera module is activated to obtain a third image of the target through the third camera unit, wherein the third equivalent focal length of the third camera unit is greater than the second equivalent focal length of the second camera unit; and A second distance between the multi-camera module and the target is obtained, based at least in part on the first image, the third image, and the relative positional relationship between the first camera unit and the third camera unit, wherein the second distance is the distance between the multi-camera module and the target.

15. The automatic zoom imaging method according to any one of claims 12 to 14, wherein, The adjustment command is further used to drive the first driving element of the driving assembly to drive at least a portion of the lenses in the first lens group of the at least one lens group to perform optical zoom.

16. The automatic zoom imaging method according to claim 15, wherein, The adjustment command is further used to drive the second driving element of the driving assembly to drive the second lens group of the at least one lens group to perform optical focusing and / or compensation.

17. The automatic zoom imaging method according to claim 12, wherein, The image obtained by fusing the first image of the target captured by the first camera unit after optical zoom and the images of the target captured by the other camera units of the multi-camera module includes: The first image of the subject captured by the first camera unit after optical zoom and the second image of the subject captured by the second camera unit are fused together to obtain a fused image.

18. The automatic zoom imaging method according to claim 14, wherein, The image obtained by fusing the first image of the target captured by the first camera unit after optical zoom and the images of the target captured by the other camera units of the multi-camera module includes: The first image of the subject captured by the first camera unit after optical zoom and the third image of the subject captured by the third camera unit are fused together to obtain a fused image.

19. The automatic zoom imaging method according to claim 11, further comprising: Based on the movement trajectory of the target, the multi-camera module is moved so that the target is always within the shooting window of the multi-camera module.

20. The automatic zoom imaging method according to claim 11, further comprising: Based on the motion trajectory of the target being photographed, the reflective element of the first camera unit is moved and / or rotated.

21. A camera module device, characterized in that, include: The camera unit includes a photosensitive chip, a reflective element, at least one lens group located on the photosensitive path of the photosensitive chip, and a drive assembly for driving at least a portion of the lenses in the at least one lens group to perform optical zoom. as well as Distance measuring unit; The driving component is configured to drive at least a portion of the lenses in the at least one lens group to perform optical zoom based on an adjustment command, wherein the adjustment command is generated based on the distance between the camera module and the target, and the distance between the camera module and the target is measured by the ranging unit. The reflective element moves toward or away from the lens group of the camera unit to achieve tracking shooting.

22. The camera module device according to claim 21, wherein, The at least one lens group includes a first lens group and a second lens group, and the driving component includes a first driving element configured to drive at least a portion of the lenses in the first lens group to perform optical zoom based on the adjustment command.

23. The camera module device according to claim 22, wherein, The driving assembly further includes a second driving element configured to drive the second lens group for optical focusing based on the adjustment command.

24. The camera module device according to claim 21, wherein, The reflective element is disposed on the photosensitive path of the photosensitive chip to deflect the imaging light.

25. The camera module device according to claim 24, wherein, The driving assembly further includes a stabilization mechanism for driving the reflective element to perform optical image stabilization.

26. The camera module device according to claim 22, wherein, The driving assembly further includes a stabilization mechanism for driving the first lens group and / or the second lens group to perform optical image stabilization.

27. The camera module device according to claim 21, wherein, The ranging unit includes a projector and a receiver. The projector is configured to project a detection signal with a specific wavelength onto the target. The receiver is configured to receive the detection signal reflected back from the target and determine the distance between the ranging unit and the target based on the time-of-flight law.

28. The camera module device according to claim 21, wherein, The ranging unit is implemented as a TOF camera unit to acquire the distance between the camera module device and the target being photographed.

29. A camera system, characterized in that, include: The camera module device as described in any one of claims 21 to 28; as well as A processor communicatively connected to the camera module device, wherein the processor is configured to generate adjustment commands based on the distance of the camera module device relative to the target.

30. An electronic device, characterized in that, Includes the camera module device according to any one of claims 21-28.

31. An automatic zoom imaging method, characterized in that, include: Get zoom command; In response to the zoom command, the distance between the camera module and the target is obtained through the ranging module; Based on the distance, an adjustment command is generated, which is used to drive the driving component of the camera unit of the camera module device to drive at least a portion of the lenses in at least one lens group of the camera unit to perform optical zoom; as well as Obtain an image of the subject captured by the camera unit after optical zoom; During tracking and shooting, the reflective element of the camera unit is moved toward or away from the lens group of the camera unit.

32. The automatic zoom imaging method according to claim 31, wherein, In response to the zoom command, the distance between the camera module and the target is obtained through the ranging module, including: Project a detection signal onto the target; The detection signal received from the target being photographed; and Based on the time-of-flight law, the distance between the ranging module and the target is determined, wherein the distance between the ranging module and the target is set as the distance between the camera module device and the target.

33. The automatic zoom imaging method according to claim 31, wherein, The adjustment command is further used to drive the first driving element of the driving assembly to drive at least a portion of the lenses in the first lens group of the at least one lens group to perform optical zoom.

34. The automatic zoom imaging method according to claim 33, wherein, The adjustment command is further used to drive the second driving element of the driving assembly to drive the second lens group of the at least one lens group to perform optical focusing.

Images