Zoom method, shooting module, terminal equipment and storage medium
By combining multiple cameras and image processing modules in the shooting module and adopting a hybrid zoom method, the problem of taking into account both the zoom speed and image quality in the prior art is solved, and efficient shooting performance is achieved.
Patent Information
- Application Number
- CN202310958107.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-07-31
- Publication Date
- 2025-02-14
AI Technical Summary
Existing digital and optical zoom technologies cannot achieve high zoom speeds on the basis of ensuring image quality, resulting in limited shooting efficiency and performance.
By combining multiple cameras and image processing modules in the shooting module, a hybrid zoom method is adopted to shorten the zoom time using digital zoom, and image quality is maintained through optical zoom.
It achieves a high zoom speed on the basis of ensuring image quality, and improves shooting efficiency and performance.
Smart Images

Figure CN119450221A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of photographing technology, and in particular to a zoom method, a photographing module, a terminal device, and a storage medium. Background Art
[0002] There are two common zooming methods: digital zoom and optical zoom. Digital zoom is achieved by increasing the area of each pixel in the image, while optical zoom relies on the optical lens structure to achieve zooming.
[0003] However, digital zoom has a fast zoom speed but reduces image quality. Although optical zoom does not affect image quality, compared with digital zoom, optical zoom requires physical movement of the lens group to zoom, resulting in longer zoom time and slower zoom speed.
[0004] That is to say, the relevant zoom technology, whether digital zoom or optical zoom, cannot achieve a high zoom speed while ensuring image quality, that is, it cannot take into account both image quality and zoom speed, thereby reducing shooting efficiency and affecting shooting performance. Summary of the invention
[0005] The embodiments of the present application provide a zoom method, a shooting module, a terminal device, and a storage medium, which can take into account both image quality and zoom speed, thereby improving shooting efficiency and enhancing shooting performance.
[0006] The technical solution of the embodiment of the present application is implemented as follows:
[0007] In a first aspect, an embodiment of the present application provides a zoom method, which is applied to a shooting module, wherein the shooting module includes multiple cameras and an image processing module, and the method includes:
[0008] Obtaining a zoom instruction; wherein the zoom instruction carries a hybrid zoom ratio k, where k is greater than 0;
[0009] In response to the zoom instruction, hybrid zoom processing is performed through the multiple cameras and the image processing module to adjust the focal length of the shooting module to a k-fold focal length.
[0010] In a second aspect, an embodiment of the present application provides a shooting module, the shooting module comprising: an acquisition unit, a zoom unit,
[0011] The acquisition unit is used to acquire a zoom instruction; wherein the zoom instruction carries a hybrid zoom ratio k, where k is greater than 0;
[0012] The zoom unit is used to respond to the zoom instruction and perform hybrid zoom processing through multiple cameras and image processing modules to adjust the focal length of the shooting module to a k-fold focal length.
[0013] In a third aspect, an embodiment of the present application provides a shooting module, wherein the shooting module includes a plurality of cameras and an image processing module.
[0014] The multiple cameras and the image processing module are used to perform hybrid zoom processing in response to a zoom instruction to adjust the focal length of the shooting module to a k-fold focal length; wherein the zoom instruction carries a hybrid zoom ratio k, where k is greater than 0.
[0015] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium having a program stored thereon, and when the program is executed by a processor, the method described in the first aspect above is implemented.
[0016] In a fifth aspect, an embodiment of the present application provides a terminal device, wherein the terminal device includes a shooting module, wherein the shooting module includes multiple cameras and an image processing module, and the shooting module is used to execute the method described in any one of claims 1-6.
[0017] The embodiment of the present application provides a zoom method, a shooting module, a terminal device, and a storage medium, wherein the shooting module includes multiple cameras and an image processing module, and the shooting module obtains a zoom instruction; wherein the zoom instruction carries a hybrid zoom ratio k, and k is greater than 0; in response to the zoom instruction, a hybrid zoom process is performed through multiple cameras and an image processing module, and the focal length of the shooting module is adjusted to a k-fold focal length. It can be seen that in the embodiment of the present application, after the shooting module obtains the zoom instruction carrying the hybrid zoom ratio k, it can perform optical zoom through multiple cameras, and perform digital zoom through the image processing module at the same time, that is, combine optical zoom and digital zoom to perform hybrid zoom processing, so that the focal length of the shooting module quickly reaches a k-fold focal length, on the one hand, the digital zoom is used to shorten the zoom time, and on the other hand, the optical zoom is used to avoid the reduction of image quality, thereby obtaining a higher zoom speed on the basis of ensuring image quality, that is, it can take into account both image quality and zoom speed, thereby improving shooting efficiency and shooting performance. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] Figure 1 is a schematic diagram of a camera in a common mobile phone;
[0019] Figure 2 is a schematic diagram of the zoom ratio changing with time;
[0020] Figure 3 It is a schematic diagram of the composition structure of the shooting module;
[0021] Figure 4 Schematic diagram of the implementation process of the zoom method;
[0022] Figure 5Schematic diagram of hybrid zoom Figure 1 ;
[0023] Figure 6 Schematic diagram of hybrid zoom Figure 2 ;
[0024] Figure 7 The structure diagram of the camera module according to the embodiment of the present application is shown in FIG. Figure 1 ;
[0025] Figure 8 The structure diagram of the camera module according to the embodiment of the present application is shown in FIG. Figure 2 ;
[0026] Fig. 9 A schematic diagram of the structure of the terminal device proposed in the embodiment of the present application. DETAILED DESCRIPTION
[0027] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. It is understood that the specific embodiments described herein are only used to explain the related applications, rather than to limit the applications. It should also be noted that, for ease of description, only the parts related to the related applications are shown in the drawings.
[0028] With the continuous development of terminal technology, electronic devices are generally equipped with a camera device, and the camera device has a zoom shooting function to meet more usage scenarios of photo shooting and video recording.
[0029] Common shooting devices can be equipped with multiple cameras, and the user can choose to switch between the cameras to meet photography needs in various focal lengths, from wide-angle to telephoto. However, due to the limited configuration space of the electronic device installed in the device, such as a mobile phone, the number of optional focal lengths and the image size of each camera are limited.
[0030] For example, Figure 1 This is a schematic diagram of the cameras in common mobile phones. As shown in the figure, most mobile phones choose to use a large-image wide-angle camera (main camera, 1 group), a medium- or small-image ultra-wide-angle camera (1 group), and a small-image telephoto camera (1 to 2 groups).
[0031] It should be noted that there are two common zoom methods: digital zoom and optical zoom.
[0032] Digital zoom is achieved by increasing the area of each pixel in the image through the processor in the camera module. For example, when selecting the focal length between the cameras for shooting, one of the cameras will be selected for digital zoom and then equivalently converted to the focal length required for shooting.
[0033] However, when the image is magnified to a certain ratio, the image quality will be seriously degraded, that is, digital zoom has the disadvantage of reducing the image quality.
[0034] In order to improve the problem of deteriorating image quality during digital zoom, optical zoom modules came into being. Unlike digital zoom which uses image cropping algorithms for calculation, optical zoom requires physically moving the lens group to achieve zooming.
[0035] Optical zoom is achieved by changing the position of the lens, the object, and the focus. When the imaging plane moves horizontally, the viewing angle and focal length change, and the farther the scene is, the clearer it becomes, giving the feeling that the object is getting closer.
[0036] Obviously, there are two ways to change the viewing angle. One is to change the focal length of the lens, that is, optical zoom, which mainly changes the focal length of the lens by changing the relative positions of the lenses in the zoom lens. Among them, the zoom lens consists of a fixed lens group and a variable lens group. By moving the variable lens group and changing the imaging light path, the focal length of the lens can be changed within a certain range, thereby changing the shooting viewing angle.
[0037] It can be seen that optical zoom mainly relies on the optical lens structure to achieve zoom. Although it can improve image quality compared to digital zoom, the zoom speed of optical zoom is lower than that of digital zoom.
[0038] For example, Figure 2 is a schematic diagram of the zoom ratio changing with time, such as Figure 2 As shown in the figure, taking the zoom time from 1x focal length to 3x focal length as an example, for digital zoom, it takes 0.4s for the wide-angle module (1x focal length) to zoom to the telephoto module (3x focal length). For optical zoom, it takes 0.8s for the wide-angle module (1x focal length) to zoom to the telephoto module (3x focal length), which is far behind the digital zoom time.
[0039] For example, Table 1 compares the change of zoom ratio of optical zoom and digital zoom over time. At the same time, zoom processing is performed through optical zoom and digital zoom. At 0.4s, the digital zoom can zoom from 1x focal length to 3x focal length, that is, the zoom ratio is 3, and the optical zoom can zoom from 1x focal length to 2x focal length, that is, the zoom ratio is 2. It can be seen that the zoom rate of digital zoom is higher than that of optical zoom.
[0040] Table 1
[0041] Time(s) Zoom ratio (optical zoom) Zoom ratio (digital zoom) 0.00 1.00 1.00 0.02 1.05 1.10 0.04 1.10 1.20 0.06 1.15 1.30 0.08 1.20 1.40 0.10 1.25 1.50 0.12 1.30 1.60 0.14 1.35 1.70 0.16 1.40 1.80 0.18 1.45 1.90 0.20 1.50 2.00 0.22 1.55 2.10 0.24 1.60 2.20 0.26 1.65 2.30 0.28 1.70 2.40 0.30 1.75 2.50 0.32 1.80 2.60 0.34 1.85 2.70 0.36 1.90 2.80 0.38 1.95 2.90 0.40 2.00 3.00
[0042] To sum up, digital zoom has a fast zoom speed, but it will reduce image quality. Although optical zoom does not affect image quality, compared with digital zoom, optical zoom requires physical movement of the lens group to zoom, which results in a longer zoom time and slower zoom speed.
[0043] It can be seen from this that the relevant zoom technology, whether digital zoom or optical zoom, cannot achieve a high zoom speed while ensuring image quality, that is, it cannot take into account both image quality and zoom speed, thereby reducing shooting efficiency and affecting shooting performance.
[0044] In order to solve the above problems, in an embodiment of the present application, the shooting module includes multiple cameras and an image processing module, and the shooting module obtains a zoom instruction; wherein the zoom instruction carries a hybrid zoom ratio k, and k is greater than 0; in response to the zoom instruction, a hybrid zoom process is performed through multiple cameras and an image processing module to adjust the focal length of the shooting module to a k-fold focal length. It can be seen that in an embodiment of the present application, after the shooting module obtains a zoom instruction carrying a hybrid zoom ratio k, it can perform optical zoom through multiple cameras, and at the same time perform digital zoom through the image processing module, that is, combine optical zoom and digital zoom to perform hybrid zoom processing, so that the focal length of the shooting module quickly reaches a k-fold focal length, on the one hand, using digital zoom to shorten the zoom time, and on the other hand, using optical zoom to avoid the reduction of image quality, thereby obtaining a higher zoom speed on the basis of ensuring image quality, that is, being able to take into account both image quality and zoom speed, thereby improving shooting efficiency and shooting performance.
[0045] The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.
[0046] An embodiment of the present application provides a zoom method, which can be applied to a shooting module, wherein the shooting module may include multiple cameras and an image processor.
[0047] It should be noted that in the embodiments of the present application, in order to realize the optical zoom function, the shooting module can be provided with multiple cameras with different image planes, so that the photography requirements of various focal lengths such as wide-angle to telephoto can be realized by switching between different cameras.
[0048] It should be noted that, in an embodiment of the present application, in order to realize the digital zoom function, the shooting module may be provided with an image processing module, wherein the image processing module may perform scaling processing on each pixel area in the image to complete the digital zoom processing.
[0049] Exemplarily, in some embodiments, Figure 3 It is a schematic diagram of the composition structure of the shooting module, such as Figure 3As shown, the shooting module can be provided with multiple cameras, including a large image plane wide-angle camera, a medium and small image plane ultra-wide-angle camera, and a small image plane telephoto camera. At the same time, the shooting module can also be provided with an image processing module, which can process the captured video or image accordingly.
[0050] It should be noted that in the embodiment of the present application, the shooting module may also include a fixed lens group and a variable lens group. By moving the variable lens group and changing the imaging light path, the focal length of the lens may be changed within a certain range, thereby also changing the shooting angle.
[0051] Furthermore, in the embodiments of the present application, Figure 4 is a schematic diagram of the implementation process of the zoom method, such as Figure 4 As shown, the method for performing hybrid zoom by the shooting module may include the following steps:
[0052] Step 101: Obtain a zoom instruction; wherein the zoom instruction carries a hybrid zoom ratio k, where k is greater than 0.
[0053] In an embodiment of the present application, the shooting module may first obtain a zoom instruction, wherein the zoom instruction is used to instruct the shooting module to perform zoom processing.
[0054] It can be understood that in the embodiments of the present application, the shooting module can implement optical zoom processing based on the configured multiple cameras, and can also implement digital zoom processing through the configured image processing module, that is, the shooting module has a hybrid zoom function that combines optical zoom and digital zoom.
[0055] It should be noted that, in an embodiment of the present application, the zoom instruction obtained by the shooting module may carry a hybrid zoom ratio k, where k may be any value greater than 0.
[0056] The image produced by a zoom lens changes in various ways within each focal range. The wide-angle end can expand the shooting range, the telephoto end can magnify the subject, and the shooting range can be freely changed even if the photographer does not move. This change can be called the zoom ratio.
[0057] It can be understood that, in the embodiments of the present application, the hybrid zoom ratio is the target zoom ratio for the hybrid zoom processing performed by the shooting module.
[0058] For example, in some embodiments, assuming that the hybrid zoom ratio carried in the acquired zoom instruction is 3, then after the hybrid zoom processing, the shooting module needs to adjust the original focal length to a 3x focal length, that is, a 3× focal length.
[0059] Furthermore, in the embodiment of the present application, the shooting module not only has a hybrid zoom function combining optical zoom and digital zoom, but also has the function of independently performing optical zoom or digital zoom. Accordingly, in the embodiment of the present application, the zoom instruction obtained by the shooting module can instruct the shooting module to perform hybrid zoom processing, and can also instruct the shooting module to perform optical zoom processing or digital zoom processing.
[0060] Exemplarily, in some embodiments, when the zoom instruction instructs the shooting module to perform hybrid zoom processing, the zoom instruction may carry a hybrid zoom ratio, such as k.
[0061] Exemplarily, in some embodiments, when the zoom instruction instructs the shooting module to perform optical zoom processing, the zoom instruction may carry the optical zoom ratio.
[0062] Exemplarily, in some embodiments, when the zoom instruction instructs the shooting module to perform digital zoom processing, the zoom instruction may carry a digital zoom ratio.
[0063] Further, in an embodiment of the present application, the camera module may obtain the zoom instruction in any manner, for example, by receiving the zoom instruction sent by the terminal device, or by obtaining the zoom instruction by physical pressing or touching, which is not specifically limited in the present application.
[0064] It should be noted that in the embodiments of the present application, no matter which type of zoom processing is indicated by the zoom instruction obtained by the shooting module, the focal length corresponding to the shooting module can be adjusted according to the zoom magnification corresponding to the zoom type, thereby completing the zoom processing.
[0065] Step 102: In response to the zoom instruction, hybrid zoom processing is performed through multiple cameras and image processing modules to adjust the focal length of the shooting module to a k-fold focal length.
[0066] In an embodiment of the present application, after obtaining a zoom instruction carrying a hybrid zoom ratio k, the shooting module can respond to the zoom instruction and perform hybrid zoom processing through multiple cameras and image processing modules, so that the focal length of the shooting module can be adjusted to a k-fold focal length.
[0067] It should be noted that in the embodiments of the present application, since the shooting module can realize optical zoom processing through the configured multiple cameras, and can also realize digital zoom processing through the configured image processing module, after obtaining the zoom instruction, it can perform hybrid zoom processing based on the hybrid zoom ratio k carried by the zoom instruction, combining optical zoom and digital zoom.
[0068] That is, in an embodiment of the present application, hybrid zoom processing may be combined with different types of zoom processing, that is, hybrid zoom processing may include optical zoom processing performed by the multiple cameras and digital zoom processing performed by the image processing module.
[0069] It should be noted that in the embodiment of the present application, after determining the hybrid zoom ratio k, the focal length obtained after completing the hybrid zoom processing can be determined, that is, the focal length of the shooting module can be adjusted to a k-fold focal length through hybrid zoom.
[0070] For example, in some embodiments, assuming that the focal length at the wide-angle end is 24 mm and k is 5, the focal length obtained after completing a 5x zoom is 24 mm-120 mm.
[0071] For example, in some embodiments, assuming that the focal length at the wide-angle end is 28 mm and k is 5, the focal length obtained after completing a 5x zoom is 28 mm-140 mm.
[0072] Further, in an embodiment of the present application, the shooting module can obtain the zoom instruction at a first moment; accordingly, at the first moment, the focal length of the shooting module is an initial focal length, the optical zoom magnification corresponding to the multiple cameras is a first initial magnification, and the digital zoom magnification corresponding to the image processing module is a second initial magnification.
[0073] It can be understood that in an embodiment of the present application, at the first moment of obtaining a zoom instruction, the initial focal length of the shooting module that has not performed hybrid zoom processing can be defined as the initial focal length, for example, a 1× focal length; the optical zoom magnifications corresponding to multiple cameras that have not performed hybrid zoom processing can be defined as a first initial magnification, for example, the first initial magnification is 1; the digital zoom magnification corresponding to the image processing module that has not performed hybrid zoom processing can be defined as a second initial magnification, for example, the second initial magnification is 1.
[0074] Furthermore, in an embodiment of the present application, when hybrid zoom processing is performed through the multiple cameras and the image processing module to adjust the focal length of the shooting module to a k-fold focal length, the digital zoom ratio can be first adjusted from the second initial ratio to the hybrid zoom ratio k through the image processing module, so that the focal length of the shooting module is adjusted from the initial focal length to the k-fold focal length; then, the focal length of the shooting module can be maintained at the k-fold focal length, and the optical zoom ratio can be adjusted from the first initial ratio to the hybrid zoom ratio k through the multiple cameras, and at the same time, the digital zoom ratio can be adjusted from the hybrid zoom ratio k to the second initial ratio through the image processing module.
[0075] It can be understood that in the embodiments of the present application, during the hybrid zoom processing, the shooting module can first perform digital zoom processing through the image processing module to adjust the focal length of the shooting module from the initial focal length to a k-fold focal length, and then, on the basis of ensuring that the focal length of the shooting module is a k-fold focal length, on the one hand, optical zoom processing is performed through multiple cameras, and on the other hand, digital zoom processing continues to be performed through the image processing module, until the optical zoom ratio is adjusted from the first initial ratio to the hybrid zoom ratio k, and the digital zoom ratio is restored to the second initial ratio.
[0076] That is to say, in an embodiment of the present application, in the process of adjusting the focal length of the shooting module to a k× focal length through hybrid zoom processing, the focal length of the shooting module can be quickly adjusted using digital zoom first, wherein the digital zoom processing is performed through the image processing module, and the digital zoom ratio is adjusted from the second initial ratio to the hybrid zoom ratio k. At this time, the focal length of the shooting module is also correspondingly adjusted from the initial focal length, such as 1× focal length, to k× focal length. Next, the focal length of the shooting module is maintained at k× focal length, and a joint zoom processing is performed using optical zoom and digital zoom, wherein optical zoom processing is performed through multiple cameras, and the optical zoom ratio is adjusted from the first initial ratio to the hybrid zoom ratio k. At the same time, the digital zoom processing is continuously performed through the image processing module, and the digital zoom ratio is adjusted from the hybrid zoom ratio k to the second initial ratio.
[0077] Exemplarily, in some embodiments, assuming that k is 3 and the initial focal length is 1×, during hybrid zoom processing, digital zoom can be used first to achieve the target 3× focal length, and then the 3× focal length is maintained unchanged, the optical zoom is started, and the digital zoom ratio is gradually reduced until the optical zoom ratio is 3 and the digital zoom ratio is 1.
[0078] Exemplarily, in some embodiments, Figure 5 Schematic diagram of hybrid zoom Figure 1 ,like Figure 5 As shown, you can first use the digital zoom to gradually increase the optical zoom ratio to 3, so that the focal length of the shooting module reaches 3× focal length (corresponding to 0.4s), and then start the optical zoom, gradually increase the optical zoom ratio to 3, and gradually reduce the digital zoom ratio to 1, maintaining the 3× focal length unchanged (corresponding to 1.2s).
[0079] It can be seen that in the embodiments of the present application, based on the above Figure 5 The hybrid zoom process adjusts the focal length of the shooting module from 1× to 3× in 0.4s, which is equivalent to the zoom time using only digital zoom. That is, the zoom speed is much faster than the optical zoom process, and the digital zoom ratio is gradually reduced to 1, which can ensure the image quality in the subsequent shooting process.
[0080] Exemplarily, in some embodiments, Table 2 shows how the zoom ratio changes over time during a hybrid zoom process that combines digital zoom and optical zoom. Digital zoom is first used to gradually increase the optical zoom ratio to 3. At 0.4s, the hybrid zoom ratio is 3, that is, the focal length of the shooting module reaches 3×. The focal length of the shooting module is maintained at 3×, and then the optical zoom is started, and the optical zoom ratio is gradually increased while the digital zoom ratio is gradually reduced. At 1.2s, the optical zoom ratio is 3 and the digital zoom ratio is 1.
[0081] Table 2
[0082]
[0083]
[0084]
[0085] Furthermore, in an embodiment of the present application, when hybrid zoom processing is performed through the multiple cameras and the image processing module to adjust the focal length of the shooting module to a k-fold focal length, the optical zoom ratio can be first adjusted from the first initial ratio to the first ratio through the multiple cameras, and at the same time, the digital zoom ratio can be adjusted from the second initial ratio to the second ratio through the image processing module, so that the focal length of the shooting module is adjusted from the initial focal length to the k-fold focal length; then, the focal length of the shooting module can be maintained at the k-fold focal length, and the optical zoom ratio can be adjusted from the first ratio to the hybrid zoom ratio k through the multiple cameras, and at the same time, the digital zoom ratio can be adjusted from the second ratio to the second initial ratio through the image processing module.
[0086] It can be understood that in the embodiments of the present application, during the hybrid zoom processing, the shooting module can use digital zoom and optical zoom at the same time, that is, hybrid zoom processing is performed through the multiple cameras and the image processing module to adjust the focal length of the shooting module from the initial focal length to a k-fold focal length, and then, on the basis of ensuring that the focal length of the shooting module is a k-fold focal length, on the one hand, optical zoom processing continues to be performed through multiple cameras, and on the other hand, digital zoom processing continues to be performed through the image processing module, until the optical zoom ratio is adjusted from the first initial ratio to the hybrid zoom ratio k, and the digital zoom ratio is restored to the second initial ratio.
[0087] That is to say, in the embodiment of the present application, in the process of adjusting the focal length of the shooting module to a k× focal length through hybrid zoom processing, the focal length of the shooting module can be quickly adjusted by using digital zoom and optical zoom at the same time, wherein the optical zoom processing is performed through the multiple cameras to adjust the optical zoom ratio from the first initial ratio to the first ratio, and the digital zoom processing is performed through the image processing module to adjust the digital zoom ratio from the second initial ratio to the second ratio. At this time, the focal length of the shooting module is also correspondingly adjusted from the initial focal length, such as 1× focal length, to k× focal length. Then, the focal length of the shooting module is maintained at k× focal length, and the optical zoom and digital zoom are continued to be used for joint zoom processing, wherein the optical zoom processing is performed through the multiple cameras to adjust the optical zoom ratio from the first ratio to the hybrid zoom ratio k, and the digital zoom processing is continuously performed through the image processing module to adjust the digital zoom ratio from the second ratio to the second initial ratio.
[0088] Exemplarily, in some embodiments, assuming that k is 3 and the initial focal length is 1×, during hybrid zoom processing, optical zoom and digital zoom can be used simultaneously to achieve the target 3× focal length, and then the 3× focal length is maintained unchanged, and the optical zoom ratio continues to increase, while gradually reducing the digital zoom ratio until the optical zoom ratio is 3 and the digital zoom ratio is 1.
[0089] Exemplarily, in some embodiments, Figure 6 Schematic diagram of hybrid zoom Figure 2 ,like Figure 6 As shown, the optical zoom and digital zoom can be used at the same time, and the optical zoom ratio can be gradually increased to 1.5, and the digital zoom ratio can be gradually increased to 2, so that the focal length of the shooting module reaches 3× focal length (corresponding to 0.2s). Then, the optical zoom ratio can be further increased to 3, and the digital zoom ratio can be gradually reduced to 1, maintaining the 3× focal length unchanged (corresponding to 0.8s).
[0090] It can be seen that in the embodiments of the present application, based on the above Figure 6 The zoom time of adjusting the focal length of the shooting module from 1× to 3× through hybrid zoom processing is 0.2s, which is lower than the zoom time using only digital zoom. That is, the zoom speed is much faster than the optical zoom processing, and the digital zoom ratio is gradually reduced to 1 subsequently, which can ensure the image quality in the subsequent shooting process.
[0091] Exemplarily, in some embodiments, Table 3 shows how the zoom ratio changes over time during a hybrid zoom process that combines digital zoom and optical zoom. Optical zoom and digital zoom are used simultaneously. At 0.2s, the optical zoom ratio increases to 1.5, the digital zoom ratio increases to 2, and the hybrid zoom ratio is 3, that is, the focal length of the shooting module reaches 3× focal length. The focal length of the shooting module is maintained at 3× focal length unchanged, and the optical zoom ratio continues to increase while the digital zoom ratio is gradually reduced. At 0.8s, the optical zoom ratio is 3, and the digital zoom ratio is 1.
[0092] Table 3
[0093]
[0094]
[0095] It can be seen that in an embodiment of the present application, the hybrid zoom processing includes an optical zoom processing performed by the multiple cameras, and a digital zoom processing performed by the image processing module. Specifically, the hybrid zoom processing may include a combined zoom processing by digital zoom and / or optical zoom at different standard zoom processing stages. For example, one hybrid zoom method is to first use digital zoom to make the focal length of the shooting module quickly reach the target focal length (such as k times the focal length), and then turn on the optical zoom until the optical zoom ratio reaches k, while reducing the digital zoom ratio to the initial ratio (such as 1). Another hybrid zoom method is to use digital zoom and optical zoom at the same time to make the focal length of the shooting module quickly reach the target focal length (such as k times the focal length), and then continue to increase the optical zoom ratio to k, while reducing the digital zoom ratio to the initial ratio (such as 1).
[0096] Furthermore, in an embodiment of the application, the shooting module can adjust the focal length of the shooting module from the initial focal length to the k-fold focal length through the image processing module at the second moment, and complete the hybrid zoom processing at the third moment.
[0097] It should be noted that, in an embodiment of the present application, the third moment is greater than the second moment, that is, the moment when the shooting module is adjusted to the k-fold focal length is earlier than the moment when the entire hybrid zoom processing is completed.
[0098] Exemplarily, in some embodiments, based on the above Figure 5As shown in Table 2, the second moment is 0.4s, and the third moment is 1.2s. At the second moment, the focal length of the shooting module is adjusted from the initial focal length to the k-fold focal length through the image processing module, that is, digital zoom is first used to gradually increase the optical zoom ratio to 3. At 0.4s, the hybrid zoom ratio is 3, and it can be considered that the focal length of the shooting module reaches 3× focal length. Then, the focal length of the shooting module is maintained at 3× focal length, and the optical zoom is started again, and the optical zoom ratio is gradually increased while the digital zoom ratio is gradually reduced. At 1.2s, the optical zoom ratio is 3 and the digital zoom ratio is 1, that is, the hybrid zoom process is completed at the third moment.
[0099] Furthermore, in an embodiment of the application, the shooting module can adjust the focal length of the shooting module from the initial focal length to the k-fold focal length through the multiple cameras and the image processing module at the fourth moment, and complete the hybrid zoom processing at the fifth moment.
[0100] It should be noted that, in an embodiment of the present application, the fifth moment is greater than the fourth moment, that is, the moment when the shooting module is adjusted to the k-fold focal length is earlier than the moment when the entire hybrid zoom processing is completed.
[0101] Exemplarily, in some embodiments, based on the above Figure 6 As shown in Table 3, the second moment is 0.2s, the third moment is 0.8s, and at the fourth moment, the focal length of the shooting module is adjusted from the initial focal length to the k-fold focal length through the multiple cameras and the image processing module, that is, the optical zoom and digital zoom are used simultaneously. At 0.2s, the optical zoom ratio increases to 1.5, the digital zoom ratio increases to 2, and the hybrid zoom ratio is 3. It can be considered that the focal length of the shooting module reaches 3× focal length. Then, the focal length of the shooting module is maintained at 3× focal length, and the optical zoom ratio continues to increase while the digital zoom ratio is gradually reduced. At 0.8s, the optical zoom ratio is 3, and the digital zoom ratio is 1, that is, the hybrid zoom process is completed at the fifth moment.
[0102] It should be noted that, in the embodiment of the present application, the second moment is greater than the fourth moment, and the third moment is greater than the fifth moment.
[0103] It can be understood that in the embodiments of the present application, the digital zoom is first used to quickly adjust the focal length of the shooting module in the initial stage, and the hybrid zoom solution of the optical zoom and the digital zoom is then combined in the subsequent stage. Compared with the hybrid zoom solution of using both the optical zoom and the digital zoom to quickly adjust the focal length of the shooting module in the initial stage, and continuing to combine the optical zoom and the digital zoom in the subsequent stage, on the one hand, the zoom time of the former adjusting the focal length of the shooting module to the target focal length (such as k× focal length) is equal to the zoom time of using only the digital zoom, and the latter adjusting the focal length of the shooting module to the target focal length (such as k× focal length) is shorter than the zoom time of using only the digital zoom. × focal length) is less than the zoom time of using only digital zoom, that is, in the stage of adjusting the focal length of the shooting module to the target focal length (such as k× focal length), the zoom time of the former is greater than the latter, that is, the second moment is greater than the fourth moment; on the other hand, the time for the former to restore the digital zoom ratio to the initial ratio is also greater than the time for the latter to restore the digital zoom ratio to the initial ratio, that is, in the stage of reducing the digital zoom ratio to the initial ratio (such as 1), the zoom time of the former is also greater than the latter; on another hand, the time for the former to complete the hybrid zoom processing is also greater than the time for the latter to complete the hybrid zoom processing.
[0104] Exemplarily, in some embodiments, based on the above Figure 5 , 6 As shown in Tables 2 and 3, the zoom time for the former to adjust the focal length of the shooting module to a 3× focal length is 0.4s, and the zoom time for the latter to adjust the focal length of the shooting module to a 3× focal length is 0.2s, and the former is greater than the latter; on the other hand, the time for the former to restore the digital zoom ratio to the initial ratio is 0.8s, and the time for the latter to restore the digital zoom ratio to the initial ratio is 0.6s, and the former is greater than the latter; on yet another hand, the time for the former to complete the hybrid zoom processing is 1.2s, and the time for the latter to complete the hybrid zoom processing is 0.8s, and the former is greater than the latter.
[0105] In summary, through the zoom method proposed in the above steps 101 to 102, a hybrid zoom processing of optical zoom and digital zoom can be used to quickly reach the target focal length and shorten the zoom time. Then, after reaching the target focal length, the optical zoom ratio can be increased while the digital zoom ratio can be reduced while maintaining the target focal length ratio, thereby improving the problem of image quality damage caused by using digital zoom in the early stage of zooming.
[0106] The embodiment of the present application provides a zoom method, which is applied to a shooting module, wherein the shooting module includes multiple cameras and an image processing module, and the shooting module obtains a zoom instruction; wherein the zoom instruction carries a hybrid zoom ratio k, and k is greater than 0; in response to the zoom instruction, a hybrid zoom process is performed through multiple cameras and an image processing module, and the focal length of the shooting module is adjusted to a k-fold focal length. It can be seen that in the embodiment of the present application, after the shooting module obtains the zoom instruction carrying the hybrid zoom ratio k, it can perform optical zoom through multiple cameras, and perform digital zoom through the image processing module at the same time, that is, combine optical zoom and digital zoom to perform hybrid zoom processing, so that the focal length of the shooting module quickly reaches a k-fold focal length, on the one hand, the digital zoom is used to shorten the zoom time, and on the other hand, the optical zoom is used to avoid the reduction of image quality, thereby obtaining a higher zoom speed on the basis of ensuring image quality, that is, it can take into account both image quality and zoom speed, thereby improving shooting efficiency and shooting performance.
[0107] Based on the above embodiment, in another embodiment of the present application, Figure 7 The structure diagram of the camera module according to the embodiment of the present application is shown in FIG. Figure 1 ,like Figure 7 As shown, the shooting module 10 proposed in the embodiment of the present application may include an acquisition unit 111, a zoom unit 112,
[0108] The acquisition unit 111 is used to acquire a zoom instruction; wherein the zoom instruction carries a hybrid zoom ratio k, where k is greater than 0;
[0109] The zoom unit 112 is used to respond to the zoom instruction and perform hybrid zoom processing through multiple cameras and image processing modules to adjust the focal length of the shooting module to a k-fold focal length.
[0110] In the embodiments of the present application, further, Figure 8 The structure diagram of the camera module according to the embodiment of the present application is shown in FIG. Figure 2 ,like Figure 8 As shown, the shooting module 10 proposed in the embodiment of the present application may also include multiple cameras 121 and an image processing module 122.
[0111] Furthermore, in an embodiment of the present application, the above-mentioned multiple cameras 121 and image processing module 122 are used to perform hybrid zoom processing in response to a zoom instruction, and adjust the focal length of the shooting module to a k-fold focal length; wherein the zoom instruction carries a hybrid zoom ratio k, and k is greater than 0.
[0112] In addition, each functional module in this embodiment can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The above integrated unit can be implemented in the form of hardware or software functional modules.
[0113] If the integrated unit is implemented in the form of a software function module and is not sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this embodiment is essentially or the part that contributes to the prior art or the whole or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, server, or network device, etc.) or a processor to perform all or part of the steps of the method of this embodiment. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (ROM), random access memory (RAM), disk or optical disk, etc., which can store program code.
[0114] In the embodiments of the present application, further, Fig. 9 This is a schematic diagram of the structure of the terminal device proposed in the embodiment of the present application, such as Fig. 9 As shown, the terminal device 20 proposed in the embodiment of the present application may include a shooting module 10, wherein the shooting module 10 may also include multiple cameras 121 and an image processing module 122.
[0115] The embodiment of the present application provides a terminal device and a shooting module, the terminal device includes a shooting module, the shooting module includes multiple cameras and an image processing module, the shooting module obtains a zoom instruction; wherein the zoom instruction carries a hybrid zoom ratio k, k is greater than 0; in response to the zoom instruction, a hybrid zoom process is performed through multiple cameras and an image processing module, and the focal length of the shooting module is adjusted to a k-fold focal length. It can be seen that in the embodiment of the present application, after the shooting module obtains the zoom instruction carrying the hybrid zoom ratio k, it can perform optical zoom through multiple cameras, and perform digital zoom through the image processing module at the same time, that is, hybrid zoom processing is performed by combining optical zoom and digital zoom, so that the focal length of the shooting module quickly reaches a k-fold focal length, on the one hand, the digital zoom is used to shorten the zoom time, and on the other hand, the optical zoom is used to avoid the reduction of image quality, thereby obtaining a higher zoom speed on the basis of ensuring image quality, that is, it can take into account both image quality and zoom speed, thereby improving shooting efficiency and shooting performance.
[0116] An embodiment of the present application provides a computer-readable storage medium on which a program is stored. When the program is executed by a processor, the zoom method as described above is implemented.
[0117] Specifically, the program instructions corresponding to a zoom method in this embodiment may be stored in a storage medium such as a CD, a hard disk, or a USB flash drive. When the program instructions corresponding to a zoom method in the storage medium are read or executed by an electronic device, the following steps are included:
[0118] Obtaining a zoom instruction; wherein the zoom instruction carries a hybrid zoom ratio k, where k is greater than 0;
[0119] In response to the zoom instruction, hybrid zoom processing is performed through the multiple cameras and the image processing module to adjust the focal length of the shooting module to a k-fold focal length.
[0120] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of hardware embodiments, software embodiments, or embodiments in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) that contain computer-usable program code.
[0121] The present application is described with reference to implementation flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the process in the flowchart. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0122] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device, which is implemented in the implementation flow diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0123] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operation steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for executing the steps in the flowchart. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0124] The above description is only a preferred embodiment of the present application and is not intended to limit the protection scope of the present application.
Claims
1. A zoom method, characterized in that: The zoom method is applied to a shooting module, the shooting module includes a plurality of cameras and an image processing module, and the method includes: Obtaining a zoom instruction; wherein the zoom instruction carries a hybrid zoom ratio k, where k is greater than 0; In response to the zoom instruction, hybrid zoom processing is performed through the multiple cameras and the image processing module to adjust the focal length of the shooting module to a k-fold focal length.
2. The method according to claim 1, characterized in that The hybrid zoom processing includes an optical zoom processing performed by the multiple cameras and a digital zoom processing performed by the image processing module.
3. The method according to claim 1 or 2, characterized in that: The zoom instruction is obtained at the first moment; accordingly, At the first moment, the focal length of the shooting module is an initial focal length, the optical zoom magnifications corresponding to the multiple cameras are a first initial magnification, and the digital zoom magnification corresponding to the image processing module is a second initial magnification.
4. The method according to claim 3, wherein: The hybrid zoom processing is performed by the multiple cameras and the image processing module to adjust the focal length of the shooting module to a k-fold focal length, including: The digital zoom ratio is adjusted from the second initial ratio to a hybrid zoom ratio k by the image processing module, so that the focal length of the shooting module is adjusted from the initial focal length to the k-fold focal length; The focal length of the shooting module is maintained at the k-fold focal length, the optical zoom ratio is adjusted from the first initial ratio to the hybrid zoom ratio k through the multiple cameras, and the digital zoom ratio is adjusted from the hybrid zoom ratio k to the second initial ratio through the image processing module.
5. The method according to claim 3, wherein: The hybrid zoom processing is performed by the multiple cameras and the image processing module to adjust the focal length of the shooting module to a k-fold focal length, including: The optical zoom ratio is adjusted from the first initial ratio to a first ratio by the multiple cameras, and the digital zoom ratio is adjusted from the second initial ratio to a second ratio by the image processing module, so that the focal length of the shooting module is adjusted from the initial focal length to the k-fold focal length; The focal length of the shooting module is maintained at the k-fold focal length, the optical zoom ratio is adjusted from the first ratio to the hybrid zoom ratio k through the multiple cameras, and the digital zoom ratio is adjusted from the second ratio to the second initial ratio through the image processing module.
6. The method according to claim 3, characterized in that At a second moment, the focal length of the shooting module is adjusted from the initial focal length to the k-fold focal length by the image processing module, and a hybrid zoom process is completed at a third moment; wherein the third moment is greater than the second moment; or, At a fourth moment, the focal length of the shooting module is adjusted from the initial focal length to the k-fold focal length through the multiple cameras and the image processing module, and a hybrid zoom process is completed at a fifth moment; wherein the fifth moment is greater than the fourth moment; Among them, the second moment is greater than the fourth moment, and the third moment is greater than the fifth moment.
7. A shooting module, characterized in that: The shooting module includes: an acquisition unit, a zoom unit, The acquisition unit is used to acquire a zoom instruction; wherein the zoom instruction carries a hybrid zoom ratio k, where k is greater than 0; The zoom unit is used to respond to the zoom instruction and perform hybrid zoom processing through multiple cameras and image processing modules to adjust the focal length of the shooting module to a k-fold focal length.
8. A shooting module, characterized in that: The shooting module includes multiple cameras and an image processing module. The multiple cameras and the image processing module are used to perform hybrid zoom processing in response to a zoom instruction to adjust the focal length of the shooting module to a k-fold focal length; wherein the zoom instruction carries a hybrid zoom ratio k, where k is greater than 0.
9. A computer-readable storage medium having a program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.
10. A terminal device, characterized in that: The terminal device includes a shooting module, which includes multiple cameras and an image processing module. The shooting module is used to execute the method according to any one of claims 1 to 6.
Citation Information
Patent Citations
Image pickup apparatus and control method thereof
CN101472073A
Image acquisition method and device
CN109495681A
Photographing method for terminal, and terminal
CN109906599A
Preview image display method and device, computer equipment and storage medium
CN113473002A
Zoom control method, system, equipment and medium
CN114285992A