Image sensor control method and device, electronic equipment, computer readable storage medium and computer program product

Abstract

The invention relates to an image sensor control method and device, electronic equipment, a computer readable storage medium and a computer program product. The method comprises the following steps: in response to triggering of a preset zooming event, obtaining a target zooming magnification of the preset zooming event; the preset zooming event is a new zooming event input in the zooming process of the previous zooming event; determining an image sensor needing to be called by the preset zoom event according to the target zoom ratio of the last zoom event and the target zoom ratio of the preset zoom event; and controlling the corresponding image sensor to be turned on or turned off according to the image sensor needing to be called. By adopting the method, the zooming fluency can be improved.

Description

Technical Field

[0001] The present application relates to the field of imaging technologies, and particularly to an image sensor control method, apparatus, electronic device, computer-readable storage medium, and computer program product. Background Art

[0002] With the development of electronic device technologies, more and more cameras are equipped on electronic devices. When using an electronic device to capture a picture, a fixed-focus lens relay method can be adopted between multiple cameras to achieve a zoom effect, so as to meet the shooting requirements of multiple application scenarios.

[0003] However, due to the hardware differences of sensors in different cameras and the defects of the existing focus switching process, image jumps or freezes usually occur during zooming, resulting in an unsmooth zooming result. Summary of the Invention

[0004] Based on this, it is necessary to provide an image sensor control method, apparatus, electronic device, computer-readable storage medium, and computer program product that can improve the smoothness of zooming for the above technical problems.

[0005] In a first aspect, the present application provides an image sensor control method, including:

[0006] In response to a preset zoom event being triggered, obtain the target zoom ratio of the preset zoom event; the preset zoom event is a new zoom event input during the zooming process of the previous zoom event;

[0007] Determine the image sensor to be called for the preset zoom event according to the target zoom ratio of the previous zoom event and the target zoom ratio of the preset zoom event;

[0008] Control the corresponding image sensor to be turned on or off according to the image sensor to be called.

[0009] In one embodiment, the number of image sensors to be called is less than or equal to the maximum number of image sensors that can be supported to be turned on by the image signal processor resources.

[0010] In one embodiment, the determining the image sensor to be called for the preset zoom event according to the target zoom ratio of the previous zoom event and the target zoom ratio of the preset zoom event includes:

[0011] Select a first zoom ratio to be used from multiple preset zoom ratios according to the target zoom ratio of the previous zoom event and the target zoom ratio of the preset zoom event;

[0012] Determine the image sensor to be called; the image sensor to be called includes the image sensor corresponding to the transition zoom ratio, and the transition zoom ratio is one of the first zoom ratios to be used.

[0013] In one embodiment, the determining the image sensor to be called for the preset zoom event according to the target zoom ratio of the preset zoom event and the target zoom ratio of the previous zoom event includes:

[0014] Obtain the starting zoom ratio of the previous zoom event;

[0015] Determine the image sensor to be called for the preset zoom event according to the starting zoom ratio of the previous zoom event, the target zoom ratio of the preset zoom event, and the target zoom ratio of the previous zoom event.

[0016] In one embodiment, the determining the image sensor to be called for the preset zoom event according to the starting zoom ratio of the previous zoom event, the target zoom ratio of the preset zoom event, and the target zoom ratio of the previous zoom event includes:

[0017] Select the second zoom ratio to be used from multiple preset zoom ratios according to the starting zoom ratio of the previous zoom event and the target zoom ratio of the previous zoom event;

[0018] Select the third zoom ratio to be used from multiple preset zoom ratios according to the target zoom ratio of the previous zoom event and the target zoom ratio of the preset zoom event;

[0019] Determine the image sensor to be called for the preset zoom event; the image sensor to be called includes the image sensor corresponding to the transition zoom ratio, and the transition zoom ratio is one of the second zoom ratio to be used or the third zoom ratio to be used.

[0020] In one embodiment, the method further includes:

[0021] In response to the current zoom event being triggered, obtain the current zoom ratio of the current image frame;

[0022] In the case where the current zoom ratio is different from the target zoom ratio of the previous zoom event, determine that the current zoom event is the preset zoom event.

[0023] In one embodiment, the determining that the current zoom event is the preset zoom event includes:

[0024] Determine the number of optical zoom points to be passed based on the starting zoom ratio of the previous zoom event and the target zoom ratio of the current zoom event;

[0025] When the number of optical zoom points is greater than a preset optical zoom point number threshold, determine that the current zoom event is the preset zoom event.

[0026] In one embodiment, the optical zoom point number threshold is associated with the maximum number of image sensors that the image signal processor resources can support to turn on.

[0027] In one embodiment, controlling the corresponding image sensor to turn on or off according to the image sensor to be called for the preset zoom event includes:

[0028] When the image signal processor resources cannot support the image sensor to be called to turn on, compare the already turned-on image sensors with the image sensor to be called, and determine the image sensor to be turned off;

[0029] After turning off the image sensor to be turned off, turn on the image sensor to be called.

[0030] In one embodiment, the image sensors to be called include a first image sensor and a second image sensor. The first image sensor is the image sensor corresponding to the transition zoom ratio, and the second image sensor is the image sensor corresponding to the target zoom ratio of the preset zoom event. Controlling the corresponding image sensor to turn on or off according to the image sensor to be called for the preset zoom event includes:

[0031] When the first image sensor is not turned on and the second image sensor is already turned on, then do not turn on the first image sensor;

[0032] When the first image sensor is not turned on and the second image sensor is not turned on, then turn on the first image sensor first and then turn on the second image sensor.

[0033] In a second aspect, the present application also provides an image sensor control device, including:

[0034] An acquisition module, configured to acquire the target zoom ratio of the preset zoom event in response to the trigger of the preset zoom event; the preset zoom event is a new zoom event input during the zoom process of the previous zoom event;

[0035] A determination module, configured to determine the image sensor to be called for the preset zoom event according to the target zoom ratio of the previous zoom event and the target zoom ratio of the preset zoom event;

[0036] A control module, configured to control the corresponding image sensor to be turned on or off according to the image sensor to be called.

[0037] In a third aspect, the present application further provides an electronic device, including a memory and a processor. The memory stores a computer program, and when the processor executes the computer program, the steps of the above method are implemented.

[0038] In a fourth aspect, the present application further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the above method are implemented.

[0039] In a fifth aspect, the present application further provides a computer program product, including a computer program. When the computer program is executed by a processor, the steps of the above method are implemented.

[0040] For the above image sensor control method, device, electronic device, computer-readable storage medium, and computer program product, by responding to the triggering of a preset zoom event, the target zoom ratio of the preset zoom event is obtained; the preset zoom event is a new zoom event input during the zoom process of the previous zoom event; according to the target zoom ratio of the previous zoom event and the target zoom ratio of the preset zoom event, the image sensor to be called for the preset zoom event is determined; and according to the image sensor to be called, the corresponding image sensor is controlled to be turned on or off.

[0041] In this way, when the previous zoom event is not completed, if a new zoom event (preset zoom event) is triggered, the target zoom ratio of the previous zoom event is used as the starting zoom ratio of the secondary zoom event. Combining the target zoom ratio of the previous zoom event and the target zoom ratio of the preset zoom event, the image sensor to be called for the preset zoom event is determined, instead of using the current zoom ratio when the preset zoom event is triggered as the starting zoom ratio of the secondary zoom event for making the image sensor call decision. This can avoid the situation that since the current zoom ratio can be any point between the optical zoom points, there may be multiple different call decisions, resulting in easy triggering of incorrect closing and incorrect activation of the image sensor. In summary, by comprehensively considering the target zoom ratio of the previous zoom event and the target zoom ratio of the preset zoom event, the present application can improve the accuracy of the image sensor call decision, avoid frame loss or stuttering caused by abnormal closing of the image sensor, ensure the consistency of the zoom ratio switching jump performance, and thus effectively improve the zoom smoothness. Description of the Drawings

[0042] To more clearly illustrate the technical solutions in the embodiments of the present application or the related art, the following will briefly introduce the accompanying drawings required for the description of the embodiments of the present application or the related art. Obviously, the accompanying drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other related accompanying drawings can also be obtained based on these drawings.

[0043] FIG. 1(a) is a schematic diagram of traditional camera optical zoom in one embodiment;

[0044] FIG. 1(b) is a schematic diagram of traditional camera digital zoom in one embodiment;

[0045] FIG. 1(c) is a schematic diagram of lens relay zoom in a mobile phone in one embodiment;

[0046] Figure 2 FIG. 13 is a schematic flowchart of a method for controlling an image sensor in one embodiment;

[0047] Figure 3 FIG. 14 is a schematic flowchart of another method for controlling an image sensor in one embodiment;

[0048] Figure 4 FIG. 15 is a schematic diagram of the call decision logic of an image sensor in one embodiment;

[0049] Figure 5 FIG. 16 is a structural block diagram of an image sensor control device in one embodiment;

[0050] Figure 6 FIG. 17 is an internal structure diagram of an electronic device in one embodiment. Detailed implementation manners

[0051] In order to make the purpose, technical solutions and advantages of the present application clearer, the following further details the present application in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0052] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above accompanying drawings are used to distinguish similar objects and do not necessarily need to describe a specific order or sequence. It should be understood that such used data can be interchanged under appropriate circumstances so that the embodiments of the present disclosure described herein can be implemented in an order different from those illustrated or described herein. The implementation manners described in the following exemplary embodiments do not represent all implementation manners consistent with the present disclosure. On the contrary, they are only examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0053] First, before specifically introducing the technical solutions of the embodiments of the present disclosure, the technical background or the evolution context based on which the embodiments of the present disclosure are described will be introduced. In the field of camera shooting of electronic devices, when it comes to zoom technology, traditional zoom is usually divided into optical zoom and digital zoom. For example, the traditional camera optical zoom shown in FIG. 1(a) and the digital zoom shown in FIG. 1(b). However, due to the limitations of the size design of electronic devices, especially the thickness of mobile phones, it is difficult to integrate a zoom lens with a complex optical structure on an electronic device. Therefore, the method of using fixed-focus lenses of multiple cameras to relay to achieve the zoom effect has become the standard configuration of current electronic devices. For example, refer to the schematic diagram of lens relay zoom in the mobile phone shown in FIG. 1(c), on which there are three cameras with different focal lengths, namely a wide-angle camera 102, an ultra-wide-angle camera 104, and a telephoto camera 106. The pixel of the ultra-wide-angle camera 104 is 20MP, the equivalent focal length is 16mm, and the maximum optical value F = 2.2; the pixel of the wide-angle camera 102 is 40MP, the equivalent focal length is 27mm, and the maximum optical value F = 1.6; the pixel of the telephoto camera 106 is 8MP, the equivalent focal length is 125mm, and the maximum optical value F = 3.4; this mobile phone can achieve continuous change of the focal length between 16 - 27mm and 27 - 125mm, and through the hybrid zoom of optical zoom and digital zoom, and adopting the lens relay zoom - software fusion scheme (refer to FIG. 1(c)), continuous zoom of the 16 - 125mm focal length can be achieved. Further, as Figure 2 shown, the schematic diagram of the mobile phone shown in FIG. 1(c) may further include: a flash 108 and a TOF (Time of flight) 110.

[0054] However, due to the hardware differences of the sensors in different cameras and the defects of the existing focus switching process, image jumps or freezes usually occur during the zooming process, resulting in an unsmooth zooming result.

[0055] To solve the above technical problems, the embodiments of the present application provide an image sensor control method, device, electronic device, computer-readable storage medium, and computer program product. The following will introduce an image sensor control method provided by the embodiments of the present application with reference to the accompanying drawings.

[0056] In an exemplary embodiment, as Figure 2As shown, an image sensor control method is provided. Taking the application of this method to an electronic device as an example for illustration, the electronic device can be, but is not limited to, various personal computers, laptop computers, smartphones, tablet computers, Internet of Things devices, and portable wearable devices. The Internet of Things devices can be smart speakers, smart TVs, smart air conditioners, smart in-vehicle devices, smart cars, etc., and the portable wearable devices can be smart watches and smart bracelets, etc. It can be understood that this method can also be applied to a system including an electronic device and a server, and is implemented through the interaction between the electronic device and the server. Among them, multiple cameras are installed on the electronic device. When using the electronic device to capture images, the multiple cameras can achieve a zoom effect by means of a fixed-focus lens relay to meet the shooting requirements of multiple application scenarios.

[0057] In this embodiment, taking the application of this method to an electronic device as an example for illustration, it includes step S210 to step S230, where:

[0058] Step S210, in response to a preset zoom event being triggered, obtain the target zoom ratio of the preset zoom event.

[0059] Among them, the preset zoom event is a new zoom event input during the zoom process of the previous zoom event.

[0060] Among them, the zoom event can refer to the event of receiving a zoom operation.

[0061] Among them, the zoom operation can be a point-cut zoom operation or a slide-cut zoom operation.

[0062] Among them, point-cut zoom means switching from one zoom ratio to another different zoom ratio during shooting. Through the point-cut zoom operation, videos with different zoom ratios can be shot. For example, the camera provides multiple shooting ratios: 0.6x, 1x, 2x, 3x,..., 6x, and the default shooting ratio is 1x. When the user wants to shoot a 3x video, they can select 3x. The above switching from 1x to 3x is called one point-cut zoom.

[0063] Among them, slide-cut zoom means sliding to a certain target zoom ratio.

[0064] In this embodiment, both the preset zoom event and the previous zoom event refer to the zoom events of receiving point-cut zoom operations.

[0065] In specific implementation, when a new zoom event is triggered, if the new zoom event is a new zoom event input during the zoom process of the previous zoom event, then determine that the new zoom event is a preset zoom event, and the electronic device can, in response to the preset zoom event being triggered, obtain the target zoom ratio of the preset zoom event.

[0066] For example, during the process of the electronic device switching from a 0.6x zoom ratio to a 3x zoom ratio, the user inputs a new zoom event to the electronic device by clicking the 6x zoom ratio. Since this new zoom event is input before the previous zoom event of switching from 0.6x zoom ratio to 3x zoom ratio is completed, it can be determined that this new zoom event is a preset zoom event, and the electronic device can obtain the target zoom ratio of this preset zoom event: 6x.

[0067] In this application, the scenario where a new zoom event is triggered during the zoom process of the previous zoom event is defined as a continuous point-cut scenario.

[0068] Step S220: Determine the image sensor that the preset zoom event needs to call according to the target zoom ratio of the previous zoom event and the target zoom ratio of the preset zoom event.

[0069] Different cameras may have different zoom ratio ranges. Implementing different zoom ratios may require different cameras. When a certain zoom ratio needs to be achieved using a certain camera, the corresponding image sensor of that camera needs to be called to turn on the image sensor. Generally, an electronic device may include one or more cameras. If there is one camera, its zoom range is limited, and when there are multiple cameras, the zoom range is wider. The electronic device can use one of the cameras as the main camera and the other cameras as secondary cameras. The main camera refers to the main camera in the electronic device that is used to capture most of the image data. The zoom ratio at which the camera switches is generally the optical zoom point.

[0070] In a specific implementation, the electronic device can determine the image sensor that the preset zoom event needs to call according to the target zoom ratio of the previous zoom event and the target zoom ratio of the preset zoom event. Continuing with the above example, during the process of the electronic device switching from a 0.6x zoom ratio to a 3x zoom ratio, the user inputs a preset zoom event to the electronic device by clicking the 6x zoom ratio. Then the target zoom ratio of the previous zoom event is 3x, and the target zoom ratio of the preset zoom event is 6x. The electronic device can determine the image sensor that the preset zoom event needs to call through the 3x zoom ratio and the 6x zoom ratio.

[0071] It can be understood that in some electronic devices, the number of image signal processor resources is less than the number of cameras, and it is impossible to support multiple cameras to be turned on simultaneously. Therefore, the number of image sensors that the determined preset zoom event needs to call should be less than or equal to the maximum number of image sensors that the image signal processor resources can support to turn on.

[0072] Step S230: Control the corresponding image sensor to turn on or off according to the image sensor that needs to be called.

[0073] In a specific implementation, the electronic device can control the image sensor corresponding to the camera on the electronic device to turn on or off according to the image sensor required by the preset zoom event.

[0074] In some embodiments, the electronic device can compare the image sensor required by the preset zoom event with the currently turned-on image sensor to control the corresponding image sensor to turn on or off.

[0075] In the above image sensor control method, by responding to the triggering of a preset zoom event, the target zoom ratio of the preset zoom event is obtained; the preset zoom event is a new zoom event input during the zoom process of the previous zoom event; according to the target zoom ratio of the previous zoom event and the target zoom ratio of the preset zoom event, the image sensor required by the preset zoom event is determined; and according to the image sensor to be called, the corresponding image sensor is controlled to turn on or off.

[0076] In this way, when the previous zoom event is not completed, if a new zoom event (preset zoom event) is triggered, the target zoom ratio of the previous zoom event is used as the starting zoom ratio of the secondary zoom event. Combining the target zoom ratio of the previous zoom event and the target zoom ratio of the preset zoom event, the image sensor required by the preset zoom event is determined, rather than using the current zoom ratio at the time when the preset zoom event is triggered as the starting zoom ratio of the secondary zoom event for making the image sensor call decision. This can avoid the situation that since the current zoom ratio can be any point between the optical zoom points, there may be multiple different call decisions, resulting in easy triggering of incorrect closing and incorrect activation of the image sensor. In summary, by comprehensively considering the target zoom ratio of the previous zoom event and the target zoom ratio of the preset zoom event, the present application can improve the accuracy of the image sensor call decision, avoid frame loss or freezing caused by abnormal closing of the image sensor, ensure the consistency of the zoom ratio switching jump performance, and thus effectively improve the zoom smoothness.

[0077] In one embodiment, the method further includes: responding to the triggering of the current zoom event, obtaining the current zoom ratio of the current image frame; and determining that the current zoom event is a preset zoom event when the current zoom ratio is different from the target zoom ratio of the previous zoom event.

[0078] Wherein, the current image frame refers to the image frame that needs to be previewed, displayed, photographed, or recorded currently. The current zoom ratio refers to the zoom ratio of the current image frame.

[0079] In a specific implementation, the electronic device can respond to the triggering of the current zoom event, obtain the current zoom ratio of the current image frame, and determine that the current zoom event is a preset zoom event when the current zoom ratio is different from the target zoom ratio of the previous zoom event.

[0080] For example, a certain zoom event is used to indicate that the electronic device switches from a zoom ratio of 0.6x to a zoom ratio of 3x. When the current zoom event is triggered, the current zoom ratio of the current image frame is 2x, and the current zoom ratio of 2x is different from the target zoom ratio of 3x of the zoom event of switching from a zoom ratio of 0.6x to a zoom ratio of 3x. This indicates that the current zoom event occurs before the zoom event of switching from a zoom ratio of 0.6x to a zoom ratio of 3x is completed. That is to say, the current zoom event is a new zoom event input during the zoom process of the previous zoom event and can be used as a preset zoom event.

[0081] If the current zoom ratio of the current image frame is 3x, which is the same as the target zoom ratio of 3x of the zoom event of switching from a zoom ratio of 0.6x to a zoom ratio of 3x, it indicates that the zoom event of switching from a zoom ratio of 0.6x to a zoom ratio of 3x has been completed, and the current zoom event is a completely new zoom event and is not used as a preset zoom event.

[0082] The technical solution of this embodiment is to respond to the triggering of the current zoom event, obtain the current zoom ratio of the current image frame, and determine that the current zoom event is a preset zoom event when the current zoom ratio is different from the target zoom ratio of the previous zoom event. In this way, by judging whether the current zoom ratio when the current zoom event is triggered is the same as the target zoom ratio of the previous zoom event, it can be accurately determined whether the current zoom event occurs before the previous zoom event is completed, and thus it can be accurately determined whether the current zoom event is a preset zoom event.

[0083] In one embodiment, determining that the current zoom event is a preset zoom event includes: determining the number of optical zoom points to be passed according to the starting zoom ratio of the previous zoom event and the target zoom ratio of the current zoom event; and determining that the current zoom event is a preset zoom event when the number of optical zoom points is greater than a preset optical zoom point number threshold.

[0084] Among them, the optical change point refers to the zoom magnification threshold for switching or turning on a new camera. It can be understood as the zoom magnification threshold for switching from one camera to another, or the zoom magnification threshold for adding a new camera based on the current camera. For example, the camera includes UW (Ultra Wide, ultra-wide-angle camera), W (Wide, wide-angle camera), T (Telephoto, telephoto camera), and UT (Ultra Telephoto, ultra-telephoto camera). In the stable state, the optical change point corresponding to the ultra-wide-angle lens is 0.6, the optical change point corresponding to the wide-angle lens is 1.0, the optical change point corresponding to the telephoto lens is 3.0, and the optical change point corresponding to the ultra-telephoto lens is 6.0.

[0085] Among them, the optical change point quantity threshold is associated with the maximum number of image sensors that the image signal processor resources can support to turn on.

[0086] In specific implementation, when the current zoom magnification is different from the target zoom magnification of the previous zoom event, during the process of the electronic device determining whether the current zoom event is a preset zoom event, it can determine the number of optical change points to pass through according to the starting zoom magnification of the previous zoom event and the target zoom magnification of the current zoom event. When the number of optical change points is greater than the preset optical change point quantity threshold, it is determined that the current zoom event is a preset zoom event.

[0087] In practical applications, the optical change point quantity threshold is associated with the maximum number of image sensors that the image signal processor resources can support to turn on. For example, the optical change point quantity threshold can be equal to the maximum number of image sensors that the image signal processor resources can support to turn on.

[0088] For example, the maximum number of image sensors that the image signal processor resources can support to turn on is 3. The cameras on the electronic device include an ultra-wide-angle camera, a wide-angle camera, a telephoto camera, and an ultra-telephoto camera; the starting zoom magnification of the previous zoom event is 0.6x, and the target zoom magnification of the current zoom event is 6x. Then the optical change points to pass through include 0.6x, 1x, 3x, and 6x. The number of optical change points is 4, which is greater than the preset optical change point quantity threshold. Then it is determined that the current zoom event is a preset zoom event.

[0089] In this way, since the image signal processor resources are fewer than the number of cameras and cannot support multiple cameras to be turned on simultaneously, when the image signal processor resources cannot support multiple cameras to be turned on simultaneously, some unnecessary cameras need to be turned off to release the occupied image signal processor resources, and then the released image signal processor resources are used to support the turning on of the cameras that need to be called. Therefore, the electronic device can control the corresponding image sensor to turn on or off according to the image sensor that needs to be called.

[0090] In the technical solution of this embodiment, the number of optical zoom points to be passed through is determined based on the starting zoom ratio of the previous zoom event and the target zoom ratio of the current zoom event; when the number of optical zoom points is greater than a preset optical zoom point number threshold, it is determined that the current zoom event is a preset zoom event. In this way, when the current zoom ratio is different from the target zoom ratio of the previous zoom event, whether the number of optical zoom points to be passed through between the starting zoom ratio of the previous zoom event and the target zoom ratio of the current zoom event is greater than the preset optical zoom point number threshold is used as the basis for determining whether it is a preset zoom event. Among them, the optical zoom point number threshold is associated with the maximum number of image sensors that the image signal processor resources can support to turn on. Therefore, the corresponding image sensors can be accurately determined to be turned on or off according to the image sensors required for the preset zoom event.

[0091] In some embodiments, when the number of optical zoom points to be passed through between the starting zoom ratio of the previous zoom event and the target zoom ratio of the preset zoom event is greater than the preset optical zoom point number threshold, the image sensors to be called may include transitional sensors. Specifically:

[0092] Determining the image sensors required for the preset zoom event according to the target zoom ratio of the previous zoom event and the target zoom ratio of the preset zoom event includes: selecting the first zoom ratio to be used from multiple preset zoom ratios according to the target zoom ratio of the previous zoom event and the target zoom ratio of the preset zoom event; determining the image sensors to be called.

[0093] Among them, the image sensors to be called include the image sensors corresponding to the transitional zoom ratios, and the transitional zoom ratios are one of the first zoom ratios to be used.

[0094] Among them, the multiple preset zoom ratios can be determined according to the optical zoom points corresponding to each camera on the electronic device. For example, if the cameras include UW (Ultra Wide, ultra-wide-angle camera), W (Wide, wide-angle camera), T (Telephoto, telephoto camera), and UT (Ultra Telephoto, ultra-long telephoto camera), then the multiple preset zoom ratios can at least include 0.6x, 1x, 3x, 6x.

[0095] In a specific implementation, when the electronic device determines the image sensor to be called for a preset zoom event based on the target zoom ratio of the previous zoom event and the target zoom ratio of the preset zoom event, it can select the first zoom ratio to be used from multiple preset zoom ratios according to the target zoom ratio of the previous zoom event and the target zoom ratio of the preset zoom event. The first zoom ratio to be used includes the transitional zoom ratio. Thus, the electronic device can determine the image sensor to be called according to the first zoom ratio to be used. Among them, the image sensor to be called includes the image sensor corresponding to the transitional zoom ratio, and the transitional zoom ratio is one of the first zoom ratios to be used.

[0096] Among them, the first zoom ratio can at least include the transitional zoom ratio and the target zoom ratio of the preset zoom event, and the image sensor to be called can at least include the image sensor corresponding to the transitional zoom ratio and the image sensor corresponding to the target zoom ratio of the preset zoom event.

[0097] In practical applications, the first zoom ratio to be used can include the zoom ratio corresponding to the optical zoom point passed between the target zoom ratio of the previous zoom event and the target zoom ratio of the preset zoom event.

[0098] In practical applications, the association relationship between the preset zoom ratio and the image sensor is shown in Table 1:

[0099] Table 1

[0100]

[0101] For example, taking the target zoom ratio of the previous zoom event as 3x (3x corresponds to the starting focal length of the telephoto camera (T) in Table 1) and the target zoom ratio of the preset zoom event as 6x as an example, the passed optical zoom points include 3x and 6x. Then the first zoom ratio to be used can include 3x and 6x. Combining Table 1, the image sensors to be called can include the image sensor corresponding to the telephoto camera (T) to be called at 3x and the image sensor corresponding to the ultra-telephoto lens (UT) to be called at 6x. Among them, the transitional zoom ratio is 3x.

[0102] The technical solution of this embodiment selects a first zoom ratio to be used from multiple preset zoom ratios according to the target zoom ratio of the previous zoom event and the target zoom ratio of the preset zoom event; determines the image sensor to be called; the image sensor to be called includes the image sensor corresponding to the transition zoom ratio, and the transition zoom ratio is one of the first zoom ratios to be used. In this way, according to the target zoom ratio of the previous zoom event and the target zoom ratio of the preset zoom event, the first zoom ratio including the transition zoom ratio can be accurately selected, so that the image sensor to be called can be determined according to the first zoom ratio, and the image sensor to be called includes the image sensor corresponding to the transition zoom ratio. By making a clarity transition through the image sensor corresponding to the transition zoom ratio, the coherence of the zoom process can be ensured.

[0103] In one embodiment, determining the image sensor to be called for the preset zoom event according to the target zoom ratio of the preset zoom event and the target zoom ratio of the previous zoom event includes: obtaining the starting zoom ratio of the previous zoom event; determining the image sensor to be called for the preset zoom event according to the starting zoom ratio of the previous zoom event, the target zoom ratio of the preset zoom event, and the target zoom ratio of the previous zoom event.

[0104] In specific implementation, when the electronic device determines the image sensor to be called for the preset zoom event according to the target zoom ratio of the preset zoom event and the target zoom ratio of the previous zoom event, it can also obtain the starting zoom ratio of the previous zoom event; determine the image sensor to be called for the preset zoom event according to the starting zoom ratio of the previous zoom event, the target zoom ratio of the preset zoom event, and the target zoom ratio of the previous zoom event.

[0105] For example, the previous zoom event is used to instruct the electronic device to switch from a 0.6x zoom ratio to a 3x zoom ratio. During the process of the electronic device switching from a 0.6x zoom ratio to a 3x zoom ratio, the user inputs a preset zoom event to the electronic device by clicking the 6x zoom ratio. Then the starting zoom ratio of the previous zoom event is 0.6x, the target zoom ratio of the previous zoom event is 3x, and the target zoom ratio of the preset zoom event is 6x.

[0106] The technical solution of this embodiment is to obtain the starting zoom ratio of the previous zoom event; determine the image sensor to be called for the preset zoom event according to the starting zoom ratio of the previous zoom event, the target zoom ratio of the preset zoom event, and the target zoom ratio of the previous zoom event. In this way, by combining the starting zoom ratio of the previous zoom event, the target zoom ratio of the previous zoom event, and the target zoom ratio of the preset zoom event, the change situation of the zoom process can be determined more comprehensively, and a more accurate decision on calling the image sensor can be made.

[0107] In one embodiment, determining the image sensor to be called for the preset zoom event according to the starting zoom ratio of the previous zoom event, the target zoom ratio of the preset zoom event, and the target zoom ratio of the previous zoom event includes: selecting the second zoom ratio to be used from multiple preset zoom ratios according to the starting zoom ratio of the previous zoom event and the target zoom ratio of the previous zoom event; selecting the third zoom ratio to be used from multiple preset zoom ratios according to the target zoom ratio of the previous zoom event and the target zoom ratio of the preset zoom event; determining the image sensor to be called for the preset zoom event.

[0108] Among them, the image sensor to be called includes the image sensor corresponding to the transition zoom ratio, and the transition zoom ratio is one of the second zoom ratio to be used or the third zoom ratio to be used.

[0109] In specific implementation, when the electronic device determines the image sensor to be called for the preset zoom event according to the starting zoom ratio of the previous zoom event, the target zoom ratio of the preset zoom event, and the target zoom ratio of the previous zoom event, it can select the second zoom ratio to be used from multiple preset zoom ratios according to the starting zoom ratio of the previous zoom event and the target zoom ratio of the previous zoom event; select the third zoom ratio to be used from multiple preset zoom ratios according to the target zoom ratio of the previous zoom event and the target zoom ratio of the preset zoom event. Thus, the image sensor to be called for the preset zoom event can be determined according to the selected second zoom ratio to be used and the third zoom ratio to be used; the image sensor to be called includes the image sensor corresponding to the transition zoom ratio, and the transition zoom ratio is one of the second zoom ratio to be used or the third zoom ratio to be used.

[0110] Among them, the second zoom ratio to be used may include the zoom ratio corresponding to the optical zoom point passed between the starting zoom ratio of the previous zoom event and the target zoom ratio of the previous zoom event.

[0111] Among them, the third zoom ratio to be used may include the zoom ratios corresponding to the optical zoom points passed between the target zoom ratio of the previous zoom event and the target zoom ratio of the preset zoom event.

[0112] Among them, the transitional zoom ratio may be the target zoom ratio of the previous zoom event.

[0113] For example, if the starting zoom ratio of the previous zoom event is 0.6x (0.6x corresponds to the starting focal length of the ultra-wide-angle camera (UW) in Table 1), the target zoom ratio of the previous zoom event is 1x, and the passed optical zoom points include 0.6x and 1x, then the second zoom ratio to be used may include 0.6x and 1x; if the target zoom ratio of the preset zoom event is 6x, then the passed optical zoom points between the target zoom ratio 1x of the previous zoom event and 6x include 1x, 3x, and 6x, then the third zoom ratio to be used may include 1x, 3x, and 6x, and the target zoom ratio 1x of the previous zoom event can be used as the transitional zoom ratio.

[0114] Combined with Table 1, the image sensors corresponding to the second zoom ratio to be used (0.6x and 1x) may include the image sensor corresponding to the ultra-wide-angle camera (UW) and the image sensor corresponding to the wide-angle camera (W); the image sensors corresponding to the third zoom ratio to be used (1x, 3x, and 6x) may include the image sensor corresponding to the wide-angle camera (W), the image sensor corresponding to the telephoto camera (T), and the image sensor corresponding to the ultra-telephoto lens (UT); the image sensors to be called for the finally determined preset zoom event may include the image sensor corresponding to the transitional zoom ratio (wide-angle camera (W)), the image sensor corresponding to the starting zoom ratio of the previous zoom event (ultra-wide-angle camera (UW)), and the image sensor corresponding to the target zoom ratio of the preset zoom event (ultra-telephoto lens (UT)).

[0115] The technical solution of this embodiment selects the second zoom ratio to be used from multiple preset zoom ratios according to the starting zoom ratio of the previous zoom event and the target zoom ratio of the previous zoom event; selects the third zoom ratio to be used from multiple preset zoom ratios according to the target zoom ratio of the previous zoom event and the target zoom ratio of the preset zoom event; determines the image sensors to be called for the preset zoom event; the image sensors to be called include the image sensor corresponding to the transitional zoom ratio, and the transitional zoom ratio is one of the second zoom ratio to be used or the third zoom ratio to be used.

[0116] Thus, by combining the starting zoom ratio of the previous zoom event, the target zoom ratio of the preset zoom event, and the target zoom ratio of the previous zoom event, the two zoom ratios to be used (the second zoom ratio and the third zoom ratio respectively) can be determined. Therefore, based on the two determined zoom ratios to be used, the transition zoom ratio can be determined more accurately, and thus the image sensor to be called for the preset zoom event can be determined more accurately, reducing the mis - activation of the image sensor.

[0117] In one embodiment, controlling the corresponding image sensor to be turned on or off according to the image sensor to be called for the preset zoom event includes: when the image signal processor resources cannot support the activation of the image sensor to be called, comparing the activated image sensor with the image sensor to be called to determine the image sensor to be turned off; after turning off the image sensor to be turned off, turning on the image sensor to be called.

[0118] Optionally, the electronic device can determine the activation status of the image sensor by obtaining the status flag bit of the image sensor. The status flag bit being the first flag indicates that the image sensor is activated, and the status flag bit being the second flag indicates that the image sensor is not activated, that is, in the off state. The first flag and the second flag can be configured as needed. Thus, the electronic device can determine the activated image sensor according to the status flag bit of the image sensor.

[0119] In a specific implementation, when the electronic device controls the corresponding image sensor to be turned on or off according to the image sensor to be called for the preset zoom event, it is necessary to detect whether the image signal processor resources support the activation of the image sensor to be called. As described above, when the number of image signal processors is less than the number of cameras, multiple cameras cannot be activated simultaneously. When the image signal processor resources cannot support the simultaneous activation of multiple cameras, some unnecessary cameras need to be turned off to release the occupied image signal processor resources, and then the released image signal processor resources are used to support the activation of the camera to be called.

[0120] For example, the maximum number of image sensors that the image signal processor resources can support to be turned on is 3. The cameras on the electronic device include an ultra-wide-angle camera, a wide-angle camera, a telephoto camera, and an ultra-telephoto camera. If the starting zoom ratio of the previous zoom event was 0.6x, the target zoom ratio of the previous zoom event was 3x, and the target zoom ratio of the preset zoom event is 6x, and the image sensors corresponding to 3 cameras have been turned on during the previous zoom event: the image sensors corresponding to UW, W, and T respectively, and it is determined that the image sensors to be called for the preset zoom event include the image sensors corresponding to UW, T, and UT respectively. Since the image sensors corresponding to 3 cameras have been turned on during the previous zoom event, and the preset zoom event still needs to call UT, therefore, at this time, the image signal processor resources cannot support the image sensors to be called to be turned on.

[0121] Furthermore, when the image signal processor resources cannot support the image sensors to be called to be turned on, the electronic device can compare the turned-on image sensors with the image sensors to be called, determine the image sensors to be turned off, and after turning off the image sensors to be turned off, turn on the image sensors to be called.

[0122] Continuing with the above example, the turned-on image sensors are: the image sensors corresponding to UW, W, and T respectively; the image sensors to be called for the preset zoom event include the image sensors corresponding to UW, T, and UT respectively. By comparison, it can be determined that the image sensor to be turned off is the image sensor corresponding to W. After turning off the image sensor corresponding to W, then turn on the image sensors to be called.

[0123] The technical solution of this embodiment, when the image signal processor resources cannot support the image sensors to be called to be turned on, by comparing the turned-on image sensors with the image sensors to be called, can more accurately determine the image sensors to be turned off; after turning off the image sensors to be turned off, the occupied image signal processor resources can be released, and then the released image signal processor resources can be used to support the turning on of the cameras to be called.

[0124] In one embodiment, the image sensors to be called include a first image sensor and a second image sensor. The first image sensor is the image sensor corresponding to the transition zoom ratio, and the second image sensor is the image sensor corresponding to the target zoom ratio of the preset zoom event.

[0125] Based on the image sensor to be called according to the preset zoom event, control the corresponding image sensor to turn on or off, including: when the first image sensor is not turned on and the second image sensor is already turned on, the first image sensor is not turned on; when the first image sensor is not turned on and the second image sensor is not turned on, the first image sensor is turned on first and then the second image sensor is turned on.

[0126] In specific implementation, when the electronic device controls the corresponding image sensor to turn on or off according to the image sensor to be called according to the preset zoom event, when the first image sensor is not turned on and the second image sensor is already turned on, the first image sensor is not turned on. In this way, when the image sensor corresponding to the transition zoom ratio is not turned on and the image sensor corresponding to the target zoom ratio of the preset zoom event is already turned on, the transition image sensor (the first image sensor) is not turned on. That is, instead of going through the intermediate transition image sensor for clarity transition, the zoom switch is directly responded to by the second image sensor, which can further ensure the followability of continuous switching. That is, as long as one of the transition image sensor and the image sensor corresponding to the target zoom ratio of the preset zoom event is in the on state, the zoom switch can be responded to.

[0127] When the first image sensor is not turned on and the second image sensor is not turned on, the first image sensor is turned on first and then the second image sensor is turned on. In this way, when the image sensor corresponding to the transition zoom ratio is not turned on and the image sensor corresponding to the target zoom ratio of the preset zoom event is not turned on, since the transition image sensor needs to be used earlier, the transition image sensor (the first image sensor) is turned on first to ensure that the transition image sensor can be pulled up in time, and the image sensor corresponding to the target zoom ratio of the preset zoom event can be pulled up later. The pulling-up order of the transition image sensor and the image sensor corresponding to the target zoom ratio of the preset zoom event avoids the problem of insufficient hardware resources in a short time, and can better support the response to zoom to improve the followability of continuous zoom switching.

[0128] Taking a four-camera platform as an example, for a four-camera platform, continuous point cuts or cross-cut scenes require switching control of different image sensors. Currently, the image signal processor resources can only support turning on 3 image sensors at the same time. This requires that when the four-camera resource limit is reached, one image sensor needs to be turned off first and then another image sensor is turned on; only after the target image sensor is turned on can a new zoom be responded to, which will affect the followability of the secondary switch in the continuous point cut scene.

[0129] Meanwhile, operating a single image sensor by turning it off and then on again within a short period of time may also lead to dropped frames (mainly because the design requirements of the platform process dictate that the next operation cannot be responded to until the turn-on or turn-off process is completed). Therefore, this embodiment provides an image sensor control method to optimize the switching strategy of the image sensor for continuous point-switching and cross-cutting scenarios (such as a quad-camera platform) to improve zoom smoothness.

[0130] Specifically, this image sensor control method is applicable to the cross-cutting scenario of a quad-camera platform, mainly for the continuous point-switching scenario of a quad-camera platform. As Figure 3 shown, a flowchart of another image sensor control method is provided. The image sensor control process may include:

[0131] S1, Turn on the camera and start image preview / video recording.

[0132] S2, When the current zoom event is triggered, first detect whether the current zoom event is a point-switching zoom event or a sliding zoom event.

[0133] Among them, if it is a sliding zoom event, determine the current zoom ratio of the current image frame and the target zoom ratio corresponding to the current zoom event, and control the corresponding image sensor to turn on or off according to the sliding image sensor call strategy.

[0134] S3, If it is a point-switching zoom event, determine whether it is a continuous point-switching zoom event or a non-continuous point-switching zoom event based on the current zoom ratio of the current image frame and the target zoom ratio of the previous zoom event.

[0135] Among them, if the current zoom ratio is different from the target zoom ratio of the previous zoom event, it is a continuous point-switching zoom event; if the current zoom ratio is the same as the target zoom ratio of the previous zoom event, it is a non-continuous point-switching zoom event.

[0136] Among them, if it is a non-continuous point-switching zoom event, control the corresponding image sensor to turn on or off according to the ordinary point-switching image sensor call strategy (determine the image sensor to be called based on the current zoom ratio of the current image frame and the target zoom ratio corresponding to the current zoom event).

[0137] S4, If it is a continuous point-switching zoom event, it is necessary to determine whether it is a cross-quad-camera continuous point-switching zoom event.

[0138] Among them, the cross-quad-camera continuous point-switching zoom event is the preset zoom event in the above embodiment.

[0139] Among them, the number of optical zoom points to be passed can be determined according to the starting zoom ratio of the previous zoom event and the target zoom ratio of the current zoom event; in the case where the number of optical zoom points is greater than a preset optical zoom point number threshold, it is determined that the current zoom event is a preset zoom event. Among them, the optical zoom point number threshold is equal to the maximum number of image sensors that the image signal processor resources can support to turn on (in this embodiment, the maximum number of image sensors that the image signal processor resources can support to turn on is 3).

[0140] S5. If the current zoom event is a cross-four-camera continuous point cut zoom event, adopt a cross-four-camera continuous point cut image sensor call strategy: then determine the image sensor to be called for the current zoom event according to the starting zoom ratio of the previous zoom event, the target zoom ratio of the current zoom event, and the target zoom ratio of the previous zoom event.

[0141] S6. Compare the already turned-on image sensors with the image sensors to be called, and determine the image sensors to be turned off; after turning off the image sensors to be turned off, turn on the image sensors to be called to perform the subsequent zoom process (alignment and fusion).

[0142] Among them, in the case where the current zoom event is a cross-four-camera continuous point cut zoom event, first judge the start-up flow situation of the transition image sensor. Once the transition image sensor is in the on state or there is available resources, it can respond to the zoom; after turning on the transition image sensor, then check the pull-up state of the image sensor corresponding to the target zoom ratio of the current zoom event (if it is pulled up, trigger the pull-up at this time);

[0143] S7. Complete the zoom process and continue previewing or image recording.

[0144] Taking the previous zoom event for indicating that the electronic device switches from a 0.6x zoom ratio to a 3x zoom ratio as an example, if during the process of the electronic device switching from a 0.6x zoom ratio to a 3x zoom ratio, a zoom event of switching to a 6x zoom ratio is triggered, then the current zoom event is a cross-four-camera continuous point cut zoom event (preset zoom event). If the call decision of the image sensor is directly made based on the current zoom ratio of the current image frame, it is very easy to trigger the mis-turning-off and mis-pulling-up of the image sensor. Combining Table 1, if the call decision of the image sensor is made based on the current zoom ratio of the current image frame, the starting point of the secondary zoom switch may be any zoom ratio between 0.6x and 3x; according to the decision table provided in Table 1, there will be multiple different call decisions, which will not only lead to abnormal selection of the aligned image sensor, but also cause the deterioration of the followability due to the mis-turning-off of the image sensor that should have remained on. Therefore, for the call decision of the image sensor in this scenario, the decision logic as Figure 4 shown can be adopted for decision-making:

[0145] Obtain the starting zoom ratio of the previous zoom event. Based on the starting zoom ratio of the previous zoom event and the target zoom ratio of the current zoom event, determine the number of optical zoom points to be passed through. According to whether the current zoom ratio is the same as the target zoom ratio of the previous zoom event, and whether the number of optical zoom points is greater than a preset optical zoom point number threshold (the optical zoom point number threshold is associated with the maximum number of image sensors that the image signal processor resources can support to turn on), determine whether the current zoom event is a preset zoom event. In the case of a preset zoom event, based on the starting zoom ratio of the previous zoom event, the target zoom ratio of the preset zoom event, and the target zoom ratio of the previous zoom event, determine the image sensors to be called for the preset zoom event, so as to control the corresponding image sensors to turn on or off according to the image sensors to be called, without waiting until the previous zoom event is completed before responding to the zoom.

[0146] In this way, by comprehensively considering the starting zoom ratio of the previous zoom event, the target zoom ratio of the preset zoom event, and the target zoom ratio of the previous zoom event, a more reasonable decision on the start and stop control of the image sensors is made. This not only makes the switching of the image sensors in the continuous point-cut scene more reasonable, but also optimizes the problems of frame loss, jitter, and followability deviation caused by incorrect turning off or on of the image sensors; there is also a certain optimization of the followability for the four-camera scene. This improves the overall zoom experience better and also ensures the consistency of each switching jump performance.

[0147] It should be understood that although the steps in the flowcharts involved in the above-described embodiments are shown in sequence according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless there is a clear description in this article, the execution of these steps does not have a strict order limit, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-described embodiments may include multiple steps or multiple stages. These steps or stages are not necessarily executed at the same moment, but can be executed at different moments. The execution order of these steps or stages is not necessarily sequential, but can be executed alternately or in turn with at least a part of other steps or steps or stages in other steps.

[0148] Based on the same inventive concept, an embodiment of the present application also provides an image sensor control device for implementing the above-mentioned image sensor control method. The solution provided by this device to solve the problem is similar to the solution described in the above method. Therefore, the specific limitations in one or more embodiments of the image sensor control device provided below can refer to the limitations on the image sensor control method in the above text, and will not be repeated here.

[0149] In an exemplary embodiment, as Figure 5 shown, an image sensor control device is provided, including: an acquisition module 510, a determination module 520, and a control module 530, where:

[0150] The acquisition module 510 is configured to, in response to a preset zoom event being triggered, acquire a target zoom ratio of the preset zoom event; the preset zoom event is a new zoom event input during the zoom process of the previous zoom event.

[0151] The determination module 520 is configured to determine an image sensor to be called for the preset zoom event according to the target zoom ratio of the previous zoom event and the target zoom ratio of the preset zoom event.

[0152] The control module 530 is configured to control the corresponding image sensor to be turned on or off according to the image sensor to be called.

[0153] In one embodiment, the number of image sensors to be called is less than or equal to the maximum number of image sensors that the image signal processor resources can support to be turned on.

[0154] In one embodiment, the determination module 520 is specifically configured to select a first zoom ratio to be used from multiple preset zoom ratios according to the target zoom ratio of the previous zoom event and the target zoom ratio of the preset zoom event; determine the image sensor to be called; the image sensor to be called includes the image sensor corresponding to the transition zoom ratio, and the transition zoom ratio is one of the first zoom ratios to be used.

[0155] In one embodiment, the determination module 520 is specifically configured to acquire the starting zoom ratio of the previous zoom event; determine the image sensor to be called for the preset zoom event according to the starting zoom ratio of the previous zoom event, the target zoom ratio of the preset zoom event, and the target zoom ratio of the previous zoom event.

[0156] In one embodiment, the determining module 520 is specifically configured to select a second zoom ratio to be used from a plurality of preset zoom ratios according to the starting zoom ratio of the last zoom event and the target zoom ratio of the last zoom event; select a third zoom ratio to be used from a plurality of preset zoom ratios according to the target zoom ratio of the last zoom event and the target zoom ratio of the preset zoom event; determine the image sensor to be called for the preset zoom event; the image sensor to be called includes the image sensor corresponding to the transition zoom ratio, and the transition zoom ratio is one of the second zoom ratio to be used or the third zoom ratio to be used.

[0157] In one embodiment, the device further includes: a judging module, configured to, in response to a current zoom event being triggered, obtain the current zoom ratio of the current image frame; and determine that the current zoom event is the preset zoom event when the current zoom ratio is different from the target zoom ratio of the last zoom event.

[0158] In one embodiment, the judging module is specifically configured to determine the number of optical zoom points to be passed according to the starting zoom ratio of the last zoom event and the target zoom ratio of the current zoom event; and determine that the current zoom event is the preset zoom event when the number of optical zoom points is greater than a preset optical zoom point number threshold.

[0159] In one embodiment, the optical zoom point number threshold is associated with the maximum number of image sensors that the image signal processor resources can support to turn on.

[0160] In one embodiment, the control module 530 is specifically configured to, when the image signal processor resources cannot support the image sensor to be called to turn on, compare the image sensors that have been turned on and the image sensor to be called, and determine the image sensor to be turned off; after turning off the image sensor to be turned off, turn on the image sensor to be called.

[0161] In one embodiment, the image sensor to be called includes a first image sensor and a second image sensor, the first image sensor is the image sensor corresponding to the transition zoom ratio, and the second image sensor is the image sensor corresponding to the target zoom ratio of the preset zoom event. The control module 530 is specifically configured to not turn on the first image sensor when the first image sensor is not turned on and the second image sensor has been turned on; and turn on the first image sensor first and then turn on the second image sensor when the first image sensor is not turned on and the second image sensor is not turned on.

[0162] Each module in the above image sensor control device can be implemented in whole or in part by software, hardware, or a combination thereof. Each of the above modules can be embedded in the processor in the electronic device in hardware form or be independent of it, or be stored in the memory of the electronic device in software form so that the processor can call and execute the operations corresponding to each of the above modules.

[0163] In an exemplary embodiment, an electronic device is provided. The electronic device can be a terminal, and its internal structure diagram can be as Figure 6 shown. The electronic device includes a processor, a memory, an input / output interface, a communication interface, a display unit, and an input device. Among them, the processor, the memory, and the input / output interface are connected through a system bus, and the communication interface, the display unit, and the input device are connected to the system bus through the input / output interface. Among them, the processor of the electronic device is used to provide computing and control capabilities. The memory of the electronic device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input / output interface of the electronic device is used to exchange information between the processor and external devices. The communication interface of the electronic device is used to communicate with external terminals in a wired or wireless manner. The wireless manner can be implemented through WIFI, a mobile cellular network, near field communication (NFC), or other technologies. When the computer program is executed by the processor, it implements an image sensor control method. The display unit of the electronic device is used to form a visually visible picture, which can be a display screen, a projection device, or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen. The input device of the electronic device can be a touch layer covering the display screen, or a button, a trackball, or a touchpad provided on the housing of the electronic device, or an external keyboard, touchpad, or mouse, etc.

[0164] Those skilled in the art can understand that Figure 6 the structure shown in

[0165] merely represents a block diagram of some structures related to the solution of the present application, and does not constitute a limitation on the electronic device to which the solution of the present application is applied. The specific electronic device may include more or fewer components than those shown in the figure, or combine certain components, or have a different component layout.

[0166] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps of the above-mentioned image processing method are implemented.

[0167] In one embodiment, a computer program product is provided, including a computer program. When the computer program is executed by a processor, the steps of the above-mentioned image processing method are implemented.

[0168] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in this application are all information and data that have been authorized by the user or fully authorized by all parties, and the collection, use, and processing of relevant data need to comply with relevant regulations.

[0169] Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be completed by instructing relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above methods. Among them, any reference to a memory, database, or other medium used in the embodiments provided in this application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc. The databases involved in the embodiments provided in this application can include at least one of relational databases and non-relational databases. Non-relational databases can include distributed databases based on blockchain, etc., without limitation. The processors involved in the embodiments provided in this application can be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, data processing logics based on quantum computing, artificial intelligence (AI) processors, etc., without limitation.

[0170] The technical features of the above embodiments can be combined arbitrarily. For the sake of brevity of description, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, it should be considered to be within the scope recorded in this application.

[0171] The above-described embodiments merely represent several implementation manners of the present application. The description thereof is relatively specific and detailed, but it should not be construed as a limitation on the patent scope of the present application. It should be noted that for those of ordinary skill in the art, without departing from the concept of the present application, several modifications and improvements can still be made, and these all fall within the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the appended claims.

Claims

1. An image sensor control method, characterized in that, The method includes: In response to a preset zoom event being triggered, obtaining the target zoom ratio of the preset zoom event; the preset zoom event is a new zoom event input during the zoom process of the previous zoom event; Determining the image sensor to be called for the preset zoom event according to the target zoom ratio of the previous zoom event and the target zoom ratio of the preset zoom event; Controlling the corresponding image sensor to be turned on or off according to the image sensor to be called.

2. The method according to claim 1, characterized in that, The number of image sensors to be called is less than or equal to the maximum number of image sensors that the image signal processor resources can support to turn on.

3. The method according to claim 1, wherein The determining the image sensor to be called for the preset zoom event according to the target zoom ratio of the previous zoom event and the target zoom ratio of the preset zoom event includes: Selecting a first zoom ratio to be used from multiple preset zoom ratios according to the target zoom ratio of the previous zoom event and the target zoom ratio of the preset zoom event; Determining the image sensor to be called; the image sensor to be called includes the image sensor corresponding to the transition zoom ratio, and the transition zoom ratio is one of the first zoom ratios to be used.

4. The method according to claim 1, wherein The determining the image sensor to be called for the preset zoom event according to the target zoom ratio of the preset zoom event and the target zoom ratio of the previous zoom event includes: Obtaining the starting zoom ratio of the previous zoom event; Determining the image sensor to be called for the preset zoom event according to the starting zoom ratio of the previous zoom event, the target zoom ratio of the preset zoom event, and the target zoom ratio of the previous zoom event.

5. The method according to claim 4, characterized in that The determining the image sensor to be called for the preset zoom event according to the starting zoom ratio of the previous zoom event, the target zoom ratio of the preset zoom event, and the target zoom ratio of the previous zoom event includes: Selecting a second zoom ratio to be used from multiple preset zoom ratios according to the starting zoom ratio of the previous zoom event and the target zoom ratio of the previous zoom event; Selecting a third zoom ratio to be used from multiple preset zoom ratios according to the target zoom ratio of the previous zoom event and the target zoom ratio of the preset zoom event; Determining the image sensor to be called for the preset zoom event; the image sensor to be called includes the image sensor corresponding to the transition zoom ratio, and the transition zoom ratio is one of the second zoom ratio to be used or the third zoom ratio to be used.

6. The method according to claim 1, wherein The method further includes: In response to a current zoom event being triggered, obtaining the current zoom ratio of the current image frame; Determining that the current zoom event is the preset zoom event when the current zoom ratio is different from the target zoom ratio of the previous zoom event.

7. The method according to claim 6, wherein The determining that the current zoom event is the preset zoom event includes: Determine the number of optical zoom points that need to be passed based on the starting zoom ratio of the previous zoom event and the target zoom ratio of the current zoom event; In the case where the number of optical zoom points is greater than a preset optical zoom point number threshold, determine that the current zoom event is the preset zoom event.

8. The method according to claim 7, wherein The optical zoom point number threshold is associated with the maximum number of image sensors that the image signal processor resources can support to turn on.

9. The method according to claim 1, characterized in that Controlling the corresponding image sensor to turn on or off according to the image sensor that needs to be called according to the preset zoom event includes: In the case where the image signal processor resources cannot support the image sensor that needs to be called to turn on, compare the turned-on image sensors with the image sensor that needs to be called, and determine the image sensor that needs to be turned off; After turning off the image sensor that needs to be turned off, turn on the image sensor that needs to be called.

10. The method according to claim 1, characterized in that The image sensor that needs to be called includes a first image sensor and a second image sensor. The first image sensor is the image sensor corresponding to the transition zoom ratio, and the second image sensor is the image sensor corresponding to the target zoom ratio of the preset zoom event. Controlling the corresponding image sensor to turn on or off according to the image sensor that needs to be called according to the preset zoom event includes: In the case where the first image sensor is not turned on and the second image sensor is turned on, do not turn on the first image sensor; In the case where the first image sensor is not turned on and the second image sensor is not turned on, first turn on the first image sensor and then turn on the second image sensor.

11. An image sensor control device, characterized in that, The device includes: An acquisition module, configured to, in response to a preset zoom event being triggered, acquire the target zoom ratio of the preset zoom event; the preset zoom event is a new zoom event input during the zoom process of the previous zoom event; A determination module, configured to determine the image sensor that needs to be called according to the preset zoom event based on the target zoom ratio of the previous zoom event and the target zoom ratio of the preset zoom event; A control module, configured to control the corresponding image sensor to turn on or off according to the image sensor that needs to be called.

12. An electronic device, comprising a memory and a processor, the memory storing a computer program, characterized in that, When the processor executes the computer program, the steps of the method according to any one of claims 1 to 10 are implemented.

13. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, the steps of the method according to any one of claims 1 to 10 are implemented.

14. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by the processor, the steps of the method according to any one of claims 1 to 10 are implemented.

Images