Image sensor control method and apparatus, and electronic device and readable storage medium
By determining the target sensor identifier and the sensor identifier to be turned on in the image sensor control method, the image sensor is controlled to turn on and off, which solves the problem of reduced zoom smoothness caused by the number of image sensors exceeding the number of processing units, and achieves a smoother zoom effect.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP LTD
- Filing Date
- 2025-11-26
- Publication Date
- 2026-07-30
AI Technical Summary
In electronic devices where the number of image sensors is greater than the number of image processing units, existing image sensor control methods result in reduced zoom smoothness.
By responding to zoom operations, the target zoom magnification is obtained, the target sensor identifier and the sensor identifier to be activated are determined, and the image sensor is controlled to turn on and off to avoid multiple switching and improve zoom smoothness.
This reduces the number of image sensor switching operations during zooming, improving the smoothness and continuity of zooming.
Smart Images

Figure CN2025137852_30072026_PF_FP_ABST
Abstract
Description
Image sensor control methods, devices, electronic equipment, and readable storage media
[0001] Related applications
[0002] This application claims priority to Chinese patent application filed on January 26, 2025, with application number 202510125172X, entitled "Image Sensor Control Method, Apparatus, Electronic Device and Readable Storage Medium", the entire contents of which are incorporated herein by reference. Technical Field
[0003] This application relates to the field of image display technology, and in particular to an image sensor control method, apparatus, electronic device, and readable storage medium. Background Technology
[0004] With the development of image display technology, SAT (Spatial Alignment Transform) zoom solutions have emerged, which improve the smoothness of zooming in electronic devices.
[0005] In traditional technology, the number of image processing units in electronic devices is the same as the number of image sensors. When a user switches zoom levels, the electronic device switches the zoom levels by controlling the switching of image sensors. However, for electronic devices with a greater number of image sensors than image processing units, using the above-mentioned image sensor control method will result in reduced zoom smoothness. Summary of the Invention
[0006] This application provides an image sensor control method, apparatus, electronic device, and readable storage medium.
[0007] In a first aspect, this application provides an image sensor control method, comprising:
[0008] In response to a zoom operation of the first zoom type, a first target zoom ratio and a second target zoom ratio are obtained, wherein the second target zoom ratio is sent later than the first target zoom ratio.
[0009] Based on the first target zoom ratio and the second target zoom ratio, the target sensor identifier is determined;
[0010] Based on the target sensor identifier and the already activated sensor identifier, determine the sensor identifier to be activated; and
[0011] Turn on the image sensor corresponding to the sensor identifier to be turned on.
[0012] Secondly, this application provides an image sensor control method, including:
[0013] In response to a zoom operation of the second zoom type, a first target zoom ratio and a second target zoom ratio are obtained, wherein the second target zoom ratio is sent later than the first target zoom ratio.
[0014] Based on the second zoom type, the first target zoom ratio, and the second target zoom ratio, determine the zoom ratio to be switched;
[0015] Obtain the target sensor identifier corresponding to the zoom ratio to be switched, and the identifier of the sensor that has been enabled;
[0016] Based on the activated sensor identifier and the target sensor identifier, determine the target number of image processing units required;
[0017] When the number of targets is greater than the total number of image processing units, identify the sensor identifiers to be turned off and the sensor identifiers to be turned on; and
[0018] Turn off the image sensor corresponding to the sensor identifier to be turned off, and turn on the image sensor corresponding to the sensor identifier to be turned on.
[0019] Thirdly, this application also provides an image sensor control device, comprising:
[0020] The response module is used to respond to the zoom operation of the first zoom type, and to obtain the first target zoom ratio and the second target zoom ratio. The second target zoom ratio is sent later than the first target zoom ratio.
[0021] The first determining module is used to determine the target sensor identifier based on the first target zoom ratio and the second target zoom ratio;
[0022] The second determining module is used to determine the sensor identifier to be activated based on the target sensor identifier and the already activated sensor identifier; and
[0023] The control module is used to activate the image sensor corresponding to the sensor identifier to be activated.
[0024] Fourthly, this application also provides an image sensor control device, comprising:
[0025] The response module is used to respond to the zoom operation of the first zoom type, and to obtain the first target zoom ratio and the second target zoom ratio, wherein the second target zoom ratio is sent later than the first target zoom ratio.
[0026] The first determining module is used to determine the zoom ratio to be switched based on the first zoom type, the first target zoom ratio, and the second target zoom ratio;
[0027] The acquisition module is used to acquire the target sensor identifier corresponding to the zoom ratio to be switched, and the sensor identifier that has been turned on;
[0028] The statistics module is used to determine the target number of image processing units required based on the activated sensor identifier and the target sensor identifier.
[0029] The second determining module is used to determine the sensor identifiers to be turned off and the sensor identifiers to be turned on when the number of targets is greater than the total number of image processing units; and
[0030] The control module is used to turn off the image sensor corresponding to the sensor identifier to be turned off, and to turn on the image sensor corresponding to the sensor identifier to be turned on.
[0031] Fifthly, this application also provides an electronic device, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the operation of any of the methods described in the first aspect.
[0032] In a sixth aspect, this application also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the operation of the method described in any of the first aspects.
[0033] In a seventh aspect, this application also provides a computer program product, including a computer program that, when executed by a processor, implements the operation of the method described in any of the first aspects.
[0034] Details of one or more embodiments of this application are set forth in the following drawings and description. Other features and advantages of this application will become apparent from the specification, drawings, and claims. Attached Figure Description
[0035] To more clearly illustrate the technical solutions in the embodiments of this application or related technologies, the drawings used in the description of the embodiments of this application or related technologies will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.
[0036] Figure 1 is a flowchart illustrating an image sensor control method in one embodiment.
[0037] Figure 2 is a schematic diagram of the image sensor activation strategy for a point-cutting scene in one embodiment.
[0038] Figure 3 is a flowchart illustrating the target sensor identification operation in one embodiment.
[0039] Figure 4 is a flowchart illustrating the image sensor control method in another embodiment.
[0040] Figure 5 is a schematic diagram of the process for determining the sliding cutting method in one embodiment.
[0041] Figure 6 is a schematic diagram of the mapping relationship in one embodiment.
[0042] Figure 7 is a flowchart illustrating the image sensor control method in another embodiment.
[0043] Figure 8 is a structural block diagram of an image sensor control device in one embodiment.
[0044] Figure 9 is a structural block diagram of the image sensor control device in another embodiment.
[0045] Figure 10 is an internal structure diagram of an electronic device in one embodiment. Detailed Implementation
[0046] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.
[0047] In some exemplary embodiments, as shown in FIG1, an image sensor control method is provided. This is illustrated using an electronic device as an example. The electronic device can be, but is not limited to, various personal computers, laptops, smartphones, tablets, IoT devices, and portable wearable devices. IoT devices can be smart speakers, smart TVs, smart air conditioners, smart in-vehicle devices, smart cars, etc., and portable wearable devices can be smartwatches and smart bracelets, etc. It is understood that this method can also be applied to a system including electronic devices and servers, and implemented through the interaction between the electronic devices and the server. In this embodiment, the method includes operations 102 to 108, wherein:
[0048] Operation 102, in response to a zoom operation of the first zoom type, obtains a first target zoom ratio and a second target zoom ratio, wherein the second target zoom ratio is sent later than the first target zoom ratio.
[0049] In this context, zoom operation refers to the operation of changing the focal length. The first zoom type refers to the type of the first zoom operation. The first zoom type can be a point-to-point zoom, and the zoom control can include one or more controls. Different zoom controls correspond to different zoom magnifications. Triggering the zoom control achieves the corresponding zoom magnification. The operator can perform point-to-point zoom using the zoom control, which can be a physical control or a virtual control; there are no restrictions here. The first target zoom magnification is the zoom magnification sent to the hardware abstraction layer by the shooting application before sending the second target zoom magnification. The second target zoom magnification is the zoom magnification sent to the hardware abstraction layer by the shooting application after the zoom operation of the first zoom type is triggered. The second target zoom magnification is a fixed zoom magnification, such as one of 0.6X, 1X, 2X, 3X, and 6X. The sending time refers to the time when the shooting application sends the data to the hardware abstraction layer.
[0050] For example, the electronic device responds to a zoom operation of the first zoom type to obtain a second target zoom magnification, and based on the sending time of the second target zoom magnification, obtains the first target zoom magnification corresponding to the previous adjacent sending time.
[0051] In some exemplary embodiments, the number of image sensors in the electronic device is greater than the number of image processing units. The electronic device responds to a zoom operation of a first zoom type to obtain a second target zoom magnification. Based on the release time of the second target zoom magnification, it obtains the first target zoom magnification corresponding to the previous adjacent release time. An image processing unit refers to a unit used to perform initial processing on the image data acquired by the image sensors. It can be understood that each activated image sensor needs to be configured with an image processing unit to perform initial processing on the image data acquired by the image sensor. The image processing unit includes, but is not limited to, a TFE (Top Frame Engine). For example, the electronic device has four image sensors: an ultra-wide-angle (UW) image sensor, a wide-angle (W) image sensor, a telephoto (T) image sensor, and an ultra-telephoto (UT) image sensor. The electronic device also has three image processing units.
[0052] Operation 104: Determine the target sensor identifier based on the first target zoom ratio and the second target zoom ratio.
[0053] Among them, the target sensor identifier refers to the image sensor identifier of the image sensor required to switch to the second target zoom level.
[0054] For example, the electronic device determines the target sensor identifier based on the sensor zoom ratio range in which the first target zoom ratio is located and the sensor zoom ratio range in which the second target zoom ratio is located. Here, the sensor zoom ratio range refers to the zoom ratio range corresponding to the image sensor. For example, the sensor zoom ratio range for an ultra-wide-angle (UW) image sensor is [0.6X, 1X), for a wide-angle (W) image sensor it is [1X, 3X), for a telephoto (T) image sensor it is [3X, 6X), and for an ultra-telephoto (UT) image sensor it is [6X, 10X].
[0055] In some exemplary embodiments, a schematic diagram of the image sensor activation strategy for a point-cutting scene is shown in Figure 2. The row containing the sensor zoom ratio range in the first column with the first target zoom ratio is determined as the target row; the column containing the second target zoom ratio in the first row is determined as the target column; and the image sensor identifiers in the target row and target column are determined as the target sensor identifiers. For example, if the first target zoom ratio is 0.6X and the second target zoom ratio is 3X, then the target sensor identifiers are UW, W, and UT.
[0056] Operation 106: Determine the sensor identifier to be activated based on the target sensor identifier and the already activated sensor identifier.
[0057] The "Activated Sensor" identifier refers to the image sensor identifier of the currently activated image sensor. The "To be Activated Sensor" identifier refers to the image sensor identifier of the image sensor that is about to be activated; it can be understood as the image sensor identifier of the image sensor that needs to be activated in order to switch to the second target zoom magnification.
[0058] For example, the electronic device compares the target sensor identifier with the already enabled sensor identifier, and determines the target sensor identifier that does not have the same identifier as the already enabled sensor identifier as the sensor identifier to be enabled.
[0059] Operation 108: Enable the image sensor corresponding to the sensor identifier to be enabled.
[0060] For example, the hardware abstraction layer in an electronic device controls the activation of the image sensor corresponding to the sensor identifier to be activated.
[0061] In the above image sensor control method, the starting point and ending point of the zoom operation of the first zoom type are fixed, so that the first target zoom ratio and the second target zoom ratio corresponding to the zoom operation of the first zoom type are fixed zoom ratios. The image sensor required to switch the zoom ratio from the first target zoom ratio to the second target zoom ratio is also fixed. Therefore, the target sensor identifier can be determined according to the first target zoom ratio and the second target zoom ratio. Then, the sensor identifier to be activated can be determined according to the target sensor identifier and the activated sensor identifier. By activating the image sensor corresponding to the sensor identifier to be activated, the zoom ratio can be switched, thus avoiding multiple image sensor switching during the zoom ratio switching process, thereby improving the smoothness of zoom.
[0062] In some exemplary embodiments, as shown in FIG3, determining the target sensor identifier based on a first target zoom ratio and a second target zoom ratio includes:
[0063] Operation 302: Determine the first target sensor identifier based on the first zoom range in which the first target zoom ratio is located.
[0064] Here, the first zoom range refers to the sensor zoom range in which the first target zoom range is located. The first target sensor identifier refers to the image sensor identifier corresponding to the first zoom range.
[0065] For example, the electronic device obtains the mapping relationship between the sensor zoom range and the image sensor identifier, determines the sensor zoom range in which the first target zoom range is located as the first zoom range, and determines the image sensor identifier corresponding to the first zoom range as the first target sensor identifier.
[0066] Operation 304: Determine the second target sensor identifier based on the second zoom range in which the second target zoom ratio is located.
[0067] The second zoom range refers to the sensor zoom range in which the second target zoom range is located. The second target sensor identifier refers to the image sensor identifier corresponding to the second zoom range.
[0068] For example, the electronic device determines the sensor zoom range in which the second target zoom range is located as the second zoom range, and determines the image sensor identifier corresponding to the second zoom range as the second target sensor identifier.
[0069] Operation 306: Determine the target sensor identifier based on the first target sensor identifier and the second target sensor identifier.
[0070] For example, when there is no gap between the first zoom range and the second zoom range, the first target sensor identifier and the second target sensor identifier are used to determine the target sensor identifier. For instance, if the first zoom range is [0.6X, 1X) and the second zoom range is [1X, 3X), the first target sensor identifier is an ultra-wide-angle image sensor, the second target sensor identifier is a wide-angle image sensor, and there is no gap between the [0.6X, 1X) and [1X, 3X) sensor zoom ranges, then the ultra-wide-angle image sensor and the wide-angle image sensor are the target sensor identifiers.
[0071] In this embodiment, a first target sensor identifier is determined by the first zoom range in which the first target zoom range is located, and a second target sensor identifier is determined by the second zoom range in which the second target zoom range is located. Then, a target sensor identifier is determined based on the first target sensor identifier and the second target sensor identifier. That is, during the process of switching from the first target zoom range to the second target zoom range, if the image sensor identified by the first target sensor identifier and the image sensor identified by the second target sensor identifier are needed, the target sensor identifier is determined based on the first target sensor identifier and the second target sensor identifier. This avoids multiple switching of image sensors during the zoom range switching process, thereby improving the smoothness of zooming.
[0072] In some exemplary embodiments, determining the target sensor identifier based on the first target sensor identifier and the second target sensor identifier includes:
[0073] When there is at least one sensor zoom range between the first zoom range and the second zoom range, a third target sensor identifier is determined based on at least one sensor zoom range; the first target sensor identifier, the second target sensor identifier, and the third target sensor identifier are determined as the target sensor identifier.
[0074] The phrase "at least one sensor zoom range exists between the first zoom range and the second zoom range" means that there are one or more sensor zoom ranges between the maximum threshold of the first zoom range and the minimum threshold of the second zoom range. For example, if the first zoom range is [0.6X, 1X) and the second zoom range is [3X, 6X), then there is one sensor zoom range of [1X, 3X). Alternatively, if the first zoom range is [0.6X, 1X) and the second zoom range is [6X, 10X), then there are two sensor zoom ranges of [1X, 3X] and [3X, 6X].
[0075] For example, when there is at least one sensor zoom range between the first zoom range and the second zoom range, the electronic device determines a third target sensor identifier based on at least one sensor zoom range, and identifies the first target sensor identifier, the second target sensor identifier, and the third target sensor identifier as target sensor identifiers.
[0076] In this embodiment, the first zoom range and the second zoom range are separated by at least one sensor zoom range, indicating that the zoom range switching is relatively large. Considering the image clarity during the zoom range switching process and the limitation of the number of image processing units, the third target sensor identifier is determined based on at least one sensor zoom range, and the first target sensor identifier, the second target sensor identifier, and the third target sensor identifier are determined as the target sensor identifier.
[0077] In some exemplary embodiments, determining a third target sensor identifier based on at least one sensor zoom range includes:
[0078] If at least one sensor zoom range is spaced between the first zoom range and the second zoom range, and the image sensor corresponding to one of the sensor zoom ranges is a fallback switching sensor, then the image sensor identifier of the fallback switching sensor is determined as the third target sensor identifier.
[0079] The fallback switching sensor refers to the image sensor used in fallback scenes. Fallback is a mechanism that switches lenses based on the shooting scene distance and ambient brightness. The fallback switching sensor can be a pre-configured image sensor for fallback scenes; for example, it could be a wide-angle image sensor or a telephoto image sensor.
[0080] For example, if an electronic device supports a fallback scenario, and the image sensor corresponding to one of the zoom ranges of at least one sensor is a fallback switching sensor, then the image sensor identifier of the fallback switching sensor is determined as the third target sensor identifier. For instance, if the first zoom range is [0.6X, 1X) and the second zoom range is [3X, 6X), and there exists a sensor zoom range [1X, 3X), which corresponds to a wide-angle image sensor, and the wide-angle image sensor is a pre-configured fallback switching sensor, then the image sensor identifier of the fallback switching sensor is determined as the third target sensor identifier.
[0081] In this embodiment, the electronic device supports fallback scenarios, and the image sensor corresponding to one of the zoom magnification ranges of at least one sensor is a fallback switching sensor. Considering that a fallback scenario may be triggered during zooming, the image sensor identifier of the fallback switching sensor is determined as the third target sensor identifier. This can be understood as follows: by pre-activating the fallback switching sensor, when a fallback scenario is triggered, the fallback switching sensor can be used quickly to respond, avoiding stuttering during zooming and improving the smoothness of zooming.
[0082] In some exemplary embodiments, determining a third target sensor based on at least one sensor zoom range includes:
[0083] When there are two sensor zoom ranges between the first zoom range and the second zoom range, the zoom range to be switched is determined based on the first zoom type, the first target zoom range, and the second target zoom range. The two sensor zoom ranges include a third zoom range and a fourth zoom range, and the maximum value of the third zoom range is less than or equal to the minimum value of the fourth zoom range. When the zoom range to be switched is located in the first zoom range, the image sensor identifier of the image sensor corresponding to the third zoom range is determined as the third sensor identifier.
[0084] The zoom ratio to be switched refers to the zoom ratio that is about to be switched to. It can be understood that in the process of switching from the first target zoom ratio to the second target zoom ratio, the zoom ratio needs to be switched multiple times. The zoom ratio to be switched is the zoom ratio that is about to be switched to. The zoom ratio to be switched is greater than the first target zoom ratio and less than or equal to the second target zoom ratio.
[0085] For example, when there is a third zoom range and a fourth zoom range between the first zoom range and the second zoom range, the electronic device determines the zoom range to be switched based on the first zoom type, the first target zoom range, and the second target zoom range. If the zoom range to be switched is located in the first zoom range, the image sensor identifier of the image sensor corresponding to the third zoom range is determined as the third sensor identifier. For example, if the first zoom range and the second zoom range are separated by a third zoom range and a fourth zoom range, then the first zoom range is [0.6X, 1X), the second zoom range is [6X, 10X), the third zoom range is [1X, 3X), and the fourth zoom range is [3X, 6X). If the zoom range to be switched is located in the first zoom range [0.6X, 1X), then the image sensor identifier of the wide-angle image sensor corresponding to the third zoom range [1X, 3X) is determined as the third sensor identifier. This can be understood as the target sensor identifier in the zoom range [0.6X, 1X) being an ultra-wide-angle image sensor, a wide-angle image sensor, and an ultra-telephoto image sensor.
[0086] In this embodiment, the first zoom range and the second zoom range are separated by two sensor zoom ranges, indicating that the zoom range switching is relatively large. Therefore, the zoom range to be switched is determined based on the first zoom type, the first target zoom range, and the second target zoom range. When the zoom range to be switched is located in the first zoom range, the image sensor identifier of the image sensor corresponding to the third zoom range is determined as the third sensor identifier. This can be understood as the target sensor identifiers corresponding to the zoom range to be switched in the first zoom range being the first target sensor identifier, the second target sensor identifier, and the third target sensor identifier.
[0087] In some exemplary embodiments, the method further includes:
[0088] If the zoom ratio to be switched is greater than the maximum threshold of the first zoom ratio range, the image sensor identifier of the image sensor corresponding to the third zoom ratio range is determined as the updated first sensor identifier; the image sensor identifier of the image sensor corresponding to the fourth zoom ratio range is determined as the third sensor identifier.
[0089] The maximum threshold of the first zoom range refers to the maximum value of the first zoom range.
[0090] For example, when the zoom ratio to be switched is greater than the maximum threshold of the first zoom ratio range, the image sensor identifier of the image sensor corresponding to the third zoom ratio range is determined as the updated first sensor identifier, and the image sensor identifier of the image sensor corresponding to the fourth zoom ratio range is determined as the third sensor identifier. For example, if the first zoom range and the second zoom range are separated by a third zoom range and a fourth zoom range, then the first zoom range is [0.6X, 1X), the second zoom range is [6X, 10X), the third zoom range is [1X, 3X), and the fourth zoom range is [3X, 6X). If the zoom range to be switched is greater than the maximum threshold of 1X in the first zoom range [0.6X, 1X), then the image sensor identifier of the wide-angle image sensor corresponding to the third zoom range [1X, 3X) is determined as the updated first sensor identifier, and the image sensor identifier of the telephoto image sensor corresponding to the fourth zoom range [6X, 10X) is determined as the third sensor identifier. This can be understood as the target sensor identifiers in the zoom range [1X, 6X) being the wide-angle image sensor, the telephoto image sensor, and the super telephoto image sensor.
[0091] In this embodiment, during the process of switching from the first target zoom ratio to the second target zoom ratio, although the zoom ratio switching range is relatively large, when the zoom ratio to be switched is within [0.6X, 1X), the target sensor identifier corresponds to the ultra-wide-angle image sensor, wide-angle image sensor, and super telephoto image sensor. When the zoom ratio to be switched is within [1X, 6X), the target sensor identifier corresponds to the wide-angle image sensor, telephoto image sensor, and super telephoto image sensor. During the entire zoom ratio switching process, the switching from the ultra-wide-angle image sensor, wide-angle image sensor, and super telephoto image sensor to the wide-angle image sensor, telephoto image sensor, and super telephoto image sensor involves a scenario spanning four image sensors. During the entire process, it is only necessary to turn off the ultra-wide-angle image sensor, release the image processing unit that performs initial processing on the image data acquired by the ultra-wide-angle image sensor, and then turn on the telephoto image sensor to avoid switching the image sensor multiple times during the zoom ratio switching process, thereby improving the smoothness of zooming.
[0092] In some exemplary embodiments, determining the sensor identifier to be activated based on the target sensor identifier and the already activated sensor identifier includes:
[0093] Obtain the current zoom ratio and compare it with the first target zoom ratio; if the current zoom ratio is equal to the first target zoom ratio, determine the point cutting method as the first point cutting method; if the current zoom ratio is not equal to the first target zoom ratio, determine the point cutting method as the second point cutting method; based on the point cutting method, the target sensor identifier, and the already activated sensor identifier, determine the sensor identifier to be activated.
[0094] The current zoom ratio is typically for the current image frame; that is, it refers to the zoom ratio corresponding to the current image frame. The current image frame refers to the image frame that needs to be previewed, captured, or recorded. Correspondingly, the zoom operation can occur in a camera preview scene, a photo capture scene, or a recording scene. The current zoom ratio refers to the zoom ratio of the current image frame. The point-to-point switching method refers to the way the zoom control is triggered to switch zoom ratios. The point-to-point switching method can be either a first point-to-point switching method or a second point-to-point switching method. The first point-to-point switching method is a non-continuous point-to-point switching method, meaning that the next trigger operation occurs only after the previous zoom operation has been completed. This can be understood as the second target zoom ratio being acquired only after the first target zoom ratio has been reached. The second point-to-point switching method is a continuous point-to-point switching method, meaning that the next trigger operation occurs before the previous zoom operation has been completed. This can be understood as the second target zoom ratio being acquired before the first target zoom ratio has been reached.
[0095] For example, after determining the target sensor identifier, the electronic device obtains the current zoom ratio, compares the current zoom ratio with the first target zoom ratio, and if the current zoom ratio is equal to the first target zoom ratio, then the point cutting method is determined to be the first point cutting method; if the current zoom ratio is not equal to the first target zoom ratio, then the point cutting method is determined to be the second point cutting method; then, based on the point cutting method, the target sensor identifier, and the already activated sensor identifier, the sensor identifier to be activated is determined.
[0096] In this embodiment, after determining the target sensor identifier, the point-cutting method is determined by comparing whether the current zoom ratio is equal to the first target zoom ratio. If the current zoom ratio is equal to the first target zoom ratio, it means that the next triggering operation is responded to after the zoom of the previous triggering operation is completed. If the two triggering operations are discontinuous, the zoom method is discontinuous point-cutting. If the current zoom ratio is not equal to the first target zoom ratio, it means that the next triggering operation is responded to before the zoom of the previous triggering operation is completed. If the two triggering operations are continuous, the zoom method is continuous point-cutting. Then, based on the point-cutting method, the target sensor identifier, and the already activated sensor identifier, the sensor identifier to be activated is determined. That is, different methods are used to determine the sensor identifier to be activated according to different methods, thereby improving the accuracy of determining the sensor identifier to be activated.
[0097] In some exemplary embodiments, determining the sensor identifier to be activated based on the point-cutting method, the target sensor identifier, and the already activated sensor identifier includes:
[0098] When the point cutting method is the first point cutting method, the sensor identifier to be activated is determined based on the target sensor identifier and the already activated sensor identifier.
[0099] For example, if the point-cutting method is the first point-cutting method, the electronic device compares the target sensor identifier with the already activated sensor identifier, and determines the target sensor identifier that is different from the already activated sensor identifier as the sensor identifier to be activated.
[0100] In this embodiment, when the point-cutting method is the first point-cutting method, the target sensor identifier that is different from the already activated sensor identifier is determined as the sensor identifier to be activated, so as to provide accurate basic data for subsequent zoom ratio switching.
[0101] In some exemplary embodiments, determining the sensor identifier to be activated based on the point-cutting method, the target sensor identifier, and the already activated sensor identifier includes:
[0102] When the point cutting method is the second point cutting method, the target number of image processing units required is determined based on the target sensor identifier and the already activated sensor identifier; when the target number is less than or equal to the total number of image processing units, the sensor identifier to be activated is determined based on the target sensor identifier and the already activated sensor identifier.
[0103] The target number refers to the total number of image processing units required to activate the image sensors corresponding to the target sensor identifier, including the sensors already activated, without disabling the activated sensors. For example, if the activated sensors corresponding to the activated sensor identifier are an ultra-wide-angle image sensor, a wide-angle image sensor, and an ultra-telephoto image sensor, and the target sensors corresponding to the target sensor identifier are a wide-angle image sensor, a telephoto image sensor, and an ultra-telephoto image sensor, and the sensor to be activated corresponding to the sensor to be activated is a telephoto image sensor, then activating the telephoto image sensor without disabling the activated sensors, along with the already activated ultra-wide-angle, wide-angle, and ultra-telephoto image sensors, requires a target number of 4 image processing units. The total number refers to the total number of image processing units in the electronic device; for example, the total number of image processing units is 3.
[0104] For example, if the point cutting method is the second point cutting method, the target number of image processing units required is determined based on the target sensor identifier and the activated sensor identifier. The target number is compared with the total number of image processing units. If the target number is less than or equal to the total number, the target sensor identifier and the activated sensor identifier are compared. The target sensor identifier that is different from the activated sensor identifier is determined as the sensor identifier to be activated.
[0105] In this embodiment, when the point cutting method is the second point cutting method, if the number of targets is less than or equal to the total number of image processing units, it means that the electronic device has idle image processing units. It is not necessary to release the used image processing units. It is only necessary to determine the sensor identifier to be turned on based on the target sensor identifier and the already turned-on sensor identifier.
[0106] In some exemplary embodiments, the method further includes:
[0107] If the number of targets is greater than the total number, obtain the updated current zoom ratio; after the updated current zoom ratio is equal to the first target zoom ratio, determine the sensor identifier to be turned on and the sensor identifier to be turned off based on the target sensor identifier and the enabled sensor identifier corresponding to the updated current zoom ratio; turn off the image sensor corresponding to the sensor identifier to be turned off.
[0108] For example, if the number of targets is greater than the total number, the electronic device obtains the updated current zoom ratio based on a preset time interval, compares the updated current zoom ratio with the first target zoom ratio, until the updated current zoom ratio is equal to the first target zoom ratio, determines the target sensor identifier that is different from the enabled sensor identifier corresponding to the updated current zoom ratio as the sensor identifier to be enabled, determines the enabled sensor identifier that is different from the target sensor identifier as the sensor identifier to be disabled, and disables the image sensor corresponding to the sensor identifier to be disabled.
[0109] For example, if the first target zoom level is 3X, and the current zoom level is 2.5X, when the electronic device responds to the point-to-point trigger operation to acquire the second target zoom level of 6X, it needs to wait until the current zoom level is 3X before turning off the image sensor corresponding to the sensor to be turned off and turning on the image sensor corresponding to the sensor to be turned on. Although this process sacrifices some of the responsiveness of the trigger operation, it ensures that the number of dual frames for each zoom level switch is consistent, avoiding image jumps during zooming. If the 6X zoom level switch is performed directly without waiting for the current zoom level to be 3X, the zoom animation that was previously being generated using image data from the wide-angle and telephoto image sensors will be skipped when switching to 6X. The zoom animation fusion will stop abruptly, and the original zoom animation using image data from the wide-angle and telephoto image sensors will become one using only image data from the wide-angle image sensor, resulting in image jumps during zooming.
[0110] In this embodiment, the number of targets is greater than the total number, indicating that the electronic device has no unused image processing units to perform initial processing on the image data collected by the image sensor corresponding to the sensor to be turned on. It is necessary to turn off the sensor corresponding to the sensor to be turned on and release the image processing unit. If the sensor to be turned off is turned off before the current zoom ratio is less than the first target zoom ratio, it will cause image jitter. Therefore, it is necessary to wait until the updated current zoom ratio is equal to the first target zoom ratio, and then determine the sensor to be turned on and the sensor to be turned off based on the target sensor identifier and the sensor to be turned on corresponding to the updated current zoom ratio. The image sensor corresponding to the sensor to be turned off is turned off, the image processing unit matching the sensor to be turned off is released, and then the image sensor corresponding to the sensor to be turned on is turned on to avoid image jitter during zooming and improve the smoothness of zooming.
[0111] In some exemplary embodiments, as shown in FIG4, an image sensor control method includes:
[0112] Operation 402, in response to a zoom operation of the second zoom type, obtains a first target zoom ratio and a second target zoom ratio, wherein the second target zoom ratio is sent later than the first target zoom ratio.
[0113] The second zoom type refers to a second zoom mode, which can be a sliding zoom, performed by the operator using a zoom dial. The first target zoom magnification is the zoom magnification sent to the hardware abstraction layer by the shooting application before the second target zoom magnification is sent. The second target zoom magnification is the zoom magnification sent to the hardware abstraction layer by the shooting application when the zoom operation of the second zoom type is triggered; the second target zoom magnification is a non-fixed zoom magnification.
[0114] For example, in response to a zoom operation of the second zoom type, the electronic device obtains a second target zoom magnification and, based on the sending time of the second target zoom magnification, obtains a first target zoom magnification corresponding to the previous adjacent sending time.
[0115] Operation 404: Determine the zoom ratio to be switched based on the second zoom type, the first target zoom ratio, and the second target zoom ratio.
[0116] The zoom ratio to be switched refers to the zoom ratio that is about to be switched to. It can be understood that in the process of switching from the first target zoom ratio to the second target zoom ratio, the zoom ratio needs to be switched multiple times. The zoom ratio to be switched is the zoom ratio that is about to be switched to. The zoom ratio to be switched is greater than the first target zoom ratio and less than or equal to the second target zoom ratio.
[0117] For example, the electronic device determines the sliding mode based on a first target zoom ratio and a second target zoom ratio, obtains the zoom ratio curve corresponding to the sliding mode, and determines the zoom ratio to be switched based on the zoom ratio curve, the first target zoom ratio, and the second target zoom ratio. Here, the sliding mode refers to the way the zoom ratio changes, and the sliding mode includes, but is not limited to, one of a first sliding mode and a second sliding mode. The first sliding mode can be a fast sliding mode, and the second sliding mode can be a slow sliding mode.
[0118] Operation 406: Obtain the target sensor identifier corresponding to the zoom ratio to be switched, as well as the identifier of the sensor that is enabled.
[0119] For example, the electronic device determines the zoom scene based on the first target zoom ratio and the second target zoom ratio, determines the target sensor identifier corresponding to the zoom ratio to be switched based on the zoom scene and the zoom ratio to be switched, and obtains the identifier of the enabled sensor.
[0120] Operation 408: Based on the enabled sensor identifier and the target sensor identifier, determine the target number of image processing units required.
[0121] For example, the electronic device determines the target number of image processing units required based on the enabled sensor identifier and the target sensor identifier.
[0122] Operation 410: When the number of targets is greater than the total number of image processing units, determine the sensor identifiers to be turned off and the sensor identifiers to be turned on.
[0123] For example, the electronic device compares the number of targets with the total number of image processing units. If the number of targets is greater than the total number, the target sensor identifier that is different from the already enabled sensor identifier is identified as the sensor identifier to be enabled, and the already enabled sensor identifier that is different from the target sensor identifier is identified as the sensor identifier to be disabled.
[0124] In some exemplary embodiments, if the number of targets is less than or equal to the total number, a target sensor identifier that is different from the already enabled sensor identifier is determined as the sensor identifier to be enabled, and the image sensor corresponding to the sensor identifier to be enabled is enabled.
[0125] Operation 412: Turn off the image sensor corresponding to the sensor to be turned off identifier, and turn on the image sensor corresponding to the sensor to be turned on identifier.
[0126] For example, the electronic device turns off the image sensor corresponding to the sensor identifier to be turned off, and turns on the image sensor corresponding to the sensor identifier to be turned on.
[0127] In this embodiment, the zoom ratio to be switched is determined by the second zoom type, the first target zoom ratio, and the second target zoom ratio. The target number of image processing units required is determined based on the activated sensor identifier and the target sensor identifier corresponding to the zoom ratio to be switched. If the target number is greater than the total number of image processing units, it indicates that there are not enough idle image processing units. Therefore, when determining the sensor identifier to be activated, it is necessary to determine the sensor identifier to be deactivated. By deactivating the image sensor corresponding to the sensor identifier to be deactivated, the image processing unit is freed up, laying the foundation for activating the image sensor corresponding to the sensor identifier to be activated. On this basis, the image sensor corresponding to the sensor identifier to be activated is activated, realizing the switching of zoom ratio.
[0128] In some exemplary embodiments, determining the zoom ratio to be switched based on the second zoom type, the first target zoom ratio, and the second target zoom ratio includes:
[0129] Determine the difference between the first target zoom ratio and the second target zoom ratio; determine the sliding mode based on the relationship between the difference value and the difference threshold; obtain the zoom ratio curve corresponding to the sliding mode; and determine the zoom ratio to be switched based on the zoom ratio curve, the first target zoom ratio, and the second target zoom ratio.
[0130] Here, the difference value refers to the absolute value of the difference between the zoom ratio of the first target and the zoom ratio of the second target. The difference threshold is a threshold used to determine the sliding cutting mode by comparing it with the difference value.
[0131] For example, the electronic device subtracts the second target zoom ratio from the first target zoom ratio to obtain the difference, calculates the absolute value of the difference to obtain the difference value between the first target zoom ratio and the second target zoom ratio; determines the sliding mode based on the relationship between the difference value and the difference threshold, obtains the zoom ratio curve corresponding to the sliding mode, and determines the zoom ratio to be switched based on the zoom ratio curve, the first target zoom ratio and the second target zoom ratio.
[0132] In this embodiment, the sliding mode is determined by the relationship between the difference value and the difference threshold, and the zoom ratio curve corresponding to the sliding mode is obtained. That is, different sliding modes correspond to different zoom ratio curves. Based on the zoom ratio curve, the first target zoom ratio and the second target zoom ratio, the zoom ratio to be switched is determined to improve the accuracy of the zoom ratio to be switched.
[0133] In some exemplary embodiments, determining the sliding mode and obtaining the zoom ratio curve corresponding to the sliding mode based on the magnitude relationship between the difference value and the difference threshold includes:
[0134] The difference value is compared with the difference threshold; if the difference value is greater than the difference threshold, the sliding method is determined to be the first sliding method; if the difference value is less than or equal to the difference threshold, the sliding method is determined to be the second sliding method; if the sliding method is the first sliding method, the obtained zoom ratio curve is the first zoom ratio curve; if the sliding method is the second sliding method, the obtained zoom ratio curve is the second zoom ratio curve.
[0135] The first sliding cut refers to a sliding cut where the zoom magnification changes rapidly; this can be a fast sliding cut. The second sliding cut refers to a sliding cut where the zoom magnification changes slowly; this can be a slow sliding cut. The first zoom magnification curve refers to the zoom magnification curve corresponding to the first sliding cut, and the second zoom magnification curve refers to the zoom magnification curve corresponding to the second sliding cut.
[0136] For example, the electronic device compares the difference value with the difference threshold. If the difference value is greater than the difference threshold, the sliding mode is determined to be the first sliding mode, and the first zoom ratio curve corresponding to the first sliding mode is obtained. If the difference value is less than or equal to the difference threshold, the sliding mode is determined to be the second sliding mode, and the second zoom ratio curve corresponding to the second sliding mode is obtained.
[0137] In an exemplary embodiment, a schematic diagram of the sliding mode determination process is shown in Figure 5, including: determining the sliding mode as a first sliding mode or a second sliding mode based on a first target zoom ratio and a second target zoom ratio; determining the first sliding mode as a first cross-four-camera sliding mode or a first non-cross-four-camera sliding mode based on the enabled sensor identifier corresponding to the current zoom ratio and the target sensor identifier determined based on the first target zoom ratio and the second target zoom ratio, or determining the second sliding mode as a second cross-four-camera sliding mode or a second non-cross-four-camera sliding mode.
[0138] In this embodiment, the sliding method is determined by the relationship between the difference value and the difference threshold. Different sliding methods result in different zoom ratio curves, that is, the obtained zoom ratio curve matches the sliding method.
[0139] In some exemplary embodiments, obtaining the target sensor identifier corresponding to the zoom ratio to be switched includes:
[0140] Based on the relationship between the first target zoom ratio and the second target zoom ratio, the zoom scene is determined; based on the zoom scene and the zoom ratio to be switched, the target sensor identifier corresponding to the zoom ratio to be switched is determined.
[0141] The zoom scene represents the trend of zoom magnification change. Zoom scenes include, but are not limited to, one of the following: zoom in / zoom out / zoom down / zoom up. The zoom in / zoom up / zoom down scene refers to the scenario where the zoom dial is activated, and the operator has not performed a slide cut; the second target zoom magnification is equal to the first target zoom magnification. The zoom up / zoom down scene refers to the scenario where the zoom magnification increases, and the second target zoom magnification is greater than the first target zoom magnification. The zoom down / zoom down scene refers to the scenario where the zoom magnification decreases, and the second target zoom magnification is less than the first target zoom magnification.
[0142] For example, the electronic device compares a first target zoom ratio and a second target zoom ratio. If the first target zoom ratio equals the second target zoom ratio, the zoom scene is determined to be a zoom-up / zoom-out scene; if the first target zoom ratio is less than the second target zoom ratio, the zoom scene is determined to be a zoom-in scene; if the first target zoom ratio is greater than the second target zoom ratio, the zoom scene is determined to be a zoom-out scene. The target mapping relationship corresponding to the zoom scene is obtained. This target mapping relationship includes the correspondence between multiple zoom ratio ranges and image sensor identifiers. The image sensor identifier corresponding to the zoom ratio range to be switched is determined, and the target sensor identifier corresponding to the zoom ratio to be switched is identified. Here, the target mapping relationship refers to the mapping relationship corresponding to the zoom scene, which includes the correspondence between multiple zoom ratio ranges and image sensor identifiers.
[0143] For example, Figure 6 illustrates the mapping relationships, including the mapping relationships corresponding to the zoom-up and zoom-out scenes. In the zoom-up and zoom-out scene, the zoom range [0.6X, 1.5X) corresponds to the ultra-wide-angle image sensor and the wide-angle image sensor; the zoom range [1.5X, 4.8X) corresponds to the ultra-wide-angle image sensor, the wide-angle image sensor, and the telephoto image sensor; and the zoom range [4.8X, 10X) corresponds to the wide-angle image sensor, the telephoto image sensor, and the super telephoto image sensor. In the zoom-in scene, the zoom range [0.6X, 1.5X) corresponds to the ultra-wide-angle image sensor... The zoom range [1.5X, 4.8X) corresponds to the wide-angle image sensor and the telephoto image sensor, while the zoom range [4.8X, 10X) corresponds to the telephoto image sensor and the super telephoto image sensor. In the zoomed-out scene, the zoom range [0.6X, 1.5X) corresponds to the ultra-wide-angle image sensor and the wide-angle image sensor, the zoom range [1.5X, 4.8X) corresponds to the ultra-wide-angle image sensor, the wide-angle image sensor and the telephoto image sensor, and the zoom range [4.8X, 10X) corresponds to the wide-angle image sensor, the telephoto image sensor and the super telephoto image sensor.
[0144] In this embodiment, the zoom scene is determined by the relationship between the first target zoom ratio and the second target zoom ratio. The target sensor identifier is determined by the zoom scene and the zoom ratio to be switched, so as to improve the accuracy of the target sensor identifier.
[0145] In some exemplary embodiments, before the methods for turning off the image sensor corresponding to the sensor identifier to be turned off and turning on the image sensor corresponding to the sensor identifier to be turned on, the method further includes:
[0146] In response to a zoom operation of the second zoom type, the first image sensor, the second image sensor, and the third image sensor are turned on; if it is determined that the zoom ratio to be switched is within the zoom ratio range corresponding to the fourth image sensor, the image sensor identifier of the fourth image sensor is determined as the sensor identifier to be turned on; based on the target sensor identifier corresponding to the zoom ratio to be switched, the sensor identifier to be turned off is determined from the image sensor identifiers of the first image sensor, the second image sensor, and the third image sensor.
[0147] Among them, the first image sensor, the second image sensor, the third image sensor, and the fourth image sensor are four different image sensors in the electronic device.
[0148] For example, in response to a zoom operation of the second zoom type, the electronic device turns on the first image sensor, the second image sensor and the third image sensor, compares the zoom ratio to be switched with the zoom ratio range corresponding to the fourth image sensor, and if the zoom ratio to be switched is in the zoom ratio range corresponding to the fourth image sensor, then the image sensor identifier of the fourth image sensor is determined as the sensor identifier to be turned on.
[0149] Obtain the target sensor identifier corresponding to the zoom ratio to be switched, and identify the image sensor identifier that is different from the target sensor identifier among the image sensor identifiers of the first image sensor, the second image sensor, and the third image sensor as the sensor identifier to be turned off.
[0150] In an exemplary embodiment, the first image sensor is an ultra-wide-angle image sensor, the second image sensor is a wide-angle image sensor, the third image sensor is an ultra-telephoto image sensor, and the fourth image sensor is a telephoto image sensor. In response to a zoom operation of the second zoom type, the electronic device acquires a first target zoom ratio and a second target zoom ratio, and activates the first, second, and third image sensors. Based on the first and second target zoom ratios, it determines whether the zoom process passes through the zoom ratio range corresponding to the fourth image sensor. If it does not pass through the zoom ratio range corresponding to the fourth image sensor, the first, second, and third image sensors remain activated. If it passes through the zoom ratio range corresponding to the fourth image sensor, and it is determined that the zoom ratio to be switched is within the zoom ratio range corresponding to the fourth image sensor, the image sensor identifier of the fourth image sensor is identified as the sensor identifier to be activated. Based on the target sensor identifier corresponding to the zoom ratio to be switched, the sensor identifier to be deactivated is determined from the image sensor identifiers of the first, second, and third image sensors.
[0151] In this embodiment, after responding to the sliding cut trigger operation, the three image sensors are directly turned on. When the zoom ratio to be switched is not in the zoom ratio range corresponding to the fourth image sensor, the above three image sensors are kept on. When the zoom ratio to be switched is in the zoom ratio range corresponding to the fourth image sensor, the fourth image sensor is determined as the image sensor to be turned on. The image sensor to be turned off is determined from the first, second and third image sensors, and then the image sensor is switched. This avoids turning the image sensors on and off multiple times, thereby improving the smoothness of zoom.
[0152] In some exemplary embodiments, before determining the target number of image processing units required based on the enabled sensor identifier and the target sensor identifier, the method further includes:
[0153] If the current zoom ratio is not equal to the second target zoom ratio, obtain the third target zoom ratio; if both the first and third target zoom ratios are less than the second target zoom ratio, or both are greater than the second target zoom ratio; based on the current zoom ratio and the third target zoom ratio, determine the updated zoom ratio to be switched; determine the target sensor identifier corresponding to the updated zoom ratio to be switched, and the activated sensor identifier corresponding to the current zoom ratio.
[0154] The third zoom ratio refers to the zoom ratio issued after the second target zoom ratio.
[0155] For example, when the current zoom ratio is not equal to the second target zoom ratio, the electronic device obtains the third target zoom ratio. If both the first target zoom ratio and the third target zoom ratio are less than the second target zoom ratio, or both are greater than the second target zoom ratio, then based on the current zoom ratio and the third target zoom ratio, an updated zoom ratio to be switched is determined, the target sensor identifier corresponding to the updated zoom ratio to be switched is determined, and the activated sensor identifier corresponding to the current zoom ratio is determined.
[0156] In this embodiment, during the process of switching the zoom magnification to the second target zoom magnification, the electronic device responds again to the trigger operation of the second zoom type to obtain the third target zoom magnification. If both the first target zoom magnification and the third target zoom magnification are less than the second target zoom magnification, or both are greater than the second target zoom magnification, it indicates that the two trigger operations are in opposite directions. The zoom to the second target zoom magnification is stopped before the zoom magnification changes to the second target zoom magnification, thus avoiding the switching of the image sensor caused by changing the zoom magnification to the second target zoom magnification, and the switching of the image sensor again caused by zooming from the second target zoom magnification to the third target zoom magnification. That is, the two switching of the image sensor are avoided, thereby improving the smoothness of zooming.
[0157] In some exemplary embodiments, when the number of targets is greater than the total number of image processing units, determining sensor identifiers to be turned off and sensor identifiers to be turned on includes:
[0158] If a fallback sensor exists among the active sensors corresponding to the active sensor identifier, the shooting parameters are obtained; based on the shooting parameters, if it is determined that the fallback sensor does not need to be used, the image sensor identifier of the fallback sensor is identified as the sensor identifier to be turned off; the target sensor identifier that is different from the active sensor identifier is identified as the sensor identifier to be turned on.
[0159] Among them, shooting parameters refer to the parameters used to determine whether the back-switch sensor needs to be used. Shooting parameters may include, but are not limited to, at least one of the following: shooting scene distance and shooting environment brightness.
[0160] For example, if a fallback sensor exists among the enabled sensors corresponding to the enabled sensor identifier, the electronic device acquires the shooting parameters and determines whether the fallback sensor needs to be used based on the shooting parameters. If the fallback sensor does not need to be used, the image sensor identifier of the fallback sensor is identified as the sensor identifier to be turned off, and the target sensor identifier, which is different from the enabled sensor identifier, is identified as the sensor identifier to be turned on.
[0161] In this embodiment, when it is necessary to determine the sensor identifier to be turned off and the sensor identifier to be turned on, if there is a fallback switching sensor among the turned-on sensors corresponding to the turned-on sensor identifier, and it is determined from the shooting parameters that the fallback switching sensor does not need to be used, then the image sensor identifier of the fallback switching sensor can be determined as the sensor identifier to be turned off, thereby improving the efficiency of determining the sensor identifier to be turned off.
[0162] In an exemplary embodiment, a control optimization scheme for the image sensors of a 4-camera platform is proposed, mainly targeting the switching control of different image sensors during the SAT (Synchronous Aspect Ratio) switching process of the 4-camera platform. Because some platforms have limitations in ISP (Image Signal Processor) hardware resources (e.g., only 3 image processing units exist, allowing only 3 image sensors to be activated simultaneously), insufficient image processing unit resources are triggered when zoom ratio switching involves 4 image sensors. Therefore, an image sensor control method as shown in Figure 7 is proposed, including:
[0163] During image preview or video recording, the electronic device responds to the trigger operation of zoom ratio change, obtains the second target zoom ratio, and based on the time of the second target zoom ratio, obtains the first target zoom ratio corresponding to the previous adjacent time of the second time of the second time of the second time of the second time of the second time of the second time of the second time of the second time of the second time of the third ... third time of
[0164] First, it is determined whether the triggered operation is a point cut or a slide cut. If the triggered operation is determined to be a slide cut, the electronic device subtracts the second target zoom ratio from the first target zoom ratio to obtain the difference. The absolute value of the difference is calculated to obtain the difference value between the first target zoom ratio and the second target zoom ratio. The difference value is compared with the difference threshold. If the difference value is greater than the difference threshold, the slide cut method is determined to be a fast slide cut, and the first zoom ratio curve corresponding to the fast slide cut is obtained. If the difference value is less than or equal to the difference threshold, the slide cut method is determined to be a slow slide cut, and the second zoom ratio curve corresponding to the slow slide cut is obtained. Based on the zoom ratio curve, the first target zoom ratio, and the second target zoom ratio, the zoom ratio to be switched is determined.
[0165] The electronic device compares a first target zoom ratio and a second target zoom ratio. If the first target zoom ratio equals the second target zoom ratio, the zoom scene is determined to be a zoom-out scene; if the first target zoom ratio is less than the second target zoom ratio, the zoom scene is determined to be a zoom-in scene; if the first target zoom ratio is greater than the second target zoom ratio, the zoom scene is determined to be a zoom-out scene. The target mapping relationship corresponding to the zoom scene is obtained. This target mapping relationship includes the correspondence between multiple zoom ratio ranges and image sensor identifiers. The image sensor identifier corresponding to the zoom ratio range where the zoom ratio to be switched is located is used to determine the target sensor identifier corresponding to the zoom ratio to be switched.
[0166] The electronic device acquires the identifiers of enabled sensors. Based on these identifiers and the target sensor identifier, it determines the target number of image processing units required. It compares the target number with the total number of image processing units. If the target number is greater than the total number, it identifies target sensor identifiers that are different from the enabled sensor identifiers and identifies enabled sensor identifiers that are different from the target sensor identifiers and identifies sensor identifiers that are different from the target sensor identifiers and identify ....
[0167] If the triggered operation is determined to be a point cut, the electronic device acquires the mapping relationship between the sensor zoom range and the image sensor identifier. It determines the sensor zoom range containing the first target zoom range as the first zoom range and the image sensor identifier corresponding to the first zoom range as the first target sensor identifier; it then determines the sensor zoom range containing the second target zoom range as the second zoom range and the image sensor identifier corresponding to the second zoom range as the second target sensor identifier. If there is no intervening sensor zoom range between the first and second zoom ranges, the first and second target sensor identifiers are used to determine the target sensor identifier.
[0168] Alternatively, if at least one sensor zoom range is spaced between the first zoom range and the second zoom range, and the image sensor corresponding to one of the sensor zoom ranges is a fallback switching sensor, then the image sensor identifier of the fallback switching sensor is determined as the third target sensor identifier. The first target sensor identifier, the second target sensor identifier, and the third target sensor identifier are then used to determine the target sensor identifier.
[0169] The electronic device compares the current zoom level with the first target zoom level. If the current zoom level is equal to the first target zoom level, the point cutting method is determined to be non-continuous point cutting; if the current zoom level is not equal to the first target zoom level, the point cutting method is determined to be continuous point cutting.
[0170] If the point cutting method is non-continuous point cutting, the electronic device compares the target sensor identifier with the already activated sensor identifier, determines the target sensor identifier that is different from the already activated sensor identifier, and activates the image sensor corresponding to the sensor identifier to be activated.
[0171] If the point cutting method is continuous point cutting, the target number of image processing units required is determined based on the target sensor identifier and the already activated sensor identifier. The target number is compared with the total number of image processing units. If the target number is less than or equal to the total number, the target sensor identifier and the already activated sensor identifier are compared. The target sensor identifier that is different from the already activated sensor identifier is determined as the sensor identifier to be activated, and the image sensor corresponding to the sensor identifier to be activated is activated.
[0172] If the number of targets is greater than the total number, the electronic device obtains the updated current zoom ratio based on a preset time interval, compares the updated current zoom ratio with the first target zoom ratio, until the updated current zoom ratio equals the first target zoom ratio, identifies the target sensor identifier that is different from the active sensor identifier corresponding to the updated current zoom ratio as the sensor identifier to be activated, identifies the active sensor identifier that is different from the target sensor identifier as the sensor identifier to be deactivated, deactivates the image sensor corresponding to the sensor identifier to be deactivated, and activates the image sensor corresponding to the sensor identifier to be activated.
[0173] Start zooming, and once zooming is complete, resume image preview or video recording.
[0174] In the above solution, for electronic devices with only 3 image processing units but 4 image sensors, resource constraints arise during SAT scene switching. This solution optimizes the image sensor control strategy for 4-camera scenarios. It not only provides more reasonable image sensor activation for ordinary slow-motion scene cutting (avoiding excessive image sensor activation leading to high power consumption and optimizing overall scene power consumption), but also implements reasonable strategy control for zoom scenarios such as sliding cuts and continuous scene cutting. This allows the zoom experience to maintain responsiveness while meeting the algorithm alignment requirements (frame count for dual-frame operation) and the need for fast fallback switching, even with the limited resources of a 4-camera platform. Overall, this solution's overall strategy better optimizes the responsiveness and consistency of scene cutting across 4-camera scenarios, ensuring that the zoom experience on a 4-camera platform is consistent with that on a 3-camera platform.
[0175] It should be understood that although the operations in the flowcharts of the embodiments described above are shown sequentially according to the arrows, these operations are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these operations, and they can be executed in other orders. Moreover, at least some of the operations in the flowcharts of the embodiments described above may include multiple operations or multiple stages. These operations or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these operations or stages is not necessarily sequential, but can be performed alternately or in turn with other operations or at least some of the operations or stages in other operations.
[0176] Based on the same inventive concept, this application also provides an image sensor control device for implementing the image sensor control method described above. The solution provided by this device is similar to the implementation described in the above method; therefore, the specific limitations in one or more image sensor control device embodiments provided below can be found in the limitations of the image sensor control method described above, and will not be repeated here.
[0177] In some exemplary embodiments, as shown in FIG8, an image sensor control device is provided, including: a response module 802, a first determination module 804, a second determination module 806, and a control module 808, wherein:
[0178] The response module 802 is used to respond to the zoom operation of the first zoom type, and to obtain the first target zoom ratio and the second target zoom ratio, wherein the second target zoom ratio is sent later than the first target zoom ratio.
[0179] The first determining module 804 is used to determine the target sensor identifier based on the first target zoom ratio and the second target zoom ratio;
[0180] The second determining module 806 is used to determine the sensor identifier to be activated based on the target sensor identifier and the activated sensor identifier;
[0181] The control module 808 is used to activate the image sensor corresponding to the sensor identifier to be activated.
[0182] In some exemplary embodiments, the first determining module 804 is further configured to: determine a first target sensor identifier based on the first zoom range in which the first target zoom range is located; determine a second target sensor identifier based on the second zoom range in which the second target zoom range is located; and determine a target sensor identifier based on the first target sensor identifier and the second target sensor identifier.
[0183] In some exemplary embodiments, the first determining module 804 is further configured to: determine a third target sensor identifier based on at least one sensor zoom range when there is at least one sensor zoom range between the first zoom range and the second zoom range; and determine the first target sensor identifier, the second target sensor identifier, and the third target sensor identifier as target sensor identifiers.
[0184] In some exemplary embodiments, the first determining module 804 is further configured to: determine the image sensor identifier of the back-switch sensor as the third target sensor identifier when at least one sensor zoom range is spaced between the first zoom range and the second zoom range, and the image sensor corresponding to one of the sensor zoom ranges is a back-switch sensor.
[0185] In some exemplary embodiments, the first determining module 804 is further configured to: determine the zoom ratio to be switched based on the first zoom type, the first target zoom ratio, and the second target zoom ratio when there are two sensor zoom ratio ranges between the first zoom ratio range and the second zoom ratio range; the two sensor zoom ratio ranges include a third zoom ratio range and a fourth zoom ratio range, and the maximum value of the third zoom ratio range is less than or equal to the minimum value of the fourth zoom ratio range; when the zoom ratio to be switched is located in the first zoom ratio range, determine the image sensor identifier of the image sensor corresponding to the third zoom ratio range as the third sensor identifier.
[0186] In some exemplary embodiments, the first determining module 804 is further configured to: determine the image sensor identifier of the image sensor corresponding to the third zoom range as the updated first sensor identifier when the zoom range to be switched is greater than the maximum threshold of the first zoom range; and determine the image sensor identifier of the image sensor corresponding to the fourth zoom range as the third sensor identifier.
[0187] In some exemplary embodiments, the second determining module 806 is further configured to: obtain the current zoom ratio, compare the current zoom ratio with the first target zoom ratio; if the current zoom ratio is equal to the first target zoom ratio, determine the point cutting method as the first point cutting method; if the current zoom ratio is not equal to the first target zoom ratio, determine the point cutting method as the second point cutting method; and determine the sensor identifier to be activated based on the point cutting method, the target sensor identifier, and the activated sensor identifier.
[0188] In some exemplary embodiments, the second determining module 806 is further configured to: determine the sensor identifier to be turned on based on the target sensor identifier and the already turned-on sensor identifier when the point cutting method is the first point cutting method.
[0189] In some exemplary embodiments, the second determining module 806 is further configured to: determine the target number of image processing units required based on the target sensor identifier and the activated sensor identifier when the point cutting method is the second point cutting method; and determine the sensor identifier to be activated based on the target sensor identifier and the activated sensor identifier when the target number is less than or equal to the total number of image processing units.
[0190] In some exemplary embodiments, the second determining module 806 is further configured to: when the number of targets is greater than the total number, obtain the updated current zoom ratio; after the updated current zoom ratio is equal to the first target zoom ratio, determine the sensor identifier to be turned on and the sensor identifier to be turned off based on the target sensor identifier and the enabled sensor identifier corresponding to the updated current zoom ratio; and turn off the image sensor corresponding to the sensor identifier to be turned off.
[0191] In some exemplary embodiments, as shown in FIG9, an image sensor control device is provided, including: a response module 902, a first determination module 904, an acquisition module 906, a statistics module 908, a second determination module 910, and a control module 912, wherein:
[0192] The response module 902 is used to respond to the zoom operation of the first zoom type, and to obtain the first target zoom ratio and the second target zoom ratio, wherein the second target zoom ratio is sent later than the first target zoom ratio.
[0193] The first determining module 904 is used to determine the zoom ratio to be switched based on the first zoom type, the first target zoom ratio, and the second target zoom ratio.
[0194] The acquisition module 906 is used to acquire the target sensor identifier corresponding to the zoom ratio to be switched, as well as the sensor identifier that has been turned on;
[0195] The statistics module 908 is used to determine the number of target image processing units required based on the enabled sensor identifier and the target sensor identifier.
[0196] The second determining module 910 is used to determine the sensor identifier to be turned off and the sensor identifier to be turned on when the number of targets is greater than the total number of image processing units.
[0197] The control module 912 is used to turn off the image sensor corresponding to the sensor identifier to be turned off, and to turn on the image sensor corresponding to the sensor identifier to be turned on.
[0198] In some exemplary embodiments, the first determining module 904 is further configured to: determine the difference value between the first target zoom ratio and the second target zoom ratio; determine the sliding mode based on the magnitude relationship between the difference value and the difference threshold; obtain the zoom ratio curve corresponding to the sliding mode; and determine the zoom ratio to be switched based on the zoom ratio curve, the first target zoom ratio, and the second target zoom ratio.
[0199] In some exemplary embodiments, the first determining module 904 is further configured to: compare the difference value with a difference threshold; if the difference value is greater than the difference threshold, determine the sliding method as a first sliding method; if the difference value is less than or equal to the difference threshold, determine the sliding method as a second sliding method; if the sliding method is the first sliding method, the obtained zoom ratio curve is the first zoom ratio curve; if the sliding method is the second sliding method, the obtained zoom ratio curve is the second zoom ratio curve.
[0200] In some exemplary embodiments, the acquisition module 906 is further configured to: determine the zoom scene based on the relationship between the first target zoom ratio and the second target zoom ratio; and determine the target sensor identifier corresponding to the zoom ratio to be switched based on the zoom scene and the zoom ratio to be switched.
[0201] In some exemplary embodiments, the response module 902 is further configured to: activate the first image sensor, the second image sensor, and the third image sensor in response to a zoom operation of the second zoom type; determine the image sensor identifier of the fourth image sensor as the sensor identifier to be activated if it is determined that the zoom ratio to be switched is within the zoom ratio range corresponding to the fourth image sensor; and determine the sensor identifier to be deactivated from the image sensor identifiers of the first image sensor, the second image sensor, and the third image sensor based on the target sensor identifier corresponding to the zoom ratio to be switched.
[0202] In some exemplary embodiments, the response module 902 is further configured to: obtain a third target zoom ratio when the current zoom ratio is not equal to the second target zoom ratio; both the first target zoom ratio and the third target zoom ratio are less than the second target zoom ratio, or both are greater than the second target zoom ratio; determine an updated zoom ratio to be switched based on the current zoom ratio and the third target zoom ratio; and determine the target sensor identifier corresponding to the updated zoom ratio to be switched, and the activated sensor identifier corresponding to the current zoom ratio.
[0203] In some exemplary embodiments, the second determining module 910 is further configured to: acquire shooting parameters when there is a fallback switching sensor among the enabled sensors corresponding to the enabled sensor identifier; based on the shooting parameters, determine the image sensor identifier of the fallback switching sensor as the sensor identifier to be turned off when it is determined that the fallback switching sensor is not needed; and determine the target sensor identifier that is different from the enabled sensor identifier as the sensor identifier to be turned on.
[0204] Each module in the aforementioned image sensor control device can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in the processor of the electronic device in hardware form or independent of it, or stored in the memory of the electronic device in software form, so that the processor can call and execute the operations corresponding to each module.
[0205] In an exemplary embodiment, an electronic device is provided, which may be a terminal, and its internal structure diagram is shown in Figure 10. The electronic device includes a processor, a memory, an input / output interface, a communication interface, a display unit, and an input device. The processor, memory, and input / output interface are connected via a system bus, and the communication interface, display unit, and input device are also connected to the system bus via the input / output interface. The processor of the electronic device provides computing and control capabilities. The memory of the electronic device includes a non-volatile storage medium and internal memory. The non-volatile storage medium stores an operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium. The input / output interface of the electronic device is used for exchanging information between the processor and external devices. The communication interface of the electronic device is used for wired or wireless communication with external terminals; wireless communication can be achieved through Wi-Fi, mobile cellular networks, Near Field Communication (NFC), or other technologies. When the computer program is executed by the processor, it implements an image sensor control method. The display unit of the electronic device is used to form a visually visible image and may be a display screen, a projection device, or a virtual reality imaging device. The display screen can be an LCD screen or an e-ink screen. The input device of the electronic device can be a touch layer covering the display screen, or buttons, trackballs, or touchpads set on the casing of the electronic device, or external keyboards, touchpads, or mice, etc.
[0206] Those skilled in the art will understand that the structure shown in Figure 10 is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the electronic device to which the present application is applied. The specific electronic device may include more or fewer components than shown in the figure, or combine certain components, or have different component arrangements.
[0207] In one embodiment, an electronic device is provided, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to perform the operations described in the above method embodiments.
[0208] In one embodiment, a computer-readable storage medium is provided having a computer program stored thereon that, when executed by a processor, performs the operations described in the above method embodiments.
[0209] In one embodiment, a computer program product is provided, including a computer program that, when executed by a processor, implements the operations described in the above method embodiments.
[0210] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of the relevant data must comply with relevant regulations.
[0211] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this application may include at least one type of relational database and non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this application may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, artificial intelligence (AI) processors, etc., and are not limited to these.
[0212] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.
[0213] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of this patent application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this application should be determined by the appended claims.
Claims
1. An image sensor control method, characterized in that, include: In response to a zoom operation of the first zoom type, a first target zoom ratio and a second target zoom ratio are obtained, wherein the second target zoom ratio is sent later than the first target zoom ratio. Based on the first target zoom ratio and the second target zoom ratio, the target sensor identifier is determined; Based on the target sensor identifier and the already activated sensor identifier, determine the sensor identifier to be activated; and Turn on the image sensor corresponding to the sensor identifier to be turned on.
2. The method according to claim 1, characterized in that, The step of determining the target sensor identifier based on the first target zoom ratio and the second target zoom ratio includes: Based on the first zoom range in which the first target zoom ratio is located, the first target sensor identifier is determined; Based on the second zoom range in which the second target zoom ratio is located, the second target sensor identifier is determined; and The target sensor identifier is determined based on the first target sensor identifier and the second target sensor identifier.
3. The method according to claim 2, characterized in that, The step of determining the target sensor identifier based on the first target sensor identifier and the second target sensor identifier includes: When at least one sensor zoom range is spaced between the first zoom range and the second zoom range, a third target sensor identifier is determined based on at least one of the sensor zoom ranges; and The first target sensor identifier, the second target sensor identifier, and the third target sensor identifier are determined as target sensor identifiers.
4. The method according to claim 3, characterized in that, The step of determining the third target sensor identifier based on at least one of the sensor zoom ranges includes: If at least one sensor zoom range is spaced between the first zoom range and the second zoom range, and the image sensor corresponding to one of the sensor zoom ranges is a fallback switching sensor, then the image sensor identifier of the fallback switching sensor is determined as the third target sensor identifier.
5. The method according to claim 3, characterized in that, The determination of the third target sensor based on at least one zoom range of the sensor includes: When there are two sensor zoom ranges between the first zoom range and the second zoom range, the zoom range to be switched is determined based on the first zoom type, the first target zoom range, and the second target zoom range; the two sensor zoom ranges include a third zoom range and a fourth zoom range, and the maximum value of the third zoom range is less than or equal to the minimum value of the fourth zoom range; and When the zoom ratio to be switched is within the first zoom ratio range, the image sensor identifier of the image sensor corresponding to the third zoom ratio range is determined as the third sensor identifier.
6. The method according to claim 5, characterized in that, The method further includes: If the zoom ratio to be switched is greater than the maximum threshold of the first zoom ratio range, the image sensor identifier of the image sensor corresponding to the third zoom ratio range is determined as the updated first sensor identifier; and The image sensor identifier of the image sensor corresponding to the fourth zoom range is determined as the third sensor identifier.
7. The method according to claim 1, characterized in that, The step of determining the sensor identifier to be activated based on the target sensor identifier and the already activated sensor identifier includes: Obtain the current zoom ratio and compare the current zoom ratio with the first target zoom ratio; When the current zoom ratio is equal to the first target zoom ratio, the point cutting method is determined to be the first point cutting method; When the current zoom ratio is not equal to the first target zoom ratio, the point-cutting method is determined to be the second point-cutting method; and Based on the point cutting method, the target sensor identifier, and the already activated sensor identifier, the sensor identifier to be activated is determined.
8. The method according to claim 7, characterized in that, The step of determining the sensor identifier to be activated based on the point cutting method, the target sensor identifier, and the already activated sensor identifier includes: When the point cutting method is the first point cutting method, the sensor identifier to be activated is determined based on the target sensor identifier and the already activated sensor identifier.
9. The method according to claim 7, characterized in that, The step of determining the sensor identifier to be activated based on the point cutting method, the target sensor identifier, and the already activated sensor identifier includes: When the point-cutting method is the second point-cutting method, the required number of target image processing units is determined based on the target sensor identifier and the activated sensor identifier; and If the number of targets is less than or equal to the total number of image processing units, the sensor identifier to be activated is determined based on the target sensor identifier and the already activated sensor identifier.
10. The method according to claim 9, characterized in that, The method further includes: If the number of targets is greater than the total number, obtain the updated current zoom ratio; After the updated current zoom ratio equals the first target zoom ratio, based on the target sensor identifier and the enabled sensor identifier corresponding to the updated current zoom ratio, determine the sensor identifier to be enabled and the sensor identifier to be disabled; and Turn off the image sensor corresponding to the sensor identifier to be turned off.
11. An image sensor control method, characterized in that, include: In response to a zoom operation of the second zoom type, a first target zoom ratio and a second target zoom ratio are obtained, wherein the second target zoom ratio is sent later than the first target zoom ratio. Based on the second zoom type, the first target zoom ratio, and the second target zoom ratio, determine the zoom ratio to be switched; Obtain the target sensor identifier corresponding to the zoom ratio to be switched, and the identifier of the sensor that has been enabled; Based on the activated sensor identifier and the target sensor identifier, determine the target number of image processing units required; If the number of targets is greater than the total number of image processing units, determine the sensor identifiers to be turned off and the sensor identifiers to be turned on; and Turn off the image sensor corresponding to the sensor identifier to be turned off, and turn on the image sensor corresponding to the sensor identifier to be turned on.
12. The method according to claim 11, characterized in that, The step of determining the zoom ratio to be switched based on the second zoom type, the first target zoom ratio, and the second target zoom ratio includes: Determine the difference between the first target zoom ratio and the second target zoom ratio; Based on the relationship between the difference value and the difference threshold, the sliding cutting method is determined; and Obtain the zoom ratio curve corresponding to the sliding mode, and determine the zoom ratio to be switched based on the zoom ratio curve, the first target zoom ratio, and the second target zoom ratio.
13. The method according to claim 12, characterized in that, The step of determining the sliding cutting method based on the magnitude relationship between the difference value and the difference threshold includes: The difference value is compared with the difference threshold; If the difference value is greater than the difference threshold, the sliding cutting method is determined to be the first sliding cutting method; and If the difference value is less than or equal to the difference threshold, the sliding cutting method is determined to be the second sliding cutting method; The step of obtaining the zoom ratio curve corresponding to the sliding cutting method includes: When the sliding cutting method is the first sliding cutting method, the obtained zoom ratio curve is the first zoom ratio curve; and When the sliding cutting method is the second sliding cutting method, the obtained zoom ratio curve is the second zoom ratio curve.
14. The method according to claim 11, characterized in that, The step of obtaining the target sensor identifier corresponding to the zoom ratio to be switched includes: Based on the relationship between the first target zoom ratio and the second target zoom ratio, the zoom scene is determined; and Based on the zoom scene and the zoom ratio to be switched, the target sensor identifier corresponding to the zoom ratio to be switched is determined.
15. The method according to claim 11, characterized in that, Before the methods for closing the image sensor corresponding to the sensor identifier to be closed and opening the image sensor corresponding to the sensor identifier to be opened, the method further includes: In response to zoom operation of the second zoom type, the first image sensor, the second image sensor, and the third image sensor are activated; If it is determined that the zoom ratio to be switched is within the zoom ratio range corresponding to the fourth image sensor, the image sensor identifier of the fourth image sensor is identified as the sensor identifier to be activated; and Based on the target sensor identifier corresponding to the zoom ratio to be switched, the sensor identifier to be turned off is determined from the image sensor identifiers of the first image sensor, the second image sensor, and the third image sensor.
16. The method according to claim 11, characterized in that, Before determining the target number of image processing units required based on the activated sensor identifier and the target sensor identifier, the method further includes: If the current zoom ratio is not equal to the second target zoom ratio, obtain a third target zoom ratio; both the first target zoom ratio and the third target zoom ratio are less than the second target zoom ratio, or both are greater than the second target zoom ratio. Based on the current zoom ratio and the third target zoom ratio, determine the updated zoom ratio to be switched; and Determine the target sensor identifier corresponding to the updated zoom ratio to be switched, and the activated sensor identifier corresponding to the current zoom ratio.
17. The method according to claim 11, characterized in that, When the number of targets is greater than the total number of image processing units, determining the sensor identifiers to be turned off and the sensor identifiers to be turned on includes: If a sensor has been switched back among the active sensors corresponding to the active sensor identifier, the shooting parameters are obtained. Based on the shooting parameters, if it is determined that the reverting sensor switch is not needed, the image sensor identifier for the reverting sensor switch is set as the sensor identifier to be turned off; and The target sensor identifier that is different from the activated sensor identifier is identified as the sensor identifier to be activated.
18. An image sensor control device, characterized in that, The device includes: The response module is used to respond to the zoom operation of the first zoom type, and to obtain the first target zoom ratio and the second target zoom ratio, wherein the second target zoom ratio is sent later than the first target zoom ratio. The first determining module is used to determine the target sensor identifier based on the first target zoom ratio and the second target zoom ratio; The second determining module is used to determine the sensor identifier to be activated based on the target sensor identifier and the activated sensor identifier; and The control module is used to activate the image sensor corresponding to the sensor identifier to be activated.
19. An image sensor control device, characterized in that, The device includes: The response module is used to respond to the zoom operation of the first zoom type, and to obtain the first target zoom ratio and the second target zoom ratio, wherein the second target zoom ratio is sent later than the first target zoom ratio. The first determining module is used to determine the zoom ratio to be switched based on the first zoom type, the first target zoom ratio, and the second target zoom ratio; The acquisition module is used to acquire the target sensor identifier corresponding to the zoom ratio to be switched, and the sensor identifier that has been turned on; The statistics module is used to determine the target number of image processing units required based on the activated sensor identifier and the target sensor identifier. The second determining module is used to determine the sensor identifiers to be turned off and the sensor identifiers to be turned on when the number of targets is greater than the total number of image processing units; and The control module is used to turn off the image sensor corresponding to the sensor identifier to be turned off, and to turn on the image sensor corresponding to the sensor identifier to be turned on.
20. An electronic device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it performs the operation of the method according to any one of claims 1 to 17.
21. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it performs the operation of the method according to any one of claims 1 to 17.
22. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it performs the operation of the method according to any one of claims 1 to 17.