ISP determination method, electronic device and storage medium

Abstract

In a technical solution of an ISP determination method, an electronic device, and a storage medium provided in an embodiment of the present invention, a zoom instruction input by a user is received by a driving device, and the zoom instruction includes a target zoom ratio and a zoom mode; the driving device determines a target CSI and a target ISP according to the target zoom ratio; the driving device determines connection configuration parameters according to the original zoom ratio, the target zoom ratio, and the zoom mode, and sends the connection configuration parameters to the original CSI and the target CSI. The original CSI executes a processing method with the original ISP according to the connection configuration parameters, and the target CSI executes a processing method with the target ISP according to the connection configuration parameters. The embodiment of the present invention only uses two ISPs, the first ISP and the second ISP, and the two ISPs can realize image processing of image data output by more than three cameras, thereby reducing the chip area, the power consumption of the ISP, and the required bandwidth.

Description

[Technical field]

[0001] The present invention relates to the field of computer technology, and in particular to an ISP determination method, electronic equipment and storage medium. [Background technology]

[0002] In order to meet people's higher requirements for shooting effects, the camera software in smartphones is constantly upgraded and updated, and multi-cameras have become an indispensable configuration for most smartphones. In camera software, multi-camera scenarios generally refer to dual-camera, triple-camera, quad-camera or penta-camera, but there are also cases of six or more cameras. But at the same time, the more cameras a smartphone is equipped with, the more data the image signal processor (Image Signal Prosessor, ISP for short) intellectual property (Intellectual Property Right, IP for short) in the mobile phone chip needs to process. For example, if a smartphone is equipped with three cameras, the ISP IP needs to have the ability to process three cameras, the chip area is larger, and the power consumption of the ISP IP is also higher.

[0003] In multi-camera scenarios, full-focus zoom scenarios have the highest requirements for the switching performance between multiple cameras in the camera software. Smartphones with three or more cameras have full-focus zoom functions. When switching between multiple cameras, users should not feel any obvious freezes in the picture. The brightness, color, and clarity of the picture should also change smoothly. The camera software needs to smoothly complete the switching between multiple cameras.

[0004] Taking the three-camera scenario as an example, in order to support the full-focus zoom function of the three cameras, smartphones are generally designed with three ISP pipelines, each of which processes the image data collected by one camera. To run the camera software at a certain moment, all three ISP pipelines need to be in working state, resulting in high ISP power consumption and required bandwidth. When the resolution of the image data collected by the three cameras of the smartphone is large, the ISP power consumption and required bandwidth are even greater. [Summary of the invention]

[0005] In view of this, an embodiment of the present invention provides an ISP hardware architecture that supports multiple cameras, so as to solve the problems in the prior art that the ISP chip area is large, and the ISP power consumption and required bandwidth are large.

[0006] In a first aspect, an embodiment of the present invention provides a method for determining an ISP, the method comprising:

[0007] The driving device receives a zoom instruction input by a user, wherein the zoom instruction includes a target zoom ratio and a zoom mode;

[0008] The driving device determines a target camera serial interface CSI and a target ISP according to the target zoom ratio;

[0009] The driving device determines a connection configuration parameter according to the original zoom ratio, the target zoom ratio and the zoom mode, and sends the connection configuration parameter to the original CSI and the target CSI;

[0010] The original CSI performs a processing method with the original ISP according to the connection configuration parameters and the target CSI performs a processing method with the target ISP according to the connection configuration parameters, the original ISP is the first ISP and / or the second ISP, and the target ISP is the first ISP and / or the second ISP.

[0011] In a possible implementation manner, the zoom mode is smooth zoom, the original CSI includes a first CSI, the target CSI includes a first CSI and a second CSI, the original ISP includes a first ISP, and the target ISP includes a first ISP and a second ISP;

[0012] The original CSI performs a processing method with the original ISP according to the connection configuration parameter and the target CSI performs a processing method with the target ISP according to the connection configuration parameter, including:

[0013] The first CSI maintains a connection with the first ISP according to the connection configuration parameter;

[0014] The second CSI establishes a connection with the second ISP according to the connection configuration parameters.

[0015] In a possible implementation manner, the zoom mode is smooth zoom, the original CSI includes the first CSI, the target CSI includes the second CSI and the third CSI, the original ISP includes the first ISP, and the target ISP includes the first ISP and the second ISP;

[0016] The original CSI performs a processing method with the original ISP according to the connection configuration parameter and the target CSI performs a processing method with the target ISP according to the connection configuration parameter, including:

[0017] After the first CSI processes the current frame image data through the first ISP, disconnecting the first CSI from the first ISP according to the connection configuration parameters;

[0018] The second CSI establishes a connection with the first ISP according to the connection configuration parameters after the first CSI disconnects from the first ISP;

[0019] The third CSI establishes a connection with the second ISP according to the connection configuration parameters.

[0020] In a possible implementation manner, the zoom mode is smooth zoom, the original CSI includes a first CSI and a second CSI, the target CSI includes a second CSI, the original ISP includes a first ISP and a second ISP, and the target ISP includes a second ISP;

[0021] The original CSI performs a processing method with the original ISP according to the connection configuration parameter and the target CSI performs a processing method with the target ISP according to the connection configuration parameter, including:

[0022] After the first CSI processes the current frame image data through the first ISP, disconnecting the first CSI from the first ISP according to the connection configuration parameters;

[0023] The second CSI maintains the connection with the second ISP according to the connection configuration parameters.

[0024] In a possible implementation manner, the zoom mode is smooth zoom, the original CSI includes a first CSI and a second CSI, the target CSI includes a second CSI and a third CSI, the original ISP includes a first ISP and a second ISP, and the target ISP includes a first ISP and a second ISP;

[0025] The original CSI performs a processing method with the original ISP according to the connection configuration parameter and the target CSI performs a processing method with the target ISP according to the connection configuration parameter, including:

[0026] After the first CSI processes the current frame image data through the first ISP, disconnecting the first CSI from the first ISP according to the connection configuration parameters;

[0027] The second CSI maintains a connection with the second ISP according to the connection configuration parameter;

[0028] The third CSI establishes a connection with the first ISP according to the connection configuration parameters after the first CSI disconnects from the first ISP.

[0029] In a possible implementation manner, the zoom mode is smooth zoom, the original CSI includes a first CSI and a second CSI, the target CSI is a third CSI, the original ISP includes a first ISP and a second ISP, and the target ISP includes the first ISP or the second ISP;

[0030] The original CSI performs a processing method with the original ISP according to the connection configuration parameter and the target CSI performs a processing method with the target ISP according to the connection configuration parameter, including:

[0031] After the first CSI processes the current frame image data through the first ISP, disconnecting the first CSI from the first ISP according to the connection configuration parameters;

[0032] After the second ISP processes the current frame image data, the second CSI disconnects the second ISP according to the connection configuration parameters;

[0033] The third CSI establishes a connection with the first ISP according to the connection configuration parameters after the first CSI disconnects the connection with the first ISP; or, the third CSI establishes a connection with the second ISP according to the connection configuration parameters after the second CSI disconnects the connection with the second ISP.

[0034] In a possible implementation manner, the zoom mode is smooth zoom, the original CSI includes the first CSI, the target CSI includes the second CSI, the original ISP is the first ISP, and the target ISP is the second ISP;

[0035] The original CSI performs a processing method with the original ISP according to the connection configuration parameter and the target CSI performs a processing method with the target ISP according to the connection configuration parameter, including:

[0036] After the first CSI processes the current frame image data through the first ISP, disconnecting the first CSI from the first ISP according to the connection configuration parameters;

[0037] The second CSI establishes a connection with the second ISP according to the connection configuration parameters.

[0038] In a possible implementation manner, the zoom mode is jump zoom, the original CSI includes the first CSI, the target CSI includes the second CSI, the original ISP includes the first ISP, and the target ISP includes the second ISP;

[0039] The original CSI performs a processing method with the original ISP according to the connection configuration parameter and the target CSI performs a processing method with the target ISP according to the connection configuration parameter, including:

[0040] The first CSI disconnects the connection with the first ISP according to the connection configuration parameter;

[0041] The second CSI establishes a connection with the second ISP according to the connection configuration parameters.

[0042] In a second aspect, an embodiment of the present invention provides an electronic device, which includes:

[0043] A driving device, configured to receive a zoom instruction input by a user, where the zoom instruction includes a target zoom ratio and a zoom mode; determine a target CSI and a target ISP according to the target zoom ratio; determine connection configuration parameters according to the original zoom ratio, the target zoom ratio, and the zoom mode, and send the connection configuration parameters to the original CSI and the target CSI;

[0044] The original CSI is configured to execute a processing method with the original ISP according to the connection configuration parameters, where the original ISP is the first ISP and / or the second ISP;

[0045] The target CSI is configured to execute a processing method with the target ISP according to the connection configuration parameters, where the target ISP is the first ISP and / or the second ISP.

[0046] In a third aspect, an embodiment of the present invention provides an electronic device, including one or more processors; a memory; and one or more computer programs, where the one or more computer programs are stored in the memory, and the one or more computer programs include instructions that, when executed by the electronic device, cause the electronic device to execute the steps of the method for determining an ISP as described in the first aspect.

[0047] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, where the computer-readable storage medium includes a stored program, and when the program runs, it controls the device where the computer-readable storage medium is located to execute the steps of the method for determining an ISP as described in the first aspect.

[0048] In the technical solution of a method for determining an ISP, an electronic device, and a storage medium provided by an embodiment of the present invention, a driving device receives a zoom instruction input by a user, where the zoom instruction includes a target zoom ratio and a zoom mode; the driving device determines a target CSI and a target ISP according to the target zoom ratio; the driving device determines connection configuration parameters according to the original zoom ratio, the target zoom ratio, and the zoom mode, and sends the connection configuration parameters to the original CSI and the target CSI. The original CSI executes a processing method with the original ISP according to the connection configuration parameters, and the target CSI executes a processing method with the target ISP according to the connection configuration parameters. The embodiment of the present invention only uses two ISPs, namely the first ISP and the second ISP, and can perform image data processing on the output of three or more cameras through the two ISPs, thereby reducing the chip area, reducing the power consumption and required bandwidth of the ISP.

Brief Description of the Drawings

[0049] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0050] Figure 1 A schematic diagram of the structure of an electronic device provided by an embodiment of the present invention.

[0051] Figure 2 A flowchart of an ISP determination method provided by an embodiment of the present invention.

[0052] Figure 3 A signaling flow chart of an ISP determination method provided by an embodiment of the present invention.

[0053] Figure 4 A signaling flow chart of another ISP determination method provided by an embodiment of the present invention.

[0054] Figure 5 A signaling flow chart of another ISP determination method provided by an embodiment of the present invention.

[0055] Figure 6 A signaling flow chart of another ISP determination method provided by an embodiment of the present invention.

[0056] Figure 7 A signaling flow chart of another ISP determination method provided by an embodiment of the present invention.

[0057] Figure 8 A signaling flow chart of another ISP determination method provided by an embodiment of the present invention.

[0058] Fig. 9 A signaling flow chart of another ISP determination method provided by an embodiment of the present invention.

[0059] Fig.10 A schematic diagram of the structure of an electronic device provided by an embodiment of the present invention. [Specific implementation method]

[0060] In order to better understand the technical solution of the present invention, the embodiments of the present invention are described in detail below with reference to the accompanying drawings.

[0061] It should be clear that the described embodiments are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0062] The terms used in the embodiments of the present invention are only for the purpose of describing specific embodiments, and are not intended to limit the present invention. The singular forms "a", "said" and "the" used in the embodiments of the present invention and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings.

[0063] It should be understood that the term "and / or" used in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.

[0064] Figure 1 A schematic diagram of the structure of an electronic device provided by an embodiment of the present invention is shown in FIG. Figure 1 As shown, the electronic device includes a driving device 11, a target camera serial interface (CMOS Serial Interface, CSI for short), a target ISP, an original CSI and an original ISP.

[0065] In the embodiment of the present invention, the electronic device may include an ISP, and the ISP includes a first ISP 12 and a second ISP 13. The original ISP may include the first ISP 12 and / or the second ISP 13, and the target ISP may include the first ISP 12 and / or the second ISP 13.

[0066] The driving device 11 is used to receive a zoom instruction input by a user, the zoom instruction including a target zoom ratio and a zoom mode; determine a target CSI and a target ISP according to the target zoom ratio; determine a connection configuration parameter according to the original zoom ratio, the target zoom ratio and the zoom mode, and send the connection configuration parameter to the original CSI and the target CSI. The original CSI executes a processing method with the original ISP according to the connection configuration parameter, and the target CSI executes a processing method with the target ISP according to the connection configuration parameter.

[0067] In the embodiment of the present invention, the electronic device may include multiple CSIs, and the driving device 11 is connected to the multiple CSIs. Figure 1 As shown, for example, taking an electronic device with a triple-camera function as an example, the electronic device includes a first CSI 14 , a second CSI 15 and a third CSI 16 , and the driving device 11 is connected to the first CSI 14 , the second CSI 15 and the third CSI 16 .

[0068] As an optional solution, in the zoom command input by the user received by the driving device 11, the zoom mode is smooth zoom, the original CSI includes the first CSI 14, the target CSI includes the first CSI 14 and the second CSI 15, the original ISP includes the first ISP 12, and the target ISP includes the first ISP 12 and the second ISP 13. The first CSI 14 is used to maintain the connection with the first ISP 12 according to the connection configuration parameters. The second CSI 15 is used to establish a connection with the second ISP 13 according to the connection configuration parameters.

[0069] As another optional solution, in the zoom command input by the user received by the driving device 11, the zoom mode is smooth zoom, the original CSI includes the first CSI 14, the target CSI includes the second CSI 15 and the third CSI 16, the original ISP includes the first ISP 12, and the target ISP includes the first ISP 12 and the second ISP 13. The first CSI 14 is used to disconnect the connection with the first ISP 12 according to the connection configuration parameters after the current frame image data is processed by the first ISP 12. The second CSI 15 is used to establish a connection with the first ISP 12 according to the connection configuration parameters after the first CSI 14 disconnects the connection with the first ISP 12. The third CSI 16 is used to establish a connection with the second ISP 13 according to the connection configuration parameters.

[0070] As another optional solution, in the zoom command input by the user received by the driving device 11, the zoom mode is smooth zoom, the original CSI includes the first CSI 14 and the second CSI 15, the target CSI includes the second CSI 15, the original ISP includes the first ISP 12 and the second ISP 13, and the target ISP includes the second ISP 13. The first CSI 14 is used to disconnect the connection with the first ISP 12 according to the connection configuration parameters after the current frame image data is processed by the first ISP 12. The second CSI 15 is used to maintain the connection with the second ISP 13 according to the connection configuration parameters.

[0071] As another optional solution, in the zoom command input by the user received by the driving device 11, the zoom mode is smooth zoom, the original CSI includes the first CSI 14 and the second CSI 15, the target CSI includes the second CSI 15 and the third CSI 16, the original ISP includes the first ISP 12 and the second ISP 13, and the target ISP includes the first ISP 12 and the second ISP 13. The first CSI 14 is used to disconnect the connection with the first ISP 12 according to the connection configuration parameters after the current frame image data is processed by the first ISP 12. The second CSI 15 is used to maintain the connection with the second ISP 13 according to the connection configuration parameters. The third CSI 16 is used to establish a connection with the first ISP 12 according to the connection configuration parameters after the first CSI 14 disconnects the connection with the first ISP 12.

[0072] As another optional solution, in the zoom instruction input by the user received by the driving device 11, the zoom mode is smooth zoom, the original CSI includes the first CSI 14 and the second CSI 15, the target CSI is the third CSI 16, the original ISP includes the first ISP 12 and the second ISP 13, and the target ISP includes the first ISP 12 or the second ISP 13. The first CSI 14 is used to disconnect the connection with the first ISP 12 according to the connection configuration parameters after the current frame image data is processed by the first ISP 12. The second CSI 15 is used to disconnect the connection with the second ISP 13 according to the connection configuration parameters after the current frame image data is processed by the second ISP 13. The third CSI 16 is used to establish a connection with the first ISP 12 according to the connection configuration parameters after the first CSI 14 disconnects the connection with the first ISP 12; or, the third CSI 16 is used to establish a connection with the second ISP 13 according to the connection configuration parameters after the second CSI 15 disconnects the connection with the second ISP 13.

[0073] As another optional solution, in the zoom command input by the user received by the driving device 11, the zoom mode is smooth zoom, the original CSI includes the first CSI 14, the target CSI includes the second CSI 15, the original ISP is the first ISP 12, and the target ISP is the second ISP 13. The first CSI 14 is used to disconnect the connection with the first ISP 12 according to the connection configuration parameters after the current frame image data is processed by the first ISP 12. The second CSI 15 is used to establish a connection with the second ISP 13 according to the connection configuration parameters.

[0074] As another optional solution, in the zoom command input by the user received by the driving device 11, the zoom mode is jump zoom, the original CSI includes the first CSI 14, the target CSI includes the second CSI 15, the original ISP includes the first ISP 12, and the target ISP includes the second ISP 13. The first CSI 14 is used to disconnect the connection with the first ISP 12 according to the connection configuration parameters. The second CSI 15 is used to establish a connection with the second ISP 13 according to the connection configuration parameters.

[0075] In an embodiment of the present invention, the electronic device includes a plurality of cameras, each camera includes a sensor. The electronic device includes a plurality of sensors and a plurality of physical layer (PHY) interfaces, each sensor corresponds to a PHY interface, each sensor corresponds to a CSI, and each sensor is connected to a corresponding CSI via a corresponding PHY interface. Figure 1 As shown, for example, taking an electronic device with a triple-camera function as an example, the electronic device with a triple-camera function includes three cameras, the three cameras include an ultra-wide angle (UW) camera, a wide angle (W) camera, and a telephoto (T) camera, each camera may include a sensor, then the electronic device may include three sensors, the three sensors include an ultra-wide angle sensor 17, a wide angle sensor 18, and a telephoto sensor 19. The multiple PHY interfaces include a first PHY interface 20, a second PHY interface 21, and a third PHY interface 22. Among them, the ultra-wide angle camera includes an ultra-wide angle sensor 17, and the ultra-wide angle sensor 17 is connected to the first CSI 14 through the first PHY interface 20; the wide angle camera includes a wide angle sensor 18, and the wide angle sensor 18 is connected to the second CSI 15 through the second PHY interface 21; the telephoto camera includes a telephoto sensor 19, and the telephoto sensor 19 is connected to the third CSI 16 through the third PHY interface 22.

[0076] In the embodiment of the present invention, the sensor is used to output image data to the ISP through the PHY interface and the CSI. Figure 1 As shown, for example, the image data is ultra-wide-angle image data, and the ultra-wide-angle sensor 17 is used to output the ultra-wide-angle image data to the first ISP 12 through the first PHY interface 20 and the first CSI 14; or, the image data is wide-angle image data, and the wide-angle sensor 18 is used to output the wide-angle image data to the second ISP 13 through the second PHY interface 21 and the second CSI 15; or, the image data is telephoto image data, and the telephoto sensor 19 is used to output the telephoto image data to the first ISP 12 through the third PHY interface 22 and the third CSI 16.

[0077] In the embodiment of the present invention, the electronic device further includes a double data rate synchronous dynamic random access memory (Double Data Rate, DDR for short) 23 .

[0078] As an optional solution, DDR 23 is connected to the first ISP 12 and the second ISP 13. The first ISP 12 is used to perform image processing on the image data to generate first output data, and output the first output data to DDR 23; the second ISP 13 is used to perform image processing on the image data to generate second output data, and output the second output data to DDR 23.

[0079] As another optional solution, the electronic device further includes a fusion module 24, the first ISP 12 and the second ISP 13 are connected to the fusion module 24, and the fusion module 24 is connected to the DDR 23. The fusion module 24 is used to fuse the first output data output by the first ISP 12 and the second output data output by the second ISP 13, generate fused data, and output the fused data to the DDR 23.

[0080] In the technical solution of the electronic device provided by the embodiment of the present invention, a zoom instruction input by a user is received by a driving device, and the zoom instruction includes a target zoom ratio and a zoom mode; the driving device determines a target CSI and a target ISP according to the target zoom ratio; the driving device determines connection configuration parameters according to the original zoom ratio, the target zoom ratio and the zoom mode, and sends the connection configuration parameters to the original CSI and the target CSI. The original CSI executes the processing method with the original ISP according to the connection configuration parameters, and the target CSI executes the processing method with the target ISP according to the connection configuration parameters. The embodiment of the present invention only uses two ISPs, the first ISP and the second ISP, and the two ISPs can realize image processing of image data output by more than three cameras, thereby reducing the chip area, reducing the power consumption of the ISP and the required bandwidth.

[0081] Figure 2 A flowchart of an ISP determination method provided by an embodiment of the present invention is as follows: Figure 2 As shown, the method includes:

[0082] Step 101: A driving device receives a zoom instruction input by a user, where the zoom instruction includes a target zoom ratio and a zoom mode.

[0083] Each step in the embodiment of the present invention may be performed by an electronic device, and the electronic device includes but is not limited to a mobile phone, a tablet computer, a personal computer, etc. In the embodiment of the present invention, the electronic device may include more than three cameras, for example, the electronic device may include an ultra-wide-angle camera, a wide-angle camera, and a telephoto camera. Among them, the ultra-wide-angle camera includes an ultra-wide-angle sensor, and the ultra-wide-angle sensor has 13 million pixels (MegaPixel, abbreviated as MP or M) and an optical zoom capability of 0.6x zoom to 1.0x zoom; the wide-angle camera includes a wide-angle sensor, and the wide-angle sensor has 64M 4in1 pixels, that is, 16M pixels and an optical zoom capability of 1.0x zoom to 3.0x zoom; the telephoto camera includes a telephoto sensor, and the telephoto sensor has 13M pixels and an optical zoom capability of 3.0x zoom to 30.0x zoom. If the zoom instruction input by the user includes smooth zoom, in order to achieve a smooth transition of the image displayed on the shooting interface of the electronic device when switching between the three sensors, the zoom ratio corresponding to the optical zoom capability is divided into multiple optical zoom capability intervals. For example, the zoom ratio corresponding to the optical zoom capability of the three sensors is divided into five optical zoom capability intervals, and the five optical zoom capability intervals are [0.6x, 0.9x), [0.9x, 1.1x], (1.1x, 2.9x), [2.9x, 3.1x] and (3.1x, 30x]. If the zoom instruction input by the user includes jump zoom, the zoom ratio corresponding to the optical zoom capability is divided into multiple optical zoom capability intervals. For example, the zoom ratio corresponding to the optical zoom capability of the three sensors is divided into three optical zoom capability intervals, and the three optical zoom capability intervals are [0.6x, 1.0x), [1.0x, 3.0x) and [3.0x, 30x].

[0084] In the embodiment of the present invention, different optical zoom capability intervals correspond to different sensors. For smooth zoom, the optical zoom capability interval corresponding to when two sensors work at the same time is a transition interval, and the optical zoom capability interval corresponding to when one sensor works is a non-transition interval. For jump zoom, only one sensor works at the same time, that is, one sensor corresponds to one optical zoom capability interval.

[0085] As an optional solution, a zoom slider is provided on the shooting interface displayed by the electronic device, and the user can slide the zoom slider or click the zoom slider to input a zoom instruction.

[0086] As another optional solution, an optical focus corresponding to a boundary value of an optical zoom capability interval is set on a shooting interface displayed by the electronic device, and the user can click on the optical focus to input a zoom instruction.

[0087] When the user slides the zoom slider to a certain position on the zoom slider, the zoom ratio corresponding to the position is the target zoom ratio, and the user inputs the target zoom ratio; when the user slides the zoom slider, the input zoom mode is smooth zoom. Among them, smooth zoom includes sequential smooth zoom or reverse smooth zoom. For example, the zoom mode input by the user is a smooth zoom from 0.6x to 1.0x. At this time, the original zoom ratio is 0.6x, the target zoom ratio is 1.0x, and the zoom mode is sequential smooth zoom. For example, the zoom mode input by the user is a smooth zoom from 3.0x to 1.0x. At this time, the original zoom ratio is 3.0x, the target zoom ratio is 1.0x, and the zoom mode is reverse smooth zoom.

[0088] When the user clicks a certain position point on the zoom slider, the zoom ratio corresponding to the position point is the target zoom ratio, and the user inputs the target zoom ratio; when the user clicks the zoom slider, the input zoom mode is jump zoom. For example, the original zoom ratio is 0.6x, the user clicks 3.0x on the zoom slider, and the user inputs a jump zoom from 0.6x to 3.0x. At this time, the original zoom ratio is 0.6x, the target zoom ratio is 3.0x, and the zoom mode is jump zoom. Alternatively, the user clicks on the optical focus corresponding to the boundary value of the optical zoom capability interval, and the zoom ratio corresponding to the optical focus is the target zoom ratio, and the user inputs the target zoom ratio; when the user clicks on the optical focus, the input zoom mode is jump zoom. For example, three optical focuses are set on the shooting interface displayed by the electronic device, and the three optical focuses correspond to three target zoom ratios, and the three target zoom ratios include 0.6x, 1.0x and 3.0x. The original zoom ratio is 0.6x, and the user clicks the optical focus corresponding to 1.0x. The zoom mode input by the user is a jump zoom from 0.6x to 1.0x. At this time, the original zoom ratio is 0.6x, the target zoom ratio is 3.0x, and the zoom mode is a jump zoom.

[0089] Step 102: The driving device determines a target CSI and a target ISP according to a target zoom ratio.

[0090] In this step, the driving device determines the optical zoom capability interval corresponding to the target zoom ratio according to the target zoom ratio, and determines the CSI corresponding to the optical zoom capability interval as the target CSI and determines the ISP corresponding to the optical zoom capability interval as the target ISP.

[0091] Step 103: The driving device determines connection configuration parameters according to the original zoom ratio, the target zoom ratio and the zoom mode, and sends the connection configuration parameters to the original CSI and the target CSI.

[0092] In the embodiment of the present invention, the connection configuration parameter is used to indicate the processing mode between the original CSI and the original ISP, and to indicate the processing mode between the target CSI and the target ISP. The processing mode between the original CSI and the original ISP includes maintaining the connection or disconnecting the connection, and the processing mode between the target CSI and the target ISP includes establishing the connection or maintaining the connection.

[0093] Step 104: The original CSI performs a processing method with the original ISP according to the connection configuration parameters, and the target CSI performs a processing method with the target ISP according to the connection configuration parameters, the original ISP is the first ISP and / or the second ISP, and the target ISP is the first ISP and / or the second ISP.

[0094] In this step, since the ISP processes the image data at the frame level, the ISP needs to process the image data between the Start of Frame (SOF) and the End of Frame (EOF) of the current frame (i.e., process the current frame image data) before it can continue to process the next frame image data. After the original CSI processes the current frame image data through the original ISP, the next frame connection configuration parameters take effect. At this time, the original CSI executes the processing method with the original ISP according to the connection configuration parameters and the target CSI executes the processing method with the target ISP according to the connection configuration parameters.

[0095] In a technical solution of a method for determining an ISP provided in an embodiment of the present invention, a zoom instruction input by a user is received by a driving device, and the zoom instruction includes a target zoom ratio and a zoom mode; the driving device determines a target CSI and a target ISP according to the target zoom ratio; the driving device determines connection configuration parameters according to the original zoom ratio, the target zoom ratio and the zoom mode, and sends the connection configuration parameters to the original CSI and the target CSI. The original CSI executes a processing method with the original ISP according to the connection configuration parameters, and the target CSI executes a processing method with the target ISP according to the connection configuration parameters. The embodiment of the present invention only uses two ISPs, the first ISP and the second ISP, and the two ISPs can realize image processing of image data output by more than three cameras, thereby reducing the chip area, reducing the power consumption of the ISP and the required bandwidth.

[0096] Figure 3 A signaling flow chart of an ISP determination method provided by an embodiment of the present invention, such as Figure 3 As shown, the method includes:

[0097] Step 201: The driving device receives a zoom instruction input by a user, where the zoom instruction includes a target zoom ratio and a zoom mode.

[0098] In this embodiment, the user slides the zoom slider on the shooting interface displayed by the electronic device to input the target zoom ratio and zoom mode to the driving device of the electronic device. The zoom mode is smooth zoom, and the smooth zoom is sequential smooth zoom. For example, if the zoom mode input by the user is a sequential smooth zoom from 0.6x to 1.0x, the original zoom ratio is 0.6x, the target zoom ratio is 1.0x, the optical zoom capability interval corresponding to the original zoom ratio is [0.6x, 0.9x), and the optical zoom capability interval corresponding to the target zoom ratio 1.0x is [0.9x, 1.1x].

[0099] In this embodiment, the original CSI includes the first CSI, the optical zoom capability interval corresponding to the original zoom ratio corresponds to a sensor corresponding to the first CSI, and the optical zoom capability interval corresponding to the original zoom ratio corresponds to the first ISP, and the optical zoom capability interval corresponding to the original zoom ratio is a non-transition interval; the target CSI includes the first CSI and the second CSI, and the optical zoom capability interval corresponding to the target zoom ratio corresponds to the sensor corresponding to the first CSI and the sensor corresponding to the second CSI, and the optical zoom capability interval corresponding to the target zoom ratio corresponds to the first ISP and the second ISP. The optical zoom capability interval corresponding to the target zoom ratio is a transition interval. In this embodiment, the original zoom ratio is in the non-transition interval and the target zoom ratio is in the transition interval, and a sensor corresponding to the non-transition interval is the same as one of the two sensors corresponding to the transition interval, for example, a sensor corresponding to the non-transition interval is an ultra-wide-angle sensor, and the two sensors corresponding to the transition interval are an ultra-wide-angle sensor and a wide-angle sensor. In this embodiment, the user inputs a zoom instruction, so that the working sensor is switched from the ultra-wide-angle sensor to the ultra-wide-angle sensor and the wide-angle sensor.

[0100] Step 202: The driving device determines a target CSI and a target ISP according to a target zoom ratio, where the target CSI includes a first CSI and a second CSI, and the target ISP includes a first ISP and a second ISP.

[0101] In the embodiment of the present invention, the original ISP includes the first ISP, and the target ISP includes the first ISP and the second ISP. For example, the optical zoom capability interval corresponding to the target zoom ratio 1.0x is [0.9x, 1.1x], the CSI corresponding to [0.9x, 1.1x] includes the first CSI and the second CSI, and the ISP corresponding to [0.9x, 1.1x] includes the first ISP and the second ISP.

[0102] Step 203: The driving device determines connection configuration parameters according to the original zoom ratio, the target zoom ratio and the zoom mode.

[0103] In this embodiment, the connection configuration parameter is used to indicate the processing mode between the original CSI and the original ISP, and to indicate the processing mode between the target CSI and the target ISP. For example, the zoom mode is smooth zoom, the CSI corresponding to the original zoom ratio includes the first CSI and the ISP corresponding to the original zoom ratio includes the first ISP, the CSI corresponding to the target zoom ratio includes the first CSI and the second CSI and the ISP corresponding to the target zoom ratio includes the first ISP and the second ISP, then the driving device determines that the first CSI maintains a connection with the first ISP and the second CSI establishes a connection with the second ISP, so the connection configuration parameter may include a configuration parameter for maintaining a connection between the first CSI and the first ISP and a configuration parameter for establishing a connection between the second CSI and the second ISP.

[0104] Step 204: The driving device sends the connection configuration parameters to the first CSI.

[0105] In this step, after receiving the connection configuration parameters, the first CSI learns that it needs to maintain the connection with the first ISP through the configuration parameters for maintaining the connection between the first CSI and the first ISP in the connection configuration parameters.

[0106] Step 205: The driving device sends the connection configuration parameters to the second CSI.

[0107] In this step, after receiving the connection configuration parameters, the second CSI learns that a connection needs to be established with the second ISP through the configuration parameters for establishing a connection between the second CSI and the second ISP in the connection configuration parameters.

[0108] Step 206: The first CSI maintains the connection with the first ISP according to the connection configuration parameters.

[0109] In this step, the first CSI maintains the connection with the first ISP according to the configuration parameters for maintaining the connection between the first CSI and the first ISP. Specifically, when the first ISP completes processing of the current frame image data, the connection configuration parameters take effect, and at this time, the first CSI maintains the connection with the first ISP. Then, the first ISP performs image processing on the next frame image data output by the ultra-wide-angle sensor through the first PHY interface and the first CSI to generate the first output data.

[0110] Step 207: The second CSI establishes a connection with the second ISP according to the connection configuration parameters.

[0111] In this step, the second CSI establishes a connection with the second ISP according to the configuration parameters for establishing a connection between the second CSI and the second ISP. Specifically, when the first ISP completes processing of the current frame image data, the connection configuration parameters take effect, and at this time, the second CSI establishes a connection with the second ISP. Then, the second ISP performs image processing on the next frame image data output by the wide-angle sensor through the second PHY interface and the second CSI to generate second output data.

[0112] In the embodiment of the present invention, two ISPs are used to implement image processing on image data output by more than three cameras, so that the power consumption of the ISP in this embodiment is reduced to 69% of the power consumption of the ISP in the related art, and the bandwidth required by the ISP in the embodiment of the present invention is reduced to 68.75% of the bandwidth required by the ISP in the related art, thereby reducing the chip area and reducing the power consumption and required bandwidth of the ISP.

[0113] Figure 4 A signaling flow chart of another ISP determination method provided by an embodiment of the present invention, such as Figure 4 As shown, the method includes:

[0114] Step 301: The driving device receives a zoom instruction input by a user, where the zoom instruction includes a target zoom ratio and a zoom mode.

[0115] In this embodiment, the user slides the zoom slider on the shooting interface displayed by the electronic device to input the target zoom ratio and zoom mode to the driving device of the electronic device. The zoom mode is smooth zoom, and the smooth zoom is sequential smooth zoom. For example, if the zoom mode input by the user is a sequential smooth zoom from 0.6x to 3.0x, the original zoom ratio is 0.6x, the target zoom ratio is 3.0x, the optical zoom capability interval corresponding to the original zoom ratio is [0.6x, 0.9x), and the optical zoom capability interval corresponding to the target zoom ratio 3.0x is [2.9x, 3.1x].

[0116] In this embodiment, the original CSI includes the first CSI, the optical zoom capability interval corresponding to the original zoom ratio corresponds to a sensor corresponding to the first CSI, and the optical zoom capability interval corresponding to the original zoom ratio corresponds to the first ISP, and the optical zoom capability interval corresponding to the original zoom ratio is a non-transition interval; the target CSI includes the second CSI and the third CSI, the optical zoom capability interval corresponding to the target zoom ratio corresponds to the sensor corresponding to the second CSI and the sensor corresponding to the third CSI, and the optical zoom capability interval corresponding to the target zoom ratio corresponds to the first ISP and the second ISP, and the optical zoom capability interval corresponding to the target zoom ratio is a transition interval. In this embodiment, the original zoom ratio is in the non-transition interval and the target zoom ratio is in the transition interval, and a sensor corresponding to the non-transition interval is different from any one of the two sensors corresponding to the transition interval. For example, a sensor corresponding to the non-transition interval is an ultra-wide-angle sensor, and two sensors corresponding to the transition interval are a wide-angle sensor and a telephoto sensor. In this embodiment, the user inputs a zoom instruction, so that the working sensor is switched from the ultra-wide-angle sensor to the wide-angle sensor and the telephoto sensor.

[0117] Step 302: The driving device determines a target CSI and a target ISP according to a target zoom ratio, where the target CSI includes a second CSI and a third CSI, and the target ISP includes a first ISP and a second ISP.

[0118] In the embodiment of the present invention, the original ISP includes the first ISP, and the target ISP includes the first ISP and the second ISP. For example, the optical zoom capability interval corresponding to the target zoom ratio 3.0x is [2.9x, 3.1x], the CSI corresponding to [2.9x, 3.1x] includes the second CSI and the third CSI, and the ISP corresponding to [2.9x, 3.1x] includes the first ISP and the second ISP.

[0119] Step 303: The driving device determines connection configuration parameters according to the original zoom ratio, the target zoom ratio and the zoom mode.

[0120] In this embodiment, the connection configuration parameter is used to indicate the processing mode between the original CSI and the original ISP, and to indicate the processing mode between the target CSI and the target ISP. For example, the zoom mode is smooth zoom, the CSI corresponding to the original zoom ratio includes the first CSI and the ISP corresponding to the original zoom ratio includes the first ISP, the CSI corresponding to the target zoom ratio includes the second CSI and the third CSI, and the ISP corresponding to the target zoom ratio includes the first ISP and the second ISP. At this time, the connection configuration parameter is used to indicate that the processing mode between the first CSI and the first ISP is disconnection, the processing mode between the second CSI and the first ISP is establishment of connection, and the processing mode between the third CSI and the second ISP is establishment of connection. Then, the driving device determines that the first CSI is disconnected from the first ISP, the second CSI is connected to the first ISP, and the third CSI is connected to the second ISP. Therefore, the connection configuration parameter may include a configuration parameter for disconnecting the first CSI from the first ISP, a configuration parameter for establishing a connection between the second CSI and the first ISP, and a configuration parameter for establishing a connection between the third CSI and the second ISP.

[0121] Step 304: The driving device sends the connection configuration parameters to the first CSI.

[0122] In this step, after receiving the connection configuration parameters, the first CSI learns that it needs to disconnect from the first ISP through the first CSI and the first ISP disconnection configuration parameters in the connection configuration parameters.

[0123] Step 305: The driving device sends the connection configuration parameters to the second CSI.

[0124] In this step, after receiving the connection configuration parameters, the second CSI learns that a connection needs to be established with the first ISP through the configuration parameters for establishing a connection between the second CSI and the first ISP in the connection configuration parameters.

[0125] Step 306: The driving device sends the connection configuration parameters to the third CSI.

[0126] In this step, after receiving the connection configuration parameters, the third CSI learns that a connection needs to be established with the second ISP through the configuration parameters for establishing a connection between the third CSI and the second ISP in the connection configuration parameters.

[0127] Step 307: After the first CSI processes the current frame image data through the first ISP, the first CSI disconnects from the first ISP according to the connection configuration parameters.

[0128] In this step, the first CSI disconnects from the first ISP according to the configuration parameters for disconnecting the first CSI and the first ISP. Specifically, when the first ISP finishes processing the current frame of image data, the connection configuration parameters take effect, and at this time, the first CSI disconnects from the first ISP. Then, the first ISP stops processing the next frame of image data output by the ultra-wide-angle sensor through the first PHY interface and the first CSI, and the first ISP no longer generates the first output data.

[0129] Step 308: After the first CSI disconnects from the first ISP, the second CSI establishes a connection with the first ISP according to the connection configuration parameters.

[0130] In this step, the second CSI establishes a connection with the first ISP according to the configuration parameters for establishing a connection between the second CSI and the first ISP. Specifically, when the first ISP has processed the current frame image data and the first CSI disconnects from the first ISP, the connection configuration parameters take effect, and the first CSI now establishes a connection with the first ISP. It should be noted that at the same time, the ISP can only perform image processing on the next frame of image data output by a sensor through the PHY interface and CSI, so the second CSI can establish a connection with the first ISP only after the first CSI disconnects from the first ISP. Then, the first ISP performs image processing on the next frame of image data output by the wide-angle sensor through the second PHY interface and the second CSI to generate first output data.

[0131] Step 309: The third CSI establishes a connection with the second ISP according to the connection configuration parameters.

[0132] In this step, the third CSI establishes a connection with the second ISP according to the configuration parameters for establishing a connection between the third CSI and the second ISP. The connection configuration parameters take effect in the next frame, and the second CSI establishes a connection with the second ISP. Then, the second ISP performs image processing on the next frame of image data output by the telephoto sensor through the third PHY interface and the third CSI to generate second output data.

[0133] In the embodiment of the present invention, two ISPs are used to implement image processing on image data output by more than three cameras, so that the power consumption of the ISP in this embodiment is reduced to 69% of the power consumption of the ISP in the related art, and the bandwidth required by the ISP in the embodiment of the present invention is reduced to 68.75% of the bandwidth required by the ISP in the related art, thereby reducing the chip area and reducing the power consumption and required bandwidth of the ISP.

[0134] Figure 5 A signaling flow chart of another ISP determination method provided by an embodiment of the present invention, such as Figure 5As shown, the method includes:

[0135] Step 401: The driving device receives a zoom instruction input by a user, where the zoom instruction includes a target zoom ratio and a zoom mode.

[0136] In this embodiment, the user slides the zoom slider on the shooting interface displayed by the electronic device to input the target zoom ratio and zoom mode to the driving device of the electronic device. The zoom mode is smooth zoom, and the smooth zoom is sequential smooth zoom. For example, if the zoom mode input by the user is a sequential smooth zoom from 1.0x to 2.1x, the original zoom ratio is 1.0x, the target zoom ratio is 2.1x, the optical zoom capability interval corresponding to the original zoom ratio is [0.9x, 1.1x], and the optical zoom capability interval corresponding to the target zoom ratio 3.0x is (1.1x, 2.9x).

[0137] In this embodiment, the original CSI includes a first CSI and a second CSI, and the optical zoom capability interval corresponding to the original zoom ratio corresponds to the sensor corresponding to the first CSI and the sensor corresponding to the second CSI. At this time, the optical zoom capability interval corresponding to the original zoom ratio corresponds to the first ISP and the second ISP, and the optical zoom capability interval corresponding to the original zoom ratio is a transition interval; the target CSI includes a second CSI, and the optical zoom capability interval corresponding to the target zoom ratio corresponds to a sensor corresponding to the second CSI. At this time, the optical zoom capability interval corresponding to the target zoom ratio corresponds to the second ISP, and the optical zoom capability interval corresponding to the target zoom ratio is a non-transition interval. In this embodiment, the original zoom ratio is in the transition interval and the target zoom ratio is in the non-transition interval, and a sensor corresponding to the non-transition interval is the same as one of the two sensors corresponding to the transition interval. For example, a sensor corresponding to the non-transition interval is a wide-angle sensor, and two sensors corresponding to the transition interval are an ultra-wide-angle sensor and a wide-angle sensor. In this embodiment, the user inputs a zoom instruction so that the working sensors are switched from the ultra-wide-angle sensor and the wide-angle sensor to the ultra-wide-angle sensor.

[0138] Step 402: The driving device determines a target CSI and a target ISP according to a target zoom ratio, where the target CSI includes a second CSI, and the target ISP includes a second ISP.

[0139] In the embodiment of the present invention, the original ISP includes the first ISP and the second ISP, and the target ISP includes the second ISP. For example, the optical zoom capability interval corresponding to the target zoom ratio 2.1x is (1.1x, 2.9x), the CSI corresponding to (1.1x, 2.9x) includes the second CSI, and the ISP corresponding to (1.1x, 2.9x) includes the second ISP.

[0140] Step 403: The driving device determines connection configuration parameters according to the original zoom ratio, the target zoom ratio and the zoom mode.

[0141] In this embodiment, the connection configuration parameter is used to indicate the processing mode between the original CSI and the original ISP, and to indicate the processing mode between the target CSI and the target ISP. For example, the zoom mode is smooth zoom, the CSI corresponding to the original zoom ratio includes the first CSI and the second CSI, and the ISP corresponding to the original zoom ratio includes the first ISP and the second ISP, the CSI corresponding to the target zoom ratio includes the second CSI, and the ISP corresponding to the target zoom ratio includes the second ISP. At this time, the connection configuration parameter is used to indicate that the processing mode between the first CSI and the first ISP is to disconnect and the processing mode between the second CSI and the second ISP is to maintain connection, then the driving device determines that the first CSI is disconnected from the first ISP and the second CSI is connected to the second ISP, so the connection configuration parameter may include the configuration parameter for disconnecting the first CSI and the first ISP and the configuration parameter for maintaining the connection between the second CSI and the second ISP.

[0142] Step 404: The driving device sends the connection configuration parameters to the first CSI.

[0143] In this step, after receiving the connection configuration parameters, the first CSI learns that it needs to disconnect from the first ISP through the first CSI and the first ISP disconnection configuration parameters in the connection configuration parameters.

[0144] Step 405: The driving device sends the connection configuration parameters to the second CSI.

[0145] In this step, after receiving the connection configuration parameters, the second CSI learns that it needs to maintain connection with the second ISP through the second CSI and the configuration parameters for maintaining connection with the second ISP in the connection configuration parameters.

[0146] Step 406: After the first CSI processes the current frame image data through the first ISP, the first CSI disconnects from the first ISP according to the connection configuration parameters.

[0147] In this step, the first CSI disconnects from the first ISP according to the configuration parameters for disconnecting the first CSI and the first ISP. Specifically, when the first ISP finishes processing the current frame of image data, the connection configuration parameters take effect, and at this time, the first CSI disconnects from the first ISP. Then, the first ISP stops processing the next frame of image data output by the ultra-wide-angle sensor through the first PHY interface and the first CSI, and the first ISP no longer generates the first output data.

[0148] Step 407: The second CSI maintains the connection with the second ISP according to the connection configuration parameters.

[0149] In this step, the second CSI maintains the connection with the second ISP according to the configuration parameters for maintaining the connection between the second CSI and the second ISP. Specifically, when the second ISP processes the current frame image data, the connection configuration parameters take effect, and the second CSI maintains the connection with the second ISP. Then, the second ISP performs image processing on the next frame image data output by the wide-angle sensor through the second PHY interface and the second CSI to generate second output data.

[0150] In the embodiment of the present invention, two ISPs are used to implement image processing on image data output by more than three cameras, so that the power consumption of the ISP in this embodiment is reduced to 30.02% of the power consumption of the ISP in the related art, and the bandwidth required by the ISP in the embodiment of the present invention is reduced to 31.25% of the bandwidth required by the ISP in the related art, thereby reducing the chip area and reducing the power consumption and required bandwidth of the ISP.

[0151] Figure 6 A signaling flow chart of another ISP determination method provided by an embodiment of the present invention, such as Figure 6 As shown, the method includes:

[0152] Step 501: The driving device receives a zoom instruction input by a user, where the zoom instruction includes a target zoom ratio and a zoom mode.

[0153] In this embodiment, the user slides the zoom slider on the shooting interface displayed by the electronic device to input the target zoom ratio and zoom mode to the driving device of the electronic device. The zoom mode is smooth zoom, and the smooth zoom is sequential smooth zoom. For example, if the zoom mode input by the user is a sequential smooth zoom from 1.0x to 3.0x, the original zoom ratio is 1.0x, the target zoom ratio is 3.0x, the optical zoom capability interval corresponding to the original zoom ratio is [0.9x, 1.1x], and the optical zoom capability interval corresponding to the target zoom ratio 3.0x is [2.9x, 3.1x].

[0154] In this embodiment, the original CSI includes a first CSI and a second CSI, and the optical zoom capability interval corresponding to the original zoom ratio corresponds to the sensor corresponding to the first CSI and the sensor corresponding to the second CSI. At this time, the optical zoom capability interval corresponding to the original zoom ratio corresponds to the first ISP and the second ISP, and the optical zoom capability interval corresponding to the original zoom ratio is a transition interval; the target CSI includes a second CSI and a third CSI, and the optical zoom capability interval corresponding to the target zoom ratio corresponds to the sensor corresponding to the second CSI and the sensor corresponding to the third CSI. At this time, the optical zoom capability interval corresponding to the target zoom ratio corresponds to the first ISP and the second ISP, and the optical zoom capability interval corresponding to the target zoom ratio is a transition interval. In this embodiment, the original zoom ratio is in the transition interval and the target zoom ratio is in the transition interval, the two sensors corresponding to the transition interval corresponding to the original zoom ratio are the same as one of the two sensors corresponding to the transition interval corresponding to the target zoom ratio, for example, the sensors corresponding to the transition interval [0.9x, 1.1x] are the ultra-wide-angle sensor and the wide-angle sensor, and the two sensors corresponding to the transition interval [2.9x, 3.1x] are the wide-angle sensor and the telephoto sensor. In this embodiment, the user inputs a zoom command to switch the working sensors from the ultra-wide-angle sensor and the wide-angle sensor to the wide-angle sensor and the telephoto sensor.

[0155] Step 502: The driving device determines a target CSI and a target ISP according to a target zoom ratio, where the target CSI includes a second CSI and a third CSI, and the target ISP includes a first ISP and a second ISP.

[0156] In the embodiment of the present invention, the original ISP includes the first ISP and the second ISP, and the target ISP includes the first ISP and the second ISP. For example, the optical zoom capability interval corresponding to the target zoom ratio 3.0x is [2.9x, 3.1x], the CSI corresponding to [2.9x, 3.1x] includes the second CSI and the third CSI, and the ISP corresponding to [2.9x, 3.1x] includes the first ISP and the second ISP.

[0157] Step 503: The driving device determines connection configuration parameters according to the original zoom ratio, the target zoom ratio and the zoom mode.

[0158] In this embodiment, the connection configuration parameter is used to indicate the processing mode between the original CSI and the original ISP, and to indicate the processing mode between the target CSI and the target ISP. For example, the zoom mode is smooth zoom, the CSI corresponding to the original zoom ratio includes the first CSI and the second CSI, and the ISP corresponding to the original zoom ratio includes the first ISP and the second ISP, the CSI corresponding to the target zoom ratio includes the second CSI and the third CSI, and the ISP corresponding to the target zoom ratio includes the first ISP and the second ISP. At this time, the connection configuration parameter is used to indicate that the processing mode between the first CSI and the first ISP is to disconnect, the processing mode between the second CSI and the second ISP is to maintain the connection, and the processing mode between the third CSI and the first ISP is to establish a connection. Then, the driving device determines that the first CSI is disconnected from the first ISP, the second CSI is connected to the second ISP, and the third CSI is connected to the first ISP. Therefore, the connection configuration parameter may include a configuration parameter for disconnecting the first CSI from the first ISP, a configuration parameter for maintaining the connection between the second CSI and the second ISP, and a configuration parameter for establishing the connection between the third CSI and the first ISP.

[0159] Step 504: The driving device sends the connection configuration parameters to the first CSI.

[0160] In this step, after receiving the connection configuration parameters, the first CSI learns that it needs to disconnect from the first ISP through the first CSI and the first ISP disconnection configuration parameters in the connection configuration parameters.

[0161] Step 505: The driving device sends the connection configuration parameters to the second CSI.

[0162] In this step, after receiving the connection configuration parameters, the second CSI learns that it needs to maintain connection with the second ISP through the second CSI and the configuration parameters for maintaining connection with the second ISP in the connection configuration parameters.

[0163] Step 506: The driving device sends the connection configuration parameters to the third CSI.

[0164] After receiving the connection configuration parameters, the third CSI learns that a connection needs to be established with the first ISP through the configuration parameters for establishing a connection between the third CSI and the first ISP in the connection configuration parameters.

[0165] Step 507: After the first ISP processes the current frame image data, the first CSI disconnects from the first ISP according to the connection configuration parameters.

[0166] In this step, the first CSI disconnects from the first ISP according to the configuration parameters for disconnecting the first CSI and the first ISP. Specifically, when the first ISP finishes processing the current frame of image data, the connection configuration parameters take effect, and at this time, the first CSI disconnects from the first ISP. Then, the first ISP stops processing the next frame of image data output by the ultra-wide-angle sensor through the first PHY interface and the first CSI, and the first ISP no longer generates the first output data.

[0167] Step 508: The second CSI maintains the connection with the second ISP according to the connection configuration parameters.

[0168] In this step, the second CSI maintains the connection with the second ISP according to the configuration parameters for maintaining the connection between the second CSI and the second ISP. Specifically, when the second ISP processes the current frame image data, the connection configuration parameters take effect, and the second CSI maintains the connection with the second ISP. Then, the second ISP performs image processing on the next frame image data output by the wide-angle sensor through the second PHY interface and the second CSI to generate second output data.

[0169] Step 509: After the first CSI disconnects from the first ISP, the third CSI establishes a connection with the first ISP according to the connection configuration parameters.

[0170] In this step, the third CSI establishes a connection with the first ISP according to the configuration parameters for establishing a connection between the third CSI and the first ISP. Specifically, when the first ISP has processed the current frame image data and the first CSI disconnects from the first ISP, the connection configuration parameters take effect, and the third CSI establishes a connection with the first ISP. It should be noted that at the same time, the ISP can only perform image processing on the next frame of image data output by a sensor through the PHY interface and CSI, so the third CSI can establish a connection with the first ISP only after the first CSI disconnects from the first ISP. Then, the first ISP performs image processing on the next frame of image data output by the telephoto sensor through the third PHY interface and the third CSI to generate first output data.

[0171] In the embodiment of the present invention, two ISPs are used to implement image processing on image data output by more than three cameras, so that the power consumption of the ISP in this embodiment is reduced to 69% of the power consumption of the ISP in the related art, and the bandwidth required by the ISP in the embodiment of the present invention is reduced to 68.75% of the bandwidth required by the ISP in the related art, thereby reducing the chip area and reducing the power consumption and required bandwidth of the ISP.

[0172] Figure 7A signaling flow chart of another ISP determination method provided by an embodiment of the present invention, such as Figure 7 As shown, the method includes:

[0173] Step 601: The driving device receives a zoom instruction input by a user, where the zoom instruction includes a target zoom ratio and a zoom mode.

[0174] In this embodiment, the user slides the zoom slider on the shooting interface displayed by the electronic device to input the target zoom ratio and zoom mode to the driving device of the electronic device. The zoom mode is smooth zoom, and the smooth zoom is sequential smooth zoom. For example, the zoom mode input by the user is a sequential smooth zoom from 1.0x to 5.0x, then the original zoom ratio is 1.0x, the target zoom ratio is 5.0x, the original zoom ratio 1.0x corresponds to an optical zoom capability interval of [0.9x, 1.1x], and the target zoom ratio 5.0x corresponds to an optical zoom capability interval of (3.1x, 30x].

[0175] In this embodiment, the original CSI includes the first CSI and the second CSI, the optical zoom capability interval corresponding to the original zoom ratio corresponds to the sensor corresponding to the first CSI and the sensor corresponding to the second CSI, at this time the optical zoom capability interval corresponding to the original zoom ratio corresponds to the first ISP and the second ISP, and the optical zoom capability interval corresponding to the original zoom ratio is a transition interval; the target CSI includes the third CSI, the optical zoom capability interval corresponding to the target zoom ratio corresponds to the sensor corresponding to the third CSI, at this time the optical zoom capability interval corresponding to the target zoom ratio corresponds to the first ISP or the second ISP, and the optical zoom capability interval corresponding to the target zoom ratio is a non-transition interval. In this embodiment, the original zoom ratio is in the transition interval and the target zoom ratio is in the non-transition interval, and a sensor corresponding to the non-transition interval is different from any one of the two sensors corresponding to the transition interval. For example, a sensor corresponding to the non-transition interval is a telephoto sensor, and two sensors corresponding to the transition interval are an ultra-wide-angle sensor and a wide-angle sensor. In this embodiment, the user inputs a zoom instruction so that the working sensor is switched from the ultra-wide-angle sensor and the wide-angle sensor to the telephoto sensor.

[0176] Step 602: The driving device determines a target CSI and a target ISP according to a target zoom ratio, wherein the target CSI is a third CSI, and the target ISP includes the first ISP or the second ISP.

[0177] In an embodiment of the present invention, the original ISP includes a first ISP and a second ISP, and the target ISP includes the first ISP or the second ISP. For example, the optical zoom capability interval corresponding to the target zoom ratio 5.0x is [3.1x, 30x], the CSI corresponding to [3.1x, 30x] includes a third CSI, and the ISP corresponding to [3.1x, 30x] includes the first ISP or the second ISP.

[0178] Step 603: The driving device determines connection configuration parameters according to the original zoom ratio, the target zoom ratio and the zoom mode.

[0179] In this embodiment, the connection configuration parameter is used to indicate the processing mode between the original CSI and the original ISP, and to indicate the processing mode between the target CSI and the target ISP. For example, the zoom mode is smooth zoom, the CSI corresponding to the original zoom ratio includes the first CSI and the second CSI, and the ISP corresponding to the original zoom ratio includes the first ISP and the second ISP, the CSI corresponding to the target zoom ratio includes the third CSI, and the ISP corresponding to the target zoom ratio includes the first ISP or the second ISP. At this time, the connection configuration parameter is used to indicate that the processing mode between the first CSI and the first ISP is disconnection, the processing mode between the second CSI and the second ISP is disconnection, and the processing mode between the third CSI and the first ISP is establishment of connection. Then, the driving device determines that the first CSI is disconnected from the first ISP, the second CSI is disconnected from the second ISP, and the third CSI is connected to the first ISP. Therefore, the connection configuration parameter may include a configuration parameter for disconnecting the first CSI from the first ISP, a configuration parameter for disconnecting the second CSI from the second ISP, and a configuration parameter for establishing a connection between the third CSI and the first ISP. Alternatively, the connection configuration parameters are used to indicate that the processing mode between the first CSI and the first ISP is disconnection, the processing mode between the second CSI and the second ISP is disconnection, and the processing mode between the third CSI and the second ISP is establishment of connection, then the driving device determines that the first CSI is disconnected from the first ISP, the second CSI is disconnected from the second ISP, and the third CSI is connected to the second ISP, so the connection configuration parameters may include configuration parameters for disconnecting the first CSI and the first ISP, configuration parameters for disconnecting the second CSI and the second ISP, and configuration parameters for establishing the third CSI and the second ISP.

[0180] Step 604: The driving device sends the connection configuration parameters to the first CSI.

[0181] In this step, after receiving the connection configuration parameters, the first CSI learns that it needs to disconnect from the first ISP through the first CSI and the first ISP disconnection configuration parameters in the connection configuration parameters.

[0182] Step 605: The driving device sends the connection configuration parameters to the second CSI.

[0183] In this step, after receiving the connection configuration parameters, the second CSI learns that it needs to disconnect from the second ISP through the second CSI and the configuration parameters for disconnecting the second ISP in the connection configuration parameters.

[0184] Step 606: The driving device sends the connection configuration parameters to the third CSI.

[0185] In this step, after receiving the connection configuration parameters, the third CSI learns that a connection needs to be established with the first ISP through the configuration parameters for establishing a connection between the third CSI and the first ISP in the connection configuration parameters. Alternatively, after receiving the connection configuration parameters, the third CSI learns that a connection needs to be established with the second ISP through the configuration parameters for establishing a connection between the third CSI and the second ISP in the connection configuration parameters.

[0186] Step 607: After the first CSI processes the current frame image data through the first ISP, the first CSI disconnects from the first ISP according to the connection configuration parameters.

[0187] In this step, the first CSI disconnects from the first ISP according to the configuration parameters for disconnecting the first CSI and the first ISP. Specifically, when the first ISP finishes processing the current frame of image data, the connection configuration parameters take effect, and at this time, the first CSI disconnects from the first ISP. Then, the first ISP stops processing the next frame of image data output by the ultra-wide-angle sensor through the first PHY interface and the first CSI, and the first ISP no longer generates the first output data.

[0188] Step 608: After the second ISP processes the current frame image data, the second CSI disconnects from the second ISP according to the connection configuration parameters.

[0189] In this step, the second CSI disconnects from the second ISP according to the configuration parameters for disconnecting the second CSI and the second ISP. Specifically, after the second ISP processes the current frame of image data, the connection configuration parameters take effect, and the second CSI disconnects from the second ISP. Then, the second ISP stops processing the next frame of image data output by the wide-angle sensor through the second PHY interface and the second CSI, and the second ISP no longer generates the second output data.

[0190] Step 609: After the first CSI disconnects from the first ISP, the third CSI establishes a connection with the first ISP according to the connection configuration parameters; or, after the second CSI disconnects from the second ISP, the third CSI establishes a connection with the second ISP according to the connection configuration parameters.

[0191] In this step, the third CSI establishes a connection with the first ISP according to the configuration parameters for establishing a connection between the third CSI and the first ISP. Specifically, after the first ISP processes the current frame image data and the first CSI disconnects from the first ISP, the connection configuration parameters take effect, and the third CSI establishes a connection with the first ISP. It should be noted that at the same time, the ISP can only perform image processing on the next frame of image data output by a sensor through the PHY interface and CSI, so the third CSI can establish a connection with the first ISP only after the first CSI disconnects from the first ISP. Then, the first ISP performs image processing on the next frame of image data output by the telephoto sensor through the third PHY interface and the third CSI to generate first output data.

[0192] Alternatively, the third CSI establishes a connection with the second ISP according to the configuration parameters for establishing a connection between the third CSI and the second ISP. Specifically, after the second ISP processes the current frame image data and the second CSI disconnects the connection with the second ISP, the connection configuration parameters take effect, and the third CSI establishes a connection with the second ISP. Only after the second CSI disconnects the connection with the second ISP can the third CSI establish a connection with the second ISP. Then, the second ISP performs image processing on the next frame of image data output by the telephoto sensor through the third PHY interface and the third CSI to generate second output data.

[0193] In the embodiment of the present invention, two ISPs are used to implement image processing on image data output by more than three cameras, so that the power consumption of the ISP in this embodiment is reduced to 30.02% of the power consumption of the ISP in the related art, and the bandwidth required by the ISP in the embodiment of the present invention is reduced to 31.25% of the bandwidth required by the ISP in the related art, thereby reducing the chip area and reducing the power consumption and required bandwidth of the ISP.

[0194] Figure 8 A signaling flow chart of another ISP determination method provided by an embodiment of the present invention, such as Figure 8 As shown, the method includes:

[0195] Step 701: The driving device receives a zoom instruction input by a user, where the zoom instruction includes a target zoom ratio and a zoom mode.

[0196] In this embodiment, the user slides the zoom slider on the shooting interface displayed by the electronic device to input the target zoom ratio and zoom mode to the driving device of the electronic device. The zoom mode is smooth zoom, and the smooth zoom is reverse smooth zoom. For example, if the zoom mode input by the user is reverse smooth zoom from 2.0x to 0.8x, the original zoom ratio is 2.0x, the target zoom ratio is 0.8x, the original zoom ratio 2.0x corresponds to an optical zoom capability interval of (1.1x, 2.9x), and the target zoom ratio 0.8x corresponds to an optical zoom capability interval of [0.6x, 0.9x).

[0197] In this embodiment, the original CSI includes a first CSI, and the optical zoom capability interval corresponding to the original zoom ratio corresponds to a sensor corresponding to the first CSI. At this time, the optical zoom capability interval corresponding to the original zoom ratio corresponds to the first ISP, and the optical zoom capability interval corresponding to the original zoom ratio is a non-transition interval; the target CSI includes a second CSI, and the optical zoom capability interval corresponding to the target zoom ratio corresponds to the sensor corresponding to the second CSI. At this time, the optical zoom capability interval corresponding to the target zoom ratio corresponds to the second ISP. The optical zoom capability interval corresponding to the target zoom ratio is a non-transition interval. In this embodiment, the original zoom ratio is in the non-transition interval and the target zoom ratio is in the non-transition interval. A sensor corresponding to the non-transition interval corresponding to the original zoom ratio is different from a sensor corresponding to the non-transition interval corresponding to the target zoom ratio. For example, a sensor corresponding to the non-transition interval (1.1x, 2.9x) is a wide-angle sensor, and a sensor corresponding to the non-transition interval [0.6x, 0.9x) is an ultra-wide-angle sensor. In this embodiment, the user inputs a zoom instruction to switch the working sensor from the wide-angle sensor to the ultra-wide-angle sensor.

[0198] Step 702: The driving device determines a target CSI and a target ISP according to a target zoom ratio, where the target CSI includes a second CSI, and the target ISP includes a second ISP.

[0199] In the embodiment of the present invention, the original ISP includes the first ISP, and the target ISP includes the second ISP. For example, the optical zoom capability interval corresponding to the target zoom ratio 0.8x is [0.6x, 0.9x), the CSI corresponding to [0.6x, 0.9x) includes the second CSI, and the ISP corresponding to [0.6x, 0.9x) includes the second ISP.

[0200] Step 703: The driving device determines connection configuration parameters according to the original zoom ratio, the target zoom ratio and the zoom mode.

[0201] In an embodiment of the present invention, the connection configuration parameters are used to indicate the processing method between the original CSI and the original ISP, and to indicate the processing method between the target CSI and the target ISP. Among them, the processing method between the original CSI and the original ISP is to disconnect, and the processing method between the target CSI and the target ISP includes establishing a connection. For example, the zoom method is smooth zoom, the CSI corresponding to the original zoom ratio includes the first CSI and the ISP corresponding to the original zoom ratio includes the first ISP, the CSI corresponding to the target zoom ratio includes the second CSI and the ISP corresponding to the target zoom ratio includes the second ISP, then the driving device determines that the first CSI is disconnected from the first ISP and the first CSI is connected to the second ISP, so the connection configuration parameters may include configuration parameters for disconnecting the first CSI and the first ISP and configuration parameters for establishing a connection between the second CSI and the second ISP.

[0202] Step 704: The driving device sends the connection configuration parameters to the first CSI.

[0203] In this step, after receiving the connection configuration parameters, the first CSI learns that it needs to disconnect from the first ISP through the configuration parameters for disconnecting the first CSI from the first ISP in the connection configuration parameters.

[0204] Step 705: The driving device sends the connection configuration parameters to the second CSI.

[0205] In this step, after receiving the connection configuration parameters, the second CSI learns that a connection needs to be established with the second ISP through the configuration parameters for establishing a connection between the second CSI and the second ISP in the connection configuration parameters.

[0206] Step 706: After the first CSI processes the current frame image data through the first ISP, the first CSI disconnects from the first ISP according to the connection configuration parameters.

[0207] In this step, the first CSI disconnects from the first ISP according to the configuration parameters for disconnecting the first CSI and the first ISP. Specifically, when the first ISP finishes processing the current frame image data, the connection configuration parameters take effect, and at this time, the second CSI disconnects from the first ISP. Then, the first ISP stops processing the next frame of image data output by the wide-angle sensor through the first PHY interface and the first CSI, and the first ISP no longer generates the first output data.

[0208] Step 707: The second CSI establishes a connection with the second ISP according to the connection configuration parameters.

[0209] In this step, the second CSI establishes a connection with the second ISP according to the configuration parameters for establishing a connection between the second CSI and the second ISP. Specifically, when the first ISP completes processing of the current frame image data, the connection configuration parameters take effect, and at this time, the second CSI establishes a connection with the second ISP. Then, the second ISP performs image processing on the next frame image data output by the ultra-wide-angle sensor through the second PHY interface and the second CSI to generate second output data.

[0210] In the embodiment of the present invention, two ISPs are used to implement image processing on image data output by more than three cameras, so that the power consumption of the ISP in this embodiment is reduced to 30.02% of the power consumption of the ISP in the related art, and the bandwidth required by the ISP in the embodiment of the present invention is reduced to 31.25% of the bandwidth required by the ISP in the related art, thereby reducing the chip area and reducing the power consumption and required bandwidth of the ISP.

[0211] Fig. 9 A signaling flow chart of another ISP determination method provided by an embodiment of the present invention, such as Fig. 9 As shown, the method includes:

[0212] Step 801: The driving device receives a zoom instruction input by a user, where the zoom instruction includes a target zoom ratio and a zoom mode.

[0213] As an optional solution, the user clicks on the zoom slider on the shooting interface displayed by the electronic device to input the target zoom ratio and zoom mode to the driving device of the electronic device. The optical zoom capability interval corresponding to the original zoom ratio is different from the optical zoom capability interval corresponding to the target zoom ratio, and the zoom mode is jump zoom. For example, if the zoom mode input by the user is a jump zoom from 0.8x to 2.0x, then the original zoom ratio is 0.8x, the target zoom ratio is 2.0x, the optical zoom capability interval corresponding to the original zoom ratio 0.8x is [0.6x, 1.0x), and the optical zoom capability interval corresponding to the target zoom ratio 2.0x is [1.0x, 3.0x). As another optional solution, the user clicks on the optical focus corresponding to the boundary value of the optical zoom capability interval on the shooting interface displayed by the electronic device to input the target zoom ratio and zoom mode to the driving device of the electronic device, and the zoom mode is jump zoom. For example, if the zoom mode input by the user is a jump zoom from 0.6x to 1.0x, the original zoom ratio is 0.6x, the target zoom ratio is 1.0x, the optical zoom capability range corresponding to the original zoom ratio 0.6x is [0.6x, 1.0x), and the optical zoom capability range corresponding to the target zoom ratio 1.0x is [1.0x, 3.0x).

[0214] In this embodiment, the original CSI includes a first CSI, and the optical zoom capability interval corresponding to the original zoom ratio corresponds to a sensor corresponding to the first CSI. In this case, the optical zoom capability interval corresponding to the original zoom ratio corresponds to the first ISP; the target CSI includes a second CSI, and the optical zoom capability interval corresponding to the target zoom ratio corresponds to a sensor corresponding to the second CSI. In this case, the optical zoom capability interval corresponding to the target zoom ratio corresponds to the second ISP. A sensor corresponding to the optical zoom capability interval corresponding to the original zoom ratio is different from a sensor corresponding to the optical zoom capability interval corresponding to the target zoom ratio. For example, a sensor corresponding to the optical zoom capability interval [0.6x, 1.0x) is an ultra-wide-angle sensor, and a sensor corresponding to the optical zoom capability interval [1.0x, 3.0x) is a wide-angle sensor. In this embodiment, the user inputs a zoom instruction, so that the working sensor is switched from the ultra-wide-angle sensor to the wide-angle sensor. Step 802: The driving device determines the target CSI and the target ISP according to the target zoom ratio. The target CSI includes the second CSI, and the target ISP includes the second ISP.

[0215] In an embodiment of the present invention, the original ISP includes a first ISP, and the target ISP includes a second ISP. For example, the optical zoom capability interval corresponding to the target zoom ratio 2.0x is [1.0x, 3.0x), the CSI corresponding to [1.0x, 3.0x) includes the second CSI, and the ISP corresponding to [1.0x, 3.0x) includes the second ISP.

[0216] Step 803: The driving device determines connection configuration parameters according to the original zoom ratio, the target zoom ratio and the zoom mode.

[0217] In an embodiment of the present invention, the connection configuration parameters are used to indicate the processing method between the original CSI and the original ISP, and to indicate the processing method between the target CSI and the target ISP. Among them, the processing method between the original CSI and the original ISP is to disconnect, and the processing method between the target CSI and the target ISP includes establishing a connection. For example, the zoom method is jump zoom, the CSI corresponding to the original zoom ratio includes the first CSI and the ISP corresponding to the original zoom ratio includes the first ISP, the CSI corresponding to the target zoom ratio includes the second CSI and the ISP corresponding to the target zoom ratio includes the second ISP, then the driving device determines that the first CSI is disconnected from the first ISP and the second CSI is connected to the second ISP, so the connection configuration parameters may include configuration parameters for disconnecting the first CSI and the first ISP and configuration parameters for establishing a connection between the second CSI and the second ISP.

[0218] Step 804: The driving device sends the connection configuration parameters to the first CSI.

[0219] In this step, after receiving the connection configuration parameters, the first CSI learns that it needs to disconnect from the first ISP through the configuration parameters for disconnecting the first CSI from the first ISP in the connection configuration parameters.

[0220] Step 805: The driving device sends the connection configuration parameters to the second CSI.

[0221] In this step, after receiving the connection configuration parameters, the second CSI learns that a connection needs to be established with the second ISP through the configuration parameters for establishing a connection between the second CSI and the second ISP in the connection configuration parameters.

[0222] Step 806: The first CSI disconnects from the first ISP according to the connection configuration parameters.

[0223] In this step, the first CSI disconnects from the first ISP according to the configuration parameters for disconnecting the first CSI and the first ISP. Specifically, when the first ISP finishes processing the current frame of image data, the connection configuration parameters take effect, and at this time, the first CSI disconnects from the first ISP. Then, the first ISP stops processing the next frame of image data output by the ultra-wide-angle sensor through the first PHY interface and the first CSI, and the first ISP no longer generates the first output data.

[0224] Step 807: The second CSI establishes a connection with the second ISP according to the connection configuration parameters.

[0225] In this step, the second CSI establishes a connection with the second ISP according to the configuration parameters for establishing a connection between the second CSI and the second ISP. Specifically, when the first ISP completes processing of the current frame image data, the connection configuration parameters take effect, and at this time, the second CSI establishes a connection with the second ISP. Then, the second ISP performs image processing on the next frame image data output by the wide-angle sensor through the second PHY interface and the second CSI to generate second output data.

[0226] In the embodiment of the present invention, two ISPs are used to implement image processing on image data output by more than three cameras, so that the power consumption of the ISP in this embodiment is reduced to 30.02% of the power consumption of the ISP in the related art, and the bandwidth required by the ISP in the embodiment of the present invention is reduced to 31.25% of the bandwidth required by the ISP in the related art, thereby reducing the chip area and reducing the power consumption and required bandwidth of the ISP.

[0227] An embodiment of the present invention provides a storage medium, which includes a stored program. When the program is running, the device where the storage medium is located is controlled to execute the steps of the embodiment of the above-mentioned ISP determination method. For a specific description, please refer to the embodiment of the above-mentioned ISP determination method.

[0228] Fig.10 FIG. 1 is a schematic diagram of the structure of an electronic device provided by an embodiment of the present invention. Fig.10 As shown, the electronic device 30 includes:

[0229] The processor 31, the memory 32, and the computer program 33 stored in the memory 32 and executable on the processor 31, when the computer program 33 is executed by the processor 31, implements the data processing method applied in the embodiment, to avoid repetition, it is not described one by one here. Alternatively, when the computer program is executed by the processor 31, it implements the functions of each model / unit applied in the electronic device 30 in the embodiment, to avoid repetition, it is not described one by one here.

[0230] The electronic device 30 includes, but is not limited to, a processor 31 and a memory 32. Those skilled in the art will appreciate that Figure 4 It is only an example of the electronic device 30 and does not constitute a limitation of the electronic device 30. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, the electronic device 30 may also include input and output devices, network access devices, buses, etc.

[0231] The processor 31 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.

[0232] The memory 32 may be an internal storage unit of the electronic device 30, such as a hard disk or memory of the electronic device 30. The memory 32 may also be an external storage device of the electronic device 30, such as a plug-in hard disk, a Smart Media (SM) card, a Secure Digital (SD) card, a Flash Card, etc. equipped on the electronic device 30. Further, the memory 32 may also include both an internal storage unit of the electronic device 30 and an external storage device. The memory 32 is used to store computer programs and other programs and data required by the computer device. The memory 32 may also be used to temporarily store data that has been output or is to be output.

[0233] In the several embodiments provided by the present invention, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0234] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0235] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0236] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.

Claims

1. A method for determining an image signal processor ISP, It is characterized in that The ISP includes a first ISP and a second ISP, and the method includes: The driving device receives a zoom instruction input by a user, wherein the zoom instruction includes a target zoom ratio and a zoom mode; The driving device determines a target camera serial interface CSI and a target ISP according to the target zoom ratio, which specifically includes: determining an optical zoom capability interval corresponding to the target zoom ratio according to the target zoom ratio, determining the CSI corresponding to the optical zoom capability interval as the target CSI, and determining the ISP corresponding to the optical zoom capability interval as the target ISP; The driving device determines a connection configuration parameter according to the original zoom ratio, the target zoom ratio and the zoom mode, and sends the connection configuration parameter to the original CSI and the target CSI; The original CSI performs a processing method with the original ISP according to the connection configuration parameters and the target CSI performs a processing method with the target ISP according to the connection configuration parameters, the original ISP is the first ISP and / or the second ISP, and the target ISP is the first ISP and / or the second ISP.

2. The method according to claim 1, It is characterized in that The zoom mode is smooth zoom, the original CSI includes a first CSI, the target CSI includes a first CSI and a second CSI, the original ISP includes a first ISP, and the target ISP includes a first ISP and a second ISP; The original CSI performs a processing method with the original ISP according to the connection configuration parameter and the target CSI performs a processing method with the target ISP according to the connection configuration parameter, including: The first CSI maintains a connection with the first ISP according to the connection configuration parameter; The second CSI establishes a connection with the second ISP according to the connection configuration parameters.

3. The method according to claim 1, It is characterized in that The zoom mode is smooth zoom, the original CSI includes the first CSI, the target CSI includes the second CSI and the third CSI, the original ISP includes the first ISP, and the target ISP includes the first ISP and the second ISP; The original CSI performs a processing method with the original ISP according to the connection configuration parameter and the target CSI performs a processing method with the target ISP according to the connection configuration parameter, including: After the first CSI processes the current frame image data through the first ISP, disconnecting the first CSI from the first ISP according to the connection configuration parameters; The second CSI establishes a connection with the first ISP according to the connection configuration parameters after the first CSI disconnects from the first ISP; The third CSI establishes a connection with the second ISP according to the connection configuration parameters.

4. The method according to claim 1, It is characterized in that The zoom mode is smooth zoom, the original CSI includes a first CSI and a second CSI, the target CSI includes a second CSI, the original ISP includes a first ISP and a second ISP, and the target ISP includes a second ISP; The original CSI performs a processing method with the original ISP according to the connection configuration parameter and the target CSI performs a processing method with the target ISP according to the connection configuration parameter, including: After the first CSI processes the current frame image data through the first ISP, disconnecting the first CSI from the first ISP according to the connection configuration parameters; The second CSI maintains the connection with the second ISP according to the connection configuration parameters.

5. The method according to claim 1, It is characterized in that The zoom mode is smooth zoom, the original CSI includes the first CSI and the second CSI, the target CSI includes the second CSI and the third CSI, the original ISP includes the first ISP and the second ISP, and the target ISP includes the first ISP and the second ISP; The original CSI performs a processing method with the original ISP according to the connection configuration parameter and the target CSI performs a processing method with the target ISP according to the connection configuration parameter, including: After the first CSI processes the current frame image data through the first ISP, disconnecting the first CSI from the first ISP according to the connection configuration parameters; The second CSI maintains a connection with the second ISP according to the connection configuration parameter; The third CSI establishes a connection with the first ISP according to the connection configuration parameters after the first CSI disconnects from the first ISP.

6. The method according to claim 1, It is characterized in that The zoom mode is smooth zoom, the original CSI includes the first CSI and the second CSI, the target CSI is the third CSI, the original ISP includes the first ISP and the second ISP, and the target ISP includes the first ISP or the second ISP; The original CSI performs a processing method with the original ISP according to the connection configuration parameter and the target CSI performs a processing method with the target ISP according to the connection configuration parameter, including: After the first CSI processes the current frame image data through the first ISP, disconnecting the first CSI from the first ISP according to the connection configuration parameters; After the second ISP processes the current frame image data, the second CSI disconnects the second ISP according to the connection configuration parameters; The third CSI establishes a connection with the first ISP according to the connection configuration parameters after the first CSI disconnects the connection with the first ISP; or, the third CSI establishes a connection with the second ISP according to the connection configuration parameters after the second CSI disconnects the connection with the second ISP.

7. The method according to claim 1, It is characterized in that The zoom mode is smooth zoom, the original CSI includes the first CSI, the target CSI includes the second CSI, the original ISP is the first ISP, and the target ISP is the second ISP; The original CSI performs a processing method with the original ISP according to the connection configuration parameter and the target CSI performs a processing method with the target ISP according to the connection configuration parameter, including: After the first CSI processes the current frame image data through the first ISP, disconnecting the first CSI from the first ISP according to the connection configuration parameters; The second CSI establishes a connection with the second ISP according to the connection configuration parameters.

8. The method according to claim 1, It is characterized in that The zoom mode is jump zoom, the original CSI includes the first CSI, the target CSI includes the second CSI, the original ISP includes the first ISP, and the target ISP includes the second ISP; The original CSI performs a processing method with the original ISP according to the connection configuration parameter and the target CSI performs a processing method with the target ISP according to the connection configuration parameter, including: The first CSI disconnects the connection with the first ISP according to the connection configuration parameter; The second CSI establishes a connection with the second ISP according to the connection configuration parameters.

9. An electronic device, It is characterized in that include: A driving device, used for receiving a zoom instruction input by a user, wherein the zoom instruction includes a target zoom ratio and a zoom mode; Determine a target CSI and a target ISP according to the target zoom ratio, wherein the method specifically includes: determining an optical zoom capability interval corresponding to the target zoom ratio according to the target zoom ratio, determining the CSI corresponding to the optical zoom capability interval as the target CSI, and determining the ISP corresponding to the optical zoom capability interval as the target ISP; determining a connection configuration parameter according to the original zoom ratio, the target zoom ratio and the zoom mode, and sending the connection configuration parameter to the original CSI and the target CSI; The original CSI is used to execute a processing method with the original ISP according to the connection configuration parameters, and the original ISP is the first ISP and / or the second ISP; The target CSI is used to execute a processing method with the target ISP according to the connection configuration parameters, and the target ISP is the first ISP and / or the second ISP.

10. An electronic device, It is characterized in that The electronic device comprises one or more processors; a memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions, which, when executed by the electronic device, enable the electronic device to perform the method described in any one of claims 1 to 8.

11. A computer-readable storage medium, It is characterized in that The computer-readable storage medium includes a stored program, wherein when the program is executed, the device where the computer-readable storage medium is located is controlled to execute the method according to any one of claims 1 to 8.

Images