Camera control method and device, terminal and computer readable storage medium

Abstract

The application discloses a camera control method and device, a terminal and a computer readable storage medium, which can improve the smoothness of image effect transition in the zooming process on the basis of reducing power consumption. The method comprises the following steps: in a first camera preview or recording scene, a target camera is enabled; in response to a first type of image processing flow, raw data collected by the target camera is processed to determine target effect data; the first camera is subjected to effect consistency processing according to the target effect data to determine first control parameters corresponding to the first camera; and in response to a zooming instruction received in the preview or recording scene, the first camera and the target camera are controlled to realize zooming based on the first control parameters.

Description

Technical Field

[0001] This application relates to the field of terminal camera technology, and in particular to a camera control method, device, terminal and computer-readable storage medium. Background Technology

[0002] Currently, for terminals equipped with multiple cameras, zooming is typically performed in the preview interface output by the main camera. Zooming triggers the activation of the secondary cameras, and the zoom ratio is then smoothly transitioned by switching between the main and secondary cameras. However, due to the differences in imaging effects and styles between different cameras, abrupt changes in image effects such as brightness can occur when switching zoom between different cameras, reducing the smoothness of image effect transitions during zooming. Summary of the Invention

[0003] This application aims to provide a camera control method, device, terminal, and computer-readable storage medium that can improve the smoothness of image effect transitions during zooming while reducing power consumption.

[0004] The technical solution of this application is implemented as follows:

[0005] In a first aspect, this application provides a camera control method, the method comprising:

[0006] Enable the target camera in the first camera preview or recording scenario;

[0007] In response to the first type of image processing flow, the raw data acquired by the target camera is processed to determine the target effect data;

[0008] Based on the target effect data, the first camera is subjected to effect consistency processing to determine the first control parameter corresponding to the first camera;

[0009] In response to a zoom command received in the preview or recording scene, the first camera and the target camera are controlled to zoom based on the first control parameters.

[0010] Secondly, this application provides a camera control device, the device comprising:

[0011] A startup module is used to enable a target camera when the first camera is previewing or recording a scene; the target camera includes features for synchronizing the imaging effects of multiple cameras.

[0012] The data processing module is used to process the raw data collected by the target camera in response to the first type of image processing flow, and to determine the target effect data; the first type of image processing flow only includes functional nodes for determining the camera imaging effect data;

[0013] The consistency processing module is used to perform effect consistency processing on the first camera based on the target effect data, and determine the first control parameter corresponding to the first camera;

[0014] The zoom module is used to respond to a zoom command received in the preview or recording scene and control the first camera to zoom in on the target camera based on the first control parameters.

[0015] Thirdly, this application provides a terminal, including a memory and a processor; wherein,

[0016] The memory is used to store executable instructions;

[0017] The processor is used to implement the camera control method provided in the embodiments of this application when executing executable instructions stored in the memory.

[0018] Fourthly, this application provides a computer-readable storage medium storing executable instructions for inducing a processor to execute and implement the camera control method provided in the embodiments of this application.

[0019] Fifthly, embodiments of this application provide a computer program product, including a computer program or instructions, which, when executed by a processor, implement the camera control method provided in embodiments of this application.

[0020] This application provides a camera control method, apparatus, terminal, and computer-readable storage medium. In a preview or recording scenario where a first camera is the main camera, a target camera is activated. A first type of image processing flow is used to process the raw data acquired by the target camera to determine target effect data. Since the target camera can be used to synchronize the imaging effects of multiple cameras, the first camera is processed for effect consistency using the target effect data determined by the target camera to determine first control parameters. This allows the imaging effect of the first camera under the first control parameters to be close to the imaging effect of the target camera. Upon receiving a zoom command, zooming is achieved using the first camera with the first control parameters in conjunction with the target camera. This ensures that the imaging effects of all cameras involved in the zoom process move closer to the target camera, thereby improving the smoothness of image transitions during zooming. Furthermore, the first type of image processing flow corresponding to the target camera only includes functional nodes for determining image effect data, enabling the extraction of effect data through a lightweight image processing pipeline and reducing terminal power consumption. Thus, while reducing power consumption, the smoothness of image effect transitions during zooming is improved. Attached Figure Description

[0021] Figure 1This is a schematic diagram of the switching timing of the current spatial alignment transformation zoom;

[0022] Figure 2 Flowchart of the camera control method provided in the embodiments of this application Figure 1 ;

[0023] Figure 3 This is a schematic diagram of the main and secondary camera ISP pipeline configuration in a preview or recording scenario provided in the embodiments of this application.

[0024] Figure 4 Flowchart of the camera control method provided in the embodiments of this application Figure 2 ;

[0025] Figure 5 Flowchart of the camera control method provided in the embodiments of this application Figure 3 ;

[0026] Figure 6 A schematic diagram illustrating the activation range of each camera on a terminal provided in this application embodiment;

[0027] Figure 7 A schematic diagram illustrating an optional process for applying the camera control method provided in this application embodiment to a real-world scenario;

[0028] Figure 8 This is a schematic diagram of an optional structure of the camera control device provided in an embodiment of this application;

[0029] Figure 9 This is a schematic diagram of an optional structure of a terminal provided in an embodiment of this application. Detailed Implementation

[0030] To make the objectives, technical solutions, and advantages of this application clearer, the application will be further described in detail below with reference to the accompanying drawings. The described embodiments should not be regarded as limitations on this application. All other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0031] In the following description, references are made to “some embodiments,” which describe a subset of all possible embodiments. However, it is understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0032] In the following description, the terms "first, second, third" are used merely to distinguish similar objects and do not represent a specific ordering of objects. It is understood that "first, second, third" may be interchanged in a specific order or sequence where permitted, so that the embodiments of this application described herein can be implemented in an order other than that illustrated or described herein.

[0033] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of this application only and is not intended to limit this application.

[0034] The nouns and terms used in the embodiments of this application are explained below, and the nouns and terms used in the embodiments of this application shall be interpreted as follows:

[0035] 1. Multi-Camera Consistency: During manufacturing, camera modules containing multiple cameras can exhibit variations in image quality due to assembly tolerances and differences in incoming materials. For critical parameters affecting image quality, such as white balance and lens shading correction, the device typically stores only one set of software parameters adapted to the entire camera module. These individual camera differences lead to variations in the images captured by different cameras. For example, in the same environment, different cameras may produce images that are either too bright or too dark, and in severe cases, color casts may occur. Therefore, current multi-camera phones typically employ a multi-camera consistency (e.g., triple-camera consistency) solution. This solution aligns the imaging effects or styles (such as dynamic range and color cast) of the multiple cameras in the camera module towards those of a single camera, ensuring a consistent image quality across all cameras.

[0036] 2. Spatial Alignment Transform (SAT) zoom: SAT zoom uses different fixed-focus lenses in succession to achieve continuous changes in focal length, and by integrating digital zoom, it ultimately achieves a continuous and smooth zoom effect.

[0037] 3. Fallback: Fallback is a type of SAT zoom that the camera automatically triggers under certain conditions. SAT zoom can be triggered by user actions such as tapping or swiping, or by fallback. For example, fallback can include SAT zoom triggered based on the shooting scene distance and ambient light. Taking 5x zoom as an example, it might require switching to the telephoto lens. However, if the current environment is macro (the distance between the camera and the subject is less than or equal to a preset distance), which creates a magnifying glass effect for the user, the camera will first switch to another lens (such as a wide-angle lens). In other words, it should have switched to the telephoto lens, but due to the close distance or low light, the long focal length of the telephoto lens would cause image blurring, thus triggering the fallback mechanism to switch to another camera.

[0038] 4. 3A: 3A refers to the collective term for Auto Exposure (AE), Auto White Balance (AWB), and Auto Focus (AF).

[0039] 5. Field of view (FOV): also known as viewing angle, refers to the angular range in which a camera can receive images in an imaging scene, and is often referred to as the field of view.

[0040] 6. Image Signal Processing (ISP)

[0041] Currently, multi-lens configurations (such as ultra-wide-angle + wide-angle + telephoto) have become the mainstream in camera development. Achieving smooth switching between multiple lenses has become a key consideration. A hard switch with a single lens can result in noticeable jumps due to parallax and sensor configuration limitations. Therefore, better leveraging the capabilities of dual cameras in multi-lens switching scenarios is a crucial area for future imaging solutions.

[0042] Currently, on multi-lens devices, dual-camera scenarios involving lens switching mainly include SAT zoom scenarios. Due to the thickness limitations of devices, such as mobile phones, it is difficult to integrate zoom lenses with complex optical structures. Therefore, a fixed-focus lens relay method is generally used to achieve the zoom effect. Typically, the secondary camera is only activated when a zoom event such as a point-and-click or swipe is triggered in the preview scene of the main camera. Moreover, the image processing pipeline (ISP pipeline) configuration of the secondary camera is basically the same as that of the main camera to ensure a seamless switch to the secondary camera during SAT switching. For example, taking SAT zoom from an ultra-wide (UW) camera to a wide (W) camera as an example, the zoom process can be as follows: Figure 1 As shown. When a user enters a preview scene containing SAT zoom functionality through the application, the upper-layer interface module (which can be a hardware abstraction layer used to interact with the upper-layer application layer or framework layer) initializes the spatial alignment transformation module. In this preview scene, the UW camera is the main camera, and the W camera is not enabled.

[0043] Figure 1 In the process, if the user performs a swipe or point-and-click operation in the preview scene after initialization, i.e., a swipe / point-and-click event occurs, a zoom switch from the UW camera to the W camera is initiated. The upper-layer interface module sends a command to the session management module to start the W camera, instructing it to start as a secondary camera. The session management module forwards the start command to the W camera. The W camera performs image acquisition as a secondary camera according to the start command and initiates a pipeline status update for its corresponding image processing pipeline to the image processing pipeline management module.

[0044] Figure 1 In the process, the upper-layer interface module sends a dual-camera fusion command to the spatial alignment transformation module, instructing the spatial alignment transformation module to confirm the alignment status of the primary and secondary cameras frame by frame. If the alignment status meets the preset requirements, the spatial alignment transformation module sends the alignment result, indicating synchronization, to the upper-layer interface module. If the upper-layer interface module receives the alignment result, it indicates that the switching can achieve a relatively smooth effect. The upper-layer interface module then sends a primary / secondary camera switching command to the sensor management module. Upon receiving confirmation from the sensor management module, it sends a command to the UW camera to shut down the ultra-wide-angle lens, thereby shutting down the UW camera. The UW camera then initiates a status update of its corresponding image processing flow to the pipeline management module, completing the zoom switch from the UW camera to the W camera. The upper-layer interface module then performs deinitialization on the spatial alignment transformation module, releasing the system resources occupied by the spatial alignment transformation module.

[0045] During the aforementioned zoom process, due to differences in imaging effects and styles between different cameras (such as UW and W cameras), abrupt changes in image effects such as brightness occur when switching between different cameras, reducing the smoothness of zooming. Based on the current SAT zoom solution, optimization of the smoothness of SAT zoom transitions typically focuses on two aspects: firstly, increasing the number of transition frames during lens switching; and secondly, using a better fusion algorithm while keeping the number of transition frames constant. However, with a fixed frame rate, increasing the number of transition frames leads to longer switching times, affecting the responsiveness of zooming; improvements to the fusion algorithm also have limits, and the current room for optimization is not significant. Therefore, optimizing the switching effect based on the current SAT zoom solution faces considerable limitations.

[0046] Furthermore, if, in order to improve the smoothness of zoom switching, the secondary camera is enabled to synchronize its imaging effect with the main camera in advance during preview or recording, this will lead to increased power consumption. On the other hand, if synchronization is only based on the current main and secondary cameras, then to ensure consistency across multiple cameras, the imaging effect still needs to be synchronized with the standard camera (such as the W camera) after the SAT fusion process is complete. This can easily cause secondary convergence issues, resulting in a revert in brightness or AWB effects (for example, if the brightness was darkened during the SAT fusion process, it will be brightened again after synchronizing with the W camera, etc.). Therefore, the smoothness of image transitions is still reduced.

[0047] This application provides a camera control method, device, terminal, and computer-readable storage medium, which can improve the smoothness of image effect transitions during zooming while reducing power consumption. The camera control method of this application can be as follows: Figure 2 As shown, including S101-S104, as follows:

[0048] S101. In the preview or recording scenario of the first camera, enable the target camera.

[0049] The camera control method of this application embodiment is applied to a terminal equipped with at least two cameras. In some embodiments, the terminal may be various types of user terminals such as mobile phones, tablets, laptops, desktop computers, smart speakers, smartwatches, and wearable smart devices, but is not limited thereto.

[0050] In this embodiment, upon entering a preview or recording scene, the first camera is activated to output a preview or recorded image; and the target camera is enabled. The target camera includes a reference camera whose imaging effects are synchronized with those of multiple cameras.

[0051] In some embodiments, the first camera that outputs preview or recorded images in a preview or recording scene can be used as the main camera, and the target camera can be used as the secondary camera. The specific choice depends on the actual situation, and this application embodiment does not limit it.

[0052] In other words, the target camera serves as the reference camera in the multi-camera consistency scheme, providing standard imaging data. Multiple cameras on the terminal synchronize their imaging results with the target camera to ensure consistency across all cameras on the terminal.

[0053] As can be seen, compared with the current related technologies, the embodiments of this application turn on the target camera to provide a reference benchmark for the imaging effect of all lenses when the first camera is previewing or recording; instead of merely referencing the imaging effect parameters of the secondary camera as in the current related technologies.

[0054] In this embodiment, the preview or recording scene includes or has a zoom function. For example, it may include SAT zoom function, etc. The specific selection is based on the actual situation, and this embodiment does not limit it.

[0055] In some embodiments, the target camera may include a wide-angle camera, and the first camera may include any one of an ultra-wide-angle camera, a telephoto camera, or an ultra-telephoto camera. Alternatively, the target camera and the first camera may be determined according to the actual camera configuration of the terminal, and the specific selection is made according to the actual situation. This application embodiment does not limit the choice.

[0056] S102, In response to the first type of image processing flow, process the raw data collected by the target camera to determine the target effect data.

[0057] In this application, when the target camera is enabled, light enters the target camera through its lens and reaches its sensor. The sensor then performs photoelectric sensing, converting the optical signal into an electrical signal, which is further converted into a digital signal by internal analog-to-digital circuitry to obtain raw data. For example, the raw data may be Bayer raw data.

[0058] In this embodiment, for a target camera activated as a secondary camera in a preview or recording scenario, the raw data collected is processed through a first type of image processing flow to obtain imaging effect-related data as target effect data. The first type of image processing flow only includes functional nodes for determining the imaging effect data.

[0059] In other words, for preview or recording scenarios where the first camera is the main camera, the raw data acquired by the first camera is processed through a normal or general image processing pipeline (ISP pipeline) to output a preview image or recorded image in the preview or recording scenario. However, for the target camera, which is activated as a secondary camera, its purpose is only to obtain data related to the imaging effect of the target camera for multi-camera consistency synchronization. Therefore, for the ISP pipeline corresponding to the target camera, functional nodes in the general ISP pipeline that are unrelated to the camera's imaging effect can be omitted or skipped. In this way, the raw data acquired by the target camera is processed through a lightweight image processing pipeline (the second type of image processing pipeline) to obtain the target effect data.

[0060] For example, the target effect data can be the 3A statistics of the target camera. Other imaging effect-related data can also be determined as effect data according to the needs of the actual project. The specific selection is based on the actual situation and is not limited in this application embodiment.

[0061] In this embodiment, when the target camera is turned on as a secondary camera in a preview or recording scenario where the first camera is the main camera, the ISP pipeline configured for the target camera only extracts the target effect data. If the target effect data is extracted, the original image data can be discarded without subsequent image processing and image output.

[0062] As can be seen, when previewing a scene with zoom functionality, compared to current preview strategies, this embodiment not only activates the current main camera but also activates the target camera as a secondary camera using a lightweight image processing workflow. This ensures that the imaging effects of all cameras (such as 3A effects) are uniformly aligned with the imaging effect of the target camera. Furthermore, through a customized lightweight ISP pipeline, system power consumption and switching time are saved while ensuring synchronized imaging effects (the simpler the pipeline, the faster the switching).

[0063] S103. Based on the target effect data, perform effect consistency processing on the first camera and determine the first control parameters corresponding to the first camera.

[0064] In this embodiment, the target effect data represents the benchmark data for consistent synchronization of imaging effects among multiple cameras on the terminal. Using the target effect data, effect consistency processing is performed on the first camera to determine the first control parameters corresponding to the first camera, so that the imaging effect of the first camera under the first control parameters is close to the imaging effect of the target camera.

[0065] In some embodiments, a first raw image captured by a first camera according to initial first control parameters can be acquired; effect data is extracted from the first raw image to determine first effect data. For example, the first effect data may be 3A statistical data from the first camera. The initial first control parameters are updated by performing effect consistency processing on the target effect data and the first effect data to determine the first control parameters.

[0066] In some embodiments, taking the effect data containing 3A statistical data as an example, effect consistency processing can be implemented through a 3A consistency algorithm in the ISP module on the terminal. For example, using the 3A statistical data corresponding to the target camera as a benchmark, 3A data alignment processing can be performed on the 3A statistical data corresponding to the first camera to obtain the difference between the 3A statistical data corresponding to the target camera and the 3A statistical data corresponding to the first camera. Based on this difference, new control parameters (such as AE parameters, AF parameters, AWB parameters, etc.) corresponding to the first camera are generated using the 3A consistency algorithm, so that when the first camera is controlled to acquire images according to the new control parameters, the 3A effect (such as sharpness, brightness, color, etc.) of the acquired image is close to that of the target camera. The initial first control parameters are updated using the new control parameters generated by the 3A consistency algorithm to obtain the first control parameters.

[0067] In some embodiments, if no zoom command is received in the preview or recording scene, the process continues in the preview or recording scene. In this case, the raw data acquired by the target camera can continue to be processed through the first type of image processing flow to update the target effect data. Using the updated target effect data, effect consistency processing is performed on the first camera to update the first control parameters. Thus, images can be acquired through the first camera based on the continuously updated first control parameters to determine a preview image or a recorded image, and then output as a preview image stream or a recorded image stream. It is understood that since the first control parameters are determined or updated using the target effect data for effect consistency processing, the image effect of the preview image or recorded image is close to the image effect of the target camera.

[0068] In some embodiments, the first control parameter includes: the number of exposures. After updating the initial first control parameter and determining it, if the number of exposures corresponding to the initial first control parameter is less than the number of exposures corresponding to the first control parameter, the preset cache module can be powered on and enabled. If the number of exposures corresponding to the initial first control parameter is greater than the number of exposures corresponding to the first control parameter, the preset cache module can be powered off. The preset cache module is used to store the first raw data acquired by the first camera. For example, the preset cache module can be a Double Data Rate (DDR) memory. Furthermore, the operating frequency of the DDR memory must be strictly matched to the image resolution to avoid increasing power consumption. In this way, the DDR associated with the sensor can be optimized for different scenarios of single and double exposures, avoiding over-allocation of resources and reducing system resource consumption.

[0069] S104. In response to a zoom command received in a preview or recording scene, control the first camera and the target camera to zoom based on the first control parameters.

[0070] In this embodiment of the application, when a zoom operation is triggered in a preview or recording scene, the application layer responds to the zoom operation by sending a zoom command from the current main camera, such as the first camera, to other cameras to the frame layer corresponding to the camera.

[0071] In some embodiments, when a zoom event such as a point-to-click or swipe-to-zoom event is received on the preview interface, or when the preview interface triggers a fallback, a SAT zoom operation is determined. The zoom ratio is determined based on the zoom operation, and the camera to which the zoom command is directed is determined based on the zoom ratio.

[0072] In some embodiments, at least one zoom command can be determined based on the zoom operation. For example, if the zoom operation represents a zoom from 2X to 5X, a zoom command from 2X to 3X and a zoom command from 3X to 5X can be determined. This allows for relay zooming of cameras with different focal length ranges during the zoom process using at least one zoom command, improving zoom smoothness.

[0073] In this embodiment, during zooming, an image is acquired using a first camera based on first control parameters to determine a first image. During zooming, the target camera remains active, and the corresponding image processing flow for the target camera is determined based on whether the zoom command indicates zooming towards the target camera. This flow is categorized as either a first-type or second-type image processing flow. The raw data acquired by the target camera is then processed using the corresponding image processing flow, and zooming is achieved by combining the data with the first image.

[0074] In some embodiments, controlling the first camera and the target camera to achieve zoom based on the first control parameter can be categorized into the following cases:

[0075] In the first scenario, when the zoom command indicates zooming towards the target camera, the first type of image processing flow corresponding to the target camera in the preview or recording scenario is switched to the second type of image processing flow. Through the second type of image processing flow, the raw data acquired by the target camera is processed and a displayable image (i.e., the target image) is output. The zoomed image is obtained by combining the first image and the target image, and then output, thus transforming the currently displayed preview image or recorded image into a zoomed image. It can be understood that since the currently displayed preview image or recorded image is acquired by the first camera, which has undergone effect consistency processing with the target camera, the effect of transforming from the currently displayed preview image or recorded image to the zoomed image is smooth. Furthermore, during the zooming process towards the target camera, the target effect data is continuously updated through the second type of image processing flow, and the target image continues to be acquired. The first control parameters of the first camera are also updated based on the updated target effect data, and the first image continues to be acquired. The first image and the target image are then combined to complete the zoom from the first camera to the target camera.

[0076] When the zoom command indicates zooming to a camera other than the target camera, such as zooming from the first camera to the second camera (the second camera is any camera other than the first camera and the target camera among the multiple cameras of the terminal), the target camera remains enabled, and the target effect data is extracted from the raw data collected by the target camera through the first type of image processing flow. Based on the target effect data, the second camera is processed to ensure consistent effect, so that the imaging effect of the second camera, the first camera and the target camera are consistent across the three cameras. Then, based on the second image and the first image collected by the second camera, zooming from the first camera to the second camera is achieved.

[0077] Understandably, in preview or recording scenarios where the first camera is the main camera, the target camera is activated. The raw data acquired by the target camera is processed through a first-type image processing flow to determine the target effect data. Since the target camera can be used to synchronize the imaging effects of multiple cameras, using the target effect data determined by the target camera to perform effect consistency processing on the first camera and determine the first control parameters allows the imaging effect of the first camera under the first control parameters to be close to that of the target camera. Upon receiving a zoom command, using the first camera with the first control parameters, combined with the target camera, to achieve zooming allows the imaging effects of the cameras involved in the zoom process to approach those of the target camera, thereby improving the smoothness of image transitions during zooming. Furthermore, the first-type image processing flow corresponding to the target camera only includes functional nodes for determining camera imaging effect data, achieving effect data extraction through a lightweight image processing pipeline and reducing terminal power consumption. Thus, while reducing power consumption, the smoothness of image effect transitions during zooming is improved.

[0078] In some embodiments, the first type of image processing flow includes: a first sensor preprocessing node and a first image preprocessing node; the above-mentioned processing of the raw data acquired by the target camera through the first type of image processing flow to determine the target effect data includes:

[0079] The first sensor preprocessing node processes the raw data collected by the target camera each time to determine the target raw image corresponding to each collection; the first image preprocessing node extracts effect data from the target raw image corresponding to each collection to determine the target effect data.

[0080] For example, the first sensor preprocessing node can be a Sensor Front End (SFE) node in the ISP pipeline, and the first image preprocessing node can be an Image Front End (IFE) node in the ISP pipeline. The SFE module processes the raw data acquired by the sensor to generate the raw image, while the IFE performs statistical analysis on the raw image's 3A data to generate effect data. Taking a telephoto camera as the first camera and a wide-angle camera as the target camera as an example, in a preview or recording scenario where the telephoto camera is the main camera, the main and secondary camera ISP pipeline configuration can be as follows: Figure 3As shown in the diagram, the telephoto camera is configured with a standard ISP pipeline. Besides the second sensor preprocessing node (the SFE node corresponding to the telephoto camera), the second image preprocessing node (the IFE node corresponding to the telephoto camera), and an Image Processing Engine (IPE) node, it uses algorithms to improve image sharpness, texture detail, tone, color, and sharpening. Finally, the image generated by the telephoto camera is sent for display. The wide-angle camera is configured with a lightweight ISP pipeline, i.e., a second-type image processing flow, consisting only of the first sensor preprocessing node (the SFE node corresponding to the wide-angle camera) and the first image preprocessing node (the IFE node corresponding to the wide-angle camera). Since the wide-angle camera is only used to provide target effect data in this case, it does not need to be configured with IPE nodes.

[0081] based on Figure 3 When a user opens the camera and enters a mode with SAT functionality (such as photo and video modes), image preview begins. Upon entering a preview or recording scene, the wide-angle camera simultaneously activates as a secondary camera, outputting raw data. The raw image is then output through the first sensor pre-processing node. After receiving the raw image, the first image pre-processing node extracts 3A statistical data. The extracted 3A statistical data from the wide-angle camera is then sent to the 3A synchronization module. The 3A data from the telephoto camera is sent to the 3A synchronization module through the second image pre-processing node. Since the main and secondary cameras may have different frame rates, the 3A synchronization module will select the 3A statistics of the wide-angle camera whose exposure start time is closest to its own after the telephoto camera's 3A statistics arrive, and process them together through a consistency processing algorithm (3A alignment). Finally, it will provide the corrected 3A control parameters of the main camera (i.e., the first control parameter) to control the telephoto camera's frame output, so that the 3A effect of the telephoto camera is close to the frame output effect of the wide-angle camera. Until the SAT zoom switching is triggered, if the wide-angle camera becomes the camera to be zoomed in, the first type of image processing flow will only be closed when the image is output through the normal ISP pipeline; otherwise, the first type of image processing flow will continue to process the raw data of the target camera.

[0082] In some embodiments, in a preview or recording scenario where the first camera is the main camera, the first image preprocessing node discards the original target image data acquired each time after determining the target effect data. This is because to generate a displayable image, the image after IFE processing still needs to undergo many image effect-related processes. However, this implementation uses a customized lightweight ISP pipeline only to obtain accurate effect data and does not require image data. Therefore, after obtaining the effect data (such as 3A statistical data), the original target image acquired each time can be directly discarded. This greatly simplifies the secondary camera's ISP pipeline, reduces system power consumption, improves the speed of starting and stopping the ISP pipeline, and reduces the occupation of system resources (such as buffers).

[0083] It should be noted that in some embodiments, the processing algorithms within the first IFE can be further optimized based on the needs of the scenario. Some algorithm nodes related to image processing that do not affect the calculation results of 3A statistical data can be omitted, thereby further simplifying the pipeline processing flow, reducing power consumption, and improving switching speed.

[0084] In some embodiments, the process of activating the target camera may include: configuring the target camera based on a preset preview resolution and / or a preset preview frame rate; activating the target camera and collecting raw data according to the preset preview resolution and / or preset preview frame rate to complete the activation of the target camera; wherein the preset preview resolution is less than a preset resolution threshold; and the preset preview frame rate is less than a preset frame rate threshold.

[0085] Understandably, in the preview or recording scenario where the first camera is the main camera, since the target camera does not need to output images, the target camera can be configured to run at a low frame rate and / or low resolution, further reducing system power consumption and system resource usage.

[0086] It should be noted that if you enter a preview or recording scene where the target camera is the main camera, you can turn on only the target camera to output the preview or recorded image through the normal ISP pipeline, without turning on the secondary camera.

[0087] In some embodiments, based on Figure 2 ,like Figure 4 As shown, in response to a zoom command received in a preview or recording scene, the zoom process in S104 above, based on the first camera and the first control parameters, combined with the target camera, can be implemented through S201-S203, as follows:

[0088] S201. When the zoom command indicates zooming from the first camera to the target camera, the first type of image processing flow is switched to the second type of image processing flow. The raw data collected by the target camera during the zooming process is processed through the second type of image processing flow to update the target effect data and obtain the target image.

[0089] In S201, the second type of image processing flow is used to generate a displayable image. The second type of processing flow includes nodes from the first type of image processing flow. When a zoom command indicates zooming from the first camera to the target camera, it indicates that an image needs to be output from the target camera to facilitate zoom transition and switching with the first camera. Therefore, by processing the raw data acquired by the target camera during the zooming process using the second type of image processing flow, both effect data extraction based on the raw data can be performed to update the target effect data, and the target image can be obtained.

[0090] For example, the second type of image processing flow may include the entire ISP processing flow, and some flow nodes may be added or removed as needed. The specific selection is based on the actual situation, and this application embodiment does not limit it.

[0091] S202. Using the updated target effect data, perform effect consistency processing on the first camera and update the first control parameters so that the first camera can acquire the first image using the updated first control parameters.

[0092] In S202, the updated target effect data is used to perform effect consistency processing on the first camera, consistent with the corresponding process described in S103 above. This updates the first control parameters of the first camera, allowing it to continue acquiring the first image.

[0093] S203. By combining the first image and the target image, zoom is achieved from the first camera to the target camera.

[0094] In some embodiments, during the zooming process from the first camera to the target camera, the first image acquired by the first camera according to the updated first control parameters is digitally fused and zoomed with the target image output by the target camera to obtain the zoomed image displayed during the zooming process, until the zooming switch is completed, the target camera becomes the main camera, and the first camera is turned off.

[0095] It should be noted that the second type of image processing workflow differs from the first type. During the switch from the first to the second type, the target camera can be either stopped and restarted, or the flow to the target camera can remain continuous. This means the target camera can maintain an outgoing flow during pipeline switching, achieving uninterrupted mode switching and thus saving switching time. For SAT transformation scenarios, this also saves sensor start-up time and improves zoom switching speed.

[0096] It should be noted that the target camera typically operates at a low frame rate in preview or recording scenarios. In some embodiments, when the zoom command indicates zooming from the first camera to the target camera, the target camera needs to output images at the same frame rate as the first camera. Here, when the zoom command indicates zooming from the first camera to the target camera, the target camera can be reconfigured according to the first frame rate corresponding to the first camera, so that the target camera acquires raw data at the first frame rate, synchronizing with the frame rate of the first camera.

[0097] In some embodiments, in a preview or recording scenario where the first camera is the main camera, after extracting target effect data from the original target image captured by the target camera through a first type of image processing flow, the original target image may not be discarded. Instead, image content smoothing processing is performed on the original target image and the first image captured by the first camera to obtain an initial fused image. The original target image has a lower resolution than the first image, but a larger field of view. This allows for preliminary fusion of image content between the target image (with a lower resolution but a larger field of view) and the first image. The initial fused image is not displayed if zoom is not triggered. Upon receiving a zoom command indicating zoom from the first camera to the target camera in a preview or recording scenario, the first type of image processing flow is switched to a second type of image processing flow. The original data captured by the target camera is processed using the second type of image processing flow to obtain the target image. Then, digital fusion zoom is performed based on the first image, the initial fused image, and the target image to achieve zoom from the first camera to the target camera.

[0098] Here, digital fusion zoom between the target image and the first image can be achieved through pixel prediction. For example, an interpolation algorithm can be used to determine the colors around existing pixels, and pixels added using a special algorithm can be inserted based on the surrounding colors to achieve a smooth transition of image content. Since the initial fused image is also obtained by fusing the image content of the target camera and the first image, combining the initial fused image with pixel prediction can achieve a better fusion effect and further improve the smoothness of zoom switching.

[0099] In some embodiments, based on Figure 2 ,like Figure 5 As shown, the above S102 can be implemented by S301-S303, as follows:

[0100] S301. When the zoom command indicates zooming from the first camera to the second camera, activate the second camera while keeping the first camera and the target camera enabled.

[0101] S302. Continue to process the raw data collected by the target camera during zooming through the first type of image processing flow, and update the target effect data.

[0102] In this embodiment, when the zoom command indicates zooming from the first camera to the second camera, the second camera is activated as a secondary camera for image output, while the target camera remains enabled. The raw data collected by the target camera during the zooming process is then processed through the first type of image processing flow to update the target effect data.

[0103] S303. Using updated target effect data, perform effect consistency processing on the first camera and the second camera, and achieve zoom through the effect consistency processing of the first camera and the second camera.

[0104] In some embodiments, the first control parameters are updated based on the updated target effect data, and the second control parameters corresponding to the second camera are determined; an image is acquired using the updated first control parameters through the first camera to determine a first image; an image is acquired using the second camera based on the second control parameters to determine a second image; and the first image and the second image are combined to achieve zoom from the first camera to the second camera.

[0105] In this embodiment, updated target effect data is used to perform effect consistency processing on the first camera and the second camera, thereby updating the first control parameter corresponding to the first camera and determining the second control parameter corresponding to the second camera. The process of performing effect consistency processing on the first camera and the second camera is similar to the process of performing effect consistency processing on the first camera described above, and will not be repeated here.

[0106] In other words, even when zooming doesn't involve the target camera's focal length, the target camera still uses a lightweight ISP pipeline, allowing up to three pipelines to exist simultaneously. This is to ensure that focal lengths without a target camera (e.g., 6x and above in a quad-camera SAT when the wide-angle camera is the target camera) can still adjust their imaging based on the target camera's performance data. Essentially, the imaging effects of both the main and secondary cameras during zooming are synchronized with the target camera's imaging effects, rather than only between the current main and secondary cameras. This achieves consistency across all focal lengths and scenes, preventing secondary convergence or abrupt changes in image quality after SAT completion at certain focal lengths, thus improving the user experience.

[0107] In some embodiments, during the zooming process from the first camera to the second camera, the first image captured by the first camera according to the updated first control parameters and the second image captured by the second camera according to the second control parameters are digitally fused and zoomed to obtain the zoomed image displayed during the zooming process, until the zoom switch is completed, the second camera becomes the main camera, and the first camera is turned off.

[0108] In some embodiments, after completing the zoom process from the first camera to the second camera, the first camera is turned off, and the second camera becomes the main camera. At this time, the target camera remains active, and the target effect data continues to be updated through the first type of image processing flow. Thus, in scenarios where zooming ends and the second camera is used as the main camera for previewing, the second control parameters of the second camera are updated based on the updated target effect data to achieve consistent effect processing for the currently active camera; or, when zooming from the second camera to other cameras, consistent effect processing is performed on the cameras active during the current zooming process based on the updated target effect data. This continues until a zoom command to zoom from the third camera to the target camera is received, at which point the first type of image processing flow is switched to the second type of image processing flow. Through the second type of image processing flow, effect data is extracted and image processing is performed on the raw data acquired by the target camera, the target effect data is updated, and a target image is obtained. Then, using the updated target effect data, consistent effect processing is performed on the currently active third camera, and combined with the target image, zooming from the third camera to the target camera is achieved.

[0109] Specifically, updated target effect data can be used to perform effect consistency processing on the third camera, obtaining the third control parameters corresponding to the third camera. Images are acquired using the third camera based on the third control parameters to determine the third image; by combining the third image with the target image, such as performing digital fusion zoom on the third and target images, zooming from the third camera to the target camera can be achieved.

[0110] For example, the terminal is configured with a wide-angle camera, an ultra-wide-angle camera, a telephoto camera, and an ultra-telephoto camera, wherein the wide-angle camera is the target camera. The activation range of each camera can be as follows: Figure 6 As shown, apart from the wide-angle camera, all other cameras are enabled within their respective focal lengths, outputting frames at a normal frame rate (30bps) and resolution (12MP). For example, the ultra-wide-angle camera is enabled in the 0.6X-1X focal length range; the telephoto camera is enabled in the 3X-6X focal length range; and the super-telephoto camera is enabled in the 6X-8X focal length range. The wide-angle camera is enabled across all focal lengths. In its corresponding 1X-3X focal length range, it is configured with a normal frame rate (30bps) and resolution (12MP), outputting frames normally through the second type of image signal processing. In other focal lengths, the wide-angle camera remains active, configured with a low frame rate (15bps) and low resolution (3MP), providing target effect data for consistent imaging results to other cameras in the corresponding focal lengths through the first type of image signal processing. This approach optimizes system power consumption while meeting consistency requirements, resulting in a better user experience.

[0111] Below, in conjunction with Figure 7 Taking a terminal equipped with a first camera and a target camera as an example, this paper illustrates an example of the application of this application in a real-world scenario through the zoom switching process between the first camera and the target camera.

[0112] S401, Start the camera.

[0113] S402, Enter the preview or recording scene of the first camera as the main camera.

[0114] In S401-S402, by enabling photo preview or other shooting modes or focal lengths with triple-camera consistency, one can enter a preview or recording scene. The first camera is the main camera, while the target camera is simultaneously activated as the secondary camera.

[0115] S403, Enable the target camera and initialize the lightweight image processing flow.

[0116] In S403, the lightweight image processing flow corresponding to the target camera (equivalent to the first type of image processing flow) is initialized, and the target camera is configured to a low frame rate or low resolution configuration, and the target camera is turned on as a secondary camera outflow.

[0117] S404. Extract 3A statistical data from the first camera and the target camera.

[0118] In S404, the 3A statistical data of the first camera is extracted through the ISP pipeline corresponding to the first camera. Through a lightweight image processing flow, the 3A statistical data of the target camera is extracted when the raw data output by the target camera is received.

[0119] S405. Send the 3A statistical data of the first camera and the target camera to the 3A synchronization module.

[0120] In S405, for the target camera, the raw image data after acquiring the 3A statistical data is no longer transmitted; instead, the 3A statistical data is only transmitted to the 3A synchronization module for consistency processing. For the first camera, the corresponding ISP pipeline continues to execute until the first image is generated and a frame is output.

[0121] The S406 and 3A synchronization modules perform consistency processing to obtain the 3A control parameters of the first camera.

[0122] In S406, the 3A synchronization module performs consistency processing on the 3A statistical data of the first camera and the target camera to obtain the 3A control parameters of the first camera (equivalent to the first control parameters). The process is the same as described in S103 above, and will not be repeated here.

[0123] S407, the first camera updates the 3A control parameters and outputs a frame.

[0124] In S407, the first camera updates the 3A control parameters and outputs a frame, then returns to the preview or recording scene to execute the next round of S404-S406, continuously outputting preview or recorded images.

[0125] S408. Determine whether SAT zoom has been triggered. If yes, proceed to S410; otherwise, proceed to S409. Here, triggering SAT zoom refers to triggering SAT zoom from the first camera to the target camera.

[0126] S409. Continue previewing or recording.

[0127] In S409, previewing or image recording is continuously performed based on the above strategy.

[0128] S410: Close the lightweight image processing flow corresponding to the target camera and switch to the normal image processing flow to output the target image.

[0129] In S410, the lightweight image processing flow corresponding to the target camera is turned off, and the normal image processing flow (equivalent to the first type of image processing flow) is started to output the target image to meet the smooth processing of zoom switching.

[0130] S411, Alignment transformation of the target image with the first image space of the first camera.

[0131] In S411, a smooth zoom from the first camera to the target camera is achieved by aligning and transforming the target image with the first image space of the first camera.

[0132] S412, Restore the preview scene.

[0133] It is understandable that, while meeting the requirements for dual-camera activation in aligned scenarios, this application's embodiments optimize power consumption by simplifying the pipeline and adjusting sensor frame output behavior, avoiding excessive power consumption caused by directly activating dual cameras across the entire path. Furthermore, by activating the target camera as a secondary camera, the other lenses, when acting as primary cameras, utilize the 3A statistical data provided by the target camera for consistent image quality processing. This pre-synchronizes the imaging effect before zooming, improving the smoothness of image transitions during zooming.

[0134] This application also provides a camera control device. Figure 8 This is a schematic diagram of the camera control device provided in an embodiment of this application. Figure 8 As shown, the camera control device 1 includes: a startup module 11, a data processing module 12, a consistency processing module 13, and a zoom module 14, wherein:

[0135] The startup module 11 is used to activate the target camera in the first camera preview or recording scene; the target camera is used to synchronize the image effects of multiple cameras.

[0136] The data processing module 12 is used to process the raw data collected by the target camera in response to the first type of image processing flow to determine the target effect data; the first type of image processing flow only includes functional nodes for determining the camera imaging effect data.

[0137] The consistency processing module 13 is used to perform effect consistency processing on the first camera based on the target effect data, and determine the first control parameter corresponding to the first camera.

[0138] The zoom module 14 is used to respond to a zoom command received in the preview or recording scene and control the first camera and the target camera to zoom based on the first control parameters.

[0139] In some embodiments, the first type of image processing flow includes: a first sensor preprocessing node and a first image preprocessing node; the data processing module 12 is further configured to process the raw data collected by the target camera each time through the first sensor preprocessing node to determine the target raw image corresponding to each collection; and to extract effect data from the target raw image corresponding to each collection through the first image preprocessing node to determine the target effect data.

[0140] In some embodiments, after determining the target effect data, the data processing module 12 is further configured to discard the target original image data corresponding to each acquisition.

[0141] In some embodiments, the consistency processing module 13 is further configured to acquire a first original image captured by the first camera according to the initial first control parameters; extract effect data from the first original image to determine first effect data; and update the initial first control parameters by performing effect consistency processing on the target effect data and the first effect data to determine the first control parameters.

[0142] In some embodiments, the camera control device 1 further includes: an image acquisition module, which is configured to, in the event that no zoom command is received in the preview or recording scene, continue to process the raw data acquired by the target camera through the first type of image processing flow, thereby updating the target effect data; and use the updated target effect data to perform effect consistency processing on the first camera, thereby updating the first control parameters, so that the first camera performs image acquisition based on the updated first control parameters to determine the preview image or the recorded image.

[0143] In some embodiments, the startup module 11 is further configured to configure the target camera based on a preset preview resolution and / or a preset preview frame rate; and to start the target camera to collect raw data according to the preset preview resolution and / or the preset preview frame rate; wherein the preset preview resolution is less than a preset resolution threshold; and the preset preview frame rate is less than a preset frame rate threshold.

[0144] In some embodiments, the zoom module 14 is further configured to, when the zoom instruction indicates zooming from the first camera to the target camera, switch the first type of image processing flow to a second type of image processing flow, and process the raw data acquired by the target camera during the zooming process using the second type of image processing flow, update the target effect data, and obtain a target image; the second type of image processing flow is used to generate a displayable image; using the updated target effect data, perform effect consistency processing on the first camera, update the first control parameters, so that the first camera acquires a first image using the updated first control parameters; and combine the first image and the target image to achieve zooming from the first camera to the target camera.

[0145] In some embodiments, the zoom module 14 is further configured to, when the zoom instruction indicates zooming from the first camera to the target camera, reconfigure the target camera according to the first frame rate corresponding to the first camera, so that the target camera acquires raw data at the first frame rate.

[0146] In some embodiments, the zoom module 14 is further configured to: activate the second camera when the zoom instruction indicates zooming from the first camera to the second camera, and keep the first camera and the target camera enabled; continue to process the raw data collected by the target camera during the zooming process through the first type of image processing flow, and update the target effect data; use the updated target effect data to perform effect consistency processing on the first camera and the second camera, and achieve zooming through the effect consistency processing of the first camera and the second camera.

[0147] In some embodiments, the zoom module 14 is further configured to update the first control parameters using the updated target effect data, and determine the second control parameters corresponding to the second camera; to acquire an image using the updated first control parameters through the first camera to determine a first image; to acquire an image using the second camera according to the second control parameters to determine a second image; and to combine the first image and the second image to achieve zoom from the first camera to the second camera.

[0148] In some embodiments, the zoom module 14 is further configured to keep the target camera enabled and update the target effect data through the first type of image processing flow, so as to perform effect consistency processing on the currently enabled camera using the updated target effect data, until a zoom instruction representing zooming from the third camera to the target camera is received, at which point the first type of image processing flow is switched to the second type of image processing flow; the target effect data is updated and a target image is obtained through the second type of image processing flow; the effect consistency processing of the third camera is performed using the updated target effect data, and zooming from the third camera to the target camera is achieved in combination with the target image.

[0149] In some embodiments, the target camera includes: a wide-angle camera; the first camera includes: any one of an ultra-wide-angle camera, a telephoto camera, or an ultra-telephoto camera; the second camera includes: any one of an ultra-wide-angle camera, a telephoto camera, or an ultra-telephoto camera; the second camera is different from the first camera.

[0150] In some embodiments, the first control parameter includes: exposure count; the camera control device 1 further includes a control module, the control module being used to update the initial first control parameter, and after determining the first control parameter, powering on and enabling a preset cache module when the exposure count corresponding to the initial first control parameter is less than the exposure count corresponding to the first control parameter; the preset cache module is used to store the first raw data collected by the first camera; and powering off the preset cache module when the exposure count corresponding to the initial first control parameter is greater than the exposure count corresponding to the first control parameter.

[0151] In some embodiments, the data processing module 12 is further configured to perform image content smoothing processing on the original target image captured by the target camera and the first image captured by the first camera to obtain an initial fused image; the resolution of the original target image is lower than that of the first image, and the field of view of the original target image is greater than that of the first image;

[0152] The zoom module 14 is further configured to, upon receiving a zoom instruction representing zooming from the first camera to the target camera in the preview or recording scene, switch the first type of image processing flow to the second type of image processing flow, and process the raw data collected by the target camera through the second type of image processing flow to obtain a target image; and perform digital fusion zoom based on the first image, the initial fused image and the target image to realize zooming from the first camera to the target camera.

[0153] It should be noted that the description of the above device embodiments is similar to the description of the above method embodiments, and has similar beneficial effects. For technical details not disclosed in the device embodiments of this application, please refer to the description of the method embodiments of this application for understanding.

[0154] This application also provides a terminal. Figure 9 This is a schematic diagram of an optional structure of a terminal provided in an embodiment of this application. For example... Figure 9 As shown, the terminal 3 includes at least two cameras 31, a memory 32, and a processor 33. The memory 32 and the processor 33 are connected via a communication bus 34. The memory 32 stores executable instructions. The processor 33, when executing the executable instructions stored in the memory 32, utilizes the first and second cameras to implement the camera control method provided in this embodiment.

[0155] This application provides a computer-readable storage medium storing executable instructions. When the executable instructions are executed by the processor, the processor will execute the camera control method provided in this application.

[0156] In some embodiments, the computer-readable storage medium may be a ferroelectric random access memory (FRAM), a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), flash memory, magnetic surface memory, optical disc, or CD-ROM, etc.; or it may be a device that includes one or any combination of the above-mentioned memories.

[0157] In some embodiments, executable instructions may take the form of a program, software, software module, script, or code, written in any form of programming language (including compiled or interpreted languages, or declarative or procedural languages), and may be deployed in any form, including as a standalone program or as a module, component, subroutine, or other unit suitable for use in a computing environment.

[0158] As an example, executable instructions may, but do not necessarily, correspond to files in a file system. They may be stored as part of a file that holds other programs or data, for example, in one or more scripts within a Hyper Text Markup Language (HTML) document, in a single file dedicated to the program in question, or in multiple co-located files (e.g., files storing one or more modules, subroutines, or code sections). As an example, executable instructions may be deployed to execute on a single computing device, or on multiple computing devices located in one location, or on multiple computing devices distributed across multiple locations and interconnected via a communication network.

[0159] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of hardware embodiments, software embodiments, or embodiments combining software and hardware aspects. Furthermore, this application can take the form of a computer program product implemented on one or more computer-usable storage media (including, but not limited to, disk storage and optical storage) containing computer-usable program code.

[0160] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart... Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0161] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0162] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0163] The above description is merely a preferred embodiment of this application and is not intended to limit the scope of protection of this application. Any modifications, equivalent substitutions, and improvements made within the spirit and scope of this application are included within the scope of protection of this application.

Claims

1. A camera control method, characterized in that, include: Enable the target camera in the first camera preview or recording scenario; In response to the first type of image processing flow, the raw data acquired by the target camera is processed to determine the target effect data; Based on the target effect data, the first camera is subjected to effect consistency processing to determine the first control parameter corresponding to the first camera; In response to a zoom command received in the preview or recording scene, the first camera and the target camera are controlled to zoom based on the first control parameters; The step of controlling the first camera and the target camera to achieve zoom based on the first control parameter includes: When the zoom command indicates zooming from the first camera to the target camera, the first type of image processing flow is switched to the second type of image processing flow. The raw data collected by the target camera during the zooming process is processed through the second type of image processing flow to update the target effect data and obtain the target image. The second type of image processing flow is used to generate a displayable image. Using the updated target effect data, the first camera is subjected to effect consistency processing, and the first control parameters are updated so that the first camera can acquire a first image using the updated first control parameters. By combining the first image and the target image, zooming is achieved from the first camera to the target camera; or, When the zoom command indicates zooming from the first camera to the second camera, the second camera is activated, while the first camera and the target camera remain enabled. The raw data collected by the target camera during zooming is further processed through the first type of image processing flow to update the target effect data; Using the updated target effect data, the first camera and the second camera are processed to achieve consistent effect, and zoom is achieved through the first camera and the second camera with consistent effect.

2. The method according to claim 1, characterized in that, The first type of image processing flow includes: a first sensor preprocessing node and a first image preprocessing node; the step of processing the raw data acquired by the target camera in response to the first type of image processing flow to determine the target effect data includes: The first sensor preprocessing node processes the raw data collected by the target camera each time to determine the target raw image corresponding to each collection. The first image preprocessing node extracts effect data from the target original image corresponding to each acquisition to determine the target effect data.

3. The method according to claim 2, characterized in that, After determining the target effect data, the method further includes: Discard the original target image data corresponding to each acquisition.

4. The method according to claim 1, characterized in that, The step of performing effect consistency processing on the first camera based on the target effect data and determining the first control parameters corresponding to the first camera includes: Acquire the first raw image captured by the first camera according to the initial first control parameters; Extract effect data from the first original image to determine the first effect data; By performing consistency processing on the target effect data and the first effect data, the initial first control parameter is updated, and the first control parameter is determined.

5. The method according to claim 1, characterized in that, The method further includes: If no zoom command is received in the preview or recording scene, the raw data collected by the target camera continues to be processed through the first type of image processing flow, thereby updating the target effect data; Using the updated target effect data, the first camera is processed to ensure consistent effect, thereby updating the first control parameters so that the first camera can acquire images based on the updated first control parameters and determine a preview image or a recorded image.

6. The method according to claim 1, characterized in that, Activating the target camera includes: Configure the target camera based on a preset preview resolution and / or a preset preview frame rate; The target camera is activated to collect raw data according to the preset preview resolution and / or preset preview frame rate; wherein the preset preview resolution is less than a preset resolution threshold; and the preset preview frame rate is less than a preset frame rate threshold.

7. The method according to claim 1, characterized in that, The method further includes: When the zoom command indicates zooming from the first camera to the target camera, the target camera is reconfigured according to the first frame rate corresponding to the first camera, so that the target camera acquires raw data at the first frame rate.

8. The method according to claim 1, characterized in that, The step of using the updated target effect data to perform effect consistency processing on the first camera and the second camera, and achieving zoom through the effect consistency processing of the first camera and the second camera, includes: Using the updated target effect data, the first control parameter is updated, and the second control parameter corresponding to the second camera is determined; Using the first camera and the updated first control parameters, an image is acquired and a first image is determined. The second image is determined by acquiring an image using the second camera according to the second control parameters. By combining the first image and the second image, zooming is achieved from the first camera to the second camera.

9. The method according to claim 1, characterized in that, The method further includes: The target camera remains enabled, and the target effect data is updated through the first type of image processing flow to perform effect consistency processing on the currently enabled camera using the updated target effect data, until a zoom command representing zooming from the third camera to the target camera is received, at which point the first type of image processing flow is switched to the second type of image processing flow. The target effect data is updated and the target image is obtained through the second type of image processing flow; Using the updated target effect data, the third camera is processed to ensure consistent effect, and the zoom from the third camera to the target camera is achieved by combining the target image.

10. The method according to any one of claims 1-6, or claim 7, or claim 8, characterized in that, The target camera includes: a wide-angle camera; The first camera includes any one of an ultra-wide-angle camera, a telephoto camera, or an ultra-telephoto camera; The second camera includes any one of an ultra-wide-angle camera, a telephoto camera, or an ultra-telephoto camera; the second camera is different from the first camera.

11. The method according to claim 4, characterized in that, The first control parameter includes the number of exposures. After updating the initial first control parameter and determining the first control parameter, the method further includes: If the number of exposures corresponding to the initial first control parameter is less than the number of exposures corresponding to the first control parameter, power on and enable the preset cache module; the preset cache module is used to store the first raw data collected by the first camera. If the number of exposures corresponding to the initial first control parameter is greater than the number of exposures corresponding to the first control parameter, the preset cache module is powered off.

12. The method according to claim 1 or 2, characterized in that, The method further includes: The original target image captured by the target camera is combined with the first image captured by the first camera to perform image content smoothing processing to obtain an initial fused image; the resolution of the original target image is lower than that of the first image, and the field of view of the original target image is larger than that of the first image; When a zoom command representing zooming from the first camera to the target camera is received in the preview or recording scene, the first type of image processing flow is switched to the second type of image processing flow, and the raw data collected by the target camera is processed through the second type of image processing flow to obtain the target image. Digital fusion zoom is performed based on the first image, the initial fused image, and the target image to achieve zoom from the first camera to the target camera.

13. A camera control device, characterized in that, include: The startup module is used to enable the target camera in the first camera preview or recording scene; The target camera includes features for synchronizing the imaging effects of multiple cameras; The data processing module is used to process the raw data collected by the target camera in response to the first type of image processing flow, and to determine the target effect data; the first type of image processing flow only includes functional nodes for determining the camera imaging effect data; The consistency processing module is used to perform effect consistency processing on the first camera based on the target effect data, and determine the first control parameter corresponding to the first camera; A zoom module is used to respond to a zoom command received in the preview or recording scene and control the first camera and the target camera to zoom based on the first control parameters; The zoom module is further configured to, when the zoom command indicates zooming from the first camera to the target camera, switch the first type of image processing flow to a second type of image processing flow, and process the raw data acquired by the target camera during the zooming process using the second type of image processing flow, update the target effect data, and obtain a target image; the second type of image processing flow is used to generate a displayable image; using the updated target effect data, perform effect consistency processing on the first camera, update the first control parameters, so that the first camera acquires a first image using the updated first control parameters; and combine the first image and the target image to achieve zooming from the first camera to the target camera; or, When the zoom command indicates zooming from the first camera to the second camera, the second camera is activated, while the first camera and the target camera remain enabled; the raw data collected by the target camera during the zooming process is processed through the first type of image processing flow to update the target effect data; using the updated target effect data, effect consistency processing is performed on the first camera and the second camera, and zooming is achieved through the effect consistency processing of the first camera and the second camera.

14. A terminal, characterized in that, include: The system comprises a first camera, a second camera, a memory, and a processor; among which... The memory is used to store executable instructions; When the processor executes the executable instructions stored in the memory, it uses the first camera and the second camera to implement the method described in any one of claims 1 to 12.

15. A computer-readable storage medium, characterized in that, The device stores executable instructions that, when executed by a processor, implement the method according to any one of claims 1 to 12.

Images