A photographing method, an electronic device, and a computer readable storage medium

Abstract

A photographing method, an electronic device and a computer readable storage medium, relate to the technical field of photographing. The electronic device comprises a first camera and a second camera. In a first time interval, the electronic device collects a first real-time image by using the first camera, displays the first real-time image, the first camera is a camera for collecting first data, and the second camera does not work. At a first time, the electronic device responds to a first operation of a user, collects a real-time image by using the first camera and the second camera, and displays a second real-time image collected by the second camera. At a second time, the electronic device calls a photographing parameter of the first data for the second camera to collect a real-time image. Between the first time and the second time, the second camera is a camera for collecting second data, and the first camera is a camera for collecting the first data. The electronic device can call the photographing parameter of the first data to optimize the real-time image collected by the second camera.

Description

Technical Field

[0001] This application relates to the field of photography technology, and more particularly to a shooting method, electronic device, and computer-readable storage medium. Background Technology

[0002] Most portable electronic devices (such as mobile phones and tablets) have camera functions. Furthermore, to improve the image quality, these devices are typically equipped with multiple cameras. During shooting, the electronic device can perform autofocus (AF), auto exposure (AE), and auto white balance (AWB) on the activated cameras to adapt to different shooting environments.

[0003] In response to the user's shooting operations under different shooting needs, the electronic device can switch between different cameras to capture real-time images.

[0004] However, when electronic devices switch between different cameras to capture real-time images, the switched camera cannot quickly adapt to the shooting environment, resulting in poor image quality that fails to meet the user's shooting needs. Summary of the Invention

[0005] This application provides a shooting method, electronic device, and computer-readable storage medium, which can call the shooting parameters of the first channel data for the second camera to capture real-time images when displaying real-time images captured by different cameras, thereby optimizing the real-time images captured by the second camera and meeting the user's shooting needs.

[0006] To achieve the above objectives, this application adopts the following technical solution:

[0007] Firstly, this application provides a shooting method applied to an electronic device, which includes a first camera and a second camera. During a first time interval, the electronic device uses the first camera to capture and display a first real-time image. At this time, the first camera is used to capture a first channel of data, while the second camera is not operational. When a user performs a first operation on the interface of the electronic device, the electronic device receives the user's first operation at a first moment. In response to the received user's first operation, the electronic device can simultaneously use both the first and second cameras to capture real-time images and display a second real-time image captured by the second camera. At this time, the first camera remains used to capture the first channel of data, while the second camera acts as a camera for capturing the second channel of data. At a second moment after the second camera has finished activating, the electronic device calls the shooting parameters of the first channel of data for the second camera to capture real-time images, thereby optimizing the real-time images captured by the second camera. The first channel of data can be referred to as the main data stream, and the second channel of data can be referred to as the auxiliary data stream.

[0008] During the process of the electronic device capturing the first real-time image using the first camera, the electronic device continuously adjusts the shooting parameters of the first camera to optimize the imaging effect of the real-time image captured by the first camera. Therefore, the shooting parameters of the first data stream accessed by the electronic device at the second moment can be understood as the latest adjusted shooting parameters of the first camera. Furthermore, the electronic device can generally implement the process of accessing the shooting parameters of the first data stream and synchronizing them with the second data stream. Based on this, between the first and second moments, the electronic device uses the first camera as the camera for capturing the first data stream and the second camera as the camera for capturing the second data stream. The electronic device uses the shooting parameters of the first data stream for the second camera to capture images, optimizing the shooting parameters of the second camera so that the real-time image captured by the second camera has the same imaging effect as the optimized first real-time image.

[0009] In one specific implementation, the shooting parameters of the electronic device include at least one of the following: autofocus (AF) parameters, auto exposure (AE) parameters, and auto white balance (AWB) parameters.

[0010] When an electronic device calls the shooting parameters of the first data source for the second camera to acquire images, it can call one or more shooting parameters of the first data source for the second camera to acquire images, thereby optimizing one or more shooting parameters in the second camera.

[0011] In one specific implementation, at the third moment after the electronic device calls the shooting parameters of the first data stream, the electronic device determines that the real-time image captured by the second camera has been optimized, and can then switch the second camera to the camera that captures the first data stream.

[0012] After the electronic device completes the process of calling the shooting parameters of the first data channel, it promptly switches the second camera to the camera that collects the first data channel. This allows the electronic device to call the shooting parameters of the first data channel for other cameras to collect real-time images when it is necessary to switch to other cameras (such as the first camera, or a third camera in the electronic device other than the first and second cameras) to display the captured images. In other words, it can call the shooting parameters of the second camera for other cameras to collect real-time images, thereby optimizing the real-time images collected by other cameras and making the imaging effect of the real-time images collected by other cameras consistent with the optimized real-time images collected by the second camera.

[0013] In one specific implementation, the electronic device also includes a third camera.

[0014] At the fourth moment after the electronic device switches the second camera to the camera capturing the first data stream, the electronic device receives a second operation from the user. This second operation may include adjusting the zoom level from the second to the third zoom level on the electronic device's interface, where the third zoom level is outside the zoom range of the second camera. In response to the second operation, the electronic device uses the third camera to capture and display a third real-time image. At the fifth moment after the third camera has finished activating, the electronic device can use the third camera as the camera capturing the first data stream. That is, upon receiving the second operation, the electronic device changes its display from showing the real-time image captured by the first camera to showing the real-time image captured by the third camera, and switches the third camera to the camera capturing the first data stream. It should be understood that during the process of the electronic device using the third camera to capture the third real-time image, the shooting parameters of the third camera need to be dynamically adjusted according to environmental parameters.

[0015] The time taken to call the shooting parameters of the first data stream is shorter than the time taken to dynamically adjust the shooting parameters of the camera. In other words, the time interval between the fourth and fifth moments is shorter than the time interval between the first and third moments.

[0016] It should be understood that the process of the electronic device calling the shooting parameters of the first data source is extremely short. In this case, the process of the second camera switching from capturing real-time images using the initial configuration shooting parameters to capturing image data using the shooting parameters of the first data source is almost imperceptible to the naked eye. In other words, even if overexposure or underexposure occurs in the real-time image captured by the second camera using the initial configuration shooting parameters during the process of calling the shooting parameters of the first data source, it will be invisible to the naked eye. Therefore, using the shooting parameters of the first data source for the second camera to capture real-time images can quickly meet the user's shooting needs while ensuring the imaging quality of the displayed image.

[0017] In one specific implementation, at a first moment, the electronic device responds to the first operation by activating the second camera. At this time, the second camera begins to continuously output frames. The electronic device can store the number of frames output by the second camera in memory, and the initial value of the number of frames output by the second camera is 0.

[0018] The electronic device can determine whether the process of calling the shooting parameters of the first data stream is complete based on the number of frames output from the second camera. Therefore, after the first moment, the electronic device can continuously read the number of frames output from the second camera after the first moment from memory, thereby continuously monitoring the completion of the process of calling the shooting parameters of the first data stream.

[0019] At the third moment, if the number of frames retrieved from the second camera after the first moment by the electronic device is greater than or equal to the first number, it can be determined that the process of calling the shooting parameters of the first data stream has been completed. Therefore, in response to determining that the number of frames retrieved is greater than or equal to the first number, the electronic device can switch the second camera to the camera that captures the first data stream and maintain the real-time image captured by the second camera. At this time, the imaging effect of the real-time image displayed by the electronic device can be consistent with the imaging effect of the optimized real-time image captured by the first camera.

[0020] The electronic device monitors the number of frames output by the second camera after the first moment in real time. The number of frames output is used to measure whether the process of calling the shooting parameters of the first data channel for the second camera to acquire real-time images has been completed. Once it is determined that the above calling process is completed, the electronic device immediately switches the second camera to the camera that acquires the first data channel. This ensures that when the electronic device needs to display real-time images acquired by other cameras, it can quickly call the shooting parameters of the second camera from the first data channel, thereby optimizing the real-time images acquired by other cameras.

[0021] In one specific implementation, after the first moment, the electronic device can continuously read the number of frames output by the second camera after the first moment from memory. Before the third moment, when the electronic device has not completed the process of calling the shooting parameters of the first data channel, the electronic device does not switch the second camera to the camera for collecting the first data channel. Instead, it continues to use the first camera as the camera for collecting the first data channel and the second camera as the camera for collecting the second data channel, thereby ensuring the normal operation of the electronic device's process of calling the shooting parameters of the first data channel.

[0022] In one specific implementation, at the second moment, the electronic device can call the shooting parameters through a first function. This first function has the function of calling the shooting parameters of the current first channel of data stored in the electronic device.

[0023] In some embodiments, the electronic device can only call the shooting parameters of the first data channel for the second data channel. Therefore, at the second moment, the electronic device can call the shooting parameters of the first data channel through the first function to use the shooting parameters of the second data channel to optimize the shooting parameters of the second camera.

[0024] The electronic device can call the shooting parameters of the current first channel data in the electronic device through the first function, so as to realize the operation of calling the shooting parameters of the first channel data for the second camera to capture real-time images. In other words, the shooting parameters of the second camera can be optimized based on the shooting parameters of the first channel data, thereby improving the imaging effect of the real-time images captured by the second camera.

[0025] In one specific implementation, each camera has its own zoom range. When an electronic device activates different cameras, it can capture images within different zoom ranges. For example, the zoom range of the first camera is [first zoom value, second zoom value]. When the first zoom value is less than the second zoom value but greater than the first zoom value, the electronic device uses the first camera to capture real-time images.

[0026] Correspondingly, within the first time interval, the interface displayed on the electronic device may include a shooting preview area. This shooting preview area includes the first real-time image captured by the first camera.

[0027] Based on this, at the first moment, if the user's first operation includes adjusting the first zoom level to a second zoom level greater than the second zoom level value on the first interface, or adjusting the first zoom level to a second zoom level less than the first zoom level value, it is determined that the zoom level range of the first camera cannot meet the second zoom level requirement. Therefore, in response to the first operation, the electronic device displays the real-time image captured by the second camera.

[0028] In response to the user's first operation of adjusting the zoom level, the electronic device can activate the corresponding camera to capture real-time images at the second zoom level, based on the camera's zoom range. This allows the electronic device to promptly display the image the user needs while adjusting the zoom level, thus meeting the user's shooting requirements. Simultaneously, the electronic device uses the shooting parameters from the first data stream to optimize the image quality of the second camera at the second zoom level, preventing overexposure or underexposure in the displayed image.

[0029] In one specific implementation, the electronic device can be configured with a synchronization switch parameter. This parameter indicates whether the synchronization process of synchronizing the shooting parameters of the first data stream to the second data stream needs to be executed; essentially, it can be understood as enabling the synchronization switch for both streams. Generally, the synchronization switch parameter is set to "on".

[0030] After activating the second camera, the electronic device can collect the synchronization switch parameters. When the electronic device determines that the synchronization switch is on, it will activate the synchronization switch and can then access the shooting parameters of the first data stream.

[0031] In one specific implementation, after the electronic device calls the shooting parameters of the first data stream, it can obtain the target shooting parameters based on a mapping relationship. Then, the second camera can use the target shooting parameters to capture real-time images. The mapping relationship includes multiple zoom levels and the shooting parameters for each zoom level.

[0032] Based on the mapping relationship, the electronic device can quickly map the target shooting parameters according to the called shooting parameters, thereby quickly adjusting the shooting parameters of the second camera and optimizing the real-time images captured by the second camera.

[0033] In one specific implementation, at the first moment, when the electronic device responds to the first operation and uses the second camera to capture real-time images, it can query the initial configuration shooting parameters of the second camera from memory, so that the second camera can use the initial configuration shooting parameters to capture real-time images.

[0034] The electronic device sets corresponding initial configuration shooting parameters for each camera and stores them in memory. Therefore, when the electronic device activates a camera, it can read the corresponding initial configuration shooting parameters from memory to display the real-time image captured by that camera using the initial configuration shooting parameters, thus ensuring the continuity of the displayed image.

[0035] In a second aspect, this application provides an electronic device, which includes a first camera, a second camera, a display screen, a memory, and one or more processors; the first camera, the second camera, the display screen, the memory, and the processor are coupled; the memory is used to store computer program code, the computer program code including computer instructions, which, when executed by the processor, cause the electronic device to perform the method as described in the first aspect and any possible design of the method.

[0036] Thirdly, this application provides a computer-readable storage medium storing instructions that, when executed on an electronic device, cause the electronic device to perform the method described in the first aspect and any possible design thereof.

[0037] Fourthly, this application provides a computer program product that, when run on a computer, causes the computer to perform the method described in the first aspect and any possible design thereof.

[0038] It is understood that the beneficial effects achieved by the electronic device described in the second aspect, the computer-readable storage medium described in the third aspect, and the computer program product described in the fourth aspect can be referred to in the beneficial effects of the first aspect and any of its possible design embodiments, and will not be repeated here. Attached Figure Description

[0039] Figure 1 This is one of the mobile phone interface diagrams provided in the embodiments of this application;

[0040] Figure 2 This is one of the display logic diagrams for a mobile phone provided in the embodiments of this application;

[0041] Figure 3 This is a second mobile phone interface diagram provided in an embodiment of this application;

[0042] Figure 4 The third mobile phone interface diagram provided in this application embodiment;

[0043] Figure 5 A hardware structure diagram of a mobile phone provided in an embodiment of this application;

[0044] Figure 6 A software architecture diagram of a mobile phone provided in an embodiment of this application;

[0045] Figure 7 This is the second display logic diagram of a mobile phone provided in the embodiments of this application;

[0046] Figure 8 The fourth mobile phone interface diagram provided in this application embodiment;

[0047] Figure 9 This is an interactive diagram illustrating the implementation of the shooting method provided in the embodiments of this application. Detailed Implementation

[0048] The technical solutions of the embodiments of this application will be described below with reference to the accompanying drawings. In the description of this application, unless otherwise stated, " / " means "or," for example, A / B can mean A or B; the term "and / or" in this document is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone.

[0049] Furthermore, to facilitate a clear description of the technical solutions of the embodiments of this application, the terms "first" and "second" are used in the embodiments of this application to distinguish identical or similar items with substantially the same function and effect. Those skilled in the art will understand that the terms "first" and "second" are used only for descriptive purposes and do not limit the quantity or execution order, nor should they be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Therefore, a feature defined with "first" and "second" may explicitly or implicitly include one or more of that feature. In the description of this embodiment, unless otherwise stated, "multiple" means two or more. Furthermore, the terms "first" and "second" are not necessarily different. Therefore, a feature defined with "first" and "second" may explicitly or implicitly include one or more of that feature. In the description of this embodiment, unless otherwise stated, "at least one" refers to one or more, and "multiple" means two or more.

[0050] In the embodiments of this application, the words "exemplarily" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design described as "exemplarily" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design solutions. Specifically, the use of the words "exemplarily" or "for example" is intended to present the relevant concepts in a specific manner.

[0051] This application provides a shooting method. Exemplarily, this application can be applied to electronic devices that support camera functions, such as mobile phones, tablets, desktop computers, handheld computers, laptops, ultra-mobile personal computers (UMPCs), augmented reality (AR) devices, or virtual reality (VR) devices. This application does not impose any special limitations on the specific form of the electronic device.

[0052] The following text will primarily use a mobile phone as an example to illustrate the proposed solution.

[0053] In this embodiment, the mobile phone may include various applications (APPs) that support taking photos or videos. For example, camera applications and beauty camera apps. TM Or, social applications (such as WeChat) TM Shopping apps (such as Taobao) TM JD.com TM )wait.

[0054] To facilitate understanding, the following text will primarily use camera applications as an example to detail the process of taking photos with a mobile phone, illustrating the problem that when using conventional techniques to take photos, the camera cannot provide good image quality when switching cameras.

[0055] Normally, when a user taps the camera app icon on their phone's screen, the phone responds to the tap, launching the camera app and activating the camera. At this point, the phone, based on collected ambient light, color temperature, and other environmental parameters, performs autofocus (AF), auto exposure (AE), and auto white balance (AWB) on the camera. This adjusts the camera's initial shooting parameters (including at least one of the AF, AE, and AWB parameters, hereinafter referred to as 3A parameters) to obtain new 3A parameters that are more suitable for the shooting environment, resulting in better image quality. For example, the 3A parameters include white balance gain (WB Gain) and / or auto exposure digital gain (AE digital gain). For instance, AE parameters may include exposure amount, exposure time, etc.

[0056] After the camera acquires image data based on the new 3A parameters, the phone displays this data on the screen. When the user taps the shooting control in the camera app, the app responds by displaying the image data captured by the camera as a photo or video.

[0057] The following explanation uses the 3A parameter as an example to illustrate how to adjust the 3A parameter on a mobile phone.

[0058] When a phone activates its camera, the initial exposure setting is set to exposure 'a'. In some applications, under certain shooting conditions, the image data captured by the camera at exposure 'a' may be overly bright. The phone can perform after-effects (AE) on the camera based on environmental parameters such as ambient light and color temperature, reducing the exposure to exposure 'b'. By adjusting the camera's exposure from 'a' to 'b', the phone reduces the overall brightness of the image data captured by the camera under those conditions.

[0059] In other application scenarios, under certain shooting conditions, the image data captured by the camera at exposure level 'a' may be too dark. The phone can perform after-effects (AE) on the camera based on environmental parameters such as ambient light and color temperature, increasing the exposure to level 'c'. By adjusting the camera's exposure from 'a' to 'c', the phone improves the brightness of the image data captured by the camera under those conditions.

[0060] Typically, mobile phones have multiple cameras. Each camera has its own zoom range, which refers to the ratio of the image size of an object in the camera's view to its actual size. The higher the zoom range, the greater the magnification of the image data. 1.0X means that the subject can be captured by the camera at its actual size. By activating different cameras, a mobile phone can capture image data at different zoom ranges.

[0061] Taking a mobile phone equipped with a wide-angle camera, a telephoto camera, and an ultra-wide-angle camera as an example: Generally, the zoom range of a wide-angle camera is [1.0X, 2.5X], the zoom range of a telephoto camera is greater than 2.5X, and the zoom range of an ultra-wide-angle camera is less than 1.0X. Correspondingly, the magnification of image data captured by a telephoto camera (greater than 2.5x) is greater than that of an wide-angle camera (1.0x-2.5x), and the magnification of image data captured by a wide-angle camera (1.0x-2.5x) is greater than that of an ultra-wide-angle camera (less than 1.0x).

[0062] In this scenario, the phone can set a default camera to activate. Simultaneously, the phone can pre-select a zoom level as the default zoom level based on the zoom range of this default camera. When the phone launches its camera, it activates this default camera. At the default zoom level, this default camera acquires image data based on its initially configured 3A parameters. Furthermore, the phone can adjust the initially configured 3A parameters of the default camera based on environmental parameters such as ambient light and color temperature, performing AE, AF, and AWB adjustments to obtain new 3A parameters that are more adapted to the environmental conditions. This allows the default camera to acquire image data based on these new 3A parameters. Therefore, the phone's interface can display the image data acquired by the default camera based on the new 3A parameters at the default zoom level.

[0063] For example, the phone sets the wide-angle camera as the default camera. Based on the zoom range of the wide-angle camera, the phone sets 1.0X as the default zoom level. The phone can display something like this. Figure 1The interface 101 shown includes icons for multiple applications such as Notes, Settings, Calculator, Voice Recorder, Health, Weather, Messages, Contacts, Phone, and Camera. When the user clicks the camera application icon on the phone interface, the phone launches the camera application, which in turn activates the wide-angle camera (e.g., ...). Figure 1 The camera in the middle (1). The phone can display as follows: Figure 1 The interface 102 shown includes image data captured by the wide-angle camera at the default 1.0X magnification. At this time, the phone's telephoto camera (such as...) Figure 1 2) Camera in the middle, ultra-wide-angle camera (such as Figure 1 Camera 3) is in the off state.

[0064] Furthermore, in response to the user's click on the control 1021 on the phone's interface 102, the phone can use the image data captured by the wide-angle camera at 1.0x magnification as a photo taken by the user. The phone stores data such as... Figure 1 The photo shown in image 103. Control 1021 is used to trigger the phone to take a picture or video.

[0065] In some shooting scenarios, users may need to use a larger zoom level to capture images, or they may need to use a smaller zoom level. In these cases, users can adjust the zoom level on the phone's interface. However, the new zoom level may not be within the range of the currently active camera. Therefore, the phone needs to activate a new camera with a zoom level that accommodates the new zoom level and display the image captured by this new camera. The camera app can then display the image data captured by the new camera at the new zoom level. For clarity, this new zoom level can also be referred to as the second zoom level.

[0066] In other shooting scenarios, after a user adjusts the zoom level on their phone's interface, the phone determines the new zoom level within the range of the currently active camera based on the user's adjustment. Therefore, the phone doesn't need to switch cameras. Furthermore, the phone needs to adjust the 3A parameters of the active camera based on the new zoom level to determine the new 3A parameters. At this point, the camera app can display the image data captured by the active camera based on the new 3A parameters at the new zoom level.

[0067] The following explains how to take photos with a mobile phone when the new zoom level is outside the zoom level range of the already activated camera:

[0068] In camera switching scenarios, the camera that is activated first on the phone is called the first camera, and the camera that is activated later on the phone is called the second camera.

[0069] like Figure 2As shown, after the phone activates the first camera, it sends the image data 1 captured by the first camera to the display. At this time, the phone uses the image data 1 captured by the first camera as the main data stream. During the shooting process, the phone can perform AE, AF, and AWB on the first camera and adjust the 3A parameters of the first camera. When the new zoom ratio adjusted by the user is not within the zoom ratio range of the main camera, the phone activates the second camera whose zoom ratio range can meet the new zoom ratio and sends the image data 2 captured by the second camera to the display. At this time, the phone uses the image data 2 captured by the second camera as the main data stream. Furthermore, during the shooting process, the phone can perform AE, AF, and AWB on the second camera and adjust the 3A parameters of the second camera.

[0070] It should be understood that Figure 2 The long black bar in the middle represents the data stream used for display.

[0071] Normally, when a mobile phone activates its camera, it needs to complete a streaming operation (which can immediately initialize the parameters of the second camera, including the 3A parameters). Therefore, when the second camera is activated, its 3A parameters are at their initial configuration values, which may not be adapted to the shooting environment. This can lead to the following problems with the image data acquired by the second camera based on the initial 3A parameters:

[0072] 1. Image overexposure issue: The initial 3A parameters configured in the second camera cannot adapt to the shooting environment, resulting in excessive brightness and whitening of the image data acquired by the second camera based on the initial 3A parameters (hereinafter referred to as overexposure).

[0073] For example, the mobile phone interface is like Figure 3 As shown in interface 301, interface 301 includes image data captured by the wide-angle camera based on the new 3A parameters at 1.0X zoom. When the user adjusts the zoom ratio from 1.0X to 3.0X, the phone determines that 3.0X is not within the zoom ratio range of the wide-angle camera and selects the telephoto camera, with a zoom ratio range greater than 2.5X, as the second camera. The phone activates the telephoto camera and displays the image data captured by the telephoto camera. At this time, the 3A parameters of the telephoto camera are at their initial configuration values, which cannot adapt to the shooting environment, resulting in overexposure issues in the image data captured by the telephoto camera (e.g., ...). Figure 3 (As shown in interface 302).

[0074] 2. Image underexposure problem: The initial 3A parameter configuration of the second camera is not adapted to the shooting environment, resulting in the image data captured by the second camera based on the initial 3A parameter configuration having too low brightness and appearing dark (hereinafter referred to as underexposure).

[0075] For example, the mobile phone interface is like Figure 4As shown in interface 401, interface 401 includes image data captured by the wide-angle camera based on the new 3A parameters at 1.0X zoom. When the user adjusts the zoom ratio from 1.0X to 0.5X, the phone selects the ultra-wide-angle camera with a zoom ratio range less than 1.0X as the second camera. The phone activates the ultra-wide-angle camera and displays the image data captured by it. At this time, the 3A parameters of the ultra-wide-angle camera are at their initial configuration values, which cannot adapt to the shooting environment, resulting in underexposure in the image data captured by the ultra-wide-angle camera (e.g., ...). Figure 4 (As shown in interface 402).

[0076] To address the aforementioned issues, this application provides a shooting method applicable to mobile phones. During camera switching, the phone can synchronize the 3A parameters of the first camera to the second camera, adapting the new 3A parameters of the second camera to the shooting environment, thereby improving the imaging effect of the image data acquired by the second camera based on the new 3A parameters.

[0077] See Figure 5 This is a hardware structure diagram of a mobile phone provided in an embodiment of this application.

[0078] Mobile phone 100 may include a processor 110, an external memory interface 120, internal memory 121, a universal serial bus (USB) connector 130, a charging management module 140, a power management module 141, a battery 142, antenna 1, antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera module 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a touch sensor 180B, an ambient light sensor 180C, etc.

[0079] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the mobile phone 100. In other embodiments of this application, the mobile phone 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0080] Processor 110 may include one or more processing units. For example, processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU), etc. The different processing units may be independent devices or integrated into one or more processors.

[0081] The charging management module 140 is used to receive charging input from the charger. The charger can be a wireless charger or a wired charger.

[0082] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to power the processor 110, internal memory 121, display screen 194, camera module 193, and wireless communication module 160, etc.

[0083] The wireless communication function of mobile phone 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor.

[0084] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in mobile phone 100 can be used to cover one or more communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with a tuning switch.

[0085] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the mobile phone 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc.

[0086] The wireless communication module 160 can provide solutions for wireless communication applications on the mobile phone 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), Bluetooth Low Energy (BLE), ultra-wideband (UWB), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies.

[0087] The mobile phone 100 can implement display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0088] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. In some embodiments, the display screen 194 can display real-time images captured by a camera.

[0089] The mobile phone 100 can realize the camera function through the camera module 193, ISP, video codec, GPU, display 194, application processor AP, neural network processor NPU, etc.

[0090] The camera module 193 can be used to acquire color image data and depth data of the subject. The Information Service Provider (ISP) can be used to process the color image data acquired by the camera module 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the photosensitive element transmits this electrical signal to the ISP for processing, converting it into a visible image. The ISP can also perform algorithmic optimization of image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set within the camera module 193.

[0091] In some embodiments, a mobile phone may include one or more cameras. For example, a mobile phone may include a wide-angle camera, a telephoto camera, an ultra-wide-angle camera, etc.

[0092] The external storage interface 120 can be used to connect an external storage card, such as a Micro SD card, to expand the storage capacity of the mobile phone 100. The external storage card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, music, video, and other files can be saved on the external storage card, or music, video, and other files can be transferred from the mobile phone to the external storage card.

[0093] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 performs various functional methods or data processing of mobile phone 100 by executing instructions stored in internal memory 121 and / or instructions stored in memory disposed in the processor.

[0094] The mobile phone 100 can achieve audio functions such as music playback and recording through the audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.

[0095] Touch sensor 180B, also known as a "touch device," can be located on display screen 194. The touch sensor 180B and display screen 194 together form a touchscreen, also known as a "touchscreen." Touch sensor 180B is used to detect touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 194. In other embodiments, touch sensor 180B may also be located on the surface of mobile phone 100, in a different position than display screen 194.

[0096] The ambient light sensor 180C can be used to sense ambient light brightness. The phone 100 can adaptively adjust the brightness of its display 194 based on the sensed ambient light. The ambient light sensor 180C can also be used to automatically adjust white balance when taking photos. The ambient light sensor 180C can also work with the proximity sensor 180G to detect whether the phone 100 is obstructed, such as when the phone is in a pocket. When obstruction or being in a pocket is detected, some functions (such as touch functionality) can be disabled to prevent accidental operation.

[0097] Button 190 may include a power button, volume buttons, etc. Button 190 may be a mechanical button or a touch button. Mobile phone 100 can receive button input and generate key signal inputs related to user settings and function control of mobile phone 100. For example, when the mobile phone receives key signal inputs from both the power button and volume button while the camera application is running, it executes a command to capture an image.

[0098] Motor 191 can generate vibration alerts. Motor 191 can be used for incoming call vibration alerts or for touch vibration feedback. For example, different vibration feedback effects can correspond to touch operations performed on different applications (e.g., taking photos, playing audio, etc.). Motor 191 can also correspond to different vibration feedback effects for touch operations performed on different areas of the display screen 194. Different application scenarios (e.g., time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also be customized.

[0099] The SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to make contact with or separate from the mobile phone 100. The mobile phone 100 can support one or more SIM card interfaces.

[0100] The software system in the aforementioned mobile phone can adopt a layered architecture, event-driven architecture, or cloud architecture. This application embodiment uses the mobile phone as an example of a layered Android architecture. TM Taking the system as an example, we will illustrate the software structure of the mobile phone.

[0101] Reference Figure 6 This is a software architecture diagram of a mobile phone provided in an embodiment of this application.

[0102] like Figure 6 As shown, a layered architecture divides a mobile phone's software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, Android... TM The system is divided into four layers, from top to bottom: the application layer, the application framework layer, the system library, and the kernel layer.

[0103] The application layer 601 may include various application packages, such as camera, gallery, and messaging.

[0104] For example, camera applications can perform shooting services (such as capturing images, recording videos, etc.), gallery applications can perform data display services (such as displaying image data), and video applications can perform data playback services (such as playing videos).

[0105] The following text will mainly use the camera application 6011 as an example for explanation.

[0106] The camera application 6011 can send a startup notification via kernel layer 604, instructing the camera to start. The camera application 6011 can also send a frame request via kernel layer 604, instructing the camera to acquire new image data. Furthermore, the camera application 6011 can display the image data acquired by the camera in the display interface.

[0107] Furthermore, the camera application 6011 can receive an operation 'a' performed by the user on the display interface to adjust the zoom level. In response to operation 'a', the camera application 6011 can send a camera switching request at kernel layer 604.

[0108] The application framework layer 602 provides the application programming interface (API) and programming framework for the application layer. The application framework layer 602 includes some predefined functions. For example... Figure 6 As shown, the application framework layer 602 can provide camera service.

[0109] Among them, the camera service 6021 can interact with the camera hardware abstraction layer (Camera HAL) in the hardware abstraction layer (HAL) during operation.

[0110] Specifically, the camera API service 6021 can receive requests from the application layer 601 (such as camera application 6011), such as start requests, frame requests, AE requests, AF requests, and AWB requests, and send them to the HAL layer 603.

[0111] HAL layer 603 is used to connect application framework layer 602 and kernel layer 604. For example, HAL layer 603 can perform data transfer between application framework layer 602 and kernel layer 604. Of course, HAL layer 603 can also process data from lower layers (such as kernel layer 604) before transmitting it to application framework layer 602.

[0112] HAL layer 603 can receive requests sent by camera service 6021.

[0113] like Figure 6 As shown, HAL layer 603 may include a camera hardware abstraction layer (Camera Provider).

[0114] In some embodiments, the camera hardware abstraction layer 6031 can process requests from the camera application 6011 and then send the processed requests to the underlying layer (such as the kernel layer 604).

[0115] For example, the camera hardware abstraction layer 6031 can send a 3A parameter adjustment request from the camera application 6011 to the lower layer (such as the kernel layer 604), driving the kernel layer 604 to collect environmental parameters such as ambient light and color temperature information. Based on these environmental parameters, the camera hardware abstraction layer 6031 uses the 3A algorithm to determine new 3A parameters. The camera hardware abstraction layer 6031 then generates a 3A parameter optimization request based on the determined new 3A parameters and sends it to the kernel layer 604. The kernel layer 604 can then optimize the camera's 3A parameters according to the 3A parameter optimization request.

[0116] In addition, the camera hardware abstraction layer 6031 can also report image data uploaded from the underlying layer (such as the kernel layer 604) to the application layer (such as the camera application 6011) for display.

[0117] The kernel layer 604 includes a camera driver 6041, an image signal processor (ISP) 6042, and a camera device 6043. The camera device 6043 may include multiple cameras, each of which includes a lens and an image sensor.

[0118] The camera driver 6041 can receive notifications from the application layer (such as notifications instructing the camera to start or stop), and send a stream of function processing parameters to the camera device 6043 based on the notification.

[0119] The ISP6042 is used to process data fed back from the Camera device 6043.

[0120] For example, when taking a photo, the shutter is opened, and the light from the shooting environment is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, transforming it into an image visible to the naked eye.

[0121] In some embodiments, the ISP6042 can also adjust the 3A parameters of the camera.

[0122] Taking the 3A parameter as the exposure value as an example, the ISP6042 can update the camera's exposure value based on the new exposure value sent by the camera hardware abstraction layer 6031.

[0123] Understandably, the Image Signal Processor (ISP) 6042 and Camera Device 6043 are the main devices for capturing video or images. Light signals reflected from the shooting environment are converted into electrical signals by the image sensor after passing through the camera lens. These electrical signals are processed by the ISP 6042 and can be transmitted as raw data streams by the camera driver 6041 to the application layer 601. For example, image data captured by a wide-angle camera and processed by the ISP serves as the raw data stream for the wide-angle camera. The camera driver 6041 sends this raw data stream to the camera application 6011, which then displays the image data corresponding to the raw data stream.

[0124] The shooting method provided in this application embodiment can be implemented in a mobile phone with the above-described hardware and software structures.

[0125] In this embodiment, the mobile phone displays the first image data captured by the first camera. At this time, the 3A parameters of the first camera are the first 3A parameters after completing AE, AF, and AWB. That is, the mobile phone interface can display the first image data captured by the first camera based on the first 3A parameters. After the user performs a magnification adjustment operation, the mobile phone activates the second camera during the switching process and displays the second image data captured by the second camera. At this time, the mobile phone interface can display the second image data captured by the second camera based on the initial configuration 3A parameters. Simultaneously, the mobile phone maintains continuous frame output from the first camera (i.e., the first camera continuously outputs the captured first image data, but does not use it for display). The mobile phone calls the first 3A parameters carried in the first image data to determine the second 3A parameters. The mobile phone updates the initial configuration 3A parameters of the second camera to the second 3A parameters, enabling the second camera to capture second image data based on the second 3A parameters. At this time, the mobile phone displays the third image data captured by the second camera based on the second 3A parameters.

[0126] The following explains the specific process by which the phone synchronizes the 3A parameters of the first camera to the second camera in a camera switching scenario:

[0127] The higher the zoom level of a camera, the greater the magnification of the image data it captures, allowing it to capture objects within a smaller area. At different zoom levels, the phone needs to activate different cameras to capture image data at the corresponding magnification.

[0128] For example, the mobile phone interface can display as follows: Figure 3 The interface 301 shown includes image data acquired by a first camera based on first 3A parameters. The image data acquired by the first camera based on the first 3A parameters is neither too dark nor too bright, and the boundaries of objects in the image data are clear.

[0129] It should be understood that during the shooting process, the mobile phone performs AE, AF, and AWB processing on the first camera based on environmental parameters such as ambient light and color temperature information. Only after obtaining the 3A parameters of the first camera adapted to the environmental parameters can the image captured by the first camera be as shown in interface 301, with balanced brightness and clear object boundaries.

[0130] After the user adjusts the magnification, the phone activates the second camera, and the phone interface looks like this. Figure 3 As shown in interface 301, or as... Figure 4 As shown in interface 401, interface 301 or interface 401 includes image data captured by the second camera at different magnifications. However, during the process of switching cameras on the phone, the second camera captures image data based on the initially configured 3A parameters. In this case, the initially configured 3A parameters in the second camera have not been adjusted and cannot adapt to environmental parameters, causing the image data captured by the second camera based on the initially configured 3A to appear as follows. Figure 3 The overexposure phenomenon shown in interface 302, or the appearance of... Figure 4 The underexposure phenomenon shown in interface 402.

[0131] Based on this, during camera switching, the phone can synchronize the first 3A parameters of the first camera to the second camera, allowing the second 3A parameters in the second camera to adapt to the shooting environment parameters. Furthermore, the image data acquired by the second camera based on the second 3A parameters can achieve balanced brightness and clear object boundaries, avoiding overexposure or underexposure.

[0132] It should be noted that in a mobile phone, the aforementioned action of synchronizing the 3A parameters of the first camera to the second camera can be performed by modules such as the camera service in the application framework layer, the camera hardware abstraction layer, or the camera driver in the kernel layer. This application does not specifically limit this aspect.

[0133] The following section details the specific implementation of synchronizing the 3A parameters of the first camera to the second camera, so that the imaging effect of the image captured by the second camera is consistent with the imaging effect of the image captured by the first camera:

[0134] After activating the first camera, the phone performs AE, AF, and AWB on it to obtain the first 3A parameters adapted to the environment. This ensures that the image data captured by the first camera based on the first 3A parameters will not be overexposed or underexposed. The phone can then display the first image data captured by the first camera, using it as the main data stream. During camera switching, the phone activates the second camera, displays the second image data captured by it, and uses it as the auxiliary data stream. Simultaneously, the phone synchronizes the first 3A parameters of the first image data in the main data stream to the second image data in the auxiliary data stream, thus determining the second 3A parameters of the second camera. This ensures that the image data captured by the second camera based on the second 3A parameters has the same imaging effect as the image data captured by the first camera based on the first 3A parameters. For ease of explanation, the main data stream can also be referred to as the first data stream, the auxiliary data stream as the second data stream, and the image data captured by the camera as the real-time image captured by the camera.

[0135] For example, the display logic during the camera switching process on a mobile phone can be as follows: Figure 7 As shown. First, the phone sends image data 1, captured by the first camera, to the display; at this time, image data 1 is used as the main data stream. When the second camera is activated, the phone sends image data 2, captured by the second camera, to the display; at this time, image data 2 is used as the auxiliary data stream. However, the phone still uses image data 1, captured by the first camera, as the main data stream, but it is not used for display. Simultaneously, the phone synchronizes the 3A parameters of the main data stream to the auxiliary data stream. That is, the 3A parameters of the first camera are synchronized to the second camera. After completing the 3A parameter synchronization process, the phone switches image data 2, captured by the second camera, to the main data stream, while continuing to send image data 2, captured by the second camera, to the display.

[0136] It should be understood that Figure 7 The black blocks in the graph represent data streams sent for display, while the white blocks represent data streams not used for display.

[0137] The following is based on Figure 8 Using the mobile phone interfaces shown (i.e., interfaces 801 and 802) as an example, this illustrates the effect that can be achieved when the phone synchronizes the 3A parameters of the first camera to the second camera during camera switching:

[0138] The phone interface, as shown in interface 801, includes image data captured by the first camera at 1.0x zoom. The user adjusts the zoom level on the phone interface, changing it from 1.0X to 3.0X. Since 3.0X is outside the zoom range of the first camera, the phone can activate the second camera, whose zoom range includes 3.0X. Simultaneously, the phone synchronizes the 3A parameters of the first camera to the second camera, allowing the second camera to capture image data based on the synchronized second 3A parameters. At this point, the phone interface, as shown in interface 802, includes image data captured by the second camera at 3.0x zoom based on the second 3A parameters. There is no overexposure or underexposure, and object boundaries are clear.

[0139] In some embodiments, the mobile phone records the above-described camera switching process in an offline log.

[0140] For example, the offline log can be used to record the image data transmission process of each frame in the mobile phone. For instance, the mobile phone can obtain the offline log shown in Table 1 below:

[0141] Table 1

[0142]

[0143] In some embodiments, each camera has a unique identifier, such as a unique Camera ID. For example, in Table 1 above, Camera ID: 1 represents the first camera, and Camera ID: 2 represents the second camera. Role is used to characterize which data stream the image data acquired by the camera is used for; where Role: 1 indicates that the image data acquired by the camera is used as the main data stream, and Role: 2 indicates that the image data acquired by the camera is used as the auxiliary data stream. Frame is used to represent the display frame sent by the camera. The data after Frame indicates the number of display frames output by the camera, with the initial value being 0. For example, if the camera can output 30 frames of data per second, corresponding to when the camera is displaying data. The display frames Frame recorded in the Offline log include Frame: 0, Frame: 1, ..., Frame: 29.

[0144] Based on this, by combining the three parameters Camera ID, Role, and Frame, the phone's display logic can be determined. For example, Camera ID: 1, Role: 1, Frame: display frame count, indicates that the phone uses the image data captured by the first camera as a secondary data stream, and the phone displays the image data captured by the first camera. Camera ID: 2, Role: 2, Frame: display frame count, indicates that the phone uses the image data captured by the second camera as the primary data stream, and the phone displays the image data captured by the second camera.

[0145] For example, according to Table 1, the mobile phone's display process includes: Initially, the display logic of the mobile phone is to display the image data captured by the first camera, which is used as the main data stream. Then, during the switching of cameras, when the mobile phone activates the second camera, the display logic changes to displaying the image data captured by the second camera, which is used as the auxiliary data stream. Simultaneously, the mobile phone calls the 3A parameter synchronization function to synchronize the 3A parameters in the main data stream to the auxiliary data stream, that is, to synchronize the 3A parameters of the first camera to the second camera. When the 3A parameter synchronization ends, the mobile phone stops calling the 3A parameter synchronization function, updates the image data captured by the second camera to the main data stream, and continues to display the image data captured by the second camera. The 3A parameter synchronization function can be the `set.aux.info()` function, which only synchronizes the 3A parameters in the main data stream to the auxiliary data stream. For ease of explanation, the above 3A parameter synchronization function can also be referred to as the first function.

[0146] Based on the offline log, the process of switching between the main and auxiliary data streams in the mobile phone can be determined, as well as the process of calling the 3A parameter synchronization function to synchronize the 3A parameters of the first image data in the main data stream to the second image data in the auxiliary data stream.

[0147] In some embodiments, in conjunction with the hardware and software architecture of the mobile phone, this embodiment can be achieved through, as follows: Figure 9 The steps shown demonstrate the method for synchronizing 3A parameters.

[0148] Once the phone's first camera is activated, the first camera will begin to function.

[0149] S901, the camera hardware abstraction layer determines that the image data acquired by the first camera is the main data stream.

[0150] When the first camera is activated, the camera hardware abstraction layer uses the first camera as the main data stream, sends the image data captured by the first camera to the display, and uses the image data captured by the first camera as the main data stream.

[0151] While the camera application is running in the foreground, it can continuously send frame requests according to the frame rate.

[0152] S902, The camera application sends a first frame request to the camera hardware abstraction layer. The first frame request is used to instruct the first camera to acquire image data.

[0153] The camera application sends a first frame request to the hardware abstraction layer, instructing the first camera to capture image data.

[0154] It should be noted that when a phone has multiple cameras, the camera application needs to send frame requests to the cameras that are being displayed. For example, if the phone displays image data captured by the first camera, the camera application will send a frame request to the first camera.

[0155] In some embodiments, the frame request carries the identifier of the camera. For example, a frame request for a first camera sent by the camera application carries the identifier of the first camera, and a frame request for a second camera sent by the camera application carries the identifier of the second camera.

[0156] S903, the Hardware Abstraction Layer sends the first frame request to the ISP.

[0157] For example, after receiving a frame request, the camera hardware abstraction layer can determine the camera to which the frame request is targeted based on the camera identifier carried in the frame request, and then send the frame request to the ISP for processing.

[0158] S904, the ISP reads the first initial configuration 3A parameters of the first camera from memory.

[0159] After the camera hardware abstraction layer starts the camera and instructs it to output a frame (i.e., output the acquired image data), the camera first acquires image data based on the initial configuration 3A parameters. Therefore, when the ISP receives a frame request, it first reads the first initial configuration 3A parameters of the first camera from memory.

[0160] S905, the ISP sends the first frame request and the first initial configuration 3A parameters to the first camera.

[0161] The ISP sends a first frame request to the first camera, instructing the first camera to acquire image data. Simultaneously, the ISP sends the initial 3A parameters read from memory to the first camera.

[0162] S906, The first camera acquires image data a according to the first initial configuration 3A parameters.

[0163] Upon receiving the first frame request and the first initial configuration 3A parameters, the first camera acquires image data based on the first initial configuration 3A parameters. Here, the image data acquired by the first camera based on the first initial configuration 3A parameters is referred to as image data a.

[0164] S907, The first camera sends image data a to the camera hardware abstraction layer.

[0165] It should be understood that the image data captured by the first camera is generally in the form of electrical signals. The ISP needs to convert the electrical signals into an image that is visible to the naked eye, and then the ISP sends the image to the camera hardware abstraction layer. This is a simplified description. This process can be found in the description of the aforementioned software architecture embodiment of the mobile phone, and will not be repeated here.

[0166] S908, the camera hardware abstraction layer sends the image data 'a' captured by the first camera to the display.

[0167] When the camera hardware abstraction layer receives image data 'a' captured by the first camera, it can determine that image data 'a' is the main data stream, which is then used for display. Therefore, the camera hardware abstraction layer displays image data 'a'.

[0168] S909, The camera application displays the first interface; the first interface includes image data a collected by the first camera.

[0169] After receiving the image data 'a' captured by the first camera, the camera application displays a first interface on the phone screen, which includes the image data 'a' captured by the first camera.

[0170] Understandably, the first interface also includes controls for zoom level and shooting mode. The zoom level control allows you to adjust the zoom ratio, for example, to a larger or smaller zoom level. The shooting mode control allows you to adjust the camera's shooting mode, for example, to enter video recording mode or time-lapse shooting mode.

[0171] S910, the camera application sends a 3A parameter update request to the camera hardware abstraction layer. The 3A parameter update request is used to adjust the 3A parameters of the first camera.

[0172] Since the initial configuration of the first camera's 3A parameters may not be adapted to the environmental parameters, resulting in poor imaging quality of the image data 'a' acquired by the first camera, the camera application may generate a 3A parameter update request during the shooting process to adjust the camera's 3A parameters to obtain 3A parameters that are more adapted to the environmental parameters, thereby improving the imaging quality of the image data acquired by the adjusted camera.

[0173] In some embodiments, the 3A parameter update request carries the identifier of the camera. For example, a 3A parameter update request for the first camera issued by the camera application carries the identifier of the first camera, and a 3A parameter update request for the second camera issued by the camera application carries the identifier of the second camera.

[0174] After receiving a 3A parameter update request, the camera hardware abstraction layer needs to determine the camera to which the 3A parameter update request is targeted based on the camera identifier carried in the 3A parameter update request, and then send the 3A parameter update request to the ISP for processing.

[0175] S911, the camera hardware abstraction layer determines the 3A parameter update values.

[0176] When the camera hardware abstraction layer receives a 3A parameter update request from the first camera, it can use environmental parameters such as ambient light and color temperature information, and based on the 3A algorithm, calculate updated 3A parameter values ​​that are more adapted to the environmental parameters. The 3A algorithm will not be discussed in detail here.

[0177] The S912 camera hardware abstraction layer stores the updated 3A parameter values ​​in memory.

[0178] Each time the camera hardware abstraction layer determines the updated 3A parameter values ​​of the camera, it needs to store the updated 3A parameter values ​​in memory so that the ISP can read them from memory and perform further 3A parameter adjustments.

[0179] S913, the camera hardware abstraction layer sends 3A parameter update values ​​to the ISP.

[0180] When the camera hardware abstraction layer receives a 3A parameter update request from the first camera and calculates the 3A parameter update value, it sends the 3A parameter update value to the ISP.

[0181] S914, ISP updates the first initial configuration 3A parameter to the 3A parameter update value.

[0182] When the ISP receives the 3A parameter update value, it updates the first initial 3A parameter of the first camera to the 3A parameter update value.

[0183] S915 and ISP send 3A parameter update values ​​to the first camera.

[0184] S916, The first camera collects image data b based on the updated values ​​of the 3A parameters.

[0185] After receiving the updated 3A parameter values, the first camera can acquire image data b based on the updated 3A parameter values.

[0186] S917, The first camera sends image data b to the camera hardware abstraction layer.

[0187] S918, the camera hardware abstraction layer sends the image data b collected by the first camera to the display.

[0188] S919, the camera application displays a second interface; the second interface includes image data b collected by the first camera.

[0189] Since image data b is image data acquired by the first camera based on the updated 3A parameter values, image data b has a better imaging effect compared to image data a.

[0190] Understandably, during steps S906 to S922, the first camera continuously acquires image data and outputs it to the camera hardware abstraction layer. Correspondingly, the camera hardware abstraction layer continuously displays the image data acquired by the first camera.

[0191] During the shooting process, users may need to use a larger zoom level to capture images, or they may need to use a smaller zoom level. Correspondingly, users can adjust the zoom level via the phone's interface.

[0192] For example, when a user needs to adjust the zoom level, they can do so by touching or swiping the zoom control on the phone screen.

[0193] S920, the camera application receives user operations a.

[0194] S921, The camera application sends operation a to the camera hardware abstraction layer.

[0195] When the camera application receives a user's action 'a', it sends the user's action 'a' to the camera hardware abstraction layer.

[0196] S922, the camera hardware abstraction layer determines whether to switch cameras based on operation a.

[0197] Since each camera has its own zoom range, the zoom range adjusted by the user may or may not be within the zoom range of the first camera. If the new zoom range adjusted by the user is within the zoom range of the first camera, S9231 is executed, and the first camera continues to operate.

[0198] In this scenario, the camera hardware abstraction layer continues to use the image data captured by the first camera as the main data stream, which is then used for display.

[0199] Furthermore, the camera hardware abstraction layer can adjust the 3A parameters of the first camera based on the new zoom ratio and using the 3A algorithm.

[0200] If the new zoom level is not within the zoom level range of the first camera, the phone needs to switch cameras. Execute S9232, and the camera hardware abstraction layer will stop sending image data captured by the first camera to the display.

[0201] When the camera hardware abstraction layer determines, based on operation a, that the new zoom ratio is not within the zoom ratio range of the first camera, it stops sending the image data acquired by the first camera to the display.

[0202] It should be noted that at this time, the first camera continues to output frames (that is, the first camera continues to output the image data it has collected). In other words, the image data collected by the first camera is still the main data stream, but the main data stream is not used for display.

[0203] Typically, the camera hardware abstraction layer can only map the 3A parameters of the main data stream to the auxiliary data stream. Therefore, it is necessary to use the image data acquired by the first camera as the main data stream and the image data acquired by the second camera as the auxiliary data stream to facilitate the process of synchronizing the 3A parameters of the first camera to the second 3A parameters.

[0204] S924, Camera Hardware Abstraction Layer activates the second camera.

[0205] After the camera hardware abstraction layer determines that the new zoom ratio is not within the zoom ratio range of the first camera based on operation a, it continues to output frames from the first camera while activating the second camera whose zoom ratio range can meet the new zoom ratio.

[0206] In one embodiment, when the phone activates the second camera, it needs to perform stream allocation for the second camera to initialize its parameters (including 3A parameter initialization). After the phone completes the parameter initialization of the second camera, the second camera begins to work normally, and the number of working sensors in the phone is updated to 2 (indicating that two cameras are currently working). In this case, the phone starts dual-stream working mode.

[0207] It is understandable that the dual-stream working mode refers to the mode in which the first camera and the second camera work simultaneously. In this mode, the image data captured by the first camera is used as the main data stream (not displayed), while the image data captured by the second camera is used as the auxiliary data stream (displayed).

[0208] In some embodiments, if the user performs a zoom adjustment operation again during the process of the phone allocating bandwidth to the second camera, and the zoom ratio adjusted the second time is within the zoom ratio range of the first camera, then it is determined that the second camera does not need to be activated. The phone stops the bandwidth allocation operation of the second camera, turns off the second camera, and does not activate the dual-stream working mode. At this time, the number of sensors in the phone that are in working state is still 1.

[0209] S925, the camera hardware abstraction layer determines that the image data acquired by the second camera is the auxiliary path data stream.

[0210] After the camera hardware abstraction layer completes the second camera's data stream distribution, it determines that the image data captured by the second camera is the auxiliary data stream and immediately activates the dual-stream working mode. While maintaining continuous frame output from the first camera, the phone simultaneously uses the image data captured by the second camera as the auxiliary data stream and sends it to the display. This ensures that the phone's interface can immediately display the image data captured by the second camera at the new zoom level, meeting the user's shooting needs.

[0211] S926, The camera hardware abstraction layer reads the delay parameters of the first camera from the first camera.

[0212] When the phone stops displaying data from the first camera and starts displaying data from the second camera, it begins to mark the number of frames continuously output by the first camera, which is used as a latency parameter. This latency parameter characterizes the duration for synchronizing the 3A parameters of the first camera to the second camera.

[0213] S927, The camera hardware abstraction layer determines that the delay parameters do not meet the delay frame count.

[0214] The camera hardware abstraction layer can pre-set a delay frame number as a duration standard for measuring whether the 3A parameter synchronization process is complete. When the delay parameter meets (e.g., greater than or equal to) the delay frame number, it is determined that the duration for which the 3A parameters of the first camera are synchronized to the second camera is sufficient to complete the 3A parameter synchronization process.

[0215] If the delay parameter does not meet (e.g., less than) the delay frame number, it is determined that the duration for which the 3A parameters of the first camera are synchronized to the second camera is insufficient to complete the 3A parameter synchronization process, and the work of synchronizing the 3A parameters of the first camera to the second camera needs to continue.

[0216] Correspondingly, the camera hardware abstraction layer should continuously read the delay parameters of the first camera after stopping the first camera from displaying data, and thereby continuously monitor whether the 3A parameter synchronization process is completed.

[0217] S928, The camera application sends a second frame request to the camera hardware abstraction layer. The second frame request is used to instruct the second camera to acquire image data.

[0218] After activating the second camera, the camera app needs to instruct the second camera to acquire image data to maintain the continuity of image output.

[0219] In some embodiments, the second frame request carries the identifier of the second camera.

[0220] It should be noted that steps S926 to S938 are not executed in any particular order and can be performed synchronously. For example, when the second camera is activated, the camera application sends a second frame request, while the camera hardware abstraction layer reads the latency parameters of the first camera.

[0221] S929, the camera hardware abstraction layer sends a second frame request to the ISP.

[0222] When the camera hardware abstraction layer reads the second frame request, it sends the second frame request to the ISP.

[0223] For example, after receiving the second frame request, the camera hardware abstraction layer can determine the second camera to which the second frame request is targeted based on the second camera identifier carried in the second frame request, and then send the second frame request to the ISP for processing.

[0224] S930, ISP reads the second initial configuration 3A parameters of the second camera.

[0225] S931, the ISP sends a second frame request and second initial configuration parameters to the second camera.

[0226] S932, The second camera acquires image data c according to the 3A parameters of the second initial configuration.

[0227] S933, the second camera sends image data c to the camera hardware abstraction layer.

[0228] S934, the camera hardware abstraction layer sends the image data c collected by the second camera to the display.

[0229] S935, the camera application displays a third interface; the third interface includes image data c captured by the second camera.

[0230] After the camera starts up, when the camera hardware abstraction layer instructs the camera to output a frame (i.e., output the acquired image data), the camera first acquires image data based on the initial configuration 3A parameters. Therefore, when the ISP receives a frame request, it first reads the second initial configuration 3A parameters of the second camera from memory.

[0231] The ISP sends a second frame request to the second camera, instructing the second camera to acquire image data. Simultaneously, the ISP sends the second initial 3A parameters, read from memory, to the second camera.

[0232] Upon receiving the second frame request and the second initial configuration 3A parameters, the second camera acquires image data based on the second initial configuration 3A parameters. Here, the image data acquired by the second camera based on the second initial configuration 3A parameters is referred to as image data c.

[0233] The second camera sends image data c to the camera hardware abstraction layer, which then sends the image data c captured by the second camera to the display. The camera application displays a third interface that includes the image data c captured by the second camera.

[0234] It should be noted that the initial 3A parameters of the second camera may not be adapted to environmental parameters. Therefore, the image data c displayed by the camera application may exhibit overexposure or underexposure. To solve this problem, this embodiment can immediately synchronize the 3A parameters in the main data stream to the auxiliary data stream when the second camera is activated. In other words, the 3A parameters of the first camera are synchronized to the second camera. Since the 3A parameters of the first camera at this time are the 3A parameters adapted to environmental parameters after the 3A parameter adjustment operation is completed, the 3A parameters of the second camera obtained based on the 3A parameters of the first camera can also adapt to environmental parameters. That is, the imaging effect of the image acquired by the second camera based on the synchronized 3A parameters can be consistent with the imaging effect of the image acquired by the first camera.

[0235] The following details the specific implementation process of synchronizing the 3A parameters of the first camera to the second camera:

[0236] S936, the camera hardware abstraction layer reads the synchronization process switch parameters from memory.

[0237] S937, The camera hardware abstraction layer determines that the synchronization process switch parameter is turned on.

[0238] In one embodiment, a synchronization process switch parameter is configured in memory. This parameter indicates whether a synchronization process is required to synchronize the first 3A parameters of the first camera to the second camera. Typically, the phone can set the synchronization process switch parameter to "on" (for example, "true" indicates the synchronization process is on, and "false" indicates the synchronization process is off).

[0239] Correspondingly, when the second camera is activated, the camera hardware abstraction layer can read the synchronization process switch parameters in memory. Based on whether the synchronization process switch parameters are enabled, the camera hardware abstraction layer determines whether to execute the process of synchronizing the first 3A parameters of the first camera to the second camera. If the camera hardware abstraction layer determines that the synchronization process switch parameters are enabled, it will execute the process of synchronizing the first 3A parameters of the first camera to the second camera.

[0240] In some embodiments, when the synchronization process switch parameter read by the camera hardware abstraction layer into memory is off, it can be determined that there is no need to execute the process of synchronizing the first 3A parameters of the first camera to the second camera. At this time, the image data acquired by the second camera is updated to the main data stream.

[0241] S938, the camera hardware abstraction layer reads the first 3A parameter from memory. The first 3A parameter is the 3A parameter update value of the first camera that was last updated.

[0242] It is understandable that, in step S910 and thereafter, the camera hardware abstraction layer continuously adjusts the 3A parameters of the first camera, therefore the 3A parameter update values ​​are continuously updated. Correspondingly, the camera hardware abstraction layer can use the last updated 3A parameter value of the first camera as the first 3A parameter of the first camera.

[0243] In some embodiments, the 3A parameter update values ​​can be in timestamp order. The camera hardware abstraction layer can update the 3A parameters of the first camera that is closest to the current time in timestamp order, which can be called the last updated 3A parameter.

[0244] In some embodiments, the 3A parameter update value carries the identifier of the camera. Correspondingly, when the camera hardware abstraction layer determines that the last updated 3A parameter update value carries the identifier of the first camera, it uses the last updated 3A parameter update value as the first 3A parameter of the first camera.

[0245] S939, the camera hardware abstraction layer determines the second 3A parameters based on the first 3A parameters.

[0246] Because the 3A parameters required for a camera to adapt to the shooting environment differ at different zoom levels, and given that the first camera achieves good image quality based on the first 3A parameters at the first zoom level, the phone, after activating the second camera, can map the first 3A parameters at the first zoom level to the second 3A parameters based on a mapping relationship. The phone then updates the initial 3A parameters of the second camera to these second 3A parameters, ensuring that the image data acquired by the second camera based on the second 3A parameters also achieves good image quality. This mapping relationship includes multiple zoom levels and the corresponding 3A parameters for each zoom level. For ease of explanation, these second 3A parameters can also be referred to as target shooting parameters.

[0247] Taking the 3A parameter as an example of exposure, the first exposure of the first camera at the first magnification is exposure 'a'. After the phone activates the second camera, it can use the mapping relationship to map the exposure 'a' at the first magnification to obtain the exposure 'b' at the second magnification, and update the exposure parameter of the second camera to exposure 'b'. Therefore, the exposure effect of the image data acquired by the second camera at the second magnification based on exposure 'b' can be consistent with the exposure effect of the image data acquired by the first camera.

[0248] The S940 camera hardware abstraction layer stores the second 3A parameter in memory.

[0249] S941, the camera hardware abstraction layer sends the second 3A parameter to the ISP.

[0250] S942, ISP updates the second initial configuration 3A parameter to the second 3A parameter.

[0251] The camera hardware abstraction layer stores the second 3A parameters in memory and sends them to the ISP. The ISP then updates the second initial configuration 3A parameters of the second camera to the second 3A parameters. Based on this, the process of synchronizing the 3A parameters of the first camera to the second camera is completed.

[0252] In some embodiments, the second 3A parameter can also be understood as the 3A parameter of the last updated second camera. Based on this, after the camera hardware abstraction layer stores the second 3A parameter in memory, the ISP can read the second 3A parameter from memory when the camera application needs to adjust the 3A parameter of the second camera. Alternatively, when the camera hardware abstraction layer uses the second camera as the main data stream and needs to synchronize the 3A parameters of other cameras based on the 3A parameter of the second camera, it facilitates the ISP reading the second 3A parameter from memory.

[0253] S943, the camera hardware abstraction layer determines the delay parameters to satisfy the delay frame number.

[0254] When the camera hardware abstraction layer continuously reads the latency parameters, and it is determined that the latency parameters meet the required number of latency frames, it can be concluded that the duration for synchronizing the 3A parameters of the first camera to the second camera is sufficient to complete the synchronization process, i.e., the 3A parameter synchronization process is complete. The number of latency frames can be determined based on the time taken for the 3A parameter synchronization process. For example, the latency frame count could be 3 frames, or 4 frames.

[0255] It should be understood that the above-mentioned delay parameter can also be the number of frames output by the second camera when the phone starts the second camera (that is, after the first moment), and the above-mentioned delay frame number can also be called the first number.

[0256] It should be noted that synchronizing the first 3A parameters of the first camera in the main data stream to the second camera takes less time than adjusting the 3A parameters of the second camera according to the 3A algorithm. Therefore, during camera switching, overexposure or underexposure of the images captured by the second camera can be avoided.

[0257] Typically, a camera can output tens of frames of image data per second, and synchronizing the first 3A parameters of the first camera in the main data stream to the second camera only requires 3 frames. In this case, the process of the second camera switching from acquiring image data based on the initial 3A parameters to acquiring image data based on the second 3A parameters is almost imperceptible to the naked eye. In other words, even if overexposure or underexposure occurs in the image data acquired by the second camera during the synchronization of the first 3A parameters of the first camera to the second camera, it will be invisible to the naked eye.

[0258] S944, the camera hardware abstraction layer updates the main data stream with the image data acquired by the second camera.

[0259] When the 3A parameter synchronization process is completed, the camera hardware abstraction layer can use the second camera as the main camera and update the image data acquired by the second camera to the main data stream.

[0260] Normally, once the camera hardware abstraction layer designates the second camera as the primary camera, the first camera can stop working.

[0261] S945, The camera application sends a third frame request to the camera hardware abstraction layer. The third frame request is used to instruct the second camera to acquire image data.

[0262] S946, the camera hardware abstraction layer sends a third frame request to the ISP.

[0263] S947, the ISP sends a third frame request and second 3A parameters to the second camera.

[0264] S948, the second camera acquires image data d according to the second 3A parameter.

[0265] S949, The second camera sends image data d to the camera hardware abstraction layer.

[0266] The S950 camera hardware abstraction layer sends the image data d acquired by the second camera to the display.

[0267] S951, The camera application displays a fourth interface; the fourth interface includes image data d captured by the second camera.

[0268] The camera hardware abstraction layer uses the image data captured by the second camera as the main data stream and sends the image data captured by the second camera to the display. At this time, the camera corresponding to the main data stream is the display camera.

[0269] It should be noted that during steps 906 to 944, the first camera operates normally (e.g., continuously acquiring image data and transmitting it to the camera hardware abstraction layer). Furthermore, during steps 928 to 951, the second camera operates normally (e.g., continuously acquiring image data and transmitting it to the camera hardware abstraction layer). This embodiment only uses the first camera as the main data stream and the second camera as the auxiliary data stream, synchronizing the 3A parameters of the first camera to the second camera, and then switching the second camera to the main data stream as an example for illustration. It is not intended to limit the normal operating procedures of the first and second cameras.

[0270] It should be understood that the process of steps S945-S951 is the normal working process of the mobile phone sending the image data collected by the second camera to the display after the mobile phone uses the image data collected by the second camera as the main data stream. Please refer to the process of steps S902-S935 mentioned above, which will not be repeated here.

[0271] It is understandable that, since the first 3A parameters of the first camera are adjusted to adapt to environmental parameters, and the second 3A parameters are obtained by mapping based on the first 3A parameters of the first camera, the second 3A parameters can also adapt to environmental parameters. Therefore, the imaging effect of the image data d acquired by the second camera based on the second 3A parameters can be consistent with the imaging effect of the image data acquired by the first camera based on the first 3A parameters.

[0272] Other embodiments of this application provide an electronic device that may include a memory and one or more processors. The memory and processors are coupled. The memory stores computer program code, which includes computer instructions. When the processor executes the computer instructions, the electronic device can perform the steps in the above-described method embodiments. The structure of the electronic device can be referred to... Figure 5 The structure shown.

[0273] This application also provides a computer-readable storage medium including computer instructions that, when executed on the electronic device, cause the electronic device to perform the steps in the above method embodiments.

[0274] This application also provides a computer program product that, when run on a computer, causes the computer to perform the steps in the above method embodiments.

[0275] Through the above description of the embodiments, those skilled in the art can clearly understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0276] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another device, or some features may be ignored or not executed. Furthermore, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.

[0277] The units described as separate components may or may not be physically separate. A component shown as a unit can be one or more physical units; that is, it can be located in one place or distributed in multiple different locations. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0278] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0279] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, essentially or in other words, the parts that contribute to the prior art, or all or part of the technical solutions, can be embodied in the form of a software product. This software product is stored in a storage medium and includes several instructions to cause a device (which may be a microcontroller, chip, etc.) or processor to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0280] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A shooting method, characterized in that, Applied to an electronic device, the electronic device including a first camera and a second camera, the method includes: During the first time interval, the electronic device uses the first camera to capture and display the first real-time image. The first camera is a camera that captures the first channel of data, and the second camera is not working. At the first moment, the user's first operation is received; the first operation is to adjust from the first zoom level to the second zoom level, where the second zoom level is not within the zoom level range of the first camera but is within the zoom level range of the second camera. In response to the first operation, the electronic device uses the first camera and the second camera to capture real-time images and displays the second real-time image captured by the second camera; At the second moment, the electronic device calls the shooting parameters of the first data stream for the second camera to capture real-time images; Between the first time and the second time, the second camera is a camera that collects the second channel of data, and the first camera is a camera that collects the first channel of data. At the third moment, the electronic device determines that the number of frames output by the second camera after the first moment is greater than or equal to a first number. In response to determining that the number of frames output is greater than or equal to the first number, the electronic device switches the second camera to the camera that collects the first channel of data. When switching to another camera to capture real-time images, the electronic device calls the shooting parameters of the second camera in the first data stream for the other camera to capture real-time images.

2. The method according to claim 1, characterized in that, The shooting parameters include at least one of the following: autofocus (AF) parameters, auto exposure (AE) parameters, and auto white balance (AWB) parameters.

3. The method according to claim 1, characterized in that, The electronic device also includes a third camera. After the electronic device switches the second camera to the camera that collects the first channel of data at the third moment, the method further includes: In the fourth moment, receive the user's second action; In response to the second operation, the electronic device uses the third camera to capture a third real-time image and displays the third real-time image; wherein, starting from the fifth moment, the third camera is the camera that captures the first channel of data; The time interval between the fourth time and the fifth time is less than the time interval between the first time and the third time.

4. The method according to any one of claims 1-3, characterized in that, The method further includes: Between the first moment and the third moment, if the electronic device determines that the number of outgoing frames is less than the first number, the electronic device will not switch the second camera to the camera that collects the first channel of data.

5. The method according to any one of claims 1-3, characterized in that, The electronic device calls the shooting parameters of the first data stream, including: The electronic device calls the shooting parameters through a first function, which has the function of calling the shooting parameters of the current first channel data in the electronic device.

6. The method according to any one of claims 1-3, characterized in that, The display of the first real-time image includes: The electronic device displays a first interface, which includes a shooting preview area, and the shooting preview area includes the first real-time image; The first operation includes adjusting the zoom level from a first zoom level to a second zoom level on the first interface; the first zoom level is less than the second zoom level value, and the second zoom level is greater than the second zoom level value; or, the first zoom level is greater than the first zoom level value, and the second zoom level is less than the first zoom level value; the first zoom level value is less than the second zoom level value.

7. The method according to any one of claims 1-3, characterized in that, The electronic device calls the shooting parameters of the first data stream, including: In response to the activation of the synchronization switch, the electronic device retrieves the shooting parameters of the first data stream.

8. The method according to any one of claims 1-3, characterized in that, After the electronic device calls the shooting parameters of the first data stream, the method further includes: The electronic device generates target shooting parameters based on the called shooting parameters, and the target shooting parameters are used by the second camera to capture real-time images.

9. The method according to claim 8, characterized in that, Before the electronic device calls the shooting parameters of the first data stream, the method further includes: The electronic device retrieves the initial configuration shooting parameters, which are used by the second camera to capture real-time images.

10. An electronic device, characterized in that, The electronic device includes a first camera, a second camera, a display screen, a memory, and one or more processors; the first camera, the second camera, the display screen, the memory, and the processor are coupled; the memory is used to store computer program code, the computer program code including computer instructions, which, when executed by the processor, cause the electronic device to perform the method as described in any one of claims 1-9.

11. A computer-readable storage medium storing instructions, characterized in that, When the instructions are executed on an electronic device, the electronic device causes the electronic device to perform the method as described in any one of claims 1-9.

Images