A control device, camera control method, and related electronic device

Abstract

Embodiments of the present application provide a control device, a camera control method and a related electronic device, wherein the device comprises: a processor configured to: receive a switching operation, the switching operation being configured to instruct a first camera module that collects images to be switched to a second camera module; and in response to the switching operation, control the first camera module to switch from a first working state to a first low-power state, and control the second camera module to switch from a second low-power state to a second working state; and an image signal processor configured to: process a first image collected by the first camera module or a second image collected by the second camera module; wherein the image signal processor maintains a third working state during the switching process. The embodiments of the present application can reduce the time consumption of switching the camera module and improve the user experience.

Description

Technical Field

[0001] This application relates to the field of terminal technology, and in particular to a control device, a camera control method, and related electronic equipment. Background Technology

[0002] Current electronic devices often integrate multiple cameras to achieve omnidirectional video recording. However, due to chip and hardware specifications and limitations, multiple cameras share a single image signal processor (ISP). In this case, because they share a single ISP, switching between multiple cameras requires frequently powering the ISP on and off, which increases the switching time between multiple cameras.

[0003] For example, when switching from taking a photo with the rear camera to the front camera in a smartphone, it's often necessary to first stop the rear camera, power off the rear camera module and the ISP module, and then power on the ISP module and the front camera module to start taking photos with the front camera. This process of powering off and then on the ISP module increases the time spent switching between the front and rear cameras, affecting the user experience.

[0004] Therefore, improving user experience and reducing the time spent switching cameras is a technical problem that urgently needs to be solved. Summary of the Invention

[0005] This application provides a control device, a camera control method, and related electronic equipment, which can reduce the time spent switching cameras and improve the user experience.

[0006] In a first aspect, embodiments of this application provide a control device, comprising: a processor configured to: receive a switching operation, the switching operation being configured to instruct switching a first camera module for acquiring images to a second camera module; and, in response to the switching operation, control the first camera module to switch from a first operating state to a first low-power state, and control the second camera module to switch from a second low-power state to a second operating state; and an image signal processor configured to: process a first image acquired by the first camera module or a second image acquired by the second camera module; wherein, during the switching process, the image signal processor maintains a third operating state.

[0007] Currently, when switching camera modules connected to the same image signal processor (Image Signal Processor), it is often necessary to repeatedly control the Image Signal Processor to power on and off, for example, frequently switching the Image Signal Processor between its working state and low-power state. This increases the time spent switching camera modules and degrades the user experience. To address this, this application provides a control device that, upon receiving a switching operation instructing the camera to switch, controls the first camera module currently acquiring images to switch from a first working state to a first low-power state, and then directly controls the second camera module to switch from a second low-power state to a second working state, so as to acquire a second image through the second camera module. Correspondingly, during the switching process, the Image Signal Processor only needs to remain in its third working state; there is no need to control the Image Signal Processor to power off and then on again. This method of keeping the Image Signal Processor continuously in its third working state during camera module switching greatly simplifies the switching process, shortens the switching time, and improves the user experience. Furthermore, avoiding frequent switching of the Image Signal Processor's working state can extend the lifespan of the device.

[0008] In one possible implementation, the processor is further configured to: after receiving the switching operation for a preset duration, if the second camera module fails to switch, control the image signal processor to switch from the third working state to the third low-power state.

[0009] In this embodiment, if a switching failure occurs after a preset time has elapsed since the switching operation was received, the image signal processor can be switched from the third operating state to the third low-power state, or the image signal processor can be powered down. This avoids wasting power by keeping the image signal processor in the third operating state when the switching fails.

[0010] In one possible implementation, the device further includes a power supply interface for receiving power from the image signal processor; wherein, in the third operating state, the first voltage of the power supply is greater than the second voltage of the power supply in the third low-power state.

[0011] In this embodiment, the control device further includes a power supply interface, which can receive a corresponding power supply for the image signal processor so that the image signal processor can maintain a third operating state or a third low-power state. It is understood that the second voltage of the power supply in the third low-power state is lower than the first voltage of the power supply in the third operating state.

[0012] In one possible implementation, the processor mentioned above includes a central processing unit (CPU).

[0013] In this embodiment of the application, the processor in the control device may include a central processing unit (CPU). During the switching of camera modules, the image signal processor may not be switched to the third low-power state, but the second camera module may be directly switched to the second working state. This keeps the image signal processor in the third working state, greatly simplifying the process of switching camera modules, shortening the switching time, and improving the user experience.

[0014] In one possible implementation, the aforementioned control device is a system-on-a-chip (SoC).

[0015] In the embodiments of this application, the control device can be a system-on-a-chip (SoC), wherein the processor and the image signal processor can be packaged together or packaged in different chips, and the different chips together form a system-on-a-chip. This configuration can flexibly adapt to different electronic devices.

[0016] Secondly, embodiments of this application provide a camera control method applied to a control device, the control device including a processor and an image signal processor; the method includes: receiving a switching operation through the processor, the switching operation being used to instruct switching a first camera module for acquiring images to a second camera module; responding to the switching operation, controlling the first camera module to switch from a first operating state to a first low-power state, and controlling the second camera module to switch from a second low-power state to a second operating state; processing a first image acquired by the first camera module or a second image acquired by the second camera module through the image signal processor; wherein, during the switching process, the image signal processor maintains a third operating state.

[0017] In one possible implementation, the method further includes: after a preset time period following the receipt of the switching operation, if the second camera module fails to switch, the processor controls the image signal processor to switch from the third working state to the first low-power state.

[0018] In one possible implementation, the device further includes a power supply interface, and the method further includes: receiving a power supply from the image signal processor through the power supply interface; wherein, in the third operating state, the first voltage of the power supply is greater than the second voltage of the power supply in the low power consumption state.

[0019] Thirdly, embodiments of this application provide an electronic device including a first camera module, a second camera module, and any one of the control devices mentioned in the first aspect, wherein the first camera module and the second camera module are electrically connected to the control device.

[0020] In one possible implementation, the first camera module is a rear camera module and the second camera module is a front camera module; or, the first camera module is a front camera module and the second camera module is a rear camera module.

[0021] Fourthly, embodiments of this application provide a computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program, which, when executed by a computer or processor, implements any of the methods provided in the second aspect above.

[0022] Fifthly, embodiments of this application provide a computer program product, characterized in that the computer program product includes a computer program, which, when executed by a computer or processor, causes the computer or processor to perform any of the methods provided in the second aspect.

[0023] It should be understood that the camera control method provided in the second aspect of this application, the electronic device provided in the third aspect, the computer-readable storage medium provided in the fourth aspect, and the computer program product mentioned in the fifth aspect are consistent with the technical solution of the first aspect of this application. Their specific contents and beneficial effects can be referred to the control device provided in the first aspect above, and will not be repeated here. Attached Figure Description

[0024] To more clearly illustrate the technical solutions in the embodiments of this application or the background art, the accompanying drawings used in the embodiments of this application or the background art will be described below.

[0025] Figure 1 and Figure 2 This is a schematic diagram of a set of electronic devices provided in an embodiment of this application.

[0026] Figure 3 This is a schematic diagram of a control process for switching between multiple cameras in the prior art, provided in an embodiment of this application.

[0027] Figure 4 This is a schematic diagram of the hardware architecture of a control device provided in an embodiment of this application.

[0028] Figure 5 This is a schematic diagram of the hardware architecture of another control device provided in an embodiment of this application.

[0029] Figure 6 This is a schematic diagram of the hardware architecture of another control device provided in the embodiments of this application.

[0030] Figure 7This is a schematic diagram of a control process for switching between multiple cameras provided in an embodiment of this application.

[0031] Figure 8 This is a schematic diagram of the hardware architecture of another control device provided in the embodiments of this application.

[0032] Figure 9 This is a flowchart illustrating a camera control method provided in an embodiment of this application. Detailed Implementation

[0033] The embodiments of this application will now be described with reference to the accompanying drawings.

[0034] The terms "first" and "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish different objects, not to describe a specific order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or apparatus that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to such processes, methods, products, or apparatus.

[0035] It should be understood that in this application, "at least one (item)" means one or more, and "more than" means two or more. "And / or" is used to describe the relationship between related objects, indicating that three relationships can exist. For example, "A and / or B" can represent three cases: only A exists, only B exists, and both A and B exist simultaneously, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one (item) of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one (item) of a, b, or c can represent: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, and c can be single or multiple.

[0036] In this document, the term "embodiment" means that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of this application. The appearance of this phrase in various places throughout the specification does not necessarily refer to the same embodiment, nor is it a separate or alternative embodiment mutually exclusive with other embodiments. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.

[0037] As used in this specification, the terms "component," "module," "system," etc., are used to refer to computer-related entities, hardware, firmware, combinations of hardware and software, software, or software in execution. For example, a component can be, but is not limited to, a process running on a processor, a processor, an object, an executable file, an execution thread, a program, and / or a computer. As illustrated, applications running on computing devices and computing devices can both be components. One or more components may reside in a process and / or an execution thread, and components may be located on a single computer and / or distributed among two or more computers. Furthermore, these components can be executed from various computer-readable media on which various data structures are stored. Components can communicate, for example, via local and / or remote processes based on signals having one or more data packets (e.g., data from two components interacting with another component between a local system, a distributed system, and / or a network, such as the Internet interacting with other systems via signals).

[0038] First, in order to facilitate understanding of the embodiments of this application, the technical problems to be solved by the embodiments of this application are analyzed in detail below.

[0039] Current electronic devices often integrate multiple cameras to capture images from multiple angles to meet user needs. However, due to the specifications and limitations of chips and hardware in current e-reader devices, these multiple cameras may share a single image signal processor (ISP).

[0040] Taking a smartphone as an example, which includes a front-facing camera and a rear-facing camera, please refer to the attached document. Figures 1 to 3 , Figure 1 and Figure 2 This is a schematic diagram of a group of electronic devices provided in an embodiment of this application. Figure 3 This is a schematic diagram of a control process for switching between multiple cameras in the prior art, provided in an embodiment of this application.

[0041] like Figure 1 As shown, the electronic device may include a front-facing camera module, and the user interface of the electronic device may include switching controls for switching cameras; as... Figure 2 As shown, the electronic device may also include a rear camera module, wherein both the front camera module and the rear camera module can be used to acquire images and send the acquired images to an image signal processor for processing.

[0042] In the photo-taking or camera functions of electronic devices, such as Figure 1In the user interface shown, when a user interacts with the switching control, the camera module performing the photo-taking function can be switched. For example, when switching from rear-camera to front-camera photography, after interacting with the switching control, the user can first stop the rear-camera module from taking photos, power off the rear-camera module, and then power off the image signal processor (ISP); then power on the ISP, power on the front-camera module, and start front-camera photography. This operation of powering off and then powering on the ISP module increases the time spent switching cameras, affecting the user experience when switching between multiple cameras.

[0043] Therefore, this application provides a control device that, upon receiving a switching operation instructing the switching of cameras, controls the first camera module currently acquiring images to switch from a first operating state to a first low-power state, and then directly controls the second camera module to switch from a second low-power state to a second operating state, so as to acquire a second image through the second camera module. Correspondingly, during the switching process, there is no need to power down and then power on the image signal processor; the image signal processor only needs to continuously maintain a third operating state. This method of keeping the image signal processor continuously in the third operating state during camera module switching greatly simplifies the camera module switching process, shortens the switching time, and improves the user experience. Furthermore, avoiding frequent switching of the image signal processor's operating state can extend the device's lifespan. The specific implementation and corresponding structure of this control device can be referred to the relevant descriptions in the following embodiments, which will not be repeated here.

[0044] For ease of description and understanding, the control devices and electronic devices involved in the embodiments of this application will be described in detail below.

[0045] Please refer to the attached document. Figure 4 , Figure 4 This is a schematic diagram of the hardware architecture of a control device provided in an embodiment of this application.

[0046] Figure 4 This is merely one example of a control device 100. The control device 100 can be any type of electronic component located within an electronic device or the device itself. For example, the control device 100 can be a chip, a chipset, or a circuit board with a chip or chipset mounted on it. This application embodiment is not limited in this respect. The aforementioned chip, chipset, or circuit board with a chip or chipset mounted on it can operate under suitable software drivers.

[0047] The electronic device can refer to a device that includes multiple camera modules. For example, the electronic device can include, but is not limited to: mobile phone, tablet computer, personal computer, handheld computer, mobile internet device (MID), camera, wearable device (e.g., smartwatch, smart bracelet, pedometer, etc.), audio equipment, audio and video player, game console, in-vehicle equipment (e.g., equipment on vehicles such as cars, airplanes, ships, trains and high-speed trains), flying equipment (e.g., intelligent robots, hot air balloons, drones, airplanes), smart home equipment and / or smart city equipment, etc. The embodiments of this application do not impose special restrictions on the specific type of the electronic device.

[0048] The control device 100 may include multiple IP components or IP cores, which may include multiple processors, such as... Figure 4 The components shown include: a Central Processing Unit (CPU) 11, a Graphics Processing Unit (GPU) 12, a Neural Processing Unit (NPU) 13, an Image Signal Processor (ISP) 14, and a Modem 15. It is understood that the control device 100 provided in this application embodiment may also include more or fewer processors or processing modules, such as a power manager, audio processor, video processor, digital signal processor, and display module, etc., which are not specifically limited in this application embodiment. Optionally, the above-mentioned multiple processors can be integrated into one or more chips, and these one or more chips can be placed in a chipset. When one or more processors are integrated into the same chip, the chip is also called a System-on-a-Chip (SOC), specifically as follows... Figure 4 As shown.

[0049] In this embodiment of the application, the control device may include: a processor and an image signal processor, wherein the image signal processor may be the one described above. Figure 4 The ISP14 mentioned above; the processor may include the aforementioned Figure 4 The central processing unit shown may also include independently configured IP components, such as a separate controller or processing core, which are not specifically limited in this application embodiment. The specific implementation of the processor and image signal processing can also be referred to in the following embodiments, which will not be repeated here.

[0050] Furthermore, the control device 100 may also include a system bus 16 and a system cache (SC), both of which can be integrated into the aforementioned SOC. The multiple processors and the system cache (not shown) are all coupled to the system bus 16, thereby enabling the multiple processors to communicate with the system cache via the system bus 16. When the SOC includes multi-level caches (e.g., L3 or L4 caches), the system cache may also be the Last Level Cache (LLC), or it may be a shared cache for multiple processors on the SOC. This embodiment does not specifically limit the specific implementation of this application.

[0051] In some embodiments, the control device 100 may also be electrically connected to one or more other components, such as multiple camera modules in an electronic device. In this embodiment, the multiple camera modules may include, but are not limited to, a first camera module 20 and a second camera module 21. The first camera module 20 and the second camera module 21 may reuse the image signal processor ISP 14 described above.

[0052] Each of the aforementioned camera modules can be used to acquire color image data and depth data of the subject. The ISP14 can be used to process the color image data acquired by the camera modules. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP14 for processing, converting it into a visible image. The ISP14 can also perform algorithmic optimization on image noise and brightness. The ISP14 can also optimize parameters such as exposure and color temperature of the shooting scene.

[0053] In some embodiments, each camera module may include a color camera module and a sensing module. The photosensitive element of the camera in the color camera module may be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts light signals into electrical signals, which are then transmitted to an image signal processor for conversion into digital image signals. In the embodiments of this application, the first camera module and the second camera module can be used to acquire images, for example, acquiring a first image through the first camera module and acquiring a second image through the second camera module. Furthermore, since the first camera module and the second camera module share the same image signal processor, the first camera module and the second camera module can be configured not to acquire images simultaneously.

[0054] In other embodiments, each camera module may further include two or more cameras. These two or more cameras may include a color camera, which can be used to acquire color image data of the object being photographed. These two or more cameras may employ stereo vision technology to acquire depth data of the object being photographed. Stereo vision technology is based on the principle of human parallax. Under natural light, images of the same object are captured from different angles by two or more cameras, and then triangulation and other calculations are performed to obtain the distance information, i.e., depth information, between the electronic device 100 and the object being photographed. This application does not specifically limit the embodiments in this regard.

[0055] In some embodiments, the first camera module is a rear camera module and the second camera module is a front camera module; or, the first camera module is a front camera module and the second camera module is a rear camera module.

[0056] When the electronic device is a mobile phone or other corresponding smart terminal, the first camera module is a rear camera module and the second camera module is a front camera module; or, the first camera module is a front camera module and the second camera module is a rear camera module. The rear camera module and the front camera module can be understood as camera modules on different surfaces of the electronic device.

[0057] In other embodiments, the first camera module and the second camera module may also be different camera modules on the same surface of an electronic device. For example, different camera modules on a flight device, etc.

[0058] In other embodiments, the electronic device equipped with the control device 100 may also include a power management integrated circuit chip (PMIC). The PMIC (not shown) may be independently located inside the chip or outside the chip. It can provide multiple power supplies to the chip (such as CPU core voltage, I / O voltage, memory voltage, ISP operating voltage), and can also provide multiple power supplies to other components of the electronic device (such as operating voltage and storage voltage of each camera module). In the embodiments of this application, voltage can be provided to multiple camera modules when they are powered on, and the voltage can be stopped or a lower voltage can be provided when they are powered off. The embodiments of this application do not make specific limitations on this.

[0059] Based on the above Figure 4 Please refer to the attached document for the hardware architecture shown. Figure 5 , Figure 5 This is a schematic diagram of the hardware architecture of another control device provided in an embodiment of this application.

[0060] like Figure 5 As shown, the electronic device includes the control device 200, which includes a processor and an image signal processor. The processor can be as described above. Figure 4 The central processing unit or other IP component shown may also be referred to as a processing unit, control unit, or controller, etc. The image signal processor can be one of the aforementioned... Figure 4 The image signal processor (ISP) shown is electrically connected to both the first and second camera modules.

[0061] The processor can be configured to: receive a switching operation, the switching operation being configured to instruct the first camera module for acquiring images to be switched to a second camera module; and in response to the switching operation, control the first camera module to switch from a first operating state to a first low-power state, and control the second camera module to switch from a second low-power state to a second operating state.

[0062] The image signal processor can be used to process a first image captured by the first camera module or a second image captured by the second camera module; wherein, during the above switching process, the image signal processor maintains a third working state.

[0063] It is understood that the first camera module and the second camera module can be used to acquire images separately. The switching operation can be used to instruct the switching of the first camera module for image acquisition to the second camera module. Alternatively, in some other embodiments, it can also be used to instruct the switching of the second camera module for image acquisition to the first camera module.

[0064] The switching operation can be a user operation that switches camera modules after the user activates the camera function. For example, it could be a user operation that switches the camera module used for video recording or photography when the camera is turned on. It could also be a user operation that switches camera modules when a third-party application activates camera functions (such as video recording, photo taking, live streaming, etc.). Additionally, the switching operation can also be a camera module switching operation triggered by other devices or running software programs connected to the electronic device (such as communication connections, electrical connections, etc.). For example, it could be an operation that switches camera modules triggered by other devices or software programs. This application does not specifically limit the triggering form or triggering object of the switching operation.

[0065] Before receiving a switching operation, the first camera module can be used to acquire a first image and send the acquired first image to an image signal processor. The image signal processor can process the first image acquired by the first camera module, wherein the first image may include, but is not limited to, one frame or multiple frames. Therefore, at this time, the first camera module can be in a first working state, the image signal processor is in a third working state, and the second camera module cannot acquire images, so the second camera module is in a second low-power state.

[0066] Upon receiving a switching operation, in response to the operation, the processor can control the first camera module to switch from a first operating state to a first low-power state, and control the second camera module to switch from a second low-power state to a second operating state. That is, the processor can stop the first camera module from acquiring a first image and start the second camera module to acquire a second image, where the second image may include, but is not limited to, one or more frames. During this switching process of the camera modules acquiring images, the image signal processor remains in a third operating state and does not switch states. Consequently, after the camera module switching is complete, the image signal processor can directly process the second image acquired by the second camera module without needing to repeatedly power on or wake up.

[0067] It should be noted that the aforementioned operating state of a functional module includes the state in which the functional module can perform its relevant functions after being powered on (e.g., connected to a power supply). Each functional module can receive the same or different voltages provided by the power supply to maintain its corresponding operating state. For example, when the first camera module is in its first operating state, it means that after the first camera module is powered on or the power supply provides the corresponding operating voltage, the first camera module can perform image acquisition. Similarly, when the second camera module is in its second operating state, it means that after the second camera module is powered on or the power supply provides the corresponding operating voltage, the second camera module can perform image acquisition. Furthermore, when the image signal processor is in its third operating state, it can mean that after the image signal processor is powered on or the power supply provides the corresponding first voltage, the image signal processor can process the images acquired by the first or second camera module.

[0068] It should also be noted that the aforementioned low-power states can include powering down the functional modules (e.g., disconnecting the power supply) or providing only a lower voltage to the functional modules. In this state, compared to the operating state, the functional modules in the low-power state consume less power, have limited functionality, and respond more slowly. Furthermore, this low-power state can also be referred to as a power-down state, standby state, hibernation state, etc. For example, when the first camera module is in the first low-power state or the second camera module is in the second low-power state, neither the first nor the second camera module can acquire images normally; correspondingly, when the image signal processor is in the third low-power state, the image signal processor cannot receive images acquired by the first or second camera module or cannot process the received images, etc.

[0069] Because the hardware structures and functions of each functional module (such as the first camera module, the second camera module, and the image signal processor) are different, the power supply voltage corresponding to each functional module in its respective working state can be the same or different, and the power supply voltage corresponding to its respective low-power state can also be the same or different. For example, the power supply voltage corresponding to the first camera module in the first working state can be different from the power supply voltage corresponding to the second camera module in the second working state. In addition, multiple different working states can be set for the same functional module, and each working state can correspond to the same or different power supply voltages; multiple different low-power states can also be set, and each low-power state can also correspond to the same or different power supply voltages. Accordingly, for the same functional module, the power supply voltage in the working state can be greater than the power supply voltage in the low-power state. For example, for the image signal processor, the first voltage of the power supply in the third working state is greater than the second voltage of the power supply in the third low-power state. In this respect, the embodiments of this application do not specifically limit the working state and low-power state of each functional module.

[0070] It is understandable that controlling the first camera module to switch from a first operating state to a first low-power state can be achieved by controlling the voltage supplied to the first camera module by the power supply. For example, the power supply voltage received by the first camera module can be controlled to switch from a high voltage to a low voltage, thus switching the first camera module from the first operating state to the first low-power state. Similarly, controlling the power supply voltage received by the first camera module to switch from a high voltage to a low voltage also switches the first camera module from the first operating state to the first low-power state. Likewise, the second camera module and the image signal processor can both achieve switching between different states by controlling the voltage they receive.

[0071] It is also understood that controlling the first camera module to switch from the first working state to the first low-power state can also be achieved by directly controlling the first camera module to shut down some or all of its functional modules. Correspondingly, upon receiving a relevant instruction or wake-up event, turning on the shut-down functional modules can switch the system from the first low-power state back to the first working state. Similarly, the second camera module and the image signal processor can both achieve state switching by directly controlling the turning on or off some or all of their functional modules. This application does not specifically limit the method by which each functional module achieves state switching.

[0072] Accordingly, please refer to the appendix. Figure 7 , Figure 7 This is a schematic diagram of a control flow for switching between multiple cameras provided in an embodiment of this application. Figure 7 As shown, when the switching operation is triggered, the first camera module's corresponding image capture can be stopped first, i.e., image processing and image preview can be stopped. Then, the first camera module is powered down, i.e., the first camera module is switched from the first working state to the first low-power state. Then, the second camera module is powered on and its corresponding image capture is started, including enabling image processing and image preview. That is, the second camera module is switched from the second low-power state to the second working state. During the above switching process, the image signal processor can continue to maintain the third working state without controlling the image signal processor to be powered down and then powered on (i.e., to perform a state transition). This can greatly simplify the process of switching camera modules, shorten the switching time, and improve the user experience. In addition, for any camera module, starting and stopping image capture can include starting or stopping the continuous acquisition of image data by the camera module and the real-time transmission to the image signal processor, and further includes, but is not limited to, enabling and disabling the image processing process and image preview. This application embodiment does not specifically limit this. Optionally, the image processing process can be... Figures 4-6 The image signal processor in the image can perform the preview processing. Figures 4-6 The processor executes the commands, but this embodiment is not limited to this. Figure 7 The corresponding process can be executed and controlled by the processor.

[0073] In some embodiments, the processor is further configured to: after receiving the switching operation for a preset duration, if the second camera module fails to switch, control the image signal processor to switch from the third working state to the third low-power state.

[0074] Understandably, if a switching operation fails after a preset time has elapsed, the image signal processor (Image Signal Processor) can be switched from its third operating state to its third low-power state, or it can be powered down. This avoids wasting power by keeping the Image Signal Processor in its third operating state during a failed switch.

[0075] The switching failure may include, but is not limited to: the second camera module being unable to switch from the second low-power state to the second working state, or the second camera module being unable to power on, or the second camera module being unable to work normally after switching to the second working state, or the first camera module being unable to switch from the first working state to the first low-power state, or the first camera module being unable to power off, etc. In such cases, the processor may control the image signal processing to switch from the third working state to the third low-power state after receiving the switching operation for a preset time and the switching failure, or it may directly control the image signal processing to power off.

[0076] In some embodiments, the processor further includes a timer; the timer is configured to run for the preset duration; and the timer is started upon receiving the second operation.

[0077] As mentioned above Figure 6 As shown, the processor may also include a timer configured to run for a preset duration, such as a 1-second timer, which terminates after 1 second. Upon receiving the second operation, the timer can be started and run. After the preset duration, the timer completes its execution. When the timer expires, the processor can determine whether the second camera module has failed to switch. If the second camera module fails to switch, the processor can control the image signal processor to switch from the third operating state to a third low-power state. This ensures that in the event of a switching failure, the image signal processor can be switched to the third low-power state or powered down normally. The preset duration can be greater than the total time required to switch the currently capturing image camera module to the second camera module.

[0078] In some embodiments, the device further includes: a power supply interface for receiving power from the image signal processor; wherein, in the third operating state, the first voltage of the power supply is greater than the second voltage of the power supply in the third low-power state.

[0079] Please refer to the attached document. Figure 8 , Figure 8 This is a schematic diagram of the hardware architecture of another control device provided in the embodiments of this application.

[0080] like Figure 8As shown, the control device 200 also includes a power supply interface, which can receive the corresponding power supply for the image signal processor and is connected to an external power management chip. Figure 8 (Not shown) so that the image signal processor can maintain a third operating state or a third low-power state. It is understood that the second voltage of the power supply in the third low-power state is lower than the first voltage of the power supply in the third operating state. The location of this power supply interface is not specifically limited in this embodiment. For example, the power supply interface can be located between the image signal processor and the power management chip, which serves as the power supply, and can receive control from the processor or the power management chip. It is understood that the first voltage of the power supply received by the image signal processor in the third operating state is greater than the second voltage of the power supply received in the third low-power state. The processor controls the voltage of the power supply provided to the image signal processor by the power management chip to achieve state switching of the image signal processor.

[0081] In some embodiments, the processor includes a central processing unit (CPU).

[0082] In this embodiment of the application, the processor in the control device may include a central processing unit (CPU). During the switching of camera modules, the image signal processor may not be switched to the third low-power state, but the second camera module may be directly switched to the second working state. This keeps the image signal processor in the third working state, greatly simplifying the process of switching camera modules, shortening the switching time, and improving the user experience.

[0083] In other embodiments, the processor may be a processor or processing core that is independent of the central processing unit (CPU), and this application does not specifically limit this embodiment.

[0084] In some embodiments, the control device is a system-on-a-chip (SoC), in which the processor and image signal processor can be packaged together or packaged in different chips, with different chips forming a SoC. This configuration allows for flexible adaptation to different electronic devices. The control device can be located within an electronic device.

[0085] In addition, based on the aforementioned control device, this application also provides a camera control method, which can be applied to the aforementioned control device. The control device includes a processor and an image signal processor. Please refer to the appendix for details. Figure 9 , Figure 9This is a schematic flowchart illustrating a camera control method provided in an embodiment of this application. Furthermore, the control device can be located within an electronic device, as detailed in the preceding figures.

[0086] like Figure 9 As shown, the method includes:

[0087] Step S101: Receive the switching operation through the processor.

[0088] Specifically, the processor can receive switching operations, which are used to instruct the first camera module for capturing images to be switched to the second camera module.

[0089] Step S102: In response to the switching operation, control the first camera module to switch from the first working state to the first low-power state, and control the second camera module to switch from the second low-power state to the second working state.

[0090] Specifically, in response to the switching operation, the processor can control the first camera module to switch from a first operating state to a first low-power state, and control the second camera module to switch from a second low-power state to a second operating state, thereby stopping the acquisition of the first image through the first camera module and starting the acquisition of the second image through the second camera module. During this switching process, there is no need to control the image signal processor to perform state transitions.

[0091] Step S103: Process the first image captured by the first camera module or the second image captured by the second camera module using an image signal processor.

[0092] Specifically, the image signal processor maintains a third operating state during the switching process. Before switching, the image signal processor can process the first image captured by the first camera module; after switching, the image signal processor can process the second image captured by the second camera module.

[0093] In one possible implementation, the method further includes: after a preset time period following the receipt of the switching operation, if the second camera module fails to switch, the image signal processor is controlled by the processor to switch from the third working state to the third low-power state.

[0094] In some embodiments, the device further includes a power supply interface, and the method further includes: receiving a power supply from the image signal processor through the power supply interface; wherein, in the third operating state, the first voltage of the power supply is greater than the second voltage of the power supply in the low power consumption state.

[0095] Therefore, upon receiving a switching operation instructing the camera to switch, the system can control the first camera module currently acquiring images to switch from a first operating state to a first low-power state, and then directly control the second camera module to switch from a second low-power state to a second operating state, so as to acquire a second image through the second camera module. Correspondingly, during the above switching process, there is no need to power down and then power on the image signal processor; the image signal processor only needs to continuously maintain its third operating state. This method of keeping the image signal processor continuously in its third operating state during camera module switching greatly simplifies the camera module switching process, shortens the switching time, and improves the user experience.

[0096] This application also provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the method of the embodiments described above.

[0097] This application also provides a computer program product, the computer program including instructions that, when executed by a computer, cause the computer to perform the methods of the embodiments shown above.

[0098] It should be understood that the electronic device, camera control method, computer-readable storage medium, and computer program product provided in the embodiments of this application can be consistent with the technical solutions of the control device provided in this application, and their specific contents and beneficial effects can be referred to the above. Figures 4-8 The control device mentioned in the illustrated embodiment will not be described in detail here.

[0099] In the above embodiments, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions in other embodiments.

[0100] It should be noted that, for the sake of simplicity, the foregoing method embodiments are all described as a series of actions. However, those skilled in the art should understand that this application is not limited to the described order of actions, as some steps may be performed in other orders or simultaneously according to this application. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are preferred embodiments, and the actions and modules involved are not necessarily essential to this application.

[0101] In the several embodiments provided in this application, it should be understood that the disclosed apparatus can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of the units described above is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical or other forms.

[0102] If a portion of the aforementioned integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which can be a personal computer, server, or network device, specifically a processor in the computer device) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium may include various media capable of storing program code, such as a USB flash drive, portable hard drive, magnetic disk, optical disk, read-only memory (ROM), or random access memory (RAM).

[0103] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.

Claims

1. A control device, characterized in that, include: Processor, used for: Receive a switching operation, the switching operation being used to instruct the first camera module for acquiring images to be switched to the second camera module; as well as In response to the switching operation, the first camera module is controlled to switch from a first working state to a first low-power state, and the second camera module is controlled to switch from a second low-power state to a second working state. An image signal processor is used to process a first image captured by the first camera module or a second image captured by the second camera module; wherein, during the switching process, the image signal processor maintains a third working state.

2. The apparatus according to claim 1, characterized in that, The processor is also used for: If the second camera module fails to switch after a preset time period following the receiving of the switching operation, the image signal processor is controlled to switch from the third working state to the third low-power state.

3. The apparatus according to claim 2, characterized in that, The device further includes: A power supply interface is provided for receiving power from the image signal processor; wherein, in the third operating state, the first voltage of the power supply is greater than the second voltage of the power supply in the third low-power state.

4. The apparatus according to any one of claims 1-3, characterized in that, The processor includes a central processing unit (CPU).

5. The apparatus according to any one of claims 1-4, characterized in that, The control device is a system-on-a-chip (SoC).

6. A method for controlling a camera, characterized in that, The method is applied to a control device, which includes a processor and an image signal processor; the method includes: The processor receives a switching operation, which is used to indicate switching the first camera module for acquiring images to the second camera module; in response to the switching operation, the first camera module is controlled to switch from a first working state to a first low-power state, and the second camera module is controlled to switch from a second low-power state to a second working state. The image signal processor processes the first image captured by the first camera module or the second image captured by the second camera module; wherein, during the switching process, the image signal processor maintains a third working state.

7. The method according to claim 6, characterized in that, The method further includes: If the second camera module fails to switch after a preset time period following the received switching operation, the processor controls the image signal processor to switch from the third working state to the low-power state.

8. The method according to claim 6 or 7, characterized in that, The device further includes a power supply interface, and the method further includes: The image signal processor receives power from the power supply interface; wherein, in the third operating state, the first voltage of the power supply is greater than the second voltage of the power supply in the low power consumption state.

9. An electronic device, characterized in that, It includes a first camera module, a second camera module, and a control device as described in any one of claims 1-5, wherein the first camera module and the second camera module are electrically connected to the control device.

10. The device according to claim 9, characterized in that, The first camera module is a rear-facing camera module, and the second camera module is a front-facing camera module; or... The first camera module is a front-facing camera module, and the second camera module is a rear-facing camera module.

11. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a computer or processor, implements the method described in any one of claims 6-8.

12. A computer program product, characterized in that, The computer program product includes a computer program that, when executed by a computer or processor, causes the computer or processor to perform the method as described in any one of claims 6-8.

Images