Processing method, system and device, electronic equipment and storage medium
By configuring target mode to process image data acquired by camera modules, the problem of high power consumption and high cost caused by multiple ISPs processing multiple AON camera data is solved, realizing efficient image processing of multiple camera modules and reducing power consumption and cost.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-28
- Publication Date
- 2026-03-10
AI Technical Summary
In the existing technology, an image signal processor (ISP) can only process image data from one AON camera. When multiple ISPs are needed to process multiple data streams, it leads to increased power consumption and higher costs.
By identifying the target camera module currently in use and configuring the corresponding target mode, a method for processing image data acquired by the camera module is implemented, supporting simultaneous or time-division processing. This problem is solved by employing different technical means.
It achieves reduced power consumption and cost without adding an image signal processor, while supporting image data processing from multiple camera modules, thus enriching application scenarios.
Smart Images

Figure CN121644976A_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to the field of image processing technology, and in particular to a processing method, system, apparatus, electronic device, and storage medium. Background Technology
[0002] With the development of electronic device technology, more and more electronic devices support AON (always-on camera) to achieve low-power operation and faster response to operations such as face recognition and gesture control. The role of ISP (Image Signal Processor) is to process the signal output from the image sensor to obtain the processed image result.
[0003] In related technologies, one ISP corresponds to one AON camera, meaning that one ISP can only process image data from one AON camera. If image data from multiple AON cameras needs to be processed, multiple ISPs are required, which leads to increased power consumption and higher costs. Summary of the Invention
[0004] To overcome the problems existing in related technologies, this disclosure provides a processing method, system, apparatus, electronic device, and storage medium.
[0005] According to a first aspect of the present disclosure, a processing method is provided, the method comprising:
[0006] Identify the target camera module currently in use, the target camera module including a front camera module and / or a rear camera module;
[0007] Configure a target mode corresponding to the target camera module. The target mode includes a first mode or a second mode. The first mode is used to indicate that the front camera module and the rear camera module can be used simultaneously. The second mode is used to indicate that the front camera module and the rear camera module can be used independently in time division.
[0008] Based on the target pattern, the image data acquired by the target camera module is processed.
[0009] In some embodiments, configuring the target mode corresponding to the target camera module includes:
[0010] When the target camera module includes the front camera module and the rear camera module, the target mode is determined to be the first mode; or...
[0011] When the target camera module includes the front camera module or the rear camera module, the target mode is determined to be the second mode.
[0012] In some embodiments, when the target camera module includes the front camera module and the rear camera module, determining the target mode as the first mode includes:
[0013] When the target camera module includes the front camera module and the rear camera module, the working mode corresponding to the target camera module is configured as a dual camera working mode, and the signal processing mode corresponding to the target camera module is determined as a synchronous signal processing mode.
[0014] The first mode includes the dual-camera working mode and the synchronous signal processing mode. The dual-camera working mode is used to indicate that the front camera module and the rear camera module are currently in use. The synchronous signal processing mode is used to indicate that the image data collected by the front camera module and the image data collected by the rear camera module are processed synchronously.
[0015] In some embodiments, determining the target mode as the second mode when the target camera module includes the front camera module or the rear camera module includes:
[0016] When the target camera module includes the front camera module or the rear camera module, the working mode corresponding to the target camera module is configured as a single camera working mode, and the signal processing mode corresponding to the target camera module is determined as a time-division signal processing mode.
[0017] The second mode includes the single-camera working mode and the time-division signal processing mode. The single-camera working mode is used to indicate that the front camera module or the rear camera module is currently in use, and the time-division signal processing mode is used to indicate that the image data collected by the single camera module currently in use is processed separately.
[0018] According to a second aspect of the present disclosure, a processing system is provided, the processing system including a front-facing camera module, a rear-facing camera module, a multiplexer, and an image signal processor, wherein the front-facing camera module is connected to the multiplexer, the rear-facing camera module is connected to the multiplexer, and the multiplexer is connected to the image signal processor;
[0019] The multiplexer is configured to determine the target camera module currently in use, the target camera module including a front camera module and / or a rear camera module; and to configure a target mode corresponding to the target camera module, the target mode including a first mode or a second mode, the first mode being configured to indicate that the front camera module and the rear camera module can be used simultaneously, and the second mode being configured to indicate that the front camera module and the rear camera module can be used independently in time-division multiplexing.
[0020] The image signal processor is used to process the image data acquired by the target camera module based on the target mode.
[0021] In some embodiments,
[0022] When the target camera module includes the front-facing camera module and the rear-facing camera module, the multiplexer is used to determine that the target mode is the first mode; or...
[0023] When the target camera module includes the front camera module or the rear camera module, the multiplexer is used to determine that the target mode is the second mode.
[0024] In some embodiments, the multiplexer includes a first configuration register and a second configuration register.
[0025] When the target camera module includes the front camera module and the rear camera module, the first configuration register is used to configure the working mode corresponding to the target camera module as a dual-camera working mode; the second configuration register is used to determine the signal processing mode corresponding to the target camera module as a synchronous signal processing mode.
[0026] The first mode includes the dual-camera working mode and the synchronous signal processing mode. The dual-camera working mode is used to indicate that the front camera module and the rear camera module are currently in use. The synchronous signal processing mode is used to indicate that the image data collected by the front camera module and the image data collected by the rear camera module are processed synchronously.
[0027] In some embodiments, the multiplexer includes a first configuration register and a second configuration register.
[0028] When the target camera module includes the front camera module or the rear camera module, the first configuration register is used to configure the working mode corresponding to the target camera module as a single camera working mode; the second configuration register is used to determine the signal processing mode corresponding to the target camera module as a time-division signal processing mode.
[0029] The second mode includes the single-camera working mode and the time-division signal processing mode. The single-camera working mode is used to indicate that the front camera module or the rear camera module is currently in use, and the time-division signal processing mode is used to indicate that the image data collected by the single camera module currently in use is processed separately.
[0030] In some embodiments, the processing system further includes a first controller and a second controller, the front-facing camera module is connected to the first controller, the first controller is connected to the multiplexer, the rear-facing camera module is connected to the second controller, and the second controller is connected to the multiplexer;
[0031] The first controller is used to transmit the image captured by the front-facing camera module to the multiplexer;
[0032] The second controller is used to transmit the images captured by the rear camera module to the multiplexer.
[0033] According to a third aspect of the present disclosure, a processing apparatus is provided, the apparatus comprising:
[0034] The module determination module is configured to determine the target camera module currently in use, the target camera module including a front camera module and / or a rear camera module;
[0035] The mode configuration module is configured to configure a target mode corresponding to the target camera module. The target mode includes a first mode or a second mode. The first mode is used to indicate that the front camera module and the rear camera module can be used simultaneously. The second mode is used to indicate that the front camera module and the rear camera module can be used independently in time division.
[0036] The processing module is configured to process the image data acquired by the target camera module based on the target mode.
[0037] In some embodiments, the mode configuration module is configured to:
[0038] When the target camera module includes the front camera module and the rear camera module, the target mode is determined to be the first mode; or...
[0039] When the target camera module includes the front camera module or the rear camera module, the target mode is determined to be the second mode.
[0040] In some embodiments, the mode configuration module is configured to:
[0041] When the target camera module includes the front camera module and the rear camera module, the working mode corresponding to the target camera module is configured as a dual camera working mode, and the signal processing mode corresponding to the target camera module is determined as a synchronous signal processing mode.
[0042] The first mode includes the dual-camera working mode and the synchronous signal processing mode. The dual-camera working mode is used to indicate that the front camera module and the rear camera module are currently in use. The synchronous signal processing mode is used to indicate that the image data collected by the front camera module and the image data collected by the rear camera module are processed synchronously.
[0043] In some embodiments, the mode configuration module is configured to:
[0044] When the target camera module includes the front camera module or the rear camera module, the working mode corresponding to the target camera module is configured as a single camera working mode, and the signal processing mode corresponding to the target camera module is determined as a time-division signal processing mode.
[0045] The second mode includes the single-camera working mode and the time-division signal processing mode. The single-camera working mode is used to indicate that the front camera module or the rear camera module is currently in use, and the time-division signal processing mode is used to indicate that the image data collected by the single camera module currently in use is processed separately.
[0046] According to a fourth aspect of the present disclosure, an electronic device is provided, comprising:
[0047] processor;
[0048] Memory used to store processor-executable instructions;
[0049] The processor is configured to perform the processing method as described in the first aspect of the embodiments of this disclosure.
[0050] According to a fifth aspect of the present disclosure, a non-transitory computer-readable storage medium is provided, wherein when instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to perform the processing method as described in the first aspect of the present disclosure.
[0051] The method described above, as disclosed in this invention, has the following beneficial effects:
[0052] The method provided in this disclosure can determine the current target mode based on the target camera module currently in use, that is, determine whether it is necessary to process image data from multiple camera modules or image data from one camera module. Then, based on the target mode, the image data collected by the target camera module is processed. By configuring the target mode, image data processing under different modes can be achieved without adding an additional image signal processor, thus reducing power consumption and cost.
[0053] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description
[0054] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.
[0055] Figure 1 This is a flowchart illustrating a processing method according to an exemplary embodiment;
[0056] Figure 2 This is a flowchart illustrating a processing method according to an exemplary embodiment;
[0057] Figure 3 This is a flowchart illustrating a processing method according to an exemplary embodiment;
[0058] Figure 4 This is a block diagram illustrating a processing system according to an exemplary embodiment;
[0059] Figure 5 This is a block diagram illustrating a processing apparatus according to an exemplary embodiment;
[0060] Figure 6 This is a block diagram of an electronic device according to an exemplary embodiment. Detailed Implementation
[0061] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numerals in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Rather, they are merely examples of apparatuses and methods consistent with some aspects of the invention as detailed in the appended claims.
[0062] In related technologies, one ISP corresponds to one AON camera, meaning that one ISP can only process image data from one AON camera. If image data from multiple AON cameras needs to be processed, multiple ISPs are required, leading to increased power consumption and higher costs. For example, a separate ISP is needed for the front-facing AON camera and the rear-facing AON camera; it is not possible to process both simultaneously using only one ISP.
[0063] The method provided in this disclosure can determine the current target mode based on the target camera module currently in use, that is, determine whether it is necessary to process image data from multiple camera modules or image data from one camera module. Then, based on the target mode, the image data collected by the target camera module is processed. By configuring the target mode, image data processing under different modes can be achieved without adding an additional image signal processor, thus reducing power consumption and cost.
[0064] The method provided in this disclosure is executed by an electronic device, which may be a mobile phone, tablet computer, laptop computer, wearable device, or other device with multiple camera modules.
[0065] Figure 1 This is a flowchart illustrating a processing method according to an exemplary embodiment, executed by an electronic device, see [link to flowchart]. Figure 1 The method includes the following steps:
[0066] Step S101: Determine the target camera module currently in use, including a front camera module and / or a rear camera module.
[0067] In this embodiment of the disclosure, the electronic device is provided with a front-facing camera module and a rear-facing camera module, and the user can select the camera module to use as needed. Optionally, a front-facing camera module can be used, for example, for face recognition, gesture recognition, or other operations, in which case the target camera module is the front-facing camera module; or, a rear-facing camera module can be used, for example, for QR code scanning, object detection, or other operations, in which case the target camera module is the rear-facing camera module; or, both a front-facing camera module and a rear-facing camera module can be used simultaneously, for example, while using a front-facing camera module for face recognition or gesture recognition, a rear-facing camera module for QR code scanning or object detection, in which case both the front-facing camera module and the rear-facing camera module are the target camera modules.
[0068] Step S102: Configure the target mode corresponding to the target camera module. The target mode includes a first mode or a second mode. The first mode is used to indicate that the front camera module and the rear camera module can be used simultaneously. The second mode is used to indicate that the front camera module and the rear camera module can be used independently in time division.
[0069] In this embodiment of the disclosure, since the image data collected when using only the front-facing camera module, using only the rear-facing camera module, and using both the front-facing and rear-facing camera modules are different, different processing methods are needed for different situations in order to better process the image data collected by the camera modules. Therefore, it is necessary to configure a target mode corresponding to the target camera module. This target mode indicates the currently used camera module and the image data processing method.
[0070] In some embodiments, configuring a target mode corresponding to a target camera module includes: when the target camera module includes a front-facing camera module and a rear-facing camera module, determining the target mode as a first mode; or, when the target camera module includes either a front-facing camera module or a rear-facing camera module, determining the target mode as a second mode. In other words, the corresponding target mode is set according to the number of target camera modules currently in use.
[0071] Step S103: Based on the target pattern, process the image data acquired by the target camera module.
[0072] When the target camera module includes a front camera module and a rear camera module, the image data collected by the target camera module is processed based on the first mode, that is, the image data collected by the front camera module and the image data collected by the rear camera module are processed simultaneously. When the target camera module includes either a front camera module or a rear camera module, the image data collected by the target camera module is processed based on the second mode, that is, only the image data collected by the front camera module or only the image data collected by the rear camera module needs to be processed.
[0073] The method provided in this disclosure, by configuring a target mode, enables the processing of image data under different modes without the need for an additional image signal processor, thereby reducing power consumption and cost.
[0074] In some embodiments, each mode includes a working mode and a signal processing mode. The working mode characterizes the camera module currently in use, and the signal processing mode characterizes the processing method for the image data acquired by the currently used camera module. The following describes... Figure 2 The illustrated embodiments explain the configuration process for each mode.
[0075] Figure 2 This is a flowchart illustrating a processing method according to an exemplary embodiment, executed by an electronic device, see [link to flowchart]. Figure 2 The method includes the following steps:
[0076] Step S201: Determine the target camera module currently in use.
[0077] In some embodiments, the image data acquired by different camera modules has different transmission paths. Therefore, the target camera module currently in use can be determined based on the transmission path of the image data; alternatively, the operating information of the underlying camera module can be directly read to determine the target camera module currently in use. Of course, other methods can also be used to determine the target camera module, and this disclosure does not limit this approach.
[0078] In this embodiment of the disclosure, subsequent corresponding operations are performed according to the target camera module being used. When the target camera module includes a front camera module and a rear camera module, step S202 is executed; when the target camera module includes either a front camera module or a rear camera module, step S204 is executed.
[0079] Step S202: When the target camera module includes a front camera module and a rear camera module, the working mode corresponding to the target camera module is configured as a dual camera working mode, and the signal processing mode corresponding to the target camera module is determined as a synchronous signal processing mode.
[0080] The first mode includes a dual-camera working mode and a synchronous signal processing mode. The dual-camera working mode indicates that the front-facing camera module and the rear-facing camera module are currently in use, while the synchronous signal processing mode indicates that image data acquired by the front-facing camera module and the image data acquired by the rear-facing camera module are processed simultaneously. The dual-camera mode can also be called the simultaneous working mode.
[0081] In this embodiment, the operating mode is configured as a dual-camera operating mode, indicating that a front-facing camera module and a rear-facing camera module are currently in use, meaning that the first and second channels operate simultaneously. The first channel is the channel for transmitting image data corresponding to the front-facing camera module, and the second channel is the channel for transmitting image data corresponding to the rear-facing camera module. Then, the signal processing mode is configured as a synchronous signal processing mode so that subsequent processing of image data acquired by the front-facing camera module and the rear-facing camera module can be performed synchronously.
[0082] Step S203: Based on the synchronous signal processing mode, process the image data acquired by the target camera module.
[0083] When the target camera module includes a front camera module and a rear camera module, after configuring the synchronous signal processing mode, the image data collected by the front camera module and the image data collected by the rear camera module are processed synchronously. For example, two processing threads can be created, each processing thread is used to process the image data collected by one camera module, and the two processing threads execute synchronously.
[0084] Step S204: When the target camera module includes a front camera module or a rear camera module, configure the working mode of the target camera module as a single camera working mode and determine the signal processing mode of the target camera module as a time-division signal processing mode.
[0085] The second mode includes a single-camera working mode and a time-division signal processing mode. The single-camera working mode indicates that the front-facing camera module or the rear-facing camera module is currently in use, while the time-division signal processing mode indicates that the image data collected by the single camera module currently in use is processed separately.
[0086] In this embodiment, the operating mode is configured as a single-camera operating mode, indicating that either a front-facing camera module or a rear-facing camera module is currently in use, i.e., one of the first and second paths. Then, the signal processing mode is configured as a time-division signal processing mode, so that image data acquired by either the front-facing camera module or the rear-facing camera module can be processed independently subsequently.
[0087] In some embodiments, the image data acquired by the front-facing camera module can be processed using the processing method corresponding to the front-facing camera module, and the image data acquired by the rear-facing camera module can be processed using the processing method corresponding to the rear-facing camera module. The processing methods for the front-facing camera module and the rear-facing camera module can be the same or different. The processing methods may include multiple image processing algorithms or other processing methods, and this disclosure does not limit this.
[0088] Step S205: Based on the time-division signal processing mode, process the image data acquired by the target camera module.
[0089] When the target camera module includes a front camera module or a rear camera module, after configuring the time-division signal processing mode, the image data collected by the front camera module or the image data collected by the rear camera module are processed separately.
[0090] In some embodiments, during the processing, it can be further determined whether the target camera module currently in use is a front-facing camera module or a rear-facing camera module. If the target camera module is a front-facing camera module, the processing method corresponding to the front-facing camera module is used to process the image data collected by the front-facing camera module. If the target camera module is a rear-facing camera module, the processing method corresponding to the rear-facing camera module is used to process the image data collected by the rear-facing camera module.
[0091] The method provided in this disclosure, by configuring a target mode, enables the processing of image data under different modes without requiring an additional image signal processor, thus reducing power consumption and cost. Furthermore, it can process image data acquired by a single camera module or simultaneously process image data acquired by multiple camera modules, enriching its application scenarios.
[0092] See one example. Figure 3 The flowchart shown illustrates the processing method, which includes the following steps:
[0093] Step S1: The electronic device is in standby mode.
[0094] Step S2: Determine whether the AON function is enabled. If the AON function is not enabled, proceed to step S3. If the AON function is enabled, proceed to step S4.
[0095] Step S3: Enable AON function.
[0096] Optionally, a prompt message is displayed to prompt the user to enable the AON function. If the user wants to enable the AON function, the AON function is enabled on the electronic device. If the user does not want to enable it, the AON function is not enabled and no further operations are performed.
[0097] Step S4: Determine whether the current setting is a single AON. If it is a single AON setting, proceed to step S5. If it is not a single AON setting, proceed to step S9.
[0098] The single AON setting refers to using either the front camera module or the rear camera module.
[0099] Step S5: Configure the working mode as single camera working mode and the signal processing mode as time-division signal processing mode.
[0100] Step S6: Determine whether the front camera module is being used. If the front camera module is being used, proceed to step S7; otherwise, proceed to step S8.
[0101] Step S7: Process the image data acquired by the front-facing camera module.
[0102] Step S8: Process the image data acquired by the rear camera module.
[0103] Step S9: Configure the working mode as dual-camera working mode and the signal processing mode as synchronous signal processing mode.
[0104] Step S10: Simultaneously process the image data acquired by the front camera module and the image data acquired by the rear camera module.
[0105] This disclosure also provides a processing system, which includes a front-facing camera module, a rear-facing camera module, a multiplexer, and an image signal processor. The front-facing camera module is connected to the multiplexer, the rear-facing camera module is connected to the multiplexer, and the multiplexer is connected to the image signal processor.
[0106] The multiplexer is used to determine the target camera module currently in use, including a front camera module and / or a rear camera module; and to configure a target mode corresponding to the target camera module, including a first mode or a second mode, wherein the first mode is used to characterize the simultaneous use of the front camera module and the rear camera module, and the second mode is used to characterize the independent time-division use of the front camera module and the rear camera module.
[0107] An image signal processor is used to process image data acquired by a target camera module based on the target pattern.
[0108] In some embodiments, when the target camera module includes a front-facing camera module and a rear-facing camera module, the multiplexer is used to determine the target mode as a first mode; or,
[0109] When the target camera module includes a front camera module or a rear camera module, the multiplexer is used to determine the target mode as the second mode.
[0110] In some embodiments, the multiplexer includes a first configuration register and a second configuration register.
[0111] When the target camera module includes a front camera module and a rear camera module, the first configuration register is used to configure the working mode of the target camera module as a dual-camera working mode; the second configuration register is used to determine the signal processing mode of the target camera module as a synchronous signal processing mode.
[0112] The first mode includes a dual-camera working mode and a synchronous signal processing mode. The dual-camera working mode is used to indicate that the front camera module and the rear camera module are currently in use, and the synchronous signal processing mode is used to indicate that the image data collected by the front camera module and the image data collected by the rear camera module are processed synchronously.
[0113] In some embodiments, the multiplexer includes a first configuration register and a second configuration register.
[0114] When the target camera module includes a front camera module or a rear camera module, the first configuration register is used to configure the working mode of the target camera module as a single camera working mode; the second configuration register is used to determine the signal processing mode of the target camera module as a time-division signal processing mode.
[0115] The second mode includes a single-camera working mode and a time-division signal processing mode. The single-camera working mode indicates that the front-facing camera module or the rear-facing camera module is currently in use, while the time-division signal processing mode indicates that the image data collected by the single camera module currently in use is processed separately.
[0116] In some embodiments, the processing system further includes a first controller and a second controller, the front camera module is connected to the first controller, the first controller is connected to a multiplexer, the rear camera module is connected to the second controller, and the second controller is connected to a multiplexer.
[0117] The first controller is used to transmit the images captured by the front-facing camera module to the multiplexer.
[0118] The second controller is used to transmit the images captured by the rear camera module to the multiplexer.
[0119] The implementation methods for the operations performed by the multiplexer and image signal processor are described above. Figure 1 and Figure 2 The embodiments shown will not be described in detail here.
[0120] In some embodiments, a block diagram of the processing system is as follows: Figure 4 As shown, the first controller can also be called the first CSI (Container Storage Interface) controller, and the second controller can also be called the second CSI controller. In addition to the front-facing camera module, the rear-facing camera module, the multiplexer, the image signal processor, the first CSI controller, and the second CSI controller, the processing system also includes: random access memory (RAM), a first interface (C-PHY / D-PHY) for connecting the front-facing camera module and the first CSI controller, and a second interface (C-PHY / D-PHY) for connecting the rear-facing camera module and the second CSI controller. The RAM is connected to the image signal processor and is used to store the image data processed by the image signal processor. The RAM can be static random access memory (SRAM) or dynamic random access memory (DRAM).
[0121] For the multiplexer, the first CSI controller can transmit the usage information of the front camera module to the multiplexer, and the second CSI controller can transmit the usage information of the rear camera module to the multiplexer. Thus, the multiplexer can determine the target camera module currently in use, and then configure the corresponding working mode and signal processing mode according to the target camera module through the first configuration register and the second configuration register respectively. Then, the image signal processor can process the image data acquired by the target camera module according to the configured mode. Thus, the multiplexer realizes the multiplexing function and the switching function. The multiplexing function means that the front camera module and the rear camera module can be used simultaneously through one image signal processor, and the switching function means that the front camera module and the rear camera module can be used independently in a time-division manner through one image signal processor.
[0122] Figure 5 This is a block diagram illustrating a processing apparatus according to an exemplary embodiment, configured in an electronic device, see [link to relevant documentation]. Figure 5 The device includes:
[0123] The module determination module 501 is configured to determine the target camera module currently in use, including a front camera module and / or a rear camera module;
[0124] The mode configuration module 502 is configured to configure a target mode corresponding to the target camera module. The target mode includes a first mode or a second mode. The first mode is used to indicate that the front camera module and the rear camera module can be used simultaneously. The second mode is used to indicate that the front camera module and the rear camera module can be used independently in time division.
[0125] The processing module 503 is configured to process image data acquired by the target camera module based on the target mode.
[0126] In some embodiments, the mode configuration module 502 is configured as follows:
[0127] When the target camera module includes a front-facing camera module and a rear-facing camera module, the target mode is determined to be the first mode; or,
[0128] When the target camera module includes a front camera module or a rear camera module, the target mode is determined to be the second mode.
[0129] In some embodiments, the mode configuration module 502 is configured as follows:
[0130] When the target camera module includes a front camera module and a rear camera module, the working mode corresponding to the target camera module is configured as a dual camera working mode, and the signal processing mode corresponding to the target camera module is determined as a synchronous signal processing mode.
[0131] The first mode includes a dual-camera working mode and a synchronous signal processing mode. The dual-camera working mode is used to indicate that the front camera module and the rear camera module are currently in use, and the synchronous signal processing mode is used to indicate that the image data collected by the front camera module and the image data collected by the rear camera module are processed synchronously.
[0132] In some embodiments, the mode configuration module 502 is configured as follows:
[0133] When the target camera module includes a front camera module or a rear camera module, the working mode corresponding to the target camera module is configured as a single camera working mode, and the signal processing mode corresponding to the target camera module is determined as a time-division signal processing mode.
[0134] The second mode includes a single-camera working mode and a time-division signal processing mode. The single-camera working mode indicates that the front-facing camera module or the rear-facing camera module is currently in use, while the time-division signal processing mode indicates that the image data collected by the single camera module currently in use is processed separately.
[0135] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.
[0136] This disclosure also provides an electronic device, including: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured to execute the processing method described in the above embodiments.
[0137] Figure 6 This is a block diagram of an electronic device 600 according to an exemplary embodiment.
[0138] Reference Figure 6 The electronic device 600 may include one or more of the following components: a processing component 602, a memory 604, a power supply component 606, a multimedia component 608, an audio component 610, an input / output (I / O) interface 612, a sensor component 614, and a communication component 616.
[0139] Processing component 602 typically controls the overall operation of electronic device 600, such as operations associated with display, telephone calls, data communication, camera operation, and recording operations. Processing component 602 may include one or more processors 620 to execute instructions to perform all or part of the steps of the methods described above. Furthermore, processing component 602 may include one or more modules to facilitate interaction between processing component 602 and other components. For example, processing component 602 may include a multimedia module to facilitate interaction between multimedia component 608 and processing component 602.
[0140] Memory 604 is configured to store various types of data to support the operation of electronic device 600. Examples of this data include instructions for any application or method operating on electronic device 600, contact data, phonebook data, messages, pictures, videos, etc. Memory 604 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.
[0141] Power supply component 606 provides power to various components of electronic device 600. Power supply component 606 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to electronic device 600.
[0142] Multimedia component 608 includes a screen that provides an output interface between the electronic device 600 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touchscreen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may sense not only the boundaries of the touch or swipe action but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 608 includes a front-facing camera and / or a rear-facing camera. When the electronic device 600 is in an operating mode, such as a shooting mode or a video mode, the front-facing camera and / or the rear-facing camera may receive external multimedia data. Each front-facing camera and rear-facing camera may be a fixed optical lens system or have focal length and optical zoom capabilities.
[0143] Audio component 610 is configured to output and / or input audio signals. For example, audio component 610 includes a microphone (MIC) configured to receive external audio signals when electronic device 600 is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio signals may be further stored in memory 604 or transmitted via communication component 616. In some embodiments, audio component 610 also includes a speaker for outputting audio signals.
[0144] I / O interface 612 provides an interface between processing component 602 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, home buttons, volume buttons, power buttons, and lock buttons.
[0145] Sensor assembly 614 includes one or more sensors for providing state assessments of various aspects of electronic device 600. For example, sensor assembly 614 can detect the on / off state of electronic device 600, the relative positioning of components such as the display and keypad of electronic device 600, changes in position of electronic device 600 or a component of electronic device 600, the presence or absence of user contact with electronic device 600, orientation or acceleration / deceleration of electronic device 600, and temperature changes of electronic device 600. Sensor assembly 614 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 614 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, sensor assembly 614 may also include an accelerometer, gyroscope, magnetometer, pressure sensor, or temperature sensor.
[0146] Communication component 616 is configured to facilitate wired or wireless communication between electronic device 600 and other devices. Electronic device 600 can access wireless networks based on communication standards, such as WiFi, 2G, or 3G, or combinations thereof. In one exemplary embodiment, communication component 616 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, communication component 616 also includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
[0147] In an exemplary embodiment, the electronic device 600 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the methods described above.
[0148] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 604 including instructions, which can be executed by a processor 620 of an electronic device 600 to perform the above-described method. For example, the non-transitory computer-readable storage medium may be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.
[0149] This disclosure also provides a non-transitory computer-readable storage medium, wherein when the instructions in the storage medium are executed by a processor of an electronic device, the electronic device is able to perform the processing methods described in the above embodiments.
[0150] Other embodiments of the invention will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention that follow the general principles of the invention and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of the invention are indicated by the following claims.
[0151] It should be understood that the present invention is not limited to the precise structure described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of the invention is limited only by the appended claims.
Claims
1. A processing method characterized by, The method comprises: determining a target camera module currently in use, the target camera module comprising a front camera module and / or a rear camera module; configuring a target mode corresponding to the target camera module, the target mode comprising a first mode or a second mode, the first mode being used to represent support for simultaneous use of the front camera module and the rear camera module, and the second mode being used to represent support for independent time-sharing use of the front camera module and the rear camera module; processing image data collected by the target camera module based on the target mode.
2. The treatment method according to claim 1, characterized in that, The configuration of the target mode corresponding to the target camera module comprises: when the target camera module comprises the front camera module and the rear camera module, determining that the target mode is the first mode; or when the target camera module comprises the front camera module or the rear camera module, determining that the target mode is the second mode.
3. The treatment method according to claim 2, characterized in that, The determination that the target mode is the first mode when the target camera module comprises the front camera module and the rear camera module comprises: when the target camera module comprises the front camera module and the rear camera module, configuring a working mode corresponding to the target camera module as a dual-camera working mode, and determining a signal processing mode corresponding to the target camera module as a synchronous signal processing mode; wherein the first mode comprises the dual-camera working mode and the synchronous signal processing mode, the dual-camera working mode being used to represent that the front camera module and the rear camera module are currently in use, and the synchronous signal processing mode being used to represent synchronous processing of image data collected by the front camera module and image data collected by the rear camera module.
4. The treatment method of claim 2, wherein The determination that the target mode is the second mode when the target camera module comprises the front camera module or the rear camera module comprises: when the target camera module comprises the front camera module or the rear camera module, configuring a working mode corresponding to the target camera module as a single-camera working mode, and determining a signal processing mode corresponding to the target camera module as a time-sharing signal processing mode; wherein the second mode comprises the single-camera working mode and the time-sharing signal processing mode, the single-camera working mode being used to represent that the front camera module or the rear camera module is currently in use, and the time-sharing signal processing mode being used to represent separate processing of image data collected by a single camera module currently in use.
5. A processing system, characterized by The processing system comprises a front camera module, a rear camera module, a multiplexer, and an image signal processor, the front camera module being connected to the multiplexer, the rear camera module being connected to the multiplexer, and the multiplexer being connected to the image signal processor; The multiplexer is configured to determine a target camera module currently in use, the target camera module comprising the front camera module and / or the rear camera module; and configure a target mode corresponding to the target camera module, the target mode comprising a first mode or a second mode, the first mode being used to represent support for simultaneous use of the front camera module and the rear camera module, and the second mode being used to represent support for independent time-sharing use of the front camera module and the rear camera module; The image signal processor is configured to process image data collected by the target camera module based on the target mode.
6. The processing system of claim 5, wherein when the target camera module comprises the front camera module and the rear camera module, the multiplexer is configured to determine that the target mode is the first mode; or when the target camera module comprises the front camera module or the rear camera module, the multiplexer is configured to determine that the target mode is the second mode.
7. The processing system of claim 6, wherein, The multiplexer comprises a first configuration register and a second configuration register, when the target camera module comprises the front camera module and the rear camera module, the first configuration register is configured to configure a working mode corresponding to the target camera module as a dual-camera working mode, and the second configuration register is configured to determine a signal processing mode corresponding to the target camera module as a synchronous signal processing mode; wherein the first mode comprises the dual-camera working mode and the synchronous signal processing mode, the dual-camera working mode being used to represent that the front camera module and the rear camera module are currently in use, and the synchronous signal processing mode being used to represent synchronous processing of image data collected by the front camera module and image data collected by the rear camera module.
8. The processing system of claim 6, wherein, The multiplexer comprises a first configuration register and a second configuration register, when the target camera module comprises the front camera module or the rear camera module, the first configuration register is configured to configure a working mode corresponding to the target camera module as a single-camera working mode, and the second configuration register is configured to determine a signal processing mode corresponding to the target camera module as a time-sharing signal processing mode; wherein the second mode comprises the single-camera working mode and the time-sharing signal processing mode, the single-camera working mode being used to represent that the front camera module or the rear camera module is currently in use, and the time-sharing signal processing mode being used to represent separate processing of image data collected by a single camera module currently in use.
9. The processing system of claim 5, wherein, The processing system further comprises a first controller and a second controller, the front camera module is connected to the first controller, the first controller is connected to the multiplexer, the rear camera module is connected to the second controller, and the second controller is connected to the multiplexer. The first controller is configured to transmit an image captured by the front camera module to the multiplexer. The second controller is configured to transmit an image captured by the rear camera module to the multiplexer.
10. A processing device, characterized by The apparatus comprises: a module determination module configured to determine a target camera module currently in use, the target camera module comprising a front camera module and / or a rear camera module; a mode configuration module configured to configure a target mode corresponding to the target camera module, the target mode comprising a first mode or a second mode, the first mode being used to represent support for simultaneous use of the front camera module and the rear camera module, and the second mode being used to represent support for independent time-sharing use of the front camera module and the rear camera module; a processing module configured to process image data captured by the target camera module based on the target mode.
11. An electronic device, comprising: comprise: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to perform the processing method according to any one of claims 1-4.
12. A non-transitory computer-readable storage medium, comprising: When the instructions in the storage medium are executed by the processor of the electronic device, the electronic device is enabled to perform the processing method according to any one of claims 1-4.