Image processing method and apparatus, and electronic device

Abstract

Disclosed in the present application are an image processing method and apparatus, and an electronic device. The method is executed by an electronic device, which comprises a camera module, an application processor and an image processing chip. The method comprises: an application processor acquiring image configuration parameters; the application processor sending the image configuration parameters to both a camera module and an image processing chip; the camera module generating a target image frame on the basis of the image configuration parameters, and sending the target image frame to the image processing chip; and the image processing chip performing image processing on the target image frame on the basis of the image configuration parameters, so as to obtain a first processed image.

Description

Image processing method, device and electronic device

[0001] Cross-reference to Related Applications

[0002] This application claims priority to Chinese Patent Application No. 202411344841.4, filed on September 25, 2024, the contents of which are incorporated herein by reference in its entirety. TECHNICAL FIELD

[0003] The present application belongs to the technical field of image processing, and specifically relates to an image processing method, device and electronic device. BACKGROUND

[0004] With the rapid development of electronic technology, electronic devices have been widely applied, and can support the image function of the electronic device through a camera module and an application processor system chip (AP SoC).

[0005] At present, the electronic device can use the AP SoC to process the image frame output by the camera module. Since the hardware on the application processor (AP) side is of a general type and is not usually optimized for a specific application scenario such as a shooting business scenario, this image processing method may have the problem of poor output image quality. SUMMARY

[0006] The purpose of the embodiments of the present application is to provide an image processing method, device and electronic device, which solves the technical problem of poor output image quality in the image processing method of directly processing images on the AP side, and can improve the output image quality of the electronic device.

[0007] In a first aspect, the embodiments of the present application provide an image processing method, which is executed by an electronic device, the electronic device comprising a camera module, an application processor and an image processing chip, and the method comprising:

[0008] The application processor acquires image configuration parameters;

[0009] The application processor sends the image configuration parameters to the camera module and the image processing chip respectively;

[0010] The camera module generates a target image frame based on the image configuration parameters, and sends the target image frame to the image processing chip;

[0011] The image processing chip performs image processing on the target image frame based on the image configuration parameters to obtain a first processed image.

[0012] In a second aspect, an embodiment of the present application provides an image processing apparatus applied to an electronic device, the electronic device comprising a camera module, an application processor and an image processing chip, and the apparatus comprising:

[0013] an acquisition module configured to acquire, by the application processor, image configuration parameters;

[0014] a first sending module configured to send, by the application processor, the image configuration parameters to the camera module and the image processing chip respectively;

[0015] a generation module configured to generate, by the camera module, a target image frame based on the image configuration parameters;

[0016] a second sending module configured to send, by the camera module, the target image frame to the image processing chip;

[0017] an image processing module configured to perform, by the image processing chip, image processing on the target image frame based on the image configuration parameters to obtain a first processed image.

[0018] In a third aspect, an embodiment of the present application provides an electronic device comprising a processor and a memory, wherein the memory stores programs or instructions executable on the processor, and the programs or instructions are executed by the processor to implement the steps of the image processing method according to the first aspect.

[0019] In a fourth aspect, an embodiment of the present application provides a readable storage medium, wherein the readable storage medium stores programs or instructions, and the programs or instructions are executed by a processor to implement the steps of the image processing method according to the first aspect.

[0020] In a fifth aspect, an embodiment of the present application provides a chip comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, the processor is configured to run programs or instructions to implement the steps of the image processing method according to the first aspect.

[0021] In a sixth aspect, an embodiment of the present application provides a computer program product stored in a storage medium, and the computer program product is executed by at least one processor to implement the steps of the image processing method according to the first aspect.

[0022] In the embodiments of the present application, the image configuration parameters are acquired by an AP in the electronic device; the AP sends the image configuration parameters to a camera module in the electronic device and an image processing chip in the electronic device respectively; the camera module generates a target image frame based on the image configuration parameters and sends the target image frame to the image processing chip; the image processing chip performs image processing on the target image frame based on the image configuration parameters to obtain a first processed image. Since the image processing of the image processing chip depends on the actual exposure, gain and other configuration parameters of the image frame, the same image configuration parameters are sent to the camera module and the image processing chip by the AP to control the camera module to generate an image frame based on the image configuration parameters and control the image processing chip to use the same image configuration parameters on the image frame output by the camera module, so that the image processing chip can enhance the image support capability of the electronic device, thereby improving the output image quality of the electronic device. BRIEF DESCRIPTION OF DRAWINGS

[0023] FIG. 1 is a flowchart of an image processing method according to some embodiments of the present application;

[0024] FIG. 2 is a timing diagram of sending image configuration parameters by an application processor according to some embodiments of the present application;

[0025] FIG. 3 is a timing diagram of sending image configuration parameters by an application processor according to some embodiments of the present application;

[0026] FIG. 4 is a timing diagram of sending image configuration parameters by an application processor according to some embodiments of the present application;

[0027] FIG. 5 is a timing diagram of storing image configuration parameters by an image processing chip according to some embodiments of the present application;

[0028] FIG. 6 is a functional framework diagram of implementing image processing by an electronic device according to some embodiments of the present application;

[0029] FIG. 7 is a processing flow diagram of image configuration parameters by an image processing chip according to some embodiments of the present application;

[0030] FIG. 8 is an interaction diagram of an image processing method according to some embodiments of the present application;

[0031] FIG. 9 is a structural diagram of an image processing apparatus according to some embodiments of the present application;

[0032] FIG. 10 is a structural diagram of an electronic device according to some embodiments of the present application;

[0033] FIG. 11 is a hardware structural diagram of an electronic device according to some embodiments of the present application. DETAILED DESCRIPTION

[0034] The technical solutions in the embodiments of the present application will be clearly described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only some, but not all of the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by a person of ordinary skill in the art belong to the scope of protection of the present application.

[0035] The terms "first", "second", and the like in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the terms used in this way can be interchanged under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than that illustrated or described herein, and the objects distinguished by "first", "second", etc. are generally of a kind and do not limit the number of objects, for example, the first object can be one or more. In addition, "and / or" in the specification and claims means at least one of the connected objects, and the character " / " generally means that the objects before and after are in an "or" relationship.

[0036] The image processing method provided by the embodiments of the present application will be described in detail below with reference to the drawings and specific embodiments and their application scenarios.

[0037] It should be noted that the image processing method of the embodiments of the present application is executed by an electronic device, which can include a camera module, an application processor (AP SoC) and an image processing chip.

[0038] The camera module can include an image sensor (Sensor), which can be a complementary metal oxide semiconductor (CMOS) Sensor. The camera module can perform image exposure through the CMOS Sensor to generate an image frame. Then, in some embodiments, the camera module can output the image frame to the AP SoC and the image processing chip, respectively.

[0039] The image processing chip generally refers to an external chip or module used for graphics processing in mobile devices or computers. The image processing chip is usually used to provide additional graphics processing capability to improve the graphics performance of the device and process graphics-related tasks. In mobile devices, the image processing chip can be used to accelerate games, video playback, graphics rendering and other tasks to provide a smoother user experience. The image processing chip usually works with the central processing unit (CPU) to share the load of graphics processing, thereby improving the performance and efficiency of the overall system.

[0040] In some embodiments, the image processing chip can be an application specific integrated circuit (ASIC) chip. In some embodiments, an external graphic processing unit (GPU) in a computer can also be regarded as an image processing chip, which is used to process complex graphics tasks such as three-dimensional (3D) modeling, video editing, etc. In some high-performance computers or game devices, users can also choose to install additional graphic processors to improve graphics performance.

[0041] The application processor (AP) is a super large scale integrated circuit that extends audio and video functions and special interfaces based on the central processing unit, and plays a role in operation and calling of other functional components in electronic devices.

[0042] The AP can include an AP SoC, which can control the camera module to output image frames, and can also control the image processing chip to perform image processing based on the image frames output by the camera module to obtain first processed images.

[0043] In some embodiments, the AP can also include an image post-processing module that can perform image post-processing on the first processed images sent by the image processing chip based on the image frames output by the camera module to output the video of the electronic device. In this way, the electronic device can realize the video support capability through the camera module, the AP and the image processing chip.

[0044] In some embodiments, the electronic device can include an AP, a camera module and an ASIC chip. The camera module can output image frames to the AP SoC and the ASIC chip through shunting. The ASIC chip can perform image processing based on the image frames output by the camera module and send the obtained first processed images to the AP SoC. The AP SoC can perform image post-processing on the first processed images based on the image frames output by the camera module to output the video accordingly and realize the video support capability.

[0045] During the output of the video by the electronic device, the camera module can generate image frames based on image configuration parameters, i.e. the image configuration parameters are applied to the camera module to make the camera module generate image frames, and the image processing chip can perform image processing on the image frames based on the image configuration parameters. In order to ensure that the electronic device outputs good video effects, the image configuration parameters applied to the camera module when generating the image frames need to be the same as the image configuration parameters used by the image processing chip to process the image frames, which will be described in detail below.

[0046] FIG. 1 is a flowchart of an image processing method according to an embodiment of the present application. As shown in FIG. 1, the method comprises the following steps:

[0047] In step 101, an application processor acquires image configuration parameters.

[0048] In some embodiments, the image configuration parameters can include 3A related meta configuration parameters of the camera module, where 3A refers to Auto Exposure (AE), Auto White Balance (AWB) and Auto Focus (AF) of the camera module. The AE is to adjust the shutter, aperture and sensitivity to make the image reach the appropriate brightness, the AWB is to adjust the gain value of the Red (R) / Blue (B) channel of the image to adjust the color temperature / hue performance of the image, and the AF is to control the displacement of the focus motor to make the lens focus on the appropriate position.

[0049] In some embodiments, the image configuration parameters can include control parameters of the working mode of the camera module and parameters related to the exposure of the camera module. The working mode of the camera module can indicate the color temperature performance of the generated image frame, such as soft or black and white, etc. The image characteristics of the image frame output by the camera module under different working modes are different, and in some embodiments, the working mode of the camera module can be controlled by adjusting the gain value of the R / B channel of the image.

[0050] In some embodiments, the image configuration parameters can act on the CMOS sensor (Sensor) to make the CMOS Sensor generate an image frame based on the image configuration parameters, where the image frame can be output by the camera module to the AP SoC. The AP SoC can issue new image configuration parameters to the CMOS Sensor in the process of receiving the image frame.

[0051] In some embodiments, due to the characteristics of the CMOS Sensor, the configuration issued by the AP SoC in the process of receiving each image frame can include: a configuration acting on the CMOS Sensor to generate the next image frame, and a configuration acting on the CMOS Sensor to generate the next image frame. That is, if the AP SoC issues image configuration parameters to the CMOS Sensor between the end time of receiving the N-1th (N is an integer greater than 1) image frame and the receiving process of the Nth image frame, the image configuration parameters can include the first configuration parameters corresponding to the N+1th image frame of the camera module, and the second configuration parameters corresponding to the N+2th image frame of the camera module.

[0052] The first configuration parameter corresponding to the N+1th image frame of the camera module refers to a configuration parameter that can act on the CMOS Sensor to generate the N+1th image frame. The second configuration parameter corresponding to the N+2th image frame of the camera module refers to a configuration parameter that can act on the CMOS Sensor to generate the N+2th image frame.

[0053] The first configuration parameter can be a first type of configuration parameter, and the first type of configuration parameter is a control parameter of the working mode of the camera module. The second configuration parameter can be a second type of configuration parameter, and the second type of configuration parameter is a parameter related to exposure.

[0054] In some embodiments, the AP SoC can obtain the image configuration parameter when the electronic device starts the camera module. In some embodiments, the AP SoC can obtain a pre-set image configuration parameter. For example, the AP SoC can obtain a pre-set image configuration parameter when the camera module starts to start. In some embodiments, the AP SoC can calculate the image configuration parameter based on the image features of the N-1th image frame when the N-1th image frame is obtained. In this way, the image features output by the electronic device can be dynamically adjusted, and the output image effect of the electronic device can be improved.

[0055] Step 102, the application processor sends the image configuration parameter to the camera module and the image processing chip respectively.

[0056] The AP SoC can send the image configuration parameter to the camera module and the image processing chip at the same time, or can send the image configuration parameter to the camera module and the image processing chip at different times.

[0057] Due to the shadow mechanism of the CMOS Sensor, the AP SoC needs to send the image configuration parameter to the camera module before the effective time of the image configuration parameter in the hardware register of the CMOS Sensor. The shadow mechanism of the CMOS Sensor refers to that the hardware register of the CMOS Sensor acts as a shadow of the CMOS Sensor, so that the hardware register can process the operation of the CMOS Sensor and ensure the last effect, that is, meet the demand of writing to the CMOS Sensor. The hardware register needs to correctly process its own state to ensure that the operation of the CMOS Sensor is consistent.

[0058] That is, the hardware register of the CMOS Sensor needs to be written with the image configuration parameter before the image configuration parameter acts on the CMOS Sensor. Moreover, the image configuration parameter needs to be written into the hardware register before the image configuration parameter takes effect in the hardware register of the CMOS Sensor, so as to ensure that the image configuration parameter stored in the hardware register can act on the CMOS Sensor, and the CMOS Sensor generates a corresponding image frame.

[0059] In some embodiments, in a case where the image configuration parameter includes a first configuration parameter corresponding to an N+1th image frame of the camera module, and a second configuration parameter corresponding to an N+2th image frame of the camera module, since the image configuration parameter takes effect in the hardware register of the CMOS Sensor usually in a process of receiving an Nth image frame output by the camera module, the application processor can send the image configuration parameter to the camera module near a starting time of receiving the Nth image frame output by the camera module.

[0060] Correspondingly, the camera module can store the image configuration parameter into the hardware register before the state of the hardware register of the CMOS Sensor is switched, so that the image configuration parameter stored in the hardware register of the CMOS Sensor takes effect when the state of the hardware register of the CMOS Sensor is switched. Wherein, the CMOS Sensor taking effect on the image configuration parameter refers to the state of the image configuration parameter stored in the hardware register being switched to an effective state, and in a case where the CMOS Sensor takes effect on the image configuration parameter, the image configuration parameter can act on the CMOS Sensor to generate an image frame.

[0061] Wherein, due to the shadow mechanism of the image processing chip, the configuration parameter of the image frame needs to be written into the hardware register of the image processing chip before the image frame is received, so as to ensure that the image processing chip can perform image processing based on the configuration parameter stored in the hardware register. Wherein, the shadow mechanism of the image processing chip is similar to the principle of the shadow mechanism of the CMOS Sensor, which will not be described here.

[0062] In some embodiments, when the image configuration parameter includes a first configuration parameter corresponding to an N+1th image frame of the camera module and a second configuration parameter corresponding to an N+2th image frame of the camera module, the application processor can send the image configuration parameter to the image processing chip before a starting moment of receiving the N+1th image frame. Correspondingly, the image processing chip can store the image configuration parameter in the hardware register, so that the image configuration parameter stored in the hardware register of the image processing chip can be used for image processing of the corresponding image frame.

[0063] In this step, the application processor sends the same image configuration parameter to the camera module and the image processing chip, so that the application processor can control the camera module and the image processing chip to perform corresponding operations based on the same image configuration parameter, thereby ensuring that the electronic device outputs good image effects.

[0064] In step 103, the camera module generates a target image frame based on the image configuration parameter and sends the target image frame to the image processing chip.

[0065] In some embodiments, when the camera module receives the image configuration parameter, the camera module can write the image configuration parameter into the hardware register of the CMOS Sensor. The image configuration parameter stored in the hardware register of the CMOS Sensor can act on the camera module, so that the CMOS Sensor of the camera module generates a target image frame. The image configuration parameter acting on the camera module means that the image configuration parameter is used to adjust parameters such as shutter, aperture, sensitivity, and gain value of image red R / blue B channel, and control the displacement of the focusing motor, so that the CMOS Sensor generates a corresponding image frame.

[0066] In some embodiments, the CMOS Sensor can be divided into two branches, and the image frames are sent to the AP SoC and the image processing chip, respectively.

[0067] In some embodiments, the image configuration parameter can include a first configuration parameter corresponding to the N+1th image frame and a second configuration parameter corresponding to the N+2th image frame. In the working process of the CMOS Sensor, the first configuration parameter stored in the hardware register of the CMOS Sensor can be acquired, and the first configuration parameter is applied to the CMOS Sensor to generate the N+1th image frame. The second configuration parameter stored in the hardware register of the CMOS Sensor can be acquired, and the second configuration parameter is applied to the CMOS Sensor to generate the N+2th image frame. The target image frame can include two image frames, which are the N+1th image frame and the N+2th image frame.

[0068] In some embodiments, the image configuration parameter can include a first configuration parameter corresponding to the N+1th image frame of the camera module and a second configuration parameter corresponding to the N+2th image frame of the camera module. The camera module can generate the N+1th image frame based on the second configuration parameter corresponding to the N+1th image frame and the first configuration parameter. The camera module can also generate the N+2th image frame based on the second configuration parameter corresponding to the N+2th image frame and the first configuration parameter.

[0069] The first configuration parameter and the second configuration parameter corresponding to the same image frame are issued by the application processor at different times. For example, the second configuration parameter corresponding to the N+1th image frame is issued by the application processor in the process of receiving the N-1th image frame. The first configuration parameter corresponding to the N+1th image frame is issued by the application processor in the process of receiving the Nth image frame. The second configuration parameter corresponding to the N+2th image frame is issued by the application processor in the process of receiving the Nth image frame. The first configuration parameter corresponding to the N+2th image frame is issued by the application processor in the process of receiving the N+1th image frame.

[0070] In the case that the camera module generates the target image frame, the camera module can send the target image frame to the image processing chip to perform image processing on the target image frame by means of the image processing function of the image processing chip, thereby improving the output image effect of the electronic device.

[0071] In step 104, the image processing chip performs image processing on the target image frame based on the image configuration parameter to obtain a first processed image.

[0072] In some embodiments, the image processing chip can store the image configuration parameter in the hardware register after receiving the image configuration parameter.

[0073] In some embodiments, the image configuration parameter can include a first configuration parameter corresponding to an N+1th image frame of the camera module and a second configuration parameter corresponding to an N+2th image frame of the camera module, and the target image frame can include the N+1th image frame and the N+2th image frame. The image processing chip can perform image processing on the N+1th image frame based on the first configuration parameter stored in the hardware register when the N+1th image frame is received, and perform image processing on the N+2th image frame based on the second configuration parameter stored in the hardware register when the N+2th image frame is received.

[0074] In some embodiments, the image configuration parameter can include a first configuration parameter corresponding to an N+1th image frame of the camera module and a second configuration parameter corresponding to an N+2th image frame of the camera module, and the target image frame can include the N+1th image frame and the N+2th image frame. The image processing chip can perform image processing on the N+1th image frame based on the first configuration parameter stored in the hardware register when the N+1th image frame is received, and perform image processing on the N+2th image frame based on the second configuration parameter stored in the hardware register when the N+2th image frame is received.

[0075] In the embodiment, the AP SoC sends the same set of image configuration parameters to the camera module and the image processing chip, and accordingly, the image configuration parameter can be applied to the CMOS Sensor to generate an image frame, and when the image processing chip receives the image frame, the image configuration parameter can be applied to the image frame. In this way, the image processing chip can perform image processing based on the same image configuration parameter as applied to the CMOS Sensor, so as to enhance the image support capability of the electronic device. The image processing performed by the image processing chip can include image transformation, image enhancement, image denoising, etc., and the image processing is used to improve the image performance of the electronic device.

[0076] In this embodiment, the image configuration parameters are acquired by the AP in the electronic device; the AP sends the image configuration parameters to the camera module in the electronic device and the image processing chip in the electronic device respectively; the camera module generates a target image frame based on the image configuration parameters and sends the target image frame to the image processing chip; the image processing chip performs image processing on the target image frame based on the image configuration parameters to obtain a first processed image. Since the image processing of the image processing chip depends on the actual exposure, gain and other configuration parameters of the image frame, the same image configuration parameters are sent to the camera module and the image processing chip by the AP to control the camera module to generate an image frame based on the image configuration parameters and control the image processing chip to use the same image configuration parameters on the image frame output by the camera module. In this way, the image processing chip can enhance the image support capability of the electronic device, thereby improving the output image quality of the electronic device.

[0077] In some embodiments, since both the CMOS Sensor and the image processing chip have a shadow mechanism, the image configuration parameters need to be stored in the corresponding hardware registers before taking effect in the hardware registers, which requires the image configuration parameters of the hardware registers of the image processing chip to be synchronized with the image configuration parameters of the hardware registers of the CMOS Sensor. If synchronization cannot be achieved, the output image quality of the electronic device may be affected.

[0078] In this embodiment, the image configuration parameters of the hardware registers of the image processing chip are synchronized with the image configuration parameters of the hardware registers of the CMOS Sensor, so that the image configuration parameters acting on the CMOS Sensor to generate an image frame are the same as the image configuration parameters used by the image processing chip to process the image frame.

[0079] It can be seen that due to the shadow mechanism of the CMOS Sensor chip and the image processing chip, the AP SoC needs to send the image configuration parameters to the CMOS Sensor chip and the image processing chip at the correct time point, and the image processing chip needs to store the image configuration parameters in the hardware registers at the correct time point. In this way, the image configuration parameters of the hardware registers of the image processing chip can be synchronized with the image configuration parameters of the hardware registers of the CMOS Sensor, so that the image configuration parameters acting on the CMOS Sensor to generate an image frame are the same as the image configuration parameters used by the image processing chip to process the image frame, thereby ensuring the output image quality of the electronic device.

[0080] Considering the configuration issued by the application processor in the receiving process of each image frame, both the configuration corresponding to the next image frame and the configuration corresponding to the next image frame are included, and the hardware register has a shadow mechanism, the image processing chip needs to store and manage the image configuration parameters, and the image processing chip controls the writing time of different types of configuration parameters to the hardware register.

[0081] Optionally, the step 102 specifically includes:

[0082] The application processor sends the image configuration parameters to the camera module between the first time and the second time; and the application processor sends the image configuration parameters to the image processing chip between the third time and the fourth time.

[0083] The image frame corresponding to the image configuration parameters includes the N+1th image frame of the camera module, the first time is the end time of the application processor receiving the N-1th image frame of the camera module, the second time is the effective time of the image configuration parameters in the camera module, the effective time is a time in the receiving process of the Nth image frame of the camera module by the application processor, the third time is the end time of receiving the N-1th image frame of the camera module, the fourth time is the start time of receiving the N+1th image frame of the camera module by the application processor, and N is an integer greater than 1.

[0084] The time when the application processor sends the image configuration parameters to the camera module can be the same as or different from the time when the application processor sends the image configuration parameters to the image processing chip.

[0085] The time when the application processor sends the image configuration parameters to the camera module is after the first time, because the AP SoC can calculate the image configuration parameters based on the image features of the N-1th image frame. The time when the application processor sends the image configuration parameters to the camera module is before the second time, because the shadow mechanism of the CMOS Sensor determines that the image configuration parameters are written to the hardware register before the state of the hardware register of the CMOS Sensor is switched. In this way, it can be ensured that the image configuration parameters stored in the hardware register can act on the CMOS Sensor to generate the N+1th image frame and the N+2th image frame. When the state of the hardware register of the CMOS Sensor is switched to the effective state, it means that the CMOS Sensor takes effect on the image configuration parameters, and the corresponding image configuration parameters can act on the CMOS Sensor to generate the N+1th image frame and the N+2th image frame.

[0086] As shown in FIG. 2, the camera module can output image frames to the AP SoC frame by frame, and the AP SoC can send the image configuration parameter to the camera module at any time between the first time 201 and the second time 202.

[0087] The time at which the application processor sends the image configuration parameter to the image processing chip is between the third time and the fourth time, which is determined by the shadow mechanism of the image processing chip, to ensure that the image processing chip has received the image processing chip sent by the application processor and written into the hardware register when the N+1th image frame arrives. In this way, it can be ensured that the image configuration parameter stored in the hardware register of the image processing chip acts on the N+1th image frame.

[0088] As shown in FIG. 3, the camera module can output image frames to the AP SoC and the image processing chip frame by frame, and the AP SoC can send the image configuration parameter to the image processing chip at any time between the third time 301 and the fourth time 302.

[0089] In this embodiment, the AP SoC controls the sending time of the image configuration parameter so that its sending time is before the effective time of the image configuration parameter in the hardware register in the shadow mechanism of the CMOS Sensor and the image processing chip, respectively. In this way, it can be ensured that the image configuration parameter used by the camera module to generate the image frame is the same as the image configuration parameter used by the image processing chip to process the image frame.

[0090] Optionally, the time at which the application processor sends the image configuration parameter to the camera module is the same as the time at which the application processor sends the image configuration parameter to the image processing chip.

[0091] In this embodiment, the time at which the application processor sends the image configuration parameter to the camera module is the same as the time at which the application processor sends the image configuration parameter to the image processing chip. In this way, the application processor can use the same set of sending control processes to send the image configuration parameter, without using different sending control processes to send the image configuration parameter to the camera module and the image processing chip, thereby simplifying the sending control process of the image configuration parameter by the AP SoC, and further improving the efficiency of image processing.

[0092] The image configuration parameter is valid in the camera module at a time point, which is usually in the process of receiving the Nth image frame by the application processor. In some embodiments, the image configuration parameter is valid in the hardware register of the CMOS sensor at a time point near the start time of receiving the Nth image frame by the AP SoC. The AP SoC can determine the start time of receiving the Nth image frame by the AP SoC by detecting the start of frame (SOF) of the Nth image frame, i.e., the start flag.

[0093] Optionally, the time point at which the application processor sends the image configuration parameter to the camera module is after the start time of receiving the Nth image frame by the application processor from the camera module, and the difference between the start time of receiving the Nth image frame by the application processor from the camera module and the time point at which the application processor sends the image configuration parameter to the camera module is less than a preset threshold. The preset threshold can be set according to actual conditions, which is not limited here.

[0094] As shown in FIG. 4, the camera module can output image frames to the AP SoC and the image processing chip frame by frame. The AP SoC can send the image configuration parameter to the camera module and the image processing chip at time point 401, which is near the start time 402 of receiving the Nth image frame by the application processor from the camera module.

[0095] In this way, the CMOS sensor can write the image configuration parameter into the hardware register before the state of the hardware register is switched, so that the image configuration parameter of the hardware register of the CMOS sensor can be synchronized with the image configuration parameter of the hardware register of the ASIC chip.

[0096] Optionally, after the step 102, the method further includes:

[0097] The image processing chip writes the image configuration parameter into the register.

[0098] The step 104 specifically includes:

[0099] The image processing chip performs image processing on the target image frame based on the image configuration parameter stored in the register to obtain a first processed image in a case where the target image frame is received.

[0100] In some embodiments, the image processing chip can include two registers, i.e., a first register and a second register. The first register can store a first type of configuration parameter, i.e., a first configuration parameter, and the second register can store a second type of configuration parameter, i.e., a second configuration parameter.

[0101] In some embodiments, the image processing chip, upon receiving the image configuration parameters, can directly write the first configuration parameters into the first register and write the second configuration parameters into the second register. In some embodiments, the image configuration parameters can be buffered first through a buffering mechanism, and then the first configuration parameters can be written into the first register at a corresponding time, and the second configuration parameters can be written into the second register at a corresponding time.

[0102] Correspondingly, upon receiving the target image frames, the image processing chip performs image processing on the target image frames based on the image configuration parameters stored in the registers to obtain first processed images. The first processed images can include two images, which are an image obtained by performing image processing on the N+1th image frame and an image obtained by performing image processing on the N+2th image frame.

[0103] In some embodiments, upon receiving the N+1th image frame, the image processing chip performs image processing on the N+1th image frame based on the first configuration parameters stored in the first register, and upon receiving the N+2th image frame, the image processing chip performs image processing on the N+2th image frame based on the second configuration parameters stored in the second register. In this way, by writing the image configuration parameters into the registers, the image processing chip can ensure correct processing of the image frames.

[0104] It should be noted that due to the shadow mechanism of the hardware registers of the image processing chip, the first configuration parameters need to be written into the first register and the second configuration parameters need to be written into the second register at the correct time to ensure that the same configuration parameters as the CMOS Sensor can be used for image processing. Optionally, the image configuration parameters include first configuration parameters corresponding to the N+1th image frame of the camera module and second configuration parameters corresponding to the N+2th image frame of the camera module, and the target image frames include the N+1th image frame and the N+2th image frame; the ASIC chip writes the image configuration parameters into the registers, including:

[0105] the image processing chip writes the first configuration parameters corresponding to the N+1th image frame into the first register at the fifth time, and the image processing chip writes the second configuration parameters corresponding to the N+2th image frame into the second register at the sixth time;

[0106] The first configuration parameters stored in the first register are used for image processing on the N+1th image frame, the second configuration parameters stored in the second register are used for image processing on the N+2th image frame, the fifth time is before the start time of the image processing chip receiving the N+1th image frame, and the sixth time is before the start time of the image processing chip receiving the N+2th image frame.

[0107] The fifth time and the sixth time can be the same or different.

[0108] In some embodiments, the image processing chip, upon receiving the image configuration parameters, can first store the image configuration parameters in the cache area, and then read the first configuration parameters from the cache area and write them into the first register at the fifth time, and read the second configuration parameters from the cache area and write them into the second register at the sixth time.

[0109] As shown in FIG. 5, the image processing chip can write the first configuration parameters into the first register between the time 501 of receiving the image configuration parameters and the fifth time 502, and write the second configuration parameters into the second register between the time 501 of receiving the image configuration parameters and the sixth time 503. In this way, the image processing chip controls the writing of different types of configuration parameters into the hardware registers at different times by storing and managing the image configuration parameters, so as to ensure that the image configuration parameters stored in the hardware registers of the image processing chip are the same as the image configuration parameters stored in the hardware registers of the CMOS Sensor.

[0110] In some embodiments, FIG. 6 is a functional framework schematic diagram of an electronic device implementing image processing according to some embodiments of the present application. As shown in FIG. 6, the electronic device includes an AP SoC 601, a CMOS Sensor 602, and an ASIC chip 603. The AP SoC 601 can send image configuration parameters to the CMOS Sensor 602 and the ASIC chip 603 respectively.

[0111] The ASIC chip 603 can include a cache management module 6031 for caching the image configuration parameters to a suitable memory area in its own space for subsequent use. The cache management module 6031 can cache the first configuration parameters to a first cache area and cache the second configuration parameters to a second cache area.

[0112] The ASIC chip 603 can further include hardware registers 6032, such as a first register and a second register. The first configuration parameters can be read from the first cache area and written into the first register at the fifth time, such as the end time of the ASIC chip 603 receiving the Nth image frame. The second configuration parameters can be read from the second cache area and written into the second register at the sixth time, such as the start time of the ASIC chip 603 receiving the N+1th image frame.

[0113] It should be noted that the starting moment at which the AP SoC and the image processing chip receive the image frame can be determined by detecting the starting flag of the image frame, that is, in the case of detecting the starting flag of the image frame, it can be determined that the moment is the starting moment of receiving the image frame. Correspondingly, the ending moment at which the AP SoC and the image processing chip receive the image frame can be determined by detecting the ending flag of the image frame, that is, in the case of detecting the ending flag of the image frame, it can be determined that the moment is the ending moment of receiving the image frame.

[0114] In this embodiment, the shadow mechanism of the image processing chip can be considered, and the first configuration parameter of the first cache area is written to the first register at the fifth moment, and the second configuration parameter of the second cache area is written to the second register at the sixth moment through the cache mechanism, so that the image configuration parameters of the hardware registers of the image processing chip and the image configuration parameters of the hardware registers of the CMOS Sensor can be synchronized.

[0115] Optionally, the fifth moment is an ending moment at which the image processing chip receives the Nth image frame of the camera module; or,

[0116] The sixth moment is a starting moment at which the image processing chip receives the N+1th image frame.

[0117] In this embodiment, the image processing chip determines the ending moment at which the image processing chip receives the Nth image frame of the camera module by detecting the end of frame (EOF) of the Nth image frame, that is, the ending flag, and determines the starting moment at which the image processing chip receives the N+1th image frame of the camera module by detecting the SOF of the N+1th image frame, that is, the starting flag.

[0118] FIG. 7 is a schematic diagram of a processing flow of an image processing chip for image configuration parameters according to some embodiments of the present application. As shown in FIG. 7, the image processing chip can be an ASIC chip, and the flow includes the following steps:

[0119] In step 701, the ASIC chip receives the image configuration parameters issued by the AP SoC in the receiving process of the Nth image frame. In the case that the electronic device starts the camera module, the CMOS Sensor in the camera module usually sends image frames to the AP SoC and the ASIC chip frame by frame, and the AP SoC can send the same set of image configuration parameters to the CMOS Sensor and the ASIC chip in the receiving process of each image frame.

[0120] Step 702: The ASIC chip caches the received image configuration parameters into the cache queue of the cache area. Considering that the image configuration parameters issued by the AP SoC include configuration parameters effective in the next frame and configuration parameters effective in the frame after the next frame, the length of the cache queue can be set to 2.

[0121] Step 703: When the end flag of the Nth image frame is detected, step 704 is performed.

[0122] Step 704: At the end of the Nth image frame, the first configuration parameter is read from the cache queue and written into the first register.

[0123] Step 705: When the start flag of the N+1th image frame is detected, step 706 is performed.

[0124] Step 706: At the start of the N+1th image frame, the second configuration parameter is read from the cache queue and written into the second register.

[0125] Step 707: The ASIC chip receives the N+1th image frame, and in the receiving process, the image configuration parameters issued by the AP SoC are received again, and thus the process is cycled to step 701 to continue the processing of the image configuration parameters.

[0126] In the embodiment, the image processing chip can control the timing of writing different types of configuration parameters into the register by detecting the SOF and EOF of the image frame. In the case of ensuring that the image configuration parameters of the hardware register of the image processing chip are synchronized with the image configuration parameters of the hardware register of the CMOS Sensor, the processing flow of the image processing chip for the image configuration parameters can be simplified, and thus the image processing flow can be simplified.

[0127] The following specific example details the specific process of the image processing method of the embodiment of the application.

[0128] FIG. 8 is an interaction diagram of the image processing method of some embodiments of the application, as shown in FIG. 8, including the following steps:

[0129] Step 801: After the AP SoC receives the N-1th image frame output by the CMOS Sensor, the 3A related meta configuration parameters, i.e., the image configuration parameters, can be calculated based on the image features of the N-1th image frame, and the image configuration parameters are issued to the CMOS Sensor and the ASIC chip near the SOF of the Nth image frame.

[0130] Step 802: a microcontroller unit (MCU) of the ASIC chip locally caches the received image configuration parameter. Wherein, after the ASIC MCU receives the image configuration parameter issued by the AP SoC, the ASIC MCU implements effective management through a cache management module such as a meta manager (MetaMgr) module. The functions that need to be supported include: each time the image configuration parameter is received, it needs to be managed in a queue; each time the ASIC chip receives an image frame with a MIPI format, and at the end of the image frame, the first configuration parameter is read from the MetaMgr module; each time the ASIC chip receives the start of the MIPI image frame, the second configuration parameter is read from the MetaMgr module; each configuration parameter cannot be overwritten before being read from the MetaMgr module and written to a hardware register.

[0131] Module 803: the ASIC MCU reads the first configuration parameter from the MetaMgr module at the end of each received image frame, and updates the first configuration parameter to a first register; the ASIC MCU reads the second configuration parameter from the MetaMgr module at the start of each received image frame, and updates the second configuration parameter to a second register.

[0132] In this way, at the start of the Nth image frame, the exposure-related parameter of the N+1th image frame can be read and updated to the second register, and at the end of the Nth image frame, the control parameter of the N+1th image frame about the working mode of the camera module can be read and updated to the first register, so that the effective control of different types of meta configuration parameters acting on each image frame can be accurately implemented.

[0133] The image processing method provided in the embodiment of the application can be executed by an image processing device. In the embodiment of the application, the image processing device is taken as an example to illustrate the image processing device provided in the embodiment of the application.

[0134] Referring to FIG. 9, FIG. 9 is a structural schematic diagram of an image processing device 900 provided in the embodiment of the application, which is applied to an electronic device including a camera module, an application processor and an image processing chip. The device includes:

[0135] The acquisition module 901 is configured to acquire, by the application processor, an image configuration parameter.

[0136] The first sending module 902 is configured to send, by the application processor, the image configuration parameter to the camera module and the image processing chip respectively.

[0137] The generation module 903 is configured to generate, by the camera module, a target image frame based on the image configuration parameter.

[0138] The second sending module 904 is configured to send, by the camera module, the target image frame to the image processing chip.

[0139] The image processing module 905 is configured to perform image processing on the target image frame based on the image configuration parameter to obtain a first processed image.

[0140] Optionally, the first sending module 902 is specifically configured to:

[0141] The application processor sends the image configuration parameter to the camera module between the first time and the second time, and the application processor sends the image configuration parameter to the image processing chip between the third time and the fourth time.

[0142] The image configuration parameter corresponds to an (N+1)th image frame of the camera module, the first time is an end time of receiving, by the application processor, an (N-1)th image frame of the camera module, the second time is an effective time of the image configuration parameter in the camera module, the effective time is a time in a receiving process of an Nth image frame of the camera module by the application processor, the third time is an end time of receiving the (N-1)th image frame of the camera module, the fourth time is a start time of receiving the (N+1)th image frame of the camera module by the application processor, and N is an integer greater than 1.

[0143] Optionally, the time at which the application processor sends the image configuration parameter to the camera module is the same as the time at which the application processor sends the image configuration parameter to the image processing chip.

[0144] Optionally, the time at which the application processor sends the image configuration parameter to the camera module is after a start time of receiving the Nth image frame of the camera module by the application processor, and a difference between the start time of receiving the Nth image frame of the camera module by the application processor and the time at which the application processor sends the image configuration parameter to the camera module is less than a preset threshold.

[0145] Optionally, the apparatus further includes:

[0146] The storage module is configured to write, by the image processing chip, the image configuration parameter into a register.

[0147] The image processing module 905 is specifically configured to, in a case where the target image frame is received, perform image processing on the target image frame based on the image configuration parameter stored in the register to obtain a first processed image.

[0148] Optionally, the image configuration parameter includes a first configuration parameter corresponding to the (N+1)th image frame of the camera module and a second configuration parameter corresponding to an (N+2)th image frame of the camera module, and the target image frame includes the (N+1)th image frame and the (N+2)th image frame.

[0149] The image processing chip writes the first configuration parameter corresponding to the N+1 image frames into the first register at the fifth time; and the image processing chip writes the second configuration parameter corresponding to the N+2 image frames into the second register at the sixth time.

[0150] The first configuration parameter stored in the first register is used for image processing of the N+1 image frame, the second configuration parameter stored in the second register is used for image processing of the N+2 image frame, the fifth time is before a starting time of the image processing chip receiving the N+1 image frames, and the sixth time is before a starting time of the image processing chip receiving the N+2 image frames.

[0151] Optionally, the fifth time is an ending time of the image processing chip receiving the N image frame of the camera module.

[0152] The sixth time is a starting time of the image processing chip receiving the N+1 image frame.

[0153] In this embodiment, the image configuration parameter is acquired by the AP in the electronic device, the AP sends the image configuration parameter to the camera module in the electronic device and the image processing chip in the electronic device respectively, the camera module generates a target image frame based on the image configuration parameter and sends the target image frame to the image processing chip, and the image processing chip performs image processing on the target image frame based on the image configuration parameter to obtain a first processed image. Since the image processing of the image processing chip depends on the actual exposure, gain and other configuration parameters of the image frame, the same image configuration parameter is sent to the camera module and the image processing chip by the AP to control the camera module to generate an image frame based on the image configuration parameter and control the image processing chip to use the same image configuration parameter on the image frame output by the camera module, so that the image processing chip can enhance the image support capability of the electronic device, thereby improving the output image quality of the electronic device.

[0154] The image processing apparatus in the embodiments of the present application can be an electronic device or a component in an electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other device than a terminal. For example, the electronic device can be a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted electronic device, a Mobile Internet Device (MID), an augmented reality (AR) / virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), or the like, and can also be a server, a Network Attached Storage (NAS), a personal computer (PC), a television (TV), a teller machine, a self-service machine, or the like. The embodiments of the present application are not limited in this regard.

[0155] The image processing apparatus in the embodiments of the present application can be a device with an operating system. The operating system can be an Android operating system, an ios operating system, or other possible operating system. The embodiments of the present application are not limited in this regard.

[0156] The image processing apparatus provided in the embodiments of the present application can implement each process implemented by the method embodiment of FIG. 1. To avoid repetition, details are not described herein.

[0157] Optionally, as shown in FIG. 10, the embodiments of the present application further provide an electronic device 1000, which includes a processor 1001 and a memory 1002. The memory 1002 stores programs or instructions executable on the processor 1001. The programs or instructions are executed by the processor 1001 to implement each step of the above image processing method embodiments and achieve the same technical effects. To avoid repetition, details are not described herein.

[0158] It should be noted that the electronic device in the embodiments of the present application includes the mobile electronic device and the non-mobile electronic device described above.

[0159] FIG. 11 is a schematic diagram of a hardware structure of an electronic device implementing the embodiments of the present application.

[0160] The electronic device 1100 includes, but is not limited to, a radio frequency unit 1101, a network module 1102, an audio output unit 1103, an input unit 1104, a sensor 1105, a display unit 1106, a user input unit 1107, an interface unit 1108, a memory 1109, and a processor 1110, etc. The electronic device can also include a camera module, an application processor, and an image processing chip.

[0161] Those skilled in the art can understand that the electronic device 1100 can also include a power supply (such as a battery) for supplying power to each component, and the power supply can be logically connected to the processor 1110 through a power management system, so as to realize functions such as management of charging, discharging, and power consumption management through the power management system. The electronic device structure shown in FIG. 11 does not constitute a limitation on the electronic device, and the electronic device can include more or fewer components than shown, or combine certain components, or different component arrangements, which will not be described here.

[0162] The processor 1110 is configured to:

[0163] The application processor obtains image configuration parameters;

[0164] The application processor sends the image configuration parameters to the camera module and the image processing chip, respectively;

[0165] The camera module generates a target image frame based on the image configuration parameters and sends the target image frame to the image processing chip;

[0166] The image processing chip performs image processing on the target image frame based on the image configuration parameters to obtain a first processed image.

[0167] In this embodiment, the image configuration parameters are obtained by the AP in the electronic device; the AP sends the image configuration parameters to the camera module in the electronic device and the image processing chip in the electronic device, respectively; the camera module generates a target image frame based on the image configuration parameters and sends the target image frame to the image processing chip; and the image processing chip performs image processing on the target image frame based on the image configuration parameters to obtain a first processed image. Since the image processing of the image processing chip depends on the actual exposure, gain, and other configuration parameters of the image frame, the same image configuration parameters are sent to the camera module and the image processing chip by the AP to control the camera module to generate an image frame based on the image configuration parameters and control the image processing chip to use the same image configuration parameters on the image frame output by the camera module. In this way, the image processing chip can enhance the image support capability of the electronic device, thereby improving the output image quality of the electronic device.

[0168] Optionally, the processor 1110 is further configured to:

[0169] The application processor sends the image configuration parameter to the camera module between the first time and the second time; and the application processor sends the image configuration parameter to the image processing chip between the third time and the fourth time.

[0170] The image frame corresponding to the image configuration parameter includes an (N+1)th image frame of the camera module, the first time is an end time of receiving an (N-1)th image frame of the camera module by the application processor, the second time is an effective time of the image configuration parameter in the camera module, the effective time is a time in a receiving process of an Nth image frame of the camera module by the application processor, the third time is an end time of receiving the (N-1)th image frame of the camera module, the fourth time is a start time of receiving the (N+1)th image frame of the camera module by the application processor, and N is an integer greater than 1.

[0171] Optionally, the time at which the application processor sends the image configuration parameter to the camera module is the same as the time at which the application processor sends the image configuration parameter to the image processing chip.

[0172] Optionally, the time at which the application processor sends the image configuration parameter to the camera module is after a start time of receiving the Nth image frame of the camera module by the application processor, and a difference between the start time of receiving the Nth image frame of the camera module by the application processor and the time is less than a preset threshold.

[0173] Optionally, the processor 1110 is further configured to:

[0174] The image processing chip writes the image configuration parameter into a register.

[0175] The image processing chip performs image processing on the target image frame based on the image configuration parameter stored in the register to obtain a first processed image.

[0176] Optionally, the image configuration parameter includes a first configuration parameter corresponding to the (N+1)th image frame of the camera module and a second configuration parameter corresponding to an (N+2)th image frame of the camera module, and the target image frame includes the (N+1)th image frame and the (N+2)th image frame; and the processor 1110 is further configured to:

[0177] The image processing chip writes the first configuration parameter corresponding to the (N+1)th image frame into a first register at a fifth time; and the image processing chip writes the second configuration parameter corresponding to the (N+2)th image frame into a second register at a sixth time.

[0178] The first configuration parameter stored in the first register is used for image processing on the N+1th image frame, the second configuration parameter stored in the second register is used for image processing on the N+2th image frame, the fifth time point is before a starting time point of receiving the N+1th image frame by the image processing chip, and the sixth time point is before a starting time point of receiving the N+2th image frame by the image processing chip.

[0179] Optionally, the fifth time point is an ending time point of receiving the Nth image frame of the camera module by the image processing chip; or,

[0180] The sixth time point is a starting time point of receiving the N+1th image frame by the image processing chip.

[0181] It should be understood that in the embodiments of the present application, the input unit 1104 can include a graphics processor (GPU) 11041 and a microphone 11042. The graphics processor 11041 processes image data of a still picture or a video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 1106 can include a display panel 11061, which can be configured in the form of a liquid crystal display, an organic light-emitting diode, etc. The user input unit 1107 includes at least one of a touch panel 11071 and other input devices 11072. The touch panel 11071 is also called a touch screen. The touch panel 11071 can include a touch detection device and a touch controller. The other input devices 11072 can include, but are not limited to, a physical keyboard, function keys (such as volume control keys, on-off keys, etc.), a trackball, a mouse, an operation lever, and the like, which will not be described here.

[0182] The memory 1109 can be used to store software programs and various data. The memory 1109 can mainly include a first storage area storing programs or instructions and a second storage area storing data, wherein the first storage area can store an operating system, application programs or instructions required by at least one function (such as a sound playing function, an image playing function, etc.), and the like. In addition, the memory 1109 can include a volatile memory or a non-volatile memory, or the memory 1109 can include both volatile and non-volatile memories. The non-volatile memory can be a Read-Only Memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically EPROM (EEPROM), or a flash memory. The volatile memory can be a Random Access Memory (RAM), a Static RAM (SRAM), a Dynamic RAM (DRAM), a Synchronous DRAM (SDRAM), a Double Data Rate SDRAM (DDR SDRAM), an Enhanced SDRAM (ESDRAM), a Synch link DRAM (SLDRAM), and a Direct Rambus RAM (DRRAM). The memory 1109 in the embodiments of the present application includes but is not limited to these and any other suitable types of memories.

[0183] The processor 1110 can include one or more processing units; in some embodiments, the processor 1110 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and an application program, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It can be understood that the above-mentioned modem processor can also not be integrated into the processor 1110.

[0184] The embodiments of the present application also provide a readable storage medium, the readable storage medium stores programs or instructions, the programs or instructions are executed by a processor to realize various processes of the above-mentioned image processing method embodiments, and the same technical effects can be achieved. To avoid repetition, details are not described here.

[0185] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes a computer readable storage medium, such as a computer readable only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0186] The embodiment of the present application further provides a chip, which comprises a processor and a communication interface, the communication interface is coupled with the processor, the processor is used for running programs or instructions to realize the processes of the above image processing method embodiments and achieve the same technical effects. To avoid repetition, details are not described herein.

[0187] It should be understood that the chip mentioned in the embodiment of the present application can also be referred to as a system level chip, a system chip, a chip system or a system on chip, etc.

[0188] The embodiment of the present application provides a computer program product, which is stored in a storage medium, and is executed by at least one processor to realize the processes of the above image processing method embodiments and achieve the same technical effects. To avoid repetition, details are not described herein.

[0189] It should be noted that in this document, the term "comprising" or "including" or any other variant thereof is intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements not only includes those elements, but also includes other elements not explicitly listed or inherent to such process, method, article or device. Without more limitations, the element defined by the statement "comprising a" does not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the method and device in the embodiment of the present application is not limited to the order of performing the functions as shown or discussed, but can also include performing the functions in a substantially simultaneous manner or in the opposite order, for example, the described method can be performed in an order different from that described, and various steps can also be added, omitted or combined. In addition, the features described with reference to some examples can be combined in other examples.

[0190] Through the above description of the embodiments, those skilled in the art can clearly understand that the above-mentioned example methods can be realized by means of software and a necessary general hardware platform, and of course, can also be realized by hardware, but in many cases, the former is a better embodiment. Based on such understanding, the technical solutions of the present application can be embodied in the form of a computer software product in essence or in the form of a part that contributes to the prior art, which is stored in a storage medium (such as a ROM / RAM, a magnetic disc, an optical disc), and includes a plurality of instructions for causing an electronic device (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in the various embodiments of the present application.

[0191] The embodiments of the present application are described above in combination with the drawings, but the present application is not limited to the above-mentioned specific embodiments, and the above-mentioned specific embodiments are only illustrative and not restrictive. Those skilled in the art can make many forms under the inspiration of the present application without departing from the scope of the present application and the scope protected by the claims.

Claims

1. An image processing method, executed by an electronic device, the electronic device comprising a camera module, an application processor and an image processing chip, the method comprising: obtaining, by the application processor, an image configuration parameter; sending, by the application processor, the image configuration parameter to the camera module and the image processing chip respectively; generating, by the camera module, a target image frame based on the image configuration parameter, and sending the target image frame to the image processing chip; and performing, by the image processing chip, image processing on the target image frame based on the image configuration parameter to obtain a first processed image. The application processor sends the image configuration parameter to the camera module and the image processing chip respectively, comprising: the application processor sends the image configuration parameter to the camera module between a first time and a second time; and the application processor sends the image configuration parameter to the image processing chip between a third time and a fourth time. The image configuration parameter corresponds to an N+1th image frame of the camera module, the first time is an end time of the application processor receiving an N-1th image frame of the camera module, the second time is an effective time of the image configuration parameter in the camera module, the effective time is a time in the process of the application processor receiving an Nth image frame of the camera module, the third time is an end time of the camera module receiving the N-1th image frame, the fourth time is a start time of the application processor receiving the N+1th image frame of the camera module, and N is an integer greater than 1. The time at which the application processor sends the image configuration parameter to the camera module is the same as the time at which the application processor sends the image configuration parameter to the image processing chip. The time at which the application processor sends the image configuration parameter to the camera module is after the start time of the application processor receiving the Nth image frame of the camera module, and the difference between the time and the start time is less than a preset threshold.

2. The method of claim 1, wherein, After the application processor sends the image configuration parameter to the camera module and the image processing chip respectively, the method further comprises: writing, by the image processing chip, the image configuration parameter into a register; and performing, by the image processing chip, image processing on the target image frame based on the image configuration parameter to obtain a first processed image. The image processing chip performs image processing on the target image frame based on the image configuration parameter stored in the register to obtain a first processed image. The image configuration parameter comprises a first configuration parameter corresponding to the N+1th image frame of the camera module and a second configuration parameter corresponding to an N+2th image frame of the camera module, and the target image frame comprises the N+1th image frame and the N+2th image frame.

3. The method of claim 2, wherein, ​ 4. The method of claim 2, wherein, ​ 5. The method of any one of claims 1 to 4, wherein, ​ ​ ​ ​ 6. The method of claim 5, wherein, ​ The image processing chip writes the image configuration parameter into a register, including: The image processing chip writes the first configuration parameter corresponding to the N+1 image frames into a first register at a fifth time; and the image processing chip writes the second configuration parameter corresponding to the N+2 image frames into a second register at a sixth time; The first configuration parameter stored in the first register is used for image processing of the N+1 image frame, and the second configuration parameter stored in the second register is used for image processing of the N+2 image frame, the fifth time is before the start time of the image processing chip receiving the N+1 image frame, and the sixth time is before the start time of the image processing chip receiving the N+2 image frame.

7. The method of claim 6, wherein, The fifth time is the end time of the image processing chip receiving the Nth image frame of the camera module; or The sixth time is the start time of the image processing chip receiving the N+1 image frame. 8.An image processing apparatus applied to an electronic device, the electronic device comprising a camera module, an application processor and an image processing chip, the apparatus comprising: an acquisition module configured to acquire, by the application processor, an image configuration parameter; a first sending module configured to send, by the application processor, the image configuration parameter to the camera module and the image processing chip respectively; a generation module configured to generate, by the camera module, a target image frame based on the image configuration parameter; a second sending module configured to send, by the camera module, the target image frame to the image processing chip; an image processing module configured to perform, by the image processing chip, image processing on the target image frame based on the image configuration parameter to obtain a first processed image.

9. The apparatus of claim 8, wherein, The first sending module is specifically configured to: send, by the application processor, the image configuration parameter to the camera module between a first time and a second time; and send, by the application processor, the image configuration parameter to the image processing chip between a third time and a fourth time; The image configuration parameter corresponds to an image frame comprising an N+1 image frame of the camera module, the first time is an end time of the application processor receiving an N-1 image frame of the camera module, the second time is an effective time of the image configuration parameter in the camera module, the effective time is a time in a receiving process of the Nth image frame of the camera module by the application processor, the third time is an end time of the camera module receiving the N-1 image frame, the fourth time is a start time of the application processor receiving the N+1 image frame of the camera module, and N is an integer greater than 1.

10. The apparatus of claim 9, wherein, The time of the application processor sending the image configuration parameter to the camera module is the same as the time of the application processor sending the image configuration parameter to the image processing chip.

11. The apparatus of claim 9, wherein, The application processor sends the image configuration parameters to the camera module at a time point after a start time point at which the application processor receives the Nth image frame of the camera module, and a difference between the start time point and the time point is less than a preset threshold.

12. The apparatus of any one of claims 8-11, further comprising: a storage module configured to cause the image processing chip to write the image configuration parameters into a register; an image processing module configured to cause the image processing chip to perform image processing on the target image frame based on the image configuration parameters stored in the register to obtain a first processed image, when the target image frame is received.

13. The apparatus of claim 12, wherein, The image configuration parameters include a first configuration parameter corresponding to an N+1th image frame of the camera module and a second configuration parameter corresponding to an N+2th image frame of the camera module, and the target image frame includes the N+1th image frame and the N+2th image frame; and the storage module is specifically configured to: the image processing chip writes the first configuration parameter corresponding to the N+1th image frame into a first register at a fifth time point; and the image processing chip writes the second configuration parameter corresponding to the N+2th image frame into a second register at a sixth time point; wherein the first configuration parameter stored in the first register is used for image processing on the N+1th image frame, the second configuration parameter stored in the second register is used for image processing on the N+2th image frame, the fifth time point is before a start time point at which the image processing chip receives the N+1th image frame, and the sixth time point is before a start time point at which the image processing chip receives the N+2th image frame.

14. The apparatus of claim 13, wherein, The fifth time point is an end time point at which the image processing chip receives the Nth image frame of the camera module; or The sixth time point is a start time point at which the image processing chip receives the N+1th image frame.

15. An electronic device, comprising a processor and a memory, the memory storing programs or instructions executable on the processor, the programs or instructions being executed by the processor to implement the steps of the image processing method according to any one of claims 1-7.

16. A readable storage medium, the readable storage medium storing programs or instructions, the programs or instructions being executed by a processor to implement the steps of the image processing method according to any one of claims 1-7.

17. A chip, the chip comprising a processor and a communication interface, the communication interface and the processor being coupled, the processor being configured to run programs or instructions to implement the steps of the image processing method according to any one of claims 1-7.

18. A computer program product, the program product being stored in a storage medium, the program product being executed by at least one processor to implement the steps of the image processing method according to any one of claims 1-7.

Images