Image processing circuits and image processing methods

Abstract

This application discloses an image processing circuit and an image processing method, belonging to the field of image processing technology. The image processing circuit includes: a main control chip, an image processing chip, an image sensor, and a display screen. The image processing chip is electrically connected to the main control chip, the image sensor, and the display screen. The image sensor is used to acquire first image data. The image processing chip is used to acquire the first image data acquired by the image sensor, process the first image data to generate second image data, and send the second image data to the main control chip. The main control chip is used to receive the second image data, convert the format of the second image data into a target format, generate third image data, and send the third image data to the image processing chip. The image processing chip is used to receive the third image data, process the third image data, generate target image data, and send the target image data to the display screen. The display screen is used to display the target image data.

Description

Technical Field

[0001] This application belongs to the field of image processing technology, specifically relating to an image processing circuit and an image processing method. Background Technology

[0002] Electronic devices are widely used in daily life for taking photos and videos. In related technologies, image sensors typically capture raw RAW images, which are then processed by electronic devices to convert them into YUV domain images. Noise reduction and edge enhancement are then performed in the YUV domain before JPG encoding is used to generate a photograph. In poor lighting conditions or with short exposure times, the raw RAW images contain a lot of noise, and the computing power and power consumption of the electronic devices cannot meet the image processing requirements, resulting in poor imaging or preview quality. Summary of the Invention

[0003] The purpose of this application is to provide an image processing circuit and an image processing method that can solve the problem of poor imaging or preview effects.

[0004] In a first aspect, embodiments of this application provide an image processing circuit, including a main control chip, an image processing chip, an image sensor, and a display screen, wherein the image processing chip is electrically connected to the main control chip, the image sensor, and the display screen respectively;

[0005] The image sensor is used to acquire first image data;

[0006] The image processing chip is used to acquire first image data collected by the image sensor, process the first image data to generate second image data, and send the second image data to the main control chip;

[0007] The main control chip is used to receive the second image data, convert the format of the second image data into the target format, generate the third image data, and send the third image data to the image processing chip;

[0008] The image processing chip is used to receive the third image data, process the third image data, generate target image data, and send the target image data to the display screen;

[0009] The display screen is used to display the target image data. Secondly, embodiments of this application provide an image processing method applied to the image processing circuit of the first aspect, the method comprising:

[0010] The image sensor acquires first image data and sends the first image data to the image processing chip;

[0011] The image processing chip processes the first image data to generate second image data, and sends the second image data to the main control chip;

[0012] The main control chip converts the format of the second image data into the target format, generates the third image data, and sends the third image data to the image processing chip;

[0013] The image processing chip processes the third image data to generate target image data, and sends the target image data to the display screen;

[0014] The display screen displays the target image data. In a third aspect, embodiments of this application provide an image processing apparatus applied to the image processing circuit of the first aspect, the apparatus comprising:

[0015] The first processing module is used to enable the image sensor to acquire first image data and send the first image data to the image processing chip;

[0016] The second processing module is used to enable the image processing chip to process the first image data, generate second image data, and send the second image data to the main control chip;

[0017] The third processing module is used to enable the main control chip to convert the format of the second image data into the target format, generate the third image data, and send the third image data to the image processing chip;

[0018] The fourth processing module is used to enable the image processing chip to process the third image data, generate target image data, and send the target image data to the display screen;

[0019] A fifth processing module is used to display the target image data on the display screen. In a fourth aspect, embodiments of this application provide an image processing chip, which includes a processor and a communication interface. The communication interface is coupled to the processor, the communication interface is used to transmit image data, and the processor is used to run programs or instructions to implement the method described in the second aspect.

[0020] Fifthly, embodiments of this application provide a processor chip, the processor chip including a processor and a communication interface, the communication interface being coupled to the processor, the communication interface being used to transmit image data, and the processor being used to run programs or instructions to implement the method described in the second aspect.

[0021] In a sixth aspect, embodiments of this application provide an electronic device including a processor and a memory, the memory storing programs or instructions executable on the processor, the programs or instructions, when executed by the processor, implementing the steps of the method described in the second aspect.

[0022] In a seventh aspect, embodiments of this application provide a readable storage medium on which a program or instructions are stored, which, when executed by a processor, implement the steps of the method described in the second aspect.

[0023] Eighthly, embodiments of this application provide a computer program product stored in a storage medium, which is executed by at least one processor to implement the method described in the second aspect.

[0024] In this embodiment, by setting independent processing chips between the main control chip and the image sensor, and between the main control chip and the display screen, and by using the processing chips to process the image twice, before and after the main control chip, effective noise reduction is achieved, thereby improving the image quality. Attached Figure Description

[0025] Figure 1 This is one of the schematic diagrams of the image processing circuit provided in the embodiments of this application;

[0026] Figure 2 This is a second schematic diagram of the image processing circuit provided in the embodiments of this application;

[0027] Figure 3 This is the third schematic diagram of the image processing circuit provided in the embodiments of this application;

[0028] Figure 4 This is one of the schematic flowcharts of the image processing method provided in the embodiments of this application;

[0029] Figure 5 This is a second schematic flowchart of the image processing method provided in the embodiments of this application;

[0030] Figure 6 This is the third schematic flowchart of the image processing method provided in the embodiments of this application;

[0031] Figure 7 This is a schematic diagram of the structure of the image processing apparatus provided in the embodiments of this application;

[0032] Figure 8 This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application;

[0033] Figure 9 This is a hardware schematic diagram of the electronic device provided in the embodiments of this application. Detailed Implementation

[0034] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.

[0035] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such use of data can be interchanged where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more. Furthermore, in the specification and claims, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.

[0036] The image processing circuit, image processing method, image processing device, image processing chip, processor chip, electronic device, and readable storage medium provided in this application will be described in detail below with reference to the accompanying drawings and through specific embodiments and application scenarios.

[0037] The image processing method can be applied to a terminal, specifically executed by the terminal's hardware or software. The entity executing this image processing method can be the terminal itself, or its control device, etc.

[0038] The terminal includes, but is not limited to, mobile phones or tablets and other portable communication devices with touch-sensitive surfaces (e.g., touchscreen displays and / or touchpads). It should also be understood that, in some embodiments, the terminal may not be a portable communication device, but rather a desktop computer with touch-sensitive surfaces (e.g., touchscreen displays and / or touchpads).

[0039] The following embodiments describe a terminal including a display and a touch-sensitive surface. However, it should be understood that the terminal may include one or more other physical user interface devices such as a physical keyboard, mouse, and joystick.

[0040] This application provides an image processing circuit.

[0041] The image processing circuit can be installed in a terminal, which may include, but is not limited to, a user's mobile phone, computer, tablet, watch, or vehicle terminal.

[0042] like Figure 1As shown, the image processing circuit includes: an image sensor 110, a main control chip 130, an image processing chip 120, and a display screen 140.

[0043] In this embodiment, the image sensor 110 (Camera sensor) is used to acquire first image data. The image sensor 110 includes, but is not limited to, a CMOS or CCD image sensor, such as a sensor installed in the camera module of the terminal.

[0044] It is understandable that when the terminal is working normally, the user can open a shooting APP, such as a mobile phone camera, and the sensor in the camera module installed on the terminal can be used as the image sensor 110 in this application. In shooting mode, the first image data can be collected through the sensor in the camera module.

[0045] The first image data may include one frame of the first image, or it may include multiple frames of the first image.

[0046] The image sensor 110 can be one or more, and this application does not limit it.

[0047] For example, in actual operation, the electronic device receives a first input from the user and, in response to the first input, activates the image sensor 110 to acquire first image data. The first input is used to activate the camera mode.

[0048] The first input can be in at least one of the following ways:

[0049] Firstly, the first input can be touch input, including but not limited to click input, swipe input, and press input.

[0050] In this embodiment, receiving the user's first input can be receiving the user's touch operation on the display area of ​​the terminal screen.

[0051] If the target control is displayed on the current screen, touching the target control will enable the first input; or the first input can be set to multiple consecutive taps on the display area within a target time interval.

[0052] Secondly, the first input can be a physical button input.

[0053] In this embodiment, the terminal is equipped with corresponding physical buttons to receive the user's first input, which can be expressed as receiving the user's first input by pressing the corresponding physical button; the first input can also be a combination operation of pressing multiple physical buttons simultaneously.

[0054] Thirdly, the first input can be voice input.

[0055] In this embodiment, the terminal can trigger the display of the shooting interface when it receives a voice message such as "Enter the camera".

[0056] Of course, in other embodiments, the first input may also be in other forms, including but not limited to motion-sensing gesture input, etc., which can be determined according to actual needs, and this application embodiment does not limit it.

[0057] It should be noted that the image information acquired by the image sensor 110 is the first image data, which is RAW data, that is, image data in the Bayer domain.

[0058] RAW data, or raw data, is the original data captured by a CMOS or CCD image sensor and converted into digital signals. It is lossless and contains the object's original color information, etc. RAW data is generally formatted using a Bayer array.

[0059] The image processing chip 120 is a chip independent of the main control chip 130 and the image sensor 110. It can be located between the main control chip 130 and the display screen 140, and the image processing chip 120 is electrically connected to the main control chip 130, the image sensor 110 and the display screen 140 respectively.

[0060] The image processing chip 120 is used to acquire the first image data collected by the image sensor 110, process the first image data to generate the second image data, and send the second image data to the main control chip 130.

[0061] The second image data is the image data generated after preprocessing.

[0062] Preprocessing includes, but is not limited to: performing black level compensation, lens correction, and bad pixel correction on the first image in the Bayer domain.

[0063] The second image data can be a single frame of image data, or it can be multiple frames of image data.

[0064] It should be noted that the second image data may include a complete frame of image, or it may include data from a portion of a frame of image.

[0065] The main control chip 130 can be an AP chip, including an image signal processing (ISP) module 135, a dynamic random access memory (DRAM) module 134, a graphics processing unit (GPU) module 137, and a CPU module 136.

[0066] The main control chip 130 is used to perform image processing on the second image data obtained after preprocessing by the image processing chip 120, converting the format of the second image data into the target format to generate the third image data.

[0067] The target format can be YUV format.

[0068] Specifically, the main control chip 130 is used to perform Demosaic color interpolation, RGB domain format conversion, automatic white balance correction, color correction, 3A and Gamma correction on the second image data, and convert it into a YUV domain image to generate the third image data.

[0069] Understandably, YUV is a type of true-color color space. "Y" represents luminance (or luma), which is the grayscale value, while "U" and "V" represent chroma (or chroma), which are used to characterize the color and saturation of an image and to specify the color of a pixel.

[0070] The main control chip 130 sends the third image data to the image processing chip 120.

[0071] The image processing chip 120 is also used to receive third image data and process the third image data to generate target image data, and send the target image data to the display screen 140.

[0072] The image processing chip 120 processes the third image data, mainly by performing noise reduction in the YUV domain and edge enhancement on the third image data.

[0073] The target image data can be the final preview image or the image generated from the shot.

[0074] Display screen 140 is used to display target image data.

[0075] The display screen 140 can be a mobile phone screen or a projection screen, etc.

[0076] For example, during the shooting process, the phone receives the user's first input, which is used to activate the shooting function.

[0077] In response to the first input, the mobile phone controls its camera module to acquire first image data and displays the first image data in normal shooting mode.

[0078] At this time, as Figure 2 As shown, the main control chip 130 uses I2C / SPI to control the image processing chip 120 to operate in BYPASS mode.

[0079] The mobile phone receives a second input from the user, which is used to enter night scene shooting mode or backlight mode. In response to the input, the main control chip 130 uses I2C / SPI to control the image processing chip 120 to switch from bypass mode to normal working mode.

[0080] like Figure 5 As shown, in normal working mode, i.e. night scene shooting mode, the camera sends the first image data it has acquired to the image processing chip 120 for preprocessing. The first image data is a RAW image.

[0081] The image processing chip 120 performs real-time noise reduction and other processing on the RAW image sent by the camera line by line to generate second image data, and sends the second image data to the main control chip 130.

[0082] The main control chip 130 processes the second image data through its built-in ISP, converts it into a YUV image, generates the third image data, and sends the YUV image to the image processing chip 120 for post-processing via the DSI interface.

[0083] The image processing chip 120 performs noise reduction and other processing on the third image data to generate target image data, and sends the target image data to the display screen 140 for preview display through the DSI interface.

[0084] In some embodiments, the image processing chip 120 further includes a seventh interface, and the main control chip 130 further includes an eighth interface.

[0085] In this embodiment, the seventh interface is electrically connected to the eighth interface.

[0086] Continue to refer to Figure 1 The seventh interface can be a MIPI CSI TX 128, and the eighth interface can be a MIPI CSI RX133.

[0087] Image processing chip 120 is used to send target image data to main control chip 130 through the seventh interface;

[0088] The main control chip 130 is used to receive target image data through the eighth interface and encode and save the target image data.

[0089] Optionally, this embodiment can be applied in video recording mode.

[0090] For example, in video recording mode, the phone receives input from the user to enter video recording mode, and in response to the input, the phone controls the camera to capture first image data.

[0091] The image sensor 110 sequentially sends the first image data of each frame it acquires to the image processing chip 120 for preprocessing.

[0092] The image processing chip 120 processes each frame of RAW image sent by the camera in real time, line by line, to generate multiple frames of second image data, and sends the multiple frames of second image data to the main control chip 130.

[0093] The main control chip 130 processes each frame of second image data through its built-in ISP, converts it into multiple frames of YUV images, generates multiple frames of third image data, and sends the multiple frames of YUV images to the image processing chip 120 for post-processing through the DSI interface.

[0094] The image processing chip 120 performs noise reduction and other processing on multiple frames of third image data to generate multiple frames of target image data. Each frame of target image data is sent to the display screen 140 for preview display via DSI. Another path sends each frame of target image data back to the main control chip 130 via CSI for encoding and saving as a video.

[0095] During the research and development process, the inventors discovered that in related technologies, the image captured by the image sensor is generally processed in the RAW domain by the ISP built into the AP chip of the mobile phone, and then converted into the YUV domain to generate the final image.

[0096] In daily life, when users take pictures with their mobile phones in low-light environments such as at night, the images captured by the image sensor will have problems such as high noise and unclear details. This requires powerful ISP and algorithm processing to present the effect seen by the naked eye. Especially for real-time night scene recording or preview, each frame of the image captured by the sensor needs to be processed by algorithms such as noise reduction.

[0097] The existing AP's computing performance and power consumption cannot meet the above requirements, and the design architecture and algorithm of the built-in ISP image processing are fixed, making it difficult to achieve differentiation and improvement. As a result, the final image generated in night scene shooting mode often has poor imaging effect.

[0098] In this application, by employing image processing chip 120 to perform RAW domain preprocessing on the first image acquired by image sensor 110 to generate second image data, and after main control chip 130 converts the second image data into YUV domain to generate third image data, noise reduction processing is performed on the third image data again. Without improving the computing performance of main control chip 130, the image clarity can be effectively improved, thereby improving the shooting effect.

[0099] According to the image processing circuit provided in the embodiments of this application, an independent image processing chip 120 is set between the main control chip 130 and the image sensor 110, and between the main control chip 130 and the display screen 140. The image processing chip 120 processes the image data twice, before and after the main control chip 130, to achieve effective noise reduction and improve the image quality.

[0100] Continue to refer to Figure 1 In some embodiments, the image processing chip 120 includes: a preprocessing module 121 (Pre ISP module 121), a postprocessing module 122 (Post ISP module 122), a first interface, a second interface, a third interface, and a fourth interface; the main control chip 130 includes a fifth interface and a sixth interface.

[0101] Optionally, the first interface can be a MIPI CSI RX 123, the second interface can be a MIPI CSI TX 124, the third interface can be a MIPI DSI RX 126, the fourth interface can be a MIPI DSI TX 125, the fifth interface can be a MIPI CSI RX 131, and the sixth interface can be a MIPI DSI TX 132.

[0102] Where CSI is the camera interface, DSI is the display interface, RX is used to represent the receiving port, and TX is used to represent the transmitting port.

[0103] The preprocessing module 121 is connected between the first interface and the second interface, and the postprocessing module 122 is connected between the third interface and the fourth interface. The first interface is electrically connected to the image sensor 110, the second interface is electrically connected to the fifth interface, and the third interface is electrically connected to the sixth interface. The preprocessing module 121 is connected between the first interface and the second interface, and is electrically connected to the image sensor 110 through the first interface.

[0104] In this embodiment, the image processing chip 120 can transmit data with the image sensor 110, the main control chip 130, and the display screen 140 via the MIPI protocol.

[0105] The image processing chip 120 can support independent control of the image sensor 110, or it can support the main control chip 130 to control the image sensor 110 by bypassing the I2C control signal.

[0106] The preprocessing module 121 is used to receive first image data sent from the image sensor 110 through the first interface, and preprocess the first image data to generate fourth image data.

[0107] It should be noted that in actual execution, the Pre ISP module 121 supports two modes. Mode 1 uses a hardware NR module for noise reduction, with the algorithm being fully hard-coded, which has the advantage of fast processing speed. Mode 2 uses an internal DSP to run software algorithms for noise reduction, which has the advantage of supporting algorithm upgrades.

[0108] In addition, the Pre ISP module 121 supports line-by-line processing, which does not require waiting for a complete frame of image to be processed before sending out data. It can send out data after processing 4 lines of data. The Pre ISP module 121 performs preprocessing and comparison, directly bypassing the process and only adding 4 lines of delay.

[0109] The second interface is used to send the second image data to the main control chip 130, wherein the second image data is generated based on the fourth image data.

[0110] It should be noted that when the fourth image data is a single frame, the second image data is the same as the fourth image data.

[0111] When the fourth image data consists of multiple frames, the second image data can be image data generated after processing such as compositing the multiple frames of the fourth image data.

[0112] The main control chip 130 is used to receive the second image data through the fifth interface, convert the format of the second image data into the target format, generate the third image data, and send the third image data to the image processing chip 120 through the sixth interface.

[0113] The processing procedure has been described in the above embodiments and will not be repeated here.

[0114] The post-processing module 122 is used to receive third image data through the third interface, process the third image data, and generate fifth image data.

[0115] The post-processing module 122 is used to perform image processing on the third image data obtained by the main control chip 130 to generate the fifth image data.

[0116] Similarly, the Post ISP module 122 also supports processing and sending data line by line, and can send data without a delay of 1 frame.

[0117] The fourth interface is used to send target image data to the display screen, wherein the target image data is generated based on the fifth image data.

[0118] It should be noted that when the fifth image data is a single frame, the target image data is the fifth image data.

[0119] When the fifth image data consists of multiple frames, the target image data can be image data generated after processing such as compositing the multiple frames of the fifth image data.

[0120] like Figure 1 As shown, in actual execution, the first image in the RAW domain acquired by the image sensor 110 is first transmitted to the Pre ISP module 121 of the image processing chip 120 through MIPI CSI TX 124 and MIPI CSI RX 131 for preprocessing in the RAW domain to generate the fourth image data.

[0121] By first performing noise reduction processing in the RAW domain using the hardware on the PreISP module 121 of the image-independent image processing chip 120, the impact on image quality caused by different noise changes after signal processing by each block of the ISP in the RAW domain can be effectively avoided. For example, the noise away from the center increases due to lens correction, the noise in the image is changed into structural noise during the interpolation operation of the original signal using Demosaic, and the nonlinear changes in noise after gamma correction are also affected by different noise changes, thus helping to improve image quality.

[0122] Image processing chip 120 identifies the fourth image data as the second image data and transmits the second image data to the built-in ISP of main control chip 130 for processing through the second and third interfaces. The main control chip 130 processes the RAW image through the built-in ISP, converts it into YUV data, generates the third image data, and then sends the third image data to post-processing module 122 for post-processing through the MIPI DSI interface.

[0123] The Post ISP module 122 of the image processing chip 120 performs further noise reduction and SDR2HDR processing on the third image data in the YUV domain to generate the fifth image data.

[0124] The image processing chip 120 determines the fifth image data as the target image data and performs different operations based on different shooting modes.

[0125] For example, in photo preview or video preview mode, image processing chip 120 sends target image data to display screen 140 for display through the fourth interface; or, in video recording mode, image processing chip 120 sends target image data to display screen 140 through the fourth interface and sends it back to main control chip 130 through the seventh interface, where it is encoded and saved as a video.

[0126] According to the image processing circuit provided in the embodiments of this application, by performing image processing twice by the image processing chip before and after the main control chip, effective noise reduction can be achieved, thereby improving the image quality. In addition, by connecting the main control chip and the image processing chip through the MIPI DSI TX interface, data transmission can be achieved without the main control chip supporting the MIPI CSI TX interface, which helps to reduce hardware costs.

[0127] like Figure 3 As shown, in some embodiments, the image processing chip 120 further includes a first synthesis module 1204 and a second synthesis module 1205.

[0128] In this embodiment, the first synthesis module 1204 is connected between the preprocessing module 121 and the second interface, and the second synthesis module 1205 is electrically connected to the postprocessing module 122.

[0129] The first synthesis module 1204 is used to receive the fourth image data sent by the preprocessing module 121, perform synthesis processing on the fourth image data to generate the second image data, and send the second image data to the main control chip 130.

[0130] It is understood that in this embodiment, the post-processing module 122 can also be used to determine the latest frame of the fifth image data as the target image data and send the fifth image data to the second synthesis module 1205.

[0131] The second synthesis module 1205 is used to synthesize the fifth image data sent by the post-processing module 122 to generate a frame of sixth image data.

[0132] In other embodiments, the second synthesis module 1205 may also be used to send the sixth image data to the main control chip 130 for storage by the main control chip 130.

[0133] For example, in actual operation, when the user takes a picture and the camera enters night scene shooting mode, the image processing chip 120 switches from bypass mode to normal working mode.

[0134] Image sensor 110 acquires the first image of P frames and sends the P frame first image data to image processing chip 120. The value of P can be 8 or 10, etc.

[0135] The PreISP module 121 of the image processing chip 120 performs RAW domain preprocessing on the first P-frame image to generate the fourth P-frame image data. The fourth P-frame image data is sent to the main control chip 130. At the same time, the latest N-frame fourth image data is sent to the DRAM inside the image processing chip 120 for caching. For example, the value of N can be 6 or 8.

[0136] Where P and N are both positive integers, and P ≥ N.

[0137] The terminal receives a third input from the user, which is used to determine whether to take a picture.

[0138] like Figure 6 As shown, in response to the third input, the first synthesis module 1204 performs an M-frame noise reduction algorithm on the fourth image data in the N-frame RAW domain to synthesize it into N / M-frame second image data, which is then sent to the main control chip 130 for processing by the built-in ISP and converted into N / M-frame third image data in the YUV domain.

[0139] The main control chip 130 sends the N / M frame third image data to the image processing chip 120.

[0140] The Post ISP module 122 of the image processing chip 120 performs post-processing on each frame of third image data to generate N / M frames of fifth image data. In preview mode, the latest frame of fifth image data is used as the target image data, that is, as the preview display image after the photo is taken, and sent to the display screen 140 for display.

[0141] In addition, the image processing chip 120 will also generate N / M frame fifth image data and cache it in the DRAM inside the image processing chip 120.

[0142] During the photo taking process, the second synthesis module 1205 in the image processing chip 120 performs multi-frame noise reduction processing on the N / M frame fifth image data, synthesizes it into a single frame of sixth image data, and sends the sixth image data back to the main control chip 130, where it is encoded and saved as the actual photo taken.

[0143] For example, when N=6 and M=2, after multi-frame noise reduction and synthesis by the main control chip 130, three frames of third image data in the YUV domain can be generated.

[0144] The Post ISP module 122 of the image processing chip 120 performs post-processing on each frame of third image data to generate three frames of fifth image data. It then performs multi-frame noise reduction on the three frames of fifth image data, synthesizes them into one frame of sixth image data, and sends the sixth image data back to the main control chip 130, where it is encoded and saved as a photo that has actually been taken.

[0145] According to the image processing circuit provided in the embodiments of this application, the image processing chip performs two multi-frame noise reduction processes in the RAW domain and the YUV domain respectively, which can further improve the noise reduction effect and improve the image quality; in addition, the YUV domain multi-frame synthesis and imaging algorithm processing in the background will not affect the shooting speed.

[0146] This application provides an image processing method. The subject executing the image processing method can be a terminal, including but not limited to mobile terminals such as mobile phones, tablets, and cameras; non-mobile terminals such as desktop computers; or terminal control devices.

[0147] It should be noted that this image processing method is applied to the image processing circuit described above.

[0148] like Figure 4 As shown, the image processing method includes steps 410, 420, 430, 440 and 450.

[0149] Step 410: Image sensor 110 acquires first image data and sends the first image data to image processing chip 120;

[0150] In this step, the first image data is an image in the RAW domain.

[0151] The first image data can be the image data of a single frame or the image data of multiple frames.

[0152] Step 420: The image processing chip 120 processes the first image data to generate the second image data and sends the second image data to the main control chip 130.

[0153] In this step, the second image data is the image data processed in the RAW domain. The number of frames in the second image data can be the same as or different from the number of frames in the first image data.

[0154] During actual execution, the image processing chip 120 is controlled by the main control chip 130 and switches from bypass mode to normal working mode.

[0155] In normal operating mode, the image processing chip 120 receives the first image data sent by the image sensor 110 through the first interface, and performs RAW domain processing on the first image to generate the second image data.

[0156] The image processing chip 120 processes the first image data in the RAW domain, which can be manifested as performing black level compensation, lens correction, and bad pixel correction on the first image in the Bayer domain.

[0157] The second image data generated after preprocessing by the image processing chip 120 is sent to the main control chip 130 through the second interface.

[0158] Optionally, this step is applied to night scene shooting mode.

[0159] In some embodiments, prior to step 410, the method may further include:

[0160] Receive the user's second input;

[0161] In response to the second input, enter night scene shooting mode.

[0162] The second input is used to determine whether to enter night scene shooting mode.

[0163] The second input can be the same as the first input, such as touch input, physical button input, voice input, and motion gesture input, which will not be elaborated here.

[0164] In some embodiments, step 410 may further include: the image processing chip 120 performs line-by-line noise reduction processing on the first image data to generate second image data, and sends the second image data line by line to the main control chip 130 based on the target number of lines.

[0165] In this embodiment, the image processing chip 120 performs real-time noise reduction and other processing on the first image data sent by the image sensor 110 line by line to generate second image data, and sends the second image data line by line to the main control chip 130 based on the target number of lines.

[0166] The second image data sent to the main control chip 130 can be data from a portion of a frame of an image after processing by the image processing chip 120.

[0167] In actual execution, line-by-line noise reduction can be performed through the preprocessing module 121.

[0168] Among them, the Pre ISP module 121 supports line-by-line processing, and can transmit data without waiting for a complete frame of image processing to be completed.

[0169] For example, the first image data includes N rows of data. The image processing chip 120 processes the N rows of data sequentially, starting from the first row. After processing the first four rows of data, the currently processed four rows of data are sent to the main control chip 130, which then processes them. These four rows of data constitute the second image data.

[0170] Subsequently, the image processing chip 120 continues to process the data in rows 5-8 and sends the newly generated 4 rows of data to the main control chip 130. The newly generated 4 rows of data are the updated second image data, which is then processed by the main control chip 130.

[0171] This process continues until all N rows of data have been processed.

[0172] In this embodiment, the preprocessing module 121 performs line-by-line noise reduction in the RAW domain, which can shorten the processing latency and significantly improve the image processing speed.

[0173] Step 430: The main control chip 130 converts the second image data into the target format, generates the third image data, and sends the third image data to the image processing chip 120.

[0174] In this step, the target format is YUV.

[0175] The third image data is an image in the YUV domain generated after processing by the main control chip 130.

[0176] The main control chip 130 converts the second image data into a target format to generate the third image data. This can be manifested as follows: the main control chip 130 performs Demosaic color interpolation, RGB domain format conversion, automatic white balance correction, color correction, and Gamma correction on the second image data, and converts it into a YUV domain image to generate the third image data.

[0177] In actual execution, this step can be performed using the ISP algorithm built into the main control chip 130.

[0178] After the main control chip 130 generates the third image data, it sends the third image data to the image processing chip 120 through the second interface.

[0179] Step 440: The image processing chip 120 processes the third image data to generate target image data and sends the target image data to the display screen 140.

[0180] In this step, the target image data is the image data generated after processing in the YUV domain.

[0181] In actual execution, the image processing chip 120 processes the third image data to generate the target image data. This can be manifested as follows: the image processing chip 120 performs noise reduction and SDR2HDR algorithms on the third image data to generate the target image data.

[0182] It should be noted that, depending on the mode, the image processing chip 120 can send the target image data to different modules.

[0183] For example, such as Figure 5 As shown, in photo preview or video preview mode, the image processing chip 120 can send the target image data to the display screen 140 for display via MIPI DSI.

[0184] For example, continue to refer to Figure 5In photo or video mode, the image processing chip 120 can send the target image data to the display screen 140 for display via MIPI DSI TX 125, and send it back to the main control chip 130 via MIPI CSI TX 128 for encoding and saving as a video.

[0185] In some embodiments, step 430 may further include: the image processing chip 120 performs line-by-line noise reduction processing on the third image data to generate target image data, and sends the target image data line by line to the display screen 140 based on the target number of lines.

[0186] In this embodiment, the image processing chip 120 performs real-time noise reduction and other processing on the third image data sent by the main control chip 130 line by line to generate target image data, and sends the target image data to the display screen 140 for display.

[0187] In actual execution, line-by-line noise reduction can be performed through the post-processing module 122.

[0188] Among them, the Post ISP module 122 supports line-by-line processing, and can transmit data without waiting for a complete frame of image processing to be completed.

[0189] For example, the third image data includes N rows of data. The image processing chip 120 processes the N rows of data sequentially, starting from the first row. After processing the first four rows of data, the processed four rows of data can be sent to the display screen 140 as the target image data for display.

[0190] Afterwards, the image processing chip 120 continues to process the data in rows 5-8, and sends the newly generated 4 rows of target image data to the display screen 140 for display.

[0191] This process continues until all N rows of data have been processed, at which point the final generated target image data is displayed on screen 140.

[0192] Similarly, by performing line-by-line noise reduction in the YUV domain through the post-processing module 122, the processing latency can be further shortened, significantly improving the image processing speed and the image preview speed.

[0193] Step 450: Display screen 140 displays the target image data.

[0194] In this step, the display screen 140 can be a mobile phone screen, a projection screen, or the like.

[0195] Display screen 140 is used to display image data for real-time preview.

[0196] For example, while a user is taking a picture with their phone, the phone receives a second input from the user;

[0197] The phone responded to the input and entered night mode.

[0198] At this time, the main control chip 130 uses I2C / SPI to control the image processing chip 120 to switch from bypass mode to normal operation mode.

[0199] In normal operating mode, the image sensor 110 sends the first image data acquired in the RAW domain to the image processing chip 120 for preprocessing.

[0200] The image processing chip 120 performs real-time noise reduction and other processing on the RAW image sent by the camera row by row to generate second image data, and sends the second image data to the main control chip 130.

[0201] The main control chip 130 processes the second image data through its built-in ISP, converts it into a YUV image, generates the third image data, and sends the YUV image to the image processing chip 120 for post-processing via the DSI interface.

[0202] In preview mode, the image processing chip 120 performs real-time noise reduction and other processing on the third image data in the YUV domain row by row to generate target image data, and sends the target image data to the display screen 140 for preview display via DSI.

[0203] According to the image processing method provided in the embodiments of this application, noise reduction processing is performed in the RAW domain and YUV domain by an image processing chip. This can effectively reduce noise in images in night scene mode without improving the computing performance of the main control chip, thereby improving image clarity and image quality.

[0204] In some embodiments, continue to refer to Figure 5 After the image processing chip 120 processes the third image data to generate the target image data, the method may further include:

[0205] Image processing chip 120 sends target image data to main control chip 130;

[0206] The main control chip 130 encodes and stores the target image data.

[0207] Optionally, this embodiment is applied to shooting or recording mode.

[0208] For example, in shooting or recording mode, the image processing chip 120 sends the target image data to the display screen 140 for preview display through the fourth interface, and sends the target image data back to the main control chip 130 through the seventh interface for encoding and saving.

[0209] like Figure 6As shown, in some embodiments, the first image data includes multiple frames of first images.

[0210] Step 420 may also include: the image processing chip 120 performs multi-frame noise reduction and synthesis processing on the first image data to generate second image data of the target number of frames, and sends the second image data of the target number of frames to the main control chip 130.

[0211] Step 430 may also include: the main control chip 130 converts the second image data of the target frame number into the target format, generates the third image data of the target frame number, and sends the third image data of the target frame number to the image processing chip 120.

[0212] Step 440 may also include: the image processing chip 120 performs noise reduction processing on the third image data of the target frame number to generate the fifth image data of the target frame number, determines the latest frame image data in the fifth image data of the target frame number as the target image data, and sends the target image data to the display screen 140.

[0213] Furthermore, the image processing chip 120 performs multi-frame noise reduction and synthesis processing on the fifth image data of the target frame number to generate a sixth image data frame.

[0214] In this embodiment, the target frame number is less than or equal to the frame number of the first image, and the target frame number is greater than zero.

[0215] For example, in actual operation, when the user takes a picture and the camera enters night scene shooting mode, the image processing chip 120 switches from bypass mode to normal working mode.

[0216] Image sensor 110 acquires the first image of P-frame and sends the first image of P-frame to image processing chip 120.

[0217] The PreISP module 121 of the image processing chip 120 performs RAW domain preprocessing on the first image data of P-frame to generate the fourth image data of P-frame. The fourth image data of P-frame is sent to the main control chip 130, and at the same time, the latest fourth image data of N-frame is sent to the DRAM inside the image processing chip 120 for caching.

[0218] Where P and N are both positive integers, and P ≥ N.

[0219] The terminal receives a third input from the user, which is used to determine whether to take a picture.

[0220] In response to the third input, the terminal first synthesis module 1204 performs an M-frame noise reduction algorithm on the fourth image data in the N-frame RAW domain to synthesize it into N / M-frame second image data, which is then sent to the main control chip 130 for processing by the built-in ISP and converted into N / M-frame third image data in the YUV domain.

[0221] The main control chip 130 sends the N / M frame third image data to the image processing chip 120.

[0222] The Post ISP module 122 of the image processing chip 120 performs post-processing on each frame of third image data to generate fifth image data. In preview mode, the latest frame of fifth image data is used as the target image data, that is, as the preview display image after the photo is taken, and sent to the display screen 140 for display.

[0223] In addition, the image processing chip 120 will also generate N / M frames of the fifth image and cache them in the DRAM inside the image processing chip 120.

[0224] During the photo taking process, the second synthesis module 1205 of the image processing chip 120 performs multi-frame noise reduction processing on the N / M frame fifth image, synthesizes it into a single frame of sixth image data, and sends the sixth image data back to the main control chip 130, where it is encoded and saved as the actual photo taken.

[0225] According to the image processing method provided in the embodiments of this application, the image processing chip performs two multi-frame noise reduction processes in the RAW domain and the YUV domain respectively, which can further improve the noise reduction effect and improve the image quality; in addition, the YUV domain multi-frame synthesis and imaging algorithm processing in the background will not affect the shooting speed.

[0226] The image processing method provided in this application can be executed by an image processing device. This application uses an image processing device executing the image processing method as an example to illustrate the image processing device provided in this application.

[0227] This application also provides an image processing apparatus.

[0228] It should be noted that this image processing device is used in the electronic device described above.

[0229] like Figure 7 As shown, the image processing device includes: a first processing module 710, a second processing module 720, a third processing module 730, a fourth processing module 740, and a fifth processing module 750.

[0230] The first processing module 710 is used to enable the image sensor to acquire first image data and send the first image data to the image processing chip;

[0231] The second processing module 720 is used to enable the image processing chip to process the first image data, generate the second image data, and send the second image data to the main control chip;

[0232] The third processing module 730 is used to enable the main control chip to convert the format of the second image data into the target format, generate the third image data, and send the third image data to the image processing chip.

[0233] The fourth processing module 740 is used to enable the image processing chip to process the third image data, generate target image data, and send the target image data to the display screen;

[0234] The fifth processing module 750 is used to display the target image data on the display screen. According to the image processing apparatus provided in this application embodiment, by performing noise reduction processing in both the RAW and YUV domains using an image processing chip, noise reduction can be effectively achieved in the image without increasing the computing performance of the main control chip, thereby improving image clarity and ultimately enhancing imaging quality.

[0235] In some embodiments, the first image data includes multiple frames of first images.

[0236] The second processing module 720 is further configured to: enable the image processing chip to perform multi-frame noise reduction and synthesis processing on the first image data to generate second image data with a target number of frames, and send the second image data with a target number of frames to the main control chip;

[0237] The third processing module 730 is also used to: convert the format of the second image data of the target frame number into the target format, generate the third image data of the target frame number, and send the third image data of the target frame number to the image processing chip.

[0238] The fourth processing module 740 is also used for:

[0239] The image processing chip performs noise reduction processing on the third image data of the target frame number to generate the fifth image data of the target frame number. The latest frame image data in the fifth image data of the target frame number is determined as the target image data and sent to the display screen.

[0240] Furthermore, the image processing chip performs multi-frame noise reduction and synthesis processing on the fifth image data of the target frame number to generate a sixth image data frame.

[0241] In some embodiments,

[0242] The second processing module 720 is further configured to: enable the image processing chip to perform line-by-line noise reduction processing on the first image data to generate the second image data, and send the second image data line by line to the main control chip based on the target number of lines;

[0243] The fourth processing module 740 is also used to: enable the image processing chip to perform line-by-line noise reduction processing on the third image data, generate target image data, and send the target image data to the display screen line by line based on the target number of lines.

[0244] In some embodiments, the device may further include:

[0245] The sixth processing module is used to process the third image data by the image processing chip and generate the target image data, and then send the target image data to the main control chip.

[0246] The seventh processing module is used to enable the main control chip to encode and store the target image data.

[0247] The image processing device in this application embodiment can be an electronic device or a component within an electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices besides a terminal. For example, the electronic device can be a mobile phone, tablet computer, laptop computer, PDA, in-vehicle electronic device, mobile internet device (MID), augmented reality (AR) / virtual reality (VR) device, robot, wearable device, ultra-mobile personal computer (UMPC), netbook, or personal digital assistant (PDA), etc. It can also be network attached storage (NAS), personal computer (PC), television (TV), ATM, or self-service machine, etc. This application embodiment does not specifically limit the device.

[0248] The image processing device in this application embodiment can be a device with an operating system. The operating system can be Android, iOS, or other possible operating systems; this application embodiment does not specifically limit the specific operating system.

[0249] The image processing apparatus provided in this application embodiment can achieve... Figures 4 to 6 The various processes implemented in the method implementation examples will not be described again here to avoid repetition.

[0250] Optionally, such as Figure 8 As shown, this application embodiment also provides an electronic device 800, including a processor 801, a memory 802, and a program or instructions stored in the memory 802 and executable on the processor 801. When the program or instructions are executed by the processor 801, they implement the various processes of the above-described image processing method embodiments and achieve the same technical effects. To avoid repetition, they will not be described again here.

[0251] It should be noted that the electronic devices in the embodiments of this application include the mobile electronic devices and non-mobile electronic devices described above.

[0252] Figure 9 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of this application.

[0253] The electronic device 900 includes, but is not limited to, components such as: radio frequency unit 901, network module 902, audio output unit 903, input unit 904, sensor 905, display unit 906, user input unit 907, interface unit 908, memory 909, and processor 910.

[0254] Those skilled in the art will understand that the electronic device 900 may also include a power supply (such as a battery) for supplying power to various components. The power supply may be logically connected to the processor 910 through a power management system, thereby enabling functions such as managing charging, discharging, and power consumption through the power management system. Figure 9 The electronic device structure shown does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.

[0255] The processor 910 is used to enable the image sensor to acquire first image data and send the first image data to the image processing chip.

[0256] This is used to enable the image processing chip to process the first image data, generate the second image data, and send the second image data to the main control chip;

[0257] This is used to enable the main control chip to convert the format of the second image data into the target format, generate the third image data, and send the third image data to the image processing chip;

[0258] This is used to enable the image processing chip to process the third image data, generate the target image data, and send the target image data to the display screen;

[0259] Used to make the display screen show the target image data.

[0260] According to the electronic device provided in the embodiments of this application, by having the image processing chip perform noise reduction processing in the RAW domain and YUV domain respectively, noise reduction can be effectively performed on images in night scene mode without improving the computing performance of the main control chip, thereby improving the image clarity and thus improving the imaging quality.

[0261] Optionally, the first image data includes multiple frames of the first image.

[0262] The processor 910 is also used to: enable the image processing chip to perform multi-frame noise reduction and synthesis processing on the first image data to generate second image data with a target number of frames, and send the second image data with a target number of frames to the main control chip;

[0263] The main control chip converts the format of the second image data of the target frame number into the target format, generates the third image data of the target frame number, and sends the third image data of the target frame number to the image processing chip.

[0264] The image processing chip performs noise reduction processing on the third image data of the target frame number to generate the fifth image data of the target frame number. The latest frame image data in the fifth image data of the target frame number is determined as the target image data and sent to the display screen.

[0265] Furthermore, the image processing chip performs multi-frame noise reduction and synthesis processing on the fifth image data of the target frame number to generate a sixth image data frame.

[0266] Optionally,

[0267] The processor 910 is also used to: enable the image processing chip to perform line-by-line noise reduction processing on the first image data to generate second image data, and send the second image data line by line to the main control chip based on the target number of lines;

[0268] The image processing chip performs line-by-line noise reduction on the third image data to generate target image data, and sends the target image data to the display screen line by line based on the target number of lines.

[0269] Optionally,

[0270] The processor 910 is also used to: after the image processing chip processes the third image data and generates target image data, enable the image processing chip to send the target image data to the main control chip;

[0271] The main control chip encodes and stores the target image data.

[0272] According to the electronic device provided in the embodiments of this application, by having the image processing chip perform two multi-frame noise reduction processes in the RAW domain and the YUV domain respectively, the noise reduction effect can be further improved and the image quality can be improved; in addition, the YUV domain multi-frame synthesis imaging algorithm processing in the background will not affect the shooting speed.

[0273] It should be understood that, in this embodiment, the input unit 904 may include a graphics processing unit (GPU) 9041 and a microphone 9042. The GPU 9041 processes image data of still images or videos obtained by an image capture device (such as a camera) in video capture mode or image capture mode. The display unit 906 may include a display panel 9061, which may be configured in the form of a liquid crystal display, an organic light-emitting diode, or the like. The user input unit 907 includes at least one of a touch panel 9071 and other input devices 9072. The touch panel 9071 is also called a touch screen. The touch panel 9071 may include a touch detection device and a touch controller. Other input devices 9072 may include, but are not limited to, physical keyboards, function keys (such as volume control buttons, power buttons, etc.), trackballs, mice, and joysticks, which will not be described in detail here.

[0274] The memory 909 can be used to store software programs and various data.

[0275] The memory 909 may primarily include a first storage area for storing programs or instructions and a second storage area for storing data. The first storage area may store the operating system, application programs or instructions required for at least one function (such as sound playback, image playback, etc.). Furthermore, the memory 909 may include volatile memory or non-volatile memory, or both. The non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct memory bus RAM (DRRAM). The memory 909 in the embodiments of this application includes, but is not limited to, these and any other suitable types of memory.

[0276] Processor 910 may include one or more processing units; optionally, processor 910 integrates an application processor and a modem processor, wherein the application processor mainly handles operations involving the operating system, user interface, and applications, and the modem processor mainly handles wireless communication signals, such as a baseband processor. It is understood that the aforementioned modem processor may also not be integrated into processor 910.

[0277] This application also provides an image processing chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The communication interface is used to transmit image data, and the processor is used to run programs or instructions to implement the steps of the image processing method described above.

[0278] This application also provides a processor chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The communication interface is used to transmit image data, and the processor is used to run programs or instructions to implement the steps of the image processing method described above.

[0279] This application also provides a readable storage medium storing a program or instructions. When the program or instructions are executed by a processor, they implement the various processes of the above-described image processing method embodiments and achieve the same technical effects. To avoid repetition, they will not be described again here.

[0280] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes computer-readable storage media, such as computer read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.

[0281] This application embodiment also provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is used to run programs or instructions to implement the various processes of the above-described image processing method embodiments and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0282] It should be understood that the chip mentioned in the embodiments of this application may also be referred to as a system-on-a-chip, system chip, chip system, or system-on-a-chip, etc.

[0283] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

[0284] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0285] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.

Claims

1. An image processing circuit, characterized in that, It includes a main control chip, an image processing chip, an image sensor, and a display screen, wherein the image processing chip is electrically connected to the main control chip, the image sensor, and the display screen respectively; The image sensor is used to acquire first image data; the first image data is a RAW image. The image processing chip is used to acquire first image data collected by the image sensor, perform RAW domain noise reduction processing on the first image data to generate second image data, and send the second image data to the main control chip; The main control chip is used to receive the second image data, convert the format of the second image data into YUV format, generate the third image data, and send the third image data to the image processing chip; The image processing chip is used to receive the third image data and perform noise reduction processing on the third image data in the YUV domain to generate target image data, and send the target image data to the display screen; The display screen is used to display the target image data; The image processing chip includes a preprocessing module, a postprocessing module, a first interface, a second interface, a third interface, and a fourth interface. The main control chip includes a fifth interface and a sixth interface. The preprocessing module is connected between the first interface and the second interface, and the postprocessing module is connected between the third interface and the fourth interface. The first interface is electrically connected to the image sensor, the second interface is electrically connected to the fifth interface, and the third interface is electrically connected to the sixth interface. The preprocessing module is used to receive the first image data sent from the image sensor through the first interface, and to perform RAW domain noise reduction processing on the first image data to generate the fourth image data; the preprocessing module supports two modes, mode one is to perform noise reduction processing through a hardware module, and mode two is to perform noise reduction processing through an internally running software algorithm. The second interface is used to send the second image data to the main control chip, wherein the second image data is generated based on the fourth image data; The main control chip is used to receive the second image data through the fifth interface and convert the format of the second image data into YUV format to generate third image data, and send the third image data to the image processing chip through the sixth interface; The post-processing module is used to receive the third image data through the third interface, and to perform noise reduction processing on the third image data in the YUV domain to generate the fifth image data; The fourth interface is used to send the target image data to the display screen, and the target image data is generated based on the fifth image data.

2. The image processing circuit according to claim 1, characterized in that, The image processing chip further includes a first synthesis module and a second synthesis module. The first synthesis module is connected between the preprocessing module and the second interface, and the second synthesis module is electrically connected to the postprocessing module. The first synthesis module is used to receive the fourth image data sent by the preprocessing module, perform synthesis processing on the fourth image data to generate the second image data, and send the second image data to the main control chip; The post-processing module is further configured to determine the latest frame of the fifth image data as the target image data, and send the fifth image data to the second synthesis module; The second synthesis module is used to synthesize the fifth image data sent by the post-processing module to generate a sixth image data frame.

3. The image processing circuit according to claim 1, characterized in that, The image processing chip further includes a seventh interface, and the main control chip further includes an eighth interface, with the seventh interface and the eighth interface being electrically connected. The image processing chip is used to send the target image data to the main control chip through the seventh interface; The main control chip is used to receive the target image data through the eighth interface and to encode and save the target image data.

4. An image processing method, characterized in that, The method, applied to the image processing circuit as described in any one of claims 1-3, comprises: An image sensor acquires first image data and sends the first image data to an image processing chip; the first image data is a RAW image. The image processing chip performs RAW domain noise reduction processing on the first image data to generate second image data, and sends the second image data to the main control chip; The main control chip converts the format of the second image data into YUV format, generates third image data, and sends the third image data to the image processing chip; The image processing chip performs noise reduction processing on the third image data in the YUV domain to generate target image data, and sends the target image data to the display screen; The display screen shows the target image data.

5. The image processing method according to claim 4, characterized in that, The first image data includes multiple frames of first images. The image processing chip performs RAW domain noise reduction processing on the first image data to generate second image data, and sends the second image data to the main control chip, including: The preprocessing module of the image processing chip performs multi-frame noise reduction and synthesis processing in the RAW domain on the first image data to generate second image data with a target number of frames, and sends the second image data with a target number of frames to the main control chip; The main control chip converts the format of the second image data into YUV format, generates third image data, and sends the third image data to the image processing chip, including: The main control chip converts the format of the second image data of the target frame number into YUV format, generates the third image data of the target frame number, and sends the third image data of the target frame number to the image processing chip. The post-processing module of the image processing chip performs noise reduction processing on the third image data in the YUV domain to generate target image data, and sends the target image data to the display screen, including: The image processing chip performs noise reduction processing on the third image data of the target frame number in the YUV domain to generate the fifth image data of the target frame number. The latest frame image data in the fifth image data of the target frame number is determined as the target image data, and the target image data is sent to the display screen. Furthermore, the image processing chip performs multi-frame noise reduction and synthesis processing on the fifth image data of the target frame number to generate a sixth image data frame.

6. The image processing method according to claim 4, characterized in that, The image processing chip performs RAW domain noise reduction processing on the first image data to generate second image data, and sends the second image data to the main control chip. This includes: the preprocessing module of the image processing chip performs RAW domain line-by-line noise reduction processing on the first image data to generate second image data, and sends the second image data line by line to the main control chip based on the target number of lines. The image processing chip performs noise reduction processing on the third image data in the YUV domain to generate target image data, and sends the target image data to the display screen. This includes: the post-processing module of the image processing chip performs line-by-line noise reduction processing on the third image data in the YUV domain to generate target image data, and sends the target image data to the display screen line by line based on the target number of lines.

7. The image processing method according to claim 4, characterized in that, After the image processing chip processes the third image data to generate the target image data, the method further includes: The image processing chip sends the target image data to the main control chip; The main control chip encodes and stores the target image data.

8. An image processing apparatus, characterized in that, The apparatus, used in an image processing circuit as described in any one of claims 1-3, comprises: A first processing module is configured to enable an image sensor to acquire first image data and send the first image data to an image processing chip; the first image data is a RAW image. The second processing module is used to enable the image processing chip to perform RAW domain noise reduction processing on the first image data, generate second image data, and send the second image data to the main control chip. The third processing module is used to enable the main control chip to convert the format of the second image data into YUV format, generate the third image data, and send the third image data to the image processing chip; The fourth processing module is used to enable the image processing chip to perform noise reduction processing on the third image data in the YUV domain, generate target image data, and send the target image data to the display screen; The fifth processing module is used to enable the display screen to display the target image data.

9. An image processing chip, characterized in that, The image processing chip includes a processor and a communication interface, the communication interface being coupled to the processor, the communication interface being used to transmit image data, and the processor being used to run programs or instructions to implement the steps of the image processing method as described in any one of claims 4-7.

10. A processor chip, characterized in that, The processor chip includes a processor and a communication interface, the communication interface being coupled to the processor, the communication interface being used to transmit image data, and the processor being used to run programs or instructions to implement the steps of the image processing method as described in any one of claims 4-7.

Images