Image processing method and circuit, electronic equipment, chip and medium

Abstract

The invention discloses an image processing method and circuit, electronic equipment, a chip and a medium, and belongs to the technical field of image processing. The method is applied to an image processing chip, and comprises the following steps: acquiring a first image acquired by an image sensor under the condition that a shooting instruction is received; segmenting the first image into M image slices, wherein M is an integer greater than or equal to 2; sequentially carrying out the following processing on the M image slices: carrying out image processing on a first image slice to obtain first image data, and transmitting the first image data to a main control chip; wherein the first image slice is any one of the M image slices.

Description

Technical Field

[0001] The present application belongs to the field of computer technology, and specifically relates to an image processing method, circuit, electronic device, chip and medium. Background Art

[0002] At present, when an external image processing chip is equipped with a neural network processor (NPU) to accelerate the photo, it is necessary to send back the RAW image, the RGB image after the photo is accelerated, and the metadata (meta). According to the design of the Mobile Industry Processor Interface Alliance (MIPI), the sent back information needs to be saved in the dynamic RAM (DDR) and then sent back to the application processor (AP), that is, the main control chip. The image processing chip and AP cannot perform parallel algorithm processing, and the processing efficiency is low. Summary of the invention

[0003] The purpose of the embodiments of the present application is to provide an image processing method, circuit, electronic device, chip and medium, which can solve the problem of low efficiency of existing image processing.

[0004] In a first aspect, an embodiment of the present application provides an image processing method, which is applied to an image processing chip, comprising:

[0005] When receiving a shooting instruction, acquiring a first image captured by an image sensor;

[0006] Dividing the first image into M image slices, where M is an integer greater than or equal to 2;

[0007] The following processing is performed on the M image slices in sequence: image processing is performed on the first image slice to obtain first image data, and the first image data is transmitted to the main control chip; wherein the first image slice is any one of the M image slices.

[0008] In a second aspect, an embodiment of the present application provides an image processing method, which is applied to a main control chip, including:

[0009] Receive first image data sent by an image processing chip; wherein the first image data is obtained after image processing is performed on a first image slice, the first image slice is any one of M image slices, the M image slices are obtained by segmenting the first image, the first image is acquired by an image sensor when a shooting instruction is received, and M is an integer greater than or equal to 2;

[0010] Post-processing the first image data to obtain processed data;

[0011] After the M processing data corresponding to the M image slices are acquired, a captured image corresponding to the first image is obtained according to the M processing data.

[0012] In a third aspect, an embodiment of the present application provides an image processing circuit, including a main control chip and an image processing chip, wherein the main control chip is connected to the image processing chip;

[0013] The image processing chip is used to obtain a first image captured by an image sensor when receiving a shooting instruction; divide the first image into M image slices, where M is an integer greater than or equal to 2; and sequentially perform the following processing on the M image slices: perform image processing on the first image slice to obtain first image data, and transmit the first image data to the main control chip for processing; wherein the first image slice is any one of the M image slices;

[0014] The main control chip is used to receive the first image data sent by the image processing chip; post-process the first image data to obtain processed data; after obtaining the M processed data corresponding to the M image slices, obtain the captured image corresponding to the first image according to the M processed data.

[0015] In a fourth aspect, an embodiment of the present application provides an electronic device, comprising the image processing circuit as described in the third aspect.

[0016] In a fifth aspect, an embodiment of the present application provides an image processing chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the steps of the image processing method described in the first aspect.

[0017] In a sixth aspect, an embodiment of the present application provides a main control chip, which includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the steps of the image processing method described in the second aspect.

[0018] In a seventh aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the method described in the first aspect or the second aspect are implemented.

[0019] In an eighth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the first aspect or the second aspect.

[0020] In an embodiment of the present application, upon receiving a shooting instruction, the image processing chip obtains a first image captured by an image sensor; by dividing the first image into M image slices, the image processing chip can perform image processing on each of the M image slices in turn, so that each time an image slice is processed, the processed data of the image slice obtained by image processing is sent to the main control chip, so that the main control chip can perform post-processing on the processed data corresponding to a single image slice in advance, without having to wait until all the data to be returned are obtained before performing post-processing, and the image processing chip and the main control chip can execute their respective corresponding image processing algorithms on the first image in parallel, thereby improving image processing efficiency and shooting performance. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 is one of the flow charts of the image processing method according to an embodiment of the present application;

[0022] Figure 2 This is the second flowchart of the image processing method of the embodiment of the present application;

[0023] Figure 3 This is the third flowchart of the image processing method of the embodiment of the present application;

[0024] Figure 4 This is the fourth flowchart of the image processing method of the embodiment of the present application;

[0025] Figure 5 is a schematic diagram of an image processing circuit according to an embodiment of the present application;

[0026] Figure 6 is a schematic diagram of the structure of an electronic device according to an embodiment of the present application;

[0027] Figure 7 It is a schematic diagram of the hardware structure of the electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0028] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0029] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0030] The image processing method provided in the embodiment of the present application is described in detail below through specific embodiments and their application scenarios in conjunction with the accompanying drawings.

[0031] like Figure 1 As shown, the present application provides an image processing method, which is applied to an image processing chip, comprising the following steps:

[0032] Step 101: upon receiving a shooting instruction, obtaining a first image captured by an image sensor.

[0033] Exemplarily, a user opens a camera application installed in an electronic device and enters a shooting preview interface. When the user triggers a photo-taking operation through a shooting control, the camera application, driven by the image processing chip, sends a shooting instruction and related shooting parameters to the image processing chip. The image processing chip controls the image sensor to complete a frame capture action and reads a first image from the memory of the image sensor. The first image is the original image data in the RAW format captured by the image sensor.

[0034] Step 102: Segment the first image into M image slices, where M is an integer greater than or equal to 2.

[0035] As an optional implementation, each of the image slices includes P rows of pixels, and the first image includes M×P pixel rows, where P is a positive integer. That is, the first image is divided into M equal image slices.

[0036] It should be noted that the above image segmentation method is only an example of implementation and is not limited thereto. For example, according to implementation requirements, the first image can be segmented into image slices of irregular sizes, or the width of each image slice can be made smaller than the width of the first image.

[0037] Step 103: performing the following processing on the M image slices in sequence: performing image processing on the first image slice to obtain first image data, and transmitting the first image data to the main control chip; wherein the first image slice is any one of the M image slices.

[0038] In a specific implementation, the image processing chip first performs image processing on the i-th image slice to obtain the i-th image data; then the i-th image data corresponding to the i-th image slice is stored in the dynamic memory; finally, the image processing chip takes out the i-th image data in the dynamic memory and transmits it to the main control chip; after processing the i-th image slice, the image processing chip first performs image processing on the i+1-th image slice to obtain the i+1-th image data; then the i-th image data corresponding to the i-th image slice is stored in the dynamic memory; finally, the image processing chip takes out the i+1-th image data in the dynamic memory and transmits it to the main control chip, where i is an integer from 1 to M-1; and so on, until M image slices are processed.

[0039] In the specific implementation, the image processing chip uses the neural network processing units (NPU) therein to process the image slices to realize the photo acceleration function.

[0040] Correspondingly, after the main control chip receives the i-th image data sent by the image processing chip, it post-processes the i-th image data to obtain the i-th processed data; after the main control chip obtains the M processed data corresponding to the M image slices, it obtains the captured image corresponding to the first image based on the M processed data.

[0041] In a specific implementation, a neural network processor (NPU) in an image processing chip performs image processing on the image slices. Optionally, the image processing includes at least one of the following: denoising, color correction, white balance adjustment, sharpening, and high dynamic range (HDR) processing.

[0042] In the above embodiment, upon receiving a shooting instruction, the image processing chip obtains a first image captured by the image sensor; by dividing the first image into M image slices, the image processing chip can perform image processing on each of the M image slices in turn, so that after each image slice is processed, the processed data of the image slice obtained by image processing is sent to the main control chip, so that the main control chip can perform post-processing on the processed data corresponding to a single image slice in advance, without having to wait until all the data to be returned are obtained before performing post-processing, and the image processing chip and the main control chip can execute their respective corresponding image processing algorithms on the first image in parallel, thereby improving image processing efficiency and shooting performance.

[0043] In some optional embodiments, performing image processing on the first image slice to obtain first image data, and transmitting the first image data to the main control chip includes:

[0044] performing image processing on the first image slice to obtain first image data corresponding to the first image slice;

[0045] Storing the first image data in a dynamic RAM (DDR);

[0046] The first image data in the dynamic memory is taken out and transmitted to the main control chip.

[0047] The dynamic memory only stores image data corresponding to one image slice.

[0048] In this embodiment, the dynamic RAM (DDR) in the image processing chip only stores the image data corresponding to one image slice at a time, and does not need to store the image data corresponding to the complete image of the first image, which can reduce the space occupied by the DDR in the image processing chip. For example, an RGB format image with a size of 4000×3000 is about 70 megabytes (MB). Through this embodiment, only the image data corresponding to one image slice needs to be stored. If it is divided into 10 image slices for transmission, the DDR only needs to store 7MB.

[0049] In some optional embodiments, after acquiring the first image captured by the image sensor, the method further includes:

[0050] Sending the first image and metadata corresponding to the first image to the main control chip;

[0051] After transmitting the first image data to the main control chip, the method further includes:

[0052] Sending an interrupt signal to the main control chip, wherein the interrupt signal is used to instruct post-processing of the first image data;

[0053] In specific implementation, the image processing chip performs image processing on each image slice to obtain image data corresponding to each image slice; after transmitting the processed image data to the main control chip, the image processing chip generates an interrupt signal to notify the main control chip to start post-processing of the single image data.

[0054] Optionally, the metadata includes at least one of the following: embedded data, image depth data, image motion vector, etc., where the embedded data is additional information related to the image, the depth data is used to indicate the distance between the object in the scene and the camera, and the motion vector data is used to describe the movement direction and speed of the object in the image.

[0055] Example 1: See Figure 2 The present application provides an image processing method comprising the following steps:

[0056] Step 201: upon receiving a shooting instruction, the image processing chip acquires a first image captured by an image sensor.

[0057] Step 202: The image processing chip sends the first image and corresponding metadata to the main control chip through the Mobile Industry Processor Interface (MIPI) interface.

[0058] It should be noted that the first image in RAW format and the corresponding metadata do not need to rely on the camera acceleration processing results of the NPU, and can be first sent back to the main control chip for related processing. For example, the main control chip obtains the timestamp information in the metadata, and determines the buffer and metadata required by the main control chip in advance according to the timestamp information to prevent the data from being flushed for subsequent processing.

[0059] Step 203: Segment the first image into M image slices, where M is an integer greater than or equal to 2.

[0060] For example, if the first image in RAW format is divided into 10 image slices, taking the size of the first image as 4000×3000 as an example, the size of each image slice is 4000×300; wherein 4000 indicates that the width of the image is 4000 pixels (pixels), 3000 indicates that the height of the image is 3000 pixels (pixels), and 300 indicates that the height of the image is 300 pixels (pixels).

[0061] Step 204: sequentially perform the following processing on the M image slices: perform image processing on the first image slice to obtain first image data, and transmit the first image data to the main control chip; wherein the first image slice is any one of the M image slices.

[0062] It can be understood that the first image slice refers to any one of the 1st image slice to the Mth image slice.

[0063] In a specific implementation, after the i-th image data corresponding to the i-th image slice is stored in the dynamic memory and the i-th image data in the dynamic memory is transmitted to the main control chip, image processing is performed on the i+1-th image slice, and the obtained i+1-th image data is stored in the dynamic memory; finally, the i+1-th image data stored in the dynamic memory is taken out and transmitted to the main control chip; and so on, until M image slices are processed and transmitted; i belongs to 1 to M-1, and i is an integer.

[0064] In specific implementation, each image data is taken out from the dynamic memory of the image processing chip, transmitted back to the main control chip through the MIPI interface, and saved in the memory of the main control chip.

[0065] Step 205: After transmitting the first image data in the dynamic memory to the main control chip, the image processing chip sends an interrupt signal to the main control chip.

[0066] That is, after performing image processing on each image slice and transmitting the processed image data to the main control chip, the image processing chip will generate an interrupt signal to notify the main control chip to start post-processing the single image data. In other words, after the image processing chip transmits the i-th image data in the dynamic memory to the main control chip, it sends an interrupt signal to the main control chip to indicate to the main control chip that the i-th image data has been written into the DDR of the main control chip, and the main control chip can read the data and perform post-processing on the i-th image data.

[0067] Step 206: The main control chip performs post-processing on the first image data according to the interrupt signal to obtain the processed data.

[0068] It should be pointed out that after the image processing chip transfers the i-th image data in the dynamic memory to the main control chip, if the image processing chip does not send an interrupt signal to the main control chip, the main control chip can only start post-processing after receiving the M image data corresponding to the M image slices, and the synchronous processing of the image processing chip and the main control chip cannot be achieved. In other words, by sending a final interrupt signal to the main control chip, the image processing chip can enable the main control chip to treat the image data corresponding to each image slice as a frame of image data and start post-processing the image data corresponding to a single image slice. Under normal circumstances, the main control chip can start post-processing only after receiving the image data corresponding to all image slices. Therefore, the image processing chip notifies the main control chip through the interrupt signal in advance, so that the main control chip and the image processing chip can perform image processing on the first image in parallel.

[0069] Optionally, the post-processing performed by the main control chip includes at least one of the following: noise reduction processing of back-end image signal processing (Image Signal Processing, ISP), YUV domain algorithms, such as beauty, etc.

[0070] Step 207: After acquiring the M processed data corresponding to the M image slices, obtain a captured image corresponding to the first image according to the M processed data.

[0071] For example, the main control chip obtains a photo in JPEG format corresponding to the first image according to the M processing data.

[0072] In some optional embodiments, the step of transmitting the i-th image data in the dynamic memory to a main control chip includes:

[0073] generating a first data frame corresponding to the first image data according to the first image data, the first image and metadata corresponding to the first image;

[0074] The first data frame is transmitted to the main control chip.

[0075] Example 2: Reference Figure 3 The present application provides an image processing method comprising the following steps:

[0076] Step 301: upon receiving a shooting instruction, the image processing chip acquires a first image captured by an image sensor.

[0077] Step 302: The image processing chip divides the first image into M image slices, where M is an integer greater than or equal to 2.

[0078] For example, if the first image in RAW format is divided into 10 image slices, taking the size of the first image as 4000×3000 as an example, the size of each image slice is 4000×300.

[0079] Step 303: Perform the following processing on the M image slices in sequence: perform image processing on the first image slice to obtain first image data, and package the first image data, the first image and the metadata corresponding to the first image to generate a first data frame; transmit the first data frame to the main control chip; wherein the first image slice is any one of the M image slices.

[0080] It can be understood that the first image slice refers to any one of the 1st image slice to the Mth image slice.

[0081] In a specific implementation, after obtaining the i-th image data corresponding to the i-th image slice, the i-th image data is stored in a dynamic memory; after taking out the i-th image data in the dynamic memory, and packaging the i-th image data, the first image and the metadata corresponding to the first image to generate the i-th data frame; the i-th data frame is transmitted to the main control chip; further, image processing is performed on the i+1-th image slice, and the i+1-th image data, the first image and the metadata corresponding to the first image are packaged to generate the i+1-th data frame; and so on, until M image slices are processed and transmitted; i belongs to 1 to M-1, and i is an integer.

[0082] In specific implementation, the i-th data frame is transmitted back to the main control chip through the MIPI interface, and the i-th data frame is saved in the memory of the main control chip.

[0083] It should be noted that, since one data frame contains RGB format image data of a single image slice, a first image in RAW format and corresponding metadata, the RAW format image and metadata need to be repeatedly transmitted M times.

[0084] Step 304: the main control chip receives the first data frame, and obtains first image data according to the first data frame; and post-processes the first image data to obtain processed data;

[0085] It should be noted that since each data frame is a frame of data and has a default notification mechanism, the image processing chip does not need to send an interrupt signal. After receiving the i-th data frame, the main control chip will start post-processing the i-th image data. Since this embodiment does not need to send an interrupt signal, it can save general-purpose input / output (GPIO) hardware resources.

[0086] Step 305: After acquiring the M processing data corresponding to the M image slices, the main control chip obtains a captured image corresponding to the first image according to the M processing data.

[0087] For example, the main control chip performs post-processing according to the M processing data to obtain a JPEG format photo corresponding to the first image. Optionally, the post-processing performed by the main control chip includes at least one of the following: noise reduction processing of the back-end ISP, YUV domain algorithm, such as beauty, etc.

[0088] like Figure 4 As shown, the embodiment of the present application also provides an image processing method, which is applied to a main control chip and includes the following steps:

[0089] Step 401: Receive first image data sent by an image processing chip; wherein the first image data is obtained after image processing of a first image slice, the first image slice is any one of M image slices, the M image slices are obtained by segmenting the first image, the first image is acquired by an image sensor upon receiving a shooting instruction, and M is an integer greater than or equal to 2.

[0090] In specific implementation, the main control chip sequentially receives the image data corresponding to each image slice sent by the image processing chip. For example, it first receives the i-th image data corresponding to the i-th image slice, and then receives the i+1-th image data corresponding to the i+1-th image slice.

[0091] Optionally, each of the image slices includes P rows of pixels, and the first image includes M×P rows of pixels.

[0092] Step 402: Post-process the first image data to obtain processed data.

[0093] In a specific implementation, after receiving the i-th image data corresponding to the i-th image slice sent by the image processing chip, the main control chip starts post-processing the i-th image data; thereafter, the main control chip receives the i+1-th image data corresponding to the i+1-th image slice sent by the image processing chip, and starts post-processing the i+1-th image data; and so on, until M processing data corresponding to the M image slices are received.

[0094] Optionally, the post-processing performed by the main control chip includes at least one of the following: noise reduction processing of the back-end ISP, YUV domain algorithms such as beauty, etc.

[0095] Step 403: after acquiring the M processing data corresponding to the M image slices, obtaining a captured image corresponding to the first image according to the M processing data.

[0096] In the above embodiment, after the main control chip receives the image data corresponding to an image slice, it can post-process the image data corresponding to the image slice to obtain a processed data; after obtaining the M processed data corresponding to the M image slices, the captured image corresponding to the first image is obtained according to the M processed data. In this way, the main control chip can post-process the first image in advance, and the image processing chip and the main control chip can execute their respective corresponding image processing algorithms on the first image in parallel, thereby improving the image processing efficiency and shooting performance.

[0097] In some optional embodiments, post-processing the first image data to obtain processed data includes:

[0098] After acquiring the first image data corresponding to the first image slice, receiving an interrupt signal sent by the image processing chip, wherein the interrupt signal is used to instruct post-processing of the first image data;

[0099] According to the interrupt signal, the first image data is post-processed to obtain the processed data. Optionally, before receiving the first image data sent by the image processing chip, the method further includes:

[0100] Receive a first image and metadata corresponding to the first image sent by an image processing chip; wherein the metadata includes at least one of the following: embedded data, depth data of the image, motion vector of the image, etc., the embedded data is additional information related to the image, the depth data is used to indicate the distance between an object in a scene and a camera, and the motion vector data is used to describe the movement direction and speed of an object in the image.

[0101] For detailed explanation of this embodiment, please refer to the introduction of Example 1 above, which will not be described again here to avoid repetition.

[0102] In some optional embodiments, the receiving first image data sent by the image processing chip includes:

[0103] receiving a first data frame sent by the image processing chip; wherein the first data frame is generated according to the first image data, the first image and metadata corresponding to the first image;

[0104] The post-processing of the first image data to obtain processed data includes:

[0105] obtaining, according to the first data frame, the first image data, the first image, and metadata corresponding to the first image;

[0106] The first image data is post-processed to obtain the processed data. For the explanation of this embodiment, please refer to the introduction of the above-mentioned Example 2, which will not be described here to avoid repetition.

[0107] like Figure 5 As shown, an embodiment of the present application further provides an image processing circuit, comprising a main control chip and an image processing chip, wherein the main control chip is connected to the image processing chip;

[0108] The image processing chip is used to obtain a first image captured by an image sensor when receiving a shooting instruction; divide the first image into M image slices, where M is an integer greater than or equal to 2; and sequentially perform the following processing on the M image slices: perform image processing on the first image slice to obtain first image data, and transmit the first image data to the main control chip for processing; wherein the first image slice is any one of the M image slices;

[0109] The main control chip is used to receive the first image data sent by the image processing chip; post-process the first image data to obtain processed data; after obtaining the M processed data corresponding to the M image slices, obtain the captured image corresponding to the first image according to the M processed data.

[0110] In the above embodiment, upon receiving a shooting instruction, the image processing chip obtains a first image captured by the image sensor; by dividing the first image into M image slices, image processing can be performed on each of the M image slices in turn, so that after each image slice is processed, image data of the image slice obtained by image processing is sent to the main control chip, so that the main control chip can post-process the first image in advance, and the image processing chip and the main control chip can execute their respective corresponding image processing algorithms on the first image in parallel, thereby improving image processing efficiency and shooting performance.

[0111] In some optional embodiments, the image processing chip is further used for:

[0112] performing image processing on the first image slice to obtain first image data corresponding to the first image slice;

[0113] storing the first image data in a dynamic memory;

[0114] The first image data in the dynamic memory is taken out and transmitted to the main control chip.

[0115] The DDR in the image processing chip in this embodiment stores only the image data corresponding to one image slice at a time, and does not need to store the image data corresponding to the complete image of the first image, thereby reducing the space occupied by the DDR in the image processing chip.

[0116] In some optional embodiments, the image processing chip is further used to, after acquiring the first image captured by the image sensor, send the first image and metadata corresponding to the first image to the main control chip; after transmitting the first image data to the main control chip for processing, send an interrupt signal to the main control chip, wherein the interrupt signal is used to instruct post-processing of the first image data;

[0117] The main control chip is also used to receive the first image and metadata corresponding to the first image sent by the image processing chip, and after acquiring the first image data, receive an interrupt signal sent by the image processing chip, the interrupt signal is used to indicate post-processing of the first image data; according to the interrupt signal, the first image data is post-processed to obtain the processed data. Optionally, the metadata includes at least one of the following: embedded data, image depth data, image motion vector, etc., embedded data is additional information related to the image, depth data is used to indicate the distance between the object in the scene and the camera, and motion vector data is used to describe the movement direction and speed of the object in the image.

[0118] The detailed explanation of this embodiment can be found in the introduction of the above-mentioned Example 1, which will not be described again here to avoid repetition.

[0119] In some optional embodiments, the image processing chip is specifically configured to generate a first data frame according to the first image data, the first image and metadata corresponding to the first image; and transmit the first data frame to the main control chip;

[0120] The main control chip is specifically used to receive the first data frame sent by the image processing chip; obtain the first image data, the first image and metadata corresponding to the first image according to the first data frame; and post-process the first image data to obtain the processed data.

[0121] The detailed explanation of this embodiment can be found in the introduction of the above-mentioned Example 2, which will not be described again here to avoid repetition.

[0122] In some optional embodiments, each of the image slices includes P rows of pixels, and the first image includes M×P rows of pixels.

[0123] In some optional embodiments, the present application also provides an electronic device, including the image processing circuit as described above.

[0124] like Figure 6 As shown, the electronic device 600 includes the image processing circuit, image sensor 603 and memory 602 as described above, the image processing circuit includes a main control chip 601 and an image processing chip 604, the main control chip 601 includes a processor 6011; the memory 602 stores programs or instructions that can be run on the processor 6011, and when the program or instruction is executed by the processor 6011, the various steps of the above-mentioned image processing method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0125] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

[0126] Figure 7 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0127] The electronic device 700 includes but is not limited to: a radio frequency unit 701, a network module 702, an audio output unit 703, an input unit 704, an image sensor 705, a display unit 706, a user input unit 707, an interface unit 708, a memory 709, a main control chip 710, an image processing chip 711 and other components.

[0128] Those skilled in the art will appreciate that the electronic device 700 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the main control chip 710 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Figure 7 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0129] The image processing chip 711 is used to obtain a first image captured by an image sensor when receiving a shooting instruction; divide the first image into M image slices, where M is an integer greater than or equal to 2; and sequentially perform the following processing on the M image slices: perform image processing on the first image slice to obtain first image data, and transmit the first image data to the main control chip; wherein the first image slice is any one of the M image slices;

[0130] The main control chip 710 is used to receive the first image data sent by the image processing chip; post-process the first image data to obtain processed data; after obtaining the M processed data corresponding to the M image slices, obtain the captured image corresponding to the first image according to the M processed data.

[0131] Optionally, the image processing chip 711 is further configured to perform image processing on the first image slice to obtain first image data corresponding to the first image slice;

[0132] storing the first image data in a dynamic memory;

[0133] The first image data in the dynamic memory is taken out and transmitted to the main control chip.

[0134] Optionally, the image processing chip 711 is further configured to, after acquiring a first image captured by the image sensor, send the first image and metadata corresponding to the first image to the main control chip; after transmitting the first image data to the main control chip for processing, send an interrupt signal to the main control chip, wherein the interrupt signal is used to instruct post-processing of the first image data;

[0135] The main control chip 710 is also used to receive the first image and metadata corresponding to the first image sent by the image processing chip, and after acquiring the first image data, receive an interrupt signal sent by the image processing chip, wherein the interrupt signal is used to indicate post-processing of the first image data; according to the interrupt signal, the first image data is post-processed to obtain the processed data.

[0136] Optionally, the image processing chip 711 is specifically configured to generate a first data frame according to the first image data, the first image and metadata corresponding to the first image; and transmit the first data frame to the main control chip;

[0137] The main control chip 710 specifically receives the first data frame sent by the image processing chip; decodes the first data frame to obtain the first image data, the first image and metadata corresponding to the first image; and post-processes the first image data to obtain the processed data.

[0138] Optionally, each of the image slices includes P rows of pixels, and the first image includes M×P rows of pixels.

[0139] It should be understood that in the embodiment of the present application, the input unit 704 may include a graphics processor (Graphics Processing Unit, GPU) 7041 and a microphone 7042, and the graphics processor 7041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 706 may include a display panel 7061, and the display panel 7061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 707 includes a touch panel 7071 and at least one of other input devices 7072. The touch panel 7071 is also called a touch screen. The touch panel 7071 may include two parts: a touch detection device and a touch controller. Other input devices 7072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0140] The memory 709 can be used to store software programs and various data. The memory 709 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 709 may include a volatile memory or a non-volatile memory, or the memory 709 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 709 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0141] The main control chip 710 may include one or more processing units; optionally, the main control chip 710 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to the operating system, user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the above-mentioned modem processor may not be integrated into the main control chip 710.

[0142] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned image processing method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0143] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0144] An embodiment of the present application further provides an image processing chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned image processing method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0145] An embodiment of the present application further provides a main control chip, which includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned image processing method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0146] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0147] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned image processing method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0148] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0149] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0150] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. An image processing method, characterized in that: Applied to image processing chips, including: When receiving a shooting instruction, acquiring a first image captured by an image sensor; Dividing the first image into M image slices, where M is an integer greater than or equal to 2; The following processing is performed on the M image slices in sequence: image processing is performed on the first image slice to obtain first image data, and the first image data is transmitted to the main control chip; wherein the first image slice is any one of the M image slices.

2. The image processing method according to claim 1, characterized in that: The step of performing image processing on the first image slice to obtain first image data, and transmitting the first image data to the main control chip includes: performing image processing on the first image slice to obtain first image data corresponding to the first image slice; storing the first image data in a dynamic memory; The first image data in the dynamic memory is taken out and transmitted to the main control chip.

3. The image processing method according to claim 1, characterized in that: After acquiring the first image captured by the image sensor, the method further includes: Sending the first image and metadata corresponding to the first image to the main control chip; After transmitting the first image data to the main control chip, the method further includes: An interrupt signal is sent to the main control chip, where the interrupt signal is used to instruct post-processing of the first image data.

4. The image processing method according to claim 1, characterized in that: The transmitting the image data to the main control chip for processing includes: generating a first data frame corresponding to the first image data according to the first image data, the first image and metadata corresponding to the first image; The first data frame is transmitted to the main control chip.

5. The image processing method according to claim 1, characterized in that: Each of the image slices includes P rows of pixels, the first image includes M×P pixel rows, and P is a positive integer.

6. An image processing method, characterized in that: Applied to main control chips, including: Receive first image data sent by an image processing chip; wherein the first image data is obtained after image processing is performed on a first image slice, the first image slice is any one of M image slices, the M image slices are obtained by segmenting the first image, the first image is acquired by an image sensor when a shooting instruction is received, and M is an integer greater than or equal to 2; Post-processing the first image data to obtain processed data; After the M processing data corresponding to the M image slices are acquired, a captured image corresponding to the first image is obtained according to the M processing data.

7. The image processing method according to claim 6, characterized in that: The post-processing of the first image data to obtain processed data includes: After acquiring the first image data corresponding to the first image slice, receiving an interrupt signal sent by the image processing chip, wherein the interrupt signal is used to instruct post-processing of the first image data; The first image data is post-processed according to the interrupt signal to obtain the processed data.

8. The image processing method according to claim 7, characterized in that: The method further comprises: The first image and metadata corresponding to the first image sent by the image processing chip are received.

9. The image processing method according to claim 6, characterized in that: The receiving first image data sent by the image processing chip includes: receiving a first data frame sent by the image processing chip; wherein the first data frame is generated according to the first image data, the first image and metadata corresponding to the first image; The post-processing of the first image data to obtain processed data includes: obtaining, according to the first data frame, the first image data, the first image, and metadata corresponding to the first image; The first image data is post-processed to obtain the processed data.

10. The image processing method according to claim 6, characterized in that: Each of the image slices includes P rows of pixels, the first image includes M×P pixel rows, and P is a positive integer.

11. An image processing circuit, characterized in that: It includes a main control chip and an image processing chip, wherein the main control chip is connected to the image processing chip; The image processing chip is used to obtain a first image captured by an image sensor when receiving a shooting instruction; divide the first image into M image slices, where M is an integer greater than or equal to 2; and sequentially perform the following processing on the M image slices: perform image processing on the first image slice to obtain first image data, and transmit the first image data to the main control chip for processing; wherein the first image slice is any one of the M image slices; The main control chip is used to receive the first image data sent by the image processing chip; post-process the first image data to obtain processed data; after obtaining the M processed data corresponding to the M image slices, obtain the captured image corresponding to the first image according to the M processed data.

12. The image processing circuit according to claim 11, characterized in that: The image processing chip is also used for: performing image processing on the first image slice to obtain first image data corresponding to the first image slice; storing the first image data in a dynamic memory; The first image data in the dynamic memory is taken out and transmitted to the main control chip.

13. The image processing circuit according to claim 11, characterized in that: The image processing chip is further configured to, after acquiring a first image captured by the image sensor, send the first image and metadata corresponding to the first image to the main control chip; after transmitting the first image data to the main control chip for processing, send an interrupt signal to the main control chip, wherein the interrupt signal is used to instruct post-processing of the first image data; The main control chip is also used to receive the first image and metadata corresponding to the first image sent by the image processing chip, and after acquiring the first image data, receive an interrupt signal sent by the image processing chip, wherein the interrupt signal is used to indicate post-processing of the first image data; according to the interrupt signal, the first image data is post-processed to obtain the processed data.

14. The image processing circuit according to claim 11, characterized in that: The image processing chip is specifically configured to generate a first data frame according to the first image data, the first image and metadata corresponding to the first image; and transmit the first data frame to the main control chip; The main control chip is specifically used to receive the first data frame sent by the image processing chip; obtain the first image data, the first image and metadata corresponding to the first image according to the first data frame; and post-process the first image data to obtain the processed data.

15. The image processing circuit according to claim 11, characterized in that: Each of the image slices includes P rows of pixels, the first image includes M×P pixel rows, and P is a positive integer.

16. An electronic device, characterized in that: The method comprises the image processing circuit as claimed in any one of claims 11 to 15.

17. An image processing chip, characterized in that: The image processing chip includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the steps of the image processing method according to any one of claims 1 to 5.

18. A main control chip, characterized in that: The main control chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the steps of the image processing method according to any one of claims 6 to 10.

19. A readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by a processor, the steps of the image processing method according to any one of claims 1 to 5, or the steps of the image processing method according to any one of claims 6 to 10 are implemented.

Images