Image processing method, electronic device, readable storage medium, and program product

Abstract

The application discloses an image processing method, an electronic device, a readable storage medium and a program product, and belongs to the technical field of image processing. The image processing method comprises the following steps: in the case that a main control chip acquires a to-be-processed image, m first cropped images are obtained by cropping the to-be-processed image, and adjacent two first cropped images have common pixel content; the m first cropped images are transmitted to corresponding m independent display chips based on the main control chip; image processing is performed on the received first cropped images based on the m independent display chips, and corresponding target images are obtained; common pixel content in the corresponding target images is cropped based on the m independent display chips, and m second cropped images are obtained, and any two adjacent second cropped images do not have common pixel content; and the cropped second cropped images are transmitted to corresponding display units for display based on the m independent display chips.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of image processing, in particular to an image processing method, an electronic device, a readable storage medium and a program product. BACKGROUND

[0002] In the related art, independent display chips are widely used in personal computers. As external dedicated image processing units, they can bring higher frame rate, higher resolution, color saturation, contrast and other display enhancement effects. With the outbreak of mobile Internet, game and image demands have gradually expanded to mobile intelligent terminals, and independent display chips have also been applied to mobile intelligent terminals. However, when a mobile intelligent terminal has two or more display driver integrated circuits (DDICs), processing based on independent display chips has the problem of poor image processing effect. SUMMARY

[0003] The present application provides an image processing method, an electronic device, a readable storage medium and a program product, which can improve the image processing effect.

[0004] In a first aspect, an image processing method is provided, which is applied to an electronic device. The electronic device includes a master control chip, m independent display chips and m display units. The m display units are spliced to form a display module. The m independent display chips correspond to the m display units one by one. The m is an integer greater than 1. The method includes:

[0005] In the case that the master control chip obtains a to-be-processed image, m first cropped images are obtained by cropping the to-be-processed image. The m first cropped images correspond to the m independent display chips one by one, and in the m first cropped images, two first cropped images adjacent in image have common pixel content overlapped in image.

[0006] The m first cropped images are transmitted to the corresponding m independent display chips based on the master control chip.

[0007] The m independent display chips perform image processing on the received first cropped images to obtain corresponding target images.

[0008] The m independent display chips crop the common pixel content in the corresponding target images to obtain m second cropped images. The m second cropped images can be spliced to form image content corresponding to the to-be-processed image. In the m second cropped images, any two second cropped images adjacent in image do not have common pixel content overlapped in image.

[0009] transmit the second cropped image to a corresponding display unit for display.

[0010] In a second aspect, an electronic device is provided, which includes a master control chip, m independent display chips, and m display units. The m display units are spliced to form a display module. The m independent display chips correspond to the m display units one-to-one. The master control chip is connected with the m display units through the m independent display chips. The m is an integer greater than 1.

[0011] The master control chip is configured to, in a case where a to-be-processed image is acquired, crop the to-be-processed image to obtain m first cropped images. The m first cropped images correspond to the m independent display chips one-to-one. In the m first cropped images, two first cropped images adjacent in image have common pixel content overlapped in image.

[0012] The master control chip is further configured to transmit the m first cropped images to the corresponding m independent display chips, respectively.

[0013] The independent display chip is configured to perform image processing on the received first cropped image to obtain a corresponding target image.

[0014] The independent display chip is further configured to crop the common pixel content in the corresponding target image to obtain m second cropped images. The m second cropped images can be spliced to form image content corresponding to the to-be-processed image. In the m second cropped images, any two second cropped images adjacent in image do not have common pixel content overlapped in image.

[0015] The independent display chip is further configured to transmit the second cropped image to a corresponding display unit for display.

[0016] In a third aspect, an electronic device is provided, which includes a processor and a memory. The memory stores programs or instructions executable on the processor. When the programs or instructions are executed by the processor, the steps of the method according to the first aspect are implemented.

[0017] In a fourth aspect, a readable storage medium is provided. The readable storage medium stores programs or instructions. When the programs or instructions are executed by a processor, the steps of the method according to the first aspect are implemented.

[0018] In a fifth aspect, a chip is provided. The chip includes a processor and a communication interface. The communication interface is coupled with the processor. The processor is configured to run programs or instructions to implement the steps of the method according to the first aspect.

[0019] In a sixth aspect, an embodiment of the present application provides a computer program product stored in a storage medium, and the computer program product is executed by at least one processor to implement the steps of the method of the first aspect.

[0020] In the embodiment of the present application, by setting an independent display chip for each display unit, the images to be displayed of each display unit in the screen can be processed by the corresponding independent display chip, so as to improve the image quality. Meanwhile, by making the two first cropped images adjacent to each other have image overlapping public pixel content, and cropping the public pixel content after the independent display chip processes the first cropped image, so as to improve the image quality at the joint of the two adjacent display units, thereby improving the image processing effect. BRIEF DESCRIPTION OF DRAWINGS

[0021] Figure 1 is one of the flowcharts of the image processing method provided by the embodiment of the present application;

[0022] Figure 2 is another flowchart of the image processing method provided by the embodiment of the present application;

[0023] Figure 3 is a third flowchart of the image processing method provided by the embodiment of the present application;

[0024] Figure 4 is a schematic diagram of cropping the image to be processed when m is equal to 2 in the embodiment of the present application;

[0025] Figure 5 is a schematic diagram of cropping the image to be processed when m is equal to 3 in the embodiment of the present application;

[0026] Figure 6 is a schematic diagram of the two second cropped images obtained by cropping in the embodiment of the present application;

[0027] Figure 7 is a schematic diagram obtained by cropping the image to be processed based on the method in the related art;

[0028] Figure 8 is a schematic diagram of the image convolution processing in the embodiment of the present application;

[0029] Figure 9 is a schematic diagram of the pixel padding of the image in the embodiment of the present application; Figure 2

[0030] Figure 10 is a schematic diagram of the structure of the electronic device provided by the embodiment of the present application;

[0031] ​Figure 11 The embodiment of the present application provides a hardware structure schematic diagram of an electronic device. DETAILED DESCRIPTION

[0032] The technical solutions in the embodiments of the present application will be clearly described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, but not all the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art belong to the scope of protection of the present application.

[0033] The terms "first", "second", and the like in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than that illustrated or described herein, and the objects distinguished by "first", "second", etc. are usually a category and do not limit the number of objects, for example, the first object can be one or more. In addition, "and / or" in the specification and claims indicates at least one of the connected objects, and the character " / ", generally indicates that the front and rear associated objects are in a "or" relationship.

[0034] The image processing method, the electronic device, the readable storage medium and the program product provided by the embodiments of the present application will be described in detail below with reference to the drawings and specific embodiments and their application scenarios.

[0035] Please refer to Figure 1 , Figure 1 A flowchart of an image processing method provided by the embodiments of the present application is shown, the image processing method is applied to an electronic device, the electronic device includes a master control chip, m independent display chips and m display units, the m display units are spliced to form a display module, the m independent display chips correspond to the m display units one by one, m is an integer greater than 1, and the method includes the following steps:

[0036] Step 101, in the case that the master control chip acquires a to-be-processed image, m first cropped images are obtained by cropping the to-be-processed image, wherein the m first cropped images correspond to the m independent display chips one by one, and adjacent two first cropped images in the m first cropped images have image overlapping public pixel content;

[0037] Step 102, based on the master control chip, the m first cropped images are transmitted to the corresponding m independent display chips respectively;

[0038] Step 103, based on the m independent display chips, image processing is performed on the received first cropped images to obtain corresponding target images.

[0039] Step 104, cropping the common pixel content in the corresponding target image based on the m independent display chips to obtain m second cropped images, wherein the m second cropped images can be spliced to form the image content corresponding to the to-be-processed image, and in the m second cropped images, any two second cropped images adjacent in image do not have common pixel content of image overlap;

[0040] Step 105, transmitting the second cropped image after cropping to the corresponding display unit based on the m independent display chips for display.

[0041] The above-mentioned main control chip can be a system on chip (SoC) or an application processor (AP) and the like.

[0042] The above-mentioned electronic device can be various types of electronic devices, for example, can be a mobile phone, a tablet computer, a vehicle-mounted terminal and the like.

[0043] The above-mentioned main control chip can be connected with the m display units through the m independent display chips. Specifically, the main control chip can include m display serial interfaces (DSIs) corresponding to the m independent display chips one by one. The independent display chip can include one DSI RX interface and one DSI TX interface. The display unit includes one DDIC. In the m DSI interfaces of the main control chip, each DSI interface is connected with the DSI RX interface of the corresponding independent display chip. The DSI TX interface of the independent display chip is connected with the DDIC of the corresponding display unit. For example, please refer to Figure 2 , the value of m is 2, the main control chip is an SoC, the SoC includes two DSI interfaces DSI0 and DSI1, the DSI0 interface of the SoC is connected with the DSI RX0 interface of the independent display chip 1, and the DSI TX0 interface of the independent display chip 1 is connected with the DDIC1 of the corresponding display unit 1. The DSI1 interface of the SoC is connected with the DSI RX0 interface of the independent display chip 2, and the DSI TX0 interface of the independent display chip 2 is connected with the DDIC2 of the corresponding display unit 2. For another example, please refer to Figure 3, the m is 3, the master chip is SoC, the SoC includes three DSI interfaces of DSI0, DSI1 and DSI2, the DSI0 interface of the SoC is connected with the DSI RX0 interface of the independent display chip 1, the DSI TX0 interface of the independent display chip 1 is connected with the DDIC1 of the corresponding display unit 1; the DSI1 interface of the SoC is connected with the DSI RX0 interface of the independent display chip 2, the DSI TX0 interface of the independent display chip 2 is connected with the DDIC2 of the corresponding display unit 2. The DSI2 interface of the SoC is connected with the DSI RX0 interface of the independent display chip 3, and the DSI TX0 interface of the independent display chip 3 is connected with the DDIC3 of the corresponding display unit 3.

[0044] The to-be-processed image can be to-be-processed image data in various scenes, for example, can be a game picture in a game scene, or a video picture in a video playing scene, or a shooting image in a shooting scene, and the like.

[0045] In the related art, since the independent display chip only has one set of display interface (DSI RX0 and DSI TX0), it cannot be connected with two or more DDICs at the same time, and therefore, when the electronic device has two or more DDICs, the image cannot be processed based on the independent display chip. Based on this, in the embodiments of the present application, m independent display chips are arranged to ensure that each display unit has a corresponding independent display chip, so that the to-be-displayed image of each display unit can be processed based on the m independent display chips. In addition, since the image needs to be segmented before being processed based on the m independent display chips, different independent display chips process different regions of the to-be-displayed image, and the processed image is transmitted to the corresponding display unit, so that the content displayed by the m display units can be spliced to form a complete image.

[0046] However, the super-resolution function of the independent display chip generally uses a convolutional neural network algorithm, and a certain range of pixel data around a pixel point needs to be referred to when performing convolution operation. If two independent display chips respectively receive two half-screen images, the pixels at the junction of the two half-screens will lack pixels in the direction of the other half-screen as a reference, resulting in a phenomenon that the image junction is not smooth when the super-resolved local images are spliced together. Based on this, in the embodiments of the present application, when the DSI interfaces of the main control chip send local image data, some pixel data is sent at the image junction. After the independent display chip completes the super-resolution operation on the received local image data, the image data sent by the SoC is cropped and then transmitted to the DDIC of the display unit. Since the pixel data at the image junction is used for convolution operation reference, the super-resolution effect of each independent display chip at the image junction can be seamlessly connected, avoiding effect jump. It can be understood that the first cropped image in the embodiments of the present application is the local image data sent by the DSI interface of the main control chip.

[0047] It can be understood that, in the m first cropped images, any two first cropped images adjacent to each other have common pixel content of image overlap, and the common pixel content in any two first cropped images corresponds to the image of the same region in the to-be-processed image. For example, referring to Figure 4 When the m is equal to 2, Figure 4 The left image and the right image in the above formula can be respectively taken as two first cropped images, wherein the range of the image content of the left first cropped image is from the left boundary line of the left image to the right boundary line of the common pixel content, i.e., from the left boundary line of the left image to the position of the straight line a. The range of the image content of the right first cropped image is from the right boundary line of the right image to the left boundary line of the common pixel content, i.e., from the right boundary line of the right image to the position of the straight line b. Figure 4 It can be seen that the junction of the two first cropped images has an overlapping part, which is the common pixel content of the two first cropped images.

[0048] For another example, referring to Figure 5 When the m is equal to 3, Figure 5The left image, the middle image and the right image in the image can be respectively taken as three first cropped images. The range of the image content of the first cropped image on the left side is from the left boundary line of the left image to the right boundary line of the first common pixel content, i.e. from the left boundary line of the left image to the position of the straight line d. The range of the image content of the first cropped image in the middle is from the left boundary line of the first common pixel content to the right boundary line of the second common pixel content, i.e. from the straight line c to the position of the straight line f. The range of the image content of the first cropped image on the right side is from the right boundary line of the right image to the left boundary line of the second common pixel content, i.e. from the right boundary line of the right image to the position of the straight line e. It can be seen that the first cropped image on the left side has an overlapping part with the left side of the first cropped image in the middle, which is the first common pixel content in the image. Figure 5 It can be seen that the first cropped image on the left side has an overlapping part with the left side of the first cropped image in the middle, which is the first common pixel content in the image. Figure 5 The first cropped image on the right side has an overlapping part with the right side of the first cropped image in the middle, which is the second common pixel content in the image. Figure 5 The first cropped image on the right side has an overlapping part with the right side of the first cropped image in the middle, which is the second common pixel content in the image.

[0049] The image processing can be image enhancement processing of the image based on various image processing modes. In some embodiments of the present application, the image processing can include convolution operation of different convolution kernels and the original image to achieve different effects, for example, the effects can include edge sharpening, mean blur, etc.

[0050] It can be understood that, since the two first cropped images adjacent to each other in the image have the common pixel content of image overlap, before the m first cropped images are cropped from the to-be-processed image, m same to-be-processed images can be generated, and then one first cropped image can be cropped from each to-be-processed image. In addition, in some embodiments, only two same to-be-processed images can be generated, and then one first cropped image can be cropped from each to-be-processed image after one first cropped image is cropped each time, and then one first cropped image is cropped again. In this way, according to the cropping of the two to-be-processed images, the m first cropped images can also be obtained. In addition, the number of the same to-be-processed images generated in the cropping process can also be between 2 and m, as long as the m first cropped images can be cropped, and the specific cropping mode is not limited in the embodiments of the present application.

[0051] Before the above-mentioned cropping of the common pixel content in the target image to obtain the m second cropped images, the cropping position can be determined in advance to ensure that after cropping, the two second cropped images adjacent to each other in the image can splice a complete image corresponding to the common pixel content. For example, the two adjacent target images can each reserve half of the common pixel content, or one of the two target images reserves 1 / 3 of the common pixel content and the other target image reserves 2 / 3 of the common pixel content, etc.

[0052] The m second cropped images can be spliced to form the image content corresponding to the to-be-processed image. Specifically, the image obtained after splicing the m second cropped images can include all image elements in the to-be-processed image, that is, the entity objects in the to-be-processed image. For example, when the to-be-processed image includes image content of a person, a tree, the sky, and grassland, the image elements in the to-be-processed image can include a person, a tree, the sky, and grassland. The difference between the image obtained after splicing the m second cropped images and the to-be-processed image is that the image quality of the image obtained after splicing the m second cropped images is different from that of the to-be-processed image. Since the image obtained after splicing the m second cropped images can be regarded as an image obtained after the above-mentioned image processing of the to-be-processed image, the image quality of the image obtained after splicing the m second cropped images is usually higher than that of the to-be-processed image, for example, the image definition of the image obtained after splicing the m second cropped images can be higher than that of the to-be-processed image.

[0053] In this embodiment, by arranging an independent display chip for each display unit, the to-be-displayed image of each display unit in the screen can be processed by the corresponding independent display chip to improve the image quality. Meanwhile, by arranging the two first cropped images adjacent to each other to have the common pixel content, and cropping the common pixel content after the independent display chip processes the first cropped image, it is beneficial to improve the image quality at the splicing position of the two adjacent display units, thereby improving the image processing effect.

[0054] Optionally, the cropping of the common pixel content in the target image based on the m independent display chips to obtain the m second cropped images comprises:

[0055] The target independent display chip crops the common pixel content in the target image along the center line of the image corresponding to the common pixel content to obtain the corresponding second cropped image, wherein the target independent display chip is any one of the m independent display chips.

[0056] The center line can be a boundary line between two adjacent display units of the image before the image to be processed is cropped, so that the cropping line can form a boundary line between the two second cropped images after cropping. For example, refer to Figure 4 When m is equal to 2, the target image can be cropped along the vertical center line of the overlapping part of the two target images to remove the redundant part of the target image. Refer to Figure 6 The two second cropped images obtained after the image in the embodiment is cropped along the vertical center line. Figure 4 The schematic diagram of the two second cropped images obtained after the image in the embodiment is cropped along the vertical center line. Figure 6 In the embodiment, the second cropped image 1 is a second cropped image obtained by cropping the target image corresponding to the left image in Figure 4 In the embodiment, the second cropped image 2 is a second cropped image obtained by cropping the target image corresponding to the right image in Figure 4 In the embodiment, the second cropped image 2 is a second cropped image obtained by cropping the target image corresponding to the right image in

[0057] In the embodiment, since the independent display chip can have a poor processing effect on the edge position of the first cropped image, that is, the image processing effect of the target image obtained after processing can be poor, the common pixel content can be cropped along the center line of the image corresponding to the common pixel content, so that each second cropped image can retain half of the picture of the common pixel content, that is, the edge position of each target image corresponding to the image of the common pixel content can be removed, thereby facilitating the adjacent two second cropped images to have a better image processing effect at the boundary.

[0058] Optionally, the image processing based on the m independent display chips to the received first cropped image to obtain the corresponding target image comprises:

[0059] The image convolution processing based on the m independent display chips to the received first cropped image to obtain the corresponding target image, wherein the convolution kernel of the image convolution processing is n×n pixels, the size of the image corresponding to the common pixel content in the direction perpendicular to the center line is greater than or equal to n-1 pixels, and the n is an odd number greater than 1.

[0060] It can be understood that different first cropped images in the m first cropped images are transmitted to different independent processing chips for processing, that is, only one corresponding first cropped image is received by one independent display chip, and one first cropped image is processed.

[0061] Since the image corresponding to the common pixel content has a size greater than or equal to n-1 pixels in the direction perpendicular to the center line, that is, (n-1) / 2 pixels are cropped in the direction perpendicular to the center line during the cropping of the target image, at least (n-1) / 2 pixels of the image are reserved at the junction line of the two adjacent images of the image when the image is cropped, for example, the center line in Figure 4 , Figure 4 is the junction line of the two adjacent images of the image, in order to obtain the first cropped image in the embodiment of the present application, when the first cropped image on the left is generated, the cropping line can be shifted right from the center line by at least (n-1) / 2 pixels, that is, the cropping line is shifted from the center line in Figure 4 to the position indicated by the straight line a in Figure 4 , and the image is cropped along the straight line a to obtain the first cropped image on the left. Correspondingly, when the first cropped image on the right is generated, the cropping line can be shifted left from the center line by at least (n-1) / 2 pixels, that is, the cropping line is shifted from the center line in Figure 4 to the position indicated by the straight line b in Figure 4 , and the image is cropped along the straight line b to obtain the first cropped image on the right. In this way, the image corresponding to the common pixel content has a size greater than or equal to n-1 pixels in the direction perpendicular to the center line, at this time, the two first cropped images have the common pixel content. In the related art, the image is usually cropped along the junction line during the cropping of the image, for example, please refer to Figure 7 , after the image in Figure 4 is cropped based on the method in the related art, the schematic diagram of the two cropped images obtained after the cropping of the image is shown, at this time, there is no common pixel content between the two cropped images.

[0062] Please refer to Figure 8 , the schematic diagram of image convolution processing, wherein the convolution kernel is 3x3, as shown in Figure 8 , the image convolution processing of the pixel at the position shown in Figure 8 is to multiply the domain pixel value of the pixel with the corresponding elements of the filter matrix one by one and then add them up, the specific process is: (4x0)+(0x0)+(0x0)+(0x1)+(0x1)+(0x0)+(0x1)+(-4x2)=-8.

[0063] It can be seen that, for a pixel at a certain position, image convolution processing needs to use (n-1) / 2 pixels around the pixel as a reference. Therefore, in the embodiments of the present application, it can also be ensured that the pixels at the junction of two adjacent images have good image processing effect. When generating the first cropped image, at least (n-1) / 2 pixels are reserved at the junction line, so that when performing image convolution processing on the pixel points at the junction line, there are enough real image pixels as a reference. After image convolution processing, the at least (n-1) / 2 extra pixels are removed by cropping to ensure that the m second cropped images obtained can be complete images and do not include repeated images.

[0064] In some embodiments of the present application, the size of the image corresponding to the common pixel content along the direction perpendicular to the center line is equal to n-1 pixels. In this way, the image processing effect of the pixels at the junction can be ensured, and the number of pixels that need to be processed by the independent display chip is reduced.

[0065] In this implementation, by making the size of the image corresponding to the common pixel content along the direction perpendicular to the center line greater than or equal to n-1 pixels, the independent display chip has better image processing effect on the pixels at the junction in the first cropped image.

[0066] Optionally, the image convolution processing based on the m independent display chips on the received first cropped image to obtain the corresponding target image comprises:

[0067] The target independent display chip performs preprocessing on the received first cropped image to obtain a preprocessed image, wherein the preprocessing comprises: performing pixel padding along the target edge of the first cropped image to the outside of the first cropped image to form a padding image on the outside of the first cropped image, the target edge comprises other edges in the first cropped image except the edges in the image corresponding to the common pixel content, and the distance between the outside edge of the padding image and the target edge is greater than or equal to (n-1) / 2;

[0068] The target independent display chip performs image convolution processing on the preprocessed image to obtain the corresponding target image;

[0069] The target independent display chip crops the common pixel content in the target image along the center line of the image corresponding to the common pixel content in the corresponding target image to obtain the corresponding second cropped image, comprising:

[0070] cropping the common pixel content along a center line of the image corresponding to the common pixel content in the corresponding target image, and cropping the padding image in the target image to obtain a corresponding second cropped image.

[0071] Please refer to Figure 4 When the m is equal to 2, the target edges of the left image include the upper side edge, the lower side edge and the left side edge; the target edges of the right image include the upper side edge, the lower side edge and the right side edge. Please refer to Figure 5 When the m is equal to 3, the target edges of the left image include the upper side edge, the lower side edge and the left side edge; the target edges of the middle image include the upper side edge and the lower side edge; the target edges of the right image include the upper side edge, the lower side edge and the right side edge.

[0072] Specifically, since there is no pixel outside the target edge, and the premise of the convolution processing of the pixel at the target edge is that there are (n-1) / 2 pixels around the target edge, in order to ensure that the pixel at the target edge can also be processed in the process of image convolution processing, pixel padding can be performed outside the target edge to ensure that there are (n-1) / 2 pixels around the target edge. Wherein, the pixel padding outside the target edge of the first cropped image can be random pixel padding, or the pixels of the padding image can be filled with 0.

[0073] In some embodiments of the present application, the distance between the outer side edge of the padding image and the target edge is equal to (n-1) / 2, and the pixels of the padding image are all filled with 0. Please refer to Figure 9 The schematic diagram of the image after pixel padding of the embodiments of the present application is shown in Figure 4 The schematic diagram of the image after pixel padding of the embodiments of the present application is shown in

[0074] The above-mentioned cropping the padding image in the target image specifically refers to: cropping the padding image along the target edge, so as to remove the pixel area filled in the image processing process.

[0075] In this implementation, before the independent display chip performs image convolution processing, pixel is filled outside the target edge to ensure that the pixel at the target edge can be normally processed by image convolution processing in the process of image convolution processing, and after the image convolution processing, the padding image is cropped, so that the effect of image processing at the target edge can be further improved.

[0076] Please refer to Figure 2FIG. 1 is a flowchart of an image processing method provided by some embodiments of the present application, wherein m is equal to 2, the resolution of the image to be processed is 3000x2000, display unit 1 and display unit 2 can respectively display images with a resolution of 1500x2000, at this time, if the value of n is 33, the resolution of the two first cropped images obtained by the SoC after cropping the image to be processed is 1516x2000 and 1516x2000 respectively, so the two first cropped images with a resolution of 1516x2000 can be output by the DSI 0 and DSI 1 of the SoC, and the method comprises the following steps:

[0077] The DSI 0 and DSI 1 of the SoC respectively output two half-screen image data with a resolution of 1516x2000 to the independent display chip 1 and the independent display chip 2. The two half-screen images output by the SoC overlap by 16 pixels on both sides of the middle line.

[0078] The DSI RX0 interface of the independent display chip 1 and the independent display chip 2 respectively receives two half-screen image data with a resolution of 1516x2000 and sends them to the super resolution (SR) module of each for super resolution processing. The super resolution module uses a convolutional neural network algorithm to extract image details by performing convolution operations on the original image.

[0079] After the SR module of the independent display chip 1 and the independent display chip 2 completes the super resolution processing, it sends the image data to the crop module, which crops the 16 extra pixels sent by the SoC to obtain image data with a resolution of 1500x2000.

[0080] The independent display chip 1 and the independent display chip 2 transmit the cropped image to the DDIC1 and the DDIC2 respectively through the DSI TX0, and the DDIC1 and the DDIC2 respectively complete the display driving of the two half-screens.

[0081] Please refer to Figure 3 FIG. 2 is a flowchart of an image processing method provided by some embodiments of the present application, wherein m is equal to 3, the resolution of the image to be processed is 3000x2000, display unit 1, display unit 2 and display unit 3 can respectively display images with a resolution of 1000x2000, at this time, if the value of n is 33, the resolution of the three first cropped images obtained by the SoC after cropping the image to be processed is 1016x2000, 1032x2000 and 1016x2000 respectively, so the three first cropped images can be output by the DSI 0, DSI 1 and DSI 2 of the SoC, and the method comprises the following steps:

[0082] The DSI RX0 modules of the independent display chip 1, the independent display chip 2 and the independent display chip 3 respectively receive image data output by the SoC based on a resolution of 1016*2000, 1032*2000 and 1016*2000, and transmit the received image data to the SR module for super-resolution processing.

[0083] After the SR modules of the independent display chip 1, the independent display chip 2 and the independent display chip 3 complete the super-resolution processing, the image data is sent to the Crop module for cropping processing to obtain image data with a resolution of 1500*2000. The independent display chip 1 and the independent display chip 3 crop 16 pixels that are sent by the SoC, and the independent display chip 2 crops 32 pixels (16 pixels on each side) that are sent by the SoC.

[0084] The independent display chip 1, the independent display chip 2 and the independent display chip 3 transmit the cropped image to the DDIC1, the DDIC2 and the DDIC3 respectively through the DSI TX0, and the DDIC1, the DDIC2 and the DDIC3 complete the display driving of the three parts of the screen respectively.

[0085] Some embodiments of the present application also provide an electronic device, which comprises a master control chip, m independent display chips and m display units, the m display units are spliced to form a display module, the m independent display chips correspond to the m display units one by one, the master control chip is connected with the m display units through the m independent display chips, and m is an integer greater than 1.

[0086] The master control chip is configured to crop the to-be-processed image to obtain m first cropped images in a case where the to-be-processed image is obtained, wherein the m first cropped images correspond to the m independent display chips one by one, and adjacent two first cropped images in the m first cropped images have common pixel content of image overlap.

[0087] The master control chip is further configured to transmit the m first cropped images to the corresponding m independent display chips respectively.

[0088] The independent display chip is configured to perform image processing on the received first cropped image to obtain a corresponding target image.

[0089] The independent display chip is further configured to crop the common pixel content in the corresponding target image to obtain m second cropped images, wherein the m second cropped images can be spliced to form image content corresponding to the to-be-processed image, and any two adjacent second cropped images in the m second cropped images do not have common pixel content of image overlap.

[0090] The independent display chip is further configured to transmit the second cropped image to a corresponding display unit for display.

[0091] Optionally, the target independent display chip is configured to crop the common pixel content in the corresponding target image along a center line of the image corresponding to the common pixel content to obtain a corresponding second cropped image, wherein the target independent display chip is any one of the m independent display chips.

[0092] Optionally, the independent display chip is specifically configured to perform image convolution processing on the received first cropped image to obtain a corresponding target image, a convolution kernel of the image convolution processing is n×n pixels, a size of the image corresponding to the common pixel content in a direction perpendicular to the center line is greater than or equal to n-1 pixels, and n is an odd number greater than 1.

[0093] Optionally, the target independent display chip is specifically configured to perform preprocessing on the received first cropped image to obtain a preprocessed image, wherein the preprocessing includes: performing pixel padding to an outer side of the first cropped image along a target edge of the first cropped image to form a padding image on the outer side of the first cropped image, the target edge includes other edges in the first cropped image except edges in the image corresponding to the common pixel content, and a distance between an outer side edge of the padding image and the target edge is greater than or equal to (n-1) / 2.

[0094] The target independent display chip is specifically further configured to perform image convolution processing on the preprocessed image to obtain a corresponding target image.

[0095] The target independent display chip is specifically further configured to crop the common pixel content in the corresponding target image along a center line of the image corresponding to the common pixel content, and crop the padding image in the target image to obtain a corresponding second cropped image.

[0096] The embodiment is an electronic device corresponding to the above image processing method, the electronic device can implement each process of the above method embodiment, and has the same beneficial effects. To avoid repetition, details are not described herein again.

[0097] In this embodiment, by setting an independent display chip for each display unit, the image to be displayed of each display unit in the screen can be processed by the corresponding independent display chip, so as to improve the image quality. Meanwhile, by making the two first cropped images adjacent to each other have image overlapping public pixel content, and cropping the public pixel content after the independent display chip processes the first cropped image, the image quality at the joint of the two adjacent display units can be improved, so as to improve the image processing effect.

[0098] The electronic device in the embodiments of the present application can be various types of electronic devices, and can also be a component in an electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or can be other devices than a terminal. For example, the electronic device can be a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted electronic device, a Mobile Internet Device (MID), an augmented reality (AR) / virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), and can also be a server, a Network Attached Storage (NAS), a personal computer (PC), a television (TV), a teller machine, or a self-service machine, and the like. The embodiments of the present application are not limited in this regard.

[0099] The electronic device in the embodiments of the present application can be a device with an operating system. The operating system can be an Android operating system, can be an ios operating system, or can be other possible operating systems, and the embodiments of the present application are not limited in this regard.

[0100] The electronic device provided in the embodiments of the present application can implement Figure 1 The processes implemented by the method embodiments are not repeated here to avoid repetition.

[0101] Optionally, as shown in Figure 10 The embodiments of the present application also provide an electronic device 800, which includes a processor 801, a memory 802, a program or instruction stored in the memory 802 and executable on the processor 801. When the program or instruction is executed by the processor 801, the processes of the above image processing method embodiments are implemented, and the same technical effects are achieved. To avoid repetition, the processes are not repeated here.

[0102] It should be noted that the electronic device in the embodiments of the present application includes the mobile electronic device and the non-mobile electronic device described above.

[0103] Figure 11 A hardware structure schematic diagram of an electronic device in an embodiment of the present application.

[0104] The electronic device 900 includes, but is not limited to, a radio frequency unit 901, a network module 902, an audio output unit 903, an input unit 904, a sensor 905, a display unit 906, a user input unit 907, an interface unit 908, a memory 909, and a processor 910, etc.

[0105] The processor 910 is configured to, when the main control chip obtains a to-be-processed image, crop the to-be-processed image to obtain m first cropped images, wherein the m first cropped images correspond to the m independent display chips one by one, and adjacent two first cropped images in the m first cropped images have common pixel content of image overlap.

[0106] The processor 910 is further configured to transmit the m first cropped images to the corresponding m independent display chips based on the main control chip.

[0107] The processor 910 is further configured to perform image processing on the received first cropped image based on the m independent display chips to obtain a corresponding target image.

[0108] The processor 910 is further configured to crop the common pixel content in the corresponding target image based on the m independent display chips to obtain m second cropped images, wherein the m second cropped images can be spliced to form image content corresponding to the to-be-processed image, and any two adjacent second cropped images in the m second cropped images do not have common pixel content of image overlap.

[0109] The processor 910 is further configured to transmit the cropped second cropped image to the corresponding display unit for display based on the m independent display chips.

[0110] Optionally, the processor 910 is further configured to crop the common pixel content in the corresponding target image along a center line of an image corresponding to the common pixel content based on a target independent display chip in the corresponding target image to obtain a corresponding second cropped image, wherein the target independent display chip is any one of the m independent display chips.

[0111] Optionally, the processor 910 is further configured to perform image convolution processing on the received first cropped image based on the m independent display chips to obtain a corresponding target image, wherein a convolution kernel of the image convolution processing is n×n pixels, a size of the image corresponding to the common pixel content in a direction perpendicular to the center line is greater than or equal to n-1 pixels, and n is an odd number greater than 1.

[0112] Optionally, the processor 910 is further configured to perform preprocessing on the received first cropped image based on the target independent display chip to obtain a preprocessed image, wherein the preprocessing includes: performing pixel padding on an outer side of the first cropped image along a target edge of the first cropped image to form a padding image on the outer side of the first cropped image, the target edge includes other edges in the first cropped image except for edges in the image corresponding to the common pixel content, and a distance between an outer edge of the padding image and the target edge is greater than or equal to (n-1) / 2.

[0113] The processor 910 is further configured to perform image convolution processing on the preprocessed image based on the target independent display chip to obtain a corresponding target image.

[0114] The processor 910 is further configured to crop the common pixel content along a center line of the image corresponding to the common pixel content in the corresponding target image and crop the padding image in the target image based on the target independent display chip to obtain a corresponding second cropped image.

[0115] Those skilled in the art can understand that the electronic device 900 can further include a power supply (such as a battery) for supplying power to each component, and the power supply can be logically connected to the processor 910 through a power management system, so as to realize functions such as management of charging, discharging, and power consumption management through the power management system. Figure 11 The electronic device structure shown in the figure does not constitute a limitation on the electronic device, and the electronic device can include more or fewer components than the figure, or combine certain components, or different component arrangements, which are not described here.

[0116] It should be understood that in the embodiments of the present application, the input unit 904 can include a graphics processor (GPU) 9041 and a microphone 9042. The graphics processor 9041 processes image data of a still picture or a video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 906 can include a display panel 9061, which can be configured in the form of a liquid crystal display, an organic light-emitting diode, or the like. The user input unit 907 includes a touch panel 9071 and other input devices 9072. The touch panel 9071 is also referred to as a touch screen. The touch panel 9071 can include two parts of a touch detection device and a touch controller. The other input devices 9072 can include, but are not limited to, a physical keyboard, function keys (such as volume control keys, on-off keys, and the like), a trackball, a mouse, a joystick, and the like, which will not be described here.

[0117] The memory 909 can be used to store software programs and various data. The memory 909 can mainly include a first storage area storing programs or instructions and a second storage area storing data, wherein the first storage area can store an operating system, application programs or instructions required by at least one function (such as a sound playing function, an image playing function, and the like), and the like. In addition, the memory 909 can include a volatile memory or a non-volatile memory, or the memory 909 can include both volatile and non-volatile memories. The non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically EPROM (EEPROM), or a flash memory. The volatile memory can be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDR SDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synch link DRAM (SLDRAM), and a direct memory bus random access memory (Direct Rambus RAM, DRRAM). The memory 909 in the embodiments of the present application includes but is not limited to these and any other suitable types of memory.

[0118] The processor 910 can include one or more processing units; optionally, the processor 910 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to operating systems, user interfaces, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It can be understood that the above-mentioned modem processor can also not be integrated into the processor 910.

[0119] The embodiment of the present application further provides a readable storage medium, wherein the readable storage medium stores a program or instructions, the program or instructions are executed by a processor to realize various processes of the above-mentioned image processing method embodiment, and the same technical effects can be achieved, and details are not described herein again to avoid repetition.

[0120] The processor is the processor in the electronic device in the above-mentioned embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (Read-Only Memory, ROM), a random access memory (Random Access Memory, RAM), a magnetic disk or an optical disk, etc.

[0121] The embodiment of the present application further provides a chip, wherein the chip includes a processor and a communication interface, the communication interface is coupled with the processor, and the processor is used to run a program or instructions to realize various processes of the above-mentioned image processing method embodiment, and the same technical effects can be achieved, and details are not described herein again to avoid repetition.

[0122] It should be understood that the chip mentioned in the embodiment of the present application can also be referred to as a system-level chip, a system chip, a chip system, or a system-on-chip, etc.

[0123] It should be noted that in this document, the term "comprising" or "including" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, but also includes other elements not explicitly listed or inherent to such a process, method, article or device. Without more limitations, the element defined by the statement "including a" does not exclude the presence of additional identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the method and device in the present application is not limited to the order of functions shown or discussed, and can also include functions performed in a substantially simultaneous manner or in reverse order, for example, the described method can be performed in an order different from that described, and various steps can also be added, omitted or combined. In addition, the features described with reference to some examples can be combined in other examples.

[0124] Through the description of the above embodiments, those skilled in the art can clearly understand that the above-mentioned example methods can be realized by means of software and a necessary general hardware platform, and of course, can also be realized by hardware, but in many cases, the former is a better embodiment. Based on such understanding, the technical solutions of the present application can be embodied in the form of a software product in essence or in the form of a part that contributes to the prior art. The computer software product is stored in a storage medium (such as a ROM / RAM, a magnetic disk, or an optical disk) and includes a plurality of instructions for causing a terminal (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in the various embodiments of the present application.

[0125] The embodiments of the present application are described above in combination with the drawings, but the present application is not limited to the above-mentioned specific embodiments, and the above-mentioned specific embodiments are only illustrative and not limiting. Those skilled in the art can make many forms without departing from the scope of the present application under the inspiration of the present application, and all of them belong to the protection of the present application.

Claims

1. An image processing method, characterized in that: Applied to an electronic device, the electronic device includes a main control chip, m independent display chips and m display units, the m display units are spliced ​​to form a display module, the m independent display chips correspond to the m display units one-to-one, and m is an integer greater than 1. The method includes: When the main control chip obtains an image to be processed, cropping the image to be processed to obtain m first cropped images, wherein the m first cropped images correspond one-to-one to the m independent display chips, and two adjacent first cropped images among the m first cropped images have common pixel content with image overlap; Based on the main control chip, the m first cropped images are respectively transmitted to the corresponding m independent display chips; performing image processing on the received first cropped image based on the m independent display chips to obtain a corresponding target image; Cropping common pixel content in the corresponding target image based on the m independent display chips to obtain m second cropped images, wherein the m second cropped images can be spliced ​​to form image content corresponding to the image to be processed, and any two adjacent second cropped images among the m second cropped images do not have overlapping common pixel content; The cropped second cropped image is transmitted to a corresponding display unit for display based on the m independent display chips.

2. The method according to claim 1, characterized in that The step of cropping common pixel contents in the corresponding target image based on the m independent display chips to obtain m second cropped images includes: Based on the target independent display chip in the corresponding target image, the common pixel content in the target image is cropped along the center line of the image corresponding to the common pixel content to obtain a corresponding second cropped image, wherein the target independent display chip is any one of the m independent display chips.

3. The method according to claim 2, characterized in that The performing image processing on the received first cropped image based on the m independent display chips to obtain a corresponding target image includes: Based on the m independent display chips, image convolution processing is performed on the received first cropped image to obtain a corresponding target image, wherein a convolution kernel of the image convolution processing is n×n pixels, and the image corresponding to the common pixel content has a size greater than or equal to n-1 pixels along a direction perpendicular to the center line, and n is an odd number greater than 1.

4. The method according to claim 3, characterized in that The performing image convolution processing on the received first cropped image based on the m independent display chips to obtain a corresponding target image includes: Preprocessing the received first cropped image based on the target independent display chip to obtain a preprocessed image, wherein the preprocessing includes: padding pixels along a target edge of the first cropped image toward an outer side of the first cropped image to form a padded image outside the first cropped image, the target edge including edges of the first cropped image other than edges in the image corresponding to the common pixel content, and a distance between an outer edge of the padded image and the target edge being greater than or equal to (n-1) / 2; performing image convolution processing on the pre-processed image based on the target independent display chip to obtain a corresponding target image; The target independent display chip, in the corresponding target image, crops the common pixel content in the target image along the center line of the image corresponding to the common pixel content to obtain a corresponding second cropped image, comprising: Based on the target independent display chip, the common pixel content is cropped along the center line of the image corresponding to the common pixel content in the corresponding target image, and the filling image in the target image is cropped to obtain a corresponding second cropped image.

5. An electronic device, characterized in that: A display module comprising a main control chip, m independent display chips, and m display units, wherein the m display units are spliced ​​together to form a display module, wherein the m independent display chips correspond one-to-one to the m display units, and the main control chip is connected to the m display units via the m independent display chips, where m is an integer greater than 1; The main control chip is configured to, upon acquiring an image to be processed, crop the image to be processed to obtain m first cropped images, wherein the m first cropped images correspond one-to-one to the m independent display chips, and two adjacent first cropped images among the m first cropped images have overlapping common pixel content; The main control chip is further configured to transmit the m first cropped images to the corresponding m independent display chips respectively; The independent display chip is used to perform image processing on the received first cropped image to obtain a corresponding target image; The independent display chip is further configured to crop common pixel content in the corresponding target image to obtain m second cropped images, wherein the m second cropped images can be spliced ​​to form image content corresponding to the image to be processed, and any two adjacent second cropped images among the m second cropped images do not have overlapping common pixel content; The independent display chip is further used to transmit the cropped second cropped image to the corresponding display unit for display.

6. The electronic device according to claim 5, characterized in that A target independent display chip is used to crop the common pixel content in the corresponding target image along the center line of the image corresponding to the common pixel content to obtain a corresponding second cropped image, wherein the target independent display chip is any one of the m independent display chips.

7. The electronic device according to claim 6, wherein: The independent display chip is specifically used to perform image convolution processing on the received first cropped image to obtain a corresponding target image, the convolution kernel of the image convolution processing is n×n pixels, and the image corresponding to the common pixel content has a size greater than or equal to n-1 pixels along the direction perpendicular to the center line, where n is an odd number greater than 1.

8. The electronic device according to claim 7, wherein: The target independent display chip is specifically configured to preprocess the received first cropped image to obtain a preprocessed image, wherein the preprocessing includes: performing pixel padding along a target edge of the first cropped image toward an outer side of the first cropped image to form a padded image outside the first cropped image, wherein the target edge includes edges of the first cropped image other than edges in the image corresponding to the common pixel content, and a distance between an outer edge of the padded image and the target edge is greater than or equal to (n-1) / 2; The target independent display chip is further configured to perform image convolution processing on the pre-processed image to obtain a corresponding target image; The target independent display chip is specifically further used to crop the common pixel content along the center line of the image corresponding to the common pixel content in the corresponding target image, and to crop the filling image in the target image to obtain a corresponding second cropped image.

9. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the image processing method according to any one of claims 1 to 4 are implemented.

10. A readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by a processor, the steps of the image processing method according to any one of claims 1 to 4 are implemented.

11. A computer program product, characterized in that The computer program product is stored in a storage medium, and is executed by at least one processor to implement the steps of the image processing method according to any one of claims 1 to 4.

Images