Image processing apparatus and method

Abstract

The invention discloses an image processing device and method. The image processing device comprises a processing module and a display module. The processing module is electrically connected with the display module; wherein the processing module is used for sending image processing data of a current frame image to the display module; and the display module is used for receiving the image processing data and displaying the current frame image based on a gray scale mean value APL indicated by the image processing data.

Description

TECHNICAL FIELD

[0001] The present application belongs to the field of image processing, and particularly relates to an image processing device and method. BACKGROUND

[0002] The platform end can contain multiple processors, such as a central processing unit (CPU), a graphics processing unit (GPU), a display processing unit (DPU), etc., which are mainly used to perform tasks such as layer rendering, synthesis and display sending, and then transmit image data to a display driver integrated circuit (DDIC) through a display serial interface (DSI). After processing by the internal modules of the DDIC, the row scanning signal and the column driving signal are respectively output to the display panel.

[0003] The average pixel level (APL) refers to the statistical average value of the gray scale of the entire image. The APL value can be used to represent the load size when displaying the image, for example, when all pixels are turned on at 255 full gray scale, the corresponding image load is large. In the prior art, the DDIC calculates the APL of the image, and then adjusts the image based on the APL value. As the receiver, the DDIC can only calculate the APL of the image after receiving the entire image, that is, the APL value is calculated with a delay of 1 frame, which will cause the APL calculated at this time to be mismatched with the currently received image frame. The APL calculated corresponds to the previous frame of the currently received image frame, and processing the currently received image frame based on the calculated APL will cause the processed image to fail to achieve the expected display effect. SUMMARY

[0004] The purpose of the embodiments of the present application is to provide an image processing device and method to solve the problem that the APL calculation delay causes the processed image to fail to achieve the expected display effect.

[0005] In a first aspect, the embodiments of the present application provide an image processing device, comprising a processing module and a display module; the processing module is electrically connected to the display module;

[0006] The processing module is configured to send image processing data of a current frame of image to the display module; the display module is configured to receive the image processing data and display the current frame of image based on a gray scale average value APL indicated by the image processing data.

[0007] In a second aspect, an embodiment of the present application provides an image processing method, comprising:

[0008] The display module receives image processing data of the current frame image sent by the processing module;

[0009] The display module displays the current frame image based on the APL indicated by the image processing data.

[0010] In a third aspect, an embodiment of the present application provides a readable storage medium, wherein the readable storage medium stores a program or instructions, and the program or instructions are executed by a processor to implement the steps of the method according to the second aspect.

[0011] In a fourth aspect, an embodiment of the present application provides a chip, wherein the chip comprises a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to run a program or instructions to implement the method according to the second aspect.

[0012] In an eighth aspect, an embodiment of the present application provides a computer program product stored in a storage medium, and the program product is executed by at least one processor to implement the method according to the second aspect.

[0013] In the embodiment of the present application, the processing module sends image processing data of the current frame image to the display module, the image processing data can indicate the APL of the current frame image, and the display module displays the current frame image based on the image processing data. In the present application, the display module does not need to calculate the APL by itself after receiving the image processing data, and can display the current frame image according to the indicated APL of the current frame image, thereby saving processing time and ensuring accurate adjustment of the image or the driving signal, so as to ensure the display effect of the image and save energy consumption. BRIEF DESCRIPTION OF DRAWINGS

[0014] Figure 1 is a structural schematic diagram of an image processing device according to an embodiment of the present application;

[0015] Figure 2a , Figure 2b and Figure 2c is a schematic diagram of image display corresponding to the APL value according to an embodiment of the present application;

[0016] Figure 3 is a structural schematic diagram of image processing data sent by the processing module according to an embodiment of the present application;

[0017] Figure 4 is a structural schematic diagram of image processing data sent by the processing module according to an embodiment of the present application;

[0018] Figure 5Fig. 2 is a structural schematic diagram of the image processing device according to an embodiment of the present application;

[0019] Figure 6 Fig. 3 is a structural schematic diagram of image processing data sent by the processing module according to an embodiment of the present application;

[0020] Figure 7 Fig. 4 is a structural schematic diagram of image processing data sent by the processing module according to an embodiment of the present application;

[0021] Figure 8 Fig. 5 is a structural schematic diagram of the image processing device according to an embodiment of the present application.

[0022] Fig. 1 is a structural schematic diagram of the image processing device according to an embodiment of the present application. DETAILED DESCRIPTION

[0023] The embodiments of the present application will be described in detail below with reference to the accompanying drawings. In the drawings, the same or similar components are denoted by the same reference numerals throughout. The embodiments described below are examples for explaining the present application and are not intended to limit the present application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without creative work fall within the scope of the present application.

[0024] In the description of the present application, the terms "first", "second" can explicitly or implicitly include one or more of the features. In the description of the present application, the meaning of "a plurality of" is two or more, unless otherwise specified. In addition, "and / or" in the specification and claims means at least one of the connected objects, and the character " / ", generally means that the front and rear associated objects are in an "or" relationship.

[0025] In the description of the present application, it should be noted that, unless otherwise specified and limited, the terms "mounting", "connecting", "connecting" should be understood in a broad sense, for example, it can be fixedly connected, or it can be detachably connected, or integrally connected; it can be mechanically connected, or it can be electrically connected; it can be directly connected, or it can be indirectly connected through an intermediate medium; it can be the communication inside two elements. For those skilled in the art, the specific meaning of the above terms in the present application can be understood according to the specific circumstances.

[0026] The image processing device and method provided by the embodiments of the present application will be described in detail below with reference to the accompanying drawings and specific embodiments and application scenarios.

[0027] AsFigure 1 As shown in the embodiments of the present application, an image processing device is provided, which comprises a processing module 1 and a display module 2; the processing module 1 is electrically connected to the display module 2; the processing module 1 is configured to send image processing data of a current frame image to the display module 2; and the display module 2 is configured to receive the image processing data and display the current frame image based on an average gray level APL indicated by the image processing data.

[0028] In the embodiments, the processing module 1 is, for example, a processor or a component comprising a processor, for example, the processing module 1 can be an application processor (Application Processor) of a platform. The processing module 1 can comprise a CPU, a GPU and / or a DPU. The display module 2 is, for example, a display screen or a component comprising a display screen, for example, the display module 2 comprises a DDIC. The processing module 1 and the display module 2 can transmit data through a display serial interface (Display Serial Interface, DSI).

[0029] The processing module 1 and the display module 2 can belong to the same electronic device. The processing module 1 can calculate and / or process image processing data of an image frame to be displayed, for example, for a current nth frame image to be displayed, the processing module 1 obtains image processing data of the frame image. Optionally, the image processing data can indicate the APL of the current frame image, for example, the image processing data comprises an APL value of the current frame image, or the image processing data does not comprise the APL value of the current frame image, but the image processing data is obtained based on the APL.

[0030] The APL refers to the statistical average of the gray levels of the entire image, and the calculation formula is as follows:

[0031]

[0032] Different gray level values represent the depth of color, and the average gray level can be expressed in the form of percentage. For example Figure 2a 、 Figure 2b and Figure 2c As shown in the embodiments of the present application, different APL values correspond to different image display gray levels. It should be noted that different processor manufacturers may have different ways of calculating APL, which is similar to the above calculation method. The embodiments of the present application do not limit the specific method of determining the APL of the image frame.

[0033] The processing module 1 sends the image processing data to the display module 2, and the display module 2 displays the current frame image based on the APL indicated by the image processing data.

[0034] In the embodiment of the present application, the processing module sends image processing data of the current frame image to the display module, the image processing data can indicate the APL of the current frame image, and the display module displays the current frame image based on the image processing data. In the present application, the display module does not need to calculate the APL by itself after receiving the image processing data, and can display the current frame image according to the indicated APL of the current frame image, thereby saving processing time and ensuring accurate adjustment of the image or the driving signal, so as to ensure the display effect of the image and save energy consumption.

[0035] As an optional embodiment, as shown in Figure 1 The processing module 1 comprises an image processing module 11, and the image processing module 11 is configured to determine the APL of the current frame image.

[0036] In the embodiment, the image processing module 11 can be a processor, such as a CPU and / or a GPU. For example, after collecting the image, the CPU performs rendering, synthesis and other processing on the current frame image to obtain image data corresponding to the image frame, and the GPU can determine the APL of the image frame based on the image data. After the GPU obtains the APL of the current frame image, the processing module 1 can send the image processing data containing the APL to the display module 2 through the DSI, and the display module 2 displays the current frame image based on the APL in the image processing data. For example, the display module 2 can adjust at least one parameter of the current frame image, such as brightness, color gamut, contrast and the like, based on the APL in the image processing data of the current frame image, and display the adjusted current frame image. In the embodiment, the display module 2 does not need to calculate the APL of the current frame image by itself, and can directly process the current frame image based on the APL in the image processing data sent by the processing module 1, thereby saving processing time and ensuring accurate adjustment of the current frame image or the driving signal.

[0037] As an optional embodiment, the processing module 1 further comprises a picture quality processing module 12, and the picture quality processing module 12 is configured to adjust image parameters of the current frame image according to the APL of the current frame image, the image parameters comprising at least one of the following: brightness, color gamut, contrast.

[0038] In this embodiment, the picture quality processing module 12 is, for example, an algorithm (display PQ) module. The picture quality processing module 12 can process the current frame image based on the APL of the current frame image, such as adjusting at least one parameter of the current frame image, such as luminance, color gamut, contrast, and the like. It can be understood that the processing module 1 can also directly process the current frame image based on the APL after calculating the APL of the current frame image, and send the image processing data of the current frame image obtained after adjusting the parameters based on the APL to the display module 2. The display module 2 does not need to further adjust the current frame image, saves the image processing time of the display module, and can ensure that the current frame image is displayed based on the parameters matched with the APL, and improves the image display effect.

[0039] In an embodiment, the image processing data includes the APL of the current frame image and the image data of the current frame image; or the image processing data is data obtained after adjusting the image parameters of the current frame image according to the APL of the current frame image.

[0040] In this embodiment, the image processing data sent by the processing module 1 to the display module 2 can display the APL of the current frame image and the image data of the current frame image. In this way, the display module does not need to calculate the APL of the current frame image by itself, and can directly adjust at least one of the luminance, color gamut, and / or contrast of the current frame image, driving signal, and the like based on the APL of the current frame image sent by the processing module 1. Not only does this save the processing time of the display module, but it also ensures accurate adjustment of the current frame image or the driving signal of the current frame image.

[0041] Alternatively, the image processing data sent by the processing module 1 to the display module 2 is image data that implicitly indicates the APL of the current frame image. It can also be understood that the processing module 1 has adjusted the current frame image based on the APL of the current frame image, and the image processing data is the adjusted image data. The display module 2 can directly display the current frame image, and the luminance, color gamut, contrast, and the like of the displayed current frame image are parameters adjusted based on the APL of the current frame image.

[0042] In this embodiment, the processing module calculates the image data of the current frame image and the APL, and sends the image data and the APL to the display module, so that the display module does not need to calculate the APL by itself, the processing time is saved, the image data and the APL of the same image frame can be received at the same time or in a shorter time, the processing of the current frame image is completed, the accurate adjustment of the image or the driving signal is ensured, the display effect of the image is ensured, and the energy consumption is saved. Alternatively, after the processing module calculates the APL of the current frame image, the processing module can also send the parameters of the current frame image adjusted according to the APL to the display module, so that the display module does not need to calculate the APL by itself and does not need to process the image data, the processing time is saved, the processing energy consumption is saved, and the display effect of the image can be ensured.

[0043] As an optional embodiment, the display module 2 comprises a display driving chip 21.

[0044] The display driving chip 21 is configured to adjust the related parameters of the current frame image according to the APL indicated by the image processing data, and the related parameters comprise image parameters and / or display driving current of the current frame image, and the image parameters comprise at least one of luminance, color gamut, and contrast.

[0045] In this embodiment, the display driving chip 21 is a chip for driving the screen to light up, such as a DDIC. The display driving chip 21 can comprise a cache, a coding and decoding module, and some IP. After the processing of these modules in the DDIC, the voltage or current signals corresponding to the row scanning signals and the data in the column direction of the display panel are output respectively, and the display of the image is completed. In this embodiment, the processing module 1 sends the image processing data to the display module 2, and the display driving chip 21 in the display module 2 can adjust the parameters of the current frame image based on the APL in the image processing data, such as adjusting at least one of the luminance, the contrast, and the color gamut of the image. For example, when the APL value of the current frame image is small, the load required for displaying the current frame image is small, and the luminance of the image can be adjusted to be high, so that the image is displayed more brightly, and the user's viewing experience in outdoor or HDR scenes is improved.

[0046] Optionally, the display driving chip 21 is further configured to determine the display power of the current frame image based on the APL indicated by the image processing data when the image processing data is received, and adjust the display driving current based on the display power.

[0047] In this embodiment, the display driving chip 21 can also adjust the driving signal for driving the display of the current frame image based on the APL in the image processing data. For example, when the APL value of the current frame image is small, the display power required for displaying the current frame image is small, and thus the voltage or current of the driving signal in the row direction or the column direction can be adjusted to be low, thereby achieving power saving.

[0048] As an optional embodiment, the display module 2 further comprises an image display module 22 configured to display the adjusted current frame image.

[0049] In this embodiment, if the image processing data sent by the processing module 1 comprises the APL and the image data of the current frame image, the display driving chip 21 of the display module 2 can display the current frame image after adjusting the related parameters of the image data based on the APL; if the image processing data sent by the processing module 1 is the data obtained after the processing module 1 adjusts the image parameters of the current frame image based on the APL of the current frame image, the display driving chip 21 can directly display the current frame image without adjusting the image parameters of the current frame image.

[0050] As an optional embodiment, in the case where the processing module 1 sends the image processing data to the display module 2:

[0051] The APL of the current frame image and the image data of the current frame image are located in the same data stream.

[0052] Or,

[0053] The APL of the current frame image is indicated by a first instruction, and the first instruction and the image data of the current frame image are located in different data streams.

[0054] In this embodiment, when the processing module 1 sends the image processing data to the display module 2, there are two sending modes:

[0055] Mode one: the processing module 1 calculates the image data and the APL of the current frame image, encodes the image data and the APL to obtain a data stream, and transmits the data stream to the display module 2. For example, the GPU processes and synthesizes the current frame image to obtain the image data, calculates the APL value of the current frame image according to the image data, encodes the image data and the APL together, and stores them in the cache, and the DPU reads the data in the cache and sends it to the display module 2. Optionally, in the case where the APL of the current frame image and the image data of the current frame image are located in the same data stream, the APL of the current frame image is located at the head or the tail of the data stream. For example, the APL of the current frame image is located at the head of the data stream, and the APL of the current frame image is located at the tail of the data stream. Figure 3As shown in the figure. In this way, the display module 2 can first identify the APL value of the current frame image after receiving the data stream, and can determine in advance whether to process the current frame image, thereby saving processing time.

[0056] It should be noted that the APL can also be located at the tail of the data stream. Since the decoding time of the data stream is short, the decoding time of the front and rear of the data stream is small, and the display module 2 can cache the image data of the current frame image after decoding the image data of the current frame image first, and then decode the APL, and then process the current frame image according to the APL.

[0057] Second, the processing module 1 calculates the image data of the current frame image and the APL, and sends the image data of the current frame image and the APL to the display module 2 respectively. Specifically, the APL can be sent in the form of an instruction to save signaling overhead. For example: the GPU processes and synthesizes the current frame image to obtain the image data, and calculates the APL value of the current frame image according to the image data. The GPU can encode and store the image data of the current frame image and the APL in the cache. The DPU reads the data in the cache, sends the image data of the current frame image to the display module through the data stream, and sends a short packet instruction to the display module 2 for the APL of the current frame image. The short packet instruction indicates the value of the APL of the current frame image, for example Figure 4 As shown in the figure.

[0058] Optionally, in the case where the first instruction and the image data of the current frame image are located in different data streams, the data stream of the first instruction is located before the data stream of the current frame image. In this way, the display module 2 can first obtain the APL value of the current frame image, and can determine in advance whether to process the current frame image, thereby saving processing time.

[0059] Optionally, the data packet length of the first instruction is less than the data packet length of the current frame image.

[0060] In this case, the first instruction is a short packet instruction, and the sending time is short. Since the sending time of the first instruction is short, no matter what the sending order of the first instruction and the image data of the current frame image is, the display module 2 can quickly obtain the APL of the current frame image, and process the current frame image.

[0061] Optionally, the processing module 1 can complete the sending of the first instruction within one frame of time when sending the first instruction, so as to ensure that the display module receives the image data of the current frame image and the APL with a small time difference, thereby processing the current frame image based on the APL, and saving processing time.

[0062] As an optional embodiment, the processing module 1 further comprises a data processing module 13 configured to compile the APL of the current frame image according to the bit depth of the processing module 1; wherein the APL contained in the image processing data of the current frame image is the compiled APL.

[0063] In this embodiment, the data processing module 13 can be a DPU. The processing module 1 can compile the APL of the current frame image before sending the image processing data of the current frame image. The compilation of the APL is usually related to the bit depth of the processor, and different bit depths correspond to different color numbers, color number = 2bit depth, for example: for an 8-bit (bit) processor, the corresponding color number is 2 8 = 256, i.e. gray scale 0-255, and the maximum gray scale is 255. For a 12-bit processor, the corresponding color number is 2 12 = 4096, i.e. gray scale 0-4095, and the maximum gray scale is 4095.

[0064] When the APL is compiled, the maximum gray scale corresponding to the bit depth of the processor can be used for compilation, and the result is sent to the display module 2 after conversion. For example, the processing module is an 8-bit processor, so the APL can be compiled as APL*255, and the result is stored and sent in hexadecimal after rounding, for example, the APL of the current frame image is 20%, which corresponds to 255*20% = 51 (decimal) in 8-bit, and the corresponding hexadecimal is 0x33. The APL = 0x33. The data processing module 13 can send the 0x33 to the display module such as a DDIC for identification, and the DDIC performs some algorithmic operations based on the APL of the current frame image. The data processing module 13 compiles the APL to meet the transmission requirements between the processing module and the display module.

[0065] The embodiments of the present application further provide an image processing method applied to the image processing device, comprising:

[0066] The display module receives the image processing data of the current frame image sent by the processing module; and the display module displays the current frame image based on the APL indicated by the image processing data.

[0067] In this embodiment, the processing module can calculate and / or process image processing data of the image frame to be displayed. For example, for the nth image frame to be displayed, the processing module obtains image processing data of the frame. Optionally, the image processing data can indicate the APL of the current frame, for example, the image processing data contains the APL value of the current frame, or the image processing data is obtained based on the APL adjustment. The processing module sends the image processing data to the display module, and the display module displays the current frame based on the APL indicated by the image processing data.

[0068] Optionally, the image processing method further includes determining the APL of the current frame.

[0069] The image parameters of the current frame are adjusted according to the APL of the current frame, and the image parameters include at least one of the following: brightness, color gamut, and contrast.

[0070] Optionally, the image processing method further includes compiling the APL of the current frame according to the bit depth of the processor.

[0071] Optionally, the image processing method further includes adjusting the related parameters of the current frame according to the APL indicated by the image processing data; the related parameters include the image parameters of the current frame and / or the display driving current; the image parameters include at least one of the following: brightness, color gamut, and contrast.

[0072] The adjusted current frame is displayed.

[0073] Optionally, the image processing method further includes determining the display power of the current frame based on the APL indicated by the image processing data; and adjusting the display driving current based on the display power.

[0074] In the embodiments of the present application, the display module does not need to calculate the APL itself after receiving the image processing data, and can display the current frame according to the APL of the current frame indicated by the image processing data, thereby saving processing time and ensuring accurate adjustment of the image or driving signal, so as to ensure the display effect of the image and save energy consumption.

[0075] It should be noted that the image processing method of the present embodiment can realize any function of the processing module and / or the display module in the above-mentioned image processing device, and will not be described in detail here.

[0076] The image processing process of the present application will be illustrated below for different image processing methods.

[0077] In an embodiment, the image data corresponding to the current frame image and the APL are jointly encoded to obtain a data stream; and the processing module transmits the data stream to the display module.

[0078] As shown in Figure 5 , the processing module is a platform end including a processor, and the display module is a display screen. As shown in Figure 5 , the information interaction between the processing module and the display module is shown. Figure 6 , the processing module transmits image processing data to the display module.

[0079] As shown in Table 1, the n-th frame image is the current frame image, and the (n+1)-th frame image is the next frame image of the current frame image. After the GPU of the platform end performs APL operation on the n-th frame image, the APL value of the n-th frame image is stored in the cache and then transmitted in the MIPI data format. As shown in Table 1, the APL value of the n-th frame image is 20%, which is coded as 0x33; and the APL value of the (n+1)-th frame image is 70%, which is coded as 0xb2. The APL value of each frame image is coded at the front end of the data of the frame, as shown in Figure 6 , 0x33 is located at the front end of the data of the n-th frame image, and 0xb2 is located at the front end of the data of the (n+1)-th frame image. After the DDIC receives the data stream of the n-th frame image, the APL value 20% of the n-th frame image and the image data of the n-th frame image are obtained through decoding, and the n-th frame image can be processed for brightness enhancement based on the APL value; and after the DDIC receives the data stream of the (n+1)-th frame image, the APL value 70% of the (n+1)-th frame image and the image data of the (n+1)-th frame image are obtained through decoding, and the (n+1)-th frame image can be processed for brightness enhancement based on the APL value.

[0080] In this embodiment, the higher the APL value, the lower the brightness enhancement ratio. In the traditional scheme, for the next frame image of the current frame image, i.e., the (n+1)-th frame image, the 70% load is set to 1.5 times brightness enhancement. Since the DDIC delays 1 frame in calculating the APL, it leads to misjudgment, and the DDIC performs 2 times brightness enhancement according to the APL=20% of the last frame (n-th frame), which exceeds the power of the power chip (not shown in the figure), resulting in high risk of image output. As shown in Table 1, the embodiment of the present application is set according to the APL of the current frame image, so there is no risk of image output.

[0081] Table 1: Comparison of the processing method of the present application and the traditional processing method for images

[0082]

[0083] In another embodiment, the image data and the APL value of the same image frame are sent separately.

[0084] As shown in FIG. 5 and FIG. 6, Figure 7 As shown in FIG. 5 and FIG. 6, Figure 5 As shown in FIG. 5 and FIG. 6, Figure 7 As shown in FIG. 5 and FIG. 6,

[0085] As shown in Table 2, in the traditional scheme, since there is a 1-frame delay in receiving the APL by the DDIC, when adjusting the drive current corresponding to the m-th image, it is adjusted according to the APL value corresponding to the previous frame (m-1-th) image; when adjusting the drive current corresponding to the m+1-th image, it is adjusted according to the APL value corresponding to the previous frame (m-th) image, that is, the APL value is 20%, and the actual load is 70%, which will cause the adjusted drive current to be low, and the image display to be abnormal. The embodiment of the present application is based on the APL value of the current frame image to adjust the drive current, so there will be no display abnormality problem caused by the high APL value (high load) being incorrectly configured as a low drive current.

[0086] Before sending each frame of image data, the DPU reads the image data and the APL value of the frame of image from the cache. The DPU first sends the APL value of the frame of image, and then sends the image data of the frame of image. Optionally, the APL value of the current frame of image can be indicated by a first instruction. The DDIC first receives the APL value of the frame of image, determines the load size of the frame of image, and then receives the image data of the frame of image. The DDIC adjusts the intensity of the row or column drive signal based on the APL, thereby achieving power saving based on the APL value of the current frame. As shown in Table 2, the APL value of the n-th frame of image is 20%, which is compiled as 0x33; the APL value of the (m+1)-th frame of image is 70%, which is compiled as 0xb2. The APL value is sent to the DDIC before the image data. After receiving the APL, the DDIC can adjust the drive current corresponding to the frame of image according to the APL. The smaller the APL, that is, the smaller the display load, the lower the drive current output by the DDIC to the panel, thereby achieving power saving.

[0087] As shown in Table 2, in the traditional scheme, since there is a 1-frame delay in receiving the APL by the DDIC, when adjusting the drive current corresponding to the m-th image, it is adjusted according to the APL value corresponding to the previous frame (m-1-th) image; when adjusting the drive current corresponding to the m+1-th image, it is adjusted according to the APL value corresponding to the previous frame (m-th) image, that is, the APL value is 20%, and the actual load is 70%, which will cause the adjusted drive current to be low, and the image display to be abnormal. The embodiment of the present application is based on the APL value of the current frame image to adjust the drive current, so there will be no display abnormality problem caused by the high APL value (high load) being incorrectly configured as a low drive current.

[0088] Table 2: Comparison of the processing method of the present application and the traditional processing method

[0089]

[0090] In another embodiment, the processing module calculates the APL of the current frame image, and processes the image data of the current frame image according to the APL of the current frame image to obtain image processing data, and sends the image processing data to the display module.

[0091] As shown in Figure 8 the processing module is a platform end including a processor, and the display module is a display screen, for example, the processor (such as a GPU) of the platform end calculates the corresponding APL of the current frame image according to the image data of the current frame image. After the picture quality processing module, such as the algorithm (display PQ) module of the platform end, processes the current frame image based on the APL value (such as brightness, color gamut, contrast, etc.), the adjusted image processing data is stored in the cache. The DPU reads the image processing data from the cache and sends it to the DDIC, and the DDIC does not need to adjust the brightness of the image again.

[0092] In this embodiment, the APL of the current frame image is calculated by the processing module, and then transmitted to the DDIC. The DDIC receives the data and performs algorithm operation based on the APL value of the current frame image to perform brightness enhancement or power saving function on the image; or the processing module calculates the APL of the current frame image, and adjusts the image parameters based on the APL of the current frame image, and sends the adjusted image processing data to the DDIC, without the need for the DDIC to process the image, saving processing time. In addition, the APL of the current frame image is calculated by the processing module, which can avoid the case that different DDICs calculate different APLs, and ensure that the display effect of the image is consistent under different DDICs.

[0093] In the embodiment of the present application, the processing module sends the image processing data of the current frame image to the display module, and the image processing data can indicate the APL of the current frame image. The display module displays the current frame image based on the image processing data. In the present application, the display module does not need to calculate the APL itself after receiving the image processing data, and can display the current frame image according to the indicated APL of the current frame image, saving processing time, and ensuring accurate adjustment of the image or driving signal, thereby ensuring the display effect of the image and saving energy consumption.

[0094] It should be noted that the image processing device provided in the embodiments of the present application can realize the various processes realized by the image processing method embodiments, and thus the details are not repeated here.

[0095] The image processing apparatus in the embodiments of the present applicationapplicationbe an electronic device or a component in an electronic device, such as an integrated circuit or a chip. The electronic deviceapplicationbe a terminal or another device other than a terminal. For example, the electronic deviceapplicationbe a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted electronic device, a Mobile Internet Device (MID), an augmented reality (AR) / virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), andapplicationbe a server, a Network Attached Storage (NAS), a personal computer (PC), a television (TV), a teller machine, or a self-service machine, without limitation.

[0096] The image processing apparatus in the embodiments of the present applicationapplicationbe a device with an operating system. The operating systemapplicationbe an Android operating system, an ios operating system, or another possible operating system, without limitation.

[0097] The embodiments of the present application further provide a readable storage medium having a program or instructions stored thereon, which, when executed by a processor, implement various processes of the above image processing method embodiments and achieve the same technical effects. To avoid repetition, details are not described herein.

[0098] The processorapplicationbe the processor in the electronic device in the above embodiments. The readable storage mediumapplicationinclude a computer readable storage medium, such as a computer readable only memory (ROM), a random access memory (RAM), a magnetic disc, or an optical disc.

[0099] The embodiments of the present application further provide a chip including a processor and a communication interface. The communication interface is coupled to the processor. The processor is configured to execute a program or instructions to implement various processes of the above image processing method embodiments and achieve the same technical effects. To avoid repetition, details are not described herein.

[0100] It should be understood that the chip mentioned in the embodiments of the present applicationapplicationalso be referred to as a system-level chip, a system chip, a chip system, or a system-on-chip chip.

[0101] The embodiment of the present application provides a computer program product, the program product is stored in a storage medium, the program product is executed by at least one processor to realize each process of the above image processing method embodiment, and the same technical effects can be achieved, to avoid repetition, here no longer tedious.

[0102] It should be noted that in this paper, the term "including", "containing" or any other variant thereof is intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements not only includes those elements, but also includes other elements not explicitly listed, or includes elements inherent to such process, method, article or device. Without more limitations, the element defined by the sentence "including a" does not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the method and device in the embodiments of the present application is not limited to the order of functions shown or discussed, but can also include functions performed in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method can be performed in an order different from that described, and various steps can also be added, omitted or combined. In addition, the features described with reference to some examples can be combined in other examples.

[0103] From the above description of the embodiments, those skilled in the art can clearly understand that the above embodiment method can be realized by software and necessary general hardware platform, of course, it can also be realized by hardware, but in many cases, the former is a better embodiment. Based on such understanding, the technical solutions of the present application can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, magnetic disc, optical disc), including a plurality of instructions for making a terminal (which can be a mobile phone, computer, server or network equipment, etc.) execute the method described in each embodiment of the present application.

[0104] The embodiments of the present application are described above in combination with the drawings, but the present application is not limited to the above specific embodiments, the above specific embodiments are only illustrative, not restrictive, and those skilled in the art can make many forms under the inspiration of the present application without departing from the scope of the present application and the protection scope of the claims.

Claims

1. An image processing apparatus, characterized in that, It includes a processing module and a display module; the processing module and the display module are electrically connected; The processing module is used to send image processing data of the current frame image to the display module; the display module is used to receive the image processing data and display the current frame image based on the grayscale mean APL indicated by the image processing data.

2. The apparatus according to claim 1, characterized in that, The processing module includes: an image processing module; The image processing module is used to determine the APL of the current frame image.

3. The apparatus according to claim 2, characterized in that, The processing module also includes: an image quality processing module; The image quality processing module is used to adjust the image parameters of the current frame image according to the APL of the current frame image. The image parameters include at least one of the following: brightness, color gamut, and contrast.

4. The apparatus according to claim 2 or 3, characterized in that, The image processing data includes the APL of the current frame image and the image data of the current frame image; or, the image processing data is data obtained by adjusting the image parameters of the current frame image according to the APL of the current frame image.

5. The apparatus according to claim 1 or 2, characterized in that, The display module includes: a display driver chip; The display driver chip is used to: adjust the relevant parameters of the current frame image according to the APL indicated by the image processing data; The relevant parameters include: the image parameters of the current frame image and / or the display drive current; the image parameters include at least one of the following: brightness, color gamut, and contrast.

6. The apparatus according to claim 5, characterized in that, The display module further includes an image display module for displaying the adjusted current frame image.

7. The apparatus according to claim 4, characterized in that, When the processing module sends the image processing data to the display module: The APL of the current frame image and the image data of the current frame image are located in the same data stream; or, The APL of the current frame image is indicated by a first instruction, and the first instruction and the image data of the current frame image are located in different data streams.

8. The apparatus according to claim 7, characterized in that, When the APL of the current frame image and the image data of the current frame image are in the same data stream, the APL of the current frame image is located at the beginning or end of the data stream.

9. The apparatus according to claim 7, characterized in that, In the case where the image data of the first instruction and the current frame image are in different data streams, the data stream of the first instruction is located before the data stream of the current frame image.

10. The apparatus according to claim 7 or 9, characterized in that, The data packet length of the first instruction is less than the data packet length of the current frame image.

11. The apparatus according to claim 5, characterized in that, The display driver chip is further configured to: upon receiving the image processing data, determine the display power of the current frame image based on the APL indicated by the image processing data; and adjust the display driving current based on the display power.

12. The apparatus according to claim 2, characterized in that, The processing module further includes: a data processing module, used to compile the APL of the current frame image according to the bit depth of the processing module; The APL included in the image processing data is a compiled APL.

13. An image processing method, applied to the image processing apparatus as described in any one of claims 1 to 12, characterized in that, include: The display module receives image processing data of the current frame image sent by the processing module; The display module displays the current frame image based on the APL indicated by the image processing data.

Images