Image processing apparatus and method, and electronic device

By collaboratively adjusting the pixel value of image data and screen backlight brightness through the system-level chip and independent display chip, the limitations of SDR2HDR technology are solved, contrast is enhanced and visual effects are improved, and it is suitable for a variety of terminal devices.

WO2025201159A1PCT designated stage Publication Date: 2025-10-02VIVO MOBILE COMM CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2025/083691
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-03-26
Filing Date
2025-03-20
Publication Date
2025-10-02

AI Technical Summary

Technical Problem

Existing SDR2HDR technology has limitations in improving image or video quality. It requires terminal devices to support specific technical standards or has limited contrast improvement, resulting in poor visual effects.

Method used

By working together with the system-level chip and the independent display chip, the pixel value of the image data is adjusted according to the initial backlight brightness, target backlight brightness and brightness threshold, thereby improving the screen backlight brightness and achieving improved contrast without the need for format conversion.

Benefits of technology

It significantly enhances the contrast of images, improves visual effects, and is applicable to devices that do not require the terminal device to support specific technical standards, thus expanding its scope of application.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2025083691_02102025_PF_FP_ABST
    Figure CN2025083691_02102025_PF_FP_ABST
Patent Text Reader

Abstract

The present application relates to the technical field of display, and discloses an image processing apparatus and method, and an electronic device. The apparatus comprises a system-on-chip, a standalone display chip, and a display panel. The system-on-chip is used for determining initial backlight brightness, target backlight brightness, and a brightness threshold of a screen, sending the initial backlight brightness and the brightness threshold to the standalone display chip for initialization, and upon determining that the standalone display chip has completed initialization, sending image data to be processed and the target backlight brightness to the standalone display chip. The standalone display chip is used for performing initialization on the basis of the initial backlight brightness and the brightness threshold, and upon completing initialization, adjusting a pixel value of the image data on the basis of the initial backlight brightness, the target backlight brightness, and the brightness threshold, and sending adjusted image data and the target backlight brightness to the display panel for display.
Need to check novelty before this filing date? Find Prior Art

Description

Image processing device, method and electronic equipment

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to the Chinese patent application filed with the China Patent Office on March 26, 2024, with application number 202410353072.8 and invention name “Image processing device, method and electronic device”. The entire contents of the Chinese patent application are incorporated herein by reference. Technical Field

[0003] The present application belongs to the field of display technology, and specifically relates to an image processing device, method and electronic equipment. Background Art

[0004] Standard Dynamic Range (SDR) video is produced based on the SDR technical standard, while High Dynamic Range (HDR) video is produced based on the HDR technical standard. Because HDR technology produces and displays images with a higher color range and brightness range, HDR video offers better picture quality and visual effects than SDR video.

[0005] Current Internet videos are usually SDR videos. In order to improve the video quality, in related technologies, SDR2HDR (Standard Dynamic Range to High Dynamic Range) technology can be used to process SDR videos. When using SDR2HDR technology to process SDR videos, one solution is to convert the format of the SDR video to obtain HDR video, and the other solution is to modify the pixel value of the video image so that the modified video image can achieve an effect similar to HDR display. However, in actual applications, the above two solutions have certain limitations. Specifically, the first solution requires the terminal device to support the corresponding HDR technical standard to decode the converted HDR video, and the second solution has limited improvement in the contrast of the video picture, resulting in the contrast of the video picture cannot meet actual needs and the visual effect is poor. In actual applications, in addition to the above-mentioned SDR videos, some images also have the need to improve image quality. When using SDR2HDR technology to process images, the above limitations also exist. Summary of the Invention

[0006] The purpose of the embodiments of the present application is to provide an image processing device, method and electronic device that can solve the problem of how to overcome the limitations of existing solutions to effectively improve the image quality or video quality when it is necessary to improve the image quality or video quality.

[0007] In a first aspect, an embodiment of the present application provides an image processing device, including a system-on-chip, an independent display chip, and a display panel, wherein:

[0008] The system-level chip is used to determine the initial backlight brightness, target backlight brightness and brightness threshold of the screen, send the initial backlight brightness and the brightness threshold to the independent display chip for initialization, and send the image data to be processed and the target backlight brightness to the independent display chip when it is determined that the independent display chip has completed initialization;

[0009] The independent display chip is configured to be initialized according to the initial backlight brightness and the brightness threshold, and when the initialization is completed, adjust the pixel values ​​of the image data according to the initial backlight brightness, the target backlight brightness, and the brightness threshold, and send the adjusted image data and the target backlight brightness to the display panel;

[0010] The display panel is configured to display the adjusted image data based on the target backlight brightness.

[0011] In a second aspect, an embodiment of the present application provides an electronic device, which includes the image processing device as described in the first aspect.

[0012] In a third aspect, an embodiment of the present application provides an image processing method, comprising:

[0013] Determine the initial backlight brightness, target backlight brightness and brightness threshold of the screen;

[0014] Sending the initial backlight brightness and the brightness threshold to an independent display chip for initialization;

[0015] When it is determined that the independent display chip has completed initialization, the image data to be processed and the target backlight brightness are sent to the independent display chip, the initial backlight brightness, the target backlight brightness and the brightness threshold are used by the independent display chip to adjust the pixel value of the image data, and the adjusted image data and the target backlight brightness are sent to the display panel, and the display panel displays the adjusted image data based on the target backlight brightness.

[0016] In a fourth aspect, an embodiment of the present application provides an image processing method, comprising:

[0017] Receive the initial backlight brightness and brightness threshold of the screen sent by the system-level chip;

[0018] Initializing according to the initial backlight brightness and the brightness threshold;

[0019] When initialization is completed, receiving the image data to be processed and the target backlight brightness sent by the system-level chip;

[0020] adjusting pixel values ​​of the image data according to the initial backlight brightness, the target backlight brightness, and the brightness threshold;

[0021] The adjusted image data and the target backlight brightness are sent to a display panel, and the display panel displays the adjusted image data based on the target backlight brightness.

[0022] In a fifth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the method described in the third aspect or the fourth aspect are implemented.

[0023] In a sixth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the method described in the third aspect or the fourth aspect.

[0024] In a seventh aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the third aspect or the fourth aspect.

[0025] In an embodiment of the present application, when processing an image, since the pixel value of the image data can be adjusted according to the initial backlight brightness, target backlight brightness and brightness threshold of the screen, the display brightness of the pixel can be adjusted. Since the initial backlight brightness of the screen can be increased to the target backlight brightness, the backlight brightness of the screen can be increased. Since the display brightness of the pixel and the backlight brightness of the screen are related to the contrast of the image, by adjusting the display brightness of the pixel in the image and increasing the backlight brightness of the screen, the contrast of the image can be greatly improved, further improving the visual effect of the image. In addition, since the image format conversion is not involved when processing the image, when displaying the processed image, there is no need for the terminal device to support the corresponding technical standards, thereby avoiding restrictions on the terminal device and having a wider range of applications. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] FIG1 is a schematic structural diagram of an image processing device according to an embodiment of the present application;

[0027] FIG2 is a schematic diagram of an image processing apparatus according to an embodiment of the present application processing image data in an SDR video;

[0028] FIG3 is a schematic diagram of an image processing apparatus according to an embodiment of the present application processing image data in an SDR video;

[0029] FIG4 is a flow chart of an image processing method according to an embodiment of the present application;

[0030] FIG5 is a flow chart of an image processing method according to an embodiment of the present application;

[0031] FIG6 is a schematic structural diagram of an electronic device according to an embodiment of the present application;

[0032] FIG7 is a schematic diagram of the hardware structure of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0033] The following will be combined with the accompanying drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the embodiments described are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field are within the scope of protection of this application.

[0034] The terms "first," "second," and the like in the specification and claims of this application are used to distinguish similar objects, and are not used to describe a specific order or precedence. It should be understood that the terms used in this manner are interchangeable where appropriate, so that the embodiments of this application can be implemented in an order other than that illustrated or described herein, and that the objects distinguished by "first," "second," and the like are generally of the same type, and do not limit the number of objects; for example, the first object can be one or more. In addition, the term "and / or" in the specification and claims refers to at least one of the connected objects, and the character " / " generally indicates that the objects connected are in an "or" relationship.

[0035] The image processing apparatus, method, and electronic device provided in the embodiments of the present application are described in detail below with reference to specific embodiments and their application scenarios in conjunction with the accompanying drawings.

[0036] FIG1 is a schematic structural diagram of an image processing device 10 according to an embodiment of the present application.

[0037] As shown in FIG1 , the image processing device 10 includes a system-on-chip 11, an independent display chip 12, and a display panel 13. The system-on-chip 11 is used to determine the initial backlight brightness, target backlight brightness, and brightness threshold of the screen, and send the initial backlight brightness and brightness threshold to the independent display chip 12 for initialization. When it is determined that the independent display chip 12 has completed initialization, the image data to be processed and the target backlight brightness are sent to the independent display chip 12. The independent display chip 12 is used to initialize according to the initial backlight brightness and brightness threshold. When initialization is complete, the pixel values ​​of the image data to be processed are adjusted according to the initial backlight brightness, target backlight brightness, and brightness threshold, and the adjusted image data and target backlight brightness are sent to the display panel 13. The display panel 13 is used to display the adjusted image data based on the target backlight brightness.

[0038] The image data to be processed may be a single frame of image data or multiple frames of image data. In the case of multiple frames of image data, the multiple frames of image data may be multiple frames of continuous image data in the same video, which may be, for example, an SDR video. Where the image data to be processed is multiple frames of continuous image data in an SDR video, the SDR2HDR function in the terminal device may be enabled before processing the image data to be processed. For example, when the terminal device is playing an SDR video, if a user wants to improve the image quality of the SDR video so that the SDR video has the display effect of an HDR video, the user may enable the SDR2HDR function of the terminal device (the terminal device may provide an SDR2HDR function enable button, which the user may enable). Alternatively, in other possible implementations, the SDR2HDR function may be enabled automatically by the terminal device. For example, after a user opens a game application in the terminal device, the terminal device may recognize that the current scene is a game scene, and the game screen (which can be considered an SDR video) generally has higher image quality requirements. In this case, the terminal device may enable the SDR2HDR function automatically.

[0039] The aforementioned system-on-chip 11 may be a SoC (System on Chip) in a terminal device. In some embodiments, the system-on-chip 11 may include modules such as a processor core, a digital signal processor, a storage module, a communication interface, a power management module, and a radio frequency front-end. When processing image data, the system-on-chip 11 may determine the initial backlight brightness, target backlight brightness, and brightness threshold of the screen. The initial backlight brightness of the screen may be the backlight brightness of the screen when displaying the image data to be processed. The target backlight brightness of the screen may be the backlight brightness to which the initial backlight brightness needs to be increased. The target backlight brightness may be a set value or calculated by the system-on-chip 11 based on the initial backlight brightness and the brightening capability (e.g., a brightening factor) of the independent display chip 12. The brightness threshold is a comparison threshold that can be used by the independent display chip 12 to identify different regions in the image data so that when the independent display chip 12 adjusts the pixel values ​​of the image data, the pixel values ​​of different regions of the image data can be adjusted to different degrees. The brightness threshold may be a set value or calculated by the system-on-chip 11 based on the initial backlight brightness.

[0040] After determining the initial backlight brightness, target backlight brightness, and brightness threshold of the screen, the system-level chip 11 can send these parameters and the image data to be processed to the independent display chip 12. The sending can be carried out in steps. Specifically, when the image data to be processed is a single frame of image data, the system-level chip 11 can first send the initial backlight brightness and brightness threshold to the independent display chip 12 for initialization. When it is determined that the independent display chip 12 has completed initialization, the image data to be processed and the target backlight brightness are sent to the independent display chip 12. When the image data to be processed is multiple frames of image data, the system-level chip 11 can first send the initial backlight brightness and brightness threshold to the independent display chip 12 for initialization. When it is determined that the independent display chip 12 has completed initialization, the first frame of image data to be processed and the target backlight brightness corresponding to the frame of image data are sent to the independent display chip 12. Then, the second frame of image data to be processed and the target backlight brightness corresponding to the frame of image data are sent to the independent display chip 12. And so on and so forth, until the last frame of image data to be processed and the target backlight brightness corresponding to the frame of image data are sent to the independent display chip 12. Optionally, in some embodiments, if the independent display chip 12 has sufficiently fast processing capabilities, the system-level chip 11 can also send the screen's initial backlight brightness, target backlight brightness, brightness threshold, and the first frame of image data to be processed (if the image data to be processed is a frame of image data, then the first frame of image data here is the frame of image data to be processed) to the independent display chip 12, and then the independent display chip 12 will initialize and process the first frame of image data in a relatively short time. In actual applications, for greater security, the screen's initial backlight brightness, target backlight brightness, brightness threshold, and image data to be processed can be sent in steps.

[0041] When the independent display chip 12 is initialized, the microcontroller unit (MCU) in the independent display chip 12 can optionally initialize the image processing module in the independent display chip 12 (specifically, the module in the independent display chip 12 for adjusting the pixel values ​​of the image data) based on the initial backlight brightness and brightness threshold. Specifically, when the image data to be processed is image data in an SDR video, the image processing module in the independent display chip 12 can be an SDR2HDR module. After the independent display chip 12 has completed initialization, it can send a notification message to the system-level chip 11, which is used to notify the system-level chip 11 that the independent display chip 12 has completed initialization. The system-level chip 12 can confirm whether the independent display chip 12 has completed initialization based on the received notification message. In this way, since the independent display chip 12 can be initialized before processing the image data to be processed, when the independent display chip 12 adjusts the pixel values ​​of the image data to be processed, it can adjust the pixel values ​​based on the initial backlight brightness and brightness threshold at the time of initialization, thereby avoiding errors.

[0042] Based on the image processing device provided by the embodiment of the present application, when processing an image, since the pixel value of the image data can be adjusted according to the initial backlight brightness, target backlight brightness and brightness threshold of the screen, the display brightness of the pixel can be adjusted. Since the initial backlight brightness of the screen can be increased to the target backlight brightness, the backlight brightness of the screen can be increased. Since the display brightness of the pixel and the backlight brightness of the screen are related to the contrast of the image, by adjusting the display brightness of the pixels in the image and increasing the backlight brightness of the screen, the contrast of the image can be greatly increased, further improving the visual effect of the image. In addition, since the image format conversion is not involved when processing the image, when displaying the processed image, there is no need for the terminal device to support the corresponding technical standards, thereby avoiding restrictions on the terminal device and having a wider range of applications. For example, when the image data to be processed is image data in an SDR video, and the image data is processed to obtain the display effect of an HDR video, since the entire image processing process does not involve video format conversion, that is, the SDR video is not converted into an HDR video format, when displaying the processed SDR video, there is no need for the terminal device to support the corresponding HDR technical standard, thereby avoiding restrictions on the terminal device and having a wider range of applications.

[0043] In some embodiments, when the image data to be processed is multiple consecutive frames of image data from the same video, the image data to be processed may include first image data corresponding to transition frames and second image data corresponding to non-transition frames. A transition frame may be a video frame corresponding to the transition from the initial backlight brightness to the target backlight brightness to be increased. The purpose of a transition frame is to avoid video flickering caused by a significant difference in backlight brightness between two adjacent frames when increasing the screen backlight brightness. A non-transition frame is a video frame displayed after the initial backlight brightness is increased to the target backlight brightness. When the image data includes first image data corresponding to transition frames and second image data corresponding to non-transition frames, the target backlight brightness sent by the system-on-chip to the independent display chip may include a first target backlight brightness corresponding to the first image data and a second target backlight brightness corresponding to the second image data, where the first target backlight brightness is less than the second target backlight brightness. The second target backlight brightness is the target backlight brightness to which the initial backlight brightness is ultimately increased, and the second image data of different frames corresponds to the same second target backlight brightness. The first target backlight brightness is the transition brightness corresponding to the transition from the initial backlight brightness to the second target backlight brightness. The first image data of different frames can correspond to different first backlight brightnesses. The first target backlight brightness can slowly increase (linearly or nonlinearly) with the number of frames of the first image data to the second target backlight brightness.

[0044] When the image data includes first image data corresponding to a transition frame and second image data corresponding to a non-transition frame, and the target backlight brightness includes a first target backlight brightness and a second target backlight brightness, the system-on-chip is configured to send the to-be-processed image data and the target backlight brightness to the independent display chip, and may include:

[0045] The system-level chip is used to first send the first image data and the first target backlight brightness to the independent display chip, and then send the second image data and the second target backlight brightness to the independent display chip.

[0046] For example, the first image data includes N frames, and the second image data includes M frames (both N and M are integers greater than 0). Then, when the system-level chip sends the image data and the corresponding target backlight brightness to the independent display chip, it can first send the first frame of first image data and the corresponding first target backlight brightness to the independent display chip, and then send the second frame of first image data and the corresponding first target backlight brightness to the independent display chip, ... and so on, until the Nth frame of first image data and the corresponding first target backlight brightness are sent to the independent display chip, and then continue to send the first frame of second image data and the corresponding second target backlight brightness to the independent display chip, and then send the second frame of second image data and the corresponding second target backlight brightness to the independent display chip, ... and so on, until the Mth frame of second image data and the corresponding second target backlight brightness are sent to the independent display chip.

[0047] In this way, since the image data includes the first image data corresponding to the transition frame and the second image data corresponding to the non-transition frame, the first image data corresponds to the first target backlight brightness, and the second image data corresponds to the second backlight brightness. When the system-level chip sends the image data and the target backlight brightness to the independent display chip, it first sends the first image data and the first target backlight brightness corresponding to the transition frame, and then sends the second image data and the second target backlight brightness corresponding to the non-transition frame. Therefore, when the brightness is subsequently increased, the initial backlight brightness can be smoothly increased to the second target backlight brightness based on the first image data and the first target backlight brightness corresponding to the transition frame to avoid screen flickering.

[0048] It should be noted that when the system-level chip sends the first image data and the corresponding first target backlight brightness to the independent display chip, for a certain transition frame, the first image data and the first target backlight brightness corresponding to the transition frame need to be sent in the same frame and cannot cross frames. Otherwise, there will be a problem of mismatch between the first image data and the first target backlight brightness, resulting in problems with the first target backlight brightness when the initial backlight brightness of the first image data is subsequently increased, and thus the initial backlight brightness cannot smoothly transition to the second target backlight brightness.

[0049] In some embodiments, when the system chip sends the target backlight brightness (the first target backlight brightness or the second target backlight brightness) to the independent display chip, it may specifically send a screen backlight control command to the independent display chip, where the screen backlight control command carries information about the target backlight brightness. Thus, the target backlight brightness can be sent via the screen backlight control command, facilitating subsequent backlight brightness enhancement based on the screen backlight control command.

[0050] In some embodiments, when the image data includes first image data corresponding to a transition frame and second image data corresponding to a non-transition frame, and the target backlight brightness includes a first target backlight brightness and a second target backlight brightness, the system-level chip is further configured to:

[0051] Determine a second target backlight brightness according to the initial backlight brightness and the brightening multiple;

[0052] Determine the number of transition frames;

[0053] The first target backlight brightness is determined according to the number of transition frames, the initial backlight brightness, and the second target backlight brightness.

[0054] The brightening multiple can be determined according to the brightening capability of the independent display chip, or it can also be determined according to the actual brightening requirements, which is not specifically limited here. When determining the second target backlight brightness based on the initial backlight brightness and the brightening multiple, the product of the initial backlight brightness and the brightening multiple can be specifically determined as the second target backlight brightness. For example, if the initial screen brightness is 300nit and the brightening multiple is 2, the second target backlight brightness is 600nit. It should be noted that the second target backlight brightness needs to be less than the maximum backlight brightness that the screen can display. For example, if the maximum backlight brightness that the screen can display is 3000nit, the second target backlight brightness needs to be less than 3000nit.

[0055] The number of transition frames can be determined according to actual needs. For example, if a smoother transition of backlight brightness is required, the number of transition frames can be more; if the transition smoothness requirement is not high, the number of transition frames can be less.

[0056] When determining the first target backlight brightness based on the number of transition frames, the initial backlight brightness, and the second target backlight brightness, if the transition is linear, the first target backlight brightness can be determined according to a linear formula; if the transition is not linear, the first target backlight brightness can be determined according to a nonlinear formula. Taking a linear transition as an example, assuming that the initial screen brightness is 300 nits, the second target screen brightness is 600 nits, and the number of transition frames is 30, then the first target backlight brightness of the i-th transition frame is equal to 300 + i*(600-300) / 30, where i=1, 2, ..., 29, 30.

[0057] In some embodiments, the system-on-chip for determining the brightness threshold may include:

[0058] The system-level chip is used to determine a brightness threshold according to an initial backlight brightness and a preset coefficient, where the preset coefficient is greater than 0 and less than 1.

[0059] When determining the brightness threshold based on the initial backlight brightness and the preset coefficient, the system-level chip may determine the brightness threshold as the product of the initial backlight brightness and the preset coefficient. For example, if the initial backlight brightness is 300 nits and the preset system is 0.4, the brightness threshold is 120 nits.

[0060] In some embodiments, when the target backlight brightness is greater than or equal to the preset backlight brightness, the system-level chip is also used to turn on the high brightness mode (HBM) of the display panel. The preset backlight brightness can be the maximum backlight brightness that the screen is open to the user to adjust. When the high brightness mode is not turned on, the backlight brightness can be increased to the preset backlight brightness. When the high brightness mode is turned on, a greater brightness increase can be achieved. Therefore, when the target backlight brightness is greater than the maximum backlight brightness, it is necessary to turn on the high brightness mode. In the high brightness mode, the backlight brightness of the screen can be increased to the target backlight brightness.

[0061] In some embodiments, the independent display chip is configured to adjust the pixel value of the image data according to the initial backlight brightness, the target backlight brightness, and the brightness threshold, which may include:

[0062] The independent display chip is used to determine a first grayscale value of each pixel value in the image data at the initial screen brightness and a second grayscale value of the brightness threshold at the initial screen brightness;

[0063] The independent display chip is used to determine the low brightness area and the high brightness area of ​​the image data according to the first grayscale value and the second grayscale value;

[0064] The independent display chip is used to adjust the pixel values ​​in the low brightness area and the pixel values ​​in the high brightness area according to the target backlight brightness.

[0065] The first grayscale value and the second grayscale value are grayscale values ​​of brightness. There is a correspondence between pixel values ​​and grayscale values, and the grayscale value of each pixel value in the image data under the initial backlight brightness (i.e., the above-mentioned first grayscale value) can be obtained based on the correspondence. For example, taking a pixel as an example, assuming that the pixel value corresponding to the pixel is (100, 100, 100), and the initial backlight brightness is 300nit, when determining the first grayscale value of the pixel value under the initial backlight brightness of 300nit, the first grayscale value corresponding to the pixel value (100, 100, 100) can be calculated as 100 according to the RGB to YUV formula specified in the BT.709 standard (or the color gamut conversion formula specified in other standards).

[0066] There is also a corresponding relationship between the brightness threshold and the grayscale value. Based on this corresponding relationship, the grayscale value of the brightness threshold at the initial backlight brightness (i.e., the second grayscale value mentioned above) can be obtained. For example, assuming the threshold brightness is 120 nits and the initial screen brightness is 300 nits, when determining the second grayscale value of the brightness threshold of 120 nits at a backlight brightness of 300 nits, the second grayscale value can be obtained as 168 based on the backlight curve of gamma 2.2.

[0067] After obtaining a first grayscale value of each pixel value in the image data at the initial backlight brightness and a second grayscale value of the brightness threshold at the initial backlight brightness, the independent display chip can be used to divide the image data into regions based on the first grayscale value and the second grayscale value to obtain a low-brightness region and a high-brightness region, wherein the first grayscale value corresponding to the pixel value in the low-brightness region is less than the second grayscale value, and the first grayscale value corresponding to the pixel value in the high-brightness region is greater than or equal to the second grayscale value.

[0068] After the low-brightness area and the high-brightness area are divided, the independent display chip can be used to adjust the pixel values ​​in the low-brightness area and the pixel values ​​in the high-brightness area according to the target backlight brightness. The independent display chip adjusts the pixel values ​​in the low-brightness area to a different degree than the pixel values ​​in the high-brightness area.

[0069] In some embodiments, the independent display chip is configured to adjust pixel values ​​in a low-brightness area and pixel values ​​in a high-brightness area according to a target backlight brightness, which may include:

[0070] The independent display chip is used to reduce the pixel value of the low brightness area according to the target backlight brightness, and keep the pixel value of the high brightness area unchanged; or,

[0071] The independent display chip is used to reduce the pixel value of the low brightness area and increase the pixel value of the high brightness area according to the target backlight brightness.

[0072] The size of the pixel value is related to (directly proportional to) the pixel's display brightness, which is in turn related to (directly proportional to) the screen's backlight brightness. The reason for reducing the pixel values ​​in low-brightness areas and increasing or keeping the pixel values ​​in high-brightness areas unchanged is to ensure that after the initial backlight brightness is increased to the target backlight brightness, the display brightness of the pixels in low-brightness areas remains unchanged (or changes slightly), while the display brightness of the pixels in high-brightness areas increases. Because the display brightness difference between pixels is related to (directly proportional to) the contrast ratio, the contrast ratio of the image can be significantly improved by increasing the initial backlight brightness to the target backlight brightness, keeping the display brightness of the pixels in low-brightness areas unchanged, and increasing the display brightness of the pixels in high-brightness areas.

[0073] It should be noted that, in some possible implementations, the pixel value of the high-brightness area can be increased, and the pixel value of the low-brightness area can remain unchanged, or the pixel values ​​of both the high-brightness area and the low-brightness area can be reduced and the adjustment degree of the low-brightness area can be larger, or the pixel values ​​of both the high-brightness area and the low-brightness area can be increased and the adjustment degree of the high-brightness area can be larger. As long as the display brightness difference between the low-brightness area and the high-brightness area can be increased and the picture contrast can be greatly improved, there is no specific limitation on the adjustment method here.

[0074] When the independent display chip adjusts the pixel value of the low brightness area according to the target screen brightness, the adjustment method can be multiple. Optionally, in some embodiments, the independent display chip is used to adjust the pixel value of the low brightness area according to the target backlight brightness, which may include:

[0075] The independent display chip is used to determine an adjustment coefficient according to the initial backlight brightness and the target backlight brightness, and to reduce the pixel value of the low-brightness area according to the adjustment coefficient.

[0076] The adjustment coefficient is greater than 0 and less than 1. When the independent display chip determines the adjustment coefficient according to the initial backlight brightness and the target backlight brightness, optionally, in some embodiments, the adjustment coefficient can be determined by the following formula:

[0077] Among them, a is the adjustment coefficient, L n is the target backlight brightness, and L0 is the initial backlight brightness.

[0078] It should be understood that in other implementations, the adjustment coefficient may also be determined by other methods, which will not be illustrated one by one here.

[0079] After determining the adjustment coefficient, when the pixel value of the low-brightness area is adjusted to a smaller value according to the adjustment coefficient, for each pixel value, the product of the pixel value and the adjustment coefficient can be determined as the adjusted pixel value. Since the adjustment coefficient is less than 1, the pixel value of the low-brightness area can be adjusted to a smaller value.

[0080] When an independent display chip increases the pixel value of a high-brightness area according to the target backlight brightness, there are multiple ways to adjust it. For example, the sum of the pixel value and a preset value (greater than 0) can be determined as the adjusted pixel value, or the product of the pixel value and a specified coefficient (greater than 1, such as the inverse of the above-mentioned adjustment coefficient) can be determined as the adjusted pixel value. As long as the pixel value can be increased, there is no specific limitation on the adjustment method here.

[0081] The above examples illustrate how an independent display chip adjusts the pixel value of image data according to the initial backlight brightness, the target backlight brightness and the brightness threshold. It should be understood that the independent display chip can also adjust the pixel value of image data in other ways, as long as it can ensure that the contrast of the picture can be greatly improved when the brightness is increased. For example, when dividing high-brightness areas and low-brightness areas, the brightness threshold can be converted into a pixel value, and the high-brightness area and the low-brightness area are divided according to the size relationship between the pixel value and the pixel value of the image. For another example, when dividing the area according to the first grayscale value and the second grayscale value, more areas can also be divided, such as a high-brightness area, a medium-brightness area and a low-brightness area. The pixel value of the high-brightness area is increased, the pixel value of the medium-brightness area remains unchanged, and the pixel value of the low-brightness area is reduced. Other possible implementation methods will not be illustrated one by one here.

[0082] In some embodiments, the display panel includes a display driver chip (DDIC), which can be used to provide power and timing signals necessary for the operation of the display panel. After the display panel receives the adjusted image data and target backlight brightness sent by the independent display chip, the display driver chip in the display panel will complete the adjustment of the backlight brightness and the driving display of the image data, that is, the display driver chip increases the initial backlight brightness of the screen to the target backlight brightness and displays the adjusted image data. Since when the pixel values ​​in the image data are adjusted, specifically the pixel values ​​in the low-brightness area are adjusted down and the pixel values ​​in the high-brightness area are adjusted up or remain unchanged, therefore, after the screen backlight is brightened, when the adjusted image data is displayed, the difference between the display brightness of the pixel values ​​in the high-brightness area of ​​the image data and the display brightness of the pixel values ​​in the low-brightness area is large, thereby greatly improving the contrast of the picture and achieving better visual effects.

[0083] In order to facilitate understanding of the image processing device provided in the embodiments of the present application and how the processing device processes image data, some more specific implementation methods shown in Figures 2 and 3 will be used as examples for explanation below.

[0084] Figure 2 is a schematic diagram of an image processing device according to an embodiment of the present application processing image data in an SDR video. The processing device shown in Figure 2 includes a SoC (corresponding to the system-on-chip in the embodiment shown in Figure 1), an independent display IC (corresponding to the independent display chip in the embodiment shown in Figure 1) and a display module (corresponding to the display panel in the embodiment shown in Figure 1). The SoC includes a display serial interface (DSI) and a general purpose input / output port (GPIO). The independent display IC includes a display serial interface receiving module DSIRx, a display serial interface transmitting module DSI Tx, GPIO, an SDR2HDR module and an MCU module. The display module includes a DDIC.

[0085] Assume that the maximum backlight brightness Lmax1 that the terminal screen can display is 3000 nits, and the maximum backlight brightness Lmax2 that is open to user adjustment is 800 nits. The brightening factor of the SDR2HDR function in the independent display IC is set to 2 times, and the brightness threshold Lth is set to 0.4 times the initial backlight brightness L0. When the initial backlight brightness L0 is 300 nits, the user turns on the SDR2HDR function. In this case, the processing device shown in Figure 2 can include the following steps when processing image data in the SDR video:

[0086] Step 1: SoC obtains the initial backlight brightness L0 = 300nit, calculates the brightness threshold Lth = 300*0.4 = 120nit, the second target backlight brightness LN = 300*2 = 600nit, the number of frames corresponding to the transition from the initial backlight brightness to the target backlight brightness is n, and the first target backlight brightness Ln corresponding to each frame image.

[0087] Step 2: SoC sends the initial backlight brightness L0 = 300nit and the brightness threshold Lth = 120nit to the independent display IC through GPIO (transmission interfaces such as I2C and SPI can be used) for the independent display IC to initialize the SDR2HDR module.

[0088] Step 3: After the MCU module of the independent graphics IC receives L0 and Lth, it initializes the SDR2HDR module in the independent graphics IC and notifies the SoC of the initialization success. The SoC sends the image data Dn and the screen backlight control command corresponding to the first target backlight brightness Ln of the frame image to the independent graphics IC via DSI. The independent graphics IC receives the image data Dn and the screen backlight control command corresponding to the first target backlight brightness Ln of the frame image via DSI Rx. It should be noted here that the image data Dn and the screen backlight control command corresponding to the first target backlight brightness Ln corresponding to the frame image need to be sent to the independent graphics IC in the same frame and cannot be sent across frames.

[0089] Step 4: The independent display IC parses the screen backlight control command and obtains the first target backlight brightness Ln. The SDR2HDR module of the independent display IC processes the image data Dn based on the initial backlight brightness L0, the brightness threshold Lth and the first target backlight brightness Ln, specifically including:

[0090] 1) Calculating the first grayscale value of each pixel in the image data Dn at the initial backlight brightness L0 and the second grayscale value of the brightness threshold Lth at the initial backlight brightness L0;

[0091] 2) performing partitioning processing on each pixel in the image data Dn according to the first grayscale value and the second grayscale value, where pixels with a first grayscale value less than the second grayscale value are divided into a low brightness area, and pixels with a first grayscale value greater than or equal to the second grayscale value are divided into a high brightness area;

[0092] 3) Adjusting the pixel values ​​of pixels in different regions based on the first target backlight brightness Ln. Specifically, the pixel values ​​of pixels in low-brightness regions are adjusted downward so that the actual display brightness of the pixels in these regions remains unchanged after the initial backlight brightness is increased to the first target backlight brightness Ln. The pixel values ​​of pixels in high-brightness regions can remain unchanged or be increased.

[0093] Taking a pixel in the image data Dn as an example, the specific implementation method is as follows:

[0094] First, the RGB value of the pixel is obtained, for example (100, 100, 100), and the first grayscale value of the pixel under the initial backlight brightness is calculated. For example, the first grayscale value corresponding to the RGB value (100, 100, 100) can be calculated as 100 according to the RGB to YUV conversion formula specified in the BT.709 standard (or the color gamut conversion formula specified in other standards).

[0095] Next, calculate the second grayscale value of the brightness threshold at the initial backlight brightness. The brightness threshold Lth = 120 nits, the initial backlight brightness L0 = 300 nits, and from the backlight curve of gamma 2.2, it can be obtained that the second grayscale value corresponding to the brightness threshold Lth at a backlight brightness of 300 nits is 168.

[0096] Finally, since the first grayscale value 100 corresponding to (100, 100, 100) is less than 168, the pixel is classified as a low-brightness area. To ensure that the display brightness of the pixel remains unchanged after the screen is brightened, the RGB value of the pixel needs to be reduced. The reduction method can be to multiply the RGB value of the pixel by a fixed coefficient a. The calculation formula of coefficient a is:

[0097] L n The pixel value of (100, 100, 100) is changed to (73, 73, 73) after being processed by the SDR2HDR module.

[0098] Based on the same method, the adjusted pixel value of each pixel in the image data Dn can be calculated.

[0099] Step 5: The independent display IC sends the processed image data Dn and the screen backlight control command corresponding to the first target backlight brightness Ln to the DDIC in the display module, and the DDIC completes the screen backlight adjustment and display driving tasks.

[0100] Step 6: After processing n frames of image data, the backlight brightness of the screen smoothly transitions from the initial backlight brightness of 300 nit to the second target backlight brightness of 600 nit, achieving the SDR2HDR effect.

[0101] Figure 3 is a schematic diagram of an image processing device according to an embodiment of the present invention processing image data in an SDR video. The structure of the processing device shown in Figure 3 is the same as that of the processing device shown in Figure 2, and will not be described in detail here.

[0102] Assume that the maximum backlight brightness Lmax1 that the terminal screen can display is 3000nit, and the maximum backlight brightness Lmax2 open to the user for adjustment is 800nit. The brightening factor of the SDR2HDR function in the independent display IC is set to 2 times, and the brightness threshold Lth is set to 0.4 times the initial backlight brightness L0. The user manually drags the brightness bar to set the initial backlight brightness of the screen to the maximum value Lmax2 (that is, the initial backlight brightness L0 = 800nit) and then turns on the SDR2HDR function. In this case, the processing device shown in Figure 3 may include the following steps when processing the image data in the SDR video:

[0103] Step 1: SoC obtains the initial backlight brightness L0 = 800nit, calculates the brightness threshold Lth = 800*0.4 = 320nit, the second target backlight brightness LN = 800*2 = 1600nit, the number of frames corresponding to the transition from the initial backlight brightness to the target backlight brightness is n, and the first target backlight brightness Ln corresponding to each frame image.

[0104] Step 2: If the SoC determines that the target backlight brightness LN is higher than the maximum brightness Lmax2 open to the user, the SoC turns on the HBM mode of the DDIC. That is, the SoC sends an HBM on command to the independent graphics IC, and the independent graphics IC sends the HBM on command to the display module. The display module turns on the high-brightness mode according to the HBM on command so that the backlight brightness can be brightened subsequently.

[0105] Step 3: SoC sends the initial backlight brightness L0 = 800nit and the brightness threshold Lth = 320nit to the independent display IC through GPIO (transmission interfaces such as I2C and SPI can be used) for the independent display IC to initialize the SDR2HDR module.

[0106] Step 4: After the MCU module of the independent graphics IC receives L0 and Lth, it initializes the SDR2HDR module in the independent graphics IC and notifies the SoC of the initialization success. The SoC sends the image data Dn and the screen backlight control command corresponding to the first target backlight brightness Ln of the frame image to the independent graphics IC via DSI. The independent graphics IC receives the image data Dn and the screen backlight control command corresponding to the first target backlight brightness Ln of the frame image via DSI Rx. It should be noted here that the image data Dn and the screen backlight control command corresponding to the first target backlight brightness Ln corresponding to the frame image need to be sent to the independent graphics IC in the same frame and cannot be sent across frames.

[0107] Step 5: The independent graphics IC parses the screen backlight control command and obtains the first target backlight brightness Ln. The independent graphics IC's SDR2HDR module processes the image data Dn based on the initial backlight brightness L0, the brightness threshold Lth, and the first target backlight brightness Ln. The specific implementation is the same as that of step 4 in the embodiment shown in Figure 2 and will not be repeated here.

[0108] Step 6: The independent display IC sends the processed image data Dn and the screen backlight control command corresponding to the first target backlight brightness Ln to the DDIC in the display module, and the DDIC completes the screen backlight adjustment and display driving tasks.

[0109] Step 7: After processing n frames of image data, the backlight brightness of the screen smoothly transitions from the initial backlight brightness of 800 nit to the second target backlight brightness of 1600 nit, achieving the SDR2HDR effect.

[0110] In an embodiment of the present application, when processing an image, since the pixel value of the image data can be adjusted according to the initial backlight brightness, target backlight brightness and brightness threshold of the screen, the display brightness of the pixel can be adjusted. Since the initial backlight brightness of the screen can be increased to the target backlight brightness, the backlight brightness of the screen can be increased. Since the display brightness of the pixel and the backlight brightness of the screen are related to the contrast of the image, by adjusting the display brightness of the pixel in the image and increasing the backlight brightness of the screen, the contrast of the image can be greatly improved, further improving the visual effect of the image. In addition, since the image format conversion is not involved when processing the image, when displaying the processed image, there is no need for the terminal device to support the corresponding technical standards, thereby avoiding restrictions on the terminal device and having a wider range of applications.

[0111] The image processing device in the embodiment of the present application can be an electronic device or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other device other than a terminal. For example, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a mobile Internet device (MID), an augmented reality (AR) / virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a personal digital assistant (PDA), etc. It can also be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine or a self-service machine, etc., and the embodiment of the present application does not specifically limit it.

[0112] The image processing device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0113] An embodiment of the present application provides an electronic device, which may include the image processing device provided in the embodiment of the present application. When processing an image, the electronic device can significantly improve the contrast of the image, resulting in a better visual effect.

[0114] Optionally, the present application provides an image processing method, as shown in Figure 4. Figure 4 is a flow chart of an image processing method according to an embodiment of the present application, which can be executed by the system-on-chip shown in Figure 1 and can include the following steps.

[0115] S42: Determine the initial backlight brightness, target backlight brightness, and brightness threshold of the screen.

[0116] The initial backlight brightness may be the backlight brightness of the screen when displaying the image data to be processed.

[0117] The target backlight brightness of the screen may be the backlight brightness to which the initial backlight brightness needs to be increased. In some embodiments, when the target backlight brightness is greater than or equal to the preset backlight brightness, a high brightness mode HBM of the display panel may be enabled.

[0118] The brightness threshold is a comparative threshold that can be used by the independent display chip to determine different regions in the image data so that when the independent display chip adjusts the pixel values ​​of the image data, the pixel values ​​of different regions of the image data can be adjusted to different degrees. In some embodiments, determining the brightness threshold may include:

[0119] The brightness threshold is determined according to the initial backlight brightness and a preset coefficient, where the preset coefficient is greater than 0 and less than 1.

[0120] For example, the product of the initial backlight brightness and a preset coefficient may be determined as the brightness threshold.

[0121] S44: Send the initial backlight brightness and brightness threshold to the independent display chip for initialization.

[0122] S46: When it is determined that the independent display chip has completed initialization, the image data to be processed and the target backlight brightness are sent to the independent display chip, the initial backlight brightness, the target backlight brightness and the brightness threshold are used by the independent display chip to adjust the pixel value of the image data, and the adjusted image data and target backlight brightness are sent to the display panel, which displays the adjusted image data based on the target backlight brightness.

[0123] The image data to be processed may be one frame of image data or multiple frames of image data. In the case of multiple frames of image data, the multiple frames of image data may be multiple frames of continuous image data in the same video, which may be an SDR video, for example.

[0124] In some embodiments, when the image data to be processed is a plurality of continuous frames of image data in a video, the image data to be processed may include first image data corresponding to a transition frame and second image data corresponding to a non-transition frame. The target backlight brightness includes a first target backlight brightness corresponding to the first image data and a second target backlight brightness corresponding to the second image data, where the first target backlight brightness is less than the second target backlight brightness. Thus, when the image data to be processed and the target backlight brightness are sent to the independent display chip, the following may be included:

[0125] The first image data and the first target backlight brightness are first sent to the independent display chip, and then the second image data and the second target backlight brightness are sent to the independent display chip.

[0126] In the case where the target backlight brightness includes the first target backlight brightness and the second target backlight brightness, determining the target backlight brightness may further include:

[0127] Determine a second target backlight brightness according to the initial backlight brightness and the brightening multiple;

[0128] Determine the number of transition frames;

[0129] The first target backlight brightness is determined according to the number of transition frames, the initial backlight brightness, and the second target backlight brightness.

[0130] The specific implementation of each step from S42 to S46 mentioned above can refer to the specific implementation of the corresponding steps executed by the system-level chip in the embodiment shown in FIG1 , and can achieve corresponding technical effects, which will not be repeated here.

[0131] Optionally, the present application further provides an image processing method, as shown in Figure 5. Figure 5 is a flow chart of an image processing method according to an embodiment of the present application, which can be executed by the independent display chip shown in Figure 1 and can include the following steps.

[0132] S52: Receive the initial backlight brightness and brightness threshold of the screen sent by the system-level chip.

[0133] S54: Initialization is performed according to the initial backlight brightness and the brightness threshold.

[0134] S56: When initialization is completed, receive the image data to be processed and the target backlight brightness sent by the system-level chip.

[0135] S58: Adjusting the pixel values ​​of the image data according to the initial backlight brightness, the target backlight brightness and the brightness threshold.

[0136] In some embodiments, adjusting the pixel value of the image data according to the initial backlight brightness, the target backlight brightness, and the brightness threshold may include:

[0137] Determining a first grayscale value of each pixel value in the image data at the initial backlight brightness and a second grayscale value of the brightness threshold at the initial screen brightness;

[0138] determining a low brightness area and a high brightness area of ​​the image data according to the first grayscale value and the second grayscale value;

[0139] The pixel values ​​in the low brightness area and the pixel values ​​in the high brightness area are adjusted according to the target backlight brightness.

[0140] In some embodiments, adjusting the pixel values ​​in the low brightness area and the pixel values ​​in the high brightness area according to the target backlight brightness includes:

[0141] According to the target backlight brightness, the pixel values ​​of the low-brightness area are adjusted to a smaller value, while the pixel values ​​of the high-brightness area remain unchanged; or

[0142] According to the target backlight brightness, the pixel values ​​in the low-brightness area are adjusted to be smaller, and the pixel values ​​in the high-brightness area are adjusted to be larger.

[0143] In some embodiments, reducing the pixel value of the low brightness area according to the target backlight brightness may include:

[0144] An adjustment coefficient is determined according to the initial backlight brightness and the target backlight brightness, and the pixel value of the low-brightness area is adjusted to be smaller according to the adjustment coefficient.

[0145] S510: Sending the adjusted image data and the target backlight brightness to the display panel, and the display panel displays the adjusted image data based on the target backlight brightness.

[0146] The specific implementation of each step from S52 to S510 can refer to the specific implementation of the corresponding steps executed by the independent display chip in the embodiment shown in FIG1 , and can achieve corresponding technical effects, which will not be repeated here.

[0147] Optionally, as shown in Figure 6, an embodiment of the present application also provides an electronic device 600, including a processor 601 and a memory 602, and the memory 602 stores a program or instruction that can be run on the processor 601. When the program or instruction is executed by the processor 601, the various steps of the above-mentioned image processing method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0148] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

[0149] FIG7 is a schematic diagram of the hardware structure of an electronic device implementing an embodiment of the present application.

[0150] The electronic device 700 includes but is not limited to components such as a radio frequency unit 701 , a network module 702 , an audio output unit 703 , an input unit 704 , a sensor 705 , a display unit 706 , a user input unit 707 , an interface unit 708 , a memory 709 , and a processor 710 .

[0151] Those skilled in the art will appreciate that the electronic device 700 may further include a power source (e.g., a battery) to power various components. The power source may be logically connected to the processor 710 via a power management system, thereby enabling the power management system to manage charging, discharging, and power consumption. The electronic device structure shown in FIG7 does not limit the electronic device. The electronic device may include more or fewer components than shown, or may combine certain components or arrange the components differently, which will not be described in detail here.

[0152] The processor 710 is configured to:

[0153] Determine the initial backlight brightness, target backlight brightness and brightness threshold of the screen;

[0154] Sending the initial backlight brightness and the brightness threshold to an independent display chip for initialization;

[0155] When it is determined that the independent display chip has completed initialization, the image data to be processed and the target backlight brightness are sent to the independent display chip, the initial backlight brightness, the target backlight brightness and the brightness threshold are used by the independent display chip to adjust the pixel value of the image data, and the adjusted image data and the target backlight brightness are sent to the display panel, and the display panel displays the adjusted image data based on the target backlight brightness.

[0156] Alternatively, the processor 710 is configured to:

[0157] Initializing according to the initial backlight brightness and the brightness threshold;

[0158] When initialization is completed, receiving the image data to be processed and the target backlight brightness sent by the system-level chip;

[0159] adjusting pixel values ​​of the image data according to the initial backlight brightness, the target backlight brightness, and the brightness threshold;

[0160] The adjusted image data and the target backlight brightness are sent to a display panel, and the display panel displays the adjusted image data based on the target backlight brightness.

[0161] In this way, when processing an image, since the pixel values ​​of the image data can be adjusted according to the initial backlight brightness, target backlight brightness, and brightness threshold of the screen, the display brightness of the pixels can be adjusted. Since the initial backlight brightness of the screen can be increased to the target backlight brightness, the backlight brightness of the screen can be increased. Since the display brightness of the pixels and the backlight brightness of the screen are related to the contrast of the image, by adjusting the display brightness of the pixels in the image and increasing the backlight brightness of the screen, the contrast of the image can be greatly increased, further improving the visual effect of the image. In addition, since the image format conversion is not involved when processing the image, when displaying the processed image, there is no need for the terminal device to support the corresponding technical standards, thereby avoiding restrictions on the terminal device and having a wider range of applications.

[0162] It should be understood that in an embodiment of the present application, the input unit 704 may include a graphics processing unit (GPU) 7041 and a microphone 7042, and the graphics processor 7041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 706 may include a display panel 7061, and the display panel 7061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 707 includes a touch panel 7071 and at least one of other input devices 7072. The touch panel 7071 is also called a touch screen. The touch panel 7071 may include two parts: a touch detection device and a touch controller. Other input devices 7072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and an operating stick, which will not be repeated here.

[0163] The memory 709 can be used to store software programs and various data. The memory 709 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, applications or instructions required for at least one function (such as a sound playback function, an image playback function, etc.). In addition, the memory 709 may include a volatile memory or a non-volatile memory, or the memory 709 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM), and a direct memory bus random access memory (DRRAM). The memory 709 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0164] Processor 710 may include one or more processing units. Optionally, processor 710 integrates an application processor and a modem processor. The application processor primarily handles operations related to the operating system, user interface, and application programs, while the modem processor primarily processes wireless communication signals, such as a baseband processor. It is understood that the modem processor may not be integrated into processor 710.

[0165] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned image processing method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0166] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0167] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned image processing method embodiment and achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0168] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0169] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned image processing method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0170] It should be noted that, in this article, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the statement "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device comprising the element. In addition, it should be noted that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in the opposite order according to the functions involved. For example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0171] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), including a number of instructions for enabling a terminal (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in each embodiment of the present application.

[0172] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of this application, ordinary technicians in this field can also make many forms without departing from the purpose of this application and the scope of protection of the claims, all of which are within the protection of this application.

Claims

1. An image processing device comprising a system-on-chip, an independent display chip, and a display panel, wherein: The system-level chip is used to determine the initial backlight brightness, target backlight brightness and brightness threshold of the screen, send the initial backlight brightness and the brightness threshold to the independent display chip for initialization, and send the image data to be processed and the target backlight brightness to the independent display chip when it is determined that the independent display chip has completed initialization; The independent display chip is configured to be initialized according to the initial backlight brightness and the brightness threshold, and when the initialization is completed, adjust the pixel values ​​of the image data according to the initial backlight brightness, the target backlight brightness, and the brightness threshold, and send the adjusted image data and the target backlight brightness to the display panel; The display panel is configured to display the adjusted image data based on the target backlight brightness.

2. The device according to claim 1, wherein In the case where the image data to be processed is image data in a video, the image data to be processed includes first image data corresponding to a transition frame and second image data corresponding to a non-transition frame; The target backlight brightness includes a first target backlight brightness corresponding to the first image data and a second target backlight brightness corresponding to the second image data, and the first target backlight brightness is smaller than the second target backlight brightness; The system-level chip is used to send the image data to be processed and the target backlight brightness to the independent display chip, including: The system-level chip is used to first send the first image data and the first target backlight brightness to the independent display chip, and then send the second image data and the second target backlight brightness to the independent display chip.

3. The device according to claim 2, wherein The system-on-chip is also used for: Determining the second target backlight brightness according to the initial backlight brightness and the brightness increase factor; determining the number of the transition frames; The first target backlight brightness is determined according to the number of the transition frames, the initial backlight brightness, and the second target backlight brightness.

4. The device according to claim 1, wherein The system-level chip is used to determine the brightness threshold, including: The system-level chip is used to determine the brightness threshold according to the initial backlight brightness and a preset coefficient, where the preset coefficient is greater than 0 and less than 1.

5. The device according to claim 1, wherein When the target backlight brightness is greater than or equal to the preset backlight brightness, the system-on-chip is further configured to enable a high brightness mode (HBM) of the display panel.

6. The device according to claim 1, wherein The independent display chip is configured to adjust the pixel value of the image data according to the initial backlight brightness, the target backlight brightness, and the brightness threshold, including: The independent display chip is used to determine a first grayscale value of each pixel value in the image data at the initial backlight brightness and a second grayscale value of the brightness threshold at the initial backlight brightness; The independent display chip is used to determine the low brightness area and the high brightness area of ​​the image data according to the first grayscale value and the second grayscale value; The independent display chip is used to adjust the pixel values ​​in the low brightness area and the pixel values ​​in the high brightness area according to the target backlight brightness.

7. The device according to claim 6, wherein The independent display chip is used to adjust the pixel values ​​in the low brightness area and the pixel values ​​in the high brightness area according to the target backlight brightness, including: The independent display chip is used to reduce the pixel value of the low brightness area according to the target backlight brightness, and keep the pixel value of the high brightness area unchanged; or The independent display chip is used to reduce the pixel value of the low brightness area and increase the pixel value of the high brightness area according to the target backlight brightness.

8. The device according to claim 7, wherein The independent display chip is used to reduce the pixel value of the low brightness area according to the target backlight brightness, including: The independent display chip is used to determine an adjustment coefficient according to the initial backlight brightness and the target backlight brightness, and to reduce the pixel value of the low-brightness area according to the adjustment coefficient. 9 . An electronic device comprising the image processing device according to claim 1 .

10. An image processing method, comprising: Determine the initial backlight brightness, target backlight brightness and brightness threshold of the screen; Sending the initial backlight brightness and the brightness threshold to an independent display chip for initialization; When it is determined that the independent display chip has completed initialization, the image data to be processed and the target backlight brightness are sent to the independent display chip, the initial backlight brightness, the target backlight brightness and the brightness threshold are used by the independent display chip to adjust the pixel value of the image data, and the adjusted image data and the target backlight brightness are sent to the display panel, and the display panel displays the adjusted image data based on the target backlight brightness.

11. An image processing method, comprising: Receive the initial backlight brightness and brightness threshold of the screen sent by the system-level chip; Initializing according to the initial backlight brightness and the brightness threshold; When initialization is completed, receiving the image data to be processed and the target backlight brightness sent by the system-level chip; adjusting pixel values ​​of the image data according to the initial backlight brightness, the target backlight brightness, and the brightness threshold; The adjusted image data and the target backlight brightness are sent to a display panel, and the display panel displays the adjusted image data based on the target backlight brightness.

12. A readable storage medium storing a program or instruction, wherein the program or instruction, when executed by a processor, implements the steps of the image processing method according to claim 10 or 11.

Citation Information

Patent Citations

  • Display driving device, display driving method and display equipment

    CN113053327A

  • Image processing method, device and equipment

    CN115457920A

  • Image processing method and electronic equipment

    CN116466899A

  • Electronic device

    CN117373396A

  • Image processing device and method and electronic equipment

    CN118101865A