Backlight adjustment method, device, terminal and storage medium
By upsampling the curves and brightness histograms of the LCD monitor, the backlight brightness is adjusted to match the image brightness requirements, solving the problem of power waste when displaying high-brightness pixels in the LCD monitor and achieving more efficient energy consumption.
Patent Information
- Application Number
- CN202211486041.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-11-24
- Publication Date
- 2025-12-02
- Estimated Expiration
- 2042-11-24
AI Technical Summary
When displaying high-brightness pixel images, existing LCD monitors typically maintain maximum backlight brightness, resulting in wasted power consumption.
By acquiring the curve and brightness histogram of the target image, upsampling is performed using the curve slope, and the backlight brightness of the display screen is adjusted to match the image brightness requirements.
It reduces the power consumption of the display screen and improves the energy efficiency of the displayed images.
Smart Images

Figure CN115798419B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of computer technology, and in particular to a backlight adjustment method, apparatus, terminal and storage medium. Background Technology
[0002] With the development of LCD technology, users are increasingly demanding higher image quality from LCD displays. Since liquid crystals themselves do not emit light, a backlight is required to display images on an LCD. In related technologies, LCDs typically operate with the backlight at maximum brightness when displaying images. However, this leads to wasted power consumption when displaying images with only a few high-brightness pixels. Summary of the Invention
[0003] This application provides a backlight adjustment method, apparatus, terminal, and storage medium, which can reduce power consumption by adjusting the backlight brightness of the display screen. The technical solution is as follows:
[0004] On the one hand, a backlight adjustment method is provided, the method comprising:
[0005] Acquire a target image, a first curve of the target image, and a first brightness histogram of the target image. The first curve is used to indicate the correspondence between the brightness of the target image and the backlight brightness of the display screen, and the first brightness histogram is used to indicate the relationship between the number of pixels in the target image and the brightness of the pixels.
[0006] Based on the slope of at least one curve in the first curve, the first curve and the first brightness histogram are upsampled respectively to obtain the second curve and the second brightness histogram.
[0007] Based on the second curve and the second brightness histogram, adjust the backlight brightness of the display screen.
[0008] On the other hand, a backlight adjustment device is provided, the device comprising:
[0009] The first acquisition module is used to acquire a target image, a first curve of the target image, and a first brightness histogram of the target image. The first curve is used to indicate the correspondence between the brightness of the target image and the backlight brightness of the display screen, and the first brightness histogram is used to indicate the relationship between the number of pixels in the target image and the brightness of the pixels.
[0010] The upsampling module is used to upsample the first curve and the first brightness histogram based on the slope of at least one curve in the first curve to obtain a second curve and a second brightness histogram.
[0011] The adjustment module is used to adjust the backlight brightness of the display screen based on the second curve and the second brightness histogram.
[0012] In some embodiments, the upsampling module includes:
[0013] The first determining unit is used to determine at least one point on the curve based on at least one curve slope in the first curve graph, with one point corresponding to one curve slope.
[0014] The first division unit is used to divide the first curve into at least two curve regions and the first brightness histogram into at least two histogram regions based on the reference brightness represented by the abscissa of the at least one point.
[0015] The first upsampling unit is used to upsample the at least two curve regions at different ratios to obtain the second curve.
[0016] The second upsampling unit is used to upsample the at least two histogram regions at different ratios to obtain the second brightness histogram.
[0017] In some embodiments, the first upsampling unit is further configured to, for any one of the at least two curve regions, determine the upsampling ratio of the curve region based on the relationship between the slope of the curve within the curve region and the slope at the endpoint of the curve within the curve region;
[0018] The second upsampling unit is further configured to determine, based on the upsampling ratio of the curve region, the ratio of upsampling the histogram region corresponding to the curve region in the at least two histogram regions.
[0019] In some embodiments, the adjustment module includes:
[0020] A brightness determination unit is used to determine the target brightness of the target image based on the second brightness histogram, wherein the target brightness is the largest brightness among a plurality of candidate brightness values, and the number of pixels corresponding to the candidate brightness values is greater than a number threshold.
[0021] A backlight determination unit is used to determine the target backlight brightness corresponding to the target brightness from the second curve graph;
[0022] An adjustment unit is used to adjust the backlight brightness of the display screen to the target backlight brightness.
[0023] In some embodiments, the apparatus further includes:
[0024] The second acquisition module is used to acquire the target image, the third curve of the target image, and the third brightness histogram of the target image. The third curve is used to indicate the correspondence between the brightness of the target image and the backlight brightness, and the third brightness histogram is used to indicate the relationship between the number of pixels and the brightness of the pixels in the target image.
[0025] The downsampling module is used to downsample the third curve and the third brightness histogram based on the slope of at least one curve in the third curve to obtain the first curve and the first brightness histogram.
[0026] The storage module is used to store the target image, a first curve of the target image, and a first brightness histogram of the target image.
[0027] In some embodiments, the downsampling module includes:
[0028] The second determining unit is used to determine at least one point on the curve based on at least one curve slope on the curve in the third curve graph, with one point corresponding to one curve slope.
[0029] The second division unit is used to divide the third curve into at least two curve regions and the third brightness histogram into at least two histogram regions based on the reference brightness represented by the abscissa of the at least one point.
[0030] The first downsampling unit is used to downsample the at least two curve regions at different ratios to obtain the first curve graph.
[0031] The second downsampling unit is used to downsample the at least two histogram regions at different ratios to obtain the first brightness histogram.
[0032] In some embodiments, the adjustment module is further configured to adjust the brightness of pixels in the target image based on the backlight brightness of the display screen; and display the target image based on the backlight brightness and the brightness of pixels in the target image.
[0033] On the other hand, a terminal is provided, the terminal including a processor and a memory; the memory stores at least one piece of program code, the at least one piece of program code being executed by the processor to implement the backlight adjustment method as described above.
[0034] On the other hand, a computer-readable storage medium is provided that stores at least one piece of program code, the at least one piece of program code being executed by a processor to implement the backlight adjustment method as described above.
[0035] On the other hand, a computer program product is provided, including a computer program loaded and executed by a processor to implement the backlight adjustment method as described above.
[0036] This application provides a backlight adjustment method. Since the slope of the curve at different points in the first curve graph varies, and this slope reflects the rate of change of the curve, upsampling of the first curve graph and the first brightness histogram based on at least one curve slope in the first curve graph allows for more accurate and smooth expansion of the first curve graph and the first brightness histogram based on the rate of change of the curve, resulting in a second curve graph and a second brightness histogram with more sampling points. Since the brightness histogram indicates the relationship between the number of pixels in the target image and the brightness of the pixels, and the curve graph indicates the correspondence between the brightness of the target image and the backlight brightness, the rich sampling points in the second brightness histogram and the second curve graph allow for a more accurate determination of the appropriate backlight brightness when displaying the target image. This adjusts the backlight brightness when the display screen shows the target image, reducing power consumption compared to maximizing the backlight brightness when displaying any image. Attached Figure Description
[0037] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0038] Figure 1 This is a schematic diagram of an implementation environment provided in an embodiment of this application;
[0039] Figure 2 This is a flowchart of a backlight adjustment method provided in an embodiment of this application;
[0040] Figure 3 This is a flowchart of another backlight adjustment method provided in the embodiments of this application;
[0041] Figure 4 This is a schematic diagram of a third curve provided in an embodiment of this application;
[0042] Figure 5 This is a schematic diagram of another third curve provided in an embodiment of this application;
[0043] Figure 6 This is a schematic diagram of a first graph provided in an embodiment of this application;
[0044] Figure 7This is a schematic diagram of a first brightness histogram provided in an embodiment of this application;
[0045] Figure 8 This is a schematic diagram of a second brightness histogram provided in an embodiment of this application;
[0046] Figure 9 This is a schematic diagram of a second graph provided in an embodiment of this application;
[0047] Figure 10 This is a structural block diagram of a backlight adjustment device provided in an embodiment of this application;
[0048] Figure 11 This is a structural block diagram of another backlight adjustment device provided in the embodiments of this application;
[0049] Figure 12 This is a structural block diagram of a terminal provided in an embodiment of this application. Detailed Implementation
[0050] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described in further detail below with reference to the accompanying drawings.
[0051] It is understood that the terms "first," "second," etc., used in this application may be used to describe various concepts herein, but unless otherwise stated, these concepts are not limited by these terms. These terms are only used to distinguish one concept from another. For example, without departing from the scope of this application, a first luminance histogram may be referred to as a second luminance histogram, and similarly, a second luminance histogram may be referred to as a first luminance histogram.
[0052] "At least one" refers to one or more second brightness levels. For example, at least one second brightness level can be any integer number of second brightness levels greater than or equal to one, such as one second brightness level, two second brightness levels, three second brightness levels, etc. "Multiple" refers to two or more second brightness levels. For example, multiple second brightness levels can be any integer number of second brightness levels greater than or equal to two, such as two second brightness levels, three second brightness levels, etc. "Each" refers to each of the at least one second brightness level. For example, each second brightness level refers to each of the multiple second brightness levels. If the multiple second brightness levels are three second brightness levels, then each second brightness level refers to each of the three second brightness levels.
[0053] It should be noted that all information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.), and signals involved in this application have been authorized by the user or fully authorized by all parties, and the collection, use, and processing of related data must comply with the relevant laws, regulations, and standards of the relevant countries and regions. For example, the target images involved in this application were all obtained with full authorization.
[0054] Figure 1 This is a schematic diagram of an implementation environment provided in an embodiment of this application. See also... Figure 1 The implementation environment includes terminal 101 and server 102.
[0055] Terminal 101 can be at least one of the following devices: LCD monitor, smartphone, smartwatch, desktop computer, laptop, MP3 player (Moving Picture Experts Group Audio Layer III), MP4 player (Moving Picture Experts Group Audio Layer IV), and laptop computer. An application can be installed and run on terminal 101 to display the target image. Users can log in to the application through terminal 101 to view the target image. Terminal 101 can be connected to server 102 via a wireless network or wired network.
[0056] Terminal 101 can refer to one of multiple terminals; this embodiment uses terminal 101 as an example. Those skilled in the art will understand that the number of terminals can be more or less. For example, there may be several terminals, or dozens or hundreds, or even more. This embodiment does not limit the number of terminals or the type of devices. The application is associated with server 102, which provides background services.
[0057] Server 102 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms. Server 102 is associated with the aforementioned application and provides background services to the application. In some embodiments, terminal 101, based on the application, obtains a target image, a first curve of the target image, and a first brightness histogram of the target image from server 102, and displays the target image through the application. In some embodiments, terminal 101 includes a TCON (Timing Controller) and a display. The display is used to display a target image. After receiving the target image, the first curve of the target image, and the first brightness histogram of the target image sent by the server 102, the TCON determines the backlight brightness of the display screen when displaying the target image based on the backlight adjustment method provided in this application embodiment. It then converts the target image into a timing signal required for the display to display the target image, and transmits the pixel data of the target image and the backlight brightness of the display screen to the display, thereby achieving the purpose of the display showing the target image based on the backlight brightness. Optionally, the backlight adjustment method provided in this application embodiment can also be executed by the CPU (Central Processing Unit) of the terminal. Alternatively, after receiving the target image, the first curve of the target image, and the first brightness histogram of the target image sent by the server 102, an external server processes the first curve and the first brightness histogram of the target image based on the backlight adjustment method provided in this application embodiment to determine the backlight brightness of the display screen when displaying the target image. This application embodiment does not impose any limitations on this.
[0058] In some embodiments, server 102 undertakes the primary computing task, and terminal 101 undertakes the secondary computing task; or, server 102 undertakes the secondary computing task, and terminal 101 undertakes the primary computing task; or, server 102 and terminal 101 collaborate on computing using a distributed computing architecture. Server 102 can connect to terminal 101 and other terminals via a wireless network or a wired network. Optionally, the number of servers can be more or less, and this embodiment does not limit this. Of course, server 102 may also include other functional servers to provide more comprehensive and diversified services.
[0059] Figure 2 This is a flowchart of a backlight adjustment method provided in an embodiment of this application. The method is executed by a terminal; see [link to relevant documentation]. Figure 2The method includes:
[0060] 201. The terminal acquires a target image, a first curve of the target image, and a first brightness histogram of the target image. The first curve is used to indicate the correspondence between the brightness of the target image and the backlight brightness of the display screen, and the first brightness histogram is used to indicate the relationship between the number of pixels in the target image and the brightness of the pixels.
[0061] In this embodiment, the terminal is a device with a display screen, such as a mobile phone, desktop computer, laptop computer, or smart TV. The target image can be an image to be displayed or an image of any frame from a video to be displayed. Accordingly, the terminal can display the target image through the display screen. Optionally, the display screen is a liquid crystal display screen. The terminal can acquire the target image, a first curve of the target image, and a first luminance histogram of the target image. The terminal can acquire the target image, the first curve of the target image, and the first luminance histogram of the target image locally, or it can acquire the target image, the first curve of the target image, and the first luminance histogram of the target image from a server. Accordingly, in response to the acquisition command sent by the terminal, the server sends the target image, the first curve of the target image, and the first luminance histogram of the target image to the terminal.
[0062] Since the display screen itself does not emit light, the terminal needs to turn on the screen's backlight to display images. The target image contains multiple pixels, and different pixels have different brightness levels. In the first brightness histogram, the horizontal axis represents the pixel brightness, and the vertical axis represents the number of pixels. Based on this first brightness histogram, the number of pixels corresponding to a given brightness level can be determined. The number of pixels in the target image is positively correlated with the target image's resolution. The higher the resolution, the more pixels in the image, and the clearer the image; the lower the resolution, the fewer pixels in the image, and the blurrier the image. In the first curve, the horizontal axis represents the target image brightness, and the vertical axis represents the display screen's backlight brightness. In related technologies, the horizontal axis of the curve represents the highest brightness of a pixel in the corresponding image. However, in this embodiment, the brightness of the target image is one of the brightness levels of all pixels in the target image, and this brightness represents the brightness of pixels in the target image that exceed a preset threshold. The preset threshold can be 60%, 70%, or 80% of the total number of pixels in the target image; however, this embodiment does not limit the specific number of the preset threshold. Accordingly, based on the first brightness histogram and the first curve of the target image, the terminal can determine the backlight brightness when the display screen shows the target image.
[0063] 202. The terminal upsamples the first curve and the first brightness histogram based on the slope of at least one curve in the first curve to obtain the second curve and the second brightness histogram.
[0064] In this embodiment, the first curve graph includes a curve, where the horizontal axis of a point on the curve represents the brightness of the target image, and the vertical axis represents the backlight brightness of the display screen. Since the slope of the curve varies at different points on the first curve graph, and this slope reflects the rate of change of the curve, the terminal can divide the curve in the first curve graph into at least two curve segments based on the brightness corresponding to at least one curve slope. The slopes of different curve segments change at different rates. The terminal obtains the second curve graph by upsampling the at least two curve segments at different ratios. Similarly, the terminal also divides the first brightness histogram into at least two parts based on the brightness corresponding to at least one curve slope. The terminal obtains the second brightness histogram by upsampling the histograms of the at least two parts at different ratios. By upsampling the first curve graph and the first brightness histogram based on the rate of change of the curve, a more accurate and smooth expansion of the first curve graph and the first brightness histogram can be achieved, resulting in a second curve graph and a second brightness histogram with more sampling points.
[0065] 203. The terminal adjusts the backlight brightness of the display screen based on the second curve and the second brightness histogram.
[0066] In this embodiment, the terminal determines a brightness level from the second brightness histogram based on the correspondence between the number of pixels and the brightness of the pixels in the target image, indicated by the second brightness histogram. Then, based on the correspondence between the brightness of the target image and the backlight brightness of the display screen, indicated by a second curve, the terminal determines the corresponding backlight brightness of the display screen, thereby determining a suitable backlight brightness for displaying the target image. The terminal adjusts the backlight brightness of the display screen to display the target image.
[0067] This application provides a backlight adjustment method. Since the slope of the curve at different points in the first curve graph varies, and this slope reflects the rate of change of the curve, upsampling of the first curve graph and the first brightness histogram based on at least one curve slope in the first curve graph allows for more accurate and smooth expansion of the first curve graph and the first brightness histogram based on the rate of change of the curve, resulting in a second curve graph and a second brightness histogram with more sampling points. Since the brightness histogram indicates the relationship between the number of pixels in the target image and the brightness of the pixels, and the curve graph indicates the correspondence between the brightness of the target image and the backlight brightness, the rich sampling points in the second brightness histogram and the second curve graph allow for a more accurate determination of the appropriate backlight brightness when displaying the target image. This adjusts the backlight brightness when the display screen shows the target image, reducing power consumption compared to maximizing the backlight brightness when displaying any image.
[0068] Figure 3 This is a flowchart of another backlight adjustment method provided in an embodiment of this application. This method is executed by a terminal; see [link to relevant documentation]. Figure 3 The method includes:
[0069] 301. The terminal acquires the target image, the third curve of the target image, and the third brightness histogram of the target image. The third curve is used to indicate the correspondence between the brightness of the target image and the backlight brightness, and the third brightness histogram is used to indicate the relationship between the number of pixels in the target image and the brightness of the pixels.
[0070] In this embodiment, the target image can be an image to be displayed or an image from any frame of a video to be displayed. The terminal can obtain the target image, its third curve, and its third luminance histogram from the server. The third curve is a curve of the target image without compression, and the third luminance histogram is a luminance histogram of the target image without compression. Here, "without compression" means that the initial sampling points are retained; correspondingly, after compression (as in sampling), the number of sampling points will be reduced.
[0071] In some embodiments, the terminal can directly adjust the backlight brightness of the display screen based on the third curve and the third luminance histogram, without performing steps 302-309 below. Accordingly, the terminal determines a luminance from the third luminance histogram based on the number of pixels in the target image. The terminal then determines the corresponding backlight brightness of the display screen from the third curve. The terminal adjusts the backlight brightness of the display screen to display the target image.
[0072] It should be noted that, since the third curve and the third brightness histogram occupy a large amount of storage space, the terminal can compress the third curve and the third brightness histogram by performing the following step 302 to reduce the storage space occupied by the third curve and the third brightness histogram.
[0073] 302. The terminal downsamples the third curve and the third brightness histogram based on the slope of at least one curve in the third curve to obtain a first curve and a first brightness histogram. The first curve is used to indicate the correspondence between the brightness of the target image and the backlight brightness of the display screen, and the first brightness histogram is used to indicate the relationship between the number of pixels in the target image and the brightness of the pixels.
[0074] In this embodiment, the third curve graph includes a curve, where the horizontal axis of a point on the curve represents the brightness of the target image, and the vertical axis represents the backlight brightness of the display screen. Since the slope of the curve varies at different points on the third curve graph, and this slope reflects the rate of change of the curve, the terminal can divide the third curve graph into at least two curve segments based on the brightness corresponding to at least one curve slope. The slopes of different curve segments change at different rates. The terminal obtains the first curve graph by downsampling the at least two curve segments at different ratios. Similarly, the terminal also divides the third brightness histogram into at least two parts based on the brightness corresponding to at least one curve slope. The terminal obtains the first brightness histogram by downsampling the histograms of the at least two parts at different ratios.
[0075] For example, see Figure 4 The third graph shown includes four curves, each corresponding to a different display screen. Comparing these four curves reveals that the curves for different display screens have different shapes. Display screen 1 has the largest curvature; the curve is very steep when the brightness is less than 100 nits, and very flat when the brightness is greater than 100 nits. Display screen 4 has the smallest curvature; the curve is relatively steep when the brightness is less than 400 nits, and relatively flat when the brightness is greater than 400 nits. According to... Figure 4 It can also be seen that the slope of the curve is different at different points on each curve, and the slope of the curve can reflect the different rates of change of the curve.
[0076] Since the at least one curve slope can be one or more, the terminal downsamples the third curve and the third brightness histogram based on one curve slope. Alternatively, the terminal downsamples the third curve and the third brightness histogram based on multiple curve slopes. By downsampling the third curve and the third brightness histogram separately based on at least one curve slope, the third curve and the third brightness histogram can be compressed separately, reducing the storage space occupied by storing the third curve and the third brightness histogram.
[0077] In some embodiments, the terminal can downsample the third curve and the third brightness histogram based on multiple curve slopes. Correspondingly, the terminal divides the third curve into multiple curve regions based on the multiple curve slopes. The slopes of different curve regions change at different rates. The terminal obtains the first curve by downsampling the multiple curve regions at different ratios. Similarly, since the horizontal axis of the first brightness histogram represents pixel brightness, the terminal also divides the third brightness histogram into multiple histogram regions based on the brightness corresponding to the multiple curve slopes. The terminal obtains the first brightness histogram by downsampling the histograms of the multiple histogram regions at different ratios. By using multiple curve slopes, the terminal can determine the downsampling ratio for each curve region in the third curve based on the rate of change of the curves within multiple curve regions in the third curve. This allows the terminal to determine the downsampling ratio for the histogram regions corresponding to the multiple curve regions in the third brightness histogram. This enables a more accurate and smooth reduction of the first curve and the first brightness histogram, resulting in a second curve and a second brightness histogram with fewer sampling points, thus saving the terminal's storage space.
[0078] In some embodiments, the terminal can downsample the third curve and the third brightness histogram based on a curve slope. Accordingly, the terminal divides the third curve into two curve regions based on a curve slope. The curve slopes of the different curve regions change at different rates. The terminal obtains the first curve by downsampling the two curve regions at different ratios. Similarly, since the horizontal axis of the first brightness histogram represents pixel brightness, the terminal also divides the third brightness histogram into two histogram regions based on the brightness corresponding to the two curve slopes. The terminal obtains the first brightness histogram by downsampling the histograms of the two histogram regions at different ratios. By using a curve slope, the terminal can determine the downsampling ratio for the two curve regions in the third curve based on the rate of change of the curves in the two curve regions. This allows the terminal to determine the downsampling ratio for the histogram regions in the third brightness histogram corresponding to the two curve regions. This enables a more accurate and smooth reduction of the first curve and the first brightness histogram, resulting in a second curve and a second brightness histogram with fewer sampling points, thus saving the terminal's storage space.
[0079] In some embodiments, the terminal can determine at least one point on the curve based on at least one curve slope, and divide the third curve and the third brightness histogram based on the brightness represented by the abscissa of the at least one point, and then downsample at least two curve regions and at least two histogram regions respectively. Accordingly, the terminal downsamples the third curve and the third brightness histogram through the following steps (1)-(4).
[0080] (1) The terminal determines at least one point on the curve based on at least one curve slope in the third curve graph, with one point corresponding to one curve slope.
[0081] In this embodiment, the third curve graph includes a curve, where the horizontal axis of a point on the curve represents the brightness of the target image, and the vertical axis represents the backlight brightness of the display screen. Since the slope of the curve varies at different points in the first curve graph, the terminal can determine at least one point on the curve based on at least one curve slope in the first curve graph. This at least one curve slope can be one or more; correspondingly, the terminal determines a point on the curve based on one curve slope. Alternatively, the terminal determines multiple points on the curve based on multiple curve slopes.
[0082] (2) The terminal divides the third curve into at least two curve regions and the third brightness histogram into at least two histogram regions based on the reference brightness represented by the abscissa of at least one point.
[0083] In this embodiment, the terminal determines at least one point on the curve based on at least one curve slope. Since the abscissa of this point represents the brightness of the target image, the terminal can divide the third curve into at least two curve regions based on the reference brightness represented by the abscissa of the at least one point. Similarly, since the abscissa of the third brightness histogram is the brightness of the pixel, the terminal divides the third brightness into at least two histogram regions based on the reference brightness represented by the abscissa of the at least one point. Specifically, when the terminal determines one point, the terminal divides the third curve into two curve regions and the third brightness histogram into two histogram regions based on the reference brightness represented by the abscissa of the one point. Alternatively, when the terminal determines multiple points, the terminal divides the third curve into multiple curve regions and the third brightness histogram into multiple histogram regions based on the reference brightness represented by the abscissas of the multiple points.
[0084] (3) The terminal performs downsampling on at least two curve regions at different ratios to obtain the first curve graph.
[0085] In this embodiment, since the rate of change of the curves differs within each curve region, using the same downsampling ratio for at least two curve regions in the third curve graph would waste storage space. Therefore, at least two curve regions are downsampled at different ratios to obtain the first curve graph. Optionally, the downsampling ratio of the curve region is inversely correlated with the rate of change of the curve within the curve region; the faster the rate of change of the curve within the curve region, the smaller the downsampling ratio; the slower the rate of change of the curve within the curve region, the larger the downsampling ratio. This downsampling ratio is used to indicate that downsampling is performed on the curves within the curve region at a certain sampling interval.
[0086] (4) The terminal downsamples at least two histogram regions at different ratios to obtain the first brightness histogram.
[0087] In this embodiment, for any curved region, the terminal divides the third curve into at least two curved regions and the third brightness histogram into at least two histogram regions based on the brightness represented by the abscissa of at least one point on the curve. Therefore, based on the downsampling ratio of the curved region, the terminal can determine the downsampling ratio of the histogram region corresponding to the curved region in the at least two histogram regions. Optionally, the downsampling ratio of the histogram region is also inversely correlated with the rate of change of the curve within the curved region; the faster the rate of change of the curve within the curved region, the smaller the downsampling ratio of the histogram region; the slower the rate of change of the curve within the curved region, the larger the downsampling ratio of the histogram region.
[0088] For example, see Figure 5The third curve shown is a convex curve, with the horizontal axis representing the brightness of the target image. The horizontal axis ranges from 0 nits to 1023 nits, and the slope of the tangent line at each point on the curve gradually decreases as the horizontal axis increases. The point where the slope of the tangent line is 1 is determined as follows: Figure 5 As shown, the x-coordinate of this point is 288 nits, and the y-coordinate is 676 nits. The expression for the tangent line at this point is y = x + 388. Along this tangent line, for every 1 nit increase in the x-coordinate, the y-coordinate also increases by 1 nit. In the curve region where the x-coordinate is greater than 288 nits, the curve changes more slowly compared to the tangent line. Since for every 1 nit increase in the x-coordinate of this curve, the y-coordinate increases by less than 1 nit, the increase in the y-coordinate of the tangent line is greater than the increase in the y-coordinate of the curve, i.e., a > b. Here, 'a' represents the increase in the y-coordinate of the tangent line for every 1 nit increase in the x-coordinate; 'b' represents the increase in the y-coordinate of the curve for every 1 nit increase in the x-coordinate in the curve region where the x-coordinate is greater than 288 nits. This indicates that in the curve region where the x-coordinate is greater than 288 nits, the difference between adjacent points on the curve is small, and it is not necessary to preserve the data for this curve region completely. In the curve region where the x-coordinate is less than 288 nits, the curve changes more rapidly compared to the tangent line. Since the ordinate of the curve increases by more than 1 nit for every 1 nit increase in the abscissa, the increase in the ordinate of the tangent line is less than the increase in the ordinate of the curve. This indicates that the differences between adjacent points on the curve are significant in the curve region where the abscissa is less than 288 nit, requiring more complete data preservation in this region. Therefore, based on the slope of a curve in the third curve graph, the terminal determines a point on the curve with a slope of 1 and uses this point as a dividing point. The abscissa of this dividing point represents a brightness of 288 nits. Based on the brightness represented by the abscissa of this dividing point, the third curve graph is divided into two curve regions with different rates of change: one with a fast rate of change and the other with a slow rate of change. The terminal performs downsampling on these two curve regions at different ratios. In the curve region where the brightness represented by the abscissa is less than 288 nits, every 8 brightness values on the abscissa are grouped together; in the curve region where the brightness represented by the abscissa is greater than 288 nits, every 32 brightness values on the abscissa are grouped together, resulting in the following... Figure 6The first curve is shown. Group 1 has a maximum brightness of 7 nits (0-7 nits), and Group 2 has a maximum brightness of 15 nits (8-15 nits). The terminal uses the group number as the x-axis of the first curve and the backlight brightness of the display screen corresponding to the maximum brightness of each group as the y-axis. Similarly, based on the brightness represented by the x-axis of the dividing point, the terminal divides the third brightness histogram into two histogram regions and downsamples these two regions at different ratios. Within the histogram region where the brightness is less than 288 nits (represented by the x-axis), every two brightness levels on the x-axis are grouped together, and the sum of the number of pixels corresponding to the two brightness levels within each group is taken as the number of pixels in that group. For example, if a pixel's brightness is between 0 and 1 nit, it is added to group 1, and the count of pixels in group 1 is incremented by 1. Within the curve region on the horizontal axis where brightness is greater than 288 nits, every 16 brightness levels on the horizontal axis are grouped together, and the sum of the counts of the pixels corresponding to the 16 brightness levels in that group is taken as the count of pixels in that group. For example, if a pixel's brightness is between 288 and 303 nits, it is added to group 145, and the count of pixels in group 145 is incremented by 1; if a pixel's brightness is between 304 and 319 nits, it is added to group 146, and the count of pixels in group 146 is incremented by 1, and so on, resulting in... Figure 7 The first brightness histogram is shown below. Group 1 is 0-1 nit, with a maximum brightness of 1 nit; Group 2-3 nit is 2, with a maximum brightness of 3 nits. The terminal uses the group number of each group as the x-axis of the first brightness histogram and the number of pixels corresponding to each group as the y-axis of the corresponding first brightness histogram.
[0089] In some embodiments, the terminal determines a point on the curve of the third curve at every sampling interval. The brightness represented by the abscissa of this point is used as the abscissa of a point on the curve of the first curve, and the backlight brightness represented by the ordinate of this point is used as the ordinate of a point on the curve of the first curve. Then, the first curve is plotted based on the abscissa and ordinate of this point.
[0090] In some embodiments, the terminal determines a luminance from the third luminance histogram at every sampling interval, uses this luminance as the abscissa of the first luminance histogram, and uses the total number of pixels in the histogram region corresponding to the luminance within the sampling interval as the ordinate of the luminance in the first luminance histogram. Therefore, the third luminance histogram can be downsampled at a certain sampling interval to obtain the first luminance histogram.
[0091] 303. The terminal stores the target image, the first curve of the target image, and the first brightness histogram of the target image.
[0092] In this embodiment, the terminal stores the target image, a first curve, and a first brightness histogram. Since the stored first curve and first brightness histogram are obtained through downsampling, the storage space occupied is reduced.
[0093] For example, taking a target image with a resolution of 1080*1920 as an example, the storage space occupied by the third brightness histogram of the target image is calculated to be [log2]. (1080×1920 / 4port / 1024) ]×(2 10 = 9 × 1024 = 9216 bits. Where 4 ports indicate that 4 pixels can be processed in parallel, and each port represents the R (Red), G (Green), and B (Blue) channels of each pixel. The total storage space occupied by the third curve of this target image is... The total memory occupied by the third brightness histogram and the third curve is 9216 + 10240 = 19456 bits. After downsampling the third curve and the third brightness histogram, the first curve and the first brightness histogram are obtained. The storage space occupied by the first brightness histogram is [log2]. (1080×1920 / 4port / 1024) [×(288 / 2+(1024-288) / 16)=9×190=1710 bits. The storage space occupied by this first graph is...] The total storage space occupied by the third brightness histogram and the third curve is 1710 + 590 = 2300 bits. Storing the first curve and the first brightness histogram after compression at the terminal reduces storage space by 17156 bits compared to storing the uncompressed third curve and the third brightness histogram.
[0094] 304. The terminal acquires the target image, the first curve of the target image, and the first brightness histogram of the target image.
[0095] In this embodiment of the application, the terminal obtains the target image, the first curve of the target image, and the first brightness histogram of the target image stored in step 303 from the local machine.
[0096] In some embodiments, the target image, the first curve of the target image, and the first brightness histogram of the target image can be stored in a server. The terminal can obtain the target image, the first curve of the target image, and the first brightness histogram of the target image from the server. The embodiments of this application do not limit the method by which the terminal obtains the target image, the first curve of the target image, and the first brightness histogram of the target image.
[0097] In some embodiments, the terminal may acquire the target image, a first curve of the target image, and a first brightness histogram of the target image from its local storage based on a preloading instruction for the target image. The terminal may trigger the preloading instruction for the target object when displaying the previous frame of the target image, or it may trigger the preloading instruction for the target object when displaying the previous N frames of the target image, where N is an integer greater than 2.
[0098] In some embodiments, the terminal obtains a target image, a first curve of the target image, and a first brightness histogram of the target image from the server. Accordingly, the terminal may omit steps 301-303 described above.
[0099] It should be noted that after the terminal acquires the target image, the first curve of the target image, and the first luminance histogram of the target image, it can upsample the first curve and the first luminance histogram separately, as shown in steps 305-308. Alternatively, the terminal may not upsample the first luminance histogram, but instead first determine the target luminance of the target image from the first luminance histogram, and then upsample the first curve to obtain a second curve, so that the second curve includes the target luminance. Then, the target backlight luminance corresponding to the target luminance is determined from the second curve. The target luminance is the largest among multiple candidate luminances, and the number of pixels corresponding to the candidate luminance is greater than a quantity threshold. The quantity threshold is related to the size of the target image and the energy-saving intensity. A higher quantity threshold results in a lower determined target luminance and higher energy-saving intensity, but lower display quality of the target image; a lower quantity threshold results in a higher determined target luminance and lower energy-saving intensity, but better display quality of the target image. The quantity threshold can be set by the terminal or input by the user to the terminal; this application embodiment does not limit the source of the quantity threshold.
[0100] 305. The terminal determines at least one point on the curve based on at least one curve slope in the first curve graph, with each point corresponding to one curve slope.
[0101] In this embodiment, the first curve graph includes a curve, where the horizontal axis of a point on the curve represents the brightness of the target image, and the vertical axis represents the backlight brightness of the display screen. Since the slope of the curve differs at different points, the terminal can determine at least one point on the curve based on at least one curve slope. This at least one curve slope can be one or more; correspondingly, the terminal determines a point on the curve based on one curve slope. Alternatively, the terminal determines multiple points on the curve based on multiple curve slopes.
[0102] 306. The terminal divides the first curve into at least two curve regions and the first brightness histogram into at least two histogram regions based on the reference brightness represented by the abscissa of at least one point.
[0103] In this embodiment, since the abscissa of a point on the curve represents the brightness of the target image, the terminal can divide the first curve into at least two curve regions based on the reference brightness represented by the abscissa of at least one point. The rate of change of the curve is different within each curve region. Similarly, the terminal can divide the first brightness into at least two histogram regions based on the reference brightness represented by the abscissa of at least one point. The reference brightness represented by the abscissa of the at least one point can be one or more. The terminal divides the first curve into two curve regions and the first brightness histogram into two histogram regions based on the reference brightness represented by the abscissa of one point. Alternatively, the terminal divides the first curve into multiple curve regions and the first brightness histogram into multiple histogram regions based on the reference brightness represented by the abscissas of multiple points.
[0104] In some embodiments, the curve in the first curve graph is a convex curve. Therefore, for any point on the curve, if the brightness represented by the horizontal coordinate of that point is greater than the reference brightness, the curve changes relatively slowly within the curve region; if the brightness represented by the horizontal coordinate of that point is less than the reference brightness, the curve changes relatively quickly within the curve region.
[0105] In some embodiments, the terminal can determine the upsampling ratio of the curve region and the histogram region based on the rate of change of the curve within the curve region. Accordingly, the terminal determines the upsampling ratio of the curve region and the histogram region through the following steps (1) and (2).
[0106] (1) For any one of the at least two curve regions, the terminal determines the upsampling ratio of the curve region based on the relationship between the slope of the curve in the curve region and the slope at the endpoint of the curve in the curve region.
[0107] In this embodiment, since the slope of a point on a curve reflects the rate of change of the curve at that point, the rate of change of the curve within that region can be determined based on the relationship between the slope of the curve within the curve region and the slope at the endpoint of the curve within that region. Based on the rate of change of the curve within that region, the upsampling ratio for that region is determined. Optionally, the upsampling ratio for that region is positively correlated with the rate of change of the curve within that region; the faster the rate of change of the curve within that region, the larger the upsampling ratio; conversely, the slower the rate of change of the curve within that region, the smaller the upsampling ratio.
[0108] (2) The terminal determines the upsampling ratio of the histogram regions corresponding to the curve regions in at least two histogram regions based on the upsampling ratio of the curve regions.
[0109] In this embodiment, since the horizontal axis of both the first luminance histogram and the first curve is luminance, the terminal can determine the histogram region corresponding to the curve region based on the correspondence between the luminance of the curve region and the histogram region. Then, based on the upsampling ratio of the curve region, the upsampling ratio of the histogram region corresponding to the curve region is determined. Optionally, the upsampling ratio of the histogram region is also positively correlated with the rate of change of the curve within the curve region; the faster the rate of change of the curve within the curve region, the larger the upsampling ratio of the histogram region; the slower the rate of change of the curve within the curve region, the smaller the upsampling ratio of the histogram region.
[0110] 307. The terminal upsamples at least two curve regions at different ratios to obtain the second curve.
[0111] In this embodiment, since the rate of change of the curve varies within each curve region, the upsampling ratio performed by the terminal differs for each curve region. Accordingly, the terminal upsamples at least two curve regions at different ratios to obtain the second curve graph.
[0112] For example, with a reference brightness of 36 nits, the terminal divides the first curve into two regions based on this reference brightness. If the curve in the first curve is a convex curve, then for the region where the reference brightness (represented by the horizontal axis) is less than 36 nits, the curve changes slowly, and 7 brightness levels are inserted between two adjacent brightness levels within this region. For the region where the reference brightness (represented by the horizontal axis) is greater than 36 nits, the curve changes quickly, and 31 brightness levels are inserted between two adjacent brightness levels within this region. For example, when two adjacent brightness levels are 0 nits and 1 nit, 7 brightness levels are inserted at equal intervals between 0 and 1 nit: 7 nits, 6 nits, 5 nits, 4 nits, 3 nits, 2 nits, and 1 nit. After inserting 7 brightness levels, the original 1 nit becomes 8 nits.
[0113] 308. The terminal upsamples at least two histogram regions at different ratios to obtain a second brightness histogram.
[0114] In this embodiment, since the rate of change of the curve varies within each curve region, and the curve regions correspond to the histogram regions, the upsampling ratio performed by the terminal varies based on the histogram regions corresponding to different curve regions. Accordingly, the terminal upsamples at least two histograms at different ratios to obtain a second brightness histogram.
[0115] For example, with a reference brightness of 36 nits, the terminal divides the first brightness histogram into two histogram regions based on this reference brightness. For the histogram region where the reference brightness is less than 36 nits (represented by the horizontal axis), seven brightness values are inserted between two adjacent brightness values within this histogram region. For the histogram region where the reference brightness is greater than 36 nits (represented by the horizontal axis), 31 brightness values are inserted between two adjacent brightness values within this histogram region. For example, when two adjacent brightness values are 0 nits and 1 nit, seven brightness values are inserted at equal intervals between 0 and 1 nit: 7 nits, 6 nits, 5 nits, 4 nits, 3 nits, 2 nits, and 1 nit. After inserting these seven brightness values, the original 1 nit becomes 8 nits.
[0116] 309. The terminal adjusts the backlight brightness of the display screen based on the second curve and the second brightness histogram.
[0117] In this embodiment, the terminal determines a brightness level based on the second brightness histogram by counting the number of pixels in the target image. Then, it determines the corresponding backlight brightness of the display screen from the second curve, thereby adjusting the backlight brightness of the display screen. For a detailed implementation, please refer to step 203 above; it will not be repeated here.
[0118] In some embodiments, the terminal can determine the target brightness of the target image based on the second brightness histogram, and determine the target backlight brightness corresponding to the target brightness from the second curve, and adjust the backlight brightness of the display screen to the target backlight brightness. Accordingly, the terminal adjusts the backlight brightness of the display screen through the following steps (1)-(3).
[0119] (1) The terminal determines the target brightness of the target image based on the second brightness histogram. The target brightness is the largest brightness among multiple candidate brightnesses, and the number of pixels corresponding to the candidate brightness is greater than the number threshold.
[0120] In this embodiment of the application, since the second brightness histogram is used to indicate the relationship between the number of pixels and the brightness of the pixels in the target image, based on the second brightness histogram, multiple candidate brightness levels when the number of pixels is greater than the number threshold can be determined, and the maximum brightness among the multiple candidate brightness levels is determined as the target brightness of the target image.
[0121] The quantity threshold is related to the size of the target image and the energy-saving intensity. A higher quantity threshold results in a lower target brightness and higher energy-saving intensity, but lower display quality of the target image; a lower quantity threshold results in a higher target brightness and lower energy-saving intensity, but better display quality of the target image. The quantity threshold can be set by the terminal or input by the user into the terminal; this application embodiment does not limit the source of the quantity threshold.
[0122] For example, such as Figure 8 The second brightness histogram shown has a quantity threshold of 200. In this brightness histogram, the terminal searches for the brightness of the first pixel whose quantity exceeds the quantity threshold, moving from maximum brightness to minimum brightness. The brightness of this pixel is 540 nits, and the target brightness is 540 nits.
[0123] (2) The terminal determines the target backlight brightness corresponding to the target brightness from the second curve.
[0124] In this embodiment, the second curve can indicate the correspondence between the brightness of the target image and the backlight brightness of the display screen. Since the target brightness of the target image can reflect the brightness of most pixels in the target image, after the terminal determines the target brightness of the target image, it determines the target backlight brightness corresponding to the target brightness from the second curve. This target backlight brightness is the appropriate backlight brightness when displaying the target image.
[0125] For example, such as Figure 9 As shown in the second curve, based on this curve, the terminal can determine that when the target brightness is 540 nits, the corresponding target backlight brightness of the display is 850 nits. By adjusting the backlight brightness of the display to 850 nits, compared to setting the backlight brightness to 1023 nits, the terminal saves approximately 16.9% in power consumption.
[0126] (3) The terminal adjusts the backlight brightness of the display screen to the target backlight brightness.
[0127] In this embodiment, after determining the target backlight brightness, the terminal adjusts the backlight brightness of the display screen to the target backlight brightness. Compared to the case where the backlight brightness is set to maximum for any image, determining the target backlight brightness for displaying the target image and adjusting the backlight brightness of the display screen to the target backlight brightness can reduce power consumption.
[0128] In some embodiments, after adjusting the backlight brightness of the display screen, the terminal can adjust the pixel brightness based on the backlight brightness. Correspondingly, the terminal adjusts the pixel brightness in the target image based on the backlight brightness of the display screen; and displays the target image based on the backlight brightness and the pixel brightness in the target image. Since the product between the adjustment ratio of the backlight brightness of the display screen and the adjustment ratio of the pixel brightness in the target image is 1, i.e., BL*OC = 1, where BL represents the adjustment ratio of the backlight brightness and OC represents the adjustment ratio of the pixel brightness, the terminal can determine the pixel brightness adjustment ratio based on the adjustment ratio of the backlight brightness of the display screen. After adjusting the backlight brightness of the display screen, to prevent the brightness of the target image from dimming when the backlight brightness of the display screen decreases, the terminal can adjust the pixel brightness to maintain the same display effect when the target image is displayed. At this time, the display effect of the target image is the same as the display effect before the backlight brightness adjustment.
[0129] For example, if the backlight brightness of the display is reduced from 1023 nits to 850 nits, that is, the backlight brightness of the display is reduced to 83.1% of the original, the brightness of the pixels in the target image will increase by 1.2 times.
[0130] This application provides a backlight adjustment method. Since the slope of the curve at different points in the first curve graph varies, and this slope reflects the rate of change of the curve, upsampling of the first curve graph and the first brightness histogram based on at least one curve slope in the first curve graph allows for more accurate and smooth expansion of the first curve graph and the first brightness histogram based on the rate of change of the curve, resulting in a second curve graph and a second brightness histogram with more sampling points. Since the brightness histogram indicates the relationship between the number of pixels in the target image and the brightness of the pixels, and the curve graph indicates the correspondence between the brightness of the target image and the backlight brightness, the rich sampling points in the second brightness histogram and the second curve graph allow for a more accurate determination of the appropriate backlight brightness when displaying the target image. This adjusts the backlight brightness when the display screen shows the target image, reducing power consumption compared to maximizing the backlight brightness when displaying any image.
[0131] All of the above-mentioned optional technical solutions can be combined in any way to form the optional embodiments of this application, and will not be described in detail here.
[0132] The following are embodiments of the apparatus described in this application, which can be used to execute the embodiments of the method described in this application. For details not disclosed in the apparatus embodiments of this application, please refer to the embodiments of the method described in this application.
[0133] Figure 10This is a schematic diagram of a backlight adjustment device provided in an embodiment of this application. See also... Figure 10 The device includes: a first acquisition module 1001, an upsampling module 1002, and an adjustment module 1003.
[0134] The first acquisition module 1001 is used to acquire a target image, a first curve of the target image, and a first brightness histogram of the target image. The first curve is used to indicate the correspondence between the brightness of the target image and the backlight brightness of the display screen, and the first brightness histogram is used to indicate the relationship between the number of pixels in the target image and the brightness of the pixels.
[0135] The upsampling module 1002 is used to upsample the first curve and the first brightness histogram based on the slope of at least one curve on the curve in the first curve to obtain the second curve and the second brightness histogram.
[0136] The adjustment module 1003 is used to adjust the backlight brightness of the display screen based on the second curve and the second brightness histogram.
[0137] In some embodiments, Figure 11 This is a structural block diagram of another backlight adjustment device provided according to an embodiment of this application. See also... Figure 11 The upsampling module 1002 includes:
[0138] The first determining unit 1101 is used to determine at least one point on the curve based on at least one curve slope on the curve in the first curve graph, with one point corresponding to one curve slope.
[0139] The first division unit 1102 is used to divide the first curve into at least two curve regions and the first brightness histogram into at least two histogram regions based on the reference brightness represented by the abscissa of at least one point.
[0140] The first upsampling unit 1103 is used to upsample at least two curve regions at different ratios to obtain a second curve.
[0141] The second upsampling unit 1104 is used to upsample at least two histogram regions at different ratios to obtain a second brightness histogram.
[0142] In some embodiments, the first upsampling unit 1103 is further configured to determine, for any one of at least two curve regions, the upsampling ratio of the curve region based on the relationship between the slope of the curve within the curve region and the slope at the endpoint of the curve within the curve region.
[0143] The second upsampling unit 1104 is also used to determine, based on the upsampling ratio of the curve region, the ratio of upsampling the histogram region corresponding to the curve region in at least two histogram regions.
[0144] In some embodiments, please continue to see Figure 11 The adjustment module 1003 includes:
[0145] The brightness determination unit 1105 is used to determine the target brightness of the target image based on the second brightness histogram. The target brightness is the maximum brightness among multiple candidate brightness values, and the number of pixels corresponding to the candidate brightness values is greater than a number threshold.
[0146] Backlight determination unit 1106 is used to determine the target backlight brightness corresponding to the target brightness from the second curve graph;
[0147] The adjustment unit 1107 is used to adjust the backlight brightness of the display screen to the target backlight brightness.
[0148] In some embodiments, please continue to see Figure 11 The device also includes:
[0149] The second acquisition module 1004 is used to acquire a target image, a third curve of the target image, and a third brightness histogram of the target image. The third curve is used to indicate the correspondence between the brightness of the target image and the backlight brightness, and the third brightness histogram is used to indicate the relationship between the number of pixels in the target image and the brightness of the pixels.
[0150] The downsampling module 1005 is used to downsample the third curve and the third brightness histogram based on the slope of at least one curve on the curve in the third curve to obtain the first curve and the first brightness histogram.
[0151] Storage module 1006 is used to store the target image, the first curve of the target image, and the first brightness histogram of the target image.
[0152] In some embodiments, please continue to see Figure 11 The downsampling module 1005 includes:
[0153] The second determining unit 1108 is used to determine at least one point on the curve based on at least one curve slope on the curve in the third curve graph, with one point corresponding to one curve slope.
[0154] The second division unit 1109 is used to divide the third curve into at least two curve regions and the third brightness histogram into at least two histogram regions based on the reference brightness represented by the abscissa of at least one point.
[0155] The first downsampling unit 1110 is used to downsample at least two curve regions at different ratios to obtain a first curve graph;
[0156] The second downsampling unit 1111 is used to downsample at least two histogram regions at different ratios to obtain a first brightness histogram.
[0157] In some embodiments, the adjustment module 1003 is further configured to:
[0158] Adjust the brightness of pixels in the target image based on the backlight brightness of the display screen;
[0159] The target image is displayed based on the backlight brightness and the brightness of pixels in the target image.
[0160] This application provides a backlight adjustment device. Since the slope of the curve at different points in the first curve graph varies, and this slope reflects the rate of change of the curve, upsampling of the first curve graph and the first brightness histogram based on at least one curve slope in the first curve graph allows for more accurate and smooth expansion of the first curve graph and the first brightness histogram based on the rate of change of the curve, resulting in a second curve graph and a second brightness histogram with more sampling points. Since the brightness histogram indicates the relationship between the number of pixels in the target image and the brightness of the pixels, and the curve graph indicates the correspondence between the brightness of the target image and the backlight brightness, the rich sampling points in the second brightness histogram and the second curve graph allow for a more accurate determination of the appropriate backlight brightness when displaying the target image. This adjusts the backlight brightness when the display screen shows the target image, reducing power consumption compared to maximizing the backlight brightness when displaying any image.
[0161] It should be noted that the apparatus provided in the above embodiments is only illustrated by the division of the above functional modules when implementing its functions. In practical applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the computer device can be divided into different functional modules to complete all or part of the functions described above. In addition, the backlight adjustment device and the backlight adjustment method embodiments provided in the above embodiments belong to the same concept, and their specific implementation process can be found in the method embodiments, which will not be repeated here.
[0162] This application provides a terminal, which includes a processor and a memory; the memory stores at least one piece of program code, which is executed by the processor to implement the backlight adjustment method provided in the above-described method embodiments.
[0163] Figure 12This is a structural block diagram of a terminal provided in an embodiment of this application. In some embodiments, the terminal 1200 is a smartphone, tablet computer, wearable device, or other terminal capable of accessing a wireless local area network as a wireless station. The terminal 1200 includes a processor 1201 and a memory 1202.
[0164] Processor 1201 may include one or more processing cores, such as a quad-core processor, an octa-core processor, etc. Processor 1201 may be implemented using at least one hardware form selected from DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). Processor 1201 may also include a main processor and a coprocessor. The main processor, also known as a CPU (Central Processing Unit), is used to process data in the wake-up state; the coprocessor is a low-power processor used to process data in the standby state. In some embodiments, processor 1201 may integrate a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the screen. In some embodiments, processor 1201 may also include an AI (Artificial Intelligence) processor, which is used to handle computational operations related to machine learning.
[0165] The memory 1202 may include one or more computer-readable storage media, which may be non-transitory. The memory 1202 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices or flash memory devices. In some embodiments, the non-transitory computer-readable storage media in the memory 1202 are used to store at least one program code, which is executed by the processor 1201 to implement the backlight adjustment method provided in the method embodiments of this application.
[0166] In some embodiments, the terminal 1200 may also optionally include a peripheral device interface 1203 and at least one peripheral device. The processor 1201, memory 1202, and peripheral device interface 1203 can be connected via a bus or signal line. Each peripheral device can be connected to the peripheral device interface 1203 via a bus, signal line, or circuit board. Specifically, the peripheral device includes at least one of the following: a radio frequency circuit 1204, a display screen 1205, a camera assembly 1206, an audio circuit 1207, a positioning assembly 1208, and a power supply 1209.
[0167] Peripheral device interface 1203 can be used to connect at least one I / O (Input / Output) related peripheral device to processor 1201 and memory 1202. In some embodiments, processor 1201, memory 1202 and peripheral device interface 1203 are integrated on the same chip or circuit board; in some other embodiments, any one or two of processor 1201, memory 1202 and peripheral device interface 1203 can be implemented on separate chips or circuit boards, which is not limited in this embodiment.
[0168] The radio frequency (RF) circuit 1204 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The RF circuit 1204 communicates with communication networks and other communication devices via electromagnetic signals. The RF circuit 1204 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals back into electrical signals. Optionally, the RF circuit 1204 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, an object identification module card, etc. The RF circuit 1204 can communicate with other terminals via at least one wireless communication protocol. This wireless communication protocol includes, but is not limited to: metropolitan area networks (MANs), various generations of mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks (WLANs), and / or WiFi (Wireless Fidelity) networks. In some embodiments, the RF circuit 1204 may also include circuitry related to NFC (Near Field Communication), which is not limited in this application.
[0169] Display screen 1205 is used to display a UI (User Interface). This UI may include graphics, text, icons, videos, and any combination thereof. When display screen 1205 is a touch display screen, it also has the ability to collect touch signals on or above its surface. These touch signals can be input as control signals to processor 1201 for processing. In this case, display screen 1205 can also be used to provide virtual buttons and / or a virtual keyboard, also known as soft buttons and / or a soft keyboard. In some embodiments, there may be one display screen 1205, which serves as the front panel of terminal 1200; in other embodiments, there may be at least two display screens, respectively disposed on different surfaces of terminal 1200 or in a folded design; in still other embodiments, display screen 1205 may be a flexible display screen, disposed on a curved or folded surface of terminal 1200. Furthermore, display screen 1205 may also be configured as a non-rectangular, irregular shape, i.e., a non-rectangular screen. The display screen 1205 can be made of materials such as LCD (Liquid Crystal Display) and OLED (Organic Light-Emitting Diode).
[0170] The camera assembly 1206 is used to acquire images or videos. Optionally, the camera assembly 1206 includes a front-facing camera and a rear-facing camera. The front-facing camera is disposed on the front panel of the terminal, and the rear-facing camera is disposed on the back of the terminal. In some embodiments, there are at least two rear-facing cameras, which are any one of a main camera, a depth-sensing camera, a wide-angle camera, and a telephoto camera, to achieve background blurring by fusion of the main camera and the depth-sensing camera, panoramic shooting by fusion of the main camera and the wide-angle camera, VR (Virtual Reality) shooting, or other fusion shooting functions. In some embodiments, the camera assembly 1206 may also include a flash. The flash can be a single-color temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm light flash and a cool light flash, which can be used for light compensation at different color temperatures.
[0171] The audio circuit 1207 may include a microphone and a speaker. The microphone is used to collect sound waves from objects and the environment, converting the sound waves into electrical signals that are input to the processor 1201 for processing, or input to the radio frequency circuit 1204 for voice communication. For stereo sound acquisition or noise reduction purposes, multiple microphones may be used, each positioned at a different location on the terminal 1200. The microphone may also be an array microphone or an omnidirectional microphone. The speaker is used to convert electrical signals from the processor 1201 or the radio frequency circuit 1204 into sound waves. The speaker may be a conventional diaphragm speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can convert electrical signals not only into audible sound waves but also into inaudible sound waves for purposes such as distance measurement. In some embodiments, the audio circuit 1207 may also include a headphone jack.
[0172] Power supply 1208 is used to power the various components in terminal 1200. Power supply 1208 can be AC power, DC power, a disposable battery, or a rechargeable battery. When power supply 1208 includes a rechargeable battery, the rechargeable battery can support wired charging or wireless charging. The rechargeable battery can also be used to support fast charging technology.
[0173] In some embodiments, the terminal 1200 further includes one or more sensors 1209. The one or more sensors 1209 include, but are not limited to: an acceleration sensor 1210, a gyroscope sensor 1211, a pressure sensor 1212, an optical sensor 1213, and a proximity sensor 1214.
[0174] Accelerometer 1210 can detect the magnitude of acceleration on the three coordinate axes of a coordinate system established with terminal 1200. For example, accelerometer 1210 can be used to detect the components of gravitational acceleration on the three coordinate axes. Processor 1201 can control display screen 1205 to display the user interface in either a landscape or portrait view based on the gravitational acceleration signal acquired by accelerometer 1210. Accelerometer 1210 can also be used for games or for acquiring user motion data.
[0175] The gyroscope sensor 1211 can detect the orientation and rotation angle of the terminal 1200. The gyroscope sensor 1211 can work in conjunction with the accelerometer sensor 1210 to collect the user's 3D movements on the terminal 1200. Based on the data collected by the gyroscope sensor 1211, the processor 1201 can perform the following functions: motion sensing (e.g., changing the UI based on the user's tilt), image stabilization during shooting, game control, and inertial navigation.
[0176] The pressure sensor 1212 can be disposed on the side bezel of the terminal 1200 and / or on the lower layer of the display screen 1205. When the pressure sensor 1212 is disposed on the side bezel of the terminal 1200, it can detect the user's grip signal on the terminal 1200, and the processor 1201 can perform left / right hand recognition or quick operation based on the grip signal collected by the pressure sensor 1212. When the pressure sensor 1212 is disposed on the lower layer of the display screen 1205, the processor 1201 can control the operable controls on the UI interface based on the user's pressure operation on the display screen 1205. The operable controls include at least one of button controls, scroll bar controls, icon controls, and menu controls.
[0177] Optical sensor 1213 is used to collect ambient light intensity. In one embodiment, processor 1201 can control the display brightness of display screen 1205 based on the ambient light intensity collected by optical sensor 1213. Optionally, when the ambient light intensity is high, the display brightness of display screen 1205 is increased; when the ambient light intensity is low, the display brightness of display screen 1205 is decreased. In another embodiment, processor 1201 can also dynamically adjust the shooting parameters of camera assembly 1206 based on the ambient light intensity collected by optical sensor 1213.
[0178] The proximity sensor 1214, also known as a distance sensor, is installed on the front panel of the terminal 1200. The proximity sensor 1214 is used to detect the distance between the user and the front of the terminal 1200. In one embodiment, when the proximity sensor 1214 detects that the distance between the user and the front of the terminal 1200 is gradually decreasing, the processor 1201 controls the display screen 1205 to switch from a screen-on state to a screen-off state; when the proximity sensor 1214 detects that the distance between the user and the front of the terminal 1200 is gradually increasing, the processor 1201 controls the display screen 1205 to switch from a screen-off state to a screen-on state.
[0179] Those skilled in the art will understand that Figure 12 The structure shown does not constitute a limitation on terminal 1200 and may include more or fewer components than shown, or combine certain components, or use different component arrangements.
[0180] This application also provides a computer-readable storage medium storing at least one piece of program code, which is loaded and executed by the processor to implement the backlight adjustment method shown in the above embodiments.
[0181] This application also provides a computer program product that stores at least one piece of program code, which is executed by a processor to implement the backlight adjustment method shown in the above embodiments.
[0182] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.
[0183] Those skilled in the art will understand that all or part of the steps in the backlight adjustment method of the above embodiments can be implemented by hardware, or by a program instructing related hardware. The program can be stored in a computer-readable storage medium, such as a read-only memory, a disk, or an optical disk. The above descriptions are merely optional embodiments of this application and are not intended to limit the application. Any modifications, equivalent substitutions, or improvements made within the spirit and principles of this application should be included within the scope of protection of this application.
Claims
1. A backlight adjustment method, characterized in that, The method includes: Acquire a target image, a first curve of the target image, and a first brightness histogram of the target image. The first curve includes a curve, where the horizontal axis of a point on the curve represents the brightness of the target image, and the vertical axis represents the backlight brightness of the display screen. The first brightness histogram is used to indicate the relationship between the number of pixels and the brightness of the pixels in the target image. Based on at least one curve slope on the curve in the first curve graph, at least one point is determined on the curve, with one point corresponding to one curve slope. Based on the reference brightness represented by the abscissa of the at least one point, the first curve is divided into at least two curve regions, and the first brightness histogram is divided into at least two histogram regions. For any one of the at least two curve regions, the rate of change of the curve within the curve region is determined based on the relationship between the slope of the curve within the curve region and the slope at the endpoint of the curve within the curve region. Based on the rate of change of the curve within the curve region, the proportion of upsampling of the curve region is determined, and the proportion of upsampling of the curve region is positively correlated with the rate of change of the curve within the curve region; Based on the upsampling ratio of the curve region, the upsampling ratio of the histogram regions corresponding to the curve region in the at least two histogram regions is determined; The at least two curve regions are upsampled at different ratios to obtain a second curve. The at least two histogram regions are upsampled at different ratios to obtain a second brightness histogram; Based on the second curve and the second brightness histogram, adjust the backlight brightness of the display screen.
2. The method according to claim 1, characterized in that, Adjusting the backlight brightness of the display screen based on the second curve and the second brightness histogram includes: Based on the second brightness histogram, the target brightness of the target image is determined. The target brightness is the largest brightness among a plurality of candidate brightness values, and the number of pixels corresponding to the candidate brightness values is greater than a number threshold. Determine the target backlight brightness corresponding to the target brightness from the second curve graph; Adjust the backlight brightness of the display screen to the target backlight brightness.
3. The method according to claim 1, characterized in that, Before acquiring the target image, the first curve of the target image, and the first brightness histogram of the target image, the method further includes: The target image, the third curve of the target image, and the third brightness histogram of the target image are obtained. The third curve is used to indicate the correspondence between the brightness of the target image and the backlight brightness, and the third brightness histogram is used to indicate the relationship between the number of pixels and the brightness of the pixels in the target image. Based on the slope of at least one curve in the third curve, the third curve and the third brightness histogram are downsampled respectively to obtain the first curve and the first brightness histogram. The target image, a first curve of the target image, and a first brightness histogram of the target image are stored.
4. The method according to claim 3, characterized in that, The step of downsampling the third curve and the third brightness histogram based on the slope of at least one curve in the third curve to obtain the first curve and the first brightness histogram includes: Based on at least one curve slope on the curve in the third curve graph, at least one point is determined on the curve, with one point corresponding to one curve slope. Based on the reference brightness represented by the abscissa of the at least one point, the third curve is divided into at least two curve regions, and the third brightness histogram is divided into at least two histogram regions. The first curve is obtained by downsampling the at least two curve regions at different ratios. The first brightness histogram is obtained by downsampling the at least two histogram regions at different ratios.
5. The method according to claim 1, characterized in that, After adjusting the backlight brightness of the display screen based on the second curve and the second brightness histogram, the method further includes: Adjust the brightness of pixels in the target image based on the backlight brightness of the display screen; The target image is displayed based on the backlight brightness and the brightness of the pixels in the target image.
6. A backlight adjustment device, characterized in that, The device includes: The acquisition module is used to acquire a target image, a first curve of the target image, and a first brightness histogram of the target image. The first curve includes a curve, the horizontal axis of the points on the curve is the brightness of the target image, and the vertical axis is the backlight brightness of the display screen. The first brightness histogram is used to indicate the relationship between the number of pixels and the brightness of the pixels in the target image. The sampling module is used to determine at least one point on the curve based on at least one curve slope in the first curve graph, with one point corresponding to one curve slope. The sampling module is further configured to divide the first curve into at least two curve regions and the first brightness histogram into at least two histogram regions based on the reference brightness represented by the abscissa of the at least one point. The sampling module is further configured to, for any one of the at least two curve regions, determine the rate of change of the curve within the curve region based on the relationship between the slope of the curve within the curve region and the slope at the endpoint of the curve within the curve region. The sampling module is also used to determine the upsampling ratio of the curve region based on the rate of change of the curve within the curve region, wherein the upsampling ratio of the curve region is positively correlated with the rate of change of the curve within the curve region; The sampling module is further configured to determine, based on the upsampling ratio of the curve region, the ratio of upsampling the histogram region corresponding to the curve region in the at least two histogram regions; The sampling module is also used to upsample the at least two curve regions at different ratios to obtain a second curve. The sampling module is further configured to upsample the at least two histogram regions at different ratios to obtain a second brightness histogram. The adjustment module is used to adjust the backlight brightness of the display screen based on the second curve and the second brightness histogram.
7. A terminal, characterized in that, The terminal includes a processor and a memory; the memory stores at least one piece of program code, which is executed by the processor to implement the backlight adjustment method as described in any one of claims 1 to 5.
8. A computer-readable storage medium, characterized in that, The storage medium stores at least one piece of program code, which is executed by a processor to implement the backlight adjustment method as described in any one of claims 1 to 5.
9. A computer program product, comprising a computer program, characterized in that, The computer program is loaded and executed by a processor to implement the backlight adjustment method as described in any one of claims 1 to 5.
Citation Information
Patent Citations
Method and device for adjusting display image based on backlight brightness
CN108257580A
Backlight control method and device and display equipment
CN114420059A