Backlight adjustment method, device, terminal and storage medium
By interpolating and upsampling the brightness histogram and curve of the LCD monitor, the backlight brightness is adjusted, which solves the energy waste problem when the LCD monitor displays high-brightness images and achieves more efficient backlight management.
Patent Information
- Application Number
- CN202211496801.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-11-24
- Publication Date
- 2025-12-02
- Estimated Expiration
- 2042-11-24
AI Technical Summary
In LCD monitors, when displaying images with only a few high-brightness areas, the backlight remains at maximum brightness, resulting in energy waste.
By acquiring the brightness histogram and curve of the target image, upsampling is performed using histogram and curve interpolation to determine the appropriate backlight brightness and adjust the backlight brightness of the display screen.
Accurately determining the backlight brightness when displaying the target image reduces power consumption and avoids energy waste from keeping the backlight at maximum brightness.
Smart Images

Figure CN115862552B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of computer technology, and in particular to a backlight adjustment method, apparatus, terminal and storage medium. Background Technology
[0002] With the development of LCD technology, users are increasingly demanding higher image quality from LCD monitors. When displaying images on an LCD monitor, since the liquid crystal itself does not emit light, the monitor's backlight must be turned on to display the image. In traditional LCD technology, the backlight is always on at maximum brightness, regardless of the content being displayed. This results in wasted power consumption when displaying images with only a few high-brightness areas. Summary of the Invention
[0003] This application provides a backlight adjustment method, apparatus, terminal, and storage medium, capable of determining a suitable backlight brightness when displaying a target image, thereby adjusting the backlight brightness of the display screen when displaying the target image. The technical solution is as follows:
[0004] On the one hand, a backlight adjustment method is provided, the method comprising:
[0005] Acquire a target image, a first curve of the target image, and a first brightness histogram of the target image. The first curve is used to indicate the correspondence between the brightness of the target image and the backlight brightness of the display screen, and the first brightness histogram is used to indicate the correspondence between the brightness of pixels and the number of pixels in the target image.
[0006] The first brightness histogram is upsampled based on at least one histogram interpolation method to obtain the second brightness histogram;
[0007] Based on at least one curve interpolation method, the first curve is upsampled to obtain the second curve.
[0008] The backlight brightness of the display screen is adjusted based on the second brightness histogram and the second curve.
[0009] On the other hand, a backlight adjustment device is provided, the device comprising:
[0010] The first acquisition module is used to acquire a target image, a first curve of the target image, and a first brightness histogram of the target image. The first curve is used to indicate the correspondence between the brightness of the target image and the backlight brightness of the display screen, and the first brightness histogram is used to indicate the correspondence between the brightness of pixels and the number of pixels in the target image.
[0011] The first upsampling module is used to upsample the first brightness histogram based on at least one histogram interpolation method to obtain a second brightness histogram.
[0012] The second upsampling module is used to upsample the first curve based on at least one curve interpolation method to obtain the second curve.
[0013] An adjustment module is used to adjust the backlight brightness of the display screen based on the second brightness histogram and the second curve.
[0014] In some embodiments, the first brightness histogram includes a plurality of first brightness values of pixels;
[0015] The first upsampling module is configured to, for any one of the plurality of first brightness values, insert at least one second brightness value to the left of the first brightness value based on the histogram interpolation method corresponding to the first brightness value; allocate the number of pixels corresponding to the first brightness value to the at least one second brightness value based on the allocation ratio indicated by the histogram interpolation method corresponding to the first brightness value, so as to realize the upsampling of the first brightness value; and obtain the second brightness histogram after completing the upsampling of the plurality of first brightness values.
[0016] In some embodiments, the second curve includes the plurality of first brightness values of the pixels;
[0017] The second upsampling module is used to insert at least one second brightness to the left of any one of the plurality of first brightnesses based on the curve interpolation method corresponding to the first brightness; determine the backlight brightness corresponding to the at least one second brightness based on the curve interpolation method corresponding to the first brightness and the backlight brightness corresponding to the first brightness, so as to realize the upsampling of the first brightness; and obtain the second curve after completing the upsampling of the plurality of first brightnesses.
[0018] In some embodiments, the apparatus further includes:
[0019] The first determining module is used to determine a pixel number threshold based on the total number of pixels in the first brightness histogram;
[0020] The second determining module is used to determine, for any one of the plurality of first brightnesses, if the number of pixels corresponding to the first brightness is greater than the pixel number threshold, the histogram interpolation method corresponding to the first brightness is the first histogram interpolation method.
[0021] The second determining module is further configured to determine the histogram interpolation method corresponding to the first brightness as the second histogram interpolation method when the number of pixels corresponding to the first brightness is not greater than the number of pixels threshold, wherein the number of interpolations of the first histogram interpolation method is less than the number of interpolations of the second histogram interpolation method.
[0022] In some embodiments, the apparatus further includes:
[0023] The second acquisition module is used to acquire the target image, the third curve of the target image, and the third brightness histogram of the target image. The third curve is used to indicate the correspondence between the brightness of the target image and the backlight brightness of the display screen, and the third brightness histogram is used to indicate the correspondence between the brightness of pixels and the number of pixels in the target image.
[0024] The first downsampling module is used to downsample the third brightness histogram based on at least one histogram sampling method to obtain the first brightness histogram.
[0025] The second downsampling module is used to downsample the third curve based on at least one curve sampling method to obtain the first curve.
[0026] The storage module is used to store the target image, the first curve, and the first brightness histogram.
[0027] In some embodiments, the first downsampling module is configured to determine at least one first luminance in the third luminance histogram based on the at least one histogram sampling method; divide the third luminance histogram into at least two histogram regions based on the at least one first luminance, with one histogram region corresponding to one first luminance; for any first luminance, use the first luminance as the abscissa in the first luminance histogram; and use the total number of pixels in the histogram region corresponding to the first luminance as the ordinate in the first luminance histogram.
[0028] In some embodiments, the second downsampling module is used to determine at least one third brightness in the third curve based on at least one curve sampling method; and to draw the first curve based on the at least one third brightness and the backlight brightness of the at least one third brightness.
[0029] In some embodiments, the adjustment module is configured to determine the target brightness of the target image based on the second brightness histogram, wherein the target brightness is the largest brightness among a plurality of candidate brightnesses, and the number of pixels corresponding to the candidate brightnesses is greater than a number threshold; determine the target backlight brightness corresponding to the target brightness from the second curve; and adjust the backlight brightness of the display screen to the target backlight brightness.
[0030] In some embodiments, the apparatus further includes:
[0031] A pixel brightness adjustment module is used to adjust the brightness of pixels in the target image based on the backlight brightness of the display screen;
[0032] The display module is used to display the target image based on the brightness of the pixels in the target image and the backlight brightness of the display screen.
[0033] On the other hand, a terminal is provided, the terminal including a processor and a memory, the memory storing at least one computer program, the at least one computer program being loaded and executed by the processor to implement the backlight adjustment method as described above.
[0034] On the other hand, a computer-readable storage medium is provided that stores at least one computer program, which is loaded and executed by a processor to implement the backlight adjustment method as described above.
[0035] On the other hand, a computer program product is provided, including a computer program loaded and executed by a processor to implement the backlight adjustment method as described above.
[0036] This application provides a backlight adjustment scheme. By upsampling a first luminance histogram based on at least one histogram interpolation method, the first luminance histogram can be expanded more accurately to obtain a second luminance histogram with more sampling points. Similarly, by using at least one curve interpolation method, a second curve with more sampling points can be obtained. Since the luminance histogram is used to indicate the relationship between the number of pixels in the target image and the brightness of the pixels, and the curve is used to indicate the correspondence between the brightness of the target image and the backlight brightness, the rich sampling points in the second luminance histogram and the second curve can more accurately determine the appropriate backlight brightness when displaying the target image, thereby adjusting the backlight brightness of the display screen when displaying the target image. Compared to setting the backlight brightness to maximum for any image, this reduces power consumption. Attached Figure Description
[0037] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0038] Figure 1 This is a schematic diagram of an implementation environment provided in an embodiment of this application;
[0039] Figure 2 This is a flowchart of a backlight adjustment method provided in an embodiment of this application;
[0040] Figure 3 This is a flowchart of another backlight adjustment method provided in the embodiments of this application;
[0041] Figure 4 This is a schematic diagram of a third luminance histogram provided in an embodiment of this application;
[0042] Figure 5 This is a schematic diagram of a first brightness histogram provided in an embodiment of this application;
[0043] Figure 6 This is a schematic diagram of a third curve provided in an embodiment of this application;
[0044] Figure 7 This is a schematic diagram of a first graph provided in an embodiment of this application;
[0045] Figure 8 This is a schematic diagram of a brightness histogram provided in an embodiment of this application;
[0046] Figure 9 This is a schematic diagram of a graph provided in an embodiment of this application;
[0047] Figure 10 This is a schematic diagram of the structure of a backlight adjustment device provided in an embodiment of this application;
[0048] Figure 11 This is a schematic diagram of another backlight adjustment device provided in the embodiments of this application;
[0049] Figure 12 This is a schematic diagram of the structure of a terminal provided in an embodiment of this application. Detailed Implementation
[0050] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the implementation methods of this application will be further described in detail below with reference to the accompanying drawings.
[0051] It is understood that the terms "first," "second," etc., used in this application may be used to describe various concepts herein, but unless otherwise stated, these concepts are not limited by these terms. These terms are only used to distinguish one concept from another. For example, without departing from the scope of this application, a first luminance histogram may be referred to as a second luminance histogram, and similarly, a second luminance histogram may be referred to as a first luminance histogram.
[0052] "At least one" refers to one or more second brightness levels. For example, at least one second brightness level can be any integer number of second brightness levels greater than or equal to one, such as one second brightness level, two second brightness levels, three second brightness levels, etc. "Multiple" refers to two or more second brightness levels. For example, multiple second brightness levels can be any integer number of second brightness levels greater than or equal to two, such as two second brightness levels, three second brightness levels, etc. "Each" refers to each of the at least one second brightness level. For example, each second brightness level refers to each of the multiple second brightness levels. If the multiple second brightness levels are three second brightness levels, then each second brightness level refers to each of the three second brightness levels.
[0053] It should be noted that all information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.), and signals involved in this application have been authorized by the user or fully authorized by all parties, and the collection, use, and processing of related data must comply with the relevant laws, regulations, and standards of the relevant countries and regions. For example, the target images involved in this application were all obtained with full authorization.
[0054] Figure 1 This is a schematic diagram of an implementation environment provided in an embodiment of this application. See also... Figure 1 The implementation environment includes: terminal 101 and server 102.
[0055] Terminal 101 can be at least one of the following devices: LCD monitor, smartphone, smartwatch, desktop computer, laptop, MP3 player (Moving Picture Experts Group Audio Layer III), MP4 player (Moving Picture Experts Group Audio Layer IV), and laptop computer. An application can be installed and run on terminal 101 to display the target image. Users can log in to the application through terminal 101 to view the target image. Terminal 101 can be connected to server 102 via a wireless network or wired network.
[0056] Terminal 101 can refer to one of multiple terminals; this embodiment uses terminal 101 as an example. Those skilled in the art will understand that the number of terminals can be more or less. For example, there may be several terminals, or dozens or hundreds, or even more. This embodiment does not limit the number of terminals or the type of devices. The application is associated with server 102, which provides background services.
[0057] Server 102 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms. Server 102 is associated with the aforementioned application and provides background services to the application. In some embodiments, terminal 101, based on the application, obtains a target image, a first curve of the target image, and a first brightness histogram of the target image from server 102, and displays the target image through the application. In some embodiments, terminal 101 includes a TCON (Timing Controller) and a display. The display is used to display a target image. After receiving the target image, the first curve of the target image, and the first brightness histogram of the target image sent by the server 102, the TCON determines the backlight brightness of the display screen when displaying the target image based on the backlight adjustment method provided in this application embodiment. It then converts the target image into a timing signal required for the display to display the target image, and transmits the pixel data of the target image and the backlight brightness of the display screen to the display, thereby achieving the purpose of the display showing the target image based on the backlight brightness. Optionally, the backlight adjustment method provided in this application embodiment can also be executed by the CPU (Central Processing Unit) of the terminal. Alternatively, after receiving the target image, the first curve of the target image, and the first brightness histogram of the target image sent by the server 102, an external server processes the first curve and the first brightness histogram of the target image based on the backlight adjustment method provided in this application embodiment to determine the backlight brightness of the display screen when displaying the target image. This application embodiment does not impose any limitations on this.
[0058] In some embodiments, server 102 undertakes the primary computing task, and terminal 101 undertakes the secondary computing task; or, server 102 undertakes the secondary computing task, and terminal 101 undertakes the primary computing task; or, server 102 and terminal 101 collaborate on computing using a distributed computing architecture. Server 102 can connect to terminal 101 and other terminals via a wireless network or a wired network. Optionally, the number of servers can be more or less, and this embodiment does not limit this. Of course, server 102 may also include other functional servers to provide more comprehensive and diversified services.
[0059] Figure 2 This is a flowchart of a backlight adjustment method provided in an embodiment of this application. The method is executed by a terminal. (See also...) Figure 2 The method includes:
[0060] 201. The terminal acquires a target image, a first curve of the target image, and a first brightness histogram of the target image. The first curve is used to indicate the correspondence between the brightness of the target image and the backlight brightness of the display screen, and the first brightness histogram is used to indicate the correspondence between the brightness of pixels and the number of pixels in the target image.
[0061] In this embodiment, the terminal is a device with a display screen, such as a mobile phone, desktop computer, laptop computer, or smart TV. The target image can be an image to be displayed or an image of any frame from a video to be displayed. Accordingly, the terminal can display the target image through the display screen. Optionally, the display screen is a liquid crystal display screen. The terminal can acquire the target image, a first luminance histogram of the target image, and a first curve of the target image. The terminal can acquire the target image, the first luminance histogram, and the first curve of the target image from local storage, or it can acquire the target image, the first luminance histogram, and the first curve of the target image from a server. Accordingly, the terminal can send an acquisition request to the server and receive the target image, the first curve of the target image, and the first luminance histogram of the target image returned by the server.
[0062] Since the display screen itself does not emit light, the terminal needs to turn on the screen's backlight to display the image. The target image contains multiple pixels, and different pixels have different brightness. In the first brightness histogram, the horizontal axis represents the brightness of a pixel, and the vertical axis represents the number of pixels. In the first curve graph, the horizontal axis represents the brightness of the target image, and the vertical axis represents the backlight brightness of the display screen. In related technologies, the horizontal axis of the curve graph represents the highest brightness of a pixel in the corresponding image. However, in this embodiment, the brightness of the target image is one of the brightnesses of all pixels in the target image, which represents the brightness of pixels in the target image whose number of pixels is greater than a preset threshold. The preset threshold can be 60%, 70%, or 80% of the total number of pixels in the target image; this embodiment does not limit the specific number of the preset threshold. Accordingly, based on the obtained first brightness histogram and first curve graph, the terminal can determine the backlight brightness of the display screen when displaying the target image and display the target image based on the backlight brightness.
[0063] 202. The terminal upsamples the first brightness histogram based on at least one histogram interpolation method to obtain the second brightness histogram.
[0064] In this embodiment, the terminal inserts sampling points into a first luminance histogram using at least one histogram interpolation method to obtain a second luminance histogram. The histogram interpolation method indicates the position and number of inserted sampling points in the first luminance histogram. The inserted sampling points indicate the luminance of a pixel and the number of pixels. The more sampling points inserted into the first luminance histogram, the denser the sampling points; conversely, the fewer sampling points inserted, the sparser the sampling points. By upsampling different parts of the first luminance histogram using at least one histogram interpolation method, the terminal can expand the first luminance histogram to obtain a second luminance histogram with more sampling points.
[0065] 203. The terminal upsamples the first curve based on at least one curve interpolation method to obtain the second curve.
[0066] In this embodiment, the terminal inserts sampling points onto the curve of a first curve using at least one curve interpolation method to obtain a second curve. The curve interpolation method indicates the position and number of sampling points inserted onto the curve of the first curve. The inserted sampling points indicate pixel brightness and display backlight brightness. By upsampling different portions of the first curve using at least one curve interpolation method, the terminal can expand the first curve and obtain a second curve with more sampling points.
[0067] 204. The terminal adjusts the backlight brightness of the display screen based on the second brightness histogram and the second curve.
[0068] In this embodiment, the terminal determines a brightness level from the second brightness histogram based on the correspondence between the number of pixels and the brightness of the pixels in the target image, indicated by the second brightness histogram. Then, based on the correspondence between the brightness of the target image and the backlight brightness of the display screen, indicated by a second curve, the terminal determines the corresponding backlight brightness of the display screen, thereby determining a suitable backlight brightness for displaying the target image. The terminal adjusts the backlight brightness of the display screen to display the target image.
[0069] This application provides a backlight adjustment method. By upsampling a first luminance histogram based on at least one histogram interpolation method, the first luminance histogram can be expanded more accurately to obtain a second luminance histogram with more sampling points. Similarly, by using at least one curve interpolation method, a second curve with more sampling points can be obtained. Since the luminance histogram is used to indicate the correspondence between the number of pixels in the target image and the brightness of the pixels, and the curve is used to indicate the correspondence between the brightness of the target image and the backlight brightness of the display screen, the rich sampling points in the second luminance histogram and the second curve can more accurately determine the appropriate backlight brightness when displaying the target image, thereby adjusting the backlight brightness of the display screen when displaying the target image. Compared to setting the backlight brightness to maximum for any image, this reduces power consumption.
[0070] Figure 3 This is a flowchart of another backlight adjustment method provided in an embodiment of this application. This method is executed by a terminal. See [link to flowchart]. Figure 3 The method includes:
[0071] 301. The terminal acquires the target image, the third curve of the target image, and the third brightness histogram of the target image. The third curve is used to indicate the correspondence between the brightness of the target image and the backlight brightness of the display screen, and the third brightness histogram is used to indicate the correspondence between the brightness of pixels and the number of pixels in the target image.
[0072] In this embodiment, the target image can be an image to be displayed or an image from any frame of a video to be displayed. The terminal can receive the target image, a third curve of the target image, and a third luminance histogram of the target image sent by the server. The third curve is a curve of the target image without compression, and the third luminance histogram is a luminance histogram of the target image without compression. Here, "without compression" means that the initial sampling points are retained; correspondingly, after compression (as in sampling), the number of sampling points will be reduced.
[0073] In some embodiments, the terminal can directly adjust the backlight brightness of the display screen based on the third curve and the third luminance histogram, without performing steps 302-314 below. Accordingly, the terminal determines a luminance from the third luminance histogram based on the number of pixels in the target image. The terminal then determines the corresponding backlight brightness of the display screen from the third curve. The terminal adjusts the backlight brightness of the display screen to display the target image.
[0074] It should be noted that, since the third curve and the third brightness histogram occupy a large amount of storage space, the terminal can compress the third curve and the third brightness histogram by executing the following steps 302-303 to reduce the storage space occupied by the third curve and the third brightness histogram.
[0075] It should be noted that during the downsampling of the third curve and the third brightness histogram in steps 302-303 below, the sampling method for the third curve and the sampling method for the third histogram can be the same or different. The consistent sampling method means that the sampling method for the horizontal axis is the same.
[0076] 302. The terminal downsamples the third brightness histogram based on at least one histogram sampling method to obtain the first brightness histogram.
[0077] In this embodiment, the terminal merges some sampling points in the third brightness histogram based on at least one histogram sampling method to obtain a first brightness histogram. Each sampling point in the third brightness histogram indicates the brightness of the corresponding pixel and the number of pixels corresponding to that sampling point. The at least one histogram sampling method can be one or more. Accordingly, the terminal uses one histogram sampling method to downsample the third brightness histogram. Alternatively, the terminal divides the third brightness histogram into multiple histogram regions and downsamples each histogram region using a different histogram sampling method. By downsampling the third brightness histogram based on at least one histogram sampling method, the various parts of the third brightness histogram can be compressed, reducing the storage space occupied by storing the third brightness histogram.
[0078] In some embodiments, the terminal can downsample different regions of the third brightness histogram based on different histogram sampling methods. Accordingly, the terminal determines at least one first brightness in the third brightness histogram based on multiple histogram sampling methods. Different histogram sampling methods can indicate different ways of determining at least one first brightness. The way of determining at least one first brightness includes determining at least one first brightness according to different downsampling intervals. Based on at least one first brightness, the terminal divides the third brightness histogram into at least two histogram regions, with one histogram region corresponding to one first brightness. For any first brightness, the terminal uses that first brightness as the abscissa of the first brightness histogram and the total number of pixels in the histogram region corresponding to that first brightness as the ordinate of the first brightness in the first brightness histogram. By using different histogram sampling methods, more accurate downsampling can be performed for different regions of the third brightness histogram using the histogram sampling method corresponding to that region, thereby improving the compression effect of the third brightness histogram.
[0079] In some embodiments, the terminal can also downsample the third brightness histogram based on a histogram sampling method. Accordingly, the terminal determines at least one first brightness in the third brightness histogram based on this histogram sampling method. Based on at least one first brightness, the terminal divides the third brightness histogram into at least two histogram regions, with each histogram region corresponding to one first brightness. For any first brightness, the terminal uses that first brightness as the abscissa of the first brightness histogram and the total number of pixels in the histogram region corresponding to that first brightness as the ordinate of the first brightness in the first brightness histogram. This histogram sampling method enables downsampling of the third brightness histogram at a certain sampling interval, achieving compression of the third brightness histogram.
[0080] For example, such as Figure 4 The third luminance histogram shown includes 2 10Each sampling point, i.e., the sampling point in the third brightness histogram, has an x-coordinate of 0-1023 nits, indicating the brightness of the pixel corresponding to each of the 1024 sampling points. If a histogram sampling method indicates a downsampling interval of 8, the terminal determines 128 first brightness levels based on this downsampling interval. That is, every 8 brightness levels, the terminal determines the largest brightness among those 8 brightness levels as a first brightness level. For example, if the terminal is between 0-7 nits, it determines the first first brightness level as 7 nits; if it is between 8-15 nits, it determines the second first brightness level as 15 nits, and so on, until it is between 1016-1023 nits, where it determines the 128th first brightness level as 1023 nits. Accordingly, the third brightness histogram is divided into 128 histogram regions, with one histogram region corresponding to one first brightness level. Based on the determined 128 first brightness levels, the terminal merges the brightness of every 8 adjacent pixels in the third brightness histogram into the same group, resulting in 128 groups, each group corresponding to one first brightness level. For example, 0-7 nits is the first group, and the first brightness corresponding to the first group is 7 nits; 8-15 nits is the second group, and the first brightness corresponding to the second group is 15 nits. The terminal uses the group number of each group as the x-axis of the first brightness histogram and the number of pixels corresponding to each group as the y-axis, resulting in the following... Figure 5 The first brightness histogram is shown below. For example, if the brightness of a pixel is between 0 and 7 nits, this pixel is added to the first group, and the number of pixels in the first group is incremented by 1. If the brightness of a pixel is between 8 and 15 nits, this pixel is added to the second group, and the number of pixels in the second group is incremented by 1. And so on. If the brightness of a pixel is between 1016 and 1023 nits, this pixel is added to the last group (group 128), and the number of pixels in group 128 is incremented by 1.
[0081] In some embodiments, the terminal uses the first brightness as the horizontal axis of the first brightness histogram and the number of pixels corresponding to each group as the vertical axis corresponding to the first brightness to obtain the first brightness histogram.
[0082] 303. The terminal downsamples the third curve based on at least one curve sampling method to obtain the first curve.
[0083] In this embodiment, the terminal merges some sampling points in the third curve based on at least one curve sampling method to obtain a first curve. The sampling points in the third curve indicate the brightness of the target image corresponding to that sampling point and the backlight brightness of the display screen corresponding to that sampling point. Specifically, when there is one histogram sampling method, there is one curve sampling method; when there are multiple histogram sampling methods, there are also multiple curve sampling methods. Accordingly, the terminal uses one curve sampling method to downsample the third brightness curve. Alternatively, the terminal downsamples different parts of the third curve based on multiple different curve sampling methods. By downsampling the third curve based on at least one curve sampling method, the various parts of the third curve can be compressed, reducing the storage space occupied by storing the third curve.
[0084] In some embodiments, when the sampling method for the third curve is inconsistent with the sampling method for the third histogram, the terminal can downsample the third curve based on one or more curve sampling methods. See Embodiment 1 and Embodiment 2 below.
[0085] In Method 1, the terminal can downsample the third curve based on multiple different curve sampling methods. Correspondingly, the terminal determines at least one third brightness level in the third curve based on these multiple curve sampling methods. Different curve sampling methods indicate different ways of determining at least one third brightness level. These methods include determining at least one third brightness level according to different downsampling intervals. The terminal draws a first curve based on the at least one third brightness level and the backlight brightness of the at least one third brightness level. By using different curve sampling methods, more precise downsampling can be performed on different parts of the third curve, improving the compression effect of the third curve.
[0086] Method Two: The terminal downsamples the third curve based on a curve sampling method. Correspondingly, the terminal determines at least one third brightness level in the third curve based on this curve sampling method. The terminal then plots the first curve based on the at least one third brightness level and the backlight brightness of that third brightness level. This curve sampling method allows the third curve to be downsampled at a certain sampling interval, achieving compression of the third curve.
[0087] For example, such as Figure 6 The third graph shown includes 2 10There are 1024 sampling points. The horizontal axis of the third curve is 0-1023 nits, indicating the brightness of the target image corresponding to each of the 1024 sampling points. The vertical axis indicates the backlight brightness of the display screen corresponding to the brightness of the target image. If the downsampling interval indicated by the curve sampling method is 32, the terminal determines 32 third brightness values based on this sampling interval. The terminal then plots the first curve based on these 32 third brightness values and the corresponding backlight brightness of the display screen.
[0088] In some embodiments, when the sampling method of the terminal for the third curve is consistent with the sampling method for the third histogram, the terminal can downsample the third curve based on one or more curve sampling methods. Specifically, during the downsampling of the third curve, at least one third brightness determined based on one or more curve sampling methods is consistent with the first brightness in the first brightness histogram. See embodiments three and four below.
[0089] Method 3: The terminal can downsample the third curve based on different curve sampling methods. Accordingly, the terminal determines at least one first luminance consistent with the first luminance histogram in the third curve based on multiple curve sampling methods. The terminal then plots the first curve based on the at least one first luminance and the backlight luminance of that first luminance. By determining the first luminance consistent with the first luminance histogram, the backlight luminance of the display screen corresponding to the first luminance in the first luminance histogram can be retained in the first curve. Thus, after determining the luminance of a target image from the first luminance histogram, the corresponding backlight luminance can be found in the first curve.
[0090] Method four: The terminal can downsample the third curve based on a curve sampling method. Accordingly, based on this curve sampling method, the terminal determines at least one first luminance in the third curve that matches the first luminance histogram. The terminal then plots the first curve based on at least one first luminance and the backlight luminance of that first luminance. Through this curve sampling method, the third curve can be downsampled according to the third luminance histogram. Figure 1 By downsampling at consistent sampling intervals, compression of the third curve is achieved. Furthermore, after determining the brightness of a target image from the first brightness histogram, the corresponding backlight brightness of the target image can be found from the first curve.
[0091] For example, such as Figure 6 The third graph shown includes 2 10The third curve has 1024 sampling points. The horizontal axis of the curve is 0-1023 nits, indicating the brightness of the target image corresponding to each of the 1024 sampling points. The vertical axis indicates the backlight brightness of the display screen corresponding to the brightness of the target image. If the sampling method of the curve is consistent with the sampling method of the third histogram, and the downsampling interval indicated by the sampling method of the third histogram is 32, the terminal determines 32 first brightness points in the third brightness histogram and 32 third brightness points corresponding to the first brightness points in the third curve based on the sampling method of the third histogram. Among them, the 32 first brightness points and the 32 third brightness points each correspond to 32 groups. The terminal uses the group number corresponding to the 32 third brightness points as the horizontal axis of the first curve and the backlight brightness of the display screen corresponding to each third brightness point as the vertical axis of the group, and plots the curve as shown below. Figure 7 The first curve shown.
[0092] 304. The terminal stores the target image, the first curve, and the first brightness histogram.
[0093] In this embodiment, the terminal stores the target image, a first curve, and a first brightness histogram. Since the stored first curve and first brightness histogram are obtained through downsampling, the storage space occupied is reduced.
[0094] For example, for a target image with a pixel resolution of 1080*1920, the storage space occupied by the third curve is... The storage space occupied by the third brightness histogram is [log2]. (1080×1920 / 4port / 1024) ]×(2 10 = 9 × 1024 = 9216 bits. Here, 4 ports indicates that 4 pixels can be processed in parallel, and each port represents one of the three channels (R (Red), G (Green), and B (Blue)) for each pixel. The storage space occupied by the first curve obtained after downsampling is... The storage space occupied by the first brightness histogram obtained after downsampling is [log2]. (1080×1920 / 4port / 1024) ]×(2 7 = 9 × 128 = 1152 bits. The first curve and the first brightness histogram obtained after terminal storage compression can reduce the storage space by 17984 bits compared to storing the third curve and the third brightness histogram without compression.
[0095] 305. The terminal acquires a target image, a first curve of the target image, and a first brightness histogram of the target image, wherein the first brightness histogram includes multiple first brightness values of pixels.
[0096] In this embodiment, the terminal obtains the target image, the first curve of the target image, and the first brightness histogram of the target image stored in step 304 from its local storage. The horizontal axis of the first brightness histogram of the target image includes multiple first brightness values of the pixels.
[0097] In some embodiments, the terminal may acquire the target image, a first curve of the target image, and a first brightness histogram of the target image from its local storage based on a preloading instruction for the target image. The terminal may trigger the preloading instruction for the target object when displaying the previous frame of the target image, or it may trigger the preloading instruction for the target object when displaying the previous N frames of the target image, where N is an integer greater than 2.
[0098] In some embodiments, the terminal obtains a target image, a first curve of the target image, and a first brightness histogram of the target image from the server. Accordingly, the terminal may omit steps 301-304 described above.
[0099] It should be noted that after the terminal acquires the target image, the first curve of the target image, and the first brightness histogram of the target image, it can upsample the first curve and the first brightness histogram separately, as shown in steps 306-311. It should also be noted that the terminal may choose not to upsample the first histogram. In this case, the histogram interpolation method is not performed, and the terminal upsamples the first curve based on the first brightness histogram to ensure that the number of x-axis points in the two graphs is consistent, as shown in steps 309-311.
[0100] 306. For any one of the multiple first brightness levels, the terminal inserts at least one second brightness level to the left of the first brightness level based on the histogram interpolation method corresponding to the first brightness level.
[0101] In this embodiment, for any first brightness in the first brightness histogram, the terminal inserts at least one second brightness to the left of the first brightness based on the histogram interpolation method corresponding to that first brightness. The histogram interpolation method indicates the number of inserted second brightnesses and the interpolation interval between them. Since the first brightness obtained during downsampling of the third brightness histogram in step 302 is the maximum pixel brightness in the histogram region corresponding to that first brightness, and the brightness of pixels on the left side of the first brightness histogram is less than the brightness of pixels on the right side, the terminal can insert at least one second brightness to the left of the first brightness during upsampling of the first brightness histogram.
[0102] For example, for a first luminance histogram containing 128 first luminance values, when the first luminance is 7 nits, the interpolation method corresponding to the first luminance indicates that the number of second luminance values inserted is 7, and the interpolation interval for inserting the second luminance values is equal. Based on the histogram interpolation method corresponding to the first luminance, the terminal inserts 7 second luminance values at equal intervals to the left of the first luminance: 6 nits, 5 nits, 4 nits, 3 nits, 2 nits, 1 nit, and 0 nits.
[0103] In some embodiments, the terminal can determine the histogram interpolation method corresponding to the first brightness based on a pixel number threshold. The terminal determines the pixel number threshold based on the total number of pixels in the first brightness histogram. The pixel number threshold can be 50%, 60%, or 70% of the total number of pixels, etc., and this embodiment does not limit the pixel number threshold. For any first brightness among multiple first brightnesses, if the number of pixels corresponding to the first brightness is greater than the pixel number threshold, the histogram interpolation method corresponding to the first brightness is determined to be a first histogram interpolation method; if the number of pixels corresponding to the first brightness is not greater than the pixel number threshold, the histogram interpolation method corresponding to the first brightness is determined to be a second histogram interpolation method, where the number of interpolations in the first histogram interpolation method is less than the number of interpolations in the second histogram interpolation method. By determining the histogram interpolation method corresponding to the first brightness based on the number of pixels corresponding to the first brightness and the pixel number threshold, the histogram interpolation method corresponding to the first brightness can be selected for different first brightnesses in the first brightness histogram, so as to perform more accurate upsampling of the first brightness histogram.
[0104] 307. The terminal allocates the number of pixels corresponding to the first brightness to at least one second brightness based on the allocation ratio indicated by the histogram interpolation method corresponding to the first brightness, so as to achieve upsampling of the first brightness.
[0105] In this embodiment, the histogram interpolation method indicates the allocation ratio of the number of pixels corresponding to the first brightness to the newly inserted second brightness on the left. Based on the allocation ratio indicated by the histogram interpolation method corresponding to the first brightness, the terminal allocates the number of pixels corresponding to the first brightness to at least one newly inserted second brightness on the left, thereby achieving upsampling of the first brightness. Since the vertical axis of the first brightness obtained during the downsampling of the third brightness histogram in step 302 is the total number of pixels in the histogram region corresponding to that first brightness, the upsampling of the first brightness histogram can be reasonably expanded by redistributing the number of pixels corresponding to the first brightness to at least one newly inserted second brightness on the left, thus achieving upsampling of the first brightness.
[0106] 308. After completing upsampling of multiple first brightness values, the terminal obtains a second brightness histogram.
[0107] In this embodiment, the first luminance histogram includes multiple first luminance values of pixels. After the terminal performs upsampling on each first luminance value using steps 306 and 307 as described above, it obtains a second luminance histogram. Compared to the first luminance histogram, the second luminance histogram has more sampling points.
[0108] 309. For any one of the multiple first brightness levels, the terminal inserts at least one second brightness level to the left of the first brightness level based on the curve interpolation method corresponding to the first brightness level.
[0109] In this embodiment, the terminal inserts at least one second brightness to the left of the first brightness based on the curve interpolation method corresponding to the first brightness. The inserted second brightness is consistent with the at least one second brightness inserted into the first brightness histogram in step 308 above. Alternatively, the number of first brightnesses in the first curve and the number of at least one second brightness inserted into the first curve are consistent with the number of pixels in the first brightness histogram.
[0110] For example, if a second brightness is inserted at equal intervals into a first brightness histogram to obtain a second brightness histogram containing 128 brightness sampling points of indicator pixels, then 96 second brightness points need to be inserted at equal intervals into a first curve containing 32 first brightness points to obtain a second curve containing 128 brightness sampling points of indicator pixels.
[0111] 310. The terminal determines at least one backlight brightness corresponding to a second brightness based on the curve interpolation method corresponding to the first brightness and the backlight brightness corresponding to the first brightness, so as to realize the upsampling of the first brightness.
[0112] In this embodiment, the curve interpolation method can indicate and determine the backlight brightness corresponding to at least one second brightness. For any first brightness, the terminal determines the backlight brightness corresponding to at least one second brightness inserted to the left of the first brightness based on the curve interpolation method corresponding to the first brightness and the backlight brightness corresponding to the first brightness, according to the backlight brightness determination method indicated by the curve. The backlight brightness determination method includes, based on the first brightness adjacent to the first brightness to the left of the first brightness, reducing the backlight brightness corresponding to the first brightness at equal intervals to obtain the backlight brightness corresponding to at least one second brightness; or, based on the first brightness adjacent to the first brightness to the left of the first brightness, reducing the backlight brightness corresponding to the first brightness by a certain proportion to obtain the backlight brightness corresponding to at least one second brightness.
[0113] For example, if three second brightness levels are inserted to the left of a certain first brightness level, the interpolation method of the curve corresponding to the first brightness level indicates that the backlight brightness corresponding to the first brightness level is reduced at equal intervals based on the first brightness level adjacent to the first brightness level to the left of the first brightness level. The resulting backlight brightness is then used as the backlight brightness corresponding to the three second brightness levels. If the backlight brightness corresponding to the first brightness level is 1000 nits, and the first brightness level adjacent to the first brightness level to the left of the first brightness level is 800 nits, then the terminal determines the backlight brightness corresponding to the three second brightness levels as 850 nits, 900 nits, and 950 nits, respectively.
[0114] 311. After the terminal has completed upsampling of multiple first brightness values, it obtains the second curve.
[0115] In this embodiment, the first curve includes multiple first brightness values of pixels. After the terminal performs upsampling on each first brightness value using steps 309 and 310 as described above, it obtains a second curve. The second curve has more sampling points than the first curve.
[0116] 312. The terminal determines the target brightness of the target image based on the second brightness histogram. The target brightness is the maximum brightness among multiple candidate brightness levels, and the number of pixels corresponding to the candidate brightness is greater than the number threshold.
[0117] In this embodiment, the second brightness histogram indicates the correspondence between the number of pixels and the brightness of the pixels. Based on the second brightness histogram, the terminal determines at least one brightness level where the number of pixels in the second brightness histogram is greater than a number threshold, and selects at least one brightness level as a candidate brightness level. The terminal selects the largest candidate brightness level from among the candidate brightness levels as the target brightness level of the target image.
[0118] The quantity threshold is related to the size of the target image and the energy-saving intensity. A higher quantity threshold results in a lower target brightness and higher energy-saving intensity, but lower display quality of the target image; a lower quantity threshold results in a higher target brightness and lower energy-saving intensity, but better display quality of the target image. The quantity threshold can be set by the terminal or input by the user into the terminal; this application embodiment does not limit the source of the quantity threshold.
[0119] For example, such as Figure 8 The brightness histogram shown has a quantity threshold of 200. The terminal searches this brightness histogram from maximum brightness to minimum brightness for the first pixel whose quantity exceeds the quantity threshold. This pixel's brightness is 540 nits, and the target brightness is 540 nits.
[0120] 313. The terminal determines the target backlight brightness corresponding to the target brightness from the second curve graph.
[0121] In this embodiment, the second curve can indicate the correspondence between the brightness of the target image and the backlight brightness of the display screen. Since the target brightness of the target image can reflect the brightness of most pixels in the target image, after the terminal determines the target brightness of the target image, it determines the target backlight brightness corresponding to the target brightness from the second curve. This target backlight brightness is the appropriate backlight brightness when displaying the target image.
[0122] For example, such as Figure 9 The curve shown indicates that a target backlight brightness of 540 nits corresponds to a target backlight brightness of 850 nits, and the terminal determines the target backlight brightness to be 850 nits.
[0123] 314. The terminal adjusts the backlight brightness of the display screen to the target backlight brightness.
[0124] In this embodiment, after determining the target backlight brightness, the terminal adjusts the backlight brightness of the display screen to the target backlight brightness. Compared to the case where the backlight brightness is set to maximum for any image, determining the target backlight brightness for displaying the target image and adjusting the backlight brightness of the display screen to the target backlight brightness can reduce power consumption.
[0125] In some embodiments, after adjusting the backlight brightness of the display screen, the terminal can also perform pixel compensation. Based on the backlight brightness of the display screen, the terminal can adjust the brightness of pixels in the target image, and display the target image based on the brightness of the pixels in the target image and the backlight brightness of the display screen. The product of the adjustment ratio of the backlight brightness of the display screen and the adjustment ratio of the brightness of the pixels in the target image is 1. For example, if the backlight brightness of the display screen is reduced from 1023 nits to 850 nits, a reduction of 83.1% of the original, the brightness of the pixels in the target image is correspondingly increased by 1.2 times. By adjusting the brightness of the pixels in the target image, it is possible to avoid the displayed target image being too dark due to lowering the backlight brightness of the display screen.
[0126] Figure 10 This is a schematic diagram of a backlight adjustment device provided in an embodiment of this application. See also... Figure 10 The device includes: a first acquisition module 1001, a first upsampling module 1002, a second upsampling module 1003, and an adjustment module 1004.
[0127] The first acquisition module 1001 is used to acquire a target image, a first curve of the target image, and a first brightness histogram of the target image. The first curve is used to indicate the correspondence between the brightness of the target image and the backlight brightness of the display screen, and the first brightness histogram is used to indicate the correspondence between the brightness of pixels and the number of pixels in the target image.
[0128] The first upsampling module 1002 is used to upsample the first brightness histogram based on at least one histogram interpolation method to obtain the second brightness histogram.
[0129] The second upsampling module 1003 is used to upsample the first curve based on at least one curve interpolation method to obtain the second curve.
[0130] The adjustment module 1004 is used to adjust the backlight brightness of the display screen based on the second brightness histogram and the second curve.
[0131] In some embodiments, the first luminance histogram includes a plurality of first luminances of pixels;
[0132] The first upsampling module 1002 is used to, for any one of a plurality of first brightnesses, insert at least one second brightness to the left of the first brightness based on the histogram interpolation method corresponding to the first brightness; allocate the number of pixels corresponding to the first brightness to at least one second brightness based on the allocation ratio indicated by the histogram interpolation method corresponding to the first brightness, so as to realize the upsampling of the first brightness; and obtain a second brightness histogram after completing the upsampling of a plurality of first brightnesses.
[0133] In some embodiments, the second curve includes a plurality of first brightness values of pixels;
[0134] The second upsampling module 1003 is used to insert at least one second brightness to the left of any first brightness among a plurality of first brightnesses, based on the curve interpolation method corresponding to the first brightness; to determine the backlight brightness corresponding to at least one second brightness based on the curve interpolation method corresponding to the first brightness and the backlight brightness corresponding to the first brightness, so as to realize the upsampling of the first brightness; and to obtain a second curve after completing the upsampling of multiple first brightnesses.
[0135] In some embodiments, Figure 11 This is a schematic diagram of another backlight adjustment device provided in an embodiment of this application. See also... Figure 11 As shown, the device also includes:
[0136] The first determining module 1005 is used to determine a pixel number threshold based on the total number of pixels in the first brightness histogram.
[0137] The second determining module 1006 is used to determine the histogram interpolation method corresponding to the first brightness as the first histogram interpolation method when the number of pixels corresponding to the first brightness is greater than the number of pixels threshold for any one of the multiple first brightnesses.
[0138] The second determining module 1006 is further configured to determine the histogram interpolation method corresponding to the first brightness as the second histogram interpolation method when the number of pixels corresponding to the first brightness is not greater than the number of pixels threshold, wherein the number of interpolations of the first histogram interpolation method is less than the number of interpolations of the second histogram interpolation method.
[0139] In some embodiments, see Figure 11 As shown, the device also includes:
[0140] The second acquisition module 1007 is used to acquire a target image, a third curve of the target image, and a third brightness histogram of the target image. The third curve is used to indicate the correspondence between the brightness of the target image and the backlight brightness of the display screen, and the third brightness histogram is used to indicate the correspondence between the brightness of pixels and the number of pixels in the target image.
[0141] The first downsampling module 1008 is used to downsample the third brightness histogram based on at least one histogram sampling method to obtain the first brightness histogram.
[0142] The second downsampling module 1009 is used to downsample the third curve based on at least one curve sampling method to obtain the first curve.
[0143] Storage module 1010 is used to store the target image, the first curve, and the first brightness histogram.
[0144] In some embodiments, the first downsampling module 1008 is configured to determine at least one first luminance in a third luminance histogram based on at least one histogram sampling method; divide the third luminance histogram into at least two histogram regions based on at least one first luminance, with one histogram region corresponding to one first luminance; for any first luminance, use the first luminance as the abscissa in the first luminance histogram; and use the total number of pixels in the histogram region corresponding to the first luminance as the ordinate in the first luminance histogram.
[0145] In some embodiments, the second downsampling module 1009 is used to determine at least one third brightness in a third curve based on at least one curve sampling method; and to draw a first curve based on the at least one third brightness and the backlight brightness of the at least one third brightness.
[0146] In some embodiments, the adjustment module 1010 is used to determine the target brightness of the target image based on the second brightness histogram, wherein the target brightness is the largest brightness among a plurality of candidate brightnesses and the number of pixels corresponding to the candidate brightnesses is greater than a number threshold; determine the target backlight brightness corresponding to the target brightness from the second curve; and adjust the backlight brightness of the display screen to the target backlight brightness.
[0147] In some embodiments, see Figure 11 As shown, the device also includes:
[0148] The pixel brightness adjustment module 1011 is used to adjust the brightness of pixels in the target image based on the backlight brightness of the display screen.
[0149] Display module 1012 is used to display the target image based on the brightness of pixels in the target image and the backlight brightness of the display screen.
[0150] This application provides a backlight adjustment device that, by upsampling a first luminance histogram based on at least one histogram interpolation method, can more accurately expand the first luminance histogram to obtain a second luminance histogram with more sampling points. Similarly, by using at least one curve interpolation method, a second curve with more sampling points can be obtained. Since the luminance histogram is used to indicate the correspondence between the number of pixels in the target image and the brightness of the pixels, and the curve is used to indicate the correspondence between the brightness of the target image and the backlight brightness of the display screen, the rich sampling points in the second luminance histogram and the second curve can more accurately determine the appropriate backlight brightness when displaying the target image, thereby adjusting the backlight brightness of the display screen when displaying the target image. Compared to setting the backlight brightness to maximum for any image, this reduces power consumption.
[0151] It should be noted that the backlight adjustment device provided in the above embodiments is only an example of the division of the above functional modules. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the terminal can be divided into different functional modules to complete all or part of the functions described above. In addition, the backlight adjustment device and the backlight adjustment method embodiments provided in the above embodiments belong to the same concept, and the specific implementation process can be found in the method embodiments, which will not be repeated here.
[0152] This application also provides a terminal, which includes a processor and a memory. The memory stores at least one computer program, which is loaded and executed by the processor to implement the backlight adjustment method of the above embodiments.
[0153] Figure 12 This is a schematic diagram of the structure of a terminal provided in an embodiment of this application.
[0154] Terminal 1200 includes a processor 1201 and a memory 1202.
[0155] Processor 1201 may include one or more processing cores, such as a quad-core processor, an octa-core processor, etc. Processor 1201 may be implemented using at least one hardware form selected from DSP (Digital Signal Processing), FPGA (Field Programmable Gate Array), and PLA (Programmable Logic Array). Processor 1201 may also include a main processor and a coprocessor. The main processor, also known as a CPU (Central Processing Unit), is used to process data in the wake-up state; the coprocessor is a low-power processor used to process data in the standby state. In some embodiments, processor 1201 may integrate a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the screen. In some embodiments, processor 1201 may also include an AI (Artificial Intelligence) processor, which is used to handle computational operations related to machine learning.
[0156] The memory 1202 may include one or more computer-readable storage media, which may be non-transitory. The memory 1202 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices or flash memory devices. In some embodiments, the non-transitory computer-readable storage media in the memory 1202 are used to store at least one computer program, which is used by the processor 1201 to implement the backlight adjustment method provided in the method embodiments of this application.
[0157] In some embodiments, the terminal 1200 may also optionally include: a peripheral device interface 1203 and at least one peripheral device. The processor 1201, memory 1202, and peripheral device interface 1203 can be connected via a bus or signal line. Each peripheral device can be connected to the peripheral device interface 1203 via a bus, signal line, or circuit board. Optionally, the peripheral device includes at least one of: a radio frequency circuit 1204, a display screen 1205, a camera assembly 1206, an audio circuit 1207, and a power supply 1208.
[0158] Peripheral device interface 1203 can be used to connect at least one I / O (Input / Output) related peripheral device to processor 1201 and memory 1202. In some embodiments, processor 1201, memory 1202 and peripheral device interface 1203 are integrated on the same chip or circuit board; in some other embodiments, any one or two of processor 1201, memory 1202 and peripheral device interface 1203 can be implemented on separate chips or circuit boards, which is not limited in this embodiment.
[0159] The radio frequency (RF) circuit 1204 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The RF circuit 1204 communicates with communication networks and other communication devices via electromagnetic signals. The RF circuit 1204 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals back into electrical signals. Optionally, the RF circuit 1204 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, etc. The RF circuit 1204 can communicate with other devices via at least one wireless communication protocol. This wireless communication protocol includes, but is not limited to: metropolitan area networks (MANs), various generations of mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks (WLANs), and / or WiFi (Wireless Fidelity) networks. In some embodiments, the RF circuit 1204 may also include circuitry related to NFC (Near Field Communication), which is not limited in this application.
[0160] Display screen 1205 is used to display a UI (User Interface). This UI may include graphics, text, icons, videos, and any combination thereof. When display screen 1205 is a touch display screen, it also has the ability to collect touch signals on or above its surface. These touch signals can be input as control signals to processor 1201 for processing. In this case, display screen 1205 can also be used to provide virtual buttons and / or a virtual keyboard, also known as soft buttons and / or a soft keyboard. In some embodiments, there may be one display screen 1205, disposed on the front panel of terminal 1200; in other embodiments, there may be at least two display screens, disposed on different surfaces of terminal 1200 or in a folded design; in still other embodiments, display screen 1205 may be a flexible display screen, disposed on a curved or folded surface of terminal 1200. Furthermore, display screen 1205 may also be configured as a non-rectangular, irregular shape, i.e., a non-rectangular screen. The display screen 1205 can be made of materials such as LCD (Liquid Crystal Display) and OLED (Organic Light-Emitting Diode).
[0161] The camera assembly 1206 is used to acquire images or videos. Optionally, the camera assembly 1206 includes a front-facing camera and a rear-facing camera. The front-facing camera is disposed on the front panel of the terminal 1200, and the rear-facing camera is disposed on the back of the terminal 1200. In some embodiments, there are at least two rear-facing cameras, which are any one of a main camera, a depth-sensing camera, a wide-angle camera, and a telephoto camera, to achieve background blurring by fusion of the main camera and the depth-sensing camera, panoramic shooting by fusion of the main camera and the wide-angle camera, VR (Virtual Reality) shooting, or other fusion shooting functions. In some embodiments, the camera assembly 1206 may also include a flash. The flash may be a single-color temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm light flash and a cool light flash, which can be used for light compensation at different color temperatures.
[0162] The audio circuit 1207 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, converting the sound waves into electrical signals that are input to the processor 1201 for processing, or input to the radio frequency circuit 1204 for voice communication. For stereo sound acquisition or noise reduction purposes, multiple microphones may be used, each positioned at a different location on the terminal 1200. The microphone may also be an array microphone or an omnidirectional microphone. The speaker is used to convert electrical signals from the processor 1201 or the radio frequency circuit 1204 into sound waves. The speaker may be a conventional diaphragm speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can convert electrical signals not only into audible sound waves but also into inaudible sound waves for purposes such as distance measurement. In some embodiments, the audio circuit 1207 may also include a headphone jack.
[0163] Power supply 1208 is used to power the various components in terminal 1200. Power supply 1208 can be AC power, DC power, a disposable battery, or a rechargeable battery. When power supply 1208 includes a rechargeable battery, the rechargeable battery can support wired charging or wireless charging. The rechargeable battery can also be used to support fast charging technology.
[0164] In some embodiments, the terminal 1200 further includes one or more sensors 1209. The one or more sensors 1209 include, but are not limited to: an acceleration sensor 1210, a gyroscope sensor 1211, a pressure sensor 1212, an optical sensor 1213, and a proximity sensor 1214.
[0165] Accelerometer 1210 can detect the magnitude of acceleration on the three coordinate axes of a coordinate system established with terminal 1200. For example, accelerometer 1210 can be used to detect the components of gravitational acceleration on the three coordinate axes. Processor 1201 can control display screen 1205 to display the user interface in either a landscape or portrait view based on the gravitational acceleration signal acquired by accelerometer 1210. Accelerometer 1210 can also be used for games or for acquiring user motion data.
[0166] The gyroscope sensor 1211 can detect the orientation and rotation angle of the terminal 1200. The gyroscope sensor 1211 can work in conjunction with the accelerometer sensor 1210 to collect the user's 3D movements on the terminal 1200. Based on the data collected by the gyroscope sensor 1211, the processor 1201 can perform the following functions: motion sensing (e.g., changing the UI based on the user's tilt), image stabilization during shooting, game control, and inertial navigation.
[0167] The pressure sensor 1212 can be disposed on the side bezel of the terminal 1200 and / or on the lower layer of the display screen 1205. When the pressure sensor 1212 is disposed on the side bezel of the terminal 1200, it can detect the user's grip signal on the terminal 1200, and the processor 1201 can perform left / right hand recognition or quick operation based on the grip signal collected by the pressure sensor 1212. When the pressure sensor 1212 is disposed on the lower layer of the display screen 1205, the processor 1201 can control the operable controls on the UI interface based on the user's pressure operation on the display screen 1205. The operable controls include at least one of button controls, scroll bar controls, icon controls, and menu controls.
[0168] Optical sensor 1213 is used to collect ambient light intensity. In one embodiment, processor 1201 can control the display brightness of display screen 1205 based on the ambient light intensity collected by optical sensor 1213. Optionally, when the ambient light intensity is high, the display brightness of display screen 1205 is increased; when the ambient light intensity is low, the display brightness of display screen 1205 is decreased. In another embodiment, processor 1201 can also dynamically adjust the shooting parameters of camera assembly 1206 based on the ambient light intensity collected by optical sensor 1213.
[0169] The proximity sensor 1214, also known as a distance sensor, is installed on the front panel of the terminal 1200. The proximity sensor 1214 is used to detect the distance between the user and the front of the terminal 1200. In one embodiment, when the proximity sensor 1214 detects that the distance between the user and the front of the terminal 1200 is gradually decreasing, the processor 1201 controls the display screen 1205 to switch from a screen-on state to a screen-off state; when the proximity sensor 1214 detects that the distance between the user and the front of the terminal 1200 is gradually increasing, the processor 1201 controls the display screen 1205 to switch from a screen-off state to a screen-on state.
[0170] Those skilled in the art will understand that Figure 12 The structure shown does not constitute a limitation on terminal 1200 and may include more or fewer components than shown, or combine certain components, or use different component arrangements.
[0171] This application also provides a computer-readable storage medium storing at least one computer program, which is loaded and executed by a processor to implement the backlight adjustment method of the above embodiments.
[0172] This application also provides a computer program product, including a computer program that is loaded and executed by a processor to implement the backlight adjustment method as described in the above embodiments.
[0173] Those skilled in the art will understand that all or part of the steps of the above embodiments can be implemented by hardware or by a program instructing related hardware. The program can be stored in a computer-readable storage medium, such as a read-only memory, a disk, or an optical disk.
[0174] The above are merely optional embodiments of the present application and are not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present application should be included within the protection scope of the present application.
Claims
1. A backlight adjustment method, characterized in that, The method includes: Acquire a target image, a first curve of the target image, and a first brightness histogram of the target image. The horizontal axis of the first curve is the brightness of the target image, and the vertical axis is the backlight brightness of the display screen. The horizontal axis of the first brightness histogram is the brightness of the pixels in the target image, and the vertical axis is the number of pixels in the target image. The first brightness histogram includes multiple first brightness values of the pixels, and the first curve includes the multiple first brightness values of the pixels. Based on the total number of pixels in the first brightness histogram, a pixel number threshold is determined; For any one of the plurality of first brightness, if the number of pixels corresponding to the first brightness is greater than the pixel number threshold, the histogram interpolation method corresponding to the first brightness is determined to be the first histogram interpolation method. If the number of pixels corresponding to the first brightness is not greater than the pixel number threshold, the histogram interpolation method corresponding to the first brightness is determined to be the second histogram interpolation method, and the number of interpolations of the first histogram interpolation method is less than the number of interpolations of the second histogram interpolation method. Based on the histogram interpolation method corresponding to the first brightness, at least one second brightness is inserted to the left of the first brightness. Based on the allocation ratio indicated by the histogram interpolation method corresponding to the first brightness, the number of pixels corresponding to the first brightness is allocated to the at least one second brightness to achieve upsampling of the first brightness. After completing the upsampling of the multiple first brightnesses, a second brightness histogram is obtained. Based on the curve interpolation method corresponding to the first brightness, at least one second brightness is inserted to the left of the first brightness. Based on the curve interpolation method corresponding to the first brightness and the backlight brightness corresponding to the first brightness, the backlight brightness corresponding to the at least one second brightness is determined to achieve upsampling of the first brightness. After completing the upsampling of the multiple first brightnesses, a second curve is obtained. The backlight brightness of the display screen is adjusted based on the second brightness histogram and the second curve.
2. The method according to claim 1, characterized in that, Before acquiring the target image, the first curve of the target image, and the first brightness histogram of the target image, the method further includes: The target image, the third curve of the target image, and the third brightness histogram of the target image are obtained. The third curve is used to indicate the correspondence between the brightness of the target image and the backlight brightness of the display screen, and the third brightness histogram is used to indicate the correspondence between the brightness of pixels and the number of pixels in the target image. The third brightness histogram is downsampled based on at least one histogram sampling method to obtain the first brightness histogram; The third curve is downsampled based on at least one curve sampling method to obtain the first curve. The target image, the first curve, and the first brightness histogram are stored.
3. The method according to claim 2, characterized in that, The step of downsampling the third luminance histogram based on at least one histogram sampling method to obtain the first luminance histogram includes: Based on the at least one histogram sampling method, at least one first luminance is determined in the third luminance histogram; Based on the at least one first brightness, the third brightness histogram is divided into at least two histogram regions, with one histogram region corresponding to one first brightness; For any given first brightness, the first brightness is used as the horizontal axis of the first brightness histogram; The total number of pixels in the histogram region corresponding to the first brightness is used as the vertical axis of the first brightness in the first brightness histogram.
4. The method according to claim 3, characterized in that, The step of downsampling the third curve based on at least one curve sampling method to obtain the first curve includes: Based on at least one curve sampling method, at least one third brightness is determined in the third curve. The first curve is plotted based on the at least one third brightness and the backlight brightness of the at least one third brightness.
5. The method according to claim 1, characterized in that, Adjusting the backlight brightness of the display screen based on the second brightness histogram and the second curve includes: Based on the second brightness histogram, the target brightness of the target image is determined. The target brightness is the largest brightness among a plurality of candidate brightness values, and the number of pixels corresponding to the candidate brightness values is greater than a number threshold. Determine the target backlight brightness corresponding to the target brightness from the second curve graph; Adjust the backlight brightness of the display screen to the target backlight brightness.
6. The method according to claim 1, characterized in that, The method further includes: Adjust the brightness of pixels in the target image based on the backlight brightness of the display screen; The target image is displayed based on the brightness of the pixels in the target image and the backlight brightness of the display screen.
7. A backlight adjustment device, characterized in that, The device includes: The first acquisition module is used to acquire a target image, a first curve of the target image, and a first brightness histogram of the target image. The horizontal axis of the first curve is the brightness of the target image, and the vertical axis is the backlight brightness of the display screen. The horizontal axis of the first brightness histogram is the brightness of the pixels in the target image, and the vertical axis is the number of pixels in the target image. The first brightness histogram includes multiple first brightness values of the pixels, and the first curve includes the multiple first brightness values of the pixels. The first determining module is used to determine a pixel number threshold based on the total number of pixels in the first brightness histogram; The second determining module is used to determine, for any one of the plurality of first brightnesses, if the number of pixels corresponding to the first brightness is greater than the pixel number threshold, the histogram interpolation method corresponding to the first brightness is the first histogram interpolation method. The second determining module is further configured to determine the histogram interpolation method corresponding to the first brightness as the second histogram interpolation method when the number of pixels corresponding to the first brightness is not greater than the number of pixels threshold, wherein the number of interpolations of the first histogram interpolation method is less than the number of interpolations of the second histogram interpolation method. The first upsampling module is used to insert at least one second brightness to the left of the first brightness based on the histogram interpolation method corresponding to the first brightness, and to allocate the number of pixels corresponding to the first brightness to the at least one second brightness based on the allocation ratio indicated by the histogram interpolation method corresponding to the first brightness, so as to realize the upsampling of the first brightness, and to obtain the second brightness histogram after completing the upsampling of the multiple first brightnesses. The second upsampling module is used to insert at least one second brightness to the left of the first brightness based on the curve interpolation method corresponding to the first brightness, and to determine the backlight brightness corresponding to the at least one second brightness based on the curve interpolation method corresponding to the first brightness and the backlight brightness corresponding to the first brightness, so as to realize the upsampling of the first brightness, and to obtain the second curve after completing the upsampling of the multiple first brightnesses. An adjustment module is used to adjust the backlight brightness of the display screen based on the second brightness histogram and the second curve.
8. A terminal, characterized in that, The terminal includes a processor and a memory, the memory storing at least one computer program, which is loaded and executed by the processor to implement the backlight adjustment method as described in any one of claims 1 to 6.
9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores at least one computer program, which is loaded and executed by a processor to implement the backlight adjustment method as described in any one of claims 1 to 6.
10. A computer program product, comprising a computer program, characterized in that, The computer program is loaded and executed by a processor to implement the backlight adjustment method as described in any one of claims 1 to 6.
Citation Information
Patent Citations
Method and device for adjusting display image based on backlight brightness
CN108257580A
Backlight control method and device and display equipment
CN114420059A