Display module, lamp strip control method based on display module, and display device

Abstract

The application discloses a display module, a lamp strip control method based on the display module and a display device, and belongs to the technical field of image processing. A brightness adjustment module in a timing controller of the display module adjusts the brightness of a video frame to be played, and the adjusted video frame is displayed through a display panel. The application sets a lamp strip control module in the timing controller, so that the lamp strip control module acquires the total pixel brightness of the adjusted video frame, and controls the light-emitting color and the light-emitting brightness of the lamp strip based on the color of the video frame and the adjusted total pixel brightness, so that the light-emitting color and the light-emitting brightness of the lamp strip can be synchronized with the brightness and the color of the video frame displayed by the display panel, the display effect of the lamp strip is improved, and the immersive experience of a user is improved.

Description

Technical Field

[0001] This application relates to the field of image processing, and in particular to a display module, a light strip control method based on the display module, and a display device. Background Technology

[0002] With the rapid development of mobile internet, users have increasingly higher requirements for the display effect of display panels (such as TV screens) in display modules.

[0003] In related technologies, display modules can be paired with immersive lighting systems. Immersive lighting systems include light strips and light strip control chips. The light strips are set around the display panel of the display module, and the light strip control chip is set in the system-on-chip (SOC) of the display module. The SOC outputs the video frames to be played to the display module to control the display panel to display the video frames. According to the output video frames, the SOC controls the light strips around the display panel, so that the light strips emit light corresponding to the video frames, creating a borderless and high-end feel. It also makes the light strips flash rhythmically according to the audio information of the video frames, adding a stronger sense of atmosphere and experience to watching videos.

[0004] However, the brightness of the video frames displayed on the display panel (i.e., the actual display brightness) may differ from the brightness of the video frames output by the SOC. This is especially true for display panels in Organic Light-Emitting Diode Television (OLED TVs). Unlike traditional LCD displays, OLED TVs have a timing controller circuit. This timing controller circuit has powerful image processing capabilities, which can cause the brightness of the LED strip to differ from the actual display brightness of the video frames. This prevents the LED strip's brightness from synchronizing with the actual display brightness of the video frames, thus reducing the display effect of the LED strip. Summary of the Invention

[0005] This application provides a display module, a light strip control method based on the display module, and a display device, which can improve the display effect of the light strip installed on the display panel of the display module. The technical solution is as follows:

[0006] On one hand, a display module is provided, the display module including a display panel and a timing controller, the display panel being connected to the timing controller, and the periphery of the display panel supporting the installation of light strips;

[0007] The timing controller includes a brightness adjustment module and a light strip control module. The brightness adjustment module is connected to the light strip control module, and the light strip control module is used to connect to the light strip.

[0008] The brightness adjustment module is used to adjust the brightness of the pixels of the first video frame to be played, so as to obtain the second video frame and the total pixel brightness of the second video frame.

[0009] The brightness adjustment module is also used to display the second video frame through the display panel and send the total pixel brightness to the light strip control module;

[0010] The light strip control module is used to control the light emission color and light emission brightness of the light strip based on the color information of the first video frame and the total pixel brightness, wherein the color information indicates the color of the pixel point of the first video frame.

[0011] In one possible implementation, the brightness adjustment module is used for:

[0012] Based on the brightness adjustment range corresponding to the total pixel brightness of the first video frame among multiple brightness adjustment ranges, the brightness of the pixels of the first video frame is adjusted to obtain the second video frame and the total pixel brightness of the second video frame. The multiple brightness adjustment ranges correspond to different total pixel brightnesses.

[0013] In one possible implementation, the brightness adjustment module is used for:

[0014] If the total pixel brightness of each of the multiple third video frames is the same as the total pixel brightness of the first video frame, and the total display duration of the multiple third video frames is greater than or equal to the first duration, the brightness of the pixels of the first video frame is reduced to obtain the second video frame and the total pixel brightness of the second video frame. The multiple third video frames are the video frames before the second video frame displayed on the display panel.

[0015] In one possible implementation, the brightness adjustment module includes a first brightness adjustment unit and a second brightness adjustment unit, wherein the first brightness adjustment unit, the second brightness adjustment unit and the display module are connected in sequence, and the second brightness adjustment unit is also connected to the light strip control module.

[0016] The first brightness adjustment unit is used to adjust the brightness of the pixels of the first video frame based on the brightness adjustment range corresponding to the total pixel brightness of the first video frame among multiple brightness adjustment ranges, to obtain the fourth video frame and the total pixel brightness of the fourth video frame, and to send the fourth video frame and the total pixel brightness of the fourth video frame to the second brightness adjustment unit, wherein the multiple brightness adjustment ranges correspond to different total pixel brightness.

[0017] The second brightness adjustment unit is used to reduce the brightness of the pixels of the fourth video frame if the total pixel brightness of each of the multiple third video frames is the same as the total pixel brightness of the fourth video frame, and the total display duration of the multiple third video frames is greater than or equal to the first duration, so as to obtain the second video frame and the total pixel brightness of the second video frame. The multiple third video frames are video frames before the second video frame displayed on the display panel.

[0018] The second brightness adjustment unit is also used to display the second video frame through the display panel and send the total pixel brightness to the light strip control module.

[0019] In one possible implementation, the first brightness adjustment unit is also connected to the display panel and the light strip control module;

[0020] The first brightness adjustment unit is further configured to, if the second brightness adjustment unit is not in operation, display the fourth video frame through the display panel and send the total pixel brightness of the fourth video frame to the light strip control module;

[0021] The light strip control module is also used to control the light emission color and brightness of the light strip based on the color information and the total pixel brightness of the fourth video frame.

[0022] In one possible implementation, the first brightness adjustment unit is also connected to the display panel and the light strip control module;

[0023] The first brightness adjustment unit is also used to send the total pixel brightness of the fourth video frame to the light strip control module;

[0024] The light strip control module is further configured to control the light emission color and brightness of the light strip based on the color information and the total pixel brightness of the second video frame if the total pixel brightness of the fourth video frame and the total pixel brightness of the second video frame are obtained.

[0025] In one possible implementation, the timing controller is also used to connect to the system-on-a-chip of the display module;

[0026] The brightness adjustment module is also used to acquire the first video frame sent by the system-on-a-chip;

[0027] The LED strip control module is also used to acquire the color information sent by the system-on-a-chip.

[0028] In one possible implementation, the timing controller is also used to connect to the system-on-a-chip of the display module;

[0029] The brightness adjustment module is also used to acquire the first video frame sent by the system-on-a-chip;

[0030] The light strip control module is also used to extract colors from the first video frame to obtain color information of the first video frame.

[0031] In one possible implementation, the first video frame includes multiple partitions, and the color information includes the total color value of each partition in the multiple partitions, wherein the total color value is the sum of the color values ​​of each pixel in the partition;

[0032] The light strip control module is also used for:

[0033] The video frame is divided into regions to obtain multiple partitions, all of which are located at the edges of the video frame.

[0034] Based on the color values ​​of each pixel in each of the multiple partitions, the total color value of each partition is obtained.

[0035] In one possible implementation, the light strip control module is further configured to:

[0036] If the display panel is in a black screen maintenance state, the light-emitting effect of the light strip is controlled based on the black screen maintenance progress of the display panel, so that the light-emitting effect can indicate the black screen maintenance progress.

[0037] On the other hand, a light strip control method based on a display module is provided, wherein the display module is any display module involved in the above-mentioned aspect, and the method is executed by the timing controller, the method comprising:

[0038] The brightness of the pixels in the first video frame to be played is adjusted to obtain the second video frame and the total pixel brightness of the second video frame;

[0039] The second video frame is displayed through the display panel;

[0040] Based on the color information of the first video frame and the total pixel brightness, the emission color and emission brightness of the light strip are controlled, wherein the color information indicates the color of the pixels in the first video frame.

[0041] In one possible implementation, adjusting the brightness of the pixels in the first video frame to be played to obtain the second video frame and the total pixel brightness of the second video frame includes:

[0042] Based on the brightness adjustment range corresponding to the total pixel brightness of the first video frame among multiple brightness adjustment ranges, the brightness of the pixels of the first video frame is adjusted to obtain the second video frame and the total pixel brightness of the second video frame. The multiple brightness adjustment ranges correspond to different total pixel brightnesses.

[0043] In one possible implementation, adjusting the brightness of the pixels in the first video frame to be played to obtain the second video frame and the total pixel brightness of the second video frame includes:

[0044] If the total pixel brightness of each of the multiple third video frames is the same as the total pixel brightness of the first video frame, and the total display duration of the multiple third video frames is greater than or equal to the first duration, the brightness of the pixels of the first video frame is reduced to obtain the second video frame and the total pixel brightness of the second video frame. The multiple third video frames are the video frames before the second video frame displayed on the display panel.

[0045] In one possible implementation, adjusting the brightness of the pixels in the first video frame to be played to obtain the second video frame and the total pixel brightness of the second video frame includes:

[0046] Based on the brightness adjustment range corresponding to the total pixel brightness of the first video frame among multiple brightness adjustment ranges, the brightness of the pixels of the first video frame is adjusted to obtain the fourth video frame and the total pixel brightness of the fourth video frame. The multiple brightness adjustment ranges correspond to different total pixel brightness.

[0047] If the total pixel brightness of each of the multiple third video frames is the same as the total pixel brightness of the fourth video frame, and the total display duration of the multiple third video frames is greater than or equal to the first duration, the brightness of the pixels of the fourth video frame is reduced to obtain the second video frame and the total pixel brightness of the second video frame. The multiple third video frames are the video frames before the second video frame displayed on the display panel.

[0048] In one possible implementation, after obtaining the fourth video frame and the total pixel brightness of the fourth video frame, the method further includes:

[0049] The fourth video frame is displayed through the display panel;

[0050] The emission color and emission brightness of the light strip are controlled based on the color information and the total pixel brightness of the fourth video frame.

[0051] In one possible implementation, before controlling the emission color and brightness of the light strip based on the color information of the first video frame and the total pixel brightness, the method includes:

[0052] The system-on-a-chip of the display module is used to obtain the first video frame and the color information.

[0053] In one possible implementation, before controlling the emission color and brightness of the light strip based on the color information of the first video frame and the total pixel brightness, the method includes:

[0054] Obtain the first video frame sent by the system-on-a-chip of the display module;

[0055] Colors are extracted from the first video frame to obtain its color information.

[0056] In one possible implementation, the first video frame includes multiple partitions, and the color information includes the total color value of each partition in the multiple partitions, wherein the total color value is the sum of the color values ​​of each pixel in the partition;

[0057] The step of extracting color from the first video frame to obtain the color information of the first video frame includes:

[0058] The first video frame is divided into regions to obtain the plurality of partitions, all of which are located at the edge of the video frame;

[0059] Based on the color values ​​of each pixel in each of the multiple partitions, the total color value of each partition is obtained.

[0060] In one possible implementation, the method further includes:

[0061] If the display panel is in a power-off black screen maintenance compensation state, the light-emitting effect of the light strip is controlled based on the black screen maintenance progress of the display panel, so that the light-emitting effect can indicate the black screen maintenance progress.

[0062] On the other hand, a display device is provided, the display device including a system-on-a-chip and a display module as described above, the system-on-a-chip being used to provide video frames to be played to the display module.

[0063] On the other hand, a computer program product or computer program is provided, which includes at least one program segment stored in a computer-readable storage medium. The timing controller in the display module or the LED strip control module in the timing controller reads the at least one program segment from the computer-readable storage medium. The timing controller or the LED strip control module executes the at least one program segment, causing the timing controller or the LED strip control module to perform the LED strip control method based on the display module provided in various optional implementations of the above-mentioned aspects or aspects.

[0064] The beneficial effects of the technical solutions provided in this application are:

[0065] The brightness of the video frame to be played is adjusted by the brightness adjustment module in the timing controller of the display module, and the adjusted video frame is displayed on the display panel. This application sets a light strip control module in the timing controller so that the light strip control module can obtain the total pixel brightness of the adjusted video frame, and control the light strip's emission color and brightness based on the color of the video frame and the adjusted total pixel brightness. This makes the light strip's emission color and brightness synchronized with the brightness and color of the video frame displayed on the display panel, improving the light strip's display effect and enhancing the user's immersive experience. Attached Figure Description

[0066] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0067] Figure 1 This is a diagram illustrating an immersive lighting system architecture based on a display module, provided in an embodiment of this application.

[0068] Figure 2 This is a schematic diagram of the structure of a display module provided in an embodiment of this application;

[0069] Figure 3 This is a schematic diagram of another display module provided in an embodiment of this application;

[0070] Figure 4 This is a schematic diagram of another display module provided in an embodiment of this application;

[0071] Figure 5 This is a flowchart of a light strip control method based on a display module provided in an embodiment of this application;

[0072] Figure 6This is a schematic diagram of video stream data transfer provided in an embodiment of this application;

[0073] Figure 7 This is another data flow diagram of a video stream provided in an embodiment of this application;

[0074] Figure 8 This is a schematic diagram of a video frame partitioning method provided in an embodiment of this application;

[0075] Figure 9 This is a timing diagram of the operation of a first brightness adjustment unit provided in an embodiment of this application;

[0076] Figure 10 This is a timing diagram of the operation of a second brightness adjustment unit provided in an embodiment of this application;

[0077] Figure 11 This is a flowchart of a pixel brightness selection process for a video frame to be played, provided in an embodiment of this application.

[0078] Figure 12 This is another flowchart for selecting the pixel brightness of a video frame to be played, provided in an embodiment of this application. Detailed Implementation

[0079] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described in further detail below with reference to the accompanying drawings.

[0080] In this application, the terms "first," "second," etc., are used to distinguish identical or similar items that have essentially the same function. It should be understood that there is no logical or temporal dependency between "first," "second," and "nth," nor does it limit the quantity or execution order. It should also be understood that although the following description uses the terms "first," "second," etc., to describe various elements, these elements should not be limited by the terms.

[0081] These terms are simply used to distinguish one element from another. For example, without departing from the various examples, the first element can be referred to as the second element, and similarly, the second element can be referred to as the first element. Both the first and second elements can be elements, and in some cases, they can be separate and distinct elements.

[0082] "At least one" means one or more elements. For example, at least one element can be one element, two elements, three elements, or any integer number of elements greater than or equal to one. "At least two" means two or more elements. For example, at least two elements can be two elements, three elements, or any integer number of elements greater than or equal to two.

[0083] Figure 1This is a diagram illustrating an immersive lighting system architecture based on a display module, as provided in an embodiment of this application. Figure 1 As shown, the immersive lighting system 100 includes a display device A and a light strip B. The display device A can be installed on a terminal that supports video playback (such as a television, home theater equipment, etc.). Here, this embodiment does not limit the type of terminal.

[0084] Display device A displays video frames of the video to be played. Display device A is connected to light strip B. Display device A also controls the brightness and color of light strip B based on the color and brightness information of the video frames. This synchronizes the brightness of light strip B with the brightness of the video frames currently displayed on display device A, and the color of light strip B with the color of the video frames currently displayed on display device A. This allows users to achieve an immersive experience when watching videos through display device A. Specifically, the color information of the video frames indicates the color of the pixels, the brightness information indicates the lightness or darkness of the video frames, the color of light strip B refers to the color of the light emitted by light strip B, and the brightness of light strip B refers to the luminance of the light emitted by light strip B.

[0085] like Figure 1 As shown, display device A includes a display module 200 and a system-on-a-chip (SOC) 300. The SOC 300 is connected to the display module 200 and is used to acquire the video stream of the video to be played, providing the display module 200 with video frames from the video stream. The display module 200 then displays the video frames. Before displaying each video frame, the display module 200 performs image processing on the video frames to change their brightness and / or color, and then displays the image-processed video frames, so that the final displayed video frames differ from the video frames output by the SOC 300 in brightness and / or color.

[0086] Next, combined Figure 2 The schematic diagram of a display module provided in this application embodiment is shown below. The working principle of the display module 200 is described below.

[0087] like Figure 2As shown, the display module 200 includes a timing controller (Tcon) 21 and a display panel 22. The display panel 22 is the video display module in the display module 200, used to display video frames. The display panel 22 can be an organic light-emitting diode (OLED) panel, a light-emitting diode (LED) panel, a twisted nematic (TN) panel, a vertical alignment plate (VA) panel, or an in-plane switching (IPS) panel. Here, this application embodiment does not limit the type of display panel 22.

[0088] The timing controller 21 is connected to the display panel 22. For any video frame in the video stream sent by the SOC 300, the timing controller 21 performs at least one image processing operation on the video frame and drives the display panel 22 to display the processed video frame. For example, Figure 3 The schematic diagram shown in this application embodiment illustrates another display module structure. The display module 2a includes a timing controller 21, a display panel 22, a data driver 23, and a scan driver 24. The timing controller 21 also includes an interface that interfaces with the display panel 22. This interface is connected to the data driver 23 and the scan driver 24. The video frame processed by the timing controller 21 is sent to the interface. Based on the video frame, the interface sends a data signal to the data driver 23 and a gate-driven on-array (GOA) signal or a gate driver integrated circuit (GDAC) signal to the scan driver 24 to drive the data driver 23 and the scan driver 24 to display the video frame through the display panel 22.

[0089] The periphery of the display panel 22 supports the installation of light strips (such as light strip A). ​​The timing controller 21 is also used to control the light color and brightness of the light strips according to the color and brightness information of the processed video frames, so that the light color of the light strips is synchronized with the color of the video frames displayed on the display panel, and the light brightness of the light strips is synchronized with the brightness of the video frames displayed on the display panel. This creates a high-end sense of borderless video images, adds a stronger sense of atmosphere and experience to watching videos, and achieves an immersive experience.

[0090] like Figure 2As shown, the timing controller 21 includes a brightness adjustment module 211 and a light strip control module 212. The brightness adjustment module 211 is a module in the timing controller 21 used to adjust the brightness of video frames. The brightness of the video frames displayed on the display panel 22 is controlled by the brightness adjustment module 211.

[0091] In some embodiments, the brightness adjustment module 211 includes multiple brightness adjustment units, each of which supports adjusting the brightness of a video frame. The multiple brightness adjustment units employ different brightness adjustment logics for the video frames. These multiple brightness adjustment units have different priorities, thus forming a multi-level brightness adjustment unit. Following a descending priority order, the multiple brightness adjustment units form a brightness adjustment pipeline for the video frame. The priority of a brightness adjustment unit indicates its order within the brightness adjustment pipeline. Accordingly, the multiple brightness adjustment units are connected sequentially according to a descending priority order. For a video frame to be processed by the brightness adjustment module 21, the video frame first reaches the highest priority brightness adjustment unit. After adjusting the brightness of the video frame, the highest priority brightness adjustment unit transmits the adjusted video frame to the next-level brightness adjustment unit, which continues to adjust the brightness of the video frame. This process continues until the lowest priority brightness adjustment unit finishes adjusting the brightness and outputs the adjusted video frame. The video frame is then displayed on the display panel 22 according to the brightness information of the video frame output by the lowest priority brightness adjustment unit. In other embodiments, at least one of the multiple brightness adjustment units has its own brightness adjustment conditions. These brightness adjustment units will adjust the brightness of the input video frame only when the input video frame meets its own brightness adjustment conditions. Therefore, when the video frame flows between these multiple brightness adjustment units, some brightness adjustment units may not adjust the brightness of the video frame.

[0092] For example Figure 4The schematic diagram shown in this application embodiment illustrates another display module structure. The brightness adjustment module 211 in the display module 21a includes a first brightness adjustment unit and a second brightness adjustment unit. The first brightness adjustment unit is connected to the second brightness adjustment unit, and the priority of the first brightness adjustment unit is higher than that of the second brightness adjustment unit. The first brightness adjustment unit and the second brightness adjustment unit use different logics to adjust the brightness of video frames. For example, the first brightness adjustment unit adjusts the brightness of video frames according to the Automatic Brightness Limit (ABL) algorithm or the Peak Luminance Control (PLC) algorithm, while the second brightness adjustment unit adjusts the brightness of video frames according to the Automatic Static Brightness Limit (ASBL) algorithm or the Temporary Peak Luminance Control (TPC) algorithm. Both the ABL and PLC algorithms control the brightness performance of the display panel through the Average Picture Level (APL). APL defines how much of the image (i.e., video frame) displayed on the display panel is bright and how much is dark, and describes it in a form similar to "screen ratio". Both the ASBL and TPC algorithms control the brightness of the video frames to gradually decrease as the display panel displays static images (i.e., video frames). In other embodiments, the brightness adjustment module 211 may also include two or more brightness adjustment units. Here, the number of brightness adjustment units in the brightness adjustment module 211 varies in the embodiments of this application.

[0093] In some other embodiments, the brightness adjustment module 211 does not include multiple brightness adjustment units; the brightness adjustment module 211 itself is a brightness adjustment unit.

[0094] Continue to refer to Figure 2The brightness adjustment module 211 is connected to the light strip control module 212 so that the brightness adjustment module 211 can transmit the brightness information of the video frame after brightness adjustment to the light strip control module 212. When the brightness adjustment module 211 includes multiple brightness adjustment units, these multiple brightness adjustment units are all connected to the LED strip control module 212. For a video frame to be processed by the brightness adjustment module 211, after the video frame is input to each brightness adjustment unit according to its priority, each brightness adjustment unit may adjust the brightness of the input video frame or not, and send the input video frame or the brightness-adjusted video frame to the next-level unit (the next-level brightness adjustment unit or the next-level unit after the brightness adjustment module 211), and send the brightness information of the output video frame to the LED strip control module 212. Correspondingly, the LED strip control module 212 can receive multiple brightness information of the video frame. According to the priority of the multiple brightness adjustment units, it takes the brightness information of the brightness adjustment unit with the lowest priority among these multiple brightness information as the final brightness information of the video frame, thereby controlling the light emission brightness of the LED strip based on the final brightness information. This allows the light emission brightness of the LED strip to be the same as or closer to the brightness of the video frame displayed on the display panel 22, improving the display effect of the LED strip. For example, Figure 4 The first brightness adjustment unit and the second brightness adjustment unit in the medium brightness adjustment module 211 are both connected to the light strip control module 212.

[0095] In other embodiments, when the brightness adjustment module 211 includes multiple brightness adjustment units, only the lowest priority brightness adjustment unit among the multiple brightness adjustment units is connected to the light strip control module 212, so that the light strip control module 212 obtains the final brightness information of the video frame from the lowest priority brightness adjustment unit. For example, the first brightness adjustment unit in the brightness adjustment module is not connected to the light strip control module 212, while the second brightness adjustment unit is connected to the light strip control module 212.

[0096] The brightness adjustment module 211 is an image processing module in the timing controller 21. In some embodiments, the timing controller 21 may also include other image processing modules besides the brightness adjustment module. In this case, the timing controller 21 includes multiple image processing modules, each performing one or more image processing operations on the video frame. These multiple image processing modules are connected sequentially to form an image processing pipeline in the timing controller 21a. Video frames from the video stream from the SOC 300 enter the multiple image processing modules sequentially according to the order in the image processing pipeline. Each image processing module performs different image processing on the input video frame. For example, the brightness adjustment module among the multiple image processing modules adjusts the brightness of the image, while other image processing modules perform processing on the video frame other than brightness. When the last image processing module in the image processing pipeline finishes processing the video frame, it sends the processed video frame to the interface of the docking display panel 22 so that the display panel 22 can be controlled to display the processed video frame through the interface. The brightness adjustment module 211 can be any image processing module in the image processing pipeline (i.e., in sequence). In this embodiment of the application, the position of the brightness adjustment module 211 in the image processing pipeline is not limited.

[0097] For example, Figure 4 The timing controller 21a shown also includes an image processing module 213, which performs processing on the input video frames except for brightness. The video frames sent by the SOC300 are first input to the image processing module 213, which then sends the processed video frames to the brightness adjustment module 211. The brightness adjustment module 211 adjusts the brightness of the video frames. The brightness adjustment module 211 is connected to the display panel 22, which displays the brightness-adjusted video frames.

[0098] In other embodiments, the LED strip control module 212 is connected to each brightness adjustment unit in the brightness adjustment module 211. For a video frame to be played, after the video frame is input to each brightness adjustment unit according to the priority of the brightness adjustment unit, each brightness adjustment unit sends the video frame or the brightness-adjusted video frame to the next-level unit (the next-level brightness adjustment unit, the next-level image processing module or interface of the brightness adjustment module in the image processing pipeline), and sends the brightness information of the output video frame to the LED strip control module 212. Accordingly, the LED strip control module 212 can receive multiple brightness information of the video frame to be played. According to the priority of the multiple brightness adjustment units, the brightness information of the brightness adjustment unit with the lowest priority among these multiple brightness information is taken as the final brightness information of the video frame to be played. Based on the final brightness information, the LED strip brightness is controlled, so that the brightness of the LED strip is the same as or closer to the brightness of the video frame displayed on the display panel 22, thereby improving the display effect of the LED strip.

[0099] It should be understood that, Figure 2 The timing controller 21 in the middle can be replaced with Figure 4 21a in the middle, Figure 1 The display module 200 in the middle can be replaced with Figure 3 The display module 2a in the middle.

[0100] For any of the display modules described above, combined with Figure 5 The flowchart shown in this application illustrates a method for controlling a light strip based on a display module. The control process of the light strip is described below. This method is executed by a timing controller in the display module and includes the following steps.

[0101] 501. The timing controller obtains the color information of the first video frame, which indicates the color of the pixels in the first video frame.

[0102] In this embodiment, the first video frame is any video frame of the video currently being played on the terminal, and the second video frame is the first video frame after brightness adjustment. In this application, any video frame includes multiple pixels, and each pixel includes multiple sub-pixels. Each sub-pixel represents a color. For example, there may be three sub-pixels: red (R), green (G), and blue (B). Alternatively, there may be four sub-pixels: R, G, B, and white (W). In other embodiments, each pixel includes more than four sub-pixels. However, this application does not limit the number of sub-pixels in a pixel. The color of each pixel is represented by the grayscale values ​​of its multiple sub-pixels.

[0103] For example Figure 6The illustration shown is a data flow diagram of a video stream provided by an embodiment of this application. The SOC of the display module sends a video stream of a video to be played to the timing controller. The video stream includes image data of multiple video frames. Correspondingly, for the display module, the video stream is the original image data of the input video. The timing controller sequentially obtains the image data of multiple video frames of the video stream, takes the currently obtained video frame as the first video frame, and obtains the image data of the first video frame, which is also the acquisition of the first video frame, thereby realizing the acquisition of the first video frame sent by the SOC of the display module.

[0104] Each video frame includes multiple pixels, and the image data of each video frame includes the color information of that video frame. The color information of that video frame includes the color information of each pixel in that video frame, and the color information of each pixel includes the grayscale value of each sub-pixel of that pixel.

[0105] like Figure 6 As shown, in addition to sending the image data of the first video frame to the timing controller, the SOC also sends the color information of the first video frame to the LED strip control module in the timing controller, so that the LED strip control module can obtain the color information of the first video frame sent by the SOC.

[0106] In another possible implementation, the SOC does not provide the color information of the first video frame to the LED strip control module. Instead, the LED strip control module obtains the color information of the first video frame from the video stream. This allows the LED strip control module to control the LED strip based on the color information of the video frame and the total pixel brightness. This eliminates the need to set up an LED strip control module in the SOC, thus avoiding the need to develop a separate SOC for the display module and saving development costs.

[0107] For example Figure 7 The diagram shown is another data flow diagram of a video stream provided by an embodiment of this application. The SOC sends a video stream to the timing controller. After the timing controller obtains the image data of the first video frame, it extracts the color information of the first video frame from the image data of the first video frame to realize the color extraction of the first video frame and obtain the color information of the first video frame.

[0108] In other embodiments, considering that it is desirable for the light strip to emit the same color as the edge of the currently displayed video frame, when extracting the color of the first video frame, the color information of the edge area of ​​the first video frame can be extracted instead of the color information of the entire first video frame, for example, in steps 5011-5012 below.

[0109] Step 5011: The light strip control module divides the first video frame into regions to obtain multiple partitions, at least one edge of each of the multiple partitions being an edge of the first video frame.

[0110] For example Figure 8 The illustration shown is a schematic diagram of a video frame partitioning method provided in this application embodiment. The light strip control module divides the first video frame into n (n>0) partitions according to any one of the partitioning methods 1-4, such that at least one edge of each partition is located at the edge of the first video frame.

[0111] In this document, partitioning method 1 refers to partitioning the first video frame by row, and partitioning method 2 refers to partitioning the first video frame by column. Partitioning method 3 refers to first partitioning the first video frame by row to obtain multiple row partitions, such that at least one edge of each row partition is located at the edge of the first video frame, and then partitioning each row partition by column; or, first partitioning the first video frame by column to obtain multiple column partitions, such that at least one edge of each column partition is located at the edge of the first video frame, and then partitioning each column partition by row. Partitioning method 4 refers to dividing the first video frame into a first region and a second region, where the first region includes all edges of the first video frame, the second region is located inside the first region, and the first region is divided into n partitions along its outer edge. Partitioning methods 1-4 are examples; the light strip control module can also use other partitioning methods to partition the first video frame. Here, this application embodiment does not limit the partitioning method.

[0112] Step 5012: The timing control module obtains the total color value of each partition based on the color values ​​of each pixel in each partition.

[0113] In this system, the color value of a pixel is the grayscale value of each of its subpixels. The total color value of each partition is the sum of the color values ​​of all pixels in that partition. For example, the total color value of each partition includes the total color values ​​of multiple subpixels, each subpixel corresponding to a different subpixel, and the total color value of each subpixel is the sum of the grayscale values ​​of the corresponding subpixel of each pixel in the partition.

[0114] For example, for any partition, the timing control module obtains the grayscale value of each sub-pixel of each pixel point in the partition from the image data of the first video frame. For any sub-pixel, the grayscale value of the sub-pixel of each pixel point in the partition is summed to obtain the total color value of the sub-pixel of the partition. The total color value of the sub-pixels of the partition is then used as the total color value of the partition.

[0115] After obtaining the total color value of multiple partitions, the total color value of multiple partitions is used as the color information of the first video frame.

[0116] 502. The timing controller adjusts the brightness of the pixels of the first video frame to be played to obtain the second video frame and the total pixel brightness of the second video frame.

[0117] In this application, the first video frame is any frame of the video currently being played on the terminal, and the second video frame is the first video frame after brightness adjustment. Each video frame includes multiple pixels, and each pixel includes multiple sub-pixels. Each sub-pixel represents a color. For example, there may be three sub-pixels: red (R), green (G), and blue (B). Alternatively, there may be four sub-pixels: R, G, B, and white (W). In other embodiments, each pixel includes more than four sub-pixels. However, this application does not limit the number of sub-pixels in a pixel. The color of each pixel is represented by the grayscale values ​​of its sub-pixels, and each sub-pixel's grayscale value indicates the brightness of the pixel at that sub-pixel. The total pixel brightness of any video frame is the sum of the grayscale values ​​of all sub-pixels of all pixels in that video frame.

[0118] The following is an example of step 502 being executed by the brightness adjustment module in the timing controller:

[0119] by Figure 6 and Figure 7 For example, for the display module, the video stream sent by the SOC is the original image data of the input video. Accordingly, the timing controller sequentially obtains the image data of multiple video frames of the video stream. Taking any one of the multiple video frames as the first video frame, the timing controller performs image processing on the first video frame according to the image data of the first video frame in the order of the internal image processing pipeline. For example, the image data of the first video frame is first input to image processing module 1 in the image processing pipeline. Image processing module 1 performs one type of image processing on the first video frame based on the input image data and outputs the processed image data of the first video frame to image processing module 2. Image processing module 2 continues to perform another type of image processing on the first video frame based on the input image data of the first video frame and outputs the processed image data of the first video frame to image processing module 3. Image processing module 3 continues to perform another type of image processing on the first video frame based on the input image data of the first video frame and outputs the processed image data of the first video frame to the brightness adjustment module. The image data of the first video frame is input to the brightness adjustment module, which then obtains the first video frame and performs this step 502 on the first video frame based on the input image data of the first video frame.

[0120] It should be noted that, in order to better illustrate the data flow direction of image data in the timing controller, Figure 6 and Figure 7Taking the image pipeline structure in the timing controller as an example, which includes image processing modules 1-3 and a brightness adjustment module, in other embodiments, the image pipeline structure may also include other image processing modules besides image processing modules 1-3. Here, this application embodiment does not limit the number of other image processing modules or the order of other image processing modules in the image pipeline structure. In other embodiments, the image pipeline structure may also include any one or any two of image processing modules 1-3. Here, this application embodiment does not limit the number of image processing modules in the timing controller or the order of image processing modules in the image pipeline structure.

[0121] The above text introduced several structures of the brightness adjustment module. For different structures of the brightness adjustment module, the following adjustment methods are shown.

[0122] In the case where the brightness adjustment module includes multiple brightness adjustment units, taking the brightness adjustment module including a first brightness adjustment unit and a second brightness adjustment unit as an example, the brightness adjustment module adjusts the brightness of the first video frame through the following steps 5021 and 5022.

[0123] Step 5021: The first brightness adjustment unit adjusts the brightness of the pixels of the first video frame based on the brightness adjustment range corresponding to the total pixel brightness of the first video frame among multiple brightness adjustment ranges, to obtain the fourth video frame and the total pixel brightness of the fourth video frame. The multiple brightness adjustment ranges correspond to different total pixel brightness.

[0124] The fourth video frame is the first video frame after brightness adjustment. Each brightness adjustment range is any value between -100% and 100%. The values ​​of multiple brightness adjustment ranges are different. Each brightness adjustment range corresponds to a total pixel brightness value range. Different brightness adjustment ranges correspond to different total pixel brightness value ranges. Each total pixel brightness value range includes the brightness of multiple pixels.

[0125] After acquiring the image data of the first input video frame, the first brightness adjustment unit obtains the total pixel brightness of the first video frame (referred to as the first total pixel brightness) based on the color information of each pixel in the image data. For example, for any sub-pixel of a pixel, the grayscale value of that sub-pixel within the color information of each pixel in the image data is summed to obtain the total sub-pixel brightness corresponding to that sub-pixel. After obtaining the total sub-pixel brightness corresponding to each sub-pixel of a pixel, the total sub-pixel brightness corresponding to each sub-pixel is summed to obtain the first total pixel brightness.

[0126] After obtaining the first total pixel brightness, the first brightness adjustment unit queries the brightness adjustment range corresponding to the total pixel brightness value range to which the first total pixel brightness belongs from multiple brightness adjustment ranges. The queried brightness adjustment range is used as the target brightness adjustment range. The first total pixel brightness of the target brightness adjustment range is added to the first total pixel brightness to obtain the total pixel brightness of the fourth video frame (called the fourth total pixel brightness), that is, first total pixel brightness * (1 + target brightness adjustment range) = fourth total pixel brightness.

[0127] For the grayscale values ​​of all sub-pixels of all pixels in the image data of the first video frame, the grayscale values ​​of all sub-pixels are increased by a target value so that the sum of the grayscale values ​​of all sub-pixels is equal to the brightness of the fourth total pixel. The image data after increasing the target value is the image data of the fourth video frame, which is also the second video frame.

[0128] For further explanation of step 5021, see [link to relevant documentation]. Figure 9 The timing diagram of a first brightness adjustment unit provided in this embodiment of the application is shown. Taking pixels including sub-pixels R, G, B, and W as an example, the clock signal CLK, reset signal RST, data enable signal DE, and pixel signals i_lr / g / b / w are all input signals of the first brightness adjustment unit. The clock signal CLK is used to ensure the transmission order of the pixel signals i_lr / g / b / w in each input video frame. The reset signal RST is the reset signal of the first brightness adjustment unit; a low level of the reset signal RST triggers the first brightness adjustment unit to reset, and a high level of the reset signal RST indicates that the first brightness adjustment unit is in an unused state. The data enable signal DE is a valid flag for the input video signals (such as pixel signals i_lr / g / b / w) in the first brightness adjustment unit; a low level of the data enable signal DE indicates that the input video signal is invalid, and a high level of the data enable signal DE indicates that the input video signal is valid. The pixel signal i_lr / g / b / w is used to transmit the color information of each video frame in the order of the video frames. For example, the pixel signal i_lr / g / b / w transmits the color information i_l1 of the first video frame, the color information i_l2 of the second video frame, the color information i_l3 of the third video frame, and the color information i_l4 of the fourth video frame in sequence.

[0129] The enable signal EN enables the brightness adjustment function of the first brightness adjustment unit. When the enable signal EN is low, the first brightness adjustment unit disables the brightness adjustment function; when the enable signal EN is high, the first brightness adjustment unit enables the brightness adjustment function. Sub-pixel total brightness information: o_lr_sum_total, o_lb_sum_total, o_lg_sum_total, and o_lw_sum_total. These sub-pixel total brightness information o_lr_sum_total, o_lb_sum_total, o_lg_sum_total, and o_lw_sum_total respectively include the total brightness of the sub-pixels in sub-pixels R, B, G, and W of the video frame. The brightness gain signal gain includes the total pixel brightness after brightness adjustment for each video frame.

[0130] After enabling the brightness adjustment function, taking the first video frame carried by the input pixel signal i_lr / g / b / w as an example, based on the color information i_l1 of the first video frame, the total sub-pixel brightness sum_r1, sum_b1, sum_g1, and sum_w1 of the first video frame on sub-pixel R, sub-pixel B, and sub-pixel W of the first video frame are calculated. The total pixel brightness of the first video frame is obtained by summing the total sub-pixel brightness sum_r1, sum_b1, sum_g1, and sum_w1. The total pixel brightness of the first video frame is then adjusted by the target adjustment range to obtain the adjusted total pixel brightness gain1. The total pixel brightness gain1 is then output as the adjusted total brightness information gain of the first video frame to the second brightness adjustment unit. After obtaining the color information i_l2 of the second video frame, the color information i_l2 is processed in the same way as the color information i_l1, and so on, so that the total pixel brightness after brightness adjustment of each video frame is passed to the second brightness adjustment unit.

[0131] In Figure 6 and Figure 7 For example, after acquiring the image data of the fourth video frame and the total pixel brightness of the fourth video frame, the first brightness adjustment unit sends the image data of the fourth video frame and the total pixel brightness of the fourth video frame to the second brightness adjustment unit, so as to send the fourth video frame and the total pixel brightness of the fourth video frame to the second brightness adjustment unit.

[0132] Step 5022: If the total pixel brightness of each of the multiple third video frames is the same as the total pixel brightness of the fourth video frame, and the total display duration of the multiple third video frames is greater than or equal to the first duration, the second brightness adjustment unit reduces the brightness of the pixels of the fourth video frame to obtain the second video frame and the total pixel brightness of the second video frame. The multiple third video frames are the video frames before the second video frame displayed on the display panel.

[0133] Among them, multiple third video frames are video frames continuously displayed on the display panel before the acquisition of the fourth video frame, and the total pixel brightness of these multiple third video frames is the same. If the total pixel brightness of multiple third video frames is the same, then these multiple third video frames are considered to be static video frames (i.e., static images). The first duration is the duration for which the adjustment module waits to adjust the brightness of the static video frames.

[0134] For example, multiple first durations are preset, each corresponding to a different range of total pixel brightness values. If the total pixel brightness of the current video frame is the same as that of the previous video frame, then both the current and previous video frames are static video frames. The total pixel brightness of the current video frame is used as the baseline brightness. Based on the first duration corresponding to the range of total pixel brightness values ​​to which this baseline brightness belongs, a brightness adjustment mode is enabled for the static video frame with this baseline brightness.

[0135] If the total pixel brightness of each video frame acquired within the first time period is the same as the reference brightness, then the brightness of the video frame will not be processed.

[0136] Within the first duration, if the total pixel brightness of all acquired video frames is the reference brightness, then the video frames acquired within the first duration are considered the third video frames. For each video frame acquired after the first duration has elapsed, if the total pixel brightness of that video frame is the reference brightness, then the total pixel brightness of that video frame is reduced by a brightness threshold. If the total pixel brightness of that video frame is not the reference brightness, then the brightness amplitude of the video frame is not adjusted, and the brightness adjustment mode is turned off for static video frames with the reference brightness.

[0137] Alternatively, after the first duration is reached, if the total pixel brightness of subsequent video frames is at the baseline brightness, after each second duration, the total pixel brightness of these video frames is reduced by one brightness threshold. For example, after the first duration is reached, a second timer is started. If the total pixel brightness of multiple video frames acquired within the second duration is at the baseline brightness, the total pixel brightness of these video frames is reduced by one brightness threshold. After the second duration is reached, the second timer is reset. If the total pixel brightness of multiple video frames acquired within the next second duration is at the baseline brightness, the total pixel brightness of these video frames is reduced by two brightness thresholds, and so on. If, after starting the second timer, the total pixel brightness of any video frame acquired is not at the baseline brightness, the brightness adjustment mode is turned off for static video frames with the baseline brightness.

[0138] Accordingly, if the fourth video frame is acquired within the first duration, its brightness is not processed. If the fourth video frame is acquired after the first duration has elapsed, its total pixel brightness is adjusted as described above, and the adjusted total pixel brightness of the fourth video frame becomes the second total pixel brightness of the second video frame.

[0139] For further explanation of step 5022, see [link to relevant documentation]. Figure 10 The illustrated embodiment of this application provides a timing diagram of a second brightness adjustment unit. An enable signal EN is used to enable the brightness adjustment function of the second brightness adjustment unit. When the enable signal EN is low, the second brightness adjustment unit disables the brightness adjustment function; when the enable signal EN is high, the second brightness adjustment unit enables the brightness adjustment function. The first brightness adjustment unit outputs the total brightness information gain of the video to the second brightness unit. The total brightness information gain includes the total pixel brightness (e.g., gain1, gain2) after brightness adjustment for multiple video frames. For example, the total pixel brightness gain1 for video frame m after brightness adjustment, and the total pixel brightness gain2 for the second video frame after brightness adjustment. When the enable signal EN is high, if the video frame to which gain1 belongs is detected to be a static video frame, using gain1 as the reference brightness, after a first duration t, the output ratio value decreases by a brightness threshold every second (i.e., the second duration) based on the gain1 value. If the obtained gain value changes after the first duration t, the output ratio value immediately becomes the currently obtained gain value. The ratio value is also the total pixel brightness of the video frame output by the second brightness adjustment module.

[0140] For the grayscale values ​​of all sub-pixels of all pixels in the image data of the fourth video frame, the grayscale values ​​of all sub-pixels are increased by a target value so that the sum of the grayscale values ​​of all sub-pixels is equal to the second total pixel brightness. The image data after increasing the target value is the image data of the second video frame, which is to say, the second video frame is obtained.

[0141] like Figure 6 and Figure 7 As shown, after acquiring the image data of the second video frame and the second total pixel brightness, the second brightness adjustment unit, as follows: Figure 6 and Figure 7 As shown, the second total pixel brightness of the second video frame is output to the LED strip control module. If the brightness adjustment module is the last image processing module in the image processing pipeline, the second brightness adjustment unit sends the image data of the second video frame to the interface of the timing controller connected to the display panel. If there are other image processing modules after the brightness adjustment module in the image processing pipeline, the image data of the second video frame is output to these other image processing modules for processing. Finally, the last image processing module in the image processing pipeline sends the processed image data of the second video frame to this interface. It should be understood that the other image processing modules will not adjust the brightness of the second video frame; therefore, even if the other image processing modules perform image processing on the second video frame, the brightness of the second video frame will not change.

[0142] By adjusting the brightness of the video frame in step 5011, the overall brightness of the display panel can be effectively controlled when the video frame with adjusted brightness is displayed on the display panel. Similarly, by adjusting the brightness of the video frame in step 5022, the overall brightness of the static video frame on the display panel can be effectively controlled when the static video frame with adjusted brightness is displayed on the display panel.

[0143] 503. The timing controller displays the second video frame through the display panel.

[0144] like Figure 6 and Figure 7 As shown, if the brightness adjustment module is the last image processing module in the image processing pipeline, after the second brightness adjustment unit obtains the image data of the second video frame, it sends the image data of the second video frame to the interface of the timing controller that connects to the display panel. Based on the image data, the interface controls the display panel to display the second video frame.

[0145] If there are other image processing modules after the brightness adjustment module in the image processing pipeline, the second brightness adjustment unit outputs the image data of the second video frame to the other image processing modules. The other image processing modules process the second video frame, and finally the last image processing module in the image processing pipeline sends the processed image data of the second video frame to this interface. It should be understood that the other image processing modules will not adjust the brightness of the second video frame. Therefore, even if the other image processing modules perform image processing on the second video frame, the brightness of the second video frame will not change.

[0146] 504. The timing controller controls the light emission color and brightness of the light strip based on the color information of the first video frame and the total pixel brightness of the second video frame. The color information indicates the color of the pixels in the first video frame.

[0147] Step 504 can be executed by the LED strip control module in the timing controller.

[0148] Since the LED strip control module is connected to the second brightness adjustment unit, after obtaining the total pixel brightness of the second video frame, the second brightness adjustment unit sends the total pixel brightness of the second video frame to the LED strip control module. Correspondingly, the second brightness adjustment unit obtains the total pixel brightness of the sent second video frame. After obtaining the total pixel brightness of the second video frame, the LED strip control module controls the emitted color and brightness of the LED strip based on the color information of the first video frame and the total pixel brightness of the second video frame.

[0149] For example, the second brightness adjustment unit synchronizes the light strip's emission color based on the color information of the first video frame, making the light strip's emission color closer to the color of the second video frame, thereby improving the light strip's display effect and enhancing the user's immersive experience.

[0150] In addition, when the color information of the first video frame includes the total color value of multiple partitions, the light emission color of each position of the light strip is made the same as the color of the corresponding partition, so as to ensure that the color of each partition can be accurately displayed on the light strip. This achieves fine control over the color of the light strip, further improves the display effect of the light strip, and further enhances the user's immersive experience.

[0151] For example, the second brightness adjustment unit synchronizes the light emission color of the light strip based on the total pixel brightness of the second video frame, so that the light emission brightness of the light strip is synchronized with the brightness of the second video frame displayed on the display panel, which enhances the display effect of the light strip and improves the user's immersive experience.

[0152] It should be understood that steps 503 and 504 are performed simultaneously so that the color of the light strip is synchronized with the color of the video frame displayed on the display panel, and the brightness of the light strip is synchronized with the brightness of the video frame displayed on the display panel.

[0153] The brightness adjustment module in the timing controller of the display module adjusts the brightness of the video frame to be played, and displays the adjusted video frame through the display panel. The method provided in this application embodiment sets up a light strip control module in the timing controller so that the light strip control module can obtain the total pixel brightness of the adjusted video frame, and control the light strip's emission color and emission brightness based on the color of the video frame and the adjusted total pixel brightness. This makes the light strip's emission color and emission brightness synchronized with the brightness and color of the video frame displayed on the display panel, improving the light strip's display effect and enhancing the user's immersive experience.

[0154] Figure 5 The illustrated embodiment uses the example of the second brightness adjustment unit providing the total pixel brightness of the second video frame to the light strip control module. In other embodiments, the first brightness adjustment unit is also connected to the light strip control module, and the first brightness adjustment unit can also provide the total pixel brightness to the light strip control module.

[0155] by Figure 6 and Figure 7 For example, after the first brightness adjustment unit obtains the total pixel brightness of the fourth video frame, it sends the total pixel brightness of the fourth video frame to the light strip control module. Since the second brightness adjustment unit also sends the total pixel brightness of the second video frame to the light strip control module, the light strip control module may obtain the total pixel brightness of the fourth video frame and the total pixel brightness of the second video frame. If the total pixel brightness of the fourth video frame and the total pixel brightness of the second video frame are obtained, since the total pixel brightness of the second video frame is the actual total pixel brightness of the second video frame displayed on the display panel, the light strip control module will select the total pixel brightness of the second video frame as the total pixel brightness of the first video frame. Based on the color information of the first video frame and the total pixel brightness of the second video frame, the light strip's emission color and emission brightness are controlled.

[0156] If the second brightness adjustment unit is not enabled, it is not in operation. If the second brightness adjustment unit is not in operation, the first brightness adjustment module displays the fourth video frame through the display panel and sends the total pixel brightness of the fourth video frame to the light strip control module. The light strip control module then controls the light strip's emission color and brightness based on the color information of the first video frame and the total pixel brightness of the fourth video frame, making the light strip's brightness closer to the total pixel brightness of the second video frame. This avoids situations where the light strip's brightness cannot be effectively controlled if the total pixel brightness of the second video frame is not available. The process of the first brightness adjustment module displaying the fourth video frame through the display panel is similar to the process of the second brightness adjustment module displaying the second video frame through the display panel.

[0157] For example Figure 11 The illustrated embodiment of this application provides a flowchart for selecting pixel brightness of a video frame to be played. The LED strip control module detects whether the brightness adjustment module has been reset. If the brightness adjustment module has not been reset, a first preset pixel brightness is used as the LED strip's illumination brightness (light). Based on the color information of the first video frame and the first preset pixel brightness, the LED strip's illumination color and brightness are controlled. If the brightness adjustment module has been reset, the module detects whether the first brightness adjustment unit is enabled (i.e., whether it is in a working state). If the first brightness adjustment unit is not enabled (i.e., not in a working state), a second preset pixel brightness is used as the LED strip's illumination brightness (light). Based on the color information of the first video frame and the second preset pixel brightness, the LED strip's illumination color and brightness are controlled. If the first brightness adjustment unit is enabled (i.e., in a working state), the module detects whether the second brightness adjustment unit is enabled (i.e., not in a working state). If the second brightness adjustment unit is not enabled (i.e., not in a working state), the total pixel brightness of the fourth video frame sent by the first brightness adjustment unit is used as the LED strip's illumination brightness (light). Based on the color information of the first video frame and the total pixel brightness of the fourth video frame, the LED strip's illumination color and brightness are controlled. If the second brightness adjustment unit is detected as enabled, the total pixel brightness of the second video frame sent by the second brightness adjustment unit is used as the light strip's illumination brightness (light). Based on the color information of the first video frame and the total pixel brightness of the second video frame, the light strip's emission color and brightness are controlled. This ensures that the light strip control module can control the light strip's illumination brightness under various conditions.

[0158] The above Figures 5-11The embodiments shown are all based on the example of a brightness adjustment module including a multi-level brightness adjustment unit. In other embodiments, the brightness adjustment module does not include a multi-level brightness adjustment unit. In the case where the brightness adjustment module does not include a multi-level brightness adjustment unit, the brightness adjustment module adjusts the brightness of the pixels of the first video frame through the following adjustment method 1 or adjustment method 2.

[0159] Adjustment Method 1: The brightness adjustment module adjusts the brightness of the pixels in the first video frame based on the brightness adjustment range corresponding to the total pixel brightness of the first video frame among multiple brightness adjustment ranges, to obtain the second video frame and the total pixel brightness of the second video frame. Multiple brightness adjustment ranges correspond to different total pixel brightness.

[0160] The adjustment method 1 is similar to step 5021 described above, and will not be repeated here. By adjusting the brightness of the video frame using adjustment method 1, the overall brightness of the display panel can be effectively controlled when the video frame with adjusted brightness is displayed on the display panel.

[0161] Adjustment Method 2: Brightness Adjustment Module If the total pixel brightness of each of the multiple third video frames is the same as the total pixel brightness of the first video frame, and the total display duration of the multiple third video frames is greater than or equal to the first duration, the brightness adjustment module reduces the pixel brightness of the first video frame to obtain the second video frame and the total pixel brightness of the second video frame. The multiple third video frames are the video frames before the second video frame displayed on the display panel.

[0162] The adjustment method 2 follows the same principle as step 5022, except that in step 5022, the total brightness information of the fourth video frame obtained by the second adjustment unit is calculated by the first adjustment unit, while in adjustment method 2, the brightness adjustment module needs to calculate the total pixel brightness of the first video frame based on the image data of the first video frame. Therefore, this application embodiment will not elaborate on adjustment method 2. By adjusting the brightness of the video frame using adjustment method 2, the overall brightness of the static video frame on the display panel can be effectively controlled when the brightness-adjusted static video frame is displayed on the display panel.

[0163] After the brightness adjustment module obtains the image data and total pixel brightness of the second video frame, it adjusts the brightness of the video frame using adjustment method 1. This effectively controls the overall brightness of the display panel when displaying the brightness-adjusted video frame. For example, similar to the second brightness adjustment submodule, it outputs the total pixel brightness of the second video frame to the LED strip control module and outputs the image data of the second video frame to the interface. This allows the LED strip control module to control the LED strip's brightness based on the total pixel brightness of the second video frame, and the interface to drive the display panel to display the second video frame based on the image data.

[0164] In some embodiments, the timing controller further includes a black screen maintenance module, which provides a black screen maintenance function for the display panel. This black screen maintenance function refers to controlling the display panel to remain black for a certain period (referred to as the third period) to indicate that the display panel is in a black screen maintenance state. For example, when the timing controller performs shutdown compensation on the display panel, it controls the display panel to remain black, at which point the display panel is in a black screen maintenance state. If the display panel is in a black screen maintenance state, the LED strip control module controls the LED strip's illumination effect based on the black screen maintenance progress of the display panel, so that the illumination effect indicates the black screen maintenance progress.

[0165] For example, Figure 12 The flowchart shown in this embodiment of the application illustrates another pixel brightness selection process for a video frame to be played. The LED strip control module detects the operating mode of the display panel. If the operating mode of the display panel is detected to be display mode, then according to... Figure 11 The selection logic shown selects the total pixel brightness of the video frame. Based on this selected total pixel brightness, the light strip's brightness is controlled. If the display panel's operating mode is detected as a black screen maintenance mode, then the display panel is in a black screen maintenance state. The light strip control module obtains the black screen maintenance duration (i.e., the third duration) from the black screen maintenance module. The light strip control module sets the third preset total pixel brightness as the light strip's brightness (`light`). Based on the third duration and the third preset brightness, the light strip is controlled to complete its illumination within the third duration. For example, starting from a certain position on the light strip, the light strip is controlled to begin illuminating from that starting position, gradually increasing the length of illumination along the strip until the entire light strip is illuminated within the third duration. This progress in illumination indicates the black screen maintenance progress of the display panel to the user.

[0166] The above embodiments are all illustrated using the example of a timing controller including various modules. In other embodiments, the timing controller does not distinguish between modules, and the functions of each module are implemented by the timing controller.

[0167] In an exemplary embodiment, the LED strip control module described above is not located within the timing controller or the SOC, but is located in the display module and is independent of the timing controller, or is not located in the display module and is independent of the SOC, thereby reducing the development costs of the timing controller and the SOC.

[0168] In an exemplary embodiment, a computer-readable storage medium is also provided, such as a memory including program code, which can be executed by the timing controller described above to complete the LED strip control method based on the display module in the above embodiments. Alternatively, it can be executed by the LED strip control module to complete the LED strip control method based on the display module in the above embodiments. The computer-readable storage medium may be a read-only memory (ROM), a random access memory (RAM), a compact disc read-only memory (CD-ROM), magnetic tape, floppy disk, or optical data storage device, etc.

[0169] It should be noted that all information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.), and signals involved in this application have been authorized by the user or fully authorized by all parties, and the collection, use, and processing of related data must comply with the relevant laws, regulations, and standards of the relevant countries and regions. For example, the video streams involved in this application were all obtained with full authorization.

[0170] Those skilled in the art will understand that all or part of the steps of the above embodiments can be implemented by hardware or by hardware related to program instructions. The program can be stored in a computer-readable storage medium, such as a read-only memory, a disk, or an optical disk.

[0171] The above description is merely an optional embodiment of this application and is not intended to limit this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.

Claims

1. A display module, characterized by The display module comprises a display panel and a timing controller, the display panel is connected with the timing controller, and the display panel is provided with a peripheral support lamp strip; The timing controller comprises a brightness adjustment module and a lamp strip control module, the brightness adjustment module is connected with the lamp strip control module, and the lamp strip control module is used for being connected with the lamp strip; The brightness adjustment module is used for adjusting the brightness of the pixel points of the first video frame to be played to obtain a second video frame and the total pixel brightness of the second video frame; The brightness adjustment module is also used for displaying the second video frame through the display panel and sending the total pixel brightness to the lamp strip control module; The lamp strip control module is used for controlling the light-emitting color and light-emitting brightness of the lamp strip based on the color information of the first video frame and the total pixel brightness, and the color information indicates the color of the pixel points of the first video frame.

2. The module of claim 1, wherein The brightness adjustment module is used for: adjusting the brightness of the pixel points of the first video frame based on the brightness adjustment amplitude corresponding to the total pixel brightness of the first video frame in a plurality of brightness adjustment amplitudes to obtain the second video frame and the total pixel brightness of the second video frame, and the plurality of brightness adjustment amplitudes correspond to different total pixel brightnesses.

3. The module of claim 1, wherein The brightness adjustment module is used for: if the total pixel brightness of each third video frame in a plurality of third video frames is the same as the total pixel brightness of the first video frame, and the total display time length of the plurality of third video frames is greater than or equal to a first time length, the brightness of the pixel points of the fourth video frame is reduced to obtain the second video frame and the total pixel brightness of the second video frame, and the plurality of third video frames are video frames before the second video frame displayed by the display panel.

4. The module of claim 1, wherein The brightness adjustment module comprises a first brightness adjustment unit and a second brightness adjustment unit, the first brightness adjustment unit, the second brightness adjustment unit and the display panel are connected in sequence, and the second brightness adjustment unit is also connected with the lamp strip control module; The first brightness adjustment unit is used for adjusting the brightness of the pixel points of the first video frame based on the brightness adjustment amplitude corresponding to the total pixel brightness of the first video frame in a plurality of brightness adjustment amplitudes to obtain a fourth video frame and the total pixel brightness of the fourth video frame, and the plurality of brightness adjustment amplitudes correspond to different total pixel brightnesses. The second brightness adjustment unit is used for reducing the brightness of the pixel points of the fourth video frame to obtain the second video frame and the total pixel brightness of the second video frame if the total pixel brightness of each third video frame in a plurality of third video frames is the same as the total pixel brightness of the fourth video frame, and the total display time length of the plurality of third video frames is greater than or equal to a first time length, and the plurality of third video frames are video frames before the second video frame displayed by the display panel. The second brightness adjustment unit is further configured to display the second video frame by the display panel and send the total pixel brightness of the second video frame to the lamp strip control module.

5. The module of claim 4, wherein The first brightness adjustment unit is further connected with the display panel and the lamp strip control module; The first brightness adjustment unit is further configured to display the fourth video frame by the display panel and send the total pixel brightness of the fourth video frame to the lamp strip control module if the second brightness adjustment unit is not in the working state. The lamp strip control module is further configured to control the light-emitting color and the light-emitting brightness of the lamp strip based on the color information and the total pixel brightness of the fourth video frame.

6. The module according to claim 4 or 5, characterized in that The first brightness adjustment unit is further connected with the display panel and the lamp strip control module; The first brightness adjustment unit is further configured to send the total pixel brightness of the fourth video frame to the lamp strip control module. The lamp strip control module is further configured to control the light-emitting color and the light-emitting brightness of the lamp strip based on the color information and the total pixel brightness of the second video frame if the total pixel brightness of the fourth video frame and the total pixel brightness of the second video frame are acquired.

7. The module according to any one of claims 1 to 5, characterized in that The timing controller is further connected with a system-level chip of the display module; The brightness adjustment module is further configured to acquire the first video frame sent by the system-level chip; The lamp strip control module is further configured to acquire the color information sent by the system-level chip.

8. The module according to any one of claims 1 to 5, characterized in that The timing controller is further connected with a system-level chip of the display module; The brightness adjustment module is further configured to acquire the first video frame sent by the system-level chip; The lamp strip control module is further configured to extract the color of the first video frame to obtain the color information of the first video frame.

9. The module of claim 8, wherein, The first video frame includes a plurality of partitions, and the color information includes a total color value of each partition in the plurality of partitions, the total color value being a sum of color values of each pixel point in the partition; The lamp strip control module is further configured to: divide the video frame into a plurality of partitions, the plurality of partitions being located at edges of the video frame; acquire a total color value of each partition based on color values of each pixel point in each partition in the plurality of partitions.

10. The module according to any one of claims 1-5, 9, wherein, The lamp strip control module is further configured to: if the display panel is in a black screen maintenance state, control a light-emitting effect of the lamp strip based on a black screen maintenance progress of the display panel, so that the light-emitting effect can indicate the black screen maintenance progress. 11.A display module-based light strip control method, characterized in that, The display module is the display module of any one of claims 1-10, the method is executed by the timing controller, and the method comprises: adjusting brightness of a pixel point of a first video frame to be played to obtain a second video frame and total pixel brightness of the second video frame; displaying the second video frame by the display panel; controlling a light-emitting color and a light-emitting brightness of the lamp strip based on color information of the first video frame and the total pixel brightness, the color information indicating a color of the pixel point of the first video frame.

12. The method of claim 11, wherein, The method further includes: adjusting the brightness of the pixel points of the first video frame to be played to obtain a second video frame and total pixel brightness of the second video frame, wherein the total pixel brightness of the first video frame is different from the total pixel brightness of the second video frame.

13. The method of claim 11, wherein, The method further includes: adjusting the brightness of the pixel points of the first video frame to be played to obtain a second video frame and total pixel brightness of the second video frame, wherein the total pixel brightness of the first video frame is different from the total pixel brightness of the second video frame.

14. The method of claim 11, wherein, The method further includes: if the total pixel brightness of each third video frame in a plurality of third video frames is the same as the total pixel brightness of the first video frame, and the total display duration of the plurality of third video frames is greater than or equal to a first duration, reducing the brightness of the pixel points of the first video frame to obtain the second video frame and the total pixel brightness of the second video frame, wherein the plurality of third video frames are video frames displayed by the display panel before the second video frame. The method further includes:

15. The method of claim 14, wherein, adjusting the brightness of the pixel points of the first video frame to be played to obtain a second video frame and total pixel brightness of the second video frame, wherein the total pixel brightness of the first video frame is different from the total pixel brightness of the second video frame. The method further includes: if the total pixel brightness of each third video frame in a plurality of third video frames is the same as the total pixel brightness of the fourth video frame, and the total display duration of the plurality of third video frames is greater than or equal to a first duration, reducing the brightness of the pixel points of the fourth video frame to obtain the second video frame and the total pixel brightness of the second video frame, wherein the plurality of third video frames are video frames displayed by the display panel before the second video frame.

16. The method according to any one of claims 11-15, characterized in that, The method further includes: displaying the fourth video frame by the display panel; 17. The method according to any one of claims 11-15, characterized in that, controlling the light-emitting color and light-emitting brightness of the lamp strip based on the color information and the total pixel brightness of the fourth video frame. The method further includes: obtaining the first video frame and the color information sent by a system-level chip of the display module.

18. The method of claim 17, wherein, The method further includes: obtaining the first video frame sent by a system-level chip of the display module; extracting the color of the first video frame to obtain the color information of the first video frame. The first video frame includes a plurality of partitions, and the color information includes a total color value of each partition in the plurality of partitions, wherein the total color value is a sum of color values of each pixel point in the partition. The color extraction on the first video frame includes: The first video frame is divided into regions to obtain the plurality of partitions, and the plurality of partitions are located at edges of the video frame; Based on color values of each pixel point in each partition of the plurality of partitions, a total color value of each partition is obtained.

19. The method according to any one of claims 11-15, 18, characterized in that, The method further includes: If the display panel is in a black screen maintenance state, based on a black screen maintenance progress of the display panel, a light-emitting effect of the light strip is controlled, so that the light-emitting effect can indicate the black screen maintenance progress.

20. A display device comprising: The display device includes a system-level chip and a display module as claimed in any one of claims 1-10, and the system-level chip is configured to provide a video frame to be played for the display module.

Images