Display module, strip lamp control method based on display module, and display device

Abstract

The present application relates to the technical field of image processing, and discloses a display module, a strip lamp control method based on the display module, and a display device. A brightness adjustment module in a timing controller of the display module adjusts the brightness of a video frame to be played back, and the adjusted video frame is displayed by means of a display panel. According to the present application, a strip lamp control module is arranged in the timing controller, such that the strip lamp control module obtains the total pixel brightness of the adjusted video frame; and on the basis of the color of the video frame and the adjusted total pixel brightness, the light-emitting color and the light-emitting brightness of a strip lamp are controlled to enable the light-emitting color and the light-emitting brightness of the strip lamp to be synchronous with the brightness and the color of the video frame displayed by the display panel, thereby improving the display effect of the strip lamp, enhancing immersive experience of a user.

Description

Display module, light strip control method based on display module, and display device

[0001] This application claims priority to Chinese patent application No. 202310788309.0 filed on June 29, 2023, entitled “Display module, light strip control method based on display module, and display device,” the entire contents of which are incorporated herein by reference. Technical Field

[0002] The present application relates to the field of image processing, and in particular to a display module, a light strip control method based on the display module, and a display device. Background Art

[0003] With the rapid development of mobile Internet, users have increasingly higher requirements for the display effects of display panels in display modules (such as TV screens).

[0004] In related technologies, the display module can be equipped with an immersive lighting system, which includes light strips and light strip control chips. The light strips are arranged around the display panel of the display module, and the light strip control chip is arranged on the system-on-chip (SOC) of the display module. The SOC outputs the video frames to be played to the display module to control the display panel to display the video frames. The SOC controls the light strips around the display panel according to the output video frames, so that the light strips emit light corresponding to the video frames, creating a borderless sense of luxury, and also making the light strips flash with a rhythmic beat according to the audio information of the video frame, adding a stronger sense of atmosphere and experience for watching videos.

[0005] However, the brightness of the video frame displayed by the display panel (i.e., the actual display brightness) may be different from the brightness of the video frame output by the SOC, especially the display panel in the organic light-emitting diode television (OLED TV). The difference between it and the traditional liquid crystal display is that the timing controller circuit it is equipped with has powerful image processing capabilities, which will cause the luminous brightness of the light strip to be different from the actual display brightness of the video frame, making it impossible to synchronize the luminous brightness of the light strip with the actual display brightness of the video frame, thereby reducing the display effect of the light strip.

[0006] Summary of the Invention

[0007] The embodiments of the present application provide a display module, a light strip control method based on the display module, and a display device, which can improve the display effect of the light strip set on the display panel of the display module. The technical solution is as follows:

[0008] In one aspect, a display module is provided, comprising a display panel and a timing controller, wherein the display panel is connected to the timing controller, and a light strip is provided on the periphery of the display panel;

[0009] The timing controller includes a brightness adjustment module and a light strip control module, the brightness adjustment module is connected to the light strip control module, and the light strip control module is used to connect to the light strip;

[0010] The brightness adjustment module is used to adjust the brightness of the pixels of the first video frame to be played to obtain the second video frame and the total pixel brightness of the second video frame;

[0011] The brightness adjustment module is further configured to display the second video frame through the display panel and send the total pixel brightness to the light strip control module;

[0012] The light strip control module is used to control the luminous color and luminous brightness of the light strip based on the color information of the first video frame and the total pixel brightness, where the color information indicates the color of the pixel points of the first video frame.

[0013] In a possible implementation, the brightness adjustment module is configured to:

[0014] Based on the brightness adjustment amplitude corresponding to the total pixel brightness of the first video frame among multiple brightness adjustment amplitudes, the brightness of the pixel points of the first video frame is adjusted to obtain the second video frame and the total pixel brightness of the second video frame, and the multiple brightness adjustment amplitudes correspond to different total pixel brightnesses.

[0015] In a possible implementation, the brightness adjustment module is configured to:

[0016] If the total pixel brightness of each of the multiple third video frames is the same as the total pixel brightness of the first video frame, and the total display time of the multiple third video frames is greater than or equal to the first time, the brightness of the pixels of the first video frame is reduced to obtain the second video frame and the total pixel brightness of the second video frame, and the multiple third video frames are video frames before the second video frame displayed on the display panel.

[0017] In a possible implementation, the brightness adjustment module includes a first brightness adjustment unit and a second brightness adjustment unit, the first brightness adjustment unit, the second brightness adjustment unit, and the display module are connected in sequence, and the second brightness adjustment unit is further connected to the light strip control module;

[0018] the first brightness adjustment unit being configured to adjust the brightness of pixels of the first video frame based on a brightness adjustment amplitude corresponding to the total pixel brightness of the first video frame among multiple brightness adjustment amplitudes to obtain a fourth video frame and the total pixel brightness of the fourth video frame, and to send the fourth video frame and the total pixel brightness of the fourth video frame to the second brightness adjustment unit, the multiple brightness adjustment amplitudes corresponding to different total pixel brightnesses;

[0019] The second brightness adjustment unit is configured to, if the total pixel brightness of each of a plurality of third video frames is the same as the total pixel brightness of the fourth video frame and the total display duration of the plurality of third video frames is greater than or equal to the first duration, reduce the brightness of the pixels of the fourth video frame to obtain the second video frame and the total pixel brightness of the second video frame, wherein the plurality of third video frames are video frames displayed on the display panel before the second video frame;

[0020] The second brightness adjustment unit is further configured to display the second video frame through the display panel and send the total pixel brightness to the light strip control module.

[0021] In a possible implementation, the first brightness adjustment unit is further connected to the display panel and the light strip control module;

[0022] The first brightness adjustment unit is further configured to display the fourth video frame through the display panel and send the total pixel brightness of the fourth video frame to the light strip control module if the second brightness adjustment unit is not in a working state;

[0023] The light strip control module is further configured to control the luminous color and luminous brightness of the light strip based on the color information and the total pixel brightness of the fourth video frame.

[0024] In a possible implementation, the first brightness adjustment unit is further connected to the display panel and the light strip control module;

[0025] The first brightness adjustment unit is further configured to send the total pixel brightness of the fourth video frame to the light strip control module;

[0026] The light strip control module is also used to control the luminous color and luminous brightness of the light strip based on the color information and the total pixel brightness of the second video frame if the total pixel brightness of the fourth video frame and the total pixel brightness of the second video frame are obtained.

[0027] In a possible implementation, the timing controller is further configured to connect to a system-on-chip of the display module;

[0028] The brightness adjustment module is further configured to obtain the first video frame sent by the system-level chip;

[0029] The light strip control module is further configured to obtain the color information sent by the system-level chip.

[0030] In a possible implementation, the timing controller is further configured to connect to a system-on-chip of the display module;

[0031] The brightness adjustment module is further configured to obtain the first video frame sent by the system-level chip;

[0032] The light strip control module is further configured to perform color extraction on the first video frame to obtain color information of the first video frame.

[0033] In a possible implementation, the first video frame includes multiple partitions, the color information includes a total color value of each of the multiple partitions, and the total color value is the sum of color values ​​of each pixel in the partition;

[0034] The light strip control module is also used for:

[0035] Dividing the video frame into regions to obtain the multiple partitions, wherein the multiple partitions are all located at edges of the video frame;

[0036] Based on the color values ​​of the pixels in each of the multiple partitions, a total color value of each partition is obtained.

[0037] In one possible implementation, the light strip control module is further configured to:

[0038] If the display panel is in a black screen maintenance state, the luminous effect of the light strip is controlled based on the black screen maintenance progress of the display panel, so that the luminous effect can indicate the black screen maintenance progress.

[0039] In another aspect, a light strip control method based on a display module is provided. The display module is any display module mentioned in the first aspect, and the method is executed by the timing controller. The method includes:

[0040] Adjusting the brightness of pixels of a first video frame to be played to obtain a second video frame and a total pixel brightness of the second video frame;

[0041] displaying the second video frame through the display panel;

[0042] Based on the color information of the first video frame and the total pixel brightness, the luminous color and luminous brightness of the light strip are controlled, and the color information indicates the color of the pixel point of the first video frame.

[0043] In a possible implementation, adjusting the brightness of pixels of the first video frame to be played to obtain the second video frame and the total pixel brightness of the second video frame includes:

[0044] Based on the brightness adjustment amplitude corresponding to the total pixel brightness of the first video frame among multiple brightness adjustment amplitudes, the brightness of the pixel points of the first video frame is adjusted to obtain the second video frame and the total pixel brightness of the second video frame, and the multiple brightness adjustment amplitudes correspond to different total pixel brightnesses.

[0045] In a possible implementation, adjusting the brightness of pixels of the first video frame to be played to obtain the second video frame and the total pixel brightness of the second video frame includes:

[0046] If the total pixel brightness of each of the multiple third video frames is the same as the total pixel brightness of the first video frame, and the total display time of the multiple third video frames is greater than or equal to the first time, the brightness of the pixels of the first video frame is reduced to obtain the second video frame and the total pixel brightness of the second video frame, and the multiple third video frames are video frames before the second video frame displayed on the display panel.

[0047] In a possible implementation, adjusting the brightness of pixels of the first video frame to be played to obtain the second video frame and the total pixel brightness of the second video frame includes:

[0048] adjusting the brightness of pixels of the first video frame based on a brightness adjustment amplitude corresponding to the total pixel brightness of the first video frame among multiple brightness adjustment amplitudes, to obtain a fourth video frame and the total pixel brightness of the fourth video frame, the multiple brightness adjustment amplitudes corresponding to different total pixel brightnesses;

[0049] If the total pixel brightness of each of the multiple third video frames is the same as the total pixel brightness of the fourth video frame, and the total display time of the multiple third video frames is greater than or equal to the first time, the brightness of the pixels of the fourth video frame is reduced to obtain the second video frame and the total pixel brightness of the second video frame, and the multiple third video frames are video frames before the second video frame displayed on the display panel.

[0050] In a possible implementation, after obtaining the fourth video frame and the total pixel brightness of the fourth video frame, the method further includes:

[0051] displaying the fourth video frame through the display panel;

[0052] Based on the color information and the total pixel brightness of the fourth video frame, the luminous color and luminous brightness of the light strip are controlled.

[0053] In one possible implementation, before controlling the luminous color and luminous brightness of the light strip based on the color information of the first video frame and the total pixel brightness, the method includes:

[0054] The first video frame and the color information sent by the system-on-chip of the display module are obtained.

[0055] In one possible implementation, before controlling the luminous color and luminous brightness of the light strip based on the color information of the first video frame and the total pixel brightness, the method includes:

[0056] Acquire the first video frame sent by the system-on-chip of the display module;

[0057] Color extraction is performed on the first video frame to obtain color information of the first video frame.

[0058] In a possible implementation, the first video frame includes multiple partitions, the color information includes a total color value of each of the multiple partitions, and the total color value is the sum of color values ​​of each pixel in the partition;

[0059] The performing color extraction on the first video frame to obtain color information of the first video frame includes:

[0060] Dividing the first video frame into regions to obtain the multiple partitions, wherein the multiple partitions are all located at edges of the video frame;

[0061] Based on the color values ​​of the pixels in each of the multiple partitions, a total color value of each partition is obtained.

[0062] In a possible implementation, the method further includes:

[0063] If the display panel is in a shutdown black screen maintenance compensation state, the luminous effect of the light strip is controlled based on the black screen maintenance progress of the display panel so that the luminous effect can indicate the black screen maintenance progress.

[0064] On the other hand, a display device is provided, comprising a system-on-chip and any display module as described above, wherein the system-on-chip is configured to provide the display module with video frames to be played.

[0065] On the other hand, a computer program product or computer program is provided, which includes at least one program segment, and the at least one program segment is stored in a computer-readable storage medium. The timing controller in the display module or the light strip control module in the timing controller reads the at least one program segment from the computer-readable storage medium, and the timing controller or the light strip control module executes the at least one program segment, so that the timing controller or the light strip control module executes the light strip control method based on the display module provided in the above-mentioned one aspect or various optional implementations of the one aspect.

[0066] The beneficial effects of the technical solution provided by the embodiments of the present application are:

[0067] The brightness of the video frame to be played is adjusted by the brightness adjustment module in the timing controller of the display module, and the adjusted video frame is displayed through the display panel. This application sets a light strip control module in the timing controller so that the light strip control module obtains the total pixel brightness of the adjusted video frame, and controls the luminous color and luminous brightness of the light strip based on the color of the video frame and the adjusted total pixel brightness, so that the luminous color and luminous brightness of the light strip can be synchronized with the brightness and color of the video frame displayed on the display panel, thereby improving the display effect of the light strip and enhancing the user's immersive experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0068] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0069] FIG1 is an architecture diagram of an immersive lighting system based on a display module provided in an embodiment of the present application;

[0070] FIG2 is a schematic structural diagram of a display module provided in an embodiment of the present application;

[0071] FIG3 is a schematic structural diagram of another display module provided in an embodiment of the present application;

[0072] FIG4 is a schematic structural diagram of another display module provided in an embodiment of the present application;

[0073] FIG5 is a flow chart of a light strip control method based on a display module provided in an embodiment of the present application;

[0074] FIG6 is a schematic diagram of data flow of a video stream provided in an embodiment of the present application;

[0075] FIG7 is a schematic diagram of data flow of another video stream provided in an embodiment of the present application;

[0076] FIG8 is a schematic diagram of a partitioning method of a video frame provided in an embodiment of the present application;

[0077] FIG9 is a working timing diagram of a first brightness adjustment unit provided in an embodiment of the present application;

[0078] FIG10 is a timing diagram of the operation of a second brightness adjustment unit provided in an embodiment of the present application;

[0079] FIG11 is a flowchart of pixel brightness selection for a video frame to be played provided by an embodiment of the present application;

[0080] FIG12 is another flowchart of pixel brightness selection of a video frame to be played provided in an embodiment of the present application. DETAILED DESCRIPTION

[0081] In order to make the objectives, technical solutions and advantages of this application clearer, the implementation methods of this application will be further described in detail below with reference to the accompanying drawings.

[0082] In this application, the terms "first," "second," and the like are used to distinguish identical or similar items having substantially the same role and function. It should be understood that "first," "second," and "nth" do not have a logical or temporal dependency, nor do they limit the quantity or execution order. It should also be understood that although the following description uses the terms "first," "second," and the like to describe various elements, these elements should not be limited by these terms.

[0083] These terms are simply used to distinguish one element from another. For example, a first element can be referred to as a second element, and similarly, a second element can be referred to as a first element, without departing from the scope of various examples. Both the first element and the second element can be elements, and in some cases, can be separate and different elements.

[0084] Here, at least one refers to one or more than one, for example, at least one element can be one element, two elements, three elements, or any other integer greater than or equal to one. At least two refers to two or more than two, for example, at least two elements can be two elements, three elements, or any other integer greater than or equal to two.

[0085] Figure 1 is a diagram of the architecture of an immersive lighting system based on a display module according to an embodiment of the present application. As shown in Figure 1 , the immersive lighting system 100 includes a display device A and a light strip B. Display device A can be installed on a terminal that supports video playback (such as a television, home theater equipment, etc.). This embodiment does not limit the type of terminal.

[0086] Display device A is used to display the video frame of the video to be played. Display device A is connected to light strip B. Display device A is also used to control the luminance and luminous color of light strip B based on the color information and brightness information of the video frame, so that the luminance of light strip B is synchronized with the brightness of the video frame currently displayed by display device A, and the luminous color of light strip B is synchronized with the color of the video frame currently displayed by display device A, so that the user can achieve an immersive experience when watching the video through display device A. Among them, the color information of the video frame indicates the color of the pixel points of the video frame, the brightness information of the video frame indicates the brightness (i.e., brightness) of the video frame, the luminous color of light strip B refers to the color of the light emitted by light strip B, and the luminous brightness of light strip B refers to the brightness of the light emitted by light strip B.

[0087] As shown in Figure 1, display device A includes a display module 200 and a system-on-chip (SOC) 300. The SOC 300 is connected to the display module 200. The SOC 300 is used to obtain a video stream of a video to be played and provide the display module 200 with video frames from the video stream. The display module 200 then displays the video frames from the video stream. Before displaying each video frame, the display module 200 performs image processing on the video frame to change its brightness and / or color. The processed video frame is then displayed, resulting in a difference in brightness and / or color between the final displayed video frame and the video frame output by the SOC 300.

[0088] Next, the working principle of the display module 200 is introduced as follows with reference to the structural schematic diagram of a display module provided in an embodiment of the present application as shown in FIG. 2 .

[0089] As shown in FIG2 , the display module 200 includes a timing controller (Tcon) 21 and a display panel 22. The display panel 22 is a video display module in the display module 200 and is used to display video frames. The display panel 22 can be an organic light-emitting diode (OLED) panel, a light-emitting diode (LED) panel, a twisted nematic (TN) panel, a vertical alignment (VA) panel, or an in-plane switching (IPS) panel. The present embodiment of the present application does not limit the type of the display panel 22.

[0090] The timing controller 21 is connected to the display panel 22. For any video frame in the video stream sent by the SOC 300, the timing controller 21 performs at least one image processing on the video frame and drives the display panel 22 to display the processed video frame. For example, FIG3 shows a structural schematic diagram of another display module provided by an embodiment of the present application. The display module 2a includes a timing controller 21, a display panel 22, a data driver 23, and a scan driver 24. The timing controller 21 also includes an interface for docking with the display panel 22. The interface is connected to the data driver 23 and the scan driver 24. The video frame processed by the timing controller 21 is sent to the interface. The interface sends a data signal to the data driver 23 and sends a gate drive on array (GOA) signal or a gate driver integrated circuit (Gate Driver IC) signal to the scan driver 24 according to the video frame, so as to drive the data driver 23 and the scan driver 24 to display the video frame through the display panel 22.

[0091] The periphery of the display panel 22 supports the setting of a light strip (such as light strip A), and the timing controller 21 is also used to control the luminous color and luminous brightness of the light strip according to the color information and brightness information of the processed video frame, so that the luminous color of the light strip is synchronized with the color of the video frame displayed by the display panel, and the luminous brightness of the light strip is synchronized with the brightness of the video frame displayed by the display panel, thereby creating a high-end sense of borderless video images, adding a stronger sense of atmosphere and experience for watching videos, thereby achieving an immersive experience.

[0092] As shown in FIG2 , the timing controller 21 includes a brightness adjustment module 211 and a light strip control module 212 . The brightness adjustment module 211 is a module in the timing controller 21 for adjusting the brightness of the video frame. The brightness of the video frame displayed on the display panel 22 is controlled by the brightness adjustment module 211 .

[0093] In some embodiments, the brightness adjustment module 211 includes multiple brightness adjustment units, each of which supports adjusting the brightness of a video frame. The multiple brightness adjustment units have different brightness adjustment logic for the video frames. These multiple brightness adjustment units have different priorities, thereby forming a multi-level brightness adjustment unit. In descending order of priority, the multiple brightness adjustment units form a brightness adjustment pipeline for the video frame. The priority of the brightness adjustment unit indicates the order of the brightness adjustment unit in the brightness adjustment pipeline. Accordingly, the multiple brightness adjustment units are connected in sequence in descending order of priority. For a video frame to be processed by the brightness adjustment module 21, the video frame first reaches the brightness adjustment unit with the highest priority. After the brightness adjustment unit with the highest priority adjusts the brightness of the video frame, it transmits the brightness-adjusted video frame to the brightness adjustment unit at the next level. The brightness adjustment unit at the next level continues to adjust the brightness of the video frame, and so on, until the brightness adjustment unit with the lowest priority adjusts the brightness and outputs the brightness-adjusted video frame. The video frame is displayed on the display panel 22 according to the brightness information of the video frame output by the brightness adjustment unit with the lowest priority. In other embodiments, at least one of the multiple brightness adjustment units has its own brightness adjustment condition. These brightness adjustment units will adjust the brightness of the input video frame only when the input video frame meets its own brightness adjustment condition. Therefore, when the video frame flows between these multiple brightness adjustment units, some brightness adjustment units may not adjust the brightness of the video frame.

[0094] For example, as shown in FIG4 , a structural diagram of another display module provided in an embodiment of the present application, the brightness adjustment module 211 in the display module 21a includes a first brightness adjustment unit and a second brightness adjustment unit, wherein the first brightness adjustment unit is connected to the second brightness adjustment unit, and the priority of the first brightness adjustment unit is higher than the priority of the second brightness adjustment unit. The first brightness adjustment unit and the second brightness adjustment unit have different brightness adjustment logics for the video frames. For example, the first brightness adjustment unit adjusts the brightness of the video frame according to the Automatic Brightness Limit (ABL) algorithm or the Peak Luminance Control (PLC) algorithm, and the second brightness adjustment unit adjusts the brightness of the video frame according to the Automatic Static Brightness Limit (ASBL) algorithm or the Temporary Peak Luminance Control (TPC) algorithm. The ABL algorithm and the PLC algorithm both control the brightness performance of the display panel through the Average Picture Level (APL). The APL defines how much of the image (i.e., video frame) displayed on the display panel is bright and how much is dark, and is described in a form similar to "screen ratio". The ASBL algorithm and the TPC algorithm both control the brightness of the video frame to gradually decrease as the display panel displays a static picture (i.e., video frame). In other embodiments, the brightness adjustment module 211 may further include more than two brightness adjustment units. Here, the embodiments of the present application have different numbers of brightness adjustment units in the brightness adjustment module 211.

[0095] In some other embodiments, the brightness adjustment module 211 does not include multiple brightness adjustment units, and the brightness adjustment module 211 itself is a brightness adjustment unit.

[0096] 2 , the brightness adjustment module 211 is connected to the light strip control module 212 , so that the brightness adjustment module 211 transmits brightness information of the video frame after brightness adjustment to the light strip control module 212 . In the case where the brightness adjustment module 211 includes multiple brightness adjustment units, these multiple brightness adjustment units are all connected to the light strip control module 212. For the video frame to be processed by the brightness adjustment module 211, when the video frame is input to each brightness adjustment unit according to the priority of the brightness adjustment unit, each brightness adjustment unit may adjust the brightness of the input video frame or may not adjust the input video frame, and send the input video frame or the brightness-adjusted video frame to the next-level unit (such as the next-level brightness adjustment unit or the next-level unit of the brightness adjustment module 211), and send the brightness information of the output video frame to the light strip control module 212. Accordingly, the light strip control module 212 can receive multiple brightness information of the video frame, and according to the priorities of the multiple brightness adjustment units, use the brightness information of the brightness adjustment unit with the lowest priority among the multiple brightness information as the final brightness information of the video frame, so as to control the luminous brightness of the light strip based on the final brightness information, so that the luminous brightness of the light strip can be the same as or closer to the brightness of the video frame displayed on the display panel 22, thereby improving the display effect of the light strip. For example, the first brightness adjustment unit and the second brightness adjustment unit in the brightness adjustment module 211 in FIG. 4 are both connected to the light strip control module 212 .

[0097] In other embodiments, when the brightness adjustment module 211 includes multiple brightness adjustment units, only the brightness adjustment unit with the lowest priority among the multiple brightness adjustment units is connected to the light strip control module 212, so that the light strip control module 212 obtains the final brightness information of the video frame from the brightness adjustment unit with the lowest priority. For example, the first brightness adjustment unit in the brightness adjustment module is not connected to the light strip control module 212, while the second brightness adjustment unit is connected to the light strip control module 212.

[0098] The brightness adjustment module 211 is an image processing module in the timing controller 21. In other embodiments, the timing controller 21 may also include other image processing modules in addition to the brightness adjustment module. In this case, the timing controller 21 includes multiple image processing modules, each of which performs one or more image processing operations on the video frames. These multiple image processing modules are connected in sequence to form an image processing pipeline in the timing controller 21a. The video frames in the video stream from the SOC 300 enter the multiple image processing modules in sequence according to the order in the image processing pipeline. Each image processing module performs different image processing operations on the input video frames. For example, the brightness adjustment module in the multiple image processing modules adjusts the brightness of the image, while the other image processing modules perform processing other than brightness on the video frames. After the last image processing module in the image processing pipeline completes processing the video frame, it sends the processed video frame to the interface of the docking display panel 22 so that the display panel 22 can be controlled by the interface to display the processed video frame. The brightness adjustment module 211 may be an image processing module at any position (ie, sequence) in the image processing pipeline. The embodiment of the present application does not limit the position of the brightness adjustment module 211 in the image processing pipeline.

[0099] For example, the timing controller 21a shown in FIG4 also includes an image processing module 213, which is configured to perform processing other than brightness on the input video frames. The video frames sent by the SOC 300 are first input to the image processing module 213. The image processing module 213 then sends the processed video frames to the brightness adjustment module 211, which then adjusts the brightness of the video frames. The brightness adjustment module 211 is connected to the display panel 22, and the brightness-adjusted video frames are displayed on the display panel 22.

[0100] In other embodiments, the light strip control module 212 is connected to each brightness adjustment unit in the brightness adjustment module 211. For the video frame to be played, after the video frame is input to each brightness adjustment unit according to the priority of the brightness adjustment unit, each brightness adjustment unit sends the video frame or the video frame after brightness adjustment to the next-level unit (such as the next-level brightness adjustment unit, the next-level image processing module or interface of the brightness adjustment module in the image processing pipeline), and sends the brightness information of the output video frame to the light strip control module 212. Accordingly, the light strip control module 212 can receive multiple brightness information of the video frame to be played, and according to the priority of the multiple brightness adjustment units, the brightness information of the brightness adjustment unit with the lowest priority among the multiple brightness information is used as the final brightness information of the video frame to be played, so as to control the luminous brightness of the light strip based on the final brightness information, so that the luminous brightness of the light strip can be the same as the brightness of the video frame displayed on the display panel 22 or can be closer to the brightness of the video frame displayed on the display panel 22, thereby improving the display effect of the light strip.

[0101] It should be understood that the timing controller 21 in FIG. 2 can be replaced by 21 a in FIG. 4 , and the display module 200 in FIG. 1 can be replaced by the display module 2 a in FIG. 3 .

[0102] For any of the display modules described above, the control process of the light strip is described below in conjunction with the flowchart of a light strip control method based on a display module provided by an embodiment of the present application shown in Figure 5. The method is executed by a timing controller in the display module and includes the following steps.

[0103] 501. A timing controller obtains color information of a first video frame, where the color information indicates the color of a pixel in the first video frame.

[0104] Wherein, the first video frame is any video frame of the video currently played by the terminal, and the second video frame is the first video frame after brightness adjustment. In the present application, any video frame includes multiple pixels, each pixel includes multiple sub-pixels, and each sub-pixel represents a color. For example, there are 3 multiple sub-pixels, namely red (Red, R), green (Gree, G) and blue (Blue, B). For another example, there are 4 multiple sub-pixels, namely R, G, B and white (White, W). In other embodiments, each pixel includes more than 4 sub-pixels. Here, the embodiment of the present application does not limit the number of sub-pixels in the pixel. The color of each pixel is represented by the grayscale values ​​of the multiple sub-pixels.

[0105] For example, FIG6 shows a data flow diagram of a video stream provided by an embodiment of the present application. The SOC of the display module sends a video stream of a video to be played to the timing controller. The video stream includes image data of multiple video frames. Accordingly, for the display module, the video stream is the original image data of the input video. The timing controller sequentially obtains the image data of multiple video frames of the video stream, and takes the currently obtained video frame as the first video frame. Obtaining the image data of the first video frame is also obtaining the first video frame, thereby obtaining the first video frame sent by the SOC of the display module.

[0106] Among them, each video frame includes multiple pixels, the image data of each video frame includes the color information of the video frame, the color information of the video frame includes the color information of each pixel of the video frame, and the color information of each pixel includes the grayscale value of each sub-pixel of the pixel.

[0107] As shown in FIG6 , in addition to sending the image data of the first video frame to the timing controller, the SOC also sends the color information of the first video frame to the light strip control module in the timing controller, so that the light strip control module obtains the color information of the first video frame sent by the SOC.

[0108] In another possible implementation, the SOC does not provide the color information of the first video frame to the light strip control module. Instead, the light strip control module obtains the color information of the first video frame from the video stream, so that the light strip control module can control the light strip according to the color information of the video frame and the total pixel brightness. There is no need to set up the light strip control module in the SOC, and thus there is no need to independently develop the SOC of the display module, saving development costs.

[0109] For example, as shown in Figure 7, a data flow diagram of another video stream provided in an embodiment of the present application, the SOC sends a video stream to the timing controller. After the timing controller obtains the image data of the first video frame, the color information of the first video frame is extracted from the image data of the first video frame to implement color extraction of the first video frame and obtain the color information of the first video frame.

[0110] In other embodiments, considering that it is desired that the light strip light color be the same as the color of the edge of the currently displayed video frame, when performing color extraction on the first video frame, the color information of the edge area of ​​the first video frame can be extracted instead of extracting the color information of the entire first video frame, such as the following steps 5011-5012.

[0111] Step 5011: The light strip control module divides the first video frame into regions to obtain multiple partitions, and at least one side of the multiple partitions is an edge of the first video frame.

[0112] For example, as shown in FIG8 , a schematic diagram of a partitioning method of a video frame provided in an embodiment of the present application, the light strip control module divides the first video frame into n (n>0) partitions according to any of the partitioning methods 1-4, so that at least one side of each partition is located at the edge of the first video frame.

[0113] Among them, partitioning method 1 refers to partitioning the first video frame by rows, and partitioning method 2 refers to partitioning the first video frame by columns. Partitioning method 3 refers to first partitioning the first video frame by rows to obtain multiple row partitions, so that at least one edge of each row partition is located at the edge of the first video frame, and then partitioning each row partition by columns, or first partitioning the first video frame by columns to obtain multiple column partitions, so that at least one edge of each column partition is located at the edge of the first video frame, and then partitioning each column partition by rows. Partitioning method 4 refers to dividing the first video frame into a first area and a second area first, the first area includes all the edges of the first video frame, the second area is located inside the first area, and the first area is divided into n partitions along the outer edge of the first area. Partitioning methods 1-4 are all examples, and the light strip control module can also adopt other partitioning methods to partition the first video frame. Here, the embodiment of the present application does not limit the partitioning method.

[0114] Step 5012: The timing control module obtains the total color value of each partition based on the color value of each pixel point in each partition among the multiple partitions.

[0115] The color value of a pixel is the grayscale value of each sub-pixel of the pixel. The total color value of each partition is the sum of the color values ​​of each pixel in the partition. Exemplarily, the total color value of each partition includes multiple sub-pixel total color values, each of which corresponds to a different plurality of sub-pixels, and each sub-pixel total color value is the sum of the grayscale values ​​of each pixel in the partition at the corresponding sub-pixel.

[0116] For example, for any partition, the timing control module obtains the grayscale value of each sub-pixel of each pixel point of the partition from the image data of the first video frame. For any sub-pixel, the grayscale value of the sub-pixel of each pixel point of the partition is summed to obtain the total sub-pixel color value of the sub-pixel of the partition, and the total sub-pixel color value of multiple sub-pixels of the partition is used as the total color value of the partition.

[0117] After the total color values ​​of the multiple partitions are acquired, the total color values ​​of the multiple partitions are used as the color information of the first video frame.

[0118] 502. The timing controller adjusts the brightness of the pixels of the first video frame to be played to obtain a second video frame and a total pixel brightness of the second video frame.

[0119] Wherein, the first video frame is any video frame of the video currently played by the terminal, and the second video frame is the first video frame after brightness adjustment. In the present application, any video frame includes multiple pixels, each pixel includes multiple sub-pixels, and each sub-pixel represents a color. For example, there are 3 multiple sub-pixels, namely red (Red, R), green (Gree, G) and blue (Blue, B). For another example, there are 4 multiple sub-pixels, namely R, G, B and white (White, W). In other embodiments, each pixel includes more than 4 sub-pixels. Here, the embodiment of the present application does not limit the number of sub-pixels in the pixel. The color of each pixel is represented by the grayscale values ​​of multiple sub-pixels, and the grayscale value of each sub-pixel indicates the brightness of the pixel on the sub-pixel. The total pixel brightness of any video frame is the sum of the grayscale values ​​of all sub-pixels of all pixels of the video frame.

[0120] The following takes the brightness adjustment module in the timing controller executing step 502 as an example to introduce step 502 as follows:

[0121] Taking Figures 6 and 7 as an example, for the display module, the video stream sent by the SOC is the original image data of the input video. Accordingly, the timing controller sequentially obtains the image data of multiple video frames of the video stream, and takes any one of the multiple video frames as the first video frame. The timing controller performs image processing on the first video frame according to the image data of the first video frame in accordance with the internal image processing pipeline order. For example, the image data of the first video frame is first input into the image processing module 1 in the image processing pipeline. The image processing module 1 performs a certain image processing on the first video frame according to the input image data, and then outputs the processed image data of the first video frame to the image processing module 2. The image processing module 2 continues to perform another image processing on the first video frame according to the input image data of the first video frame, and outputs the processed image data of the first video frame to the image processing module 3. The image processing module 3 continues to perform another image processing on the first video frame according to the input image data of the first video frame, and outputs the processed image data of the first video frame to the brightness adjustment module. The image data of the first video frame is input into the brightness adjustment module. The brightness adjustment module obtains the first video frame and executes this step 502 on the first video frame according to the input image data of the first video frame.

[0122] It should be noted that, in order to facilitate the reflection of the data flow direction of the image data in the timing controller, Figures 6 and 7 only take the image pipeline structure in the timing controller as: image processing modules 1-3 and brightness adjustment module as an example. In other embodiments, the image pipeline structure may also include other image processing modules in addition to image processing modules 1-3. Here, the embodiment of the present application does not limit the number of other image processing modules and the order of other image processing modules in the image pipeline structure. In other embodiments, the image pipeline structure may also include any one or any two of the image processing modules 1-3. Here, the embodiment of the present application does not limit the number of image processing modules in the timing controller and the order of the image processing modules in the image pipeline structure.

[0123] The above describes multiple structures of the brightness adjustment module. The following adjustment methods are shown for different structures of the brightness adjustment module.

[0124] In the case where the brightness adjustment module includes multiple brightness adjustment units, taking the brightness adjustment module including a first brightness adjustment unit and a second brightness adjustment unit as an example, the brightness adjustment module adjusts the brightness of the first video frame through the following steps 5021 and 5022.

[0125] Step 5021: The first brightness adjustment unit adjusts the brightness of the pixel points of the first video frame based on the brightness adjustment amplitude corresponding to the total pixel brightness of the first video frame among the multiple brightness adjustment amplitudes to obtain the fourth video frame and the total pixel brightness of the fourth video frame, and the multiple brightness adjustment amplitudes correspond to different total pixel brightnesses.

[0126] Among them, the fourth video frame is the first video frame after brightness adjustment, each brightness adjustment amplitude is any value between -100% and 100%, the values ​​of multiple brightness adjustment amplitudes are different, each brightness adjustment amplitude corresponds to a total pixel brightness value range, different brightness adjustment amplitudes correspond to different total pixel brightness value ranges, and each total pixel brightness value range includes multiple pixel brightnesses.

[0127] After receiving the input image data of the first video frame, the first brightness adjustment unit obtains the total pixel brightness of the first video frame (referred to as a first total pixel brightness) based on the color information of each pixel in the image data. For example, for any sub-pixel of a pixel, the grayscale values ​​of the sub-pixel in the color information of each pixel in the image data are summed to obtain the sub-pixel total brightness corresponding to the sub-pixel. After obtaining the sub-pixel total brightness corresponding to each sub-pixel of the pixel, the sub-pixel total brightness corresponding to each sub-pixel is summed to obtain the first total pixel brightness.

[0128] After obtaining the first total pixel brightness, the first brightness adjustment unit queries the brightness adjustment amplitude corresponding to the total pixel brightness value range to which the first total pixel brightness belongs from multiple brightness adjustment amplitudes, takes the queried brightness adjustment amplitude as the target brightness adjustment amplitude, and adds the first total pixel brightness of the target brightness adjustment amplitude to the first total pixel brightness to obtain the total pixel brightness of the fourth video frame (referred to as the fourth total pixel brightness), that is, the first total pixel brightness*(1+target brightness adjustment amplitude)=fourth total pixel brightness.

[0129] For the grayscale values ​​of all sub-pixels of all pixels in the image data of the first video frame, the grayscale values ​​of all sub-pixels are increased by the target value so that the sum of the grayscale values ​​of all sub-pixels is equal to the fourth total pixel brightness. The image data after adding the target value is the image data of the fourth video frame, that is, the second video frame is obtained.

[0130] To further illustrate step 5021, refer to FIG9 , an operating timing diagram of a first brightness adjustment unit provided in an embodiment of the present application. Taking pixels including sub-pixels R, G, B, and W as an example, a clock signal CLK, a reset signal RST, a data enable signal DE, and pixel signals i_lr / g / b / w are all input signals to the first brightness adjustment unit. The clock signal CLK is used to ensure the transmission order of the pixel signals i_lr / g / b / w of each input video frame. The reset signal RST is a reset signal for the first brightness adjustment unit. A low level of the reset signal RST triggers the first brightness adjustment unit to reset, while a high level of the reset signal RST indicates that the first brightness adjustment unit is in an unavailable state. The data enable signal DE is a valid flag for the video signal (e.g., pixel signals i_lr / g / b / w) input to the first brightness adjustment unit. A low level of the data enable signal DE indicates that the input video signal is invalid, while a high level of the data enable signal DE indicates that the input video signal is valid. The pixel point signals i_lr / g / b / w are used to transmit the color information of each video frame in the order of the video frames. For example, the pixel point signals i_lr / g / b / w sequentially transmit the color information i_l1 of the first video frame, the color information i_l2 of the second video frame, the color information i_l3 of the third video frame, and the color information i_l4 of the fourth video frame.

[0131] The enable signal EN is used to enable the brightness adjustment function of the first brightness adjustment unit. When the enable signal EN is at a low level, the first brightness adjustment unit turns off the brightness adjustment function. When the enable signal EN is at a high level, the first brightness adjustment unit turns on the brightness adjustment function. Sub-pixel total brightness information: o_lr_sum_total, o_lb_sum_total, o_lg_sum_total, and o_lw_sum_total. The sub-pixel total brightness information o_lr_sum_total, o_lb_sum_total, o_lg_sum_total, and o_lw_sum_total respectively include the total sub-pixel brightness of the video frame on the sub-pixels R, B, G, and W. The brightness gain signal gain includes the total pixel brightness after brightness adjustment for each video frame.

[0132] After the brightness adjustment function is turned on, taking the input pixel signal i_lr / g / b / w carrying the first video frame as an example, according to the color information i_l1 of the first video frame, the total sub-pixel brightness sum_r1 on sub-pixel R of the first video frame, the total sub-pixel brightness sum_b1 on sub-pixel B of the first video frame, the total sub-pixel brightness sum_g1 on sub-pixel R of the first video frame, and the total sub-pixel brightness sum_w1 on sub-pixel W of the first video frame are calculated, and the total sub-pixel brightness sum_r1, the total sub-pixel brightness sum_b1, the total sub-pixel brightness sum_g1, and the total sub-pixel brightness sum_w1 are summed to obtain the total pixel brightness of the first video frame, and the total pixel brightness of the first video frame is adjusted by the target adjustment amplitude to obtain the total pixel brightness gain1 after the brightness adjustment of the first video frame, and the total pixel brightness gain1 is output as the total brightness information gain after the brightness adjustment of the first video frame to the second brightness adjustment unit. After obtaining the color information i_l2 of the second video frame, the color information i_l2 is processed in the same manner as the color information i_l1, and so on, and the total pixel brightness after brightness adjustment of each video frame is transmitted to the second brightness adjustment unit.

[0133] Taking Figures 6 and 7 as an example, after obtaining the image data of the fourth video frame and the fourth total pixel brightness, the first brightness adjustment unit sends the image data of the fourth video frame and the fourth total pixel brightness to the second brightness adjustment unit to achieve sending the fourth video frame and the total pixel brightness of the fourth video frame to the second brightness adjustment unit.

[0134] Step 5022: If the total pixel brightness of each of the multiple third video frames is the same as the total pixel brightness of the fourth video frame, and the total display time of the multiple third video frames is greater than or equal to the first time, the second brightness adjustment unit reduces the brightness of the pixel points of the fourth video frame to obtain the second video frame and the total pixel brightness of the second video frame, and the multiple third video frames are video frames before the second video frame displayed on the display panel.

[0135] The plurality of third video frames are video frames continuously displayed on the display panel before the fourth video frame is obtained, and the plurality of third video frames have the same total pixel brightness. If the plurality of third video frames have the same total pixel brightness, the plurality of third video frames are considered to be static video frames (i.e., static images). The first duration is the duration during which the adjustment module waits to adjust the brightness of the static video frames.

[0136] For example, multiple first durations are preset, and the multiple first durations correspond to different total pixel brightness value ranges. If the total pixel brightness of the current video frame is the same as the total pixel brightness of the previous video frame, then both the current video frame and the previous video frame are static video frames. The total pixel brightness of the current video frame is used as the reference brightness, and based on the first duration corresponding to the total pixel brightness value range to which the reference brightness belongs, the brightness adjustment mode is enabled for the static video frame of the reference brightness:

[0137] During the first time period, if the total pixel brightness of each acquired video frame is the reference brightness, the brightness of the video frame is not processed.

[0138] During the first duration, if the total pixel brightness of each video frame obtained is the reference brightness, each video frame obtained during the first duration is used as a third video frame. For each video frame obtained after the first duration, if the total pixel brightness of the video frame is the reference brightness, the total pixel brightness of the video frame is reduced by the brightness threshold. If the total pixel brightness of the video frame is not the reference brightness, the brightness amplitude of the video frame is not adjusted, and the brightness adjustment mode is disabled for static video frames at the reference brightness.

[0139] Alternatively, after reaching the first duration, if the total pixel brightness of the multiple video frames subsequently acquired is the reference brightness, after reaching the first duration, the total pixel brightness of the multiple video frames is reduced by one brightness threshold value every second duration. For example, after reaching the first duration, the second timer is turned on, and if the total pixel brightness of the multiple video frames acquired within the second duration is the reference brightness, the total pixel brightness of the multiple video frames is reduced by one brightness threshold value, and after reaching the second duration, the second timer is reset, and if the total pixel brightness of the multiple video frames acquired within the next second duration is the reference brightness, the total pixel brightness of the multiple video frames is reduced by 2 brightness threshold values, and so on. If the total pixel brightness of any video frame acquired after the second timer is turned on is not the reference brightness, the brightness adjustment mode is turned off for the static video frame of the reference brightness.

[0140] Accordingly, if the fourth video frame is a video frame acquired within the first duration, the brightness of the fourth video frame is not processed. If the fourth video frame is a video frame acquired after the first duration has elapsed, the total pixel brightness of the fourth video frame is adjusted in the above manner, and the adjusted total pixel brightness of the fourth video frame is the second total pixel brightness of the second video frame.

[0141] To further illustrate step 5022, refer to the working timing diagram of a second brightness adjustment unit provided in an embodiment of the present application shown in FIG10. The enable signal EN signal is used to enable the brightness adjustment function of the second brightness adjustment unit. When the enable signal EN signal is at a low level, the second brightness adjustment unit turns off the brightness adjustment function. When the enable signal EN signal is at a high level, the second brightness adjustment unit turns on the brightness adjustment function. The first brightness adjustment unit outputs the total brightness information gain of the video to the second brightness unit. The total brightness information gain includes the total pixel brightness after the brightness of multiple video frames is adjusted (such as gain1, gain2), such as the total pixel brightness gain1 after the brightness of the m video frame is adjusted, and the total pixel brightness gain2 after the brightness of the second video frame is adjusted. When the enable signal EN signal is at a high level, when it is detected that the video frame to which gain1 belongs is a static video frame, gain1 is used as the reference brightness. After waiting for the first time period t, the output ratio value is reduced by the brightness threshold value per second (i.e., the second time period) based on the gain1 value. If the acquired gain value changes after the first time duration t, the output ratio value immediately becomes the currently acquired gain value, wherein the ratio value is also the total pixel brightness of the video frame output by the second brightness adjustment module.

[0142] For the grayscale values ​​of all sub-pixels of all pixels in the image data of the fourth video frame, the grayscale values ​​of all sub-pixels are increased by the target value so that the sum of the grayscale values ​​of all sub-pixels is equal to the second total pixel brightness. The image data after adding the target value is the image data of the second video frame, that is, the second video frame is obtained.

[0143] As shown in Figures 6 and 7, after obtaining the image data of the second video frame and the second total pixel brightness, the second brightness adjustment unit outputs the second total pixel brightness of the second video frame to the light strip control module, as shown in Figures 6 and 7. If the brightness adjustment module is the last image processing module in the image processing pipeline, the second brightness adjustment unit sends the image data of the second video frame to the interface of the timing controller connected to the display panel. If there are other image processing modules after the brightness adjustment module in the image processing pipeline, the image data of the second video frame is output to the other image processing modules, and the second video frame is processed by the other image processing modules. Finally, the last image processing module in the image processing pipeline sends the processed image data of the second video frame to the interface. It should be understood that the other image processing modules will not adjust the brightness of the second video frame. Therefore, even if the other image processing modules perform image processing on the second video frame, the brightness of the second video frame will not be changed.

[0144] By adjusting the brightness of the video frame in step 5011, the overall brightness of the display panel can be effectively controlled when the brightness-adjusted video frame is displayed on the display panel. By adjusting the brightness of the video frame in step 5022, the overall brightness of the static video frame on the display panel can be effectively controlled when the brightness-adjusted static video frame is displayed on the display panel.

[0145] 503. The timing controller displays the second video frame through the display panel.

[0146] As shown in Figures 6 and 7, if the brightness adjustment module is the last image processing module in the image processing pipeline, after obtaining the image data of the second video frame, the second brightness adjustment unit sends the image data of the second video frame to the interface of the timing controller connected to the display panel, and the interface controls the display panel to display the second video frame based on the image data.

[0147] If there are other image processing modules after the brightness adjustment module in the image processing pipeline, the second brightness adjustment unit outputs the image data of the second video frame to the other image processing modules, and the second video frame is processed by the other image processing modules. Finally, the last image processing module in the image processing pipeline sends the processed image data of the second video frame to the interface. It should be understood that the other image processing modules will not adjust the brightness of the second video frame. Therefore, even if the other image processing modules perform image processing on the second video frame, the brightness of the second video frame will not change.

[0148] 504. The timing controller controls the luminous color and luminous brightness of the light strip based on the color information of the first video frame and the total pixel brightness of the second video frame, where the color information indicates the color of the pixel points of the first video frame.

[0149] Here, step 504 may be performed by a light strip control module in a timing controller.

[0150] Because the light strip control module is connected to the second brightness adjustment unit, the second brightness adjustment unit, after obtaining the total pixel brightness of the second video frame, sends the total pixel brightness of the second video frame to the light strip control module. In response, the second brightness adjustment unit obtains the total pixel brightness of the second video frame. After obtaining the total pixel brightness of the second video frame, the light strip control module controls the light color and brightness of the light strip based on the color information of the first video frame and the total pixel brightness of the second video frame.

[0151] For example, the second brightness adjustment unit synchronizes the luminous color of the light strip based on the color information of the first video frame, so that the luminous color of the light strip is closer to the color of the second video frame, thereby improving the display effect of the light strip and enhancing the user's immersive experience.

[0152] In addition, when the color information of the first video frame includes the total color value of multiple partitions, the luminous color of each position of the light strip is the same as the color of the partition corresponding to the position, so as to ensure that the color of each partition can be accurately displayed on the light strip, thereby achieving refined control of the color of the light strip, further improving the display effect of the light strip, and further enhancing the user's immersive experience.

[0153] For another example, the second brightness adjustment unit synchronizes the luminous color of the light strip based on the total pixel brightness of the second video frame, so that the luminous brightness of the light strip is synchronized with the brightness of the second video frame displayed by the display panel, thereby increasing the display effect of the light strip and improving the user's immersive experience.

[0154] It should be understood that step 503 and step 504 are performed simultaneously so that the luminous color of the light strip is synchronized with the color of the video frame displayed by the display panel, and the luminous brightness of the light strip is synchronized with the brightness of the video frame displayed by the display panel.

[0155] The brightness adjustment module in the timing controller of the display module adjusts the brightness of the video frame to be played, and displays the adjusted video frame through the display panel. The method provided in the embodiment of the present application sets a light strip control module in the timing controller so that the light strip control module obtains the total pixel brightness of the adjusted video frame, and controls the luminous color and luminous brightness of the light strip based on the color of the video frame and the adjusted total pixel brightness, so that the luminous color and luminous brightness of the light strip can be synchronized with the brightness and color of the video frame displayed on the display panel, thereby improving the display effect of the light strip and enhancing the user's immersive experience.

[0156] The embodiment shown in Figure 5 is introduced by taking the example of the second brightness adjustment unit providing the total pixel brightness of the second video frame to the light strip control module. In other embodiments, the first brightness adjustment unit is also connected to the light strip control module, and the first brightness adjustment unit can also provide the total pixel brightness to the light strip control module.

[0157] Taking Figures 6 and 7 as an example, after the first brightness adjustment unit obtains the total pixel brightness of the fourth video frame, it sends the total pixel brightness of the fourth video frame to the light strip control module. Since the second brightness adjustment unit also sends the total pixel brightness of the second video frame to the light strip control module, the light strip control module may obtain the total pixel brightness of the fourth video frame and the total pixel brightness of the second video frame. If the total pixel brightness of the fourth video frame and the total pixel brightness of the second video frame are obtained, since the total pixel brightness of the second video frame is the actual total pixel brightness of the second video frame displayed on the display panel, the light strip control module will select the total pixel brightness of the second video frame as the total pixel brightness of the first video frame, and control the luminous color and luminous brightness of the light strip based on the color information of the first video frame and the total pixel brightness of the second video frame.

[0158] If the second brightness adjustment unit is not enabled, the second brightness adjustment unit is not in a working state. If the second brightness adjustment unit is not in a working state, the first brightness adjustment module displays the fourth video frame through the display panel and sends the total pixel brightness of the fourth video frame to the light strip control module. The light strip control module controls the luminous color and luminous brightness of the light strip based on the color information of the first video frame and the total pixel brightness of the fourth video frame, so that the luminous brightness of the light strip is closer to the total pixel brightness of the second video frame, so as to avoid the situation where the luminous brightness of the light strip cannot be effectively controlled when the total pixel brightness of the second video frame cannot be obtained. Among them, the process of the first brightness adjustment module displaying the fourth video frame through the display panel is the same as the process of the second brightness adjustment module displaying the second video frame through the display panel.

[0159] For example, FIG11 shows a flowchart of pixel brightness selection for a video frame to be played provided by an embodiment of the present application. The light strip control module detects whether the brightness adjustment module is reset. If it is detected that the brightness adjustment module is not reset, the first preset pixel brightness is used as the light strip luminance light, and the light strip luminous color and luminous brightness are controlled based on the color information of the first video frame and the first preset pixel brightness. If it is detected that the brightness adjustment module is reset, it is detected whether the first brightness adjustment unit is enabled (i.e., whether it is in a working state). If it is detected that the first brightness adjustment unit is not enabled (i.e., not in a working state), the second preset pixel brightness is used as the light strip luminous brightness light, and the light strip luminous color and luminous brightness are controlled based on the color information of the first video frame and the second preset pixel brightness. If it is detected that the first brightness adjustment unit is enabled (i.e., in working state), then it is detected whether the second brightness adjustment unit is enabled (i.e., in working state). If it is detected that the second brightness adjustment unit is not enabled (i.e., not in working state), then the total pixel brightness of the fourth video frame sent by the first brightness adjustment unit is used as the light strip luminance light, and the light strip luminous color and luminous brightness are controlled based on the color information of the first video frame and the total pixel brightness of the fourth video frame. If it is detected that the second brightness adjustment unit is enabled, then the total pixel brightness of the second video frame sent by the second brightness adjustment unit is used as the light strip luminous brightness light, and the light strip luminous color and luminous brightness are controlled based on the color information of the first video frame and the total pixel brightness of the second video frame. This ensures that the light strip control module can control the light strip luminous brightness in various situations.

[0160] The embodiments shown in Figures 5 to 11 above are all introduced by taking the example that the brightness adjustment module includes a multi-level brightness adjustment unit. In other embodiments, the brightness adjustment module does not include a multi-level brightness adjustment unit. When the brightness adjustment module does not include a multi-level brightness adjustment unit, the brightness adjustment module adjusts the brightness of the pixel points of the first video frame through the following adjustment method 1 or adjustment method 2.

[0161] Adjustment method 1: The brightness adjustment module adjusts the brightness of the pixel points of the first video frame based on the brightness adjustment amplitude corresponding to the total pixel brightness of the first video frame among multiple brightness adjustment amplitudes to obtain the second video frame and the total pixel brightness of the second video frame. The multiple brightness adjustment amplitudes correspond to different total pixel brightnesses.

[0162] Adjustment method 1 is similar to step 5021 above, and the present embodiment will not elaborate on adjustment method 1. By adjusting the brightness of the video frame by adjustment method 1, the overall brightness of the display panel can be effectively controlled when the brightness-adjusted video frame is displayed on the display panel.

[0163] Adjustment method 2, brightness adjustment module: If the total pixel brightness of each third video frame in the multiple third video frames is the same as the total pixel brightness of the first video frame, and the total display time of the multiple third video frames is greater than or equal to the first time, the brightness adjustment module reduces the brightness of the pixel points of the first video frame to obtain the second video frame and the total pixel brightness of the second video frame. The multiple third video frames are video frames before the second video frame displayed on the display panel.

[0164] Among them, the above-mentioned step 5022 of adjustment method 2 is similar, the difference being that the total brightness information of the fourth video frame obtained by the second adjustment unit in step 5022 is calculated by the first adjustment unit, while in adjustment method 2, the brightness adjustment module is required to calculate the total pixel brightness of the first video frame based on the image data of the first video frame. Here, the embodiment of the present application will not be further described in detail about adjustment method 2. By adjusting the brightness of the video frame by adjustment method 2, when the static video frame after brightness adjustment is displayed on the display panel, the overall brightness of the static video frame on the display panel can be effectively controlled.

[0165] After the brightness adjustment module obtains the image data of the second video frame and the total pixel brightness of the second video frame, it adjusts the brightness of the video frame using adjustment method 1. When the brightness-adjusted video frame is displayed on the display panel, the overall brightness of the display panel can be effectively controlled. For example, similar to the second brightness adjustment sub-module, the total pixel brightness of the second video frame is output to the light strip control module, and the image data of the second video frame is output to the interface, so that the light strip control module controls the light strip's brightness based on the total pixel brightness of the second video frame. The interface drives the display panel to display the second video frame based on the image data of the second video frame.

[0166] In other embodiments, the timing controller further includes a black screen maintenance module, which is configured to provide a black screen maintenance function for the display panel. The black screen maintenance function refers to controlling the display panel to be black for a certain period of time (referred to as a third period of time) to indicate that the display panel is in a black screen maintenance state. For example, when the timing controller is performing shutdown compensation on the display panel, the display panel is controlled to be black, and the display panel is in the black screen maintenance state. If the display panel is in the black screen maintenance state, the light strip control module controls the lighting effect of the light strip based on the black screen maintenance progress of the display panel, so that the lighting effect can indicate the black screen maintenance progress.

[0167] For example, FIG12 shows another flowchart of pixel brightness selection of a video frame to be played provided by an embodiment of the present application. The light strip control module detects the working mode of the display panel. If it is detected that the working mode of the display panel is the display mode, the total pixel brightness of the video frame is selected according to the selection logic shown in FIG11, and the luminous brightness of the light strip is controlled according to the selected total pixel brightness. If it is detected that the working mode of the display panel is the black screen maintenance mode, the display panel is in the black screen maintenance state at this time, and the light strip control module obtains the black screen maintenance time (i.e., the third time) from the black screen maintenance module. The light strip control module uses the third preset total pixel brightness as the light strip luminous brightness light. According to the third time and the third preset luminous brightness, the light strip is controlled to complete the lighting of the entire light strip within the third time. For example, with a certain position of the light strip as the starting position, the light strip is controlled to start lighting from the starting position, and the length of lighting is gradually increased along the light strip until the entire light strip is fully lit for the third time. Thus, the lighting progress of the light strip is used to prompt the user of the black screen maintenance progress of the display panel.

[0168] The above embodiments are described by taking the timing controller including various modules as an example. In other embodiments, the timing controller does not distinguish modules inside, and the functions of various modules are implemented by the timing controller.

[0169] In an exemplary embodiment, the light strip control module described above is not set in the timing controller and is not set in the SOC, but is set in the display module and is independent of the timing controller, or is not set in the display module and is independent of the SOC, thereby reducing the development cost of the timing controller and the SOC.

[0170] In an exemplary embodiment, a computer-readable storage medium is also provided, such as a memory including program code. The program code can be executed by the timing controller described above to implement the light strip control method based on the display module in the above embodiment. Alternatively, the program code can be executed by the light strip control module to implement the light strip control method based on the display module in the above embodiment. The computer-readable storage medium can be a read-only memory (ROM), a random access memory (RAM), a compact disc read-only memory (CD-ROM), a magnetic tape, a floppy disk, an optical data storage device, or the like.

[0171] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, storage, and display, etc.), and signals involved in this application are all authorized by the user or fully authorized by all parties, and the collection, use, and processing of relevant data must comply with the relevant laws, regulations, and standards of the relevant countries and regions. For example, the video streams involved in this application are all obtained with full authorization.

[0172] Those skilled in the art will understand that all or part of the steps of implementing the above embodiments can be completed by hardware or by hardware related to program instructions. The program can be stored in a computer-readable storage medium, and the above-mentioned storage medium can be a read-only memory, a disk or an optical disk, etc.

[0173] The above description is merely an optional embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present application shall be included in the scope of protection of the present application.

Claims

1. A display module, characterized in that: The display module includes a display panel and a timing controller, the display panel is connected to the timing controller, and the periphery of the display panel supports the setting of a light strip; The timing controller comprises a brightness adjustment module and a light strip control module, the brightness adjustment module is connected to the light strip control module, and the light strip control module is used to be connected to the light strip; The brightness adjustment module is used to adjust the brightness of the pixel points of the first video frame to be played to obtain the second video frame and the total pixel brightness of the second video frame; The brightness adjustment module is further used to display the second video frame through the display panel and send the total pixel brightness to the light strip control module; The light strip control module is used to control the luminous color and luminous brightness of the light strip based on the color information of the first video frame and the total pixel brightness, and the color information indicates the color of the pixel point of the first video frame.

2. The module according to claim 1, characterized in that: The brightness adjustment module is used for: Based on a brightness adjustment amplitude among multiple brightness adjustment amplitudes corresponding to the total pixel brightness of the first video frame, the brightness of the pixel points of the first video frame is adjusted to obtain the second video frame and the total pixel brightness of the second video frame, and the multiple brightness adjustment amplitudes correspond to different total pixel brightnesses.

3. The module according to claim 1, characterized in that: The brightness adjustment module is used for: If the total pixel brightness of each of the multiple third video frames is the same as the total pixel brightness of the first video frame, and the total display time of the multiple third video frames is greater than or equal to the first time, the brightness of the pixels of the first video frame is reduced to obtain the second video frame and the total pixel brightness of the second video frame, and the multiple third video frames are video frames before the second video frame displayed by the display panel.

4. The module according to claim 1, characterized in that: The brightness adjustment module includes a first brightness adjustment unit and a second brightness adjustment unit, the first brightness adjustment unit, the second brightness adjustment unit and the display module are connected in sequence, and the second brightness adjustment unit is also connected to the light strip control module; The first brightness adjustment unit is configured to adjust the brightness of the pixel points of the first video frame based on a brightness adjustment amplitude corresponding to the total pixel brightness of the first video frame among multiple brightness adjustment amplitudes, obtain a fourth video frame and the total pixel brightness of the fourth video frame, and send the fourth video frame and the total pixel brightness of the fourth video frame to the second brightness adjustment unit, wherein the multiple brightness adjustment amplitudes correspond to different total pixel brightnesses; The second brightness adjustment unit is configured to reduce the brightness of the pixels of the fourth video frame to obtain the second video frame and the total pixel brightness of the second video frame if the total pixel brightness of each of the plurality of third video frames is the same as the total pixel brightness of the fourth video frame and the total display duration of the plurality of third video frames is greater than or equal to the first duration, and the plurality of third video frames are video frames before the second video frame displayed by the display panel; The second brightness adjustment unit is further used to display the second video frame through the display panel and send the total pixel brightness to the light strip control module.

5. The module according to claim 4, characterized in that: The first brightness adjustment unit is also connected to the display panel and the light strip control module; The first brightness adjustment unit is further configured to display the fourth video frame through the display panel and send the total pixel brightness of the fourth video frame to the light strip control module if the second brightness adjustment unit is not in a working state; The light strip control module is further used to control the luminous color and luminous brightness of the light strip based on the color information and the total pixel brightness of the fourth video frame.

6. The module according to claim 4 or 5, characterized in that: The first brightness adjustment unit is also connected to the display panel and the light strip control module; The first brightness adjustment unit is further used to send the total pixel brightness of the fourth video frame to the light strip control module; The light strip control module is also used to control the luminous color and luminous brightness of the light strip based on the color information and the total pixel brightness of the second video frame if the total pixel brightness of the fourth video frame and the total pixel brightness of the second video frame are obtained.

7. The module according to any one of claims 1 to 6, characterized in that: The timing controller is also used to connect to the system-level chip of the display module; The brightness adjustment module is further used to obtain the first video frame sent by the system-level chip; The light strip control module is further used to obtain the color information sent by the system-level chip.

8. The module according to any one of claims 1 to 6, characterized in that: The timing controller is also used to connect to the system-level chip of the display module; The brightness adjustment module is further used to obtain the first video frame sent by the system-level chip; The light strip control module is further used to extract color from the first video frame to obtain color information of the first video frame.

9. The module according to claim 8, characterized in that: The first video frame includes a plurality of partitions, the color information includes a total color value of each of the plurality of partitions, and the total color value is the sum of color values ​​of each pixel in the partition; The light strip control module is also used for: Dividing the video frame into regions to obtain the multiple partitions, wherein the multiple partitions are all located at the edge of the video frame; Based on the color values ​​of each pixel point in each of the multiple partitions, a total color value of each partition is obtained.

10. The module according to any one of claims 1 to 9, characterized in that: The light strip control module is also used for: If the display panel is in a black screen maintenance state, the luminous effect of the light strip is controlled based on the black screen maintenance progress of the display panel, so that the luminous effect can indicate the black screen maintenance progress.

11. A light strip control method based on a display module, characterized in that: The display module is the display module of any one of claims 1 to 10, the method is executed by the timing controller, and the method comprises: Adjusting the brightness of the pixels of the first video frame to be played to obtain a second video frame and a total pixel brightness of the second video frame; Displaying the second video frame through the display panel; Based on the color information of the first video frame and the total pixel brightness, the luminous color and luminous brightness of the light strip are controlled, and the color information indicates the color of the pixel point of the first video frame.

12. The method according to claim 11, characterized in that The step of adjusting the brightness of the pixel points of the first video frame to be played to obtain the second video frame and the total pixel brightness of the second video frame comprises: Based on a brightness adjustment amplitude among multiple brightness adjustment amplitudes corresponding to the total pixel brightness of the first video frame, the brightness of the pixel points of the first video frame is adjusted to obtain the second video frame and the total pixel brightness of the second video frame, and the multiple brightness adjustment amplitudes correspond to different total pixel brightnesses.

13. The method according to claim 11, characterized in that The step of adjusting the brightness of the pixel points of the first video frame to be played to obtain the second video frame and the total pixel brightness of the second video frame comprises: If the total pixel brightness of each of the multiple third video frames is the same as the total pixel brightness of the first video frame, and the total display time of the multiple third video frames is greater than or equal to the first time, the brightness of the pixels of the first video frame is reduced to obtain the second video frame and the total pixel brightness of the second video frame, and the multiple third video frames are video frames before the second video frame displayed by the display panel.

14. The method according to claim 11, characterized in that The step of adjusting the brightness of the pixel points of the first video frame to be played to obtain the second video frame and the total pixel brightness of the second video frame comprises: Adjusting the brightness of the pixel points of the first video frame based on a brightness adjustment amplitude corresponding to the total pixel brightness of the first video frame among multiple brightness adjustment amplitudes to obtain a fourth video frame and the total pixel brightness of the fourth video frame, the multiple brightness adjustment amplitudes corresponding to different total pixel brightnesses; If the total pixel brightness of each of the plurality of third video frames is the same as the total pixel brightness of the fourth video frame, and the total display time of the plurality of third video frames is greater than or equal to the first time, the brightness of the pixel points of the fourth video frame is reduced to obtain the second video frame and the second video frame. The total pixel brightness of the frame, the plurality of third video frames are video frames before the second video frame displayed by the display panel.

15. The method according to claim 14, characterized in that After obtaining the fourth video frame and the total pixel brightness of the fourth video frame, the method further includes: Displaying the fourth video frame through the display panel; Based on the color information and the total pixel brightness of the fourth video frame, the luminous color and luminous brightness of the light strip are controlled.

16. The method according to any one of claims 11 to 15, characterized in that Before controlling the luminous color and luminous brightness of the light strip based on the color information of the first video frame and the total pixel brightness, the method includes: The first video frame and the color information sent by the system-level chip of the display module are obtained.

17. The method according to any one of claims 11 to 15, characterized in that Before controlling the luminous color and luminous brightness of the light strip based on the color information of the first video frame and the total pixel brightness, the method includes: Acquire the first video frame sent by the system-level chip of the display module; Perform color extraction on the first video frame to obtain color information of the first video frame.

18. The method according to claim 17, characterized in that The first video frame includes a plurality of partitions, the color information includes a total color value of each of the plurality of partitions, and the total color value is the sum of color values ​​of each pixel in the partition; The performing color extraction on the first video frame to obtain color information of the first video frame includes: Divide the first video frame into regions to obtain the multiple partitions, wherein the multiple partitions are all located at the edge of the video frame; Based on the color values ​​of each pixel point in each of the multiple partitions, a total color value of each partition is obtained.

19. The method according to any one of claims 11 to 18, characterized in that The method further comprises: If the display panel is in a black screen maintenance state, the luminous effect of the light strip is controlled based on the black screen maintenance progress of the display panel, so that the luminous effect can indicate the black screen maintenance progress.

20. A display device, characterized in that: The display device comprises a system-on-chip and a display module as described in any one of claims 1 to 10, wherein the system-on-chip is used to provide the display module with video frames to be played.

Images