Backlight following method and related device
Patent Information
- Application Number
- CN202310989084.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-08-07
- Publication Date
- 2026-10-20
- Estimated Expiration
- 2043-08-07
AI Technical Summary
[0005]本发明的目的是提供一种背光跟随方法及相关设备,旨在解决现有背光分区技术对需要在播放时根据视频流实时对各个背光分区进行计算,导致需要较高的运算能力的问题
[0030]本发明通过预先对存储的视频解析好存储的视频流对应的各个背光分区的亮度信息流,在播放时直接根据解析的亮度信息流控制背光分区的亮度,避免了需要对视频流实时解析,造成主控芯片运算压力过大,导致的播放卡顿和主控芯片成本过高的问题。
Smart Images

Figure CN117219012B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of screen control applications, and more particularly to a backlight following method and related equipment. Background Technology
[0002] Existing displays typically consist of an LCD panel, backlight, and driving circuitry. Since the LCD panel does not emit light on its own, a backlight is needed to illuminate the entire LCD screen so that the image can be displayed. The backlight provides sufficient brightness to ensure that the image on the display is clearly visible under various environmental conditions. In addition, the backlight can also improve the contrast ratio of the display, that is, the difference between black and white. By adjusting the brightness and darkness of the backlight, the image on the display can be made clearer, sharper, and more detailed. In other words, the backlight effect plays an important role in the display effect of the LCD screen.
[0003] Especially for advertising videos played on digital signage, the backlight effect directly affects the display of product details. If the product details are not displayed well, the advertising effect will be directly affected. To increase the contrast of the display, existing monitors have adopted a backlight zoning technology. This physically divides the screen's backlight into multiple independent backlight zones. By varying the brightness of different backlight zones, the illumination of each zone works in coordination to enhance image contrast and thus improve the display effect.
[0004] However, in the existing technology, this solution requires real-time parsing of the video stream being played, which puts a lot of pressure on the main control chip. This not only increases the manufacturing cost of the display, but may also cause problems such as playback stuttering. Summary of the Invention
[0005] The purpose of this invention is to provide a backlight following method and related equipment, which aims to solve the problem that existing backlight zoning technology requires high computing power because it needs to calculate each backlight zone in real time according to the video stream during playback.
[0006] The technical solution adopted by this invention to solve the technical problem is as follows:
[0007] This invention provides a backlight following method, the backlight following method comprising:
[0008] Obtain the stored video stream to be played and the corresponding brightness information stream of each backlight zone;
[0009] The screen is controlled to play according to the video stream, and the backlight zones are controlled to illuminate according to the brightness information stream of each backlight zone corresponding to the video stream.
[0010] Optionally, the brightness information stream of each backlight zone is obtained in advance by parsing the stored video stream to be played. Specifically, obtaining the brightness information stream of each backlight zone from the stored video stream to be played includes:
[0011] The system retrieves the stored video stream to be played, performs frame-by-frame analysis on the video stream, and obtains the average brightness information of each backlight zone in each frame of the video stream.
[0012] The brightness information stream of each backlight zone is formed based on the average brightness information of each backlight zone in each frame.
[0013] Optionally, the step of performing frame-by-frame analysis of the video stream to obtain the average brightness information of each backlight zone in each frame of the video stream specifically includes:
[0014] The average brightness information of each backlight partition in each frame is obtained by calculating the average brightness information of the pixels included in each backlight partition in each frame of the video stream.
[0015] Optionally, calculating the average brightness information of the pixels included in each backlight zone specifically includes:
[0016] Every set number of pixels, one pixel is taken as the sampled pixel.
[0017] Calculate the average value of the brightness information of the sampled pixels included in each backlight zone.
[0018] Optionally, the video streams are multiple, and the backlight following method further includes:
[0019] Get the number of videos to be played, and divide the video area into a corresponding number of video regions based on the number of videos;
[0020] The step of controlling screen playback based on video stream, and controlling backlighting of each backlight zone based on brightness information stream corresponding to the video stream, specifically includes:
[0021] Each video region is set to correspond to a video stream, and the screen of the video region is controlled to play according to the video stream corresponding to the video region;
[0022] Based on the brightness information stream of the backlight zone corresponding to the video area, control the backlight zone of the video area to perform backlighting.
[0023] Optionally, dividing the video into a corresponding number of regions based on the number of videos specifically includes:
[0024] The video region is divided according to the backlight partition to ensure that each video region contains only the complete backlight partition.
[0025] Optionally, controlling the backlight partition of the video area to provide backlight includes: if the same backlight partition belongs to two video areas at the same time, determining the priority of the two video areas in the backlight partition, and controlling the backlight partition with the brightness information stream of the video area with higher priority in the backlight partition.
[0026] Optionally, the higher priority video region is specifically the video region with higher required brightness in the backlight partition.
[0027] In addition, to achieve the above objectives, the present invention also provides a display comprising: a screen, a memory, a processor, and a backlight following program stored in the memory and executable on the processor, wherein the backlight of the screen has multiple backlight zones, and the backlight following program, when executed by the processor, implements the steps of the backlight following method as described above.
[0028] In addition, to achieve the above objectives, the present invention also provides a computer-readable storage medium storing a backlight following program, which, when executed by a processor, implements the steps of the backlight following method as described above.
[0029] The present invention, by employing the above technical solution, has the following effects:
[0030] This invention pre-parses the brightness information stream of each backlight zone corresponding to the stored video stream, and directly controls the brightness of the backlight zone according to the parsed brightness information stream during playback. This avoids the problems of excessive computing pressure on the main control chip, resulting in playback stuttering and high cost of the main control chip, which require real-time parsing of the video stream. Attached Figure Description
[0031] Figure 1 This is a flowchart of the backlight following method in a preferred embodiment of the present invention;
[0032] Figure 2 This is a flowchart of the backlight following method in a preferred embodiment of the present invention;
[0033] Figure 3 This is a schematic diagram showing the division of the advertising area and the backlight area of the screen in a preferred embodiment of the present invention;
[0034] Figure 4 This is a schematic diagram of the operating environment of a preferred embodiment of the display of the present invention. Detailed Implementation
[0035] To make the objectives, technical solutions, and advantages of this invention clearer and more explicit, the invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
[0036] Example 1
[0037] Please see Figure 1-2 , Figure 1 This is a flowchart of the backlight following method in a preferred embodiment of the present invention. Figure 2 This is a flowchart of the backlight following method in a preferred embodiment of the present invention.
[0038] Example 1 discloses a backlight following method, including the steps of
[0039] S1. Obtain the stored video stream to be played and the corresponding brightness information stream of each backlight zone.
[0040] The backlight following method in this embodiment specifically addresses the problem in existing technologies where, due to the need for large-scale deployment of advertising machines and cost control purposes, the main control chip (CPU) of existing advertising machines is usually low-cost, making it impossible to apply existing backlight zoning technology to perform real-time analysis of the video stream. All advertising content shares a single backlight, making it impossible to perform individual backlight zoning control for each advertisement. In particular, it is impossible to achieve accurate contrast when displaying product details, resulting in a less than ideal advertising display effect. The solution is to implement individual control for each backlight zone and apply it to the advertising screen of the advertising machine to improve the advertising effect displayed on the advertising screen.
[0041] It is worth noting that the backlight following method of the present invention can also be applied to other devices that play back stored video streams, such as computers, tablet computers, and other devices that play stored video files.
[0042] In this embodiment, the video stream of the advertisement is specifically obtained and stored locally on the advertising machine after being sent by the information transmission system.
[0043] An information publishing system consists of a server, a network, a player, and a display device. The server sends information to the player via the network (wide area network / local area network / private network, including wireless networks). The player then combines audio, video, images, text, and other information (including playback position and content) and sends it to a display device such as an LCD TV that can accept audio and video input to form an audio and video file for playback.
[0044] It is worth noting that the video stream method of distributing advertisements through the information dissemination system has advantages such as centralized control, centralized management, and real-time release. It can be remotely controlled through a wide area network without the need for manual card replacement or insertion. It can play different advertising information content in different locations, for different audiences, and at different times. Software upgrades can also be performed remotely without the need for on-site personnel. Furthermore, it can instantly release emergency information and sudden events, insert media files, and achieve the synchronous release of real-time information such as bank foreign exchange, fund interest rates, policies and regulations, promotional activities, weather forecasts, and clocks. Therefore, this embodiment adopts the video stream control method of the information dissemination system to control the display of the advertising machine.
[0045] However, in other embodiments, depending on actual business needs, the advertising screen can also play fixed video content. This involves inputting the video stream of the advertisement to be played into the internal storage of the advertising machine. Subsequent changes to the content played on the advertising screen are made through manual intervention. Other methods can also be used to deliver the video stream of the advertisement; this invention is not limited to these.
[0046] Please refer to Figure 3 Optionally, if there are multiple video streams for an advertisement, step S1 may also involve obtaining the number of advertisements to be placed and dividing the advertisement area into a corresponding number based on the number of advertisements.
[0047] In the field of advertising machines, there are currently two product forms. One is a physical dual-screen or triple-screen splicing, where the backend information dissemination system sends an advertisement to each screen individually. The other is a complete large screen, where the number of advertisements displayed is controlled by the backend information dissemination system (hereinafter referred to as the information dissemination system), and the advertisements are spliced on one screen. Because the cost of physical multi-screen is high, most existing advertising machines adopt a single-screen form and use the information dissemination system to deliver multiple advertisements. The backlight following method in this embodiment is also aimed at the advertising screen of the advertising machine that uses a single-screen form and delivers multiple advertisements through the information dissemination system.
[0048] Assuming that three advertisements need to be displayed, the information dissemination system saves the video streams of the three advertisements in the storage of the advertising machine. The advertising machine obtains the number of advertisements (3) based on the three advertisements issued by the information dissemination system. Based on the number of advertisements (3), it divides the area into three regions as shown in the figure, namely region A, region B, and region C, to correspond to the three advertisements that need to be displayed.
[0049] In this embodiment, the advertising area is divided according to the backlight partition, so that each advertising area contains only the complete backlight partition, and each backlight partition belongs to only one advertising area.
[0050] The backlight following method of this embodiment applies to the backlight of the advertising machine screen, which is composed of multiple backlight zones. That is, the advertising machine of this embodiment uses backlight zone technology. The emergence of backlight zone technology is to realize independent brightness control of each zone in the backlight panel, so as to better control the brightness and darkness effect in the TV picture and bring a better visual experience.
[0051] Specifically, in this embodiment, the advertising machine uses a 2K resolution screen. 2K resolution is a display device with a horizontal resolution of approximately 2000 pixels. In this embodiment, it is specifically a 1920*1080 resolution screen.
[0052] Please refer to Figure 3 In this embodiment, the screen of the advertising machine has 7 rows and 12 columns, with a total of 84 backlight zones. Among them, area A occupies 3 rows and 12 columns, with a total of 36 backlight zones; area B occupies 4 rows and 6 columns, with a total of 24 backlight zones; and area C occupies 4 rows and 6 columns, with a total of 24 backlight zones.
[0053] Each advertising area contains only a complete backlight zone, so that the edges of each area can get a good backlight effect. This avoids the problem of inconsistent brightness required by the two video streams at the same time, which would result in poor display effect.
[0054] In other embodiments, if it is inconvenient to adjust the aspect ratio or scale the advertisements, resulting in the same backlight zone belonging to two advertisement areas simultaneously, then the required brightness of the two advertisement areas in that backlight zone is compared, and the brightness of the backlight zone is controlled to be the higher brightness.
[0055] In this embodiment, the brightness information stream of each corresponding backlight partition is specifically obtained by analyzing the video stream frame by frame to obtain the average brightness information of each backlight partition in each frame of the video stream, forming the brightness information stream of each corresponding backlight partition.
[0056] This embodiment uses the video stream of region A as an example. The advertising machine's screen resolution is 1920*1080, divided into 84 backlight zones. Each backlight zone contains 24,685 pixels. It's worth noting that because the pixel data may not be divisible by the number of backlight zones, some pixel data may be missing. These missing parts can be discarded. Region A contains 36 backlight zones, totaling 888,685 pixels. In each frame of the video stream playing in region A, the average brightness information of each backlight zone is calculated. The average brightness information of a backlight zone is the average of the brightness information of each pixel in the backlight zone, which is ∑Yi / 24685, where Yi is the brightness information of the i-th pixel in the backlight zone.
[0057] Optionally, since different SOCs have different processing performance and different advertising machines have different screen resolutions, it is sometimes too time-consuming to extract and analyze the brightness information of all pixels. Therefore, the average brightness information of each backlight zone can be obtained by sampling extraction.
[0058] Specifically, the brightness information Yi value of a pixel can be extracted every 5 or more pixels. That is, a sampled pixel is taken every 5 or more pixels, and the average brightness information of the backlight partition in each frame is calculated to obtain the average brightness information of the backlight partition in that frame.
[0059] After calculating the average brightness information of each backlight zone in region A, the average brightness information is expressed as an 8-bit conversion and mapped to the brightness information table of region A, as shown in Table 1 below.
[0060] Table 1
[0061]
[0062] S3. Control the screen to play according to the video stream, and control the backlight zones to backlight according to the brightness information stream of each backlight zone corresponding to the video stream.
[0063] Specifically, a synchronization signal is used for control, so that each frame of the video stream is sent to the screen for backlighting. At the same time, the average brightness information of the backlight partitions of each frame is synchronously sent to each backlight partition for backlight control through hardware SPI or other communication interfaces, so as to increase the contrast of the played video and achieve a clear and good contrast, so as to fully display the details of the advertised products and achieve a good promotional effect.
[0064] Because of the unique playback mechanism of advertising machines, compared to televisions, advertising machines require downloading the advertisements to be played locally before playing them. Moreover, the same advertising machine will only play a fixed stream of advertisements within a specific time period, either playing one advertisement continuously or looping several advertisements. In other words, the advertisements played by the advertising machine are unchanging over a period of time. Based on this characteristic, the backlight information required for these advertisement video streams can be calculated and stored in advance using the advertising machine's CPU. When the advertisement is played, it can be sent to the backlight according to the advertisement synchronization signal.
[0065] Compared to televisions, the backlight following method of this invention can reduce the burden on the main control CPU of the advertising machine. Therefore, a lower-cost CPU can be used to achieve backlight following control of the advertising machine. On the one hand, this can reduce the deployment cost of the advertising machine. If there is no need to reduce the cost, the same cost can be used to deploy an advertising machine with a higher resolution to achieve a better advertising effect.
[0066] Example 2
[0067] Please see Figure 4 Based on the above method, the present invention also provides a display, the display comprising: a screen 30, a memory 10, a processor 20, and a backlight following program stored in the memory 10 and executable on the processor 20, the backlight of the screen 30 having multiple backlight zones, and the backlight following program implementing the steps of the backlight following method as described above when executed by the processor 20.
[0068] In some embodiments, the memory 20 may be an internal storage unit of the display, such as the display's hard drive or memory. In other embodiments, the memory 20 may be an external storage device of the display, such as a plug-in hard drive, Smart Media Card (SMC), Secure Digital (SD) card, or Flash Card. Furthermore, the memory 20 may include both internal and external storage units of the display. The memory 20 is used to store application software and various types of data installed on the display, such as the program code installed on the display. The memory 20 can also be used to temporarily store data that has been output or will be output. In one embodiment, the memory 20 stores a backlight following program 40, which can be executed by the processor 10 to implement the backlight following method of this application.
[0069] In some embodiments, the processor 10 may be a central processing unit (CPU), a microprocessor, or other data processing chip, used to run program code stored in the memory 20 or process data, such as executing the backlight following method.
[0070] Example 3
[0071] This embodiment provides a storage medium, characterized in that the computer-readable storage medium stores a backlight following program, which, when executed by a processor, implements the steps of the backlight following method as described above.
[0072] In summary, to address the issue that existing display backlight following methods place high demands on the main control chip, this application pre-parses the brightness information stream of each backlight zone corresponding to the stored video stream. During playback, the brightness of the backlight zones is directly controlled based on the parsed brightness information stream, avoiding the need for real-time parsing of the video stream, which necessitates the use of an expensive main control chip.
[0073] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or display that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or display. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or display that includes that element.
[0074] Of course, those skilled in the art will understand that all or part of the processes in the above embodiments can be implemented by a computer program instructing related hardware (such as a processor, controller, etc.). The program can be stored in a computer-readable storage medium, and when executed, it can include the processes described in the above method embodiments. The storage medium can be a memory, magnetic disk, optical disk, etc.
[0075] It should be understood that the application of the present invention is not limited to the examples above. Those skilled in the art can make improvements or modifications based on the above description, and all such improvements and modifications should fall within the protection scope of the appended claims.
Claims
1. A backlight following method, characterized in that, The backlight following method includes: Obtain the stored video stream to be played and the corresponding brightness information stream of each backlight zone; The screen is controlled to play according to the video stream, and the backlight zones are controlled to illuminate according to the brightness information stream of each backlight zone corresponding to the video stream. The brightness information stream of each backlight zone is obtained by pre-analyzing the stored video stream to be played. Specifically, this includes: The system retrieves the stored video stream to be played, performs frame-by-frame analysis on the video stream, and obtains the average brightness information of each backlight zone in each frame of the video stream. The brightness information stream of each backlight zone is formed based on the average brightness information of each backlight zone in each frame. The step of performing frame-by-frame analysis of the video stream to obtain the average brightness information of each backlight zone in each frame of the video stream specifically includes: The average brightness information of each backlight partition in each frame is obtained by calculating the average brightness information of the pixels included in each backlight partition in each frame of the video stream. The calculation of the average brightness information of the pixels included in each backlight zone specifically includes: Every set number of pixels, one pixel is taken as the sampled pixel. Calculate the average value of the brightness information of the sampled pixels included in each backlight zone; A synchronization signal is used to synchronize the output of each frame of the video stream with the corresponding brightness information stream; the brightness information stream is synchronously transmitted to each backlight zone for backlight control via hardware SPI or other communication interfaces.
2. The backlight following method according to claim 1, characterized in that, The video streams are multiple, and the backlight following method further includes: Get the number of videos to be played, and divide the video area into a corresponding number of video regions based on the number of videos; The step of controlling screen playback based on video stream, and controlling backlighting of each backlight zone based on brightness information stream corresponding to the video stream, specifically includes: Each video region is set to correspond to a video stream, and the screen of the video region is controlled to play according to the video stream corresponding to the video region; Based on the brightness information stream of the backlight zone corresponding to the video area, control the backlight zone of the video area to perform backlighting.
3. The backlight following method according to claim 2, characterized in that, The process of dividing the video into a corresponding number of video regions based on the number of videos specifically includes: The video region is divided according to the backlight partition to ensure that each video region contains only the complete backlight partition.
4. The backlight following method according to claim 2, characterized in that, The backlighting of the backlight partition of the control video area includes: if the same backlight partition belongs to two video areas at the same time, the priority of the two video areas in the backlight partition is determined, and the brightness information stream of the video area with higher priority in the backlight partition is used to control the backlight partition.
5. The backlight following method according to claim 4, characterized in that, The high-priority video area is specifically the video area with high brightness required in the backlight zone.
6. A display, characterized in that, The display includes: a screen, a memory, a processor, and a backlight following program stored in the memory and executable on the processor. The backlight of the screen has multiple backlight zones, and the backlight following program, when executed by the processor, implements the steps of the backlight following method as described in any one of claims 1-5.
7. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a backlight following program, which, when executed by a processor, implements the steps of the backlight following method as described in any one of claims 1-5.
Citation Information
Patent Citations
Backlight display control chip and display device
CN112530377A
Backlight control system
CN113053329A