System on chip, display terminal and readable storage medium

Abstract

The present disclosure provides a system on chip, a display terminal and a readable storage medium. The system on chip is applied to the display terminal. The display terminal further comprises a display panel and a backlight module. The system on chip comprises a first data interface, a second data interface, a memory, a central processing unit and a computer program stored in the memory and capable of running on the central processing unit. The central processing unit is connected with the first data interface and the second data interface respectively. When the computer program is executed by the central processing unit, the following steps are implemented: obtaining to-be-displayed data; obtaining backlight matrix data according to the to-be-displayed data; outputting the to-be-displayed data to the display panel through the first data interface and outputting the backlight matrix data to the backlight module through the second data interface.

Description

Technical Field

[0001] This disclosure relates to the field of display technology, and in particular to a system-on-a-chip, a display terminal, and a readable storage medium. Background Technology

[0002] Liquid Crystal Display (LCD) panels boast advantages such as ultra-long lifespan, low power consumption, low operating voltage, high color rendering index, fast response speed, environmental friendliness, small size, and low radiation, and are widely used in electronic devices such as laptops, mobile phones, and LCD TVs. LCD panels rely on backlights for illumination, and their display quality is affected by backlight adjustment. Local dimming technology, with its advantages of reducing power consumption, improving contrast and grayscale levels, and reducing image retention, is applied to the backlight adjustment of LCD panels. Summary of the Invention

[0003] The system-on-a-chip, display terminal, and readable storage medium provided in this disclosure offer a more versatile local dimming solution to address the problem of traditional local dimming solutions being unable to be deeply customized, thus facilitating adaptation to the actual dimming needs of the screen.

[0004] In a first aspect, embodiments of this disclosure provide a system-on-a-chip (SoC) applied to a display terminal, the display terminal further including a display panel and a backlight module; the SoC includes a first data interface, a second data interface, a memory, a central processing unit (CPU), and a computer program stored in the memory and executable on the CPU, the CPU being connected to the first data interface and the second data interface respectively, and the computer program, when executed by the CPU, performs the following steps:

[0005] Get the data to be displayed;

[0006] Based on the data to be displayed, the backlight matrix data is obtained;

[0007] The data to be displayed is output to the display panel through the first data interface, and the backlight matrix data is output to the backlight module through the second data interface.

[0008] Optionally, the above-mentioned system-on-a-chip further includes: a local dimming module, wherein the computer program, when executed by the central processing unit, further implements the following steps:

[0009] Block the flow of the data to be displayed to the local dimming module;

[0010] Based on the data to be displayed, the backlight matrix data is obtained, including:

[0011] The data to be displayed is input into a preset local dimming model to obtain backlight matrix data.

[0012] Optionally, the above-mentioned system-on-a-chip further includes a video decoder, which is connected to the central processing unit, and the acquisition of data to be displayed includes:

[0013] The data to be displayed can be obtained by calling the screenshot interface; or, during the initialization phase, the video callback function can be registered in the video decoder so that the video decoder can call back each frame of video data through the video callback function; and each frame of video data called back can be used as the data to be displayed in sequence.

[0014] Optionally, the above-mentioned system-on-a-chip further includes: a local dimming module, which is connected to the central processing unit and obtains backlight matrix data based on the data to be displayed, including:

[0015] The data to be displayed is input into the local dimming module so that the local dimming module performs local dimming processing on the data to be displayed to obtain the initial backlight matrix data;

[0016] Obtain the initial backlight matrix data output by the local dimming module;

[0017] The initial backlight matrix data is input into a preset backlight adjustment model to obtain the adjusted backlight matrix data.

[0018] Optionally, obtaining the initial backlight matrix data output by the local dimming module includes:

[0019] During the initialization phase, the data callback function is registered to the local dimming module;

[0020] The initial backlight matrix data output by the local dimming module is called back through the data callback function.

[0021] Optionally, the above-mentioned system-on-a-chip further includes: multiple general-purpose computing components, wherein the multiple general-purpose computing components include the central processing unit, and obtain backlight matrix data according to the data to be displayed, including:

[0022] Using a pre-configured inference framework, the computing resources of at least one of the general-purpose computing components in the system-on-a-chip are invoked to calculate the backlight matrix data of the data to be displayed; or,

[0023] By calling a pre-configured general computing power interface, a target computing power component is selected from the multiple general computing power components, and the computing power resources of the target computing power component are used to calculate the backlight matrix data of the data to be displayed.

[0024] Optionally, the implementation steps of the above-mentioned general computing power interface include:

[0025] Obtain the current usage status of each computing component in the system-on-a-chip;

[0026] Based on the usage of each of the general computing power components, determine the remaining computing power of each of the general computing power components;

[0027] The target computing power component is determined by comparing the remaining computing power of each of the general computing power components.

[0028] The target computing component calculates and returns the backlight matrix data of the data to be displayed.

[0029] Optionally, the aforementioned memory includes a first buffer and a second buffer. Before outputting the data to be displayed to the display panel through the first data interface and the backlight matrix data to the backlight module through the second data interface, the computer program, when executed by the central processing unit, further implements the following steps:

[0030] The data to be displayed is stored in the first buffer;

[0031] The backlight matrix data is stored in the second buffer;

[0032] After the first buffer and the second buffer respectively store the matching data to be displayed and the backlight matrix data, the data to be displayed is extracted from the first buffer and transmitted to the first data interface, and the backlight matrix data matching the data to be displayed is extracted from the second buffer and transmitted to the second data interface.

[0033] Optionally, the backlight matrix data carries a timestamp of the corresponding data to be displayed, so as to find the data to be displayed that matches the backlight matrix data from the first buffer using the timestamp.

[0034] Secondly, this disclosure provides a display terminal, including: a display panel, a display control module, a backlight module, and a system-on-a-chip (SoC) provided in the first aspect above. The first data interface of the SoC is connected to the display control module, the display control module is connected to the display panel, and the second data interface of the SoC is connected to the backlight module.

[0035] Thirdly, embodiments of this disclosure provide a computer-readable storage medium having the computer program described in the system-on-a-chip provided in the first aspect stored thereon.

[0036] The system-on-a-chip, display terminal, and readable storage medium provided in this disclosure abandon the traditional method of relying solely on a dedicated local dimming module built into the system-on-a-chip for local dimming. Instead, backlight adjustment is based on a soft-core algorithm executed on the central processing unit. The soft-core algorithm is portable and can be customized, replaced, and optimized according to the needs of the screen, making it more versatile and able to meet the needs of different display screens without increasing hardware costs.

[0037] The above description is merely an overview of the technical solutions provided by the embodiments of this disclosure. In order to better understand the technical means of the embodiments of this disclosure and to implement them in accordance with the contents of the specification, and to make the above and other objects, features and advantages of the embodiments of this disclosure more apparent and understandable, specific implementation methods of the embodiments of this disclosure are described below. Attached Figure Description

[0038] To more clearly illustrate the technical solutions in this disclosure, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of this disclosure. For those skilled in the art, other drawings can be obtained based on these drawings without any creative effort.

[0039] Figure 1 A schematic diagram of the first local dimming scheme is shown;

[0040] Figure 2 A schematic diagram of the second local dimming scheme is shown;

[0041] Figure 3 A schematic diagram of the third local dimming scheme is shown;

[0042] Figure 4 The present disclosure shows a structural diagram of a system-on-a-chip according to some embodiments;

[0043] Figure 5 The diagram illustrates the computational power allocation in some embodiments of this disclosure;

[0044] Figure 6 A flowchart illustrating the workflow of a general computing interface in some embodiments of this disclosure is shown;

[0045] Figure 7 This invention discloses a schematic diagram illustrating the synchronization principle between the data to be displayed and the backlight matrix data in some embodiments of the present disclosure.

[0046] Figure 8 A schematic diagram of the structure of a display terminal according to some embodiments of the present disclosure is shown. Detailed Implementation

[0047] Exemplary embodiments of the present disclosure will now be described in more detail with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be implemented in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.

[0048] Figure 1 A schematic diagram of the first local dimming scheme is shown; Figure 2 A schematic diagram of the second local dimming scheme is shown; Figure 3 A schematic diagram of the third local dimming scheme is shown. See also Figures 1 to 3 As shown, there are three main local dimming solutions:

[0049] like Figure 1 As shown, in the first method, the calculation and output of the LocalDimming backlight matrix data are performed by a dedicated local dimming module 101 within the Scaler chip 100. However, the local dimming module 101 is built into the Scaler chip 100 and is customized by the Scaler chip manufacturer, making it impossible to replace it with a custom LocalDimming algorithm. Furthermore, the processing power of the local dimming module 101 in the Scaler chip 100 is limited and cannot meet the increasingly diverse dimming requirements.

[0050] like Figure 2 As shown, the second method involves adding a dedicated image quality chip 210 to the back end of the Scaler chip 200 to complete the calculation and output of the LocalDimming backlight matrix data. The image quality chip 210 can only run the LocalDimming program provided by the image quality chip manufacturer and does not support custom algorithms, thus failing to meet the personalized needs of the screen.

[0051] like Figure 3 As shown, the third method involves adding an FPGA (Field Programmable Gate Array) 310 to the back end of the Scaler chip 300 to perform the calculation and output of the Local Dimming backlight matrix data. The FPGA 310 is expensive, significantly increasing the cost of the backlight adjustment scheme. Furthermore, adding the FPGA 310 requires additional fan cooling, resulting in poor noise reduction.

[0052] From a cost perspective, most manufacturers adopt the first and second solutions mentioned above. However, the first and second solutions are not highly customized. The LocalDimming module is a black box for display manufacturers. If the LocalDimming function has problems such as trailing or halo that need to be optimized, it will be very difficult to ask the chip manufacturer to customize it.

[0053] Therefore, the embodiments of this disclosure provide a more versatile local dimming solution that does not require additional hardware costs, making it easier to adapt to the actual dimming needs of the screen.

[0054] The following description, in conjunction with the accompanying drawings, provides a more detailed account of some embodiments of the system-on-a-chip, display terminal, and readable storage medium provided in this disclosure.

[0055] This disclosure provides some embodiments of a system-on-a-chip (SOC) for use in a display terminal. The display terminal also includes a display panel and a backlight module. Figure 4 A structural diagram of a system-on-a-chip (SoC) according to some embodiments of this disclosure is shown. For example... Figure 4 As shown, the system-on-a-chip 400 includes: a first data interface 431, a second data interface 432, a memory 420, a central processing unit (CPU) 410, and a computer program 421 stored in the memory 420 and executable on the CPU 410. The CPU 410 is connected to both the first data interface 431 and the second data interface 432. When the computer program 421 is executed by the processor, it implements the steps of the following backlight adjustment method.

[0056] The backlight adjustment method may include at least: acquiring data to be displayed; obtaining backlight matrix data based on the data to be displayed; outputting the data to be displayed to the display panel through a first data interface 431, and outputting the backlight matrix data to the backlight module through a second data interface 432, so as to realize the display of the data to be displayed. For example, the first data interface 431 may be an eDP / VBO interface, and the second data interface 432 may be an SPI interface.

[0057] In the system-on-chip 400 of this disclosure embodiment, the local dimming scheme that relies solely on dedicated local dimming hardware is abandoned. Instead, a soft-core algorithm executed on the central processing unit 410 is used for backlight adjustment. Here, the soft-core algorithm refers to an algorithm executed by standard general-purpose hardware such as the CPU and GPU (Graphics Processing Unit) in the system-on-chip 400, without relying on dedicated local dimming hardware. The soft-core algorithm is portable and can be customized, replaced, and optimized according to the needs of the screen, offering greater versatility and meeting the requirements of different display screens without increasing hardware costs.

[0058] like Figure 4 As shown, in some embodiments of this disclosure, the system-on-a-chip 400 further includes a local dimming module 450, which is connected to the central processing unit 410. The local dimming module 450 is originally built into the system-on-a-chip 400, such as a Scaler chip, to calculate and output backlight matrix data. It is dedicated local dimming hardware and is a black box for display manufacturers. It should be noted that, unlike the CPU and GPU (Graphics Processing Unit) processors with general processing capabilities, the local dimming module 450 is a dedicated processor used to perform the calculation and output of backlight matrix data. The interface within the local dimming module 450 is proprietary and not provided to general-purpose computing hardware. Therefore, display manufacturers cannot access it. Thus, simply using the existing local dimming module 450 within the system-on-a-chip 400 does not allow for customization of its internal processing algorithms according to the actual needs of the screen.

[0059] In some embodiments of this disclosure, the system-on-a-chip 400 further includes a video decoder 440, which is connected to the central processing unit 410. For example, an image is input via an external High Definition Multimedia Interface (HDMI), and then decoded by the video decoder 440 into RGB / YUV format video data, i.e., the data to be displayed. Considering that the data to be displayed originally flows to the local dimming module 450, in order to break the established method of relying on the dedicated local dimming module 450 for local dimming, in some embodiments of this disclosure, the backlight adjustment method may further include: blocking the flow of the data to be displayed to the local dimming module 450. At this time, the process of obtaining backlight matrix data based on the data to be displayed may include: inputting the data to be displayed into a preset local dimming model to obtain backlight matrix data. The local dimming model belongs to the aforementioned soft-core algorithm, does not rely on dedicated Local Dimming hardware, and can be configured according to the actual dimming requirements of the screen. At this time, the local dimming module 450 no longer receives the data to be displayed, and therefore no longer outputs backlight matrix data.

[0060] There are several ways to block the flow of data to be displayed to the local dimming module 450. Two of these methods are described below.

[0061] The first method is screenshotting. This is achieved by calling a screenshot interface in a dedicated software thread. In this case, the process of obtaining the data to be displayed includes: obtaining the data to be displayed by calling the screenshot interface, inputting the obtained data into a pre-configured local dimming model, and then processing it through an algorithm to obtain the backlight matrix data.

[0062] The second method is the video callback method. In this case, the process of obtaining the data to be displayed can include: during the initialization phase, registering the video callback function with the video decoder 440 so that the video decoder 440 can use the video callback function to call back each frame of video data, thereby inputting each frame of video data as the data to be displayed into the pre-configured local dimming model, and obtaining the backlight matrix data after algorithm processing.

[0063] In this embodiment, the above-mentioned local dimming model has multiple implementations and can be customized according to the actual dimming requirements of the screen. This embodiment does not limit this.

[0064] It is understood that the backlight module includes multiple backlight sources arranged in an array, which together form the backlight area of ​​the display screen. The entire backlight area can be divided into multiple backlight zones, each corresponding to an image zone of the data to be displayed. The backlight circuit of each backlight zone is driven to emit light according to the backlight value of that backlight zone, providing backlight for the display of the corresponding image zone.

[0065] The backlight matrix data includes multiple backlight values, each of which determines the backlight brightness of a backlight zone. For example, these multiple backlight values ​​can be calculated based on the grayscale of each pixel in the data to be displayed.

[0066] In some examples, the data to be displayed can be first divided into image partitions, and then the backlight value of the corresponding backlight partition can be obtained based on each image partition. For example, taking an image of 3840×2160 resolution as the data to be displayed, with a backlight area comprising 192×108 backlight partitions, where each image area includes 40*40 pixels, it can be divided into 192×108 image partitions. There are various methods to obtain the backlight value of each image partition, such as using the maximum value method, the average value method, the Cumulative Distribution Function (CDF) method, or the dynamic threshold method.

[0067] For example, the maximum value method uses the highest grayscale value among multiple pixels in each image partition to calculate the backlight value of the backlight partition. This can improve the display brightness of the backlight partition, but it is prone to sudden backlight changes, causing backlight flickering. The average value method, on the other hand, uses the average grayscale value of multiple pixels in each image partition to calculate the backlight value of the backlight partition. Compared to the maximum value method, the average value method can save power, but it can result in insufficient display brightness and is prone to losing very small pixels.

[0068] For example, the backlight value of a corresponding backlight zone can be calculated by weighting the maximum and average grayscale values ​​of the image zones. This combines the advantages of the maximum value method and the average value method, and improves the backlight abruptness problem caused by the maximum value method and the insufficient display brightness problem caused by the average value method, thereby making the calculated backlight value more optimized. It should be noted that the sum of the weighting coefficient of the maximum grayscale value and the weighting coefficient of the average grayscale value is 1. This embodiment of the disclosure does not limit the weighting coefficient of the maximum grayscale value and the weighting coefficient of the average grayscale value. For example, the weighting coefficients of the maximum grayscale value and the average grayscale value can both be 0.5, or they can be any other arbitrary value.

[0069] In some examples, after obtaining the backlight values ​​(i.e., the backlight matrix) for each backlight zone through the above data processing, spatial filtering can be further applied to the backlight matrix to optimize the backlight matrix data. This is beneficial for smooth screen display and improves interlayer issues. For example, maximum value filtering can be used; or mean filtering or median filtering can be used, etc. The selection and setting can be made according to actual needs, and this embodiment does not limit this.

[0070] In some embodiments of this disclosure, the backlight matrix data can also be obtained in conjunction with the local dimming module 450 and the soft-core algorithm. In this case, the process of obtaining the backlight matrix data based on the data to be displayed may include: inputting the data to be displayed into the local dimming module 450 so that the local dimming module 450 performs local dimming processing on the data to be displayed to obtain initial backlight matrix data; acquiring the initial backlight matrix data output by the local dimming module 450; inputting the initial backlight matrix data into a preset backlight adjustment model to obtain adjusted backlight matrix data, and then transmitting it to the second data interface 432 for output.

[0071] In other words, each frame of data to be displayed output by the video decoder 440 still flows to the local dimming module 450 built into the system-on-a-chip 400. The local dimming module 450 simply performs basic processing and outputs initial backlight matrix data, for example, a 48*48 backlight matrix. Then, the initial backlight matrix data output by the local dimming module 450 is input into the backlight adjustment model for further optimization and adjustment, instead of being directly output through the second data interface 432. This allows the final output backlight matrix data to better adapt to the screen's requirements, thereby achieving a better display effect.

[0072] In some examples, the process of obtaining the initial backlight matrix data output by the local dimming module 450 may include: registering a data callback function to the local dimming module 450 during the initialization phase; and then, calling back the initial backlight matrix data output by the local dimming module 450 through the data callback function. For ease of distinction, the initial backlight matrix data output by the local dimming module 450 will be referred to as backlight matrix A, and the backlight matrix data optimized and adjusted by the backlight adjustment model will be referred to as backlight matrix B. After registering the data callback function to the local dimming module 450, the backlight matrix A for each frame can be called back through this data callback function. The called-backlight matrix A is then sent to the pre-configured backlight adjustment model, and after algorithm processing, backlight matrix B (optimized and adjusted backlight matrix data) can be obtained.

[0073] The backlight adjustment model here also belongs to the aforementioned soft-core algorithm, which does not rely on dedicated LocalDimmig hardware and can be configured according to the actual dimming requirements of the screen. The backlight adjustment model and the local dimming model have different algorithmic functions, and therefore different implementation methods. The input of the local dimming model is the data to be displayed, and the output is backlight matrix data. The input of the backlight adjustment model here is the initial backlight matrix data (i.e., the backlight matrix data output by the local dimming module 450), and the output is the optimized and adjusted backlight matrix data.

[0074] In this embodiment, the backlight adjustment model has multiple implementations. Two examples are mainly listed below for illustration. In practice, it can be customized according to the actual dimming requirements of the screen. This embodiment does not limit it in this regard.

[0075] The first example involves obtaining a backlight difference matrix based on the backlight matrix data corresponding to the data to be displayed in two adjacent frames. This backlight difference matrix can be used to detect difference values ​​and the location of backlight changes; predict backlight change trends and speeds; and smooth the backlight change locations to reduce flicker and optimize backlight performance. For instance, by determining whether the difference values ​​at a backlight change location with a positive difference value and its adjacent locations are zero, the backlight change trend at that location can be easily and effectively determined, allowing for targeted backlight optimization to address issues such as flickering and motion blur in moving objects. For example, based on the backlight change trend, the backlight values ​​at adjacent locations can be adjusted to smooth the backlight, thereby improving flickering during object movement.

[0076] In the second example, the initial backlight value of the target backlight zone can be corrected based on a preset backlight threshold and the initial backlight values ​​of the backlight zones adjacent to the target backlight zone (i.e., the backlight values ​​in the initial backlight matrix data output by the local dimming module 450), resulting in the target backlight zone's backlight value. Here, the target backlight zone refers to each individual backlight zone. By setting a preset backlight threshold and then correcting the initial backlight value of the target backlight zone based on this threshold and the initial backlight values ​​of the adjacent backlight zones, isolated backlight zones prone to halo effects can be significantly suppressed. Non-isolated backlight zones are left unprocessed, retaining their initial backlight values. This effectively reduces halo effects associated with local dimming and compensates for local detail loss caused by overflow without affecting overall display brightness and contrast. For specific implementation details, please refer to relevant technologies; they will not be elaborated here. Furthermore, in some examples, flicker suppression processing can be applied to the obtained backlight values ​​to further optimize the backlight matrix data. For specific implementation details, please refer to relevant technologies; they will not be elaborated here.

[0077] In some embodiments of this disclosure, the backlight adjustment method may further include: performing pixel compensation on the data to be displayed based on the backlight matrix data corresponding to the data to be displayed and a preset pixel compensation model, thereby outputting the pixel-compensated data to be displayed. It should be noted that the pixel compensation model here is also a soft-core algorithm, which does not rely on dedicated hardware and can be customized and configured according to the actual compensation requirements of the screen.

[0078] There are various implementations of the pixel compensation model, and this embodiment does not limit this one. For example, backlight diffusion can be performed based on the backlight value of each backlight zone and a preset optical diffusion to obtain the backlight brightness of each pixel. Then, the pixel compensation coefficient of each pixel can be obtained by looking up a table based on the backlight brightness of each pixel. Pixel compensation is then performed on each pixel in the data to be displayed according to the pixel compensation coefficient, thereby outputting the compensated data to be displayed. In other examples, gamma calibration and white balance processing can be further performed on the compensated data to be displayed. Specific implementation processes can be found in related technologies and will not be detailed here.

[0079] Of course, in other embodiments, each frame of video image decoded by the video decoder 440 can be directly output as data to be displayed, depending on the needs of the actual application scenario. This embodiment does not limit this.

[0080] It should be noted that the soft-core algorithms used in any of the above embodiments (such as the local dimming model, backlight adjustment model, and pixel compensation model) are implemented using the computing power of general-purpose hardware within the system-on-chip 400, thus eliminating the limitations of dedicated LocalDimming hardware (i.e., the local dimming module 450). This allows the soft-core algorithms to be easily ported to different SoC platforms, resulting in good algorithm versatility. Taking the local dimming model as an example, the standard library libAlgorithm.a can be generated first, for example, using standard gcc; then, libAlgorithm.a can be compiled into the SoC software, for example, using standard gcc. When in use, the backlight matrix data can be output by calling libAlgorithm.a.

[0081] In order to utilize general computing resources and ensure that the soft-core algorithm has cross-platform attributes, this disclosure mainly describes two exemplary methods of using computing power. In practice, the computing power usage method can be selected and configured according to the needs of the application scenario, and this embodiment does not impose any restrictions on it.

[0082] In some embodiments of this disclosure, the system-on-chip 400 further includes multiple general-purpose computing components. These general-purpose computing components are general-purpose standard hardware within the system-on-chip 400, and may include, for example, a central processing unit 410, a graphics processing unit, a neural network processing unit (NPU), and a data processing unit (DPU). Figure 4 As shown, among the multiple general-purpose computing components, the other general-purpose computing components 460 besides the central processing unit 410 are connected to the central processing unit 410. Figure 5A schematic diagram of computing power allocation in some embodiments of this disclosure is shown.

[0083] The first example uses a terminal inference framework. Taking the calculation of backlight matrix data as an example, a pre-configured inference framework can be used to call upon the computing resources of at least one general-purpose computing component in the system-on-a-chip 400 to calculate the backlight matrix data of the data to be displayed. For example, as... Figure 5 As shown, the computational power of one or more general computing components such as GPU, NPU, and DPU can be invoked through the operator interface of the inference framework to perform soft-core algorithm calculations and output the calculation results. For example, for the local dimming model mentioned above, the input of the corresponding inference framework is: the data to be displayed, and the output is: backlight matrix data; for the backlight adjustment model mentioned above, the input of the corresponding inference framework is: the initial backlight matrix data; and the output is: the optimized and adjusted backlight matrix data.

[0084] The second example uses a general-purpose computing interface. Taking the calculation of backlight matrix data as an example again, such as... Figure 5 As shown, by calling a pre-configured general computing power interface, a target computing power component can be selected from the multiple computing power components mentioned above, and the computing power resources of the target computing power component can be used to calculate the backlight matrix data of the data to be displayed. This helps to make more rational use of the computing power resources in the system-on-a-chip 400 and improve computing efficiency. For example, for the local dimming model mentioned above, the input data of the general computing power interface may include: the data to be displayed, and the return result is: backlight matrix data; for the backlight adjustment model mentioned above, the input data of the general computing power interface may include: initial backlight matrix data; and the return result is: optimized and adjusted backlight matrix data.

[0085] For example, Figure 6 A flowchart illustrating the workflow of a general computing interface in some embodiments of this disclosure is shown. For example... Figure 6 As shown, the working steps of the general computing power interface may include:

[0086] Step S601: Obtain the usage status of each general computing component in the current system-on-a-chip;

[0087] Step S602: Determine the remaining computing power of each general computing power component based on the usage status of each general computing power component;

[0088] Step S603: Determine the target computing power component by comparing the remaining computing power of each general computing power component;

[0089] Step S604: Calculate and return the backlight matrix data of the data to be displayed using the target computing power component.

[0090] For example, taking the general computing power interface corresponding to the local dimming model mentioned above as an example, when using it, the data to be displayed can first be sent to the general computing power interface. Then, the general computing power interface obtains the general computing power components in the current system-on-a-chip 400 that can be used to provide computing power resources for the local dimming model, obtains the usage status of each available general computing power component, and then obtains and compares the remaining computing power of each available general computing power component.

[0091] In some embodiments of this disclosure, the general-purpose computing component with the most remaining computing power can be identified as the target computing component. For example, if the GPU has the most remaining computing power, it can be used as the target computing component, running a local dimming model on the GPU to calculate and return the backlight matrix data of the data to be displayed. Similarly, if the CPU has the most remaining computing power, it can be used as the target computing component, running a local dimming model on the CPU to output the backlight matrix data of the data to be displayed. Of course, if other available general-purpose computing components, such as the NPU or DPU, have the most remaining computing power, they can also be used as the target computing component, running a local dimming model to calculate and return the backlight matrix data of the data to be displayed. In other embodiments, other methods can also be used to determine the target computing component, and this embodiment does not limit this approach.

[0092] Furthermore, research has revealed that if the data to be displayed output by the first data interface 431 does not match the backlight matrix data output by the second data interface 432, it may cause phenomena such as haloing and trailing in the display, affecting the display effect. For example, if the video image decoded by the video decoder 440 is directly used as the data to be displayed, the output of the data to be displayed will be faster than the output of the backlight matrix data because the backlight matrix data needs to be processed by an algorithm.

[0093] Therefore, in some embodiments of this disclosure, before outputting the data to be displayed to the display panel through the first data interface 431 and the backlight matrix data to the backlight module through the second data interface 432, the above-mentioned backlight adjustment method further includes: performing synchronization processing on the data to be displayed and its corresponding backlight matrix data, so as to synchronize the output of the data to be displayed and the backlight matrix data, improve the halo, trailing and other phenomena caused by the asynchrony between the two, and improve the display effect.

[0094] In one optional implementation, the memory 420 may include a first buffer 422 and a second buffer 423. It is understood that a buffer is part of the memory space. That is, a certain amount of storage space is reserved in the memory space to buffer input or output data; this reserved space is called a buffer. The storage space reserved for the buffer is fixed; when data overflows, the excess data will overwrite the previous data. The process of synchronizing the data to be displayed with its corresponding backlight matrix data may include: storing the data to be displayed in the first buffer 422; storing the backlight matrix data in the second buffer 423; after the first buffer 422 and the second buffer 423 respectively store the matching data to be displayed and the backlight matrix data, retrieving the data to be displayed from the first buffer 422 and transmitting it to the first data interface 431, and retrieving the backlight matrix data matching the data to be displayed from the second buffer 423 and transmitting it to the second data interface 432.

[0095] In other words, buffers are provided for the data to be displayed and the backlight matrix data respectively. For example, the first buffer 422 can buffer several frames of data to be displayed, and the second buffer 423 can buffer the backlight matrix data corresponding to several frames of data to be displayed. It should be noted that the storage space of the first buffer 422 and the second buffer 423 can be determined according to the arrival time difference between the data to be displayed and the backlight matrix data and the needs of the actual application scenario. The size of their storage spaces can be the same or different; this embodiment does not impose any restrictions on this. For example, when the data to be displayed arrives before the backlight matrix data, the data to be displayed will not be displayed immediately, but will wait for its corresponding backlight matrix data to arrive before being displayed.

[0096] Taking the scenario where the data to be displayed arrives before its corresponding backlight matrix data as an example, a backlight-sync mechanism can be used to achieve synchronized output of the data to be displayed and the backlight matrix data. For instance, the acquired data to be displayed can be stored frame by frame in the first buffer 422, and the acquired backlight matrix data can also be stored sequentially in the second buffer 423. When storing the current backlight matrix data in the second buffer 423, a synchronization signal is sent to the data to be displayed that matches the current backlight matrix data stored in the first buffer 422. In response to the synchronization signal, the data to be displayed is then displayed. In other words, only the data to be displayed that receives the synchronization signal for the corresponding backlight matrix data can be displayed, ensuring synchronization between the data to be displayed and the backlight matrix data.

[0097] For example, the backlight matrix data may carry a timestamp of the corresponding data to be displayed, so that the data to be displayed that matches the backlight matrix data can be found from the first buffer 422 through the timestamp, thereby sending a synchronization signal.

[0098] For example, Figure 7 The diagram illustrates the synchronization principle between the data to be displayed and the backlight matrix data in some embodiments of this disclosure. Figure 7 Taking the data to be displayed as an example, which is input to the backlight matrix data buffer before its corresponding data, as follows: Figure 7 As shown, assuming the data to be displayed in the third frame is the current data to be displayed, when the backlight matrix data of the third frame is stored in the second buffer 423, the data to be displayed in the third frame can be found in the first buffer 422 according to the timestamp it carries. A synchronization signal is then sent for the data to be displayed in the third frame, and the data to be displayed in the third frame is output through the first data interface 431 and the backlight matrix data of the third frame is output through the second data interface 432, thus realizing the display of the data to be displayed in the third frame. Similarly, the synchronization of the data to be displayed in subsequent frames with the corresponding backlight matrix data can be completed, which helps to improve problems such as halo and trailing.

[0099] Figure 8 A schematic diagram of the structure of a display terminal according to some embodiments of this disclosure is shown. For example... Figure 8 As shown, some embodiments of this disclosure provide a display terminal 80, which may include: a display panel 500, a display control module 510, a backlight module 600, and a system-on-a-chip 400, such as a Scaler chip, provided in any of the embodiments described above. The system-on-a-chip 400 has a first data interface 431 connected to the display control module 510, the display control module 510 connected to the display panel 500, and a second data interface 432 connected to the backlight module 600.

[0100] The data to be displayed output from the first data interface 431 is input to the display control module 510, which then controls the display panel 500 to display the data. For example, the display control module 510 may include a timing controller (TCON).

[0101] In some embodiments of this disclosure, the backlight module 600 may include: a backlight control module 610, multiple backlight driving modules 620, and multiple backlight sources 630. It should be noted that... Figure 8Only one backlight driving module 620 and one backlight source 630 are shown in this embodiment. The actual number is determined according to the backlight requirements of the application scenario and is not limited here. The backlight control module 610 is connected to the backlight driving module 620, and the backlight driving module 620 is connected to the backlight source 630 it drives. For example, the backlight control module 610 may include a microcontroller unit (MCU) or a chip with data processing capabilities such as an FPGA. For example, the backlight source 630 may be an LED, Mini-LED, or Micro-LED, and correspondingly, the backlight driving module 620 may be an LED driver circuit (LED-Driver IC). Of course, other suitable backlight sources 630 may be used in other examples, and this embodiment does not limit this.

[0102] For example, the backlight matrix data output from the second data interface 432 is input to the microcontroller unit. The microcontroller unit stores the mapping relationship between backlight values ​​and backlight drive signals. Based on this mapping relationship, the backlight drive signal corresponding to each backlight value in the backlight matrix data can be determined. Based on the backlight drive signal corresponding to each backlight value, each backlight drive module 620 is controlled to drive the backlight source 630 of the corresponding backlight zone to emit light, so as to cooperate with the display panel 500 to display the data to be displayed.

[0103] In the display terminal 80 of this embodiment, the system-on-a-chip 400 performs backlight adjustment based on a soft-core algorithm executed on the central processing unit 410. The soft-core algorithm does not rely on dedicated local dimming hardware, is portable, and can be customized, replaced, and optimized according to the needs of the screen. Thus, without increasing hardware costs, it can achieve a local dimming effect that is more adapted to the screen requirements, which is beneficial to improving the display effect of the display terminal 80.

[0104] Furthermore, the system-on-a-chip 400 in the display terminal 80 also performs synchronous processing on the output of the data to be displayed and the backlight matrix data, which helps to improve problems such as halo and trailing, and further enhances the display effect of the display terminal 80.

[0105] In addition, some embodiments of this disclosure provide a computer-readable storage medium storing the aforementioned computer program 421 in the system-on-a-chip 400 provided in any of the embodiments above. When the computer program 421 is implanted into the system-on-a-chip 400 and runs on the system-on-a-chip 400, the system-on-a-chip 400 performs the various processes of the aforementioned backlight adjustment method and achieves the same technical effect. To avoid repetition, it will not be described again here. For example, the computer-readable storage medium may be a read-only memory 420 (ROM), a random access memory 420 (RAM), a magnetic disk, or an optical disk, etc.

[0106] Those skilled in the art will understand that embodiments of this disclosure can be provided as methods, systems, or computer program products. Therefore, this disclosure can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this disclosure can take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage and optical storage) containing computer-usable program code.

[0107] This disclosure is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus, and computer program products according to embodiments of this disclosure. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0108] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0109] These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable apparatus for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0110] In this document, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, without necessarily requiring or implying any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element. The term "a plurality of" means two or more, including two or more cases.

[0111] Although some exemplary embodiments of this disclosure have been described, those skilled in the art, upon learning the basic inventive concept, can make further changes and modifications to these embodiments. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments as well as all changes and modifications falling within the scope of this disclosure.

Claims

1. A system-on-a-chip, characterized in that, The system-on-a-chip (SoC) is applied to a display terminal, which further includes a display panel and a backlight module. The SoC includes a first data interface, a second data interface, a memory, a central processing unit (CPU), and a computer program stored in the memory and executable on the CPU. The CPU is connected to both the first data interface and the second data interface. The SoC also includes a local dimming module. When the computer program is executed by the CPU, it performs the following steps: Acquire the data to be displayed and store it in the first buffer of the memory; Obtaining backlight matrix data based on the data to be displayed includes: inputting the data to be displayed into a local dimming module so that the local dimming module performs local dimming processing on the data to be displayed to obtain initial backlight matrix data; calling back the initial backlight matrix data output by the local dimming module through a data callback function registered in the local dimming module during the initialization phase; inputting the initial backlight matrix data into a preset backlight adjustment model to obtain adjusted backlight matrix data, and storing the backlight matrix data in the second buffer of the memory; The method of outputting the data to be displayed to the display panel through the first data interface and the backlight matrix data to the backlight module through the second data interface includes: after the first buffer and the second buffer respectively store the matching data to be displayed and the backlight matrix data, extracting the data to be displayed from the first buffer and transmitting it to the first data interface for output to the display panel, and extracting the backlight matrix data matching the data to be displayed from the second buffer and transmitting it to the second data interface for output to the backlight module.

2. The system-on-a-chip according to claim 1, characterized in that, The system-on-a-chip further includes: multiple general-purpose computing components, including the central processing unit, which obtains backlight matrix data based on the data to be displayed, including: Using a pre-configured inference framework, the computing resources of at least one of the general-purpose computing components in the system-on-a-chip are invoked to calculate the backlight matrix data of the data to be displayed; or, By calling a pre-configured general computing power interface, a target computing power component is selected from the multiple general computing power components, and the computing power resources of the target computing power component are used to calculate the backlight matrix data of the data to be displayed.

3. The system-on-a-chip according to claim 2, characterized in that, The implementation steps of the general computing power interface include: Obtain the current usage status of each computing component in the system-on-a-chip; Based on the usage of each of the general computing power components, determine the remaining computing power of each of the general computing power components; The target computing power component is determined by comparing the remaining computing power of each of the general computing power components. The target computing component calculates and returns the backlight matrix data of the data to be displayed.

4. The system-on-a-chip according to claim 1, characterized in that, The backlight matrix data carries a timestamp of the corresponding data to be displayed, so as to find the data to be displayed that matches the backlight matrix data from the first buffer using the timestamp.

5. A display terminal, characterized in that, include: The system-on-a-chip (SoC) comprises a display panel, a display control module, a backlight module, and any one of claims 1-4, wherein the first data interface of the SoC is connected to the display control module, the display control module is connected to the display panel, and the second data interface of the SoC is connected to the backlight module.

6. A computer-readable storage medium, characterized in that, It stores the computer program in the system-on-a-chip according to any one of claims 1-4.

Images