Display processing circuit, method, device and chip

Abstract

The invention discloses a display processing circuit, method, equipment and chip, and belongs to the technical field of image processing. A display mode determination unit in the circuit is used for determining a display mode of a first image frame to be displayed, and the display mode comprises an OSD image display mode or an OSD image hiding mode; and the processing unit is used for controlling the operation of reading the first OSD image corresponding to the first image frame from the external storage module according to the display mode. And when the OSD image is not displayed, the operation of acquiring the OSD image is directly canceled, so that the bandwidth sum occupied by acquiring the OSD image is reduced, and the resource consumption is reduced.

Description

Technical Field

[0001] Embodiments of the present application relate to the field of image processing technology, and particularly to a display processing circuit, method, device and chip. Background Art

[0002] In the field of image processing technology, a display panel can display an image in an OSD (on screen display) image. Taking the OSD image as the software page of a playback software and the displayed image as an image frame in a video as an example, the software page includes a playback window and adjustment components for adjusting video playback, and the display panel can play the video in the playback window. However, in some cases, during the process of the display panel displaying an image, the user page may not be displayed either. Continuing with the example of the OSD image being the software page of the playback software, the display panel displays the video full screen and hides the OSD image. Therefore, there is an urgent need for a display processing circuit for adjusting the operating state according to the situation of the display panel displaying the OSD image. Summary of the Invention

[0003] Embodiments of the present application provide a display processing circuit, method, device and chip, which can be used to adjust the operating state according to the situation of the display screen displaying the user page. The technical solutions are as follows:

[0004] On the one hand, embodiments of the present application provide a display processing circuit, which includes a display mode determination unit and a processing unit;

[0005] The display mode determination unit is used to determine the display mode of a first image frame to be displayed, and the display mode includes a display OSD image mode or a hide OSD image mode;

[0006] The processing unit is used to control the operation of reading a first OSD image corresponding to the first image frame from an external storage module according to the display mode.

[0007] In a possible implementation manner, the display mode determination unit is used to obtain the display information of a second OSD image corresponding to a second image frame on the display panel, and determine the display mode of the first image frame according to the display information. The second image frame is displayed before the first image frame, and the display information represents the transparency of the display panel displaying the second OSD image.

[0008] In a possible implementation manner, the display mode determination unit is used to count the alpha (transparency value) of each pixel point in the second OSD image, and determine the display information according to the alpha of each pixel point.

[0009] In a possible implementation, the processing unit is configured to prohibit reading the first OSD image from the external storage module when the display mode is the hidden OSD image mode;

[0010] When the display mode is the display OSD image mode, read the first OSD image from the external storage module.

[0011] In a possible implementation, the processing unit includes a superimposing unit, a timing adjustment unit, and an image quality processing unit; when the display mode is adjusted to the hidden OSD image mode and the second OSD image reaches the blanking area:

[0012] The superimposing unit is configured to obtain display data to be displayed based on the first image frame, and the data for obtaining the display data does not include the first OSD image;

[0013] The timing adjustment unit is configured to extend the data reading interval, where the data reading interval is the interval for reading graphic data from the external storage module, and the graphic data is used by the image quality processing unit to process the first OSD image in the display OSD image mode;

[0014] The image quality processing unit is configured to send the graphic data to the superimposing unit, and the graphic data is read from the external storage module based on the extended data reading interval.

[0015] In a possible implementation, the processing unit includes a timing adjustment unit and an image quality processing unit; when the display mode is adjusted to the display OSD image mode and the second OSD image reaches the blanking area:

[0016] The timing adjustment unit is configured to set the data reading interval to a first duration, where the data reading interval is the interval for reading graphic data from the external storage module, and the first duration is shorter than the data reading interval of the timing adjustment unit in the hidden OSD image mode;

[0017] The image quality processing unit is configured to process the graphic data to obtain the first OSD image, and the graphic data is read from the external storage module based on the first duration.

[0018] In a possible implementation, the processing unit further includes a superimposing unit;

[0019] The superimposing unit is configured to superimpose the first OSD image and the first image frame to obtain a superimposed result to be displayed.

[0020] On the other hand, a display processing method is provided, and the method includes:

[0021] Determine the display mode of the first image frame to be displayed, where the display mode includes a display OSD image mode or a hidden OSD image mode;

[0022] According to the display mode, control the operation of reading the first OSD image corresponding to the first image frame from an external storage module.

[0023] In a possible implementation, the determining the display mode of the first image frame to be displayed includes:

[0024] Obtain the display information of the second OSD image corresponding to the second image frame on the display panel, and determine the display mode of the first image frame according to the display information. The second image frame is displayed before the first image frame, and the display information represents the transparency of the display panel in displaying the second OSD image.

[0025] In a possible implementation, the obtaining the display information of the second OSD image corresponding to the second image frame on the display panel includes:

[0026] Statistically analyze the alpha of each pixel point in the second OSD image;

[0027] Determine the display information according to the alpha of each pixel point.

[0028] In a possible implementation, the controlling the operation of reading the first OSD image corresponding to the first image frame from the external storage module according to the display mode includes:

[0029] In the case where the display mode is the hidden OSD image mode, prohibit reading the first OSD image from the external storage module;

[0030] Alternatively, in the case where the display mode is the display OSD image mode, read the first OSD image from the external storage module.

[0031] In a possible implementation, when the display mode is adjusted to the hidden OSD image mode and the second OSD image reaches the blanking area, the prohibiting reading the first OSD image from the external storage module includes:

[0032] Obtain the display data to be displayed based on the first image frame, and the data for obtaining the display data does not include the first OSD image;

[0033] Extend the data reading interval, where the data reading interval is the interval for reading graphic data from the external storage module, and the graphic data is processed to obtain the first OSD image in the display OSD image mode, and the processing of the graphic data is prohibited in the hidden OSD image mode.

[0034] In a possible implementation, when the display mode is adjusted to the display OSD image mode and the second OSD image reaches the blanking area, the reading of the first OSD image from the external storage module includes:

[0035] Set the data reading interval to a first duration, where the data reading interval is the interval for reading graphic data from the external storage module, and the first duration is shorter than the data reading interval in the hidden OSD image mode;

[0036] Process the graphic data to obtain the first OSD image, where the graphic data is read from the external storage module based on the first duration.

[0037] In a possible implementation, after processing the graphic data to obtain the first OSD image, it further includes:

[0038] Overlay the first OSD image and the first image frame to obtain an overlay result to be displayed.

[0039] On the other hand, a display device is also provided, where the device includes the display processing circuit and the display panel described in any of the above, and the display processing circuit controls the acquisition of the first OSD image corresponding to the first image frame based on the display mode of the display device.

[0040] On the other hand, a chip is provided, where the chip includes the display processing circuit described in any of the above.

[0041] The technical solution provided by this application at least brings the following beneficial effects:

[0042] By adding a display mode determination unit, the processing unit can timely obtain whether the display mode is the display OSD image mode or the hidden OSD image mode, so as to directly cancel the operation of obtaining the OSD image when the OSD image is hidden, reduce the bandwidth occupied by obtaining the OSD image, and reduce resource consumption. Description of the Drawings

[0043] In order to more clearly illustrate the technical solutions in the embodiments of this application, the following will briefly introduce the drawings required for the description of the embodiments. Obviously, the following drawings are only some embodiments of this application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0044] Figure 1 It is a schematic diagram of the display of a display panel provided by an embodiment of the present application;

[0045] Figure 2 It is a schematic structural diagram of an OSD module provided by an embodiment of the present application;

[0046] Figure 3 It is a schematic structural diagram of a display processing circuit provided by an embodiment of the present application;

[0047] Figure 4 It is a schematic structural diagram of another display processing circuit provided by an embodiment of the present application;

[0048] Figure 5 It is a schematic structural diagram of a display mode determination unit provided by an embodiment of the present application;

[0049] Figure 6 It is a schematic diagram of the switching of an operating state provided by an embodiment of the present application;

[0050] Figure 7 It is a schematic structural diagram of yet another display processing circuit provided by an embodiment of the present application;

[0051] Figure 8 It is a schematic diagram of a timing transformation provided by an embodiment of the present application;

[0052] Figure 9 It is a schematic diagram of yet another timing transformation provided by an embodiment of the present application;

[0053] Figure 10 It is a schematic structural diagram of still another display processing circuit provided by an embodiment of the present application;

[0054] Figure 11 It is a flowchart of the switching of an operating state provided by an embodiment of the present application;

[0055] Figure 12 It is a flowchart of the switching of yet another operating state provided by an embodiment of the present application;

[0056] Figure 13 It is a flowchart of a display processing method provided by an embodiment of the present application. Detailed implementation manners

[0057] To make the objectives, technical solutions, and advantages of the present application clearer, the following will further describe the embodiments of the present application in detail with reference to the accompanying drawings.

[0058] In the field of image processing technology, a display panel displays an image frame through a UI (user interface). The image frame can be a static image or a frame of a dynamic image. The dynamic image can be an image in gif (Graphics Interchange Format) format or a video. Among them, the user interface includes a display window of the image and a display control component, and the display panel can display the image in the display window of the user interface.

[0059] Figure 1 The following is a schematic diagram of the display of a display panel provided by an embodiment of the present application. Refer to Figure 1 (1). The display panel configured on the mobile phone displays the user interface full screen. The user interface includes a display window, and the image frame displayed in the display window is an image of a little boy's shape. The user interface also includes a display control component, including a closing component 1 for closing the page, a volume component 2 for adjusting the volume, a component 3 for adjusting the clarity, a component 4 for adjusting the playback speed, a switch component 5 for controlling the barrage switch, a pause component 6, etc.

[0060] In some cases, during the process of displaying an image using the user interface, the graphic data of the user interface can be processed by an OSD module to obtain the page data of the user interface. Since the page data is obtained by processing through the OSD module, this page data can also be called an OSD image.

[0061] Figure 2 The following is a schematic diagram of the structure of an OSD module provided by an embodiment of the present application. Refer to Figure 2 , the OSD module includes an RDMA (remote direct memory access) unit, a DTG (display timing generate) unit, a PQ-IP (Picture Quality intellectual property core). The OSD module is connected to a DDR (Double Data Rate Synchronous Dynamic Random Access Memory) and a MIXER (image overlay module). Figure 2 Firmware is also configured in the circuit shown in the figure to control the operation of each device in the OSD module.

[0062] In some cases, the DDR is connected to an external graphics generator, which writes the graphic data of the user page into the DDR in real time. Each unit in the OSD_PATH (path) operates in a post-drive circuit mode. The DTG generates video timing information, and the PQ-IP reads the graphic data from the DDR based on the video timing information through RDMA (Read Direct Memory Access).

[0063] The PQ-IP processes the read graphic data and sends the processed OSD image to the MIXER. The MIXER superimposes and outputs the OSD image with the image frame, and the image frame corresponds to Figure 2 the main path data in it. Optionally, the Firmware coordinates the functions of the hardware circuit by controlling the reading and writing of registers to control the PQ-IP, DTG, and MIXER to perform the above operations.

[0064] However, due to inherent reasons in the protocol layer, the operating system layer usually does not transfer the display state of the user page to the underlying hardware system. The Firmware configured in the underlying hardware system cannot obtain the true display state of the user page from the operating system layer, nor can it control the display state of the user page on the display panel. If the display state of the user page on the display panel needs to be switched, for example, from display to hide. It is achieved by adjusting the image transparency value during the process of the graphics generator generating graphic data. For example, when starting to hide the UI on the display panel, the image transparency value in the graphic data generated by the graphics generator is 0%.

[0065] Among them, the display panel hiding the user page can be that the display panel displays the image frame full screen, such as Figure 1 (2) of, or it can be that the display panel displays the image frame in a pop-up window, such as Figure 1 (3) of, or it can also be that the display panel cancels the display of the image frame. But no matter what situation the display panel starts to hide the user page based on, since the OSD module cannot obtain the display state of the user page, even when the display panel hides the user page, the OSD module still reads and processes the graphic data from the DDR in real time to obtain the OSD image, and the OSD module always maintains the same bandwidth and power consumption.

[0066] Moreover, if the OSD module is a multi-channel OSD, the multi-channel OSD can process multiple layers of UI, and the display states of each layer of UI in the multiple layers of UI may all change. In a scenario of frequent switching, if each channel of OSD still reads and processes data in real time, it occupies a high system bandwidth and wastes a lot of hardware resources. In addition, since the total bandwidth is related to the selection of DDR particles, wasting bandwidth resources also means an increase in the IC (integrated circuit) development cost. Based on this, the embodiments of the present application provide a display processing circuit for optimizing the bandwidth and power consumption occupied during the process of the display processing circuit obtaining the OSD image when the UI is hidden on the display panel.

[0067] Figure 3 FIG. is a schematic structural diagram of a display processing circuit provided by an embodiment of the present application. Refer to Figure 3 , this circuit includes a display mode determination unit 11 and a processing unit 12, and the display mode determination unit 11 and the processing unit 12 are connected. Among them, the display mode determination unit 11 is used to determine the display mode of the first image frame to be displayed, and the display mode includes a display OSD image mode and a hidden OSD image mode.

[0068] Exemplarily, the display mode determination unit 11 is used to obtain the display information of the second OSD image corresponding to the second image frame on the display panel, and determine the display mode of the first image frame according to the display information. Among them, the second image frame is displayed before the first image frame. The second image frame may also be an image frame to be displayed. For example, the second image frame is the next frame to be displayed, and it can be understood that the order of the display panel displaying images is the current frame at the current moment, the second image frame, and the first image frame. The second OSD image corresponding to the second image frame refers to the OSD image displayed together with the second image frame. The display information of the second OSD image represents the transparency of the display panel displaying the second OSD image.

[0069] In a possible implementation manner, the display mode determination unit 11 is connected to an external storage module. This external storage module is a module configured outside the OSD module. The external storage module can be configured inside the display processing circuit or outside the display processing circuit. The external storage module is used to cache the graphic data of the user page processed in real time by the external graphics generator based on the display situation of the display panel. This external storage module is, for example, Figure 2 the DDR shown, or it can also be other storage devices with data storage functions.

[0070] In addition, the display mode determination unit 11 can be directly connected to the external storage module or indirectly connected to the external storage module. Refer to Figure 4The display processing circuit further includes an access unit 13, the display mode determination unit 11 is connected to the access unit 13, and the access unit 13 is connected to the external storage module. The access unit 13 can be any device having a memory access control function, such as Figure 2 RDMA shown.

[0071] Regardless of the manner in which the display mode determination unit 11 is connected to the external storage module, the graphic data stored in the external storage module can be read, and the display information of the second OSD image can be determined based on the graphic data. In one possible implementation, since the graphic data acquired by the display mode determination unit 11 indicates the pixel value and transparency value of each pixel in the second OSD image. The display mode determination unit 11 can count the transparency value of each pixel in the second OSD image, and determine the display information according to the transparency value of each pixel. For example, the number of pixel points whose transparency value is greater than the transparency threshold is determined, and the number of pixel points is used as the display information of the second OSD image to reflect the degree of transparency of the second OSD image on the display panel.

[0072] The transparency threshold can be set based on experience or implementation environment, such as a display screen. Optionally, the transparency value of a pixel is negatively correlated with the degree of transparency of the pixel. The greater the transparency value of any pixel, the more opaque any pixel is on the display panel. A transparency value of 0% indicates complete transparency, and 100% indicates complete opacity. In addition, the transparency value can also be other values, such as 0 to 255.

[0073] Optionally, the display mode determination unit 11 may further process the number of pixels to obtain display information of the second image frame. Since the first image frame is displayed after the second image frame, the display mode of the first image frame will be consistent with the display mode of the second image frame to avoid the problem of discontinuous display. Therefore, the display mode of the second image frame can be used as the display mode of the first image frame.

[0074] by Figure 5 Taking the display mode determination unit 11 shown as an example, the display mode determination unit 11 includes a counting unit 111 and a first unit 112. Exemplarily, the counting unit 111 can be any device with a numerical statistical function, such as a counter. The counting unit 111 is used to count the number of pixel points whose transparency value is greater than the transparent threshold. The statistical process can be referred to the above embodiment, and will not be repeated here.

[0075] After the counting unit 111 obtains the number of pixels, the first unit 112 assigns state parameters based on the number of pixels and the pixel threshold to obtain a display mode. The first unit 112 may be any device with a parameter adjustment function, such as a register.

[0076] Among them, the pixel threshold can be any integer set based on experience and the implementation environment, and the implementation environment is, for example, the user page source. If there is an error in the user page source, there may be an offset in the transparency values of some pixels in the user page displayed based on the user page source. By setting the pixel threshold, the influence of these pixels with offset transparency values on the mode judgment can be avoided. In some cases, the pixel threshold can also be set to 0.

[0077] In a possible implementation manner, for the case where the transparency value is negatively correlated with the transparency degree, the first unit 112 compares the number of pixels and the pixel threshold. When the number of pixels is greater than the pixel threshold, it is determined that the display panel displays the second OSD image, and the first unit 112 assigns the status parameter to the second value indicating the OSD image display mode. When the number of pixels is not greater than the pixel threshold, it is determined that the second OSD image is completely transparent on the display panel, and the display panel does not display the second OSD image. It can be understood that the display panel hides the second OSD image, and the first unit 112 assigns the status parameter to the first value indicating the OSD image hiding mode.

[0078] Optionally, the first value and the second value can be any different numerical values set based on experience and the implementation environment, and the implementation environment can be the assignment range of the first unit 112. The first value is, for example, 0, and the second value is, for example, 1. Next, taking the first unit 112 as a register, the assigned status parameter as UI_status, the first value as 0, the second value as 1, and the pixel threshold as 0 as an example, the process of assigning the status parameter will be illustrated.

[0079] The counter counts the number of pixels with alpha (transparency value) greater than the transparency threshold based on the graphic data. At the end of the current frame, it updates the number of pixels to the register alpha_num_ro and clears the counter to start counting again. If alpha_num_ro = 0, it is determined that the display panel hides the second OSD image, and UI_status = 0 is set; if alpha_num_ro > 0, it is determined that the display panel displays the second OSD image, and UI_status = 1 is set.

[0080] Optionally, the transparency value can also be positively correlated with the degree of transparency. For example, the higher the transparency value of any pixel, the greater the degree of transparency of the pixel. When the transparency value of the pixel reaches 100%, the pixel is fully transparent on the display panel. In this case, the first unit 112 can determine that the display panel does not display the second OSD image when the number of pixels is greater than the pixel threshold, and assign the status parameter to the first value indicating the hidden OSD image mode. When the number of pixels is not greater than the pixel threshold, it is determined that the display panel displays the second OSD image, and the status parameter is assigned to the second value indicating the display OSD image mode.

[0081] After the display mode determining unit 11 obtains the display mode, the processing unit 12 can control the operation of reading the first OSD image corresponding to the first image frame from the external storage module according to the display mode. Taking the display mode obtained by the processing unit 12 as the assigned status parameter as an example, the processing unit 12 can directly determine whether it is the hidden OSD image mode based on whether the display mode is the first value.

[0082] Optionally, since the display information can also represent the display mode, the process of determining the display mode based on the display information can also be executed by the processing unit 12. For example, the processing unit 12 receives the display information sent by the display mode determining unit 11. If the display information is the number of pixels and the transparency value is negatively correlated with the degree of transparency, the processing unit 12 can determine that the display mode is the display OSD image mode when the number of pixels is greater than the pixel threshold; when the number of pixels is not greater than the pixel threshold, it is determined that the display mode is the hidden OSD image mode. It can be understood that the processing unit 12 can also configure a second unit similar to the first unit to implement the judgment of the display mode.

[0083] Regardless of how the processing unit 12 determines the display mode of the first image frame, the process of obtaining the first OSD image can be controlled by including but not limited to the following two methods.

[0084] Method 1: When the display mode is the hidden OSD image mode, prohibit reading the first OSD image from the external storage module.

[0085] Figure 6 This is a schematic diagram of a state switch provided by an embodiment of the present application. The operating states of the processing unit 12 include UI_ON and UI_OFF. Among them, the processing unit 12 will normally obtain the first OSD image in the UI_ON state, and will prohibit obtaining the first OSD image in the UI_OFF state.

[0086] When the display mode is adjusted, the processing unit 12 can adjust its operating state to cancel the acquisition of the first OSD image. Here, the adjustment of the display mode means that the previously counted display mode is the OSD image display mode, while the display mode of the first image frame is the hidden OSD image mode. In some cases, the adjustment of the display mode can also be determined based on the operating state. For example, when the operating state of the processing unit 12 is UI_ON, but the display mode of the first image frame is the hidden OSD image mode, the processing unit 12 determines that the display mode has been adjusted.

[0087] In addition, since the display mode is counted by the display mode determination unit 11, the processing unit 12 can also refer to the operating conditions of the display mode determination unit 11 to trigger the adjustment of the operating state. For example Figure 6 as shown Figure 6 where UI_DET is the display mode determination unit 11 and UI_status is the status parameter. The processing unit 12 can switch the operating state from UI_ON to UI_OFF when UI_DET is enabled and UI_status = 0. When UI_DET is disabled or UI_status = 1, the operating state is switched from UI_OFF to UI_ON.

[0088] Regardless of the method by which the processing unit 12 triggers the switching of the operating state, the acquisition of the first OSD image can be adjusted by switching the operating state. Figure 7 FIG. is a schematic structural diagram of a processing unit 12 provided by an embodiment of the present application. Figure 7 In this, the processing unit 12 includes a superimposing unit 121, a timing adjustment unit 122, and an image quality processing unit 123. Among them, the superimposing unit 121 is used to superimpose the image frame and the OSD image so that the display panel displays the picture based on the superimposing result. The displayed picture includes the OSD image and the image displayed within the OSD image. The timing adjustment unit 122 is used to control the timing of the OSD image, and this timing affects the data request interval of the OSD image. The image quality processing unit 123 is used to process the data read from the external storage module to obtain the OSD image to be superimposed. Next, taking Figure 7 as an example to illustrate the process of each unit in the processing unit 12 switching the operating state.

[0089] Exemplarily, when the display mode is adjusted to the hidden OSD image mode and the second OSD image reaches the blanking area, the superimposing unit 121 is used to obtain the display data to be displayed based on the first image frame, and the data for obtaining the display data does not include the first OSD image; the timing adjustment unit 122 is used to extend the data reading interval, and the data reading interval is the interval for reading graphic data from the external storage module, and the graphic data is used by the graphic quality processing unit 123 to process the first OSD image in the display OSD image mode; the image quality processing unit 123 is used to send the graphic data to the superimposing unit 121, and the graphic data is read from the external storage module based on the extended data reading interval.

[0090] Among them, the blanking area refers to the non-display area set to eliminate the retrace lines during the electron beam scanning in the image display process. Since in the blanking area, the display panel pauses scanning the image and still displays the previous frame of the display screen, switching the operating state after reaching the blanking area can effectively prevent the display screen of the display panel from being affected and improve the interactive experience.

[0091] The processing unit 12 can first prohibit the superimposing unit 121 from superimposing the first OSD image after reaching the blanking area. For example, modify the superimposing configuration to adjust the output so that the first OSD image does not participate in the superimposing. Taking the superimposing unit 121 as an example that can select the data sources of each superimposing layer, the superimposing unit 121 can set the data source of the layer where the first OSD image is located to an invalid value, and the invalid value is, for example, 0. The data source of the layer where the first OSD image is located can be understood as the data sent by the graphic quality processing unit 123. By controlling the superimposing unit 121 not to superimpose the first OSD image, the subsequent display screen of the display panel will not be affected by the first OSD image.

[0092] Since when the display panel does not display the first OSD image, the external graphics generator still processes the graphic data of the user page based on the display situation of the display panel, and the graphic data is also written into the external storage module. Therefore, the processing unit 12 still reads the graphic data written into the external storage module and sends the read graphic data to the display mode determination unit 11 to judge the display mode based on the graphic data, so as to detect the adjustment of the display mode in time when the display mode is adjusted from the hidden OSD mode to the display OSD mode, and the processing unit 12 adjusts the acquisition of the OSD image based on the adjustment of the display mode.

[0093] In addition, when the display panel resumes displaying the user page, the processing unit 12 continuously reading the graphic data can timely locate the graphic data of the user page to be displayed, so as to quickly resume the display of the user page. For example, if the processing unit 12 does not continuously read the graphic data, it will cause the address of the graphic data corresponding to the OSD image to be displayed cannot be located after the display is resumed, resulting in the corresponding graphic data cannot be read from the external storage module. However, if the processing unit 12 continuously reads the graphic data, after the display is resumed, the graphic data stored in the external storage module can be directly read sequentially.

[0094] Exemplarily, the processing unit 12 can modify the configuration of the timing adjustment unit 122 to adjust the OSD_PATH timing from the mode of following the main path video timing to the free video timing mode, so as to extend the data reading interval. The mode of following the main path video timing means that the phase of the OSD_PATH timing relative to the main path video timing is fixed, and the htotal (the number of clock cycles of the line scan interval) and vtotal (the total number of vertical lines) in the timing are the same. The free video timing mode means that the phase of the OSD_PATH timing relative to the main path video timing is not fixed, and the htotal and vtotal in the timing can be different. The htotal in the free video timing mode after the OSD_PATH is adjusted is greater than the htotal of following the main path video timing. The increase in the line scan time interval indicates that the time to request one line of data increases. Therefore, extending the htotal can achieve the extension of the data reading interval. Optionally, the data reading interval extended by the timing adjustment unit 122 can be a fixed duration or a non-fixed duration.

[0095] In this case, although the processing unit 12 still reads the graphic data and occupies a part of the bandwidth resources, in the hidden OSD mode, the data reading interval for reading the graphic data is the extended interval. Compared with the first duration in the OSD display mode, the reading time interval is longer and the occupied bandwidth resources are less, realizing the saving of bandwidth resources.

[0096] For the image quality processing unit 123, since the current display screen of the display panel has nothing to do with the user page, the image quality processing unit 123 does not need to process the read graphic data and can be directly disabled to save power. Among them, the process of the image quality processing unit 123 reading the graphic data from the external storage module is, for example: the access unit reads the graphic data from the external storage module according to the data reading interval changed by the timing adjustment unit 122, and the access unit sends the read graphic data to the display mode determination unit 11. After the display mode determination unit 11 determines the display mode based on the graphic data, it sends the graphic data to the image quality processing unit 123.

[0097] Optionally, the image quality processing unit 123 not processing the graphic data can either directly discard the graphic data or send the graphic data to the overlay unit 121. If the overlay unit 121 receives the graphic data sent by the image quality processing unit 123, since the overlay unit 121 has set that the data source corresponding to the graphic data does not participate in the overlay, the overlay unit 121 will not overlay the graphic data sent by the image quality processing unit 123 with the first image frame. For example, the overlay unit 121 can discard the graphic data. The operating state of the processing unit 12 can be switched to Figure 6 the UI_OFF state shown.

[0098] Figure 8 is a schematic diagram of a timing transformation provided by an embodiment of the present application. Figure 8 In it, osd_vs, osd_hs, and osd_den are the timings of the OSD image entering the overlay unit 121, main_video_vs, main_video_hs, and main_video_den are the timings of the image frame entering the overlay unit 121, vs is the frame start flag, hs is the line start flag, and den is the data valid flag. In the frame when UI_status just becomes 0, the timing still follows the main path video timing mode as before, Figure 8 and the osd_vs and osd_hs in it still maintain a fixed relative position with main_video_vs and main_video_hs.

[0099] After the osd_den of the second image frame ends, that is, in the OSD blanking area of the second image frame, the configurations of the overlay unit 121 and the timing adjustment unit 122 are adjusted, and the video timing of OSD_PATH is changed to the free video timing mode. Starting from the next frame, Figure 8 the relative positions of osd_vs and osd_hs and main_video_vs and main_video_hs in it are no longer fixed. At the same time, the interval time between osd_hs increases from htotal clock cycles to htotal + n clock cycles, that is, the time to read each line of data from the external storage module increases, and the bandwidth requirement of the user page decreases. The bandwidth requirement refers to the amount of data requested from the external storage module within a unit time. Increasing htotal means that the time to request one line of data increases, so the bandwidth requirement can be reduced.

[0100] Method 2: In the case where the display mode is the OSD image display mode, read the first OSD image from the external storage module.

[0101] Similar to the situation of Method 1, if the display mode is adjusted to the OSD image display mode, the processing unit 12 will also switch its operating state, from Figure 6The UI-OFF shown is switched to UI_ON, so as to normally obtain the first OSD image, enabling the display panel to display the user page based on the first OSD image.

[0102] Continuing with the example where the processing unit 12 shown includes a superimposing unit 121, a timing adjustment unit 122, and an image quality unit 123, when the display mode is adjusted to the OSD image display mode and the second OSD image reaches the blanking area, the process of each unit switching its operating state includes but is not limited to: the timing adjustment unit 122 sets the data reading interval to a first duration, where the data reading interval is the interval for reading graphic data from the external storage module, and the first duration is shorter than the extended data reading interval of the timing adjustment unit 122 in the hidden OSD image mode; the image quality processing unit 123 is used to process the graphic data to obtain the first OSD image, and the graphic data is read from the external storage module based on the first duration; the superimposing unit 121 is used to superimpose the first OSD image and the first image frame to obtain the superimposed result to be displayed. Figure 7

[0103] Optionally, after the second OSD image reaches the OSD blanking area, the timing adjustment unit 122 can be configured to restore the OSD_PATH video timing from the free video timing mode to the follow main path video timing mode, thereby restoring the data reading interval for the original OSD to request one line of data from the external storage module and restoring the data reading interval to a fixed first duration. The first duration is determined based on the data reading interval duration of the first image frame.

[0104] After that, the configuration of the image quality processing unit 123 is restored to enable the image quality processing unit 123 in preparation for normal output of the first OSD image. Since the timing adjustment unit 122 and the image quality processing unit 123 in the processing unit 12 have been restored to the UI_ON state, the processing unit 12 can normally obtain graphic data from the external storage module and process it to obtain the first OSD image to be displayed. Based on this, the processing unit 12 can further restore the configuration of the superimposing unit 121 and set the data source of the layer where the first OSD image is located to a valid value, such as 1, to normally superimpose the first OSD image and the first image frame.

[0105] Optionally, the configuration of the superimposing unit 121 is restored when the vs of the first image frame reaches the rising edge, and the first OSD image and the first image frame are superimposed only when the rising edge is reached. By controlling the superimposing timing, bad pictures in the picture obtained by superimposing the first OSD image and the first image frame can be avoided.

[0106] ​Among them, a bad picture refers to pixel errors in the user page, and pixel errors include, but are not limited to, pixel loss or incorrect pixel data, etc. The reason for the appearance of bad pictures during the superposition process is that the OSD_PATH timing or OSD_PATH data used for superposition is incorrect. For example, it is caused by the unfixed phase of the OSD_PATH timing relative to the main video timing, or the PQ IP in the OSD_PATH not being restored in time, etc.

[0107] After the superposition unit 121, the timing adjustment unit 122, and the image quality unit 123 in the processing unit 12 execute each operation as shown in the above embodiments, the operating state of the processing unit 12 switches to Figure 6 the UI_ON state shown, and the display panel can normally display the user page.

[0108] Figure 9 This is another timing transformation schematic diagram provided by the embodiment of the present application. Figure 9 In it, when the user page just resumes display, for example, when UI_status is just 1, the OSD_PATH video timing is still in the free video timing mode. In this mode, the relative positions of osd_vs and osd_hs with respect to main_video_vs and main_video_hs are still not fixed. After the osd_den of the second OSD image ends, that is, in the OSD blanking area of the second OSD image, after the configuration of the timing adjustment unit 12 is issued, the OSD_PATH video timing changes to follow the main video timing mode. Starting from the next frame, the relative positions of osd_vs, osd_hs with main_video_vs, main_video_hs are fixed, and at the same time, the interval time between osd_hs is reduced from htotal + n clock cycles to htotal clock cycles, that is, the time to read each line of data from the external storage module is restored to the first duration, and the bandwidth requirement of the OSD returns to normal.

[0109] In addition, the above examples are intended to illustrate the process of the processing unit 12 switching its operating state, rather than limiting each unit in the display processing circuit. In some cases, the processing unit 12 further includes a state control unit for controlling the operating states of the superposition unit 121, the graphic quality processing unit 123, and the timing adjustment unit 122. For example, when the display mode is adjusted to the hidden OSD image mode and the second OSD image reaches the blanking area, the operating state of the superposition unit 121 is adjusted to the first state, and the first state means that before displaying the first image frame, the first image frame and the first OSD image are not superimposed; the timing mode of the timing adjustment unit 122 is adjusted to the free video timing mode to extend the data reading interval; the operating state of the image quality processing unit 123 is adjusted to the second state, and the second state means that the graphic data is not processed.

[0110] Alternatively, when the display mode is adjusted to the OSD image display mode and the second OSD image reaches the blanking area, the timing mode of the timing adjustment unit 122 is adjusted to follow the main video timing mode to set the data reading interval to the first duration; the operating state of the image quality processing unit 123 is adjusted to the third state, where the third state indicates processing graphic data, and the operating state of the overlay unit 121 is adjusted to the fourth state, where the fourth state indicates overlaying the first image frame and the first OSD image before displaying the first image frame.

[0111] See Figure 10 , Figure 10 the DDR corresponding to that in Figure 4 the external storage module shown, and RDMA corresponding to Figure 4 the access unit 13 shown, UI_DET corresponding to the display mode determination unit 11, DTG corresponding to the timing adjustment unit 122, PQ-IP corresponding to the image quality processing unit 123, MIXER corresponding to the overlay unit 121, and Firmware corresponding to the state control unit. A state machine driver for handling different display modes is added. The Firmware is used to obtain the display mode sent by the UI_DET and adjust the operating states of the DTG, PQ-IP, and MIXER based on the display mode to implement the adjustments involved in Method 1 or Method 2 in the above embodiments, thereby improving the bandwidth utilization rate of the OSD circuit and reducing power consumption.

[0112] Next, taking the structure of the display processing circuit as shown in Figure 10 as an example, and the display mode being determined based on UI_status, the process of adjusting the operating state based on the display mode will be illustrated. Exemplarily, the program in the Firmware will adjust the operating state according to UI_DET enable / disable and UI_status, and the process of adjusting the operating state is as shown in Figure 11 or Figure 12 shown. Among them, Figure 11 corresponds to Method 1. When the operating state (Status) of the display processing circuit is UI_ON, after the Firmware obtains the UI_status sent by the UI_DET through the bus (bus), it will determine whether it is UI_DET enable && UI_status = 0, where && indicates AND.

[0113] If either UI_DET is not enabled or UI_status = 1 occurs, the Firmware will maintain the operating state as UI_ON. If UI_DET is enabled and UI_status = 0, the Firmware will determine whether it is in the OSD blanking area. If it is not in the OSD blanking area, it will continue to wait. If it is in the OSD blanking area, it will send a configuration to the MIXER, indicating not to overlay with the OSD.

[0114] After that, the Firmware modifies the DTG configuration, configures the timing mode in the DTG as the free timing mode to increase the line scan time, thereby extending the data request interval for reading graphic data from the DDR. Optionally, after adjusting the timing mode, the Firmware will further disable the PQ-IP to cancel the processing of graphic data. For the graphic data read from the DDR, it will be directly discarded. For example, after RDMA reads the graphic data from the DDR, it sends the graphic data to UI_DET. UI_DET determines the display mode based on the graphic data and sends the graphic data to PQ-IP. PQ-IP sends the graphic data to the MIXER, and the MIXER does not use the received graphic data. After performing the above operations, the operating state of the display processing circuit is changed to UI_OFF.

[0115] Figure 12 For the corresponding method 2, see Figure 12 When the Status of the display processing circuit is UI_OFF, after the Firmware obtains the UI_status sent by UI_DET, it will determine whether it is UI_DET disabled || UI_status = 1, where || indicates OR. If UI_DET is enabled and UI_status = 0, the Firmware will maintain the operating state as UI_OFF. If either UI_DET is not enabled or UI_status = 1 occurs, the Firmware will determine whether it is in the OSD blanking area. If it is not in the OSD blanking area, it will continue to wait. If it is in the OSD blanking area, it will modify the DTG configuration and configure the timing mode in the DTG as the follow mode configuration.

[0116] Optionally, after adjusting the timing mode, the Firmware will further restore the PQ-IP configuration and enable the PQ-IP to resume the processing of graphic data read from the DDR. Then the Firmware restores the MIXER configuration, indicating to overlay with the OSD, and the restored configuration takes effect at the rising edge of the next frame osd_vs. After performing the above operations, the operating state of the display processing circuit is changed to UI_ON.

[0117] In summary, the display processing circuit provided by the embodiment of the present application can enable the processing unit 12 to obtain the display mode of the first image frame on the display panel in a timely manner by adding a display mode determination unit 11, so as to directly cancel the operation of obtaining the OSD image when hiding the OSD image, reducing bandwidth occupancy and resource consumption. It is applicable to various OSD circuits, whether it is a single-layer OSD or a multi-layer OSD, and has strong scalability.

[0118] The embodiment of the present application also provides a display processing method. Refer to Figure 13 , and this method includes step 1301-step 1302.

[0119] In step 1301, determine the display mode of the first image frame to be displayed, where the display mode includes a display OSD image mode or a hide OSD image mode.

[0120] Exemplarily, the process of obtaining the display mode is similar to the process of the display mode determination unit 11 obtaining the display mode in the embodiment shown in Figure 3 . It is possible to obtain the display information of the second OSD image corresponding to the second image frame on the display panel, and determine the display mode of the first image frame according to the display information. The second image frame is displayed before the first image frame, and the display information represents the transparency of the display panel for displaying the second OSD image.

[0121] Optionally, the process of obtaining the display information is similar to the process of the display mode determination unit 11 obtaining the display information in the embodiment shown in Figure 3 . It includes counting the alpha of each pixel point in the second OSD image; determining the display information according to the alpha of each pixel point. For a detailed description, refer to the relevant description of the embodiment shown in Figure 3 , and details will not be repeated here.

[0122] In step 1302, control the operation of reading the first OSD image corresponding to the first image frame from the external storage module according to the display mode.

[0123] Exemplarily, in the case where the display mode is the hide OSD image mode, prohibit reading the first OSD image from the external storage module; or, in the case where the display mode is the display OSD image mode, read the first OSD image from the external storage module.

[0124] Optionally, when the display mode is the hidden OSD image mode and the second OSD image reaches the blanking area, the process by which the processing unit prohibits obtaining the first OSD image includes: obtaining display data to be displayed based on the first image frame, where the data for obtaining the display data does not include the first OSD image; extending the data reading interval, where the data reading interval is the interval for reading graphic data from an external storage module, and the graphic data is processed to obtain the first OSD image in the display OSD image mode and is prohibited from being processed in the hidden OSD image mode. The above process is similar to the process of Method 1 in the embodiment shown in Figure 6 and reference may be made to the relevant description, which will not be elaborated here.

[0125] Exemplarily, if the display mode is the display OSD image mode, the processing unit may obtain the first OSD image. When the display mode is adjusted to the display OSD image mode and the second OSD image reaches the blanking area, the obtaining process includes, but is not limited to, setting the data reading interval to a first duration, where the data reading interval is the interval for reading graphic data from an external storage module, and the first duration is shorter than the extended data reading interval in the case of the hidden OSD image mode; processing the graphic data to obtain the first OSD image, where the graphic data is read from the external storage module based on the first duration. After that, the processing unit may superimpose the first OSD image and the first image frame to obtain a superimposed result to be displayed. The process of obtaining and superimposing the first OSD image may refer to the process of Method 2 in the embodiment shown in Figure 6 and reference may be made to the relevant description, which will not be repeated here.

[0126] An embodiment of the present application provides a display device, which includes a display panel and Figure 3 、 Figure 4 、 Figure 7 or Figure 10 any one of the display processing circuits shown, and the display processing circuit controls the obtaining of the first OSD image corresponding to the first image frame based on the display mode of the display device.

[0127] Exemplarily, the display device may be any device with a display function and may be any terminal. Optionally, the terminal may be any electronic product that can perform human-computer interaction with a user in one or more ways such as a keyboard, a touchpad, a touch screen, a remote control, voice interaction, or a handwriting device, such as a PC (Personal Computer), a mobile phone, a smart phone, a PDA (Personal Digital Assistant), a wearable device, a PPC (Pocket PC), a tablet computer, a smart vehicle console, a smart TV, etc.

[0128] The embodiments of the present application also provide a display chip, which includes Figure 3 , Figure 4 , Figure 7 or Figure 10 any of the shown display processing circuits. The chip can be any image chip with UI display, such as a TV-SoC (television on-chip) chip, an STB (Set Top Box) chip, or a monitor chip.

[0129] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data for analysis, stored data, displayed data, etc.), and signals involved in this application are all authorized by the user or fully authorized by all parties, and the collection, use, and processing of relevant data need to comply with relevant laws, regulations, and standards of relevant countries and regions. For example, the display information involved in this application is obtained under full authorization.

[0130] It should be understood that the term "a plurality of" mentioned herein refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B may represent: A exists alone, A and B exist simultaneously, and B exists alone. The character " / " generally indicates that the associated objects before and after are in an "or" relationship.

[0131] The above are only exemplary embodiments of the present application and are not intended to limit the present application. Any modifications, equivalent replacements, improvements, etc. made within the principles of the present application shall be included in the protection scope of the present application.

Claims

1. A display processing circuit, characterized in that, The circuit includes a display mode determination unit and a processing unit; The display mode determination unit is configured to determine the display mode of a first image frame to be displayed, where the display mode includes a display screen displaying an OSD image mode or a hidden OSD image mode; The processing unit is configured to control an operation of reading a first OSD image corresponding to the first image frame from an external storage module according to the display mode.

2. The circuit according to claim 1, wherein The display mode determination unit is configured to obtain display information of a second OSD image corresponding to a second image frame on a display panel, and determine the display mode of the first image frame according to the display information. The second image frame is displayed before the first image frame, and the display information represents the transparency of the display panel displaying the second OSD image.

3. The circuit according to claim 2, characterized in that, The display mode determination unit is configured to count transparency values alpha of each pixel point in the second OSD image, and determine the display information according to the alpha of each pixel point.

4. The circuit according to any one of claims 1-3, characterized in that, The processing unit is configured to prohibit reading the first OSD image from the external storage module when the display mode is the hidden OSD image mode; When the display mode is the display OSD image mode, read the first OSD image from the external storage module.

5. The circuit according to claim 4, wherein The processing unit includes a superimposing unit, a timing adjustment unit, and an image quality processing unit; when the display mode is adjusted to the hidden OSD image mode and the second OSD image reaches the blanking area: The superimposing unit is configured to obtain display data to be displayed based on the first image frame, and the data for obtaining the display data does not include the first OSD image; The timing adjustment unit is configured to extend a data reading interval, where the data reading interval is an interval for reading graphic data from the external storage module, and the graphic data is used for the image quality processing unit to process to obtain the first OSD image in the display OSD image mode; The image quality processing unit is configured to send the graphic data to the superimposing unit, and the graphic data is read from the external storage module based on the extended data reading interval.

6. The circuit according to claim 4, wherein The processing unit includes a timing adjustment unit and an image quality processing unit; when the display mode is adjusted to the display OSD image mode and the second OSD image reaches the blanking area: The timing adjustment unit is configured to set the data reading interval to a first duration, where the data reading interval is an interval for reading graphic data from the external storage module, and the first duration is shorter than the data reading interval of the timing adjustment unit in the hidden OSD image mode; The image quality processing unit is configured to process the graphic data to obtain the first OSD image, and the graphic data is read from the external storage module based on the first duration.

7. A display processing method, characterized in that The method includes: Determining the display mode of a first image frame to be displayed, where the display mode includes a display screen displaying an OSD image mode or a hidden OSD image mode; Control the operation of reading the first OSD image corresponding to the first image frame from the external storage module according to the display mode.

8. The method according to claim 7, wherein The determining the display mode of the first image frame to be displayed includes: Obtain the display information of the second OSD image corresponding to the second image frame on the display panel, and determine the display mode of the first image frame according to the display information. The second image frame is displayed before the first image frame, and the display information represents the transparency of the display panel in displaying the second OSD image.

9. The method according to claim 8, characterized in that, The obtaining the display information of the second OSD image corresponding to the second image frame on the display panel includes: Count the transparency values alpha of each pixel point in the second OSD image; Determine the display information according to the alpha of each pixel point.

10. The method according to any one of claims 7-9, characterized in that, The controlling the operation of reading the first OSD image corresponding to the first image frame from the external storage module according to the display mode includes: In the case where the display mode is the hidden OSD image mode, prohibit reading the first OSD image from the external storage module; In the case where the display mode is the display OSD image mode, read the first OSD image from the external storage module.

11. The method according to claim 10, wherein When the display mode is adjusted to the hidden OSD image mode and the second OSD image reaches the blanking area, the prohibiting reading the first OSD image from the external storage module includes: Obtain the display data to be displayed based on the first image frame, and the data for obtaining the display data does not include the first OSD image; Lengthen the data reading interval, where the data reading interval is the interval for reading graphic data from the external storage module. The graphic data is processed to obtain the first OSD image in the display OSD image mode, and the graphic data is prohibited from being processed in the hidden OSD image mode.

12. The method according to claim 10, wherein When the display mode is adjusted to the display OSD image mode and the second OSD image reaches the blanking area, the reading the first OSD image from the external storage module includes: Set the data reading interval to a first duration, where the data reading interval is the interval for reading graphic data from the external storage module, and the first duration is shorter than the data reading interval in the hidden OSD image mode; Process the graphic data to obtain the first OSD image, where the graphic data is read from the external storage module based on the first duration.

13. A display device, characterized in that, The display device includes a display panel and the display processing circuit according to any one of claims 1-6. The display processing circuit controls the acquisition of the first screen display OSD image corresponding to the first image frame based on the display mode of the display device.

14. A display chip, characterized in that, The display chip includes the display processing circuit according to any one of claims 1-6.

Images