Data processing method and device and storage medium

Abstract

The embodiment of the invention provides a data processing method and device and a storage medium, and the method comprises the steps that first equipment obtains a first data frame, and the first data frame comprises at least one display content; the first device determines content description information corresponding to the first data frame, wherein the content description information comprises the type of each display content in the at least one display content and display layout information of each display content in the first data frame; and the first equipment sends the first data frame and content description information to the second equipment, wherein the content description information is used for adjusting the image quality of a display image corresponding to the first data frame. Through the method, the second device can determine the parameter of the image quality algorithm corresponding to each display content according to the type of each display content in the content description information, so that the image quality of each display content can be adjusted, and the image quality of the whole display image can be improved.

Description

Technical Field

[0001] The present application relates to the field of media technology, and in particular to a data processing method, device and storage medium. Background Art

[0002] In the scenario of device interconnection, the need for information interaction between devices often arises. For example, in the scenario of TV and set-top box interconnection, when the TV needs to play a video, the set-top box sends the video content to the TV. When the set-top box is playing a source, if the user interface (UI) content needs to be displayed at the same time, the set-top box will superimpose the video content and the UI content and transmit it to the TV. The TV will then perform unified image quality processing on the superimposed image according to the video content. However, the image quality processing applicable to the video is not applicable to the UI content, which will cause abnormal image quality of the UI content. Summary of the invention

[0003] The present application provides a data processing method, device and storage medium for improving the image quality of the entire display screen.

[0004] In a first aspect, the present application provides a data processing method, which can be performed by a first device or a component in the first device. Taking the method that can be performed by the first device as an example, in the method, the first device obtains a first data frame, and the first data frame includes at least one display content. The first device determines content description information corresponding to the first data frame, and the content description information includes the type of each display content in the at least one display content and the display layout information of each display content in the first data frame. Then, the first device sends the first data frame and the content description information to the second device, and the content description information is used to adjust the image quality of the display screen corresponding to the first data frame.

[0005] Through this method, in addition to sending the first data frame to the second device, the first device also sends content description information corresponding to the first data frame, so that the second device can determine the parameters of the image quality algorithm corresponding to each display content according to the type of each display content in the content description information, and adjust the image quality of each display content separately, thereby improving the image quality of the entire display screen.

[0006] In a possible implementation, before determining the content description information corresponding to the first data frame, the first device may also determine that the second device supports separate image quality processing for different types of display content. That is, when the first device determines that the second device supports separate image quality processing for different types of display content, it determines and sends the content description information corresponding to the first data frame to the second device, so that the second device can adjust the image quality of each display content in the display screen. Correspondingly, when it is determined that the second device does not support separate image quality processing for different types of display content, the content description information corresponding to the first data frame is not determined, and the content description information is not sent, thereby saving computing resources and network overhead.

[0007] In a possible implementation, the first device determines that the second device supports image quality processing for different types of display content separately, including: if the first device reads capability information of the second device when the first device establishes a connection with the second device, then it is determined that the second device supports image quality processing for different types of display content separately. This implementation can conveniently determine that the second device supports image quality processing for different types of display content separately.

[0008] In a possible implementation, the display layout information of each display content in the first data frame includes: position information of each display content in the first data frame, size information of each display content, and transparency information of each display content.

[0009] In a possible implementation manner, the at least one display content includes video content and / or UI content.

[0010] In a possible implementation, the first device includes any one of the following: a set-top box; a box end of a split TV; a smart middle screen; a set-top box with a screen; and a smart speaker.

[0011] In a second aspect, the present application provides a data processing method, which can be executed by a second device or a component in the second device. Taking the method that can be executed by the second device as an example, in the method, the second device receives a first data frame and content description information sent by the first device, the first data frame includes at least one display content, and the content description information includes the type of each display content in the at least one display content and the display layout information of each display content in the first data frame. The second device determines the parameters of the image quality algorithm corresponding to each display content in the at least one display content according to the type of each display content in the at least one display content, and then adjusts the image quality of the display screen corresponding to the first data frame according to the display layout information of each display content in the at least one display content in the first data frame and the parameters of the image quality algorithm corresponding to each display content.

[0012] Through this method, in addition to receiving the first data frame, the second device also receives the content description information corresponding to the first data frame, and then can determine the parameters of the corresponding image quality algorithm according to the type of each display content in the content description information, so as to adjust the image quality of each display content in the display picture corresponding to the first data frame, thereby improving the image quality of the display picture.

[0013] In a possible implementation, the type of at least one display content is a first type. The second device determines the parameters of the image quality algorithm corresponding to at least one display content according to the type of each display content in the at least one display content, including: the second device determines the parameters of the first image quality algorithm according to the first type, and the parameters of the first image quality algorithm are used to adjust the image quality of the display screen corresponding to the first data frame. In this way, unified image quality processing can be achieved for display content of the same type.

[0014] In a possible implementation, at least one type of display content includes a first type and a second type; the second device determines the type of at least one display content including the parameters of the corresponding image quality algorithm according to the type of each display content in the at least one display content, including: the second device determines the parameters of the first image quality algorithm according to the first type, and the parameters of the first image quality algorithm are used to adjust the image quality of the display content corresponding to the first type in the display screen corresponding to the first data frame; the second device determines the parameters of the second image quality algorithm according to the second type, and the parameters of the second image quality algorithm are used to adjust the image quality of the display content corresponding to the second type in the display screen corresponding to the first data frame. In this way, different types of display content can be processed separately.

[0015] In a possible implementation, the image quality algorithm corresponding to each display content includes at least one of the following: a clarity algorithm; a contrast algorithm; a noise reduction algorithm; and a color adjustment algorithm.

[0016] In a possible implementation manner, the at least one display content includes video content and / or UI content.

[0017] In a possible implementation, the second device may be a display terminal.

[0018] In a third aspect, the present application provides a device, including a processing module and a communication module.

[0019] A processing module is used to obtain a first data frame, the first data frame including at least one display content; determine content description information corresponding to the first data frame, the content description information including the type of each display content in the at least one display content and display layout information of each display content in the first data frame;

[0020] The communication module is used to send a first data frame and content description information to a second device, where the content description information is used to adjust the image quality of a display image corresponding to the first data frame.

[0021] In a possible implementation, the processing module is further used to: determine whether the second device supports separate image quality processing for different types of display content.

[0022] In a possible implementation, the processing module is specifically configured to: if the first device establishes a connection with the second device and reads capability information of the second device, determine that the second device supports separate image quality processing for different types of display content.

[0023] In a possible implementation, the display layout information of each display content in the first data frame includes: position information of each display content in the first data frame, size information of each display content, and transparency information of each display content.

[0024] In a possible implementation manner, the at least one display content includes video content and / or UI content.

[0025] In a possible implementation, the device includes any one of the following: a set-top box; a box end of a split TV; a smart middle screen; a set-top box with a screen; and a smart speaker.

[0026] In a fourth aspect, the present application provides a device, including a processing module and a communication module.

[0027] A communication module, configured to receive a first data frame and content description information sent by a first device, wherein the first data frame includes at least one display content, and the content description information includes a type of each display content in the at least one display content and display layout information of each display content in the first data frame;

[0028] A processing module is used to determine the parameters of the image quality algorithm corresponding to each display content in at least one display content according to the type of each display content in at least one display content; and adjust the image quality of the display screen corresponding to the first data frame according to the display layout information of each display content in the at least one display content in the first data frame and the parameters of the image quality algorithm corresponding to each display content.

[0029] In a possible implementation, the type of at least one display content is a first type; the processing module is specifically used to: determine parameters of a first image quality algorithm according to the first type, and the parameters of the first image quality algorithm are used to adjust the image quality of the display screen.

[0030] In one possible implementation, at least one type of display content includes a first type and a second type; the processing module is specifically used to: determine parameters of a first image quality algorithm according to the first type, and the parameters of the first image quality algorithm are used to adjust the image quality of the display content corresponding to the first type in the display screen; determine parameters of a second image quality algorithm according to the second type, and the parameters of the second image quality algorithm are used to adjust the image quality of the display content corresponding to the second type in the display screen.

[0031] In a possible implementation, the image quality algorithm corresponding to each display content includes at least one of the following: a clarity algorithm; a contrast algorithm; a noise reduction algorithm; and a color adjustment algorithm.

[0032] In a possible implementation manner, the at least one display content includes video content and / or UI content.

[0033] In a possible implementation manner, the device is a display terminal.

[0034] In a fifth aspect, the present application provides a device, comprising a memory, a processor and a communication interface, wherein the memory stores one or more computer programs, and the one or more computer programs include instructions; the processor is used to execute instructions and call the communication interface, so that the device executes the method of the first aspect and / or any possible implementation of the first aspect, or executes the method of the second aspect or any possible implementation of the second aspect.

[0035] In a sixth aspect, the present application provides a computer-readable storage medium, which includes a computer program. When the computer program runs on a computer, the electronic device executes the method of the first aspect or any possible implementation of the first aspect, or executes the method of the second aspect or any possible implementation of the second aspect.

[0036] Among them, for the beneficial effects of the third to sixth aspects, please refer to the beneficial effects of the first or second aspect and will not be repeated. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] Figure 1 A schematic diagram of the system architecture provided for an embodiment of the present application;

[0038] Figure 2 A flowchart of a data processing method provided in an embodiment of the present application;

[0039] Figure 3 A schematic diagram of a first data frame provided in an embodiment of the present application;

[0040] Figure 4 A schematic diagram of a first data frame provided in an embodiment of the present application;

[0041] Figure 5 A schematic diagram of a first data frame provided in an embodiment of the present application;

[0042] Figure 6 A flowchart of a data processing method provided in an embodiment of the present application;

[0043] Figure 7 A flowchart of a data processing method provided in an embodiment of the present application;

[0044] Figure 8 A schematic diagram of a device structure provided in an embodiment of the present application;

[0045] Fig. 9 A schematic diagram of a device structure provided in an embodiment of the present application. DETAILED DESCRIPTION

[0046] The technical solutions in the embodiments of the present application will be described clearly and completely below in conjunction with the drawings in the embodiments of the present application. The terms used in the following embodiments are only for the purpose of describing specific embodiments and are not intended to be used as limitations on the present application. As used in the specification and the appended claims of the present application, the singular expressions "one", "a kind", "said", "above", "the" and "this" are intended to also include expressions such as "one or more", unless there is a clear contrary indication in the context. It should also be understood that in the embodiments of the present application, "one or more" refers to one, two or more; "and / or" describes the association relationship of the associated objects, indicating that three relationships may exist; for example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the objects associated before and after are in an "or" relationship.

[0047] References to "some embodiments" and the like described in this specification mean that a particular feature, structure or characteristic described in conjunction with the embodiment is included in one or more embodiments of the present application. Thus, the phrases "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily all refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in another way. The terms "include", "comprises", "has" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in another way.

[0048] The multiple involved in the embodiments of the present application means greater than or equal to two. It should be noted that in the description of the embodiments of the present application, the words "first", "second", etc. are only used for the purpose of distinguishing the description, and cannot be understood as indicating or implying relative importance, nor can they be understood as indicating or implying an order.

[0049] First, some nouns involved in the embodiments of the present application are explained to facilitate understanding by those skilled in the art.

[0050] High Definition Multimedia Interface (HDMI) is a fully digital video and sound transmission interface that can send uncompressed audio and video signals.

[0051] Extended display identification data (EDID) is a standard for display identification data developed by the Video Electronics Standards Association (VESA) when developing the display data channel (digital display channel, DDC) communication protocol.

[0052] Display Port (DP) is a digital video interface standard developed by an alliance of PC and chip manufacturers and standardized by VESA.

[0053] User interface (UI) refers to the overall design of the software's human-computer interaction, operating logic, and interface aesthetics. This article mainly refers to graphical interfaces such as menu bars and volume bars.

[0054] Currently, in the interconnection scenario of TV and set-top box, when the set-top box is playing a video source, if the UI content needs to be displayed at the same time, the set-top box will superimpose the video content and the UI content and transmit them to the TV. For example, high dynamic range (HDR) video is superimposed on standard dynamic range (SDR) UI. After that, the TV will perform unified image quality processing on the superimposed picture according to the video content. However, the image quality processing applicable to the video is not applicable to the UI content, which will cause abnormal image quality of the UI content.

[0055] In view of this, the present application provides a data processing method that can adjust the image quality of different types of display content, thereby improving the image quality of the display screen. The embodiments of the present application can be applied to different device interconnection scenarios, including but not limited to the interconnection scenario of TV and set-top box, the interconnection scenario of split TV, the interconnection scenario of display and set-top box, and the interconnection scenario of TV with smart middle screen, screen set-top box, smart speaker and other devices that can output video signals. The following embodiments are described by taking the interconnection scenario of TV and set-top box as an example.

[0056] It should be understood that the interconnection interface between the interconnected devices can be an HDMI interface, a DP interface, or other high-speed video interfaces, and this application does not limit this. Taking the interconnection interface between the first device and the second device as an HDMI interface as an example, the first device can obtain EDID from the second device, and the first device can also send data frames and information frame packets corresponding to the data frames to the second device. This application does not limit the names of EDID, data frames, information frame packets, etc. The interconnection interface between the first device and the second device is different, and the corresponding EDID, data frames, information frame packets, etc. The name may also change accordingly. The interconnection method between any two devices can be wired or wireless.

[0057] Figure 1 Schematic diagram of a system architecture applicable to an embodiment of the present application.

[0058] like Figure 1 As shown, the system architecture includes a first device 101 and at least one second device 102. The first device 101 may have data processing capabilities, the second device 102 may have data display capabilities, and the first device 101 may communicate or exchange data with at least one second device.

[0059] In some possible scenarios, the first device 101 may be a terminal device with data processing capabilities. In the embodiment of the present application, the terminal device may also be referred to as user equipment (UE), access terminal, user unit, user station, mobile station, mobile station, remote station, remote terminal, mobile device, user terminal, terminal, wireless communication device, user agent or user device. The first device in the embodiment of the present application may be a set-top box, a split TV (box end), a smart middle screen, a set-top box with a screen, a smart speaker, a mobile phone, a tablet computer (pad), and a computer with wireless transceiver function.

[0060] The second device 102 may be a display terminal capable of presenting data to a user, such as a television, a monitor, a vehicle-mounted device, a split television (TV terminal), or a smart screen.

[0061] The data processing method provided in the embodiment of the present application is described in detail below with reference to the accompanying drawings.

[0062] Figure 2 A flowchart of a data processing method is shown as an example. The method may include the following steps:

[0063] Step 201: A first device obtains a first data frame, where the first data frame may include at least one display content.

[0064] The at least one display content includes video content and / or UI content.

[0065] In some examples, a first device may send a video to a second device. Generally speaking, a video includes multiple frames of images arranged in a time sequence. Each frame of the video may be recorded as a video frame. The first device processes each video frame in a time sequence and sends it to the second device to play the video on the second device. Taking the first device sending a target video to the second device as an example, the first data frame may be any video frame in the target video. For example, at least one display content included in the first data frame is a video content, such as Figure 3 The first data frame shown includes multiple video contents, namely video 1, video 2, video 3 and video 4.

[0066] In other examples, when the first device sends a video to the second device, it needs to send UI content at the same time. In addition to any video frame in the target video, the first data frame may also include UI content. That is, the first data frame may include at least one video content and at least one UI content, for example Figure 4 The first data frame shown includes four video contents, namely video 1, video 2, video 3 and video 4. The first data frame also includes a UI content, namely UI1. UI1 can be superimposed on video 3 and video 4 with a certain transparency.

[0067] In some other examples, all display contents included in the first data frame are UI contents, that is, the first data frame includes at least one UI content. Figure 5 The first data frame shown includes UI1 and UI2, and UI1 is superimposed on UI2. In some other examples, at least one UI content may not be superimposed on each other.

[0068] Step 202: The first device determines content description information corresponding to the first data frame.

[0069] The content description information includes the type of each display content in at least one display content and the display layout information of each display content in the first data frame. Exemplarily, the display layout information of each display content in the first data frame may include but is not limited to the following information: position information of each display content in the first data frame, size information of each display content, and transparency information of each display content.

[0070] by Figure 4For example, the first data frame includes video 1, video 2, video 3, video 4 and UI1, wherein the types corresponding to video 1, video 2, video 3 and video 4 are all video types, and the type corresponding to UI1 is UI type. The content description information corresponding to the first data frame includes the types corresponding to video 1, video 2, video 3, video 4 and UI1, respectively, and the display layout information of video 1, video 2, video 3, video 4 and UI1 in the first data frame, respectively.

[0071] Taking video 1 as an example, the display layout information is introduced. The display layout information of video 1 may include the position information of video 1 in the first data frame, the size information of video 1, and the transparency information of video 1. Among them, the position information of video 1 in the first data frame is used to indicate the position coordinates of video 1 in the display screen corresponding to the first data frame. For example, the position information of video 1 includes a vertex coordinate of the area where video 1 is located. For example, the position information of video 1 can include the four vertex coordinates of the area where video 1 is located. For example, the position information of video 1 can include the center coordinates of the area where video 1 is located. This application does not limit this. The size information of video 1 may include but is not limited to at least one of the following: the length and width of the area where video 1 is located, and the area of ​​the area where video 1 is located. The transparency information of video 1 may include the transparency value of video 1. The transparency value range may be between 0 and 1. The value 0 indicates complete transparency, the value 1 indicates complete opacity, and the value between 0 and 1 indicates semi-transparency. In some other embodiments, the value 0 may also indicate complete opacity and the value 1 indicates complete transparency.

[0072] In a possible implementation, before step 202, the first device may also determine that the second device supports image quality processing for different types of display content. That is, the first device performs step 202 when determining that the second device supports image quality processing for different types of display content.

[0073] The following is an introduction to the specific implementation method of the first device determining that the second device supports separate image quality processing for different types of display content. If the first device reads the capability information of the second device when the first device establishes a connection with the second device, the first device determines that the second device supports separate image quality processing for different types of display content. Alternatively, if the first device reads the capability information of the second device when the first device establishes a connection with the second device, and the capability information includes information indicating that the second device supports separate image quality processing for different types of display content, the first device determines that the second device supports separate image quality processing for different types of display content.

[0074] Correspondingly, if the first device cannot read the capability information of the second device when the first device establishes a connection with the second device, the first device determines that the second device does not support separate image quality processing for different types of display content. Alternatively, if the first device reads the capability information of the second device, and the capability information includes information indicating that the second device does not support separate image quality processing for different types of display content, the first device determines that the second device does not support separate image quality processing for different types of display content.

[0075] In some other embodiments, when it is determined that the second device does not support separate image quality processing for different types of display content, the first device directly sends the first data frame to the second device, and then the second device uses the parameters of the same image quality algorithm to perform uniform image quality adjustment on the display screen corresponding to the first data frame. In this case, steps 202 to 205 are not executed.

[0076] Step 203: The first device sends a first data frame and content description information to the second device. Correspondingly, the second device receives the first data frame and content description information sent by the first device.

[0077] The content description information is used by the second device to adjust the image quality of the display image corresponding to the first data frame.

[0078] Step 204: The second device determines parameters of an image quality algorithm corresponding to each display content of the at least one display content according to the type of each display content of the at least one display content.

[0079] There are many implementations for step 204 , and two possible implementations are provided below.

[0080] In a possible implementation, the type of at least one display content is the first type, that is, the types corresponding to the at least one display content included in the first data frame are all of the same type, that is, the first type. For example, the first type is a video type or a UI type. The second device can determine the parameters of the first image quality algorithm according to the first type, and the parameters of the first image quality algorithm are used to adjust the image quality of the display screen corresponding to the first data frame.

[0081] In another possible implementation, at least one type of display content includes a first type and at least one second type, and any two of the at least one second type are different. There are at least two types of content in the at least one display content included in the first data frame, and the at least one type of display content includes two types, namely the first type and the second type. The second device determines the parameters of the first image quality algorithm according to the first type, and the second device determines the parameters of the second image quality algorithm according to the second type. The parameters of the first image quality algorithm are used to adjust the image quality of the display content corresponding to the first type in the display screen, and the parameters of the second image quality algorithm are used to adjust the image quality of the display content corresponding to the second type in the display screen.

[0082] The image quality algorithm corresponding to each display content involved in this application may include but is not limited to at least one of the following: a clarity algorithm; a contrast algorithm; a noise reduction algorithm; and a color adjustment algorithm.

[0083] Step 205 : The second device adjusts the image quality of the display screen corresponding to the first data frame according to the display layout information of each display content in the at least one display content in the first data frame and the parameters of the image quality algorithm.

[0084] The second device may traverse each display content in the first data frame according to the display layout information of each display content in the first data frame of at least one display content, and then adjust the image quality of the corresponding display content according to the parameters of the image quality algorithm corresponding to each display content.

[0085] by Figure 4 Taking the first data frame shown as an example, for example, video 1, video 2, video 3, and video 4 correspond to parameter 1 of the image quality algorithm, and UI1 corresponds to parameter 2 of the image quality algorithm. The second device can determine the area where video 1 is located according to the display layout information of video 1 in the first data frame, and then adjust the image quality of the area where video 1 is located according to parameter 1 of the image quality algorithm; determine the area where video 2 is located according to the display layout information of video 2 in the first data frame, and then adjust the image quality of the area where video 2 is located according to parameter 1 of the image quality algorithm; determine the area where video 3 is located according to the display layout information of video 3 in the first data frame, and then adjust the image quality of the area where video 3 is located according to parameter 1 of the image quality algorithm, determine the area where video 4 is located according to the display layout information of video 4 in the first data frame, and then adjust the image quality of the area where video 4 is located according to parameter 1 of the image quality algorithm, determine the area where UI1 is located according to the display layout information of UI1 in the first data frame, and then adjust the image quality of the area where UI1 is located according to parameter 2 of the image quality algorithm.

[0086] In an embodiment of the present application, in addition to receiving the first data frame, the second device also receives content description information corresponding to the first data frame, and can then determine the parameters of the corresponding image quality algorithm according to the type of each display content in the content description information, so as to adjust the image quality of each display content separately, thereby improving the image quality of the display screen.

[0087] Taking the first device as a set-top box and the second device as a television as an example, a specific example of a data processing method performed by a set-top box is provided below. Figure 6 As shown, the data processing method includes the following steps:

[0088] Step 601: The set-top box obtains the EDID of the TV and parses the EDID.

[0089] For example, the set-top box can obtain the EDID of the TV when performing HDMI handshake with the TV.

[0090] In some embodiments, if the TV supports separate processing of video and UI image quality, the TV will package its own flag of supporting separate processing of video and UI image quality in EDID, which will be read when shaking hands with the set-top box; if the TV does not support separate processing of video and UI image quality, the EDID of the TV does not include the flag of supporting separate processing of video and UI image quality. Alternatively, if the TV does not support separate processing of video and UI image quality, the EDID of the TV includes a flag of whether to support separate processing of video and UI image quality, and the flag indicates that separate processing of video and UI image quality is not supported. When the set-top box shakes hands with the TV, the EDID is obtained and parsed.

[0091] If the set-top box parses the flag that supports separate processing of video and UI image quality from EDID, it is determined that the TV supports separate processing of video and UI image quality; if the set-top box does not parse the flag that supports separate processing of video and UI image quality from EDID, or if the set-top box parses the flag of whether to support separate processing of video and UI image quality from EDID, and the flag indicates that separate processing of video and UI image quality is not supported, it is determined that the TV does not support separate processing of video and UI image quality.

[0092] In other embodiments, the EDID of the TV may include a flag for whether to support separate processing of video and UI image quality. For example, a value of 1 indicates that separate processing of video and UI image quality is supported, and a value of 0 indicates that separate processing of video and UI image quality is not supported. If the set-top box parses the EDID to find that the value of the flag for whether to support separate processing of video and UI image quality is 1, it is determined that the TV supports separate processing of video and UI image quality; if the set-top box parses the EDID to find that the value of the flag for whether to support separate processing of video and UI image quality is 0, it is determined that the TV does not support separate processing of video and UI image quality. In other embodiments, the value may be 1, indicating that separate processing of video and UI image quality is not supported, and the value may be 0, indicating that separate processing of video and UI image quality is supported, and this application does not limit this.

[0093] The "flag for supporting separate processing of video and UI image quality" involved in the embodiments of the present application may also be referred to as an image quality processing flag, and other implementation methods may also be adopted, which is not limited in the present application.

[0094] Step 602, the set-top box determines whether the TV supports separate processing of video and UI image quality; if so, execute step 603; if not, execute step 605;

[0095] Step 603, the set-top box calculates / counts the type of each video content in at least one video content in each data frame to be sent and the display layout information of each video content in the first data frame, as well as the type of each UI content in at least one UI content and the display layout information of each UI content in the first data frame.

[0096] For example, for a data frame, the display layout information of at least one video content includes the video coordinates, width, height, and transparency information of each video content in the at least one video content, and the display layout information of at least one UI content includes the video coordinates, width, height, and transparency information of each UI content in the at least one UI content. It should be understood that the present application does not limit the name of the display layout information, nor does it limit the specific information included in the display layout information, such as the location information of one or more groups of videos and the location information and transparency information of UI content, as long as the television can perform image quality processing on each display content included in the first data frame respectively.

[0097] Step 604: After the HDMI channel between the set-top box and the television is established, the set-top box sends a plurality of data frames and an HDMI information frame packet corresponding to each data frame to the television.

[0098] Taking the first data frame as an example, the HDMI information frame packet includes the type of each video content in at least one video content in the first data frame and the display layout information of each video content in the first data frame, as well as the type of each UI content in at least one UI content and the display layout information of each UI content.

[0099] In an embodiment of the present application, the set-top box can send the location information of one or more groups of videos and the location information, transparency information, etc. of the UI content to the TV using an HDMI information frame packet, or can send it to the TV in other ways.

[0100] Step 605: After the HDMI channel between the set-top box and the television is established, the set-top box sends a plurality of data frames to the television.

[0101] Through the above example, when the set-top box sends each data frame (for example, the first data frame) to the TV, the type of each video content in at least one video content in the first data frame and the display layout information of each video content in the first data frame, as well as the type of each UI content in at least one UI content and the display layout information of each UI content in the first data frame are encapsulated into an HDMI information frame packet, and the HDMI information frame packet is also sent to the TV, thereby informing the TV of the type and display layout information of each content in the first data frame through the HDMI information frame packet, so that the TV can know to adjust the picture quality of each content according to the type and display layout information of each content in the first data frame, thereby improving the picture quality of the displayed picture.

[0102] Based on the above Figure 6 , a specific example of a data processing method performed by a television is provided below. Figure 7 As shown, the data processing method includes the following steps:

[0103] Step 701: After the HDMI channel between the set-top box and the television is established, the television receives at least one data frame and an HDMI information frame packet corresponding to each data frame.

[0104] When the set-top box receives each data frame, it will also receive the HDMI information frame packet corresponding to the data frame. The following steps are described using the first data frame as an example.

[0105] Step 702: The TV parses the HDMI information frame packet corresponding to the first data frame to obtain the type of each video content in at least one video content in the first data frame and the display layout information of each video content in the first data frame, as well as the type of each UI content in at least one UI content and the display layout information of each UI content in the first data frame.

[0106] Step 703: The television traverses the video area and the UI area in the first data frame according to the display layout information of each video content in the at least one video content and the display layout information of each UI content in the at least one UI content in the first data frame.

[0107] Step 704 , the TV determines whether all video areas and UI areas have been traversed; if so, the process ends; if not, step 705 is executed.

[0108] Step 705: The television determines parameters of a first image quality algorithm according to the type of at least one video content, and determines parameters of a second image quality algorithm according to the type of at least one UI content.

[0109] Step 706: The television adjusts the image quality of each video area in the display image corresponding to the first data frame according to the parameters of the first image quality algorithm, and adjusts the image quality of each UI area in the display image corresponding to the first data frame according to the parameters of the second image quality algorithm.

[0110] Step 707: the television displays the display picture corresponding to the first data frame after the picture quality is adjusted. Then, the process ends.

[0111] The embodiments of the present application do not limit the specific strategy for adjusting the image quality of each display content (such as video and / or UI content), as long as the image quality settings can be adaptively adjusted according to the type, position information, transparency information, etc. corresponding to each display content.

[0112] In order to implement the functions of the method provided in the above embodiment of the present application, the first device and the second device may include a hardware structure and / or a software module, and implement the above functions in the form of a hardware structure, a software module, or a hardware structure plus a software module. Whether one of the above functions is executed in the form of a hardware structure, a software module, or a hardware structure plus a software module depends on the specific application and design constraints of the technical solution.

[0113] The following describes the device used to implement the above method in the embodiment of the present application in conjunction with the accompanying drawings. Therefore, the above content can be used in subsequent embodiments, and the repeated content will not be repeated.

[0114] Figure 8 A schematic diagram of the structure of the device 800 provided in the embodiment of the present application. Figure 8 As shown, it includes a processing module 801 and a communication module 802.

[0115] In some examples, the apparatus 800 is used to implement Figure 2The function of the first device or the second device in the method shown. The device 800 may be the first device or a device integrated in the first device, or the device 800 may be the second device or a device integrated in the second device. For example, the device 800 may be a chip system. In the embodiment of the present application, the chip system may be composed of a chip, or may include a chip and other discrete devices.

[0116] For example, when the device 800 is Figure 2 In the method shown, when the first device is connected, the processing module 801 is used to obtain a first data frame and determine content description information corresponding to the first data frame, wherein the first data frame includes at least one display content, and the content description information includes the type of each display content in the at least one display content and the display layout information of each display content in the first data frame. The communication module 802 is used to send the first data frame and the content description information to the second device, wherein the content description information is used to adjust the image quality of the display screen corresponding to the first data frame.

[0117] For another example, when the device 800 is Figure 2 When the second device in the method shown is used, the communication module 802 is used to receive the first data frame and the content description information. The processing module 801 is used to determine the parameters of the image quality algorithm corresponding to each display content in the at least one display content according to the type of each display content in the at least one display content, and adjust the image quality of the display screen corresponding to the first data frame according to the display layout information of each display content in the at least one display content in the first data frame and the parameters of the image quality algorithm corresponding to each display content. Optionally, when the device 800 is Figure 2 When the second device in the method shown is used, the apparatus 800 may further include a display module 803 for displaying a display screen of the first data frame.

[0118] For the specific execution process of the processing module 801 and the communication module 802, please refer to the description in the above method embodiment. The division of modules in the embodiments of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation. In addition, the functional modules in the various embodiments of the present application can be integrated into a processor, or they can exist physically separately, or two or more modules can be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware or in the form of software functional modules. For example, the processing module 801 can be composed of Fig. 9 The communication module 802 may be implemented by the processor 910 of Fig. 9 The display module 803 can be implemented by the communication interface 930 of Fig. 9 The display screen 950 is realized.

[0119] Same as above idea, Fig. 9As shown, an embodiment of the present application further provides an apparatus 900, including a processor 910, for implementing the functions of the first device or the second device in the above method. For details, please refer to the detailed description in the method, which will not be described here.

[0120] In some embodiments, the device 900 may also include a memory 920 for storing computer programs and / or data. The computer program includes instructions. The memory 920 is coupled to the processor 910. The coupling in the embodiment of the present application is an interval coupling or communication connection between devices, units or modules, which can be electrical, mechanical or other forms, and is used for information exchange between devices, units or modules. As another implementation, the memory 910 can also be located outside the device 900. The processor 910 can operate in conjunction with the memory 920. The processor 910 may execute instructions stored in the memory 920. Alternatively, the memory 920 may be included in the processor 910.

[0121] In some embodiments, the device 900 may further include a communication interface 930 for communicating with other devices through a transmission medium, so that the device used in the device 900 can communicate with other devices or apparatuses. Exemplarily, the communication interface 930 may be a transceiver, circuit, bus, module or other type of communication interface, and the processor 910 uses the communication interface 930 to send and receive information and implement the method in the above embodiment. For example, when the device 900 is a first device, the other device or apparatus may be a second device, and the communication interface 930 may be used to send a first data frame and corresponding content description information to the second device; for another example, when the device 900 is a second device, the other device or apparatus may be a first device, and the communication interface 930 may be used to receive a first data frame and corresponding content description information sent by the first device.

[0122] The embodiment of the present application does not limit the connection medium between the communication interface 930, the processor 910 and the memory 920. Fig. 9 The memory 920, the processor 910 and the communication interface 930 may be connected via a bus 940, which may be divided into an address bus, a data bus, a control bus, etc. Optionally, when the apparatus 900 is a second device, the apparatus 900 may further include a display screen 950 for displaying a display screen corresponding to the first data frame.

[0123] It should be understood that the processor 910 may be a chip. For example, the processor may be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processor unit (CPU), a network processor (NP), a digital signal processor (DSP), a micro controller unit (MCU), a programmable logic device (PLD), or other integrated chips.

[0124] Processor 910 may be an integrated circuit chip with signal processing capability. In the implementation process, each step of the above method embodiment may be completed by an integrated logic circuit of hardware in the processor or an instruction in the form of software. The above processor may be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component. The methods, steps and logic block diagrams disclosed in the embodiments of the present application may be implemented or executed. A general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc. The steps of the method disclosed in conjunction with the embodiments of the present application may be directly embodied as being executed by a hardware decoding processor, or may be executed by a combination of hardware and software modules in a decoding processor. The software module may be located in a mature storage medium in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in a memory, and the processor reads the information in the memory and completes the steps of the above method in conjunction with its hardware.

[0125] It can be understood that the memory in the embodiments of the present application can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), and direct RAM (DR RAM). It should be noted that the memory of the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.

[0126] An embodiment of the present application further provides a readable storage medium, in which a program is stored. When the program is run on a computer, the computer executes the method in any one of the above embodiments.

[0127] An embodiment of the present application further provides a computer program product, which includes: a computer program code, and when the computer program code is run on a computer, the computer executes the method in any one of the above embodiments.

[0128] In addition, an embodiment of the present application also provides a device, which can specifically be a chip, component or module, and the device may include a connected processor and memory; wherein the memory is used to store instructions, and when the device is running, the processor can execute the computer-executable instructions stored in the memory so that the chip executes the methods in the above-mentioned method embodiments.

[0129] Among them, the electronic device, computer storage medium, computer program product or chip provided in the embodiments of the present application are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0130] Through the description of the above implementation methods, technical personnel in the relevant field can understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0131] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of modules or units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0132] The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0133] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0134] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to perform all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.

[0135] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A data processing method, characterized in that: Applied to a first device, the method includes: Acquire a first data frame, where the first data frame includes at least one display content; Determine content description information corresponding to the first data frame, where the content description information includes a type of each display content in the at least one display content and display layout information of each display content in the first data frame; The first data frame and the content description information are sent to a second device, where the content description information is used to adjust the image quality of a display image corresponding to the first data frame.

2. The method according to claim 1, characterized in that Before determining the content description information corresponding to the first data frame, the method further includes: It is determined that the second device supports separate image quality processing for different types of display content.

3. The method according to claim 2, characterized in that The determining that the second device supports respectively performing image quality processing on different types of display content includes: If the first device establishes a connection with the second device, and the first device reads the capability information of the second device, it is determined that the second device supports separate image quality processing for different types of display content.

4. The method according to any one of claims 1 to 3, characterized in that: The display layout information of each display content in the first data frame includes: Position information of each display content in the first data frame, size information of each display content, and transparency information of each display content.

5. The method according to any one of claims 1 to 4, characterized in that: The at least one display content includes video content and / or UI content.

6. The method according to any one of claims 1 to 5, characterized in that: The first device includes any one of the following: Set-top box; split TV box end; smart middle screen; set-top box with screen; smart speaker.

7. A data processing method, characterized in that: Applied to the second device, the method includes: Receive a first data frame and content description information sent by a first device, wherein the first data frame includes at least one display content, and the content description information includes a type of each display content in the at least one display content and display layout information of each display content in the first data frame; Determining, according to the type of each display content in the at least one display content, a parameter of an image quality algorithm corresponding to each display content in the at least one display content; The image quality of the display picture corresponding to the first data frame is adjusted according to the display layout information of each display content in the at least one display content in the first data frame and the parameters of the image quality algorithm corresponding to each display content.

8. The method according to claim 7, characterized in that The type of the at least one displayed content is a first type; The determining, according to the type of each display content in the at least one display content, parameters of the image quality algorithm corresponding to the at least one display content respectively comprises: According to the first type, parameters of a first image quality algorithm are determined, where the parameters of the first image quality algorithm are used to adjust the image quality of the display image.

9. The method according to claim 7, characterized in that The type of the at least one displayed content includes a first type and a second type; The determining, according to the type of each display content in the at least one display content, parameters of the image quality algorithm corresponding to the at least one display content respectively comprises: Determining parameters of a first image quality algorithm according to the first type, wherein the parameters of the first image quality algorithm are used to adjust the image quality of display content corresponding to the first type in the display picture; According to the second type, parameters of a second image quality algorithm are determined, where the parameters of the second image quality algorithm are used to adjust the image quality of display content corresponding to the second type in the display picture.

10. The method according to any one of claims 7 to 9, characterized in that: The image quality algorithm corresponding to each of the display contents includes at least one of the following: Clarity algorithm; contrast algorithm; noise reduction algorithm; color adjustment algorithm.

11. The method according to any one of claims 7 to 10, characterized in that: The at least one display content includes video content and / or UI content.

12. The method according to any one of claims 7 to 11, characterized in that: The second device is a display terminal.

13. A device, characterized in that: include: A processing module, configured to acquire a first data frame, wherein the first data frame includes at least one display content; Determine content description information corresponding to the first data frame, where the content description information includes a type of each display content in the at least one display content and display layout information of each display content in the first data frame; The communication module is used to send the first data frame and the content description information to the second device, where the content description information is used to adjust the image quality of the display image corresponding to the first data frame.

14. The device according to claim 13, characterized in that The processing module is further used for: It is determined that the second device supports separate image quality processing for different types of display content.

15. The device according to claim 14, characterized in that The processing module is specifically used for: If the capability information of the second device is read when the first device establishes a connection with the second device, it is determined that the second device supports separate image quality processing for different types of display content.

16. The device according to any one of claims 13 to 15, characterized in that: The display layout information of each display content in the first data frame includes: Position information of each display content in the first data frame, size information of each display content, and transparency information of each display content.

17. The device according to any one of claims 13 to 16, characterized in that: The at least one display content includes video content and / or UI content.

18. The device according to any one of claims 13 to 17, characterized in that: The device comprises any of the following: Set-top box; split TV box end; smart middle screen; set-top box with screen.

19. A device, characterized in that: include: a communication module, configured to receive a first data frame and content description information sent by a first device, wherein the first data frame includes at least one display content, and the content description information includes a type of each display content in the at least one display content and display layout information of each display content in the first data frame; A processing module is used to determine the parameters of the image quality algorithm corresponding to each display content in the at least one display content according to the type of each display content in the at least one display content; and adjust the image quality of the display screen corresponding to the first data frame according to the display layout information of each display content in the at least one display content in the first data frame and the parameters of the image quality algorithm corresponding to each display content.

20. The device according to claim 19, characterized in that The type of the at least one displayed content is the first type; and the processing module is specifically configured to: According to the first type, parameters of a first image quality algorithm are determined, where the parameters of the first image quality algorithm are used to adjust the image quality of the display image.

21. The device according to claim 19, characterized in that The type of the at least one displayed content includes a first type and a second type; the processing module is specifically configured to: Determining parameters of a first image quality algorithm according to the first type, wherein the parameters of the first image quality algorithm are used to adjust the image quality of display content corresponding to the first type in the display picture; According to the second type, parameters of a second image quality algorithm are determined, where the parameters of the second image quality algorithm are used to adjust the image quality of display content corresponding to the second type in the display picture.

22. The device according to any one of claims 19 to 21, characterized in that The image quality algorithm corresponding to each of the display contents includes at least one of the following: Clarity algorithm; contrast algorithm; noise reduction algorithm; color adjustment algorithm.

23. The device according to any one of claims 19 to 22, characterized in that The at least one display content includes video content and / or UI content.

24. The device according to any one of claims 19 to 23, characterized in that The device is a display terminal.

25. A device, characterized in that: The device includes a memory, a processor and a communication interface, wherein the memory stores one or more computer programs, and the one or more computer programs include instructions; the processor is used to execute the instructions and call the communication interface, so that the device executes the method according to any one of claims 1 to 12.

26. A computer-readable storage medium, characterized in that: The computer-readable storage medium comprises a computer program, and when the computer program is executed on a computer, the computer is caused to execute the method according to any one of claims 1 to 12.

Images