Video transmission method, video display method and equipment

Abstract

The invention discloses a video transmission method, a video display method and equipment, and relates to the technical field of multimedia. The source device and the display device are connected through the UMI bus, video transmission in the ARGB format can be supported, and compared with a DP protocol and an HDMI protocol which only support transmission in the RGB video format or transmission in the YUV video format obtained by converting the RGB video format, the video transmission formats which can be supported and realized by the source device are enriched. Furthermore, the display equipment does not need to consume more computing power to analyze and calculate the video in the RGB video format or the YUV video format to obtain the transparency, so that the computing power consumption of the display equipment is reduced, the picture optimization efficiency in the video display process is improved, and the user experience is improved. The display effect of the video in the display equipment is improved, and the video watching experience of a user is improved.

Description

Technical Field

[0001] The present application relates to the field of multimedia technology, and in particular to a video transmission method, a video display method and a device. Background Art

[0002] With the development of big data, artificial intelligence (AI), and cloud computing technology, various types of multimedia data continue to emerge. Taking the wired transmission of video data between different devices as an example, different devices can use a display port (DP) bus or a high definition multimedia interface (HDMI) bus to transmit video data. When a display device plays a video, the display device determines the transparency (alpha) of each frame of the video according to the RGB (red green blue) information in the video, and adjusts the image displayed in the display device based on the transparency to improve the display effect of the video. However, since the DP protocol and the HDMI protocol only support the transmission of the RGB video format or the YUV video format obtained by converting the RGB video format, the display device needs to parse and calculate the video in the RGB video format or the YUV video format to obtain the transparency, which occupies the processing resources of the display device, and the picture optimization efficiency of the display device during the video display process is affected. Summary of the invention

[0003] The present application provides a video transmission method, a video display method and a device, which solves the problem that the display device needs to parse and calculate the video in RGB video format or YUV video format to obtain transparency, which affects the picture optimization efficiency during the video display process.

[0004] This application adopts the following technical solution.

[0005] In the first aspect, the present application provides a video transmission method. The video transmission method is executed by a source device, and the source device is connected to a display device through a first bus. The video transmission method includes: the source device generates a video stream to be sent; and sends the video stream to the display device through the first bus. Wherein, the video stream includes one or more video frames, each video frame includes: one or more vertical blanking packets (vertical blanking packets, VBP or VBP packets), and multiple active video packets (active video packets, AVP or AVP packets); the VBP packet carries: an identifier indicating that the format of multiple AVP packets is ARGB format, and the ARGB format includes: red (Red, R) component, green (Green, G) component, blue (Blue, B) component and transparency (alpha, A) component.

[0006] The source device and display device in this application are connected through the UMI bus and can support video transmission in ARGB format. Compared with the DP protocol and HDMI protocol, which only support the transmission of RGB video format or YUV video format obtained by converting RGB video format, the source device can support more video transmission formats. Furthermore, the display device does not need to consume more computing power to parse and calculate the transparency of the video in RGB video format or YUV video format, which reduces the computing power consumption of the display device, is conducive to improving the picture optimization efficiency during the video display process, improving the display effect of the video in the display device, and improving the user's experience of watching the video.

[0007] In a second aspect, the present application provides a video display method. The video display method is executed by a display device, and the display device is connected to a source device through a first bus. The video display method includes: the display device receives a video stream sent by a source device; the video stream includes one or more video frames, and each video frame includes: one or more vertical blanking messages VBP messages, and multiple valid video messages AVP messages; the VBP message carries: an identifier indicating that the format of multiple AVP messages is ARGB format, and the ARGB format includes: R component, G component, B component and A component; and the display device parses and displays multiple AVP messages in the video stream according to the ARGB format indicated by the identifier.

[0008] Since the VBP message in the video frame identifies the AVP format as ARGB format, and the ARGB format includes: R component, G component, B component and A component (transparency component), the display device does not need to consume more computing power to parse and calculate the transparency of the video in RGB video format or YUV video format, which reduces the computing power consumption of the display device, is conducive to improving the picture optimization efficiency during the video display process, improving the display effect of the video in the display device, and improving the user's video viewing experience.

[0009] In combination with the video transmission method provided in the first aspect or the video display method provided in the second aspect, in an optional implementation, the above-mentioned VBP message includes a pixel format field, and the pixel format field carries the above-mentioned identifier. The format of the marked AVP message is identified by a specific field, so that the source device and the display device can determine the parsing method of the AVP message according to the identifier recorded in the specific field, thereby improving the efficiency of video parsing.

[0010] In combination with the video transmission method provided in the first aspect or the video display method provided in the second aspect, in an optional implementation, the tail of the above-mentioned VBP message carries a cyclic redundancy check (CRC), which is used to verify the accuracy of the VBP message.

[0011] In combination with the video transmission method provided in the first aspect or the video display method provided in the second aspect, in an optional implementation manner, the first bus provided in the present application is a unified multimedia interconnection interface (UMI) bus.

[0012] In combination with the video transmission method provided in the first aspect or the video display method provided in the second aspect, in an optional implementation method, the color depth (bit per component, bpc) of the ARGB format is M, then a group of pixel components in multiple AVP messages include: M-bit R components, M-bit G components, M-bit B components and M-bit A components, where M is a positive integer.

[0013] In a first possible example, the value of M is 8, the format of the AVP message is: ARGB 8bpc, and a group of pixel components includes: an 8-bit R component, an 8-bit G component, an 8-bit B component, and an 8-bit A component.

[0014] In a second possible example, the value of M is 10, the format of the AVP message is: ARGB 10bpc, and a set of pixel components includes: a 10-bit R component, a 10-bit G component, a 10-bit B component and a 10-bit A component.

[0015] In a third possible example, the value of M is 12, the format of the AVP message is: ARGB 12bpc, and a set of pixel components includes: a 12-bit R component, a 12-bit G component, a 12-bit B component and a 12-bit A component.

[0016] In a fourth possible example, the value of M is 16, the format of the AVP message is: ARGB 16bpc, and a group of pixel components includes: a 16-bit R component, a 16-bit G component, a 16-bit B component and a 16-bit A component.

[0017] The above four examples are only possible values ​​of M provided in this application, and it should not be understood that M can only take values ​​from the above 8, 10, 12 and 16.

[0018] In combination with the video transmission method provided in the first aspect or the video display method provided in the second aspect, in an optional implementation method, the AVP message in each of the aforementioned video frames includes one or more rows. If the pixel components included in the ARGB format cannot completely fill the last AVP message in the Nth row of the AVP message, the unfilled pixel portion in the last 32 bits of the last AVP message is 0, and the Nth row is one of the one or more rows.

[0019] In a third aspect, the present application provides a video device, which includes a module for executing the method of any one of the implementation modes of the first aspect or the second aspect.

[0020] In a fourth aspect, the present application provides a video processing device. The video processing device includes: a memory, a transceiver, and a processor. The processor is used to generate a video stream to be sent; the memory is used to cache the video stream; the transceiver is used to send the video stream; the memory, the transceiver, and the processor are used to collaboratively execute the method in the first aspect or any optional implementation of the first aspect. Exemplarily, the video processing device is used to implement the function of the source device in the first aspect.

[0021] In a fifth aspect, the present application provides a display device. The display device includes: a transceiver and a display unit. The transceiver is used to receive a video stream through a first bus; the video stream includes one or more video frames, each video frame includes: one or more VBP messages, and multiple AVP messages; the VBP message carries: an identifier indicating that the format of multiple AVP messages is ARGB format, and the ARGB format includes: R component, G component, B component and A component. The display unit is used to process and display the video stream. The transceiver and the display unit are used to collaboratively execute the method in the second aspect or any optional implementation of the second aspect. Exemplarily, the display device is used to implement the function of the display device in the second aspect.

[0022] In a sixth aspect, the present application provides a video transmission system. The video transmission system includes a source device provided in the fourth aspect and a display device provided in the fifth aspect, the source device and the display device are connected via a bus, the source device can be used to implement the function of the source device in the first aspect or the second aspect, and the display device can be used to implement the function of the display device in the first aspect or the second aspect. Therefore, the video transmission system can also achieve the beneficial effects of the methods in the first aspect and the second aspect, which will not be described in detail here.

[0023] In a seventh aspect, the present application provides a computer-readable storage medium. The computer-readable storage medium includes: computer software instructions. When the computer software instructions are executed in a computing device, the computing device executes the operation steps of the method in the first aspect or any possible implementation of the first aspect, and executes the operation steps of the method described in the second aspect or any possible implementation of the second aspect. For example, the computing device is the aforementioned source device or display device, etc.

[0024] In an eighth aspect, the present application provides a computer program product. When the computer program product is run on a computer, the computing device executes the operation steps of the method in the first aspect or any possible implementation of the first aspect, and executes the operation steps of the method described in the second aspect or any possible implementation of the second aspect. For example, the computer is the aforementioned source device or display device, etc.

[0025] Regarding the beneficial effects of the third to eighth aspects, reference may be made to the description of any implementation in the first or second aspect, and no further description is given here. Based on the implementations provided in the above aspects, this application may be further combined to provide more implementations. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 A schematic diagram of a video transmission system provided for this application;

[0027] Figure 2 A schematic diagram of an audio and video encoding and decoding system provided by the present application;

[0028] Figure 3 A schematic diagram of a video transmission method provided by the present application;

[0029] Figure 4 A schematic diagram of the structure of a video frame provided in this application;

[0030] Figure 5 A schematic diagram of the effect of screen optimization provided by this application;

[0031] Figure 6 A schematic diagram of an ARGB 8bpc video data arrangement provided for this application;

[0032] Figure 7 A schematic diagram of an ARGB 10bpc video data arrangement provided in this application;

[0033] Figure 8 A schematic diagram of an ARGB 12bpc video data arrangement provided for this application;

[0034] Fig. 9A schematic diagram of an ARGB 16bpc video data arrangement provided for this application;

[0035] Fig.10 A schematic diagram of the structure of a video device provided by the present application;

[0036] Fig.11 A schematic diagram of the structure of the video processing device provided for this application;

[0037] Fig.12 This is a schematic diagram of the structure of the display device provided in this application. DETAILED DESCRIPTION

[0038] The present application provides a video transmission method, wherein a source device can directly read the capability description information of a display device through a bus, and send a video stream to the display device only when the capability description information indicates that the display device supports processing ARGB information. The VBP message in the video stream indicates that the format of the AVP message is ARGB format, and the pixel components in the ARGB format include: R component, G component, B component and A component.

[0039] Specifically, compared with the DP protocol and HDMI protocol which only support the transmission of RGB video format or YUV video format obtained by converting RGB video format, the source device and display device in the present application are connected through the UMI bus and can support video transmission in ARGB format, enriching the video transmission formats that the source device can support and implement. As a result, the display device does not need to consume more computing power to parse and calculate the transparency of the video in RGB video format or YUV video format, which reduces the computing power consumption of the display device, and is conducive to improving the picture optimization efficiency during the video display process, improving the display effect of the video in the display device, and improving the user's experience of watching the video.

[0040] The technical solutions involved in this application may not only be applied to current audio and video transmission technologies or audio and video standards, but may also be applied to future audio and video transmission technologies or audio and video standards. The terms used in the implementation methods of this application are only used to explain the specific embodiments of this application and are not intended to limit this application. The following is a brief introduction to some concepts that may be involved in this application.

[0041] Video streaming refers to the transmission of video data, for example, a video stream can be processed as a stable and continuous stream through a network. A video stream includes multiple video frames, each of which corresponds to a frame of image.

[0042] Descriptive information packet (DIP or DIP message): used to describe different data in a data packet.

[0043] Color information: Information used to describe the different colors of the video screen, such as red, green, or blue.

[0044] Transparency (alpha) refers to the degree of transparency of a transparent display, that is, the degree of transparency of the display device background or display background.

[0045] In this embodiment, video is a general term, and video includes a sequence of multiple continuous frames, where one frame corresponds to one image. Video and audio are information application technology terms, and refer to video, audio, or multimedia content including video and audio.

[0046] In order to make the description of the following embodiments clear and concise, an introduction to the related art is first given.

[0047] Figure 1 A schematic diagram of a video transmission system provided by the present application. The video processing process may include but is not limited to: video acquisition, video encoding, video transmission, video decoding and playback process.

[0048] Figure 1 The video and audio transmission system in the embodiment includes a set-top box 110, a smart TV 120, a plurality of video and audio playback devices and a server 130. The set-top box 110 is connected to the operator network through a network cable and can receive video and audio streams from the server 130. The network can realize the function of video and audio transmission, and the network can include one or more network devices, such as a network device 131 which can be a router or a switch. In some optional implementations, the set-top box 110 and the server 130 can also communicate through wireless communication, which is not limited in this application.

[0049] The set-top box 110 is a video and audio processing device, which is used to realize functions such as receiving, processing and pushing video streams or video and audio streams. In some possible situations, the set-top box 110 may also be called an Internet TV set-top box, a network high-definition player or other. Exemplarily, the set-top box 110 may refer to a TV box provided by a network operator or a TV box purchased by a user. For the hardware implementation of the set-top box 110, please refer to the following Fig.11 The description is not repeated here.

[0050] Smart TV 120 is a display device with video and audio processing functions, which realizes functions such as receiving, processing, pushing and playing video streams or video and audio streams. In some possible situations, the smart TV 120 may refer to video and audio devices such as conference tablets, smart TVs or projectors, which are not limited in this application. For the hardware implementation of smart TV 120, please refer to the following Fig.11 or Fig.12The description is not repeated here.

[0051] The plurality of video and audio playback devices include: video and audio playback devices 121 to video and audio playback devices 124. For example, these video and audio playback devices may include but are not limited to: a multimedia control platform or other devices supporting video and audio playback functions, such as a virtual reality (VR) terminal device or an augmented reality (AR) terminal device, etc. For the hardware implementation of the video and audio playback device, please refer to the following Fig.12 The description is not repeated here.

[0052] In this embodiment, the set-top box 110 and the smart TV 120 may be connected via a bus 125, the set-top box 110 and each video and audio playback device may also be connected via the bus 125, and the smart TV 120 and each video and audio playback device may also be connected via the bus 125. Exemplarily, the bus 125 may be a data bus supporting video and video and audio transmission, for example, the bus 125 is a UMI bus.

[0053] The UMI bus refers to a bus connected based on the UMI interface provided by the source device and the sink device. The UMI bus can be used to connect a charger to charge electronic devices (such as the above-mentioned smart TV, set-top box or audio and video playback device), and can also be used to transmit data between electronic devices and peripheral devices. It can also be used to connect headphones and play audio through headphones. The above-mentioned UMI interface can also be used to connect other electronic devices, such as AR devices, etc.

[0054] When the UMI bus is used to implement data communication functions between devices, the UMI bus can support uncompressed video and compressed video transmission, and can also support various advanced features such as Quick Video Transport (QVT), Auto Low Latency Mode (ALLM), and Dynamic Frame Rate Refresh (DFR). In addition, the UMI bus can also support LPCM format audio and video defined by IEC 60958 and various high-dynamic range (HDR) protocols, such as the HDR protocol specified in T / UWA 005.1-2022, such as HDR Vivid, etc. UMI also supports encryption control protection for data transmission such as audio and video. In some optional implementations, the bus 125 may also refer to other types of buses that can implement the functions supported by the above-mentioned UMI bus.

[0055] The server 130 may be an application server or an authentication and authorization server. The server 130 may provide video services, game services, message services, music services, authentication and authorization services, etc. In one example, the functions of multiple services may be integrated on the server 130, for example, game services and music services may be deployed on the server 130. In another example, the functions of some services may be integrated on the server 130, for example, some services of the game service and some services of the video service may be deployed on the server 130. The server 130 may also provide multiple virtual machines using virtualization technology, and various services are provided by the virtual machines. The embodiments of the present application do not limit the deployment form of the server. The network device 131 is connected to the server 130 wirelessly or wiredly. Figure 1 This is just a schematic diagram. The network can also include other devices. Figure 1 Not drawn in.

[0056] It can be understood that the above-mentioned video and audio is a general term. The video and audio include multiple video frames. One video frame corresponds to a group of messages, and the group of messages carries the video and audio data to be parsed and played. Figure 1 This is just a schematic diagram. The video and audio transmission system may also include other equipment. Figure 1 The embodiments of the present application do not limit the number and type of each device included in the system.

[0057] exist Figure 1 The audio and video transmission system shown is based on Figure 2 This is a schematic diagram of an audio and video codec system provided by the present application. The audio and video codec system includes a source device 210 and a sink device 220. The source device 210 establishes a communication connection with the sink device 220 via a UMI bus.

[0058] The source device 210 can implement the video and audio encoding function, such as Figure 1 As shown, the source device 210 may be a set-top box 110 or a smart TV 120 . The source device 210 may also be an audio and video control center with audio and video encoding capabilities. For example, the audio and video control center includes one or more servers.

[0059] The source device 210 may include a data source 211 , a pre-processing module 212 , an audio and video transmission adapter 213 , and a communication interface 214 .

[0060] The data source 211 may include or may be any type of electronic device for collecting audio and video, and / or any type of source audio and video generating device, such as a computer graphics processor for generating computer animation scenes or any type of device for acquiring and / or providing source audio and video, or computer generating source audio and video. The data source 211 may be any type of memory or storage for storing the above-mentioned source audio and video. The above-mentioned source audio and video may include multiple audio and video streams or images obtained by multiple audio and video acquisition devices (such as cameras), such as ultra high definition (UHD) video, high definition (HD) video, 4K video, etc.

[0061] The preprocessing module 212 is used to receive source video and audio, and preprocess the source video and audio to obtain video and audio or multiple frames of images. For example, the preprocessing performed by the preprocessing module 212 may include color format conversion (e.g., conversion from RGB to YCbCr), octree structuring, video and audio splicing, audio track merging and deletion, or channel number adjustment, etc.

[0062] The video and audio transmission adapter 213 is used to receive video and audio or images, and encode the video and audio, images or images to obtain coded data. In some optional situations, the coded stream (coded data) obtained by encoding can also be called a bit stream. If the coded data is obtained by encoding the video and audio data, the bit stream refers to the video and audio stream.

[0063] The communication interface 214 in the source device 210 may be used to receive encoded data (such as a video stream or an audio / video stream), and send the encoded data (or a version of the encoded data after any other processing) to another device such as the sink device 220 or any other device through a UMI bus for storage, display, playback, or image reconstruction.

[0064] exist Figure 2 In the example of , the video and audio transmission adapter 213 and the communication interface 214 in the source device 210 may be referred to as the UMI controller of the source device 210 , and the video and audio reception adapter 223 and the communication interface 223 in the sink device 220 may be referred to as the UMI controller of the sink device 220 .

[0065] Optionally, the source device 210 includes a bitstream buffer, which is used to store bitstreams corresponding to one or more coding units.

[0066] The above-mentioned sink device 220 can realize the function of video and audio decoding, such as Figure 1 As shown, the sink device 220 may be Figure 1 Any of the smart TV 120 or audio and video playback devices shown.

[0067] The sink device 220 may include a video and audio playback unit 221 , a post-processing module 222 , a video and audio receiving adapter 223 , and a communication interface 224 .

[0068] The communication interface 224 in the sink device 220 is used to receive the encoded data (or a version of the encoded data after any other processing is performed on the encoded data) from the source device 210 or any other source device such as a storage device.

[0069] The communication interface 214 and the communication interface 224 may be used to communicate via a direct communication link between the source device 210 and the sink device 220, such as a direct wired connection. Figure 2 For more information about the UMI bus, see Figure 1 The description is not repeated here.

[0070] The communication interface 224 corresponds to the communication interface 214, for example, and can be used to receive transmission data and process the transmission data using any type of corresponding transmission decoding or processing and / or decapsulation to obtain encoded data (such as a video stream or an audio / video stream).

[0071] The communication interface 224 and the communication interface 214 can be configured as follows: Figure 2 The unidirectional communication interface indicated by the arrow pointing from the source device 210 to the corresponding UMI bus of the sink device 220, or the bidirectional communication interface, can be used to send and receive messages, etc. to establish a connection, confirm and exchange any other information related to the communication link, or data transmission such as encoded compressed data transmission, etc.

[0072] The video and audio receiving adapter 223 is used to receive encoded data and decode the encoded data to obtain decoded data (video or video and audio, etc.).

[0073] The post-processing module 222 is used to post-process the decoded data to obtain post-processed data (such as an image to be displayed or an audio and video to be played). The post-processing performed by the post-processing module 222 may include, for example, color format conversion (such as conversion from YCbCr to RGB), octree reconstruction, audio and video splitting and fusion, etc., or any other processing for generating data for output by the audio and video playback unit 221.

[0074] The video and audio playback unit 221 is used to receive post-processed data for display or playback to a user or viewer, etc. The video and audio playback unit 221 may be or include any type of display for representing the reconstructed image, such as an integrated or external display screen or display. For example, the display screen may include a liquid crystal display (LCD), an organic light emitting diode (OLED) display, a plasma display, a projector, a micro LED display, a liquid crystal on silicon (LCoS), a digital light processor (DLP), or any other type of display screen. The video and audio playback unit 221 may also include one or more video and audio playback modules, each of which may refer to a speaker, an intelligent speaker, an amplifier, etc.

[0075] As an optional implementation, the source device 210 and the sink device 220 may transmit the encoded data through a data forwarding device. For example, the data forwarding device may be a router or a switch. It is worth noting that the data forwarding device needs to support the UMI interface. It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present application is only a schematic illustration and does not constitute a structural limitation on the source device and the sink device. In other embodiments of the present application, the structural limitation of the source device and the sink device may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0076] The implementation of the video transmission method provided in the embodiment of the present application will be described in detail below with reference to the accompanying drawings.

[0077] Here, the video transmission method of the embodiment of the present application is as follows: Figure 2 The source device 210 and the sink device 220 are shown as an example for explanation. Figure 3 A flowchart of a video transmission method provided in the present application. Among them, the source device 31 is used to implement the function of the source device 210, and the display device 32 is used to implement the function of the host device 220. In this embodiment, the source device 31 may also be referred to as an audio-visual sending device, an audio-visual sending terminal or a video sending device, and the display device 32 may also be referred to as an audio-visual receiving device, an audio-visual playing device or a video receiving device. In this embodiment, the source device 31 and the display device 32 are connected via a bus 33, and the bus 33 may refer to a UMI bus. For the specific implementation of the UMI bus, please refer to the aforementioned Figure 2 In some examples, the bus 33 may also be referred to as a connection bus, a first bus or other names.

[0078] In a first possible application scenario, the source device 31 may be Figure 1 The set-top box 110 and the display device 32 may be Figure 1 The smart TV 120 in the embodiment of the present invention pushes video and audio data to the smart TV, such as a set-top box.

[0079] In a second possible application scenario, the source device 31 may be Figure 1 The set-top box 110 and the display device 32 may be Figure 1 Any video and audio playback device in the video and audio playback device, such as any one of the video and audio playback devices 121 to the video and audio playback device 124. For example, a set-top box pushes video and audio data to the video and audio playback device.

[0080] In a third possible application scenario, the source device 31 may be Figure 1 The smart TV 120 and the display device 32 may be Figure 1 Any video and audio playback device in the video and audio playback device, such as any one of the video and audio playback devices 121 to the video and audio playback device 124. For example, a smart TV pushes video and audio data to the video and audio playback device.

[0081] The above three possible application scenarios are only examples provided in this embodiment and should not be construed as limiting the present application. In other possible examples, the source device 31 may be Figure 1 Any one of the audio and video playback devices (such as the audio and video playback device 121), the display device 32 is another audio and video playback device (such as the audio and video playback device 122) different from the aforementioned audio and video playback device.

[0082] See also Figure 3 The video transmission method provided in this embodiment includes the following steps S310 to S340.

[0083] S310 , the source device 31 reads capability description information of the display device 32 through the bus 33 .

[0084] The capability description information is used to indicate the color display capability of the display device 32. In some possible situations, the capability description information may also be referred to as a capability descriptor, which may include one or more bits of information.

[0085] In an optional example, the display device 32 includes a memory in which the capability description information is stored. The memory may include, but is not limited to, random access memory (RAM), flash memory, read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), register, hard disk, mobile hard disk, CD-ROM or any other form of storage medium known in the art.

[0086] In another optional example, the display device 32 includes a dedicated register, and the state of the dedicated register is used to indicate the above-mentioned capability description information. If the value indicated by the register is 1, the capability description information indicates that the display device 32 has the ability to display videos in ARGB format; if the value indicated by the register is 0, the capability description information indicates that the display device 32 does not have the ability to display videos in ARGB format.

[0087] It is worth noting that, since the capability description information indicates the color display capability of the device, in some cases, the capability description information is also called device comprehensive capability description information, and the area in the display device storing the DCCD information is called the DCCD area or simply DCCD, which is not limited in this application. In DCCD, the display device declares the capability of the locally supported video formats, such as but not limited to: RGB, RGB, YCbCr 4:4:4, YCbCr 4:2:2, YCbCr 4:2:0, Y-Only, Raw Data or other formats, etc.

[0088] Optionally, the DCCD may also store other content describing the audio and video processing capabilities of the display device, such as audio processing capabilities (whether the display device supports processing pure audio data packets), HDR display capabilities (whether the display device supports displaying specific types of HDR videos, such as Colorful HDR), or others.

[0089] The color display capability mentioned above includes: the display capability of the display device for pixels of different colors. The different colors here may include but are not limited to: red (Red), green (Green), blue (Blue) or others. In some examples, the color display capability also includes the display capability of the display device for transparency, and the transparency refers to the transparency of the transparent display screen, that is, the transparency of the display device background or the display screen background.

[0090] If the capability description information indicates that the display device 32 supports processing color information (ARGB information) carrying transparency, the source device 31 executes S320; if the capability description information indicates that the display device 32 does not support processing ARGB information, the source device 31 sends a regular video stream (such as RGB format or YUV format) to the display device 32.

[0091] It is worth noting that the above S310 is not a mandatory execution step of the source device 31. The source device 31 may not interact with the display device 32, but directly generate and send a video stream, and the display device 32 parses and displays the video stream according to its own capabilities.

[0092] S320: The source device 31 generates a video stream to be sent.

[0093] The video stream includes one or more video frames, and each video frame includes: one or more vertical blanking messages (VBP messages), and multiple valid video messages (AVP messages).

[0094] The following is combined with Figure 4 , an exemplary description is given of the format of the video frame in the video stream, Figure 4 A schematic diagram of the structure of a video frame provided in this application. Figure 4 In the video, a frame includes: multimedia message and timing signal.

[0095] Multimedia messages include one or both of valid video messages (AVP messages) and audio sample packets (audio samplepacket, ASP or ASP messages). AVP messages are used to transmit valid video data or valid pixels or valid pixel data (or valid video pixel data), and ASP messages are used to transmit audio data. Figure 4 In the video frame, multiple AVP messages are arranged in rows in the video frame, and multiple AVP messages belonging to the same row are a video row.

[0096] It is worth noting that Figure 4 The structure of the video frame is only an example provided by the present application and should not be understood as a limitation of the present application. In some possible implementations, a single video frame may also include only one line of AVP messages, which is not limited by the present application.

[0097] Optionally, when the link bandwidth is greater than the video bandwidth, an ASP can be inserted between two AVPs, but the priority of the ASP is lower than that of the AVP.

[0098] The timing signals include: a horizontal synchronization signal (Hsync), a vertical synchronization signal (Vsync) and a display enable (DE) signal, which are used to describe the video timing of the video, that is, when should a message or signal be transmitted. Hsync indicates the start of scanning a row of pixels (such as the signal received by the row register in the display device 32 is 1), Vsync indicates the start of scanning a video frame, and display enable DE indicates whether valid data can be received (such as DE=1 indicates that valid data can be received, and DE=0 indicates that valid data cannot be received).

[0099] Combination Figure 4 , briefly explain the video timing of the video frame: during the blanking period (Hblank) of the total row pixels (Htotal) or the row blanking area, the video frame cannot transmit AVP messages, but can transmit other messages, such as ASP, DIP messages, etc.; during the active period (Hactive) of the total row pixels (Htotal) or the row active area, the video frame can transmit AVP messages. The starting point of Hactive is marked by the horizontal blanking packet (HBP), which indicates the end of the row blanking area. Exemplarily, the audio and video sending adapter in the source device sends HBP for each video line and immediately sends it at the end of Hblank.

[0100] exist Figure 4 In the video frame shown, the line blanking area of ​​the video frame includes a VBP message, which is used to indicate the video line where the Vsync rising edge (in terms of positive polarity) of a video frame is located. Exemplarily, the video and audio transmission adapter in the source device sends one or more VBPs (such as Figure 4 For example, if Vsync is positive polarity, the video and audio transmission adapter replaces HBP with VBP in the video line where the rising edge of Vsync is located, and sends two more VBPs immediately; if Vsync is negative polarity, the video and audio transmission adapter replaces HBP with VBP in the video line where the falling edge of Vsync is located, and sends two more VBPs immediately.

[0101] For the above VBP message, the VBP message includes a tunnel message header and a payload part. For example, the tunnel message header occupies 4 bytes, the payload part occupies 28 bytes, and a single VBP message occupies 32 bytes in total.

[0102] The VBP message carries: an identifier indicating that the format of the multiple AVP messages is the ARGB format, and the identifier is carried in the payload part of the VBP message. The tunnel message header and the payload part of the VBP message are respectively exemplarily described in conjunction with Table 1 and Table 2.

[0103] Table 1: Tunnel header of VBP message

[0104]

[0105] Among them, ShuttleID is used to identify a data transmission channel on the link (Link), and the value is 0 to 127; for the audio and video adapter (audio and video sending adapter or audio and video receiving adapter), this field is the adapter ID set at the factory.

[0106] Table 2: Payload part of VBP message

[0107]

[0108]

[0109]

[0110] Among them, the pixel format (PixelFormat) field is used to carry the aforementioned identifier indicating the format used by the video. When the video format used by the AVP message in the video is the ARGB format, the value recorded in the PixelFormat can be: "05h".

[0111] It can be understood that when the AVP message in the video stream is not in ARGB format, it can also be in other formats: RGB, YCbCr4:4:4, YCbCr 4:2:2, YCbCr 4:2:0, Y-Only, Raw Data or other formats, etc.

[0112] In this embodiment, the source device sets an identifier indicating the format of the AVP message in the VBP message, and packages the AVP message according to the format indicated by the identifier, so that the display device can parse these AVP messages based on the format indicated by the identifier and output video, thereby avoiding the problem of reduced picture optimization efficiency caused by the display device consuming more computing power.

[0113] The ARGB format includes multiple types of pixel components: R pixel component (R component), G pixel component (G component), B pixel component (B component) and A pixel component (A component or transparency component). In the AVP message, the R component, G component, B component and A component arranged continuously can be called a group of pixel components. Transparency (alpha) refers to the degree of transparency of a transparent display screen, that is, the degree of transparency of the display device background or the display screen background. In some possible examples, the R component, G component and B component are used to describe the information used for different colors of the video screen, such as R, G, B or others.

[0114] The data arrangement of the ARGB format is associated with the color depth (bpc), and the color depth refers to the bit width (in bits) of a single pixel component.

[0115] For example, if the color depth of the ARGB format is M, then a set of pixel components in multiple AVP messages includes: M-bit R component, M-bit G component, M-bit B component and M-bit A component, where M is a positive integer. The arrangement rules and methods of pixel components in the AVP message in the ARGB format can be referred to as follows: Figures 6 to 9 The description is not repeated here.

[0116] Corresponding to the video sending adapter in the source device sending a VBP message, after the video receiving adapter in the display device (or host device) receives the VBP message, it first performs a CRC check. If the check fails, it receives the next VBP message until the correct VBP message is received. That is, the receiving end takes the first accurate VBP message received as the basis.

[0117] Please continue to see Figure 3 The video transmission method provided in this embodiment also includes the following steps S330 and S340.

[0118] S330 , the source device 31 sends the video stream generated in S320 to the display device 32 via the bus 33 .

[0119] Corresponding to the process of S330, the display device 32 receives the video stream sent by the source device 31 through the bus 33. The specific implementation of the video stream can refer to the relevant content of the aforementioned S320, which will not be described in detail here.

[0120] Compared with the DP protocol and HDMI protocol which only support the transmission of RGB video format or YUV video format obtained by converting RGB video format, the source device and display device in this application are connected through the UMI bus and can support video transmission in ARGB format, enriching the video transmission formats that the source device can support.

[0121] S340: The display device 32 parses and displays multiple AVP messages in the video stream according to the ARGB format indicated by the identifier in the VBP message.

[0122] Since the AVP message carries ARGB information, the display device does not need to consume much computing power to parse and calculate the transparency of videos in RGB video format or YUV video format, which reduces the computing power consumption of the display device, is beneficial to improving the picture optimization efficiency during the video display process, improving the display effect of the video in the display device, and improving the user's video viewing experience.

[0123] In addition, since the VBP message in the video stream indicates the format of the AVP message, the display device can quickly parse the AVP message using a parsing method corresponding to the format of the AVP message, thereby achieving video decoding synchronization between the source device and the display device, thereby further improving the efficiency of video picture optimization.

[0124] Regarding the effect of optimizing the transparency of the image on the display device, the following Figure 5 An example of a comparison is provided, such as Figure 5 As shown, Figure 5 A schematic diagram of the effect of picture optimization provided for the present application. In the source device 31, the user interface (UI) image is transmitted in the ARGB format, and the video image is transmitted in the RGB or YCbCr format. In the display device 32, after the display device 32 enhances the video image, the enhanced image and the UI image are layered, the image to be displayed is determined, and the screen is displayed in the display device 32. Since the format of the AVP message carrying the UI image received by the display device 32 is in the ARGB format, the display device 32 can layer the enhanced image based on the transparency included in the ARGB information in the AVP message, thereby reducing the transparency calculation process and improving the picture optimization efficiency.

[0125] The following is combined with Figures 6 to 9 , an exemplary description is given of the data arrangement of various pixel components in the AVP message.

[0126] In a first possible implementation manner, the color depth of the ARGB format is 8, and a group of pixel components in the multiple AVP messages includes: an 8-bit R component, an 8-bit G component, an 8-bit B component, and an 8-bit A component.

[0127] like Figure 6 As shown, Figure 6 A schematic diagram of an ARGB 8bpc video data arrangement provided in this application. Figure 6In the example, a single AVP message occupies 512 bytes, including a 4-byte tunnel header and a 508-byte payload. The payload is used to carry pixel data of valid video (i.e., R component, G component, B component, and A component). The R component, G component, B component, and A component are arranged in sequence, and each 8 bits × 4 = 32 bits is a group of pixel components. For the tunnel header of the AVP message, refer to the example provided in Table 3 below.

[0128] Table 3: Tunnel header of AVP message

[0129]

[0130] The header structures of the tunnel header of the AVP message and the tunnel header of the VBP message (as shown in Table 1) are the same, except that the values ​​of some fields are different: the value of Type of the AVP message is 4b'0101.

[0131] In a second possible implementation, the color depth of the ARGB format is 10, and a group of pixel components in the multiple AVP messages includes: a 10-bit R component, a 10-bit G component, a 10-bit B component, and a 10-bit A component.

[0132] like Figure 7 As shown, Figure 7 A schematic diagram of an ARGB 10bpc video data arrangement provided in this application. Figure 7 In the AVP, a single AVP message occupies 512 bytes, including a 4-byte tunnel message header and a 508-byte payload. The payload is used to carry pixel data of the effective video (i.e., R component, G component, B component, and A component), and the R component, G component, B component, and A component are arranged in sequence, and each 10 bits × 4 = 40 bits (bits) is a group of pixel components.

[0133] In a third possible implementation, the color depth of the ARGB format is 12, and a group of pixel components in the multiple AVP messages includes: a 12-bit R component, a 12-bit G component, a 12-bit B component, and a 12-bit A component.

[0134] like Figure 8 As shown, Figure 8 A schematic diagram of an ARGB 12bpc video data arrangement provided in this application, Figure 8 and Figure 6 The difference between them is that each 12 bits×4=48 bits is a group of pixel components.

[0135] In a fourth possible implementation, the color depth of the ARGB format is 16, and a group of pixel components in the multiple AVP messages includes: a 16-bit R component, a 16-bit G component, a 16-bit B component, and a 16-bit A component.

[0136] like Fig. 9 As shown, Fig. 9 A schematic diagram of an ARGB 16bpc video data arrangement provided in this application, Fig. 9 and Figure 6 The difference between them is that each 16 bits×4=64 bits is a group of pixel components.

[0137] In some optional examples, the R component, the G component, the B component, and the A component may also be arranged in other orders, not limited to Figures 6 to 9 The data arrangement order of each pixel component in the data is not limited in this application.

[0138] The above four possible implementation methods are only exemplary descriptions of AVP messages in ARGB format with different color depths provided in this embodiment. In other optional methods, the AVP message may also adopt data arrangement methods with other color depths.

[0139] In this embodiment, the pixel format (PixelFormat) in the VBP message indicates the format of the AVP message, and when the AVP message is encapsulated in the ARGB format, the display device parses the AVP message to obtain the transparency of the video, and optimizes the video based on the transparency, thereby reducing the problem of computing power consumption caused by the display device calculating and simulating RGB information to determine transparency, which is beneficial to improving the efficiency of video picture optimization and improving the user's video viewing experience.

[0140] When the amount of pixel data of valid video that a video frame can carry is limited and the pixel data of valid video to be transmitted is limited, a single video frame will be filled with as much pixel data of valid video as possible. However, the amount of pixel data is inconsistent with the maximum amount of pixel data that a video frame can carry, which may result in bits of unfilled pixels in the video frame. Figure 4 and Figure 6 The content shown is exemplified for illustration. If the pixel components included in the ARGB format cannot completely fill the last AVP message in the Nth row of the AVP message, the unfilled pixel portion in the last 32 bits of the last AVP message is 0, and the Nth row is one of the one or more rows.

[0141] It is worth noting that the last AVP message here refers to the last one in each row of AVP messages, not the last one in the video frame. Also, the last 32 bits of the last AVP message do not mean that the unfilled pixel part of the AVP message is set to 0 when each AVP message in the video frame cannot be filled completely, but the unfilled pixel part in the last 32 bits of the last AVP message is set to 0 only when the last AVP message in a row of AVP messages in the video frame cannot be filled completely.

[0142] For example, when DE is 1, the video and audio transmission adapter obtains pixel data from the pixel data interface at the rising edge of the pixel clock, arranges the pixel data in sequence to generate a valid video packet (AVP), and then sends the generated valid video packets in sequence. Except for the AVP packet at the end of the line, which needs to be filled with padding data (such as 0 or other specified symbols) for padding, the pixel arrangement within a line does not insert padding data.

[0143] It is understandable that, in order to implement the functions in the above embodiments, the source device and the display device include hardware structures and / or software modules corresponding to the execution of each function. It should be easily appreciated by those skilled in the art that, in combination with the units and method steps of each example described in the embodiments disclosed in this application, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application scenario and design constraints of the technical solution.

[0144] Combined with the above Figures 1 to 9 The video transmission method provided by this embodiment is described in detail. Fig.10 , describing the video device provided according to this embodiment.

[0145] Fig.10 1 is a schematic diagram of the structure of a video device provided by the present application. The video device 1000 can be used to implement the functions of any one of the devices in the above method embodiments, and thus can also achieve the beneficial effects of the above method embodiments. In this embodiment, the video device 1000 can be as follows: Figure 1 The set-top box 110, smart TV 120 or any display device shown may also be Figure 2 The source device 210 or sink device 220 shown may also be a source device or a display device provided in subsequent embodiments. It should be understood that the video apparatus 1000 may also be a module (such as a chip) applied to any of the aforementioned devices.

[0146] like Fig.10As shown, the video device 1000 includes: a transceiver module 1010 and a processing module 1020. The transceiver module 1010 and the processing module 1020 can cooperate to implement each step in the above method embodiment. A more detailed description of the above transceiver module 1010 and the processing module 1020 can be directly obtained by referring to the relevant description of the device in the method embodiment shown in the above figures, and no further description is given here.

[0147] When the video device implements the video transmission method shown in any of the above-mentioned figures through software, the video device and its various units may also be software modules. The above-mentioned video transmission method is implemented by calling the software module through a processor. The processor may be a central processing unit (CPU), an application-specific integrated circuit (ASIC), or a programmable logic device (PLD), and the above-mentioned PLD may be a complex programmable logical device (CPLD), a field programmable gate array (FPGA), a generic array logic (GAL) or any combination thereof.

[0148] Understandably, Fig.10 The video device shown is only an example provided in this embodiment. The video device may include more or fewer units according to different video transmission processes, and this application is not limited to this.

[0149] When the video device is implemented by hardware, the hardware can be implemented by a processor or a chip system. The chip system includes one or more chips, each chip including an interface circuit and a control circuit. The interface circuit is used to receive data from other devices outside the chip and transmit it to the control circuit, or send data from the control circuit to other devices outside the chip. The control circuit and the interface circuit are used to implement any possible implementation method in the above embodiments through a logic circuit or execution code instructions. The beneficial effects can be found in the description of any aspect of the above embodiments, which will not be repeated here.

[0150] It is understood that the processor in the embodiments of the present application may be a CPU, or other general-purpose processors, digital signal processors (DSP), ASICs, FPGAs or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. The general-purpose processor may be a microprocessor or any conventional processor.

[0151] in addition, Fig.10 The video device 1000 shown may also be processed by a video processing device such as Fig.11 As shown, Fig.11 This is a structural diagram of a video processing device provided in the present application. The video processing device 1100 includes: a memory 1110 and at least one processor 1120. The processor 1120 can implement the video transmission method provided in the above embodiment. The memory 1110 is used to store software instructions corresponding to the above video transmission method.

[0152] As an optional implementation, in hardware implementation, the video processing device 1100 may refer to a chip or chip system encapsulated with one or more processors 1120. For example, when the video processing device 1100 is used to implement the method steps in the above embodiment, the processor 1120 included in the video processing device 1100 executes the steps of the source device 31 in the above method and its possible sub-steps. In an optional scenario, the video processing device 1100 may also include a communication interface 1130, which may be used to send and receive data. For example, the communication interface 1130 is used to receive audio and video data, or to send audio and video streams, etc.; the communication interface 1130 may be implemented by an interface circuit included in the video processing device 1100. Therefore, in some examples, the communication interface 1130 may also be referred to as a transceiver of the video processing device. In this embodiment, the communication interface 1130 supports wired connection using a UMI interface.

[0153] In the embodiment of the present application, the communication interface 1130, the processor 1120 and the memory 1110 may be connected via a bus 1140, and the bus 1140 may be divided into an address bus, a data bus, a control bus, etc. The bus 1140 may be a Peripheral Component Interconnect Express (PCIe) bus, an extended industry standard architecture (EISA) bus, a unified bus (Ubus or UB), a compute express link (CXL), a cache coherent interconnect for accelerators (CCIX), or other types of buses, etc.

[0154] It is worth noting that the video processing device 1100 can also perform Fig.10 The functions of the video device 1000 shown are not described in detail here.

[0155] The video processing device 1100 provided in this embodiment may be the above set-top box 110, smart TV 120, source device 210 or source device 31, etc., or other devices with video processing functions, which are not limited in this application. For example, when the aforementioned display device also has a video processing function, the video processing device 1000 may refer to any one of the aforementioned display devices.

[0156] in addition, Fig.10 The video device 1000 shown can also be implemented by a display device. When the video device 1000 is implemented by a display device, this embodiment provides a possible example, such as Fig.12 As shown, Fig.12 A schematic diagram of the structure of a display device provided in the present application. The display device includes: a processor 210, an external memory interface 220, an internal memory 221, a universal serial bus (USB) interface 230, a UMI interface 231, an antenna 1, an antenna 2, a mobile communication module 250, a wireless communication module 260, an audio module 270, a speaker 270A, a receiver 270B, a microphone 270C, a sensor module 280, a button 290, an indicator 292, a camera 293, a display screen 294, a subscriber identification module (SIM) card interface 1-N 295, etc.

[0157] Among them, the above-mentioned sensor module 280 may include sensors such as pressure sensor, gyroscope sensor, air pressure sensor, magnetic sensor, acceleration sensor, distance sensor, proximity light sensor, fingerprint sensor, temperature sensor, touch sensor, ambient light sensor and bone conduction sensor.

[0158] It is to be understood that the structure illustrated in this embodiment does not constitute a specific limitation on the display device. In other embodiments, the display device may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0159] The processor 210 may include one or more processing units, for example, the processor 210 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0160] The controller can be the nerve center and command center of the display device. The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of fetching and executing instructions.

[0161] The processor 210 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 210 is a cache memory. The memory may store instructions or data that the processor 210 has just used or cyclically used. If the processor 210 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 210, and thus improves the efficiency of the system.

[0162] In some embodiments, the processor 210 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a USB interface, a UMI interface, etc.

[0163] It is understandable that the interface connection relationship between the modules illustrated in this embodiment is only a schematic illustration and does not constitute a structural limitation on the display device. In other embodiments, the display device may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0164] The wireless communication function of the display device can be implemented through antenna 1, antenna 2, mobile communication module 250, wireless communication module 260, modem processor and baseband processor, etc. In some embodiments, antenna 1 of the display device is coupled with mobile communication module 250, and antenna 2 is coupled with wireless communication module 260, so that the display device can communicate with the network and other devices through wireless communication technology.

[0165] The wired communication function of the display device can be implemented through the USB interface 230 or the UMI interface 231. For example, the display device receives or sends video streams and AVP messages through the bus connected to the UMI interface 231.

[0166] The display device implements the display function through a GPU, a display screen 294, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 294 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 210 may include one or more GPUs, which execute program instructions to generate or change display information.

[0167] The display screen 294 is used to display images, videos, etc. The display screen 294 includes a display panel.

[0168] The display device can realize the shooting function through ISP, camera 293, video codec, GPU, display screen 294 and application processor. ISP is used to process the data fed back by camera 293. Camera 293 is used to capture static images or videos. In some embodiments, the display device may include 1 or N cameras 293, where N is a positive integer greater than 1.

[0169] In this embodiment, the above display screen 294, video codec, GPU, display screen 294 and application processor may also be collectively referred to as a display unit of the display device 32, which is used to process and display the received video stream.

[0170] The external memory interface 220 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the display device. The external memory card communicates with the processor 210 through the external memory interface 220 to implement a data storage function. For example, files such as music and videos can be stored in the external memory card.

[0171] The internal memory 221 may be used to store computer executable program codes, which include instructions. The processor 210 executes various functional applications and data processing of the display device by running the instructions stored in the internal memory 221. For example, in an embodiment of the present application, the processor 210 may execute the instructions stored in the internal memory 221, and the internal memory 221 may include a program storage area and a data storage area.

[0172] The program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the display device (such as video and audio data, a phone book, etc.), etc. In addition, the internal memory 221 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0173] The display device can implement audio functions such as music playback and recording through the audio module 270, the speaker 270A, the receiver 270B, the microphone 270C, and the application processor.

[0174] The button 290 includes a power button, a volume button, etc. The button 290 may be a mechanical button or a touch button. The indicator 292 may be an indicator light, which may be used to indicate the charging status, the change of the power, or may be used to indicate messages, missed calls, notifications, etc.

[0175] The method steps in the embodiments of the present application can also be implemented by a processor executing software instructions. The software instructions can be composed of corresponding software modules, and the software modules can be stored in random access memory (RAM), flash memory, read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), registers, hard disks, mobile hard disks, CD-ROMs, or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an ASIC. In addition, the ASIC can be located in a network device or a terminal device. Of course, the processor and the storage medium can also be present in a video processing device and a display device as discrete components.

[0176] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented by software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer programs or instructions. When the computer program or instruction is loaded and executed on a computer, the process or function described in the embodiment of the present application is executed in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, a network device, a user device or other programmable device. The computer program or instruction may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer program or instruction may be transmitted from one website site, computer, server or data center to another website site, computer, server or data center by wired or wireless means. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium may be a magnetic medium, for example, a floppy disk, a hard disk, a tape; it may also be an optical medium, for example, a digital video disc (DVD); it may also be a semiconductor medium, for example, a solid state drive (SSD).

[0177] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in the present application, and these modifications or replacements should be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the protection scope of the claims.

Claims

1. A video transmission method, characterized in that: The method is performed by a source device, the source device is connected to a display device via a first bus, and the method includes: The source device generates a video stream to be sent; The video stream includes one or more video frames, each of which includes: one or more vertical blanking messages VBP messages, and multiple valid video messages AVP messages; the VBP message carries: an identifier indicating that the format of the multiple AVP messages is ARGB format, and the ARGB format includes: a red R component, a green G component, a blue B component, and a transparency A component; The source device sends the video stream to the display device through the first bus.

2. The method according to claim 1, characterized in that The VBP message includes a pixel format field, and the pixel format field carries the identifier.

3. The method according to claim 1 or 2, characterized in that: The first bus is a unified multimedia interconnect (UMI) bus.

4. The method according to any one of claims 1 to 3, characterized in that The color depth of the ARGB format is M, then a group of pixel components in the multiple AVP messages includes: an M-bit R component, an M-bit G component, an M-bit B component and an M-bit A component, where M is a positive integer.

5. The method according to claim 4, characterized in that The value of M is 8, 10, 12 or 16.

6. The method according to any one of claims 1 to 5, characterized in that The AVP message in each video frame includes one or more rows. If the pixel components included in the ARGB format cannot completely fill the last AVP message in the Nth row of the AVP message, the unfilled pixel part in the last 32 bits of the last AVP message is 0, and the Nth row is one of the one or more rows.

7. A video display method, characterized in that: The method is performed by a display device, the display device is connected to a source device via a first bus, and the method includes: The display device receives a video stream sent by the source device; the video stream includes one or more video frames, each video frame includes: one or more vertical blanking messages VBP messages, and multiple valid video messages AVP messages; the VBP message carries: an identifier indicating that the format of the multiple AVP messages is ARGB format, and the ARGB format includes: red R component, green G component, blue B component and transparency A component; The display device parses and displays multiple AVP messages in the video stream according to the ARGB format indicated by the identifier.

8. The method according to claim 7, characterized in that The VBP message includes a pixel format field, and the pixel format field carries the identifier.

9. The method according to claim 7 or 8, characterized in that: The first bus is a unified multimedia interconnect (UMI) bus.

10. The method according to any one of claims 7 to 9, characterized in that: The color depth of the ARGB format is M, then a group of pixel components in the multiple AVP messages includes: an M-bit R component, an M-bit G component, an M-bit B component and an M-bit A component, where M is a positive integer.

11. The method according to claim 10, characterized in that The value of M is 8, 10, 12 or 16.

12. The method according to any one of claims 7 to 11, characterized in that: The AVP message in each video frame includes one or more rows. If the pixel components included in the ARGB format cannot completely fill the last AVP message in the Nth row of the AVP message, the unfilled pixel part in the last 32 bits of the last AVP message is 0, and the Nth row is one of the one or more rows.

13. A video processing device, characterized in that: include: memories, transceivers, and processors; The processor is used to generate a video stream to be sent; The memory is used to cache the video stream; The transceiver is used to send the video stream; The memory, the transceiver and the processor are configured to collaboratively execute the method of any one of claims 1 to 6.

14. A display device, characterized in that: include: transceiver and display unit; The transceiver is used to receive a video stream via a first bus; The video stream includes one or more video frames, each video frame includes: one or more vertical blanking messages VBP messages, and multiple valid video messages AVP messages; the VBP message carries: an identifier indicating that the format of the multiple AVP messages is ARGB format, and the ARGB format includes: R component, G component, B component and A component; The display unit is used to process and display the video stream; The transceiver and the display unit are used to collaboratively execute the method of any one of claims 7-12.

Images