Video transmission method and device

Abstract

Provided are a video transmission method and a device, relating to the technical field of media, and capable of dynamically enabling a low-delay mode for video data, thereby reducing the display delay of a sink device for a video. The method is applied to a source device or a chip in a source device. The method comprises: querying the capability of a sink device; and when the sink device has an automatic low-delay capability, transmitting a first vertical blanking packet (VBP) and first video data to the sink device, an automatic low-delay field comprised in the first VBP being a first value, and the first value being used for instructing to enable an automatic low-delay mode for the first video data.

Description

Video transmission method and device Technical Field

[0001] The present application relates to the field of media technology, and in particular to a video transmission method and device. Background Art

[0002] With the development of big data, artificial intelligence (AI), and cloud computing technologies, various types of multimedia data are constantly emerging, and more requirements are being placed on the transmission performance of multimedia data between different devices. Taking video data as an example, in some scenarios, the display latency on the display device must be as low as possible. Therefore, achieving low-latency display of video data still faces many challenges.

[0003] Summary of the Invention

[0004] The present application provides a video transmission method and device that can dynamically enable a low-latency mode for video data, thereby reducing the display delay of the video on the host device.

[0005] This application adopts the following technical solutions:

[0006] In a first aspect, the present application provides a video transmission method, which is applied to a source device or a chip in a source device, the method comprising: querying the capabilities of a host device; when the host device has automatic low-latency capability, transmitting a first vertical blanking message VBP and first video data to the host device; the automatic low-latency field included in the first VBP is a first value, and the first value is used to indicate that the automatic low-latency mode is enabled for the first video data.

[0007] In this application, when the source device queries that the host device has automatic low latency capability, the source device can carry a field in the VBP that instructs the host device to turn on the automatic low latency mode, and send the VBP and video data to the host device, so that the host device turns on the automatic low latency mode according to the instruction of the automatic low latency field to reduce the display delay of the video by the host device.

[0008] Furthermore, when the host device supports automatic low latency capability and needs to turn on the automatic low latency mode, this method can more conveniently and dynamically control the turning on of the automatic low latency mode by carrying a field indicating turning on the automatic low latency mode in the VBP, without the need for manual turning on.

[0009] In one possible implementation, the video transmission method provided in an embodiment of the present application further includes: transmitting a second vertical blanking message VBP and second video data to the host device; the automatic low latency field included in the second VBP is a second value, and the second value is used to indicate that the automatic low latency mode is turned off for the second video data.

[0010] In one possible implementation, the above-mentioned transmission of the first VBP and the first video data to the host device specifically includes: transmitting a first video frame to the host device, the first video frame including at least one first VBP and multiple first valid video packets AVP, and the multiple first AVPs are used to carry the first video data.

[0011] In one possible implementation, the above-mentioned transmission of the second VBP and the second video data to the host device specifically includes: transmitting a second video frame to the host device, the second video frame including at least one second VBP and multiple second valid video packets AVP, and the multiple second AVPs are used to carry the second video data.

[0012] In an embodiment of the present application, VBP is sent in each video frame, and VBP includes a field for automatic low-latency mode. In this way, frame-level control of video data can be achieved to dynamically turn on or off the automatic low-latency mode for video frames, which is highly flexible.

[0013] In a second aspect, the present application provides a video transmission method, which is applied to a host device or a chip in the host device, the method comprising: receiving a first vertical blanking message VBP and first video data sent by a source device; and when the automatic low latency field included in the first VBP is a first value, enabling an automatic low latency mode for the first video data.

[0014] In the present application, after the host device receives the first VBP and the first video data sent by the source device, it turns on the automatic low-latency mode according to the indication of the automatic low-latency field in the first VBP sent by the source device, and quickly processes the first video data in the automatic low-latency mode, which can reduce the display delay of the video by the host device.

[0015] Furthermore, when the host device supports automatic low latency capability and needs to turn on the automatic low latency mode, this method can more conveniently and dynamically control the turning on of the automatic low latency mode by carrying a field indicating turning on the automatic low latency mode in the VBP, without the need for manual turning on.

[0016] In one possible implementation, the video transmission method provided in an embodiment of the present application also includes: receiving a second vertical blanking message VBP and second video data sent by a source device; when the automatic low latency field included in the second VBP is a second value, turning off the automatic low latency mode for the second video data.

[0017] In one possible implementation, the above-mentioned receiving the first vertical blanking message VBP and the first video data sent by the source device specifically includes: receiving the first video frame sent by the source device, the first video frame includes at least one first VBP and multiple first valid video messages AVP, and the multiple first AVPs are used to carry the first video data.

[0018] In one possible implementation, the second vertical blanking message VBP and the second video data sent by the receiving source device specifically include: receiving the second video frame sent by the source device, the second video frame includes at least one second VBP and multiple second valid video messages AVP, and the multiple second AVPs are used to carry the second video data.

[0019] In one possible implementation, after the sink device enables automatic low-latency mode for the first video data, to implement the automatic low-latency function and reduce the display delay of the video on the sink device, the sink device may choose not to perform video quality enhancement processing on the video data. For example, the sink device does not perform at least one of the following processing on the first video data, including but not limited to: resolution conversion, noise suppression, contrast enhancement, color correction, motion compensation, or frame interpolation.

[0020] In this application, after the automatic low-latency mode is turned on, the host device does not need to perform some or all of the image quality enhancement post-processing. After the host device completes the necessary processing, the video can be displayed quickly. That is, the host device can quickly process video data in the automatic low-latency mode, thereby reducing the display delay of the video.

[0021] In one possible implementation, when the host device turns off the automatic low-latency mode, the host device resumes executing at least one process for enhancing video quality that was suspended when the automatic low-latency mode was turned on, that is, reopens one or more processing modules for enhancing video quality, and executes the process for enhancing video quality to improve video quality.

[0022] In a third aspect, the present application provides a video processing device, which includes a module for executing the method of any one of the implementations of the first aspect or the second aspect.

[0023] In a fourth aspect, the present application provides a source device comprising: a memory, a transceiver, and a processor; the memory, the transceiver, and the processor are configured to collaboratively execute the method described in the first aspect and any one of its possible implementations.

[0024] In a fifth aspect, the present application provides a host device, comprising: a transceiver and a processor; the transceiver and the processor are configured to collaboratively execute the method described in the second aspect and any one of its possible implementations.

[0025] In a sixth aspect, the present application provides a video transmission system. The video transmission system includes the source device provided in the fourth aspect and the sink device provided in the fifth aspect. The source device can be used to implement the functions of the source device in the first or second aspect, and the sink device can be used to implement the functions of the sink device in the first or second aspect. Therefore, the video transmission system can also achieve the beneficial effects of the methods described in the first and second aspects, which will not be elaborated here.

[0026] In a seventh aspect, the present application provides a computer-readable storage medium storing computer instructions, which, when executed on a computing device, execute the method of any one of the first aspect and its possible implementations, or the second aspect and its possible implementations. For example, the computing device is the aforementioned source device or sink device.

[0027] In an eighth aspect, the present application provides a computer program product comprising computer instructions that, when executed on a computing device, execute the method of the first aspect and any one of its possible implementations. For example, the computing device is the aforementioned source device or sink device.

[0028] In a ninth aspect, the present application provides a chip system, comprising: a processor configured to call and execute a computer program from a memory, so that a computing device equipped with the chip system executes the method described in any one of the first aspect and its possible implementations, or the second aspect and its possible implementations. The computing device may be the aforementioned source device or sink device.

[0029] It should be understood that the beneficial effects achieved by the technical solutions of the second to ninth aspects of this application and the corresponding possible implementation methods can be referred to the technical effects of the first aspect and its corresponding possible implementation methods mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] FIG1 is a schematic diagram of a video transmission system provided in an embodiment of the present application;

[0031] FIG2 is a schematic diagram of an audio and video encoding and decoding system provided in an embodiment of the present application;

[0032] FIG3 is a block diagram of an audio and video transmission adapter provided in an embodiment of the present application;

[0033] FIG4 is a block diagram of an audio / video receiving adapter provided in an embodiment of the present application;

[0034] FIG5 is a flow chart of a video transmission method according to an embodiment of the present application;

[0035] FIG6 is a schematic diagram of the structure of a vertical blanking message VBP provided in an embodiment of the present application;

[0036] FIG7 is a schematic diagram of the structure of a video frame provided in an embodiment of the present application;

[0037] FIG8 is a schematic diagram of the structure of an effective video packet AVP provided in an embodiment of the present application;

[0038] FIG9 is a second flow chart of a video transmission method provided in an embodiment of the present application;

[0039] FIG10 is a schematic structural diagram of a video processing device provided by the present application;

[0040] FIG11 is a schematic diagram of the structure of a video processing device provided by this application;

[0041] FIG12 is a schematic structural diagram of the display device provided in this application. DETAILED DESCRIPTION

[0042] The term "and / or" in this article is merely a description of the association relationship between associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0043] In the description and claims of the embodiments of this application, the terms "first" and "second" are used to distinguish different objects rather than to describe a specific order of the objects. For example, "first video data" and "second video data" are used to distinguish different video data rather than to describe a specific order of the video data.

[0044] In the embodiments of this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of this application should not be interpreted as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.

[0045] In the description of the embodiments of the present application, unless otherwise specified, “plurality” means two or more.

[0046] It is understandable that different scenarios have different display delay requirements for the host device. For example, in a gaming scenario, the display delay of the host device is required to be as low as possible, so that the user's gaming experience can be higher. For other scenarios, there are no strict requirements for the display delay of the host device. To meet the needs of different scenarios, an embodiment of the present application provides a video transmission method for transmitting video between a source device and a host device. The method supports an automatic low latency (ALLM) mode. When the source device queries that the host device has an automatic low latency capability, the source device can carry a field in the vertical blanking message indicating that the host device has turned on the automatic low latency mode, and send the vertical blanking packet (VBP) and video data to the host device, so that the host device turns on the automatic low latency mode according to the instruction of the automatic low latency field to reduce the display delay of the video data by the host device.

[0047] The technical solutions involved in the embodiments of this application can be applied not only to current audio and video transmission technologies or audio and video standards, but may also be applied to future audio and video transmission technologies or audio and video standards. The terms used in the implementation methods of this application are only used to explain the specific embodiments of this application and are not intended to limit this application. The following is a brief introduction to some concepts that may be involved in this application.

[0048] Video streaming refers to the transmission of video data, i.e., a video stream that can be processed as a stable and continuous flow over a network. Video (or video data) captured by a video capture device consists of multiple frames. This video data is packaged and encapsulated to create a video stream, which consists of multiple frames, each corresponding to a single image.

[0049] In this embodiment, video is a general term that includes a sequence of multiple consecutive frames, with one frame corresponding to one image. Video and audio are information application technology terms that refer to video, audio, or multimedia content including video and audio.

[0050] The video formats supported by the video transmission method provided in the embodiments of the present application include but are not limited to RGB, YCbCr4:4:4, YCbCr4:2:2, YCbCr4:2:0, ARGB, Y-only, RAW, etc.

[0051] The video transmission method provided in the embodiments of the present application supports video data with component bit widths (or color depths) including, but not limited to, one or more of the following: 8-bit, 10-bit, 12-bit, or 16-bit. For example, for video data in RGB format, if the component bit width is 8-bit, the R component of a pixel occupies 8 bits, the G component occupies 8 bits, and the B component occupies 8 bits. This can also be described as supporting video data with 8 bits per component (bpc), 10 bits per component, 12 bits per component, or 16 bits per component.

[0052] In order to make the description of the following embodiments clear and concise, an introduction to related technologies is first given.

[0053] Figure 1 is a schematic diagram of a video transmission system provided by an embodiment of the present application. The video processing process may include but is not limited to: video acquisition, video encoding, video transmission, video decoding and playback processes.

[0054] The audio and video transmission system in Figure 1 includes a set-top box 110, a smart TV 120, multiple audio and video playback devices, and a server 130. The set-top box 110 is connected to the operator's network via a network cable and can receive audio and video streams from the server 130. The network can implement audio and video transmission and can include one or more network devices, such as a router or switch. In some optional implementations, the set-top box 110 and the server 130 can also communicate via wireless communication, which is not limited in this embodiment of the present application.

[0055] The set-top box 110 is a video and audio processing device that is used to implement functions such as receiving, processing, and pushing video streams or video and audio streams. In some possible scenarios, the set-top box 110 may also be called an Internet TV set-top box, a network high-definition player, or other similar devices. For example, the set-top box 110 may refer to a TV box provided by a network operator or a TV box purchased by a user. For the hardware implementation of the set-top box 110, reference may be made to the description of FIG. 11 below, which will not be described in detail here.

[0056] Smart TV 120 is a display device with audio and video processing capabilities that implements functions such as receiving, processing, pushing, and playing video or audio streams. In some possible scenarios, Smart TV 120 may refer to an audio and video device such as a conference tablet, smart TV, or projector, but this embodiment of the application is not limited to this. The hardware implementation of Smart TV 120 can be referred to the description of Figures 11 or 12 below and will not be repeated here.

[0057] The multiple audio and video playback devices include audio and video playback devices 121 to 124. For example, these audio and video playback devices may include, but are not limited to, multimedia control platforms or other devices that support audio and video playback functions, such as virtual reality (VR) terminal devices or augmented reality (AR) terminal devices. The hardware implementation of the audio and video playback devices can be found in the description of FIG. 12 below and is not detailed here.

[0058] In this embodiment, the set-top box 110 and the smart TV 120 are connected via a network, for example, via an audio and video interface network. The set-top box 110 and each audio and video playback device may also be connected via an audio and video interface network. The smart TV 120 and each audio and video playback device may also be connected via an audio and video interface network. Exemplarily, the audio and video interface network may be a wired network that supports video and audio and video transmission. Optionally, the audio and video interface network may be referred to as a unified multimedia internet network. In some implementations, the unified multimedia internet network may also be referred to by other names.

[0059] The unified multimedia internet network supports both uncompressed and compressed video transmission, as well as advanced features such as quick video transport (QVT), auto low latency mode (ALLM), and dynamic frame rate refresh (DFR). It also supports LPCM audio and video formats defined in IEC 60958, as well as various HDR protocols, such as HDR Vivid, as specified in T / UWA 005.1-2022. The unified multimedia internet network also supports encryption control and protection for audio and video data transmission.

[0060] The server 130 may be an application server or an authentication and authorization server. The server 130 may provide video services, game services, message services, music services, authentication and authorization services, and the like. In one example, the functions of multiple services may be integrated on the server 130. For example, a game service and a music service may be deployed on the server 130. In another example, the functions of some services may be integrated on the server 130. For example, some services of the game service and some services of the video service may be deployed on the server 130. The server 130 may also utilize virtualization technology to provide multiple virtual machines, which provide various services. The embodiments of the present application do not limit the deployment form of the server. The network device 131 is connected to the server 130 via a wireless or wired mode. The schematic diagram of FIG1 is merely an example. Other devices may also be included in the network, which are not shown in FIG1.

[0061] Figure 1 is only a schematic diagram, and the video and audio transmission system may also include other devices, which are not shown in Figure 1. The embodiment of the present application does not limit the number and type of each device included in the system.

[0062] Based on the audio and video transmission system shown in Figure 1, Figure 2 is a schematic diagram of an audio and video encoding and decoding system provided in an embodiment of the present application. The audio and video encoding and decoding system includes a source device 210 and a host device 220. The source device 210 establishes a communication connection with the host device 220 through a unified multimedia Internet network.

[0063] The above-mentioned source device 210 can realize the function of audio and video encoding. As shown in Figure 1, the source device 210 can be the set-top box 110 or the smart TV 120 shown in Figure 1. The source device 210 can also be an audio and video control center with audio and video encoding capabilities. For example, the audio and video control center includes one or more servers.

[0064] The source device 210 may include a data source 211 , a pre-processing module 212 , an audio and video transmission adapter 213 , and a communication interface 214 .

[0065] The data source 211 may include or may be any type of electronic device for capturing audio and video, and / or any type of source audio and video generating device, such as a computer graphics processor for generating computer animation scenes or any type of device for acquiring and / or providing source audio and video, or computer-generated source audio and video. The data source 211 may be any type of memory or storage for storing the above-mentioned source audio and video. The above-mentioned source audio and video may include multiple audio and video streams or images captured by multiple audio and video capturing devices (such as cameras), such as ultra high definition (UHD) video, high definition (HD) video, 4K video, 8K video, etc.

[0066] The pre-processing module 212 is configured to receive source audio and video and pre-process the source audio and video to obtain audio and video or multiple frames of images. For example, the pre-processing performed by the pre-processing module 212 may include color format conversion (e.g., from RGB to YCbCr), octree structuring, audio and video splicing, audio track merging and deletion, or channel number adjustment.

[0067] The audio / video transmission adapter 213 is used to receive audio / video or images and encode the audio / video or images to obtain encoded data. In some optional situations, the encoded code stream (encoded data) may also be referred to as a bit stream. If the encoded data is obtained by encoding audio / video data, the bit stream refers to the audio / video stream; if the encoded data is obtained by encoding video data, the bit stream refers to the video stream.

[0068] The communication interface 214 in the source device 210 can be used to receive encoded data (such as a video stream or an audio / video stream) and send the encoded data (or a version of the encoded data after any other processing) to another device such as the host device 220 or any other device via the unified multimedia internet network for storage, display, playback, or image reconstruction.

[0069] Optionally, the source device 210 includes a bitstream buffer, which is used to store bitstreams corresponding to one or more coding units.

[0070] The above-mentioned sink device 220 can implement the function of audio and video decoding. As shown in Figure 1, when the source device 210 is a set-top box 110, the sink device 220 can be any of the smart TVs 120 or audio and video playback devices shown in Figure 1. When the source device 210 is a smart TV 120, the sink device 220 can be any of the audio and video playback devices.

[0071] The sink device 220 may include a video and audio playback unit 221 , a post-processing module 222 , a video and audio receiving adapter 223 , and a communication interface 224 .

[0072] The communication interface 224 in the sink device 220 is configured to receive the encoded data (or a version of the encoded data after any other processing has been performed on the encoded data) from the source device 210 or any other source device such as a storage device.

[0073] Communication interface 214 and communication interface 224 can be used to connect source device 210 and sink device 220 through a direct communication link, such as a direct wired connection, as shown in the unified multimedia internet network in FIG2 . For details about the unified multimedia internet network, please refer to the description of FIG1 and will not be repeated here.

[0074] The communication interface 224 corresponds to the communication interface 214 and can be used, for example, to transmit data and process the data using any type of corresponding transmission decoding or processing and / or decapsulation to obtain audio and video data.

[0075] Both the communication interface 224 and the communication interface 214 can be configured as a unidirectional communication interface or a bidirectional communication interface as indicated by the arrow pointing from the source device 210 to the corresponding unified multimedia internet network of the sink device 220 in FIG2 , and can be used to send and receive messages, etc. to establish a connection, and transmit other information, etc., such as transmitting information related to the communication link, or, for example, transmitting information related to audio and video data (such as descriptive information DIP of audio and video).

[0076] The video and audio receiving adapter 223 is used to receive encoded data and decode the encoded data to obtain decoded data (video or video and audio, etc.).

[0077] The post-processing module 222 is used to post-process the decoded data to obtain post-processed data (such as an image to be displayed or audio and video to be played). The post-processing performed by the post-processing module 222 may include, for example, color format conversion (such as from YCbCr to RGB), octree reconstruction, audio and video splitting and fusion, or any other processing for generating data for output by the audio and video playback unit 221.

[0078] The audio and video playback unit 221 is used to receive post-processed data for display or playback to a user or viewer, etc. The audio and video playback unit 221 can be or include any type of display for representing the reconstructed image, such as an integrated or external display screen or display. For example, the display screen may include a liquid crystal display (LCD), an organic light emitting diode (OLED) display, a plasma display, a projector, a micro LED display, a liquid crystal on silicon (LCoS) display, a digital light processor (DLP), or any other type of display screen. The audio and video playback unit 221 can also include one or more audio and video playback modules, each of which can refer to a speaker, a smart speaker, an amplifier, etc.

[0079] As an optional implementation, the source device 210 and the sink device 220 can transmit the encoded data through a data forwarding device. For example, the data forwarding device can be a router or a switch. It is worth noting that the data forwarding device needs to support the unified multimedia internet network.

[0080] Figure 3 shows a logical block diagram of an audio / video transmitter adapter. The adapter receives video and audio signals, including vertical synchronization (Vsync), horizontal synchronization (Hsync), pixel clock, video data, and display enable (DE), as well as descriptive information. These signals are then encapsulated into corresponding packets, such as the vertical blanking packet (VBP), horizontal blanking packet (HBP), active video packet (AVP), audio sample packet (ASP), and descriptive information packet (DIP). When content protection is enabled, the AVP and ASP are sent to the content protection encryption module for encryption, generating an encryption description packet (EDP) and a key distribution packet (KDP). The encrypted AVP is AVP', and the encrypted ASP is ASP'. These packets are combined into a single audio / video stream by the audio / video stream multiplexer and then sent to the audio / video receiver adapter of the sink device via the transport and electrical layers of the unified multimedia internetwork.

[0081] Figure 4 is a logic block diagram of an audio and video receiving adapter. The audio and video receiving adapter is responsible for receiving the audio and video stream, parsing it into various messages (VBP, HBP, DIP, AVP (AVP' in the case of encryption), ASP (ASP' in the case of encryption)), and restoring vertical synchronization (Vsync) / horizontal synchronization (Hsync) / pixel clock / pixel data / display enable (DE) / audio clock / audio data based on the messages.

[0082] The implementation of the video transmission method provided in the embodiment of the present application will be described in detail below with reference to the accompanying drawings.

[0083] Here, the video transmission method of an embodiment of the present application is described as being executed by the source device 210 or a chip in the source device 210 and the sink device 220 or a chip in the sink device 220 shown in FIG2 . FIG5 is a flow chart of a video transmission method provided by the present application. In this embodiment, the source device may also be referred to as an audio and video transmitting device, an audio and video transmitting terminal, etc., and the sink device may also be referred to as an audio and video receiving device, an audio and video playing device, etc. In this embodiment, the source device and the sink device are connected via a unified multimedia internet network.

[0084] In a first possible application scenario, the source device may be the set-top box 110 in Figure 1, and the sink device may be the smart TV 120 in Figure 1. For example, the set-top box pushes video and audio data to the smart TV.

[0085] In a second possible application scenario, the source device may be the set-top box 110 in FIG1 , and the sink device may be any video and audio playback device in FIG1 , such as any one of the video and audio playback devices 121 to 124. For example, the set-top box pushes video and audio data to the video and audio playback device.

[0086] In a third possible application scenario, the source device may be the smart TV 120 in FIG1 , and the sink device may be any of the video and audio playback devices in FIG1 , such as any of the video and audio playback devices 121 to 124. For example, the smart TV pushes video and audio data to the video and audio playback device.

[0087] The above three possible application scenarios are merely examples provided in this embodiment and should not be construed as limiting the present application. In other possible examples, the source device may be any of the video and audio playback devices in FIG1 (e.g., video and audio playback device 121), and the sink device may be another video and audio playback device different from the aforementioned video and audio playback device (e.g., video and audio playback device 122).

[0088] 5 , the video transmission method provided in the embodiment of the present application includes S501 - S503 .

[0089] S501: The source device queries the capability of the sink device.

[0090] In an embodiment of the present application, the sink device provides information indicating the capabilities of the sink device. The source device queries the capabilities of the sink device, including the source device obtaining capability description information of the sink device. The process of the source device obtaining the capability information of the sink device includes: the source device sends a query message to the sink device, where the query message is used to query the capabilities of the sink device; and then, the sink device sends (feeds back) the capability description information of the sink device to the source device, and the source device receives the capability description information sent by the sink device, where the capability description information may indicate the capabilities of the sink device.

[0091] The capability description information of the sink device may include information indicating the automatic low latency capability of the sink device, that is, including information indicating whether the sink device has automatic low latency capability. In some possible scenarios, the capability description information may also be referred to as a capability descriptor, which may include one or more bits of information.

[0092] In some cases, the sink device's capability description information may also be referred to as device comprehensive capability description information. The area in the sink device that stores this DCCD information is called a DCCD area or simply DCCD, though this application does not limit this. In the DCCD, the sink device declares whether it supports automatic latency capabilities, such as automatic low latency. The source device queries the sink device's capabilities through the DCCD, and the sink device then provides feedback on its capabilities to the source device.

[0093] Optionally, the DCCD may also store other content describing the audio and video processing capabilities of the host device, such as audio processing capabilities (whether the host device supports processing pure audio data packets), HDR display capabilities (whether the host device supports displaying specific types of HDR videos, such as Colorful HDR), or others.

[0094] In an optional example, the sink device includes a memory storing the capability description information. The memory may include, but is not limited to, random access memory (RAM), flash memory, read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), registers, a hard disk, a removable hard disk, a CD-ROM, or any other form of storage medium known in the art.

[0095] In another optional example, the sink device includes a dedicated register whose state is used to indicate the capability description information. If the value indicated by the register is 1, the capability description information indicates that the sink device has automatic low latency capability; if the value indicated by the register is 0, the capability description information indicates that the sink device does not have automatic low latency capability.

[0096] S502: If the sink device has automatic low latency capability, the source device transmits a first VBP and first video data to the sink device. The first VBP includes an automatic low latency (ALLM) field with a first value, which indicates that an automatic low latency mode is enabled for the first video data. Accordingly, the sink device receives the first VBP and first video data sent by the source device.

[0097] The first video data is a frame of data in the video data to be sent by the source device, that is, the first video data corresponds to valid data (or valid pixels, or valid pixel data) of a frame image in the video.

[0098] It is understood that when the source device determines that the sink device has automatic low latency capability, the source device can choose whether to instruct the sink device to enable automatic low latency mode based on actual needs. For example, the source device can choose whether to enable automatic low latency mode based on the type of video content. Optionally, different types of video content may include, but are not limited to, graphics, images, videos, or games. The source device can also choose whether to enable automatic low latency mode for all types of video content.

[0099] In the embodiment of the present application, the vertical blanking message is used to transmit the VBS (Vblank Start) signal, i.e., the vertical blanking start signal. The vertical blanking message VBP includes a 4-byte message header (also called a tunnel message header) and a 28-byte message payload (also called a payload, load), totaling 32 bytes.

[0100] For example, referring to the structural diagram of VBP shown in Figure 6, the tunnel message header occupies 4 bytes, the message payload occupies 28 bytes, and a single VBP occupies a total of 32 bytes. The following is an exemplary description of the tunnel message header and message payload of VBP in combination with Table 1 and Table 2.

[0101] Table 1: VBP tunnel header

[0102] The message payload of the VBP includes frame-level control information (VFC), which is used to describe information related to the video of this frame.

[0103] Table 2: VBP message payload

[0104] In conjunction with Table 2, the ALLM field in Table 2 is the automatic low latency field. The ALLM field occupies 1 bit. When the ALLM field value is 1, it indicates that automatic low latency mode is enabled. When the ALLM field value is 0, it indicates that automatic low latency mode is not enabled. If the source device determines that automatic low latency mode needs to be enabled, the source device sets the 1st bit of the ALLM field in the VBP to 1 to instruct the sink device to enable ALLM mode.

[0105] In one possible implementation, the process of the source device transmitting the first VBP and the first video data to the host device specifically includes: the source device transmits a first video frame to the host device, the first video frame includes at least one first VBP and multiple first valid video packets AVP, and the multiple first AVPs are used to carry the first video data.

[0106] In the embodiment of the present application, after the source device (the video and audio transmission adapter in the source device) obtains the video data, it encapsulates the video data into an AVP message. It will be appreciated that for a frame of video data, the video data is encapsulated into multiple AVP messages. Optionally, the source device can send three VBPs to the sink device to ensure the success rate of VBP transmission.

[0107] As can be understood, referring to the block diagram of the audio and video transmission adapter shown in Figure 3 above, after the audio and video transmission adapter in the source device encapsulates the video data into AVP packets, the AVP packets in the source device are combined with other packets through the audio and video stream multiplexer to form a video stream. Other packets include vertical blanking packets (VBP), horizontal blanking packets (HBP), active video packets (AVP), audio sample packets (ASP), and descriptive information packets (DIP). The video stream includes multiple video frames, each of which corresponds to an image of the video.

[0108] Based on the above, it can be seen that in the embodiment of the present application, a video frame includes an AVP that carries video data and also includes a VBP that carries frame-level control information.

[0109] In an embodiment of the present application, VBP is sent in each video frame, and VBP includes a field for automatic low-latency mode. In this way, frame-level control of video data can be achieved to enable automatic low-latency mode for a certain video frame, which is highly flexible.

[0110] The format of a video frame in a video stream is described below in conjunction with FIG7 , which is a schematic diagram of the structure of a video frame provided by the present application. In FIG7 , a video frame includes: a multimedia message and a timing signal.

[0111] Multimedia packets include one or both of Active Video Packets (AVPs) and Audio Sample Packets (ASPs). AVPs are used to transmit video data, while ASPs are used to transmit audio data. As shown in Figure 7, multiple AVPs are arranged in rows within a video frame. Multiple AVPs belonging to the same row constitute a video row.

[0112] It is worth noting that the structure of the video frame in Figure 7 is only an example provided by this application and should not be understood as a limitation of this application. In some possible implementations, a single video frame may also include only one line of AVP message, which is not limited by this application.

[0113] Optionally, when the link bandwidth is greater than the video bandwidth, an ASP can be inserted between two AVPs, but the ASP has a lower priority than the AVP.

[0114] Timing signals include the horizontal synchronization signal (Hsync), the vertical synchronization signal (Vsync), and the display enable (DE) signal. These signals describe the video timing, that is, when which messages or signals should be transmitted. Hsync indicates the start of scanning a row of pixels (e.g., when the row register in the sink device receives a signal of 1), Vsync indicates the start of scanning a video frame, and display enable (DE) indicates whether valid data can be received (e.g., DE = 1 indicates that valid data can be received, and DE = 0 indicates that valid data cannot be received).

[0115] In conjunction with Figure 7, the video timing of the video frame is briefly explained: a video frame includes a vertical blanking area, a horizontal blanking area, and an active video area. In the blanking area, the video frame cannot transmit AVP messages, but can transmit other messages, such as ASP, DIP messages, etc.; in the video active area, the video frame can transmit AVP messages carrying audio and video data. The starting point of Hactive is marked by the horizontal blanking packet (HBP), which indicates the end of the line blanking area. Exemplarily, the audio and video sending adapter in the source device sends HBP for each video line and sends it immediately at the end of Hblank.

[0116] In the video frame shown in FIG7 , the line blanking area of ​​the video frame includes a VBP, which is used to indicate the video line where the rising edge of Vsync (in terms of positive polarity) of a video frame is located. Exemplarily, the audio and video transmission adapter in the source device sends one or more VBPs in each frame (such as three consecutive VBPs in FIG7 ), and ASP and DIP cannot be inserted between VBPs. For example, if Vsync is positive polarity, the audio and video transmission adapter replaces HBP with VBP on the video line where the rising edge of Vsync is located, and sends two more VBPs immediately thereafter; if Vsync is negative polarity, the audio and video transmission adapter replaces HBP with VBP on the video line where the falling edge of Vsync is located, and sends two more VBPs immediately thereafter.

[0117] Referring to the structural diagram of the valid video packet AVP shown in Figure 8, the AVP consists of two parts: a header and a payload (a total of 512 bytes). The length of the header part is 32 bits, and the payload part is used to transmit valid video pixel data (or called video data, or valid data of video, or valid pixels, or valid pixel data, or pixel data of valid video), and its length does not exceed 508 bytes.

[0118] The structure of the header of the valid video packet AVP is shown in Table 3 below.

[0119] Table 3: AVP header

[0120] As shown in Figure 8, each AVP is encapsulated as a 32-bit line, that is, in the payload of the AVP message, each line includes 32 bits of data. If 32 bits (i.e., 4 bytes) is defined as a symbol, then the payload of an AVP includes multiple symbols.

[0121] It will be appreciated that after the audio / video receiving adapter of the sink device receives the video stream, the sink device parses the first video frame (including the first VBP and the first video data) in the video stream to obtain the value of the ALLM field in the VBP and determines whether to enable the automatic low-latency mode. Specifically, if the automatic low-latency field included in the first VBP has a first value (i.e., the value of the ALLM field is 1), the sink device executes S503 below.

[0122] S503: Enable automatic low-latency mode for the first video data.

[0123] Corresponding to the VBP sent by the video sending adapter in the source device, the video receiving adapter in the sink device first performs a CRC check after receiving the VBP. If the check fails, the next VBP is received until the correct VBP is received. That is, the receiving end takes the first accurate VBP received as the basis.

[0124] In one possible implementation, after the sink device enables automatic low-latency mode for the first video data, to implement the automatic low-latency function and reduce the sink device's video display delay, the sink device may choose not to perform video quality enhancement processing on the video data. The video quality enhancement processing includes, but is not limited to, at least one of resolution conversion, noise suppression, contrast enhancement (or dynamic contrast range enhancement), color correction, motion compensation, frame interpolation, video and audio synchronization, and super-resolution processing. It should be understood that performing video quality enhancement processing takes a considerable amount of time.

[0125] In one possible example, the host device does not perform at least one of the following processing on the first video data, including but not limited to: resolution conversion, noise suppression, contrast enhancement, color correction, motion compensation, or interpolation processing. In other words, the host device can choose to turn off one or more processing modules for performing enhanced video quality, for example, the host device turns off the module for resolution conversion. In an embodiment of the present application, after the automatic low-latency mode is turned on, the host device does not need to perform part or all of the post-processing for image quality enhancement. After the host device completes the necessary processing, the video can be displayed quickly, that is, the host device can quickly process video data in the automatic low-latency mode, thereby reducing the display delay of the video.

[0126] In some cases, different manufacturers' devices use different methods for video quality enhancement. Therefore, when sink devices from different manufacturers enable automatic low-latency mode, the processing performed by the sink devices may differ. For example, sink device 1 may perform image quality enhancement using resolution conversion, noise suppression, and contrast enhancement, while sink device 2 may perform image quality enhancement using contrast enhancement, color correction, motion compensation, or frame interpolation. When sink device 1 enables automatic low-latency mode, it disables the resolution conversion and contrast enhancement processing modules. When sink device 2 enables automatic low-latency mode, it disables the contrast enhancement and frame interpolation processing modules.

[0127] In other cases, the video quality enhancement methods used by different device categories from the same manufacturer may be the same. In one possible implementation, different sink devices from the same manufacturer may perform different processing when automatic low-latency mode is enabled. For example, sink device 1 and sink device 2 both include processing modules for resolution conversion, noise suppression, contrast enhancement, color correction, motion compensation, and frame interpolation. However, when sink device 1 enables automatic low-latency mode, the sink device disables the resolution conversion and noise suppression processing modules. When sink device 2 enables automatic low-latency mode, the sink device disables the contrast enhancement and frame interpolation processing modules.

[0128] Optionally, when the sink device enters and exits low-latency mode, the sink device must ensure that the video does not have black screen or distorted screen, the audio does not have abnormalities such as noise and plosive sounds, and the audio and video remain synchronized.

[0129] In summary, in the video transmission method provided in the embodiments of the present application, when the source device queries that the sink device has automatic low latency capability, the source device can carry a field instructing the sink device to enable automatic low latency mode in the vertical blanking message, and send the vertical blanking packet (VBP) and video data to the sink device, so that the sink device enables automatic low latency mode according to the instruction of the automatic low latency field, thereby reducing the display delay of the video on the sink device.

[0130] Furthermore, when the host device supports automatic low latency capability and needs to turn on the automatic low latency mode, this method can more conveniently and dynamically control the turning on of the automatic low latency mode by carrying a field indicating turning on the automatic low latency mode in the VBP, without the need for manual turning on.

[0131] In one possible implementation, the video transmission method provided in the embodiment of the present application can also disable the automatic low-latency mode during the video data transmission process. In conjunction with Figure 5 , as shown in Figure 9 , after the above S503 , the video transmission method provided in the embodiment of the present application further includes S504 - S505 .

[0132] S504: The source device transmits a second vertical blanking packet (VBP) and second video data to the sink device. The second VBP includes an automatic low latency field with a second value, which indicates that the automatic low latency mode is disabled for the second video data. In response, the sink device receives the second VBP and second video data sent by the source device.

[0133] In one possible implementation, the process of the source device transmitting the second VBP and the second video data to the host device specifically includes: the source device transmits a second video frame to the host device, the second video frame includes at least one second VBP and multiple second valid video packets AVP, and the multiple second AVPs are used to carry the second video data.

[0134] After the audio and video receiving adapter of the host device receives the video stream, for the second video frame in the video stream (including the second VBP and the second video data), when the automatic low latency field included in the second VBP is the second value (that is, the value of the ALLM field is 0), the host device executes S505.

[0135] S505: The sink device turns off the automatic low-latency mode for the second video data.

[0136] In conjunction with the description of the sink device enabling automatic low-latency mode in the above embodiments, when the sink device disables automatic low-latency mode, the sink device resumes executing at least one video quality enhancement process that was suspended when automatic low-latency mode was enabled, i.e., re-enables one or more video quality enhancement processing modules. For example, when the sink device enables automatic low-latency mode, the sink device disables the resolution conversion processing module and the contrast enhancement processing module. When the sink device disables automatic low-latency mode, the sink device re-enables the resolution conversion processing module and contrast enhancement, thereby increasing the resolution conversion and contrast enhancement processing of the video data to improve video quality.

[0137] Based on the above content, it can be seen that the source device sends VBP in each video frame. The VBP includes a field for automatic low latency mode. In this way, frame-level control of the video data can be achieved to dynamically turn on or off the automatic low latency mode for the video frame.

[0138] It is understood that in order to implement the functions in the above embodiments, the source device and the sink device include hardware structures and / or software modules corresponding to the execution of each function. Those skilled in the art should readily appreciate that, in combination with the units and method steps of the various examples described in the embodiments disclosed in this application, this application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in hardware or in a manner driven by computer software depends on the specific application scenario and design constraints of the technical solution.

[0139] The video transmission method provided according to the present embodiment is described in detail above with reference to FIG. 1 to FIG. 9 . The video processing device provided according to the present embodiment will be described below with reference to FIG. 10 .

[0140] Figure 10 is a schematic structural diagram of a video processing device provided in an embodiment of the present application. The video device can be used to implement the functions of any one of the devices in the above method embodiments, and therefore can also achieve the beneficial effects possessed by the above method embodiments. In this embodiment, the video processing device can be a set-top box 110, a smart TV 120, or any display device as shown in Figure 1, or a source device 210 or a sink device 220 as shown in Figure 2, or a source device or sink device provided in a subsequent embodiment. It should be understood that the video processing device can also be a module (such as a chip) applied to any of the aforementioned devices.

[0141] As shown in Figure 10, the video processing device includes a transceiver module 1001 and a processing module 1002. Transceiver module 1001 and processing module 1002 can collaboratively implement the various steps in the aforementioned method embodiment. A more detailed description of transceiver module 1001 and processing module 1002 can be directly obtained by referring to the relevant description of the device in the method embodiment shown in the aforementioned figures, and is not repeated here.

[0142] When a video processing device implements any of the video transmission methods shown in the aforementioned figures through software, the video processing device and its various units may also be software modules. The aforementioned video transmission method is implemented by a processor calling the software module. The processor may be a central processing unit (CPU), an application-specific integrated circuit (ASIC), or a programmable logic device (PLD). The PLD may be a complex programmable logical device (CPLD), a field programmable gate array (FPGA), a generic array logic (GAL), or any combination thereof.

[0143] It can be understood that the video processing device shown in FIG10 is only an example provided in this embodiment. The video processing device may include more or fewer units according to different video transmission processes, and this application does not limit this.

[0144] When the video processing device is implemented via hardware, the hardware may be implemented via a processor or a chip system. The chip system includes one or more chips, each of which includes an interface circuit and a control circuit. The interface circuit is used to receive data from other devices outside the chip and transmit it to the control circuit, or to send data from the control circuit to other devices outside the chip. The control circuit and the interface circuit are used to implement any possible implementation method of the above embodiments through logic circuits or execution code instructions. The beneficial effects can be found in the description of any aspect of the above embodiments and will not be repeated here.

[0145] It is understood that the processor in the embodiments of the present application may be a CPU, or other general-purpose processor, digital signal processor (DSP), ASIC, FPGA or other programmable logic device, transistor logic device, hardware component or any combination thereof. The general-purpose processor may be a microprocessor or any conventional processor.

[0146] The video processing apparatus shown in FIG10 may also be implemented by a video processing device. FIG11 is a schematic structural diagram of the video processing device provided in this application. The video processing device includes: a memory 1101 and at least one processor 1102. The processor 1102 may implement the video transmission method provided in the above embodiment. The memory 1101 is used to store software instructions corresponding to the above video transmission method.

[0147] As an optional implementation, in hardware implementation, the video processing device may refer to a chip or chip system encapsulated with one or more processors 1102. For example, when the video processing device is used to implement the method steps in the above embodiment, the processor 1102 included in the video processing device executes the steps of the source device in the above method and its possible sub-steps. In an optional scenario, the video processing device may also include a communication interface 1103, which can be used to send and receive data. For example, the communication interface 1103 is used to receive audio and video data, or to send audio and video streams, etc.; the communication interface 1103 can be implemented by the interface circuit included in the video processing device. Therefore, in some examples, the communication interface 1103 can also be called a transceiver of the video processing device. In this embodiment, the communication interface 1103 supports the use of a unified multimedia internet network.

[0148] In an embodiment of the present application, the communication interface 1103, the processor 1102, and the memory 1101 may be connected via a bus 1104, which may be divided into an address bus, a data bus, a control bus, etc. The bus 1104 may be a Peripheral Component Interconnect Express (PCIe) bus, an extended industry standard architecture (EISA) bus, a unified bus (Ubus or UB), a compute express link (CXL), a cache coherent interconnect for accelerators (CCIX), or other types of buses.

[0149] It is worth noting that the video processing device can also perform the functions of the video processing apparatus shown in FIG10 , which will not be described in detail here.

[0150] The video processing device provided in this embodiment may be the set-top box 110, smart TV 120, source device 210, or other devices with video processing capabilities, and this application is not limited thereto. For example, when the aforementioned display device also has a video processing function, the video processing device may refer to any of the aforementioned display devices.

[0151] In addition, the video processing device shown in FIG10 can also be implemented by a display device. When the video processing device is implemented by a display device, this embodiment provides a possible example, as shown in FIG12, which is a schematic diagram of the structure of the display device provided by the present application. The display device includes: a processor 310, an external memory interface 320, an internal memory 321, a universal serial bus (USB) interface 330, a unified multimedia interconnection interface 331, an antenna 1, an antenna 2, a mobile communication module 350, a wireless communication module 360, an audio module 370, a speaker 370A, a receiver 370B, a microphone 370C, a sensor module 380, a button 390, an indicator 392, a camera 393, a display screen 394, a subscriber identification module (SIM) card interface 1-N 395, etc.

[0152] Among them, the above-mentioned sensor module 380 may include sensors such as pressure sensor, gyroscope sensor, air pressure sensor, magnetic sensor, acceleration sensor, distance sensor, proximity light sensor, fingerprint sensor, temperature sensor, touch sensor, ambient light sensor and bone conduction sensor.

[0153] It should be understood that the structure illustrated in this embodiment does not constitute a specific limitation on the display device. In other embodiments, the display device may include more or fewer components than shown, or may combine or separate certain components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0154] The processor 310 may include one or more processing units. For example, the processor 310 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0155] The controller can be the nerve center and command center of the display device. The controller can generate operation control signals based on instruction opcodes and timing signals to complete the control of instruction fetching and execution.

[0156] Processor 310 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 310 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 310. If processor 310 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 310 latency, and thus improves system efficiency.

[0157] In some embodiments, the processor 310 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a USB interface, a unified multimedia interconnect interface, etc.

[0158] It is understood that the interface connection relationship between the modules illustrated in this embodiment is only for illustrative purposes and does not constitute a structural limitation on the display device. In other embodiments, the display device may also adopt different interface connection methods from the above embodiments, or a combination of multiple interface connection methods.

[0159] The wireless communication function of the display device can be implemented through antenna 1, antenna 2, mobile communication module 350, wireless communication module 360, a modem processor, and a baseband processor. In some embodiments, antenna 1 of the display device is coupled to mobile communication module 350, and antenna 2 is coupled to wireless communication module 360, so that the display device can communicate with the network and other devices through wireless communication technology.

[0160] The wired communication function of the display device can be implemented through the USB interface 330 or the unified multimedia interconnection interface 331. For example, the display device receives or sends video streams and AVP messages through the bus connected to the unified multimedia interconnection interface 331.

[0161] The display device implements display functions through a GPU, display screen 394, and an application processor. The GPU is a microprocessor for image processing that connects display screen 394 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 310 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0162] The display screen 394 is used to display images, videos, etc. The display screen 394 includes a display panel.

[0163] The display device can implement a camera function through an ISP, a camera 393, a video codec, a GPU, a display 394, and an application processor. The ISP processes data fed back by the camera 393. The camera 393 is used to capture still images or videos. In some embodiments, the display device may include one or N cameras 393, where N is a positive integer greater than 1.

[0164] In this embodiment, the above display screen 394, video codec, GPU, display screen 394 and application processor can also be collectively referred to as a display unit of the host device, which is used to process and display the received video stream.

[0165] External memory interface 320 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the display device. The external memory card communicates with processor 310 via external memory interface 320 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.

[0166] The internal memory 321 can be used to store computer executable program code, which includes instructions. The processor 310 executes various functional applications and data processing of the display device by running the instructions stored in the internal memory 321. For example, in an embodiment of the present application, the processor 310 can execute instructions stored in the internal memory 321, and the internal memory 321 can include a program storage area and a data storage area.

[0167] The program storage area can store an operating system and at least one application required for a function (such as a sound playback function, an image playback function, etc.). The data storage area can store data created during the use of the display device (such as audio and video data, a phone book, etc.). In addition, the internal memory 321 can include high-speed random access memory and non-volatile memory, such as at least one disk storage device, a flash memory device, or a universal flash storage (UFS).

[0168] The display device can implement audio functions such as music playback and recording through the audio module 370, the speaker 370A, the receiver 370B, the microphone 370C, and the application processor.

[0169] Buttons 390 include a power button, a volume button, and the like. Buttons 390 may be mechanical buttons or touch buttons. Indicator 392 may be an indicator light that can be used to indicate charging status, battery level changes, messages, missed calls, notifications, and the like.

[0170] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware, or any combination thereof. When implemented using a software program, all or part of the embodiments may be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer instructions are loaded and executed on a computer, all or part of the processes or functions in accordance with the embodiments of the present application are generated. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated therein. The available medium may be a magnetic medium (eg, a floppy disk, a magnetic disk, a magnetic tape), an optical medium (eg, a digital video disc (DVD)), or a semiconductor medium (eg, a solid state drive (SSD)).

[0171] Through the description of the above embodiments, those skilled in the art will clearly understand that for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. The specific working processes of the above-described systems, devices, and units can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0172] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0173] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0174] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0175] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) or a processor to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as flash memory, mobile hard disk, read-only memory, random access memory, magnetic disk or optical disk.

[0176] The above is only a specific embodiment of the present application, but the scope of protection of this application is not limited to this. Any changes or substitutions within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A video transmission method, characterized in that, applied to a source device or a chip in the source device, the method includes: querying the capabilities of a destination device; when the destination device has the automatic low-latency capability, transmitting a first vertical blanking packet (VBP) and first video data to the destination device; the automatic low-latency field included in the first VBP is a first value, and the first value is used to indicate to enable the automatic low-latency mode for the first video data.

2. The method according to claim 1, characterized in that, the method further includes: transmitting a second vertical blanking packet (VBP) and second video data to the destination device; the automatic low-latency field included in the second VBP is a second value, and the second value is used to indicate to disable the automatic low-latency mode for the second video data.

3. The method according to claim 1 or 2, characterized in that, transmitting the first VBP and the first video data to the destination device includes: transmitting a first video frame to the destination device, the first video frame includes at least one of the first VBPs and a plurality of first valid video packets (AVPs), and the plurality of first AVPs are used to carry the first video data.

4. The method according to claim 2 or 3, characterized in that, transmitting the second VBP and the second video data to the destination device includes: transmitting a second video frame to the destination device, the second video frame includes at least one of the second VBPs and a plurality of second valid video packets (AVPs), and the plurality of second AVPs are used to carry the second video data.

5. A video transmission method, characterized in that, applied to a destination device or a chip in the destination device, the method includes: receiving a first vertical blanking packet (VBP) and first video data sent by a source device; when the automatic low-latency field included in the first VBP is the first value, enabling the automatic low-latency mode for the first video data.

6. The method according to claim 5, characterized in that, the method further includes: receiving a second vertical blanking packet (VBP) and second video data sent by the source device; when the automatic low-latency field included in the second VBP is the second value, disabling the automatic low-latency mode for the second video data.

7. The method according to claim 5 or 6, characterized in that, receiving the first vertical blanking packet (VBP) and the first video data sent by the source device includes: receiving the first video frame sent by the source device, the first video frame includes at least one of the first VBPs and a plurality of first valid video packets (AVPs), and the plurality of first AVPs are used to carry the first video data.

8. The method according to claim 6 or 7, characterized in that, receiving the second vertical blanking packet (VBP) and the second video data sent by the source device includes: receiving the second video frame sent by the source device, the second video frame includes at least one of the second VBPs and a plurality of second valid video packets (AVPs), and the plurality of second AVPs are used to carry the second video data.

9. A video processing device, characterized in that, comprising: A memory, a transceiver, and a processor; the memory, the transceiver, and the processor are used to jointly execute the method according to any one of claims 1 to 4.

10. A host device, characterized in that it comprises: a transceiver and a processing unit; the transceiver and the display unit are used to jointly execute the method according to any one of claims 5 to 8.

11. A computer-readable storage medium, characterized in that it stores computer instructions which, when running on a computing device, execute the method according to any one of claims 1 to 4 or any one of claims 5 to 8.

Images